2024-09-17T02:58:10.238 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T02:58:10.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T02:58:10.361 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908403 branch: wip-pdonnell-testing-20240916.200549-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/multimds_misc} email: pdonnell@redhat.com first_in_suite: false job_id: '7908403' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240916.200549-debug ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - Scrub error on inode sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240916.200549-debug sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 476 sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf sleep_before_teardown: 0 subset: 320/512 suite: fs suite_branch: wip-pdonnell-testing-20240916.200549-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKidAJ8ZGrB/2azLewnAOM0pFWzXIvn7vN0d5x3fotxFn2zJjWAFJxhD5x4Mlpv1TeCeMEdSmv/Eogq9MqN3VWk= smithi193.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJM7ci1bXLNmRhbYA0XJhxBSeEPoCBajjC1mkkYLW02zKudBG4/fXbX1TSQPNn2IZNa3Q6to5SVwlEHG+zNSntg= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_multimds_misc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_02:09:51 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T02:58:10.362 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa; will attempt to use it 2024-09-17T02:58:10.362 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa/tasks 2024-09-17T02:58:10.363 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T02:58:10.364 INFO:teuthology.task.internal:Checking packages... 2024-09-17T02:58:10.388 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf' 2024-09-17T02:58:10.388 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T02:58:10.388 INFO:teuthology.packaging:ref: None 2024-09-17T02:58:10.388 INFO:teuthology.packaging:tag: None 2024-09-17T02:58:10.389 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240916.200549-debug 2024-09-17T02:58:10.389 INFO:teuthology.packaging:sha1: ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T02:58:10.389 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240916.200549-debug 2024-09-17T02:58:10.533 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4989.gce1b342b 2024-09-17T02:58:10.535 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T02:58:10.542 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T02:58:10.542 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T02:58:10.552 INFO:teuthology.task.internal:Saving configuration 2024-09-17T02:58:10.568 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T02:58:10.576 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T02:58:10.599 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908403', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 02:53:12.233537', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKidAJ8ZGrB/2azLewnAOM0pFWzXIvn7vN0d5x3fotxFn2zJjWAFJxhD5x4Mlpv1TeCeMEdSmv/Eogq9MqN3VWk='} 2024-09-17T02:58:10.618 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908403', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 02:53:12.232115', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJM7ci1bXLNmRhbYA0XJhxBSeEPoCBajjC1mkkYLW02zKudBG4/fXbX1TSQPNn2IZNa3Q6to5SVwlEHG+zNSntg='} 2024-09-17T02:58:10.618 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T02:58:10.625 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-17T02:58:10.625 INFO:teuthology.task.internal:roles: ubuntu@smithi193.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-17T02:58:10.625 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T02:58:10.677 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc4fd807ac0>, signals=[15]) 2024-09-17T02:58:10.677 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T02:58:10.683 INFO:teuthology.task.internal:Opening connections... 2024-09-17T02:58:10.683 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T02:58:10.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:58:10.761 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi193.front.sepia.ceph.com 2024-09-17T02:58:10.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T02:58:10.839 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T02:58:10.845 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2024-09-17T02:58:10.863 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2024-09-17T02:58:10.863 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2024-09-17T02:58:10.919 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream" 2024-09-17T02:58:10.920 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="9" 2024-09-17T02:58:10.920 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2024-09-17T02:58:10.920 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2024-09-17T02:58:10.920 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="9" 2024-09-17T02:58:10.920 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el9" 2024-09-17T02:58:10.920 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T02:58:10.920 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2024-09-17T02:58:10.920 INFO:teuthology.orchestra.run.smithi078.stdout:LOGO="fedora-logo-icon" 2024-09-17T02:58:10.920 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T02:58:10.920 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/" 2024-09-17T02:58:10.920 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T02:58:10.920 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T02:58:10.921 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T02:58:10.921 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2024-09-17T02:58:10.947 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2024-09-17T02:58:10.965 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2024-09-17T02:58:10.966 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2024-09-17T02:58:11.024 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2024-09-17T02:58:11.024 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="9" 2024-09-17T02:58:11.024 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2024-09-17T02:58:11.024 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2024-09-17T02:58:11.024 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="9" 2024-09-17T02:58:11.024 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el9" 2024-09-17T02:58:11.024 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T02:58:11.024 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2024-09-17T02:58:11.024 INFO:teuthology.orchestra.run.smithi193.stdout:LOGO="fedora-logo-icon" 2024-09-17T02:58:11.025 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T02:58:11.025 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2024-09-17T02:58:11.025 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T02:58:11.025 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T02:58:11.025 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T02:58:11.025 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2024-09-17T02:58:11.047 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T02:58:11.056 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T02:58:11.085 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T02:58:11.086 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2024-09-17T02:58:11.088 DEBUG:teuthology.orchestra.run.smithi193:> test '!' -e /home/ubuntu/cephtest 2024-09-17T02:58:11.105 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T02:58:11.111 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T02:58:11.111 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2024-09-17T02:58:11.144 DEBUG:teuthology.orchestra.run.smithi193:> test -z $(ls -A /var/lib/ceph) 2024-09-17T02:58:11.174 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T02:58:11.218 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T02:58:11.233 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-17T02:58:11.234 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-17T02:58:11.234 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-17T02:58:11.234 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T02:58:11.235 DEBUG:teuthology.orchestra.run.smithi193:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T02:58:11.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:58:11.252 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-09-17T02:58:11.253 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T02:58:11.253 DEBUG:teuthology.orchestra.run.smithi193:> uname -r 2024-09-17T02:58:11.311 INFO:teuthology.orchestra.run.smithi078.stdout:5.14.0-503.el9.x86_64 2024-09-17T02:58:11.311 INFO:teuthology.task.kernel:Running kernel on smithi078: 5.14.0-503.el9.x86_64 2024-09-17T02:58:11.311 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum install -y kernel 2024-09-17T02:58:11.312 INFO:teuthology.orchestra.run.smithi193.stdout:5.14.0-503.el9.x86_64 2024-09-17T02:58:11.312 INFO:teuthology.task.kernel:Running kernel on smithi193: 5.14.0-503.el9.x86_64 2024-09-17T02:58:11.312 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum install -y kernel 2024-09-17T02:58:14.001 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - BaseOS 9.0 MB/s | 8.3 MB 00:00 2024-09-17T02:58:14.841 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.3 MB 00:01 2024-09-17T02:58:19.501 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - AppStream 5.7 MB/s | 20 MB 00:03 2024-09-17T02:58:23.118 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - AppStream 2.5 MB/s | 20 MB 00:08 2024-09-17T02:58:23.660 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-17T02:58:25.060 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - Extras packages 110 kB/s | 19 kB 00:00 2024-09-17T02:58:25.956 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-17T02:58:28.596 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-17T02:58:30.244 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-17T02:58:31.429 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-17T02:58:31.456 INFO:teuthology.orchestra.run.smithi193.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-17T02:58:33.360 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T02:58:33.361 INFO:teuthology.orchestra.run.smithi078.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T02:58:33.447 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-17T02:58:33.458 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-17T02:58:33.459 INFO:teuthology.orchestra.run.smithi078.stdout: Package Architecture Version Repository Size 2024-09-17T02:58:33.459 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-17T02:58:33.459 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-17T02:58:33.459 INFO:teuthology.orchestra.run.smithi078.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T02:58:33.459 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-09-17T02:58:33.459 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T02:58:33.459 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T02:58:33.459 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T02:58:33.459 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T02:58:33.459 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-17T02:58:33.459 INFO:teuthology.orchestra.run.smithi078.stdout:================================================================================ 2024-09-17T02:58:33.460 INFO:teuthology.orchestra.run.smithi078.stdout:Install 4 Packages 2024-09-17T02:58:33.460 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T02:58:33.460 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 79 M 2024-09-17T02:58:33.460 INFO:teuthology.orchestra.run.smithi078.stdout:Installed size: 126 M 2024-09-17T02:58:33.460 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-17T02:58:33.647 INFO:teuthology.orchestra.run.smithi078.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 523 kB/s | 36 kB 00:00 2024-09-17T02:58:34.414 INFO:teuthology.orchestra.run.smithi078.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-17T02:58:34.756 INFO:teuthology.orchestra.run.smithi078.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 29 MB/s | 35 MB 00:01 2024-09-17T02:58:35.090 INFO:teuthology.orchestra.run.smithi078.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 20 MB/s | 29 MB 00:01 2024-09-17T02:58:35.090 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-17T02:58:35.090 INFO:teuthology.orchestra.run.smithi078.stdout:Total 48 MB/s | 79 MB 00:01 2024-09-17T02:58:35.776 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-17T02:58:36.118 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-17T02:58:36.119 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-17T02:58:36.829 INFO:teuthology.orchestra.run.smithi193.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-17T02:58:37.092 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-17T02:58:37.093 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-17T02:58:38.652 INFO:teuthology.orchestra.run.smithi193.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T02:58:38.652 INFO:teuthology.orchestra.run.smithi193.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T02:58:38.753 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-17T02:58:38.763 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-17T02:58:38.763 INFO:teuthology.orchestra.run.smithi193.stdout: Package Architecture Version Repository Size 2024-09-17T02:58:38.763 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-17T02:58:38.764 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-09-17T02:58:38.764 INFO:teuthology.orchestra.run.smithi193.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T02:58:38.764 INFO:teuthology.orchestra.run.smithi193.stdout:Installing dependencies: 2024-09-17T02:58:38.764 INFO:teuthology.orchestra.run.smithi193.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T02:58:38.764 INFO:teuthology.orchestra.run.smithi193.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T02:58:38.764 INFO:teuthology.orchestra.run.smithi193.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T02:58:38.764 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T02:58:38.764 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-17T02:58:38.764 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-09-17T02:58:38.764 INFO:teuthology.orchestra.run.smithi193.stdout:Install 4 Packages 2024-09-17T02:58:38.764 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T02:58:38.765 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 79 M 2024-09-17T02:58:38.765 INFO:teuthology.orchestra.run.smithi193.stdout:Installed size: 126 M 2024-09-17T02:58:38.765 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-17T02:58:39.039 INFO:teuthology.orchestra.run.smithi193.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 238 kB/s | 36 kB 00:00 2024-09-17T02:58:39.525 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-17T02:58:40.272 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T02:58:40.357 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T02:58:43.118 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T02:58:43.253 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T02:58:46.554 INFO:teuthology.orchestra.run.smithi193.stdout:(2/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 4.5 MB/s | 35 MB 00:07 2024-09-17T02:58:46.705 INFO:teuthology.orchestra.run.smithi193.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 2.0 MB/s | 16 MB 00:07 2024-09-17T02:58:48.091 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T02:58:48.362 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:58:52.463 INFO:teuthology.orchestra.run.smithi193.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 2.1 MB/s | 29 MB 00:13 2024-09-17T02:58:52.463 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-17T02:58:52.463 INFO:teuthology.orchestra.run.smithi193.stdout:Total 5.8 MB/s | 79 MB 00:13 2024-09-17T02:58:53.141 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-17T02:58:53.220 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:58:53.487 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-17T02:58:53.487 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-17T02:58:54.458 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-17T02:58:54.458 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-17T02:58:56.894 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-17T02:58:57.648 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T02:58:57.737 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T02:59:00.472 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T02:59:00.616 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T02:59:05.471 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T02:59:05.565 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:59:10.402 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:59:31.609 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:59:31.655 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:59:32.039 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:59:32.039 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T02:59:32.040 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T02:59:32.040 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T02:59:32.891 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:59:32.891 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T02:59:32.892 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-17T02:59:32.892 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T02:59:32.892 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T02:59:32.892 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T02:59:32.892 INFO:teuthology.orchestra.run.smithi078.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T02:59:32.892 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T02:59:32.892 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-17T02:59:33.258 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T02:59:33.334 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T02:59:33.334 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T02:59:33.334 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T02:59:33.334 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T02:59:33.335 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T02:59:33.335 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-17T02:59:33.335 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi078.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T02:59:33.335 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T02:59:33.393 INFO:teuthology.orchestra.run.smithi078.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T02:59:33.394 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T02:59:33.394 DEBUG:teuthology.orchestra.run.smithi078:> sudo rpm -qi grub2-tools 2024-09-17T02:59:33.426 INFO:teuthology.orchestra.run.smithi078.stdout:Name : grub2-tools 2024-09-17T02:59:33.426 INFO:teuthology.orchestra.run.smithi078.stdout:Epoch : 1 2024-09-17T02:59:33.426 INFO:teuthology.orchestra.run.smithi078.stdout:Version : 2.06 2024-09-17T02:59:33.426 INFO:teuthology.orchestra.run.smithi078.stdout:Release : 82.el9 2024-09-17T02:59:33.426 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: x86_64 2024-09-17T02:59:33.426 INFO:teuthology.orchestra.run.smithi078.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T02:59:33.426 INFO:teuthology.orchestra.run.smithi078.stdout:Group : Unspecified 2024-09-17T02:59:33.427 INFO:teuthology.orchestra.run.smithi078.stdout:Size : 8274670 2024-09-17T02:59:33.427 INFO:teuthology.orchestra.run.smithi078.stdout:License : GPLv3+ 2024-09-17T02:59:33.427 INFO:teuthology.orchestra.run.smithi078.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T02:59:33.427 INFO:teuthology.orchestra.run.smithi078.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T02:59:33.427 INFO:teuthology.orchestra.run.smithi078.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T02:59:33.427 INFO:teuthology.orchestra.run.smithi078.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T02:59:33.427 INFO:teuthology.orchestra.run.smithi078.stdout:Packager : builder@centos.org 2024-09-17T02:59:33.427 INFO:teuthology.orchestra.run.smithi078.stdout:Vendor : CentOS 2024-09-17T02:59:33.427 INFO:teuthology.orchestra.run.smithi078.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T02:59:33.427 INFO:teuthology.orchestra.run.smithi078.stdout:Summary : Support tools for GRUB. 2024-09-17T02:59:33.427 INFO:teuthology.orchestra.run.smithi078.stdout:Description : 2024-09-17T02:59:33.427 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T02:59:33.428 INFO:teuthology.orchestra.run.smithi078.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T02:59:33.428 INFO:teuthology.orchestra.run.smithi078.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T02:59:33.428 INFO:teuthology.orchestra.run.smithi078.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T02:59:33.428 INFO:teuthology.orchestra.run.smithi078.stdout:hardware devices. 2024-09-17T02:59:33.428 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T02:59:33.428 INFO:teuthology.orchestra.run.smithi078.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T02:59:33.429 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T02:59:33.429 INFO:teuthology.task.kernel:Updating grub on smithi078 to boot 5.14.0-508.el9.x86_64 2024-09-17T02:59:33.429 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T02:59:34.121 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2024-09-17T02:59:35.446 INFO:teuthology.orchestra.run.smithi078.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T02:59:35.471 INFO:teuthology.orchestra.run.smithi078.stderr:done 2024-09-17T02:59:35.473 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-09-17T02:59:35.489 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.CSan5iw0FS 2024-09-17T02:59:35.489 DEBUG:teuthology.orchestra.run.smithi078:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.CSan5iw0FS 2024-09-17T02:59:35.556 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.CSan5iw0FS 2024-09-17T02:59:35.701 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.CSan5iw0FS is 6KB 2024-09-17T02:59:35.750 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.CSan5iw0FS 2024-09-17T02:59:35.765 DEBUG:teuthology.orchestra.run.smithi078:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T02:59:35.827 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T02:59:35.827 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T02:59:35.828 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T02:59:35.828 INFO:teuthology.orchestra.run.smithi078.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T02:59:35.829 DEBUG:teuthology.orchestra.run.smithi078:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T02:59:35.986 DEBUG:teuthology.orchestra.run.smithi078:> sudo shutdown -r now 2024-09-17T02:59:48.694 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:59:48.741 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:59:49.075 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:59:49.075 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T02:59:49.075 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T02:59:49.075 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T02:59:49.926 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T02:59:49.926 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T02:59:49.926 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-09-17T02:59:49.927 INFO:teuthology.orchestra.run.smithi193.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T02:59:49.927 INFO:teuthology.orchestra.run.smithi193.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T02:59:49.927 INFO:teuthology.orchestra.run.smithi193.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T02:59:49.927 INFO:teuthology.orchestra.run.smithi193.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T02:59:49.927 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T02:59:49.927 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-17T02:59:50.275 DEBUG:teuthology.orchestra.run.smithi193:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T02:59:50.359 INFO:teuthology.orchestra.run.smithi193.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T02:59:50.359 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T02:59:50.359 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T02:59:50.359 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T02:59:50.359 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T02:59:50.360 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-17T02:59:50.360 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi193.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T02:59:50.360 DEBUG:teuthology.orchestra.run.smithi193:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T02:59:50.418 INFO:teuthology.orchestra.run.smithi193.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T02:59:50.419 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T02:59:50.419 DEBUG:teuthology.orchestra.run.smithi193:> sudo rpm -qi grub2-tools 2024-09-17T02:59:50.450 INFO:teuthology.orchestra.run.smithi193.stdout:Name : grub2-tools 2024-09-17T02:59:50.450 INFO:teuthology.orchestra.run.smithi193.stdout:Epoch : 1 2024-09-17T02:59:50.450 INFO:teuthology.orchestra.run.smithi193.stdout:Version : 2.06 2024-09-17T02:59:50.450 INFO:teuthology.orchestra.run.smithi193.stdout:Release : 82.el9 2024-09-17T02:59:50.451 INFO:teuthology.orchestra.run.smithi193.stdout:Architecture: x86_64 2024-09-17T02:59:50.451 INFO:teuthology.orchestra.run.smithi193.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T02:59:50.451 INFO:teuthology.orchestra.run.smithi193.stdout:Group : Unspecified 2024-09-17T02:59:50.451 INFO:teuthology.orchestra.run.smithi193.stdout:Size : 8274670 2024-09-17T02:59:50.451 INFO:teuthology.orchestra.run.smithi193.stdout:License : GPLv3+ 2024-09-17T02:59:50.451 INFO:teuthology.orchestra.run.smithi193.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T02:59:50.451 INFO:teuthology.orchestra.run.smithi193.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T02:59:50.451 INFO:teuthology.orchestra.run.smithi193.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T02:59:50.451 INFO:teuthology.orchestra.run.smithi193.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T02:59:50.451 INFO:teuthology.orchestra.run.smithi193.stdout:Packager : builder@centos.org 2024-09-17T02:59:50.451 INFO:teuthology.orchestra.run.smithi193.stdout:Vendor : CentOS 2024-09-17T02:59:50.451 INFO:teuthology.orchestra.run.smithi193.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T02:59:50.452 INFO:teuthology.orchestra.run.smithi193.stdout:Summary : Support tools for GRUB. 2024-09-17T02:59:50.452 INFO:teuthology.orchestra.run.smithi193.stdout:Description : 2024-09-17T02:59:50.452 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T02:59:50.452 INFO:teuthology.orchestra.run.smithi193.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T02:59:50.452 INFO:teuthology.orchestra.run.smithi193.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T02:59:50.452 INFO:teuthology.orchestra.run.smithi193.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T02:59:50.452 INFO:teuthology.orchestra.run.smithi193.stdout:hardware devices. 2024-09-17T02:59:50.452 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T02:59:50.452 INFO:teuthology.orchestra.run.smithi193.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T02:59:50.453 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T02:59:50.453 INFO:teuthology.task.kernel:Updating grub on smithi193 to boot 5.14.0-508.el9.x86_64 2024-09-17T02:59:50.453 DEBUG:teuthology.orchestra.run.smithi193:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T02:59:51.110 INFO:teuthology.orchestra.run.smithi193.stderr:Generating grub configuration file ... 2024-09-17T02:59:52.428 INFO:teuthology.orchestra.run.smithi193.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T02:59:52.455 INFO:teuthology.orchestra.run.smithi193.stderr:done 2024-09-17T02:59:52.457 DEBUG:teuthology.orchestra.run.smithi193:> mktemp 2024-09-17T02:59:52.473 INFO:teuthology.orchestra.run.smithi193.stdout:/tmp/tmp.FAZREd6BKq 2024-09-17T02:59:52.473 DEBUG:teuthology.orchestra.run.smithi193:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.FAZREd6BKq 2024-09-17T02:59:52.540 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 0666 /tmp/tmp.FAZREd6BKq 2024-09-17T02:59:52.676 DEBUG:teuthology.orchestra.remote:smithi193:/tmp/tmp.FAZREd6BKq is 6KB 2024-09-17T02:59:52.725 DEBUG:teuthology.orchestra.run.smithi193:> rm -fr /tmp/tmp.FAZREd6BKq 2024-09-17T02:59:52.740 DEBUG:teuthology.orchestra.run.smithi193:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T02:59:52.802 INFO:teuthology.orchestra.run.smithi193.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T02:59:52.802 INFO:teuthology.orchestra.run.smithi193.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T02:59:52.802 INFO:teuthology.orchestra.run.smithi193.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T02:59:52.802 INFO:teuthology.orchestra.run.smithi193.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T02:59:52.804 DEBUG:teuthology.orchestra.run.smithi193:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T02:59:52.957 DEBUG:teuthology.orchestra.run.smithi193:> sudo shutdown -r now 2024-09-17T03:00:06.002 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-17T03:00:06.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-17T03:00:06.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:00:22.968 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-17T03:00:22.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-09-17T03:00:22.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:00:24.513 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-09-17T03:00:33.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-17T03:00:33.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:00:36.605 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-09-17T03:00:41.405 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-09-17T03:00:48.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-17T03:00:48.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:00:50.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-09-17T03:00:50.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:00:53.473 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.193 2024-09-17T03:01:05.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-09-17T03:01:05.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:01:20.472 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-09-17T03:01:20.809 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-17T03:01:20.809 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-17T03:01:20.809 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-09-17T03:01:20.824 INFO:teuthology.orchestra.run.smithi078.stdout:5.14.0-508.el9.x86_64 2024-09-17T03:01:20.824 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T03:01:20.824 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T03:01:20.824 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T03:01:21.825 DEBUG:teuthology.parallel:result is None 2024-09-17T03:01:37.331 DEBUG:teuthology.orchestra.run.smithi193:> true 2024-09-17T03:01:37.833 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-09-17T03:01:37.833 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-508.el9.x86_64"... 2024-09-17T03:01:37.833 DEBUG:teuthology.orchestra.run.smithi193:> uname -r 2024-09-17T03:01:37.847 INFO:teuthology.orchestra.run.smithi193.stdout:5.14.0-508.el9.x86_64 2024-09-17T03:01:37.848 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T03:01:37.848 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T03:01:37.848 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T03:01:38.849 DEBUG:teuthology.parallel:result is None 2024-09-17T03:01:38.850 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T03:01:38.857 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T03:01:38.857 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T03:01:38.860 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T03:01:38.876 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T03:01:38.887 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T03:01:38.895 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T03:01:38.895 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T03:01:38.919 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T03:01:38.944 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T03:01:38.952 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T03:01:38.952 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T03:01:38.982 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T03:01:39.049 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T03:01:39.073 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T03:01:39.089 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T03:01:39.094 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T03:01:39.096 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T03:01:39.104 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T03:01:39.104 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T03:01:39.107 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T03:01:39.133 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T03:01:39.144 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T03:01:39.144 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T03:01:39.176 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T03:01:39.190 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T03:01:39.273 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T03:01:39.321 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T03:01:39.404 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T03:01:39.445 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:01:39.445 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T03:01:39.511 DEBUG:teuthology.orchestra.run.smithi193:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T03:01:39.550 DEBUG:teuthology.orchestra.run.smithi193:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T03:01:39.603 DEBUG:teuthology.orchestra.run.smithi193:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T03:01:39.686 DEBUG:teuthology.orchestra.run.smithi193:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T03:01:39.724 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:01:39.725 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T03:01:39.789 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2024-09-17T03:01:39.791 DEBUG:teuthology.orchestra.run.smithi193:> sudo service rsyslog restart 2024-09-17T03:01:39.835 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T03:01:39.882 INFO:teuthology.orchestra.run.smithi193.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T03:01:40.384 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T03:01:40.393 INFO:teuthology.task.internal:Starting timer... 2024-09-17T03:01:40.393 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T03:01:40.410 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T03:01:40.421 DEBUG:teuthology.orchestra.run.smithi078:> sudo service auditd rotate 2024-09-17T03:01:40.475 INFO:teuthology.orchestra.run.smithi078.stdout:Rotating logs: 2024-09-17T03:01:40.477 DEBUG:teuthology.orchestra.run.smithi193:> sudo service auditd rotate 2024-09-17T03:01:40.529 INFO:teuthology.orchestra.run.smithi193.stdout:Rotating logs: 2024-09-17T03:01:40.531 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T03:01:40.531 DEBUG:teuthology.orchestra.run.smithi078:> /usr/sbin/getenforce 2024-09-17T03:01:40.553 INFO:teuthology.orchestra.run.smithi078.stdout:Permissive 2024-09-17T03:01:40.553 DEBUG:teuthology.orchestra.run.smithi193:> /usr/sbin/getenforce 2024-09-17T03:01:40.584 INFO:teuthology.orchestra.run.smithi193.stdout:Permissive 2024-09-17T03:01:40.584 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi078.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi193.front.sepia.ceph.com': 'permissive'} 2024-09-17T03:01:40.584 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T03:01:40.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:01:40.621 DEBUG:teuthology.orchestra.run.smithi193:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T03:01:40.650 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:01:40.650 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T03:01:40.650 DEBUG:teuthology.orchestra.run.smithi078:> sudo /usr/sbin/setenforce permissive 2024-09-17T03:01:40.701 DEBUG:teuthology.orchestra.run.smithi193:> sudo /usr/sbin/setenforce permissive 2024-09-17T03:01:40.734 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T03:01:40.748 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-17T03:01:40.752 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-17T03:01:40.924 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T03:01:40.935 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T03:01:40.936 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi078.front.sepia.ceph.com,smithi193.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T03:05:27.558 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi078.front.sepia.ceph.com'), Remote(name='ubuntu@smithi193.front.sepia.ceph.com')] 2024-09-17T03:05:27.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-17T03:05:27.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:05:27.649 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-09-17T03:05:27.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-17T03:05:27.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-09-17T03:05:27.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T03:05:27.821 DEBUG:teuthology.orchestra.run.smithi193:> true 2024-09-17T03:05:27.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-09-17T03:05:27.903 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T03:05:27.915 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T03:05:27.915 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T03:05:27.916 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T03:05:27.918 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T03:05:27.918 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T03:05:27.950 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T03:05:27.966 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T03:05:27.971 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T03:05:27.986 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T03:05:27.992 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: ntpd: command not found 2024-09-17T03:05:28.004 INFO:teuthology.orchestra.run.smithi078.stdout:506 Cannot talk to daemon 2024-09-17T03:05:28.010 INFO:teuthology.orchestra.run.smithi193.stderr:sudo: ntpd: command not found 2024-09-17T03:05:28.019 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T03:05:28.021 INFO:teuthology.orchestra.run.smithi193.stdout:506 Cannot talk to daemon 2024-09-17T03:05:28.034 INFO:teuthology.orchestra.run.smithi078.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T03:05:28.035 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T03:05:28.049 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T03:05:28.087 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: ntpq: command not found 2024-09-17T03:05:28.091 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T03:05:28.091 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2024-09-17T03:05:28.092 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:05:28.092 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:05:28.092 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:05:28.092 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:05:28.106 INFO:teuthology.orchestra.run.smithi193.stderr:bash: line 1: ntpq: command not found 2024-09-17T03:05:28.110 INFO:teuthology.orchestra.run.smithi193.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T03:05:28.110 INFO:teuthology.orchestra.run.smithi193.stdout:=============================================================================== 2024-09-17T03:05:28.110 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:05:28.110 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:05:28.110 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:05:28.110 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:05:28.110 INFO:teuthology.run_tasks:Running task install... 2024-09-17T03:05:28.119 DEBUG:teuthology.task.install:project ceph 2024-09-17T03:05:28.119 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}} 2024-09-17T03:05:28.120 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'} 2024-09-17T03:05:28.120 INFO:teuthology.task.install:Using flavor: default 2024-09-17T03:05:28.125 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T03:05:28.125 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-17T03:05:28.126 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T03:05:28.126 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T03:05:28.128 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'tag': None, 'wait_for_package': False} 2024-09-17T03:05:28.129 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T03:05:28.281 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/ 2024-09-17T03:05:28.281 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4989.gce1b342b 2024-09-17T03:05:28.291 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/ 2024-09-17T03:05:28.291 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4989.gce1b342b 2024-09-17T03:05:28.400 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T03:05:28.400 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:05:28.400 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T03:05:28.406 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240916.200549-debug/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T03:05:28.406 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:05:28.406 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T03:05:28.427 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T03:05:28.427 DEBUG:teuthology.orchestra.run.smithi193:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T03:05:28.433 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T03:05:28.433 DEBUG:teuthology.orchestra.run.smithi078:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ce1b342bf8c6349a8c90cd607f83bff2443f21cf/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T03:05:28.497 DEBUG:teuthology.orchestra.run.smithi193:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T03:05:28.499 DEBUG:teuthology.orchestra.run.smithi078:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T03:05:28.573 DEBUG:teuthology.orchestra.run.smithi193:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T03:05:28.574 DEBUG:teuthology.orchestra.run.smithi078:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T03:05:28.638 INFO:teuthology.orchestra.run.smithi193.stdout:check_obsoletes = 1 2024-09-17T03:05:28.639 INFO:teuthology.orchestra.run.smithi078.stdout:check_obsoletes = 1 2024-09-17T03:05:28.639 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum clean all 2024-09-17T03:05:28.640 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum clean all 2024-09-17T03:05:28.870 INFO:teuthology.orchestra.run.smithi078.stdout:45 files removed 2024-09-17T03:05:28.879 INFO:teuthology.orchestra.run.smithi193.stdout:45 files removed 2024-09-17T03:05:28.896 DEBUG:teuthology.orchestra.run.smithi078:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T03:05:28.909 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T03:05:29.451 INFO:teuthology.orchestra.run.smithi078.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-17T03:05:29.459 INFO:teuthology.orchestra.run.smithi193.stdout:ceph packages for x86_64 318 kB/s | 84 kB 00:00 2024-09-17T03:05:29.743 INFO:teuthology.orchestra.run.smithi078.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-17T03:05:29.744 INFO:teuthology.orchestra.run.smithi193.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-09-17T03:05:30.019 INFO:teuthology.orchestra.run.smithi078.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-17T03:05:30.019 INFO:teuthology.orchestra.run.smithi193.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-17T03:05:32.811 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.3 MB 00:02 2024-09-17T03:05:33.574 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - BaseOS 2.3 MB/s | 8.3 MB 00:03 2024-09-17T03:05:34.904 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-17T03:05:41.724 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 6.5 MB 00:03 2024-09-17T03:05:43.322 INFO:teuthology.orchestra.run.smithi078.stdout:CentOS Stream 9 - Extras packages 74 kB/s | 19 kB 00:00 2024-09-17T03:05:44.127 INFO:teuthology.orchestra.run.smithi078.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-17T03:05:49.449 INFO:teuthology.orchestra.run.smithi078.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-17T03:05:51.611 INFO:teuthology.orchestra.run.smithi078.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T03:05:51.612 INFO:teuthology.orchestra.run.smithi078.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T03:05:51.625 INFO:teuthology.orchestra.run.smithi078.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T03:05:51.626 INFO:teuthology.orchestra.run.smithi078.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T03:05:51.627 INFO:teuthology.orchestra.run.smithi078.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T03:05:51.628 INFO:teuthology.orchestra.run.smithi078.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T03:05:51.630 INFO:teuthology.orchestra.run.smithi078.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T03:05:51.633 INFO:teuthology.orchestra.run.smithi078.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T03:05:51.634 INFO:teuthology.orchestra.run.smithi078.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T03:05:51.697 INFO:teuthology.orchestra.run.smithi078.stdout:Dependencies resolved. 2024-09-17T03:05:51.712 INFO:teuthology.orchestra.run.smithi078.stdout:======================================================================================= 2024-09-17T03:05:51.712 INFO:teuthology.orchestra.run.smithi078.stdout: Package Arch Version Repository Size 2024-09-17T03:05:51.712 INFO:teuthology.orchestra.run.smithi078.stdout:======================================================================================= 2024-09-17T03:05:51.712 INFO:teuthology.orchestra.run.smithi078.stdout:Installing: 2024-09-17T03:05:51.712 INFO:teuthology.orchestra.run.smithi078.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T03:05:51.712 INFO:teuthology.orchestra.run.smithi078.stdout: ceph x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 6.6 k 2024-09-17T03:05:51.712 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.5 M 2024-09-17T03:05:51.712 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 873 k 2024-09-17T03:05:51.712 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 148 k 2024-09-17T03:05:51.712 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 1.5 M 2024-09-17T03:05:51.713 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 154 k 2024-09-17T03:05:51.713 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 14 M 2024-09-17T03:05:51.713 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 7.4 M 2024-09-17T03:05:51.713 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 49 k 2024-09-17T03:05:51.713 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 10 M 2024-09-17T03:05:51.713 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 40 M 2024-09-17T03:05:51.713 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-volume noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 285 k 2024-09-17T03:05:51.713 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 784 k 2024-09-17T03:05:51.713 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 225 k 2024-09-17T03:05:51.713 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-shell x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 27 k 2024-09-17T03:05:51.713 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-top noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 18 k 2024-09-17T03:05:51.713 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T03:05:51.714 INFO:teuthology.orchestra.run.smithi078.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T03:05:51.714 INFO:teuthology.orchestra.run.smithi078.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T03:05:51.714 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 32 k 2024-09-17T03:05:51.714 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 766 k 2024-09-17T03:05:51.714 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 127 k 2024-09-17T03:05:51.714 INFO:teuthology.orchestra.run.smithi078.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T03:05:51.714 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T03:05:51.714 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T03:05:51.714 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T03:05:51.714 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T03:05:51.714 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T03:05:51.714 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 162 k 2024-09-17T03:05:51.715 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 321 k 2024-09-17T03:05:51.715 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 305 k 2024-09-17T03:05:51.715 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 99 k 2024-09-17T03:05:51.715 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 86 k 2024-09-17T03:05:51.715 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.1 M 2024-09-17T03:05:51.715 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 170 k 2024-09-17T03:05:51.715 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T03:05:51.715 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrading: 2024-09-17T03:05:51.715 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T03:05:51.715 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T03:05:51.715 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T03:05:51.715 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T03:05:51.715 INFO:teuthology.orchestra.run.smithi078.stdout: librados2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.4 M 2024-09-17T03:05:51.716 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.2 M 2024-09-17T03:05:51.716 INFO:teuthology.orchestra.run.smithi078.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T03:05:51.716 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T03:05:51.716 INFO:teuthology.orchestra.run.smithi078.stdout:Installing dependencies: 2024-09-17T03:05:51.716 INFO:teuthology.orchestra.run.smithi078.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T03:05:51.716 INFO:teuthology.orchestra.run.smithi078.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T03:05:51.716 INFO:teuthology.orchestra.run.smithi078.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T03:05:51.716 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 20 M 2024-09-17T03:05:51.716 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 34 k 2024-09-17T03:05:51.716 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 2.3 M 2024-09-17T03:05:51.716 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 291 k 2024-09-17T03:05:51.716 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.0 M 2024-09-17T03:05:51.717 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 18 M 2024-09-17T03:05:51.717 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 16 k 2024-09-17T03:05:51.717 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 25 k 2024-09-17T03:05:51.717 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T03:05:51.717 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T03:05:51.717 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T03:05:51.717 INFO:teuthology.orchestra.run.smithi078.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T03:05:51.717 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T03:05:51.717 INFO:teuthology.orchestra.run.smithi078.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T03:05:51.717 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T03:05:51.717 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T03:05:51.717 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 159 k 2024-09-17T03:05:51.717 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T03:05:51.718 INFO:teuthology.orchestra.run.smithi078.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T03:05:51.718 INFO:teuthology.orchestra.run.smithi078.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T03:05:51.718 INFO:teuthology.orchestra.run.smithi078.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T03:05:51.718 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T03:05:51.718 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T03:05:51.718 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 507 k 2024-09-17T03:05:51.718 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T03:05:51.718 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.3 M 2024-09-17T03:05:51.718 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T03:05:51.718 INFO:teuthology.orchestra.run.smithi078.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T03:05:51.718 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T03:05:51.718 INFO:teuthology.orchestra.run.smithi078.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T03:05:51.719 INFO:teuthology.orchestra.run.smithi078.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T03:05:51.719 INFO:teuthology.orchestra.run.smithi078.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T03:05:51.719 INFO:teuthology.orchestra.run.smithi078.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T03:05:51.719 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T03:05:51.719 INFO:teuthology.orchestra.run.smithi078.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T03:05:51.719 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T03:05:51.719 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T03:05:51.719 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T03:05:51.719 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T03:05:51.719 INFO:teuthology.orchestra.run.smithi078.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T03:05:51.719 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T03:05:51.719 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T03:05:51.719 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T03:05:51.720 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 45 k 2024-09-17T03:05:51.720 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 143 k 2024-09-17T03:05:51.720 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T03:05:51.720 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T03:05:51.720 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T03:05:51.720 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T03:05:51.720 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T03:05:51.720 INFO:teuthology.orchestra.run.smithi078.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T03:05:51.720 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T03:05:51.720 INFO:teuthology.orchestra.run.smithi078.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T03:05:51.720 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T03:05:51.720 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T03:05:51.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T03:05:51.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T03:05:51.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T03:05:51.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T03:05:51.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T03:05:51.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T03:05:51.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T03:05:51.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T03:05:51.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T03:05:51.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T03:05:51.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T03:05:51.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T03:05:51.721 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T03:05:51.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T03:05:51.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T03:05:51.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T03:05:51.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T03:05:51.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T03:05:51.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T03:05:51.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T03:05:51.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T03:05:51.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T03:05:51.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T03:05:51.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T03:05:51.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T03:05:51.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T03:05:51.722 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T03:05:51.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T03:05:51.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T03:05:51.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T03:05:51.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T03:05:51.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T03:05:51.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T03:05:51.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T03:05:51.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T03:05:51.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T03:05:51.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T03:05:51.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T03:05:51.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T03:05:51.723 INFO:teuthology.orchestra.run.smithi078.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T03:05:51.724 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T03:05:51.724 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T03:05:51.724 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T03:05:51.724 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T03:05:51.724 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T03:05:51.724 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T03:05:51.724 INFO:teuthology.orchestra.run.smithi078.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T03:05:51.724 INFO:teuthology.orchestra.run.smithi078.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T03:05:51.724 INFO:teuthology.orchestra.run.smithi078.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T03:05:51.724 INFO:teuthology.orchestra.run.smithi078.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T03:05:51.724 INFO:teuthology.orchestra.run.smithi078.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T03:05:51.724 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T03:05:51.725 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T03:05:51.725 INFO:teuthology.orchestra.run.smithi078.stdout:Installing weak dependencies: 2024-09-17T03:05:51.725 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T03:05:51.725 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:05:51.725 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction Summary 2024-09-17T03:05:51.725 INFO:teuthology.orchestra.run.smithi078.stdout:======================================================================================= 2024-09-17T03:05:51.725 INFO:teuthology.orchestra.run.smithi078.stdout:Install 149 Packages 2024-09-17T03:05:51.725 INFO:teuthology.orchestra.run.smithi078.stdout:Upgrade 8 Packages 2024-09-17T03:05:51.725 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:05:51.726 INFO:teuthology.orchestra.run.smithi078.stdout:Total download size: 228 M 2024-09-17T03:05:51.726 INFO:teuthology.orchestra.run.smithi078.stdout:Downloading Packages: 2024-09-17T03:05:52.095 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:17 2024-09-17T03:05:52.417 INFO:teuthology.orchestra.run.smithi078.stdout:(1/157): ceph-19.3.0-4989.gce1b342b.el9.x86_64. 54 kB/s | 6.6 kB 00:00 2024-09-17T03:05:52.617 INFO:teuthology.orchestra.run.smithi078.stdout:(2/157): ceph-fuse-19.3.0-4989.gce1b342b.el9.x8 4.3 MB/s | 873 kB 00:00 2024-09-17T03:05:52.684 INFO:teuthology.orchestra.run.smithi078.stdout:(3/157): ceph-immutable-object-cache-19.3.0-498 2.2 MB/s | 148 kB 00:00 2024-09-17T03:05:52.818 INFO:teuthology.orchestra.run.smithi078.stdout:(4/157): ceph-base-19.3.0-4989.gce1b342b.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-17T03:05:52.893 INFO:teuthology.orchestra.run.smithi078.stdout:(5/157): ceph-mds-19.3.0-4989.gce1b342b.el9.x86 11 MB/s | 2.3 MB 00:00 2024-09-17T03:05:52.943 INFO:teuthology.orchestra.run.smithi078.stdout:(6/157): ceph-mgr-19.3.0-4989.gce1b342b.el9.x86 12 MB/s | 1.5 MB 00:00 2024-09-17T03:05:53.280 INFO:teuthology.orchestra.run.smithi078.stdout:(7/157): ceph-mon-19.3.0-4989.gce1b342b.el9.x86 13 MB/s | 5.0 MB 00:00 2024-09-17T03:05:53.536 INFO:teuthology.orchestra.run.smithi078.stdout:(8/157): ceph-common-19.3.0-4989.gce1b342b.el9. 16 MB/s | 20 MB 00:01 2024-09-17T03:05:53.594 INFO:teuthology.orchestra.run.smithi078.stdout:(9/157): ceph-selinux-19.3.0-4989.gce1b342b.el9 433 kB/s | 25 kB 00:00 2024-09-17T03:05:53.945 INFO:teuthology.orchestra.run.smithi078.stdout:(10/157): ceph-radosgw-19.3.0-4989.gce1b342b.el 16 MB/s | 10 MB 00:00 2024-09-17T03:05:54.120 INFO:teuthology.orchestra.run.smithi078.stdout:(11/157): ceph-osd-19.3.0-4989.gce1b342b.el9.x8 15 MB/s | 18 MB 00:01 2024-09-17T03:05:54.145 INFO:teuthology.orchestra.run.smithi078.stdout:(12/157): cephfs-mirror-19.3.0-4989.gce1b342b.e 1.1 MB/s | 225 kB 00:00 2024-09-17T03:05:54.170 INFO:teuthology.orchestra.run.smithi078.stdout:(13/157): cephfs-shell-19.3.0-4989.gce1b342b.el 542 kB/s | 27 kB 00:00 2024-09-17T03:05:54.195 INFO:teuthology.orchestra.run.smithi078.stdout:(14/157): libcephfs-devel-19.3.0-4989.gce1b342b 632 kB/s | 32 kB 00:00 2024-09-17T03:05:54.246 INFO:teuthology.orchestra.run.smithi078.stdout:(15/157): libcephfs2-19.3.0-4989.gce1b342b.el9. 9.9 MB/s | 766 kB 00:00 2024-09-17T03:05:54.271 INFO:teuthology.orchestra.run.smithi078.stdout:(16/157): libcephsqlite-19.3.0-4989.gce1b342b.e 2.1 MB/s | 159 kB 00:00 2024-09-17T03:05:54.313 INFO:teuthology.orchestra.run.smithi078.stdout:(17/157): librados-devel-19.3.0-4989.gce1b342b. 3.0 MB/s | 127 kB 00:00 2024-09-17T03:05:54.338 INFO:teuthology.orchestra.run.smithi078.stdout:(18/157): libradosstriper1-19.3.0-4989.gce1b342 7.5 MB/s | 507 kB 00:00 2024-09-17T03:05:54.405 INFO:teuthology.orchestra.run.smithi078.stdout:(19/157): python3-ceph-argparse-19.3.0-4989.gce 677 kB/s | 45 kB 00:00 2024-09-17T03:05:54.472 INFO:teuthology.orchestra.run.smithi078.stdout:(20/157): python3-ceph-common-19.3.0-4989.gce1b 2.1 MB/s | 143 kB 00:00 2024-09-17T03:05:54.547 INFO:teuthology.orchestra.run.smithi078.stdout:(21/157): librgw2-19.3.0-4989.gce1b342b.el9.x86 23 MB/s | 5.3 MB 00:00 2024-09-17T03:05:54.572 INFO:teuthology.orchestra.run.smithi078.stdout:(22/157): python3-cephfs-19.3.0-4989.gce1b342b. 1.6 MB/s | 162 kB 00:00 2024-09-17T03:05:54.597 INFO:teuthology.orchestra.run.smithi078.stdout:(23/157): python3-rados-19.3.0-4989.gce1b342b.e 6.3 MB/s | 321 kB 00:00 2024-09-17T03:05:54.631 INFO:teuthology.orchestra.run.smithi078.stdout:(24/157): python3-rbd-19.3.0-4989.gce1b342b.el9 5.1 MB/s | 305 kB 00:00 2024-09-17T03:05:54.656 INFO:teuthology.orchestra.run.smithi078.stdout:(25/157): python3-rgw-19.3.0-4989.gce1b342b.el9 1.7 MB/s | 99 kB 00:00 2024-09-17T03:05:54.682 INFO:teuthology.orchestra.run.smithi078.stdout:(26/157): rbd-fuse-19.3.0-4989.gce1b342b.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-17T03:05:54.757 INFO:teuthology.orchestra.run.smithi078.stdout:(27/157): rbd-nbd-19.3.0-4989.gce1b342b.el9.x86 2.2 MB/s | 170 kB 00:00 2024-09-17T03:05:54.824 INFO:teuthology.orchestra.run.smithi078.stdout:(28/157): rbd-mirror-19.3.0-4989.gce1b342b.el9. 19 MB/s | 3.1 MB 00:00 2024-09-17T03:05:54.849 INFO:teuthology.orchestra.run.smithi078.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4989.g 373 kB/s | 34 kB 00:00 2024-09-17T03:05:54.875 INFO:teuthology.orchestra.run.smithi078.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4989.gce1b342 3.0 MB/s | 154 kB 00:00 2024-09-17T03:05:55.208 INFO:teuthology.orchestra.run.smithi078.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 22 MB/s | 7.4 MB 00:00 2024-09-17T03:05:55.275 INFO:teuthology.orchestra.run.smithi078.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4989.gce 4.3 MB/s | 291 kB 00:00 2024-09-17T03:05:55.342 INFO:teuthology.orchestra.run.smithi078.stdout:(33/157): ceph-mgr-rook-19.3.0-4989.gce1b342b.e 742 kB/s | 49 kB 00:00 2024-09-17T03:05:55.409 INFO:teuthology.orchestra.run.smithi078.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4989.gc 247 kB/s | 16 kB 00:00 2024-09-17T03:05:55.476 INFO:teuthology.orchestra.run.smithi078.stdout:(35/157): ceph-volume-19.3.0-4989.gce1b342b.el9 4.2 MB/s | 285 kB 00:00 2024-09-17T03:05:55.560 INFO:teuthology.orchestra.run.smithi078.stdout:(36/157): cephadm-19.3.0-4989.gce1b342b.el9.noa 9.2 MB/s | 784 kB 00:00 2024-09-17T03:05:55.702 INFO:teuthology.orchestra.run.smithi078.stdout:(37/157): ceph-mgr-dashboard-19.3.0-4989.gce1b3 17 MB/s | 14 MB 00:00 2024-09-17T03:05:55.719 INFO:teuthology.orchestra.run.smithi078.stdout:(38/157): cephfs-top-19.3.0-4989.gce1b342b.el9. 115 kB/s | 18 kB 00:00 2024-09-17T03:05:56.086 INFO:teuthology.orchestra.run.smithi078.stdout:(39/157): ceph-test-19.3.0-4989.gce1b342b.el9.x 16 MB/s | 40 MB 00:02 2024-09-17T03:05:56.178 INFO:teuthology.orchestra.run.smithi078.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 168 kB/s | 80 kB 00:00 2024-09-17T03:05:56.236 INFO:teuthology.orchestra.run.smithi078.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-17T03:05:56.261 INFO:teuthology.orchestra.run.smithi078.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 801 kB 00:00 2024-09-17T03:05:56.295 INFO:teuthology.orchestra.run.smithi078.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-17T03:05:56.328 INFO:teuthology.orchestra.run.smithi078.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-17T03:05:56.354 INFO:teuthology.orchestra.run.smithi078.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-17T03:05:56.379 INFO:teuthology.orchestra.run.smithi078.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-17T03:05:56.404 INFO:teuthology.orchestra.run.smithi078.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-17T03:05:56.438 INFO:teuthology.orchestra.run.smithi078.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 6.1 MB/s | 1.2 MB 00:00 2024-09-17T03:05:56.555 INFO:teuthology.orchestra.run.smithi078.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 3.8 MB/s | 689 kB 00:00 2024-09-17T03:05:56.580 INFO:teuthology.orchestra.run.smithi078.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 754 kB/s | 107 kB 00:00 2024-09-17T03:05:56.605 INFO:teuthology.orchestra.run.smithi078.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-09-17T03:05:56.647 INFO:teuthology.orchestra.run.smithi078.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-09-17T03:05:56.673 INFO:teuthology.orchestra.run.smithi078.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-17T03:05:56.698 INFO:teuthology.orchestra.run.smithi078.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-17T03:05:56.723 INFO:teuthology.orchestra.run.smithi078.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-17T03:05:56.748 INFO:teuthology.orchestra.run.smithi078.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-17T03:05:56.773 INFO:teuthology.orchestra.run.smithi078.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-17T03:05:56.800 INFO:teuthology.orchestra.run.smithi078.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-17T03:05:56.825 INFO:teuthology.orchestra.run.smithi078.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-09-17T03:05:56.883 INFO:teuthology.orchestra.run.smithi078.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-17T03:05:56.908 INFO:teuthology.orchestra.run.smithi078.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 662 kB 00:00 2024-09-17T03:05:56.934 INFO:teuthology.orchestra.run.smithi078.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 488 kB/s | 24 kB 00:00 2024-09-17T03:05:56.959 INFO:teuthology.orchestra.run.smithi078.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-17T03:05:56.984 INFO:teuthology.orchestra.run.smithi078.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 3.6 MB/s | 581 kB 00:00 2024-09-17T03:05:57.009 INFO:teuthology.orchestra.run.smithi078.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-17T03:05:57.035 INFO:teuthology.orchestra.run.smithi078.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-17T03:05:57.060 INFO:teuthology.orchestra.run.smithi078.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-17T03:05:57.152 INFO:teuthology.orchestra.run.smithi078.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 35 MB/s | 4.9 MB 00:00 2024-09-17T03:05:57.194 INFO:teuthology.orchestra.run.smithi078.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-17T03:05:57.227 INFO:teuthology.orchestra.run.smithi078.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 12 MB/s | 910 kB 00:00 2024-09-17T03:05:57.253 INFO:teuthology.orchestra.run.smithi078.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-17T03:05:57.311 INFO:teuthology.orchestra.run.smithi078.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-17T03:05:57.353 INFO:teuthology.orchestra.run.smithi078.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-09-17T03:05:57.378 INFO:teuthology.orchestra.run.smithi078.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-17T03:05:57.412 INFO:teuthology.orchestra.run.smithi078.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-09-17T03:05:57.479 INFO:teuthology.orchestra.run.smithi078.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-17T03:05:57.504 INFO:teuthology.orchestra.run.smithi078.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-17T03:05:57.530 INFO:teuthology.orchestra.run.smithi078.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-09-17T03:05:57.555 INFO:teuthology.orchestra.run.smithi078.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-09-17T03:05:57.580 INFO:teuthology.orchestra.run.smithi078.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-17T03:05:57.605 INFO:teuthology.orchestra.run.smithi078.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-17T03:05:57.630 INFO:teuthology.orchestra.run.smithi078.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-09-17T03:05:57.714 INFO:teuthology.orchestra.run.smithi078.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-17T03:05:57.739 INFO:teuthology.orchestra.run.smithi078.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-17T03:05:57.765 INFO:teuthology.orchestra.run.smithi078.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-17T03:05:57.790 INFO:teuthology.orchestra.run.smithi078.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-17T03:05:57.815 INFO:teuthology.orchestra.run.smithi078.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-09-17T03:05:57.840 INFO:teuthology.orchestra.run.smithi078.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-17T03:05:57.866 INFO:teuthology.orchestra.run.smithi078.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-17T03:05:57.900 INFO:teuthology.orchestra.run.smithi078.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-17T03:05:57.925 INFO:teuthology.orchestra.run.smithi078.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 873 kB/s | 51 kB 00:00 2024-09-17T03:05:57.950 INFO:teuthology.orchestra.run.smithi078.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-17T03:05:58.025 INFO:teuthology.orchestra.run.smithi078.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-17T03:05:58.043 INFO:teuthology.orchestra.run.smithi078.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-17T03:05:58.059 INFO:teuthology.orchestra.run.smithi078.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-17T03:05:58.084 INFO:teuthology.orchestra.run.smithi078.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 5.1 MB/s | 221 kB 00:00 2024-09-17T03:05:58.110 INFO:teuthology.orchestra.run.smithi078.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 716 kB/s | 36 kB 00:00 2024-09-17T03:05:58.135 INFO:teuthology.orchestra.run.smithi078.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-09-17T03:05:58.169 INFO:teuthology.orchestra.run.smithi078.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-17T03:05:58.194 INFO:teuthology.orchestra.run.smithi078.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 987 kB/s | 58 kB 00:00 2024-09-17T03:05:58.219 INFO:teuthology.orchestra.run.smithi078.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-17T03:05:58.244 INFO:teuthology.orchestra.run.smithi078.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-17T03:05:58.269 INFO:teuthology.orchestra.run.smithi078.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-09-17T03:05:58.503 INFO:teuthology.orchestra.run.smithi078.stdout:(104/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-17T03:05:58.528 INFO:teuthology.orchestra.run.smithi078.stdout:(105/157): lua-devel-5.4.4-4.el9.x86_64.rpm 79 kB/s | 22 kB 00:00 2024-09-17T03:05:58.595 INFO:teuthology.orchestra.run.smithi078.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 4.5 MB/s | 308 kB 00:00 2024-09-17T03:05:58.621 INFO:teuthology.orchestra.run.smithi078.stdout:(107/157): abseil-cpp-20211102.0-3.el9.x86_64.r 4.6 MB/s | 548 kB 00:00 2024-09-17T03:05:58.646 INFO:teuthology.orchestra.run.smithi078.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 388 kB/s | 19 kB 00:00 2024-09-17T03:05:58.680 INFO:teuthology.orchestra.run.smithi078.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 787 kB/s | 26 kB 00:00 2024-09-17T03:05:58.706 INFO:teuthology.orchestra.run.smithi078.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-17T03:05:58.738 INFO:teuthology.orchestra.run.smithi078.stdout:(111/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.8 MB/s | 863 kB 00:00 2024-09-17T03:05:58.763 INFO:teuthology.orchestra.run.smithi078.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-17T03:05:58.822 INFO:teuthology.orchestra.run.smithi078.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-17T03:05:58.847 INFO:teuthology.orchestra.run.smithi078.stdout:(114/157): luarocks-3.9.2-5.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-09-17T03:05:58.881 INFO:teuthology.orchestra.run.smithi078.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-17T03:05:58.923 INFO:teuthology.orchestra.run.smithi078.stdout:(116/157): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-09-17T03:05:58.948 INFO:teuthology.orchestra.run.smithi078.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 482 kB/s | 32 kB 00:00 2024-09-17T03:05:58.973 INFO:teuthology.orchestra.run.smithi078.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-17T03:05:59.007 INFO:teuthology.orchestra.run.smithi078.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-17T03:05:59.033 INFO:teuthology.orchestra.run.smithi078.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-17T03:05:59.108 INFO:teuthology.orchestra.run.smithi078.stdout:(121/157): libarrow-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-09-17T03:05:59.133 INFO:teuthology.orchestra.run.smithi078.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 2.1 MB/s | 220 kB 00:00 2024-09-17T03:05:59.158 INFO:teuthology.orchestra.run.smithi078.stdout:(123/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.0 MB/s | 303 kB 00:00 2024-09-17T03:05:59.184 INFO:teuthology.orchestra.run.smithi078.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-17T03:05:59.209 INFO:teuthology.orchestra.run.smithi078.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-17T03:05:59.234 INFO:teuthology.orchestra.run.smithi078.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-17T03:05:59.259 INFO:teuthology.orchestra.run.smithi078.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-17T03:05:59.293 INFO:teuthology.orchestra.run.smithi078.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 333 kB/s | 19 kB 00:00 2024-09-17T03:05:59.318 INFO:teuthology.orchestra.run.smithi078.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 336 kB/s | 20 kB 00:00 2024-09-17T03:05:59.344 INFO:teuthology.orchestra.run.smithi078.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-17T03:05:59.377 INFO:teuthology.orchestra.run.smithi078.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-17T03:05:59.402 INFO:teuthology.orchestra.run.smithi078.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-17T03:05:59.436 INFO:teuthology.orchestra.run.smithi078.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-17T03:05:59.461 INFO:teuthology.orchestra.run.smithi078.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 664 kB/s | 16 kB 00:00 2024-09-17T03:05:59.486 INFO:teuthology.orchestra.run.smithi078.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-17T03:05:59.512 INFO:teuthology.orchestra.run.smithi078.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-17T03:05:59.537 INFO:teuthology.orchestra.run.smithi078.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-17T03:05:59.554 INFO:teuthology.orchestra.run.smithi078.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 733 kB/s | 31 kB 00:00 2024-09-17T03:05:59.571 INFO:teuthology.orchestra.run.smithi078.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-17T03:05:59.596 INFO:teuthology.orchestra.run.smithi078.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-09-17T03:05:59.613 INFO:teuthology.orchestra.run.smithi078.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 855 kB/s | 36 kB 00:00 2024-09-17T03:05:59.639 INFO:teuthology.orchestra.run.smithi078.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-17T03:05:59.680 INFO:teuthology.orchestra.run.smithi078.stdout:(143/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.6 MB/s | 2.0 MB 00:00 2024-09-17T03:05:59.706 INFO:teuthology.orchestra.run.smithi078.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-17T03:05:59.731 INFO:teuthology.orchestra.run.smithi078.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-17T03:05:59.756 INFO:teuthology.orchestra.run.smithi078.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-17T03:05:59.782 INFO:teuthology.orchestra.run.smithi078.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-17T03:05:59.815 INFO:teuthology.orchestra.run.smithi078.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-17T03:05:59.884 INFO:teuthology.orchestra.run.smithi078.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-17T03:05:59.965 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - CRB 1.6 MB/s | 6.5 MB 00:04 2024-09-17T03:06:00.049 INFO:teuthology.orchestra.run.smithi078.stdout:(150/157): librados2-19.3.0-4989.gce1b342b.el9. 13 MB/s | 3.4 MB 00:00 2024-09-17T03:06:00.099 INFO:teuthology.orchestra.run.smithi078.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 11 MB/s | 2.3 MB 00:00 2024-09-17T03:06:00.141 INFO:teuthology.orchestra.run.smithi078.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 987 kB/s | 41 kB 00:00 2024-09-17T03:06:00.183 INFO:teuthology.orchestra.run.smithi078.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 5.8 MB/s | 249 kB 00:00 2024-09-17T03:06:00.225 INFO:teuthology.orchestra.run.smithi078.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 10 MB/s | 1.8 MB 00:00 2024-09-17T03:06:00.267 INFO:teuthology.orchestra.run.smithi078.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-09-17T03:06:00.334 INFO:teuthology.orchestra.run.smithi078.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-17T03:06:00.593 INFO:teuthology.orchestra.run.smithi078.stdout:(157/157): librbd1-19.3.0-4989.gce1b342b.el9.x8 4.1 MB/s | 3.2 MB 00:00 2024-09-17T03:06:00.598 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------------------- 2024-09-17T03:06:00.599 INFO:teuthology.orchestra.run.smithi078.stdout:Total 26 MB/s | 228 MB 00:08 2024-09-17T03:06:01.588 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-17T03:06:01.868 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction check 2024-09-17T03:06:02.021 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction check succeeded. 2024-09-17T03:06:02.021 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction test 2024-09-17T03:06:02.443 INFO:teuthology.orchestra.run.smithi193.stdout:Extra Packages for Enterprise Linux 31 MB/s | 23 MB 00:00 2024-09-17T03:06:04.251 INFO:teuthology.orchestra.run.smithi078.stdout:Transaction test succeeded. 2024-09-17T03:06:04.253 INFO:teuthology.orchestra.run.smithi078.stdout:Running transaction 2024-09-17T03:06:07.890 INFO:teuthology.orchestra.run.smithi193.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-17T03:06:10.081 INFO:teuthology.orchestra.run.smithi193.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T03:06:10.081 INFO:teuthology.orchestra.run.smithi193.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T03:06:10.092 INFO:teuthology.orchestra.run.smithi193.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T03:06:10.093 INFO:teuthology.orchestra.run.smithi193.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T03:06:10.094 INFO:teuthology.orchestra.run.smithi193.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T03:06:10.095 INFO:teuthology.orchestra.run.smithi193.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T03:06:10.097 INFO:teuthology.orchestra.run.smithi193.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T03:06:10.100 INFO:teuthology.orchestra.run.smithi193.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T03:06:10.101 INFO:teuthology.orchestra.run.smithi193.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T03:06:10.164 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-09-17T03:06:10.190 INFO:teuthology.orchestra.run.smithi193.stdout:======================================================================================= 2024-09-17T03:06:10.190 INFO:teuthology.orchestra.run.smithi193.stdout: Package Arch Version Repository Size 2024-09-17T03:06:10.190 INFO:teuthology.orchestra.run.smithi193.stdout:======================================================================================= 2024-09-17T03:06:10.190 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-09-17T03:06:10.190 INFO:teuthology.orchestra.run.smithi193.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T03:06:10.191 INFO:teuthology.orchestra.run.smithi193.stdout: ceph x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 6.6 k 2024-09-17T03:06:10.191 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-base x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.5 M 2024-09-17T03:06:10.191 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 873 k 2024-09-17T03:06:10.191 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 148 k 2024-09-17T03:06:10.191 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 1.5 M 2024-09-17T03:06:10.191 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 154 k 2024-09-17T03:06:10.191 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 14 M 2024-09-17T03:06:10.191 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 7.4 M 2024-09-17T03:06:10.191 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-rook noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 49 k 2024-09-17T03:06:10.191 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-radosgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 10 M 2024-09-17T03:06:10.191 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-test x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 40 M 2024-09-17T03:06:10.191 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-volume noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 285 k 2024-09-17T03:06:10.191 INFO:teuthology.orchestra.run.smithi193.stdout: cephadm noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 784 k 2024-09-17T03:06:10.192 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 225 k 2024-09-17T03:06:10.192 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-shell x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 27 k 2024-09-17T03:06:10.192 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-top noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 18 k 2024-09-17T03:06:10.192 INFO:teuthology.orchestra.run.smithi193.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T03:06:10.192 INFO:teuthology.orchestra.run.smithi193.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T03:06:10.192 INFO:teuthology.orchestra.run.smithi193.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T03:06:10.192 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 32 k 2024-09-17T03:06:10.192 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 766 k 2024-09-17T03:06:10.192 INFO:teuthology.orchestra.run.smithi193.stdout: librados-devel x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 127 k 2024-09-17T03:06:10.192 INFO:teuthology.orchestra.run.smithi193.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T03:06:10.192 INFO:teuthology.orchestra.run.smithi193.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T03:06:10.193 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T03:06:10.193 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T03:06:10.193 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T03:06:10.193 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T03:06:10.193 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cephfs x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 162 k 2024-09-17T03:06:10.193 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rados x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 321 k 2024-09-17T03:06:10.193 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 305 k 2024-09-17T03:06:10.193 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rgw x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 99 k 2024-09-17T03:06:10.193 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-fuse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 86 k 2024-09-17T03:06:10.193 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-mirror x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.1 M 2024-09-17T03:06:10.193 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-nbd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 170 k 2024-09-17T03:06:10.193 INFO:teuthology.orchestra.run.smithi193.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T03:06:10.194 INFO:teuthology.orchestra.run.smithi193.stdout:Upgrading: 2024-09-17T03:06:10.194 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T03:06:10.194 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T03:06:10.194 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T03:06:10.194 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T03:06:10.194 INFO:teuthology.orchestra.run.smithi193.stdout: librados2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.4 M 2024-09-17T03:06:10.194 INFO:teuthology.orchestra.run.smithi193.stdout: librbd1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 3.2 M 2024-09-17T03:06:10.194 INFO:teuthology.orchestra.run.smithi193.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T03:06:10.194 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T03:06:10.195 INFO:teuthology.orchestra.run.smithi193.stdout:Installing dependencies: 2024-09-17T03:06:10.195 INFO:teuthology.orchestra.run.smithi193.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T03:06:10.195 INFO:teuthology.orchestra.run.smithi193.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T03:06:10.195 INFO:teuthology.orchestra.run.smithi193.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T03:06:10.195 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 20 M 2024-09-17T03:06:10.195 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 34 k 2024-09-17T03:06:10.195 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mds x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 2.3 M 2024-09-17T03:06:10.195 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 291 k 2024-09-17T03:06:10.195 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mon x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.0 M 2024-09-17T03:06:10.195 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-osd x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 18 M 2024-09-17T03:06:10.195 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4989.gce1b342b.el9 ceph-noarch 16 k 2024-09-17T03:06:10.195 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-selinux x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 25 k 2024-09-17T03:06:10.196 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T03:06:10.196 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T03:06:10.196 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T03:06:10.196 INFO:teuthology.orchestra.run.smithi193.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T03:06:10.196 INFO:teuthology.orchestra.run.smithi193.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T03:06:10.196 INFO:teuthology.orchestra.run.smithi193.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T03:06:10.196 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T03:06:10.196 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T03:06:10.196 INFO:teuthology.orchestra.run.smithi193.stdout: libcephsqlite x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 159 k 2024-09-17T03:06:10.196 INFO:teuthology.orchestra.run.smithi193.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T03:06:10.196 INFO:teuthology.orchestra.run.smithi193.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T03:06:10.196 INFO:teuthology.orchestra.run.smithi193.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T03:06:10.197 INFO:teuthology.orchestra.run.smithi193.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T03:06:10.197 INFO:teuthology.orchestra.run.smithi193.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T03:06:10.197 INFO:teuthology.orchestra.run.smithi193.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T03:06:10.197 INFO:teuthology.orchestra.run.smithi193.stdout: libradosstriper1 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 507 k 2024-09-17T03:06:10.197 INFO:teuthology.orchestra.run.smithi193.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T03:06:10.197 INFO:teuthology.orchestra.run.smithi193.stdout: librgw2 x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 5.3 M 2024-09-17T03:06:10.197 INFO:teuthology.orchestra.run.smithi193.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T03:06:10.198 INFO:teuthology.orchestra.run.smithi193.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T03:06:10.198 INFO:teuthology.orchestra.run.smithi193.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T03:06:10.198 INFO:teuthology.orchestra.run.smithi193.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T03:06:10.198 INFO:teuthology.orchestra.run.smithi193.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T03:06:10.198 INFO:teuthology.orchestra.run.smithi193.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T03:06:10.198 INFO:teuthology.orchestra.run.smithi193.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T03:06:10.198 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T03:06:10.198 INFO:teuthology.orchestra.run.smithi193.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T03:06:10.198 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T03:06:10.198 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T03:06:10.198 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T03:06:10.198 INFO:teuthology.orchestra.run.smithi193.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T03:06:10.198 INFO:teuthology.orchestra.run.smithi193.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T03:06:10.199 INFO:teuthology.orchestra.run.smithi193.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T03:06:10.199 INFO:teuthology.orchestra.run.smithi193.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T03:06:10.199 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T03:06:10.199 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-argparse x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 45 k 2024-09-17T03:06:10.199 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-common x86_64 2:19.3.0-4989.gce1b342b.el9 ceph 143 k 2024-09-17T03:06:10.199 INFO:teuthology.orchestra.run.smithi193.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T03:06:10.199 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T03:06:10.199 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T03:06:10.199 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T03:06:10.199 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T03:06:10.199 INFO:teuthology.orchestra.run.smithi193.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T03:06:10.199 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T03:06:10.199 INFO:teuthology.orchestra.run.smithi193.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T03:06:10.200 INFO:teuthology.orchestra.run.smithi193.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T03:06:10.200 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T03:06:10.200 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T03:06:10.200 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T03:06:10.200 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T03:06:10.200 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T03:06:10.200 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T03:06:10.200 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T03:06:10.200 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T03:06:10.200 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T03:06:10.200 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T03:06:10.200 INFO:teuthology.orchestra.run.smithi193.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T03:06:10.201 INFO:teuthology.orchestra.run.smithi193.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T03:06:10.201 INFO:teuthology.orchestra.run.smithi193.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T03:06:10.201 INFO:teuthology.orchestra.run.smithi193.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T03:06:10.201 INFO:teuthology.orchestra.run.smithi193.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T03:06:10.201 INFO:teuthology.orchestra.run.smithi193.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T03:06:10.201 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T03:06:10.201 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T03:06:10.201 INFO:teuthology.orchestra.run.smithi193.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T03:06:10.201 INFO:teuthology.orchestra.run.smithi193.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T03:06:10.201 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T03:06:10.201 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T03:06:10.201 INFO:teuthology.orchestra.run.smithi193.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T03:06:10.201 INFO:teuthology.orchestra.run.smithi193.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T03:06:10.201 INFO:teuthology.orchestra.run.smithi193.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T03:06:10.202 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T03:06:10.202 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T03:06:10.202 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T03:06:10.202 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T03:06:10.202 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T03:06:10.202 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T03:06:10.202 INFO:teuthology.orchestra.run.smithi193.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T03:06:10.202 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T03:06:10.202 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T03:06:10.202 INFO:teuthology.orchestra.run.smithi193.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T03:06:10.202 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T03:06:10.202 INFO:teuthology.orchestra.run.smithi193.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T03:06:10.202 INFO:teuthology.orchestra.run.smithi193.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T03:06:10.203 INFO:teuthology.orchestra.run.smithi193.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T03:06:10.203 INFO:teuthology.orchestra.run.smithi193.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T03:06:10.203 INFO:teuthology.orchestra.run.smithi193.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T03:06:10.203 INFO:teuthology.orchestra.run.smithi193.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T03:06:10.203 INFO:teuthology.orchestra.run.smithi193.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T03:06:10.203 INFO:teuthology.orchestra.run.smithi193.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T03:06:10.203 INFO:teuthology.orchestra.run.smithi193.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T03:06:10.203 INFO:teuthology.orchestra.run.smithi193.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T03:06:10.203 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T03:06:10.203 INFO:teuthology.orchestra.run.smithi193.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T03:06:10.203 INFO:teuthology.orchestra.run.smithi193.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T03:06:10.203 INFO:teuthology.orchestra.run.smithi193.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T03:06:10.203 INFO:teuthology.orchestra.run.smithi193.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T03:06:10.203 INFO:teuthology.orchestra.run.smithi193.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T03:06:10.204 INFO:teuthology.orchestra.run.smithi193.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T03:06:10.204 INFO:teuthology.orchestra.run.smithi193.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T03:06:10.204 INFO:teuthology.orchestra.run.smithi193.stdout:Installing weak dependencies: 2024-09-17T03:06:10.204 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T03:06:10.204 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:06:10.204 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-09-17T03:06:10.204 INFO:teuthology.orchestra.run.smithi193.stdout:======================================================================================= 2024-09-17T03:06:10.204 INFO:teuthology.orchestra.run.smithi193.stdout:Install 149 Packages 2024-09-17T03:06:10.204 INFO:teuthology.orchestra.run.smithi193.stdout:Upgrade 8 Packages 2024-09-17T03:06:10.204 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:06:10.205 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 228 M 2024-09-17T03:06:10.205 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-09-17T03:06:10.650 INFO:teuthology.orchestra.run.smithi078.stdout: Preparing : 1/1 2024-09-17T03:06:10.767 INFO:teuthology.orchestra.run.smithi193.stdout:(1/157): ceph-19.3.0-4989.gce1b342b.el9.x86_64. 47 kB/s | 6.6 kB 00:00 2024-09-17T03:06:10.772 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T03:06:10.815 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T03:06:10.871 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T03:06:10.905 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T03:06:10.931 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T03:06:10.990 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T03:06:11.009 INFO:teuthology.orchestra.run.smithi193.stdout:(2/157): ceph-fuse-19.3.0-4989.gce1b342b.el9.x8 3.5 MB/s | 873 kB 00:00 2024-09-17T03:06:11.059 INFO:teuthology.orchestra.run.smithi193.stdout:(3/157): ceph-immutable-object-cache-19.3.0-498 2.9 MB/s | 148 kB 00:00 2024-09-17T03:06:11.368 INFO:teuthology.orchestra.run.smithi193.stdout:(4/157): ceph-mds-19.3.0-4989.gce1b342b.el9.x86 7.4 MB/s | 2.3 MB 00:00 2024-09-17T03:06:11.447 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T03:06:11.493 INFO:teuthology.orchestra.run.smithi193.stdout:(5/157): ceph-base-19.3.0-4989.gce1b342b.el9.x8 6.4 MB/s | 5.5 MB 00:00 2024-09-17T03:06:11.566 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:06:11.576 INFO:teuthology.orchestra.run.smithi193.stdout:(6/157): ceph-mgr-19.3.0-4989.gce1b342b.el9.x86 7.3 MB/s | 1.5 MB 00:00 2024-09-17T03:06:11.676 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:06:11.700 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:06:11.776 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:06:11.805 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T03:06:11.835 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T03:06:11.885 INFO:teuthology.orchestra.run.smithi193.stdout:(7/157): ceph-mon-19.3.0-4989.gce1b342b.el9.x86 13 MB/s | 5.0 MB 00:00 2024-09-17T03:06:12.007 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T03:06:12.061 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T03:06:12.088 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:06:12.177 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:06:12.206 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T03:06:12.235 INFO:teuthology.orchestra.run.smithi193.stdout:(8/157): ceph-common-19.3.0-4989.gce1b342b.el9. 12 MB/s | 20 MB 00:01 2024-09-17T03:06:12.277 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T03:06:12.294 INFO:teuthology.orchestra.run.smithi193.stdout:(9/157): ceph-selinux-19.3.0-4989.gce1b342b.el9 433 kB/s | 25 kB 00:00 2024-09-17T03:06:12.307 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T03:06:12.332 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T03:06:12.533 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T03:06:12.594 INFO:teuthology.orchestra.run.smithi193.stdout:(10/157): ceph-radosgw-19.3.0-4989.gce1b342b.el 15 MB/s | 10 MB 00:00 2024-09-17T03:06:12.703 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T03:06:12.803 INFO:teuthology.orchestra.run.smithi193.stdout:(11/157): ceph-osd-19.3.0-4989.gce1b342b.el9.x8 15 MB/s | 18 MB 00:01 2024-09-17T03:06:12.828 INFO:teuthology.orchestra.run.smithi193.stdout:(12/157): cephfs-mirror-19.3.0-4989.gce1b342b.e 964 kB/s | 225 kB 00:00 2024-09-17T03:06:12.853 INFO:teuthology.orchestra.run.smithi193.stdout:(13/157): cephfs-shell-19.3.0-4989.gce1b342b.el 541 kB/s | 27 kB 00:00 2024-09-17T03:06:12.872 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T03:06:12.878 INFO:teuthology.orchestra.run.smithi193.stdout:(14/157): libcephfs-devel-19.3.0-4989.gce1b342b 630 kB/s | 32 kB 00:00 2024-09-17T03:06:12.920 INFO:teuthology.orchestra.run.smithi193.stdout:(15/157): libcephfs2-19.3.0-4989.gce1b342b.el9. 11 MB/s | 766 kB 00:00 2024-09-17T03:06:12.946 INFO:teuthology.orchestra.run.smithi193.stdout:(16/157): libcephsqlite-19.3.0-4989.gce1b342b.e 2.3 MB/s | 159 kB 00:00 2024-09-17T03:06:12.971 INFO:teuthology.orchestra.run.smithi193.stdout:(17/157): librados-devel-19.3.0-4989.gce1b342b. 2.5 MB/s | 127 kB 00:00 2024-09-17T03:06:12.997 INFO:teuthology.orchestra.run.smithi193.stdout:(18/157): libradosstriper1-19.3.0-4989.gce1b342 9.9 MB/s | 507 kB 00:00 2024-09-17T03:06:13.008 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:06:13.038 INFO:teuthology.orchestra.run.smithi193.stdout:(19/157): python3-ceph-argparse-19.3.0-4989.gce 1.1 MB/s | 45 kB 00:00 2024-09-17T03:06:13.065 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:06:13.122 INFO:teuthology.orchestra.run.smithi193.stdout:(20/157): python3-ceph-common-19.3.0-4989.gce1b 1.7 MB/s | 143 kB 00:00 2024-09-17T03:06:13.247 INFO:teuthology.orchestra.run.smithi193.stdout:(21/157): librgw2-19.3.0-4989.gce1b342b.el9.x86 19 MB/s | 5.3 MB 00:00 2024-09-17T03:06:13.272 INFO:teuthology.orchestra.run.smithi193.stdout:(22/157): python3-cephfs-19.3.0-4989.gce1b342b. 1.1 MB/s | 162 kB 00:00 2024-09-17T03:06:13.298 INFO:teuthology.orchestra.run.smithi193.stdout:(23/157): python3-rados-19.3.0-4989.gce1b342b.e 6.3 MB/s | 321 kB 00:00 2024-09-17T03:06:13.298 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:06:13.332 INFO:teuthology.orchestra.run.smithi193.stdout:(24/157): python3-rbd-19.3.0-4989.gce1b342b.el9 5.1 MB/s | 305 kB 00:00 2024-09-17T03:06:13.357 INFO:teuthology.orchestra.run.smithi193.stdout:(25/157): python3-rgw-19.3.0-4989.gce1b342b.el9 1.6 MB/s | 99 kB 00:00 2024-09-17T03:06:13.382 INFO:teuthology.orchestra.run.smithi193.stdout:(26/157): rbd-fuse-19.3.0-4989.gce1b342b.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-17T03:06:13.405 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T03:06:13.433 INFO:teuthology.orchestra.run.smithi193.stdout:(27/157): rbd-nbd-19.3.0-4989.gce1b342b.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-17T03:06:13.449 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T03:06:13.487 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T03:06:13.508 INFO:teuthology.orchestra.run.smithi193.stdout:(28/157): rbd-mirror-19.3.0-4989.gce1b342b.el9. 21 MB/s | 3.1 MB 00:00 2024-09-17T03:06:13.533 INFO:teuthology.orchestra.run.smithi193.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4989.g 342 kB/s | 34 kB 00:00 2024-09-17T03:06:13.558 INFO:teuthology.orchestra.run.smithi193.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4989.gce1b342 3.0 MB/s | 154 kB 00:00 2024-09-17T03:06:13.559 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T03:06:13.604 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T03:06:13.637 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T03:06:13.688 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T03:06:13.721 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T03:06:13.749 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T03:06:13.817 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T03:06:13.870 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T03:06:13.902 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T03:06:13.945 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T03:06:13.993 INFO:teuthology.orchestra.run.smithi193.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 17 MB/s | 7.4 MB 00:00 2024-09-17T03:06:14.021 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T03:06:14.051 INFO:teuthology.orchestra.run.smithi193.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4989.gce 4.9 MB/s | 291 kB 00:00 2024-09-17T03:06:14.056 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 34/165 2024-09-17T03:06:14.099 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 35/165 2024-09-17T03:06:14.109 INFO:teuthology.orchestra.run.smithi193.stdout:(33/157): ceph-mgr-rook-19.3.0-4989.gce1b342b.e 846 kB/s | 49 kB 00:00 2024-09-17T03:06:14.129 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 36/165 2024-09-17T03:06:14.197 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T03:06:14.242 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T03:06:14.315 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T03:06:14.446 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T03:06:14.460 INFO:teuthology.orchestra.run.smithi193.stdout:(34/157): ceph-test-19.3.0-4989.gce1b342b.el9.x 18 MB/s | 40 MB 00:02 2024-09-17T03:06:14.485 INFO:teuthology.orchestra.run.smithi193.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4989.gc 44 kB/s | 16 kB 00:00 2024-09-17T03:06:14.494 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T03:06:14.510 INFO:teuthology.orchestra.run.smithi193.stdout:(36/157): ceph-volume-19.3.0-4989.gce1b342b.el9 5.6 MB/s | 285 kB 00:00 2024-09-17T03:06:14.661 INFO:teuthology.orchestra.run.smithi193.stdout:(37/157): ceph-mgr-dashboard-19.3.0-4989.gce1b3 13 MB/s | 14 MB 00:01 2024-09-17T03:06:14.686 INFO:teuthology.orchestra.run.smithi193.stdout:(38/157): cephfs-top-19.3.0-4989.gce1b342b.el9. 104 kB/s | 18 kB 00:00 2024-09-17T03:06:14.719 INFO:teuthology.orchestra.run.smithi193.stdout:(39/157): cephadm-19.3.0-4989.gce1b342b.el9.noa 3.3 MB/s | 784 kB 00:00 2024-09-17T03:06:14.820 INFO:teuthology.orchestra.run.smithi193.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 504 kB/s | 80 kB 00:00 2024-09-17T03:06:14.845 INFO:teuthology.orchestra.run.smithi193.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-17T03:06:14.887 INFO:teuthology.orchestra.run.smithi193.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.9 MB/s | 801 kB 00:00 2024-09-17T03:06:14.912 INFO:teuthology.orchestra.run.smithi193.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.7 MB/s | 253 kB 00:00 2024-09-17T03:06:14.937 INFO:teuthology.orchestra.run.smithi193.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-17T03:06:14.963 INFO:teuthology.orchestra.run.smithi193.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-17T03:06:14.988 INFO:teuthology.orchestra.run.smithi193.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-17T03:06:15.003 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T03:06:15.013 INFO:teuthology.orchestra.run.smithi193.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-17T03:06:15.072 INFO:teuthology.orchestra.run.smithi193.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 5.4 MB/s | 1.2 MB 00:00 2024-09-17T03:06:15.080 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T03:06:15.111 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T03:06:15.146 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T03:06:15.175 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 46/165 2024-09-17T03:06:15.189 INFO:teuthology.orchestra.run.smithi193.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 919 kB/s | 107 kB 00:00 2024-09-17T03:06:15.217 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T03:06:15.264 INFO:teuthology.orchestra.run.smithi193.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 289 kB/s | 22 kB 00:00 2024-09-17T03:06:15.373 INFO:teuthology.orchestra.run.smithi193.stdout:(51/157): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-17T03:06:15.379 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T03:06:15.448 INFO:teuthology.orchestra.run.smithi193.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-09-17T03:06:15.453 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T03:06:15.542 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T03:06:15.565 INFO:teuthology.orchestra.run.smithi193.stdout:(53/157): automake-1.16.2-8.el9.noarch.rpm 1.2 MB/s | 689 kB 00:00 2024-09-17T03:06:15.600 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T03:06:15.665 INFO:teuthology.orchestra.run.smithi193.stdout:(54/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-09-17T03:06:15.674 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T03:06:15.682 INFO:teuthology.orchestra.run.smithi193.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 155 kB/s | 18 kB 00:00 2024-09-17T03:06:15.705 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T03:06:15.716 INFO:teuthology.orchestra.run.smithi193.stdout:(56/157): bison-3.7.4-5.el9.x86_64.rpm 1.3 MB/s | 943 kB 00:00 2024-09-17T03:06:15.740 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T03:06:15.741 INFO:teuthology.orchestra.run.smithi193.stdout:(57/157): libaio-devel-0.3.111-13.el9.x86_64.rp 147 kB/s | 11 kB 00:00 2024-09-17T03:06:15.787 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T03:06:15.791 INFO:teuthology.orchestra.run.smithi193.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2024-09-17T03:06:15.832 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T03:06:15.833 INFO:teuthology.orchestra.run.smithi193.stdout:(59/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-17T03:06:15.874 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T03:06:15.875 INFO:teuthology.orchestra.run.smithi193.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 7.7 MB/s | 662 kB 00:00 2024-09-17T03:06:15.901 INFO:teuthology.orchestra.run.smithi193.stdout:(61/157): libnbd-1.20.2-2.el9.x86_64.rpm 783 kB/s | 171 kB 00:00 2024-09-17T03:06:15.916 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T03:06:15.951 INFO:teuthology.orchestra.run.smithi193.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 326 kB/s | 24 kB 00:00 2024-09-17T03:06:16.026 INFO:teuthology.orchestra.run.smithi193.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 2.9 MB/s | 581 kB 00:00 2024-09-17T03:06:16.051 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T03:06:16.051 INFO:teuthology.orchestra.run.smithi193.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 315 kB/s | 47 kB 00:00 2024-09-17T03:06:16.077 INFO:teuthology.orchestra.run.smithi193.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-17T03:06:16.094 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T03:06:16.119 INFO:teuthology.orchestra.run.smithi193.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 188 kB 00:00 2024-09-17T03:06:16.134 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T03:06:16.144 INFO:teuthology.orchestra.run.smithi193.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 417 kB/s | 38 kB 00:00 2024-09-17T03:06:16.228 INFO:teuthology.orchestra.run.smithi193.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 33 MB/s | 4.9 MB 00:00 2024-09-17T03:06:16.320 INFO:teuthology.orchestra.run.smithi193.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 9.7 MB/s | 910 kB 00:00 2024-09-17T03:06:16.334 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T03:06:16.369 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T03:06:16.395 INFO:teuthology.orchestra.run.smithi193.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-17T03:06:16.425 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T03:06:16.437 INFO:teuthology.orchestra.run.smithi193.stdout:(71/157): postgresql-13.16-1.el9.x86_64.rpm 5.4 MB/s | 1.6 MB 00:00 2024-09-17T03:06:16.459 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T03:06:16.484 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T03:06:16.545 INFO:teuthology.orchestra.run.smithi193.stdout:(72/157): postgresql-server-13.16-1.el9.x86_64. 38 MB/s | 5.8 MB 00:00 2024-09-17T03:06:16.571 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T03:06:16.604 INFO:teuthology.orchestra.run.smithi193.stdout:(73/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-09-17T03:06:16.629 INFO:teuthology.orchestra.run.smithi193.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-17T03:06:16.663 INFO:teuthology.orchestra.run.smithi193.stdout:(75/157): protobuf-3.14.0-13.el9.x86_64.rpm 4.5 MB/s | 1.0 MB 00:00 2024-09-17T03:06:16.696 INFO:teuthology.orchestra.run.smithi193.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 918 kB/s | 61 kB 00:00 2024-09-17T03:06:16.701 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T03:06:16.741 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T03:06:16.763 INFO:teuthology.orchestra.run.smithi193.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-17T03:06:16.777 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T03:06:16.789 INFO:teuthology.orchestra.run.smithi193.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-17T03:06:16.811 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T03:06:16.839 INFO:teuthology.orchestra.run.smithi193.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 340 kB/s | 26 kB 00:00 2024-09-17T03:06:16.851 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T03:06:16.865 INFO:teuthology.orchestra.run.smithi193.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 255 kB/s | 19 kB 00:00 2024-09-17T03:06:16.882 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T03:06:16.912 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T03:06:16.915 INFO:teuthology.orchestra.run.smithi193.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-17T03:06:16.940 INFO:teuthology.orchestra.run.smithi193.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 460 kB/s | 35 kB 00:00 2024-09-17T03:06:16.946 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T03:06:16.974 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T03:06:17.015 INFO:teuthology.orchestra.run.smithi193.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.3 MB/s | 250 kB 00:00 2024-09-17T03:06:17.017 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T03:06:17.051 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T03:06:17.091 INFO:teuthology.orchestra.run.smithi193.stdout:(84/157): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-09-17T03:06:17.116 INFO:teuthology.orchestra.run.smithi193.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-17T03:06:17.136 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T03:06:17.191 INFO:teuthology.orchestra.run.smithi193.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 18 MB/s | 5.1 MB 00:00 2024-09-17T03:06:17.197 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T03:06:17.217 INFO:teuthology.orchestra.run.smithi193.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 421 kB/s | 42 kB 00:00 2024-09-17T03:06:17.228 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T03:06:17.242 INFO:teuthology.orchestra.run.smithi193.stdout:(88/157): python3-packaging-20.9-5.el9.noarch.r 512 kB/s | 77 kB 00:00 2024-09-17T03:06:17.284 INFO:teuthology.orchestra.run.smithi193.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-09-17T03:06:17.309 INFO:teuthology.orchestra.run.smithi193.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-09-17T03:06:17.331 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T03:06:17.351 INFO:teuthology.orchestra.run.smithi193.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-09-17T03:06:17.376 INFO:teuthology.orchestra.run.smithi193.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 553 kB/s | 51 kB 00:00 2024-09-17T03:06:17.379 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T03:06:17.402 INFO:teuthology.orchestra.run.smithi193.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 581 kB/s | 54 kB 00:00 2024-09-17T03:06:17.469 INFO:teuthology.orchestra.run.smithi193.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-17T03:06:17.486 INFO:teuthology.orchestra.run.smithi193.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 527 kB/s | 44 kB 00:00 2024-09-17T03:06:17.536 INFO:teuthology.orchestra.run.smithi193.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 719 kB/s | 36 kB 00:00 2024-09-17T03:06:17.561 INFO:teuthology.orchestra.run.smithi193.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-09-17T03:06:17.586 INFO:teuthology.orchestra.run.smithi193.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-17T03:06:17.653 INFO:teuthology.orchestra.run.smithi193.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 3.2 MB/s | 304 kB 00:00 2024-09-17T03:06:17.670 INFO:teuthology.orchestra.run.smithi193.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 692 kB/s | 58 kB 00:00 2024-09-17T03:06:17.737 INFO:teuthology.orchestra.run.smithi193.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.1 MB/s | 96 kB 00:00 2024-09-17T03:06:17.754 INFO:teuthology.orchestra.run.smithi193.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 761 kB/s | 64 kB 00:00 2024-09-17T03:06:17.796 INFO:teuthology.orchestra.run.smithi193.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-09-17T03:06:17.821 INFO:teuthology.orchestra.run.smithi193.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 332 kB/s | 22 kB 00:00 2024-09-17T03:06:17.880 INFO:teuthology.orchestra.run.smithi193.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-17T03:06:17.914 INFO:teuthology.orchestra.run.smithi193.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-17T03:06:17.939 INFO:teuthology.orchestra.run.smithi193.stdout:(107/157): protobuf-compiler-3.14.0-13.el9.x86_ 5.9 MB/s | 863 kB 00:00 2024-09-17T03:06:17.964 INFO:teuthology.orchestra.run.smithi193.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 387 kB/s | 19 kB 00:00 2024-09-17T03:06:17.998 INFO:teuthology.orchestra.run.smithi193.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 982 kB/s | 26 kB 00:00 2024-09-17T03:06:18.024 INFO:teuthology.orchestra.run.smithi193.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-17T03:06:18.049 INFO:teuthology.orchestra.run.smithi193.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-09-17T03:06:18.074 INFO:teuthology.orchestra.run.smithi193.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-17T03:06:18.097 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T03:06:18.143 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T03:06:18.157 INFO:teuthology.orchestra.run.smithi193.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.8 MB/s | 839 kB 00:00 2024-09-17T03:06:18.177 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T03:06:18.208 INFO:teuthology.orchestra.run.smithi193.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-17T03:06:18.233 INFO:teuthology.orchestra.run.smithi193.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-17T03:06:18.275 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T03:06:18.332 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T03:06:18.376 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T03:06:18.384 INFO:teuthology.orchestra.run.smithi193.stdout:(116/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:01 2024-09-17T03:06:18.409 INFO:teuthology.orchestra.run.smithi193.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 183 kB/s | 32 kB 00:00 2024-09-17T03:06:18.443 INFO:teuthology.orchestra.run.smithi193.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.4 MB/s | 172 kB 00:00 2024-09-17T03:06:18.464 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T03:06:18.467 INFO:teuthology.orchestra.run.smithi193.stdout:(119/157): python3-certifi-2023.05.07-4.el9.noa 169 kB/s | 14 kB 00:00 2024-09-17T03:06:18.501 INFO:teuthology.orchestra.run.smithi193.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.2 MB/s | 358 kB 00:00 2024-09-17T03:06:18.505 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T03:06:18.527 INFO:teuthology.orchestra.run.smithi193.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-17T03:06:18.585 INFO:teuthology.orchestra.run.smithi193.stdout:(122/157): libarrow-9.0.0-11.el9.x86_64.rpm 6.8 MB/s | 4.4 MB 00:00 2024-09-17T03:06:18.611 INFO:teuthology.orchestra.run.smithi193.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.0 MB/s | 220 kB 00:00 2024-09-17T03:06:18.636 INFO:teuthology.orchestra.run.smithi193.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-17T03:06:18.661 INFO:teuthology.orchestra.run.smithi193.stdout:(125/157): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-17T03:06:18.682 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T03:06:18.686 INFO:teuthology.orchestra.run.smithi193.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-17T03:06:18.710 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T03:06:18.711 INFO:teuthology.orchestra.run.smithi193.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-17T03:06:18.737 INFO:teuthology.orchestra.run.smithi193.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-17T03:06:18.762 INFO:teuthology.orchestra.run.smithi193.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-09-17T03:06:18.788 INFO:teuthology.orchestra.run.smithi193.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-17T03:06:18.795 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T03:06:18.813 INFO:teuthology.orchestra.run.smithi193.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-17T03:06:18.838 INFO:teuthology.orchestra.run.smithi193.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-17T03:06:18.871 INFO:teuthology.orchestra.run.smithi193.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-17T03:06:18.897 INFO:teuthology.orchestra.run.smithi193.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-17T03:06:18.923 INFO:teuthology.orchestra.run.smithi193.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-17T03:06:18.964 INFO:teuthology.orchestra.run.smithi193.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-17T03:06:18.989 INFO:teuthology.orchestra.run.smithi193.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 423 kB/s | 28 kB 00:00 2024-09-17T03:06:19.015 INFO:teuthology.orchestra.run.smithi193.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-17T03:06:19.049 INFO:teuthology.orchestra.run.smithi193.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 1.7 MB/s | 59 kB 00:00 2024-09-17T03:06:19.074 INFO:teuthology.orchestra.run.smithi193.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-17T03:06:19.099 INFO:teuthology.orchestra.run.smithi193.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 708 kB/s | 36 kB 00:00 2024-09-17T03:06:19.125 INFO:teuthology.orchestra.run.smithi193.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-17T03:06:19.175 INFO:teuthology.orchestra.run.smithi193.stdout:(143/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.1 MB/s | 2.0 MB 00:00 2024-09-17T03:06:19.200 INFO:teuthology.orchestra.run.smithi193.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-09-17T03:06:19.225 INFO:teuthology.orchestra.run.smithi193.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-17T03:06:19.251 INFO:teuthology.orchestra.run.smithi193.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-09-17T03:06:19.276 INFO:teuthology.orchestra.run.smithi193.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-17T03:06:19.301 INFO:teuthology.orchestra.run.smithi193.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-17T03:06:19.352 INFO:teuthology.orchestra.run.smithi193.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-17T03:06:19.450 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T03:06:19.535 INFO:teuthology.orchestra.run.smithi193.stdout:(150/157): librados2-19.3.0-4989.gce1b342b.el9. 13 MB/s | 3.4 MB 00:00 2024-09-17T03:06:19.568 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T03:06:19.585 INFO:teuthology.orchestra.run.smithi193.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 9.9 MB/s | 2.3 MB 00:00 2024-09-17T03:06:19.644 INFO:teuthology.orchestra.run.smithi193.stdout:(152/157): librbd1-19.3.0-4989.gce1b342b.el9.x8 9.2 MB/s | 3.2 MB 00:00 2024-09-17T03:06:19.669 INFO:teuthology.orchestra.run.smithi193.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 489 kB/s | 41 kB 00:00 2024-09-17T03:06:19.720 INFO:teuthology.orchestra.run.smithi193.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 9.8 MB/s | 1.8 MB 00:00 2024-09-17T03:06:19.761 INFO:teuthology.orchestra.run.smithi193.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-09-17T03:06:19.787 INFO:teuthology.orchestra.run.smithi193.stdout:(156/157): NetworkManager-tui-1.51.0-1.el9.x86_ 1.7 MB/s | 249 kB 00:00 2024-09-17T03:06:19.837 INFO:teuthology.orchestra.run.smithi193.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-09-17T03:06:19.844 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-09-17T03:06:19.844 INFO:teuthology.orchestra.run.smithi193.stdout:Total 24 MB/s | 228 MB 00:09 2024-09-17T03:06:20.814 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T03:06:20.890 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T03:06:20.918 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T03:06:20.951 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T03:06:21.078 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-09-17T03:06:21.232 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-09-17T03:06:21.232 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-09-17T03:06:21.344 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T03:06:21.539 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T03:06:21.639 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T03:06:21.668 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 103/165 2024-09-17T03:06:21.711 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T03:06:22.211 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T03:06:22.233 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T03:06:22.304 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T03:06:22.334 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 107/165 2024-09-17T03:06:23.464 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-09-17T03:06:23.464 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-09-17T03:06:24.567 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:06:24.598 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:06:25.164 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:06:25.209 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T03:06:25.300 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T03:06:25.300 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T03:06:25.300 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T03:06:25.300 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:06:25.336 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T03:06:30.063 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-09-17T03:06:30.159 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T03:06:30.205 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T03:06:30.272 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T03:06:30.309 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T03:06:30.334 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T03:06:30.388 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T03:06:30.742 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T03:06:30.865 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:06:30.991 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:06:31.016 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:06:31.107 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:06:31.137 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T03:06:31.168 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T03:06:31.340 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T03:06:31.394 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T03:06:31.421 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:06:31.527 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:06:31.555 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T03:06:31.628 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 15/165 2024-09-17T03:06:31.657 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T03:06:31.680 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T03:06:31.820 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T03:06:31.991 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T03:06:32.130 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T03:06:32.252 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:06:32.332 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:06:32.556 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T03:06:32.679 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T03:06:32.724 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T03:06:32.762 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T03:06:32.827 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T03:06:32.871 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T03:06:32.904 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T03:06:32.947 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T03:06:32.980 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T03:06:33.007 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T03:06:33.075 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T03:06:33.129 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T03:06:33.161 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T03:06:33.204 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T03:06:33.280 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T03:06:33.315 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 34/165 2024-09-17T03:06:33.358 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 35/165 2024-09-17T03:06:33.387 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 36/165 2024-09-17T03:06:33.457 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T03:06:33.502 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T03:06:33.577 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T03:06:33.723 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T03:06:33.779 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T03:06:34.303 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T03:06:34.382 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T03:06:34.421 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T03:06:34.456 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T03:06:34.493 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 46/165 2024-09-17T03:06:34.536 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T03:06:34.711 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T03:06:34.763 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T03:06:34.853 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T03:06:34.918 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T03:06:34.999 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T03:06:35.032 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T03:06:35.068 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T03:06:35.114 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T03:06:35.150 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T03:06:35.194 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T03:06:35.235 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T03:06:35.371 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T03:06:35.412 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T03:06:35.462 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T03:06:35.564 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T03:06:35.597 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T03:06:35.729 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T03:06:35.913 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T03:06:35.937 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T03:06:36.033 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T03:06:36.156 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T03:06:36.194 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T03:06:36.226 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T03:06:36.256 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T03:06:36.295 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T03:06:36.328 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T03:06:36.358 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T03:06:36.392 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T03:06:36.425 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T03:06:36.467 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T03:06:36.501 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T03:06:36.592 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T03:06:36.635 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T03:06:36.667 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T03:06:36.768 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T03:06:36.825 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T03:06:36.957 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T03:06:36.960 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /sys 2024-09-17T03:06:36.960 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /proc 2024-09-17T03:06:36.960 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /mnt 2024-09-17T03:06:36.960 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /var/tmp 2024-09-17T03:06:36.960 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /home 2024-09-17T03:06:36.960 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /root 2024-09-17T03:06:36.960 INFO:teuthology.orchestra.run.smithi078.stdout:skipping the directory /tmp 2024-09-17T03:06:36.960 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:06:37.132 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T03:06:37.148 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T03:06:37.148 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:06:37.148 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T03:06:37.148 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:06:37.538 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T03:06:37.582 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T03:06:37.615 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T03:06:37.712 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T03:06:37.762 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T03:06:37.815 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T03:06:37.903 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T03:06:37.935 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T03:06:38.124 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T03:06:38.158 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T03:06:38.236 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T03:06:38.727 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T03:06:38.754 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T03:06:38.754 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:06:38.754 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T03:06:38.754 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T03:06:38.754 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T03:06:38.755 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:06:38.986 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T03:06:39.009 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T03:06:39.010 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:06:39.010 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T03:06:39.010 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T03:06:39.010 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T03:06:39.010 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:06:39.152 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T03:06:39.285 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T03:06:39.479 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T03:06:39.502 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T03:06:39.502 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:06:39.502 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T03:06:39.502 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T03:06:39.502 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T03:06:39.502 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:06:39.609 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T03:06:39.666 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T03:06:39.721 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T03:06:39.906 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T03:06:39.955 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T03:06:40.032 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T03:06:40.120 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T03:06:40.268 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T03:06:40.313 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T03:06:40.345 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T03:06:40.372 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T03:06:40.526 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T03:06:40.626 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T03:06:40.653 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T03:06:40.687 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T03:06:40.827 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T03:06:40.854 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T03:06:40.912 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 127/165 2024-09-17T03:06:40.978 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 128/165 2024-09-17T03:06:41.002 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T03:06:41.012 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T03:06:41.059 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T03:06:41.149 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 102/165 2024-09-17T03:06:41.180 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 103/165 2024-09-17T03:06:41.216 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T03:06:41.723 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T03:06:41.753 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T03:06:41.824 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 106/165 2024-09-17T03:06:41.855 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 107/165 2024-09-17T03:06:44.065 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:06:44.104 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:06:44.191 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T03:06:44.242 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T03:06:44.679 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 108/165 2024-09-17T03:06:44.724 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T03:06:44.816 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 109/165 2024-09-17T03:06:44.816 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T03:06:44.816 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T03:06:44.816 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:06:44.859 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T03:06:45.202 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T03:06:45.233 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T03:06:45.348 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T03:06:45.517 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 132/165 2024-09-17T03:06:45.544 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T03:06:45.567 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T03:06:45.567 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:06:45.568 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T03:06:45.568 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T03:06:45.568 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T03:06:45.568 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:06:45.619 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T03:06:45.632 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T03:06:45.731 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 135/165 2024-09-17T03:06:45.781 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 136/165 2024-09-17T03:06:46.739 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T03:06:46.764 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T03:06:46.787 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T03:06:46.788 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:06:46.788 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T03:06:46.788 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T03:06:46.788 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T03:06:46.788 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:06:46.839 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T03:06:46.863 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T03:06:46.863 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:06:46.863 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T03:06:46.863 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:06:46.915 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T03:06:46.939 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T03:06:46.939 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:06:46.939 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T03:06:46.939 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T03:06:46.939 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T03:06:46.939 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:06:47.257 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T03:06:47.281 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T03:06:47.281 INFO:teuthology.orchestra.run.smithi078.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:06:47.281 INFO:teuthology.orchestra.run.smithi078.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T03:06:47.281 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T03:06:47.281 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T03:06:47.281 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:06:51.278 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 142/165 2024-09-17T03:06:51.328 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 143/165 2024-09-17T03:06:51.368 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 144/165 2024-09-17T03:06:51.400 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T03:06:51.427 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T03:06:51.609 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 147/165 2024-09-17T03:06:51.657 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T03:06:51.687 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 149/165 2024-09-17T03:06:51.718 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T03:06:51.764 INFO:teuthology.orchestra.run.smithi078.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T03:06:52.394 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:06:52.436 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:06:52.456 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:06:53.273 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 153/165 2024-09-17T03:06:53.358 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T03:06:53.399 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T03:06:53.489 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T03:06:53.519 INFO:teuthology.orchestra.run.smithi078.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T03:06:53.545 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T03:06:53.578 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T03:06:53.579 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T03:06:53.662 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T03:06:53.663 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T03:06:53.739 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T03:06:53.763 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T03:06:53.769 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:06:53.769 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:06:53.957 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:06:53.957 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T03:06:54.041 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T03:06:54.107 INFO:teuthology.orchestra.run.smithi078.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:06:56.673 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 110/165 2024-09-17T03:06:56.673 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /sys 2024-09-17T03:06:56.673 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /proc 2024-09-17T03:06:56.673 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /mnt 2024-09-17T03:06:56.673 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /var/tmp 2024-09-17T03:06:56.673 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /home 2024-09-17T03:06:56.673 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /root 2024-09-17T03:06:56.674 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /tmp 2024-09-17T03:06:56.674 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:06:56.848 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T03:06:56.865 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 111/165 2024-09-17T03:06:56.865 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:06:56.865 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T03:06:56.865 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:06:58.468 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T03:06:58.494 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 112/165 2024-09-17T03:06:58.494 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:06:58.494 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T03:06:58.494 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T03:06:58.494 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T03:06:58.494 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:06:58.727 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T03:06:58.750 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 113/165 2024-09-17T03:06:58.750 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:06:58.750 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T03:06:58.750 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T03:06:58.750 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T03:06:58.751 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:06:59.219 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T03:06:59.243 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 114/165 2024-09-17T03:06:59.243 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:06:59.243 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T03:06:59.243 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T03:06:59.243 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T03:06:59.243 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:06:59.341 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T03:06:59.398 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T03:06:59.454 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T03:06:59.638 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T03:06:59.678 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T03:06:59.756 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T03:06:59.854 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T03:07:00.002 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T03:07:00.038 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T03:07:00.069 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T03:07:00.097 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T03:07:00.234 INFO:teuthology.orchestra.run.smithi078.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:07:00.235 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 1/165 2024-09-17T03:07:00.235 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2/165 2024-09-17T03:07:00.235 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 3/165 2024-09-17T03:07:00.235 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 4/165 2024-09-17T03:07:00.235 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 5/165 2024-09-17T03:07:00.235 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 6/165 2024-09-17T03:07:00.235 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 7/165 2024-09-17T03:07:00.235 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:07:00.235 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:07:00.235 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T03:07:00.235 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 11/165 2024-09-17T03:07:00.235 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 12/165 2024-09-17T03:07:00.235 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 13/165 2024-09-17T03:07:00.235 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:07:00.236 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 15/165 2024-09-17T03:07:00.236 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 16/165 2024-09-17T03:07:00.236 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 17/165 2024-09-17T03:07:00.236 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 18/165 2024-09-17T03:07:00.236 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 19/165 2024-09-17T03:07:00.236 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 20/165 2024-09-17T03:07:00.236 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 21/165 2024-09-17T03:07:00.236 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 22/165 2024-09-17T03:07:00.236 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 23/165 2024-09-17T03:07:00.236 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 24/165 2024-09-17T03:07:00.236 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 25/165 2024-09-17T03:07:00.236 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 26/165 2024-09-17T03:07:00.237 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 27/165 2024-09-17T03:07:00.237 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 28/165 2024-09-17T03:07:00.237 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 29/165 2024-09-17T03:07:00.237 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 30/165 2024-09-17T03:07:00.249 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 31/165 2024-09-17T03:07:00.249 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 32/165 2024-09-17T03:07:00.249 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 33/165 2024-09-17T03:07:00.249 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 34/165 2024-09-17T03:07:00.249 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 35/165 2024-09-17T03:07:00.249 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 36/165 2024-09-17T03:07:00.249 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 37/165 2024-09-17T03:07:00.249 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 38/165 2024-09-17T03:07:00.249 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 39/165 2024-09-17T03:07:00.249 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T03:07:00.249 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T03:07:00.250 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T03:07:00.250 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T03:07:00.250 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T03:07:00.250 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T03:07:00.250 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T03:07:00.250 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T03:07:00.250 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T03:07:00.250 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T03:07:00.250 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T03:07:00.250 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T03:07:00.250 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T03:07:00.250 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T03:07:00.250 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T03:07:00.251 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T03:07:00.251 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T03:07:00.251 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T03:07:00.251 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T03:07:00.251 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T03:07:00.251 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T03:07:00.251 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T03:07:00.251 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T03:07:00.251 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T03:07:00.251 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T03:07:00.251 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T03:07:00.251 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T03:07:00.251 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T03:07:00.252 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T03:07:00.252 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T03:07:00.252 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T03:07:00.252 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T03:07:00.252 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T03:07:00.252 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T03:07:00.252 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T03:07:00.252 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T03:07:00.252 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T03:07:00.252 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T03:07:00.252 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T03:07:00.252 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T03:07:00.252 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T03:07:00.253 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T03:07:00.253 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T03:07:00.253 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T03:07:00.253 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T03:07:00.253 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T03:07:00.253 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T03:07:00.253 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T03:07:00.253 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T03:07:00.253 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T03:07:00.253 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T03:07:00.254 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T03:07:00.254 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T03:07:00.254 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T03:07:00.254 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T03:07:00.254 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T03:07:00.254 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T03:07:00.254 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T03:07:00.254 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T03:07:00.254 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T03:07:00.254 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T03:07:00.254 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T03:07:00.254 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T03:07:00.254 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T03:07:00.255 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T03:07:00.255 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T03:07:00.255 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T03:07:00.255 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T03:07:00.255 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T03:07:00.255 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T03:07:00.255 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T03:07:00.255 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T03:07:00.255 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T03:07:00.255 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T03:07:00.255 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T03:07:00.255 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T03:07:00.255 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T03:07:00.256 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T03:07:00.256 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T03:07:00.256 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T03:07:00.256 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T03:07:00.256 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T03:07:00.256 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T03:07:00.256 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T03:07:00.256 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T03:07:00.256 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T03:07:00.256 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T03:07:00.256 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T03:07:00.256 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T03:07:00.256 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T03:07:00.257 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T03:07:00.257 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T03:07:00.257 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T03:07:00.257 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T03:07:00.257 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T03:07:00.257 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T03:07:00.257 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T03:07:00.257 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T03:07:00.257 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T03:07:00.257 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T03:07:00.257 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T03:07:00.257 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T03:07:00.257 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T03:07:00.257 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T03:07:00.258 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T03:07:00.258 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T03:07:00.258 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T03:07:00.258 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T03:07:00.258 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T03:07:00.258 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T03:07:00.258 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 150/165 2024-09-17T03:07:00.258 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T03:07:00.258 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 152/165 2024-09-17T03:07:00.258 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T03:07:00.258 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T03:07:00.258 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T03:07:00.258 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T03:07:00.259 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T03:07:00.259 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T03:07:00.259 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T03:07:00.259 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T03:07:00.259 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T03:07:00.259 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T03:07:00.259 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T03:07:00.259 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T03:07:00.519 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T03:07:00.546 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 126/165 2024-09-17T03:07:00.578 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 127/165 2024-09-17T03:07:00.644 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 128/165 2024-09-17T03:07:00.678 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T03:07:02.856 INFO:teuthology.orchestra.run.smithi078.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:07:02.856 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:02.857 INFO:teuthology.orchestra.run.smithi078.stdout:Upgraded: 2024-09-17T03:07:02.857 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T03:07:02.857 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T03:07:02.857 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T03:07:02.857 INFO:teuthology.orchestra.run.smithi078.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T03:07:02.857 INFO:teuthology.orchestra.run.smithi078.stdout: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.857 INFO:teuthology.orchestra.run.smithi078.stdout: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.857 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T03:07:02.857 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T03:07:02.857 INFO:teuthology.orchestra.run.smithi078.stdout:Installed: 2024-09-17T03:07:02.857 INFO:teuthology.orchestra.run.smithi078.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T03:07:02.857 INFO:teuthology.orchestra.run.smithi078.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T03:07:02.858 INFO:teuthology.orchestra.run.smithi078.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T03:07:02.858 INFO:teuthology.orchestra.run.smithi078.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T03:07:02.858 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.858 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.858 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.858 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.858 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:07:02.858 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-immutable-object-cache-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.858 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.858 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.858 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:07:02.858 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:07:02.858 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:07:02.859 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:07:02.859 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:07:02.859 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.859 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.859 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:07:02.859 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.859 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.859 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.859 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:07:02.859 INFO:teuthology.orchestra.run.smithi078.stdout: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:07:02.859 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.859 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.859 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:07:02.859 INFO:teuthology.orchestra.run.smithi078.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T03:07:02.859 INFO:teuthology.orchestra.run.smithi078.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T03:07:02.860 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T03:07:02.860 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T03:07:02.860 INFO:teuthology.orchestra.run.smithi078.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T03:07:02.860 INFO:teuthology.orchestra.run.smithi078.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T03:07:02.860 INFO:teuthology.orchestra.run.smithi078.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T03:07:02.860 INFO:teuthology.orchestra.run.smithi078.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T03:07:02.860 INFO:teuthology.orchestra.run.smithi078.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T03:07:02.860 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T03:07:02.860 INFO:teuthology.orchestra.run.smithi078.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T03:07:02.860 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.860 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.860 INFO:teuthology.orchestra.run.smithi078.stdout: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.860 INFO:teuthology.orchestra.run.smithi078.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T03:07:02.860 INFO:teuthology.orchestra.run.smithi078.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T03:07:02.861 INFO:teuthology.orchestra.run.smithi078.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T03:07:02.861 INFO:teuthology.orchestra.run.smithi078.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T03:07:02.861 INFO:teuthology.orchestra.run.smithi078.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T03:07:02.861 INFO:teuthology.orchestra.run.smithi078.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T03:07:02.861 INFO:teuthology.orchestra.run.smithi078.stdout: librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.861 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.861 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T03:07:02.861 INFO:teuthology.orchestra.run.smithi078.stdout: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.861 INFO:teuthology.orchestra.run.smithi078.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T03:07:02.861 INFO:teuthology.orchestra.run.smithi078.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T03:07:02.861 INFO:teuthology.orchestra.run.smithi078.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T03:07:02.861 INFO:teuthology.orchestra.run.smithi078.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T03:07:02.862 INFO:teuthology.orchestra.run.smithi078.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T03:07:02.862 INFO:teuthology.orchestra.run.smithi078.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T03:07:02.862 INFO:teuthology.orchestra.run.smithi078.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T03:07:02.862 INFO:teuthology.orchestra.run.smithi078.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T03:07:02.862 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T03:07:02.862 INFO:teuthology.orchestra.run.smithi078.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T03:07:02.862 INFO:teuthology.orchestra.run.smithi078.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T03:07:02.862 INFO:teuthology.orchestra.run.smithi078.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T03:07:02.862 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T03:07:02.862 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T03:07:02.862 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T03:07:02.862 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T03:07:02.863 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T03:07:02.863 INFO:teuthology.orchestra.run.smithi078.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T03:07:02.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T03:07:02.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T03:07:02.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T03:07:02.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T03:07:02.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T03:07:02.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T03:07:02.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T03:07:02.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T03:07:02.863 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T03:07:02.864 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T03:07:02.864 INFO:teuthology.orchestra.run.smithi078.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T03:07:02.864 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T03:07:02.864 INFO:teuthology.orchestra.run.smithi078.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T03:07:02.864 INFO:teuthology.orchestra.run.smithi078.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T03:07:02.864 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T03:07:02.864 INFO:teuthology.orchestra.run.smithi078.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T03:07:02.864 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T03:07:02.864 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T03:07:02.864 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T03:07:02.864 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T03:07:02.864 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T03:07:02.864 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T03:07:02.864 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T03:07:02.865 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T03:07:02.865 INFO:teuthology.orchestra.run.smithi078.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T03:07:02.865 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T03:07:02.865 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T03:07:02.865 INFO:teuthology.orchestra.run.smithi078.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T03:07:02.865 INFO:teuthology.orchestra.run.smithi078.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T03:07:02.865 INFO:teuthology.orchestra.run.smithi078.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T03:07:02.865 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T03:07:02.865 INFO:teuthology.orchestra.run.smithi078.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T03:07:02.865 INFO:teuthology.orchestra.run.smithi078.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T03:07:02.865 INFO:teuthology.orchestra.run.smithi078.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T03:07:02.865 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T03:07:02.865 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T03:07:02.866 INFO:teuthology.orchestra.run.smithi078.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T03:07:02.866 INFO:teuthology.orchestra.run.smithi078.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T03:07:02.866 INFO:teuthology.orchestra.run.smithi078.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T03:07:02.866 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T03:07:02.866 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T03:07:02.866 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T03:07:02.866 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T03:07:02.866 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T03:07:02.866 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T03:07:02.866 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.866 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.866 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T03:07:02.866 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T03:07:02.866 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T03:07:02.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T03:07:02.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T03:07:02.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T03:07:02.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T03:07:02.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T03:07:02.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T03:07:02.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T03:07:02.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T03:07:02.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T03:07:02.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T03:07:02.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T03:07:02.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T03:07:02.867 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T03:07:02.867 INFO:teuthology.orchestra.run.smithi078.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T03:07:02.868 INFO:teuthology.orchestra.run.smithi078.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T03:07:02.868 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.868 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.868 INFO:teuthology.orchestra.run.smithi078.stdout: rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:02.868 INFO:teuthology.orchestra.run.smithi078.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T03:07:02.868 INFO:teuthology.orchestra.run.smithi078.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T03:07:02.868 INFO:teuthology.orchestra.run.smithi078.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T03:07:02.868 INFO:teuthology.orchestra.run.smithi078.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T03:07:02.868 INFO:teuthology.orchestra.run.smithi078.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T03:07:02.868 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T03:07:02.869 INFO:teuthology.orchestra.run.smithi078.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T03:07:02.869 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:02.869 INFO:teuthology.orchestra.run.smithi078.stdout:Complete! 2024-09-17T03:07:03.315 DEBUG:teuthology.parallel:result is None 2024-09-17T03:07:03.847 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 129/165 2024-09-17T03:07:03.918 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T03:07:04.883 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 130/165 2024-09-17T03:07:04.910 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T03:07:05.025 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 131/165 2024-09-17T03:07:05.185 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 132/165 2024-09-17T03:07:05.212 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T03:07:05.236 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 133/165 2024-09-17T03:07:05.236 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:07:05.236 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T03:07:05.236 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T03:07:05.236 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T03:07:05.236 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:05.279 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T03:07:05.291 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 134/165 2024-09-17T03:07:05.389 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 135/165 2024-09-17T03:07:05.447 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 136/165 2024-09-17T03:07:06.406 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T03:07:06.440 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T03:07:06.463 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 138/165 2024-09-17T03:07:06.464 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:07:06.464 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T03:07:06.464 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T03:07:06.464 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T03:07:06.464 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:06.508 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T03:07:06.531 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 139/165 2024-09-17T03:07:06.531 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:07:06.531 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T03:07:06.531 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:06.575 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T03:07:06.599 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 140/165 2024-09-17T03:07:06.599 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:07:06.599 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T03:07:06.599 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T03:07:06.599 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T03:07:06.599 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:06.917 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T03:07:06.941 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 141/165 2024-09-17T03:07:06.941 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T03:07:06.941 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T03:07:06.941 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T03:07:06.941 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T03:07:06.941 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:10.964 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 142/165 2024-09-17T03:07:11.013 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 143/165 2024-09-17T03:07:11.054 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 144/165 2024-09-17T03:07:11.086 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T03:07:11.113 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T03:07:11.297 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 147/165 2024-09-17T03:07:11.344 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T03:07:11.374 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 149/165 2024-09-17T03:07:11.404 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T03:07:11.450 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T03:07:12.049 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:07:12.081 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:07:12.102 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T03:07:12.926 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 153/165 2024-09-17T03:07:13.020 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T03:07:13.107 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T03:07:13.198 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T03:07:13.232 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T03:07:13.258 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T03:07:13.283 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T03:07:13.283 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T03:07:13.368 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T03:07:13.368 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T03:07:13.452 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T03:07:13.477 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T03:07:13.482 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:07:13.482 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:07:13.665 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T03:07:13.665 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T03:07:13.746 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T03:07:13.810 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:07:20.190 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:07:20.190 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 1/165 2024-09-17T03:07:20.191 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2/165 2024-09-17T03:07:20.191 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 3/165 2024-09-17T03:07:20.191 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 4/165 2024-09-17T03:07:20.191 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4989.gce1b3 5/165 2024-09-17T03:07:20.191 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 6/165 2024-09-17T03:07:20.191 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 7/165 2024-09-17T03:07:20.191 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 8/165 2024-09-17T03:07:20.191 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 9/165 2024-09-17T03:07:20.191 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 10/165 2024-09-17T03:07:20.191 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 11/165 2024-09-17T03:07:20.191 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 12/165 2024-09-17T03:07:20.192 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 13/165 2024-09-17T03:07:20.192 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 14/165 2024-09-17T03:07:20.192 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_ 15/165 2024-09-17T03:07:20.192 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 16/165 2024-09-17T03:07:20.192 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 17/165 2024-09-17T03:07:20.192 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_6 18/165 2024-09-17T03:07:20.192 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86 19/165 2024-09-17T03:07:20.192 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 20/165 2024-09-17T03:07:20.192 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el 21/165 2024-09-17T03:07:20.192 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ceph-common-2:19.3.0-4989.gce1b342b.el9. 22/165 2024-09-17T03:07:20.192 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_6 23/165 2024-09-17T03:07:20.192 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 24/165 2024-09-17T03:07:20.192 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 25/165 2024-09-17T03:07:20.192 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 26/165 2024-09-17T03:07:20.193 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 27/165 2024-09-17T03:07:20.204 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 28/165 2024-09-17T03:07:20.204 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 29/165 2024-09-17T03:07:20.204 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b. 30/165 2024-09-17T03:07:20.204 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noa 31/165 2024-09-17T03:07:20.204 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.n 32/165 2024-09-17T03:07:20.205 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1 33/165 2024-09-17T03:07:20.205 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el 34/165 2024-09-17T03:07:20.205 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 35/165 2024-09-17T03:07:20.205 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.e 36/165 2024-09-17T03:07:20.205 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 37/165 2024-09-17T03:07:20.205 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 38/165 2024-09-17T03:07:20.205 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 39/165 2024-09-17T03:07:20.205 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T03:07:20.205 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T03:07:20.205 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T03:07:20.205 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T03:07:20.205 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T03:07:20.206 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T03:07:20.206 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T03:07:20.206 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T03:07:20.206 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T03:07:20.206 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T03:07:20.206 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T03:07:20.206 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T03:07:20.206 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T03:07:20.206 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T03:07:20.206 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T03:07:20.206 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T03:07:20.206 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T03:07:20.206 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T03:07:20.207 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T03:07:20.207 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T03:07:20.207 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T03:07:20.207 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T03:07:20.207 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T03:07:20.207 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T03:07:20.207 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T03:07:20.207 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T03:07:20.207 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T03:07:20.207 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T03:07:20.207 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T03:07:20.207 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T03:07:20.207 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T03:07:20.208 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T03:07:20.208 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T03:07:20.208 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T03:07:20.208 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T03:07:20.208 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T03:07:20.208 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T03:07:20.208 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T03:07:20.208 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T03:07:20.208 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T03:07:20.208 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T03:07:20.208 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T03:07:20.208 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T03:07:20.208 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T03:07:20.209 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T03:07:20.209 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T03:07:20.209 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T03:07:20.209 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T03:07:20.209 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T03:07:20.209 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T03:07:20.209 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T03:07:20.209 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T03:07:20.209 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T03:07:20.209 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T03:07:20.209 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T03:07:20.209 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T03:07:20.209 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T03:07:20.209 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T03:07:20.210 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T03:07:20.210 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T03:07:20.210 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T03:07:20.210 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T03:07:20.210 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T03:07:20.210 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T03:07:20.210 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T03:07:20.210 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T03:07:20.210 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T03:07:20.210 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T03:07:20.210 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T03:07:20.210 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T03:07:20.210 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T03:07:20.211 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T03:07:20.211 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T03:07:20.211 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T03:07:20.211 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T03:07:20.211 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T03:07:20.211 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T03:07:20.211 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T03:07:20.211 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T03:07:20.211 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T03:07:20.211 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T03:07:20.211 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T03:07:20.211 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T03:07:20.211 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T03:07:20.212 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T03:07:20.212 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T03:07:20.212 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T03:07:20.212 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T03:07:20.212 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T03:07:20.212 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T03:07:20.212 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T03:07:20.212 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T03:07:20.212 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T03:07:20.212 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T03:07:20.212 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T03:07:20.212 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T03:07:20.213 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T03:07:20.213 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T03:07:20.213 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T03:07:20.213 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T03:07:20.213 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T03:07:20.213 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T03:07:20.213 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T03:07:20.213 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T03:07:20.213 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T03:07:20.213 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T03:07:20.213 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T03:07:20.213 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T03:07:20.213 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T03:07:20.214 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T03:07:20.214 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 150/165 2024-09-17T03:07:20.214 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T03:07:20.214 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 152/165 2024-09-17T03:07:20.214 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T03:07:20.214 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T03:07:20.214 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T03:07:20.214 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T03:07:20.214 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T03:07:20.214 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T03:07:20.214 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T03:07:20.214 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T03:07:20.214 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T03:07:20.214 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T03:07:20.215 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T03:07:20.215 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T03:07:22.600 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T03:07:22.600 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:22.600 INFO:teuthology.orchestra.run.smithi193.stdout:Upgraded: 2024-09-17T03:07:22.600 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T03:07:22.600 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T03:07:22.600 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T03:07:22.600 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T03:07:22.601 INFO:teuthology.orchestra.run.smithi193.stdout: librados2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.601 INFO:teuthology.orchestra.run.smithi193.stdout: librbd1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.601 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T03:07:22.601 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T03:07:22.601 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-09-17T03:07:22.601 INFO:teuthology.orchestra.run.smithi193.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T03:07:22.601 INFO:teuthology.orchestra.run.smithi193.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T03:07:22.601 INFO:teuthology.orchestra.run.smithi193.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T03:07:22.601 INFO:teuthology.orchestra.run.smithi193.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T03:07:22.601 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.601 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-base-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.602 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.602 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.602 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-grafana-dashboards-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:07:22.602 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-immutable-object-cache-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.602 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mds-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.602 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.602 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:07:22.602 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-dashboard-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:07:22.603 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:07:22.603 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-modules-core-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:07:22.603 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-rook-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:07:22.603 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mon-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.603 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-osd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.603 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-prometheus-alerts-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:07:22.603 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-radosgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.603 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-selinux-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.603 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-test-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.603 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-volume-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:07:22.604 INFO:teuthology.orchestra.run.smithi193.stdout: cephadm-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:07:22.604 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.604 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-shell-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.604 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-top-2:19.3.0-4989.gce1b342b.el9.noarch 2024-09-17T03:07:22.604 INFO:teuthology.orchestra.run.smithi193.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T03:07:22.604 INFO:teuthology.orchestra.run.smithi193.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T03:07:22.604 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T03:07:22.604 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T03:07:22.604 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T03:07:22.604 INFO:teuthology.orchestra.run.smithi193.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T03:07:22.604 INFO:teuthology.orchestra.run.smithi193.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T03:07:22.605 INFO:teuthology.orchestra.run.smithi193.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T03:07:22.605 INFO:teuthology.orchestra.run.smithi193.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T03:07:22.605 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T03:07:22.605 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T03:07:22.605 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.605 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.605 INFO:teuthology.orchestra.run.smithi193.stdout: libcephsqlite-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.605 INFO:teuthology.orchestra.run.smithi193.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T03:07:22.605 INFO:teuthology.orchestra.run.smithi193.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T03:07:22.605 INFO:teuthology.orchestra.run.smithi193.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T03:07:22.605 INFO:teuthology.orchestra.run.smithi193.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T03:07:22.606 INFO:teuthology.orchestra.run.smithi193.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T03:07:22.606 INFO:teuthology.orchestra.run.smithi193.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T03:07:22.606 INFO:teuthology.orchestra.run.smithi193.stdout: librados-devel-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.606 INFO:teuthology.orchestra.run.smithi193.stdout: libradosstriper1-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.606 INFO:teuthology.orchestra.run.smithi193.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T03:07:22.606 INFO:teuthology.orchestra.run.smithi193.stdout: librgw2-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.607 INFO:teuthology.orchestra.run.smithi193.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T03:07:22.607 INFO:teuthology.orchestra.run.smithi193.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T03:07:22.607 INFO:teuthology.orchestra.run.smithi193.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T03:07:22.607 INFO:teuthology.orchestra.run.smithi193.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T03:07:22.607 INFO:teuthology.orchestra.run.smithi193.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T03:07:22.607 INFO:teuthology.orchestra.run.smithi193.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T03:07:22.607 INFO:teuthology.orchestra.run.smithi193.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T03:07:22.607 INFO:teuthology.orchestra.run.smithi193.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T03:07:22.607 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T03:07:22.607 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T03:07:22.607 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T03:07:22.608 INFO:teuthology.orchestra.run.smithi193.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T03:07:22.608 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T03:07:22.608 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T03:07:22.608 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T03:07:22.608 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T03:07:22.608 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T03:07:22.608 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T03:07:22.608 INFO:teuthology.orchestra.run.smithi193.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T03:07:22.608 INFO:teuthology.orchestra.run.smithi193.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T03:07:22.608 INFO:teuthology.orchestra.run.smithi193.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T03:07:22.608 INFO:teuthology.orchestra.run.smithi193.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T03:07:22.608 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T03:07:22.608 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-argparse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.608 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-common-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.609 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cephfs-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.609 INFO:teuthology.orchestra.run.smithi193.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T03:07:22.609 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T03:07:22.609 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T03:07:22.609 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T03:07:22.609 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T03:07:22.609 INFO:teuthology.orchestra.run.smithi193.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T03:07:22.609 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T03:07:22.609 INFO:teuthology.orchestra.run.smithi193.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T03:07:22.609 INFO:teuthology.orchestra.run.smithi193.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T03:07:22.609 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T03:07:22.609 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T03:07:22.609 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T03:07:22.610 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T03:07:22.610 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T03:07:22.610 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T03:07:22.610 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T03:07:22.610 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T03:07:22.610 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T03:07:22.610 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T03:07:22.610 INFO:teuthology.orchestra.run.smithi193.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T03:07:22.610 INFO:teuthology.orchestra.run.smithi193.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T03:07:22.610 INFO:teuthology.orchestra.run.smithi193.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T03:07:22.610 INFO:teuthology.orchestra.run.smithi193.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T03:07:22.610 INFO:teuthology.orchestra.run.smithi193.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T03:07:22.611 INFO:teuthology.orchestra.run.smithi193.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T03:07:22.611 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T03:07:22.611 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T03:07:22.611 INFO:teuthology.orchestra.run.smithi193.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T03:07:22.611 INFO:teuthology.orchestra.run.smithi193.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T03:07:22.611 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T03:07:22.611 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T03:07:22.611 INFO:teuthology.orchestra.run.smithi193.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T03:07:22.611 INFO:teuthology.orchestra.run.smithi193.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T03:07:22.611 INFO:teuthology.orchestra.run.smithi193.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T03:07:22.611 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T03:07:22.611 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T03:07:22.611 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T03:07:22.612 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T03:07:22.612 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T03:07:22.612 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T03:07:22.612 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rados-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.612 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.612 INFO:teuthology.orchestra.run.smithi193.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T03:07:22.612 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T03:07:22.612 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T03:07:22.612 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rgw-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.612 INFO:teuthology.orchestra.run.smithi193.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T03:07:22.612 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T03:07:22.612 INFO:teuthology.orchestra.run.smithi193.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T03:07:22.613 INFO:teuthology.orchestra.run.smithi193.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T03:07:22.613 INFO:teuthology.orchestra.run.smithi193.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T03:07:22.613 INFO:teuthology.orchestra.run.smithi193.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T03:07:22.613 INFO:teuthology.orchestra.run.smithi193.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T03:07:22.613 INFO:teuthology.orchestra.run.smithi193.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T03:07:22.613 INFO:teuthology.orchestra.run.smithi193.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T03:07:22.613 INFO:teuthology.orchestra.run.smithi193.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T03:07:22.613 INFO:teuthology.orchestra.run.smithi193.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T03:07:22.613 INFO:teuthology.orchestra.run.smithi193.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T03:07:22.613 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T03:07:22.613 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T03:07:22.614 INFO:teuthology.orchestra.run.smithi193.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T03:07:22.614 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-fuse-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.614 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-mirror-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.614 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-nbd-2:19.3.0-4989.gce1b342b.el9.x86_64 2024-09-17T03:07:22.614 INFO:teuthology.orchestra.run.smithi193.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T03:07:22.614 INFO:teuthology.orchestra.run.smithi193.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T03:07:22.614 INFO:teuthology.orchestra.run.smithi193.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T03:07:22.614 INFO:teuthology.orchestra.run.smithi193.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T03:07:22.614 INFO:teuthology.orchestra.run.smithi193.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T03:07:22.614 INFO:teuthology.orchestra.run.smithi193.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T03:07:22.615 INFO:teuthology.orchestra.run.smithi193.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T03:07:22.615 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:22.615 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-09-17T03:07:23.028 DEBUG:teuthology.parallel:result is None 2024-09-17T03:07:23.029 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T03:07:23.168 DEBUG:teuthology.orchestra.run.smithi078:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T03:07:23.196 INFO:teuthology.orchestra.run.smithi078.stdout:19.3.0-4989.gce1b342b.el9 2024-09-17T03:07:23.196 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989.gce1b342b.el9 2024-09-17T03:07:23.196 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989.gce1b342b is installed. 2024-09-17T03:07:23.198 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ce1b342bf8c6349a8c90cd607f83bff2443f21cf 2024-09-17T03:07:23.337 DEBUG:teuthology.orchestra.run.smithi193:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T03:07:23.359 INFO:teuthology.orchestra.run.smithi193.stdout:19.3.0-4989.gce1b342b.el9 2024-09-17T03:07:23.359 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4989.gce1b342b.el9 2024-09-17T03:07:23.359 INFO:teuthology.task.install:The correct ceph version 19.3.0-4989.gce1b342b is installed. 2024-09-17T03:07:23.361 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T03:07:23.362 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:07:23.362 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T03:07:23.394 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:07:23.394 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T03:07:23.427 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T03:07:23.427 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:07:23.427 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T03:07:23.463 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T03:07:23.531 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:07:23.531 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T03:07:23.557 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T03:07:23.622 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T03:07:23.623 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:07:23.623 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T03:07:23.648 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T03:07:23.713 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:07:23.713 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T03:07:23.738 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T03:07:23.802 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T03:07:23.802 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:07:23.803 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T03:07:23.828 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T03:07:23.892 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:07:23.892 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T03:07:23.917 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T03:07:23.982 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T03:07:24.068 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T03:07:24.069 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /var/log/ceph 2024-09-17T03:07:24.071 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 777 /var/log/ceph 2024-09-17T03:07:24.095 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T03:07:24.096 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T03:07:24.136 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T03:07:24.160 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T03:07:24.161 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T03:07:24.201 DEBUG:teuthology.orchestra.run.smithi193:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T03:07:24.231 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-17T03:07:24.231 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-17T03:07:24.231 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-17T03:07:24.232 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:07:24.232 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T03:07:24.279 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T03:07:24.389 DEBUG:teuthology.orchestra.run.smithi078:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T03:07:24.414 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:07:24.414 DEBUG:teuthology.orchestra.run.smithi193:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T03:07:24.430 DEBUG:teuthology.orchestra.run.smithi193:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T03:07:24.538 DEBUG:teuthology.orchestra.run.smithi193:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T03:07:24.568 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T03:07:24.568 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Scrub error on inode'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T03:07:24.568 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908403', 'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/multimds_misc}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7908403', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240916.200549-debug'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Scrub error on inode'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240916.200549-debug', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 476, 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'sleep_before_teardown': 0, 'subset': '320/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240916.200549-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_ce1b342bf8c6349a8c90cd607f83bff2443f21cf/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi078.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKidAJ8ZGrB/2azLewnAOM0pFWzXIvn7vN0d5x3fotxFn2zJjWAFJxhD5x4Mlpv1TeCeMEdSmv/Eogq9MqN3VWk=', 'smithi193.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJM7ci1bXLNmRhbYA0XJhxBSeEPoCBajjC1mkkYLW02zKudBG4/fXbX1TSQPNn2IZNa3Q6to5SVwlEHG+zNSntg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'Scrub error on inode'], 'sha1': 'ce1b342bf8c6349a8c90cd607f83bff2443f21cf', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_multimds_misc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_02:09:51', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T03:07:24.569 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T03:07:24.571 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T03:07:24.618 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T03:07:24.626 DEBUG:teuthology.orchestra.run.smithi193:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T03:07:24.683 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:07:24.683 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T03:07:24.705 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T03:07:24.705 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2024-09-17T03:07:24.761 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T03:07:24.761 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:07:24.761 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-17T03:07:24.761 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:07:24.761 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:07:24.761 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-17 03:06:54.478678971 +0000 2024-09-17T03:07:24.761 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-17 03:05:05.011027825 +0000 2024-09-17T03:07:24.761 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-17 03:05:05.011027825 +0000 2024-09-17T03:07:24.761 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-17 03:05:05.011027825 +0000 2024-09-17T03:07:24.762 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T03:07:24.824 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-17T03:07:24.824 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-17T03:07:24.824 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.00019933 s, 2.6 MB/s 2024-09-17T03:07:24.825 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T03:07:24.882 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2024-09-17T03:07:24.938 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T03:07:24.938 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:07:24.938 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-17T03:07:24.938 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:07:24.938 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:07:24.938 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-17 03:06:54.478678971 +0000 2024-09-17T03:07:24.938 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-17 03:05:05.325022832 +0000 2024-09-17T03:07:24.938 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-17 03:05:05.325022832 +0000 2024-09-17T03:07:24.938 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-17 03:05:05.325022832 +0000 2024-09-17T03:07:24.939 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T03:07:25.002 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-17T03:07:25.002 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-17T03:07:25.002 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000185924 s, 2.8 MB/s 2024-09-17T03:07:25.003 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T03:07:25.059 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2024-09-17T03:07:25.114 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T03:07:25.115 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:07:25.115 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-17T03:07:25.115 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:07:25.115 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:07:25.115 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-17 03:06:54.479678954 +0000 2024-09-17T03:07:25.115 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-17 03:05:05.657017553 +0000 2024-09-17T03:07:25.115 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-17 03:05:05.657017553 +0000 2024-09-17T03:07:25.115 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-17 03:05:05.657017553 +0000 2024-09-17T03:07:25.115 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T03:07:25.178 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-17T03:07:25.178 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-17T03:07:25.178 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000231568 s, 2.2 MB/s 2024-09-17T03:07:25.180 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T03:07:25.236 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2024-09-17T03:07:25.290 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T03:07:25.290 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:07:25.291 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-17T03:07:25.291 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:07:25.291 INFO:teuthology.orchestra.run.smithi078.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:07:25.291 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-17 03:06:54.479678954 +0000 2024-09-17T03:07:25.291 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-17 03:05:05.966012640 +0000 2024-09-17T03:07:25.291 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-17 03:05:05.966012640 +0000 2024-09-17T03:07:25.291 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2024-09-17 03:05:05.966012640 +0000 2024-09-17T03:07:25.291 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T03:07:25.353 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-17T03:07:25.353 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-17T03:07:25.354 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000156887 s, 3.3 MB/s 2024-09-17T03:07:25.355 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T03:07:25.410 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T03:07:25.410 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:07:25.411 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T03:07:25.428 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T03:07:25.428 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_1 2024-09-17T03:07:25.484 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T03:07:25.484 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:07:25.484 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-17T03:07:25.484 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:07:25.484 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:07:25.484 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-17 03:07:14.191666888 +0000 2024-09-17T03:07:25.484 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-17 03:05:05.015767519 +0000 2024-09-17T03:07:25.484 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-17 03:05:05.015767519 +0000 2024-09-17T03:07:25.484 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-09-17 03:05:05.015767519 +0000 2024-09-17T03:07:25.484 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T03:07:25.548 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-17T03:07:25.548 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-17T03:07:25.549 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000266667 s, 1.9 MB/s 2024-09-17T03:07:25.550 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T03:07:25.607 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_2 2024-09-17T03:07:25.663 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T03:07:25.663 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:07:25.663 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-17T03:07:25.664 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:07:25.664 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:07:25.664 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-17 03:07:14.191666888 +0000 2024-09-17T03:07:25.664 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-17 03:05:05.356761902 +0000 2024-09-17T03:07:25.664 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-17 03:05:05.356761902 +0000 2024-09-17T03:07:25.664 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-09-17 03:05:05.356761902 +0000 2024-09-17T03:07:25.664 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T03:07:25.727 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-17T03:07:25.727 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-17T03:07:25.727 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000238627 s, 2.1 MB/s 2024-09-17T03:07:25.728 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T03:07:25.785 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_3 2024-09-17T03:07:25.841 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T03:07:25.841 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:07:25.841 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-17T03:07:25.841 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:07:25.841 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:07:25.841 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-17 03:07:14.192666871 +0000 2024-09-17T03:07:25.841 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-17 03:05:05.662756861 +0000 2024-09-17T03:07:25.842 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-17 03:05:05.662756861 +0000 2024-09-17T03:07:25.842 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-09-17 03:05:05.662756861 +0000 2024-09-17T03:07:25.842 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T03:07:25.904 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-17T03:07:25.904 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-17T03:07:25.904 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000234453 s, 2.2 MB/s 2024-09-17T03:07:25.905 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T03:07:25.961 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_4 2024-09-17T03:07:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T03:07:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T03:07:26.017 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-17T03:07:26.017 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T03:07:26.017 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T03:07:26.017 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-09-17 03:07:14.192666871 +0000 2024-09-17T03:07:26.017 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-09-17 03:05:05.986751524 +0000 2024-09-17T03:07:26.017 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-09-17 03:05:05.986751524 +0000 2024-09-17T03:07:26.017 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-09-17 03:05:05.986751524 +0000 2024-09-17T03:07:26.018 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T03:07:26.079 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-09-17T03:07:26.080 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-09-17T03:07:26.080 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000185041 s, 2.8 MB/s 2024-09-17T03:07:26.081 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T03:07:26.137 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T03:07:26.137 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi193.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T03:07:26.138 INFO:tasks.ceph:Generating config... 2024-09-17T03:07:26.139 INFO:tasks.ceph:[client] pid file = 2024-09-17T03:07:26.139 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-17T03:07:26.139 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T03:07:26.139 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T03:07:26.139 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T03:07:26.139 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T03:07:26.140 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T03:07:26.140 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-17T03:07:26.140 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-17T03:07:26.140 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-17T03:07:26.140 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-17T03:07:26.140 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T03:07:26.140 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T03:07:26.140 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-17T03:07:26.140 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-17T03:07:26.140 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T03:07:26.140 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T03:07:26.141 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-17T03:07:26.141 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T03:07:26.141 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T03:07:26.141 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T03:07:26.141 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T03:07:26.141 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T03:07:26.141 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T03:07:26.141 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T03:07:26.207 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T03:07:26.210 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T03:07:26.265 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T03:07:26.291 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.78'), ('mon.b', '172.21.15.193'), ('mon.c', '[v2:172.21.15.193:3301,v1:172.21.15.193:6790]')] 2024-09-17T03:07:26.291 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.78,172.21.15.193,[v2:172.21.15.193:3301,v1:172.21.15.193:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-17T03:07:26.292 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:07:26.292 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T03:07:26.346 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.78 --add b 172.21.15.193 --addv c '[v2:172.21.15.193:3301,v1:172.21.15.193:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:07:26.443 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:07:26.443 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: generated fsid f3c59ba9-dab4-4ee6-8989-d80d11d430b6 2024-09-17T03:07:26.443 INFO:teuthology.orchestra.run.smithi078.stdout:setting min_mon_release = quincy 2024-09-17T03:07:26.443 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 0 2024-09-17T03:07:26.443 INFO:teuthology.orchestra.run.smithi078.stdout:fsid f3c59ba9-dab4-4ee6-8989-d80d11d430b6 2024-09-17T03:07:26.443 INFO:teuthology.orchestra.run.smithi078.stdout:last_changed 2024-09-17T03:07:26.445129+0000 2024-09-17T03:07:26.443 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-17T03:07:26.445129+0000 2024-09-17T03:07:26.443 INFO:teuthology.orchestra.run.smithi078.stdout:min_mon_release 17 (quincy) 2024-09-17T03:07:26.443 INFO:teuthology.orchestra.run.smithi078.stdout:election_strategy: 1 2024-09-17T03:07:26.443 INFO:teuthology.orchestra.run.smithi078.stdout:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-17T03:07:26.443 INFO:teuthology.orchestra.run.smithi078.stdout:1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.b 2024-09-17T03:07:26.443 INFO:teuthology.orchestra.run.smithi078.stdout:2: [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] mon.c 2024-09-17T03:07:26.444 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-17T03:07:26.445 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T03:07:26.460 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f3c59ba9-dab4-4ee6-8989-d80d11d430b6... 2024-09-17T03:07:26.461 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:07:26.503 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T03:07:26.543 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2024-09-17T03:07:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: chdir = "" 2024-09-17T03:07:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:07:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: auth supported = cephx 2024-09-17T03:07:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: filestore xattr use omap = true 2024-09-17T03:07:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: mon clock drift allowed = 1.000 2024-09-17T03:07:26.543 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: osd crush chooseleaf type = 0 2024-09-17T03:07:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: auth debug = true 2024-09-17T03:07:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on old message = true 2024-09-17T03:07:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on bug = true 2024-09-17T03:07:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:07:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn max object skew = 0 2024-09-17T03:07:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:07:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:07:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default size = 2 2024-09-17T03:07:26.544 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow primary affinity = true 2024-09-17T03:07:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow pg remap = true 2024-09-17T03:07:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:07:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:07:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on no sortbitwise = false 2024-09-17T03:07:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:07:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on too few osds = false 2024-09-17T03:07:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:07:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:07:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: mon_allow_pool_size_one = true 2024-09-17T03:07:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:07:26.545 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: osd default data pool replay window = 5 2024-09-17T03:07:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: mon allow pool delete = true 2024-09-17T03:07:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: mon cluster log file level = debug 2024-09-17T03:07:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: debug asserts on shutdown = true 2024-09-17T03:07:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: mon health detail to clog = false 2024-09-17T03:07:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: mon host = "172.21.15.78,172.21.15.193,[v2:172.21.15.193:3301,v1:172.21.15.193:6790]" 2024-09-17T03:07:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on skipped message = False 2024-09-17T03:07:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = f3c59ba9-dab4-4ee6-8989-d80d11d430b6 2024-09-17T03:07:26.546 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.546 INFO:teuthology.orchestra.run.smithi078.stdout:[osd] 2024-09-17T03:07:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: osd journal size = 100 2024-09-17T03:07:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub load threshold = 5.0 2024-09-17T03:07:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub max interval = 600 2024-09-17T03:07:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:07:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: osd recover clone overlap = true 2024-09-17T03:07:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: osd recovery max chunk = 1048576 2024-09-17T03:07:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug shutdown = true 2024-09-17T03:07:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug op order = true 2024-09-17T03:07:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug verify stray on activate = true 2024-09-17T03:07:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug trim objects = true 2024-09-17T03:07:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: osd open classes on start = true 2024-09-17T03:07:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug pg log writeout = true 2024-09-17T03:07:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:07:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: osd map max advance = 10 2024-09-17T03:07:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: journal zero on create = true 2024-09-17T03:07:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:07:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: filestore apply finisher threads = 3 2024-09-17T03:07:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: bdev debug aio = true 2024-09-17T03:07:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug misdirected ops = true 2024-09-17T03:07:26.548 INFO:teuthology.orchestra.run.smithi078.stdout: bdev async discard = True 2024-09-17T03:07:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: bdev enable discard = True 2024-09-17T03:07:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore allocator = bitmap 2024-09-17T03:07:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore block size = 96636764160 2024-09-17T03:07:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore fsck on mount = True 2024-09-17T03:07:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluefs = 1/20 2024-09-17T03:07:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluestore = 1/20 2024-09-17T03:07:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-09-17T03:07:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: debug osd = 20 2024-09-17T03:07:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: debug rocksdb = 4/10 2024-09-17T03:07:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:07:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd full ratio = 0.9 2024-09-17T03:07:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:07:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:07:26.549 INFO:teuthology.orchestra.run.smithi078.stdout: osd objectstore = bluestore 2024-09-17T03:07:26.550 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.550 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr] 2024-09-17T03:07:26.550 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-09-17T03:07:26.550 INFO:teuthology.orchestra.run.smithi078.stdout: debug mgr = 20 2024-09-17T03:07:26.550 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2024-09-17T03:07:26.550 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2024-09-17T03:07:26.550 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:07:26.550 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:07:26.550 INFO:teuthology.orchestra.run.smithi078.stdout: mgr/telemetry/nag = false 2024-09-17T03:07:26.550 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.550 INFO:teuthology.orchestra.run.smithi078.stdout:[mon] 2024-09-17T03:07:26.550 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-09-17T03:07:26.550 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2024-09-17T03:07:26.550 INFO:teuthology.orchestra.run.smithi078.stdout: debug paxos = 20 2024-09-17T03:07:26.551 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2024-09-17T03:07:26.551 INFO:teuthology.orchestra.run.smithi078.stdout: mon data avail warn = 5 2024-09-17T03:07:26.551 INFO:teuthology.orchestra.run.smithi078.stdout: mon mgr mkfs grace = 240 2024-09-17T03:07:26.551 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:07:26.551 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd reporter subtree level = osd 2024-09-17T03:07:26.551 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd prime pg temp = true 2024-09-17T03:07:26.551 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:07:26.551 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.551 INFO:teuthology.orchestra.run.smithi078.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:07:26.551 INFO:teuthology.orchestra.run.smithi078.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:07:26.551 INFO:teuthology.orchestra.run.smithi078.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:07:26.551 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.551 INFO:teuthology.orchestra.run.smithi078.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:07:26.552 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:07:26.552 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:07:26.552 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.552 INFO:teuthology.orchestra.run.smithi078.stdout: # 1m isn't quite enough 2024-09-17T03:07:26.552 INFO:teuthology.orchestra.run.smithi078.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:07:26.552 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.552 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:07:26.552 INFO:teuthology.orchestra.run.smithi078.stdout: mon down mkfs grace = 300 2024-09-17T03:07:26.552 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:07:26.552 INFO:teuthology.orchestra.run.smithi078.stdout:[client] 2024-09-17T03:07:26.552 INFO:teuthology.orchestra.run.smithi078.stdout: rgw cache enabled = true 2024-09-17T03:07:26.552 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable ops log = true 2024-09-17T03:07:26.552 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable usage log = true 2024-09-17T03:07:26.553 INFO:teuthology.orchestra.run.smithi078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:07:26.553 INFO:teuthology.orchestra.run.smithi078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:07:26.553 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = "" 2024-09-17T03:07:26.553 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.a] 2024-09-17T03:07:26.553 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.b] 2024-09-17T03:07:26.553 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.c] 2024-09-17T03:07:26.553 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2024-09-17T03:07:26.553 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2024-09-17T03:07:26.553 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2024-09-17T03:07:26.553 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2024-09-17T03:07:26.554 INFO:teuthology.orchestra.run.smithi193.stdout:[global] 2024-09-17T03:07:26.554 INFO:teuthology.orchestra.run.smithi193.stdout: chdir = "" 2024-09-17T03:07:26.554 INFO:teuthology.orchestra.run.smithi193.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T03:07:26.554 INFO:teuthology.orchestra.run.smithi193.stdout: auth supported = cephx 2024-09-17T03:07:26.554 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.554 INFO:teuthology.orchestra.run.smithi193.stdout: filestore xattr use omap = true 2024-09-17T03:07:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: mon clock drift allowed = 1.000 2024-09-17T03:07:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: osd crush chooseleaf type = 0 2024-09-17T03:07:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: auth debug = true 2024-09-17T03:07:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: ms die on old message = true 2024-09-17T03:07:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: ms die on bug = true 2024-09-17T03:07:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T03:07:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: mon pg warn max object skew = 0 2024-09-17T03:07:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T03:07:26.555 INFO:teuthology.orchestra.run.smithi193.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T03:07:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: osd pool default size = 2 2024-09-17T03:07:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd allow primary affinity = true 2024-09-17T03:07:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd allow pg remap = true 2024-09-17T03:07:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on legacy crush tunables = false 2024-09-17T03:07:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on crush straw calc version zero = false 2024-09-17T03:07:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on no sortbitwise = false 2024-09-17T03:07:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on osd down out interval zero = false 2024-09-17T03:07:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on too few osds = false 2024-09-17T03:07:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T03:07:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T03:07:26.556 INFO:teuthology.orchestra.run.smithi193.stdout: mon_allow_pool_size_one = true 2024-09-17T03:07:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T03:07:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: osd default data pool replay window = 5 2024-09-17T03:07:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: mon allow pool delete = true 2024-09-17T03:07:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: mon cluster log file level = debug 2024-09-17T03:07:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: debug asserts on shutdown = true 2024-09-17T03:07:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: mon health detail to clog = false 2024-09-17T03:07:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: mon host = "172.21.15.78,172.21.15.193,[v2:172.21.15.193:3301,v1:172.21.15.193:6790]" 2024-09-17T03:07:26.557 INFO:teuthology.orchestra.run.smithi193.stdout: ms die on skipped message = False 2024-09-17T03:07:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: fsid = f3c59ba9-dab4-4ee6-8989-d80d11d430b6 2024-09-17T03:07:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.558 INFO:teuthology.orchestra.run.smithi193.stdout:[osd] 2024-09-17T03:07:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: osd journal size = 100 2024-09-17T03:07:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: osd scrub load threshold = 5.0 2024-09-17T03:07:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: osd scrub max interval = 600 2024-09-17T03:07:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: osd mclock profile = high_recovery_ops 2024-09-17T03:07:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: osd recover clone overlap = true 2024-09-17T03:07:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: osd recovery max chunk = 1048576 2024-09-17T03:07:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.558 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug shutdown = true 2024-09-17T03:07:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug op order = true 2024-09-17T03:07:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug verify stray on activate = true 2024-09-17T03:07:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug trim objects = true 2024-09-17T03:07:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: osd open classes on start = true 2024-09-17T03:07:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug pg log writeout = true 2024-09-17T03:07:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: osd deep scrub update digest min age = 30 2024-09-17T03:07:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: osd map max advance = 10 2024-09-17T03:07:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: journal zero on create = true 2024-09-17T03:07:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.559 INFO:teuthology.orchestra.run.smithi193.stdout: filestore ondisk finisher threads = 3 2024-09-17T03:07:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: filestore apply finisher threads = 3 2024-09-17T03:07:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: bdev debug aio = true 2024-09-17T03:07:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug misdirected ops = true 2024-09-17T03:07:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: bdev async discard = True 2024-09-17T03:07:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: bdev enable discard = True 2024-09-17T03:07:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: bluestore allocator = bitmap 2024-09-17T03:07:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: bluestore block size = 96636764160 2024-09-17T03:07:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: bluestore fsck on mount = True 2024-09-17T03:07:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: debug bluefs = 1/20 2024-09-17T03:07:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: debug bluestore = 1/20 2024-09-17T03:07:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: debug ms = 1 2024-09-17T03:07:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: debug osd = 20 2024-09-17T03:07:26.560 INFO:teuthology.orchestra.run.smithi193.stdout: debug rocksdb = 4/10 2024-09-17T03:07:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T03:07:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd full ratio = 0.9 2024-09-17T03:07:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd nearfull ratio = 0.8 2024-09-17T03:07:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: osd failsafe full ratio = 0.95 2024-09-17T03:07:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: osd objectstore = bluestore 2024-09-17T03:07:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.561 INFO:teuthology.orchestra.run.smithi193.stdout:[mgr] 2024-09-17T03:07:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: debug ms = 1 2024-09-17T03:07:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: debug mgr = 20 2024-09-17T03:07:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: debug mon = 20 2024-09-17T03:07:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: debug auth = 20 2024-09-17T03:07:26.561 INFO:teuthology.orchestra.run.smithi193.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:07:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:07:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: mgr/telemetry/nag = false 2024-09-17T03:07:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.562 INFO:teuthology.orchestra.run.smithi193.stdout:[mon] 2024-09-17T03:07:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: debug ms = 1 2024-09-17T03:07:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: debug mon = 20 2024-09-17T03:07:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: debug paxos = 20 2024-09-17T03:07:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: debug auth = 20 2024-09-17T03:07:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: mon data avail warn = 5 2024-09-17T03:07:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: mon mgr mkfs grace = 240 2024-09-17T03:07:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: mon reweight min pgs per osd = 4 2024-09-17T03:07:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd reporter subtree level = osd 2024-09-17T03:07:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd prime pg temp = true 2024-09-17T03:07:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: mon reweight min bytes per osd = 10 2024-09-17T03:07:26.562 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T03:07:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T03:07:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T03:07:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T03:07:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T03:07:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T03:07:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: # 1m isn't quite enough 2024-09-17T03:07:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: mon_down_mkfs_grace = 2m 2024-09-17T03:07:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_filestore_osds = false 2024-09-17T03:07:26.563 INFO:teuthology.orchestra.run.smithi193.stdout: mon down mkfs grace = 300 2024-09-17T03:07:26.564 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-09-17T03:07:26.564 INFO:teuthology.orchestra.run.smithi193.stdout:[client] 2024-09-17T03:07:26.564 INFO:teuthology.orchestra.run.smithi193.stdout: rgw cache enabled = true 2024-09-17T03:07:26.564 INFO:teuthology.orchestra.run.smithi193.stdout: rgw enable ops log = true 2024-09-17T03:07:26.564 INFO:teuthology.orchestra.run.smithi193.stdout: rgw enable usage log = true 2024-09-17T03:07:26.564 INFO:teuthology.orchestra.run.smithi193.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T03:07:26.564 INFO:teuthology.orchestra.run.smithi193.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T03:07:26.564 INFO:teuthology.orchestra.run.smithi193.stdout: pid file = "" 2024-09-17T03:07:26.564 INFO:teuthology.orchestra.run.smithi193.stdout:[mon.a] 2024-09-17T03:07:26.564 INFO:teuthology.orchestra.run.smithi193.stdout:[mon.b] 2024-09-17T03:07:26.564 INFO:teuthology.orchestra.run.smithi193.stdout:[mon.c] 2024-09-17T03:07:26.564 INFO:teuthology.orchestra.run.smithi193.stdout:[mds.a] 2024-09-17T03:07:26.564 INFO:teuthology.orchestra.run.smithi193.stdout:[mds.c] 2024-09-17T03:07:26.565 INFO:teuthology.orchestra.run.smithi193.stdout:[mds.b] 2024-09-17T03:07:26.565 INFO:teuthology.orchestra.run.smithi193.stdout:[mds.d] 2024-09-17T03:07:26.566 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T03:07:26.566 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T03:07:26.670 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T03:07:26.671 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:07:26.671 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T03:07:26.686 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:07:26.686 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T03:07:26.741 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T03:07:26.742 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:07:26.742 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T03:07:26.742 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T03:07:26.815 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:07:26.816 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:07:26.871 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi193.front.sepia.ceph.com 2024-09-17T03:07:26.871 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:07:26.871 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T03:07:26.871 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T03:07:26.906 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:07:26.906 DEBUG:teuthology.orchestra.run.smithi193:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:07:26.963 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T03:07:26.963 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T03:07:26.963 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T03:07:27.023 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T03:07:27.026 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T03:07:27.095 INFO:teuthology.orchestra.run.smithi193.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T03:07:27.098 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T03:07:27.098 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T03:07:27.158 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T03:07:27.162 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-17T03:07:27.186 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T03:07:27.286 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T03:07:27.289 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-17T03:07:27.314 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T03:07:27.380 INFO:teuthology.orchestra.run.smithi193.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T03:07:27.383 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-17T03:07:27.408 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T03:07:27.511 INFO:teuthology.orchestra.run.smithi193.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T03:07:27.514 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-17T03:07:27.538 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T03:07:27.539 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T03:07:27.589 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T03:07:27.602 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-17T03:07:27.652 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-17T03:07:27.665 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T03:07:27.715 INFO:teuthology.orchestra.run.smithi193.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-17T03:07:27.729 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-17T03:07:27.780 INFO:teuthology.orchestra.run.smithi193.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-17T03:07:27.793 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T03:07:27.793 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi193.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T03:07:27.793 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T03:07:27.818 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T03:07:27.818 INFO:tasks.ceph:role: osd.0 2024-09-17T03:07:27.818 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T03:07:27.818 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T03:07:27.890 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:07:27.891 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:07:27.891 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:07:27.891 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:07:27.891 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:07:27.891 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:07:27.891 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:07:27.891 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:07:27.891 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:07:27.891 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:07:28.401 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-09-17T03:07:28.404 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-09-17T03:07:28.404 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T03:07:28.547 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T03:07:28.578 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T03:07:28.645 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T03:07:28.645 INFO:tasks.ceph:role: osd.1 2024-09-17T03:07:28.645 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T03:07:28.645 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T03:07:28.717 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:07:28.717 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:07:28.717 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:07:28.717 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:07:28.717 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:07:28.718 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:07:28.718 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:07:28.718 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:07:28.718 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:07:28.718 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:07:29.180 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-09-17T03:07:29.182 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-09-17T03:07:29.182 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-17T03:07:29.269 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T03:07:29.299 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T03:07:29.364 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T03:07:29.364 INFO:tasks.ceph:role: osd.2 2024-09-17T03:07:29.364 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T03:07:29.365 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T03:07:29.436 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:07:29.436 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:07:29.436 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:07:29.436 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:07:29.437 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:07:29.437 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:07:29.437 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:07:29.437 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:07:29.437 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:07:29.437 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:07:29.929 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-09-17T03:07:29.931 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-09-17T03:07:29.931 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-17T03:07:30.051 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T03:07:30.080 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-17T03:07:30.145 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T03:07:30.145 INFO:tasks.ceph:role: osd.3 2024-09-17T03:07:30.145 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T03:07:30.145 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T03:07:30.216 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:07:30.216 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:07:30.216 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:07:30.217 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:07:30.217 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:07:30.217 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:07:30.217 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:07:30.217 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:07:30.217 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:07:30.217 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:07:30.729 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-09-17T03:07:30.731 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-09-17T03:07:30.731 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-17T03:07:30.850 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-17T03:07:30.883 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:07:30.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:07:30.986+0000 7f009140b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T03:07:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:07:30.987+0000 7f009140b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T03:07:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:07:30.987+0000 7f009140b640 -1 bdev(0x55b655b8f900 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-17T03:07:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:07:30.987+0000 7f009140b640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T03:07:34.395 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T03:07:34.425 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:07:34.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:07:34.535+0000 7eff64a9c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T03:07:34.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:07:34.535+0000 7eff64a9c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T03:07:34.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:07:34.535+0000 7eff64a9c640 -1 bdev(0x5618bcda9900 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-17T03:07:34.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:07:34.535+0000 7eff64a9c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T03:07:37.690 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T03:07:37.716 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:07:37.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:07:37.812+0000 7f961bce6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T03:07:37.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:07:37.813+0000 7f961bce6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T03:07:37.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:07:37.813+0000 7f961bce6640 -1 bdev(0x55b754563900 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-17T03:07:37.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:07:37.813+0000 7f961bce6640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T03:07:40.736 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T03:07:40.763 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:07:40.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:07:40.861+0000 7f4f9b7b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-17T03:07:40.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:07:40.862+0000 7f4f9b7b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-17T03:07:40.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:07:40.862+0000 7f4f9b7b2640 -1 bdev(0x5590261e1900 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-17T03:07:40.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:07:40.862+0000 7f4f9b7b2640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-17T03:07:43.770 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T03:07:43.797 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-17T03:07:43.827 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T03:07:43.828 INFO:tasks.ceph:role: osd.4 2024-09-17T03:07:43.828 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi193.front.sepia.ceph.com 2024-09-17T03:07:43.828 DEBUG:teuthology.orchestra.run.smithi193:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T03:07:43.902 INFO:teuthology.orchestra.run.smithi193.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:07:43.903 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:07:43.903 INFO:teuthology.orchestra.run.smithi193.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:07:43.903 INFO:teuthology.orchestra.run.smithi193.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:07:43.903 INFO:teuthology.orchestra.run.smithi193.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:07:43.903 INFO:teuthology.orchestra.run.smithi193.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:07:43.903 INFO:teuthology.orchestra.run.smithi193.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:07:43.903 INFO:teuthology.orchestra.run.smithi193.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:07:43.903 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:07:43.903 INFO:teuthology.orchestra.run.smithi193.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:07:44.414 INFO:teuthology.orchestra.run.smithi193.stdout:Discarding blocks...Done. 2024-09-17T03:07:44.416 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi193.front.sepia.ceph.com -o noatime 2024-09-17T03:07:44.417 DEBUG:teuthology.orchestra.run.smithi193:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-17T03:07:44.565 DEBUG:teuthology.orchestra.run.smithi193:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-17T03:07:44.599 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-17T03:07:44.667 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T03:07:44.668 INFO:tasks.ceph:role: osd.5 2024-09-17T03:07:44.668 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi193.front.sepia.ceph.com 2024-09-17T03:07:44.668 DEBUG:teuthology.orchestra.run.smithi193:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T03:07:44.741 INFO:teuthology.orchestra.run.smithi193.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:07:44.742 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:07:44.742 INFO:teuthology.orchestra.run.smithi193.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:07:44.742 INFO:teuthology.orchestra.run.smithi193.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:07:44.742 INFO:teuthology.orchestra.run.smithi193.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:07:44.742 INFO:teuthology.orchestra.run.smithi193.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:07:44.742 INFO:teuthology.orchestra.run.smithi193.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:07:44.742 INFO:teuthology.orchestra.run.smithi193.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:07:44.742 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:07:44.743 INFO:teuthology.orchestra.run.smithi193.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:07:45.190 INFO:teuthology.orchestra.run.smithi193.stdout:Discarding blocks...Done. 2024-09-17T03:07:45.192 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi193.front.sepia.ceph.com -o noatime 2024-09-17T03:07:45.192 DEBUG:teuthology.orchestra.run.smithi193:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-17T03:07:45.275 DEBUG:teuthology.orchestra.run.smithi193:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-17T03:07:45.345 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-17T03:07:45.409 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T03:07:45.410 INFO:tasks.ceph:role: osd.6 2024-09-17T03:07:45.410 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi193.front.sepia.ceph.com 2024-09-17T03:07:45.410 DEBUG:teuthology.orchestra.run.smithi193:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T03:07:45.483 INFO:teuthology.orchestra.run.smithi193.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:07:45.483 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:07:45.483 INFO:teuthology.orchestra.run.smithi193.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:07:45.483 INFO:teuthology.orchestra.run.smithi193.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:07:45.483 INFO:teuthology.orchestra.run.smithi193.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:07:45.483 INFO:teuthology.orchestra.run.smithi193.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:07:45.483 INFO:teuthology.orchestra.run.smithi193.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:07:45.483 INFO:teuthology.orchestra.run.smithi193.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:07:45.483 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:07:45.483 INFO:teuthology.orchestra.run.smithi193.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:07:46.011 INFO:teuthology.orchestra.run.smithi193.stdout:Discarding blocks...Done. 2024-09-17T03:07:46.013 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi193.front.sepia.ceph.com -o noatime 2024-09-17T03:07:46.013 DEBUG:teuthology.orchestra.run.smithi193:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-17T03:07:46.158 DEBUG:teuthology.orchestra.run.smithi193:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-17T03:07:46.189 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-17T03:07:46.255 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T03:07:46.255 INFO:tasks.ceph:role: osd.7 2024-09-17T03:07:46.255 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi193.front.sepia.ceph.com 2024-09-17T03:07:46.255 DEBUG:teuthology.orchestra.run.smithi193:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T03:07:46.327 INFO:teuthology.orchestra.run.smithi193.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T03:07:46.327 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T03:07:46.327 INFO:teuthology.orchestra.run.smithi193.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T03:07:46.327 INFO:teuthology.orchestra.run.smithi193.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T03:07:46.327 INFO:teuthology.orchestra.run.smithi193.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T03:07:46.327 INFO:teuthology.orchestra.run.smithi193.stdout: = sunit=0 swidth=0 blks 2024-09-17T03:07:46.327 INFO:teuthology.orchestra.run.smithi193.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T03:07:46.328 INFO:teuthology.orchestra.run.smithi193.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T03:07:46.328 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T03:07:46.328 INFO:teuthology.orchestra.run.smithi193.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T03:07:46.832 INFO:teuthology.orchestra.run.smithi193.stdout:Discarding blocks...Done. 2024-09-17T03:07:46.834 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi193.front.sepia.ceph.com -o noatime 2024-09-17T03:07:46.834 DEBUG:teuthology.orchestra.run.smithi193:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-17T03:07:46.929 DEBUG:teuthology.orchestra.run.smithi193:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-17T03:07:46.961 DEBUG:teuthology.orchestra.run.smithi193:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:07:47.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:07:47.072+0000 7efdf1af1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-17T03:07:47.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:07:47.073+0000 7efdf1af1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-17T03:07:47.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:07:47.073+0000 7efdf1af1640 -1 bdev(0x555ba5ad3900 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-17T03:07:47.072 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:07:47.073+0000 7efdf1af1640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-17T03:07:49.984 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T03:07:50.011 DEBUG:teuthology.orchestra.run.smithi193:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:07:50.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:07:50.111+0000 7f33fde17640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-17T03:07:50.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:07:50.111+0000 7f33fde17640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-17T03:07:50.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:07:50.111+0000 7f33fde17640 -1 bdev(0x564d2a959900 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-17T03:07:50.111 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:07:50.111+0000 7f33fde17640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-17T03:07:53.274 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T03:07:53.303 DEBUG:teuthology.orchestra.run.smithi193:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:07:53.405 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:07:53.406+0000 7f0b12158640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-17T03:07:53.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:07:53.407+0000 7f0b12158640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-17T03:07:53.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:07:53.407+0000 7f0b12158640 -1 bdev(0x5556d8db7900 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-17T03:07:53.406 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:07:53.407+0000 7f0b12158640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-17T03:07:54.570 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:07:54.573 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:07:56.561 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T03:07:56.588 DEBUG:teuthology.orchestra.run.smithi193:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:07:56.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:07:56.687+0000 7f3ae6262640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-17T03:07:56.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:07:56.687+0000 7f3ae6262640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-17T03:07:56.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:07:56.687+0000 7f3ae6262640 -1 bdev(0x560e9fdd9900 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-17T03:07:56.687 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:07:56.687+0000 7f3ae6262640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-17T03:07:59.605 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T03:07:59.634 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T03:07:59.634 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:07:59.634 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-17T03:07:59.664 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:07:59.665 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-17T03:07:59.733 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:07:59.733 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-17T03:07:59.801 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:07:59.801 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T03:07:59.868 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:07:59.868 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T03:07:59.935 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:07:59.935 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T03:08:00.001 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:08:00.002 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-17T03:08:00.066 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:00.067 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T03:08:00.097 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:00.097 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-17T03:08:00.166 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:00.166 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-17T03:08:00.232 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:00.232 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-17T03:08:00.298 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:00.298 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-17T03:08:00.365 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:00.366 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-17T03:08:00.431 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:00.431 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-17T03:08:00.496 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:08:00.497 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T03:08:00.514 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:08:00.514 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-17T03:08:00.570 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:00.570 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-17T03:08:00.586 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:00.587 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-17T03:08:00.642 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T03:08:00.642 DEBUG:teuthology.orchestra.run.smithi078:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T03:08:00.644 DEBUG:teuthology.orchestra.run.smithi193:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T03:08:00.685 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.y] 2024-09-17T03:08:00.685 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBv8uhm1SeKARAA2hyytqNjqToQ0K+RgQ8Tbg== 2024-09-17T03:08:00.685 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2024-09-17T03:08:00.685 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBv8uhmF3icCRAAZEAXi3RiY/e4JSSr1nd2sQ== 2024-09-17T03:08:00.685 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2024-09-17T03:08:00.685 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBv8uhmFoc7ERAAlPpal3pKHjPKFotpPiJ9dA== 2024-09-17T03:08:00.686 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.0] 2024-09-17T03:08:00.686 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBy8uhmiaXeOhAAbhD0AqPz5JYg9CvycMk6cQ== 2024-09-17T03:08:00.686 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.1] 2024-09-17T03:08:00.686 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQB28uhmWT32HxAAATHdxAa6QOLYGnpPCx72iA== 2024-09-17T03:08:00.686 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.2] 2024-09-17T03:08:00.686 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQB58uhmTOOMMBAA4YSlpqeuxlIXypxCpxDJ+Q== 2024-09-17T03:08:00.686 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.3] 2024-09-17T03:08:00.686 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQB88uhmSgx6MxAAKHGCbjfVZTyeb0nX2xKkSQ== 2024-09-17T03:08:00.686 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.x] 2024-09-17T03:08:00.686 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBv8uhmcpvVBRAA2JTbv0LrIc7seMyOmOIBmA== 2024-09-17T03:08:00.686 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2024-09-17T03:08:00.686 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBv8uhmzFPWFhAAptFKHxH9Xy3l9q0gxLARBQ== 2024-09-17T03:08:00.687 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2024-09-17T03:08:00.687 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBv8uhmYJ2aHhAAhG6Sw6iZDy6s0qpiSLc//A== 2024-09-17T03:08:00.687 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.4] 2024-09-17T03:08:00.687 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCD8uhmNKZkBBAAZwn1Xf+fd3GNeP4etvNePg== 2024-09-17T03:08:00.687 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.5] 2024-09-17T03:08:00.687 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCG8uhmDTyzBhAAzeipRWM5M2fjCQt7xDGBwA== 2024-09-17T03:08:00.687 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.6] 2024-09-17T03:08:00.687 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCJ8uhmDsZLGBAAB3VNeHQoty+fQwvYpRkltw== 2024-09-17T03:08:00.687 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.7] 2024-09-17T03:08:00.687 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCM8uhm3PkQKRAAjJV2xFyyoACLkA3f/lFhWw== 2024-09-17T03:08:00.687 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2024-09-17T03:08:00.687 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBv8uhmn+c/IxAALXG+Qkwye7zc6PjcLBsk1g== 2024-09-17T03:08:00.687 INFO:teuthology.orchestra.run.smithi078.stdout:[client.2] 2024-09-17T03:08:00.688 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBv8uhmB9ABJxAATgS37nY3a3bX8wK1H3S/8A== 2024-09-17T03:08:00.688 INFO:teuthology.orchestra.run.smithi078.stdout:[client.1] 2024-09-17T03:08:00.688 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBv8uhmbzjQKhAAr/DB8TDsiWPsLHnsvUaTiw== 2024-09-17T03:08:00.688 INFO:teuthology.orchestra.run.smithi078.stdout:[client.3] 2024-09-17T03:08:00.688 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBv8uhmyhGmLhAAIfkcz3KW+qZ1qDOqQdPS5g== 2024-09-17T03:08:00.704 INFO:teuthology.orchestra.run.smithi193.stdout:[mgr.y] 2024-09-17T03:08:00.705 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBv8uhm1SeKARAA2hyytqNjqToQ0K+RgQ8Tbg== 2024-09-17T03:08:00.705 INFO:teuthology.orchestra.run.smithi193.stdout:[mds.a] 2024-09-17T03:08:00.705 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBv8uhmF3icCRAAZEAXi3RiY/e4JSSr1nd2sQ== 2024-09-17T03:08:00.705 INFO:teuthology.orchestra.run.smithi193.stdout:[mds.c] 2024-09-17T03:08:00.705 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBv8uhmFoc7ERAAlPpal3pKHjPKFotpPiJ9dA== 2024-09-17T03:08:00.705 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.0] 2024-09-17T03:08:00.705 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBy8uhmiaXeOhAAbhD0AqPz5JYg9CvycMk6cQ== 2024-09-17T03:08:00.705 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.1] 2024-09-17T03:08:00.705 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQB28uhmWT32HxAAATHdxAa6QOLYGnpPCx72iA== 2024-09-17T03:08:00.705 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.2] 2024-09-17T03:08:00.705 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQB58uhmTOOMMBAA4YSlpqeuxlIXypxCpxDJ+Q== 2024-09-17T03:08:00.706 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.3] 2024-09-17T03:08:00.706 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQB88uhmSgx6MxAAKHGCbjfVZTyeb0nX2xKkSQ== 2024-09-17T03:08:00.706 INFO:teuthology.orchestra.run.smithi193.stdout:[mgr.x] 2024-09-17T03:08:00.706 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBv8uhmcpvVBRAA2JTbv0LrIc7seMyOmOIBmA== 2024-09-17T03:08:00.706 INFO:teuthology.orchestra.run.smithi193.stdout:[mds.b] 2024-09-17T03:08:00.706 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBv8uhmzFPWFhAAptFKHxH9Xy3l9q0gxLARBQ== 2024-09-17T03:08:00.706 INFO:teuthology.orchestra.run.smithi193.stdout:[mds.d] 2024-09-17T03:08:00.706 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBv8uhmYJ2aHhAAhG6Sw6iZDy6s0qpiSLc//A== 2024-09-17T03:08:00.706 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.4] 2024-09-17T03:08:00.706 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQCD8uhmNKZkBBAAZwn1Xf+fd3GNeP4etvNePg== 2024-09-17T03:08:00.706 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.5] 2024-09-17T03:08:00.706 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQCG8uhmDTyzBhAAzeipRWM5M2fjCQt7xDGBwA== 2024-09-17T03:08:00.706 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.6] 2024-09-17T03:08:00.706 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQCJ8uhmDsZLGBAAB3VNeHQoty+fQwvYpRkltw== 2024-09-17T03:08:00.707 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.7] 2024-09-17T03:08:00.707 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQCM8uhm3PkQKRAAjJV2xFyyoACLkA3f/lFhWw== 2024-09-17T03:08:00.707 INFO:teuthology.orchestra.run.smithi193.stdout:[client.0] 2024-09-17T03:08:00.707 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBv8uhmn+c/IxAALXG+Qkwye7zc6PjcLBsk1g== 2024-09-17T03:08:00.707 INFO:teuthology.orchestra.run.smithi193.stdout:[client.2] 2024-09-17T03:08:00.707 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBv8uhmB9ABJxAATgS37nY3a3bX8wK1H3S/8A== 2024-09-17T03:08:00.707 INFO:teuthology.orchestra.run.smithi193.stdout:[client.1] 2024-09-17T03:08:00.707 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBv8uhmbzjQKhAAr/DB8TDsiWPsLHnsvUaTiw== 2024-09-17T03:08:00.707 INFO:teuthology.orchestra.run.smithi193.stdout:[client.3] 2024-09-17T03:08:00.707 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBv8uhmyhGmLhAAIfkcz3KW+qZ1qDOqQdPS5g== 2024-09-17T03:08:00.708 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T03:08:00.732 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T03:08:00.813 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:08:00.815 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:08:00.879 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:08:00.881 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:08:00.945 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:08:00.948 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:08:01.010 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:08:01.012 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:08:01.073 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:08:01.075 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:08:01.136 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:08:01.139 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:08:01.199 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T03:08:01.202 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T03:08:01.262 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:08:01.265 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:08:01.330 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:08:01.332 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T03:08:01.396 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:08:01.398 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:08:01.459 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:08:01.462 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:08:01.523 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:08:01.526 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:08:01.586 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:08:01.589 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T03:08:01.650 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:08:01.652 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:08:01.717 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:08:01.719 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:08:01.783 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:08:01.786 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:08:01.850 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:08:01.853 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T03:08:01.918 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T03:08:01.918 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T03:08:01.943 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T03:08:02.052 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T03:08:02.077 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-17T03:08:02.102 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T03:08:02.210 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-17T03:08:02.234 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-17T03:08:02.299 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T03:08:02.405 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-17T03:08:02.430 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:08:02.432 DEBUG:teuthology.orchestra.run.smithi193:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T03:08:02.486 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T03:08:02.486 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T03:08:02.487 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T03:08:02.489 INFO:tasks.ceph.mon.a:Started 2024-09-17T03:08:02.489 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-17T03:08:02.489 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-17T03:08:02.528 INFO:tasks.ceph.mon.b:Started 2024-09-17T03:08:02.528 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T03:08:02.528 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T03:08:02.530 INFO:tasks.ceph.mon.c:Started 2024-09-17T03:08:02.530 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T03:08:02.530 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-17T03:08:02.530 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-17T03:08:02.532 INFO:tasks.ceph.mgr.y:Started 2024-09-17T03:08:02.533 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T03:08:02.533 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T03:08:02.535 INFO:tasks.ceph.mgr.x:Started 2024-09-17T03:08:02.535 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-17T03:08:02.535 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-17T03:08:02.537 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-17T03:08:02.537 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-17T03:08:02.580 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-17T03:08:02.580 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-17T03:08:02.624 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-17T03:08:02.624 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-17T03:08:02.667 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-17T03:08:02.667 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-17T03:08:02.711 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-17T03:08:02.711 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-17T03:08:02.756 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-17T03:08:02.757 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-17T03:08:02.802 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-17T03:08:02.802 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-17T03:08:02.845 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-17T03:08:02.845 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-17T03:08:02.892 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-17T03:08:02.893 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-17T03:08:02.938 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-17T03:08:02.938 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-17T03:08:02.984 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-17T03:08:02.984 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-17T03:08:03.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.019+0000 7f5e8a27e640 1 -- 172.21.15.78:0/285511999 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5e841536c0 msgr2=0x7f5e840b6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.019+0000 7f5e8a27e640 1 --2- 172.21.15.78:0/285511999 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5e841536c0 0x7f5e840b6720 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c010830 tx=0x7f5e6c010cf0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.021 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-17T03:08:03.022 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-17T03:08:03.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.019+0000 7f5e8a27e640 1 -- 172.21.15.78:0/285511999 shutdown_connections 2024-09-17T03:08:03.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.019+0000 7f5e8a27e640 1 --2- 172.21.15.78:0/285511999 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5e8414d1b0 0x7f5e840b6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.019+0000 7f5e8a27e640 1 --2- 172.21.15.78:0/285511999 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5e841536c0 0x7f5e840b6720 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.019+0000 7f5e8a27e640 1 --2- 172.21.15.78:0/285511999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e70005270 0x7f5e84141bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.019+0000 7f5e8a27e640 1 -- 172.21.15.78:0/285511999 >> 172.21.15.78:0/285511999 conn(0x7f5e840cdc60 msgr2=0x7f5e8415cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.021+0000 7f1f6effd640 1 -- 172.21.15.78:0/3555451080 <== mon.1 v2:172.21.15.193:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f1f680106e0 con 0x7f1f7813eeb0 2024-09-17T03:08:03.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.020+0000 7f5e8a27e640 1 -- 172.21.15.78:0/285511999 shutdown_connections 2024-09-17T03:08:03.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.020+0000 7f5e8a27e640 1 -- 172.21.15.78:0/285511999 wait complete. 2024-09-17T03:08:03.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.024+0000 7f1f6effd640 1 -- 172.21.15.78:0/3555451080 <== mon.1 v2:172.21.15.193:3300/0 10 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v4)=0 v4) ==== 123+0+0 (secure 0 0 0) 0x7f1f68010910 con 0x7f1f7813eeb0 2024-09-17T03:08:03.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.025+0000 7f6ef8ff9640 1 -- 172.21.15.78:0/400481248 <== mon.2 v2:172.21.15.193:3301/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f6eec004b80 con 0x7f6ee4003a50 2024-09-17T03:08:03.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.023+0000 7f7a10ff9640 1 -- 172.21.15.78:0/483120258 <== mon.0 v2:172.21.15.78:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f79fc003f20 con 0x7f7a1415baf0 2024-09-17T03:08:03.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.025+0000 7f34ed7fa640 1 -- 172.21.15.78:0/795987419 <== mon.0 v2:172.21.15.78:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f34e8004310 con 0x7f34f006d7f0 2024-09-17T03:08:03.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.031+0000 7f6ef8ff9640 1 -- 172.21.15.78:0/400481248 <== mon.2 v2:172.21.15.193:3301/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f6eec004e00 con 0x7f6ee4003a50 2024-09-17T03:08:03.037 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-17T03:08:03.037 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-17T03:08:03.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.034+0000 7f1f6effd640 1 -- 172.21.15.78:0/3555451080 <== mon.1 v2:172.21.15.193:3300/0 11 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f1f68003c50 con 0x7f1f7813eeb0 2024-09-17T03:08:03.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.036+0000 7f1f6cff9640 1 -- 172.21.15.78:0/3555451080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f7813eeb0 msgr2=0x7f1f7813cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.036+0000 7f1f6cff9640 1 --2- 172.21.15.78:0/3555451080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f7813eeb0 0x7f1f7813cd40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1f68037040 tx=0x7f1f68004730 comp rx=0 tx=0).stop 2024-09-17T03:08:03.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.036+0000 7f1f6cff9640 1 -- 172.21.15.78:0/3555451080 shutdown_connections 2024-09-17T03:08:03.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.036+0000 7f1f6cff9640 1 --2- 172.21.15.78:0/3555451080 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1f7814cb10 0x7f1f7813d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.036+0000 7f1f6cff9640 1 --2- 172.21.15.78:0/3555451080 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f7813eeb0 0x7f1f7813cd40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.036+0000 7f1f6cff9640 1 --2- 172.21.15.78:0/3555451080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f64004800 0x7f1f781e4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.036+0000 7f1f6cff9640 1 -- 172.21.15.78:0/3555451080 >> 172.21.15.78:0/3555451080 conn(0x7f1f780b2e10 msgr2=0x7f1f781547b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.033+0000 7f7a10ff9640 1 -- 172.21.15.78:0/483120258 <== mon.0 v2:172.21.15.78:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7f79fc0040d0 con 0x7f7a1415baf0 2024-09-17T03:08:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.034+0000 7f7a10ff9640 1 -- 172.21.15.78:0/483120258 <== mon.0 v2:172.21.15.78:3300/0 11 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f79fc004400 con 0x7f7a1415baf0 2024-09-17T03:08:03.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.036+0000 7f34ed7fa640 1 -- 172.21.15.78:0/795987419 <== mon.0 v2:172.21.15.78:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f34e8004590 con 0x7f34f006d7f0 2024-09-17T03:08:03.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.038+0000 7f1f6cff9640 1 -- 172.21.15.78:0/3555451080 shutdown_connections 2024-09-17T03:08:03.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.038+0000 7f1f6cff9640 1 -- 172.21.15.78:0/3555451080 wait complete. 2024-09-17T03:08:03.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.037+0000 7f7a0a7fc640 1 -- 172.21.15.78:0/483120258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a1415baf0 msgr2=0x7f7a14154d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.038+0000 7f7a0a7fc640 1 --2- 172.21.15.78:0/483120258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a1415baf0 0x7f7a14154d20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00b5b0 tx=0x7f79fc00ba70 comp rx=0 tx=0).stop 2024-09-17T03:08:03.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.038+0000 7f7a0a7fc640 1 -- 172.21.15.78:0/483120258 shutdown_connections 2024-09-17T03:08:03.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.038+0000 7f7a0a7fc640 1 --2- 172.21.15.78:0/483120258 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7a141f13d0 0x7f7a140b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.038+0000 7f7a0a7fc640 1 --2- 172.21.15.78:0/483120258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a1415baf0 0x7f7a14154d20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.038+0000 7f7a0a7fc640 1 --2- 172.21.15.78:0/483120258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a140cfa20 0x7f7a140a9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.038+0000 7f7a0a7fc640 1 -- 172.21.15.78:0/483120258 >> 172.21.15.78:0/483120258 conn(0x7f7a14070b20 msgr2=0x7f7a14073f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.039+0000 7f7a0a7fc640 1 -- 172.21.15.78:0/483120258 shutdown_connections 2024-09-17T03:08:03.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.039+0000 7f7a0a7fc640 1 -- 172.21.15.78:0/483120258 wait complete. 2024-09-17T03:08:03.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.039+0000 7f96117fa640 1 -- 172.21.15.78:0/3967349421 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9604011cd0 con 0x7f96140c9cd0 2024-09-17T03:08:03.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.041+0000 7f6ef8ff9640 1 -- 172.21.15.78:0/400481248 <== mon.2 v2:172.21.15.193:3301/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6eec0038c0 con 0x7f6ee4003a50 2024-09-17T03:08:03.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.041+0000 7f6ef8ff9640 1 -- 172.21.15.78:0/400481248 <== mon.2 v2:172.21.15.193:3301/0 12 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f6eec053480 con 0x7f6ee4003a50 2024-09-17T03:08:03.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.043+0000 7f6f0278a640 1 -- 172.21.15.78:0/400481248 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ee4003a50 msgr2=0x7f6efc156870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.043+0000 7f6f0278a640 1 --2- 172.21.15.78:0/400481248 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ee4003a50 0x7f6efc156870 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6eec02f480 tx=0x7f6eec004730 comp rx=0 tx=0).stop 2024-09-17T03:08:03.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.043+0000 7f6f0278a640 1 -- 172.21.15.78:0/400481248 shutdown_connections 2024-09-17T03:08:03.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.043+0000 7f6f0278a640 1 --2- 172.21.15.78:0/400481248 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6efc0b5b40 0x7f6efc1f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.041+0000 7f961af39640 1 -- 172.21.15.78:0/3967349421 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96140b3930 con 0x7f96140c9cd0 2024-09-17T03:08:03.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.041+0000 7f961af39640 1 -- 172.21.15.78:0/3967349421 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f96140b3ed0 con 0x7f96140c9cd0 2024-09-17T03:08:03.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.042+0000 7f96117fa640 1 -- 172.21.15.78:0/3967349421 <== mon.2 v2:172.21.15.193:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96040103c0 con 0x7f96140c9cd0 2024-09-17T03:08:03.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.043+0000 7f6f0278a640 1 --2- 172.21.15.78:0/400481248 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6efc0b1e50 0x7f6efc0b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.043+0000 7f6f0278a640 1 --2- 172.21.15.78:0/400481248 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ee4003a50 0x7f6efc156870 secure :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6eec02f480 tx=0x7f6eec004730 comp rx=0 tx=0).stop 2024-09-17T03:08:03.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.043+0000 7f6f0278a640 1 -- 172.21.15.78:0/400481248 >> 172.21.15.78:0/400481248 conn(0x7f6efc0cd4b0 msgr2=0x7f6efc15a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.043+0000 7f96117fa640 1 -- 172.21.15.78:0/3967349421 <== mon.2 v2:172.21.15.193:3301/0 5 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f96040105b0 con 0x7f96140c9cd0 2024-09-17T03:08:03.044 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-17T03:08:03.045 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-17T03:08:03.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.044+0000 7f6f0278a640 1 -- 172.21.15.78:0/400481248 shutdown_connections 2024-09-17T03:08:03.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.044+0000 7f6f0278a640 1 -- 172.21.15.78:0/400481248 wait complete. 2024-09-17T03:08:03.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.044+0000 7f96117fa640 1 -- 172.21.15.78:0/3967349421 <== mon.2 v2:172.21.15.193:3301/0 6 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f960401cb60 con 0x7f96140c9cd0 2024-09-17T03:08:03.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.045+0000 7f95faffd640 1 -- 172.21.15.78:0/3967349421 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95ec005290 con 0x7f96140c9cd0 2024-09-17T03:08:03.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.048+0000 7f34ed7fa640 1 -- 172.21.15.78:0/795987419 <== mon.0 v2:172.21.15.78:3300/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34e8021420 con 0x7f34f006d7f0 2024-09-17T03:08:03.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.048+0000 7f96117fa640 1 -- 172.21.15.78:0/3967349421 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f9604021020 con 0x7f96140c9cd0 2024-09-17T03:08:03.049 INFO:tasks.ceph:setting config [mgr] client_mount_timeout = 30 2024-09-17T03:08:03.049 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mgr client_mount_timeout 30 2024-09-17T03:08:03.064 INFO:tasks.ceph:setting config [mgr] debug_client = 20 2024-09-17T03:08:03.064 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mgr debug_client 20 2024-09-17T03:08:03.077 INFO:tasks.ceph:setting config [mgr] debug_mgr = 20 2024-09-17T03:08:03.077 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mgr debug_mgr 20 2024-09-17T03:08:03.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.089+0000 7fe21eb39640 1 -- 172.21.15.78:0/464135100 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe2180d0a00 msgr2=0x7fe2180d21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.089+0000 7fe21eb39640 1 --2- 172.21.15.78:0/464135100 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe2180d0a00 0x7fe2180d21f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe210005fd0 tx=0x7fe21002aa90 comp rx=0 tx=0).stop 2024-09-17T03:08:03.090 INFO:tasks.ceph:setting config [mgr] debug_ms = 1 2024-09-17T03:08:03.090 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mgr debug_ms 1 2024-09-17T03:08:03.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.090+0000 7fe21eb39640 1 -- 172.21.15.78:0/464135100 shutdown_connections 2024-09-17T03:08:03.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.090+0000 7fe21eb39640 1 --2- 172.21.15.78:0/464135100 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe2180d0a00 0x7fe2180d21f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.090+0000 7fe21eb39640 1 --2- 172.21.15.78:0/464135100 >> v2:172.21.15.193:3300/0 conn(0x7fe2180cf880 0x7fe2180d04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.090+0000 7fe21eb39640 1 -- 172.21.15.78:0/464135100 >> 172.21.15.78:0/464135100 conn(0x7fe218072aa0 msgr2=0x7fe218072eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.090+0000 7fe21eb39640 1 -- 172.21.15.78:0/464135100 shutdown_connections 2024-09-17T03:08:03.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.090+0000 7fe21eb39640 1 -- 172.21.15.78:0/464135100 wait complete. 2024-09-17T03:08:03.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.094+0000 7fe21eb39640 1 Processor -- start 2024-09-17T03:08:03.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.094+0000 7fe21eb39640 1 -- start start 2024-09-17T03:08:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.104+0000 7fe21eb39640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe2180cf880 0x7fe21814d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.104 INFO:tasks.ceph:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-17T03:08:03.104 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mgr mon_warn_on_pool_no_app False 2024-09-17T03:08:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.104+0000 7fe21eb39640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2180d0a00 0x7fe2180b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.108+0000 7fe21c8d5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe2180cf880 0x7fe21814d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.108+0000 7fe21c8d5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe2180cf880 0x7fe21814d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.78:60814/0 (socket says 172.21.15.78:60814) 2024-09-17T03:08:03.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.108+0000 7fe217fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2180d0a00 0x7fe2180b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.108+0000 7fe217fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2180d0a00 0x7fe2180b5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43624/0 (socket says 172.21.15.78:43624) 2024-09-17T03:08:03.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.108+0000 7fe21c8d5640 1 -- 172.21.15.78:0/571903506 learned_addr learned my addr 172.21.15.78:0/571903506 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:03.110 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-17T03:08:03.110 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-17T03:08:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.108+0000 7fe21eb39640 1 --2- 172.21.15.78:0/571903506 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe2180d2730 0x7fe2180b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.108+0000 7fe21eb39640 1 -- 172.21.15.78:0/571903506 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe2181631b0 con 0x7fe2180d0a00 2024-09-17T03:08:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.108+0000 7fe21eb39640 1 -- 172.21.15.78:0/571903506 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe2180cc9c0 con 0x7fe2180cf880 2024-09-17T03:08:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.108+0000 7fe21eb39640 1 -- 172.21.15.78:0/571903506 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe2180c5f50 con 0x7fe2180d2730 2024-09-17T03:08:03.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.109+0000 7fe21c8d5640 1 -- 172.21.15.78:0/571903506 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe2180d2730 msgr2=0x7fe2180b60d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T03:08:03.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.109+0000 7fe21c8d5640 1 --2- 172.21.15.78:0/571903506 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe2180d2730 0x7fe2180b60d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.109+0000 7fe21c8d5640 1 -- 172.21.15.78:0/571903506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2180d0a00 msgr2=0x7fe2180b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.109+0000 7fe21c8d5640 1 --2- 172.21.15.78:0/571903506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2180d0a00 0x7fe2180b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.109+0000 7fe21c8d5640 1 -- 172.21.15.78:0/571903506 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe21814e3a0 con 0x7fe2180cf880 2024-09-17T03:08:03.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.109+0000 7fe217fff640 1 --2- 172.21.15.78:0/571903506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2180d0a00 0x7fe2180b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:03.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.113+0000 7fe21c8d5640 1 --2- 172.21.15.78:0/571903506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe2180cf880 0x7fe21814d950 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe20800e710 tx=0x7fe20800ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:03.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.113+0000 7fe2157fa640 1 -- 172.21.15.78:0/571903506 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20800cab0 con 0x7fe2180cf880 2024-09-17T03:08:03.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.113+0000 7fe21eb39640 1 -- 172.21.15.78:0/571903506 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2180b67e0 con 0x7fe2180cf880 2024-09-17T03:08:03.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.113+0000 7fe21eb39640 1 -- 172.21.15.78:0/571903506 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe218152fb0 con 0x7fe2180cf880 2024-09-17T03:08:03.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.114+0000 7fe2157fa640 1 -- 172.21.15.78:0/571903506 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe20800cd40 con 0x7fe2180cf880 2024-09-17T03:08:03.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.114+0000 7fe2157fa640 1 -- 172.21.15.78:0/571903506 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe208010690 con 0x7fe2180cf880 2024-09-17T03:08:03.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.114+0000 7fe2157fa640 1 -- 172.21.15.78:0/571903506 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe208010830 con 0x7fe2180cf880 2024-09-17T03:08:03.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.114+0000 7fe2157fa640 1 -- 172.21.15.78:0/571903506 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe208018c40 con 0x7fe2180cf880 2024-09-17T03:08:03.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.117+0000 7fe21eb39640 1 -- 172.21.15.78:0/571903506 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1f8005290 con 0x7fe2180cf880 2024-09-17T03:08:03.124 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-17T03:08:03.125 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-17T03:08:03.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.123+0000 7fe2157fa640 1 -- 172.21.15.78:0/571903506 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe208010c60 con 0x7fe2180cf880 2024-09-17T03:08:03.169 DEBUG:tasks.ceph:set 22 configs 2024-09-17T03:08:03.170 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.170 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.170 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.170 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.170 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.171 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.190+0000 7fe372351640 1 -- 172.21.15.78:0/3290960250 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe36c16e750 msgr2=0x7fe36c0cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.190+0000 7fe372351640 1 --2- 172.21.15.78:0/3290960250 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe36c16e750 0x7fe36c0cc940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe35c009720 tx=0x7fe35c02b5e0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.199+0000 7fe372351640 1 -- 172.21.15.78:0/3290960250 shutdown_connections 2024-09-17T03:08:03.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.199+0000 7fe372351640 1 --2- 172.21.15.78:0/3290960250 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe36c16e750 0x7fe36c0cc940 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.199+0000 7fe372351640 1 -- 172.21.15.78:0/3290960250 >> 172.21.15.78:0/3290960250 conn(0x7fe36c0b1c20 msgr2=0x7fe36c0b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.199+0000 7fe372351640 1 -- 172.21.15.78:0/3290960250 shutdown_connections 2024-09-17T03:08:03.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.204+0000 7f34d6ffd640 1 -- 172.21.15.78:0/795987419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f34c80052f0 con 0x7f34f006d7f0 2024-09-17T03:08:03.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.199+0000 7fe372351640 1 -- 172.21.15.78:0/3290960250 wait complete. 2024-09-17T03:08:03.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.202+0000 7fe372351640 1 Processor -- start 2024-09-17T03:08:03.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.212+0000 7f34ed7fa640 1 -- 172.21.15.78:0/795987419 <== mon.0 v2:172.21.15.78:3300/0 12 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7f34e80218d0 con 0x7f34f006d7f0 2024-09-17T03:08:03.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.214+0000 7f34f6d13640 1 -- 172.21.15.78:0/795987419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34f006d7f0 msgr2=0x7f34f00b5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.214+0000 7f34f6d13640 1 --2- 172.21.15.78:0/795987419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34f006d7f0 0x7f34f00b5e30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f34e800ca30 tx=0x7f34e800cef0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.214+0000 7f34f6d13640 1 -- 172.21.15.78:0/795987419 shutdown_connections 2024-09-17T03:08:03.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.214+0000 7f34f6d13640 1 --2- 172.21.15.78:0/795987419 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f34f015ea30 0x7f34f01e8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.214+0000 7f34f6d13640 1 --2- 172.21.15.78:0/795987419 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34f00b00f0 0x7f34f01ea570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.214+0000 7f34f6d13640 1 --2- 172.21.15.78:0/795987419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34f006d7f0 0x7f34f00b5e30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.214+0000 7f34f6d13640 1 -- 172.21.15.78:0/795987419 >> 172.21.15.78:0/795987419 conn(0x7f34f00cd480 msgr2=0x7f34f006cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.214+0000 7f34f6d13640 1 -- 172.21.15.78:0/795987419 shutdown_connections 2024-09-17T03:08:03.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.214+0000 7f34f6d13640 1 -- 172.21.15.78:0/795987419 wait complete. 2024-09-17T03:08:03.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.206+0000 7fe372351640 1 -- start start 2024-09-17T03:08:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.220+0000 7fe372351640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe36c0cce80 0x7fe36c0c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.220+0000 7fe372351640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe36c166c30 0x7fe36c167040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.220+0000 7fe36bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe36c0cce80 0x7fe36c0c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.220+0000 7fe36bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe36c0cce80 0x7fe36c0c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43626/0 (socket says 172.21.15.78:43626) 2024-09-17T03:08:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.220+0000 7fe372351640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe36c167580 0x7fe36c215eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.220+0000 7fe372351640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c0738a0 con 0x7fe36c0cce80 2024-09-17T03:08:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.220+0000 7fe372351640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe36c073720 con 0x7fe36c167580 2024-09-17T03:08:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.220+0000 7fe372351640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe36c073a20 con 0x7fe36c166c30 2024-09-17T03:08:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.220+0000 7fe36bfff640 1 -- 172.21.15.78:0/1499410173 learned_addr learned my addr 172.21.15.78:0/1499410173 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.220+0000 7fe36b7fe640 1 --2- 172.21.15.78:0/1499410173 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe36c166c30 0x7fe36c167040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.221+0000 7fe36bfff640 1 -- 172.21.15.78:0/1499410173 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe36c166c30 msgr2=0x7fe36c167040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.221+0000 7fe36bfff640 1 --2- 172.21.15.78:0/1499410173 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe36c166c30 0x7fe36c167040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.221+0000 7fe36bfff640 1 -- 172.21.15.78:0/1499410173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe36c167580 msgr2=0x7fe36c215eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:08:03.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.221+0000 7fe36bfff640 1 --2- 172.21.15.78:0/1499410173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe36c167580 0x7fe36c215eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.221+0000 7fe36bfff640 1 -- 172.21.15.78:0/1499410173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe36c1661c0 con 0x7fe36c0cce80 2024-09-17T03:08:03.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.228+0000 7fe36bfff640 1 --2- 172.21.15.78:0/1499410173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe36c0cce80 0x7fe36c0c9760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe35c000c00 tx=0x7fe35c004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:03.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.229+0000 7fe368ff9640 1 -- 172.21.15.78:0/1499410173 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c041030 con 0x7fe36c0cce80 2024-09-17T03:08:03.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.229+0000 7fe372351640 1 -- 172.21.15.78:0/1499410173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe36c212780 con 0x7fe36c0cce80 2024-09-17T03:08:03.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.230+0000 7fe372351640 1 -- 172.21.15.78:0/1499410173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe36c166430 con 0x7fe36c0cce80 2024-09-17T03:08:03.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.232+0000 7fe368ff9640 1 -- 172.21.15.78:0/1499410173 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe35c038040 con 0x7fe36c0cce80 2024-09-17T03:08:03.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.233+0000 7fe368ff9640 1 -- 172.21.15.78:0/1499410173 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c037030 con 0x7fe36c0cce80 2024-09-17T03:08:03.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.233+0000 7fe368ff9640 1 -- 172.21.15.78:0/1499410173 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe35c044070 con 0x7fe36c0cce80 2024-09-17T03:08:03.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.233+0000 7fe368ff9640 1 -- 172.21.15.78:0/1499410173 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe35c0329c0 con 0x7fe36c0cce80 2024-09-17T03:08:03.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.241+0000 7fe3527fc640 1 -- 172.21.15.78:0/1499410173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe34c005290 con 0x7fe36c0cce80 2024-09-17T03:08:03.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.245+0000 7fe368ff9640 1 -- 172.21.15.78:0/1499410173 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe35c0042f0 con 0x7fe36c0cce80 2024-09-17T03:08:03.253 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.272+0000 7fc53db4b640 1 -- 172.21.15.78:0/1430816042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5300550e0 msgr2=0x7fc530033ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.272+0000 7fc53db4b640 1 --2- 172.21.15.78:0/1430816042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5300550e0 0x7fc530033ce0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc52c005fd0 tx=0x7fc52c02c750 comp rx=0 tx=0).stop 2024-09-17T03:08:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.273+0000 7fc53db4b640 1 -- 172.21.15.78:0/1430816042 shutdown_connections 2024-09-17T03:08:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.273+0000 7fc53db4b640 1 --2- 172.21.15.78:0/1430816042 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc530054130 0x7fc530034220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.273+0000 7fc53db4b640 1 --2- 172.21.15.78:0/1430816042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5300550e0 0x7fc530033ce0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.273+0000 7fc53db4b640 1 -- 172.21.15.78:0/1430816042 >> 172.21.15.78:0/1430816042 conn(0x7fc53001d9a0 msgr2=0x7fc530039660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.273+0000 7fc53db4b640 1 -- 172.21.15.78:0/1430816042 shutdown_connections 2024-09-17T03:08:03.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.273+0000 7fc53db4b640 1 -- 172.21.15.78:0/1430816042 wait complete. 2024-09-17T03:08:03.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.276+0000 7fc53db4b640 1 Processor -- start 2024-09-17T03:08:03.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.288+0000 7fc53db4b640 1 -- start start 2024-09-17T03:08:03.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.290+0000 7fc53db4b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc5300070b0 0x7fc5301a99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.291+0000 7fc53db4b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc530054130 0x7fc5301a8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.291+0000 7fc537fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc530054130 0x7fc5301a8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.291+0000 7fc537fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc530054130 0x7fc5301a8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43640/0 (socket says 172.21.15.78:43640) 2024-09-17T03:08:03.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.291+0000 7fc537fff640 1 -- 172.21.15.78:0/3183887108 learned_addr learned my addr 172.21.15.78:0/3183887108 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:03.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.291+0000 7fc53db4b640 1 --2- 172.21.15.78:0/3183887108 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5300550e0 0x7fc53004d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.291+0000 7fc53db4b640 1 -- 172.21.15.78:0/3183887108 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc530006310 con 0x7fc530054130 2024-09-17T03:08:03.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.292+0000 7fc53db4b640 1 -- 172.21.15.78:0/3183887108 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc53003a060 con 0x7fc5300550e0 2024-09-17T03:08:03.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.292+0000 7fc53d34a640 1 --2- 172.21.15.78:0/3183887108 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5300550e0 0x7fc53004d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.292+0000 7fc53db4b640 1 -- 172.21.15.78:0/3183887108 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc530006490 con 0x7fc5300070b0 2024-09-17T03:08:03.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.292+0000 7fc537fff640 1 -- 172.21.15.78:0/3183887108 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc5300070b0 msgr2=0x7fc5301a99f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:08:03.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.292+0000 7fc537fff640 1 --2- 172.21.15.78:0/3183887108 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc5300070b0 0x7fc5301a99f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.292+0000 7fc537fff640 1 -- 172.21.15.78:0/3183887108 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5300550e0 msgr2=0x7fc53004d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.292+0000 7fc537fff640 1 --2- 172.21.15.78:0/3183887108 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5300550e0 0x7fc53004d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.293+0000 7fc537fff640 1 -- 172.21.15.78:0/3183887108 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5301a9f30 con 0x7fc530054130 2024-09-17T03:08:03.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.293+0000 7fc537fff640 1 --2- 172.21.15.78:0/3183887108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc530054130 0x7fc5301a8880 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc52400c790 tx=0x7fc52400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:03.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.294+0000 7fc5357fa640 1 -- 172.21.15.78:0/3183887108 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc524017070 con 0x7fc530054130 2024-09-17T03:08:03.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.294+0000 7fc5357fa640 1 -- 172.21.15.78:0/3183887108 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc524005360 con 0x7fc530054130 2024-09-17T03:08:03.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.294+0000 7fc53db4b640 1 -- 172.21.15.78:0/3183887108 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5301a8dc0 con 0x7fc530054130 2024-09-17T03:08:03.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.294+0000 7fc53db4b640 1 -- 172.21.15.78:0/3183887108 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5300fcad0 con 0x7fc530054130 2024-09-17T03:08:03.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.296+0000 7fc5357fa640 1 -- 172.21.15.78:0/3183887108 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc524003850 con 0x7fc530054130 2024-09-17T03:08:03.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.298+0000 7fc5357fa640 1 -- 172.21.15.78:0/3183887108 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc52401a070 con 0x7fc530054130 2024-09-17T03:08:03.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.298+0000 7fc5357fa640 1 -- 172.21.15.78:0/3183887108 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc52400ae00 con 0x7fc530054130 2024-09-17T03:08:03.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.298+0000 7fc522ffd640 1 -- 172.21.15.78:0/3183887108 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc514005290 con 0x7fc530054130 2024-09-17T03:08:03.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.303+0000 7fc5357fa640 1 -- 172.21.15.78:0/3183887108 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc5301a9f30 con 0x7fc530054130 2024-09-17T03:08:03.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.350+0000 7f95faffd640 1 -- 172.21.15.78:0/3967349421 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f95ec005850 con 0x7f96140c9cd0 2024-09-17T03:08:03.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.372+0000 7f96117fa640 1 -- 172.21.15.78:0/3967349421 <== mon.2 v2:172.21.15.193:3301/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f96140c6de0 con 0x7f96140c9cd0 2024-09-17T03:08:03.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.377+0000 7f961af39640 1 -- 172.21.15.78:0/3967349421 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f96140c9cd0 msgr2=0x7f96141f41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.377+0000 7f961af39640 1 --2- 172.21.15.78:0/3967349421 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f96140c9cd0 0x7f96141f41b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f96140caf80 tx=0x7f96040039c0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.377+0000 7f961af39640 1 -- 172.21.15.78:0/3967349421 shutdown_connections 2024-09-17T03:08:03.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.377+0000 7f961af39640 1 --2- 172.21.15.78:0/3967349421 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f96140c9cd0 0x7f96141f41b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.377+0000 7f961af39640 1 --2- 172.21.15.78:0/3967349421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f961414ce70 0x7f9614150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.377+0000 7f961af39640 1 --2- 172.21.15.78:0/3967349421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95fc004800 0x7f961414e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.377+0000 7f961af39640 1 -- 172.21.15.78:0/3967349421 >> 172.21.15.78:0/3967349421 conn(0x7f96140cd480 msgr2=0x7f96140cc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.377+0000 7f961af39640 1 -- 172.21.15.78:0/3967349421 shutdown_connections 2024-09-17T03:08:03.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.377+0000 7f961af39640 1 -- 172.21.15.78:0/3967349421 wait complete. 2024-09-17T03:08:03.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.379+0000 7ffacedfa640 1 -- 172.21.15.78:0/2722605143 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffac806f580 msgr2=0x7ffac80b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.379+0000 7ffacedfa640 1 --2- 172.21.15.78:0/2722605143 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffac806f580 0x7ffac80b2eb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ffab8009830 tx=0x7ffab802a560 comp rx=0 tx=0).stop 2024-09-17T03:08:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.387+0000 7ffacedfa640 1 -- 172.21.15.78:0/2722605143 shutdown_connections 2024-09-17T03:08:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.387+0000 7ffacedfa640 1 --2- 172.21.15.78:0/2722605143 >> v2:172.21.15.78:3300/0 conn(0x7ffac815baf0 0x7ffac8151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.387+0000 7ffacedfa640 1 --2- 172.21.15.78:0/2722605143 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffac806f580 0x7ffac80b2eb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.387+0000 7ffacedfa640 1 -- 172.21.15.78:0/2722605143 >> 172.21.15.78:0/2722605143 conn(0x7ffac8070b20 msgr2=0x7ffac8070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.391+0000 7ffacedfa640 1 -- 172.21.15.78:0/2722605143 shutdown_connections 2024-09-17T03:08:03.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.391+0000 7ffacedfa640 1 -- 172.21.15.78:0/2722605143 wait complete. 2024-09-17T03:08:03.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.394+0000 7ffacedfa640 1 Processor -- start 2024-09-17T03:08:03.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.394+0000 7ffacedfa640 1 -- start start 2024-09-17T03:08:03.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.397+0000 7ffacedfa640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffac80cfa20 0x7ffac82028c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.397+0000 7ffacedfa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffac815baf0 0x7ffac8201560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.397+0000 7ffacddf8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffac80cfa20 0x7ffac82028c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.397+0000 7ffacddf8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffac80cfa20 0x7ffac82028c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.78:60848/0 (socket says 172.21.15.78:60848) 2024-09-17T03:08:03.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.398+0000 7ffacddf8640 1 -- 172.21.15.78:0/1520192945 learned_addr learned my addr 172.21.15.78:0/1520192945 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:03.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.398+0000 7ffacedfa640 1 --2- 172.21.15.78:0/1520192945 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffac8201aa0 0x7ffac81e7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.398+0000 7ffacd5f7640 1 --2- 172.21.15.78:0/1520192945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffac815baf0 0x7ffac8201560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.398+0000 7ffacedfa640 1 -- 172.21.15.78:0/1520192945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ffac80d0dc0 con 0x7ffac815baf0 2024-09-17T03:08:03.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.398+0000 7ffacedfa640 1 -- 172.21.15.78:0/1520192945 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffac80d0c40 con 0x7ffac80cfa20 2024-09-17T03:08:03.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.398+0000 7fface5f9640 1 --2- 172.21.15.78:0/1520192945 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffac8201aa0 0x7ffac81e7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.398+0000 7ffacedfa640 1 -- 172.21.15.78:0/1520192945 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ffac81516b0 con 0x7ffac8201aa0 2024-09-17T03:08:03.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.399+0000 7fface5f9640 1 -- 172.21.15.78:0/1520192945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffac80cfa20 msgr2=0x7ffac82028c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.399+0000 7fface5f9640 1 --2- 172.21.15.78:0/1520192945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffac80cfa20 0x7ffac82028c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.399+0000 7fface5f9640 1 -- 172.21.15.78:0/1520192945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffac815baf0 msgr2=0x7ffac8201560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.400+0000 7fface5f9640 1 --2- 172.21.15.78:0/1520192945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffac815baf0 0x7ffac8201560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.400+0000 7fface5f9640 1 -- 172.21.15.78:0/1520192945 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac8202e00 con 0x7ffac8201aa0 2024-09-17T03:08:03.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.400+0000 7ffacd5f7640 1 --2- 172.21.15.78:0/1520192945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffac815baf0 0x7ffac8201560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:03.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.400+0000 7fface5f9640 1 --2- 172.21.15.78:0/1520192945 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffac8201aa0 0x7ffac81e7190 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffac0005fd0 tx=0x7ffac000b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.405+0000 7ffabe7fc640 1 -- 172.21.15.78:0/1520192945 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac0004d20 con 0x7ffac8201aa0 2024-09-17T03:08:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.405+0000 7ffabe7fc640 1 -- 172.21.15.78:0/1520192945 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffac000ae50 con 0x7ffac8201aa0 2024-09-17T03:08:03.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.405+0000 7ffabe7fc640 1 -- 172.21.15.78:0/1520192945 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffac000e8c0 con 0x7ffac8201aa0 2024-09-17T03:08:03.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.407+0000 7ffacedfa640 1 -- 172.21.15.78:0/1520192945 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffac81e96f0 con 0x7ffac8201aa0 2024-09-17T03:08:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.407+0000 7ffabe7fc640 1 -- 172.21.15.78:0/1520192945 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffac000ea60 con 0x7ffac8201aa0 2024-09-17T03:08:03.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.407+0000 7ffacedfa640 1 -- 172.21.15.78:0/1520192945 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ffac81e9cb0 con 0x7ffac8201aa0 2024-09-17T03:08:03.408 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.409+0000 7ffabe7fc640 1 -- 172.21.15.78:0/1520192945 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ffac0005930 con 0x7ffac8201aa0 2024-09-17T03:08:03.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.409+0000 7ffaabfff640 1 -- 172.21.15.78:0/1520192945 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa4005290 con 0x7ffac8201aa0 2024-09-17T03:08:03.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.410+0000 7fb061c27640 1 -- 172.21.15.78:0/3514009326 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb05c0c58a0 msgr2=0x7fb05c0c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.410+0000 7fb061c27640 1 --2- 172.21.15.78:0/3514009326 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb05c0c58a0 0x7fb05c0c5cb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb054005fd0 tx=0x7fb05402aa10 comp rx=0 tx=0).stop 2024-09-17T03:08:03.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.410+0000 7fb061c27640 1 -- 172.21.15.78:0/3514009326 shutdown_connections 2024-09-17T03:08:03.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.410+0000 7fb061c27640 1 --2- 172.21.15.78:0/3514009326 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb05c0c58a0 0x7fb05c0c5cb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.410+0000 7fb061c27640 1 --2- 172.21.15.78:0/3514009326 >> v2:172.21.15.78:3300/0 conn(0x7fb05c15f7e0 0x7fb05c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.410+0000 7fb061c27640 1 -- 172.21.15.78:0/3514009326 >> 172.21.15.78:0/3514009326 conn(0x7fb05c0cd6c0 msgr2=0x7fb05c0cdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.411+0000 7fb061c27640 1 -- 172.21.15.78:0/3514009326 shutdown_connections 2024-09-17T03:08:03.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.412+0000 7ffabe7fc640 1 -- 172.21.15.78:0/1520192945 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ffac0025070 con 0x7ffac8201aa0 2024-09-17T03:08:03.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.411+0000 7fb061c27640 1 -- 172.21.15.78:0/3514009326 wait complete. 2024-09-17T03:08:03.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.414+0000 7fb061c27640 1 Processor -- start 2024-09-17T03:08:03.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.419+0000 7fb061c27640 1 -- start start 2024-09-17T03:08:03.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.421+0000 7fb061c27640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb05c0cfab0 0x7fb05c06ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.422+0000 7fd28a9ad640 1 -- 172.21.15.78:0/3196797419 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd2840cac60 msgr2=0x7fd2840cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.422+0000 7fd28a9ad640 1 --2- 172.21.15.78:0/3196797419 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd2840cac60 0x7fd2840cb070 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd27c009ca0 tx=0x7fd27c02aaa0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.422+0000 7fd28a9ad640 1 -- 172.21.15.78:0/3196797419 shutdown_connections 2024-09-17T03:08:03.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.422+0000 7fd28a9ad640 1 --2- 172.21.15.78:0/3196797419 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd2840cac60 0x7fd2840cb070 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.422+0000 7fd28a9ad640 1 -- 172.21.15.78:0/3196797419 >> 172.21.15.78:0/3196797419 conn(0x7fd28406d5d0 msgr2=0x7fd28406ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.429+0000 7fb061c27640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb05c15f7e0 0x7fb05c202330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.429+0000 7fb05b7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb05c0cfab0 0x7fb05c06ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.429+0000 7fb05b7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb05c0cfab0 0x7fb05c06ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.78:60868/0 (socket says 172.21.15.78:60868) 2024-09-17T03:08:03.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.430+0000 7fb05affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb05c15f7e0 0x7fb05c202330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.430+0000 7fb05affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb05c15f7e0 0x7fb05c202330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43682/0 (socket says 172.21.15.78:43682) 2024-09-17T03:08:03.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.430+0000 7fb05b7fe640 1 -- 172.21.15.78:0/2414304384 learned_addr learned my addr 172.21.15.78:0/2414304384 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:03.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.430+0000 7fb061c27640 1 --2- 172.21.15.78:0/2414304384 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb05c202870 0x7fb05c156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.430+0000 7fb061c27640 1 -- 172.21.15.78:0/2414304384 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c0cbdb0 con 0x7fb05c15f7e0 2024-09-17T03:08:03.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.430+0000 7fb05bfff640 1 --2- 172.21.15.78:0/2414304384 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb05c202870 0x7fb05c156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.430+0000 7fb061c27640 1 -- 172.21.15.78:0/2414304384 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb05c0cbc30 con 0x7fb05c0cfab0 2024-09-17T03:08:03.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.430+0000 7fb061c27640 1 -- 172.21.15.78:0/2414304384 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb05c159e20 con 0x7fb05c202870 2024-09-17T03:08:03.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.431+0000 7fb05b7fe640 1 -- 172.21.15.78:0/2414304384 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb05c202870 msgr2=0x7fb05c156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.431+0000 7fb05b7fe640 1 --2- 172.21.15.78:0/2414304384 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb05c202870 0x7fb05c156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.431+0000 7fb05b7fe640 1 -- 172.21.15.78:0/2414304384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb05c15f7e0 msgr2=0x7fb05c202330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.431+0000 7fb05b7fe640 1 --2- 172.21.15.78:0/2414304384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb05c15f7e0 0x7fb05c202330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.431+0000 7fb05b7fe640 1 -- 172.21.15.78:0/2414304384 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb05c202f80 con 0x7fb05c0cfab0 2024-09-17T03:08:03.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.431+0000 7fb05affd640 1 --2- 172.21.15.78:0/2414304384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb05c15f7e0 0x7fb05c202330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:03.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.432+0000 7fb05b7fe640 1 --2- 172.21.15.78:0/2414304384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb05c0cfab0 0x7fb05c06ffe0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00d7b0 tx=0x7fb04c00dc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:03.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.432+0000 7fb043fff640 1 -- 172.21.15.78:0/2414304384 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c017070 con 0x7fb05c0cfab0 2024-09-17T03:08:03.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.432+0000 7fb043fff640 1 -- 172.21.15.78:0/2414304384 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb04c004310 con 0x7fb05c0cfab0 2024-09-17T03:08:03.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.433+0000 7fb061c27640 1 -- 172.21.15.78:0/2414304384 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb05c203260 con 0x7fb05c0cfab0 2024-09-17T03:08:03.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.433+0000 7fb061c27640 1 -- 172.21.15.78:0/2414304384 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb05c06f7e0 con 0x7fb05c0cfab0 2024-09-17T03:08:03.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.434+0000 7fb043fff640 1 -- 172.21.15.78:0/2414304384 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c009c30 con 0x7fb05c0cfab0 2024-09-17T03:08:03.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.434+0000 7fb043fff640 1 -- 172.21.15.78:0/2414304384 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb04c0053b0 con 0x7fb05c0cfab0 2024-09-17T03:08:03.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.435+0000 7fb043fff640 1 -- 172.21.15.78:0/2414304384 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb04c003790 con 0x7fb05c0cfab0 2024-09-17T03:08:03.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.440+0000 7fb041ffb640 1 -- 172.21.15.78:0/2414304384 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb03c005290 con 0x7fb05c0cfab0 2024-09-17T03:08:03.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.422+0000 7fd28a9ad640 1 -- 172.21.15.78:0/3196797419 shutdown_connections 2024-09-17T03:08:03.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.422+0000 7fd28a9ad640 1 -- 172.21.15.78:0/3196797419 wait complete. 2024-09-17T03:08:03.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.425+0000 7fd28a9ad640 1 Processor -- start 2024-09-17T03:08:03.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.425+0000 7fd28a9ad640 1 -- start start 2024-09-17T03:08:03.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.428+0000 7fd28a9ad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd284074640 0x7fd284154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.428+0000 7fd28a9ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2840cc630 0x7fd2840b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.428+0000 7fd28a9ad640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd284154950 0x7fd284156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.428+0000 7fd28a9ad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd2840cd2d0 con 0x7fd2840cc630 2024-09-17T03:08:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.428+0000 7fd28a9ad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd2840cd150 con 0x7fd284074640 2024-09-17T03:08:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.428+0000 7fd28a9ad640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd2840cd450 con 0x7fd284154950 2024-09-17T03:08:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.428+0000 7fd283fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd284074640 0x7fd284154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.440+0000 7fd283fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd284074640 0x7fd284154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.78:60858/0 (socket says 172.21.15.78:60858) 2024-09-17T03:08:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.440+0000 7fd283fff640 1 -- 172.21.15.78:0/1044768804 learned_addr learned my addr 172.21.15.78:0/1044768804 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.440+0000 7fd2837fe640 1 --2- 172.21.15.78:0/1044768804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2840cc630 0x7fd2840b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.440+0000 7fd283fff640 1 -- 172.21.15.78:0/1044768804 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd284154950 msgr2=0x7fd284156eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T03:08:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.440+0000 7fd283fff640 1 --2- 172.21.15.78:0/1044768804 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd284154950 0x7fd284156eb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.440+0000 7fd283fff640 1 -- 172.21.15.78:0/1044768804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2840cc630 msgr2=0x7fd2840b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.440+0000 7fd283fff640 1 --2- 172.21.15.78:0/1044768804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2840cc630 0x7fd2840b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.440+0000 7fd283fff640 1 -- 172.21.15.78:0/1044768804 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2840b4f80 con 0x7fd284074640 2024-09-17T03:08:03.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.440+0000 7fd2837fe640 1 --2- 172.21.15.78:0/1044768804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2840cc630 0x7fd2840b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:03.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.441+0000 7fd283fff640 1 --2- 172.21.15.78:0/1044768804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd284074640 0x7fd284154410 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd27400c430 tx=0x7fd27400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:03.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.443+0000 7fb043fff640 1 -- 172.21.15.78:0/2414304384 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb04c020020 con 0x7fb05c0cfab0 2024-09-17T03:08:03.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.446+0000 7fd280ff9640 1 -- 172.21.15.78:0/1044768804 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd274017070 con 0x7fd284074640 2024-09-17T03:08:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.447+0000 7fd28a9ad640 1 -- 172.21.15.78:0/1044768804 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2840b5260 con 0x7fd284074640 2024-09-17T03:08:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.447+0000 7fd28a9ad640 1 -- 172.21.15.78:0/1044768804 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2840b5820 con 0x7fd284074640 2024-09-17T03:08:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.448+0000 7fd280ff9640 1 -- 172.21.15.78:0/1044768804 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2740053c0 con 0x7fd284074640 2024-09-17T03:08:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.448+0000 7fd280ff9640 1 -- 172.21.15.78:0/1044768804 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd274003850 con 0x7fd284074640 2024-09-17T03:08:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.448+0000 7fd280ff9640 1 -- 172.21.15.78:0/1044768804 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd27401a070 con 0x7fd284074640 2024-09-17T03:08:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.448+0000 7fd280ff9640 1 -- 172.21.15.78:0/1044768804 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd27401c780 con 0x7fd284074640 2024-09-17T03:08:03.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.450+0000 7fd28a9ad640 1 -- 172.21.15.78:0/1044768804 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd264005290 con 0x7fd284074640 2024-09-17T03:08:03.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.466+0000 7fd280ff9640 1 -- 172.21.15.78:0/1044768804 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd274021020 con 0x7fd284074640 2024-09-17T03:08:03.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.472+0000 7fa7f6c63640 1 -- 172.21.15.78:0/3635990645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7f00735d0 msgr2=0x7fa7f00739e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.472+0000 7fa7f6c63640 1 --2- 172.21.15.78:0/3635990645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7f00735d0 0x7fa7f00739e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00d0ff0 tx=0x7fa7e802aa00 comp rx=0 tx=0).stop 2024-09-17T03:08:03.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.475+0000 7fa7f6c63640 1 -- 172.21.15.78:0/3635990645 shutdown_connections 2024-09-17T03:08:03.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.475+0000 7fa7f6c63640 1 --2- 172.21.15.78:0/3635990645 >> v2:172.21.15.78:3300/0 conn(0x7fa7f00d0340 0x7fa7f00d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.475+0000 7fa7f6c63640 1 --2- 172.21.15.78:0/3635990645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7f00735d0 0x7fa7f00739e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.475+0000 7fa7f6c63640 1 --2- 172.21.15.78:0/3635990645 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa7f00b33b0 0x7fa7f00b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.475+0000 7fa7f6c63640 1 -- 172.21.15.78:0/3635990645 >> 172.21.15.78:0/3635990645 conn(0x7fa7f0070b20 msgr2=0x7fa7f0070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.475+0000 7fa7f6c63640 1 -- 172.21.15.78:0/3635990645 shutdown_connections 2024-09-17T03:08:03.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.475+0000 7fa7f6c63640 1 -- 172.21.15.78:0/3635990645 wait complete. 2024-09-17T03:08:03.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.478+0000 7fa7f6c63640 1 Processor -- start 2024-09-17T03:08:03.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.479+0000 7f77143ad640 1 -- 172.21.15.78:0/1580110848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f770c08b2c0 msgr2=0x7f770c08b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.479+0000 7f77143ad640 1 --2- 172.21.15.78:0/1580110848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f770c08b2c0 0x7f770c08b6d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f770c072770 tx=0x7f770402aa70 comp rx=0 tx=0).stop 2024-09-17T03:08:03.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.480+0000 7f77143ad640 1 -- 172.21.15.78:0/1580110848 shutdown_connections 2024-09-17T03:08:03.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.480+0000 7f77143ad640 1 --2- 172.21.15.78:0/1580110848 >> v2:172.21.15.78:3300/0 conn(0x7f770c072e00 0x7f770c073210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.480+0000 7f77143ad640 1 --2- 172.21.15.78:0/1580110848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f770c08b2c0 0x7f770c08b6d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.480+0000 7f77143ad640 1 -- 172.21.15.78:0/1580110848 >> 172.21.15.78:0/1580110848 conn(0x7f770c0b1c20 msgr2=0x7f770c0b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.478+0000 7fa7f6c63640 1 -- start start 2024-09-17T03:08:03.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.480+0000 7fa7f6c63640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7f00735d0 0x7fa7f00b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.480+0000 7fa7f6c63640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7f00b33b0 0x7fa7f00cf340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.481+0000 7fa7f5c61640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7f00735d0 0x7fa7f00b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.481+0000 7fa7f5c61640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7f00735d0 0x7fa7f00b2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.78:60900/0 (socket says 172.21.15.78:60900) 2024-09-17T03:08:03.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.481+0000 7fa7f5460640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7f00b33b0 0x7fa7f00cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.481+0000 7fa7f5460640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7f00b33b0 0x7fa7f00cf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43696/0 (socket says 172.21.15.78:43696) 2024-09-17T03:08:03.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.481+0000 7fa7f6c63640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa7f00d0340 0x7fa7f00cf880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.481+0000 7fa7f6c63640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f016b820 con 0x7fa7f00b33b0 2024-09-17T03:08:03.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.481+0000 7fa7f6c63640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f016b6a0 con 0x7fa7f00735d0 2024-09-17T03:08:03.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.481+0000 7fa7f6c63640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa7f016b9a0 con 0x7fa7f00d0340 2024-09-17T03:08:03.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.482+0000 7fa7f5c61640 1 -- 172.21.15.78:0/1706953669 learned_addr learned my addr 172.21.15.78:0/1706953669 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:03.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.482+0000 7fa7f5460640 1 -- 172.21.15.78:0/1706953669 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa7f00d0340 msgr2=0x7fa7f00cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.482+0000 7fa7f5460640 1 --2- 172.21.15.78:0/1706953669 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa7f00d0340 0x7fa7f00cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.482+0000 7fa7f5460640 1 -- 172.21.15.78:0/1706953669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7f00735d0 msgr2=0x7fa7f00b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.482+0000 7fa7f5460640 1 --2- 172.21.15.78:0/1706953669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7f00735d0 0x7fa7f00b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.482+0000 7fa7f5460640 1 -- 172.21.15.78:0/1706953669 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f00ce2a0 con 0x7fa7f00b33b0 2024-09-17T03:08:03.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.483+0000 7fa7f5460640 1 --2- 172.21.15.78:0/1706953669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7f00b33b0 0x7fa7f00cf340 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8032000 tx=0x7fa7e8039e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:03.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.483+0000 7fa7e67fc640 1 -- 172.21.15.78:0/1706953669 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8033040 con 0x7fa7f00b33b0 2024-09-17T03:08:03.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.483+0000 7fa7e67fc640 1 -- 172.21.15.78:0/1706953669 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7e8043710 con 0x7fa7f00b33b0 2024-09-17T03:08:03.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.484+0000 7fa7f6c63640 1 -- 172.21.15.78:0/1706953669 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f00ce580 con 0x7fa7f00b33b0 2024-09-17T03:08:03.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.484+0000 7fa7f6c63640 1 -- 172.21.15.78:0/1706953669 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f00ceb40 con 0x7fa7f00b33b0 2024-09-17T03:08:03.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.486+0000 7fa7e67fc640 1 -- 172.21.15.78:0/1706953669 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8043b20 con 0x7fa7f00b33b0 2024-09-17T03:08:03.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.480+0000 7f77143ad640 1 -- 172.21.15.78:0/1580110848 shutdown_connections 2024-09-17T03:08:03.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.480+0000 7f77143ad640 1 -- 172.21.15.78:0/1580110848 wait complete. 2024-09-17T03:08:03.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.484+0000 7f77143ad640 1 Processor -- start 2024-09-17T03:08:03.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.484+0000 7f77143ad640 1 -- start start 2024-09-17T03:08:03.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.486+0000 7f77143ad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f770c072e00 0x7f770c0b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.487+0000 7f77143ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f770c16e750 0x7f770c0c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.487+0000 7f77143ad640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f770c0c9c60 0x7f770c0ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.487+0000 7f77143ad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f770c073750 con 0x7f770c16e750 2024-09-17T03:08:03.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.487+0000 7f77143ad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f770c0cd160 con 0x7f770c072e00 2024-09-17T03:08:03.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.487+0000 7f77143ad640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f770c0738d0 con 0x7f770c0c9c60 2024-09-17T03:08:03.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.487+0000 7f7712149640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f770c072e00 0x7f770c0b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.487+0000 7f7712149640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f770c072e00 0x7f770c0b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.78:60918/0 (socket says 172.21.15.78:60918) 2024-09-17T03:08:03.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.487+0000 7f7712149640 1 -- 172.21.15.78:0/204544888 learned_addr learned my addr 172.21.15.78:0/204544888 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:03.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.487+0000 7f7711948640 1 --2- 172.21.15.78:0/204544888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f770c16e750 0x7f770c0c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.488+0000 7f7712149640 1 -- 172.21.15.78:0/204544888 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f770c0c9c60 msgr2=0x7f770c0ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.488+0000 7fa7dbfff640 1 -- 172.21.15.78:0/1706953669 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7f016be50 con 0x7fa7f00b33b0 2024-09-17T03:08:03.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.488+0000 7f771294a640 1 --2- 172.21.15.78:0/204544888 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f770c0c9c60 0x7f770c0ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.488+0000 7f7712149640 1 --2- 172.21.15.78:0/204544888 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f770c0c9c60 0x7f770c0ca070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.488+0000 7f7712149640 1 -- 172.21.15.78:0/204544888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f770c16e750 msgr2=0x7f770c0c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.488+0000 7f7712149640 1 --2- 172.21.15.78:0/204544888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f770c16e750 0x7f770c0c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.488+0000 7f7712149640 1 -- 172.21.15.78:0/204544888 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770c0b5140 con 0x7f770c072e00 2024-09-17T03:08:03.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.488+0000 7f7712149640 1 --2- 172.21.15.78:0/204544888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f770c072e00 0x7f770c0b4980 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f770800c400 tx=0x7f770800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:03.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.490+0000 7fa7e67fc640 1 -- 172.21.15.78:0/1706953669 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa7e804a060 con 0x7fa7f00b33b0 2024-09-17T03:08:03.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.490+0000 7fa7e67fc640 1 -- 172.21.15.78:0/1706953669 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa7e804b3e0 con 0x7fa7f00b33b0 2024-09-17T03:08:03.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.492+0000 7fa7e67fc640 1 -- 172.21.15.78:0/1706953669 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa7e803e070 con 0x7fa7f00b33b0 2024-09-17T03:08:03.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.498+0000 7fc859dad640 1 -- 172.21.15.78:0/172077047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc84c051660 msgr2=0x7fc84c051a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.498+0000 7fc859dad640 1 --2- 172.21.15.78:0/172077047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc84c051660 0x7fc84c051a70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc854051230 tx=0x7fc8540a66b0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.499+0000 7f7702ffd640 1 -- 172.21.15.78:0/204544888 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77080052d0 con 0x7f770c072e00 2024-09-17T03:08:03.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.497+0000 7fe21eb39640 1 -- 172.21.15.78:0/571903506 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fe1f8005580 con 0x7fe2180cf880 2024-09-17T03:08:03.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.498+0000 7fa8f6294640 1 -- 172.21.15.78:0/849886765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8e80070e0 msgr2=0x7fa8e8053860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.498+0000 7fa8f6294640 1 --2- 172.21.15.78:0/849886765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8e80070e0 0x7fa8e8053860 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc007350 tx=0x7fa8dc02b0d0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.498+0000 7fa8f6294640 1 -- 172.21.15.78:0/849886765 shutdown_connections 2024-09-17T03:08:03.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.498+0000 7fa8f6294640 1 --2- 172.21.15.78:0/849886765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8e80070e0 0x7fa8e8053860 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.498+0000 7fa8f6294640 1 -- 172.21.15.78:0/849886765 >> 172.21.15.78:0/849886765 conn(0x7fa8e801d9d0 msgr2=0x7fa8e8039690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.499+0000 7fa8f6294640 1 -- 172.21.15.78:0/849886765 shutdown_connections 2024-09-17T03:08:03.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.499+0000 7fc859dad640 1 -- 172.21.15.78:0/172077047 shutdown_connections 2024-09-17T03:08:03.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.499+0000 7fc859dad640 1 --2- 172.21.15.78:0/172077047 >> v2:172.21.15.78:3300/0 conn(0x7fc84c054750 0x7fc84c054b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.499+0000 7fc859dad640 1 --2- 172.21.15.78:0/172077047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc84c051660 0x7fc84c051a70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.499+0000 7fc859dad640 1 -- 172.21.15.78:0/172077047 >> 172.21.15.78:0/172077047 conn(0x7fc84c01d9d0 msgr2=0x7fc84c039690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.499+0000 7fc859dad640 1 -- 172.21.15.78:0/172077047 shutdown_connections 2024-09-17T03:08:03.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.499+0000 7fc859dad640 1 -- 172.21.15.78:0/172077047 wait complete. 2024-09-17T03:08:03.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.502+0000 7fc859dad640 1 Processor -- start 2024-09-17T03:08:03.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.499+0000 7f77143ad640 1 -- 172.21.15.78:0/204544888 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f770c0b5420 con 0x7f770c072e00 2024-09-17T03:08:03.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.499+0000 7f77143ad640 1 -- 172.21.15.78:0/204544888 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f770c157c00 con 0x7f770c072e00 2024-09-17T03:08:03.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.500+0000 7f7702ffd640 1 -- 172.21.15.78:0/204544888 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7708011890 con 0x7f770c072e00 2024-09-17T03:08:03.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.500+0000 7f7702ffd640 1 -- 172.21.15.78:0/204544888 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7708011ce0 con 0x7f770c072e00 2024-09-17T03:08:03.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.502+0000 7f77143ad640 1 -- 172.21.15.78:0/204544888 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76f4005290 con 0x7f770c072e00 2024-09-17T03:08:03.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.499+0000 7fa8f6294640 1 -- 172.21.15.78:0/849886765 wait complete. 2024-09-17T03:08:03.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.502+0000 7fa8f6294640 1 Processor -- start 2024-09-17T03:08:03.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.502+0000 7fa8f6294640 1 -- start start 2024-09-17T03:08:03.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.504+0000 7fa8f6294640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa8e8055110 0x7fa8e80f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.504+0000 7fa8f6294640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8e80fdd90 0x7fa8e80f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.504+0000 7fa8f6294640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8e80ffeb0 0x7fa8e81002c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.504+0000 7fa8f6294640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e8053f20 con 0x7fa8e80ffeb0 2024-09-17T03:08:03.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.504+0000 7fa8f6294640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e8053da0 con 0x7fa8e80fdd90 2024-09-17T03:08:03.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.504+0000 7fa8f6294640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa8e80540a0 con 0x7fa8e8055110 2024-09-17T03:08:03.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.505+0000 7f7702ffd640 1 -- 172.21.15.78:0/204544888 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7708003980 con 0x7f770c072e00 2024-09-17T03:08:03.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.505+0000 7f7702ffd640 1 -- 172.21.15.78:0/204544888 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f77080193f0 con 0x7f770c072e00 2024-09-17T03:08:03.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.503+0000 7fc859dad640 1 -- start start 2024-09-17T03:08:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.505+0000 7fa8f4831640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8e80ffeb0 0x7fa8e81002c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.505+0000 7fa8f4831640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8e80ffeb0 0x7fa8e81002c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43712/0 (socket says 172.21.15.78:43712) 2024-09-17T03:08:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.505+0000 7fa8f4831640 1 -- 172.21.15.78:0/1233821909 learned_addr learned my addr 172.21.15.78:0/1233821909 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.506+0000 7fc859dad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc84c051660 0x7fc84c0e01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.506+0000 7fc8537fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc84c051660 0x7fc84c0e01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.506+0000 7fc8537fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc84c051660 0x7fc84c0e01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43724/0 (socket says 172.21.15.78:43724) 2024-09-17T03:08:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.506+0000 7fc8537fe640 1 -- 172.21.15.78:0/3737388153 learned_addr learned my addr 172.21.15.78:0/3737388153 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.506+0000 7fc859dad640 1 --2- 172.21.15.78:0/3737388153 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc84c052390 0x7fc84c181a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.506+0000 7fa8ef7fe640 1 --2- 172.21.15.78:0/1233821909 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8e80fdd90 0x7fa8e80f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.506+0000 7fa8f4831640 1 -- 172.21.15.78:0/1233821909 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa8e8055110 msgr2=0x7fa8e80f2b40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:08:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.506+0000 7fa8f4831640 1 --2- 172.21.15.78:0/1233821909 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa8e8055110 0x7fa8e80f2b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.506+0000 7fa8f4831640 1 -- 172.21.15.78:0/1233821909 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8e80fdd90 msgr2=0x7fa8e80f3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.506+0000 7fa8f4831640 1 --2- 172.21.15.78:0/1233821909 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8e80fdd90 0x7fa8e80f3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.506+0000 7fa8f4831640 1 -- 172.21.15.78:0/1233821909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e804e100 con 0x7fa8e80ffeb0 2024-09-17T03:08:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.506+0000 7fc852ffd640 1 --2- 172.21.15.78:0/3737388153 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc84c052390 0x7fc84c181a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.507+0000 7fc859dad640 1 --2- 172.21.15.78:0/3737388153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc84c054750 0x7fc84c181f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.507+0000 7fc859dad640 1 -- 172.21.15.78:0/3737388153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c052920 con 0x7fc84c051660 2024-09-17T03:08:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.507+0000 7fc859dad640 1 -- 172.21.15.78:0/3737388153 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc84c0527a0 con 0x7fc84c054750 2024-09-17T03:08:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.507+0000 7fc859dad640 1 -- 172.21.15.78:0/3737388153 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc84c0550a0 con 0x7fc84c052390 2024-09-17T03:08:03.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.507+0000 7fa8f4831640 1 --2- 172.21.15.78:0/1233821909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8e80ffeb0 0x7fa8e81002c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc007440 tx=0x7fa8dc02bb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:03.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.507+0000 7fc8537fe640 1 -- 172.21.15.78:0/3737388153 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc84c052390 msgr2=0x7fc84c181a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.507+0000 7fc8537fe640 1 --2- 172.21.15.78:0/3737388153 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc84c052390 0x7fc84c181a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.507+0000 7fc8537fe640 1 -- 172.21.15.78:0/3737388153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc84c054750 msgr2=0x7fc84c181f50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T03:08:03.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.507+0000 7fc8537fe640 1 --2- 172.21.15.78:0/3737388153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc84c054750 0x7fc84c181f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.507+0000 7fc8537fe640 1 -- 172.21.15.78:0/3737388153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc84c00b5a0 con 0x7fc84c051660 2024-09-17T03:08:03.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.508+0000 7fc8537fe640 1 --2- 172.21.15.78:0/3737388153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc84c051660 0x7fc84c0e01d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc84800c760 tx=0x7fc84800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:03.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.507+0000 7f7702ffd640 1 -- 172.21.15.78:0/204544888 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7708027020 con 0x7f770c072e00 2024-09-17T03:08:03.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.509+0000 7fa8ecff9640 1 -- 172.21.15.78:0/1233821909 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc004230 con 0x7fa8e80ffeb0 2024-09-17T03:08:03.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.509+0000 7fa8ecff9640 1 -- 172.21.15.78:0/1233821909 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8dc0044c0 con 0x7fa8e80ffeb0 2024-09-17T03:08:03.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.509+0000 7fa8f6294640 1 -- 172.21.15.78:0/1233821909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e8112900 con 0x7fa8e80ffeb0 2024-09-17T03:08:03.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.509+0000 7fa8f6294640 1 -- 172.21.15.78:0/1233821909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e804e650 con 0x7fa8e80ffeb0 2024-09-17T03:08:03.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.509+0000 7fa8ecff9640 1 -- 172.21.15.78:0/1233821909 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8dc003830 con 0x7fa8e80ffeb0 2024-09-17T03:08:03.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.510+0000 7fa8ecff9640 1 -- 172.21.15.78:0/1233821909 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa8dc00a070 con 0x7fa8e80ffeb0 2024-09-17T03:08:03.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.510+0000 7fa8ecff9640 1 -- 172.21.15.78:0/1233821909 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa8dc008380 con 0x7fa8e80ffeb0 2024-09-17T03:08:03.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.509+0000 7f03e1751640 1 -- 172.21.15.78:0/2910291226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03dc0cce80 msgr2=0x7f03dc08b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.509+0000 7f03e1751640 1 --2- 172.21.15.78:0/2910291226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03dc0cce80 0x7f03dc08b2c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f03dc0cc910 tx=0x7f03d402e890 comp rx=0 tx=0).stop 2024-09-17T03:08:03.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.510+0000 7f03e1751640 1 -- 172.21.15.78:0/2910291226 shutdown_connections 2024-09-17T03:08:03.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.510+0000 7f03e1751640 1 --2- 172.21.15.78:0/2910291226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f03dc08b800 0x7f03dc16ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.510+0000 7f03e1751640 1 --2- 172.21.15.78:0/2910291226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03dc0cce80 0x7f03dc08b2c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.510+0000 7f03e1751640 1 --2- 172.21.15.78:0/2910291226 >> v2:172.21.15.193:3300/0 conn(0x7f03dc16e750 0x7f03dc0cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.510+0000 7f03e1751640 1 -- 172.21.15.78:0/2910291226 >> 172.21.15.78:0/2910291226 conn(0x7f03dc0b1c20 msgr2=0x7f03dc0b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.510+0000 7f03e1751640 1 -- 172.21.15.78:0/2910291226 shutdown_connections 2024-09-17T03:08:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.510+0000 7f03e1751640 1 -- 172.21.15.78:0/2910291226 wait complete. 2024-09-17T03:08:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.513+0000 7f03e1751640 1 Processor -- start 2024-09-17T03:08:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.514+0000 7fe2157fa640 1 -- 172.21.15.78:0/571903506 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7fe208018420 con 0x7fe2180cf880 2024-09-17T03:08:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.515+0000 7fe21eb39640 1 -- 172.21.15.78:0/571903506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe2180cf880 msgr2=0x7fe21814d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.515+0000 7fe21eb39640 1 --2- 172.21.15.78:0/571903506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe2180cf880 0x7fe21814d950 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe20800e710 tx=0x7fe20800ebd0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.513+0000 7f03e1751640 1 -- start start 2024-09-17T03:08:03.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.515+0000 7f03e1751640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f03dc08b800 0x7f03dc167bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.516+0000 7f03e1751640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03dc16e750 0x7f03dc0b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.516+0000 7fe21eb39640 1 -- 172.21.15.78:0/571903506 shutdown_connections 2024-09-17T03:08:03.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.516+0000 7fe21eb39640 1 --2- 172.21.15.78:0/571903506 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe2180d2730 0x7fe2180b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.516+0000 7fe21eb39640 1 --2- 172.21.15.78:0/571903506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2180d0a00 0x7fe2180b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.516+0000 7fe21eb39640 1 --2- 172.21.15.78:0/571903506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe2180cf880 0x7fe21814d950 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.516+0000 7fe21eb39640 1 -- 172.21.15.78:0/571903506 >> 172.21.15.78:0/571903506 conn(0x7fe218072aa0 msgr2=0x7fe2181552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.516+0000 7f03e1751640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03dc217080 0x7f03dc216470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.516+0000 7f03e1751640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f03dc16f4c0 con 0x7f03dc217080 2024-09-17T03:08:03.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.516+0000 7f03db7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03dc217080 0x7f03dc216470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.516+0000 7f03db7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03dc217080 0x7f03dc216470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43738/0 (socket says 172.21.15.78:43738) 2024-09-17T03:08:03.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.516+0000 7f03db7fe640 1 -- 172.21.15.78:0/362985797 learned_addr learned my addr 172.21.15.78:0/362985797 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:03.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.516+0000 7f03e1751640 1 -- 172.21.15.78:0/362985797 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f03dc16f340 con 0x7f03dc16e750 2024-09-17T03:08:03.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.516+0000 7f03e1751640 1 -- 172.21.15.78:0/362985797 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f03dc16f640 con 0x7f03dc08b800 2024-09-17T03:08:03.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.516+0000 7fe21eb39640 1 -- 172.21.15.78:0/571903506 shutdown_connections 2024-09-17T03:08:03.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.516+0000 7fe21eb39640 1 -- 172.21.15.78:0/571903506 wait complete. 2024-09-17T03:08:03.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.519+0000 7fa8f6294640 1 -- 172.21.15.78:0/1233821909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8d0005290 con 0x7fa8e80ffeb0 2024-09-17T03:08:03.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.524+0000 7fc83ffff640 1 -- 172.21.15.78:0/3737388153 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8480050d0 con 0x7fc84c051660 2024-09-17T03:08:03.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.524+0000 7fc83ffff640 1 -- 172.21.15.78:0/3737388153 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc848005270 con 0x7fc84c051660 2024-09-17T03:08:03.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.524+0000 7fc83ffff640 1 -- 172.21.15.78:0/3737388153 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84800a640 con 0x7fc84c051660 2024-09-17T03:08:03.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.524+0000 7fc859dad640 1 -- 172.21.15.78:0/3737388153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc84c0e0710 con 0x7fc84c051660 2024-09-17T03:08:03.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.524+0000 7fc859dad640 1 -- 172.21.15.78:0/3737388153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc84c0e3b80 con 0x7fc84c051660 2024-09-17T03:08:03.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.527+0000 7fc83dffb640 1 -- 172.21.15.78:0/3737388153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc84c055550 con 0x7fc84c051660 2024-09-17T03:08:03.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.526+0000 7fa8ecff9640 1 -- 172.21.15.78:0/1233821909 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa8dc05d860 con 0x7fa8e80ffeb0 2024-09-17T03:08:03.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.527+0000 7f0a348f5640 1 -- 172.21.15.78:0/3176598047 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0a280e3180 msgr2=0x7f0a280e3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.527+0000 7f0a348f5640 1 --2- 172.21.15.78:0/3176598047 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0a280e3180 0x7f0a280e3590 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c009830 tx=0x7f0a1c02a410 comp rx=0 tx=0).stop 2024-09-17T03:08:03.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.528+0000 7f0a348f5640 1 -- 172.21.15.78:0/3176598047 shutdown_connections 2024-09-17T03:08:03.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.528+0000 7f0a348f5640 1 --2- 172.21.15.78:0/3176598047 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0a280e3180 0x7f0a280e3590 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.528+0000 7f0a348f5640 1 --2- 172.21.15.78:0/3176598047 >> v2:172.21.15.193:3300/0 conn(0x7f0a280348f0 0x7f0a28035ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.528+0000 7f0a348f5640 1 -- 172.21.15.78:0/3176598047 >> 172.21.15.78:0/3176598047 conn(0x7f0a2801e260 msgr2=0x7f0a28039e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.528+0000 7f0a348f5640 1 -- 172.21.15.78:0/3176598047 shutdown_connections 2024-09-17T03:08:03.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.528+0000 7f0a348f5640 1 -- 172.21.15.78:0/3176598047 wait complete. 2024-09-17T03:08:03.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.518+0000 7f03db7fe640 1 -- 172.21.15.78:0/362985797 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f03dc08b800 msgr2=0x7f03dc167bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:08:03.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.518+0000 7f03db7fe640 1 --2- 172.21.15.78:0/362985797 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f03dc08b800 0x7f03dc167bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.518+0000 7f03db7fe640 1 -- 172.21.15.78:0/362985797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03dc16e750 msgr2=0x7f03dc0b2f20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:08:03.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.518+0000 7f03db7fe640 1 --2- 172.21.15.78:0/362985797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03dc16e750 0x7f03dc0b2f20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.518+0000 7f03db7fe640 1 -- 172.21.15.78:0/362985797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03dc0b56d0 con 0x7f03dc217080 2024-09-17T03:08:03.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.527+0000 7f03db7fe640 1 --2- 172.21.15.78:0/362985797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03dc217080 0x7f03dc216470 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f03d0005d00 tx=0x7f03d000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:03.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.531+0000 7f0a348f5640 1 Processor -- start 2024-09-17T03:08:03.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.531+0000 7fc83ffff640 1 -- 172.21.15.78:0/3737388153 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc84800a7e0 con 0x7fc84c051660 2024-09-17T03:08:03.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.534+0000 7f03c37fe640 1 -- 172.21.15.78:0/362985797 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d0017070 con 0x7f03dc217080 2024-09-17T03:08:03.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.534+0000 7f03e1751640 1 -- 172.21.15.78:0/362985797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03dc168110 con 0x7f03dc217080 2024-09-17T03:08:03.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.532+0000 7f0c2a05c640 1 -- 172.21.15.78:0/3080760710 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c0c0053a0 msgr2=0x7f0c0c00ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.532+0000 7f0c2a05c640 1 --2- 172.21.15.78:0/3080760710 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c0c0053a0 0x7f0c0c00ba20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0c240c8000 tx=0x7f0c0c005830 comp rx=0 tx=0).stop 2024-09-17T03:08:03.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.532+0000 7f0c23fff640 1 -- 172.21.15.78:0/3080760710 reap_dead start 2024-09-17T03:08:03.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.532+0000 7f0c2a05c640 1 -- 172.21.15.78:0/3080760710 shutdown_connections 2024-09-17T03:08:03.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.532+0000 7f0c2a05c640 1 -- 172.21.15.78:0/3080760710 >> 172.21.15.78:0/3080760710 conn(0x7f0c2408bfc0 msgr2=0x7f0c2409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.534 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.534+0000 7f03e1751640 1 -- 172.21.15.78:0/362985797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03dc0b3ac0 con 0x7f03dc217080 2024-09-17T03:08:03.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.536+0000 7fc522ffd640 1 -- 172.21.15.78:0/3183887108 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fc514005580 con 0x7fc530054130 2024-09-17T03:08:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.536+0000 7f0c2a05c640 1 -- 172.21.15.78:0/3080760710 shutdown_connections 2024-09-17T03:08:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.537+0000 7f03c37fe640 1 -- 172.21.15.78:0/362985797 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03d0005310 con 0x7f03dc217080 2024-09-17T03:08:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.537+0000 7f03c37fe640 1 -- 172.21.15.78:0/362985797 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d0020060 con 0x7f03dc217080 2024-09-17T03:08:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.537+0000 7f03c37fe640 1 -- 172.21.15.78:0/362985797 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f03d00047a0 con 0x7f03dc217080 2024-09-17T03:08:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.537+0000 7f03c37fe640 1 -- 172.21.15.78:0/362985797 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f03d00104e0 con 0x7f03dc217080 2024-09-17T03:08:03.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.539+0000 7fc83ffff640 1 -- 172.21.15.78:0/3737388153 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc848012760 con 0x7fc84c051660 2024-09-17T03:08:03.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.539+0000 7fc83ffff640 1 -- 172.21.15.78:0/3737388153 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fc84c0e0710 con 0x7fc84c051660 2024-09-17T03:08:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.540+0000 7fe3527fc640 1 -- 172.21.15.78:0/1499410173 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fe34c005580 con 0x7fe36c0cce80 2024-09-17T03:08:03.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.540+0000 7f03c17fa640 1 -- 172.21.15.78:0/362985797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03bc005290 con 0x7f03dc217080 2024-09-17T03:08:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.543+0000 7f0a348f5640 1 -- start start 2024-09-17T03:08:03.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.545+0000 7f03c37fe640 1 -- 172.21.15.78:0/362985797 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f03dc168110 con 0x7f03dc217080 2024-09-17T03:08:03.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.545+0000 7f8a12512640 1 -- 172.21.15.78:0/663918453 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a04034410 msgr2=0x7f8a04053140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.545+0000 7f8a12512640 1 --2- 172.21.15.78:0/663918453 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a04034410 0x7f8a04053140 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c051230 tx=0x7f8a0c096750 comp rx=0 tx=0).stop 2024-09-17T03:08:03.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.545+0000 7f8a12512640 1 -- 172.21.15.78:0/663918453 shutdown_connections 2024-09-17T03:08:03.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.545+0000 7f8a12512640 1 --2- 172.21.15.78:0/663918453 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a04034410 0x7f8a04053140 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.545+0000 7f8a12512640 1 --2- 172.21.15.78:0/663918453 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8a040070d0 0x7f8a04053680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.545+0000 7f8a12512640 1 -- 172.21.15.78:0/663918453 >> 172.21.15.78:0/663918453 conn(0x7f8a0401d9c0 msgr2=0x7f8a04039680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.542+0000 7f0c2a05c640 1 -- 172.21.15.78:0/3080760710 wait complete. 2024-09-17T03:08:03.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.545+0000 7f0c2a05c640 1 Processor -- start 2024-09-17T03:08:03.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.545+0000 7f0c2a05c640 1 -- start start 2024-09-17T03:08:03.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.547+0000 7f0c2a05c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c0c0053a0 0x7f0c241f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.547+0000 7f0c2a05c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c24161e20 0x7f0c240b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.547+0000 7f0c2a05c640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c24162230 0x7f0c240b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.547+0000 7f0c2a05c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0c240d2740 con 0x7f0c24161e20 2024-09-17T03:08:03.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.547+0000 7f0c2a05c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2406fb20 con 0x7f0c0c0053a0 2024-09-17T03:08:03.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.547+0000 7f0c2a05c640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0c240d28c0 con 0x7f0c24162230 2024-09-17T03:08:03.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.547+0000 7f0c23fff640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c24162230 0x7f0c240b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.547+0000 7f0c23fff640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c24162230 0x7f0c240b6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.78:48684/0 (socket says 172.21.15.78:48684) 2024-09-17T03:08:03.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.547+0000 7f0c23fff640 1 -- 172.21.15.78:0/3475773924 learned_addr learned my addr 172.21.15.78:0/3475773924 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:03.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.548+0000 7f0c237fe640 1 --2- 172.21.15.78:0/3475773924 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c0c0053a0 0x7f0c241f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.545+0000 7f8a12512640 1 -- 172.21.15.78:0/663918453 shutdown_connections 2024-09-17T03:08:03.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.545+0000 7f8a12512640 1 -- 172.21.15.78:0/663918453 wait complete. 2024-09-17T03:08:03.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.548+0000 7f8a12512640 1 Processor -- start 2024-09-17T03:08:03.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.548+0000 7f8a12512640 1 -- start start 2024-09-17T03:08:03.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.550+0000 7f8a12512640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a040070d0 0x7f8a0404e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.550+0000 7f8a12512640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a04055100 0x7f8a0404bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.550+0000 7f8a12512640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8a040ff5b0 0x7f8a040ff9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.550+0000 7f8a12512640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8a04053d40 con 0x7f8a040070d0 2024-09-17T03:08:03.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.550+0000 7f8a12512640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8a04053bc0 con 0x7f8a04055100 2024-09-17T03:08:03.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.550+0000 7f8a12512640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8a04053ec0 con 0x7f8a040ff5b0 2024-09-17T03:08:03.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.551+0000 7f8a0b7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a04055100 0x7f8a0404bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.551+0000 7f8a0b7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a04055100 0x7f8a0404bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.78:32776/0 (socket says 172.21.15.78:32776) 2024-09-17T03:08:03.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.551+0000 7f8a0b7fe640 1 -- 172.21.15.78:0/550213640 learned_addr learned my addr 172.21.15.78:0/550213640 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:03.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.551+0000 7f8a0bfff640 1 --2- 172.21.15.78:0/550213640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a040070d0 0x7f8a0404e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.551+0000 7f0c22ffd640 1 --2- 172.21.15.78:0/3475773924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c24161e20 0x7f0c240b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.552+0000 7f0c237fe640 1 -- 172.21.15.78:0/3475773924 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c24162230 msgr2=0x7f0c240b6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.552+0000 7f0c237fe640 1 --2- 172.21.15.78:0/3475773924 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c24162230 0x7f0c240b6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.552+0000 7f0c237fe640 1 -- 172.21.15.78:0/3475773924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c24161e20 msgr2=0x7f0c240b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.552+0000 7f0c237fe640 1 --2- 172.21.15.78:0/3475773924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c24161e20 0x7f0c240b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.552+0000 7f0c237fe640 1 -- 172.21.15.78:0/3475773924 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c241f4360 con 0x7f0c0c0053a0 2024-09-17T03:08:03.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.552+0000 7f0c22ffd640 1 --2- 172.21.15.78:0/3475773924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c24161e20 0x7f0c240b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:03.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.553+0000 7f0a348f5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a280348f0 0x7f0a2804c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.553+0000 7f0c237fe640 1 --2- 172.21.15.78:0/3475773924 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c0c0053a0 0x7f0c241f3e20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800c7a0 tx=0x7f0c1800cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:03.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.553+0000 7f0a348f5640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0a28051cb0 0x7f0a280d6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.553+0000 7f0a2f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a280348f0 0x7f0a2804c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.553+0000 7f0a348f5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a280e3180 0x7f0a28053ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.554+0000 7f0a2f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a280348f0 0x7f0a2804c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43776/0 (socket says 172.21.15.78:43776) 2024-09-17T03:08:03.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.554+0000 7f0a2f7fe640 1 -- 172.21.15.78:0/1643097760 learned_addr learned my addr 172.21.15.78:0/1643097760 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:03.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.554+0000 7f0a348f5640 1 -- 172.21.15.78:0/1643097760 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0a280e3e60 con 0x7f0a280348f0 2024-09-17T03:08:03.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.554+0000 7f0a348f5640 1 -- 172.21.15.78:0/1643097760 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0a280e3ce0 con 0x7f0a280e3180 2024-09-17T03:08:03.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.554+0000 7f0a348f5640 1 -- 172.21.15.78:0/1643097760 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0a280e3fe0 con 0x7f0a28051cb0 2024-09-17T03:08:03.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.554+0000 7f0a2f7fe640 1 -- 172.21.15.78:0/1643097760 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0a28051cb0 msgr2=0x7f0a280d6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.554+0000 7f0a2f7fe640 1 --2- 172.21.15.78:0/1643097760 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0a28051cb0 0x7f0a280d6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.554+0000 7f0a2f7fe640 1 -- 172.21.15.78:0/1643097760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a280e3180 msgr2=0x7f0a28053ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.551+0000 7f8a0bfff640 1 -- 172.21.15.78:0/550213640 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8a040ff5b0 msgr2=0x7f8a040ff9c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:08:03.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.551+0000 7f8a0bfff640 1 --2- 172.21.15.78:0/550213640 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8a040ff5b0 0x7f8a040ff9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.551+0000 7f8a0bfff640 1 -- 172.21.15.78:0/550213640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a04055100 msgr2=0x7f8a0404bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.551+0000 7f8a0bfff640 1 --2- 172.21.15.78:0/550213640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a04055100 0x7f8a0404bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.551+0000 7f8a0bfff640 1 -- 172.21.15.78:0/550213640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a040fff00 con 0x7f8a040070d0 2024-09-17T03:08:03.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.551+0000 7f8a0bfff640 1 --2- 172.21.15.78:0/550213640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a040070d0 0x7f8a0404e3c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000c410 tx=0x7f8a0000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:03.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.554+0000 7f0c0bfff640 1 -- 172.21.15.78:0/3475773924 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c18007bb0 con 0x7f0c0c0053a0 2024-09-17T03:08:03.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.554+0000 7f0c0bfff640 1 -- 172.21.15.78:0/3475773924 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c18007e40 con 0x7f0c0c0053a0 2024-09-17T03:08:03.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.554+0000 7f0c2a05c640 1 -- 172.21.15.78:0/3475773924 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c241fb050 con 0x7f0c0c0053a0 2024-09-17T03:08:03.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.554+0000 7f0c2a05c640 1 -- 172.21.15.78:0/3475773924 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c241fa270 con 0x7f0c0c0053a0 2024-09-17T03:08:03.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.555+0000 7f0c0bfff640 1 -- 172.21.15.78:0/3475773924 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1800f6b0 con 0x7f0c0c0053a0 2024-09-17T03:08:03.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.557+0000 7f0c0bfff640 1 -- 172.21.15.78:0/3475773924 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0c1800f8d0 con 0x7f0c0c0053a0 2024-09-17T03:08:03.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.557+0000 7f0c0bfff640 1 -- 172.21.15.78:0/3475773924 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0c180213f0 con 0x7f0c0c0053a0 2024-09-17T03:08:03.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.561+0000 7f0a2ffff640 1 --2- 172.21.15.78:0/1643097760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a280e3180 0x7f0a28053ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.564+0000 7f0a2f7fe640 1 --2- 172.21.15.78:0/1643097760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a280e3180 0x7f0a28053ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.564+0000 7f0a2f7fe640 1 -- 172.21.15.78:0/1643097760 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2804c9e0 con 0x7f0a280348f0 2024-09-17T03:08:03.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.564+0000 7f0a2ffff640 1 --2- 172.21.15.78:0/1643097760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a280e3180 0x7f0a28053ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:03.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.564+0000 7f0a2f7fe640 1 --2- 172.21.15.78:0/1643097760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a280348f0 0x7f0a2804c000 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0a2400b3e0 tx=0x7f0a2400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:03.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.557+0000 7fc5357fa640 1 -- 172.21.15.78:0/3183887108 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fc52400a5c0 con 0x7fc530054130 2024-09-17T03:08:03.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.559+0000 7fc522ffd640 1 -- 172.21.15.78:0/3183887108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc530054130 msgr2=0x7fc5301a8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.559+0000 7fc522ffd640 1 --2- 172.21.15.78:0/3183887108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc530054130 0x7fc5301a8880 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc52400c790 tx=0x7fc52400cc50 comp rx=0 tx=0).stop 2024-09-17T03:08:03.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.559+0000 7fc522ffd640 1 -- 172.21.15.78:0/3183887108 shutdown_connections 2024-09-17T03:08:03.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.559+0000 7fc522ffd640 1 --2- 172.21.15.78:0/3183887108 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5300550e0 0x7fc53004d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.559+0000 7fc522ffd640 1 --2- 172.21.15.78:0/3183887108 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc530054130 0x7fc5301a8880 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.559+0000 7fc522ffd640 1 --2- 172.21.15.78:0/3183887108 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc5300070b0 0x7fc5301a99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.559+0000 7fc522ffd640 1 -- 172.21.15.78:0/3183887108 >> 172.21.15.78:0/3183887108 conn(0x7fc53001d9a0 msgr2=0x7fc530047050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.559+0000 7fc522ffd640 1 -- 172.21.15.78:0/3183887108 shutdown_connections 2024-09-17T03:08:03.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.559+0000 7fc522ffd640 1 -- 172.21.15.78:0/3183887108 wait complete. 2024-09-17T03:08:03.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.556+0000 7f8a08ff9640 1 -- 172.21.15.78:0/550213640 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a00017070 con 0x7f8a040070d0 2024-09-17T03:08:03.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.556+0000 7f8a08ff9640 1 -- 172.21.15.78:0/550213640 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a000035f0 con 0x7f8a040070d0 2024-09-17T03:08:03.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.556+0000 7f8a08ff9640 1 -- 172.21.15.78:0/550213640 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a00003a40 con 0x7f8a040070d0 2024-09-17T03:08:03.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.557+0000 7f8a12512640 1 -- 172.21.15.78:0/550213640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a0404c7e0 con 0x7f8a040070d0 2024-09-17T03:08:03.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.557+0000 7f8a12512640 1 -- 172.21.15.78:0/550213640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a0404f670 con 0x7f8a040070d0 2024-09-17T03:08:03.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.561+0000 7f8a12512640 1 -- 172.21.15.78:0/550213640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a04053140 con 0x7f8a040070d0 2024-09-17T03:08:03.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.557+0000 7f0c09ffb640 1 -- 172.21.15.78:0/3475773924 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c04005290 con 0x7f0c0c0053a0 2024-09-17T03:08:03.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.560+0000 7f0c0bfff640 1 -- 172.21.15.78:0/3475773924 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0c18014030 con 0x7f0c0c0053a0 2024-09-17T03:08:03.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.568+0000 7f0a1bfff640 1 -- 172.21.15.78:0/1643097760 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a24015020 con 0x7f0a280348f0 2024-09-17T03:08:03.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.569+0000 7f0a1bfff640 1 -- 172.21.15.78:0/1643097760 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a24011940 con 0x7f0a280348f0 2024-09-17T03:08:03.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.569+0000 7f0a1bfff640 1 -- 172.21.15.78:0/1643097760 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a24011d90 con 0x7f0a280348f0 2024-09-17T03:08:03.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.569+0000 7f0a348f5640 1 -- 172.21.15.78:0/1643097760 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a2804ccc0 con 0x7f0a280348f0 2024-09-17T03:08:03.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.569+0000 7f0a348f5640 1 -- 172.21.15.78:0/1643097760 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a28048a60 con 0x7f0a280348f0 2024-09-17T03:08:03.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.570+0000 7f0a19ffb640 1 -- 172.21.15.78:0/1643097760 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a28035ed0 con 0x7f0a280348f0 2024-09-17T03:08:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.568+0000 7f8a08ff9640 1 -- 172.21.15.78:0/550213640 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8a0001a070 con 0x7f8a040070d0 2024-09-17T03:08:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.568+0000 7f8a08ff9640 1 -- 172.21.15.78:0/550213640 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8a00012400 con 0x7f8a040070d0 2024-09-17T03:08:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.570+0000 7efca1dbb640 1 -- 172.21.15.78:0/498634809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc9c0cac60 msgr2=0x7efc9c0cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.570+0000 7efca1dbb640 1 --2- 172.21.15.78:0/498634809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc9c0cac60 0x7efc9c0cb070 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efc94005fd0 tx=0x7efc9402aae0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.570+0000 7efca1dbb640 1 -- 172.21.15.78:0/498634809 shutdown_connections 2024-09-17T03:08:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.570+0000 7efca1dbb640 1 --2- 172.21.15.78:0/498634809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc9c0cac60 0x7efc9c0cb070 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.570+0000 7efca1dbb640 1 --2- 172.21.15.78:0/498634809 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efc9c0cc630 0x7efc9c0cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.570+0000 7efca1dbb640 1 -- 172.21.15.78:0/498634809 >> 172.21.15.78:0/498634809 conn(0x7efc9c06d5d0 msgr2=0x7efc9c06ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.573+0000 7f8a08ff9640 1 -- 172.21.15.78:0/550213640 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f8a00021020 con 0x7f8a040070d0 2024-09-17T03:08:03.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.575+0000 7fe368ff9640 1 -- 172.21.15.78:0/1499410173 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v11)=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7fe35c032bc0 con 0x7fe36c0cce80 2024-09-17T03:08:03.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.579+0000 7fe3527fc640 1 -- 172.21.15.78:0/1499410173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe36c0cce80 msgr2=0x7fe36c0c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.579+0000 7fe3527fc640 1 --2- 172.21.15.78:0/1499410173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe36c0cce80 0x7fe36c0c9760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe35c000c00 tx=0x7fe35c004260 comp rx=0 tx=0).stop 2024-09-17T03:08:03.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.570+0000 7efca1dbb640 1 -- 172.21.15.78:0/498634809 shutdown_connections 2024-09-17T03:08:03.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.570+0000 7efca1dbb640 1 -- 172.21.15.78:0/498634809 wait complete. 2024-09-17T03:08:03.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.573+0000 7efca1dbb640 1 Processor -- start 2024-09-17T03:08:03.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.573+0000 7efca1dbb640 1 -- start start 2024-09-17T03:08:03.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.579+0000 7efca1dbb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efc9c074640 0x7efc9c167180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.579+0000 7efca1dbb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc9c0cac60 0x7efc9c0b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.579+0000 7efca1dbb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc9c0cc630 0x7efc9c0b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.579+0000 7efca1dbb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efc9c0ccf80 con 0x7efc9c0cac60 2024-09-17T03:08:03.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.579+0000 7efca1dbb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efc9c08be20 con 0x7efc9c0cc630 2024-09-17T03:08:03.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.579+0000 7efca1dbb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7efc9c0cd100 con 0x7efc9c074640 2024-09-17T03:08:03.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.579+0000 7efca0db9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efc9c074640 0x7efc9c167180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.579+0000 7efca0db9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efc9c074640 0x7efc9c167180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.78:48716/0 (socket says 172.21.15.78:48716) 2024-09-17T03:08:03.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.579+0000 7efca0db9640 1 -- 172.21.15.78:0/3601257275 learned_addr learned my addr 172.21.15.78:0/3601257275 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:03.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.579+0000 7efca15ba640 1 --2- 172.21.15.78:0/3601257275 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc9c0cc630 0x7efc9c0b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.579+0000 7efca0db9640 1 -- 172.21.15.78:0/3601257275 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc9c0cc630 msgr2=0x7efc9c0b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.579+0000 7efca0db9640 1 --2- 172.21.15.78:0/3601257275 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc9c0cc630 0x7efc9c0b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.579+0000 7efca0db9640 1 -- 172.21.15.78:0/3601257275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc9c0cac60 msgr2=0x7efc9c0b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.579+0000 7efca0db9640 1 --2- 172.21.15.78:0/3601257275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc9c0cac60 0x7efc9c0b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.580+0000 7efca0db9640 1 -- 172.21.15.78:0/3601257275 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9c201fd0 con 0x7efc9c074640 2024-09-17T03:08:03.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.580+0000 7f0a1bfff640 1 -- 172.21.15.78:0/1643097760 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0a24018020 con 0x7f0a280348f0 2024-09-17T03:08:03.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.580+0000 7efca0db9640 1 --2- 172.21.15.78:0/3601257275 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efc9c074640 0x7efc9c167180 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00c430 tx=0x7efc8c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:03.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.580+0000 7f0a1bfff640 1 -- 172.21.15.78:0/1643097760 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0a2401aa70 con 0x7f0a280348f0 2024-09-17T03:08:03.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.580+0000 7fe3527fc640 1 -- 172.21.15.78:0/1499410173 shutdown_connections 2024-09-17T03:08:03.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.580+0000 7fe3527fc640 1 --2- 172.21.15.78:0/1499410173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe36c167580 0x7fe36c215eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.580+0000 7fe3527fc640 1 --2- 172.21.15.78:0/1499410173 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe36c166c30 0x7fe36c167040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.580+0000 7fe3527fc640 1 --2- 172.21.15.78:0/1499410173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe36c0cce80 0x7fe36c0c9760 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.580+0000 7fe3527fc640 1 -- 172.21.15.78:0/1499410173 >> 172.21.15.78:0/1499410173 conn(0x7fe36c0b1c20 msgr2=0x7fe36c068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.580+0000 7efc997fa640 1 -- 172.21.15.78:0/3601257275 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c0052d0 con 0x7efc9c074640 2024-09-17T03:08:03.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.580+0000 7fe3527fc640 1 -- 172.21.15.78:0/1499410173 shutdown_connections 2024-09-17T03:08:03.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.580+0000 7fe3527fc640 1 -- 172.21.15.78:0/1499410173 wait complete. 2024-09-17T03:08:03.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.580+0000 7efca1dbb640 1 -- 172.21.15.78:0/3601257275 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc9c202290 con 0x7efc9c074640 2024-09-17T03:08:03.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.582+0000 7f0a1bfff640 1 -- 172.21.15.78:0/1643097760 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f0a2401f020 con 0x7f0a280348f0 2024-09-17T03:08:03.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.581+0000 7efca1dbb640 1 -- 172.21.15.78:0/3601257275 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efc9c202850 con 0x7efc9c074640 2024-09-17T03:08:03.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.586+0000 7efca1dbb640 1 -- 172.21.15.78:0/3601257275 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc9c0cd690 con 0x7efc9c074640 2024-09-17T03:08:03.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.586+0000 7efc997fa640 1 -- 172.21.15.78:0/3601257275 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc8c011890 con 0x7efc9c074640 2024-09-17T03:08:03.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.586+0000 7efc997fa640 1 -- 172.21.15.78:0/3601257275 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc8c011ce0 con 0x7efc9c074640 2024-09-17T03:08:03.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.586+0000 7efc997fa640 1 -- 172.21.15.78:0/3601257275 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efc8c003980 con 0x7efc9c074640 2024-09-17T03:08:03.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.586+0000 7efc997fa640 1 -- 172.21.15.78:0/3601257275 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efc8c0193f0 con 0x7efc9c074640 2024-09-17T03:08:03.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.588+0000 7efc997fa640 1 -- 172.21.15.78:0/3601257275 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7efc8c027020 con 0x7efc9c074640 2024-09-17T03:08:03.622 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.622 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.630+0000 7fb041ffb640 1 -- 172.21.15.78:0/2414304384 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fb03c005580 con 0x7fb05c0cfab0 2024-09-17T03:08:03.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.637+0000 7fb043fff640 1 -- 172.21.15.78:0/2414304384 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v12)=0 v12) ==== 120+0+0 (secure 0 0 0) 0x7fb04c003990 con 0x7fb05c0cfab0 2024-09-17T03:08:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.639+0000 7fb061c27640 1 -- 172.21.15.78:0/2414304384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb05c0cfab0 msgr2=0x7fb05c06ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.639+0000 7fb061c27640 1 --2- 172.21.15.78:0/2414304384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb05c0cfab0 0x7fb05c06ffe0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00d7b0 tx=0x7fb04c00dc70 comp rx=0 tx=0).stop 2024-09-17T03:08:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.639+0000 7fb061c27640 1 -- 172.21.15.78:0/2414304384 shutdown_connections 2024-09-17T03:08:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.639+0000 7fb061c27640 1 --2- 172.21.15.78:0/2414304384 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb05c202870 0x7fb05c156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.639+0000 7fb061c27640 1 --2- 172.21.15.78:0/2414304384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb05c15f7e0 0x7fb05c202330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.639+0000 7fb061c27640 1 --2- 172.21.15.78:0/2414304384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb05c0cfab0 0x7fb05c06ffe0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.639+0000 7fb061c27640 1 -- 172.21.15.78:0/2414304384 >> 172.21.15.78:0/2414304384 conn(0x7fb05c0cd6c0 msgr2=0x7fb05c1594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.639+0000 7fb061c27640 1 -- 172.21.15.78:0/2414304384 shutdown_connections 2024-09-17T03:08:03.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.639+0000 7fb061c27640 1 -- 172.21.15.78:0/2414304384 wait complete. 2024-09-17T03:08:03.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.671+0000 7ffaabfff640 1 -- 172.21.15.78:0/1520192945 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7ffaa4005850 con 0x7ffac8201aa0 2024-09-17T03:08:03.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.683+0000 7ffabe7fc640 1 -- 172.21.15.78:0/1520192945 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v13)=0 v13) ==== 119+0+0 (secure 0 0 0) 0x7ffac8202e00 con 0x7ffac8201aa0 2024-09-17T03:08:03.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.683+0000 7fd28a9ad640 1 -- 172.21.15.78:0/1044768804 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fd264005580 con 0x7fd284074640 2024-09-17T03:08:03.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.684+0000 7ffaabfff640 1 -- 172.21.15.78:0/1520192945 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffac8201aa0 msgr2=0x7ffac81e7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.684+0000 7ffaabfff640 1 --2- 172.21.15.78:0/1520192945 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffac8201aa0 0x7ffac81e7190 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffac0005fd0 tx=0x7ffac000b730 comp rx=0 tx=0).stop 2024-09-17T03:08:03.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.685+0000 7ffaabfff640 1 -- 172.21.15.78:0/1520192945 shutdown_connections 2024-09-17T03:08:03.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.685+0000 7ffaabfff640 1 --2- 172.21.15.78:0/1520192945 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffac8201aa0 0x7ffac81e7190 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.685+0000 7ffaabfff640 1 --2- 172.21.15.78:0/1520192945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffac815baf0 0x7ffac8201560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.685+0000 7ffaabfff640 1 --2- 172.21.15.78:0/1520192945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffac80cfa20 0x7ffac82028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.685+0000 7ffaabfff640 1 -- 172.21.15.78:0/1520192945 >> 172.21.15.78:0/1520192945 conn(0x7ffac8070b20 msgr2=0x7ffac8159e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.685+0000 7ffaabfff640 1 -- 172.21.15.78:0/1520192945 shutdown_connections 2024-09-17T03:08:03.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.685+0000 7ffaabfff640 1 -- 172.21.15.78:0/1520192945 wait complete. 2024-09-17T03:08:03.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.695+0000 7fd280ff9640 1 -- 172.21.15.78:0/1044768804 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v14)=0 v14) ==== 120+0+0 (secure 0 0 0) 0x7fd2840cb5b0 con 0x7fd284074640 2024-09-17T03:08:03.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.699+0000 7f77143ad640 1 -- 172.21.15.78:0/204544888 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f76f4005580 con 0x7f770c072e00 2024-09-17T03:08:03.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.699+0000 7fd26a7fc640 1 -- 172.21.15.78:0/1044768804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd284074640 msgr2=0x7fd284154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.700+0000 7fd26a7fc640 1 --2- 172.21.15.78:0/1044768804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd284074640 0x7fd284154410 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd27400c430 tx=0x7fd27400c8f0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.700+0000 7fd26a7fc640 1 -- 172.21.15.78:0/1044768804 shutdown_connections 2024-09-17T03:08:03.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.700+0000 7fd26a7fc640 1 --2- 172.21.15.78:0/1044768804 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd284154950 0x7fd284156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.700+0000 7fd26a7fc640 1 --2- 172.21.15.78:0/1044768804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd2840cc630 0x7fd2840b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.700+0000 7fd26a7fc640 1 --2- 172.21.15.78:0/1044768804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd284074640 0x7fd284154410 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.700+0000 7fd26a7fc640 1 -- 172.21.15.78:0/1044768804 >> 172.21.15.78:0/1044768804 conn(0x7fd28406d5d0 msgr2=0x7fd28416e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.700+0000 7fd26a7fc640 1 -- 172.21.15.78:0/1044768804 shutdown_connections 2024-09-17T03:08:03.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.700+0000 7fd26a7fc640 1 -- 172.21.15.78:0/1044768804 wait complete. 2024-09-17T03:08:03.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.709+0000 7f7702ffd640 1 -- 172.21.15.78:0/204544888 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v15)=0 v15) ==== 111+0+0 (secure 0 0 0) 0x7f770c08bc10 con 0x7f770c072e00 2024-09-17T03:08:03.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.718+0000 7f7700ff9640 1 -- 172.21.15.78:0/204544888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f770c072e00 msgr2=0x7f770c0b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.718+0000 7f7700ff9640 1 --2- 172.21.15.78:0/204544888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f770c072e00 0x7f770c0b4980 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f770800c400 tx=0x7f770800c8c0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.718+0000 7fa7dbfff640 1 -- 172.21.15.78:0/1706953669 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fa7f01635e0 con 0x7fa7f00b33b0 2024-09-17T03:08:03.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.721+0000 7f7700ff9640 1 -- 172.21.15.78:0/204544888 shutdown_connections 2024-09-17T03:08:03.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.721+0000 7f7700ff9640 1 --2- 172.21.15.78:0/204544888 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f770c0c9c60 0x7f770c0ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.721+0000 7f7700ff9640 1 --2- 172.21.15.78:0/204544888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f770c16e750 0x7f770c0c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.721+0000 7f7700ff9640 1 --2- 172.21.15.78:0/204544888 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f770c072e00 0x7f770c0b4980 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.721+0000 7f7700ff9640 1 -- 172.21.15.78:0/204544888 >> 172.21.15.78:0/204544888 conn(0x7f770c0b1c20 msgr2=0x7f770c0b1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.721+0000 7f7700ff9640 1 -- 172.21.15.78:0/204544888 shutdown_connections 2024-09-17T03:08:03.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.722+0000 7f7700ff9640 1 -- 172.21.15.78:0/204544888 wait complete. 2024-09-17T03:08:03.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.727+0000 7fa7e67fc640 1 -- 172.21.15.78:0/1706953669 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v16)=0 v16) ==== 119+0+0 (secure 0 0 0) 0x7fa7e802fb60 con 0x7fa7f00b33b0 2024-09-17T03:08:03.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.730+0000 7fa7dbfff640 1 -- 172.21.15.78:0/1706953669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7f00b33b0 msgr2=0x7fa7f00cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.730+0000 7fa7dbfff640 1 --2- 172.21.15.78:0/1706953669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7f00b33b0 0x7fa7f00cf340 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8032000 tx=0x7fa7e8039e40 comp rx=0 tx=0).stop 2024-09-17T03:08:03.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.730+0000 7fa7dbfff640 1 -- 172.21.15.78:0/1706953669 shutdown_connections 2024-09-17T03:08:03.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.730+0000 7fa7dbfff640 1 --2- 172.21.15.78:0/1706953669 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa7f00d0340 0x7fa7f00cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.730+0000 7fa7dbfff640 1 --2- 172.21.15.78:0/1706953669 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7f00b33b0 0x7fa7f00cf340 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.731+0000 7fa7dbfff640 1 --2- 172.21.15.78:0/1706953669 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa7f00735d0 0x7fa7f00b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.731+0000 7fa7dbfff640 1 -- 172.21.15.78:0/1706953669 >> 172.21.15.78:0/1706953669 conn(0x7fa7f0070b20 msgr2=0x7fa7f00b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.731+0000 7fa7dbfff640 1 -- 172.21.15.78:0/1706953669 shutdown_connections 2024-09-17T03:08:03.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.731+0000 7fa7dbfff640 1 -- 172.21.15.78:0/1706953669 wait complete. 2024-09-17T03:08:03.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.750+0000 7fc83dffb640 1 -- 172.21.15.78:0/3737388153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fc84c0507b0 con 0x7fc84c051660 2024-09-17T03:08:03.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.759+0000 7f03c17fa640 1 -- 172.21.15.78:0/362985797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f03bc005580 con 0x7f03dc217080 2024-09-17T03:08:03.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.759+0000 7fc83ffff640 1 -- 172.21.15.78:0/3737388153 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v17)=0 v17) ==== 106+0+0 (secure 0 0 0) 0x7fc84800ac60 con 0x7fc84c051660 2024-09-17T03:08:03.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.761+0000 7fc83dffb640 1 -- 172.21.15.78:0/3737388153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc84c051660 msgr2=0x7fc84c0e01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.761+0000 7fc83dffb640 1 --2- 172.21.15.78:0/3737388153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc84c051660 0x7fc84c0e01d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc84800c760 tx=0x7fc84800cc20 comp rx=0 tx=0).stop 2024-09-17T03:08:03.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.761+0000 7fc83dffb640 1 -- 172.21.15.78:0/3737388153 shutdown_connections 2024-09-17T03:08:03.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.761+0000 7fc83dffb640 1 --2- 172.21.15.78:0/3737388153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc84c054750 0x7fc84c181f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.761+0000 7fc83dffb640 1 --2- 172.21.15.78:0/3737388153 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc84c052390 0x7fc84c181a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.761+0000 7fc83dffb640 1 --2- 172.21.15.78:0/3737388153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc84c051660 0x7fc84c0e01d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.761+0000 7fc83dffb640 1 -- 172.21.15.78:0/3737388153 >> 172.21.15.78:0/3737388153 conn(0x7fc84c01d9d0 msgr2=0x7fc84c0e72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.761+0000 7fc83dffb640 1 -- 172.21.15.78:0/3737388153 shutdown_connections 2024-09-17T03:08:03.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.761+0000 7fc83dffb640 1 -- 172.21.15.78:0/3737388153 wait complete. 2024-09-17T03:08:03.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.766+0000 7f03c37fe640 1 -- 172.21.15.78:0/362985797 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v18)=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7f03dc0b56d0 con 0x7f03dc217080 2024-09-17T03:08:03.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.767+0000 7f03c17fa640 1 -- 172.21.15.78:0/362985797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03dc217080 msgr2=0x7f03dc216470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.767+0000 7f03c17fa640 1 --2- 172.21.15.78:0/362985797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03dc217080 0x7f03dc216470 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f03d0005d00 tx=0x7f03d000dae0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.767+0000 7f03c17fa640 1 -- 172.21.15.78:0/362985797 shutdown_connections 2024-09-17T03:08:03.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.767+0000 7f03c17fa640 1 --2- 172.21.15.78:0/362985797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03dc217080 0x7f03dc216470 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.767+0000 7f03c17fa640 1 --2- 172.21.15.78:0/362985797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03dc16e750 0x7f03dc0b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.767+0000 7f03c17fa640 1 --2- 172.21.15.78:0/362985797 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f03dc08b800 0x7f03dc167bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.767+0000 7f03c17fa640 1 -- 172.21.15.78:0/362985797 >> 172.21.15.78:0/362985797 conn(0x7f03dc0b1c20 msgr2=0x7f03dc0ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.768+0000 7f03c17fa640 1 -- 172.21.15.78:0/362985797 shutdown_connections 2024-09-17T03:08:03.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.768+0000 7f03c17fa640 1 -- 172.21.15.78:0/362985797 wait complete. 2024-09-17T03:08:03.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.778+0000 7f0a19ffb640 1 -- 172.21.15.78:0/1643097760 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f0a2803a960 con 0x7f0a280348f0 2024-09-17T03:08:03.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.779+0000 7f0c09ffb640 1 -- 172.21.15.78:0/3475773924 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f0c04005580 con 0x7f0c0c0053a0 2024-09-17T03:08:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.783+0000 7f0a1bfff640 1 -- 172.21.15.78:0/1643097760 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v19)=0 v19) ==== 108+0+0 (secure 0 0 0) 0x7f0a2401a400 con 0x7f0a280348f0 2024-09-17T03:08:03.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.784+0000 7f0a19ffb640 1 -- 172.21.15.78:0/1643097760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a280348f0 msgr2=0x7f0a2804c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.784+0000 7f0a19ffb640 1 --2- 172.21.15.78:0/1643097760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a280348f0 0x7f0a2804c000 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0a2400b3e0 tx=0x7f0a2400b8a0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.784+0000 7f0a19ffb640 1 -- 172.21.15.78:0/1643097760 shutdown_connections 2024-09-17T03:08:03.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.784+0000 7f0a19ffb640 1 --2- 172.21.15.78:0/1643097760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a280e3180 0x7f0a28053ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.784+0000 7f0a19ffb640 1 --2- 172.21.15.78:0/1643097760 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0a28051cb0 0x7f0a280d6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.784+0000 7f0a19ffb640 1 --2- 172.21.15.78:0/1643097760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a280348f0 0x7f0a2804c000 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.784+0000 7f0a19ffb640 1 -- 172.21.15.78:0/1643097760 >> 172.21.15.78:0/1643097760 conn(0x7f0a2801e260 msgr2=0x7f0a28050200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.784+0000 7f0a19ffb640 1 -- 172.21.15.78:0/1643097760 shutdown_connections 2024-09-17T03:08:03.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.784+0000 7f0a19ffb640 1 -- 172.21.15.78:0/1643097760 wait complete. 2024-09-17T03:08:03.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.787+0000 7efca1dbb640 1 -- 172.21.15.78:0/3601257275 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7efc9c0cb320 con 0x7efc9c074640 2024-09-17T03:08:03.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.789+0000 7f0c0bfff640 1 -- 172.21.15.78:0/3475773924 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v20)=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7f0c1800fd50 con 0x7f0c0c0053a0 2024-09-17T03:08:03.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.790+0000 7f0c09ffb640 1 -- 172.21.15.78:0/3475773924 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c0c0053a0 msgr2=0x7f0c241f3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.790+0000 7f0c09ffb640 1 --2- 172.21.15.78:0/3475773924 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c0c0053a0 0x7f0c241f3e20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0c1800c7a0 tx=0x7f0c1800cc60 comp rx=0 tx=0).stop 2024-09-17T03:08:03.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.790+0000 7fa8f6294640 1 -- 172.21.15.78:0/1233821909 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fa8d0005580 con 0x7fa8e80ffeb0 2024-09-17T03:08:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.790+0000 7f0c09ffb640 1 -- 172.21.15.78:0/3475773924 shutdown_connections 2024-09-17T03:08:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.790+0000 7f0c09ffb640 1 --2- 172.21.15.78:0/3475773924 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c24162230 0x7f0c240b6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.790+0000 7f0c09ffb640 1 --2- 172.21.15.78:0/3475773924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c24161e20 0x7f0c240b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.790+0000 7f0c09ffb640 1 --2- 172.21.15.78:0/3475773924 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c0c0053a0 0x7f0c241f3e20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.790+0000 7f0c09ffb640 1 -- 172.21.15.78:0/3475773924 >> 172.21.15.78:0/3475773924 conn(0x7f0c2408bfc0 msgr2=0x7f0c240b9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.790+0000 7f0c09ffb640 1 -- 172.21.15.78:0/3475773924 shutdown_connections 2024-09-17T03:08:03.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.790+0000 7f0c09ffb640 1 -- 172.21.15.78:0/3475773924 wait complete. 2024-09-17T03:08:03.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.795+0000 7efc997fa640 1 -- 172.21.15.78:0/3601257275 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7efc8c003c70 con 0x7efc9c074640 2024-09-17T03:08:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.796+0000 7efca1dbb640 1 -- 172.21.15.78:0/3601257275 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efc9c074640 msgr2=0x7efc9c167180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.796+0000 7efca1dbb640 1 --2- 172.21.15.78:0/3601257275 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efc9c074640 0x7efc9c167180 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00c430 tx=0x7efc8c00c8f0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.797+0000 7efca1dbb640 1 -- 172.21.15.78:0/3601257275 shutdown_connections 2024-09-17T03:08:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.797+0000 7efca1dbb640 1 --2- 172.21.15.78:0/3601257275 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efc9c0cc630 0x7efc9c0b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.797+0000 7efca1dbb640 1 --2- 172.21.15.78:0/3601257275 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc9c0cac60 0x7efc9c0b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.797+0000 7efca1dbb640 1 --2- 172.21.15.78:0/3601257275 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efc9c074640 0x7efc9c167180 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.797+0000 7efca1dbb640 1 -- 172.21.15.78:0/3601257275 >> 172.21.15.78:0/3601257275 conn(0x7efc9c06d5d0 msgr2=0x7efc9c072f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.797+0000 7efca1dbb640 1 -- 172.21.15.78:0/3601257275 shutdown_connections 2024-09-17T03:08:03.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.797+0000 7efca1dbb640 1 -- 172.21.15.78:0/3601257275 wait complete. 2024-09-17T03:08:03.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.800+0000 7fa8ecff9640 1 -- 172.21.15.78:0/1233821909 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fa8dc04b030 con 0x7fa8e80ffeb0 2024-09-17T03:08:03.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.801+0000 7fa8f6294640 1 -- 172.21.15.78:0/1233821909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8e80ffeb0 msgr2=0x7fa8e81002c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.801+0000 7fa8f6294640 1 --2- 172.21.15.78:0/1233821909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8e80ffeb0 0x7fa8e81002c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc007440 tx=0x7fa8dc02bb80 comp rx=0 tx=0).stop 2024-09-17T03:08:03.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.801+0000 7fa8f6294640 1 -- 172.21.15.78:0/1233821909 shutdown_connections 2024-09-17T03:08:03.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.801+0000 7fa8f6294640 1 --2- 172.21.15.78:0/1233821909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8e80ffeb0 0x7fa8e81002c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.801+0000 7fa8f6294640 1 --2- 172.21.15.78:0/1233821909 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa8e80fdd90 0x7fa8e80f3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.801+0000 7fa8f6294640 1 --2- 172.21.15.78:0/1233821909 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa8e8055110 0x7fa8e80f2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.801+0000 7fa8f6294640 1 -- 172.21.15.78:0/1233821909 >> 172.21.15.78:0/1233821909 conn(0x7fa8e801d9d0 msgr2=0x7fa8e8004a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.801+0000 7fa8f6294640 1 -- 172.21.15.78:0/1233821909 shutdown_connections 2024-09-17T03:08:03.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.801+0000 7fa8f6294640 1 -- 172.21.15.78:0/1233821909 wait complete. 2024-09-17T03:08:03.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.805+0000 7f8a12512640 1 -- 172.21.15.78:0/550213640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f8a040f56c0 con 0x7f8a040070d0 2024-09-17T03:08:03.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.809+0000 7f8a08ff9640 1 -- 172.21.15.78:0/550213640 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v23)=0 v23) ==== 125+0+0 (secure 0 0 0) 0x7f8a040fff00 con 0x7f8a040070d0 2024-09-17T03:08:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.811+0000 7f8a12512640 1 -- 172.21.15.78:0/550213640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a040070d0 msgr2=0x7f8a0404e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.811+0000 7f8a12512640 1 --2- 172.21.15.78:0/550213640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a040070d0 0x7f8a0404e3c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8a0000c410 tx=0x7f8a0000c8d0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.811+0000 7f8a12512640 1 -- 172.21.15.78:0/550213640 shutdown_connections 2024-09-17T03:08:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.811+0000 7f8a12512640 1 --2- 172.21.15.78:0/550213640 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8a040ff5b0 0x7f8a040ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.811+0000 7f8a12512640 1 --2- 172.21.15.78:0/550213640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a04055100 0x7f8a0404bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.811+0000 7f8a12512640 1 --2- 172.21.15.78:0/550213640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a040070d0 0x7f8a0404e3c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.811+0000 7f8a12512640 1 -- 172.21.15.78:0/550213640 >> 172.21.15.78:0/550213640 conn(0x7f8a0401d9c0 msgr2=0x7f8a040f8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.811+0000 7f8a12512640 1 -- 172.21.15.78:0/550213640 shutdown_connections 2024-09-17T03:08:03.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.811+0000 7f8a12512640 1 -- 172.21.15.78:0/550213640 wait complete. 2024-09-17T03:08:03.813 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.813 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.813 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.813 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.813 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.813 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.814 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.814 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.814 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.821 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.821 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi078') 2024-09-17T03:08:03.822 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config dump 2024-09-17T03:08:03.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.974+0000 7fb206c30640 1 -- 172.21.15.78:0/951480321 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb20015c9b0 msgr2=0x7fb2000ccfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.974+0000 7fb206c30640 1 --2- 172.21.15.78:0/951480321 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb20015c9b0 0x7fb2000ccfa0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8009be0 tx=0x7fb1e802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.974+0000 7fb206c30640 1 -- 172.21.15.78:0/951480321 shutdown_connections 2024-09-17T03:08:03.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.974+0000 7fb206c30640 1 --2- 172.21.15.78:0/951480321 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb20015c9b0 0x7fb2000ccfa0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.974+0000 7fb206c30640 1 -- 172.21.15.78:0/951480321 >> 172.21.15.78:0/951480321 conn(0x7fb2000cdc60 msgr2=0x7fb2000ce070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:03.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.974+0000 7fb206c30640 1 -- 172.21.15.78:0/951480321 shutdown_connections 2024-09-17T03:08:03.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.974+0000 7fb206c30640 1 -- 172.21.15.78:0/951480321 wait complete. 2024-09-17T03:08:03.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.976+0000 7fb206c30640 1 Processor -- start 2024-09-17T03:08:03.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.976+0000 7fb206c30640 1 -- start start 2024-09-17T03:08:03.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.977+0000 7fb206c30640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb200073e70 0x7fb200152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.977+0000 7fb206c30640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb20015c9b0 0x7fb2001f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.977+0000 7fb206c30640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb20015ff30 0x7fb2001f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:03.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.977+0000 7fb206c30640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb200166aa0 con 0x7fb20015ff30 2024-09-17T03:08:03.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.977+0000 7fb206c30640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb200166920 con 0x7fb200073e70 2024-09-17T03:08:03.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.977+0000 7fb206c30640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb200166c20 con 0x7fb20015c9b0 2024-09-17T03:08:03.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.978+0000 7fb2051cd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb20015ff30 0x7fb2001f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.978+0000 7fb2051cd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb20015ff30 0x7fb2001f5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43812/0 (socket says 172.21.15.78:43812) 2024-09-17T03:08:03.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.978+0000 7fb2051cd640 1 -- 172.21.15.78:0/3199828919 learned_addr learned my addr 172.21.15.78:0/3199828919 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:03.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.978+0000 7fb2049cc640 1 --2- 172.21.15.78:0/3199828919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb200073e70 0x7fb200152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.978+0000 7fb1fffff640 1 --2- 172.21.15.78:0/3199828919 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb20015c9b0 0x7fb2001f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:03.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.978+0000 7fb2051cd640 1 -- 172.21.15.78:0/3199828919 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb20015c9b0 msgr2=0x7fb2001f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.978+0000 7fb2051cd640 1 --2- 172.21.15.78:0/3199828919 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb20015c9b0 0x7fb2001f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.978+0000 7fb2051cd640 1 -- 172.21.15.78:0/3199828919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb200073e70 msgr2=0x7fb200152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:03.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.978+0000 7fb2051cd640 1 --2- 172.21.15.78:0/3199828919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb200073e70 0x7fb200152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:03.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.978+0000 7fb2051cd640 1 -- 172.21.15.78:0/3199828919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb200152c10 con 0x7fb20015ff30 2024-09-17T03:08:03.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.978+0000 7fb2051cd640 1 --2- 172.21.15.78:0/3199828919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb20015ff30 0x7fb2001f5da0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb1f800c480 tx=0x7fb1f800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:03.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.978+0000 7fb1fd7fa640 1 -- 172.21.15.78:0/3199828919 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8016020 con 0x7fb20015ff30 2024-09-17T03:08:03.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.978+0000 7fb1fd7fa640 1 -- 172.21.15.78:0/3199828919 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1f8012920 con 0x7fb20015ff30 2024-09-17T03:08:03.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.978+0000 7fb206c30640 1 -- 172.21.15.78:0/3199828919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb200152ef0 con 0x7fb20015ff30 2024-09-17T03:08:03.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.978+0000 7fb1fd7fa640 1 -- 172.21.15.78:0/3199828919 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1f8012d70 con 0x7fb20015ff30 2024-09-17T03:08:03.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.978+0000 7fb206c30640 1 -- 172.21.15.78:0/3199828919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2001534b0 con 0x7fb20015ff30 2024-09-17T03:08:03.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.978+0000 7fb1fd7fa640 1 -- 172.21.15.78:0/3199828919 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb1f8019020 con 0x7fb20015ff30 2024-09-17T03:08:03.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.979+0000 7fb1fd7fa640 1 -- 172.21.15.78:0/3199828919 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb1f801a970 con 0x7fb20015ff30 2024-09-17T03:08:03.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.980+0000 7fb206c30640 1 -- 172.21.15.78:0/3199828919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2000ccfa0 con 0x7fb20015ff30 2024-09-17T03:08:03.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:03.982+0000 7fb1fd7fa640 1 -- 172.21.15.78:0/3199828919 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fb1f8020030 con 0x7fb20015ff30 2024-09-17T03:08:04.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.088+0000 7fb206c30640 1 -- 172.21.15.78:0/3199828919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fb2000b0ef0 con 0x7fb20015ff30 2024-09-17T03:08:04.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.089+0000 7fb1fd7fa640 1 -- 172.21.15.78:0/3199828919 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v23) ==== 59+0+1472 (secure 0 0 0) 0x7fb1f801a410 con 0x7fb20015ff30 2024-09-17T03:08:04.087 INFO:teuthology.orchestra.run.smithi078.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:08:04.088 INFO:teuthology.orchestra.run.smithi078.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:08:04.088 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:08:04.088 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_client 20/20 2024-09-17T03:08:04.088 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:08:04.088 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:08:04.088 INFO:teuthology.orchestra.run.smithi078.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:08:04.088 INFO:teuthology.orchestra.run.smithi078.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:08:04.088 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_mds 20/20 2024-09-17T03:08:04.089 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:08:04.089 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_ms 2/2 2024-09-17T03:08:04.089 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_debug_frag true 2024-09-17T03:08:04.089 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:08:04.089 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:08:04.089 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_verify_scatter true 2024-09-17T03:08:04.089 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:08:04.089 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:08:04.089 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:08:04.089 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced client_mount_timeout 600 2024-09-17T03:08:04.089 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced debug_client 20/20 2024-09-17T03:08:04.089 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced debug_ms 1/1 2024-09-17T03:08:04.089 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:08:04.089 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:08:04.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.090+0000 7fb206c30640 1 -- 172.21.15.78:0/3199828919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb20015ff30 msgr2=0x7fb2001f5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:04.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.090+0000 7fb206c30640 1 --2- 172.21.15.78:0/3199828919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb20015ff30 0x7fb2001f5da0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb1f800c480 tx=0x7fb1f800c940 comp rx=0 tx=0).stop 2024-09-17T03:08:04.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.090+0000 7fb206c30640 1 -- 172.21.15.78:0/3199828919 shutdown_connections 2024-09-17T03:08:04.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.090+0000 7fb206c30640 1 --2- 172.21.15.78:0/3199828919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb20015ff30 0x7fb2001f5da0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:04.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.090+0000 7fb206c30640 1 --2- 172.21.15.78:0/3199828919 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb20015c9b0 0x7fb2001f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:04.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.090+0000 7fb206c30640 1 --2- 172.21.15.78:0/3199828919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb200073e70 0x7fb200152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:04.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.090+0000 7fb206c30640 1 -- 172.21.15.78:0/3199828919 >> 172.21.15.78:0/3199828919 conn(0x7fb2000cdc60 msgr2=0x7fb20015b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:04.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.090+0000 7fb206c30640 1 -- 172.21.15.78:0/3199828919 shutdown_connections 2024-09-17T03:08:04.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.090+0000 7fb206c30640 1 -- 172.21.15.78:0/3199828919 wait complete. 2024-09-17T03:08:04.104 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T03:08:04.105 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T03:08:04.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.219+0000 7f679b16e640 1 -- 172.21.15.78:0/2784648592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f679409aa30 msgr2=0x7f67940cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:04.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.219+0000 7f679b16e640 1 --2- 172.21.15.78:0/2784648592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f679409aa30 0x7f67940cee10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6780005fd0 tx=0x7f678002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:08:04.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.219+0000 7f679b16e640 1 -- 172.21.15.78:0/2784648592 shutdown_connections 2024-09-17T03:08:04.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.219+0000 7f679b16e640 1 --2- 172.21.15.78:0/2784648592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f679409aa30 0x7f67940cee10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:04.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.219+0000 7f679b16e640 1 --2- 172.21.15.78:0/2784648592 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f679415b900 0x7f67940ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:04.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.219+0000 7f679b16e640 1 -- 172.21.15.78:0/2784648592 >> 172.21.15.78:0/2784648592 conn(0x7f6794074170 msgr2=0x7f67940b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:04.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.219+0000 7f679b16e640 1 -- 172.21.15.78:0/2784648592 shutdown_connections 2024-09-17T03:08:04.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.219+0000 7f679b16e640 1 -- 172.21.15.78:0/2784648592 wait complete. 2024-09-17T03:08:04.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.221+0000 7f679b16e640 1 Processor -- start 2024-09-17T03:08:04.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.221+0000 7f679b16e640 1 -- start start 2024-09-17T03:08:04.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.222+0000 7f679b16e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f679409aa30 0x7f679415c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:04.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.222+0000 7f679b16e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67940cdbf0 0x7f679414f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:04.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.222+0000 7f679b16e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f679415b900 0x7f67941f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:04.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.222+0000 7f679b16e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f67940cf7a0 con 0x7f67940cdbf0 2024-09-17T03:08:04.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.222+0000 7f679b16e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f67940cf620 con 0x7f679415b900 2024-09-17T03:08:04.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.222+0000 7f679b16e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f67940cd1e0 con 0x7f679409aa30 2024-09-17T03:08:04.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.222+0000 7f6793fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67940cdbf0 0x7f679414f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:04.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.222+0000 7f6793fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67940cdbf0 0x7f679414f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43814/0 (socket says 172.21.15.78:43814) 2024-09-17T03:08:04.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.222+0000 7f6793fff640 1 -- 172.21.15.78:0/100706214 learned_addr learned my addr 172.21.15.78:0/100706214 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:04.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.223+0000 7f6798f0a640 1 --2- 172.21.15.78:0/100706214 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f679409aa30 0x7f679415c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:04.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.223+0000 7f679970b640 1 --2- 172.21.15.78:0/100706214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f679415b900 0x7f67941f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:04.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.223+0000 7f6793fff640 1 -- 172.21.15.78:0/100706214 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f679409aa30 msgr2=0x7f679415c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:04.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.223+0000 7f6793fff640 1 --2- 172.21.15.78:0/100706214 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f679409aa30 0x7f679415c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:04.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.223+0000 7f6793fff640 1 -- 172.21.15.78:0/100706214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f679415b900 msgr2=0x7f67941f57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:04.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.223+0000 7f6793fff640 1 --2- 172.21.15.78:0/100706214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f679415b900 0x7f67941f57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:04.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.223+0000 7f6793fff640 1 -- 172.21.15.78:0/100706214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679415dbd0 con 0x7f67940cdbf0 2024-09-17T03:08:04.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.223+0000 7f679970b640 1 --2- 172.21.15.78:0/100706214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f679415b900 0x7f67941f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:08:04.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.223+0000 7f6793fff640 1 --2- 172.21.15.78:0/100706214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67940cdbf0 0x7f679414f020 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6780000c00 tx=0x7f67800035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.223+0000 7f67917fa640 1 -- 172.21.15.78:0/100706214 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678003e030 con 0x7f67940cdbf0 2024-09-17T03:08:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.223+0000 7f67917fa640 1 -- 172.21.15.78:0/100706214 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6780003ae0 con 0x7f67940cdbf0 2024-09-17T03:08:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.223+0000 7f679b16e640 1 -- 172.21.15.78:0/100706214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67941f6470 con 0x7f67940cdbf0 2024-09-17T03:08:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.223+0000 7f67917fa640 1 -- 172.21.15.78:0/100706214 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780035040 con 0x7f67940cdbf0 2024-09-17T03:08:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.223+0000 7f679b16e640 1 -- 172.21.15.78:0/100706214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f679415c160 con 0x7f67940cdbf0 2024-09-17T03:08:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.223+0000 7f67917fa640 1 -- 172.21.15.78:0/100706214 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6780041030 con 0x7f67940cdbf0 2024-09-17T03:08:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.223+0000 7f67917fa640 1 -- 172.21.15.78:0/100706214 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f67800439d0 con 0x7f67940cdbf0 2024-09-17T03:08:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.224+0000 7f679b16e640 1 -- 172.21.15.78:0/100706214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67940cd700 con 0x7f67940cdbf0 2024-09-17T03:08:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.226+0000 7f67917fa640 1 -- 172.21.15.78:0/100706214 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f679415dbd0 con 0x7f67940cdbf0 2024-09-17T03:08:04.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.289+0000 7f679b16e640 1 -- 172.21.15.78:0/100706214 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f67941f6190 con 0x7f67940cdbf0 2024-09-17T03:08:04.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.291+0000 7f67917fa640 1 -- 172.21.15.78:0/100706214 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f6780004cc0 con 0x7f67940cdbf0 2024-09-17T03:08:04.290 INFO:teuthology.orchestra.run.smithi078.stderr:adjusted tunables profile to default 2024-09-17T03:08:04.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.292+0000 7f679b16e640 1 -- 172.21.15.78:0/100706214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67940cdbf0 msgr2=0x7f679414f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:04.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.292+0000 7f679b16e640 1 --2- 172.21.15.78:0/100706214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67940cdbf0 0x7f679414f020 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6780000c00 tx=0x7f67800035f0 comp rx=0 tx=0).stop 2024-09-17T03:08:04.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.292+0000 7f679b16e640 1 -- 172.21.15.78:0/100706214 shutdown_connections 2024-09-17T03:08:04.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.292+0000 7f679b16e640 1 --2- 172.21.15.78:0/100706214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f679415b900 0x7f67941f57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:04.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.292+0000 7f679b16e640 1 --2- 172.21.15.78:0/100706214 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67940cdbf0 0x7f679414f020 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:04.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.292+0000 7f679b16e640 1 --2- 172.21.15.78:0/100706214 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f679409aa30 0x7f679415c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:04.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.292+0000 7f679b16e640 1 -- 172.21.15.78:0/100706214 >> 172.21.15.78:0/100706214 conn(0x7f6794074170 msgr2=0x7f67940b5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:04.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.292+0000 7f679b16e640 1 -- 172.21.15.78:0/100706214 shutdown_connections 2024-09-17T03:08:04.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:04.292+0000 7f679b16e640 1 -- 172.21.15.78:0/100706214 wait complete. 2024-09-17T03:08:04.302 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T03:08:04.302 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T03:08:04.302 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:08:04.302 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T03:08:04.326 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:08:04.327 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T03:08:04.391 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:08:04.391 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T03:08:04.455 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:08:04.456 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-17T03:08:04.520 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:04.520 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-17T03:08:04.545 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:04.545 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-17T03:08:04.611 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:04.611 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-17T03:08:04.677 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:04.677 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-17T03:08:04.743 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39 0 2024-09-17T03:08:04.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.899+0000 7f480a2f2640 1 -- 172.21.15.193:0/3077524799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f480415c9b0 msgr2=0x7f48040ccfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:04.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.899+0000 7f480a2f2640 1 --2- 172.21.15.193:0/3077524799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f480415c9b0 0x7f48040ccfa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f47f4005fd0 tx=0x7f47f402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:08:04.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.899+0000 7f480a2f2640 1 -- 172.21.15.193:0/3077524799 shutdown_connections 2024-09-17T03:08:04.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.899+0000 7f480a2f2640 1 --2- 172.21.15.193:0/3077524799 >> v2:172.21.15.78:3300/0 conn(0x7f4804073e70 0x7f4804074280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:04.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.899+0000 7f480a2f2640 1 --2- 172.21.15.193:0/3077524799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f480415c9b0 0x7f48040ccfa0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:04.898 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.899+0000 7f480a2f2640 1 -- 172.21.15.193:0/3077524799 >> 172.21.15.193:0/3077524799 conn(0x7f48040cdc60 msgr2=0x7f48040ce070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:04.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.899+0000 7f480a2f2640 1 -- 172.21.15.193:0/3077524799 shutdown_connections 2024-09-17T03:08:04.899 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.899+0000 7f480a2f2640 1 -- 172.21.15.193:0/3077524799 wait complete. 2024-09-17T03:08:04.900 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.902+0000 7f480a2f2640 1 Processor -- start 2024-09-17T03:08:04.901 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.902+0000 7f480a2f2640 1 -- start start 2024-09-17T03:08:04.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.904+0000 7f480a2f2640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4804073e70 0x7f480413b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:04.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.904+0000 7f480a2f2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f480415c9b0 0x7f48041509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:04.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.904+0000 7f480a2f2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f480415ff30 0x7f48040b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:04.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.904+0000 7f480a2f2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f48040d0640 con 0x7f480415c9b0 2024-09-17T03:08:04.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.904+0000 7f480a2f2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f48040d04c0 con 0x7f480415ff30 2024-09-17T03:08:04.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.904+0000 7f480a2f2640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f48040d07c0 con 0x7f4804073e70 2024-09-17T03:08:04.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.904+0000 7f4803fff640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4804073e70 0x7f480413b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:04.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.904+0000 7f480888f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f480415ff30 0x7f48040b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:04.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.904+0000 7f4803fff640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4804073e70 0x7f480413b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.193:55204/0 (socket says 172.21.15.193:55204) 2024-09-17T03:08:04.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.904+0000 7f4803fff640 1 -- 172.21.15.193:0/3770007725 learned_addr learned my addr 172.21.15.193:0/3770007725 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-17T03:08:04.905 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.905+0000 7f48037fe640 1 --2- 172.21.15.193:0/3770007725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f480415c9b0 0x7f48041509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:04.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.905+0000 7f4803fff640 1 -- 172.21.15.193:0/3770007725 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f480415ff30 msgr2=0x7f48040b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:04.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.905+0000 7f4803fff640 1 --2- 172.21.15.193:0/3770007725 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f480415ff30 0x7f48040b1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:04.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.905+0000 7f4803fff640 1 -- 172.21.15.193:0/3770007725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f480415c9b0 msgr2=0x7f48041509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:04.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.905+0000 7f4803fff640 1 --2- 172.21.15.193:0/3770007725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f480415c9b0 0x7f48041509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:04.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.905+0000 7f4803fff640 1 -- 172.21.15.193:0/3770007725 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4804151340 con 0x7f4804073e70 2024-09-17T03:08:04.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.905+0000 7f48037fe640 1 --2- 172.21.15.193:0/3770007725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f480415c9b0 0x7f48041509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:04.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.905+0000 7f4803fff640 1 --2- 172.21.15.193:0/3770007725 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4804073e70 0x7f480413b4f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00c3a0 tx=0x7f47ec00c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:04.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.905+0000 7f4800ff9640 1 -- 172.21.15.193:0/3770007725 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec0052d0 con 0x7f4804073e70 2024-09-17T03:08:04.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.905+0000 7f4800ff9640 1 -- 172.21.15.193:0/3770007725 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47ec0106a0 con 0x7f4804073e70 2024-09-17T03:08:04.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.905+0000 7f4800ff9640 1 -- 172.21.15.193:0/3770007725 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ec010af0 con 0x7f4804073e70 2024-09-17T03:08:04.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.905+0000 7f480a2f2640 1 -- 172.21.15.193:0/3770007725 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4804151620 con 0x7f4804073e70 2024-09-17T03:08:04.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.905+0000 7f480a2f2640 1 -- 172.21.15.193:0/3770007725 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4804151be0 con 0x7f4804073e70 2024-09-17T03:08:04.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.905+0000 7f4800ff9640 1 -- 172.21.15.193:0/3770007725 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f47ec010c90 con 0x7f4804073e70 2024-09-17T03:08:04.906 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.906+0000 7f4800ff9640 1 -- 172.21.15.193:0/3770007725 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f47ec011b40 con 0x7f4804073e70 2024-09-17T03:08:04.907 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.906+0000 7f480a2f2640 1 -- 172.21.15.193:0/3770007725 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48040d0ce0 con 0x7f4804073e70 2024-09-17T03:08:04.908 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.910+0000 7f4800ff9640 1 -- 172.21.15.193:0/3770007725 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f48040747c0 con 0x7f4804073e70 2024-09-17T03:08:04.979 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.981+0000 7f480a2f2640 1 -- 172.21.15.193:0/3770007725 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39", "id": 0} v 0) -- 0x7f4804072310 con 0x7f4804073e70 2024-09-17T03:08:04.984 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.986+0000 7f4800ff9640 1 -- 172.21.15.193:0/3770007725 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f47ec0035f0 con 0x7f4804073e70 2024-09-17T03:08:04.985 INFO:teuthology.orchestra.run.smithi193.stdout:0 2024-09-17T03:08:04.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.987+0000 7f480a2f2640 1 -- 172.21.15.193:0/3770007725 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4804073e70 msgr2=0x7f480413b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:04.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.987+0000 7f480a2f2640 1 --2- 172.21.15.193:0/3770007725 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4804073e70 0x7f480413b4f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f47ec00c3a0 tx=0x7f47ec00c860 comp rx=0 tx=0).stop 2024-09-17T03:08:04.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.987+0000 7f480a2f2640 1 -- 172.21.15.193:0/3770007725 shutdown_connections 2024-09-17T03:08:04.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.987+0000 7f480a2f2640 1 --2- 172.21.15.193:0/3770007725 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f480415ff30 0x7f48040b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:04.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.987+0000 7f480a2f2640 1 --2- 172.21.15.193:0/3770007725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f480415c9b0 0x7f48041509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:04.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.987+0000 7f480a2f2640 1 --2- 172.21.15.193:0/3770007725 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4804073e70 0x7f480413b4f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:04.986 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.987+0000 7f480a2f2640 1 -- 172.21.15.193:0/3770007725 >> 172.21.15.193:0/3770007725 conn(0x7f48040cdc60 msgr2=0x7f4804071120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:04.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.987+0000 7f480a2f2640 1 -- 172.21.15.193:0/3770007725 shutdown_connections 2024-09-17T03:08:04.987 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:04.987+0000 7f480a2f2640 1 -- 172.21.15.193:0/3770007725 wait complete. 2024-09-17T03:08:04.996 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new 30487d14-0be4-4f6b-b4b8-f53e3b786d18 1 2024-09-17T03:08:05.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.109+0000 7f25a1094640 1 -- 172.21.15.193:0/4122911464 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f259c06e100 msgr2=0x7f259c0ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:05.108 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.109+0000 7f25a1094640 1 --2- 172.21.15.193:0/4122911464 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f259c06e100 0x7f259c0ce600 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2590005fd0 tx=0x7f259002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.109+0000 7f25a1094640 1 -- 172.21.15.193:0/4122911464 shutdown_connections 2024-09-17T03:08:05.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.109+0000 7f25a1094640 1 --2- 172.21.15.193:0/4122911464 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f259c06e100 0x7f259c0ce600 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.109+0000 7f25a1094640 1 -- 172.21.15.193:0/4122911464 >> 172.21.15.193:0/4122911464 conn(0x7f259c0cd4b0 msgr2=0x7f259c0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:05.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.109+0000 7f25a1094640 1 -- 172.21.15.193:0/4122911464 shutdown_connections 2024-09-17T03:08:05.109 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.109+0000 7f25a1094640 1 -- 172.21.15.193:0/4122911464 wait complete. 2024-09-17T03:08:05.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.111+0000 7f25a1094640 1 Processor -- start 2024-09-17T03:08:05.110 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.111+0000 7f25a1094640 1 -- start start 2024-09-17T03:08:05.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f25a1094640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f259c06e100 0x7f259c1f6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:05.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f25a1094640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f259c0afd70 0x7f259c0a9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:05.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f25a1094640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f259c0ceb40 0x7f259c06ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:05.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f25a1094640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f259c070de0 con 0x7f259c06e100 2024-09-17T03:08:05.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f25a1094640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f259c070c60 con 0x7f259c0ceb40 2024-09-17T03:08:05.113 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f25a1094640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f259c070f60 con 0x7f259c0afd70 2024-09-17T03:08:05.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f259a59c640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f259c0afd70 0x7f259c0a9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:05.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f259b59e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f259c0ceb40 0x7f259c06ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:05.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f259a59c640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f259c0afd70 0x7f259c0a9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.193:55220/0 (socket says 172.21.15.193:55220) 2024-09-17T03:08:05.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f259b59e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f259c0ceb40 0x7f259c06ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:35710/0 (socket says 172.21.15.193:35710) 2024-09-17T03:08:05.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f259a59c640 1 -- 172.21.15.193:0/3819801345 learned_addr learned my addr 172.21.15.193:0/3819801345 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-17T03:08:05.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f259ad9d640 1 --2- 172.21.15.193:0/3819801345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f259c06e100 0x7f259c1f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:05.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f259b59e640 1 -- 172.21.15.193:0/3819801345 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f259c0afd70 msgr2=0x7f259c0a9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:05.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f259b59e640 1 --2- 172.21.15.193:0/3819801345 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f259c0afd70 0x7f259c0a9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f259b59e640 1 -- 172.21.15.193:0/3819801345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f259c06e100 msgr2=0x7f259c1f6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:05.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f259b59e640 1 --2- 172.21.15.193:0/3819801345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f259c06e100 0x7f259c1f6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f259b59e640 1 -- 172.21.15.193:0/3819801345 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f259c1e7590 con 0x7f259c0ceb40 2024-09-17T03:08:05.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f259a59c640 1 --2- 172.21.15.193:0/3819801345 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f259c0afd70 0x7f259c0a9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:05.114 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f259b59e640 1 --2- 172.21.15.193:0/3819801345 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f259c0ceb40 0x7f259c06ce30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f259400c760 tx=0x7f259400cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:05.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f25837fe640 1 -- 172.21.15.193:0/3819801345 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2594003b70 con 0x7f259c0ceb40 2024-09-17T03:08:05.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.113+0000 7f25837fe640 1 -- 172.21.15.193:0/3819801345 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2594003d10 con 0x7f259c0ceb40 2024-09-17T03:08:05.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.114+0000 7f25a1094640 1 -- 172.21.15.193:0/3819801345 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f259c1e7a90 con 0x7f259c0ceb40 2024-09-17T03:08:05.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.114+0000 7f25837fe640 1 -- 172.21.15.193:0/3819801345 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259400aab0 con 0x7f259c0ceb40 2024-09-17T03:08:05.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.114+0000 7f25a1094640 1 -- 172.21.15.193:0/3819801345 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f259c1e8050 con 0x7f259c0ceb40 2024-09-17T03:08:05.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.114+0000 7f25837fe640 1 -- 172.21.15.193:0/3819801345 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f259400ac50 con 0x7f259c0ceb40 2024-09-17T03:08:05.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.114+0000 7f25837fe640 1 -- 172.21.15.193:0/3819801345 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f2594012550 con 0x7f259c0ceb40 2024-09-17T03:08:05.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.114+0000 7f25a1094640 1 -- 172.21.15.193:0/3819801345 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f259c1e7800 con 0x7f259c0ceb40 2024-09-17T03:08:05.115 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.117+0000 7f25837fe640 1 -- 172.21.15.193:0/3819801345 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f25940050d0 con 0x7f259c0ceb40 2024-09-17T03:08:05.186 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.187+0000 7f25a1094640 1 -- 172.21.15.193:0/3819801345 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd new", "uuid": "30487d14-0be4-4f6b-b4b8-f53e3b786d18", "id": 1} v 0) -- 0x7f259c0ce600 con 0x7f259c0ceb40 2024-09-17T03:08:05.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.193+0000 7f25837fe640 1 -- 172.21.15.193:0/3819801345 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "30487d14-0be4-4f6b-b4b8-f53e3b786d18", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f25940052b0 con 0x7f259c0ceb40 2024-09-17T03:08:05.192 INFO:teuthology.orchestra.run.smithi193.stdout:1 2024-09-17T03:08:05.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.194+0000 7f25a1094640 1 -- 172.21.15.193:0/3819801345 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f259c0ceb40 msgr2=0x7f259c06ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:05.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.194+0000 7f25a1094640 1 --2- 172.21.15.193:0/3819801345 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f259c0ceb40 0x7f259c06ce30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f259400c760 tx=0x7f259400cc20 comp rx=0 tx=0).stop 2024-09-17T03:08:05.193 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.194+0000 7f25a1094640 1 -- 172.21.15.193:0/3819801345 shutdown_connections 2024-09-17T03:08:05.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.194+0000 7f25a1094640 1 --2- 172.21.15.193:0/3819801345 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f259c0ceb40 0x7f259c06ce30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.194+0000 7f25a1094640 1 --2- 172.21.15.193:0/3819801345 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f259c0afd70 0x7f259c0a9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.194+0000 7f25a1094640 1 --2- 172.21.15.193:0/3819801345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f259c06e100 0x7f259c1f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.194+0000 7f25a1094640 1 -- 172.21.15.193:0/3819801345 >> 172.21.15.193:0/3819801345 conn(0x7f259c0cd4b0 msgr2=0x7f259c0b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:05.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.194+0000 7f25a1094640 1 -- 172.21.15.193:0/3819801345 shutdown_connections 2024-09-17T03:08:05.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.194+0000 7f25a1094640 1 -- 172.21.15.193:0/3819801345 wait complete. 2024-09-17T03:08:05.204 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new 2abcddf6-5e1a-48be-923c-b86182a547d7 2 2024-09-17T03:08:05.316 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.317+0000 7fa127ad3640 1 -- 172.21.15.193:0/4025663290 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa12015b900 msgr2=0x7fa1200ae1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:05.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.317+0000 7fa127ad3640 1 --2- 172.21.15.193:0/4025663290 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa12015b900 0x7fa1200ae1b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa110009830 tx=0x7fa11002a510 comp rx=0 tx=0).stop 2024-09-17T03:08:05.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.317+0000 7fa127ad3640 1 -- 172.21.15.193:0/4025663290 shutdown_connections 2024-09-17T03:08:05.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.317+0000 7fa127ad3640 1 --2- 172.21.15.193:0/4025663290 >> v2:172.21.15.78:3300/0 conn(0x7fa1200cf520 0x7fa1200ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.317+0000 7fa127ad3640 1 --2- 172.21.15.193:0/4025663290 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa12015b900 0x7fa1200ae1b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.317+0000 7fa127ad3640 1 -- 172.21.15.193:0/4025663290 >> 172.21.15.193:0/4025663290 conn(0x7fa120074170 msgr2=0x7fa1200b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:05.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.317+0000 7fa127ad3640 1 -- 172.21.15.193:0/4025663290 shutdown_connections 2024-09-17T03:08:05.317 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.317+0000 7fa127ad3640 1 -- 172.21.15.193:0/4025663290 wait complete. 2024-09-17T03:08:05.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.319+0000 7fa127ad3640 1 Processor -- start 2024-09-17T03:08:05.318 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.319+0000 7fa127ad3640 1 -- start start 2024-09-17T03:08:05.320 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.320+0000 7fa127ad3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa12009aa30 0x7fa1201f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:05.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.320+0000 7fa127ad3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa12015b900 0x7fa1201f8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:05.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.320+0000 7fa127ad3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1201f9230 0x7fa1200ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:05.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.320+0000 7fa127ad3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa1200cd190 con 0x7fa12015b900 2024-09-17T03:08:05.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.320+0000 7fa127ad3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa1200cd010 con 0x7fa1201f9230 2024-09-17T03:08:05.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.320+0000 7fa127ad3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa1200cd310 con 0x7fa12009aa30 2024-09-17T03:08:05.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.321+0000 7fa12586f640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa12009aa30 0x7fa1201f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:05.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.321+0000 7fa126070640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1201f9230 0x7fa1200ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:05.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.321+0000 7fa12586f640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa12009aa30 0x7fa1201f5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.193:55236/0 (socket says 172.21.15.193:55236) 2024-09-17T03:08:05.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.321+0000 7fa12586f640 1 -- 172.21.15.193:0/2195483173 learned_addr learned my addr 172.21.15.193:0/2195483173 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-17T03:08:05.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.321+0000 7fa12506e640 1 --2- 172.21.15.193:0/2195483173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa12015b900 0x7fa1201f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:05.321 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.321+0000 7fa12586f640 1 -- 172.21.15.193:0/2195483173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1201f9230 msgr2=0x7fa1200ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:05.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.321+0000 7fa12586f640 1 --2- 172.21.15.193:0/2195483173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1201f9230 0x7fa1200ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.321+0000 7fa12586f640 1 -- 172.21.15.193:0/2195483173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa12015b900 msgr2=0x7fa1201f8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:05.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.321+0000 7fa12586f640 1 --2- 172.21.15.193:0/2195483173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa12015b900 0x7fa1201f8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.321+0000 7fa12586f640 1 -- 172.21.15.193:0/2195483173 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1201f9a40 con 0x7fa12009aa30 2024-09-17T03:08:05.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.321+0000 7fa126070640 1 --2- 172.21.15.193:0/2195483173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1201f9230 0x7fa1200ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:05.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.321+0000 7fa12586f640 1 --2- 172.21.15.193:0/2195483173 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa12009aa30 0x7fa1201f5050 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa110000c00 tx=0x7fa110033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:05.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.321+0000 7fa1167fc640 1 -- 172.21.15.193:0/2195483173 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa110005c90 con 0x7fa12009aa30 2024-09-17T03:08:05.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.321+0000 7fa1167fc640 1 -- 172.21.15.193:0/2195483173 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa110031e50 con 0x7fa12009aa30 2024-09-17T03:08:05.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.321+0000 7fa1167fc640 1 -- 172.21.15.193:0/2195483173 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1100332f0 con 0x7fa12009aa30 2024-09-17T03:08:05.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.321+0000 7fa127ad3640 1 -- 172.21.15.193:0/2195483173 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1200afe10 con 0x7fa12009aa30 2024-09-17T03:08:05.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.321+0000 7fa127ad3640 1 -- 172.21.15.193:0/2195483173 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1200b03d0 con 0x7fa12009aa30 2024-09-17T03:08:05.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.322+0000 7fa1167fc640 1 -- 172.21.15.193:0/2195483173 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa110033490 con 0x7fa12009aa30 2024-09-17T03:08:05.322 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.322+0000 7fa1167fc640 1 -- 172.21.15.193:0/2195483173 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fa110003c80 con 0x7fa12009aa30 2024-09-17T03:08:05.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.322+0000 7fa127ad3640 1 -- 172.21.15.193:0/2195483173 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1200ccad0 con 0x7fa12009aa30 2024-09-17T03:08:05.323 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.324+0000 7fa1167fc640 1 -- 172.21.15.193:0/2195483173 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa11003f030 con 0x7fa12009aa30 2024-09-17T03:08:05.394 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.395+0000 7fa127ad3640 1 -- 172.21.15.193:0/2195483173 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2abcddf6-5e1a-48be-923c-b86182a547d7", "id": 2} v 0) -- 0x7fa12009f0e0 con 0x7fa12009aa30 2024-09-17T03:08:05.397 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.399+0000 7fa1167fc640 1 -- 172.21.15.193:0/2195483173 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2abcddf6-5e1a-48be-923c-b86182a547d7", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fa110033780 con 0x7fa12009aa30 2024-09-17T03:08:05.397 INFO:teuthology.orchestra.run.smithi193.stdout:2 2024-09-17T03:08:05.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.400+0000 7fa127ad3640 1 -- 172.21.15.193:0/2195483173 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa12009aa30 msgr2=0x7fa1201f5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:05.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.400+0000 7fa127ad3640 1 --2- 172.21.15.193:0/2195483173 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa12009aa30 0x7fa1201f5050 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa110000c00 tx=0x7fa110033c20 comp rx=0 tx=0).stop 2024-09-17T03:08:05.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.400+0000 7fa127ad3640 1 -- 172.21.15.193:0/2195483173 shutdown_connections 2024-09-17T03:08:05.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.400+0000 7fa127ad3640 1 --2- 172.21.15.193:0/2195483173 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1201f9230 0x7fa1200ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.400+0000 7fa127ad3640 1 --2- 172.21.15.193:0/2195483173 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa12015b900 0x7fa1201f8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.400+0000 7fa127ad3640 1 --2- 172.21.15.193:0/2195483173 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa12009aa30 0x7fa1201f5050 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.400+0000 7fa127ad3640 1 -- 172.21.15.193:0/2195483173 >> 172.21.15.193:0/2195483173 conn(0x7fa120074170 msgr2=0x7fa12015afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:05.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.400+0000 7fa127ad3640 1 -- 172.21.15.193:0/2195483173 shutdown_connections 2024-09-17T03:08:05.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.400+0000 7fa127ad3640 1 -- 172.21.15.193:0/2195483173 wait complete. 2024-09-17T03:08:05.409 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new 916d8afd-7f14-41c2-8154-8c2a6e6b61c6 3 2024-09-17T03:08:05.521 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.522+0000 7f7c923e4640 1 -- 172.21.15.193:0/206266278 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7c8c0ced00 msgr2=0x7f7c8c0cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:05.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.522+0000 7f7c923e4640 1 --2- 172.21.15.193:0/206266278 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7c8c0ced00 0x7f7c8c0cf110 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7c84005fd0 tx=0x7f7c8402aa90 comp rx=0 tx=0).stop 2024-09-17T03:08:05.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.522+0000 7f7c923e4640 1 -- 172.21.15.193:0/206266278 shutdown_connections 2024-09-17T03:08:05.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.522+0000 7f7c923e4640 1 --2- 172.21.15.193:0/206266278 >> v2:172.21.15.193:3300/0 conn(0x7f7c8c157130 0x7f7c8c160f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.522+0000 7f7c923e4640 1 --2- 172.21.15.193:0/206266278 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7c8c0ced00 0x7f7c8c0cf110 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.522+0000 7f7c923e4640 1 -- 172.21.15.193:0/206266278 >> 172.21.15.193:0/206266278 conn(0x7f7c8c06d550 msgr2=0x7f7c8c071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:05.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.522+0000 7f7c923e4640 1 -- 172.21.15.193:0/206266278 shutdown_connections 2024-09-17T03:08:05.522 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.522+0000 7f7c923e4640 1 -- 172.21.15.193:0/206266278 wait complete. 2024-09-17T03:08:05.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.524+0000 7f7c923e4640 1 Processor -- start 2024-09-17T03:08:05.523 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.524+0000 7f7c923e4640 1 -- start start 2024-09-17T03:08:05.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c923e4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7c8c0cd3b0 0x7f7c8c0c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:05.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c923e4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c8c0ced00 0x7f7c8c1f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:05.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c923e4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c8c157130 0x7f7c8c153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:05.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c923e4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8c0d07e0 con 0x7f7c8c157130 2024-09-17T03:08:05.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c923e4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8c0d0660 con 0x7f7c8c0ced00 2024-09-17T03:08:05.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c923e4640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7c8c0d0960 con 0x7f7c8c0cd3b0 2024-09-17T03:08:05.526 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c8bfff640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7c8c0cd3b0 0x7f7c8c0c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:05.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c8b7fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c8c0ced00 0x7f7c8c1f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:05.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c8bfff640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7c8c0cd3b0 0x7f7c8c0c7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.193:55248/0 (socket says 172.21.15.193:55248) 2024-09-17T03:08:05.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c8bfff640 1 -- 172.21.15.193:0/2436323961 learned_addr learned my addr 172.21.15.193:0/2436323961 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-17T03:08:05.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c90981640 1 --2- 172.21.15.193:0/2436323961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c8c157130 0x7f7c8c153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:05.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c8bfff640 1 -- 172.21.15.193:0/2436323961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c8c0ced00 msgr2=0x7f7c8c1f4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:05.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c8bfff640 1 --2- 172.21.15.193:0/2436323961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c8c0ced00 0x7f7c8c1f4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c8bfff640 1 -- 172.21.15.193:0/2436323961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c8c157130 msgr2=0x7f7c8c153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:05.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c8bfff640 1 --2- 172.21.15.193:0/2436323961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c8c157130 0x7f7c8c153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c8bfff640 1 -- 172.21.15.193:0/2436323961 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c8c0c5f20 con 0x7f7c8c0cd3b0 2024-09-17T03:08:05.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c8b7fe640 1 --2- 172.21.15.193:0/2436323961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c8c0ced00 0x7f7c8c1f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:05.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c8bfff640 1 --2- 172.21.15.193:0/2436323961 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7c8c0cd3b0 0x7f7c8c0c7b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00c3d0 tx=0x7f7c7c00c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:05.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c88ff9640 1 -- 172.21.15.193:0/2436323961 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c017070 con 0x7f7c8c0cd3b0 2024-09-17T03:08:05.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c88ff9640 1 -- 172.21.15.193:0/2436323961 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c7c0053c0 con 0x7f7c8c0cd3b0 2024-09-17T03:08:05.527 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c923e4640 1 -- 172.21.15.193:0/2436323961 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c8c0c6200 con 0x7f7c8c0cd3b0 2024-09-17T03:08:05.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.526+0000 7f7c88ff9640 1 -- 172.21.15.193:0/2436323961 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c003850 con 0x7f7c8c0cd3b0 2024-09-17T03:08:05.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.527+0000 7f7c923e4640 1 -- 172.21.15.193:0/2436323961 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c8c0c67c0 con 0x7f7c8c0cd3b0 2024-09-17T03:08:05.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.527+0000 7f7c88ff9640 1 -- 172.21.15.193:0/2436323961 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7c7c01a070 con 0x7f7c8c0cd3b0 2024-09-17T03:08:05.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.527+0000 7f7c88ff9640 1 -- 172.21.15.193:0/2436323961 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f7c7c011c20 con 0x7f7c8c0cd3b0 2024-09-17T03:08:05.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.528+0000 7f7c923e4640 1 -- 172.21.15.193:0/2436323961 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c8c0d0e60 con 0x7f7c8c0cd3b0 2024-09-17T03:08:05.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.530+0000 7f7c88ff9640 1 -- 172.21.15.193:0/2436323961 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7c7c021020 con 0x7f7c8c0cd3b0 2024-09-17T03:08:05.597 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.598+0000 7f7c923e4640 1 -- 172.21.15.193:0/2436323961 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd new", "uuid": "916d8afd-7f14-41c2-8154-8c2a6e6b61c6", "id": 3} v 0) -- 0x7f7c8c0b6a00 con 0x7f7c8c0cd3b0 2024-09-17T03:08:05.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.602+0000 7f7c88ff9640 1 -- 172.21.15.193:0/2436323961 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "916d8afd-7f14-41c2-8154-8c2a6e6b61c6", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f7c8c0cf650 con 0x7f7c8c0cd3b0 2024-09-17T03:08:05.601 INFO:teuthology.orchestra.run.smithi193.stdout:3 2024-09-17T03:08:05.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.603+0000 7f7c923e4640 1 -- 172.21.15.193:0/2436323961 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7c8c0cd3b0 msgr2=0x7f7c8c0c7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:05.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.603+0000 7f7c923e4640 1 --2- 172.21.15.193:0/2436323961 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7c8c0cd3b0 0x7f7c8c0c7b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00c3d0 tx=0x7f7c7c00c890 comp rx=0 tx=0).stop 2024-09-17T03:08:05.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.603+0000 7f7c923e4640 1 -- 172.21.15.193:0/2436323961 shutdown_connections 2024-09-17T03:08:05.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.603+0000 7f7c923e4640 1 --2- 172.21.15.193:0/2436323961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c8c157130 0x7f7c8c153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.603+0000 7f7c923e4640 1 --2- 172.21.15.193:0/2436323961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c8c0ced00 0x7f7c8c1f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.603+0000 7f7c923e4640 1 --2- 172.21.15.193:0/2436323961 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7c8c0cd3b0 0x7f7c8c0c7b10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.603+0000 7f7c923e4640 1 -- 172.21.15.193:0/2436323961 >> 172.21.15.193:0/2436323961 conn(0x7f7c8c06d550 msgr2=0x7f7c8c156820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:05.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.603+0000 7f7c923e4640 1 -- 172.21.15.193:0/2436323961 shutdown_connections 2024-09-17T03:08:05.603 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.603+0000 7f7c923e4640 1 -- 172.21.15.193:0/2436323961 wait complete. 2024-09-17T03:08:05.613 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new e27a6f71-733e-4ca0-9bf1-a703ce999504 4 2024-09-17T03:08:05.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.726+0000 7f96029df640 1 -- 172.21.15.193:0/3184465975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95fc06cde0 msgr2=0x7f95fc06d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:05.725 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.726+0000 7f96029df640 1 --2- 172.21.15.193:0/3184465975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95fc06cde0 0x7f95fc06d1f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009830 tx=0x7f95f002a480 comp rx=0 tx=0).stop 2024-09-17T03:08:05.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.726+0000 7f96029df640 1 -- 172.21.15.193:0/3184465975 shutdown_connections 2024-09-17T03:08:05.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.726+0000 7f96029df640 1 --2- 172.21.15.193:0/3184465975 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95fc06cde0 0x7f95fc06d1f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.726+0000 7f96029df640 1 --2- 172.21.15.193:0/3184465975 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95fc073e90 0x7f95fc0ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.726+0000 7f96029df640 1 -- 172.21.15.193:0/3184465975 >> 172.21.15.193:0/3184465975 conn(0x7f95fc06def0 msgr2=0x7f95fc06e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:05.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.726+0000 7f96029df640 1 -- 172.21.15.193:0/3184465975 shutdown_connections 2024-09-17T03:08:05.726 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.726+0000 7f96029df640 1 -- 172.21.15.193:0/3184465975 wait complete. 2024-09-17T03:08:05.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.728+0000 7f96029df640 1 Processor -- start 2024-09-17T03:08:05.727 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.728+0000 7f96029df640 1 -- start start 2024-09-17T03:08:05.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f96029df640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95fc06cde0 0x7f95fc15b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:05.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f96029df640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95fc073e90 0x7f95fc0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:05.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f96029df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95fc160240 0x7f95fc0c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:05.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f96029df640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc0d1450 con 0x7f95fc160240 2024-09-17T03:08:05.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f96029df640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc0d15d0 con 0x7f95fc06cde0 2024-09-17T03:08:05.730 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f96029df640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f95fc0d1750 con 0x7f95fc073e90 2024-09-17T03:08:05.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f95fb7fe640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95fc073e90 0x7f95fc0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:05.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f95fbfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95fc06cde0 0x7f95fc15b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:05.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f95fb7fe640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95fc073e90 0x7f95fc0c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.193:55264/0 (socket says 172.21.15.193:55264) 2024-09-17T03:08:05.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f95fb7fe640 1 -- 172.21.15.193:0/4160097832 learned_addr learned my addr 172.21.15.193:0/4160097832 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-17T03:08:05.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f9600f7c640 1 --2- 172.21.15.193:0/4160097832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95fc160240 0x7f95fc0c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:05.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f95fb7fe640 1 -- 172.21.15.193:0/4160097832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95fc06cde0 msgr2=0x7f95fc15b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:05.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f95fb7fe640 1 --2- 172.21.15.193:0/4160097832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95fc06cde0 0x7f95fc15b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f95fb7fe640 1 -- 172.21.15.193:0/4160097832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95fc160240 msgr2=0x7f95fc0c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:05.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f95fb7fe640 1 --2- 172.21.15.193:0/4160097832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95fc160240 0x7f95fc0c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f95fb7fe640 1 -- 172.21.15.193:0/4160097832 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95fc145890 con 0x7f95fc073e90 2024-09-17T03:08:05.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f95fbfff640 1 --2- 172.21.15.193:0/4160097832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95fc06cde0 0x7f95fc15b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:05.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f95fb7fe640 1 --2- 172.21.15.193:0/4160097832 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95fc073e90 0x7f95fc0c6d70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f95f0000c00 tx=0x7f95f0033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:05.731 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f95f8ff9640 1 -- 172.21.15.193:0/4160097832 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f0031d60 con 0x7f95fc073e90 2024-09-17T03:08:05.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f96029df640 1 -- 172.21.15.193:0/4160097832 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95fc0c6290 con 0x7f95fc073e90 2024-09-17T03:08:05.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f95f8ff9640 1 -- 172.21.15.193:0/4160097832 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95f0033e10 con 0x7f95fc073e90 2024-09-17T03:08:05.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.730+0000 7f95f8ff9640 1 -- 172.21.15.193:0/4160097832 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f0033310 con 0x7f95fc073e90 2024-09-17T03:08:05.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.731+0000 7f96029df640 1 -- 172.21.15.193:0/4160097832 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f95fc0c6850 con 0x7f95fc073e90 2024-09-17T03:08:05.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.731+0000 7f95f8ff9640 1 -- 172.21.15.193:0/4160097832 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f95f00334b0 con 0x7f95fc073e90 2024-09-17T03:08:05.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.731+0000 7f95f8ff9640 1 -- 172.21.15.193:0/4160097832 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f95f0003d20 con 0x7f95fc073e90 2024-09-17T03:08:05.732 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.732+0000 7f96029df640 1 -- 172.21.15.193:0/4160097832 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95fc145600 con 0x7f95fc073e90 2024-09-17T03:08:05.733 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.734+0000 7f95f8ff9640 1 -- 172.21.15.193:0/4160097832 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f95f0052080 con 0x7f95fc073e90 2024-09-17T03:08:05.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.804+0000 7f96029df640 1 -- 172.21.15.193:0/4160097832 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e27a6f71-733e-4ca0-9bf1-a703ce999504", "id": 4} v 0) -- 0x7f95fc06d1f0 con 0x7f95fc073e90 2024-09-17T03:08:05.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.808+0000 7f95f8ff9640 1 -- 172.21.15.193:0/4160097832 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e27a6f71-733e-4ca0-9bf1-a703ce999504", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f95f003f030 con 0x7f95fc073e90 2024-09-17T03:08:05.807 INFO:teuthology.orchestra.run.smithi193.stdout:4 2024-09-17T03:08:05.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.809+0000 7f96029df640 1 -- 172.21.15.193:0/4160097832 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95fc073e90 msgr2=0x7f95fc0c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:05.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.809+0000 7f96029df640 1 --2- 172.21.15.193:0/4160097832 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95fc073e90 0x7f95fc0c6d70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f95f0000c00 tx=0x7f95f0033c20 comp rx=0 tx=0).stop 2024-09-17T03:08:05.809 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.809+0000 7f96029df640 1 -- 172.21.15.193:0/4160097832 shutdown_connections 2024-09-17T03:08:05.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.809+0000 7f96029df640 1 --2- 172.21.15.193:0/4160097832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95fc160240 0x7f95fc0c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.809+0000 7f96029df640 1 --2- 172.21.15.193:0/4160097832 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95fc073e90 0x7f95fc0c6d70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.809+0000 7f96029df640 1 --2- 172.21.15.193:0/4160097832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95fc06cde0 0x7f95fc15b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.809+0000 7f96029df640 1 -- 172.21.15.193:0/4160097832 >> 172.21.15.193:0/4160097832 conn(0x7f95fc06def0 msgr2=0x7f95fc140550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:05.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.809+0000 7f96029df640 1 -- 172.21.15.193:0/4160097832 shutdown_connections 2024-09-17T03:08:05.810 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.809+0000 7f96029df640 1 -- 172.21.15.193:0/4160097832 wait complete. 2024-09-17T03:08:05.819 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new 1ffdb951-79f2-4a9f-b7f3-f095f09665ca 5 2024-09-17T03:08:05.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.933+0000 7fa81a27e640 1 -- 172.21.15.193:0/1377430459 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa81415b900 msgr2=0x7fa8140ae1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:05.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.933+0000 7fa81a27e640 1 --2- 172.21.15.193:0/1377430459 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa81415b900 0x7fa8140ae1b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa804005fd0 tx=0x7fa80402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.933+0000 7fa81a27e640 1 -- 172.21.15.193:0/1377430459 shutdown_connections 2024-09-17T03:08:05.933 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.933+0000 7fa81a27e640 1 --2- 172.21.15.193:0/1377430459 >> v2:172.21.15.78:3300/0 conn(0x7fa8140cf520 0x7fa8140ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.933+0000 7fa81a27e640 1 --2- 172.21.15.193:0/1377430459 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa81415b900 0x7fa8140ae1b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.933+0000 7fa81a27e640 1 -- 172.21.15.193:0/1377430459 >> 172.21.15.193:0/1377430459 conn(0x7fa814074170 msgr2=0x7fa8140b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:05.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.933+0000 7fa81a27e640 1 -- 172.21.15.193:0/1377430459 shutdown_connections 2024-09-17T03:08:05.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.933+0000 7fa81a27e640 1 -- 172.21.15.193:0/1377430459 wait complete. 2024-09-17T03:08:05.934 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.935+0000 7fa81a27e640 1 Processor -- start 2024-09-17T03:08:05.935 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.935+0000 7fa81a27e640 1 -- start start 2024-09-17T03:08:05.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.936+0000 7fa81a27e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa81409aa30 0x7fa8140aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:05.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.936+0000 7fa81a27e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa81415b900 0x7fa814155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:05.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.936+0000 7fa81a27e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa8140af210 0x7fa814153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:05.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.936+0000 7fa81a27e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa8140cd190 con 0x7fa81409aa30 2024-09-17T03:08:05.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.936+0000 7fa81a27e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa8140cd010 con 0x7fa81415b900 2024-09-17T03:08:05.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.936+0000 7fa81a27e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa8140cd310 con 0x7fa8140af210 2024-09-17T03:08:05.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.937+0000 7fa81881b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa8140af210 0x7fa814153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:05.937 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.937+0000 7fa813fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa81409aa30 0x7fa8140aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:05.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.937+0000 7fa8137fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa81415b900 0x7fa814155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:05.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.937+0000 7fa813fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa81409aa30 0x7fa8140aecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.193:48102/0 (socket says 172.21.15.193:48102) 2024-09-17T03:08:05.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.937+0000 7fa81881b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa8140af210 0x7fa814153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.193:55294/0 (socket says 172.21.15.193:55294) 2024-09-17T03:08:05.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.937+0000 7fa8137fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa81415b900 0x7fa814155ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:35760/0 (socket says 172.21.15.193:35760) 2024-09-17T03:08:05.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.937+0000 7fa813fff640 1 -- 172.21.15.193:0/2567258721 learned_addr learned my addr 172.21.15.193:0/2567258721 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-17T03:08:05.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.937+0000 7fa813fff640 1 -- 172.21.15.193:0/2567258721 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa8140af210 msgr2=0x7fa814153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:05.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.937+0000 7fa813fff640 1 --2- 172.21.15.193:0/2567258721 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa8140af210 0x7fa814153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.937+0000 7fa813fff640 1 -- 172.21.15.193:0/2567258721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa81415b900 msgr2=0x7fa814155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:05.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.937+0000 7fa813fff640 1 --2- 172.21.15.193:0/2567258721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa81415b900 0x7fa814155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:05.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.937+0000 7fa813fff640 1 -- 172.21.15.193:0/2567258721 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8140b0e90 con 0x7fa81409aa30 2024-09-17T03:08:05.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.937+0000 7fa8137fe640 1 --2- 172.21.15.193:0/2567258721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa81415b900 0x7fa814155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:05.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.937+0000 7fa81881b640 1 --2- 172.21.15.193:0/2567258721 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa8140af210 0x7fa814153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:05.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.937+0000 7fa813fff640 1 --2- 172.21.15.193:0/2567258721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa81409aa30 0x7fa8140aecd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa804006010 tx=0x7fa8040038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:05.938 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.937+0000 7fa810ff9640 1 -- 172.21.15.193:0/2567258721 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80403e030 con 0x7fa81409aa30 2024-09-17T03:08:05.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.937+0000 7fa810ff9640 1 -- 172.21.15.193:0/2567258721 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa804003ca0 con 0x7fa81409aa30 2024-09-17T03:08:05.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.937+0000 7fa81a27e640 1 -- 172.21.15.193:0/2567258721 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa814156b80 con 0x7fa81409aa30 2024-09-17T03:08:05.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.937+0000 7fa810ff9640 1 -- 172.21.15.193:0/2567258721 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa804035040 con 0x7fa81409aa30 2024-09-17T03:08:05.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.937+0000 7fa81a27e640 1 -- 172.21.15.193:0/2567258721 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa814157140 con 0x7fa81409aa30 2024-09-17T03:08:05.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.938+0000 7fa810ff9640 1 -- 172.21.15.193:0/2567258721 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa804041030 con 0x7fa81409aa30 2024-09-17T03:08:05.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.938+0000 7fa810ff9640 1 -- 172.21.15.193:0/2567258721 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fa804043bc0 con 0x7fa81409aa30 2024-09-17T03:08:05.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.939+0000 7fa81a27e640 1 -- 172.21.15.193:0/2567258721 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8140ccad0 con 0x7fa81409aa30 2024-09-17T03:08:05.939 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:05.941+0000 7fa810ff9640 1 -- 172.21.15.193:0/2567258721 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa804004f00 con 0x7fa81409aa30 2024-09-17T03:08:06.010 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.011+0000 7fa81a27e640 1 -- 172.21.15.193:0/2567258721 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1ffdb951-79f2-4a9f-b7f3-f095f09665ca", "id": 5} v 0) -- 0x7fa81415b270 con 0x7fa81409aa30 2024-09-17T03:08:06.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.013+0000 7fa810ff9640 1 -- 172.21.15.193:0/2567258721 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ffdb951-79f2-4a9f-b7f3-f095f09665ca", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fa804043640 con 0x7fa81409aa30 2024-09-17T03:08:06.012 INFO:teuthology.orchestra.run.smithi193.stdout:5 2024-09-17T03:08:06.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.015+0000 7fa81a27e640 1 -- 172.21.15.193:0/2567258721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa81409aa30 msgr2=0x7fa8140aecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:06.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.015+0000 7fa81a27e640 1 --2- 172.21.15.193:0/2567258721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa81409aa30 0x7fa8140aecd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa804006010 tx=0x7fa8040038a0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.015+0000 7fa81a27e640 1 -- 172.21.15.193:0/2567258721 shutdown_connections 2024-09-17T03:08:06.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.015+0000 7fa81a27e640 1 --2- 172.21.15.193:0/2567258721 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa8140af210 0x7fa814153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.015+0000 7fa81a27e640 1 --2- 172.21.15.193:0/2567258721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa81415b900 0x7fa814155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.015+0000 7fa81a27e640 1 --2- 172.21.15.193:0/2567258721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa81409aa30 0x7fa8140aecd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.015+0000 7fa81a27e640 1 -- 172.21.15.193:0/2567258721 >> 172.21.15.193:0/2567258721 conn(0x7fa814074170 msgr2=0x7fa81406ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:06.014 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.015+0000 7fa81a27e640 1 -- 172.21.15.193:0/2567258721 shutdown_connections 2024-09-17T03:08:06.015 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.015+0000 7fa81a27e640 1 -- 172.21.15.193:0/2567258721 wait complete. 2024-09-17T03:08:06.028 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200 6 2024-09-17T03:08:06.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.142+0000 7f107f8f9640 1 -- 172.21.15.193:0/3498248100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10780cd120 msgr2=0x7f10780af4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:06.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.142+0000 7f107f8f9640 1 --2- 172.21.15.193:0/3498248100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10780cd120 0x7f10780af4f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1068005fd0 tx=0x7f106802a510 comp rx=0 tx=0).stop 2024-09-17T03:08:06.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.142+0000 7f107f8f9640 1 -- 172.21.15.193:0/3498248100 shutdown_connections 2024-09-17T03:08:06.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.142+0000 7f107f8f9640 1 --2- 172.21.15.193:0/3498248100 >> v2:172.21.15.78:3300/0 conn(0x7f10780afa30 0x7f107815f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.142+0000 7f107f8f9640 1 --2- 172.21.15.193:0/3498248100 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10780cd120 0x7f10780af4f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.142+0000 7f107f8f9640 1 -- 172.21.15.193:0/3498248100 >> 172.21.15.193:0/3498248100 conn(0x7f10780d0a20 msgr2=0x7f10780d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:06.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.142+0000 7f107f8f9640 1 -- 172.21.15.193:0/3498248100 shutdown_connections 2024-09-17T03:08:06.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.142+0000 7f107f8f9640 1 -- 172.21.15.193:0/3498248100 wait complete. 2024-09-17T03:08:06.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.144+0000 7f107f8f9640 1 Processor -- start 2024-09-17T03:08:06.142 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.144+0000 7f107f8f9640 1 -- start start 2024-09-17T03:08:06.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.145+0000 7f107f8f9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10780afa30 0x7f1078152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:06.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.145+0000 7f107f8f9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f10780b4e70 0x7f1078151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:06.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.145+0000 7f107f8f9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10780cd120 0x7f10781f7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:06.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.145+0000 7f107f8f9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f107815fb30 con 0x7f10780cd120 2024-09-17T03:08:06.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.145+0000 7f107f8f9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f107815f9b0 con 0x7f10780afa30 2024-09-17T03:08:06.145 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.145+0000 7f107f8f9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f107815fcb0 con 0x7f10780b4e70 2024-09-17T03:08:06.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.145+0000 7f107d695640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10780afa30 0x7f1078152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:06.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.145+0000 7f107ce94640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f10780b4e70 0x7f1078151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:06.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.145+0000 7f107d695640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10780afa30 0x7f1078152c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:35780/0 (socket says 172.21.15.193:35780) 2024-09-17T03:08:06.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.145+0000 7f107d695640 1 -- 172.21.15.193:0/970333723 learned_addr learned my addr 172.21.15.193:0/970333723 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-17T03:08:06.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.145+0000 7f107de96640 1 --2- 172.21.15.193:0/970333723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10780cd120 0x7f10781f7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:06.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.145+0000 7f107d695640 1 -- 172.21.15.193:0/970333723 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f10780b4e70 msgr2=0x7f1078151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:06.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.145+0000 7f107d695640 1 --2- 172.21.15.193:0/970333723 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f10780b4e70 0x7f1078151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.145+0000 7f107d695640 1 -- 172.21.15.193:0/970333723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10780cd120 msgr2=0x7f10781f7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:06.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.145+0000 7f107d695640 1 --2- 172.21.15.193:0/970333723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10780cd120 0x7f10781f7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.145+0000 7f107d695640 1 -- 172.21.15.193:0/970333723 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1078157fd0 con 0x7f10780afa30 2024-09-17T03:08:06.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.145+0000 7f107d695640 1 --2- 172.21.15.193:0/970333723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10780afa30 0x7f1078152c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f107400c3a0 tx=0x7f107400c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:06.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.146+0000 7f106dffb640 1 -- 172.21.15.193:0/970333723 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1074017070 con 0x7f10780afa30 2024-09-17T03:08:06.146 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.146+0000 7f106dffb640 1 -- 172.21.15.193:0/970333723 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10740053c0 con 0x7f10780afa30 2024-09-17T03:08:06.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.146+0000 7f106dffb640 1 -- 172.21.15.193:0/970333723 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1074003850 con 0x7f10780afa30 2024-09-17T03:08:06.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.146+0000 7f107f8f9640 1 -- 172.21.15.193:0/970333723 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10781582b0 con 0x7f10780afa30 2024-09-17T03:08:06.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.146+0000 7f106dffb640 1 -- 172.21.15.193:0/970333723 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f107401a070 con 0x7f10780afa30 2024-09-17T03:08:06.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.146+0000 7f107f8f9640 1 -- 172.21.15.193:0/970333723 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1078158870 con 0x7f10780afa30 2024-09-17T03:08:06.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.146+0000 7f106dffb640 1 -- 172.21.15.193:0/970333723 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f1074011d20 con 0x7f10780afa30 2024-09-17T03:08:06.147 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.147+0000 7f107f8f9640 1 -- 172.21.15.193:0/970333723 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f107815f260 con 0x7f10780afa30 2024-09-17T03:08:06.148 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.149+0000 7f106dffb640 1 -- 172.21.15.193:0/970333723 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1074022070 con 0x7f10780afa30 2024-09-17T03:08:06.218 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.219+0000 7f107f8f9640 1 -- 172.21.15.193:0/970333723 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200", "id": 6} v 0) -- 0x7f10780d02c0 con 0x7f10780afa30 2024-09-17T03:08:06.222 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.223+0000 7f106dffb640 1 -- 172.21.15.193:0/970333723 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f1074011590 con 0x7f10780afa30 2024-09-17T03:08:06.222 INFO:teuthology.orchestra.run.smithi193.stdout:6 2024-09-17T03:08:06.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.224+0000 7f107f8f9640 1 -- 172.21.15.193:0/970333723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10780afa30 msgr2=0x7f1078152c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:06.223 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.224+0000 7f107f8f9640 1 --2- 172.21.15.193:0/970333723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10780afa30 0x7f1078152c90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f107400c3a0 tx=0x7f107400c860 comp rx=0 tx=0).stop 2024-09-17T03:08:06.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.224+0000 7f107f8f9640 1 -- 172.21.15.193:0/970333723 shutdown_connections 2024-09-17T03:08:06.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.224+0000 7f107f8f9640 1 --2- 172.21.15.193:0/970333723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10780cd120 0x7f10781f7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.224+0000 7f107f8f9640 1 --2- 172.21.15.193:0/970333723 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f10780b4e70 0x7f1078151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.224+0000 7f107f8f9640 1 --2- 172.21.15.193:0/970333723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10780afa30 0x7f1078152c90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.224+0000 7f107f8f9640 1 -- 172.21.15.193:0/970333723 >> 172.21.15.193:0/970333723 conn(0x7f10780d0a20 msgr2=0x7f10780b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:06.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.224+0000 7f107f8f9640 1 -- 172.21.15.193:0/970333723 shutdown_connections 2024-09-17T03:08:06.224 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.224+0000 7f107f8f9640 1 -- 172.21.15.193:0/970333723 wait complete. 2024-09-17T03:08:06.234 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new 9d94c7cc-b3a1-428c-8ddf-8532c901a7ec 7 2024-09-17T03:08:06.346 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.347+0000 7f74bafda640 1 -- 172.21.15.193:0/1238676473 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74b40b3dc0 msgr2=0x7f74b40b41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:06.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.347+0000 7f74bafda640 1 --2- 172.21.15.193:0/1238676473 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74b40b3dc0 0x7f74b40b41d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f74a0005fd0 tx=0x7f74a002a540 comp rx=0 tx=0).stop 2024-09-17T03:08:06.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.347+0000 7f74bafda640 1 -- 172.21.15.193:0/1238676473 shutdown_connections 2024-09-17T03:08:06.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.347+0000 7f74bafda640 1 --2- 172.21.15.193:0/1238676473 >> v2:172.21.15.78:3300/0 conn(0x7f74b40d0240 0x7f74b40d0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.347+0000 7f74bafda640 1 --2- 172.21.15.193:0/1238676473 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74b40b3dc0 0x7f74b40b41d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.347+0000 7f74bafda640 1 -- 172.21.15.193:0/1238676473 >> 172.21.15.193:0/1238676473 conn(0x7f74b40cedc0 msgr2=0x7f74b40cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:06.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.347+0000 7f74bafda640 1 -- 172.21.15.193:0/1238676473 shutdown_connections 2024-09-17T03:08:06.347 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.347+0000 7f74bafda640 1 -- 172.21.15.193:0/1238676473 wait complete. 2024-09-17T03:08:06.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.349+0000 7f74bafda640 1 Processor -- start 2024-09-17T03:08:06.348 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.349+0000 7f74bafda640 1 -- start start 2024-09-17T03:08:06.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.351+0000 7f74bafda640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74b40b3dc0 0x7f74b41f5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:06.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.351+0000 7f74bafda640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74b40d0240 0x7f74b41581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:06.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.351+0000 7f74bafda640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74b40d1d60 0x7f74b406f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:06.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.351+0000 7f74bafda640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f74b40cd390 con 0x7f74b40b3dc0 2024-09-17T03:08:06.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.351+0000 7f74bafda640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f74b40cd210 con 0x7f74b40d0240 2024-09-17T03:08:06.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.351+0000 7f74bafda640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f74b40d0b90 con 0x7f74b40d1d60 2024-09-17T03:08:06.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.351+0000 7f74b9577640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74b40d1d60 0x7f74b406f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:06.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.351+0000 7f74b3fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74b40d0240 0x7f74b41581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:06.351 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.351+0000 7f74b9577640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74b40d1d60 0x7f74b406f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.193:55320/0 (socket says 172.21.15.193:55320) 2024-09-17T03:08:06.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.351+0000 7f74b9577640 1 -- 172.21.15.193:0/2459007156 learned_addr learned my addr 172.21.15.193:0/2459007156 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-09-17T03:08:06.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.351+0000 7f74b8d76640 1 --2- 172.21.15.193:0/2459007156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74b40b3dc0 0x7f74b41f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:06.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.351+0000 7f74b9577640 1 -- 172.21.15.193:0/2459007156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74b40d0240 msgr2=0x7f74b41581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:06.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.351+0000 7f74b9577640 1 --2- 172.21.15.193:0/2459007156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74b40d0240 0x7f74b41581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.351+0000 7f74b9577640 1 -- 172.21.15.193:0/2459007156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74b40b3dc0 msgr2=0x7f74b41f5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:06.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.351+0000 7f74b9577640 1 --2- 172.21.15.193:0/2459007156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74b40b3dc0 0x7f74b41f5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.351+0000 7f74b9577640 1 -- 172.21.15.193:0/2459007156 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b414d860 con 0x7f74b40d1d60 2024-09-17T03:08:06.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.351+0000 7f74b3fff640 1 --2- 172.21.15.193:0/2459007156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74b40d0240 0x7f74b41581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:06.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.351+0000 7f74b8d76640 1 --2- 172.21.15.193:0/2459007156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74b40b3dc0 0x7f74b41f5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:06.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.351+0000 7f74b9577640 1 --2- 172.21.15.193:0/2459007156 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74b40d1d60 0x7f74b406f0d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00ea40 tx=0x7f74ac00ef00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:06.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.351+0000 7f74b17fa640 1 -- 172.21.15.193:0/2459007156 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac00ce40 con 0x7f74b40d1d60 2024-09-17T03:08:06.352 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.352+0000 7f74b17fa640 1 -- 172.21.15.193:0/2459007156 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74ac004c10 con 0x7f74b40d1d60 2024-09-17T03:08:06.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.352+0000 7f74b17fa640 1 -- 172.21.15.193:0/2459007156 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ac005020 con 0x7f74b40d1d60 2024-09-17T03:08:06.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.352+0000 7f74bafda640 1 -- 172.21.15.193:0/2459007156 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b414db40 con 0x7f74b40d1d60 2024-09-17T03:08:06.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.352+0000 7f74bafda640 1 -- 172.21.15.193:0/2459007156 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b414e100 con 0x7f74b40d1d60 2024-09-17T03:08:06.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.352+0000 7f74b17fa640 1 -- 172.21.15.193:0/2459007156 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f74ac005550 con 0x7f74b40d1d60 2024-09-17T03:08:06.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.352+0000 7f74b17fa640 1 -- 172.21.15.193:0/2459007156 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f74ac010a90 con 0x7f74b40d1d60 2024-09-17T03:08:06.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.353+0000 7f74bafda640 1 -- 172.21.15.193:0/2459007156 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b40b41d0 con 0x7f74b40d1d60 2024-09-17T03:08:06.353 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.355+0000 7f74b17fa640 1 -- 172.21.15.193:0/2459007156 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f74ac010db0 con 0x7f74b40d1d60 2024-09-17T03:08:06.424 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.425+0000 7f74bafda640 1 -- 172.21.15.193:0/2459007156 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9d94c7cc-b3a1-428c-8ddf-8532c901a7ec", "id": 7} v 0) -- 0x7f74b415f140 con 0x7f74b40d1d60 2024-09-17T03:08:06.428 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.429+0000 7f74b17fa640 1 -- 172.21.15.193:0/2459007156 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d94c7cc-b3a1-428c-8ddf-8532c901a7ec", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f74ac010430 con 0x7f74b40d1d60 2024-09-17T03:08:06.428 INFO:teuthology.orchestra.run.smithi193.stdout:7 2024-09-17T03:08:06.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.430+0000 7f74bafda640 1 -- 172.21.15.193:0/2459007156 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74b40d1d60 msgr2=0x7f74b406f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:06.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.430+0000 7f74bafda640 1 --2- 172.21.15.193:0/2459007156 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74b40d1d60 0x7f74b406f0d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f74ac00ea40 tx=0x7f74ac00ef00 comp rx=0 tx=0).stop 2024-09-17T03:08:06.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.430+0000 7f74bafda640 1 -- 172.21.15.193:0/2459007156 shutdown_connections 2024-09-17T03:08:06.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.430+0000 7f74bafda640 1 --2- 172.21.15.193:0/2459007156 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74b40d1d60 0x7f74b406f0d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.429 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.430+0000 7f74bafda640 1 --2- 172.21.15.193:0/2459007156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74b40d0240 0x7f74b41581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.430+0000 7f74bafda640 1 --2- 172.21.15.193:0/2459007156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74b40b3dc0 0x7f74b41f5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.430+0000 7f74bafda640 1 -- 172.21.15.193:0/2459007156 >> 172.21.15.193:0/2459007156 conn(0x7f74b40cedc0 msgr2=0x7f74b415c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:06.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.430+0000 7f74bafda640 1 -- 172.21.15.193:0/2459007156 shutdown_connections 2024-09-17T03:08:06.430 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:06.430+0000 7f74bafda640 1 -- 172.21.15.193:0/2459007156 wait complete. 2024-09-17T03:08:06.440 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T03:08:06.440 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T03:08:06.442 INFO:tasks.ceph.osd.0:Started 2024-09-17T03:08:06.442 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T03:08:06.442 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T03:08:06.444 INFO:tasks.ceph.osd.1:Started 2024-09-17T03:08:06.444 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T03:08:06.445 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T03:08:06.447 INFO:tasks.ceph.osd.2:Started 2024-09-17T03:08:06.447 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-17T03:08:06.447 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-17T03:08:06.449 INFO:tasks.ceph.osd.3:Started 2024-09-17T03:08:06.449 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-17T03:08:06.449 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-17T03:08:06.452 INFO:tasks.ceph.osd.4:Started 2024-09-17T03:08:06.452 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-17T03:08:06.452 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-17T03:08:06.454 INFO:tasks.ceph.osd.5:Started 2024-09-17T03:08:06.454 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-17T03:08:06.455 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-17T03:08:06.457 INFO:tasks.ceph.osd.6:Started 2024-09-17T03:08:06.457 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-17T03:08:06.457 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-17T03:08:06.459 INFO:tasks.ceph.osd.7:Started 2024-09-17T03:08:06.460 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:08:06.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.610+0000 7f59a8352640 1 -- 172.21.15.78:0/3260455587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59a009aa30 msgr2=0x7f59a00cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:06.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.610+0000 7f59a8352640 1 --2- 172.21.15.78:0/3260455587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59a009aa30 0x7f59a00cee10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f599c005fd0 tx=0x7f599c02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.610+0000 7f59a8352640 1 -- 172.21.15.78:0/3260455587 shutdown_connections 2024-09-17T03:08:06.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.610+0000 7f59a8352640 1 --2- 172.21.15.78:0/3260455587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59a009aa30 0x7f59a00cee10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.610+0000 7f59a8352640 1 --2- 172.21.15.78:0/3260455587 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59a015b900 0x7f59a00ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.610+0000 7f59a8352640 1 -- 172.21.15.78:0/3260455587 >> 172.21.15.78:0/3260455587 conn(0x7f59a0074170 msgr2=0x7f59a00b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:06.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.610+0000 7f59a8352640 1 -- 172.21.15.78:0/3260455587 shutdown_connections 2024-09-17T03:08:06.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.610+0000 7f59a8352640 1 -- 172.21.15.78:0/3260455587 wait complete. 2024-09-17T03:08:06.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.612+0000 7f59a8352640 1 Processor -- start 2024-09-17T03:08:06.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.612+0000 7f59a8352640 1 -- start start 2024-09-17T03:08:06.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.613+0000 7f59a8352640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59a009aa30 0x7f59a00b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:06.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.613+0000 7f59a8352640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59a00cdbf0 0x7f59a00c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:06.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.613+0000 7f59a8352640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59a015b900 0x7f59a009d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:06.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.613+0000 7f59a8352640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f59a00cf7a0 con 0x7f59a00cdbf0 2024-09-17T03:08:06.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.613+0000 7f59a8352640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f59a00cf620 con 0x7f59a015b900 2024-09-17T03:08:06.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.613+0000 7f59a8352640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f59a00cd1e0 con 0x7f59a009aa30 2024-09-17T03:08:06.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.613+0000 7f59a58ed640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59a00cdbf0 0x7f59a00c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:06.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.613+0000 7f59a58ed640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59a00cdbf0 0x7f59a00c69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50604/0 (socket says 172.21.15.78:50604) 2024-09-17T03:08:06.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.613+0000 7f59a58ed640 1 -- 172.21.15.78:0/2112375204 learned_addr learned my addr 172.21.15.78:0/2112375204 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:06.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.613+0000 7f59a60ee640 1 --2- 172.21.15.78:0/2112375204 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59a009aa30 0x7f59a00b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:06.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.614+0000 7f59a68ef640 1 --2- 172.21.15.78:0/2112375204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59a015b900 0x7f59a009d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:06.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.614+0000 7f59a58ed640 1 -- 172.21.15.78:0/2112375204 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59a009aa30 msgr2=0x7f59a00b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:06.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.614+0000 7f59a58ed640 1 --2- 172.21.15.78:0/2112375204 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59a009aa30 0x7f59a00b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.614+0000 7f59a58ed640 1 -- 172.21.15.78:0/2112375204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59a015b900 msgr2=0x7f59a009d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:06.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.614+0000 7f59a58ed640 1 --2- 172.21.15.78:0/2112375204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59a015b900 0x7f59a009d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.614+0000 7f59a58ed640 1 -- 172.21.15.78:0/2112375204 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a01f3410 con 0x7f59a00cdbf0 2024-09-17T03:08:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.614+0000 7f59a60ee640 1 --2- 172.21.15.78:0/2112375204 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59a009aa30 0x7f59a00b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.614+0000 7f59a58ed640 1 --2- 172.21.15.78:0/2112375204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59a00cdbf0 0x7f59a00c69a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f599c034040 tx=0x7f599c0035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.614+0000 7f5996ffd640 1 -- 172.21.15.78:0/2112375204 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c03e030 con 0x7f59a00cdbf0 2024-09-17T03:08:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.614+0000 7f5996ffd640 1 -- 172.21.15.78:0/2112375204 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f599c003ae0 con 0x7f59a00cdbf0 2024-09-17T03:08:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.614+0000 7f5996ffd640 1 -- 172.21.15.78:0/2112375204 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c035040 con 0x7f59a00cdbf0 2024-09-17T03:08:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.614+0000 7f59a8352640 1 -- 172.21.15.78:0/2112375204 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a00b33a0 con 0x7f59a00cdbf0 2024-09-17T03:08:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.614+0000 7f59a8352640 1 -- 172.21.15.78:0/2112375204 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a01f39b0 con 0x7f59a00cdbf0 2024-09-17T03:08:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.614+0000 7f5996ffd640 1 -- 172.21.15.78:0/2112375204 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f599c041030 con 0x7f59a00cdbf0 2024-09-17T03:08:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.614+0000 7f5996ffd640 1 -- 172.21.15.78:0/2112375204 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f599c043c20 con 0x7f59a00cdbf0 2024-09-17T03:08:06.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.615+0000 7f59a8352640 1 -- 172.21.15.78:0/2112375204 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a006fbb0 con 0x7f59a00cdbf0 2024-09-17T03:08:06.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.617+0000 7f5996ffd640 1 -- 172.21.15.78:0/2112375204 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f59a006fbb0 con 0x7f59a00cdbf0 2024-09-17T03:08:06.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.677+0000 7f59a8352640 1 -- 172.21.15.78:0/2112375204 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59a00cd700 con 0x7f59a00cdbf0 2024-09-17T03:08:06.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.678+0000 7f5996ffd640 1 -- 172.21.15.78:0/2112375204 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f599c004b30 con 0x7f59a00cdbf0 2024-09-17T03:08:06.677 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:06.677 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":10,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:08:06.427643+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:08:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.679+0000 7f59a8352640 1 -- 172.21.15.78:0/2112375204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59a00cdbf0 msgr2=0x7f59a00c69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.679+0000 7f59a8352640 1 --2- 172.21.15.78:0/2112375204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59a00cdbf0 0x7f59a00c69a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f599c034040 tx=0x7f599c0035f0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.679+0000 7f59a8352640 1 -- 172.21.15.78:0/2112375204 shutdown_connections 2024-09-17T03:08:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.679+0000 7f59a8352640 1 --2- 172.21.15.78:0/2112375204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59a015b900 0x7f59a009d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.679+0000 7f59a8352640 1 --2- 172.21.15.78:0/2112375204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59a00cdbf0 0x7f59a00c69a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.679+0000 7f59a8352640 1 --2- 172.21.15.78:0/2112375204 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59a009aa30 0x7f59a00b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.679+0000 7f59a8352640 1 -- 172.21.15.78:0/2112375204 >> 172.21.15.78:0/2112375204 conn(0x7f59a0074170 msgr2=0x7f59a00b44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.679+0000 7f59a8352640 1 -- 172.21.15.78:0/2112375204 shutdown_connections 2024-09-17T03:08:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:06.679+0000 7f59a8352640 1 -- 172.21.15.78:0/2112375204 wait complete. 2024-09-17T03:08:06.688 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T03:08:06.688 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T03:08:07.416 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-09-17T03:08:07.417+0000 7f48f4231640 -1 Falling back to public interface 2024-09-17T03:08:07.433 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-09-17T03:08:07.434+0000 7fedff40d640 -1 Falling back to public interface 2024-09-17T03:08:07.494 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T03:08:07.600 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.601+0000 7fd972025640 1 -- 172.21.15.78:0/2260349482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd96c0b0cc0 msgr2=0x7fd96c0cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:07.600 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.601+0000 7fd972025640 1 --2- 172.21.15.78:0/2260349482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd96c0b0cc0 0x7fd96c0cc520 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd954009830 tx=0x7fd95402a480 comp rx=0 tx=0).stop 2024-09-17T03:08:07.600 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.601+0000 7fd972025640 1 -- 172.21.15.78:0/2260349482 shutdown_connections 2024-09-17T03:08:07.600 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.601+0000 7fd972025640 1 --2- 172.21.15.78:0/2260349482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd96c0b0cc0 0x7fd96c0cc520 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:07.600 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.601+0000 7fd972025640 1 --2- 172.21.15.78:0/2260349482 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd96c0cca60 0x7fd96c15f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:07.601 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.601+0000 7fd972025640 1 -- 172.21.15.78:0/2260349482 >> 172.21.15.78:0/2260349482 conn(0x7fd96c0b2ed0 msgr2=0x7fd96c0b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:07.601 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.601+0000 7fd972025640 1 -- 172.21.15.78:0/2260349482 shutdown_connections 2024-09-17T03:08:07.601 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.601+0000 7fd972025640 1 -- 172.21.15.78:0/2260349482 wait complete. 2024-09-17T03:08:07.601 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.602+0000 7fd972025640 1 Processor -- start 2024-09-17T03:08:07.601 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.603+0000 7fd972025640 1 -- start start 2024-09-17T03:08:07.604 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.604+0000 7fd972025640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd96c0b0cc0 0x7fd96c09ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:07.604 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.604+0000 7fd972025640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd96c0b6720 0x7fd96c159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:07.604 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.604+0000 7fd972025640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd96c0cca60 0x7fd96c15ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:07.604 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.604+0000 7fd972025640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c0cd200 con 0x7fd96c0cca60 2024-09-17T03:08:07.604 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.604+0000 7fd972025640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd96c0cd080 con 0x7fd96c0b0cc0 2024-09-17T03:08:07.604 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.604+0000 7fd972025640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd96c15fa70 con 0x7fd96c0b6720 2024-09-17T03:08:07.604 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.604+0000 7fd96bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd96c0cca60 0x7fd96c15ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:07.604 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.604+0000 7fd96bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd96c0cca60 0x7fd96c15ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50620/0 (socket says 172.21.15.78:50620) 2024-09-17T03:08:07.605 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.604+0000 7fd96bfff640 1 -- 172.21.15.78:0/2809612807 learned_addr learned my addr 172.21.15.78:0/2809612807 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:07.605 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.604+0000 7fd963fff640 1 --2- 172.21.15.78:0/2809612807 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd96c0b6720 0x7fd96c159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:07.605 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.604+0000 7fd96b7fe640 1 --2- 172.21.15.78:0/2809612807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd96c0b0cc0 0x7fd96c09ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:07.605 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.604+0000 7fd96bfff640 1 -- 172.21.15.78:0/2809612807 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd96c0b6720 msgr2=0x7fd96c159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:07.605 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.604+0000 7fd96bfff640 1 --2- 172.21.15.78:0/2809612807 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd96c0b6720 0x7fd96c159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:07.605 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.604+0000 7fd96bfff640 1 -- 172.21.15.78:0/2809612807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd96c0b0cc0 msgr2=0x7fd96c09ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:07.605 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.604+0000 7fd96bfff640 1 --2- 172.21.15.78:0/2809612807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd96c0b0cc0 0x7fd96c09ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:07.605 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.604+0000 7fd96bfff640 1 -- 172.21.15.78:0/2809612807 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd96c1f2f80 con 0x7fd96c0cca60 2024-09-17T03:08:07.605 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.604+0000 7fd96bfff640 1 --2- 172.21.15.78:0/2809612807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd96c0cca60 0x7fd96c15ece0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd96400eab0 tx=0x7fd96400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:07.605 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.605+0000 7fd968ff9640 1 -- 172.21.15.78:0/2809612807 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96400cea0 con 0x7fd96c0cca60 2024-09-17T03:08:07.605 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.605+0000 7fd968ff9640 1 -- 172.21.15.78:0/2809612807 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd964004b20 con 0x7fd96c0cca60 2024-09-17T03:08:07.605 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.605+0000 7fd972025640 1 -- 172.21.15.78:0/2809612807 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd96c1f3260 con 0x7fd96c0cca60 2024-09-17T03:08:07.605 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.605+0000 7fd968ff9640 1 -- 172.21.15.78:0/2809612807 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd964005020 con 0x7fd96c0cca60 2024-09-17T03:08:07.606 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.605+0000 7fd972025640 1 -- 172.21.15.78:0/2809612807 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd96c15d560 con 0x7fd96c0cca60 2024-09-17T03:08:07.606 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.606+0000 7fd968ff9640 1 -- 172.21.15.78:0/2809612807 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 2) ==== 50742+0+0 (secure 0 0 0) 0x7fd9640051c0 con 0x7fd96c0cca60 2024-09-17T03:08:07.606 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.606+0000 7fd972025640 1 -- 172.21.15.78:0/2809612807 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd96c09b2c0 con 0x7fd96c0cca60 2024-09-17T03:08:07.606 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.606+0000 7fd968ff9640 1 -- 172.21.15.78:0/2809612807 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd964052fb0 con 0x7fd96c0cca60 2024-09-17T03:08:07.607 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.608+0000 7fd968ff9640 1 -- 172.21.15.78:0/2809612807 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd96400f3c0 con 0x7fd96c0cca60 2024-09-17T03:08:07.667 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.669+0000 7fd972025640 1 -- 172.21.15.78:0/2809612807 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd96c0cc520 con 0x7fd96c0cca60 2024-09-17T03:08:07.668 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.669+0000 7fd968ff9640 1 -- 172.21.15.78:0/2809612807 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd964013c20 con 0x7fd96c0cca60 2024-09-17T03:08:07.668 INFO:teuthology.misc.health.smithi078.stdout: 2024-09-17T03:08:07.668 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":10,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:08:06.427643+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:08:07.669 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.670+0000 7fd972025640 1 -- 172.21.15.78:0/2809612807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd96c0cca60 msgr2=0x7fd96c15ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:07.669 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.670+0000 7fd972025640 1 --2- 172.21.15.78:0/2809612807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd96c0cca60 0x7fd96c15ece0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd96400eab0 tx=0x7fd96400ef70 comp rx=0 tx=0).stop 2024-09-17T03:08:07.670 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.670+0000 7fd972025640 1 -- 172.21.15.78:0/2809612807 shutdown_connections 2024-09-17T03:08:07.670 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.670+0000 7fd972025640 1 --2- 172.21.15.78:0/2809612807 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd96c0cca60 0x7fd96c15ece0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:07.670 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.670+0000 7fd972025640 1 --2- 172.21.15.78:0/2809612807 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd96c0b6720 0x7fd96c159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:07.670 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.670+0000 7fd972025640 1 --2- 172.21.15.78:0/2809612807 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd96c0b0cc0 0x7fd96c09ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:07.670 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.670+0000 7fd972025640 1 -- 172.21.15.78:0/2809612807 >> 172.21.15.78:0/2809612807 conn(0x7fd96c0b2ed0 msgr2=0x7fd96c0701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:07.670 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.670+0000 7fd972025640 1 -- 172.21.15.78:0/2809612807 shutdown_connections 2024-09-17T03:08:07.670 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:07.670+0000 7fd972025640 1 -- 172.21.15.78:0/2809612807 wait complete. 2024-09-17T03:08:07.678 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-17T03:08:07.695 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-09-17T03:08:07.697+0000 7f34ee49c640 -1 Falling back to public interface 2024-09-17T03:08:07.906 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-09-17T03:08:07.908+0000 7f070e3bd640 -1 Falling back to public interface 2024-09-17T03:08:07.938 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-09-17T03:08:07.939+0000 7f1699e39640 -1 Falling back to public interface 2024-09-17T03:08:08.122 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-09-17T03:08:08.123+0000 7fadb0925640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T03:08:08.122 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-09-17T03:08:08.124+0000 7fadb0925640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T03:08:08.173 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-09-17T03:08:08.174+0000 7f353580d640 -1 Falling back to public interface 2024-09-17T03:08:08.205 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-09-17T03:08:08.206+0000 7f6c07433640 -1 Falling back to public interface 2024-09-17T03:08:08.236 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-09-17T03:08:08.237+0000 7f126541e640 -1 Falling back to public interface 2024-09-17T03:08:10.985 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-09-17T03:08:10.986+0000 7f48f4231640 -1 osd.3 0 log_to_monitors true 2024-09-17T03:08:11.226 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-09-17T03:08:11.227+0000 7fedff40d640 -1 osd.1 0 log_to_monitors true 2024-09-17T03:08:11.492 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-09-17T03:08:11.493+0000 7f34ee49c640 -1 osd.7 0 log_to_monitors true 2024-09-17T03:08:11.667 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-09-17T03:08:11.669+0000 7f070e3bd640 -1 osd.5 0 log_to_monitors true 2024-09-17T03:08:11.917 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-09-17T03:08:11.918+0000 7f353580d640 -1 osd.2 0 log_to_monitors true 2024-09-17T03:08:11.961 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-09-17T03:08:11.962+0000 7f1699e39640 -1 osd.0 0 log_to_monitors true 2024-09-17T03:08:12.032 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-09-17T03:08:12.034+0000 7f126541e640 -1 osd.4 0 log_to_monitors true 2024-09-17T03:08:12.232 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-09-17T03:08:12.234+0000 7f6c07433640 -1 osd.6 0 log_to_monitors true 2024-09-17T03:08:13.026 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-09-17T03:08:13.027+0000 7f48ef784640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T03:08:13.039 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-09-17T03:08:13.040+0000 7f48e757a640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:08:14.485 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T03:08:14.633 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.634+0000 7f864ab69640 1 -- 172.21.15.78:0/2844025712 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f86440b35d0 msgr2=0x7f86440b9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:14.634 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.634+0000 7f864ab69640 1 --2- 172.21.15.78:0/2844025712 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f86440b35d0 0x7f86440b9ab0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8638009850 tx=0x7f863802a3b0 comp rx=0 tx=0).stop 2024-09-17T03:08:14.634 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.634+0000 7f864ab69640 1 -- 172.21.15.78:0/2844025712 shutdown_connections 2024-09-17T03:08:14.634 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.634+0000 7f864ab69640 1 --2- 172.21.15.78:0/2844025712 >> v2:172.21.15.78:3300/0 conn(0x7f8644162950 0x7f8644162d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:14.634 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.634+0000 7f864ab69640 1 --2- 172.21.15.78:0/2844025712 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f86440b35d0 0x7f86440b9ab0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:14.634 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.634+0000 7f864ab69640 1 -- 172.21.15.78:0/2844025712 >> 172.21.15.78:0/2844025712 conn(0x7f86440d4660 msgr2=0x7f86440d4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:14.634 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.634+0000 7f864ab69640 1 -- 172.21.15.78:0/2844025712 shutdown_connections 2024-09-17T03:08:14.634 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.635+0000 7f864ab69640 1 -- 172.21.15.78:0/2844025712 wait complete. 2024-09-17T03:08:14.635 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.637+0000 7f864ab69640 1 Processor -- start 2024-09-17T03:08:14.636 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.637+0000 7f864ab69640 1 -- start start 2024-09-17T03:08:14.640 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.639+0000 7f864ab69640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86440b35d0 0x7f86440b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:14.640 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.639+0000 7f864ab69640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8644162950 0x7f86440b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:14.640 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.639+0000 7f864ab69640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86441632a0 0x7f864414e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:14.640 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.639+0000 7f864ab69640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f86440cf9a0 con 0x7f86440b35d0 2024-09-17T03:08:14.640 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.639+0000 7f864ab69640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f86440b2930 con 0x7f86441632a0 2024-09-17T03:08:14.640 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.639+0000 7f864ab69640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f86440cfb20 con 0x7f8644162950 2024-09-17T03:08:14.640 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.639+0000 7f8648905640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86440b35d0 0x7f86440b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:14.640 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.639+0000 7f8648905640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86440b35d0 0x7f86440b5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50682/0 (socket says 172.21.15.78:50682) 2024-09-17T03:08:14.640 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.639+0000 7f8648905640 1 -- 172.21.15.78:0/1864540366 learned_addr learned my addr 172.21.15.78:0/1864540366 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:14.640 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.640+0000 7f8648905640 1 -- 172.21.15.78:0/1864540366 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8644162950 msgr2=0x7f86440b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:14.641 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.640+0000 7f8648905640 1 --2- 172.21.15.78:0/1864540366 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8644162950 0x7f86440b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:14.641 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.640+0000 7f8648905640 1 -- 172.21.15.78:0/1864540366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86441632a0 msgr2=0x7f864414e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:14.641 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.640+0000 7f8648905640 1 --2- 172.21.15.78:0/1864540366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86441632a0 0x7f864414e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:14.641 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.640+0000 7f8648905640 1 -- 172.21.15.78:0/1864540366 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8644161110 con 0x7f86440b35d0 2024-09-17T03:08:14.641 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.640+0000 7f8648905640 1 --2- 172.21.15.78:0/1864540366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86440b35d0 0x7f86440b5b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8638000c00 tx=0x7f8638004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:14.641 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.640+0000 7f86417fa640 1 -- 172.21.15.78:0/1864540366 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8638037040 con 0x7f86440b35d0 2024-09-17T03:08:14.641 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.640+0000 7f86417fa640 1 -- 172.21.15.78:0/1864540366 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8638004030 con 0x7f86440b35d0 2024-09-17T03:08:14.641 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.640+0000 7f864ab69640 1 -- 172.21.15.78:0/1864540366 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86440ce570 con 0x7f86440b35d0 2024-09-17T03:08:14.641 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.641+0000 7f864ab69640 1 -- 172.21.15.78:0/1864540366 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86440b5390 con 0x7f86440b35d0 2024-09-17T03:08:14.641 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.641+0000 7f86417fa640 1 -- 172.21.15.78:0/1864540366 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8638005c30 con 0x7f86440b35d0 2024-09-17T03:08:14.643 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.642+0000 7f864ab69640 1 -- 172.21.15.78:0/1864540366 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86440d5250 con 0x7f86440b35d0 2024-09-17T03:08:14.643 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.642+0000 7f86417fa640 1 -- 172.21.15.78:0/1864540366 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7f86380035f0 con 0x7f86440b35d0 2024-09-17T03:08:14.643 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.643+0000 7f86417fa640 1 --2- 172.21.15.78:0/1864540366 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8628078b30 0x7f862807b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:14.643 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.643+0000 7f86417fa640 1 -- 172.21.15.78:0/1864540366 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7f86380b9f90 con 0x7f86440b35d0 2024-09-17T03:08:14.643 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.644+0000 7f8643fff640 1 --2- 172.21.15.78:0/1864540366 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8628078b30 0x7f862807b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:14.643 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.644+0000 7f8643fff640 1 --2- 172.21.15.78:0/1864540366 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8628078b30 0x7f862807b040 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f86300058c0 tx=0x7f8630005850 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:14.650 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.652+0000 7f86417fa640 1 -- 172.21.15.78:0/1864540366 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8638083110 con 0x7f86440b35d0 2024-09-17T03:08:14.924 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-09-17T03:08:14.926+0000 7fedfae39640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T03:08:14.925 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-09-17T03:08:14.926+0000 7f1261672640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T03:08:14.936 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-09-17T03:08:14.938+0000 7fedf2c2f640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:08:14.944 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-09-17T03:08:14.945+0000 7f1258c53640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:08:14.954 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-09-17T03:08:14.956+0000 7f070a34b640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T03:08:14.963 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.965+0000 7f864ab69640 1 -- 172.21.15.78:0/1864540366 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f864408ccd0 con 0x7f86440b35d0 2024-09-17T03:08:14.964 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.965+0000 7f86417fa640 1 -- 172.21.15.78:0/1864540366 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+7578 (secure 0 0 0) 0x7f8638082a10 con 0x7f86440b35d0 2024-09-17T03:08:14.964 INFO:teuthology.misc.health.smithi078.stdout: 2024-09-17T03:08:14.964 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":14,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:08:14.129945+0000","last_up_change":"2024-09-17T03:08:13.128509+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:08:14.964 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-09-17T03:08:14.966+0000 7f0702141640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:08:14.966 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-09-17T03:08:14.968+0000 7f3531a5f640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T03:08:14.967 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.968+0000 7f864ab69640 1 -- 172.21.15.78:0/1864540366 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8628078b30 msgr2=0x7f862807b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:14.967 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.968+0000 7f864ab69640 1 --2- 172.21.15.78:0/1864540366 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8628078b30 0x7f862807b040 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f86300058c0 tx=0x7f8630005850 comp rx=0 tx=0).stop 2024-09-17T03:08:14.967 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.968+0000 7f864ab69640 1 -- 172.21.15.78:0/1864540366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86440b35d0 msgr2=0x7f86440b5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:14.967 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.968+0000 7f864ab69640 1 --2- 172.21.15.78:0/1864540366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86440b35d0 0x7f86440b5b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8638000c00 tx=0x7f8638004dc0 comp rx=0 tx=0).stop 2024-09-17T03:08:14.967 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.968+0000 7f864ab69640 1 -- 172.21.15.78:0/1864540366 shutdown_connections 2024-09-17T03:08:14.967 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.968+0000 7f864ab69640 1 --2- 172.21.15.78:0/1864540366 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8628078b30 0x7f862807b040 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:14.967 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.968+0000 7f864ab69640 1 --2- 172.21.15.78:0/1864540366 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86441632a0 0x7f864414e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:14.968 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.968+0000 7f864ab69640 1 --2- 172.21.15.78:0/1864540366 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8644162950 0x7f86440b4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:14.968 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.968+0000 7f864ab69640 1 --2- 172.21.15.78:0/1864540366 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86440b35d0 0x7f86440b5b90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:14.968 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.968+0000 7f864ab69640 1 -- 172.21.15.78:0/1864540366 >> 172.21.15.78:0/1864540366 conn(0x7f86440d4660 msgr2=0x7f86440d2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:14.968 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.968+0000 7f864ab69640 1 -- 172.21.15.78:0/1864540366 shutdown_connections 2024-09-17T03:08:14.968 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:14.968+0000 7f864ab69640 1 -- 172.21.15.78:0/1864540366 wait complete. 2024-09-17T03:08:14.977 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-09-17T03:08:14.978+0000 7f1695dc7640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T03:08:14.978 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-17T03:08:14.984 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-09-17T03:08:14.986+0000 7f3529040640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:08:14.992 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-09-17T03:08:14.994+0000 7f168dbbd640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:08:15.030 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-09-17T03:08:15.032+0000 7f34eac3f640 -1 osd.7 0 waiting for initial osdmap 2024-09-17T03:08:15.047 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-09-17T03:08:15.049+0000 7f34e2220640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:08:15.294 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-09-17T03:08:15.295+0000 7f6c033c1640 -1 osd.6 0 waiting for initial osdmap 2024-09-17T03:08:15.307 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-09-17T03:08:15.309+0000 7f6bfb1b7640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T03:08:21.785 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T03:08:21.901 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.902+0000 7ff003b71640 1 -- 172.21.15.78:0/1538202205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feffc0b4150 msgr2=0x7feffc0b4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:21.901 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.902+0000 7ff003b71640 1 --2- 172.21.15.78:0/1538202205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feffc0b4150 0x7feffc0b4720 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feff8009830 tx=0x7feff802a480 comp rx=0 tx=0).stop 2024-09-17T03:08:21.902 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.902+0000 7ff003b71640 1 -- 172.21.15.78:0/1538202205 shutdown_connections 2024-09-17T03:08:21.902 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.902+0000 7ff003b71640 1 --2- 172.21.15.78:0/1538202205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feffc0b4150 0x7feffc0b4720 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:21.902 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.902+0000 7ff003b71640 1 -- 172.21.15.78:0/1538202205 >> 172.21.15.78:0/1538202205 conn(0x7feffc0d0a30 msgr2=0x7feffc0b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:21.902 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.903+0000 7ff003b71640 1 -- 172.21.15.78:0/1538202205 shutdown_connections 2024-09-17T03:08:21.902 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.903+0000 7ff003b71640 1 -- 172.21.15.78:0/1538202205 wait complete. 2024-09-17T03:08:21.903 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.904+0000 7ff003b71640 1 Processor -- start 2024-09-17T03:08:21.903 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.904+0000 7ff003b71640 1 -- start start 2024-09-17T03:08:21.906 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7ff003b71640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feffc099af0 0x7feffc0c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:21.906 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7ff003b71640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feffc0b4150 0x7feffc1e6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:21.906 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7ff003b71640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feffc0c7e80 0x7feffc1e6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:21.906 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7ff003b71640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feffc06f920 con 0x7feffc0c7e80 2024-09-17T03:08:21.906 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7ff003b71640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7feffc06f7a0 con 0x7feffc0b4150 2024-09-17T03:08:21.906 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7ff003b71640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7feffc06faa0 con 0x7feffc099af0 2024-09-17T03:08:21.906 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7ff00210e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feffc0c7e80 0x7feffc1e6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:21.906 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7ff00210e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feffc0c7e80 0x7feffc1e6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52374/0 (socket says 172.21.15.78:52374) 2024-09-17T03:08:21.906 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7ff00210e640 1 -- 172.21.15.78:0/2478372930 learned_addr learned my addr 172.21.15.78:0/2478372930 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:21.906 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7ff00110c640 1 --2- 172.21.15.78:0/2478372930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feffc0b4150 0x7feffc1e6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:21.906 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7ff00190d640 1 --2- 172.21.15.78:0/2478372930 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feffc099af0 0x7feffc0c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:21.906 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7ff00210e640 1 -- 172.21.15.78:0/2478372930 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feffc099af0 msgr2=0x7feffc0c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:21.907 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7ff00210e640 1 --2- 172.21.15.78:0/2478372930 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feffc099af0 0x7feffc0c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:21.907 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7ff00210e640 1 -- 172.21.15.78:0/2478372930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feffc0b4150 msgr2=0x7feffc1e6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:21.907 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7ff00210e640 1 --2- 172.21.15.78:0/2478372930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feffc0b4150 0x7feffc1e6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:21.907 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7ff00210e640 1 -- 172.21.15.78:0/2478372930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feffc159000 con 0x7feffc0c7e80 2024-09-17T03:08:21.907 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7ff00210e640 1 --2- 172.21.15.78:0/2478372930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feffc0c7e80 0x7feffc1e6c60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feff400cb40 tx=0x7feff400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:21.907 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7feff27fc640 1 -- 172.21.15.78:0/2478372930 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff4016020 con 0x7feffc0c7e80 2024-09-17T03:08:21.907 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7feff27fc640 1 -- 172.21.15.78:0/2478372930 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feff400ad30 con 0x7feffc0c7e80 2024-09-17T03:08:21.907 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7ff003b71640 1 -- 172.21.15.78:0/2478372930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feffc0b0920 con 0x7feffc0c7e80 2024-09-17T03:08:21.907 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7feff27fc640 1 -- 172.21.15.78:0/2478372930 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff4012680 con 0x7feffc0c7e80 2024-09-17T03:08:21.907 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.906+0000 7ff003b71640 1 -- 172.21.15.78:0/2478372930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feffc0b0ee0 con 0x7feffc0c7e80 2024-09-17T03:08:21.908 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.907+0000 7ff003b71640 1 -- 172.21.15.78:0/2478372930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feffc158d70 con 0x7feffc0c7e80 2024-09-17T03:08:21.908 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.908+0000 7feff27fc640 1 -- 172.21.15.78:0/2478372930 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feff4019020 con 0x7feffc0c7e80 2024-09-17T03:08:21.908 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.909+0000 7feff27fc640 1 --2- 172.21.15.78:0/2478372930 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fefe0078b90 0x7fefe007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:21.908 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.909+0000 7feff27fc640 1 -- 172.21.15.78:0/2478372930 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7feff409ac70 con 0x7feffc0c7e80 2024-09-17T03:08:21.908 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.909+0000 7ff00190d640 1 --2- 172.21.15.78:0/2478372930 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fefe0078b90 0x7fefe007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:21.908 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.909+0000 7ff00190d640 1 --2- 172.21.15.78:0/2478372930 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fefe0078b90 0x7fefe007b0a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feff8034000 tx=0x7feff8004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:21.912 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:21.913+0000 7feff27fc640 1 -- 172.21.15.78:0/2478372930 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feff4020030 con 0x7feffc0c7e80 2024-09-17T03:08:22.089 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:22.090+0000 7ff003b71640 1 -- 172.21.15.78:0/2478372930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feffc0b4720 con 0x7feffc0c7e80 2024-09-17T03:08:22.090 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:22.091+0000 7feff27fc640 1 -- 172.21.15.78:0/2478372930 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12872 (secure 0 0 0) 0x7feff4062d10 con 0x7feffc0c7e80 2024-09-17T03:08:22.090 INFO:teuthology.misc.health.smithi078.stdout: 2024-09-17T03:08:22.090 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":19,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:08:19.951866+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:08:22.092 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:22.093+0000 7ff003b71640 1 -- 172.21.15.78:0/2478372930 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fefe0078b90 msgr2=0x7fefe007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:22.092 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:22.093+0000 7ff003b71640 1 --2- 172.21.15.78:0/2478372930 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fefe0078b90 0x7fefe007b0a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feff8034000 tx=0x7feff8004730 comp rx=0 tx=0).stop 2024-09-17T03:08:22.092 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:22.093+0000 7ff003b71640 1 -- 172.21.15.78:0/2478372930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feffc0c7e80 msgr2=0x7feffc1e6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:22.092 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:22.093+0000 7ff003b71640 1 --2- 172.21.15.78:0/2478372930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feffc0c7e80 0x7feffc1e6c60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feff400cb40 tx=0x7feff400a060 comp rx=0 tx=0).stop 2024-09-17T03:08:22.092 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:22.093+0000 7ff003b71640 1 -- 172.21.15.78:0/2478372930 shutdown_connections 2024-09-17T03:08:22.092 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:22.093+0000 7ff003b71640 1 --2- 172.21.15.78:0/2478372930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feffc0c7e80 0x7feffc1e6c60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:22.093 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:22.093+0000 7ff003b71640 1 --2- 172.21.15.78:0/2478372930 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fefe0078b90 0x7fefe007b0a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:22.093 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:22.093+0000 7ff003b71640 1 --2- 172.21.15.78:0/2478372930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feffc0b4150 0x7feffc1e6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:22.093 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:22.093+0000 7ff003b71640 1 --2- 172.21.15.78:0/2478372930 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feffc099af0 0x7feffc0c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:22.093 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:22.093+0000 7ff003b71640 1 -- 172.21.15.78:0/2478372930 >> 172.21.15.78:0/2478372930 conn(0x7feffc0d0a30 msgr2=0x7feffc0ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:22.093 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:22.093+0000 7ff003b71640 1 -- 172.21.15.78:0/2478372930 shutdown_connections 2024-09-17T03:08:22.093 INFO:teuthology.misc.health.smithi078.stderr:2024-09-17T03:08:22.093+0000 7ff003b71640 1 -- 172.21.15.78:0/2478372930 wait complete. 2024-09-17T03:08:22.102 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-17T03:08:22.102 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T03:08:22.102 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:08:22.102 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:08:22.104 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:08:22.105 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:08:22.105 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:08:22.107 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:08:22.107 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:08:22.107 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:08:22.110 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:08:22.110 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:08:22.110 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:08:22.112 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:08:22.112 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-17T03:08:22.113 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:08:22.189 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-09-17T03:08:22.191 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2024-09-17T03:08:22.207 INFO:tasks.ceph.mds.d.smithi193.stdout:starting mds.d at 2024-09-17T03:08:22.207 INFO:tasks.ceph.mds.b.smithi193.stdout:starting mds.b at 2024-09-17T03:08:22.207 INFO:tasks.ceph.mds.d.smithi193.stderr:2024-09-17T03:08:22.209+0000 7f26a8ae6640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-17T03:08:22.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.233+0000 7f42f7920640 1 -- 172.21.15.78:0/2686836237 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42f00cf520 msgr2=0x7f42f00ae1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:22.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.233+0000 7f42f7920640 1 --2- 172.21.15.78:0/2686836237 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42f00cf520 0x7f42f00ae1b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f42e0005fd0 tx=0x7f42e002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:08:22.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.233+0000 7f42f7920640 1 -- 172.21.15.78:0/2686836237 shutdown_connections 2024-09-17T03:08:22.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.233+0000 7f42f7920640 1 --2- 172.21.15.78:0/2686836237 >> v2:172.21.15.193:3300/0 conn(0x7f42f009aa30 0x7f42f00ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:22.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.233+0000 7f42f7920640 1 --2- 172.21.15.78:0/2686836237 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42f00cf520 0x7f42f00ae1b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:22.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.233+0000 7f42f7920640 1 -- 172.21.15.78:0/2686836237 >> 172.21.15.78:0/2686836237 conn(0x7f42f0074170 msgr2=0x7f42f00b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:22.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.234+0000 7f42f7920640 1 -- 172.21.15.78:0/2686836237 shutdown_connections 2024-09-17T03:08:22.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.234+0000 7f42f7920640 1 -- 172.21.15.78:0/2686836237 wait complete. 2024-09-17T03:08:22.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.236+0000 7f42f7920640 1 Processor -- start 2024-09-17T03:08:22.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.236+0000 7f42f7920640 1 -- start start 2024-09-17T03:08:22.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.237+0000 7f42f7920640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42f009aa30 0x7f42f015cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:22.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.237+0000 7f42f7920640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42f015b900 0x7f42f01f5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:22.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.237+0000 7f42f7920640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42f01ef580 0x7f42f01f58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:22.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.237+0000 7f42f7920640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f42f00cd190 con 0x7f42f01ef580 2024-09-17T03:08:22.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.237+0000 7f42f7920640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f42f00cd010 con 0x7f42f015b900 2024-09-17T03:08:22.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.237+0000 7f42f7920640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f42f00cd310 con 0x7f42f009aa30 2024-09-17T03:08:22.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.237+0000 7f42f5ebd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42f01ef580 0x7f42f01f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:22.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.237+0000 7f42f5ebd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42f01ef580 0x7f42f01f58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52428/0 (socket says 172.21.15.78:52428) 2024-09-17T03:08:22.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.237+0000 7f42f5ebd640 1 -- 172.21.15.78:0/546402316 learned_addr learned my addr 172.21.15.78:0/546402316 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:22.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.237+0000 7f42f4ebb640 1 --2- 172.21.15.78:0/546402316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42f015b900 0x7f42f01f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:22.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.237+0000 7f42f56bc640 1 --2- 172.21.15.78:0/546402316 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42f009aa30 0x7f42f015cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:22.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.238+0000 7f42f5ebd640 1 -- 172.21.15.78:0/546402316 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42f009aa30 msgr2=0x7f42f015cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:22.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.238+0000 7f42f5ebd640 1 --2- 172.21.15.78:0/546402316 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42f009aa30 0x7f42f015cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:22.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.238+0000 7f42f5ebd640 1 -- 172.21.15.78:0/546402316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42f015b900 msgr2=0x7f42f01f5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:22.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.238+0000 7f42f5ebd640 1 --2- 172.21.15.78:0/546402316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42f015b900 0x7f42f01f5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:22.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.238+0000 7f42f5ebd640 1 -- 172.21.15.78:0/546402316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f015d5b0 con 0x7f42f01ef580 2024-09-17T03:08:22.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.238+0000 7f42f4ebb640 1 --2- 172.21.15.78:0/546402316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42f015b900 0x7f42f01f5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:22.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.238+0000 7f42f56bc640 1 --2- 172.21.15.78:0/546402316 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42f009aa30 0x7f42f015cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:22.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.238+0000 7f42f5ebd640 1 --2- 172.21.15.78:0/546402316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42f01ef580 0x7f42f01f58b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f42e800ea40 tx=0x7f42e800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:22.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.238+0000 7f42e5ffb640 1 -- 172.21.15.78:0/546402316 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e800ce40 con 0x7f42f01ef580 2024-09-17T03:08:22.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.238+0000 7f42e5ffb640 1 -- 172.21.15.78:0/546402316 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42e8004c10 con 0x7f42f01ef580 2024-09-17T03:08:22.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.238+0000 7f42e5ffb640 1 -- 172.21.15.78:0/546402316 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e8005020 con 0x7f42f01ef580 2024-09-17T03:08:22.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.238+0000 7f42f7920640 1 -- 172.21.15.78:0/546402316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f015d890 con 0x7f42f01ef580 2024-09-17T03:08:22.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.238+0000 7f42f7920640 1 -- 172.21.15.78:0/546402316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f015de50 con 0x7f42f01ef580 2024-09-17T03:08:22.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.239+0000 7f42f7920640 1 -- 172.21.15.78:0/546402316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f00ccad0 con 0x7f42f01ef580 2024-09-17T03:08:22.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.240+0000 7f42e5ffb640 1 -- 172.21.15.78:0/546402316 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f42e80051c0 con 0x7f42f01ef580 2024-09-17T03:08:22.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.240+0000 7f42e5ffb640 1 --2- 172.21.15.78:0/546402316 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42d4078b90 0x7f42d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:22.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.240+0000 7f42e5ffb640 1 -- 172.21.15.78:0/546402316 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f42e809b6a0 con 0x7f42f01ef580 2024-09-17T03:08:22.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.241+0000 7f42f56bc640 1 --2- 172.21.15.78:0/546402316 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42d4078b90 0x7f42d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:22.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.241+0000 7f42f56bc640 1 --2- 172.21.15.78:0/546402316 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42d4078b90 0x7f42d407b0a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f42ec001b10 tx=0x7f42ec009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:22.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.245+0000 7f42e5ffb640 1 -- 172.21.15.78:0/546402316 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f42e80637f0 con 0x7f42f01ef580 2024-09-17T03:08:22.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.452+0000 7f42f7920640 1 -- 172.21.15.78:0/546402316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42f009f0e0 con 0x7f42f01ef580 2024-09-17T03:08:22.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.452+0000 7f42e5ffb640 1 -- 172.21.15.78:0/546402316 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f42e8068220 con 0x7f42f01ef580 2024-09-17T03:08:22.451 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:22.451 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":2,"btime":"2024-09-17T03:08:22:196874+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/3111681444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3111681444},{"type":"v1","addr":"172.21.15.78:6833","nonce":3111681444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-17T03:08:22.452 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 2 2024-09-17T03:08:22.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.454+0000 7f42f7920640 1 -- 172.21.15.78:0/546402316 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42d4078b90 msgr2=0x7f42d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:22.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.454+0000 7f42f7920640 1 --2- 172.21.15.78:0/546402316 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42d4078b90 0x7f42d407b0a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f42ec001b10 tx=0x7f42ec009040 comp rx=0 tx=0).stop 2024-09-17T03:08:22.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.454+0000 7f42f7920640 1 -- 172.21.15.78:0/546402316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42f01ef580 msgr2=0x7f42f01f58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:22.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.454+0000 7f42f7920640 1 --2- 172.21.15.78:0/546402316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42f01ef580 0x7f42f01f58b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f42e800ea40 tx=0x7f42e800ef00 comp rx=0 tx=0).stop 2024-09-17T03:08:22.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.455+0000 7f42f7920640 1 -- 172.21.15.78:0/546402316 shutdown_connections 2024-09-17T03:08:22.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.455+0000 7f42f7920640 1 --2- 172.21.15.78:0/546402316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42f01ef580 0x7f42f01f58b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:22.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.455+0000 7f42f7920640 1 --2- 172.21.15.78:0/546402316 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42d4078b90 0x7f42d407b0a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:22.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.455+0000 7f42f7920640 1 --2- 172.21.15.78:0/546402316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42f015b900 0x7f42f01f5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:22.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.455+0000 7f42f7920640 1 --2- 172.21.15.78:0/546402316 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42f009aa30 0x7f42f015cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:22.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.455+0000 7f42f7920640 1 -- 172.21.15.78:0/546402316 >> 172.21.15.78:0/546402316 conn(0x7f42f0074170 msgr2=0x7f42f00b23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:22.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.455+0000 7f42f7920640 1 -- 172.21.15.78:0/546402316 shutdown_connections 2024-09-17T03:08:22.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:22.455+0000 7f42f7920640 1 -- 172.21.15.78:0/546402316 wait complete. 2024-09-17T03:08:24.465 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:08:24.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.590+0000 7fcee7abd640 1 -- 172.21.15.78:0/2948846712 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee00d0ce0 msgr2=0x7fcee00b9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:24.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.590+0000 7fcee7abd640 1 --2- 172.21.15.78:0/2948846712 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee00d0ce0 0x7fcee00b9be0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009830 tx=0x7fcedc02a510 comp rx=0 tx=0).stop 2024-09-17T03:08:24.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.590+0000 7fcee7abd640 1 -- 172.21.15.78:0/2948846712 shutdown_connections 2024-09-17T03:08:24.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.590+0000 7fcee7abd640 1 --2- 172.21.15.78:0/2948846712 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee00d0ce0 0x7fcee00b9be0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:24.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.590+0000 7fcee7abd640 1 -- 172.21.15.78:0/2948846712 >> 172.21.15.78:0/2948846712 conn(0x7fcee008bfc0 msgr2=0x7fcee009d870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:24.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.590+0000 7fcee7abd640 1 -- 172.21.15.78:0/2948846712 shutdown_connections 2024-09-17T03:08:24.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.590+0000 7fcee7abd640 1 -- 172.21.15.78:0/2948846712 wait complete. 2024-09-17T03:08:24.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.592+0000 7fcee7abd640 1 Processor -- start 2024-09-17T03:08:24.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.592+0000 7fcee7abd640 1 -- start start 2024-09-17T03:08:24.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.593+0000 7fcee7abd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee00cf0b0 0x7fcee00cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:24.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.593+0000 7fcee7abd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcee00d0ce0 0x7fcee01f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:24.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.593+0000 7fcee7abd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcee00cc2a0 0x7fcee01f4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:24.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.593+0000 7fcee7abd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcee00b4c90 con 0x7fcee00cf0b0 2024-09-17T03:08:24.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.593+0000 7fcee7abd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcee00b4b10 con 0x7fcee00cc2a0 2024-09-17T03:08:24.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.593+0000 7fcee7abd640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fcee00b4e10 con 0x7fcee00d0ce0 2024-09-17T03:08:24.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.593+0000 7fcee5859640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee00cf0b0 0x7fcee00cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:24.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.593+0000 7fcee5859640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee00cf0b0 0x7fcee00cbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52444/0 (socket says 172.21.15.78:52444) 2024-09-17T03:08:24.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.593+0000 7fcee5859640 1 -- 172.21.15.78:0/231058870 learned_addr learned my addr 172.21.15.78:0/231058870 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:24.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.594+0000 7fcee605a640 1 --2- 172.21.15.78:0/231058870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcee00cc2a0 0x7fcee01f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:24.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.594+0000 7fcee5058640 1 --2- 172.21.15.78:0/231058870 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcee00d0ce0 0x7fcee01f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:24.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.594+0000 7fcee5859640 1 -- 172.21.15.78:0/231058870 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcee00d0ce0 msgr2=0x7fcee01f4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:24.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.594+0000 7fcee5859640 1 --2- 172.21.15.78:0/231058870 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcee00d0ce0 0x7fcee01f4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:24.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.594+0000 7fcee5859640 1 -- 172.21.15.78:0/231058870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcee00cc2a0 msgr2=0x7fcee01f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:24.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.594+0000 7fcee5859640 1 --2- 172.21.15.78:0/231058870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcee00cc2a0 0x7fcee01f4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:24.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.594+0000 7fcee5859640 1 -- 172.21.15.78:0/231058870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee00cca10 con 0x7fcee00cf0b0 2024-09-17T03:08:24.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.594+0000 7fcee5058640 1 --2- 172.21.15.78:0/231058870 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcee00d0ce0 0x7fcee01f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:24.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.594+0000 7fcee5859640 1 --2- 172.21.15.78:0/231058870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee00cf0b0 0x7fcee00cbd60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009950 tx=0x7fcedc033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:24.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.594+0000 7fced67fc640 1 -- 172.21.15.78:0/231058870 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc031d60 con 0x7fcee00cf0b0 2024-09-17T03:08:24.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.594+0000 7fced67fc640 1 -- 172.21.15.78:0/231058870 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcedc033e10 con 0x7fcee00cf0b0 2024-09-17T03:08:24.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.594+0000 7fcee7abd640 1 -- 172.21.15.78:0/231058870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee00cccf0 con 0x7fcee00cf0b0 2024-09-17T03:08:24.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.594+0000 7fced67fc640 1 -- 172.21.15.78:0/231058870 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcedc005260 con 0x7fcee00cf0b0 2024-09-17T03:08:24.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.594+0000 7fcee7abd640 1 -- 172.21.15.78:0/231058870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee00cd2b0 con 0x7fcee00cf0b0 2024-09-17T03:08:24.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.595+0000 7fcee7abd640 1 -- 172.21.15.78:0/231058870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcee00b62a0 con 0x7fcee00cf0b0 2024-09-17T03:08:24.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.596+0000 7fced67fc640 1 -- 172.21.15.78:0/231058870 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcedc005400 con 0x7fcee00cf0b0 2024-09-17T03:08:24.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.597+0000 7fced67fc640 1 --2- 172.21.15.78:0/231058870 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcec4078b90 0x7fcec407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:24.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.597+0000 7fced67fc640 1 -- 172.21.15.78:0/231058870 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fcedc0bbbd0 con 0x7fcee00cf0b0 2024-09-17T03:08:24.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.597+0000 7fcee5058640 1 --2- 172.21.15.78:0/231058870 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcec4078b90 0x7fcec407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:24.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.598+0000 7fcee5058640 1 --2- 172.21.15.78:0/231058870 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcec4078b90 0x7fcec407b0a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcee00a21f0 tx=0x7fced0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:24.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.602+0000 7fced67fc640 1 -- 172.21.15.78:0/231058870 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcee00b62a0 con 0x7fcee00cf0b0 2024-09-17T03:08:24.651 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:08:24.654 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:08:24.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.816+0000 7fcee7abd640 1 -- 172.21.15.78:0/231058870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcee00b9be0 con 0x7fcee00cf0b0 2024-09-17T03:08:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.816+0000 7fced67fc640 1 -- 172.21.15.78:0/231058870 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3909 (secure 0 0 0) 0x7fcedc03f030 con 0x7fcee00cf0b0 2024-09-17T03:08:24.815 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:24.815 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":3,"btime":"2024-09-17T03:08:23:198099+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/3111681444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3111681444},{"type":"v1","addr":"172.21.15.78:6833","nonce":3111681444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1920750629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1920750629},{"type":"v1","addr":"172.21.15.193:6836","nonce":1920750629}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4416,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2220463802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2220463802},{"type":"v1","addr":"172.21.15.78:6835","nonce":2220463802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4425,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/934698838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":934698838},{"type":"v1","addr":"172.21.15.193:6837","nonce":934698838}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-17T03:08:24.816 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 3 2024-09-17T03:08:24.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.818+0000 7fcee7abd640 1 -- 172.21.15.78:0/231058870 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcec4078b90 msgr2=0x7fcec407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:24.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.818+0000 7fcee7abd640 1 --2- 172.21.15.78:0/231058870 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcec4078b90 0x7fcec407b0a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fcee00a21f0 tx=0x7fced0008040 comp rx=0 tx=0).stop 2024-09-17T03:08:24.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.818+0000 7fcee7abd640 1 -- 172.21.15.78:0/231058870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee00cf0b0 msgr2=0x7fcee00cbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:24.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.818+0000 7fcee7abd640 1 --2- 172.21.15.78:0/231058870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee00cf0b0 0x7fcee00cbd60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009950 tx=0x7fcedc033c20 comp rx=0 tx=0).stop 2024-09-17T03:08:24.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.818+0000 7fcee7abd640 1 -- 172.21.15.78:0/231058870 shutdown_connections 2024-09-17T03:08:24.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.818+0000 7fcee7abd640 1 --2- 172.21.15.78:0/231058870 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcec4078b90 0x7fcec407b0a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:24.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.818+0000 7fcee7abd640 1 --2- 172.21.15.78:0/231058870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcee00cc2a0 0x7fcee01f4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:24.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.818+0000 7fcee7abd640 1 --2- 172.21.15.78:0/231058870 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcee00d0ce0 0x7fcee01f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:24.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.818+0000 7fcee7abd640 1 --2- 172.21.15.78:0/231058870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee00cf0b0 0x7fcee00cbd60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:24.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.818+0000 7fcee7abd640 1 -- 172.21.15.78:0/231058870 >> 172.21.15.78:0/231058870 conn(0x7fcee008bfc0 msgr2=0x7fcee006f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:24.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.818+0000 7fcee7abd640 1 -- 172.21.15.78:0/231058870 shutdown_connections 2024-09-17T03:08:24.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.818+0000 7fcee7abd640 1 -- 172.21.15.78:0/231058870 wait complete. 2024-09-17T03:08:24.828 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:08:24.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.941+0000 7f06a3c55640 1 -- 172.21.15.78:0/4152185474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0684003fd0 msgr2=0x7f0684004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:24.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.941+0000 7f06a3c55640 1 --2- 172.21.15.78:0/4152185474 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0684003fd0 0x7f0684004800 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f069000c4a0 tx=0x7f0684005830 comp rx=0 tx=0).stop 2024-09-17T03:08:24.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.941+0000 7f06a21f2640 1 -- 172.21.15.78:0/4152185474 reap_dead start 2024-09-17T03:08:24.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.941+0000 7f06a3c55640 1 -- 172.21.15.78:0/4152185474 shutdown_connections 2024-09-17T03:08:24.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.941+0000 7f06a3c55640 1 -- 172.21.15.78:0/4152185474 >> 172.21.15.78:0/4152185474 conn(0x7f069c06d550 msgr2=0x7f069c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:24.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.941+0000 7f06a3c55640 1 -- 172.21.15.78:0/4152185474 shutdown_connections 2024-09-17T03:08:24.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.941+0000 7f06a3c55640 1 -- 172.21.15.78:0/4152185474 wait complete. 2024-09-17T03:08:24.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.943+0000 7f06a3c55640 1 Processor -- start 2024-09-17T03:08:24.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.943+0000 7f06a3c55640 1 -- start start 2024-09-17T03:08:24.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.944+0000 7f06a3c55640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0684003fd0 0x7f069c1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:24.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.944+0000 7f06a3c55640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f069c1556e0 0x7f069c1f7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:24.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.944+0000 7f06a3c55640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f069c1f7640 0x7f069c1f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:24.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.944+0000 7f06a3c55640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f069c0b7820 con 0x7f069c1f7640 2024-09-17T03:08:24.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.944+0000 7f06a3c55640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f069c0b76a0 con 0x7f0684003fd0 2024-09-17T03:08:24.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.944+0000 7f06a3c55640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f069c0b79a0 con 0x7f069c1556e0 2024-09-17T03:08:24.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.945+0000 7f06a21f2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f069c1f7640 0x7f069c1f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:24.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.945+0000 7f06a21f2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f069c1f7640 0x7f069c1f4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52456/0 (socket says 172.21.15.78:52456) 2024-09-17T03:08:24.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.945+0000 7f06a21f2640 1 -- 172.21.15.78:0/3973841588 learned_addr learned my addr 172.21.15.78:0/3973841588 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:24.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.945+0000 7f06a11f0640 1 --2- 172.21.15.78:0/3973841588 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f069c1556e0 0x7f069c1f7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:24.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.945+0000 7f06a19f1640 1 --2- 172.21.15.78:0/3973841588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0684003fd0 0x7f069c1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:24.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.945+0000 7f06a21f2640 1 -- 172.21.15.78:0/3973841588 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f069c1556e0 msgr2=0x7f069c1f7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:24.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.945+0000 7f06a21f2640 1 --2- 172.21.15.78:0/3973841588 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f069c1556e0 0x7f069c1f7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:24.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.945+0000 7f06a21f2640 1 -- 172.21.15.78:0/3973841588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0684003fd0 msgr2=0x7f069c1550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:24.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.945+0000 7f06a21f2640 1 --2- 172.21.15.78:0/3973841588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0684003fd0 0x7f069c1550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:24.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.945+0000 7f06a21f2640 1 -- 172.21.15.78:0/3973841588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069c0cb1b0 con 0x7f069c1f7640 2024-09-17T03:08:24.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.945+0000 7f06a11f0640 1 --2- 172.21.15.78:0/3973841588 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f069c1556e0 0x7f069c1f7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:08:24.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.945+0000 7f06a21f2640 1 --2- 172.21.15.78:0/3973841588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f069c1f7640 0x7f069c1f4c40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f069c0ce060 tx=0x7f06940119e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:24.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.945+0000 7f069a7fc640 1 -- 172.21.15.78:0/3973841588 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0694012a40 con 0x7f069c1f7640 2024-09-17T03:08:24.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.945+0000 7f069a7fc640 1 -- 172.21.15.78:0/3973841588 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0694012cd0 con 0x7f069c1f7640 2024-09-17T03:08:24.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.945+0000 7f069a7fc640 1 -- 172.21.15.78:0/3973841588 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069400f6a0 con 0x7f069c1f7640 2024-09-17T03:08:24.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.945+0000 7f06a3c55640 1 -- 172.21.15.78:0/3973841588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f069c0cb490 con 0x7f069c1f7640 2024-09-17T03:08:24.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.945+0000 7f06a3c55640 1 -- 172.21.15.78:0/3973841588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f069c1f5bb0 con 0x7f069c1f7640 2024-09-17T03:08:24.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.946+0000 7f06a3c55640 1 -- 172.21.15.78:0/3973841588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f069c1f7ea0 con 0x7f069c1f7640 2024-09-17T03:08:24.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.947+0000 7f069a7fc640 1 -- 172.21.15.78:0/3973841588 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f069400f840 con 0x7f069c1f7640 2024-09-17T03:08:24.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.948+0000 7f069a7fc640 1 --2- 172.21.15.78:0/3973841588 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0688078bc0 0x7f068807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:24.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.948+0000 7f069a7fc640 1 -- 172.21.15.78:0/3973841588 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f069409b3d0 con 0x7f069c1f7640 2024-09-17T03:08:24.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.948+0000 7f06a19f1640 1 --2- 172.21.15.78:0/3973841588 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0688078bc0 0x7f068807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:24.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.948+0000 7f06a19f1640 1 --2- 172.21.15.78:0/3973841588 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0688078bc0 0x7f068807b0d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f068c005fd0 tx=0x7f068c009500 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:24.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:24.952+0000 7f069a7fc640 1 -- 172.21.15.78:0/3973841588 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0694063bf0 con 0x7f069c1f7640 2024-09-17T03:08:25.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.130+0000 7f06a3c55640 1 -- 172.21.15.78:0/3973841588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f069c0d1f20 con 0x7f069c1f7640 2024-09-17T03:08:25.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.130+0000 7f069a7fc640 1 -- 172.21.15.78:0/3973841588 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7f06940634f0 con 0x7f069c1f7640 2024-09-17T03:08:25.129 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:25.129 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2024-09-17T03:08:25.129 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:08:25.129 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2024-09-17T03:08:25.129 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2024-09-17T03:08:25.129 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:08:25.129 INFO:teuthology.orchestra.run.smithi078.stdout:] 2024-09-17T03:08:25.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.132+0000 7f06a3c55640 1 -- 172.21.15.78:0/3973841588 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0688078bc0 msgr2=0x7f068807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:25.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.132+0000 7f06a3c55640 1 --2- 172.21.15.78:0/3973841588 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0688078bc0 0x7f068807b0d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f068c005fd0 tx=0x7f068c009500 comp rx=0 tx=0).stop 2024-09-17T03:08:25.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.132+0000 7f06a3c55640 1 -- 172.21.15.78:0/3973841588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f069c1f7640 msgr2=0x7f069c1f4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:25.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.132+0000 7f06a3c55640 1 --2- 172.21.15.78:0/3973841588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f069c1f7640 0x7f069c1f4c40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f069c0ce060 tx=0x7f06940119e0 comp rx=0 tx=0).stop 2024-09-17T03:08:25.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.132+0000 7f06a3c55640 1 -- 172.21.15.78:0/3973841588 shutdown_connections 2024-09-17T03:08:25.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.132+0000 7f06a3c55640 1 --2- 172.21.15.78:0/3973841588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f069c1f7640 0x7f069c1f4c40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:25.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.132+0000 7f06a3c55640 1 --2- 172.21.15.78:0/3973841588 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f069c1556e0 0x7f069c1f7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:25.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.132+0000 7f06a3c55640 1 --2- 172.21.15.78:0/3973841588 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0688078bc0 0x7f068807b0d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:25.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.132+0000 7f06a3c55640 1 --2- 172.21.15.78:0/3973841588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0684003fd0 0x7f069c1550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:25.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.132+0000 7f06a3c55640 1 -- 172.21.15.78:0/3973841588 >> 172.21.15.78:0/3973841588 conn(0x7f069c06d550 msgr2=0x7f069c0b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:25.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.132+0000 7f06a3c55640 1 -- 172.21.15.78:0/3973841588 shutdown_connections 2024-09-17T03:08:25.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.132+0000 7f06a3c55640 1 -- 172.21.15.78:0/3973841588 wait complete. 2024-09-17T03:08:25.142 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:08:25.142 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:08:25.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.259+0000 7f18bdfa8640 1 -- 172.21.15.78:0/3051360800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b80b7c60 msgr2=0x7f18b80d0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:25.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.259+0000 7f18bdfa8640 1 --2- 172.21.15.78:0/3051360800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b80b7c60 0x7f18b80d0b60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009830 tx=0x7f18a002a530 comp rx=0 tx=0).stop 2024-09-17T03:08:25.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.259+0000 7f18bdfa8640 1 -- 172.21.15.78:0/3051360800 shutdown_connections 2024-09-17T03:08:25.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.259+0000 7f18bdfa8640 1 --2- 172.21.15.78:0/3051360800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b80b7c60 0x7f18b80d0b60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:25.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.259+0000 7f18bdfa8640 1 -- 172.21.15.78:0/3051360800 >> 172.21.15.78:0/3051360800 conn(0x7f18b80cee20 msgr2=0x7f18b80cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:25.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.259+0000 7f18bdfa8640 1 -- 172.21.15.78:0/3051360800 shutdown_connections 2024-09-17T03:08:25.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.259+0000 7f18bdfa8640 1 -- 172.21.15.78:0/3051360800 wait complete. 2024-09-17T03:08:25.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.261+0000 7f18bdfa8640 1 Processor -- start 2024-09-17T03:08:25.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.261+0000 7f18bdfa8640 1 -- start start 2024-09-17T03:08:25.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.262+0000 7f18bdfa8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b80b3510 0x7f18b8154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:25.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.262+0000 7f18bdfa8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18b80b7c60 0x7f18b8155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:25.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.262+0000 7f18bdfa8640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f18b80ccd80 0x7f18b8162d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:25.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.262+0000 7f18bdfa8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f18b80cda20 con 0x7f18b80b3510 2024-09-17T03:08:25.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.262+0000 7f18bdfa8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f18b80cd8a0 con 0x7f18b80b7c60 2024-09-17T03:08:25.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.262+0000 7f18bdfa8640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f18b80cdba0 con 0x7f18b80ccd80 2024-09-17T03:08:25.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.262+0000 7f18b77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b80b3510 0x7f18b8154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:25.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.263+0000 7f18b77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b80b3510 0x7f18b8154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52474/0 (socket says 172.21.15.78:52474) 2024-09-17T03:08:25.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.263+0000 7f18b77fe640 1 -- 172.21.15.78:0/346353711 learned_addr learned my addr 172.21.15.78:0/346353711 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:25.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.263+0000 7f18b77fe640 1 -- 172.21.15.78:0/346353711 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f18b80ccd80 msgr2=0x7f18b8162d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:25.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.263+0000 7f18b77fe640 1 --2- 172.21.15.78:0/346353711 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f18b80ccd80 0x7f18b8162d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:25.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.263+0000 7f18b77fe640 1 -- 172.21.15.78:0/346353711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18b80b7c60 msgr2=0x7f18b8155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:25.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.263+0000 7f18b6ffd640 1 --2- 172.21.15.78:0/346353711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18b80b7c60 0x7f18b8155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:25.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.263+0000 7f18b77fe640 1 --2- 172.21.15.78:0/346353711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18b80b7c60 0x7f18b8155010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:25.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.263+0000 7f18b77fe640 1 -- 172.21.15.78:0/346353711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b8161c50 con 0x7f18b80b3510 2024-09-17T03:08:25.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.263+0000 7f18b77fe640 1 --2- 172.21.15.78:0/346353711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b80b3510 0x7f18b8154a40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f18a800c3c0 tx=0x7f18a8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:25.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.263+0000 7f18affff640 1 -- 172.21.15.78:0/346353711 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8017070 con 0x7f18b80b3510 2024-09-17T03:08:25.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.263+0000 7f18affff640 1 -- 172.21.15.78:0/346353711 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18a80035f0 con 0x7f18b80b3510 2024-09-17T03:08:25.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.263+0000 7f18bdfa8640 1 -- 172.21.15.78:0/346353711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b8161f30 con 0x7f18b80b3510 2024-09-17T03:08:25.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.263+0000 7f18affff640 1 -- 172.21.15.78:0/346353711 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a8003a80 con 0x7f18b80b3510 2024-09-17T03:08:25.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.263+0000 7f18bdfa8640 1 -- 172.21.15.78:0/346353711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b8162860 con 0x7f18b80b3510 2024-09-17T03:08:25.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.264+0000 7f18bdfa8640 1 -- 172.21.15.78:0/346353711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18b80cd190 con 0x7f18b80b3510 2024-09-17T03:08:25.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.265+0000 7f18affff640 1 -- 172.21.15.78:0/346353711 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f18a801a070 con 0x7f18b80b3510 2024-09-17T03:08:25.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.265+0000 7f18affff640 1 --2- 172.21.15.78:0/346353711 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1898078bc0 0x7f189807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:25.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.265+0000 7f18affff640 1 -- 172.21.15.78:0/346353711 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f18a8099c50 con 0x7f18b80b3510 2024-09-17T03:08:25.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.266+0000 7f18b6ffd640 1 --2- 172.21.15.78:0/346353711 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1898078bc0 0x7f189807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:25.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.266+0000 7f18b6ffd640 1 --2- 172.21.15.78:0/346353711 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1898078bc0 0x7f189807b0d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f18a0034000 tx=0x7f18a0004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:25.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.270+0000 7f18affff640 1 -- 172.21.15.78:0/346353711 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f18a809f020 con 0x7f18b80b3510 2024-09-17T03:08:25.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:25.444+0000 7f18bdfa8640 1 -- 172.21.15.78:0/346353711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f18b80cf620 con 0x7f18b80b3510 2024-09-17T03:08:26.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.210+0000 7f18affff640 1 -- 172.21.15.78:0/346353711 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f18a80623e0 con 0x7f18b80b3510 2024-09-17T03:08:26.209 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2024-09-17T03:08:26.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.213+0000 7f18bdfa8640 1 -- 172.21.15.78:0/346353711 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1898078bc0 msgr2=0x7f189807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:26.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.213+0000 7f18bdfa8640 1 --2- 172.21.15.78:0/346353711 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1898078bc0 0x7f189807b0d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f18a0034000 tx=0x7f18a0004730 comp rx=0 tx=0).stop 2024-09-17T03:08:26.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.213+0000 7f18bdfa8640 1 -- 172.21.15.78:0/346353711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b80b3510 msgr2=0x7f18b8154a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:26.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.213+0000 7f18bdfa8640 1 --2- 172.21.15.78:0/346353711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b80b3510 0x7f18b8154a40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f18a800c3c0 tx=0x7f18a8001e70 comp rx=0 tx=0).stop 2024-09-17T03:08:26.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.213+0000 7f18bdfa8640 1 -- 172.21.15.78:0/346353711 shutdown_connections 2024-09-17T03:08:26.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.214+0000 7f18bdfa8640 1 --2- 172.21.15.78:0/346353711 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f18b80ccd80 0x7f18b8162d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:26.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.214+0000 7f18bdfa8640 1 --2- 172.21.15.78:0/346353711 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1898078bc0 0x7f189807b0d0 secure :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f18a0034000 tx=0x7f18a0004730 comp rx=0 tx=0).stop 2024-09-17T03:08:26.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.214+0000 7f18bdfa8640 1 --2- 172.21.15.78:0/346353711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18b80b7c60 0x7f18b8155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:26.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.214+0000 7f18bdfa8640 1 --2- 172.21.15.78:0/346353711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b80b3510 0x7f18b8154a40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:26.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.214+0000 7f18bdfa8640 1 -- 172.21.15.78:0/346353711 >> 172.21.15.78:0/346353711 conn(0x7f18b80cee20 msgr2=0x7f18b80b5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:26.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.214+0000 7f18bdfa8640 1 -- 172.21.15.78:0/346353711 shutdown_connections 2024-09-17T03:08:26.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.214+0000 7f18bdfa8640 1 -- 172.21.15.78:0/346353711 wait complete. 2024-09-17T03:08:26.229 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:08:26.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.352+0000 7fbc31c86640 1 -- 172.21.15.78:0/2820804649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc2c0cf7a0 msgr2=0x7fbc2c1626e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:26.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.352+0000 7fbc31c86640 1 --2- 172.21.15.78:0/2820804649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc2c0cf7a0 0x7fbc2c1626e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c08d4e0 tx=0x7fbc2402aa30 comp rx=0 tx=0).stop 2024-09-17T03:08:26.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.352+0000 7fbc31c86640 1 -- 172.21.15.78:0/2820804649 shutdown_connections 2024-09-17T03:08:26.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.352+0000 7fbc31c86640 1 --2- 172.21.15.78:0/2820804649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc2c0cf7a0 0x7fbc2c1626e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:26.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.352+0000 7fbc31c86640 1 --2- 172.21.15.78:0/2820804649 >> v2:172.21.15.193:3300/0 conn(0x7fbc2c0d2ed0 0x7fbc2c0d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:26.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.352+0000 7fbc31c86640 1 -- 172.21.15.78:0/2820804649 >> 172.21.15.78:0/2820804649 conn(0x7fbc2c08bfc0 msgr2=0x7fbc2c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:26.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.352+0000 7fbc31c86640 1 -- 172.21.15.78:0/2820804649 shutdown_connections 2024-09-17T03:08:26.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.352+0000 7fbc31c86640 1 -- 172.21.15.78:0/2820804649 wait complete. 2024-09-17T03:08:26.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.354+0000 7fbc31c86640 1 Processor -- start 2024-09-17T03:08:26.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.354+0000 7fbc31c86640 1 -- start start 2024-09-17T03:08:26.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.355+0000 7fbc31c86640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc2c0b9b70 0x7fbc2c0cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:26.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.355+0000 7fbc31c86640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbc2c0cf7a0 0x7fbc2c0ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:26.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.355+0000 7fbc31c86640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc2c0d2ed0 0x7fbc2c0ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:26.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.355+0000 7fbc31c86640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c162c20 con 0x7fbc2c0d2ed0 2024-09-17T03:08:26.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.355+0000 7fbc31c86640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2c0cfed0 con 0x7fbc2c0b9b70 2024-09-17T03:08:26.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.355+0000 7fbc31c86640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fbc2c162da0 con 0x7fbc2c0cf7a0 2024-09-17T03:08:26.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.355+0000 7fbc2bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc2c0d2ed0 0x7fbc2c0ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:26.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.355+0000 7fbc2bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc2c0d2ed0 0x7fbc2c0ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38386/0 (socket says 172.21.15.78:38386) 2024-09-17T03:08:26.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.355+0000 7fbc2bfff640 1 -- 172.21.15.78:0/3864313714 learned_addr learned my addr 172.21.15.78:0/3864313714 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:26.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.356+0000 7fbc2b7fe640 1 --2- 172.21.15.78:0/3864313714 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc2c0b9b70 0x7fbc2c0cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:26.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.356+0000 7fbc2affd640 1 --2- 172.21.15.78:0/3864313714 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbc2c0cf7a0 0x7fbc2c0ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:26.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.356+0000 7fbc2bfff640 1 -- 172.21.15.78:0/3864313714 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbc2c0cf7a0 msgr2=0x7fbc2c0ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.356+0000 7fbc2bfff640 1 --2- 172.21.15.78:0/3864313714 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbc2c0cf7a0 0x7fbc2c0ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.356+0000 7fbc2bfff640 1 -- 172.21.15.78:0/3864313714 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc2c0b9b70 msgr2=0x7fbc2c0cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.356+0000 7fbc2bfff640 1 --2- 172.21.15.78:0/3864313714 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc2c0b9b70 0x7fbc2c0cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.356+0000 7fbc2bfff640 1 -- 172.21.15.78:0/3864313714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2c0cdc40 con 0x7fbc2c0d2ed0 2024-09-17T03:08:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.356+0000 7fbc2bfff640 1 --2- 172.21.15.78:0/3864313714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc2c0d2ed0 0x7fbc2c0ca7d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbc24009d60 tx=0x7fbc24003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.356+0000 7fbc13fff640 1 -- 172.21.15.78:0/3864313714 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc24033050 con 0x7fbc2c0d2ed0 2024-09-17T03:08:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.356+0000 7fbc13fff640 1 -- 172.21.15.78:0/3864313714 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc24004550 con 0x7fbc2c0d2ed0 2024-09-17T03:08:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.356+0000 7fbc31c86640 1 -- 172.21.15.78:0/3864313714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc2c0cded0 con 0x7fbc2c0d2ed0 2024-09-17T03:08:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.356+0000 7fbc13fff640 1 -- 172.21.15.78:0/3864313714 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc24038450 con 0x7fbc2c0d2ed0 2024-09-17T03:08:26.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.356+0000 7fbc31c86640 1 -- 172.21.15.78:0/3864313714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc2c0c8bf0 con 0x7fbc2c0d2ed0 2024-09-17T03:08:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.357+0000 7fbc31c86640 1 -- 172.21.15.78:0/3864313714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc2c1633b0 con 0x7fbc2c0d2ed0 2024-09-17T03:08:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.358+0000 7fbc13fff640 1 -- 172.21.15.78:0/3864313714 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbc24036070 con 0x7fbc2c0d2ed0 2024-09-17T03:08:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.358+0000 7fbc13fff640 1 --2- 172.21.15.78:0/3864313714 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbc18078b90 0x7fbc1807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:26.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.358+0000 7fbc13fff640 1 -- 172.21.15.78:0/3864313714 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7fbc240bc100 con 0x7fbc2c0d2ed0 2024-09-17T03:08:26.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.359+0000 7fbc2b7fe640 1 --2- 172.21.15.78:0/3864313714 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbc18078b90 0x7fbc1807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:26.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.359+0000 7fbc2b7fe640 1 --2- 172.21.15.78:0/3864313714 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbc18078b90 0x7fbc1807b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009960 tx=0x7fbc1c009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:26.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.363+0000 7fbc13fff640 1 -- 172.21.15.78:0/3864313714 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbc24084720 con 0x7fbc2c0d2ed0 2024-09-17T03:08:26.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:26.539+0000 7fbc31c86640 1 -- 172.21.15.78:0/3864313714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbc2c051040 con 0x7fbc2c0d2ed0 2024-09-17T03:08:27.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.217+0000 7fbc13fff640 1 -- 172.21.15.78:0/3864313714 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) ==== 170+0+0 (secure 0 0 0) 0x7fbc24084020 con 0x7fbc2c0d2ed0 2024-09-17T03:08:27.216 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2024-09-17T03:08:27.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.220+0000 7fbc31c86640 1 -- 172.21.15.78:0/3864313714 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbc18078b90 msgr2=0x7fbc1807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:27.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.220+0000 7fbc31c86640 1 --2- 172.21.15.78:0/3864313714 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbc18078b90 0x7fbc1807b0a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009960 tx=0x7fbc1c009060 comp rx=0 tx=0).stop 2024-09-17T03:08:27.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.220+0000 7fbc31c86640 1 -- 172.21.15.78:0/3864313714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc2c0d2ed0 msgr2=0x7fbc2c0ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:27.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.220+0000 7fbc31c86640 1 --2- 172.21.15.78:0/3864313714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc2c0d2ed0 0x7fbc2c0ca7d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbc24009d60 tx=0x7fbc24003f10 comp rx=0 tx=0).stop 2024-09-17T03:08:27.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.220+0000 7fbc31c86640 1 -- 172.21.15.78:0/3864313714 shutdown_connections 2024-09-17T03:08:27.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.220+0000 7fbc31c86640 1 --2- 172.21.15.78:0/3864313714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc2c0d2ed0 0x7fbc2c0ca7d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:27.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.220+0000 7fbc31c86640 1 --2- 172.21.15.78:0/3864313714 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbc2c0cf7a0 0x7fbc2c0ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:27.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.220+0000 7fbc31c86640 1 --2- 172.21.15.78:0/3864313714 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbc18078b90 0x7fbc1807b0a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:27.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.220+0000 7fbc31c86640 1 --2- 172.21.15.78:0/3864313714 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc2c0b9b70 0x7fbc2c0cd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:27.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.220+0000 7fbc31c86640 1 -- 172.21.15.78:0/3864313714 >> 172.21.15.78:0/3864313714 conn(0x7fbc2c08bfc0 msgr2=0x7fbc2c0ce480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:27.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.220+0000 7fbc31c86640 1 -- 172.21.15.78:0/3864313714 shutdown_connections 2024-09-17T03:08:27.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.221+0000 7fbc31c86640 1 -- 172.21.15.78:0/3864313714 wait complete. 2024-09-17T03:08:27.241 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:08:27.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.359+0000 7ff9f010b640 1 -- 172.21.15.78:0/3805321717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9e80d2310 msgr2=0x7ff9e80d2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:27.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.359+0000 7ff9f010b640 1 --2- 172.21.15.78:0/3805321717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9e80d2310 0x7ff9e80d2720 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0005fd0 tx=0x7ff9e002a820 comp rx=0 tx=0).stop 2024-09-17T03:08:27.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.359+0000 7ff9f010b640 1 -- 172.21.15.78:0/3805321717 shutdown_connections 2024-09-17T03:08:27.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.359+0000 7ff9f010b640 1 --2- 172.21.15.78:0/3805321717 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9e80d2310 0x7ff9e80d2720 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:27.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.359+0000 7ff9f010b640 1 --2- 172.21.15.78:0/3805321717 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9e815c7a0 0x7ff9e80cf680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:27.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.359+0000 7ff9f010b640 1 -- 172.21.15.78:0/3805321717 >> 172.21.15.78:0/3805321717 conn(0x7ff9e80b3f10 msgr2=0x7ff9e80b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:27.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.359+0000 7ff9f010b640 1 -- 172.21.15.78:0/3805321717 shutdown_connections 2024-09-17T03:08:27.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.359+0000 7ff9f010b640 1 -- 172.21.15.78:0/3805321717 wait complete. 2024-09-17T03:08:27.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.361+0000 7ff9f010b640 1 Processor -- start 2024-09-17T03:08:27.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.361+0000 7ff9f010b640 1 -- start start 2024-09-17T03:08:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.362+0000 7ff9f010b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9e80ccbe0 0x7ff9e81e7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.362+0000 7ff9f010b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e80d2310 0x7ff9e81456e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.362+0000 7ff9f010b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9e815c7a0 0x7ff9e8145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.362+0000 7ff9f010b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e80d18b0 con 0x7ff9e80d2310 2024-09-17T03:08:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.362+0000 7ff9f010b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e80d1730 con 0x7ff9e815c7a0 2024-09-17T03:08:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.362+0000 7ff9f010b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e80d1a30 con 0x7ff9e80ccbe0 2024-09-17T03:08:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.363+0000 7ff9ed6a6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e80d2310 0x7ff9e81456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.363+0000 7ff9ed6a6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e80d2310 0x7ff9e81456e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38390/0 (socket says 172.21.15.78:38390) 2024-09-17T03:08:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.363+0000 7ff9ed6a6640 1 -- 172.21.15.78:0/1637941792 learned_addr learned my addr 172.21.15.78:0/1637941792 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.363+0000 7ff9edea7640 1 --2- 172.21.15.78:0/1637941792 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9e80ccbe0 0x7ff9e81e7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.363+0000 7ff9ee6a8640 1 --2- 172.21.15.78:0/1637941792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9e815c7a0 0x7ff9e8145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.363+0000 7ff9ed6a6640 1 -- 172.21.15.78:0/1637941792 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9e80ccbe0 msgr2=0x7ff9e81e7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.363+0000 7ff9ed6a6640 1 --2- 172.21.15.78:0/1637941792 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9e80ccbe0 0x7ff9e81e7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.363+0000 7ff9ed6a6640 1 -- 172.21.15.78:0/1637941792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9e815c7a0 msgr2=0x7ff9e8145c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.363+0000 7ff9ed6a6640 1 --2- 172.21.15.78:0/1637941792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9e815c7a0 0x7ff9e8145c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.363+0000 7ff9ed6a6640 1 -- 172.21.15.78:0/1637941792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e815f6f0 con 0x7ff9e80d2310 2024-09-17T03:08:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.363+0000 7ff9ed6a6640 1 --2- 172.21.15.78:0/1637941792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e80d2310 0x7ff9e81456e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800e9f0 tx=0x7ff9d800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.363+0000 7ff9de7fc640 1 -- 172.21.15.78:0/1637941792 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d800cd80 con 0x7ff9e80d2310 2024-09-17T03:08:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.363+0000 7ff9de7fc640 1 -- 172.21.15.78:0/1637941792 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9d8004020 con 0x7ff9e80d2310 2024-09-17T03:08:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.363+0000 7ff9f010b640 1 -- 172.21.15.78:0/1637941792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e8143780 con 0x7ff9e80d2310 2024-09-17T03:08:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.363+0000 7ff9f010b640 1 -- 172.21.15.78:0/1637941792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e8143d40 con 0x7ff9e80d2310 2024-09-17T03:08:27.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.363+0000 7ff9de7fc640 1 -- 172.21.15.78:0/1637941792 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d80043f0 con 0x7ff9e80d2310 2024-09-17T03:08:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.364+0000 7ff9f010b640 1 -- 172.21.15.78:0/1637941792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e80d1ee0 con 0x7ff9e80d2310 2024-09-17T03:08:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.365+0000 7ff9de7fc640 1 -- 172.21.15.78:0/1637941792 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff9d80035f0 con 0x7ff9e80d2310 2024-09-17T03:08:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.365+0000 7ff9de7fc640 1 --2- 172.21.15.78:0/1637941792 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff9cc078b90 0x7ff9cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.366+0000 7ff9de7fc640 1 -- 172.21.15.78:0/1637941792 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7ff9d809b640 con 0x7ff9e80d2310 2024-09-17T03:08:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.366+0000 7ff9edea7640 1 --2- 172.21.15.78:0/1637941792 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff9cc078b90 0x7ff9cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:27.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.366+0000 7ff9edea7640 1 --2- 172.21.15.78:0/1637941792 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff9cc078b90 0x7ff9cc07b0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4007d60 tx=0x7ff9e4007cf0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:27.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.370+0000 7ff9de7fc640 1 -- 172.21.15.78:0/1637941792 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff9d8063490 con 0x7ff9e80d2310 2024-09-17T03:08:27.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:27.582+0000 7ff9f010b640 1 -- 172.21.15.78:0/1637941792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff9e815f480 con 0x7ff9e80d2310 2024-09-17T03:08:28.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.222+0000 7ff9de7fc640 1 -- 172.21.15.78:0/1637941792 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7ff9d806c020 con 0x7ff9e80d2310 2024-09-17T03:08:28.221 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 2 and data pool 3 2024-09-17T03:08:28.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.224+0000 7ff9f010b640 1 -- 172.21.15.78:0/1637941792 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff9cc078b90 msgr2=0x7ff9cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.224+0000 7ff9f010b640 1 --2- 172.21.15.78:0/1637941792 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff9cc078b90 0x7ff9cc07b0a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4007d60 tx=0x7ff9e4007cf0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.224+0000 7ff9f010b640 1 -- 172.21.15.78:0/1637941792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e80d2310 msgr2=0x7ff9e81456e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.224+0000 7ff9f010b640 1 --2- 172.21.15.78:0/1637941792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e80d2310 0x7ff9e81456e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff9d800e9f0 tx=0x7ff9d800eeb0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.224+0000 7ff9f010b640 1 -- 172.21.15.78:0/1637941792 shutdown_connections 2024-09-17T03:08:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.224+0000 7ff9f010b640 1 --2- 172.21.15.78:0/1637941792 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff9cc078b90 0x7ff9cc07b0a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.224+0000 7ff9f010b640 1 --2- 172.21.15.78:0/1637941792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9e815c7a0 0x7ff9e8145c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.224+0000 7ff9f010b640 1 --2- 172.21.15.78:0/1637941792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9e80d2310 0x7ff9e81456e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.224+0000 7ff9f010b640 1 --2- 172.21.15.78:0/1637941792 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9e80ccbe0 0x7ff9e81e7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.224+0000 7ff9f010b640 1 -- 172.21.15.78:0/1637941792 >> 172.21.15.78:0/1637941792 conn(0x7ff9e80b3f10 msgr2=0x7ff9e80b6400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.224+0000 7ff9f010b640 1 -- 172.21.15.78:0/1637941792 shutdown_connections 2024-09-17T03:08:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.224+0000 7ff9f010b640 1 -- 172.21.15.78:0/1637941792 wait complete. 2024-09-17T03:08:28.244 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:08:28.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.364+0000 7f23404de640 1 -- 172.21.15.78:0/3356796217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2324004800 msgr2=0x7f2324004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:28.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.364+0000 7f23404de640 1 --2- 172.21.15.78:0/3356796217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2324004800 0x7f2324004c10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f232800c310 tx=0x7f2324005830 comp rx=0 tx=0).stop 2024-09-17T03:08:28.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.364+0000 7f23404de640 1 -- 172.21.15.78:0/3356796217 shutdown_connections 2024-09-17T03:08:28.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.364+0000 7f23404de640 1 --2- 172.21.15.78:0/3356796217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2324004800 0x7f2324004c10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.364+0000 7f23404de640 1 -- 172.21.15.78:0/3356796217 >> 172.21.15.78:0/3356796217 conn(0x7f233808bfc0 msgr2=0x7f233809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:28.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.364+0000 7f23404de640 1 -- 172.21.15.78:0/3356796217 shutdown_connections 2024-09-17T03:08:28.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.364+0000 7f23404de640 1 -- 172.21.15.78:0/3356796217 wait complete. 2024-09-17T03:08:28.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.366+0000 7f23404de640 1 Processor -- start 2024-09-17T03:08:28.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.366+0000 7f23404de640 1 -- start start 2024-09-17T03:08:28.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.367+0000 7f23404de640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2324004800 0x7f233815c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:28.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.367+0000 7f23404de640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23381f5c90 0x7f233815de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:28.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.367+0000 7f23404de640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f23380c9610 0x7f23380c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:28.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.367+0000 7f23404de640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f23380d1c00 con 0x7f23381f5c90 2024-09-17T03:08:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.367+0000 7f23404de640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f23380d1a80 con 0x7f2324004800 2024-09-17T03:08:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.367+0000 7f23404de640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f23380d1d80 con 0x7f23380c9610 2024-09-17T03:08:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.367+0000 7f233da79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23381f5c90 0x7f233815de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.367+0000 7f233da79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23381f5c90 0x7f233815de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38416/0 (socket says 172.21.15.78:38416) 2024-09-17T03:08:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.367+0000 7f233da79640 1 -- 172.21.15.78:0/1766386281 learned_addr learned my addr 172.21.15.78:0/1766386281 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.367+0000 7f233e27a640 1 --2- 172.21.15.78:0/1766386281 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2324004800 0x7f233815c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.367+0000 7f233ea7b640 1 --2- 172.21.15.78:0/1766386281 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f23380c9610 0x7f23380c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.367+0000 7f233da79640 1 -- 172.21.15.78:0/1766386281 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f23380c9610 msgr2=0x7f23380c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.367+0000 7f233da79640 1 --2- 172.21.15.78:0/1766386281 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f23380c9610 0x7f23380c9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.367+0000 7f233da79640 1 -- 172.21.15.78:0/1766386281 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2324004800 msgr2=0x7f233815c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.367+0000 7f233da79640 1 --2- 172.21.15.78:0/1766386281 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2324004800 0x7f233815c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.367+0000 7f233da79640 1 -- 172.21.15.78:0/1766386281 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23380c9f60 con 0x7f23381f5c90 2024-09-17T03:08:28.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.367+0000 7f233e27a640 1 --2- 172.21.15.78:0/1766386281 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2324004800 0x7f233815c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:08:28.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.367+0000 7f233da79640 1 --2- 172.21.15.78:0/1766386281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23381f5c90 0x7f233815de20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f232800c430 tx=0x7f2328001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:28.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.368+0000 7f232effd640 1 -- 172.21.15.78:0/1766386281 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2328031040 con 0x7f23381f5c90 2024-09-17T03:08:28.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.368+0000 7f232effd640 1 -- 172.21.15.78:0/1766386281 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23280065e0 con 0x7f23381f5c90 2024-09-17T03:08:28.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.368+0000 7f232effd640 1 -- 172.21.15.78:0/1766386281 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2328003a40 con 0x7f23381f5c90 2024-09-17T03:08:28.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.368+0000 7f23404de640 1 -- 172.21.15.78:0/1766386281 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23380cb7e0 con 0x7f23381f5c90 2024-09-17T03:08:28.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.368+0000 7f23404de640 1 -- 172.21.15.78:0/1766386281 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23380cbda0 con 0x7f23381f5c90 2024-09-17T03:08:28.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.369+0000 7f23404de640 1 -- 172.21.15.78:0/1766386281 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23380cf310 con 0x7f23381f5c90 2024-09-17T03:08:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.370+0000 7f232effd640 1 -- 172.21.15.78:0/1766386281 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f232803e030 con 0x7f23381f5c90 2024-09-17T03:08:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.371+0000 7f232effd640 1 --2- 172.21.15.78:0/1766386281 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f231c078b90 0x7f231c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.371+0000 7f232effd640 1 -- 172.21.15.78:0/1766386281 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f23280bb1b0 con 0x7f23381f5c90 2024-09-17T03:08:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.371+0000 7f233e27a640 1 --2- 172.21.15.78:0/1766386281 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f231c078b90 0x7f231c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:28.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.371+0000 7f233e27a640 1 --2- 172.21.15.78:0/1766386281 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f231c078b90 0x7f231c07b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2338052910 tx=0x7f2334005f30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:28.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.374+0000 7f232effd640 1 -- 172.21.15.78:0/1766386281 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f23380c9f60 con 0x7f23381f5c90 2024-09-17T03:08:28.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.550+0000 7f23404de640 1 -- 172.21.15.78:0/1766386281 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23380b4020 con 0x7f23381f5c90 2024-09-17T03:08:28.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.551+0000 7f232effd640 1 -- 172.21.15.78:0/1766386281 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16654 (secure 0 0 0) 0x7f2328083680 con 0x7f23381f5c90 2024-09-17T03:08:28.551 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:28.551 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:08:27.583977+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:08:25.448752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:08:26.544015+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:08:28.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.554+0000 7f23404de640 1 -- 172.21.15.78:0/1766386281 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f231c078b90 msgr2=0x7f231c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:28.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.554+0000 7f23404de640 1 --2- 172.21.15.78:0/1766386281 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f231c078b90 0x7f231c07b0a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2338052910 tx=0x7f2334005f30 comp rx=0 tx=0).stop 2024-09-17T03:08:28.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.554+0000 7f23404de640 1 -- 172.21.15.78:0/1766386281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23381f5c90 msgr2=0x7f233815de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:28.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.554+0000 7f23404de640 1 --2- 172.21.15.78:0/1766386281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23381f5c90 0x7f233815de20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f232800c430 tx=0x7f2328001da0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.554+0000 7f23404de640 1 -- 172.21.15.78:0/1766386281 shutdown_connections 2024-09-17T03:08:28.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.554+0000 7f23404de640 1 --2- 172.21.15.78:0/1766386281 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f23380c9610 0x7f23380c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.554+0000 7f23404de640 1 --2- 172.21.15.78:0/1766386281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23381f5c90 0x7f233815de20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.554+0000 7f23404de640 1 --2- 172.21.15.78:0/1766386281 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f231c078b90 0x7f231c07b0a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.554+0000 7f23404de640 1 --2- 172.21.15.78:0/1766386281 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2324004800 0x7f233815c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.554+0000 7f23404de640 1 -- 172.21.15.78:0/1766386281 >> 172.21.15.78:0/1766386281 conn(0x7f233808bfc0 msgr2=0x7f23380d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:28.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.554+0000 7f23404de640 1 -- 172.21.15.78:0/1766386281 shutdown_connections 2024-09-17T03:08:28.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.554+0000 7f23404de640 1 -- 172.21.15.78:0/1766386281 wait complete. 2024-09-17T03:08:28.564 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:08:28.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.676+0000 7f5cc26b2640 1 -- 172.21.15.78:0/4242899359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cbc0cff70 msgr2=0x7f5cbc15c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:28.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.676+0000 7f5cc26b2640 1 --2- 172.21.15.78:0/4242899359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cbc0cff70 0x7f5cbc15c830 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5cac005fd0 tx=0x7f5cac02a540 comp rx=0 tx=0).stop 2024-09-17T03:08:28.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.676+0000 7f5cc26b2640 1 -- 172.21.15.78:0/4242899359 shutdown_connections 2024-09-17T03:08:28.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.676+0000 7f5cc26b2640 1 --2- 172.21.15.78:0/4242899359 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cbc0cff70 0x7f5cbc15c830 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.676+0000 7f5cc26b2640 1 -- 172.21.15.78:0/4242899359 >> 172.21.15.78:0/4242899359 conn(0x7f5cbc0cee20 msgr2=0x7f5cbc0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:28.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.676+0000 7f5cc26b2640 1 -- 172.21.15.78:0/4242899359 shutdown_connections 2024-09-17T03:08:28.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.676+0000 7f5cc26b2640 1 -- 172.21.15.78:0/4242899359 wait complete. 2024-09-17T03:08:28.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.678+0000 7f5cc26b2640 1 Processor -- start 2024-09-17T03:08:28.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.678+0000 7f5cc26b2640 1 -- start start 2024-09-17T03:08:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cc26b2640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5cbc0cff70 0x7f5cbc151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cc26b2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cbc160c90 0x7f5cbc06f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cc26b2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5cbc06fb50 0x7f5cbc1577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cc26b2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5cbc0d1900 con 0x7f5cbc160c90 2024-09-17T03:08:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cc26b2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5cbc0d1780 con 0x7f5cbc06fb50 2024-09-17T03:08:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cc26b2640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5cbc0d1a80 con 0x7f5cbc0cff70 2024-09-17T03:08:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cbb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cbc160c90 0x7f5cbc06f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cbb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cbc160c90 0x7f5cbc06f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38428/0 (socket says 172.21.15.78:38428) 2024-09-17T03:08:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cbb7fe640 1 -- 172.21.15.78:0/2000335905 learned_addr learned my addr 172.21.15.78:0/2000335905 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cc0c4f640 1 --2- 172.21.15.78:0/2000335905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5cbc06fb50 0x7f5cbc1577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cbbfff640 1 --2- 172.21.15.78:0/2000335905 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5cbc0cff70 0x7f5cbc151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cbb7fe640 1 -- 172.21.15.78:0/2000335905 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5cbc0cff70 msgr2=0x7f5cbc151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cbb7fe640 1 --2- 172.21.15.78:0/2000335905 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5cbc0cff70 0x7f5cbc151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cbb7fe640 1 -- 172.21.15.78:0/2000335905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5cbc06fb50 msgr2=0x7f5cbc1577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cbb7fe640 1 --2- 172.21.15.78:0/2000335905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5cbc06fb50 0x7f5cbc1577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cbb7fe640 1 -- 172.21.15.78:0/2000335905 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cbc0b2e70 con 0x7f5cbc160c90 2024-09-17T03:08:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cbb7fe640 1 --2- 172.21.15.78:0/2000335905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cbc160c90 0x7f5cbc06f610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000c3c0 tx=0x7f5cb000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cb8ff9640 1 -- 172.21.15.78:0/2000335905 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0017070 con 0x7f5cbc160c90 2024-09-17T03:08:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cb8ff9640 1 -- 172.21.15.78:0/2000335905 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5cb00035f0 con 0x7f5cbc160c90 2024-09-17T03:08:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cc26b2640 1 -- 172.21.15.78:0/2000335905 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cbc0b3150 con 0x7f5cbc160c90 2024-09-17T03:08:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cb8ff9640 1 -- 172.21.15.78:0/2000335905 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0003a40 con 0x7f5cbc160c90 2024-09-17T03:08:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.680+0000 7f5cc26b2640 1 -- 172.21.15.78:0/2000335905 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cbc0b3710 con 0x7f5cbc160c90 2024-09-17T03:08:28.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.681+0000 7f5cc26b2640 1 -- 172.21.15.78:0/2000335905 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cbc15c830 con 0x7f5cbc160c90 2024-09-17T03:08:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.682+0000 7f5cb8ff9640 1 -- 172.21.15.78:0/2000335905 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5cb001a070 con 0x7f5cbc160c90 2024-09-17T03:08:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.682+0000 7f5cb8ff9640 1 --2- 172.21.15.78:0/2000335905 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5ca8078bc0 0x7f5ca807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.683+0000 7f5cb8ff9640 1 -- 172.21.15.78:0/2000335905 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5cb0099fe0 con 0x7f5cbc160c90 2024-09-17T03:08:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.683+0000 7f5cbbfff640 1 --2- 172.21.15.78:0/2000335905 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5ca8078bc0 0x7f5ca807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.683+0000 7f5cbbfff640 1 --2- 172.21.15.78:0/2000335905 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5ca8078bc0 0x7f5ca807b0d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5cac033000 tx=0x7f5cac004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:28.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.687+0000 7f5cb8ff9640 1 -- 172.21.15.78:0/2000335905 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5cb0061d50 con 0x7f5cbc160c90 2024-09-17T03:08:28.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.861+0000 7f5cc26b2640 1 -- 172.21.15.78:0/2000335905 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5cbc1528b0 con 0x7f5cbc160c90 2024-09-17T03:08:28.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.862+0000 7f5cb8ff9640 1 -- 172.21.15.78:0/2000335905 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16654 (secure 0 0 0) 0x7f5cb0066780 con 0x7f5cbc160c90 2024-09-17T03:08:28.861 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:28.862 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:08:27.583977+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:08:25.448752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:08:26.544015+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:08:28.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.865+0000 7f5cc26b2640 1 -- 172.21.15.78:0/2000335905 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5ca8078bc0 msgr2=0x7f5ca807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:28.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.865+0000 7f5cc26b2640 1 --2- 172.21.15.78:0/2000335905 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5ca8078bc0 0x7f5ca807b0d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5cac033000 tx=0x7f5cac004730 comp rx=0 tx=0).stop 2024-09-17T03:08:28.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.865+0000 7f5cc26b2640 1 -- 172.21.15.78:0/2000335905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cbc160c90 msgr2=0x7f5cbc06f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:28.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.865+0000 7f5cc26b2640 1 --2- 172.21.15.78:0/2000335905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cbc160c90 0x7f5cbc06f610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000c3c0 tx=0x7f5cb000c880 comp rx=0 tx=0).stop 2024-09-17T03:08:28.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.865+0000 7f5cc26b2640 1 -- 172.21.15.78:0/2000335905 shutdown_connections 2024-09-17T03:08:28.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.865+0000 7f5cc26b2640 1 --2- 172.21.15.78:0/2000335905 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5ca8078bc0 0x7f5ca807b0d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.865+0000 7f5cc26b2640 1 --2- 172.21.15.78:0/2000335905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5cbc06fb50 0x7f5cbc1577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.865+0000 7f5cc26b2640 1 --2- 172.21.15.78:0/2000335905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cbc160c90 0x7f5cbc06f610 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.865+0000 7f5cc26b2640 1 --2- 172.21.15.78:0/2000335905 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5cbc0cff70 0x7f5cbc151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.865+0000 7f5cc26b2640 1 -- 172.21.15.78:0/2000335905 >> 172.21.15.78:0/2000335905 conn(0x7f5cbc0cee20 msgr2=0x7f5cbc0727f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:28.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.865+0000 7f5cc26b2640 1 -- 172.21.15.78:0/2000335905 shutdown_connections 2024-09-17T03:08:28.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.865+0000 7f5cc26b2640 1 -- 172.21.15.78:0/2000335905 wait complete. 2024-09-17T03:08:28.875 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:08:28.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.991+0000 7fe74bbe6640 1 -- 172.21.15.78:0/2659822511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7440b3910 msgr2=0x7fe74406e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:28.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.991+0000 7fe74bbe6640 1 --2- 172.21.15.78:0/2659822511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7440b3910 0x7fe74406e050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe734009ca0 tx=0x7fe73402aa50 comp rx=0 tx=0).stop 2024-09-17T03:08:28.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.991+0000 7fe74bbe6640 1 -- 172.21.15.78:0/2659822511 shutdown_connections 2024-09-17T03:08:28.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.991+0000 7fe74bbe6640 1 --2- 172.21.15.78:0/2659822511 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7440b3910 0x7fe74406e050 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.991+0000 7fe74bbe6640 1 --2- 172.21.15.78:0/2659822511 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe7440b66b0 0x7fe7440b9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.991+0000 7fe74bbe6640 1 -- 172.21.15.78:0/2659822511 >> 172.21.15.78:0/2659822511 conn(0x7fe74409d830 msgr2=0x7fe7440d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:28.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.991+0000 7fe74bbe6640 1 -- 172.21.15.78:0/2659822511 shutdown_connections 2024-09-17T03:08:28.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.991+0000 7fe74bbe6640 1 -- 172.21.15.78:0/2659822511 wait complete. 2024-09-17T03:08:28.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.993+0000 7fe74bbe6640 1 Processor -- start 2024-09-17T03:08:28.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.993+0000 7fe74bbe6640 1 -- start start 2024-09-17T03:08:28.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.994+0000 7fe74bbe6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7440b3910 0x7fe744160500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:28.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.994+0000 7fe74bbe6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7440d4c30 0x7fe7441f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:28.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.994+0000 7fe74bbe6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe744159530 0x7fe74415cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:28.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.994+0000 7fe74bbe6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe74406ec20 con 0x7fe7440b3910 2024-09-17T03:08:28.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.994+0000 7fe74bbe6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe74406eaa0 con 0x7fe7440d4c30 2024-09-17T03:08:28.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.994+0000 7fe74bbe6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe74406eda0 con 0x7fe744159530 2024-09-17T03:08:28.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.994+0000 7fe749982640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7440b3910 0x7fe744160500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:28.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.994+0000 7fe749982640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7440b3910 0x7fe744160500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38432/0 (socket says 172.21.15.78:38432) 2024-09-17T03:08:28.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.994+0000 7fe749982640 1 -- 172.21.15.78:0/2301409859 learned_addr learned my addr 172.21.15.78:0/2301409859 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:28.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.994+0000 7fe749181640 1 --2- 172.21.15.78:0/2301409859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7440d4c30 0x7fe7441f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:28.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.995+0000 7fe74a183640 1 --2- 172.21.15.78:0/2301409859 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe744159530 0x7fe74415cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:28.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.995+0000 7fe749982640 1 -- 172.21.15.78:0/2301409859 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe744159530 msgr2=0x7fe74415cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:28.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.995+0000 7fe749982640 1 --2- 172.21.15.78:0/2301409859 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe744159530 0x7fe74415cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.995+0000 7fe749982640 1 -- 172.21.15.78:0/2301409859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7440d4c30 msgr2=0x7fe7441f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:28.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.995+0000 7fe749982640 1 --2- 172.21.15.78:0/2301409859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7440d4c30 0x7fe7441f58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:28.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.995+0000 7fe749982640 1 -- 172.21.15.78:0/2301409859 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74415c7a0 con 0x7fe7440b3910 2024-09-17T03:08:28.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.995+0000 7fe749982640 1 --2- 172.21.15.78:0/2301409859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7440b3910 0x7fe744160500 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00b410 tx=0x7fe73c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:28.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.995+0000 7fe7427fc640 1 -- 172.21.15.78:0/2301409859 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73c015020 con 0x7fe7440b3910 2024-09-17T03:08:28.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.995+0000 7fe7427fc640 1 -- 172.21.15.78:0/2301409859 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe73c011920 con 0x7fe7440b3910 2024-09-17T03:08:28.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.995+0000 7fe74bbe6640 1 -- 172.21.15.78:0/2301409859 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7441f63a0 con 0x7fe7440b3910 2024-09-17T03:08:28.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.995+0000 7fe7427fc640 1 -- 172.21.15.78:0/2301409859 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73c011d70 con 0x7fe7440b3910 2024-09-17T03:08:28.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.995+0000 7fe74bbe6640 1 -- 172.21.15.78:0/2301409859 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7441f5e20 con 0x7fe7440b3910 2024-09-17T03:08:28.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.996+0000 7fe74bbe6640 1 -- 172.21.15.78:0/2301409859 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe74415c5d0 con 0x7fe7440b3910 2024-09-17T03:08:28.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.997+0000 7fe7427fc640 1 -- 172.21.15.78:0/2301409859 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe73c018020 con 0x7fe7440b3910 2024-09-17T03:08:28.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.997+0000 7fe7427fc640 1 --2- 172.21.15.78:0/2301409859 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe730078b90 0x7fe73007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:28.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.997+0000 7fe7427fc640 1 -- 172.21.15.78:0/2301409859 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe73c09aad0 con 0x7fe7440b3910 2024-09-17T03:08:28.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.997+0000 7fe749181640 1 --2- 172.21.15.78:0/2301409859 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe730078b90 0x7fe73007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:28.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:28.998+0000 7fe749181640 1 --2- 172.21.15.78:0/2301409859 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe730078b90 0x7fe73007b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe74406f400 tx=0x7fe7380090e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:29.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.002+0000 7fe7427fc640 1 -- 172.21.15.78:0/2301409859 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe73c062f10 con 0x7fe7440b3910 2024-09-17T03:08:29.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.213+0000 7fe74bbe6640 1 -- 172.21.15.78:0/2301409859 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe74406e050 con 0x7fe7440b3910 2024-09-17T03:08:29.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.243+0000 7fe7427fc640 1 -- 172.21.15.78:0/2301409859 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7fe73c062810 con 0x7fe7440b3910 2024-09-17T03:08:29.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.245+0000 7fe74bbe6640 1 -- 172.21.15.78:0/2301409859 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe730078b90 msgr2=0x7fe73007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:29.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.245+0000 7fe74bbe6640 1 --2- 172.21.15.78:0/2301409859 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe730078b90 0x7fe73007b0a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe74406f400 tx=0x7fe7380090e0 comp rx=0 tx=0).stop 2024-09-17T03:08:29.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.245+0000 7fe74bbe6640 1 -- 172.21.15.78:0/2301409859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7440b3910 msgr2=0x7fe744160500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:29.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.245+0000 7fe74bbe6640 1 --2- 172.21.15.78:0/2301409859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7440b3910 0x7fe744160500 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00b410 tx=0x7fe73c00b8d0 comp rx=0 tx=0).stop 2024-09-17T03:08:29.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.245+0000 7fe74bbe6640 1 -- 172.21.15.78:0/2301409859 shutdown_connections 2024-09-17T03:08:29.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.245+0000 7fe74bbe6640 1 --2- 172.21.15.78:0/2301409859 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe744159530 0x7fe74415cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:29.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.245+0000 7fe74bbe6640 1 --2- 172.21.15.78:0/2301409859 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe730078b90 0x7fe73007b0a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:29.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.245+0000 7fe74bbe6640 1 --2- 172.21.15.78:0/2301409859 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7440d4c30 0x7fe7441f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:29.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.245+0000 7fe74bbe6640 1 --2- 172.21.15.78:0/2301409859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7440b3910 0x7fe744160500 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:29.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.245+0000 7fe74bbe6640 1 -- 172.21.15.78:0/2301409859 >> 172.21.15.78:0/2301409859 conn(0x7fe74409d830 msgr2=0x7fe7440b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:29.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.245+0000 7fe74bbe6640 1 -- 172.21.15.78:0/2301409859 shutdown_connections 2024-09-17T03:08:29.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.245+0000 7fe74bbe6640 1 -- 172.21.15.78:0/2301409859 wait complete. 2024-09-17T03:08:29.255 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:08:29.255 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:08:29.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.371+0000 7fc0660b6640 1 -- 172.21.15.78:0/4203691239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0600cec50 msgr2=0x7fc0600cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:29.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.371+0000 7fc0660b6640 1 --2- 172.21.15.78:0/4203691239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0600cec50 0x7fc0600cf060 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc058005fd0 tx=0x7fc05802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:08:29.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.371+0000 7fc0660b6640 1 -- 172.21.15.78:0/4203691239 shutdown_connections 2024-09-17T03:08:29.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.371+0000 7fc0660b6640 1 --2- 172.21.15.78:0/4203691239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0600cec50 0x7fc0600cf060 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:29.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.371+0000 7fc0660b6640 1 --2- 172.21.15.78:0/4203691239 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc0600ccb70 0x7fc060156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:29.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.371+0000 7fc0660b6640 1 -- 172.21.15.78:0/4203691239 >> 172.21.15.78:0/4203691239 conn(0x7fc06006d4f0 msgr2=0x7fc060071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:29.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.371+0000 7fc0660b6640 1 -- 172.21.15.78:0/4203691239 shutdown_connections 2024-09-17T03:08:29.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.371+0000 7fc0660b6640 1 -- 172.21.15.78:0/4203691239 wait complete. 2024-09-17T03:08:29.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.372+0000 7fc0660b6640 1 Processor -- start 2024-09-17T03:08:29.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.373+0000 7fc0660b6640 1 -- start start 2024-09-17T03:08:29.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.374+0000 7fc0660b6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc0600ccb70 0x7fc060158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:29.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.374+0000 7fc0660b6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0600cec50 0x7fc0600b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:29.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.374+0000 7fc0660b6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc060161020 0x7fc0600b5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:29.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.374+0000 7fc0660b6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc0600d08c0 con 0x7fc0600cec50 2024-09-17T03:08:29.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.374+0000 7fc0660b6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc0600d0740 con 0x7fc060161020 2024-09-17T03:08:29.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.374+0000 7fc0660b6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc0600d0a40 con 0x7fc0600ccb70 2024-09-17T03:08:29.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.374+0000 7fc05effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0600cec50 0x7fc0600b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:29.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.374+0000 7fc05effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0600cec50 0x7fc0600b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38454/0 (socket says 172.21.15.78:38454) 2024-09-17T03:08:29.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.374+0000 7fc05effd640 1 -- 172.21.15.78:0/65739071 learned_addr learned my addr 172.21.15.78:0/65739071 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:29.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.374+0000 7fc05ffff640 1 --2- 172.21.15.78:0/65739071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc060161020 0x7fc0600b5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:29.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.374+0000 7fc05f7fe640 1 --2- 172.21.15.78:0/65739071 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc0600ccb70 0x7fc060158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:29.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.374+0000 7fc05effd640 1 -- 172.21.15.78:0/65739071 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc0600ccb70 msgr2=0x7fc060158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:29.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.374+0000 7fc05effd640 1 --2- 172.21.15.78:0/65739071 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc0600ccb70 0x7fc060158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:29.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.374+0000 7fc05effd640 1 -- 172.21.15.78:0/65739071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc060161020 msgr2=0x7fc0600b5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:29.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.374+0000 7fc05effd640 1 --2- 172.21.15.78:0/65739071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc060161020 0x7fc0600b5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:29.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.374+0000 7fc05effd640 1 -- 172.21.15.78:0/65739071 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc060158e40 con 0x7fc0600cec50 2024-09-17T03:08:29.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.374+0000 7fc05ffff640 1 --2- 172.21.15.78:0/65739071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc060161020 0x7fc0600b5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:08:29.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.374+0000 7fc05effd640 1 --2- 172.21.15.78:0/65739071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0600cec50 0x7fc0600b4100 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc05400d720 tx=0x7fc05400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:29.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.375+0000 7fc047fff640 1 -- 172.21.15.78:0/65739071 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054017070 con 0x7fc0600cec50 2024-09-17T03:08:29.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.375+0000 7fc047fff640 1 -- 172.21.15.78:0/65739071 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc054004310 con 0x7fc0600cec50 2024-09-17T03:08:29.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.375+0000 7fc0660b6640 1 -- 172.21.15.78:0/65739071 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc060159110 con 0x7fc0600cec50 2024-09-17T03:08:29.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.375+0000 7fc047fff640 1 -- 172.21.15.78:0/65739071 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc054009c30 con 0x7fc0600cec50 2024-09-17T03:08:29.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.375+0000 7fc0660b6640 1 -- 172.21.15.78:0/65739071 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0601596d0 con 0x7fc0600cec50 2024-09-17T03:08:29.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.376+0000 7fc0660b6640 1 -- 172.21.15.78:0/65739071 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc060072580 con 0x7fc0600cec50 2024-09-17T03:08:29.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.376+0000 7fc047fff640 1 -- 172.21.15.78:0/65739071 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc054005020 con 0x7fc0600cec50 2024-09-17T03:08:29.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.377+0000 7fc047fff640 1 --2- 172.21.15.78:0/65739071 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc04c078b90 0x7fc04c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:29.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.377+0000 7fc047fff640 1 -- 172.21.15.78:0/65739071 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc05409b1b0 con 0x7fc0600cec50 2024-09-17T03:08:29.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.377+0000 7fc05f7fe640 1 --2- 172.21.15.78:0/65739071 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc04c078b90 0x7fc04c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:29.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.378+0000 7fc05f7fe640 1 --2- 172.21.15.78:0/65739071 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc04c078b90 0x7fc04c07b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc050001610 tx=0x7fc050009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:29.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.382+0000 7fc047fff640 1 -- 172.21.15.78:0/65739071 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc060072580 con 0x7fc0600cec50 2024-09-17T03:08:29.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:29.591+0000 7fc0660b6640 1 -- 172.21.15.78:0/65739071 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc06015b8d0 con 0x7fc0600cec50 2024-09-17T03:08:30.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.250+0000 7fc047fff640 1 -- 172.21.15.78:0/65739071 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7fc054020020 con 0x7fc0600cec50 2024-09-17T03:08:30.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.253+0000 7fc0660b6640 1 -- 172.21.15.78:0/65739071 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc04c078b90 msgr2=0x7fc04c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:30.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.253+0000 7fc0660b6640 1 --2- 172.21.15.78:0/65739071 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc04c078b90 0x7fc04c07b0a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc050001610 tx=0x7fc050009040 comp rx=0 tx=0).stop 2024-09-17T03:08:30.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.253+0000 7fc0660b6640 1 -- 172.21.15.78:0/65739071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0600cec50 msgr2=0x7fc0600b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:30.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.253+0000 7fc0660b6640 1 --2- 172.21.15.78:0/65739071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0600cec50 0x7fc0600b4100 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc05400d720 tx=0x7fc05400dbe0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.253+0000 7fc0660b6640 1 -- 172.21.15.78:0/65739071 shutdown_connections 2024-09-17T03:08:30.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.253+0000 7fc0660b6640 1 --2- 172.21.15.78:0/65739071 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc04c078b90 0x7fc04c07b0a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.253+0000 7fc0660b6640 1 --2- 172.21.15.78:0/65739071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc060161020 0x7fc0600b5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.253+0000 7fc0660b6640 1 --2- 172.21.15.78:0/65739071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0600cec50 0x7fc0600b4100 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.253+0000 7fc0660b6640 1 --2- 172.21.15.78:0/65739071 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc0600ccb70 0x7fc060158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.253+0000 7fc0660b6640 1 -- 172.21.15.78:0/65739071 >> 172.21.15.78:0/65739071 conn(0x7fc06006d4f0 msgr2=0x7fc06015ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:30.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.253+0000 7fc0660b6640 1 -- 172.21.15.78:0/65739071 shutdown_connections 2024-09-17T03:08:30.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.253+0000 7fc0660b6640 1 -- 172.21.15.78:0/65739071 wait complete. 2024-09-17T03:08:30.265 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:08:30.265 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:08:30.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.384+0000 7f0010020640 1 -- 172.21.15.78:0/56551593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efff0003a30 msgr2=0x7efff0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.384+0000 7f0010020640 1 --2- 172.21.15.78:0/56551593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efff0003a30 0x7efff0003ea0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efff8009ed0 tx=0x7efff0005830 comp rx=0 tx=0).stop 2024-09-17T03:08:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.385+0000 7f000e5bd640 1 -- 172.21.15.78:0/56551593 reap_dead start 2024-09-17T03:08:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.385+0000 7f0010020640 1 -- 172.21.15.78:0/56551593 shutdown_connections 2024-09-17T03:08:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.385+0000 7f0010020640 1 -- 172.21.15.78:0/56551593 >> 172.21.15.78:0/56551593 conn(0x7f000806def0 msgr2=0x7f000806e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.385+0000 7f0010020640 1 -- 172.21.15.78:0/56551593 shutdown_connections 2024-09-17T03:08:30.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.385+0000 7f0010020640 1 -- 172.21.15.78:0/56551593 wait complete. 2024-09-17T03:08:30.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.386+0000 7f0010020640 1 Processor -- start 2024-09-17T03:08:30.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.386+0000 7f0010020640 1 -- start start 2024-09-17T03:08:30.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f0010020640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efff0003a30 0x7f000815f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:30.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f0010020640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f000815e240 0x7f000815e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:30.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f0010020640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00081f20d0 0x7f00081f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f0010020640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f00080d0cd0 con 0x7f00081f20d0 2024-09-17T03:08:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f0010020640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f00080d0b50 con 0x7efff0003a30 2024-09-17T03:08:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f0010020640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f00080d0e50 con 0x7f000815e240 2024-09-17T03:08:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f000e5bd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00081f20d0 0x7f00081f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f000e5bd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00081f20d0 0x7f00081f24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38482/0 (socket says 172.21.15.78:38482) 2024-09-17T03:08:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f000e5bd640 1 -- 172.21.15.78:0/296775244 learned_addr learned my addr 172.21.15.78:0/296775244 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:30.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f000ddbc640 1 --2- 172.21.15.78:0/296775244 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efff0003a30 0x7f000815f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f000d5bb640 1 --2- 172.21.15.78:0/296775244 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f000815e240 0x7f000815e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f000e5bd640 1 -- 172.21.15.78:0/296775244 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f000815e240 msgr2=0x7f000815e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f000e5bd640 1 --2- 172.21.15.78:0/296775244 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f000815e240 0x7f000815e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f000e5bd640 1 -- 172.21.15.78:0/296775244 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efff0003a30 msgr2=0x7f000815f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f000e5bd640 1 --2- 172.21.15.78:0/296775244 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efff0003a30 0x7f000815f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f000e5bd640 1 -- 172.21.15.78:0/296775244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00080cbc60 con 0x7f00081f20d0 2024-09-17T03:08:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f000e5bd640 1 --2- 172.21.15.78:0/296775244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00081f20d0 0x7f00081f24e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0008146540 tx=0x7f0000001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f00067fc640 1 -- 172.21.15.78:0/296775244 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0000011630 con 0x7f00081f20d0 2024-09-17T03:08:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f00067fc640 1 -- 172.21.15.78:0/296775244 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00000117d0 con 0x7f00081f20d0 2024-09-17T03:08:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f00067fc640 1 -- 172.21.15.78:0/296775244 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0000011c20 con 0x7f00081f20d0 2024-09-17T03:08:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.388+0000 7f0010020640 1 -- 172.21.15.78:0/296775244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00080cbf40 con 0x7f00081f20d0 2024-09-17T03:08:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.389+0000 7f0010020640 1 -- 172.21.15.78:0/296775244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00080cc500 con 0x7f00081f20d0 2024-09-17T03:08:30.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.389+0000 7f0010020640 1 -- 172.21.15.78:0/296775244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00080cb760 con 0x7f00081f20d0 2024-09-17T03:08:30.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.390+0000 7f00067fc640 1 -- 172.21.15.78:0/296775244 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f000001d470 con 0x7f00081f20d0 2024-09-17T03:08:30.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.391+0000 7f00067fc640 1 --2- 172.21.15.78:0/296775244 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efff4078b90 0x7efff407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:30.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.391+0000 7f00067fc640 1 -- 172.21.15.78:0/296775244 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f000009b250 con 0x7f00081f20d0 2024-09-17T03:08:30.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.391+0000 7f000ddbc640 1 --2- 172.21.15.78:0/296775244 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efff4078b90 0x7efff407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:30.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.391+0000 7f000ddbc640 1 --2- 172.21.15.78:0/296775244 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efff4078b90 0x7efff407b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efff8035000 tx=0x7efff802d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:30.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.395+0000 7f00067fc640 1 -- 172.21.15.78:0/296775244 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0000063040 con 0x7f00081f20d0 2024-09-17T03:08:30.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.605+0000 7f0010020640 1 -- 172.21.15.78:0/296775244 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00080cb9f0 con 0x7f00081f20d0 2024-09-17T03:08:30.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.605+0000 7f00067fc640 1 -- 172.21.15.78:0/296775244 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5220 (secure 0 0 0) 0x7f0000067a70 con 0x7f00081f20d0 2024-09-17T03:08:30.604 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:30.605 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":6,"btime":"2024-09-17T03:08:30:244213+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/3111681444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3111681444},{"type":"v1","addr":"172.21.15.78:6833","nonce":3111681444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1920750629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1920750629},{"type":"v1","addr":"172.21.15.193:6836","nonce":1920750629}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4416,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2220463802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2220463802},{"type":"v1","addr":"172.21.15.78:6835","nonce":2220463802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:08:27.583934+0000","modified":"2024-09-17T03:08:29.592351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4425},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4425":{"gid":4425,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6837/934698838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":934698838},{"type":"v1","addr":"172.21.15.193:6837","nonce":934698838}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4425,"qdb_cluster":[4425]},"id":1}]} 2024-09-17T03:08:30.605 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 6 2024-09-17T03:08:30.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.607+0000 7f0010020640 1 -- 172.21.15.78:0/296775244 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efff4078b90 msgr2=0x7efff407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:30.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.607+0000 7f0010020640 1 --2- 172.21.15.78:0/296775244 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efff4078b90 0x7efff407b0a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efff8035000 tx=0x7efff802d040 comp rx=0 tx=0).stop 2024-09-17T03:08:30.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.607+0000 7f0010020640 1 -- 172.21.15.78:0/296775244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00081f20d0 msgr2=0x7f00081f24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:30.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.607+0000 7f0010020640 1 --2- 172.21.15.78:0/296775244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00081f20d0 0x7f00081f24e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0008146540 tx=0x7f0000001630 comp rx=0 tx=0).stop 2024-09-17T03:08:30.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.608+0000 7f0010020640 1 -- 172.21.15.78:0/296775244 shutdown_connections 2024-09-17T03:08:30.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.608+0000 7f0010020640 1 --2- 172.21.15.78:0/296775244 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00081f20d0 0x7f00081f24e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.608+0000 7f0010020640 1 --2- 172.21.15.78:0/296775244 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f000815e240 0x7f000815e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.608+0000 7f0010020640 1 --2- 172.21.15.78:0/296775244 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efff4078b90 0x7efff407b0a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.608+0000 7f0010020640 1 --2- 172.21.15.78:0/296775244 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efff0003a30 0x7f000815f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.608+0000 7f0010020640 1 -- 172.21.15.78:0/296775244 >> 172.21.15.78:0/296775244 conn(0x7f000806def0 msgr2=0x7f00080d15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:30.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.608+0000 7f0010020640 1 -- 172.21.15.78:0/296775244 shutdown_connections 2024-09-17T03:08:30.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.608+0000 7f0010020640 1 -- 172.21.15.78:0/296775244 wait complete. 2024-09-17T03:08:30.617 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:08:30.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.730+0000 7f59d6fb0640 1 -- 172.21.15.78:0/1236992808 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59d0155ce0 msgr2=0x7f59d00b45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:30.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.730+0000 7f59d6fb0640 1 --2- 172.21.15.78:0/1236992808 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59d0155ce0 0x7f59d00b45a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f59c8005fd0 tx=0x7f59c802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.730+0000 7f59d6fb0640 1 -- 172.21.15.78:0/1236992808 shutdown_connections 2024-09-17T03:08:30.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.730+0000 7f59d6fb0640 1 --2- 172.21.15.78:0/1236992808 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59d0155ce0 0x7f59d00b45a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.730+0000 7f59d6fb0640 1 --2- 172.21.15.78:0/1236992808 >> v2:172.21.15.193:3300/0 conn(0x7f59d015c580 0x7f59d0070540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.730+0000 7f59d6fb0640 1 -- 172.21.15.78:0/1236992808 >> 172.21.15.78:0/1236992808 conn(0x7f59d006def0 msgr2=0x7f59d006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:30.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.730+0000 7f59d6fb0640 1 -- 172.21.15.78:0/1236992808 shutdown_connections 2024-09-17T03:08:30.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.730+0000 7f59d6fb0640 1 -- 172.21.15.78:0/1236992808 wait complete. 2024-09-17T03:08:30.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.732+0000 7f59d6fb0640 1 Processor -- start 2024-09-17T03:08:30.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.732+0000 7f59d6fb0640 1 -- start start 2024-09-17T03:08:30.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.733+0000 7f59d6fb0640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59d0074420 0x7f59d00cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:30.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.733+0000 7f59d6fb0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59d0155ce0 0x7f59d01f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:30.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.733+0000 7f59d6fb0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d01f3590 0x7f59d01e7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:30.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.733+0000 7f59d6fb0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f59d00b5090 con 0x7f59d01f3590 2024-09-17T03:08:30.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.733+0000 7f59d6fb0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f59d00b4f10 con 0x7f59d0155ce0 2024-09-17T03:08:30.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.733+0000 7f59d6fb0640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f59d00b5210 con 0x7f59d0074420 2024-09-17T03:08:30.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.733+0000 7f59d554d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d01f3590 0x7f59d01e7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:30.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.733+0000 7f59d554d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d01f3590 0x7f59d01e7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38486/0 (socket says 172.21.15.78:38486) 2024-09-17T03:08:30.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.733+0000 7f59d554d640 1 -- 172.21.15.78:0/3620068278 learned_addr learned my addr 172.21.15.78:0/3620068278 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:30.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.734+0000 7f59cffff640 1 --2- 172.21.15.78:0/3620068278 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59d0155ce0 0x7f59d01f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:30.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.734+0000 7f59d4d4c640 1 --2- 172.21.15.78:0/3620068278 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59d0074420 0x7f59d00cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:30.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.734+0000 7f59d554d640 1 -- 172.21.15.78:0/3620068278 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59d0074420 msgr2=0x7f59d00cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:30.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.734+0000 7f59d554d640 1 --2- 172.21.15.78:0/3620068278 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59d0074420 0x7f59d00cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.734+0000 7f59d554d640 1 -- 172.21.15.78:0/3620068278 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59d0155ce0 msgr2=0x7f59d01f3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:30.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.734+0000 7f59d554d640 1 --2- 172.21.15.78:0/3620068278 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59d0155ce0 0x7f59d01f3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.734+0000 7f59d554d640 1 -- 172.21.15.78:0/3620068278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d01f3d40 con 0x7f59d01f3590 2024-09-17T03:08:30.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.734+0000 7f59cffff640 1 --2- 172.21.15.78:0/3620068278 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59d0155ce0 0x7f59d01f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:08:30.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.734+0000 7f59d554d640 1 --2- 172.21.15.78:0/3620068278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d01f3590 0x7f59d01e7f30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f59c8034040 tx=0x7f59c80035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:30.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.734+0000 7f59cd7fa640 1 -- 172.21.15.78:0/3620068278 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c803e030 con 0x7f59d01f3590 2024-09-17T03:08:30.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.734+0000 7f59cd7fa640 1 -- 172.21.15.78:0/3620068278 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59c8003ae0 con 0x7f59d01f3590 2024-09-17T03:08:30.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.734+0000 7f59cd7fa640 1 -- 172.21.15.78:0/3620068278 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c8035040 con 0x7f59d01f3590 2024-09-17T03:08:30.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.734+0000 7f59d6fb0640 1 -- 172.21.15.78:0/3620068278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d01f4320 con 0x7f59d01f3590 2024-09-17T03:08:30.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.734+0000 7f59d6fb0640 1 -- 172.21.15.78:0/3620068278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d01f48e0 con 0x7f59d01f3590 2024-09-17T03:08:30.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.735+0000 7f59d6fb0640 1 -- 172.21.15.78:0/3620068278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d01f3ab0 con 0x7f59d01f3590 2024-09-17T03:08:30.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.736+0000 7f59cd7fa640 1 -- 172.21.15.78:0/3620068278 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f59c8041030 con 0x7f59d01f3590 2024-09-17T03:08:30.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.736+0000 7f59cd7fa640 1 --2- 172.21.15.78:0/3620068278 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f59bc078b90 0x7f59bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:30.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.736+0000 7f59cd7fa640 1 -- 172.21.15.78:0/3620068278 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f59c80bb380 con 0x7f59d01f3590 2024-09-17T03:08:30.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.737+0000 7f59d4d4c640 1 --2- 172.21.15.78:0/3620068278 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f59bc078b90 0x7f59bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:30.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.737+0000 7f59d4d4c640 1 --2- 172.21.15.78:0/3620068278 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f59bc078b90 0x7f59bc07b0a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f59c00015e0 tx=0x7f59c0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:30.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.741+0000 7f59cd7fa640 1 -- 172.21.15.78:0/3620068278 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f59c8083740 con 0x7f59d01f3590 2024-09-17T03:08:30.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.916+0000 7f59d6fb0640 1 -- 172.21.15.78:0/3620068278 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59d00b5730 con 0x7f59d01f3590 2024-09-17T03:08:30.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.917+0000 7f59cd7fa640 1 -- 172.21.15.78:0/3620068278 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16641 (secure 0 0 0) 0x7f59c8083040 con 0x7f59d01f3590 2024-09-17T03:08:30.916 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:30.917 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:08:29.222925+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:08:25.448752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:08:26.544015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:08:30.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.919+0000 7f59d6fb0640 1 -- 172.21.15.78:0/3620068278 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f59bc078b90 msgr2=0x7f59bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:30.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.919+0000 7f59d6fb0640 1 --2- 172.21.15.78:0/3620068278 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f59bc078b90 0x7f59bc07b0a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f59c00015e0 tx=0x7f59c0009040 comp rx=0 tx=0).stop 2024-09-17T03:08:30.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.919+0000 7f59d6fb0640 1 -- 172.21.15.78:0/3620068278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d01f3590 msgr2=0x7f59d01e7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:30.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.919+0000 7f59d6fb0640 1 --2- 172.21.15.78:0/3620068278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d01f3590 0x7f59d01e7f30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f59c8034040 tx=0x7f59c80035f0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.920+0000 7f59d6fb0640 1 -- 172.21.15.78:0/3620068278 shutdown_connections 2024-09-17T03:08:30.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.920+0000 7f59d6fb0640 1 --2- 172.21.15.78:0/3620068278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d01f3590 0x7f59d01e7f30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.920+0000 7f59d6fb0640 1 --2- 172.21.15.78:0/3620068278 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f59bc078b90 0x7f59bc07b0a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.920+0000 7f59d6fb0640 1 --2- 172.21.15.78:0/3620068278 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59d0155ce0 0x7f59d01f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.920+0000 7f59d6fb0640 1 --2- 172.21.15.78:0/3620068278 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59d0074420 0x7f59d00cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:30.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.920+0000 7f59d6fb0640 1 -- 172.21.15.78:0/3620068278 >> 172.21.15.78:0/3620068278 conn(0x7f59d006def0 msgr2=0x7f59d006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:30.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.920+0000 7f59d6fb0640 1 -- 172.21.15.78:0/3620068278 shutdown_connections 2024-09-17T03:08:30.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:30.920+0000 7f59d6fb0640 1 -- 172.21.15.78:0/3620068278 wait complete. 2024-09-17T03:08:30.930 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:08:30.930 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:08:31.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.043+0000 7f81bf807640 1 -- 172.21.15.78:0/2670205444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a4005350 msgr2=0x7f81a400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:31.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.043+0000 7f81bf807640 1 --2- 172.21.15.78:0/2670205444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a4005350 0x7f81a400b9c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f81b000c610 tx=0x7f81a4005830 comp rx=0 tx=0).stop 2024-09-17T03:08:31.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.043+0000 7f81bf807640 1 -- 172.21.15.78:0/2670205444 shutdown_connections 2024-09-17T03:08:31.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.043+0000 7f81bf807640 1 --2- 172.21.15.78:0/2670205444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a4005350 0x7f81a400b9c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.043+0000 7f81bf807640 1 -- 172.21.15.78:0/2670205444 >> 172.21.15.78:0/2670205444 conn(0x7f81b80cee20 msgr2=0x7f81b80cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:31.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.043+0000 7f81bf807640 1 -- 172.21.15.78:0/2670205444 shutdown_connections 2024-09-17T03:08:31.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.043+0000 7f81bf807640 1 -- 172.21.15.78:0/2670205444 wait complete. 2024-09-17T03:08:31.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.045+0000 7f81bf807640 1 Processor -- start 2024-09-17T03:08:31.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.045+0000 7f81bf807640 1 -- start start 2024-09-17T03:08:31.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.046+0000 7f81bf807640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a4005350 0x7f81b81f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:31.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.046+0000 7f81bf807640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81b80cbb40 0x7f81b80cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:31.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.046+0000 7f81bf807640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81b81563e0 0x7f81b81567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:31.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.046+0000 7f81bf807640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f81b80b3e20 con 0x7f81a4005350 2024-09-17T03:08:31.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.046+0000 7f81bf807640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f81b815cc00 con 0x7f81b80cbb40 2024-09-17T03:08:31.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.046+0000 7f81bf807640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f81b80b3fa0 con 0x7f81b81563e0 2024-09-17T03:08:31.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.046+0000 7f81bd5a3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a4005350 0x7f81b81f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:31.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.046+0000 7f81bd5a3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a4005350 0x7f81b81f3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38504/0 (socket says 172.21.15.78:38504) 2024-09-17T03:08:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.046+0000 7f81bd5a3640 1 -- 172.21.15.78:0/2414873308 learned_addr learned my addr 172.21.15.78:0/2414873308 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.047+0000 7f81bcda2640 1 --2- 172.21.15.78:0/2414873308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81b80cbb40 0x7f81b80cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.047+0000 7f81bdda4640 1 --2- 172.21.15.78:0/2414873308 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81b81563e0 0x7f81b81567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.047+0000 7f81bd5a3640 1 -- 172.21.15.78:0/2414873308 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81b81563e0 msgr2=0x7f81b81567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.047+0000 7f81bd5a3640 1 --2- 172.21.15.78:0/2414873308 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81b81563e0 0x7f81b81567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.047+0000 7f81bd5a3640 1 -- 172.21.15.78:0/2414873308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81b80cbb40 msgr2=0x7f81b80cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.047+0000 7f81bd5a3640 1 --2- 172.21.15.78:0/2414873308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81b80cbb40 0x7f81b80cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.047+0000 7f81bd5a3640 1 -- 172.21.15.78:0/2414873308 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b81f4210 con 0x7f81a4005350 2024-09-17T03:08:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.047+0000 7f81bdda4640 1 --2- 172.21.15.78:0/2414873308 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81b81563e0 0x7f81b81567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:08:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.047+0000 7f81bd5a3640 1 --2- 172.21.15.78:0/2414873308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a4005350 0x7f81b81f3cd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f81a8011ab0 tx=0x7f81a8011eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.047+0000 7f81adffb640 1 -- 172.21.15.78:0/2414873308 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a801e070 con 0x7f81a4005350 2024-09-17T03:08:31.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.047+0000 7f81adffb640 1 -- 172.21.15.78:0/2414873308 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81a8004460 con 0x7f81a4005350 2024-09-17T03:08:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.047+0000 7f81bf807640 1 -- 172.21.15.78:0/2414873308 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b80b1290 con 0x7f81a4005350 2024-09-17T03:08:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.047+0000 7f81adffb640 1 -- 172.21.15.78:0/2414873308 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a800fc00 con 0x7f81a4005350 2024-09-17T03:08:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.047+0000 7f81bf807640 1 -- 172.21.15.78:0/2414873308 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b81f6cf0 con 0x7f81a4005350 2024-09-17T03:08:31.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.048+0000 7f81bf807640 1 -- 172.21.15.78:0/2414873308 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81b80b4500 con 0x7f81a4005350 2024-09-17T03:08:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.049+0000 7f81adffb640 1 -- 172.21.15.78:0/2414873308 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f81a8021070 con 0x7f81a4005350 2024-09-17T03:08:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.050+0000 7f81adffb640 1 --2- 172.21.15.78:0/2414873308 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f819c078b90 0x7f819c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.050+0000 7f81adffb640 1 -- 172.21.15.78:0/2414873308 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f81a809b680 con 0x7f81a4005350 2024-09-17T03:08:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.050+0000 7f81bcda2640 1 --2- 172.21.15.78:0/2414873308 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f819c078b90 0x7f819c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:31.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.050+0000 7f81bcda2640 1 --2- 172.21.15.78:0/2414873308 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f819c078b90 0x7f819c07b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f81b80c8b10 tx=0x7f81b4006b70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:31.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.054+0000 7f81adffb640 1 -- 172.21.15.78:0/2414873308 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f81b80b1290 con 0x7f81a4005350 2024-09-17T03:08:31.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.225+0000 7f81bf807640 1 -- 172.21.15.78:0/2414873308 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81b80d1fd0 con 0x7f819c078b90 2024-09-17T03:08:31.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.230+0000 7f81adffb640 1 -- 172.21.15.78:0/2414873308 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238279 (secure 0 0 0) 0x7f81b80d1fd0 con 0x7f819c078b90 2024-09-17T03:08:31.232 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:31.234 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:08:31.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.234+0000 7f81bf807640 1 -- 172.21.15.78:0/2414873308 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f819c078b90 msgr2=0x7f819c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:31.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.234+0000 7f81bf807640 1 --2- 172.21.15.78:0/2414873308 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f819c078b90 0x7f819c07b0a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f81b80c8b10 tx=0x7f81b4006b70 comp rx=0 tx=0).stop 2024-09-17T03:08:31.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.234+0000 7f81bf807640 1 -- 172.21.15.78:0/2414873308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a4005350 msgr2=0x7f81b81f3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:31.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.234+0000 7f81bf807640 1 --2- 172.21.15.78:0/2414873308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a4005350 0x7f81b81f3cd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f81a8011ab0 tx=0x7f81a8011eb0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.234+0000 7f81bf807640 1 -- 172.21.15.78:0/2414873308 shutdown_connections 2024-09-17T03:08:31.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.234+0000 7f81bf807640 1 --2- 172.21.15.78:0/2414873308 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81b81563e0 0x7f81b81567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.234+0000 7f81bf807640 1 --2- 172.21.15.78:0/2414873308 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f819c078b90 0x7f819c07b0a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.234+0000 7f81bf807640 1 --2- 172.21.15.78:0/2414873308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81b80cbb40 0x7f81b80cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.234+0000 7f81bf807640 1 --2- 172.21.15.78:0/2414873308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a4005350 0x7f81b81f3cd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.234+0000 7f81bf807640 1 -- 172.21.15.78:0/2414873308 >> 172.21.15.78:0/2414873308 conn(0x7f81b80cee20 msgr2=0x7f81b80b51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:31.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.234+0000 7f81bf807640 1 -- 172.21.15.78:0/2414873308 shutdown_connections 2024-09-17T03:08:31.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.234+0000 7f81bf807640 1 -- 172.21.15.78:0/2414873308 wait complete. 2024-09-17T03:08:31.243 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T03:08:31.118535+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":30,"acting":30,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":223536,"kb_used_data":2624,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751184,"statfs":{"total":773094113280,"available":772865212416,"internally_reserved":0,"allocated":2686976,"data_stored":1648348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.905688"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.227179+0000","last_change":"2024-09-17T03:08:27.227179+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.227179+0000","last_undegraded":"2024-09-17T03:08:27.227179+0000","last_fullsized":"2024-09-17T03:08:27.227179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.226091+0000","last_change":"2024-09-17T03:08:27.226091+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.226091+0000","last_undegraded":"2024-09-17T03:08:27.226091+0000","last_fullsized":"2024-09-17T03:08:27.226091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.223978+0000","last_change":"2024-09-17T03:08:27.223978+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.223978+0000","last_undegraded":"2024-09-17T03:08:27.223978+0000","last_fullsized":"2024-09-17T03:08:27.223978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.226031+0000","last_change":"2024-09-17T03:08:27.226031+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.226031+0000","last_undegraded":"2024-09-17T03:08:27.226031+0000","last_fullsized":"2024-09-17T03:08:27.226031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225276+0000","last_change":"2024-09-17T03:08:27.225276+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225276+0000","last_undegraded":"2024-09-17T03:08:27.225276+0000","last_fullsized":"2024-09-17T03:08:27.225276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:08:27.241109+0000","last_change":"2024-09-17T03:08:27.237198+0000","last_active":"2024-09-17T03:08:27.241109+0000","last_peered":"2024-09-17T03:08:27.241109+0000","last_clean":"2024-09-17T03:08:27.241109+0000","last_became_active":"2024-09-17T03:08:27.236843+0000","last_became_peered":"2024-09-17T03:08:27.236843+0000","last_unstale":"2024-09-17T03:08:27.241109+0000","last_undegraded":"2024-09-17T03:08:27.241109+0000","last_fullsized":"2024-09-17T03:08:27.241109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:25.642380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:08:27.239741+0000","last_change":"2024-09-17T03:08:27.235234+0000","last_active":"2024-09-17T03:08:27.239741+0000","last_peered":"2024-09-17T03:08:27.239741+0000","last_clean":"2024-09-17T03:08:27.239741+0000","last_became_active":"2024-09-17T03:08:27.234619+0000","last_became_peered":"2024-09-17T03:08:27.234619+0000","last_unstale":"2024-09-17T03:08:27.239741+0000","last_undegraded":"2024-09-17T03:08:27.239741+0000","last_fullsized":"2024-09-17T03:08:27.239741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:56.777251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225405+0000","last_change":"2024-09-17T03:08:27.225405+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225405+0000","last_undegraded":"2024-09-17T03:08:27.225405+0000","last_fullsized":"2024-09-17T03:08:27.225405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":103,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T03:08:21.267742+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:08:21.267742+0000","last_peered":"2024-09-17T03:08:21.267742+0000","last_clean":"2024-09-17T03:08:21.267742+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:08:21.267742+0000","last_undegraded":"2024-09-17T03:08:21.267742+0000","last_fullsized":"2024-09-17T03:08:21.267742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225446+0000","last_change":"2024-09-17T03:08:27.225446+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225446+0000","last_undegraded":"2024-09-17T03:08:27.225446+0000","last_fullsized":"2024-09-17T03:08:27.225446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225298+0000","last_change":"2024-09-17T03:08:27.225298+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225298+0000","last_undegraded":"2024-09-17T03:08:27.225298+0000","last_fullsized":"2024-09-17T03:08:27.225298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.223967+0000","last_change":"2024-09-17T03:08:27.223967+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.223967+0000","last_undegraded":"2024-09-17T03:08:27.223967+0000","last_fullsized":"2024-09-17T03:08:27.223967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225195+0000","last_change":"2024-09-17T03:08:27.225195+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225195+0000","last_undegraded":"2024-09-17T03:08:27.225195+0000","last_fullsized":"2024-09-17T03:08:27.225195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:08:27.246026+0000","last_change":"2024-09-17T03:08:27.239362+0000","last_active":"2024-09-17T03:08:27.246026+0000","last_peered":"2024-09-17T03:08:27.246026+0000","last_clean":"2024-09-17T03:08:27.246026+0000","last_became_active":"2024-09-17T03:08:27.238941+0000","last_became_peered":"2024-09-17T03:08:27.238941+0000","last_unstale":"2024-09-17T03:08:27.246026+0000","last_undegraded":"2024-09-17T03:08:27.246026+0000","last_fullsized":"2024-09-17T03:08:27.246026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:09.060728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225748+0000","last_change":"2024-09-17T03:08:27.225748+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225748+0000","last_undegraded":"2024-09-17T03:08:27.225748+0000","last_fullsized":"2024-09-17T03:08:27.225748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":6,"acting":6,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":778240,"data_stored":647308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":778240,"data_stored":647308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":208896,"data_stored":69032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:08:31.247 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:08:31.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.397+0000 7f6aac263640 1 -- 172.21.15.78:0/3211874678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6aa40b9b60 msgr2=0x7f6aa40d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:31.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.397+0000 7f6aac263640 1 --2- 172.21.15.78:0/3211874678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6aa40b9b60 0x7f6aa40d4d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0005fd0 tx=0x7f6aa002a8f0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.397+0000 7f6aac263640 1 -- 172.21.15.78:0/3211874678 shutdown_connections 2024-09-17T03:08:31.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.397+0000 7f6aac263640 1 --2- 172.21.15.78:0/3211874678 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6aa40cf540 0x7f6aa40b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.397+0000 7f6aac263640 1 --2- 172.21.15.78:0/3211874678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6aa40b9b60 0x7f6aa40d4d80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.397+0000 7f6aac263640 1 -- 172.21.15.78:0/3211874678 >> 172.21.15.78:0/3211874678 conn(0x7f6aa409d7f0 msgr2=0x7f6aa40d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:31.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.398+0000 7f6aac263640 1 -- 172.21.15.78:0/3211874678 shutdown_connections 2024-09-17T03:08:31.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.398+0000 7f6aac263640 1 -- 172.21.15.78:0/3211874678 wait complete. 2024-09-17T03:08:31.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.399+0000 7f6aac263640 1 Processor -- start 2024-09-17T03:08:31.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.399+0000 7f6aac263640 1 -- start start 2024-09-17T03:08:31.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.400+0000 7f6aac263640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa40b64e0 0x7f6aa4160560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:31.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6aac263640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6aa40b9b60 0x7f6aa40c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:31.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6aac263640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6aa40cf540 0x7f6aa40c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:31.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6aac263640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa40d2e40 con 0x7f6aa40b64e0 2024-09-17T03:08:31.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6aac263640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6aa40d2cc0 con 0x7f6aa40b9b60 2024-09-17T03:08:31.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6aac263640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f6aa40d2fc0 con 0x7f6aa40cf540 2024-09-17T03:08:31.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6aa9fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa40b64e0 0x7f6aa4160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:31.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6aa9fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa40b64e0 0x7f6aa4160560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38510/0 (socket says 172.21.15.78:38510) 2024-09-17T03:08:31.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6aa9fff640 1 -- 172.21.15.78:0/4075574601 learned_addr learned my addr 172.21.15.78:0/4075574601 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:31.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6aa97fe640 1 --2- 172.21.15.78:0/4075574601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6aa40b9b60 0x7f6aa40c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:31.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6aaa800640 1 --2- 172.21.15.78:0/4075574601 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6aa40cf540 0x7f6aa40c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:31.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6aa9fff640 1 -- 172.21.15.78:0/4075574601 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6aa40cf540 msgr2=0x7f6aa40c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:31.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6aa9fff640 1 --2- 172.21.15.78:0/4075574601 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6aa40cf540 0x7f6aa40c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6aa9fff640 1 -- 172.21.15.78:0/4075574601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6aa40b9b60 msgr2=0x7f6aa40c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:31.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6aa9fff640 1 --2- 172.21.15.78:0/4075574601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6aa40b9b60 0x7f6aa40c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6aa9fff640 1 -- 172.21.15.78:0/4075574601 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aa40cb9b0 con 0x7f6aa40b64e0 2024-09-17T03:08:31.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6aa9fff640 1 --2- 172.21.15.78:0/4075574601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa40b64e0 0x7f6aa4160560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0006010 tx=0x7f6aa0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:31.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6a9a7fc640 1 -- 172.21.15.78:0/4075574601 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa0004d40 con 0x7f6aa40b64e0 2024-09-17T03:08:31.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6a9a7fc640 1 -- 172.21.15.78:0/4075574601 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6aa002d070 con 0x7f6aa40b64e0 2024-09-17T03:08:31.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6aac263640 1 -- 172.21.15.78:0/4075574601 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aa40cbc90 con 0x7f6aa40b64e0 2024-09-17T03:08:31.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6a9a7fc640 1 -- 172.21.15.78:0/4075574601 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa00042a0 con 0x7f6aa40b64e0 2024-09-17T03:08:31.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.401+0000 7f6aac263640 1 -- 172.21.15.78:0/4075574601 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aa40cc250 con 0x7f6aa40b64e0 2024-09-17T03:08:31.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.403+0000 7f6aac263640 1 -- 172.21.15.78:0/4075574601 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6aa40cee40 con 0x7f6aa40b64e0 2024-09-17T03:08:31.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.403+0000 7f6a9a7fc640 1 -- 172.21.15.78:0/4075574601 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6aa000c040 con 0x7f6aa40b64e0 2024-09-17T03:08:31.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.404+0000 7f6a9a7fc640 1 --2- 172.21.15.78:0/4075574601 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6a88078b90 0x7f6a8807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:31.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.404+0000 7f6a9a7fc640 1 -- 172.21.15.78:0/4075574601 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6aa00bc150 con 0x7f6aa40b64e0 2024-09-17T03:08:31.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.404+0000 7f6aa97fe640 1 --2- 172.21.15.78:0/4075574601 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6a88078b90 0x7f6a8807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:31.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.405+0000 7f6aa97fe640 1 --2- 172.21.15.78:0/4075574601 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6a88078b90 0x7f6a8807b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4159d90 tx=0x7f6a94005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.408+0000 7f6a9a7fc640 1 -- 172.21.15.78:0/4075574601 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6aa40cee40 con 0x7f6aa40b64e0 2024-09-17T03:08:31.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.577+0000 7f6aac263640 1 -- 172.21.15.78:0/4075574601 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6aa40d3470 con 0x7f6a88078b90 2024-09-17T03:08:31.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.582+0000 7f6a9a7fc640 1 -- 172.21.15.78:0/4075574601 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238279 (secure 0 0 0) 0x7f6aa40d3470 con 0x7f6a88078b90 2024-09-17T03:08:31.583 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:31.584 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:08:31.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.585+0000 7f6aac263640 1 -- 172.21.15.78:0/4075574601 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6a88078b90 msgr2=0x7f6a8807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:31.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.585+0000 7f6aac263640 1 --2- 172.21.15.78:0/4075574601 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6a88078b90 0x7f6a8807b0a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4159d90 tx=0x7f6a94005f90 comp rx=0 tx=0).stop 2024-09-17T03:08:31.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.585+0000 7f6aac263640 1 -- 172.21.15.78:0/4075574601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa40b64e0 msgr2=0x7f6aa4160560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.585+0000 7f6aac263640 1 --2- 172.21.15.78:0/4075574601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa40b64e0 0x7f6aa4160560 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0006010 tx=0x7f6aa0003c20 comp rx=0 tx=0).stop 2024-09-17T03:08:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.585+0000 7f6aac263640 1 -- 172.21.15.78:0/4075574601 shutdown_connections 2024-09-17T03:08:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.585+0000 7f6aac263640 1 --2- 172.21.15.78:0/4075574601 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6aa40cf540 0x7f6aa40c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.585+0000 7f6aac263640 1 --2- 172.21.15.78:0/4075574601 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6a88078b90 0x7f6a8807b0a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.585+0000 7f6aac263640 1 --2- 172.21.15.78:0/4075574601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6aa40b9b60 0x7f6aa40c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.585+0000 7f6aac263640 1 --2- 172.21.15.78:0/4075574601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6aa40b64e0 0x7f6aa4160560 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.585+0000 7f6aac263640 1 -- 172.21.15.78:0/4075574601 >> 172.21.15.78:0/4075574601 conn(0x7f6aa409d7f0 msgr2=0x7f6aa40d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.585+0000 7f6aac263640 1 -- 172.21.15.78:0/4075574601 shutdown_connections 2024-09-17T03:08:31.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.585+0000 7f6aac263640 1 -- 172.21.15.78:0/4075574601 wait complete. 2024-09-17T03:08:31.594 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T03:08:31.118535+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":30,"acting":30,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":223536,"kb_used_data":2624,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751184,"statfs":{"total":773094113280,"available":772865212416,"internally_reserved":0,"allocated":2686976,"data_stored":1648348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.905688"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.227179+0000","last_change":"2024-09-17T03:08:27.227179+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.227179+0000","last_undegraded":"2024-09-17T03:08:27.227179+0000","last_fullsized":"2024-09-17T03:08:27.227179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.226091+0000","last_change":"2024-09-17T03:08:27.226091+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.226091+0000","last_undegraded":"2024-09-17T03:08:27.226091+0000","last_fullsized":"2024-09-17T03:08:27.226091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.223978+0000","last_change":"2024-09-17T03:08:27.223978+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.223978+0000","last_undegraded":"2024-09-17T03:08:27.223978+0000","last_fullsized":"2024-09-17T03:08:27.223978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.226031+0000","last_change":"2024-09-17T03:08:27.226031+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.226031+0000","last_undegraded":"2024-09-17T03:08:27.226031+0000","last_fullsized":"2024-09-17T03:08:27.226031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225276+0000","last_change":"2024-09-17T03:08:27.225276+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225276+0000","last_undegraded":"2024-09-17T03:08:27.225276+0000","last_fullsized":"2024-09-17T03:08:27.225276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:08:27.241109+0000","last_change":"2024-09-17T03:08:27.237198+0000","last_active":"2024-09-17T03:08:27.241109+0000","last_peered":"2024-09-17T03:08:27.241109+0000","last_clean":"2024-09-17T03:08:27.241109+0000","last_became_active":"2024-09-17T03:08:27.236843+0000","last_became_peered":"2024-09-17T03:08:27.236843+0000","last_unstale":"2024-09-17T03:08:27.241109+0000","last_undegraded":"2024-09-17T03:08:27.241109+0000","last_fullsized":"2024-09-17T03:08:27.241109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:25.642380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:08:27.239741+0000","last_change":"2024-09-17T03:08:27.235234+0000","last_active":"2024-09-17T03:08:27.239741+0000","last_peered":"2024-09-17T03:08:27.239741+0000","last_clean":"2024-09-17T03:08:27.239741+0000","last_became_active":"2024-09-17T03:08:27.234619+0000","last_became_peered":"2024-09-17T03:08:27.234619+0000","last_unstale":"2024-09-17T03:08:27.239741+0000","last_undegraded":"2024-09-17T03:08:27.239741+0000","last_fullsized":"2024-09-17T03:08:27.239741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:56.777251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225405+0000","last_change":"2024-09-17T03:08:27.225405+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225405+0000","last_undegraded":"2024-09-17T03:08:27.225405+0000","last_fullsized":"2024-09-17T03:08:27.225405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":103,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T03:08:21.267742+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:08:21.267742+0000","last_peered":"2024-09-17T03:08:21.267742+0000","last_clean":"2024-09-17T03:08:21.267742+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:08:21.267742+0000","last_undegraded":"2024-09-17T03:08:21.267742+0000","last_fullsized":"2024-09-17T03:08:21.267742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225446+0000","last_change":"2024-09-17T03:08:27.225446+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225446+0000","last_undegraded":"2024-09-17T03:08:27.225446+0000","last_fullsized":"2024-09-17T03:08:27.225446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225298+0000","last_change":"2024-09-17T03:08:27.225298+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225298+0000","last_undegraded":"2024-09-17T03:08:27.225298+0000","last_fullsized":"2024-09-17T03:08:27.225298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.223967+0000","last_change":"2024-09-17T03:08:27.223967+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.223967+0000","last_undegraded":"2024-09-17T03:08:27.223967+0000","last_fullsized":"2024-09-17T03:08:27.223967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225195+0000","last_change":"2024-09-17T03:08:27.225195+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225195+0000","last_undegraded":"2024-09-17T03:08:27.225195+0000","last_fullsized":"2024-09-17T03:08:27.225195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:08:27.246026+0000","last_change":"2024-09-17T03:08:27.239362+0000","last_active":"2024-09-17T03:08:27.246026+0000","last_peered":"2024-09-17T03:08:27.246026+0000","last_clean":"2024-09-17T03:08:27.246026+0000","last_became_active":"2024-09-17T03:08:27.238941+0000","last_became_peered":"2024-09-17T03:08:27.238941+0000","last_unstale":"2024-09-17T03:08:27.246026+0000","last_undegraded":"2024-09-17T03:08:27.246026+0000","last_fullsized":"2024-09-17T03:08:27.246026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:09.060728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225748+0000","last_change":"2024-09-17T03:08:27.225748+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225748+0000","last_undegraded":"2024-09-17T03:08:27.225748+0000","last_fullsized":"2024-09-17T03:08:27.225748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":6,"acting":6,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":778240,"data_stored":647308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":778240,"data_stored":647308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":208896,"data_stored":69032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:08:31.598 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:08:31.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.747+0000 7f4e9eb69640 1 -- 172.21.15.78:0/2967489381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e980d1b10 msgr2=0x7f4e980ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:31.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.747+0000 7f4e9eb69640 1 --2- 172.21.15.78:0/2967489381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e980d1b10 0x7f4e980ccda0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4e980cec90 tx=0x7f4e8802aac0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.747+0000 7f4e9eb69640 1 -- 172.21.15.78:0/2967489381 shutdown_connections 2024-09-17T03:08:31.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.747+0000 7f4e9eb69640 1 --2- 172.21.15.78:0/2967489381 >> v2:172.21.15.193:3300/0 conn(0x7f4e980cd2e0 0x7f4e98072ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.747+0000 7f4e9eb69640 1 --2- 172.21.15.78:0/2967489381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e980d1b10 0x7f4e980ccda0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.747+0000 7f4e9eb69640 1 -- 172.21.15.78:0/2967489381 >> 172.21.15.78:0/2967489381 conn(0x7f4e980cede0 msgr2=0x7f4e980cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:31.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.747+0000 7f4e9eb69640 1 -- 172.21.15.78:0/2967489381 shutdown_connections 2024-09-17T03:08:31.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.747+0000 7f4e9eb69640 1 -- 172.21.15.78:0/2967489381 wait complete. 2024-09-17T03:08:31.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.749+0000 7f4e9eb69640 1 Processor -- start 2024-09-17T03:08:31.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.749+0000 7f4e9eb69640 1 -- start start 2024-09-17T03:08:31.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.750+0000 7f4e9eb69640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4e98073000 0x7f4e98145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:31.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.750+0000 7f4e9eb69640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e980cd2e0 0x7f4e98143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:31.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.750+0000 7f4e9eb69640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e980d1b10 0x7f4e98143690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:31.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.750+0000 7f4e9eb69640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4e980d20a0 con 0x7f4e980d1b10 2024-09-17T03:08:31.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.750+0000 7f4e9eb69640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4e980d1f20 con 0x7f4e980cd2e0 2024-09-17T03:08:31.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.750+0000 7f4e9eb69640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4e98073410 con 0x7f4e98073000 2024-09-17T03:08:31.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.750+0000 7f4e9d106640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e980d1b10 0x7f4e98143690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:31.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.751+0000 7f4e9d106640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e980d1b10 0x7f4e98143690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38532/0 (socket says 172.21.15.78:38532) 2024-09-17T03:08:31.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.751+0000 7f4e9d106640 1 -- 172.21.15.78:0/3332051645 learned_addr learned my addr 172.21.15.78:0/3332051645 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:31.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.751+0000 7f4e9c905640 1 --2- 172.21.15.78:0/3332051645 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4e98073000 0x7f4e98145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:31.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.751+0000 7f4e97fff640 1 --2- 172.21.15.78:0/3332051645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e980cd2e0 0x7f4e98143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:31.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.751+0000 7f4e9d106640 1 -- 172.21.15.78:0/3332051645 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4e98073000 msgr2=0x7f4e98145d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:31.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.751+0000 7f4e9d106640 1 --2- 172.21.15.78:0/3332051645 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4e98073000 0x7f4e98145d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.751+0000 7f4e9d106640 1 -- 172.21.15.78:0/3332051645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e980cd2e0 msgr2=0x7f4e98143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:31.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.751+0000 7f4e9d106640 1 --2- 172.21.15.78:0/3332051645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e980cd2e0 0x7f4e98143150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.751+0000 7f4e9d106640 1 -- 172.21.15.78:0/3332051645 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e980ca1c0 con 0x7f4e980d1b10 2024-09-17T03:08:31.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.751+0000 7f4e9d106640 1 --2- 172.21.15.78:0/3332051645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e980d1b10 0x7f4e98143690 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4e9000b4c0 tx=0x7f4e9000b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:31.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.751+0000 7f4e957fa640 1 -- 172.21.15.78:0/3332051645 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90015020 con 0x7f4e980d1b10 2024-09-17T03:08:31.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.751+0000 7f4e957fa640 1 -- 172.21.15.78:0/3332051645 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e90011940 con 0x7f4e980d1b10 2024-09-17T03:08:31.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.751+0000 7f4e9eb69640 1 -- 172.21.15.78:0/3332051645 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e980ca4a0 con 0x7f4e980d1b10 2024-09-17T03:08:31.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.751+0000 7f4e957fa640 1 -- 172.21.15.78:0/3332051645 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90011d90 con 0x7f4e980d1b10 2024-09-17T03:08:31.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.751+0000 7f4e9eb69640 1 -- 172.21.15.78:0/3332051645 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e980caa60 con 0x7f4e980d1b10 2024-09-17T03:08:31.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.752+0000 7f4e9eb69640 1 -- 172.21.15.78:0/3332051645 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e980c9f30 con 0x7f4e980d1b10 2024-09-17T03:08:31.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.753+0000 7f4e957fa640 1 -- 172.21.15.78:0/3332051645 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4e90018020 con 0x7f4e980d1b10 2024-09-17T03:08:31.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.753+0000 7f4e957fa640 1 --2- 172.21.15.78:0/3332051645 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4e78078bc0 0x7f4e7807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:31.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.754+0000 7f4e957fa640 1 -- 172.21.15.78:0/3332051645 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4e9009a690 con 0x7f4e980d1b10 2024-09-17T03:08:31.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.754+0000 7f4e9c905640 1 --2- 172.21.15.78:0/3332051645 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4e78078bc0 0x7f4e7807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:31.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.754+0000 7f4e9c905640 1 --2- 172.21.15.78:0/3332051645 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4e78078bc0 0x7f4e7807b0d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4e88035000 tx=0x7f4e88004ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:31.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.758+0000 7f4e957fa640 1 -- 172.21.15.78:0/3332051645 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4e9001f070 con 0x7f4e980d1b10 2024-09-17T03:08:31.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.931+0000 7f4e9eb69640 1 -- 172.21.15.78:0/3332051645 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4e9815bd20 con 0x7f4e78078bc0 2024-09-17T03:08:31.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.935+0000 7f4e957fa640 1 -- 172.21.15.78:0/3332051645 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238279 (secure 0 0 0) 0x7f4e880802e0 con 0x7f4e78078bc0 2024-09-17T03:08:31.936 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:31.937 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:08:31.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.938+0000 7f4e9eb69640 1 -- 172.21.15.78:0/3332051645 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4e78078bc0 msgr2=0x7f4e7807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:31.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.938+0000 7f4e9eb69640 1 --2- 172.21.15.78:0/3332051645 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4e78078bc0 0x7f4e7807b0d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4e88035000 tx=0x7f4e88004ab0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.938+0000 7f4e9eb69640 1 -- 172.21.15.78:0/3332051645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e980d1b10 msgr2=0x7f4e98143690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:31.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.938+0000 7f4e9eb69640 1 --2- 172.21.15.78:0/3332051645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e980d1b10 0x7f4e98143690 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4e9000b4c0 tx=0x7f4e9000b980 comp rx=0 tx=0).stop 2024-09-17T03:08:31.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.938+0000 7f4e9eb69640 1 -- 172.21.15.78:0/3332051645 shutdown_connections 2024-09-17T03:08:31.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.938+0000 7f4e9eb69640 1 --2- 172.21.15.78:0/3332051645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4e980d1b10 0x7f4e98143690 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.938+0000 7f4e9eb69640 1 --2- 172.21.15.78:0/3332051645 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4e78078bc0 0x7f4e7807b0d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.938+0000 7f4e9eb69640 1 --2- 172.21.15.78:0/3332051645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e980cd2e0 0x7f4e98143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.938+0000 7f4e9eb69640 1 --2- 172.21.15.78:0/3332051645 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4e98073000 0x7f4e98145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:31.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.938+0000 7f4e9eb69640 1 -- 172.21.15.78:0/3332051645 >> 172.21.15.78:0/3332051645 conn(0x7f4e980cede0 msgr2=0x7f4e980b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:31.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.938+0000 7f4e9eb69640 1 -- 172.21.15.78:0/3332051645 shutdown_connections 2024-09-17T03:08:31.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:31.938+0000 7f4e9eb69640 1 -- 172.21.15.78:0/3332051645 wait complete. 2024-09-17T03:08:31.948 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T03:08:31.118535+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":30,"acting":30,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":223536,"kb_used_data":2624,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751184,"statfs":{"total":773094113280,"available":772865212416,"internally_reserved":0,"allocated":2686976,"data_stored":1648348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.905688"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.227179+0000","last_change":"2024-09-17T03:08:27.227179+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.227179+0000","last_undegraded":"2024-09-17T03:08:27.227179+0000","last_fullsized":"2024-09-17T03:08:27.227179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.226091+0000","last_change":"2024-09-17T03:08:27.226091+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.226091+0000","last_undegraded":"2024-09-17T03:08:27.226091+0000","last_fullsized":"2024-09-17T03:08:27.226091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.223978+0000","last_change":"2024-09-17T03:08:27.223978+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.223978+0000","last_undegraded":"2024-09-17T03:08:27.223978+0000","last_fullsized":"2024-09-17T03:08:27.223978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.226031+0000","last_change":"2024-09-17T03:08:27.226031+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.226031+0000","last_undegraded":"2024-09-17T03:08:27.226031+0000","last_fullsized":"2024-09-17T03:08:27.226031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225276+0000","last_change":"2024-09-17T03:08:27.225276+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225276+0000","last_undegraded":"2024-09-17T03:08:27.225276+0000","last_fullsized":"2024-09-17T03:08:27.225276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:08:27.241109+0000","last_change":"2024-09-17T03:08:27.237198+0000","last_active":"2024-09-17T03:08:27.241109+0000","last_peered":"2024-09-17T03:08:27.241109+0000","last_clean":"2024-09-17T03:08:27.241109+0000","last_became_active":"2024-09-17T03:08:27.236843+0000","last_became_peered":"2024-09-17T03:08:27.236843+0000","last_unstale":"2024-09-17T03:08:27.241109+0000","last_undegraded":"2024-09-17T03:08:27.241109+0000","last_fullsized":"2024-09-17T03:08:27.241109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:25.642380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:08:27.239741+0000","last_change":"2024-09-17T03:08:27.235234+0000","last_active":"2024-09-17T03:08:27.239741+0000","last_peered":"2024-09-17T03:08:27.239741+0000","last_clean":"2024-09-17T03:08:27.239741+0000","last_became_active":"2024-09-17T03:08:27.234619+0000","last_became_peered":"2024-09-17T03:08:27.234619+0000","last_unstale":"2024-09-17T03:08:27.239741+0000","last_undegraded":"2024-09-17T03:08:27.239741+0000","last_fullsized":"2024-09-17T03:08:27.239741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:56.777251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225405+0000","last_change":"2024-09-17T03:08:27.225405+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225405+0000","last_undegraded":"2024-09-17T03:08:27.225405+0000","last_fullsized":"2024-09-17T03:08:27.225405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":103,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T03:08:21.267742+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:08:21.267742+0000","last_peered":"2024-09-17T03:08:21.267742+0000","last_clean":"2024-09-17T03:08:21.267742+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:08:21.267742+0000","last_undegraded":"2024-09-17T03:08:21.267742+0000","last_fullsized":"2024-09-17T03:08:21.267742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225446+0000","last_change":"2024-09-17T03:08:27.225446+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225446+0000","last_undegraded":"2024-09-17T03:08:27.225446+0000","last_fullsized":"2024-09-17T03:08:27.225446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225298+0000","last_change":"2024-09-17T03:08:27.225298+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225298+0000","last_undegraded":"2024-09-17T03:08:27.225298+0000","last_fullsized":"2024-09-17T03:08:27.225298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.223967+0000","last_change":"2024-09-17T03:08:27.223967+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.223967+0000","last_undegraded":"2024-09-17T03:08:27.223967+0000","last_fullsized":"2024-09-17T03:08:27.223967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225195+0000","last_change":"2024-09-17T03:08:27.225195+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225195+0000","last_undegraded":"2024-09-17T03:08:27.225195+0000","last_fullsized":"2024-09-17T03:08:27.225195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:08:27.246026+0000","last_change":"2024-09-17T03:08:27.239362+0000","last_active":"2024-09-17T03:08:27.246026+0000","last_peered":"2024-09-17T03:08:27.246026+0000","last_clean":"2024-09-17T03:08:27.246026+0000","last_became_active":"2024-09-17T03:08:27.238941+0000","last_became_peered":"2024-09-17T03:08:27.238941+0000","last_unstale":"2024-09-17T03:08:27.246026+0000","last_undegraded":"2024-09-17T03:08:27.246026+0000","last_fullsized":"2024-09-17T03:08:27.246026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:09.060728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225748+0000","last_change":"2024-09-17T03:08:27.225748+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225748+0000","last_undegraded":"2024-09-17T03:08:27.225748+0000","last_fullsized":"2024-09-17T03:08:27.225748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":6,"acting":6,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":778240,"data_stored":647308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":778240,"data_stored":647308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":208896,"data_stored":69032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:08:31.952 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-17T03:08:31.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.952 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-17T03:08:31.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.952 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-09-17T03:08:31.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.952 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-17T03:08:31.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.952 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-17T03:08:31.952 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.953 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-17T03:08:31.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.953 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-17T03:08:31.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.953 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-17T03:08:31.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:08:27.227179+0000', 'last_change': '2024-09-17T03:08:27.227179+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.227179+0000', 'last_undegraded': '2024-09-17T03:08:27.227179+0000', 'last_fullsized': '2024-09-17T03:08:27.227179+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:08:31.953 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-17T03:08:31.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.953 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-17T03:08:31.953 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.953 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-17T03:08:31.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.954 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-17T03:08:31.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.954 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-17T03:08:31.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:08:27.226091+0000', 'last_change': '2024-09-17T03:08:27.226091+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.226091+0000', 'last_undegraded': '2024-09-17T03:08:27.226091+0000', 'last_fullsized': '2024-09-17T03:08:27.226091+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:08:31.954 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-09-17T03:08:31.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.954 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-17T03:08:31.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.954 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-17T03:08:31.954 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.955 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-17T03:08:31.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.955 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-17T03:08:31.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.955 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-17T03:08:31.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.955 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-17T03:08:31.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.955 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-09-17T03:08:31.955 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.955 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-17T03:08:31.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.956 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-17T03:08:31.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:08:27.223978+0000', 'last_change': '2024-09-17T03:08:27.223978+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.223978+0000', 'last_undegraded': '2024-09-17T03:08:27.223978+0000', 'last_fullsized': '2024-09-17T03:08:27.223978+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:08:31.956 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-17T03:08:31.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.956 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-17T03:08:31.956 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:08:27.226031+0000', 'last_change': '2024-09-17T03:08:27.226031+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.226031+0000', 'last_undegraded': '2024-09-17T03:08:27.226031+0000', 'last_fullsized': '2024-09-17T03:08:27.226031+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:08:31.956 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-17T03:08:31.957 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.957 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-09-17T03:08:31.957 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.957 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-17T03:08:31.957 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:08:27.225276+0000', 'last_change': '2024-09-17T03:08:27.225276+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.225276+0000', 'last_undegraded': '2024-09-17T03:08:27.225276+0000', 'last_fullsized': '2024-09-17T03:08:27.225276+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:08:31.957 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-09-17T03:08:31.957 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.957 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-17T03:08:31.957 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.957 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-17T03:08:31.957 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.958 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-17T03:08:31.958 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.958 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-17T03:08:31.958 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.958 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-17T03:08:31.958 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.958 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1a is not active+clean 2024-09-17T03:08:31.958 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.958 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-17T03:08:31.958 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:08:27.225405+0000', 'last_change': '2024-09-17T03:08:27.225405+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.225405+0000', 'last_undegraded': '2024-09-17T03:08:27.225405+0000', 'last_fullsized': '2024-09-17T03:08:27.225405+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:08:31.958 INFO:tasks.ceph.ceph_manager.ceph:PG 2.18 is not active+clean 2024-09-17T03:08:31.958 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.959 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-17T03:08:31.959 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.959 INFO:tasks.ceph.ceph_manager.ceph:PG 2.17 is not active+clean 2024-09-17T03:08:31.959 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.959 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-17T03:08:31.959 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.959 INFO:tasks.ceph.ceph_manager.ceph:PG 2.16 is not active+clean 2024-09-17T03:08:31.959 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.959 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-17T03:08:31.959 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.959 INFO:tasks.ceph.ceph_manager.ceph:PG 2.15 is not active+clean 2024-09-17T03:08:31.960 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.960 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-17T03:08:31.960 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.960 INFO:tasks.ceph.ceph_manager.ceph:PG 2.14 is not active+clean 2024-09-17T03:08:31.960 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.960 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-17T03:08:31.960 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.960 INFO:tasks.ceph.ceph_manager.ceph:PG 2.13 is not active+clean 2024-09-17T03:08:31.960 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.960 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-17T03:08:31.960 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.961 INFO:tasks.ceph.ceph_manager.ceph:PG 2.12 is not active+clean 2024-09-17T03:08:31.961 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.961 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-17T03:08:31.961 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.961 INFO:tasks.ceph.ceph_manager.ceph:PG 2.11 is not active+clean 2024-09-17T03:08:31.961 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.961 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-17T03:08:31.961 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.961 INFO:tasks.ceph.ceph_manager.ceph:PG 2.10 is not active+clean 2024-09-17T03:08:31.961 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.961 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-17T03:08:31.961 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.962 INFO:tasks.ceph.ceph_manager.ceph:PG 2.f is not active+clean 2024-09-17T03:08:31.962 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.962 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-17T03:08:31.962 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.962 INFO:tasks.ceph.ceph_manager.ceph:PG 2.e is not active+clean 2024-09-17T03:08:31.962 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.962 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-17T03:08:31.962 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.962 INFO:tasks.ceph.ceph_manager.ceph:PG 2.d is not active+clean 2024-09-17T03:08:31.962 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.962 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-17T03:08:31.962 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.963 INFO:tasks.ceph.ceph_manager.ceph:PG 2.c is not active+clean 2024-09-17T03:08:31.963 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.963 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-17T03:08:31.963 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.963 INFO:tasks.ceph.ceph_manager.ceph:PG 2.3 is not active+clean 2024-09-17T03:08:31.963 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.963 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-17T03:08:31.963 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:08:27.225446+0000', 'last_change': '2024-09-17T03:08:27.225446+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.225446+0000', 'last_undegraded': '2024-09-17T03:08:27.225446+0000', 'last_fullsized': '2024-09-17T03:08:27.225446+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:08:31.963 INFO:tasks.ceph.ceph_manager.ceph:PG 2.0 is not active+clean 2024-09-17T03:08:31.963 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.963 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-17T03:08:31.964 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.964 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1 is not active+clean 2024-09-17T03:08:31.964 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.964 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-17T03:08:31.964 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.964 INFO:tasks.ceph.ceph_manager.ceph:PG 2.2 is not active+clean 2024-09-17T03:08:31.964 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.964 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-17T03:08:31.964 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.964 INFO:tasks.ceph.ceph_manager.ceph:PG 2.4 is not active+clean 2024-09-17T03:08:31.964 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.965 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-17T03:08:31.965 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.965 INFO:tasks.ceph.ceph_manager.ceph:PG 2.5 is not active+clean 2024-09-17T03:08:31.965 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.965 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-17T03:08:31.965 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.965 INFO:tasks.ceph.ceph_manager.ceph:PG 2.6 is not active+clean 2024-09-17T03:08:31.965 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.965 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-17T03:08:31.965 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:08:27.225298+0000', 'last_change': '2024-09-17T03:08:27.225298+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.225298+0000', 'last_undegraded': '2024-09-17T03:08:27.225298+0000', 'last_fullsized': '2024-09-17T03:08:27.225298+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:08:31.965 INFO:tasks.ceph.ceph_manager.ceph:PG 2.7 is not active+clean 2024-09-17T03:08:31.965 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.966 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-17T03:08:31.966 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.966 INFO:tasks.ceph.ceph_manager.ceph:PG 2.8 is not active+clean 2024-09-17T03:08:31.966 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.966 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-17T03:08:31.966 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.966 INFO:tasks.ceph.ceph_manager.ceph:PG 2.9 is not active+clean 2024-09-17T03:08:31.966 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.966 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-17T03:08:31.966 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:08:27.223967+0000', 'last_change': '2024-09-17T03:08:27.223967+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.223967+0000', 'last_undegraded': '2024-09-17T03:08:27.223967+0000', 'last_fullsized': '2024-09-17T03:08:27.223967+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:08:31.967 INFO:tasks.ceph.ceph_manager.ceph:PG 2.a is not active+clean 2024-09-17T03:08:31.967 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.967 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-17T03:08:31.967 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:08:27.225195+0000', 'last_change': '2024-09-17T03:08:27.225195+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.225195+0000', 'last_undegraded': '2024-09-17T03:08:27.225195+0000', 'last_fullsized': '2024-09-17T03:08:27.225195+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:08:31.967 INFO:tasks.ceph.ceph_manager.ceph:PG 2.b is not active+clean 2024-09-17T03:08:31.967 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.967 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-17T03:08:31.967 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.967 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-17T03:08:31.967 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.967 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1c is not active+clean 2024-09-17T03:08:31.967 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.968 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-17T03:08:31.968 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.968 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1d is not active+clean 2024-09-17T03:08:31.968 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.968 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-17T03:08:31.968 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:27.212097+0000', 'last_change': '2024-09-17T03:08:27.212097+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.212097+0000', 'last_undegraded': '2024-09-17T03:08:27.212097+0000', 'last_fullsized': '2024-09-17T03:08:27.212097+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.968 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-17T03:08:31.968 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:08:27.225748+0000', 'last_change': '2024-09-17T03:08:27.225748+0000', 'last_active': '2024-09-17T03:08:27.212097+0000', 'last_peered': '2024-09-17T03:08:27.212097+0000', 'last_clean': '2024-09-17T03:08:27.212097+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:27.225748+0000', 'last_undegraded': '2024-09-17T03:08:27.225748+0000', 'last_fullsized': '2024-09-17T03:08:27.225748+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:27.212097+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:08:31.968 INFO:tasks.ceph.ceph_manager.ceph:PG 2.1f is not active+clean 2024-09-17T03:08:31.968 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:08:26.206187+0000', 'last_change': '2024-09-17T03:08:26.206187+0000', 'last_active': '2024-09-17T03:08:26.206187+0000', 'last_peered': '2024-09-17T03:08:26.206187+0000', 'last_clean': '2024-09-17T03:08:26.206187+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:08:26.206187+0000', 'last_undegraded': '2024-09-17T03:08:26.206187+0000', 'last_fullsized': '2024-09-17T03:08:26.206187+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'last_clean_scrub_stamp': '2024-09-17T03:08:26.206187+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:08:31.969 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:08:32.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.101+0000 7f786deec640 1 -- 172.21.15.78:0/2347548161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78500040a0 msgr2=0x7f7850004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:32.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.101+0000 7f786deec640 1 --2- 172.21.15.78:0/2347548161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78500040a0 0x7f7850004800 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f78680ce1b0 tx=0x7f7850005830 comp rx=0 tx=0).stop 2024-09-17T03:08:32.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.101+0000 7f7867fff640 1 -- 172.21.15.78:0/2347548161 reap_dead start 2024-09-17T03:08:32.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.101+0000 7f786deec640 1 -- 172.21.15.78:0/2347548161 shutdown_connections 2024-09-17T03:08:32.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.101+0000 7f786deec640 1 -- 172.21.15.78:0/2347548161 >> 172.21.15.78:0/2347548161 conn(0x7f786806d4f0 msgr2=0x7f7868071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:32.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.101+0000 7f786deec640 1 -- 172.21.15.78:0/2347548161 shutdown_connections 2024-09-17T03:08:32.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.101+0000 7f786deec640 1 -- 172.21.15.78:0/2347548161 wait complete. 2024-09-17T03:08:32.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.103+0000 7f786deec640 1 Processor -- start 2024-09-17T03:08:32.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.103+0000 7f786deec640 1 -- start start 2024-09-17T03:08:32.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.104+0000 7f786deec640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78500040a0 0x7f78680ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:32.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.104+0000 7f786deec640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78680aa060 0x7f78680aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:32.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.104+0000 7f786deec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78680abe30 0x7f78680ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:32.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.104+0000 7f786deec640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f78680cec10 con 0x7f78680abe30 2024-09-17T03:08:32.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.104+0000 7f786deec640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f78680d1ba0 con 0x7f78680aa060 2024-09-17T03:08:32.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.104+0000 7f786deec640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f78680ced90 con 0x7f78500040a0 2024-09-17T03:08:32.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.105+0000 7f7867fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78680abe30 0x7f78680ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:32.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.105+0000 7f7867fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78680abe30 0x7f78680ac240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38546/0 (socket says 172.21.15.78:38546) 2024-09-17T03:08:32.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.105+0000 7f7867fff640 1 -- 172.21.15.78:0/2682430835 learned_addr learned my addr 172.21.15.78:0/2682430835 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:32.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.105+0000 7f7866ffd640 1 --2- 172.21.15.78:0/2682430835 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78680aa060 0x7f78680aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:32.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.105+0000 7f78677fe640 1 --2- 172.21.15.78:0/2682430835 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78500040a0 0x7f78680ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:32.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.105+0000 7f7867fff640 1 -- 172.21.15.78:0/2682430835 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78500040a0 msgr2=0x7f78680ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:32.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.105+0000 7f7867fff640 1 --2- 172.21.15.78:0/2682430835 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78500040a0 0x7f78680ae6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:32.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.105+0000 7f7867fff640 1 -- 172.21.15.78:0/2682430835 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78680aa060 msgr2=0x7f78680aa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:32.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.105+0000 7f7867fff640 1 --2- 172.21.15.78:0/2682430835 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78680aa060 0x7f78680aa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:32.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.105+0000 7f7867fff640 1 -- 172.21.15.78:0/2682430835 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78680aad90 con 0x7f78680abe30 2024-09-17T03:08:32.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.105+0000 7f7867fff640 1 --2- 172.21.15.78:0/2682430835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78680abe30 0x7f78680ac240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7860002230 tx=0x7f7860006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:32.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.105+0000 7f784ffff640 1 -- 172.21.15.78:0/2682430835 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786000fa20 con 0x7f78680abe30 2024-09-17T03:08:32.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.105+0000 7f784ffff640 1 -- 172.21.15.78:0/2682430835 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f786000fbc0 con 0x7f78680abe30 2024-09-17T03:08:32.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.105+0000 7f786deec640 1 -- 172.21.15.78:0/2682430835 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78680ab070 con 0x7f78680abe30 2024-09-17T03:08:32.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.105+0000 7f784ffff640 1 -- 172.21.15.78:0/2682430835 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860011430 con 0x7f78680abe30 2024-09-17T03:08:32.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.105+0000 7f786deec640 1 -- 172.21.15.78:0/2682430835 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78680ab630 con 0x7f78680abe30 2024-09-17T03:08:32.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.106+0000 7f786deec640 1 -- 172.21.15.78:0/2682430835 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78680aab00 con 0x7f78680abe30 2024-09-17T03:08:32.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.107+0000 7f784ffff640 1 -- 172.21.15.78:0/2682430835 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f78600115d0 con 0x7f78680abe30 2024-09-17T03:08:32.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.107+0000 7f784ffff640 1 --2- 172.21.15.78:0/2682430835 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7854078b90 0x7f785407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:32.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.108+0000 7f784ffff640 1 -- 172.21.15.78:0/2682430835 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f786009b470 con 0x7f78680abe30 2024-09-17T03:08:32.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.108+0000 7f78677fe640 1 --2- 172.21.15.78:0/2682430835 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7854078b90 0x7f785407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:32.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.108+0000 7f78677fe640 1 --2- 172.21.15.78:0/2682430835 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7854078b90 0x7f785407b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f785800bc70 tx=0x7f785800b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:32.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.112+0000 7f784ffff640 1 -- 172.21.15.78:0/2682430835 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7860063380 con 0x7f78680abe30 2024-09-17T03:08:32.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.356+0000 7f786deec640 1 -- 172.21.15.78:0/2682430835 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f78680ccbc0 con 0x7f78680abe30 2024-09-17T03:08:32.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.356+0000 7f784ffff640 1 -- 172.21.15.78:0/2682430835 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1149 (secure 0 0 0) 0x7f7860067db0 con 0x7f78680abe30 2024-09-17T03:08:32.355 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:32.355 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":82},{"state_name":"creating+peering","count":11},{"state_name":"active+clean","count":4}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":228900864,"bytes_avail":772865212416,"bytes_total":773094113280,"unknown_pgs_ratio":0.84536081552505493,"inactive_pgs_ratio":0.11340206116437912},"fsmap":{"epoch":6,"btime":"2024-09-17T03:08:30:244213+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4425}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-17T03:08:02.802674+0000","services":{}},"progress_events":{}} 2024-09-17T03:08:32.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.359+0000 7f786deec640 1 -- 172.21.15.78:0/2682430835 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7854078b90 msgr2=0x7f785407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:32.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.359+0000 7f786deec640 1 --2- 172.21.15.78:0/2682430835 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7854078b90 0x7f785407b0a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f785800bc70 tx=0x7f785800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:08:32.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.359+0000 7f786deec640 1 -- 172.21.15.78:0/2682430835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78680abe30 msgr2=0x7f78680ac240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:32.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.359+0000 7f786deec640 1 --2- 172.21.15.78:0/2682430835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78680abe30 0x7f78680ac240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7860002230 tx=0x7f7860006720 comp rx=0 tx=0).stop 2024-09-17T03:08:32.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.359+0000 7f786deec640 1 -- 172.21.15.78:0/2682430835 shutdown_connections 2024-09-17T03:08:32.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.359+0000 7f786deec640 1 --2- 172.21.15.78:0/2682430835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78680abe30 0x7f78680ac240 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:32.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.359+0000 7f786deec640 1 --2- 172.21.15.78:0/2682430835 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7854078b90 0x7f785407b0a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:32.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.359+0000 7f786deec640 1 --2- 172.21.15.78:0/2682430835 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78680aa060 0x7f78680aa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:32.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.359+0000 7f786deec640 1 --2- 172.21.15.78:0/2682430835 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78500040a0 0x7f78680ae6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:32.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.359+0000 7f786deec640 1 -- 172.21.15.78:0/2682430835 >> 172.21.15.78:0/2682430835 conn(0x7f786806d4f0 msgr2=0x7f7868068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:32.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.359+0000 7f786deec640 1 -- 172.21.15.78:0/2682430835 shutdown_connections 2024-09-17T03:08:32.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.359+0000 7f786deec640 1 -- 172.21.15.78:0/2682430835 wait complete. 2024-09-17T03:08:32.369 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:08:32.369 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:08:32.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.484+0000 7fa09256e640 1 -- 172.21.15.78:0/3522883254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa074003a50 msgr2=0x7fa074003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:32.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.484+0000 7fa09256e640 1 --2- 172.21.15.78:0/3522883254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa074003a50 0x7fa074003ec0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa07c0016c0 tx=0x7fa074005830 comp rx=0 tx=0).stop 2024-09-17T03:08:32.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.484+0000 7fa09256e640 1 -- 172.21.15.78:0/3522883254 shutdown_connections 2024-09-17T03:08:32.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.484+0000 7fa09256e640 1 --2- 172.21.15.78:0/3522883254 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa074003a50 0x7fa074003ec0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:32.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.484+0000 7fa09256e640 1 -- 172.21.15.78:0/3522883254 >> 172.21.15.78:0/3522883254 conn(0x7fa08c0710b0 msgr2=0x7fa08c0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:32.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.484+0000 7fa09256e640 1 -- 172.21.15.78:0/3522883254 shutdown_connections 2024-09-17T03:08:32.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.484+0000 7fa09256e640 1 -- 172.21.15.78:0/3522883254 wait complete. 2024-09-17T03:08:32.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.486+0000 7fa09256e640 1 Processor -- start 2024-09-17T03:08:32.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.486+0000 7fa09256e640 1 -- start start 2024-09-17T03:08:32.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.487+0000 7fa09256e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa074003a50 0x7fa08c1f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:32.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.487+0000 7fa09256e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa08c14a660 0x7fa08c1f0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:32.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.487+0000 7fa09256e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa08c1f38d0 0x7fa08c1f0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:32.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.487+0000 7fa09256e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c0ced30 con 0x7fa08c1f38d0 2024-09-17T03:08:32.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.487+0000 7fa09256e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa08c15ca10 con 0x7fa08c14a660 2024-09-17T03:08:32.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.487+0000 7fa09256e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa08c0ceeb0 con 0x7fa074003a50 2024-09-17T03:08:32.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.487+0000 7fa090b0b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa08c1f38d0 0x7fa08c1f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:32.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.487+0000 7fa090b0b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa08c1f38d0 0x7fa08c1f0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38558/0 (socket says 172.21.15.78:38558) 2024-09-17T03:08:32.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.487+0000 7fa090b0b640 1 -- 172.21.15.78:0/4042634821 learned_addr learned my addr 172.21.15.78:0/4042634821 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:32.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.487+0000 7fa08b7fe640 1 --2- 172.21.15.78:0/4042634821 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa08c14a660 0x7fa08c1f0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:32.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.487+0000 7fa08bfff640 1 --2- 172.21.15.78:0/4042634821 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa074003a50 0x7fa08c1f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:32.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.487+0000 7fa090b0b640 1 -- 172.21.15.78:0/4042634821 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa074003a50 msgr2=0x7fa08c1f3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:32.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.487+0000 7fa090b0b640 1 --2- 172.21.15.78:0/4042634821 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa074003a50 0x7fa08c1f3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:32.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.487+0000 7fa090b0b640 1 -- 172.21.15.78:0/4042634821 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa08c14a660 msgr2=0x7fa08c1f0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:32.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.487+0000 7fa090b0b640 1 --2- 172.21.15.78:0/4042634821 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa08c14a660 0x7fa08c1f0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:32.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.487+0000 7fa090b0b640 1 -- 172.21.15.78:0/4042634821 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08c0c97b0 con 0x7fa08c1f38d0 2024-09-17T03:08:32.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.487+0000 7fa08b7fe640 1 --2- 172.21.15.78:0/4042634821 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa08c14a660 0x7fa08c1f0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:32.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.487+0000 7fa08bfff640 1 --2- 172.21.15.78:0/4042634821 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa074003a50 0x7fa08c1f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:32.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.488+0000 7fa090b0b640 1 --2- 172.21.15.78:0/4042634821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa08c1f38d0 0x7fa08c1f0740 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0cdd40 tx=0x7fa084006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:32.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.488+0000 7fa088ff9640 1 -- 172.21.15.78:0/4042634821 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa084015070 con 0x7fa08c1f38d0 2024-09-17T03:08:32.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.488+0000 7fa088ff9640 1 -- 172.21.15.78:0/4042634821 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa08400fa20 con 0x7fa08c1f38d0 2024-09-17T03:08:32.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.488+0000 7fa09256e640 1 -- 172.21.15.78:0/4042634821 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa08c0c9a90 con 0x7fa08c1f38d0 2024-09-17T03:08:32.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.488+0000 7fa088ff9640 1 -- 172.21.15.78:0/4042634821 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08400fe70 con 0x7fa08c1f38d0 2024-09-17T03:08:32.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.488+0000 7fa09256e640 1 -- 172.21.15.78:0/4042634821 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa08c0ca050 con 0x7fa08c1f38d0 2024-09-17T03:08:32.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.489+0000 7fa09256e640 1 -- 172.21.15.78:0/4042634821 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa08c0cf3c0 con 0x7fa08c1f38d0 2024-09-17T03:08:32.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.489+0000 7fa088ff9640 1 -- 172.21.15.78:0/4042634821 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa08401b460 con 0x7fa08c1f38d0 2024-09-17T03:08:32.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.490+0000 7fa088ff9640 1 --2- 172.21.15.78:0/4042634821 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa078078b90 0x7fa07807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:32.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.490+0000 7fa088ff9640 1 -- 172.21.15.78:0/4042634821 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa08409bad0 con 0x7fa08c1f38d0 2024-09-17T03:08:32.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.490+0000 7fa08bfff640 1 --2- 172.21.15.78:0/4042634821 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa078078b90 0x7fa07807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:32.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.491+0000 7fa08bfff640 1 --2- 172.21.15.78:0/4042634821 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa078078b90 0x7fa07807b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa07c032000 tx=0x7fa07c001190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:32.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.494+0000 7fa088ff9640 1 -- 172.21.15.78:0/4042634821 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa084064030 con 0x7fa08c1f38d0 2024-09-17T03:08:32.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.664+0000 7fa09256e640 1 -- 172.21.15.78:0/4042634821 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa08c1f3e90 con 0x7fa078078b90 2024-09-17T03:08:32.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.668+0000 7fa088ff9640 1 -- 172.21.15.78:0/4042634821 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238279 (secure 0 0 0) 0x7fa07c07d2e0 con 0x7fa078078b90 2024-09-17T03:08:32.669 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:32.670 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:08:32.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.671+0000 7fa09256e640 1 -- 172.21.15.78:0/4042634821 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa078078b90 msgr2=0x7fa07807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:32.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.671+0000 7fa09256e640 1 --2- 172.21.15.78:0/4042634821 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa078078b90 0x7fa07807b0a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa07c032000 tx=0x7fa07c001190 comp rx=0 tx=0).stop 2024-09-17T03:08:32.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.671+0000 7fa09256e640 1 -- 172.21.15.78:0/4042634821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa08c1f38d0 msgr2=0x7fa08c1f0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.671+0000 7fa09256e640 1 --2- 172.21.15.78:0/4042634821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa08c1f38d0 0x7fa08c1f0740 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa08c0cdd40 tx=0x7fa084006720 comp rx=0 tx=0).stop 2024-09-17T03:08:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.671+0000 7fa09256e640 1 -- 172.21.15.78:0/4042634821 shutdown_connections 2024-09-17T03:08:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.671+0000 7fa09256e640 1 --2- 172.21.15.78:0/4042634821 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa08c1f38d0 0x7fa08c1f0740 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.671+0000 7fa09256e640 1 --2- 172.21.15.78:0/4042634821 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa078078b90 0x7fa07807b0a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.671+0000 7fa09256e640 1 --2- 172.21.15.78:0/4042634821 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa08c14a660 0x7fa08c1f0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.671+0000 7fa09256e640 1 --2- 172.21.15.78:0/4042634821 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa074003a50 0x7fa08c1f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.671+0000 7fa09256e640 1 -- 172.21.15.78:0/4042634821 >> 172.21.15.78:0/4042634821 conn(0x7fa08c0710b0 msgr2=0x7fa08c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.672+0000 7fa09256e640 1 -- 172.21.15.78:0/4042634821 shutdown_connections 2024-09-17T03:08:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:32.672+0000 7fa09256e640 1 -- 172.21.15.78:0/4042634821 wait complete. 2024-09-17T03:08:32.681 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T03:08:31.118535+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":30,"acting":30,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":223536,"kb_used_data":2624,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751184,"statfs":{"total":773094113280,"available":772865212416,"internally_reserved":0,"allocated":2686976,"data_stored":1648348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.905688"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.227179+0000","last_change":"2024-09-17T03:08:27.227179+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.227179+0000","last_undegraded":"2024-09-17T03:08:27.227179+0000","last_fullsized":"2024-09-17T03:08:27.227179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.226091+0000","last_change":"2024-09-17T03:08:27.226091+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.226091+0000","last_undegraded":"2024-09-17T03:08:27.226091+0000","last_fullsized":"2024-09-17T03:08:27.226091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.223978+0000","last_change":"2024-09-17T03:08:27.223978+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.223978+0000","last_undegraded":"2024-09-17T03:08:27.223978+0000","last_fullsized":"2024-09-17T03:08:27.223978+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.226031+0000","last_change":"2024-09-17T03:08:27.226031+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.226031+0000","last_undegraded":"2024-09-17T03:08:27.226031+0000","last_fullsized":"2024-09-17T03:08:27.226031+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225276+0000","last_change":"2024-09-17T03:08:27.225276+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225276+0000","last_undegraded":"2024-09-17T03:08:27.225276+0000","last_fullsized":"2024-09-17T03:08:27.225276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:08:27.241109+0000","last_change":"2024-09-17T03:08:27.237198+0000","last_active":"2024-09-17T03:08:27.241109+0000","last_peered":"2024-09-17T03:08:27.241109+0000","last_clean":"2024-09-17T03:08:27.241109+0000","last_became_active":"2024-09-17T03:08:27.236843+0000","last_became_peered":"2024-09-17T03:08:27.236843+0000","last_unstale":"2024-09-17T03:08:27.241109+0000","last_undegraded":"2024-09-17T03:08:27.241109+0000","last_fullsized":"2024-09-17T03:08:27.241109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:25.642380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:08:27.239741+0000","last_change":"2024-09-17T03:08:27.235234+0000","last_active":"2024-09-17T03:08:27.239741+0000","last_peered":"2024-09-17T03:08:27.239741+0000","last_clean":"2024-09-17T03:08:27.239741+0000","last_became_active":"2024-09-17T03:08:27.234619+0000","last_became_peered":"2024-09-17T03:08:27.234619+0000","last_unstale":"2024-09-17T03:08:27.239741+0000","last_undegraded":"2024-09-17T03:08:27.239741+0000","last_fullsized":"2024-09-17T03:08:27.239741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:56.777251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225405+0000","last_change":"2024-09-17T03:08:27.225405+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225405+0000","last_undegraded":"2024-09-17T03:08:27.225405+0000","last_fullsized":"2024-09-17T03:08:27.225405+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":103,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-17T03:08:21.267742+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:08:21.267742+0000","last_peered":"2024-09-17T03:08:21.267742+0000","last_clean":"2024-09-17T03:08:21.267742+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:08:21.267742+0000","last_undegraded":"2024-09-17T03:08:21.267742+0000","last_fullsized":"2024-09-17T03:08:21.267742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225446+0000","last_change":"2024-09-17T03:08:27.225446+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225446+0000","last_undegraded":"2024-09-17T03:08:27.225446+0000","last_fullsized":"2024-09-17T03:08:27.225446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225298+0000","last_change":"2024-09-17T03:08:27.225298+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225298+0000","last_undegraded":"2024-09-17T03:08:27.225298+0000","last_fullsized":"2024-09-17T03:08:27.225298+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.223967+0000","last_change":"2024-09-17T03:08:27.223967+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.223967+0000","last_undegraded":"2024-09-17T03:08:27.223967+0000","last_fullsized":"2024-09-17T03:08:27.223967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225195+0000","last_change":"2024-09-17T03:08:27.225195+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225195+0000","last_undegraded":"2024-09-17T03:08:27.225195+0000","last_fullsized":"2024-09-17T03:08:27.225195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:27.212097+0000","last_change":"2024-09-17T03:08:27.212097+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.212097+0000","last_undegraded":"2024-09-17T03:08:27.212097+0000","last_fullsized":"2024-09-17T03:08:27.212097+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T03:08:27.246026+0000","last_change":"2024-09-17T03:08:27.239362+0000","last_active":"2024-09-17T03:08:27.246026+0000","last_peered":"2024-09-17T03:08:27.246026+0000","last_clean":"2024-09-17T03:08:27.246026+0000","last_became_active":"2024-09-17T03:08:27.238941+0000","last_became_peered":"2024-09-17T03:08:27.238941+0000","last_unstale":"2024-09-17T03:08:27.246026+0000","last_undegraded":"2024-09-17T03:08:27.246026+0000","last_fullsized":"2024-09-17T03:08:27.246026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:56:09.060728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T03:08:27.225748+0000","last_change":"2024-09-17T03:08:27.225748+0000","last_active":"2024-09-17T03:08:27.212097+0000","last_peered":"2024-09-17T03:08:27.212097+0000","last_clean":"2024-09-17T03:08:27.212097+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:27.225748+0000","last_undegraded":"2024-09-17T03:08:27.225748+0000","last_fullsized":"2024-09-17T03:08:27.225748+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:08:26.206187+0000","last_change":"2024-09-17T03:08:26.206187+0000","last_active":"2024-09-17T03:08:26.206187+0000","last_peered":"2024-09-17T03:08:26.206187+0000","last_clean":"2024-09-17T03:08:26.206187+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:08:26.206187+0000","last_undegraded":"2024-09-17T03:08:26.206187+0000","last_fullsized":"2024-09-17T03:08:26.206187+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":22,"acting":22,"num_store_stats":1},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":6,"acting":6,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":778240,"data_stored":647308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27212,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":184320,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27208,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":184320,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27216,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":184320,"data_stored":56940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28036,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343804,"statfs":{"total":96636764160,"available":96608055296,"internally_reserved":0,"allocated":778240,"data_stored":647308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":208896,"data_stored":69032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:08:33.205 INFO:tasks.ceph.mds.b.smithi193.stderr:2024-09-17T03:08:33.207+0000 7f66d9542640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:08:35.687 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:08:35.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.823+0000 7f49614d5640 1 -- 172.21.15.78:0/1884148901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49440040d0 msgr2=0x7f4944004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:35.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.823+0000 7f49614d5640 1 --2- 172.21.15.78:0/1884148901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49440040d0 0x7f4944004800 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f495c0b7120 tx=0x7f4944005830 comp rx=0 tx=0).stop 2024-09-17T03:08:35.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.823+0000 7f495b7fe640 1 -- 172.21.15.78:0/1884148901 reap_dead start 2024-09-17T03:08:35.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.823+0000 7f49614d5640 1 -- 172.21.15.78:0/1884148901 shutdown_connections 2024-09-17T03:08:35.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.823+0000 7f49614d5640 1 -- 172.21.15.78:0/1884148901 >> 172.21.15.78:0/1884148901 conn(0x7f495c08bfc0 msgr2=0x7f495c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:35.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.823+0000 7f49614d5640 1 -- 172.21.15.78:0/1884148901 shutdown_connections 2024-09-17T03:08:35.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.823+0000 7f49614d5640 1 -- 172.21.15.78:0/1884148901 wait complete. 2024-09-17T03:08:35.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.825+0000 7f49614d5640 1 Processor -- start 2024-09-17T03:08:35.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.825+0000 7f49614d5640 1 -- start start 2024-09-17T03:08:35.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.826+0000 7f49614d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49440040d0 0x7f495c15a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:35.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.826+0000 7f49614d5640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f495c0ccac0 0x7f495c0c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:35.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.826+0000 7f49614d5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f495c0cced0 0x7f495c0c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:35.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.826+0000 7f49614d5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f495c0cfd70 con 0x7f49440040d0 2024-09-17T03:08:35.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.826+0000 7f49614d5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f495c0cfbf0 con 0x7f495c0cced0 2024-09-17T03:08:35.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.826+0000 7f49614d5640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f495c0cfef0 con 0x7f495c0ccac0 2024-09-17T03:08:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.826+0000 7f495affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49440040d0 0x7f495c15a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.827+0000 7f495affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49440040d0 0x7f495c15a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38572/0 (socket says 172.21.15.78:38572) 2024-09-17T03:08:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.827+0000 7f495affd640 1 -- 172.21.15.78:0/1343242759 learned_addr learned my addr 172.21.15.78:0/1343242759 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.827+0000 7f495a7fc640 1 --2- 172.21.15.78:0/1343242759 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f495c0ccac0 0x7f495c0c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.827+0000 7f495b7fe640 1 --2- 172.21.15.78:0/1343242759 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f495c0cced0 0x7f495c0c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.827+0000 7f495affd640 1 -- 172.21.15.78:0/1343242759 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f495c0ccac0 msgr2=0x7f495c0c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.827+0000 7f495affd640 1 --2- 172.21.15.78:0/1343242759 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f495c0ccac0 0x7f495c0c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.827+0000 7f495affd640 1 -- 172.21.15.78:0/1343242759 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f495c0cced0 msgr2=0x7f495c0c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.827+0000 7f495affd640 1 --2- 172.21.15.78:0/1343242759 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f495c0cced0 0x7f495c0c9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.827+0000 7f495affd640 1 -- 172.21.15.78:0/1343242759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495c1fa0b0 con 0x7f49440040d0 2024-09-17T03:08:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.827+0000 7f495b7fe640 1 --2- 172.21.15.78:0/1343242759 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f495c0cced0 0x7f495c0c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.827+0000 7f495a7fc640 1 --2- 172.21.15.78:0/1343242759 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f495c0ccac0 0x7f495c0c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.827+0000 7f495affd640 1 --2- 172.21.15.78:0/1343242759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49440040d0 0x7f495c15a030 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f494c003f70 tx=0x7f494c00f7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:35.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.827+0000 7f49437fe640 1 -- 172.21.15.78:0/1343242759 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c015070 con 0x7f49440040d0 2024-09-17T03:08:35.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.827+0000 7f49437fe640 1 -- 172.21.15.78:0/1343242759 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f494c011840 con 0x7f49440040d0 2024-09-17T03:08:35.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.827+0000 7f49614d5640 1 -- 172.21.15.78:0/1343242759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f495c1592b0 con 0x7f49440040d0 2024-09-17T03:08:35.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.827+0000 7f49437fe640 1 -- 172.21.15.78:0/1343242759 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c011c70 con 0x7f49440040d0 2024-09-17T03:08:35.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.827+0000 7f49614d5640 1 -- 172.21.15.78:0/1343242759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f495c159830 con 0x7f49440040d0 2024-09-17T03:08:35.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.828+0000 7f49614d5640 1 -- 172.21.15.78:0/1343242759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f495c06f3a0 con 0x7f49440040d0 2024-09-17T03:08:35.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.829+0000 7f49437fe640 1 -- 172.21.15.78:0/1343242759 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f494c0103c0 con 0x7f49440040d0 2024-09-17T03:08:35.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.829+0000 7f49437fe640 1 --2- 172.21.15.78:0/1343242759 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4948078b90 0x7f494807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:35.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.830+0000 7f49437fe640 1 -- 172.21.15.78:0/1343242759 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f494c09b9b0 con 0x7f49440040d0 2024-09-17T03:08:35.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.830+0000 7f495a7fc640 1 --2- 172.21.15.78:0/1343242759 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4948078b90 0x7f494807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:35.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.830+0000 7f495a7fc640 1 --2- 172.21.15.78:0/1343242759 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4948078b90 0x7f494807b0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4950036000 tx=0x7f49500046c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:35.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:35.834+0000 7f49437fe640 1 -- 172.21.15.78:0/1343242759 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f495c06f3a0 con 0x7f49440040d0 2024-09-17T03:08:36.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.005+0000 7f49614d5640 1 -- 172.21.15.78:0/1343242759 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f495c1630e0 con 0x7f4948078b90 2024-09-17T03:08:36.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.010+0000 7f49437fe640 1 -- 172.21.15.78:0/1343242759 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7f495c1630e0 con 0x7f4948078b90 2024-09-17T03:08:36.014 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:36.015 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:08:36.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.013+0000 7f49614d5640 1 -- 172.21.15.78:0/1343242759 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4948078b90 msgr2=0x7f494807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:36.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.013+0000 7f49614d5640 1 --2- 172.21.15.78:0/1343242759 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4948078b90 0x7f494807b0a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4950036000 tx=0x7f49500046c0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.013+0000 7f49614d5640 1 -- 172.21.15.78:0/1343242759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49440040d0 msgr2=0x7f495c15a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:36.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.013+0000 7f49614d5640 1 --2- 172.21.15.78:0/1343242759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49440040d0 0x7f495c15a030 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f494c003f70 tx=0x7f494c00f7e0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.013+0000 7f49614d5640 1 -- 172.21.15.78:0/1343242759 shutdown_connections 2024-09-17T03:08:36.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.013+0000 7f49614d5640 1 --2- 172.21.15.78:0/1343242759 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4948078b90 0x7f494807b0a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.013+0000 7f49614d5640 1 --2- 172.21.15.78:0/1343242759 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f495c0cced0 0x7f495c0c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.013+0000 7f49614d5640 1 --2- 172.21.15.78:0/1343242759 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f495c0ccac0 0x7f495c0c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.013+0000 7f49614d5640 1 --2- 172.21.15.78:0/1343242759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49440040d0 0x7f495c15a030 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.013+0000 7f49614d5640 1 -- 172.21.15.78:0/1343242759 >> 172.21.15.78:0/1343242759 conn(0x7f495c08bfc0 msgr2=0x7f495c06ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.013+0000 7f49614d5640 1 -- 172.21.15.78:0/1343242759 shutdown_connections 2024-09-17T03:08:36.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.013+0000 7f49614d5640 1 -- 172.21.15.78:0/1343242759 wait complete. 2024-09-17T03:08:36.023 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-17T03:08:35.119833+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223440,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751280,"statfs":{"total":773094113280,"available":772865310720,"internally_reserved":0,"allocated":3121152,"data_stored":1842412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.899348"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100906+0000","last_change":"2024-09-17T03:08:28.257527+0000","last_active":"2024-09-17T03:08:30.100906+0000","last_peered":"2024-09-17T03:08:30.100906+0000","last_clean":"2024-09-17T03:08:30.100906+0000","last_became_active":"2024-09-17T03:08:28.257066+0000","last_became_peered":"2024-09-17T03:08:28.257066+0000","last_unstale":"2024-09-17T03:08:30.100906+0000","last_undegraded":"2024-09-17T03:08:30.100906+0000","last_fullsized":"2024-09-17T03:08:30.100906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:02.975303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230784+0000","last_change":"2024-09-17T03:08:28.254760+0000","last_active":"2024-09-17T03:08:30.230784+0000","last_peered":"2024-09-17T03:08:30.230784+0000","last_clean":"2024-09-17T03:08:30.230784+0000","last_became_active":"2024-09-17T03:08:28.254472+0000","last_became_peered":"2024-09-17T03:08:28.254472+0000","last_unstale":"2024-09-17T03:08:30.230784+0000","last_undegraded":"2024-09-17T03:08:30.230784+0000","last_fullsized":"2024-09-17T03:08:30.230784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:58.189179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293417+0000","last_change":"2024-09-17T03:08:28.252512+0000","last_active":"2024-09-17T03:08:30.293417+0000","last_peered":"2024-09-17T03:08:30.293417+0000","last_clean":"2024-09-17T03:08:30.293417+0000","last_became_active":"2024-09-17T03:08:28.252206+0000","last_became_peered":"2024-09-17T03:08:28.252206+0000","last_unstale":"2024-09-17T03:08:30.293417+0000","last_undegraded":"2024-09-17T03:08:30.293417+0000","last_fullsized":"2024-09-17T03:08:30.293417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:50.820653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293517+0000","last_change":"2024-09-17T03:08:28.256056+0000","last_active":"2024-09-17T03:08:30.293517+0000","last_peered":"2024-09-17T03:08:30.293517+0000","last_clean":"2024-09-17T03:08:30.293517+0000","last_became_active":"2024-09-17T03:08:28.253346+0000","last_became_peered":"2024-09-17T03:08:28.253346+0000","last_unstale":"2024-09-17T03:08:30.293517+0000","last_undegraded":"2024-09-17T03:08:30.293517+0000","last_fullsized":"2024-09-17T03:08:30.293517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:50.397039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100669+0000","last_change":"2024-09-17T03:08:28.254995+0000","last_active":"2024-09-17T03:08:30.100669+0000","last_peered":"2024-09-17T03:08:30.100669+0000","last_clean":"2024-09-17T03:08:30.100669+0000","last_became_active":"2024-09-17T03:08:28.254698+0000","last_became_peered":"2024-09-17T03:08:28.254698+0000","last_unstale":"2024-09-17T03:08:30.100669+0000","last_undegraded":"2024-09-17T03:08:30.100669+0000","last_fullsized":"2024-09-17T03:08:30.100669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:54.201357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293326+0000","last_change":"2024-09-17T03:08:28.256649+0000","last_active":"2024-09-17T03:08:30.293326+0000","last_peered":"2024-09-17T03:08:30.293326+0000","last_clean":"2024-09-17T03:08:30.293326+0000","last_became_active":"2024-09-17T03:08:28.256251+0000","last_became_peered":"2024-09-17T03:08:28.256251+0000","last_unstale":"2024-09-17T03:08:30.293326+0000","last_undegraded":"2024-09-17T03:08:30.293326+0000","last_fullsized":"2024-09-17T03:08:30.293326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:24.543132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100346+0000","last_change":"2024-09-17T03:08:28.253738+0000","last_active":"2024-09-17T03:08:30.100346+0000","last_peered":"2024-09-17T03:08:30.100346+0000","last_clean":"2024-09-17T03:08:30.100346+0000","last_became_active":"2024-09-17T03:08:28.253409+0000","last_became_peered":"2024-09-17T03:08:28.253409+0000","last_unstale":"2024-09-17T03:08:30.100346+0000","last_undegraded":"2024-09-17T03:08:30.100346+0000","last_fullsized":"2024-09-17T03:08:30.100346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:50.397039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226452+0000","last_change":"2024-09-17T03:08:28.259418+0000","last_active":"2024-09-17T03:08:29.226452+0000","last_peered":"2024-09-17T03:08:29.226452+0000","last_clean":"2024-09-17T03:08:29.226452+0000","last_became_active":"2024-09-17T03:08:28.259145+0000","last_became_peered":"2024-09-17T03:08:28.259145+0000","last_unstale":"2024-09-17T03:08:29.226452+0000","last_undegraded":"2024-09-17T03:08:29.226452+0000","last_fullsized":"2024-09-17T03:08:29.226452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:24.693205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100914+0000","last_change":"2024-09-17T03:08:28.250578+0000","last_active":"2024-09-17T03:08:30.100914+0000","last_peered":"2024-09-17T03:08:30.100914+0000","last_clean":"2024-09-17T03:08:30.100914+0000","last_became_active":"2024-09-17T03:08:28.250237+0000","last_became_peered":"2024-09-17T03:08:28.250237+0000","last_unstale":"2024-09-17T03:08:30.100914+0000","last_undegraded":"2024-09-17T03:08:30.100914+0000","last_fullsized":"2024-09-17T03:08:30.100914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:25.083828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229259+0000","last_change":"2024-09-17T03:08:28.239497+0000","last_active":"2024-09-17T03:08:29.229259+0000","last_peered":"2024-09-17T03:08:29.229259+0000","last_clean":"2024-09-17T03:08:29.229259+0000","last_became_active":"2024-09-17T03:08:28.239187+0000","last_became_peered":"2024-09-17T03:08:28.239187+0000","last_unstale":"2024-09-17T03:08:29.229259+0000","last_undegraded":"2024-09-17T03:08:29.229259+0000","last_fullsized":"2024-09-17T03:08:29.229259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:02.757538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228039+0000","last_change":"2024-09-17T03:08:28.250102+0000","last_active":"2024-09-17T03:08:29.228039+0000","last_peered":"2024-09-17T03:08:29.228039+0000","last_clean":"2024-09-17T03:08:29.228039+0000","last_became_active":"2024-09-17T03:08:28.249797+0000","last_became_peered":"2024-09-17T03:08:28.249797+0000","last_unstale":"2024-09-17T03:08:29.228039+0000","last_undegraded":"2024-09-17T03:08:29.228039+0000","last_fullsized":"2024-09-17T03:08:29.228039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:19.446465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228129+0000","last_change":"2024-09-17T03:08:28.233620+0000","last_active":"2024-09-17T03:08:29.228129+0000","last_peered":"2024-09-17T03:08:29.228129+0000","last_clean":"2024-09-17T03:08:29.228129+0000","last_became_active":"2024-09-17T03:08:28.233312+0000","last_became_peered":"2024-09-17T03:08:28.233312+0000","last_unstale":"2024-09-17T03:08:29.228129+0000","last_undegraded":"2024-09-17T03:08:29.228129+0000","last_fullsized":"2024-09-17T03:08:29.228129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:39.083175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226708+0000","last_change":"2024-09-17T03:08:28.253338+0000","last_active":"2024-09-17T03:08:29.226708+0000","last_peered":"2024-09-17T03:08:29.226708+0000","last_clean":"2024-09-17T03:08:29.226708+0000","last_became_active":"2024-09-17T03:08:28.252284+0000","last_became_peered":"2024-09-17T03:08:28.252284+0000","last_unstale":"2024-09-17T03:08:29.226708+0000","last_undegraded":"2024-09-17T03:08:29.226708+0000","last_fullsized":"2024-09-17T03:08:29.226708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:47.945736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293003+0000","last_change":"2024-09-17T03:08:28.249001+0000","last_active":"2024-09-17T03:08:30.293003+0000","last_peered":"2024-09-17T03:08:30.293003+0000","last_clean":"2024-09-17T03:08:30.293003+0000","last_became_active":"2024-09-17T03:08:28.248702+0000","last_became_peered":"2024-09-17T03:08:28.248702+0000","last_unstale":"2024-09-17T03:08:30.293003+0000","last_undegraded":"2024-09-17T03:08:30.293003+0000","last_fullsized":"2024-09-17T03:08:30.293003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:21.958019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230664+0000","last_change":"2024-09-17T03:08:28.238314+0000","last_active":"2024-09-17T03:08:30.230664+0000","last_peered":"2024-09-17T03:08:30.230664+0000","last_clean":"2024-09-17T03:08:30.230664+0000","last_became_active":"2024-09-17T03:08:28.237653+0000","last_became_peered":"2024-09-17T03:08:28.237653+0000","last_unstale":"2024-09-17T03:08:30.230664+0000","last_undegraded":"2024-09-17T03:08:30.230664+0000","last_fullsized":"2024-09-17T03:08:30.230664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:05.501480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293426+0000","last_change":"2024-09-17T03:08:28.259958+0000","last_active":"2024-09-17T03:08:30.293426+0000","last_peered":"2024-09-17T03:08:30.293426+0000","last_clean":"2024-09-17T03:08:30.293426+0000","last_became_active":"2024-09-17T03:08:28.259595+0000","last_became_peered":"2024-09-17T03:08:28.259595+0000","last_unstale":"2024-09-17T03:08:30.293426+0000","last_undegraded":"2024-09-17T03:08:30.293426+0000","last_fullsized":"2024-09-17T03:08:30.293426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:10.650757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.294099+0000","last_change":"2024-09-17T03:08:28.253047+0000","last_active":"2024-09-17T03:08:30.294099+0000","last_peered":"2024-09-17T03:08:30.294099+0000","last_clean":"2024-09-17T03:08:30.294099+0000","last_became_active":"2024-09-17T03:08:28.252464+0000","last_became_peered":"2024-09-17T03:08:28.252464+0000","last_unstale":"2024-09-17T03:08:30.294099+0000","last_undegraded":"2024-09-17T03:08:30.294099+0000","last_fullsized":"2024-09-17T03:08:30.294099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:46.436651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.292836+0000","last_change":"2024-09-17T03:08:28.236142+0000","last_active":"2024-09-17T03:08:30.292836+0000","last_peered":"2024-09-17T03:08:30.292836+0000","last_clean":"2024-09-17T03:08:30.292836+0000","last_became_active":"2024-09-17T03:08:28.234294+0000","last_became_peered":"2024-09-17T03:08:28.234294+0000","last_unstale":"2024-09-17T03:08:30.292836+0000","last_undegraded":"2024-09-17T03:08:30.292836+0000","last_fullsized":"2024-09-17T03:08:30.292836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:14.380494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100799+0000","last_change":"2024-09-17T03:08:28.253214+0000","last_active":"2024-09-17T03:08:30.100799+0000","last_peered":"2024-09-17T03:08:30.100799+0000","last_clean":"2024-09-17T03:08:30.100799+0000","last_became_active":"2024-09-17T03:08:28.251617+0000","last_became_peered":"2024-09-17T03:08:28.251617+0000","last_unstale":"2024-09-17T03:08:30.100799+0000","last_undegraded":"2024-09-17T03:08:30.100799+0000","last_fullsized":"2024-09-17T03:08:30.100799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:46.436651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228620+0000","last_change":"2024-09-17T03:08:28.234354+0000","last_active":"2024-09-17T03:08:29.228620+0000","last_peered":"2024-09-17T03:08:29.228620+0000","last_clean":"2024-09-17T03:08:29.228620+0000","last_became_active":"2024-09-17T03:08:28.234028+0000","last_became_peered":"2024-09-17T03:08:28.234028+0000","last_unstale":"2024-09-17T03:08:29.228620+0000","last_undegraded":"2024-09-17T03:08:29.228620+0000","last_fullsized":"2024-09-17T03:08:29.228620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:45.993058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293511+0000","last_change":"2024-09-17T03:08:28.254197+0000","last_active":"2024-09-17T03:08:30.293511+0000","last_peered":"2024-09-17T03:08:30.293511+0000","last_clean":"2024-09-17T03:08:30.293511+0000","last_became_active":"2024-09-17T03:08:28.253658+0000","last_became_peered":"2024-09-17T03:08:28.253658+0000","last_unstale":"2024-09-17T03:08:30.293511+0000","last_undegraded":"2024-09-17T03:08:30.293511+0000","last_fullsized":"2024-09-17T03:08:30.293511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:32.455387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293415+0000","last_change":"2024-09-17T03:08:28.251554+0000","last_active":"2024-09-17T03:08:30.293415+0000","last_peered":"2024-09-17T03:08:30.293415+0000","last_clean":"2024-09-17T03:08:30.293415+0000","last_became_active":"2024-09-17T03:08:28.251248+0000","last_became_peered":"2024-09-17T03:08:28.251248+0000","last_unstale":"2024-09-17T03:08:30.293415+0000","last_undegraded":"2024-09-17T03:08:30.293415+0000","last_fullsized":"2024-09-17T03:08:30.293415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:26.430483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226932+0000","last_change":"2024-09-17T03:08:28.251521+0000","last_active":"2024-09-17T03:08:29.226932+0000","last_peered":"2024-09-17T03:08:29.226932+0000","last_clean":"2024-09-17T03:08:29.226932+0000","last_became_active":"2024-09-17T03:08:28.250475+0000","last_became_peered":"2024-09-17T03:08:28.250475+0000","last_unstale":"2024-09-17T03:08:29.226932+0000","last_undegraded":"2024-09-17T03:08:29.226932+0000","last_fullsized":"2024-09-17T03:08:29.226932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:05.560274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293354+0000","last_change":"2024-09-17T03:08:28.252379+0000","last_active":"2024-09-17T03:08:30.293354+0000","last_peered":"2024-09-17T03:08:30.293354+0000","last_clean":"2024-09-17T03:08:30.293354+0000","last_became_active":"2024-09-17T03:08:28.252064+0000","last_became_peered":"2024-09-17T03:08:28.252064+0000","last_unstale":"2024-09-17T03:08:30.293354+0000","last_undegraded":"2024-09-17T03:08:30.293354+0000","last_fullsized":"2024-09-17T03:08:30.293354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:38.557690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226859+0000","last_change":"2024-09-17T03:08:28.251210+0000","last_active":"2024-09-17T03:08:29.226859+0000","last_peered":"2024-09-17T03:08:29.226859+0000","last_clean":"2024-09-17T03:08:29.226859+0000","last_became_active":"2024-09-17T03:08:28.250780+0000","last_became_peered":"2024-09-17T03:08:28.250780+0000","last_unstale":"2024-09-17T03:08:29.226859+0000","last_undegraded":"2024-09-17T03:08:29.226859+0000","last_fullsized":"2024-09-17T03:08:29.226859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:39.174363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229299+0000","last_change":"2024-09-17T03:08:28.245417+0000","last_active":"2024-09-17T03:08:29.229299+0000","last_peered":"2024-09-17T03:08:29.229299+0000","last_clean":"2024-09-17T03:08:29.229299+0000","last_became_active":"2024-09-17T03:08:28.245091+0000","last_became_peered":"2024-09-17T03:08:28.245091+0000","last_unstale":"2024-09-17T03:08:29.229299+0000","last_undegraded":"2024-09-17T03:08:29.229299+0000","last_fullsized":"2024-09-17T03:08:29.229299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:15.100672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230750+0000","last_change":"2024-09-17T03:08:28.244539+0000","last_active":"2024-09-17T03:08:30.230750+0000","last_peered":"2024-09-17T03:08:30.230750+0000","last_clean":"2024-09-17T03:08:30.230750+0000","last_became_active":"2024-09-17T03:08:28.244240+0000","last_became_peered":"2024-09-17T03:08:28.244240+0000","last_unstale":"2024-09-17T03:08:30.230750+0000","last_undegraded":"2024-09-17T03:08:30.230750+0000","last_fullsized":"2024-09-17T03:08:30.230750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:46.318120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.227040+0000","last_change":"2024-09-17T03:08:28.251521+0000","last_active":"2024-09-17T03:08:29.227040+0000","last_peered":"2024-09-17T03:08:29.227040+0000","last_clean":"2024-09-17T03:08:29.227040+0000","last_became_active":"2024-09-17T03:08:28.250298+0000","last_became_peered":"2024-09-17T03:08:28.250298+0000","last_unstale":"2024-09-17T03:08:29.227040+0000","last_undegraded":"2024-09-17T03:08:29.227040+0000","last_fullsized":"2024-09-17T03:08:29.227040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:16.379808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293430+0000","last_change":"2024-09-17T03:08:28.253949+0000","last_active":"2024-09-17T03:08:30.293430+0000","last_peered":"2024-09-17T03:08:30.293430+0000","last_clean":"2024-09-17T03:08:30.293430+0000","last_became_active":"2024-09-17T03:08:28.253392+0000","last_became_peered":"2024-09-17T03:08:28.253392+0000","last_unstale":"2024-09-17T03:08:30.293430+0000","last_undegraded":"2024-09-17T03:08:30.293430+0000","last_fullsized":"2024-09-17T03:08:30.293430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:47.772625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293974+0000","last_change":"2024-09-17T03:08:28.258249+0000","last_active":"2024-09-17T03:08:30.293974+0000","last_peered":"2024-09-17T03:08:30.293974+0000","last_clean":"2024-09-17T03:08:30.293974+0000","last_became_active":"2024-09-17T03:08:28.253257+0000","last_became_peered":"2024-09-17T03:08:28.253257+0000","last_unstale":"2024-09-17T03:08:30.293974+0000","last_undegraded":"2024-09-17T03:08:30.293974+0000","last_fullsized":"2024-09-17T03:08:30.293974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:53.331937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293150+0000","last_change":"2024-09-17T03:08:28.242530+0000","last_active":"2024-09-17T03:08:30.293150+0000","last_peered":"2024-09-17T03:08:30.293150+0000","last_clean":"2024-09-17T03:08:30.293150+0000","last_became_active":"2024-09-17T03:08:28.242194+0000","last_became_peered":"2024-09-17T03:08:28.242194+0000","last_unstale":"2024-09-17T03:08:30.293150+0000","last_undegraded":"2024-09-17T03:08:30.293150+0000","last_fullsized":"2024-09-17T03:08:30.293150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:43.917645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228598+0000","last_change":"2024-09-17T03:08:28.254404+0000","last_active":"2024-09-17T03:08:29.228598+0000","last_peered":"2024-09-17T03:08:29.228598+0000","last_clean":"2024-09-17T03:08:29.228598+0000","last_became_active":"2024-09-17T03:08:28.254120+0000","last_became_peered":"2024-09-17T03:08:28.254120+0000","last_unstale":"2024-09-17T03:08:29.228598+0000","last_undegraded":"2024-09-17T03:08:29.228598+0000","last_fullsized":"2024-09-17T03:08:29.228598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:31.089608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229224+0000","last_change":"2024-09-17T03:08:28.240464+0000","last_active":"2024-09-17T03:08:29.229224+0000","last_peered":"2024-09-17T03:08:29.229224+0000","last_clean":"2024-09-17T03:08:29.229224+0000","last_became_active":"2024-09-17T03:08:28.240126+0000","last_became_peered":"2024-09-17T03:08:28.240126+0000","last_unstale":"2024-09-17T03:08:29.229224+0000","last_undegraded":"2024-09-17T03:08:29.229224+0000","last_fullsized":"2024-09-17T03:08:29.229224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:45.234781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.227135+0000","last_change":"2024-09-17T03:08:27.237198+0000","last_active":"2024-09-17T03:08:29.227135+0000","last_peered":"2024-09-17T03:08:29.227135+0000","last_clean":"2024-09-17T03:08:29.227135+0000","last_became_active":"2024-09-17T03:08:27.236843+0000","last_became_peered":"2024-09-17T03:08:27.236843+0000","last_unstale":"2024-09-17T03:08:29.227135+0000","last_undegraded":"2024-09-17T03:08:29.227135+0000","last_fullsized":"2024-09-17T03:08:29.227135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:37:55.460562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293718+0000","last_change":"2024-09-17T03:08:28.253848+0000","last_active":"2024-09-17T03:08:30.293718+0000","last_peered":"2024-09-17T03:08:30.293718+0000","last_clean":"2024-09-17T03:08:30.293718+0000","last_became_active":"2024-09-17T03:08:28.253338+0000","last_became_peered":"2024-09-17T03:08:28.253338+0000","last_unstale":"2024-09-17T03:08:30.293718+0000","last_undegraded":"2024-09-17T03:08:30.293718+0000","last_fullsized":"2024-09-17T03:08:30.293718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:10.650757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228202+0000","last_change":"2024-09-17T03:08:27.234560+0000","last_active":"2024-09-17T03:08:29.228202+0000","last_peered":"2024-09-17T03:08:29.228202+0000","last_clean":"2024-09-17T03:08:29.228202+0000","last_became_active":"2024-09-17T03:08:27.234229+0000","last_became_peered":"2024-09-17T03:08:27.234229+0000","last_unstale":"2024-09-17T03:08:29.228202+0000","last_undegraded":"2024-09-17T03:08:29.228202+0000","last_fullsized":"2024-09-17T03:08:29.228202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:00.000708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226514+0000","last_change":"2024-09-17T03:08:27.235234+0000","last_active":"2024-09-17T03:08:29.226514+0000","last_peered":"2024-09-17T03:08:29.226514+0000","last_clean":"2024-09-17T03:08:29.226514+0000","last_became_active":"2024-09-17T03:08:27.234619+0000","last_became_peered":"2024-09-17T03:08:27.234619+0000","last_unstale":"2024-09-17T03:08:29.226514+0000","last_undegraded":"2024-09-17T03:08:29.226514+0000","last_fullsized":"2024-09-17T03:08:29.226514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:03.610472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226522+0000","last_change":"2024-09-17T03:08:28.254403+0000","last_active":"2024-09-17T03:08:29.226522+0000","last_peered":"2024-09-17T03:08:29.226522+0000","last_clean":"2024-09-17T03:08:29.226522+0000","last_became_active":"2024-09-17T03:08:28.254108+0000","last_became_peered":"2024-09-17T03:08:28.254108+0000","last_unstale":"2024-09-17T03:08:29.226522+0000","last_undegraded":"2024-09-17T03:08:29.226522+0000","last_fullsized":"2024-09-17T03:08:29.226522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:24.259968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293550+0000","last_change":"2024-09-17T03:08:27.243918+0000","last_active":"2024-09-17T03:08:30.293550+0000","last_peered":"2024-09-17T03:08:30.293550+0000","last_clean":"2024-09-17T03:08:30.293550+0000","last_became_active":"2024-09-17T03:08:27.243599+0000","last_became_peered":"2024-09-17T03:08:27.243599+0000","last_unstale":"2024-09-17T03:08:30.293550+0000","last_undegraded":"2024-09-17T03:08:30.293550+0000","last_fullsized":"2024-09-17T03:08:30.293550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:54.113120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230690+0000","last_change":"2024-09-17T03:08:28.244814+0000","last_active":"2024-09-17T03:08:30.230690+0000","last_peered":"2024-09-17T03:08:30.230690+0000","last_clean":"2024-09-17T03:08:30.230690+0000","last_became_active":"2024-09-17T03:08:28.244535+0000","last_became_peered":"2024-09-17T03:08:28.244535+0000","last_unstale":"2024-09-17T03:08:30.230690+0000","last_undegraded":"2024-09-17T03:08:30.230690+0000","last_fullsized":"2024-09-17T03:08:30.230690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:32.455387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229081+0000","last_change":"2024-09-17T03:08:27.236752+0000","last_active":"2024-09-17T03:08:29.229081+0000","last_peered":"2024-09-17T03:08:29.229081+0000","last_clean":"2024-09-17T03:08:29.229081+0000","last_became_active":"2024-09-17T03:08:27.235857+0000","last_became_peered":"2024-09-17T03:08:27.235857+0000","last_unstale":"2024-09-17T03:08:29.229081+0000","last_undegraded":"2024-09-17T03:08:29.229081+0000","last_fullsized":"2024-09-17T03:08:29.229081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:46.272871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293746+0000","last_change":"2024-09-17T03:08:28.250397+0000","last_active":"2024-09-17T03:08:30.293746+0000","last_peered":"2024-09-17T03:08:30.293746+0000","last_clean":"2024-09-17T03:08:30.293746+0000","last_became_active":"2024-09-17T03:08:28.250087+0000","last_became_peered":"2024-09-17T03:08:28.250087+0000","last_unstale":"2024-09-17T03:08:30.293746+0000","last_undegraded":"2024-09-17T03:08:30.293746+0000","last_fullsized":"2024-09-17T03:08:30.293746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:49.687506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293814+0000","last_change":"2024-09-17T03:08:27.239555+0000","last_active":"2024-09-17T03:08:30.293814+0000","last_peered":"2024-09-17T03:08:30.293814+0000","last_clean":"2024-09-17T03:08:30.293814+0000","last_became_active":"2024-09-17T03:08:27.239051+0000","last_became_peered":"2024-09-17T03:08:27.239051+0000","last_unstale":"2024-09-17T03:08:30.293814+0000","last_undegraded":"2024-09-17T03:08:30.293814+0000","last_fullsized":"2024-09-17T03:08:30.293814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:01.379072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293660+0000","last_change":"2024-09-17T03:08:28.259335+0000","last_active":"2024-09-17T03:08:30.293660+0000","last_peered":"2024-09-17T03:08:30.293660+0000","last_clean":"2024-09-17T03:08:30.293660+0000","last_became_active":"2024-09-17T03:08:28.259026+0000","last_became_peered":"2024-09-17T03:08:28.259026+0000","last_unstale":"2024-09-17T03:08:30.293660+0000","last_undegraded":"2024-09-17T03:08:30.293660+0000","last_fullsized":"2024-09-17T03:08:30.293660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:33:49.370247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230846+0000","last_change":"2024-09-17T03:08:27.240839+0000","last_active":"2024-09-17T03:08:30.230846+0000","last_peered":"2024-09-17T03:08:30.230846+0000","last_clean":"2024-09-17T03:08:30.230846+0000","last_became_active":"2024-09-17T03:08:27.240389+0000","last_became_peered":"2024-09-17T03:08:27.240389+0000","last_unstale":"2024-09-17T03:08:30.230846+0000","last_undegraded":"2024-09-17T03:08:30.230846+0000","last_fullsized":"2024-09-17T03:08:30.230846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:13.374584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228399+0000","last_change":"2024-09-17T03:08:28.243850+0000","last_active":"2024-09-17T03:08:29.228399+0000","last_peered":"2024-09-17T03:08:29.228399+0000","last_clean":"2024-09-17T03:08:29.228399+0000","last_became_active":"2024-09-17T03:08:28.243516+0000","last_became_peered":"2024-09-17T03:08:28.243516+0000","last_unstale":"2024-09-17T03:08:29.228399+0000","last_undegraded":"2024-09-17T03:08:29.228399+0000","last_fullsized":"2024-09-17T03:08:29.228399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:02.105667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228627+0000","last_change":"2024-09-17T03:08:27.233543+0000","last_active":"2024-09-17T03:08:29.228627+0000","last_peered":"2024-09-17T03:08:29.228627+0000","last_clean":"2024-09-17T03:08:29.228627+0000","last_became_active":"2024-09-17T03:08:27.233120+0000","last_became_peered":"2024-09-17T03:08:27.233120+0000","last_unstale":"2024-09-17T03:08:29.228627+0000","last_undegraded":"2024-09-17T03:08:29.228627+0000","last_fullsized":"2024-09-17T03:08:29.228627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:49.898610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100513+0000","last_change":"2024-09-17T03:08:28.249563+0000","last_active":"2024-09-17T03:08:30.100513+0000","last_peered":"2024-09-17T03:08:30.100513+0000","last_clean":"2024-09-17T03:08:30.100513+0000","last_became_active":"2024-09-17T03:08:28.248913+0000","last_became_peered":"2024-09-17T03:08:28.248913+0000","last_unstale":"2024-09-17T03:08:30.100513+0000","last_undegraded":"2024-09-17T03:08:30.100513+0000","last_fullsized":"2024-09-17T03:08:30.100513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:04.018212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293675+0000","last_change":"2024-09-17T03:08:27.238166+0000","last_active":"2024-09-17T03:08:30.293675+0000","last_peered":"2024-09-17T03:08:30.293675+0000","last_clean":"2024-09-17T03:08:30.293675+0000","last_became_active":"2024-09-17T03:08:27.237602+0000","last_became_peered":"2024-09-17T03:08:27.237602+0000","last_unstale":"2024-09-17T03:08:30.293675+0000","last_undegraded":"2024-09-17T03:08:30.293675+0000","last_fullsized":"2024-09-17T03:08:30.293675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:53.340728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293088+0000","last_change":"2024-09-17T03:08:28.248412+0000","last_active":"2024-09-17T03:08:30.293088+0000","last_peered":"2024-09-17T03:08:30.293088+0000","last_clean":"2024-09-17T03:08:30.293088+0000","last_became_active":"2024-09-17T03:08:28.248075+0000","last_became_peered":"2024-09-17T03:08:28.248075+0000","last_unstale":"2024-09-17T03:08:30.293088+0000","last_undegraded":"2024-09-17T03:08:30.293088+0000","last_fullsized":"2024-09-17T03:08:30.293088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:49.394898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293581+0000","last_change":"2024-09-17T03:08:27.242493+0000","last_active":"2024-09-17T03:08:30.293581+0000","last_peered":"2024-09-17T03:08:30.293581+0000","last_clean":"2024-09-17T03:08:30.293581+0000","last_became_active":"2024-09-17T03:08:27.242234+0000","last_became_peered":"2024-09-17T03:08:27.242234+0000","last_unstale":"2024-09-17T03:08:30.293581+0000","last_undegraded":"2024-09-17T03:08:30.293581+0000","last_fullsized":"2024-09-17T03:08:30.293581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:06.000335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100522+0000","last_change":"2024-09-17T03:08:28.254369+0000","last_active":"2024-09-17T03:08:30.100522+0000","last_peered":"2024-09-17T03:08:30.100522+0000","last_clean":"2024-09-17T03:08:30.100522+0000","last_became_active":"2024-09-17T03:08:28.253975+0000","last_became_peered":"2024-09-17T03:08:28.253975+0000","last_unstale":"2024-09-17T03:08:30.100522+0000","last_undegraded":"2024-09-17T03:08:30.100522+0000","last_fullsized":"2024-09-17T03:08:30.100522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:49.687506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228261+0000","last_change":"2024-09-17T03:08:27.235168+0000","last_active":"2024-09-17T03:08:29.228261+0000","last_peered":"2024-09-17T03:08:29.228261+0000","last_clean":"2024-09-17T03:08:29.228261+0000","last_became_active":"2024-09-17T03:08:27.234834+0000","last_became_peered":"2024-09-17T03:08:27.234834+0000","last_unstale":"2024-09-17T03:08:29.228261+0000","last_undegraded":"2024-09-17T03:08:29.228261+0000","last_fullsized":"2024-09-17T03:08:29.228261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:49.599813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228186+0000","last_change":"2024-09-17T03:08:28.253542+0000","last_active":"2024-09-17T03:08:29.228186+0000","last_peered":"2024-09-17T03:08:29.228186+0000","last_clean":"2024-09-17T03:08:29.228186+0000","last_became_active":"2024-09-17T03:08:28.253220+0000","last_became_peered":"2024-09-17T03:08:28.253220+0000","last_unstale":"2024-09-17T03:08:29.228186+0000","last_undegraded":"2024-09-17T03:08:29.228186+0000","last_fullsized":"2024-09-17T03:08:29.228186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:28.459370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293108+0000","last_change":"2024-09-17T03:08:27.235156+0000","last_active":"2024-09-17T03:08:30.293108+0000","last_peered":"2024-09-17T03:08:30.293108+0000","last_clean":"2024-09-17T03:08:30.293108+0000","last_became_active":"2024-09-17T03:08:27.234841+0000","last_became_peered":"2024-09-17T03:08:27.234841+0000","last_unstale":"2024-09-17T03:08:30.293108+0000","last_undegraded":"2024-09-17T03:08:30.293108+0000","last_fullsized":"2024-09-17T03:08:30.293108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:16.837042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100424+0000","last_change":"2024-09-17T03:08:28.250970+0000","last_active":"2024-09-17T03:08:30.100424+0000","last_peered":"2024-09-17T03:08:30.100424+0000","last_clean":"2024-09-17T03:08:30.100424+0000","last_became_active":"2024-09-17T03:08:28.250653+0000","last_became_peered":"2024-09-17T03:08:28.250653+0000","last_unstale":"2024-09-17T03:08:30.100424+0000","last_undegraded":"2024-09-17T03:08:30.100424+0000","last_fullsized":"2024-09-17T03:08:30.100424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:04.627763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229443+0000","last_change":"2024-09-17T03:08:27.239830+0000","last_active":"2024-09-17T03:08:29.229443+0000","last_peered":"2024-09-17T03:08:29.229443+0000","last_clean":"2024-09-17T03:08:29.229443+0000","last_became_active":"2024-09-17T03:08:27.239481+0000","last_became_peered":"2024-09-17T03:08:27.239481+0000","last_unstale":"2024-09-17T03:08:29.229443+0000","last_undegraded":"2024-09-17T03:08:29.229443+0000","last_fullsized":"2024-09-17T03:08:29.229443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:33:35.844983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100795+0000","last_change":"2024-09-17T03:08:28.252808+0000","last_active":"2024-09-17T03:08:30.100795+0000","last_peered":"2024-09-17T03:08:30.100795+0000","last_clean":"2024-09-17T03:08:30.100795+0000","last_became_active":"2024-09-17T03:08:28.251890+0000","last_became_peered":"2024-09-17T03:08:28.251890+0000","last_unstale":"2024-09-17T03:08:30.100795+0000","last_undegraded":"2024-09-17T03:08:30.100795+0000","last_fullsized":"2024-09-17T03:08:30.100795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:53.331937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.292969+0000","last_change":"2024-09-17T03:08:27.234272+0000","last_active":"2024-09-17T03:08:30.292969+0000","last_peered":"2024-09-17T03:08:30.292969+0000","last_clean":"2024-09-17T03:08:30.292969+0000","last_became_active":"2024-09-17T03:08:27.233923+0000","last_became_peered":"2024-09-17T03:08:27.233923+0000","last_unstale":"2024-09-17T03:08:30.292969+0000","last_undegraded":"2024-09-17T03:08:30.292969+0000","last_fullsized":"2024-09-17T03:08:30.292969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:06.000335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.101081+0000","last_change":"2024-09-17T03:08:28.250706+0000","last_active":"2024-09-17T03:08:30.101081+0000","last_peered":"2024-09-17T03:08:30.101081+0000","last_clean":"2024-09-17T03:08:30.101081+0000","last_became_active":"2024-09-17T03:08:28.250367+0000","last_became_peered":"2024-09-17T03:08:28.250367+0000","last_unstale":"2024-09-17T03:08:30.101081+0000","last_undegraded":"2024-09-17T03:08:30.101081+0000","last_fullsized":"2024-09-17T03:08:30.101081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:42.809585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230875+0000","last_change":"2024-09-17T03:08:27.227624+0000","last_active":"2024-09-17T03:08:30.230875+0000","last_peered":"2024-09-17T03:08:30.230875+0000","last_clean":"2024-09-17T03:08:30.230875+0000","last_became_active":"2024-09-17T03:08:27.227272+0000","last_became_peered":"2024-09-17T03:08:27.227272+0000","last_unstale":"2024-09-17T03:08:30.230875+0000","last_undegraded":"2024-09-17T03:08:30.230875+0000","last_fullsized":"2024-09-17T03:08:30.230875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:40.068941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293879+0000","last_change":"2024-09-17T03:08:28.255711+0000","last_active":"2024-09-17T03:08:30.293879+0000","last_peered":"2024-09-17T03:08:30.293879+0000","last_clean":"2024-09-17T03:08:30.293879+0000","last_became_active":"2024-09-17T03:08:28.252986+0000","last_became_peered":"2024-09-17T03:08:28.252986+0000","last_unstale":"2024-09-17T03:08:30.293879+0000","last_undegraded":"2024-09-17T03:08:30.293879+0000","last_fullsized":"2024-09-17T03:08:30.293879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:48.623610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293439+0000","last_change":"2024-09-17T03:08:27.239700+0000","last_active":"2024-09-17T03:08:30.293439+0000","last_peered":"2024-09-17T03:08:30.293439+0000","last_clean":"2024-09-17T03:08:30.293439+0000","last_became_active":"2024-09-17T03:08:27.239372+0000","last_became_peered":"2024-09-17T03:08:27.239372+0000","last_unstale":"2024-09-17T03:08:30.293439+0000","last_undegraded":"2024-09-17T03:08:30.293439+0000","last_fullsized":"2024-09-17T03:08:30.293439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:01.379072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100531+0000","last_change":"2024-09-17T03:08:28.252014+0000","last_active":"2024-09-17T03:08:30.100531+0000","last_peered":"2024-09-17T03:08:30.100531+0000","last_clean":"2024-09-17T03:08:30.100531+0000","last_became_active":"2024-09-17T03:08:28.250240+0000","last_became_peered":"2024-09-17T03:08:28.250240+0000","last_unstale":"2024-09-17T03:08:30.100531+0000","last_undegraded":"2024-09-17T03:08:30.100531+0000","last_fullsized":"2024-09-17T03:08:30.100531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:27.579756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100182+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:08:30.100182+0000","last_peered":"2024-09-17T03:08:30.100182+0000","last_clean":"2024-09-17T03:08:30.100182+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:08:30.100182+0000","last_undegraded":"2024-09-17T03:08:30.100182+0000","last_fullsized":"2024-09-17T03:08:30.100182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293225+0000","last_change":"2024-09-17T03:08:27.241373+0000","last_active":"2024-09-17T03:08:30.293225+0000","last_peered":"2024-09-17T03:08:30.293225+0000","last_clean":"2024-09-17T03:08:30.293225+0000","last_became_active":"2024-09-17T03:08:27.240394+0000","last_became_peered":"2024-09-17T03:08:27.240394+0000","last_unstale":"2024-09-17T03:08:30.293225+0000","last_undegraded":"2024-09-17T03:08:30.293225+0000","last_fullsized":"2024-09-17T03:08:30.293225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:37.172953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226720+0000","last_change":"2024-09-17T03:08:28.262359+0000","last_active":"2024-09-17T03:08:29.226720+0000","last_peered":"2024-09-17T03:08:29.226720+0000","last_clean":"2024-09-17T03:08:29.226720+0000","last_became_active":"2024-09-17T03:08:28.262020+0000","last_became_peered":"2024-09-17T03:08:28.262020+0000","last_unstale":"2024-09-17T03:08:29.226720+0000","last_undegraded":"2024-09-17T03:08:29.226720+0000","last_fullsized":"2024-09-17T03:08:29.226720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:09.171993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.099995+0000","last_change":"2024-09-17T03:08:27.244435+0000","last_active":"2024-09-17T03:08:30.099995+0000","last_peered":"2024-09-17T03:08:30.099995+0000","last_clean":"2024-09-17T03:08:30.099995+0000","last_became_active":"2024-09-17T03:08:27.243833+0000","last_became_peered":"2024-09-17T03:08:27.243833+0000","last_unstale":"2024-09-17T03:08:30.099995+0000","last_undegraded":"2024-09-17T03:08:30.099995+0000","last_fullsized":"2024-09-17T03:08:30.099995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:09.601815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.292828+0000","last_change":"2024-09-17T03:08:28.251066+0000","last_active":"2024-09-17T03:08:30.292828+0000","last_peered":"2024-09-17T03:08:30.292828+0000","last_clean":"2024-09-17T03:08:30.292828+0000","last_became_active":"2024-09-17T03:08:28.250555+0000","last_became_peered":"2024-09-17T03:08:28.250555+0000","last_unstale":"2024-09-17T03:08:30.292828+0000","last_undegraded":"2024-09-17T03:08:30.292828+0000","last_fullsized":"2024-09-17T03:08:30.292828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:41.542823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293285+0000","last_change":"2024-09-17T03:08:27.231665+0000","last_active":"2024-09-17T03:08:30.293285+0000","last_peered":"2024-09-17T03:08:30.293285+0000","last_clean":"2024-09-17T03:08:30.293285+0000","last_became_active":"2024-09-17T03:08:27.231326+0000","last_became_peered":"2024-09-17T03:08:27.231326+0000","last_unstale":"2024-09-17T03:08:30.293285+0000","last_undegraded":"2024-09-17T03:08:30.293285+0000","last_fullsized":"2024-09-17T03:08:30.293285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:40.068941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230630+0000","last_change":"2024-09-17T03:08:28.242273+0000","last_active":"2024-09-17T03:08:30.230630+0000","last_peered":"2024-09-17T03:08:30.230630+0000","last_clean":"2024-09-17T03:08:30.230630+0000","last_became_active":"2024-09-17T03:08:28.241745+0000","last_became_peered":"2024-09-17T03:08:28.241745+0000","last_unstale":"2024-09-17T03:08:30.230630+0000","last_undegraded":"2024-09-17T03:08:30.230630+0000","last_fullsized":"2024-09-17T03:08:30.230630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:47.772625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293927+0000","last_change":"2024-09-17T03:08:27.246886+0000","last_active":"2024-09-17T03:08:30.293927+0000","last_peered":"2024-09-17T03:08:30.293927+0000","last_clean":"2024-09-17T03:08:30.293927+0000","last_became_active":"2024-09-17T03:08:27.246549+0000","last_became_peered":"2024-09-17T03:08:27.246549+0000","last_unstale":"2024-09-17T03:08:30.293927+0000","last_undegraded":"2024-09-17T03:08:30.293927+0000","last_fullsized":"2024-09-17T03:08:30.293927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:54.447491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229198+0000","last_change":"2024-09-17T03:08:28.256574+0000","last_active":"2024-09-17T03:08:29.229198+0000","last_peered":"2024-09-17T03:08:29.229198+0000","last_clean":"2024-09-17T03:08:29.229198+0000","last_became_active":"2024-09-17T03:08:28.255700+0000","last_became_peered":"2024-09-17T03:08:28.255700+0000","last_unstale":"2024-09-17T03:08:29.229198+0000","last_undegraded":"2024-09-17T03:08:29.229198+0000","last_fullsized":"2024-09-17T03:08:29.229198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:51.178653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230655+0000","last_change":"2024-09-17T03:08:27.239229+0000","last_active":"2024-09-17T03:08:30.230655+0000","last_peered":"2024-09-17T03:08:30.230655+0000","last_clean":"2024-09-17T03:08:30.230655+0000","last_became_active":"2024-09-17T03:08:27.238923+0000","last_became_peered":"2024-09-17T03:08:27.238923+0000","last_unstale":"2024-09-17T03:08:30.230655+0000","last_undegraded":"2024-09-17T03:08:30.230655+0000","last_fullsized":"2024-09-17T03:08:30.230655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:01.379072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293818+0000","last_change":"2024-09-17T03:08:28.255621+0000","last_active":"2024-09-17T03:08:30.293818+0000","last_peered":"2024-09-17T03:08:30.293818+0000","last_clean":"2024-09-17T03:08:30.293818+0000","last_became_active":"2024-09-17T03:08:28.255238+0000","last_became_peered":"2024-09-17T03:08:28.255238+0000","last_unstale":"2024-09-17T03:08:30.293818+0000","last_undegraded":"2024-09-17T03:08:30.293818+0000","last_fullsized":"2024-09-17T03:08:30.293818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:27.579756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100826+0000","last_change":"2024-09-17T03:08:27.244240+0000","last_active":"2024-09-17T03:08:30.100826+0000","last_peered":"2024-09-17T03:08:30.100826+0000","last_clean":"2024-09-17T03:08:30.100826+0000","last_became_active":"2024-09-17T03:08:27.243875+0000","last_became_peered":"2024-09-17T03:08:27.243875+0000","last_unstale":"2024-09-17T03:08:30.100826+0000","last_undegraded":"2024-09-17T03:08:30.100826+0000","last_fullsized":"2024-09-17T03:08:30.100826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:22.964776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230744+0000","last_change":"2024-09-17T03:08:28.244841+0000","last_active":"2024-09-17T03:08:30.230744+0000","last_peered":"2024-09-17T03:08:30.230744+0000","last_clean":"2024-09-17T03:08:30.230744+0000","last_became_active":"2024-09-17T03:08:28.244270+0000","last_became_peered":"2024-09-17T03:08:28.244270+0000","last_unstale":"2024-09-17T03:08:30.230744+0000","last_undegraded":"2024-09-17T03:08:30.230744+0000","last_fullsized":"2024-09-17T03:08:30.230744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:33:49.370247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.232271+0000","last_change":"2024-09-17T03:08:27.233708+0000","last_active":"2024-09-17T03:08:30.232271+0000","last_peered":"2024-09-17T03:08:30.232271+0000","last_clean":"2024-09-17T03:08:30.232271+0000","last_became_active":"2024-09-17T03:08:27.233372+0000","last_became_peered":"2024-09-17T03:08:27.233372+0000","last_unstale":"2024-09-17T03:08:30.232271+0000","last_undegraded":"2024-09-17T03:08:30.232271+0000","last_fullsized":"2024-09-17T03:08:30.232271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:54.447491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226938+0000","last_change":"2024-09-17T03:08:28.250727+0000","last_active":"2024-09-17T03:08:29.226938+0000","last_peered":"2024-09-17T03:08:29.226938+0000","last_clean":"2024-09-17T03:08:29.226938+0000","last_became_active":"2024-09-17T03:08:28.250399+0000","last_became_peered":"2024-09-17T03:08:28.250399+0000","last_unstale":"2024-09-17T03:08:29.226938+0000","last_undegraded":"2024-09-17T03:08:29.226938+0000","last_fullsized":"2024-09-17T03:08:29.226938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:27.379811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229217+0000","last_change":"2024-09-17T03:08:27.237826+0000","last_active":"2024-09-17T03:08:29.229217+0000","last_peered":"2024-09-17T03:08:29.229217+0000","last_clean":"2024-09-17T03:08:29.229217+0000","last_became_active":"2024-09-17T03:08:27.237278+0000","last_became_peered":"2024-09-17T03:08:27.237278+0000","last_unstale":"2024-09-17T03:08:29.229217+0000","last_undegraded":"2024-09-17T03:08:29.229217+0000","last_fullsized":"2024-09-17T03:08:29.229217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:54.762062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293785+0000","last_change":"2024-09-17T03:08:28.248479+0000","last_active":"2024-09-17T03:08:30.293785+0000","last_peered":"2024-09-17T03:08:30.293785+0000","last_clean":"2024-09-17T03:08:30.293785+0000","last_became_active":"2024-09-17T03:08:28.248131+0000","last_became_peered":"2024-09-17T03:08:28.248131+0000","last_unstale":"2024-09-17T03:08:30.293785+0000","last_undegraded":"2024-09-17T03:08:30.293785+0000","last_fullsized":"2024-09-17T03:08:30.293785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:58.189179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.099980+0000","last_change":"2024-09-17T03:08:27.241677+0000","last_active":"2024-09-17T03:08:30.099980+0000","last_peered":"2024-09-17T03:08:30.099980+0000","last_clean":"2024-09-17T03:08:30.099980+0000","last_became_active":"2024-09-17T03:08:27.241334+0000","last_became_peered":"2024-09-17T03:08:27.241334+0000","last_unstale":"2024-09-17T03:08:30.099980+0000","last_undegraded":"2024-09-17T03:08:30.099980+0000","last_fullsized":"2024-09-17T03:08:30.099980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:01.099757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228778+0000","last_change":"2024-09-17T03:08:28.237275+0000","last_active":"2024-09-17T03:08:29.228778+0000","last_peered":"2024-09-17T03:08:29.228778+0000","last_clean":"2024-09-17T03:08:29.228778+0000","last_became_active":"2024-09-17T03:08:28.236973+0000","last_became_peered":"2024-09-17T03:08:28.236973+0000","last_unstale":"2024-09-17T03:08:29.228778+0000","last_undegraded":"2024-09-17T03:08:29.228778+0000","last_fullsized":"2024-09-17T03:08:29.228778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:38.240738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230822+0000","last_change":"2024-09-17T03:08:27.238083+0000","last_active":"2024-09-17T03:08:30.230822+0000","last_peered":"2024-09-17T03:08:30.230822+0000","last_clean":"2024-09-17T03:08:30.230822+0000","last_became_active":"2024-09-17T03:08:27.237734+0000","last_became_peered":"2024-09-17T03:08:27.237734+0000","last_unstale":"2024-09-17T03:08:30.230822+0000","last_undegraded":"2024-09-17T03:08:30.230822+0000","last_fullsized":"2024-09-17T03:08:30.230822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:54.113120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226699+0000","last_change":"2024-09-17T03:08:28.240568+0000","last_active":"2024-09-17T03:08:29.226699+0000","last_peered":"2024-09-17T03:08:29.226699+0000","last_clean":"2024-09-17T03:08:29.226699+0000","last_became_active":"2024-09-17T03:08:28.240266+0000","last_became_peered":"2024-09-17T03:08:28.240266+0000","last_unstale":"2024-09-17T03:08:29.226699+0000","last_undegraded":"2024-09-17T03:08:29.226699+0000","last_fullsized":"2024-09-17T03:08:29.226699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:11.049096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230817+0000","last_change":"2024-09-17T03:08:27.229679+0000","last_active":"2024-09-17T03:08:30.230817+0000","last_peered":"2024-09-17T03:08:30.230817+0000","last_clean":"2024-09-17T03:08:30.230817+0000","last_became_active":"2024-09-17T03:08:27.229368+0000","last_became_peered":"2024-09-17T03:08:27.229368+0000","last_unstale":"2024-09-17T03:08:30.230817+0000","last_undegraded":"2024-09-17T03:08:30.230817+0000","last_fullsized":"2024-09-17T03:08:30.230817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:33.251896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.227133+0000","last_change":"2024-09-17T03:08:28.258420+0000","last_active":"2024-09-17T03:08:29.227133+0000","last_peered":"2024-09-17T03:08:29.227133+0000","last_clean":"2024-09-17T03:08:29.227133+0000","last_became_active":"2024-09-17T03:08:28.258108+0000","last_became_peered":"2024-09-17T03:08:28.258108+0000","last_unstale":"2024-09-17T03:08:29.227133+0000","last_undegraded":"2024-09-17T03:08:29.227133+0000","last_fullsized":"2024-09-17T03:08:29.227133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:36.707700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100794+0000","last_change":"2024-09-17T03:08:27.241586+0000","last_active":"2024-09-17T03:08:30.100794+0000","last_peered":"2024-09-17T03:08:30.100794+0000","last_clean":"2024-09-17T03:08:30.100794+0000","last_became_active":"2024-09-17T03:08:27.241222+0000","last_became_peered":"2024-09-17T03:08:27.241222+0000","last_unstale":"2024-09-17T03:08:30.100794+0000","last_undegraded":"2024-09-17T03:08:30.100794+0000","last_fullsized":"2024-09-17T03:08:30.100794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:50.172743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228469+0000","last_change":"2024-09-17T03:08:28.235146+0000","last_active":"2024-09-17T03:08:29.228469+0000","last_peered":"2024-09-17T03:08:29.228469+0000","last_clean":"2024-09-17T03:08:29.228469+0000","last_became_active":"2024-09-17T03:08:28.234806+0000","last_became_peered":"2024-09-17T03:08:28.234806+0000","last_unstale":"2024-09-17T03:08:29.228469+0000","last_undegraded":"2024-09-17T03:08:29.228469+0000","last_fullsized":"2024-09-17T03:08:29.228469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:17.510396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293767+0000","last_change":"2024-09-17T03:08:28.248874+0000","last_active":"2024-09-17T03:08:30.293767+0000","last_peered":"2024-09-17T03:08:30.293767+0000","last_clean":"2024-09-17T03:08:30.293767+0000","last_became_active":"2024-09-17T03:08:28.248556+0000","last_became_peered":"2024-09-17T03:08:28.248556+0000","last_unstale":"2024-09-17T03:08:30.293767+0000","last_undegraded":"2024-09-17T03:08:30.293767+0000","last_fullsized":"2024-09-17T03:08:30.293767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:54.201357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100250+0000","last_change":"2024-09-17T03:08:27.246359+0000","last_active":"2024-09-17T03:08:30.100250+0000","last_peered":"2024-09-17T03:08:30.100250+0000","last_clean":"2024-09-17T03:08:30.100250+0000","last_became_active":"2024-09-17T03:08:27.246057+0000","last_became_peered":"2024-09-17T03:08:27.246057+0000","last_unstale":"2024-09-17T03:08:30.100250+0000","last_undegraded":"2024-09-17T03:08:30.100250+0000","last_fullsized":"2024-09-17T03:08:30.100250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:37.234828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293628+0000","last_change":"2024-09-17T03:08:28.252494+0000","last_active":"2024-09-17T03:08:30.293628+0000","last_peered":"2024-09-17T03:08:30.293628+0000","last_clean":"2024-09-17T03:08:30.293628+0000","last_became_active":"2024-09-17T03:08:28.252160+0000","last_became_peered":"2024-09-17T03:08:28.252160+0000","last_unstale":"2024-09-17T03:08:30.293628+0000","last_undegraded":"2024-09-17T03:08:30.293628+0000","last_fullsized":"2024-09-17T03:08:30.293628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:04.627763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100672+0000","last_change":"2024-09-17T03:08:27.244060+0000","last_active":"2024-09-17T03:08:30.100672+0000","last_peered":"2024-09-17T03:08:30.100672+0000","last_clean":"2024-09-17T03:08:30.100672+0000","last_became_active":"2024-09-17T03:08:27.243722+0000","last_became_peered":"2024-09-17T03:08:27.243722+0000","last_unstale":"2024-09-17T03:08:30.100672+0000","last_undegraded":"2024-09-17T03:08:30.100672+0000","last_fullsized":"2024-09-17T03:08:30.100672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:44.228871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293443+0000","last_change":"2024-09-17T03:08:28.259408+0000","last_active":"2024-09-17T03:08:30.293443+0000","last_peered":"2024-09-17T03:08:30.293443+0000","last_clean":"2024-09-17T03:08:30.293443+0000","last_became_active":"2024-09-17T03:08:28.259101+0000","last_became_peered":"2024-09-17T03:08:28.259101+0000","last_unstale":"2024-09-17T03:08:30.293443+0000","last_undegraded":"2024-09-17T03:08:30.293443+0000","last_fullsized":"2024-09-17T03:08:30.293443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:05.501480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226814+0000","last_change":"2024-09-17T03:08:27.239362+0000","last_active":"2024-09-17T03:08:29.226814+0000","last_peered":"2024-09-17T03:08:29.226814+0000","last_clean":"2024-09-17T03:08:29.226814+0000","last_became_active":"2024-09-17T03:08:27.238941+0000","last_became_peered":"2024-09-17T03:08:27.238941+0000","last_unstale":"2024-09-17T03:08:29.226814+0000","last_undegraded":"2024-09-17T03:08:29.226814+0000","last_fullsized":"2024-09-17T03:08:29.226814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:29.377537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226806+0000","last_change":"2024-09-17T03:08:28.252681+0000","last_active":"2024-09-17T03:08:29.226806+0000","last_peered":"2024-09-17T03:08:29.226806+0000","last_clean":"2024-09-17T03:08:29.226806+0000","last_became_active":"2024-09-17T03:08:28.252248+0000","last_became_peered":"2024-09-17T03:08:28.252248+0000","last_unstale":"2024-09-17T03:08:29.226806+0000","last_undegraded":"2024-09-17T03:08:29.226806+0000","last_fullsized":"2024-09-17T03:08:29.226806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:54.411712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293659+0000","last_change":"2024-09-17T03:08:27.237660+0000","last_active":"2024-09-17T03:08:30.293659+0000","last_peered":"2024-09-17T03:08:30.293659+0000","last_clean":"2024-09-17T03:08:30.293659+0000","last_became_active":"2024-09-17T03:08:27.237311+0000","last_became_peered":"2024-09-17T03:08:27.237311+0000","last_unstale":"2024-09-17T03:08:30.293659+0000","last_undegraded":"2024-09-17T03:08:30.293659+0000","last_fullsized":"2024-09-17T03:08:30.293659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:00.697522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":831488,"data_stored":673057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":83719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":82197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":82233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":82107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":82267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":673113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":245760,"data_stored":83719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:08:36.027 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:08:36.028 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-17T03:08:36.028 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T03:08:36.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.178+0000 7f5a8537b640 1 -- 172.21.15.78:0/3439306597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a800cf3f0 msgr2=0x7f5a800cff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:36.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.178+0000 7f5a8537b640 1 --2- 172.21.15.78:0/3439306597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a800cf3f0 0x7f5a800cff40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5a78005fd0 tx=0x7f5a7802a710 comp rx=0 tx=0).stop 2024-09-17T03:08:36.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.178+0000 7f5a8537b640 1 -- 172.21.15.78:0/3439306597 shutdown_connections 2024-09-17T03:08:36.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.178+0000 7f5a8537b640 1 --2- 172.21.15.78:0/3439306597 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a800cf3f0 0x7f5a800cff40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.178+0000 7f5a8537b640 1 -- 172.21.15.78:0/3439306597 >> 172.21.15.78:0/3439306597 conn(0x7f5a8006d5d0 msgr2=0x7f5a80071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:36.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.178+0000 7f5a8537b640 1 -- 172.21.15.78:0/3439306597 shutdown_connections 2024-09-17T03:08:36.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.178+0000 7f5a8537b640 1 -- 172.21.15.78:0/3439306597 wait complete. 2024-09-17T03:08:36.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.180+0000 7f5a8537b640 1 Processor -- start 2024-09-17T03:08:36.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.180+0000 7f5a8537b640 1 -- start start 2024-09-17T03:08:36.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.181+0000 7f5a8537b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5a800cf3f0 0x7f5a800b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:36.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.181+0000 7f5a8537b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a800d16f0 0x7f5a801574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:36.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.181+0000 7f5a8537b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a80160550 0x7f5a801527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:36.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.181+0000 7f5a8537b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5a800d0600 con 0x7f5a800d16f0 2024-09-17T03:08:36.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.181+0000 7f5a8537b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5a800d0480 con 0x7f5a80160550 2024-09-17T03:08:36.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.181+0000 7f5a8537b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5a800d0780 con 0x7f5a800cf3f0 2024-09-17T03:08:36.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.181+0000 7f5a7e7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a800d16f0 0x7f5a801574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:36.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.182+0000 7f5a7e7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a800d16f0 0x7f5a801574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38602/0 (socket says 172.21.15.78:38602) 2024-09-17T03:08:36.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.182+0000 7f5a7e7fc640 1 -- 172.21.15.78:0/1712908286 learned_addr learned my addr 172.21.15.78:0/1712908286 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:36.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.182+0000 7f5a7f7fe640 1 --2- 172.21.15.78:0/1712908286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a80160550 0x7f5a801527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:36.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.182+0000 7f5a7effd640 1 --2- 172.21.15.78:0/1712908286 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5a800cf3f0 0x7f5a800b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:36.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.182+0000 7f5a7e7fc640 1 -- 172.21.15.78:0/1712908286 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5a800cf3f0 msgr2=0x7f5a800b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:36.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.182+0000 7f5a7e7fc640 1 --2- 172.21.15.78:0/1712908286 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5a800cf3f0 0x7f5a800b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.182+0000 7f5a7e7fc640 1 -- 172.21.15.78:0/1712908286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a80160550 msgr2=0x7f5a801527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:36.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.182+0000 7f5a7e7fc640 1 --2- 172.21.15.78:0/1712908286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a80160550 0x7f5a801527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.182+0000 7f5a7e7fc640 1 -- 172.21.15.78:0/1712908286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a80152d10 con 0x7f5a800d16f0 2024-09-17T03:08:36.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.182+0000 7f5a7effd640 1 --2- 172.21.15.78:0/1712908286 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5a800cf3f0 0x7f5a800b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:08:36.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.182+0000 7f5a7e7fc640 1 --2- 172.21.15.78:0/1712908286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a800d16f0 0x7f5a801574a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5a74001eb0 tx=0x7f5a7400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:36.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.182+0000 7f5a677fe640 1 -- 172.21.15.78:0/1712908286 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a74017070 con 0x7f5a800d16f0 2024-09-17T03:08:36.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.182+0000 7f5a677fe640 1 -- 172.21.15.78:0/1712908286 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a740053c0 con 0x7f5a800d16f0 2024-09-17T03:08:36.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.182+0000 7f5a677fe640 1 -- 172.21.15.78:0/1712908286 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a74003830 con 0x7f5a800d16f0 2024-09-17T03:08:36.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.182+0000 7f5a8537b640 1 -- 172.21.15.78:0/1712908286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a8006fe20 con 0x7f5a800d16f0 2024-09-17T03:08:36.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.182+0000 7f5a8537b640 1 -- 172.21.15.78:0/1712908286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a800b2070 con 0x7f5a800d16f0 2024-09-17T03:08:36.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.183+0000 7f5a8537b640 1 -- 172.21.15.78:0/1712908286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a800cff40 con 0x7f5a800d16f0 2024-09-17T03:08:36.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.184+0000 7f5a677fe640 1 -- 172.21.15.78:0/1712908286 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5a7401a070 con 0x7f5a800d16f0 2024-09-17T03:08:36.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.184+0000 7f5a677fe640 1 --2- 172.21.15.78:0/1712908286 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5a6c078bc0 0x7f5a6c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:36.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.184+0000 7f5a677fe640 1 -- 172.21.15.78:0/1712908286 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5a74099fa0 con 0x7f5a800d16f0 2024-09-17T03:08:36.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.184+0000 7f5a7effd640 1 --2- 172.21.15.78:0/1712908286 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5a6c078bc0 0x7f5a6c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:36.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.185+0000 7f5a7effd640 1 --2- 172.21.15.78:0/1712908286 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5a6c078bc0 0x7f5a6c07b0d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5a70007f20 tx=0x7f5a70009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:36.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.189+0000 7f5a677fe640 1 -- 172.21.15.78:0/1712908286 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5a80152d10 con 0x7f5a800d16f0 2024-09-17T03:08:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.372+0000 7f5a8537b640 1 -- 172.21.15.78:0/1712908286 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f5a800d2c90 con 0x7f5a800d16f0 2024-09-17T03:08:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.372+0000 7f5a677fe640 1 -- 172.21.15.78:0/1712908286 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v31) ==== 86+0+160 (secure 0 0 0) 0x7f5a74061e20 con 0x7f5a800d16f0 2024-09-17T03:08:36.371 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:36.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.374+0000 7f5a8537b640 1 -- 172.21.15.78:0/1712908286 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5a6c078bc0 msgr2=0x7f5a6c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:36.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.374+0000 7f5a8537b640 1 --2- 172.21.15.78:0/1712908286 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5a6c078bc0 0x7f5a6c07b0d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5a70007f20 tx=0x7f5a70009040 comp rx=0 tx=0).stop 2024-09-17T03:08:36.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.374+0000 7f5a8537b640 1 -- 172.21.15.78:0/1712908286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a800d16f0 msgr2=0x7f5a801574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:36.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.374+0000 7f5a8537b640 1 --2- 172.21.15.78:0/1712908286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a800d16f0 0x7f5a801574a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5a74001eb0 tx=0x7f5a7400c890 comp rx=0 tx=0).stop 2024-09-17T03:08:36.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.374+0000 7f5a8537b640 1 -- 172.21.15.78:0/1712908286 shutdown_connections 2024-09-17T03:08:36.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.374+0000 7f5a8537b640 1 --2- 172.21.15.78:0/1712908286 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5a6c078bc0 0x7f5a6c07b0d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.374+0000 7f5a8537b640 1 --2- 172.21.15.78:0/1712908286 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a80160550 0x7f5a801527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.374+0000 7f5a8537b640 1 --2- 172.21.15.78:0/1712908286 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a800d16f0 0x7f5a801574a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.374+0000 7f5a8537b640 1 --2- 172.21.15.78:0/1712908286 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5a800cf3f0 0x7f5a800b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.374+0000 7f5a8537b640 1 -- 172.21.15.78:0/1712908286 >> 172.21.15.78:0/1712908286 conn(0x7f5a8006d5d0 msgr2=0x7f5a800b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:36.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.375+0000 7f5a8537b640 1 -- 172.21.15.78:0/1712908286 shutdown_connections 2024-09-17T03:08:36.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.375+0000 7f5a8537b640 1 -- 172.21.15.78:0/1712908286 wait complete. 2024-09-17T03:08:36.385 INFO:teuthology.orchestra.run.smithi078.stdout:[{"version":31,"timestamp":"2024-09-17T03:08:15.297018+0000","name":"","changes":[{"name":"osd.6/osd_mclock_max_capacity_iops_ssd","new_value":"6005.051341"}]}] 2024-09-17T03:08:36.385 INFO:tasks.ceph_manager:config epoch is 31 2024-09-17T03:08:36.385 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T03:08:36.385 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T03:08:36.385 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T03:08:36.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.499+0000 7fb44f9ba640 1 -- 172.21.15.78:0/2617485805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4480d1d40 msgr2=0x7fb4480b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:36.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.499+0000 7fb44f9ba640 1 --2- 172.21.15.78:0/2617485805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4480d1d40 0x7fb4480b5210 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb444005fd0 tx=0x7fb44402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.499+0000 7fb44f9ba640 1 -- 172.21.15.78:0/2617485805 shutdown_connections 2024-09-17T03:08:36.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.499+0000 7fb44f9ba640 1 --2- 172.21.15.78:0/2617485805 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb4480ccba0 0x7fb4480ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.499+0000 7fb44f9ba640 1 --2- 172.21.15.78:0/2617485805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb4480d1d40 0x7fb4480b5210 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.499+0000 7fb44f9ba640 1 -- 172.21.15.78:0/2617485805 >> 172.21.15.78:0/2617485805 conn(0x7fb4480b3f10 msgr2=0x7fb4480b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:36.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.499+0000 7fb44f9ba640 1 -- 172.21.15.78:0/2617485805 shutdown_connections 2024-09-17T03:08:36.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.499+0000 7fb44f9ba640 1 -- 172.21.15.78:0/2617485805 wait complete. 2024-09-17T03:08:36.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.501+0000 7fb44f9ba640 1 Processor -- start 2024-09-17T03:08:36.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.501+0000 7fb44f9ba640 1 -- start start 2024-09-17T03:08:36.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.502+0000 7fb44f9ba640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb4480ccba0 0x7fb448156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:36.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.502+0000 7fb44f9ba640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4480d1d40 0x7fb4481468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:36.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.502+0000 7fb44f9ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb44815c6f0 0x7fb448146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:36.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.502+0000 7fb44f9ba640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb4480d11f0 con 0x7fb44815c6f0 2024-09-17T03:08:36.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.502+0000 7fb44f9ba640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb4480d1070 con 0x7fb4480d1d40 2024-09-17T03:08:36.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.502+0000 7fb44f9ba640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb4480d1370 con 0x7fb4480ccba0 2024-09-17T03:08:36.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.502+0000 7fb44df57640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb44815c6f0 0x7fb448146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:36.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.502+0000 7fb44df57640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb44815c6f0 0x7fb448146e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33972/0 (socket says 172.21.15.78:33972) 2024-09-17T03:08:36.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.502+0000 7fb44df57640 1 -- 172.21.15.78:0/1490076802 learned_addr learned my addr 172.21.15.78:0/1490076802 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:36.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.502+0000 7fb44cf55640 1 --2- 172.21.15.78:0/1490076802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4480d1d40 0x7fb4481468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:36.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.502+0000 7fb44d756640 1 --2- 172.21.15.78:0/1490076802 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb4480ccba0 0x7fb448156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:36.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.503+0000 7fb44df57640 1 -- 172.21.15.78:0/1490076802 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb4480ccba0 msgr2=0x7fb448156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:36.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.503+0000 7fb44df57640 1 --2- 172.21.15.78:0/1490076802 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb4480ccba0 0x7fb448156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.503+0000 7fb44df57640 1 -- 172.21.15.78:0/1490076802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4480d1d40 msgr2=0x7fb4481468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:36.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.503+0000 7fb44df57640 1 --2- 172.21.15.78:0/1490076802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4480d1d40 0x7fb4481468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.503+0000 7fb44df57640 1 -- 172.21.15.78:0/1490076802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4480c9620 con 0x7fb44815c6f0 2024-09-17T03:08:36.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.503+0000 7fb44df57640 1 --2- 172.21.15.78:0/1490076802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb44815c6f0 0x7fb448146e30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb44000e990 tx=0x7fb44000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:36.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.503+0000 7fb43dffb640 1 -- 172.21.15.78:0/1490076802 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb440004d20 con 0x7fb44815c6f0 2024-09-17T03:08:36.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.503+0000 7fb43dffb640 1 -- 172.21.15.78:0/1490076802 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb44000caa0 con 0x7fb44815c6f0 2024-09-17T03:08:36.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.503+0000 7fb44f9ba640 1 -- 172.21.15.78:0/1490076802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb448152c10 con 0x7fb44815c6f0 2024-09-17T03:08:36.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.503+0000 7fb43dffb640 1 -- 172.21.15.78:0/1490076802 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb440005020 con 0x7fb44815c6f0 2024-09-17T03:08:36.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.503+0000 7fb44f9ba640 1 -- 172.21.15.78:0/1490076802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4481f3f70 con 0x7fb44815c6f0 2024-09-17T03:08:36.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.504+0000 7fb44f9ba640 1 -- 172.21.15.78:0/1490076802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4481f3a00 con 0x7fb44815c6f0 2024-09-17T03:08:36.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.505+0000 7fb43dffb640 1 -- 172.21.15.78:0/1490076802 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb4400051c0 con 0x7fb44815c6f0 2024-09-17T03:08:36.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.505+0000 7fb43dffb640 1 --2- 172.21.15.78:0/1490076802 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb42c078bc0 0x7fb42c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:36.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.505+0000 7fb43dffb640 1 -- 172.21.15.78:0/1490076802 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb44009b4f0 con 0x7fb44815c6f0 2024-09-17T03:08:36.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.505+0000 7fb44d756640 1 --2- 172.21.15.78:0/1490076802 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb42c078bc0 0x7fb42c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:36.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.506+0000 7fb44d756640 1 --2- 172.21.15.78:0/1490076802 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb42c078bc0 0x7fb42c07b0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb444033000 tx=0x7fb444004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:36.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.509+0000 7fb43dffb640 1 -- 172.21.15.78:0/1490076802 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb440016030 con 0x7fb44815c6f0 2024-09-17T03:08:36.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.731+0000 7fb44f9ba640 1 -- 172.21.15.78:0/1490076802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb4480d18c0 con 0x7fb44815c6f0 2024-09-17T03:08:36.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.734+0000 7fb43dffb640 1 -- 172.21.15.78:0/1490076802 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194721 (secure 0 0 0) 0x7fb440063370 con 0x7fb44815c6f0 2024-09-17T03:08:36.735 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:36.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.737+0000 7fb44f9ba640 1 -- 172.21.15.78:0/1490076802 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb42c078bc0 msgr2=0x7fb42c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:36.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.737+0000 7fb44f9ba640 1 --2- 172.21.15.78:0/1490076802 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb42c078bc0 0x7fb42c07b0d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb444033000 tx=0x7fb444004730 comp rx=0 tx=0).stop 2024-09-17T03:08:36.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.737+0000 7fb44f9ba640 1 -- 172.21.15.78:0/1490076802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb44815c6f0 msgr2=0x7fb448146e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:36.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.737+0000 7fb44f9ba640 1 --2- 172.21.15.78:0/1490076802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb44815c6f0 0x7fb448146e30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb44000e990 tx=0x7fb44000ee50 comp rx=0 tx=0).stop 2024-09-17T03:08:36.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.737+0000 7fb44f9ba640 1 -- 172.21.15.78:0/1490076802 shutdown_connections 2024-09-17T03:08:36.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.737+0000 7fb44f9ba640 1 --2- 172.21.15.78:0/1490076802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb44815c6f0 0x7fb448146e30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.737+0000 7fb44f9ba640 1 --2- 172.21.15.78:0/1490076802 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb42c078bc0 0x7fb42c07b0d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.737+0000 7fb44f9ba640 1 --2- 172.21.15.78:0/1490076802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4480d1d40 0x7fb4481468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.737+0000 7fb44f9ba640 1 --2- 172.21.15.78:0/1490076802 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb4480ccba0 0x7fb448156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.737+0000 7fb44f9ba640 1 -- 172.21.15.78:0/1490076802 >> 172.21.15.78:0/1490076802 conn(0x7fb4480b3f10 msgr2=0x7fb4480b5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:36.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.737+0000 7fb44f9ba640 1 -- 172.21.15.78:0/1490076802 shutdown_connections 2024-09-17T03:08:36.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.737+0000 7fb44f9ba640 1 -- 172.21.15.78:0/1490076802 wait complete. 2024-09-17T03:08:36.746 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":2979273017},{"type":"v1","addr":"172.21.15.193:6801","nonce":2979273017}]},"active_addr":"172.21.15.193:6801/2979273017","active_change":"2024-09-17T03:08:07.109419+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4105,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.193:0","nonce":2034058240}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.193:0","nonce":3868472672}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.193:0","nonce":2074605147}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.193:0","nonce":803121917}]}]} 2024-09-17T03:08:36.751 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T03:08:36.751 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T03:08:36.752 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:08:36.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.866+0000 7f649215e640 1 -- 172.21.15.78:0/2858961479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f648c074390 msgr2=0x7f648c160220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:36.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.866+0000 7f649215e640 1 --2- 172.21.15.78:0/2858961479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f648c074390 0x7f648c160220 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f648c071c90 tx=0x7f648402aa30 comp rx=0 tx=0).stop 2024-09-17T03:08:36.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.866+0000 7f649215e640 1 -- 172.21.15.78:0/2858961479 shutdown_connections 2024-09-17T03:08:36.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.866+0000 7f649215e640 1 --2- 172.21.15.78:0/2858961479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f648c074390 0x7f648c160220 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.866+0000 7f649215e640 1 --2- 172.21.15.78:0/2858961479 >> v2:172.21.15.193:3300/0 conn(0x7f648c0cd3c0 0x7f648c073e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.866+0000 7f649215e640 1 --2- 172.21.15.78:0/2858961479 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f648c0cde80 0x7f648c0b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.866+0000 7f649215e640 1 -- 172.21.15.78:0/2858961479 >> 172.21.15.78:0/2858961479 conn(0x7f648c0b2fe0 msgr2=0x7f648c073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:36.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.866+0000 7f649215e640 1 -- 172.21.15.78:0/2858961479 shutdown_connections 2024-09-17T03:08:36.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.866+0000 7f649215e640 1 -- 172.21.15.78:0/2858961479 wait complete. 2024-09-17T03:08:36.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.868+0000 7f649215e640 1 Processor -- start 2024-09-17T03:08:36.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.868+0000 7f649215e640 1 -- start start 2024-09-17T03:08:36.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.869+0000 7f649215e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f648c074390 0x7f648c071460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:36.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.869+0000 7f649215e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f648c0cd3c0 0x7f648c1f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:36.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.869+0000 7f649215e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f648c0cde80 0x7f648c15b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:36.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.869+0000 7f649215e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f648c1608e0 con 0x7f648c074390 2024-09-17T03:08:36.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.869+0000 7f649215e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f648c160760 con 0x7f648c0cd3c0 2024-09-17T03:08:36.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.869+0000 7f649215e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f648c160a60 con 0x7f648c0cde80 2024-09-17T03:08:36.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.869+0000 7f648b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f648c074390 0x7f648c071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:36.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.870+0000 7f648b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f648c074390 0x7f648c071460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33998/0 (socket says 172.21.15.78:33998) 2024-09-17T03:08:36.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.870+0000 7f648b7fe640 1 -- 172.21.15.78:0/1990568097 learned_addr learned my addr 172.21.15.78:0/1990568097 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:36.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.870+0000 7f648bfff640 1 --2- 172.21.15.78:0/1990568097 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f648c0cde80 0x7f648c15b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:36.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.870+0000 7f648affd640 1 --2- 172.21.15.78:0/1990568097 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f648c0cd3c0 0x7f648c1f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:36.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.870+0000 7f648b7fe640 1 -- 172.21.15.78:0/1990568097 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f648c0cde80 msgr2=0x7f648c15b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:36.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.870+0000 7f648b7fe640 1 --2- 172.21.15.78:0/1990568097 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f648c0cde80 0x7f648c15b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.870+0000 7f648b7fe640 1 -- 172.21.15.78:0/1990568097 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f648c0cd3c0 msgr2=0x7f648c1f5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:36.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.870+0000 7f648b7fe640 1 --2- 172.21.15.78:0/1990568097 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f648c0cd3c0 0x7f648c1f5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:36.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.870+0000 7f648b7fe640 1 -- 172.21.15.78:0/1990568097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c06ffe0 con 0x7f648c074390 2024-09-17T03:08:36.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.870+0000 7f648b7fe640 1 --2- 172.21.15.78:0/1990568097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f648c074390 0x7f648c071460 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f647c00c970 tx=0x7f647c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:36.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.870+0000 7f6483fff640 1 -- 172.21.15.78:0/1990568097 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c007bb0 con 0x7f648c074390 2024-09-17T03:08:36.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.870+0000 7f6483fff640 1 -- 172.21.15.78:0/1990568097 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f647c005020 con 0x7f648c074390 2024-09-17T03:08:36.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.870+0000 7f649215e640 1 -- 172.21.15.78:0/1990568097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f648c0702c0 con 0x7f648c074390 2024-09-17T03:08:36.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.870+0000 7f6483fff640 1 -- 172.21.15.78:0/1990568097 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c007e60 con 0x7f648c074390 2024-09-17T03:08:36.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.870+0000 7f649215e640 1 -- 172.21.15.78:0/1990568097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f648c070880 con 0x7f648c074390 2024-09-17T03:08:36.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.871+0000 7f649215e640 1 -- 172.21.15.78:0/1990568097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f648c160fa0 con 0x7f648c074390 2024-09-17T03:08:36.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.872+0000 7f6483fff640 1 -- 172.21.15.78:0/1990568097 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f647c005470 con 0x7f648c074390 2024-09-17T03:08:36.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.872+0000 7f6483fff640 1 --2- 172.21.15.78:0/1990568097 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f646c078b90 0x7f646c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:36.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.873+0000 7f6483fff640 1 -- 172.21.15.78:0/1990568097 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f647c09b030 con 0x7f648c074390 2024-09-17T03:08:36.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.873+0000 7f648affd640 1 --2- 172.21.15.78:0/1990568097 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f646c078b90 0x7f646c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:36.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.873+0000 7f648affd640 1 --2- 172.21.15.78:0/1990568097 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f646c078b90 0x7f646c07b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f647400a490 tx=0x7f647400a420 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:36.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:36.877+0000 7f6483fff640 1 -- 172.21.15.78:0/1990568097 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f647c014030 con 0x7f648c074390 2024-09-17T03:08:37.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.055+0000 7f649215e640 1 -- 172.21.15.78:0/1990568097 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f648c0b4b50 con 0x7f648c074390 2024-09-17T03:08:37.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.056+0000 7f6483fff640 1 -- 172.21.15.78:0/1990568097 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16641 (secure 0 0 0) 0x7f647c062f40 con 0x7f648c074390 2024-09-17T03:08:37.055 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:37.055 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:08:29.222925+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:08:25.448752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:08:26.544015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:08:37.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.058+0000 7f649215e640 1 -- 172.21.15.78:0/1990568097 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f646c078b90 msgr2=0x7f646c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.058+0000 7f649215e640 1 --2- 172.21.15.78:0/1990568097 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f646c078b90 0x7f646c07b0a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f647400a490 tx=0x7f647400a420 comp rx=0 tx=0).stop 2024-09-17T03:08:37.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.058+0000 7f649215e640 1 -- 172.21.15.78:0/1990568097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f648c074390 msgr2=0x7f648c071460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.058+0000 7f649215e640 1 --2- 172.21.15.78:0/1990568097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f648c074390 0x7f648c071460 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f647c00c970 tx=0x7f647c00ce30 comp rx=0 tx=0).stop 2024-09-17T03:08:37.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.058+0000 7f649215e640 1 -- 172.21.15.78:0/1990568097 shutdown_connections 2024-09-17T03:08:37.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.058+0000 7f649215e640 1 --2- 172.21.15.78:0/1990568097 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f648c0cde80 0x7f648c15b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.058+0000 7f649215e640 1 --2- 172.21.15.78:0/1990568097 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f646c078b90 0x7f646c07b0a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.058+0000 7f649215e640 1 --2- 172.21.15.78:0/1990568097 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f648c0cd3c0 0x7f648c1f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.058+0000 7f649215e640 1 --2- 172.21.15.78:0/1990568097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f648c074390 0x7f648c071460 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.058+0000 7f649215e640 1 -- 172.21.15.78:0/1990568097 >> 172.21.15.78:0/1990568097 conn(0x7f648c0b2fe0 msgr2=0x7f648c0b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.058+0000 7f649215e640 1 -- 172.21.15.78:0/1990568097 shutdown_connections 2024-09-17T03:08:37.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.058+0000 7f649215e640 1 -- 172.21.15.78:0/1990568097 wait complete. 2024-09-17T03:08:37.068 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T03:08:37.068 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:08:37.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.182+0000 7fdf0d863640 1 -- 172.21.15.78:0/2909905407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdef4004d40 msgr2=0x7fdef4005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.182+0000 7fdf0d863640 1 --2- 172.21.15.78:0/2909905407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdef4004d40 0x7fdef4005150 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fdf00009b20 tx=0x7fdef4005830 comp rx=0 tx=0).stop 2024-09-17T03:08:37.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.182+0000 7fdf077fe640 1 -- 172.21.15.78:0/2909905407 reap_dead start 2024-09-17T03:08:37.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.182+0000 7fdf0d863640 1 -- 172.21.15.78:0/2909905407 shutdown_connections 2024-09-17T03:08:37.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.182+0000 7fdf0d863640 1 -- 172.21.15.78:0/2909905407 >> 172.21.15.78:0/2909905407 conn(0x7fdf0809d7f0 msgr2=0x7fdf080d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.182+0000 7fdf0d863640 1 -- 172.21.15.78:0/2909905407 shutdown_connections 2024-09-17T03:08:37.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.182+0000 7fdf0d863640 1 -- 172.21.15.78:0/2909905407 wait complete. 2024-09-17T03:08:37.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.184+0000 7fdf0d863640 1 Processor -- start 2024-09-17T03:08:37.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.184+0000 7fdf0d863640 1 -- start start 2024-09-17T03:08:37.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.185+0000 7fdf0d863640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdef4004d40 0x7fdf081615a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.185+0000 7fdf0d863640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf08158470 0x7fdf0815f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.185+0000 7fdf0d863640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf08146560 0x7fdf08146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.185+0000 7fdf0d863640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0806eff0 con 0x7fdf08158470 2024-09-17T03:08:37.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.185+0000 7fdf0d863640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0806f170 con 0x7fdf08146560 2024-09-17T03:08:37.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.185+0000 7fdf0d863640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fdf0806f2f0 con 0x7fdef4004d40 2024-09-17T03:08:37.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.185+0000 7fdf067fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf08158470 0x7fdf0815f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.185+0000 7fdf067fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf08158470 0x7fdf0815f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34022/0 (socket says 172.21.15.78:34022) 2024-09-17T03:08:37.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.185+0000 7fdf067fc640 1 -- 172.21.15.78:0/2843412320 learned_addr learned my addr 172.21.15.78:0/2843412320 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:37.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.186+0000 7fdf06ffd640 1 --2- 172.21.15.78:0/2843412320 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdef4004d40 0x7fdf081615a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.186+0000 7fdf077fe640 1 --2- 172.21.15.78:0/2843412320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf08146560 0x7fdf08146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.186+0000 7fdf067fc640 1 -- 172.21.15.78:0/2843412320 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdef4004d40 msgr2=0x7fdf081615a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.186+0000 7fdf067fc640 1 --2- 172.21.15.78:0/2843412320 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdef4004d40 0x7fdf081615a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.186+0000 7fdf067fc640 1 -- 172.21.15.78:0/2843412320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf08146560 msgr2=0x7fdf08146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.186+0000 7fdf067fc640 1 --2- 172.21.15.78:0/2843412320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf08146560 0x7fdf08146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.186+0000 7fdf067fc640 1 -- 172.21.15.78:0/2843412320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf08160500 con 0x7fdf08158470 2024-09-17T03:08:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.186+0000 7fdf067fc640 1 --2- 172.21.15.78:0/2843412320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf08158470 0x7fdf0815f3b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdef000e600 tx=0x7fdef000eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.186+0000 7fdefffff640 1 -- 172.21.15.78:0/2843412320 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef0015070 con 0x7fdf08158470 2024-09-17T03:08:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.186+0000 7fdefffff640 1 -- 172.21.15.78:0/2843412320 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdef000ca90 con 0x7fdf08158470 2024-09-17T03:08:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.186+0000 7fdefffff640 1 -- 172.21.15.78:0/2843412320 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdef0011460 con 0x7fdf08158470 2024-09-17T03:08:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.186+0000 7fdf0d863640 1 -- 172.21.15.78:0/2843412320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf081607e0 con 0x7fdf08158470 2024-09-17T03:08:37.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.186+0000 7fdf0d863640 1 -- 172.21.15.78:0/2843412320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf08160da0 con 0x7fdf08158470 2024-09-17T03:08:37.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.187+0000 7fdf0d863640 1 -- 172.21.15.78:0/2843412320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf08160270 con 0x7fdf08158470 2024-09-17T03:08:37.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.188+0000 7fdefffff640 1 -- 172.21.15.78:0/2843412320 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdef0018070 con 0x7fdf08158470 2024-09-17T03:08:37.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.188+0000 7fdefffff640 1 --2- 172.21.15.78:0/2843412320 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdee8078b90 0x7fdee807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.189+0000 7fdefffff640 1 -- 172.21.15.78:0/2843412320 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fdef009b180 con 0x7fdf08158470 2024-09-17T03:08:37.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.189+0000 7fdf06ffd640 1 --2- 172.21.15.78:0/2843412320 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdee8078b90 0x7fdee807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.189+0000 7fdf06ffd640 1 --2- 172.21.15.78:0/2843412320 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdee8078b90 0x7fdee807b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdef8005c60 tx=0x7fdef80094a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.193+0000 7fdefffff640 1 -- 172.21.15.78:0/2843412320 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdef0062f70 con 0x7fdf08158470 2024-09-17T03:08:37.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.369+0000 7fdf0d863640 1 -- 172.21.15.78:0/2843412320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf0806eab0 con 0x7fdf08158470 2024-09-17T03:08:37.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.370+0000 7fdefffff640 1 -- 172.21.15.78:0/2843412320 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16641 (secure 0 0 0) 0x7fdef00679a0 con 0x7fdf08158470 2024-09-17T03:08:37.369 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:37.369 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:08:29.222925+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:08:25.448752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:08:26.544015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:08:37.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.372+0000 7fdf0d863640 1 -- 172.21.15.78:0/2843412320 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdee8078b90 msgr2=0x7fdee807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.372+0000 7fdf0d863640 1 --2- 172.21.15.78:0/2843412320 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdee8078b90 0x7fdee807b0a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdef8005c60 tx=0x7fdef80094a0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.372+0000 7fdf0d863640 1 -- 172.21.15.78:0/2843412320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf08158470 msgr2=0x7fdf0815f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.372+0000 7fdf0d863640 1 --2- 172.21.15.78:0/2843412320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf08158470 0x7fdf0815f3b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdef000e600 tx=0x7fdef000eac0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.372+0000 7fdf0d863640 1 -- 172.21.15.78:0/2843412320 shutdown_connections 2024-09-17T03:08:37.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.372+0000 7fdf0d863640 1 --2- 172.21.15.78:0/2843412320 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdee8078b90 0x7fdee807b0a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.372+0000 7fdf0d863640 1 --2- 172.21.15.78:0/2843412320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdf08146560 0x7fdf08146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.373+0000 7fdf0d863640 1 --2- 172.21.15.78:0/2843412320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdf08158470 0x7fdf0815f3b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.373+0000 7fdf0d863640 1 --2- 172.21.15.78:0/2843412320 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdef4004d40 0x7fdf081615a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.373+0000 7fdf0d863640 1 -- 172.21.15.78:0/2843412320 >> 172.21.15.78:0/2843412320 conn(0x7fdf0809d7f0 msgr2=0x7fdf080b6460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.373+0000 7fdf0d863640 1 -- 172.21.15.78:0/2843412320 shutdown_connections 2024-09-17T03:08:37.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.373+0000 7fdf0d863640 1 -- 172.21.15.78:0/2843412320 wait complete. 2024-09-17T03:08:37.383 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T03:08:37.383 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T03:08:37.384 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T03:08:37.384 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T03:08:37.385 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T03:08:37.385 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T03:08:37.385 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T03:08:37.386 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T03:08:37.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.600+0000 7f4c0974e640 1 -- 172.21.15.78:0/2899044458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c040d0340 msgr2=0x7f4c040d0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.600+0000 7f4c0974e640 1 --2- 172.21.15.78:0/2899044458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c040d0340 0x7f4c040d0750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc005fd0 tx=0x7f4bfc02ad30 comp rx=0 tx=0).stop 2024-09-17T03:08:37.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.600+0000 7f4c0974e640 1 -- 172.21.15.78:0/2899044458 shutdown_connections 2024-09-17T03:08:37.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.601+0000 7f4c0974e640 1 --2- 172.21.15.78:0/2899044458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c040d0340 0x7f4c040d0750 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.601+0000 7f4c0974e640 1 --2- 172.21.15.78:0/2899044458 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c04162d90 0x7f4c041555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.601+0000 7f4c0974e640 1 -- 172.21.15.78:0/2899044458 >> 172.21.15.78:0/2899044458 conn(0x7f4c04070b20 msgr2=0x7f4c04070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.602+0000 7f4c0974e640 1 -- 172.21.15.78:0/2899044458 shutdown_connections 2024-09-17T03:08:37.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.602+0000 7f4c0974e640 1 -- 172.21.15.78:0/2899044458 wait complete. 2024-09-17T03:08:37.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.604+0000 7fd282119640 1 -- 172.21.15.78:0/2556462130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd27c0b3a50 msgr2=0x7fd27c15b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.604+0000 7f806a72b640 1 -- 172.21.15.78:0/3731410451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80640cfb90 msgr2=0x7f80640b2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.604+0000 7f806a72b640 1 --2- 172.21.15.78:0/3731410451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80640cfb90 0x7f80640b2fb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f805c005fd0 tx=0x7f805c02b920 comp rx=0 tx=0).stop 2024-09-17T03:08:37.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.604+0000 7fd282119640 1 --2- 172.21.15.78:0/2556462130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd27c0b3a50 0x7fd27c15b8c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd27c15be00 tx=0x7fd27402a8c0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.605+0000 7fd282119640 1 -- 172.21.15.78:0/2556462130 shutdown_connections 2024-09-17T03:08:37.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.605+0000 7fd282119640 1 --2- 172.21.15.78:0/2556462130 >> v2:172.21.15.193:3300/0 conn(0x7fd27c0cf890 0x7fd27c06ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.605+0000 7fd282119640 1 --2- 172.21.15.78:0/2556462130 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd27c0b3a50 0x7fd27c15b8c0 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd27c15be00 tx=0x7fd27402a8c0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.605+0000 7fd282119640 1 -- 172.21.15.78:0/2556462130 >> 172.21.15.78:0/2556462130 conn(0x7fd27c06d410 msgr2=0x7fd27c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.605+0000 7f806a72b640 1 -- 172.21.15.78:0/3731410451 shutdown_connections 2024-09-17T03:08:37.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.605+0000 7f806a72b640 1 --2- 172.21.15.78:0/3731410451 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80640cfb90 0x7f80640b2fb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.605+0000 7f806a72b640 1 --2- 172.21.15.78:0/3731410451 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80640cd240 0x7f80640cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.605+0000 7f806a72b640 1 -- 172.21.15.78:0/3731410451 >> 172.21.15.78:0/3731410451 conn(0x7f80640b1cb0 msgr2=0x7f80640b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.605+0000 7fd282119640 1 -- 172.21.15.78:0/2556462130 shutdown_connections 2024-09-17T03:08:37.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.605+0000 7fd282119640 1 -- 172.21.15.78:0/2556462130 wait complete. 2024-09-17T03:08:37.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.605+0000 7f73dadeb640 1 -- 172.21.15.78:0/3526472889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73d4070d20 msgr2=0x7f73d415b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.605+0000 7f73dadeb640 1 --2- 172.21.15.78:0/3526472889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73d4070d20 0x7f73d415b8c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f73d415be00 tx=0x7f73d002a580 comp rx=0 tx=0).stop 2024-09-17T03:08:37.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.605+0000 7f4c0974e640 1 Processor -- start 2024-09-17T03:08:37.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.605+0000 7f73dadeb640 1 -- 172.21.15.78:0/3526472889 shutdown_connections 2024-09-17T03:08:37.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.605+0000 7f73dadeb640 1 --2- 172.21.15.78:0/3526472889 >> v2:172.21.15.193:3300/0 conn(0x7f73d4073160 0x7f73d4151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.605+0000 7f73dadeb640 1 --2- 172.21.15.78:0/3526472889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73d4070d20 0x7f73d415b8c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.605+0000 7f73dadeb640 1 -- 172.21.15.78:0/3526472889 >> 172.21.15.78:0/3526472889 conn(0x7f73d406d410 msgr2=0x7f73d40b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.605+0000 7f73dadeb640 1 -- 172.21.15.78:0/3526472889 shutdown_connections 2024-09-17T03:08:37.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.606+0000 7f4c0974e640 1 -- start start 2024-09-17T03:08:37.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.605+0000 7f73dadeb640 1 -- 172.21.15.78:0/3526472889 wait complete. 2024-09-17T03:08:37.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.606+0000 7f74eebd6640 1 -- 172.21.15.78:0/2670866709 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74d4004800 msgr2=0x7f74d4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.606+0000 7f74eebd6640 1 --2- 172.21.15.78:0/2670866709 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74d4004800 0x7f74d4004c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f74e8070e00 tx=0x7f74d4005830 comp rx=0 tx=0).stop 2024-09-17T03:08:37.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.606+0000 7f806a72b640 1 -- 172.21.15.78:0/3731410451 shutdown_connections 2024-09-17T03:08:37.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.606+0000 7f806a72b640 1 -- 172.21.15.78:0/3731410451 wait complete. 2024-09-17T03:08:37.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.607+0000 7f74eebd6640 1 -- 172.21.15.78:0/2670866709 shutdown_connections 2024-09-17T03:08:37.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.607+0000 7f74eebd6640 1 --2- 172.21.15.78:0/2670866709 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74d4004800 0x7f74d4004c10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.607+0000 7f74eebd6640 1 -- 172.21.15.78:0/2670866709 >> 172.21.15.78:0/2670866709 conn(0x7f74e806d410 msgr2=0x7f74e80b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.607+0000 7f74eebd6640 1 -- 172.21.15.78:0/2670866709 shutdown_connections 2024-09-17T03:08:37.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.607+0000 7fc58e2c2640 1 -- 172.21.15.78:0/1280508488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5880d0bb0 msgr2=0x7fc5880d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.607+0000 7fc58e2c2640 1 --2- 172.21.15.78:0/1280508488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5880d0bb0 0x7fc5880d0fc0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc580005fd0 tx=0x7fc58002aaa0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.607+0000 7fe0fec63640 1 -- 172.21.15.78:0/1474739754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0f80cceb0 msgr2=0x7fe0f806ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.607+0000 7fe0fec63640 1 --2- 172.21.15.78:0/1474739754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0f80cceb0 0x7fe0f806ee90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe0f80b2730 tx=0x7fe0f002a6a0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.607+0000 7f74eebd6640 1 -- 172.21.15.78:0/2670866709 wait complete. 2024-09-17T03:08:37.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7fc58e2c2640 1 -- 172.21.15.78:0/1280508488 shutdown_connections 2024-09-17T03:08:37.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7fe0fec63640 1 -- 172.21.15.78:0/1474739754 shutdown_connections 2024-09-17T03:08:37.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7fe0fec63640 1 --2- 172.21.15.78:0/1474739754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0f80cceb0 0x7fe0f806ee90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7fe0fec63640 1 --2- 172.21.15.78:0/1474739754 >> v2:172.21.15.193:3300/0 conn(0x7fe0f80cfae0 0x7fe0f80cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7fe0fec63640 1 -- 172.21.15.78:0/1474739754 >> 172.21.15.78:0/1474739754 conn(0x7fe0f806d7d0 msgr2=0x7fe0f80b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7f0e64acc640 1 -- 172.21.15.78:0/2644030463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e48003a50 msgr2=0x7f0e48003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7f4c0974e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c040d0340 0x7f4c0414eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7f0e64acc640 1 --2- 172.21.15.78:0/2644030463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e48003a50 0x7f0e48003ec0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0e50006f80 tx=0x7f0e48005830 comp rx=0 tx=0).stop 2024-09-17T03:08:37.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7f0e5ed9d640 1 -- 172.21.15.78:0/2644030463 reap_dead start 2024-09-17T03:08:37.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7fc58e2c2640 1 --2- 172.21.15.78:0/1280508488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5880d0bb0 0x7fc5880d0fc0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7fc58e2c2640 1 -- 172.21.15.78:0/1280508488 >> 172.21.15.78:0/1280508488 conn(0x7fc58809d680 msgr2=0x7fc5880d4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7fd282119640 1 Processor -- start 2024-09-17T03:08:37.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7f4c0974e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c0415ec70 0x7f4c04158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7f73dadeb640 1 Processor -- start 2024-09-17T03:08:37.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7f4c03fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c040d0340 0x7f4c0414eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7f4c03fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c040d0340 0x7f4c0414eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.78:57566/0 (socket says 172.21.15.78:57566) 2024-09-17T03:08:37.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7fd282119640 1 -- start start 2024-09-17T03:08:37.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7f73dadeb640 1 -- start start 2024-09-17T03:08:37.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7fe0fec63640 1 -- 172.21.15.78:0/1474739754 shutdown_connections 2024-09-17T03:08:37.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7fe0fec63640 1 -- 172.21.15.78:0/1474739754 wait complete. 2024-09-17T03:08:37.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7f4c03fff640 1 -- 172.21.15.78:0/930197430 learned_addr learned my addr 172.21.15.78:0/930197430 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:37.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.608+0000 7f4c0974e640 1 --2- 172.21.15.78:0/930197430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c04162d90 0x7f4c04151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.609+0000 7f4c037fe640 1 --2- 172.21.15.78:0/930197430 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c0415ec70 0x7f4c04158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.609+0000 7f806a72b640 1 Processor -- start 2024-09-17T03:08:37.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.609+0000 7fc58e2c2640 1 -- 172.21.15.78:0/1280508488 shutdown_connections 2024-09-17T03:08:37.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.609+0000 7f4c08f4d640 1 --2- 172.21.15.78:0/930197430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c04162d90 0x7f4c04151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.609+0000 7f4c0974e640 1 -- 172.21.15.78:0/930197430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4c040ae640 con 0x7f4c04162d90 2024-09-17T03:08:37.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.609+0000 7f4c0974e640 1 -- 172.21.15.78:0/930197430 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4c040ae4c0 con 0x7f4c040d0340 2024-09-17T03:08:37.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.609+0000 7f4c0974e640 1 -- 172.21.15.78:0/930197430 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4c040ae7c0 con 0x7f4c0415ec70 2024-09-17T03:08:37.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.609+0000 7f0e64acc640 1 -- 172.21.15.78:0/2644030463 shutdown_connections 2024-09-17T03:08:37.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.609+0000 7f0e64acc640 1 -- 172.21.15.78:0/2644030463 >> 172.21.15.78:0/2644030463 conn(0x7f0e60074170 msgr2=0x7f0e600b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.609+0000 7f0e64acc640 1 -- 172.21.15.78:0/2644030463 shutdown_connections 2024-09-17T03:08:37.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.609+0000 7f0e64acc640 1 -- 172.21.15.78:0/2644030463 wait complete. 2024-09-17T03:08:37.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.609+0000 7f74eebd6640 1 Processor -- start 2024-09-17T03:08:37.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.609+0000 7f74eebd6640 1 -- start start 2024-09-17T03:08:37.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.610+0000 7f4c08f4d640 1 -- 172.21.15.78:0/930197430 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c0415ec70 msgr2=0x7f4c04158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.610+0000 7f4c08f4d640 1 --2- 172.21.15.78:0/930197430 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c0415ec70 0x7f4c04158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.610+0000 7f4c08f4d640 1 -- 172.21.15.78:0/930197430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c040d0340 msgr2=0x7f4c0414eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.610+0000 7f4c08f4d640 1 --2- 172.21.15.78:0/930197430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c040d0340 0x7f4c0414eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.610+0000 7f4c08f4d640 1 -- 172.21.15.78:0/930197430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0414f580 con 0x7f4c04162d90 2024-09-17T03:08:37.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.610+0000 7f4c03fff640 1 --2- 172.21.15.78:0/930197430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c040d0340 0x7f4c0414eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:08:37.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.610+0000 7f4c08f4d640 1 --2- 172.21.15.78:0/930197430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c04162d90 0x7f4c04151170 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4c040adc20 tx=0x7f4bfc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.610+0000 7fd282119640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd27c0704e0 0x7fd27c14dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.610+0000 7f4c00ff9640 1 -- 172.21.15.78:0/930197430 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc038040 con 0x7f4c04162d90 2024-09-17T03:08:37.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.610+0000 7f4c00ff9640 1 -- 172.21.15.78:0/930197430 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bfc0043e0 con 0x7f4c04162d90 2024-09-17T03:08:37.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.610+0000 7fd282119640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd27c0cf890 0x7fd27c15aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7f4c00ff9640 1 -- 172.21.15.78:0/930197430 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc0047d0 con 0x7f4c04162d90 2024-09-17T03:08:37.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7f73dadeb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73d406ee70 0x7f73d40cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7fd282119640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd27c1fd9b0 0x7fd27c1fddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7f73dadeb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f73d4070d20 0x7f73d41596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7fd282119640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd27c074140 con 0x7fd27c0cf890 2024-09-17T03:08:37.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7fd282119640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd27c15fa40 con 0x7fd27c1fd9b0 2024-09-17T03:08:37.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7fd282119640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd27c167ae0 con 0x7fd27c0704e0 2024-09-17T03:08:37.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7f73dadeb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73d4073160 0x7f73d41f6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7f73dadeb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f73d40cf410 con 0x7f73d4073160 2024-09-17T03:08:37.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7f73d95e8640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f73d4070d20 0x7f73d41596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7f73d95e8640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f73d4070d20 0x7f73d41596e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.78:44862/0 (socket says 172.21.15.78:44862) 2024-09-17T03:08:37.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7f73d95e8640 1 -- 172.21.15.78:0/414971371 learned_addr learned my addr 172.21.15.78:0/414971371 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:37.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7fd27b7fe640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd27c0704e0 0x7fd27c14dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7f73dadeb640 1 -- 172.21.15.78:0/414971371 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f73d40cf290 con 0x7f73d406ee70 2024-09-17T03:08:37.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7f73dadeb640 1 -- 172.21.15.78:0/414971371 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f73d40cf590 con 0x7f73d4070d20 2024-09-17T03:08:37.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7fd27bfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd27c1fd9b0 0x7fd27c1fddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7fd27b7fe640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd27c0704e0 0x7fd27c14dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.78:44864/0 (socket says 172.21.15.78:44864) 2024-09-17T03:08:37.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7fd27b7fe640 1 -- 172.21.15.78:0/2472258246 learned_addr learned my addr 172.21.15.78:0/2472258246 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:37.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7f73d9de9640 1 --2- 172.21.15.78:0/414971371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73d406ee70 0x7f73d40cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.609+0000 7fc58e2c2640 1 -- 172.21.15.78:0/1280508488 wait complete. 2024-09-17T03:08:37.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f73d95e8640 1 -- 172.21.15.78:0/414971371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73d406ee70 msgr2=0x7f73d40cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7fc58e2c2640 1 Processor -- start 2024-09-17T03:08:37.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7fe0fec63640 1 Processor -- start 2024-09-17T03:08:37.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7fd27bfff640 1 -- 172.21.15.78:0/2472258246 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd27c0704e0 msgr2=0x7fd27c14dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7fd27bfff640 1 --2- 172.21.15.78:0/2472258246 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd27c0704e0 0x7fd27c14dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7fd27bfff640 1 -- 172.21.15.78:0/2472258246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd27c0cf890 msgr2=0x7fd27c15aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7fd27bfff640 1 --2- 172.21.15.78:0/2472258246 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd27c0cf890 0x7fd27c15aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7fd27bfff640 1 -- 172.21.15.78:0/2472258246 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd27c1fe300 con 0x7fd27c1fd9b0 2024-09-17T03:08:37.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7f74eebd6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74d4004800 0x7f74e81fa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f74eebd6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74e815f200 0x7f74e815f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f74eebd6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e80cd2f0 0x7f74e80cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f74eebd6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f74e80cfad0 con 0x7f74e80cd2f0 2024-09-17T03:08:37.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f74eebd6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f74e80cf950 con 0x7f74d4004800 2024-09-17T03:08:37.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f74eebd6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f74e8163960 con 0x7f74e815f200 2024-09-17T03:08:37.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7fe0fec63640 1 -- start start 2024-09-17T03:08:37.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f74edbd4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74d4004800 0x7f74e81fa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f74ed3d3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74e815f200 0x7f74e815f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7fc58e2c2640 1 -- start start 2024-09-17T03:08:37.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f74edbd4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74d4004800 0x7f74e81fa130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.78:57590/0 (socket says 172.21.15.78:57590) 2024-09-17T03:08:37.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7fd27bfff640 1 --2- 172.21.15.78:0/2472258246 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd27c1fd9b0 0x7fd27c1fddc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd26c00c3c0 tx=0x7fd26c00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f73d95e8640 1 --2- 172.21.15.78:0/414971371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73d406ee70 0x7f73d40cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f73d95e8640 1 -- 172.21.15.78:0/414971371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73d4073160 msgr2=0x7f73d41f6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f73d95e8640 1 --2- 172.21.15.78:0/414971371 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73d4073160 0x7f73d41f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f73d95e8640 1 -- 172.21.15.78:0/414971371 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d40c5e30 con 0x7f73d4070d20 2024-09-17T03:08:37.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f74edbd4640 1 -- 172.21.15.78:0/4090303086 learned_addr learned my addr 172.21.15.78:0/4090303086 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:37.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f73d9de9640 1 --2- 172.21.15.78:0/414971371 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73d406ee70 0x7f73d40cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:37.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7fd263fff640 1 -- 172.21.15.78:0/2472258246 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c011790 con 0x7fd27c1fd9b0 2024-09-17T03:08:37.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f73d95e8640 1 --2- 172.21.15.78:0/414971371 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f73d4070d20 0x7f73d41596e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f73c400b3e0 tx=0x7f73c400b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7fd263fff640 1 -- 172.21.15.78:0/2472258246 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd26c017070 con 0x7fd27c1fd9b0 2024-09-17T03:08:37.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f74edbd4640 1 -- 172.21.15.78:0/4090303086 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74e815f200 msgr2=0x7f74e815f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f73ca7fc640 1 -- 172.21.15.78:0/414971371 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4015020 con 0x7f73d4070d20 2024-09-17T03:08:37.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f0e64acc640 1 Processor -- start 2024-09-17T03:08:37.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f74edbd4640 1 --2- 172.21.15.78:0/4090303086 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74e815f200 0x7f74e815f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f74edbd4640 1 -- 172.21.15.78:0/4090303086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e80cd2f0 msgr2=0x7f74e80cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.613+0000 7f0e64acc640 1 -- start start 2024-09-17T03:08:37.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.613+0000 7f73dadeb640 1 -- 172.21.15.78:0/414971371 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73d40c5070 con 0x7f73d4070d20 2024-09-17T03:08:37.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f74edbd4640 1 --2- 172.21.15.78:0/4090303086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e80cd2f0 0x7f74e80cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.612+0000 7f74edbd4640 1 -- 172.21.15.78:0/4090303086 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e80cdc40 con 0x7f74d4004800 2024-09-17T03:08:37.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.613+0000 7fd282119640 1 -- 172.21.15.78:0/2472258246 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd27c159680 con 0x7fd27c1fd9b0 2024-09-17T03:08:37.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.613+0000 7f73dadeb640 1 -- 172.21.15.78:0/414971371 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f73d40c5630 con 0x7f73d4070d20 2024-09-17T03:08:37.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.613+0000 7fd282119640 1 -- 172.21.15.78:0/2472258246 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd27c152360 con 0x7fd27c1fd9b0 2024-09-17T03:08:37.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.613+0000 7f73ca7fc640 1 -- 172.21.15.78:0/414971371 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73c4011940 con 0x7f73d4070d20 2024-09-17T03:08:37.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.613+0000 7fd263fff640 1 -- 172.21.15.78:0/2472258246 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd26c011cc0 con 0x7fd27c1fd9b0 2024-09-17T03:08:37.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.613+0000 7f74edbd4640 1 --2- 172.21.15.78:0/4090303086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74d4004800 0x7f74e81fa130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f74e4003fb0 tx=0x7f74e40016f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.613+0000 7f4c0974e640 1 -- 172.21.15.78:0/930197430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c0414f860 con 0x7f4c04162d90 2024-09-17T03:08:37.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.613+0000 7f4c0974e640 1 -- 172.21.15.78:0/930197430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c0414fe20 con 0x7f4c04162d90 2024-09-17T03:08:37.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.614+0000 7fc58e2c2640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc5880b9540 0x7fc5881602d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.614+0000 7f73ca7fc640 1 -- 172.21.15.78:0/414971371 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4011d90 con 0x7f73d4070d20 2024-09-17T03:08:37.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.614+0000 7fc58e2c2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5880d0bb0 0x7fc58815e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.614+0000 7fe0fec63640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0f80cceb0 0x7fe0f81570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.614+0000 7f74de7fc640 1 -- 172.21.15.78:0/4090303086 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e4015070 con 0x7f74d4004800 2024-09-17T03:08:37.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.614+0000 7f74de7fc640 1 -- 172.21.15.78:0/4090303086 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74e4011900 con 0x7f74d4004800 2024-09-17T03:08:37.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.614+0000 7f74de7fc640 1 -- 172.21.15.78:0/4090303086 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e4011d50 con 0x7f74d4004800 2024-09-17T03:08:37.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.614+0000 7f74eebd6640 1 -- 172.21.15.78:0/4090303086 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e81f9670 con 0x7f74d4004800 2024-09-17T03:08:37.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.614+0000 7f74eebd6640 1 -- 172.21.15.78:0/4090303086 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e80c5d60 con 0x7f74d4004800 2024-09-17T03:08:37.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.615+0000 7fe0fec63640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0f80cfae0 0x7fe0f8148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.615+0000 7f73dadeb640 1 -- 172.21.15.78:0/414971371 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f73bc001030 con 0x7f73d4070d20 2024-09-17T03:08:37.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.615+0000 7fe0fc9ff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0f80cceb0 0x7fe0f81570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.615+0000 7fe0fc9ff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0f80cceb0 0x7fe0f81570e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.78:57602/0 (socket says 172.21.15.78:57602) 2024-09-17T03:08:37.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.615+0000 7f0e64acc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e48003a50 0x7f0e6014d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.615+0000 7fe0f7fff640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0f80cfae0 0x7fe0f8148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.615+0000 7f0e64acc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e6015dbb0 0x7f0e600cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.615+0000 7fe0f7fff640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0f80cfae0 0x7fe0f8148ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.78:44894/0 (socket says 172.21.15.78:44894) 2024-09-17T03:08:37.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.615+0000 7f0e5e59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e48003a50 0x7f0e6014d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.615+0000 7f0e5e59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e48003a50 0x7f0e6014d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.78:57606/0 (socket says 172.21.15.78:57606) 2024-09-17T03:08:37.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.615+0000 7fd282119640 1 -- 172.21.15.78:0/2472258246 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd27c14e420 con 0x7fd27c1fd9b0 2024-09-17T03:08:37.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.615+0000 7f0e5e59c640 1 -- 172.21.15.78:0/1734795262 learned_addr learned my addr 172.21.15.78:0/1734795262 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:37.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.611+0000 7f806a72b640 1 -- start start 2024-09-17T03:08:37.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.615+0000 7f0e5dd9b640 1 --2- 172.21.15.78:0/1734795262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e6015dbb0 0x7f0e600cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.613+0000 7f806a72b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80640cf660 0x7f80640c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.613+0000 7f806a72b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80640cfb90 0x7f806415a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.613+0000 7f806a72b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f806409bce0 0x7f8064157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.613+0000 7f806a72b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f80640710a0 con 0x7f806409bce0 2024-09-17T03:08:37.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.613+0000 7f806a72b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8064070f20 con 0x7f80640cf660 2024-09-17T03:08:37.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.613+0000 7f806a72b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f80640b34f0 con 0x7f80640cfb90 2024-09-17T03:08:37.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.613+0000 7f8068cc8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f806409bce0 0x7f8064157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.613+0000 7f8068cc8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f806409bce0 0x7f8064157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34096/0 (socket says 172.21.15.78:34096) 2024-09-17T03:08:37.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.613+0000 7f8068cc8640 1 -- 172.21.15.78:0/4252198205 learned_addr learned my addr 172.21.15.78:0/4252198205 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:37.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.614+0000 7f8068cc8640 1 -- 172.21.15.78:0/4252198205 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80640cfb90 msgr2=0x7f806415a550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T03:08:37.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.614+0000 7f8068cc8640 1 --2- 172.21.15.78:0/4252198205 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80640cfb90 0x7f806415a550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.614+0000 7f8068cc8640 1 -- 172.21.15.78:0/4252198205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80640cf660 msgr2=0x7f80640c71b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T03:08:37.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.614+0000 7f8068cc8640 1 --2- 172.21.15.78:0/4252198205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80640cf660 0x7f80640c71b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.614+0000 7f8068cc8640 1 -- 172.21.15.78:0/4252198205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80640c8e70 con 0x7f806409bce0 2024-09-17T03:08:37.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.615+0000 7f0e64acc640 1 --2- 172.21.15.78:0/1734795262 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0e600cdc40 0x7f0e6015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7fe0fc9ff640 1 -- 172.21.15.78:0/1956596776 learned_addr learned my addr 172.21.15.78:0/1956596776 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:37.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.615+0000 7fc58d2c0640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc5880b9540 0x7fc5881602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7fc58d2c0640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc5880b9540 0x7fc5881602d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.78:44886/0 (socket says 172.21.15.78:44886) 2024-09-17T03:08:37.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7f0e64acc640 1 -- 172.21.15.78:0/1734795262 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0e600b2a50 con 0x7f0e6015dbb0 2024-09-17T03:08:37.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7f0e64acc640 1 -- 172.21.15.78:0/1734795262 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0e600b28d0 con 0x7f0e48003a50 2024-09-17T03:08:37.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7f0e64acc640 1 -- 172.21.15.78:0/1734795262 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0e600b2bd0 con 0x7f0e600cdc40 2024-09-17T03:08:37.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7fc58d2c0640 1 -- 172.21.15.78:0/149065790 learned_addr learned my addr 172.21.15.78:0/149065790 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:37.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7f0e5ed9d640 1 --2- 172.21.15.78:0/1734795262 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0e600cdc40 0x7f0e6015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7fe0fec63640 1 --2- 172.21.15.78:0/1956596776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0f815a9b0 0x7fe0f81e48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7fc58cabf640 1 --2- 172.21.15.78:0/149065790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5880d0bb0 0x7fc58815e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7fc58e2c2640 1 --2- 172.21.15.78:0/149065790 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5880d4ee0 0x7fc588205be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7fe0fec63640 1 -- 172.21.15.78:0/1956596776 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f80cc760 con 0x7fe0f815a9b0 2024-09-17T03:08:37.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7fe0fec63640 1 -- 172.21.15.78:0/1956596776 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f80cc5e0 con 0x7fe0f80cceb0 2024-09-17T03:08:37.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7fc58e2c2640 1 -- 172.21.15.78:0/149065790 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc58815f100 con 0x7fc5880d0bb0 2024-09-17T03:08:37.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7fe0fec63640 1 -- 172.21.15.78:0/1956596776 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe0f8070f20 con 0x7fe0f80cfae0 2024-09-17T03:08:37.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7fc58e2c2640 1 -- 172.21.15.78:0/149065790 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc58815ef80 con 0x7fc5880d4ee0 2024-09-17T03:08:37.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7f4c0974e640 1 -- 172.21.15.78:0/930197430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4c040aed50 con 0x7f4c04162d90 2024-09-17T03:08:37.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7f74eebd6640 1 -- 172.21.15.78:0/4090303086 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f74d0001030 con 0x7f74d4004800 2024-09-17T03:08:37.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7fc58dac1640 1 --2- 172.21.15.78:0/149065790 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5880d4ee0 0x7fc588205be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7fc58e2c2640 1 -- 172.21.15.78:0/149065790 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc5880b3ca0 con 0x7fc5880b9540 2024-09-17T03:08:37.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7fe0f7fff640 1 -- 172.21.15.78:0/1956596776 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0f80cceb0 msgr2=0x7fe0f81570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7fe0f7fff640 1 --2- 172.21.15.78:0/1956596776 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0f80cceb0 0x7fe0f81570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7fe0f7fff640 1 -- 172.21.15.78:0/1956596776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0f815a9b0 msgr2=0x7fe0f81e48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7fe0f7fff640 1 --2- 172.21.15.78:0/1956596776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0f815a9b0 0x7fe0f81e48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7fd263fff640 1 -- 172.21.15.78:0/2472258246 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd26c01c460 con 0x7fd27c1fd9b0 2024-09-17T03:08:37.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7fe0f7fff640 1 -- 172.21.15.78:0/1956596776 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f8157ba0 con 0x7fe0f80cfae0 2024-09-17T03:08:37.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7f0e5e59c640 1 -- 172.21.15.78:0/1734795262 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0e600cdc40 msgr2=0x7f0e6015c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7f0e5e59c640 1 --2- 172.21.15.78:0/1734795262 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0e600cdc40 0x7f0e6015c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7f0e5e59c640 1 -- 172.21.15.78:0/1734795262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e6015dbb0 msgr2=0x7f0e600cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7f0e5e59c640 1 --2- 172.21.15.78:0/1734795262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e6015dbb0 0x7f0e600cd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7f0e5e59c640 1 -- 172.21.15.78:0/1734795262 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e601f99f0 con 0x7f0e48003a50 2024-09-17T03:08:37.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7f8068cc8640 1 --2- 172.21.15.78:0/4252198205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f806409bce0 0x7f8064157150 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f805c006010 tx=0x7f805c003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7fd263fff640 1 --2- 172.21.15.78:0/2472258246 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd268078b90 0x7fd26807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.616+0000 7f73ca7fc640 1 -- 172.21.15.78:0/414971371 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f73c4018020 con 0x7f73d4070d20 2024-09-17T03:08:37.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7f0e5e59c640 1 --2- 172.21.15.78:0/1734795262 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e48003a50 0x7f0e6014d790 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e50031040 tx=0x7f0e50006c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7fc58dac1640 1 -- 172.21.15.78:0/149065790 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc5880b9540 msgr2=0x7fc5881602d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7fc58dac1640 1 --2- 172.21.15.78:0/149065790 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc5880b9540 0x7fc5881602d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7fc58dac1640 1 -- 172.21.15.78:0/149065790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5880d0bb0 msgr2=0x7fc58815e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7fc58dac1640 1 --2- 172.21.15.78:0/149065790 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5880d0bb0 0x7fc58815e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7fc58dac1640 1 -- 172.21.15.78:0/149065790 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc588160bd0 con 0x7fc5880d4ee0 2024-09-17T03:08:37.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7f8060ff9640 1 -- 172.21.15.78:0/4252198205 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c03f070 con 0x7f806409bce0 2024-09-17T03:08:37.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7fe0f7fff640 1 --2- 172.21.15.78:0/1956596776 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0f80cfae0 0x7fe0f8148ac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400e700 tx=0x7fe0e400ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7fd263fff640 1 -- 172.21.15.78:0/2472258246 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd26c09a950 con 0x7fd27c1fd9b0 2024-09-17T03:08:37.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7f8060ff9640 1 -- 172.21.15.78:0/4252198205 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f805c004540 con 0x7f806409bce0 2024-09-17T03:08:37.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7f73ca7fc640 1 --2- 172.21.15.78:0/414971371 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f73b8078bc0 0x7f73b807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7f0e4effd640 1 -- 172.21.15.78:0/1734795262 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e50032030 con 0x7f0e48003a50 2024-09-17T03:08:37.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7f8060ff9640 1 -- 172.21.15.78:0/4252198205 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805c044460 con 0x7f806409bce0 2024-09-17T03:08:37.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7f806a72b640 1 -- 172.21.15.78:0/4252198205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80640c90f0 con 0x7f806409bce0 2024-09-17T03:08:37.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.618+0000 7f806a72b640 1 -- 172.21.15.78:0/4252198205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80640c96b0 con 0x7f806409bce0 2024-09-17T03:08:37.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7fd263fff640 1 --2- 172.21.15.78:0/2472258246 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x7fd268080e60 0x7fd2680832b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7fd263fff640 1 -- 172.21.15.78:0/2472258246 --> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd26c01ae50 con 0x7fd268080e60 2024-09-17T03:08:37.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7fd263fff640 1 -- 172.21.15.78:0/2472258246 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fd26c09f280 con 0x7fd27c1fd9b0 2024-09-17T03:08:37.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7fd27b7fe640 1 --2- 172.21.15.78:0/2472258246 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd268078b90 0x7fd26807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7f74de7fc640 1 -- 172.21.15.78:0/4090303086 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f74e4018070 con 0x7f74d4004800 2024-09-17T03:08:37.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7fc58dac1640 1 --2- 172.21.15.78:0/149065790 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5880d4ee0 0x7fc588205be0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc580032000 tx=0x7fc580004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7fc57dffb640 1 -- 172.21.15.78:0/149065790 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc580045070 con 0x7fc5880d4ee0 2024-09-17T03:08:37.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.618+0000 7fc57dffb640 1 -- 172.21.15.78:0/149065790 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc580004850 con 0x7fc5880d4ee0 2024-09-17T03:08:37.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7f73ca7fc640 1 -- 172.21.15.78:0/414971371 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f73c409ad80 con 0x7f73d4070d20 2024-09-17T03:08:37.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7f73ca7fc640 1 --2- 172.21.15.78:0/414971371 >> [v2:172.21.15.193:6810/399195358,v1:172.21.15.193:6811/399195358] conn(0x7f73b8080e30 0x7f73b8083280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7f73d9de9640 1 --2- 172.21.15.78:0/414971371 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f73b8078bc0 0x7f73b807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.618+0000 7f73ca7fc640 1 -- 172.21.15.78:0/414971371 --> [v2:172.21.15.193:6810/399195358,v1:172.21.15.193:6811/399195358] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f73c400de50 con 0x7f73b8080e30 2024-09-17T03:08:37.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7fe0f57fa640 1 -- 172.21.15.78:0/1956596776 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e400cab0 con 0x7fe0f80cfae0 2024-09-17T03:08:37.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7f0e4effd640 1 -- 172.21.15.78:0/1734795262 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e50003af0 con 0x7f0e48003a50 2024-09-17T03:08:37.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7f0e64acc640 1 -- 172.21.15.78:0/1734795262 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e600ce6a0 con 0x7f0e48003a50 2024-09-17T03:08:37.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7f0e64acc640 1 -- 172.21.15.78:0/1734795262 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e6014ccb0 con 0x7f0e48003a50 2024-09-17T03:08:37.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.618+0000 7f73ca7fc640 1 -- 172.21.15.78:0/414971371 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f73c409d3e0 con 0x7f73d4070d20 2024-09-17T03:08:37.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7fe0f57fa640 1 -- 172.21.15.78:0/1956596776 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0e400cd40 con 0x7fe0f80cfae0 2024-09-17T03:08:37.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.618+0000 7f74de7fc640 1 --2- 172.21.15.78:0/4090303086 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74cc078c60 0x7f74cc07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.618+0000 7f74de7fc640 1 -- 172.21.15.78:0/4090303086 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f74e409bda0 con 0x7f74d4004800 2024-09-17T03:08:37.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.618+0000 7f74de7fc640 1 --2- 172.21.15.78:0/4090303086 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x7f74cc080f30 0x7f74cc083380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.618+0000 7f74de7fc640 1 -- 172.21.15.78:0/4090303086 --> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f74e4015e70 con 0x7f74cc080f30 2024-09-17T03:08:37.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.618+0000 7f74de7fc640 1 -- 172.21.15.78:0/4090303086 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f74e409c190 con 0x7f74d4004800 2024-09-17T03:08:37.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.619+0000 7fc57dffb640 1 -- 172.21.15.78:0/149065790 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc580036640 con 0x7fc5880d4ee0 2024-09-17T03:08:37.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.619+0000 7fc58e2c2640 1 -- 172.21.15.78:0/149065790 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc588160eb0 con 0x7fc5880d4ee0 2024-09-17T03:08:37.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.619+0000 7fc58e2c2640 1 -- 172.21.15.78:0/149065790 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc588161470 con 0x7fc5880d4ee0 2024-09-17T03:08:37.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.619+0000 7fe0fec63640 1 -- 172.21.15.78:0/1956596776 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f81e1190 con 0x7fe0f80cfae0 2024-09-17T03:08:37.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.619+0000 7fe0fec63640 1 -- 172.21.15.78:0/1956596776 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f8157620 con 0x7fe0f80cfae0 2024-09-17T03:08:37.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.619+0000 7fe0f57fa640 1 -- 172.21.15.78:0/1956596776 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e400cab0 con 0x7fe0f80cfae0 2024-09-17T03:08:37.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.619+0000 7f0e4effd640 1 -- 172.21.15.78:0/1734795262 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e50006540 con 0x7f0e48003a50 2024-09-17T03:08:37.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.617+0000 7fd27affd640 1 --2- 172.21.15.78:0/2472258246 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x7fd268080e60 0x7fd2680832b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.618+0000 7fd27affd640 1 --2- 172.21.15.78:0/2472258246 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x7fd268080e60 0x7fd2680832b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.620+0000 7f804a7fc640 1 -- 172.21.15.78:0/4252198205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f80640b39e0 con 0x7f806409bce0 2024-09-17T03:08:37.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.620+0000 7fe0fec63640 1 -- 172.21.15.78:0/1956596776 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe0f81582f0 con 0x7fe0f80cfae0 2024-09-17T03:08:37.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.619+0000 7f74ee3d5640 1 --2- 172.21.15.78:0/4090303086 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x7f74cc080f30 0x7f74cc083380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.620+0000 7fd263fff640 1 -- 172.21.15.78:0/2472258246 <== osd.2 v2:172.21.15.78:6824/3281582072 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd26c01ae50 con 0x7fd268080e60 2024-09-17T03:08:37.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.619+0000 7f73da5ea640 1 --2- 172.21.15.78:0/414971371 >> [v2:172.21.15.193:6810/399195358,v1:172.21.15.193:6811/399195358] conn(0x7f73b8080e30 0x7f73b8083280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.620+0000 7f73d9de9640 1 --2- 172.21.15.78:0/414971371 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f73b8078bc0 0x7f73b807b0d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f73d0033000 tx=0x7f73d0004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.620+0000 7f73da5ea640 1 --2- 172.21.15.78:0/414971371 >> [v2:172.21.15.193:6810/399195358,v1:172.21.15.193:6811/399195358] conn(0x7f73b8080e30 0x7f73b8083280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.620+0000 7fd27b7fe640 1 --2- 172.21.15.78:0/2472258246 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd268078b90 0x7fd26807b0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd274009420 tx=0x7fd274004ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.620+0000 7f74ed3d3640 1 --2- 172.21.15.78:0/4090303086 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74cc078c60 0x7f74cc07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.619+0000 7f0e4cff9640 1 -- 172.21.15.78:0/1734795262 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0e38001030 con 0x7f0e48003a50 2024-09-17T03:08:37.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.620+0000 7f4c00ff9640 1 -- 172.21.15.78:0/930197430 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4bfc033440 con 0x7f4c04162d90 2024-09-17T03:08:37.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.621+0000 7f0e4effd640 1 -- 172.21.15.78:0/1734795262 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0e50035020 con 0x7f0e48003a50 2024-09-17T03:08:37.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.621+0000 7f74ee3d5640 1 --2- 172.21.15.78:0/4090303086 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x7f74cc080f30 0x7f74cc083380 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.621+0000 7f4c00ff9640 1 --2- 172.21.15.78:0/930197430 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4bf0078b90 0x7f4bf007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.621+0000 7f73ca7fc640 1 -- 172.21.15.78:0/414971371 <== osd.5 v2:172.21.15.193:6810/399195358 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f73c400de50 con 0x7f73b8080e30 2024-09-17T03:08:37.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.621+0000 7f0e4effd640 1 --2- 172.21.15.78:0/1734795262 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0e40078c90 0x7f0e4007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.621+0000 7fc58e2c2640 1 -- 172.21.15.78:0/149065790 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc58815e8d0 con 0x7fc5880d4ee0 2024-09-17T03:08:37.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.621+0000 7f4c00ff9640 1 -- 172.21.15.78:0/930197430 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4bfc0bbe10 con 0x7f4c04162d90 2024-09-17T03:08:37.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.621+0000 7f8060ff9640 1 -- 172.21.15.78:0/4252198205 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f805c044600 con 0x7f806409bce0 2024-09-17T03:08:37.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.622+0000 7f0e4effd640 1 -- 172.21.15.78:0/1734795262 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0e500bbcf0 con 0x7f0e48003a50 2024-09-17T03:08:37.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.622+0000 7f74ed3d3640 1 --2- 172.21.15.78:0/4090303086 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74cc078c60 0x7f74cc07b170 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f74e0003c00 tx=0x7f74e0038040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.622+0000 7f0e5dd9b640 1 --2- 172.21.15.78:0/1734795262 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0e40078c90 0x7f0e4007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.622+0000 7f0e4effd640 1 --2- 172.21.15.78:0/1734795262 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x7f0e40080f60 0x7f0e400833b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.622+0000 7f74de7fc640 1 -- 172.21.15.78:0/4090303086 <== osd.3 v2:172.21.15.78:6800/2433795738 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f74e4015e70 con 0x7f74cc080f30 2024-09-17T03:08:37.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.622+0000 7f0e4effd640 1 -- 172.21.15.78:0/1734795262 --> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e50005eb0 con 0x7f0e40080f60 2024-09-17T03:08:37.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.622+0000 7f0e4effd640 1 -- 172.21.15.78:0/1734795262 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f0e500bc0e0 con 0x7f0e48003a50 2024-09-17T03:08:37.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.622+0000 7fc57dffb640 1 -- 172.21.15.78:0/149065790 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc58002c040 con 0x7fc5880d4ee0 2024-09-17T03:08:37.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.622+0000 7f0e5ed9d640 1 --2- 172.21.15.78:0/1734795262 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x7f0e40080f60 0x7f0e400833b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.622+0000 7f0e5dd9b640 1 --2- 172.21.15.78:0/1734795262 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0e40078c90 0x7f0e4007b1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0e6015b5f0 tx=0x7f0e54005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.621+0000 7fe0f57fa640 1 -- 172.21.15.78:0/1956596776 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe0e4004020 con 0x7fe0f80cfae0 2024-09-17T03:08:37.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.622+0000 7fe0f57fa640 1 --2- 172.21.15.78:0/1956596776 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe0dc078d90 0x7fe0dc07b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.622+0000 7fe0f57fa640 1 -- 172.21.15.78:0/1956596776 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe0e409b530 con 0x7fe0f80cfae0 2024-09-17T03:08:37.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.622+0000 7f8060ff9640 1 --2- 172.21.15.78:0/4252198205 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8050078c60 0x7f805007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.622+0000 7fe0f57fa640 1 --2- 172.21.15.78:0/1956596776 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x7fe0dc080fe0 0x7fe0dc083430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.622+0000 7fe0f57fa640 1 -- 172.21.15.78:0/1956596776 --> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe0dc083b00 con 0x7fe0dc080fe0 2024-09-17T03:08:37.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.622+0000 7fe0f57fa640 1 -- 172.21.15.78:0/1956596776 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fe0e409b920 con 0x7fe0f80cfae0 2024-09-17T03:08:37.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.622+0000 7f4c03fff640 1 --2- 172.21.15.78:0/930197430 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4bf0078b90 0x7f4bf007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.623+0000 7f4c00ff9640 1 --2- 172.21.15.78:0/930197430 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x7f4bf0080e00 0x7f4bf0083250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.623+0000 7f4c00ff9640 1 -- 172.21.15.78:0/930197430 --> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4bfc02c930 con 0x7f4bf0080e00 2024-09-17T03:08:37.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.623+0000 7f4c00ff9640 1 -- 172.21.15.78:0/930197430 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f4bfc0bc200 con 0x7f4c04162d90 2024-09-17T03:08:37.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.623+0000 7f8060ff9640 1 -- 172.21.15.78:0/4252198205 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f805c0bca20 con 0x7f806409bce0 2024-09-17T03:08:37.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.623+0000 7fc57dffb640 1 --2- 172.21.15.78:0/149065790 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc56c078c30 0x7fc56c07b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.623+0000 7fe0fc9ff640 1 --2- 172.21.15.78:0/1956596776 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe0dc078d90 0x7fe0dc07b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.623+0000 7f8063fff640 1 --2- 172.21.15.78:0/4252198205 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8050078c60 0x7f805007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.623+0000 7f0e5ed9d640 1 --2- 172.21.15.78:0/1734795262 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x7f0e40080f60 0x7f0e400833b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.623+0000 7f8060ff9640 1 --2- 172.21.15.78:0/4252198205 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x7f8050080ed0 0x7f8050083320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.623+0000 7fe0fd200640 1 --2- 172.21.15.78:0/1956596776 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x7fe0dc080fe0 0x7fe0dc083430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.623+0000 7f4c037fe640 1 --2- 172.21.15.78:0/930197430 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x7f4bf0080e00 0x7f4bf0083250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.623+0000 7f4c03fff640 1 --2- 172.21.15.78:0/930197430 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4bf0078b90 0x7f4bf007b0a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009c40 tx=0x7f4bf8005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.623+0000 7f8060ff9640 1 -- 172.21.15.78:0/4252198205 --> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80500839f0 con 0x7f8050080ed0 2024-09-17T03:08:37.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.623+0000 7f8060ff9640 1 -- 172.21.15.78:0/4252198205 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f805c0c12a0 con 0x7f806409bce0 2024-09-17T03:08:37.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.623+0000 7fc57dffb640 1 -- 172.21.15.78:0/149065790 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc5800bbfd0 con 0x7fc5880d4ee0 2024-09-17T03:08:37.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.623+0000 7fc57dffb640 1 --2- 172.21.15.78:0/149065790 >> [v2:172.21.15.193:6826/443819515,v1:172.21.15.193:6827/443819515] conn(0x7fc56c080f00 0x7fc56c083350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.623+0000 7f80637fe640 1 --2- 172.21.15.78:0/4252198205 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x7f8050080ed0 0x7f8050083320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.623+0000 7fc58d2c0640 1 --2- 172.21.15.78:0/149065790 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc56c078c30 0x7fc56c07b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.624+0000 7f4c037fe640 1 --2- 172.21.15.78:0/930197430 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x7f4bf0080e00 0x7f4bf0083250 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.624+0000 7f80637fe640 1 --2- 172.21.15.78:0/4252198205 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x7f8050080ed0 0x7f8050083320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.624+0000 7f8063fff640 1 --2- 172.21.15.78:0/4252198205 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8050078c60 0x7f805007b170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f80640c3830 tx=0x7f8054007a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.623+0000 7fc57dffb640 1 -- 172.21.15.78:0/149065790 --> [v2:172.21.15.193:6826/443819515,v1:172.21.15.193:6827/443819515] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5800020b0 con 0x7fc56c080f00 2024-09-17T03:08:37.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.624+0000 7fc57dffb640 1 -- 172.21.15.78:0/149065790 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc5800be5d0 con 0x7fc5880d4ee0 2024-09-17T03:08:37.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.624+0000 7fc58cabf640 1 --2- 172.21.15.78:0/149065790 >> [v2:172.21.15.193:6826/443819515,v1:172.21.15.193:6827/443819515] conn(0x7fc56c080f00 0x7fc56c083350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.624+0000 7fe0fc9ff640 1 --2- 172.21.15.78:0/1956596776 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe0dc078d90 0x7fe0dc07b2a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec000f60 tx=0x7fe0ec009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.624+0000 7fe0fd200640 1 --2- 172.21.15.78:0/1956596776 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x7fe0dc080fe0 0x7fe0dc083430 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.624+0000 7fc58d2c0640 1 --2- 172.21.15.78:0/149065790 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc56c078c30 0x7fc56c07b140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc5840017d0 tx=0x7fc584009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.624+0000 7f0e4effd640 1 -- 172.21.15.78:0/1734795262 <== osd.7 v2:172.21.15.193:6802/216613644 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0e50005eb0 con 0x7f0e40080f60 2024-09-17T03:08:37.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.624+0000 7fc58cabf640 1 --2- 172.21.15.78:0/149065790 >> [v2:172.21.15.193:6826/443819515,v1:172.21.15.193:6827/443819515] conn(0x7fc56c080f00 0x7fc56c083350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.625+0000 7f8060ff9640 1 -- 172.21.15.78:0/4252198205 <== osd.1 v2:172.21.15.78:6808/607587433 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f80500839f0 con 0x7f8050080ed0 2024-09-17T03:08:37.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.625+0000 7f4c00ff9640 1 -- 172.21.15.78:0/930197430 <== osd.0 v2:172.21.15.78:6816/3825297687 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4bfc02c930 con 0x7f4bf0080e00 2024-09-17T03:08:37.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.625+0000 7fe0f57fa640 1 -- 172.21.15.78:0/1956596776 <== osd.6 v2:172.21.15.193:6818/2885678262 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe0dc083b00 con 0x7fe0dc080fe0 2024-09-17T03:08:37.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.626+0000 7fc57dffb640 1 -- 172.21.15.78:0/149065790 <== osd.4 v2:172.21.15.193:6826/443819515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc5800020b0 con 0x7fc56c080f00 2024-09-17T03:08:37.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.649+0000 7fd282119640 1 -- 172.21.15.78:0/2472258246 --> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd27c159430 con 0x7fd268080e60 2024-09-17T03:08:37.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.650+0000 7fd263fff640 1 -- 172.21.15.78:0/2472258246 <== osd.2 v2:172.21.15.78:6824/3281582072 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd27c159430 con 0x7fd268080e60 2024-09-17T03:08:37.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.650+0000 7fd261ffb640 1 -- 172.21.15.78:0/2472258246 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x7fd268080e60 msgr2=0x7fd2680832b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.651+0000 7fd261ffb640 1 --2- 172.21.15.78:0/2472258246 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x7fd268080e60 0x7fd2680832b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.651+0000 7fd261ffb640 1 -- 172.21.15.78:0/2472258246 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd268078b90 msgr2=0x7fd26807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.651+0000 7fd261ffb640 1 --2- 172.21.15.78:0/2472258246 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd268078b90 0x7fd26807b0a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd274009420 tx=0x7fd274004ab0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.651+0000 7fd261ffb640 1 -- 172.21.15.78:0/2472258246 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd27c1fd9b0 msgr2=0x7fd27c1fddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.651+0000 7fd261ffb640 1 --2- 172.21.15.78:0/2472258246 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd27c1fd9b0 0x7fd27c1fddc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd26c00c3c0 tx=0x7fd26c00c880 comp rx=0 tx=0).stop 2024-09-17T03:08:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.651+0000 7fd27bfff640 1 -- 172.21.15.78:0/2472258246 reap_dead start 2024-09-17T03:08:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.651+0000 7fd261ffb640 1 -- 172.21.15.78:0/2472258246 shutdown_connections 2024-09-17T03:08:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.651+0000 7fd261ffb640 1 -- 172.21.15.78:0/2472258246 >> 172.21.15.78:0/2472258246 conn(0x7fd27c06d410 msgr2=0x7fd27c06f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.652+0000 7fd261ffb640 1 -- 172.21.15.78:0/2472258246 shutdown_connections 2024-09-17T03:08:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.652+0000 7fd261ffb640 1 -- 172.21.15.78:0/2472258246 wait complete. 2024-09-17T03:08:37.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.652+0000 7f73dadeb640 1 -- 172.21.15.78:0/414971371 --> [v2:172.21.15.193:6810/399195358,v1:172.21.15.193:6811/399195358] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f73bc002dd0 con 0x7f73b8080e30 2024-09-17T03:08:37.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.653+0000 7f74eebd6640 1 -- 172.21.15.78:0/4090303086 --> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f74d0002dd0 con 0x7f74cc080f30 2024-09-17T03:08:37.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.653+0000 7f74de7fc640 1 -- 172.21.15.78:0/4090303086 <== osd.3 v2:172.21.15.78:6800/2433795738 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f74d0002dd0 con 0x7f74cc080f30 2024-09-17T03:08:37.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.653+0000 7f73ca7fc640 1 -- 172.21.15.78:0/414971371 <== osd.5 v2:172.21.15.193:6810/399195358 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f73bc002dd0 con 0x7f73b8080e30 2024-09-17T03:08:37.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.654+0000 7f0e4cff9640 1 -- 172.21.15.78:0/1734795262 --> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0e38002dd0 con 0x7f0e40080f60 2024-09-17T03:08:37.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.654+0000 7f74eebd6640 1 -- 172.21.15.78:0/4090303086 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x7f74cc080f30 msgr2=0x7f74cc083380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.654+0000 7f74eebd6640 1 --2- 172.21.15.78:0/4090303086 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x7f74cc080f30 0x7f74cc083380 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.654+0000 7f73b7fff640 1 -- 172.21.15.78:0/414971371 >> [v2:172.21.15.193:6810/399195358,v1:172.21.15.193:6811/399195358] conn(0x7f73b8080e30 msgr2=0x7f73b8083280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.654+0000 7f73b7fff640 1 --2- 172.21.15.78:0/414971371 >> [v2:172.21.15.193:6810/399195358,v1:172.21.15.193:6811/399195358] conn(0x7f73b8080e30 0x7f73b8083280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.654+0000 7f74eebd6640 1 -- 172.21.15.78:0/4090303086 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74cc078c60 msgr2=0x7f74cc07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.654+0000 7f74eebd6640 1 --2- 172.21.15.78:0/4090303086 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74cc078c60 0x7f74cc07b170 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f74e0003c00 tx=0x7f74e0038040 comp rx=0 tx=0).stop 2024-09-17T03:08:37.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.654+0000 7f74eebd6640 1 -- 172.21.15.78:0/4090303086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74d4004800 msgr2=0x7f74e81fa130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.654+0000 7f74eebd6640 1 --2- 172.21.15.78:0/4090303086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74d4004800 0x7f74e81fa130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f74e4003fb0 tx=0x7f74e40016f0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.654+0000 7f74ee3d5640 1 -- 172.21.15.78:0/4090303086 reap_dead start 2024-09-17T03:08:37.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.654+0000 7f74eebd6640 1 -- 172.21.15.78:0/4090303086 shutdown_connections 2024-09-17T03:08:37.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.654+0000 7f74eebd6640 1 -- 172.21.15.78:0/4090303086 >> 172.21.15.78:0/4090303086 conn(0x7f74e806d410 msgr2=0x7f74e8165800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.655+0000 7f74eebd6640 1 -- 172.21.15.78:0/4090303086 shutdown_connections 2024-09-17T03:08:37.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.655+0000 7f74eebd6640 1 -- 172.21.15.78:0/4090303086 wait complete. 2024-09-17T03:08:37.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.655+0000 7f73b7fff640 1 -- 172.21.15.78:0/414971371 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f73b8078bc0 msgr2=0x7f73b807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.655+0000 7f0e4effd640 1 -- 172.21.15.78:0/1734795262 <== osd.7 v2:172.21.15.193:6802/216613644 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0e38002dd0 con 0x7f0e40080f60 2024-09-17T03:08:37.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.655+0000 7f73b7fff640 1 --2- 172.21.15.78:0/414971371 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f73b8078bc0 0x7f73b807b0d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f73d0033000 tx=0x7f73d0004730 comp rx=0 tx=0).stop 2024-09-17T03:08:37.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.655+0000 7f73b7fff640 1 -- 172.21.15.78:0/414971371 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f73d4070d20 msgr2=0x7f73d41596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.655+0000 7f73b7fff640 1 --2- 172.21.15.78:0/414971371 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f73d4070d20 0x7f73d41596e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f73c400b3e0 tx=0x7f73c400b8a0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.655+0000 7f73da5ea640 1 -- 172.21.15.78:0/414971371 reap_dead start 2024-09-17T03:08:37.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.655+0000 7f73b7fff640 1 -- 172.21.15.78:0/414971371 shutdown_connections 2024-09-17T03:08:37.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.655+0000 7f73b7fff640 1 -- 172.21.15.78:0/414971371 >> 172.21.15.78:0/414971371 conn(0x7f73d406d410 msgr2=0x7f73d40ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.655+0000 7f73b7fff640 1 -- 172.21.15.78:0/414971371 shutdown_connections 2024-09-17T03:08:37.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.655+0000 7f73b7fff640 1 -- 172.21.15.78:0/414971371 wait complete. 2024-09-17T03:08:37.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.655+0000 7f804a7fc640 1 -- 172.21.15.78:0/4252198205 --> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f80640aee90 con 0x7f8050080ed0 2024-09-17T03:08:37.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.655+0000 7fe0fec63640 1 -- 172.21.15.78:0/1956596776 --> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe0f8157950 con 0x7fe0dc080fe0 2024-09-17T03:08:37.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.655+0000 7f0e64acc640 1 -- 172.21.15.78:0/1734795262 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x7f0e40080f60 msgr2=0x7f0e400833b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.655+0000 7f0e64acc640 1 --2- 172.21.15.78:0/1734795262 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x7f0e40080f60 0x7f0e400833b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.655+0000 7f0e64acc640 1 -- 172.21.15.78:0/1734795262 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0e40078c90 msgr2=0x7f0e4007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.656+0000 7f0e64acc640 1 --2- 172.21.15.78:0/1734795262 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0e40078c90 0x7f0e4007b1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0e6015b5f0 tx=0x7f0e54005f90 comp rx=0 tx=0).stop 2024-09-17T03:08:37.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.656+0000 7f0e64acc640 1 -- 172.21.15.78:0/1734795262 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e48003a50 msgr2=0x7f0e6014d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.656+0000 7f0e64acc640 1 --2- 172.21.15.78:0/1734795262 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e48003a50 0x7f0e6014d790 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e50031040 tx=0x7f0e50006c20 comp rx=0 tx=0).stop 2024-09-17T03:08:37.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.656+0000 7f0e5ed9d640 1 -- 172.21.15.78:0/1734795262 reap_dead start 2024-09-17T03:08:37.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.656+0000 7fe0f57fa640 1 -- 172.21.15.78:0/1956596776 <== osd.6 v2:172.21.15.193:6818/2885678262 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe0f8157950 con 0x7fe0dc080fe0 2024-09-17T03:08:37.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.656+0000 7f8060ff9640 1 -- 172.21.15.78:0/4252198205 <== osd.1 v2:172.21.15.78:6808/607587433 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f80640aee90 con 0x7f8050080ed0 2024-09-17T03:08:37.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.656+0000 7f4c0974e640 1 -- 172.21.15.78:0/930197430 --> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4c04074e00 con 0x7f4bf0080e00 2024-09-17T03:08:37.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.656+0000 7f0e64acc640 1 -- 172.21.15.78:0/1734795262 shutdown_connections 2024-09-17T03:08:37.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.656+0000 7f0e64acc640 1 -- 172.21.15.78:0/1734795262 >> 172.21.15.78:0/1734795262 conn(0x7f0e60074170 msgr2=0x7f0e600b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.656+0000 7f804a7fc640 1 -- 172.21.15.78:0/4252198205 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x7f8050080ed0 msgr2=0x7f8050083320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.656+0000 7f804a7fc640 1 --2- 172.21.15.78:0/4252198205 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x7f8050080ed0 0x7f8050083320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.657+0000 7f804a7fc640 1 -- 172.21.15.78:0/4252198205 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8050078c60 msgr2=0x7f805007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.657+0000 7f804a7fc640 1 --2- 172.21.15.78:0/4252198205 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8050078c60 0x7f805007b170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f80640c3830 tx=0x7f8054007a10 comp rx=0 tx=0).stop 2024-09-17T03:08:37.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.657+0000 7f804a7fc640 1 -- 172.21.15.78:0/4252198205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f806409bce0 msgr2=0x7f8064157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.656+0000 7fc58e2c2640 1 -- 172.21.15.78:0/149065790 --> [v2:172.21.15.193:6826/443819515,v1:172.21.15.193:6827/443819515] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc588160980 con 0x7fc56c080f00 2024-09-17T03:08:37.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.656+0000 7f0e64acc640 1 -- 172.21.15.78:0/1734795262 shutdown_connections 2024-09-17T03:08:37.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.656+0000 7f0e64acc640 1 -- 172.21.15.78:0/1734795262 wait complete. 2024-09-17T03:08:37.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.657+0000 7f804a7fc640 1 --2- 172.21.15.78:0/4252198205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f806409bce0 0x7f8064157150 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f805c006010 tx=0x7f805c003ce0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.657+0000 7f8068cc8640 1 -- 172.21.15.78:0/4252198205 reap_dead start 2024-09-17T03:08:37.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.657+0000 7fe0fec63640 1 -- 172.21.15.78:0/1956596776 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x7fe0dc080fe0 msgr2=0x7fe0dc083430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.657+0000 7fe0fec63640 1 --2- 172.21.15.78:0/1956596776 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x7fe0dc080fe0 0x7fe0dc083430 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.657+0000 7f804a7fc640 1 -- 172.21.15.78:0/4252198205 shutdown_connections 2024-09-17T03:08:37.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.657+0000 7f804a7fc640 1 -- 172.21.15.78:0/4252198205 >> 172.21.15.78:0/4252198205 conn(0x7f80640b1cb0 msgr2=0x7f80640ccb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.657+0000 7fe0fec63640 1 -- 172.21.15.78:0/1956596776 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe0dc078d90 msgr2=0x7fe0dc07b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.657+0000 7fe0fec63640 1 --2- 172.21.15.78:0/1956596776 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe0dc078d90 0x7fe0dc07b2a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec000f60 tx=0x7fe0ec009040 comp rx=0 tx=0).stop 2024-09-17T03:08:37.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.657+0000 7f4c00ff9640 1 -- 172.21.15.78:0/930197430 <== osd.0 v2:172.21.15.78:6816/3825297687 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4c04074e00 con 0x7f4bf0080e00 2024-09-17T03:08:37.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.657+0000 7fe0fec63640 1 -- 172.21.15.78:0/1956596776 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0f80cfae0 msgr2=0x7fe0f8148ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.657+0000 7fe0fec63640 1 --2- 172.21.15.78:0/1956596776 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0f80cfae0 0x7fe0f8148ac0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400e700 tx=0x7fe0e400ebc0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.657+0000 7fc57dffb640 1 -- 172.21.15.78:0/149065790 <== osd.4 v2:172.21.15.193:6826/443819515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc588160980 con 0x7fc56c080f00 2024-09-17T03:08:37.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7f804a7fc640 1 -- 172.21.15.78:0/4252198205 shutdown_connections 2024-09-17T03:08:37.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7fe0fd200640 1 -- 172.21.15.78:0/1956596776 reap_dead start 2024-09-17T03:08:37.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7fe0fec63640 1 -- 172.21.15.78:0/1956596776 shutdown_connections 2024-09-17T03:08:37.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7fe0fec63640 1 -- 172.21.15.78:0/1956596776 >> 172.21.15.78:0/1956596776 conn(0x7fe0f806d7d0 msgr2=0x7fe0f80b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7fe0fec63640 1 -- 172.21.15.78:0/1956596776 shutdown_connections 2024-09-17T03:08:37.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7fe0fec63640 1 -- 172.21.15.78:0/1956596776 wait complete. 2024-09-17T03:08:37.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7fc58e2c2640 1 -- 172.21.15.78:0/149065790 >> [v2:172.21.15.193:6826/443819515,v1:172.21.15.193:6827/443819515] conn(0x7fc56c080f00 msgr2=0x7fc56c083350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7fc58e2c2640 1 --2- 172.21.15.78:0/149065790 >> [v2:172.21.15.193:6826/443819515,v1:172.21.15.193:6827/443819515] conn(0x7fc56c080f00 0x7fc56c083350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7f4c0974e640 1 -- 172.21.15.78:0/930197430 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x7f4bf0080e00 msgr2=0x7f4bf0083250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7f4c0974e640 1 --2- 172.21.15.78:0/930197430 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x7f4bf0080e00 0x7f4bf0083250 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7f4c0974e640 1 -- 172.21.15.78:0/930197430 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4bf0078b90 msgr2=0x7f4bf007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7f4c0974e640 1 --2- 172.21.15.78:0/930197430 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4bf0078b90 0x7f4bf007b0a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009c40 tx=0x7f4bf8005f90 comp rx=0 tx=0).stop 2024-09-17T03:08:37.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7f4c0974e640 1 -- 172.21.15.78:0/930197430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c04162d90 msgr2=0x7f4c04151170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7f4c0974e640 1 --2- 172.21.15.78:0/930197430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c04162d90 0x7f4c04151170 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4c040adc20 tx=0x7f4bfc004270 comp rx=0 tx=0).stop 2024-09-17T03:08:37.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7f4c08f4d640 1 -- 172.21.15.78:0/930197430 reap_dead start 2024-09-17T03:08:37.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7f4c0974e640 1 -- 172.21.15.78:0/930197430 shutdown_connections 2024-09-17T03:08:37.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7f4c0974e640 1 -- 172.21.15.78:0/930197430 >> 172.21.15.78:0/930197430 conn(0x7f4c04070b20 msgr2=0x7f4c04068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7f804a7fc640 1 -- 172.21.15.78:0/4252198205 wait complete. 2024-09-17T03:08:37.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7fc58e2c2640 1 -- 172.21.15.78:0/149065790 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc56c078c30 msgr2=0x7fc56c07b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7fc58e2c2640 1 --2- 172.21.15.78:0/149065790 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc56c078c30 0x7fc56c07b140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc5840017d0 tx=0x7fc584009040 comp rx=0 tx=0).stop 2024-09-17T03:08:37.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7fc58e2c2640 1 -- 172.21.15.78:0/149065790 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5880d4ee0 msgr2=0x7fc588205be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7fc58e2c2640 1 --2- 172.21.15.78:0/149065790 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5880d4ee0 0x7fc588205be0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc580032000 tx=0x7fc580004270 comp rx=0 tx=0).stop 2024-09-17T03:08:37.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7fc58dac1640 1 -- 172.21.15.78:0/149065790 reap_dead start 2024-09-17T03:08:37.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7fc58e2c2640 1 -- 172.21.15.78:0/149065790 shutdown_connections 2024-09-17T03:08:37.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.658+0000 7fc58e2c2640 1 -- 172.21.15.78:0/149065790 >> 172.21.15.78:0/149065790 conn(0x7fc58809d680 msgr2=0x7fc5880b7450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.659+0000 7f4c0974e640 1 -- 172.21.15.78:0/930197430 shutdown_connections 2024-09-17T03:08:37.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.659+0000 7f4c0974e640 1 -- 172.21.15.78:0/930197430 wait complete. 2024-09-17T03:08:37.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.659+0000 7fc58e2c2640 1 -- 172.21.15.78:0/149065790 shutdown_connections 2024-09-17T03:08:37.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.659+0000 7fc58e2c2640 1 -- 172.21.15.78:0/149065790 wait complete. 2024-09-17T03:08:37.702 INFO:teuthology.orchestra.run.smithi078.stdout:64424509449 2024-09-17T03:08:37.702 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T03:08:37.703 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2024-09-17T03:08:37.703 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T03:08:37.704 INFO:teuthology.orchestra.run.smithi078.stdout:64424509447 2024-09-17T03:08:37.704 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T03:08:37.705 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-17T03:08:37.705 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T03:08:37.706 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-17T03:08:37.706 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T03:08:37.707 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-17T03:08:37.707 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T03:08:37.708 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-17T03:08:37.708 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T03:08:37.709 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-17T03:08:37.709 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T03:08:37.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.957+0000 7ff853fff640 1 -- 172.21.15.78:0/2975928368 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff854070d20 msgr2=0x7ff85415b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.957+0000 7ff853fff640 1 --2- 172.21.15.78:0/2975928368 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff854070d20 0x7ff85415b8c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff83c009830 tx=0x7ff83c02a510 comp rx=0 tx=0).stop 2024-09-17T03:08:37.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.957+0000 7f70b6171640 1 -- 172.21.15.78:0/1723895051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f709c005320 msgr2=0x7f709c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.957+0000 7ff853fff640 1 -- 172.21.15.78:0/2975928368 shutdown_connections 2024-09-17T03:08:37.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.957+0000 7ff853fff640 1 --2- 172.21.15.78:0/2975928368 >> v2:172.21.15.193:3300/0 conn(0x7ff85406ee70 0x7ff85406f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.957+0000 7ff853fff640 1 --2- 172.21.15.78:0/2975928368 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff854070d20 0x7ff85415b8c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.957+0000 7ff853fff640 1 -- 172.21.15.78:0/2975928368 >> 172.21.15.78:0/2975928368 conn(0x7ff85406d410 msgr2=0x7ff8540b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.957+0000 7f70b6171640 1 --2- 172.21.15.78:0/1723895051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f709c005320 0x7f709c00b9c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f70a800c610 tx=0x7f709c005830 comp rx=0 tx=0).stop 2024-09-17T03:08:37.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.957+0000 7f70affff640 1 -- 172.21.15.78:0/1723895051 reap_dead start 2024-09-17T03:08:37.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.958+0000 7f70b6171640 1 -- 172.21.15.78:0/1723895051 shutdown_connections 2024-09-17T03:08:37.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.958+0000 7f70b6171640 1 -- 172.21.15.78:0/1723895051 >> 172.21.15.78:0/1723895051 conn(0x7f70b00b1cb0 msgr2=0x7f70b00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.958+0000 7f70b6171640 1 -- 172.21.15.78:0/1723895051 shutdown_connections 2024-09-17T03:08:37.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.958+0000 7f99f159a640 1 -- 172.21.15.78:0/742667628 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec00c2c0 con 0x7f99dc0039f0 2024-09-17T03:08:37.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.959+0000 7f43c5961640 1 -- 172.21.15.78:0/3258863103 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f43b800ae50 msgr2=0x7f43b800b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.959+0000 7f43c5961640 1 --2- 172.21.15.78:0/3258863103 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f43b800ae50 0x7f43b800b260 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00a940 tx=0x7f43ac02b7b0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.959+0000 7f43c5961640 1 -- 172.21.15.78:0/3258863103 shutdown_connections 2024-09-17T03:08:37.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.959+0000 7f43c5961640 1 --2- 172.21.15.78:0/3258863103 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f43b800ae50 0x7f43b800b260 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.959+0000 7f43c5961640 1 --2- 172.21.15.78:0/3258863103 >> v2:172.21.15.193:3300/0 conn(0x7f43b8053c00 0x7f43b8052360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.959+0000 7f43c5961640 1 -- 172.21.15.78:0/3258863103 >> 172.21.15.78:0/3258863103 conn(0x7f43b8051420 msgr2=0x7f43b8051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.958+0000 7ff853fff640 1 -- 172.21.15.78:0/2975928368 shutdown_connections 2024-09-17T03:08:37.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.958+0000 7ff853fff640 1 -- 172.21.15.78:0/2975928368 wait complete. 2024-09-17T03:08:37.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.958+0000 7f70b6171640 1 -- 172.21.15.78:0/1723895051 wait complete. 2024-09-17T03:08:37.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.959+0000 7f99f8d32640 1 -- 172.21.15.78:0/742667628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99dc0039f0 msgr2=0x7f99dc003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.960+0000 7f43c5961640 1 -- 172.21.15.78:0/3258863103 shutdown_connections 2024-09-17T03:08:37.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.959+0000 7f99f8d32640 1 --2- 172.21.15.78:0/742667628 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99dc0039f0 0x7f99dc003e80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f99ec00c6a0 tx=0x7f99dc005830 comp rx=0 tx=0).stop 2024-09-17T03:08:37.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.960+0000 7f99f2d9d640 1 -- 172.21.15.78:0/742667628 reap_dead start 2024-09-17T03:08:37.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.960+0000 7f43c5961640 1 -- 172.21.15.78:0/3258863103 wait complete. 2024-09-17T03:08:37.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.960+0000 7f99f8d32640 1 -- 172.21.15.78:0/742667628 shutdown_connections 2024-09-17T03:08:37.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.960+0000 7f99f8d32640 1 -- 172.21.15.78:0/742667628 >> 172.21.15.78:0/742667628 conn(0x7f99f408bfc0 msgr2=0x7f99f409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.961+0000 7f99f8d32640 1 -- 172.21.15.78:0/742667628 shutdown_connections 2024-09-17T03:08:37.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.961+0000 7f95450c4640 1 -- 172.21.15.78:0/3642702348 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9540070f20 msgr2=0x7f95400cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.961+0000 7f95450c4640 1 --2- 172.21.15.78:0/3642702348 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9540070f20 0x7f95400cf010 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9530009830 tx=0x7f953002a490 comp rx=0 tx=0).stop 2024-09-17T03:08:37.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.962+0000 7f95450c4640 1 -- 172.21.15.78:0/3642702348 shutdown_connections 2024-09-17T03:08:37.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.962+0000 7f95450c4640 1 --2- 172.21.15.78:0/3642702348 >> v2:172.21.15.78:3300/0 conn(0x7f95400cd240 0x7f95400b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.962+0000 7f95450c4640 1 --2- 172.21.15.78:0/3642702348 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9540070f20 0x7f95400cf010 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.962+0000 7f95450c4640 1 -- 172.21.15.78:0/3642702348 >> 172.21.15.78:0/3642702348 conn(0x7f95400b1cb0 msgr2=0x7f95400b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.962+0000 7f95450c4640 1 -- 172.21.15.78:0/3642702348 shutdown_connections 2024-09-17T03:08:37.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.963+0000 7f43c5961640 1 Processor -- start 2024-09-17T03:08:37.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.962+0000 7f95450c4640 1 -- 172.21.15.78:0/3642702348 wait complete. 2024-09-17T03:08:37.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.961+0000 7f70b6171640 1 Processor -- start 2024-09-17T03:08:37.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.963+0000 7f43c5961640 1 -- start start 2024-09-17T03:08:37.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.961+0000 7f70b6171640 1 -- start start 2024-09-17T03:08:37.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.962+0000 7ff853fff640 1 Processor -- start 2024-09-17T03:08:37.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.962+0000 7ff853fff640 1 -- start start 2024-09-17T03:08:37.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.963+0000 7f99f8d32640 1 -- 172.21.15.78:0/742667628 wait complete. 2024-09-17T03:08:37.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.963+0000 7f70b6171640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f709c005320 0x7f70b0161a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.963+0000 7f70b6171640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f70b0161f70 0x7f70b0158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.963+0000 7f70b6171640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f70b0154b00 0x7f70b0158a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.963+0000 7f70b6171640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f70b00cf7e0 con 0x7f709c005320 2024-09-17T03:08:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.963+0000 7f70b6171640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f70b00cf660 con 0x7f70b0161f70 2024-09-17T03:08:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.963+0000 7f70b6171640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f70b00cf960 con 0x7f70b0154b00 2024-09-17T03:08:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.964+0000 7f70aeffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f70b0161f70 0x7f70b0158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.964+0000 7f70aeffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f70b0161f70 0x7f70b0158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.78:57688/0 (socket says 172.21.15.78:57688) 2024-09-17T03:08:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.964+0000 7f70aeffd640 1 -- 172.21.15.78:0/4144788600 learned_addr learned my addr 172.21.15.78:0/4144788600 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.964+0000 7f70affff640 1 --2- 172.21.15.78:0/4144788600 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f70b0154b00 0x7f70b0158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.964+0000 7f70af7fe640 1 --2- 172.21.15.78:0/4144788600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f709c005320 0x7f70b0161a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.964+0000 7f70aeffd640 1 -- 172.21.15.78:0/4144788600 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f70b0154b00 msgr2=0x7f70b0158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.964+0000 7f70aeffd640 1 --2- 172.21.15.78:0/4144788600 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f70b0154b00 0x7f70b0158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.964+0000 7f70aeffd640 1 -- 172.21.15.78:0/4144788600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f709c005320 msgr2=0x7f70b0161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.964+0000 7f70aeffd640 1 --2- 172.21.15.78:0/4144788600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f709c005320 0x7f70b0161a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.964+0000 7f70aeffd640 1 -- 172.21.15.78:0/4144788600 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70b01e8890 con 0x7f70b0161f70 2024-09-17T03:08:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.964+0000 7f70af7fe640 1 --2- 172.21.15.78:0/4144788600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f709c005320 0x7f70b0161a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:08:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.964+0000 7ff853fff640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff85406ee70 0x7ff8540cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.964+0000 7ff853fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff854070d20 0x7ff854146920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.964+0000 7f70aeffd640 1 --2- 172.21.15.78:0/4144788600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f70b0161f70 0x7f70b0158530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f709800e920 tx=0x7f709800ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7ff853fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff854073160 0x7ff8541471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7ff852ffd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff85406ee70 0x7ff8540cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7ff853fff640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff8540cf680 con 0x7ff854070d20 2024-09-17T03:08:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7ff853fff640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff8540cf500 con 0x7ff854073160 2024-09-17T03:08:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7ff853fff640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff8540cf800 con 0x7ff85406ee70 2024-09-17T03:08:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7ff8527fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff854070d20 0x7ff854146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7f43c5961640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f43b800ae50 0x7f43b817eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7f43c5961640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f43b8053c00 0x7f43b80d8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7f43c5961640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43b80e35c0 0x7f43b80d8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7f43c5961640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f43b8052a20 con 0x7f43b80e35c0 2024-09-17T03:08:37.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7f43c5961640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f43b80528a0 con 0x7f43b8053c00 2024-09-17T03:08:37.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7f43c5961640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f43b80065f0 con 0x7f43b800ae50 2024-09-17T03:08:37.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7f70a7fff640 1 -- 172.21.15.78:0/4144788600 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709800cc40 con 0x7f70b0161f70 2024-09-17T03:08:37.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7f70a7fff640 1 -- 172.21.15.78:0/4144788600 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f709800cde0 con 0x7f70b0161f70 2024-09-17T03:08:37.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7ff852ffd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff85406ee70 0x7ff8540cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.78:45010/0 (socket says 172.21.15.78:45010) 2024-09-17T03:08:37.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7ff852ffd640 1 -- 172.21.15.78:0/342012266 learned_addr learned my addr 172.21.15.78:0/342012266 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:37.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7f43bffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f43b8053c00 0x7f43b80d8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7f43c495f640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f43b800ae50 0x7f43b817eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7f43c495f640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f43b800ae50 0x7f43b817eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.78:45022/0 (socket says 172.21.15.78:45022) 2024-09-17T03:08:37.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7f43c495f640 1 -- 172.21.15.78:0/1808472437 learned_addr learned my addr 172.21.15.78:0/1808472437 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:37.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.965+0000 7ff8537fe640 1 --2- 172.21.15.78:0/342012266 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff854073160 0x7ff8541471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f95450c4640 1 Processor -- start 2024-09-17T03:08:37.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f6eb508a640 1 -- 172.21.15.78:0/1039607318 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ea00039b0 msgr2=0x7f6ea0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f6eb508a640 1 --2- 172.21.15.78:0/1039607318 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ea00039b0 0x7f6ea0003e20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6eb006b8e0 tx=0x7f6ea0005830 comp rx=0 tx=0).stop 2024-09-17T03:08:37.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f43c5160640 1 --2- 172.21.15.78:0/1808472437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43b80e35c0 0x7f43b80d8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f95450c4640 1 -- start start 2024-09-17T03:08:37.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f834aaec640 1 -- 172.21.15.78:0/1053208726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f834406e3c0 msgr2=0x7f834406f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f834aaec640 1 --2- 172.21.15.78:0/1053208726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f834406e3c0 0x7f834406f7a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f834408c950 tx=0x7f833c02aa00 comp rx=0 tx=0).stop 2024-09-17T03:08:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f43c495f640 1 -- 172.21.15.78:0/1808472437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f43b8053c00 msgr2=0x7f43b80d8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f43c495f640 1 --2- 172.21.15.78:0/1808472437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f43b8053c00 0x7f43b80d8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f43c495f640 1 -- 172.21.15.78:0/1808472437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43b80e35c0 msgr2=0x7f43b80d8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f43c495f640 1 --2- 172.21.15.78:0/1808472437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43b80e35c0 0x7f43b80d8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f43c495f640 1 -- 172.21.15.78:0/1808472437 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b80d6b10 con 0x7f43b800ae50 2024-09-17T03:08:37.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f99f8d32640 1 Processor -- start 2024-09-17T03:08:37.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f834aaec640 1 -- 172.21.15.78:0/1053208726 shutdown_connections 2024-09-17T03:08:37.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f834aaec640 1 --2- 172.21.15.78:0/1053208726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f834406e3c0 0x7f834406f7a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f43c5160640 1 --2- 172.21.15.78:0/1808472437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43b80e35c0 0x7f43b80d8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:08:37.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f834aaec640 1 --2- 172.21.15.78:0/1053208726 >> v2:172.21.15.78:3300/0 conn(0x7f83440b3a60 0x7f83440cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f834aaec640 1 -- 172.21.15.78:0/1053208726 >> 172.21.15.78:0/1053208726 conn(0x7f834408bfc0 msgr2=0x7f834409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f70b6171640 1 -- 172.21.15.78:0/4144788600 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70b01e8b70 con 0x7f70b0161f70 2024-09-17T03:08:37.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f70a7fff640 1 -- 172.21.15.78:0/4144788600 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7098005280 con 0x7f70b0161f70 2024-09-17T03:08:37.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f70b6171640 1 -- 172.21.15.78:0/4144788600 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70b009bc40 con 0x7f70b0161f70 2024-09-17T03:08:37.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f43c495f640 1 --2- 172.21.15.78:0/1808472437 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f43b800ae50 0x7f43b817eab0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f43c006ad50 tx=0x7f43c0069c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7ff852ffd640 1 -- 172.21.15.78:0/342012266 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff854073160 msgr2=0x7ff8541471d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7ff852ffd640 1 --2- 172.21.15.78:0/342012266 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff854073160 0x7ff8541471d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7ff852ffd640 1 -- 172.21.15.78:0/342012266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff854070d20 msgr2=0x7ff854146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7ff852ffd640 1 --2- 172.21.15.78:0/342012266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff854070d20 0x7ff854146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7ff852ffd640 1 -- 172.21.15.78:0/342012266 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8540ca360 con 0x7ff85406ee70 2024-09-17T03:08:37.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f834aaec640 1 -- 172.21.15.78:0/1053208726 shutdown_connections 2024-09-17T03:08:37.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f6eb4889640 1 -- 172.21.15.78:0/1039607318 reap_dead start 2024-09-17T03:08:37.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f99f8d32640 1 -- start start 2024-09-17T03:08:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f6eb508a640 1 -- 172.21.15.78:0/1039607318 shutdown_connections 2024-09-17T03:08:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f6eb508a640 1 -- 172.21.15.78:0/1039607318 >> 172.21.15.78:0/1039607318 conn(0x7f6ea8055e60 msgr2=0x7f6ea800e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f43bd7fa640 1 -- 172.21.15.78:0/1808472437 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c0074770 con 0x7f43b800ae50 2024-09-17T03:08:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f43bd7fa640 1 -- 172.21.15.78:0/1808472437 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f43c008f070 con 0x7f43b800ae50 2024-09-17T03:08:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f43bd7fa640 1 -- 172.21.15.78:0/1808472437 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c0074bf0 con 0x7f43b800ae50 2024-09-17T03:08:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.966+0000 7f43c5961640 1 -- 172.21.15.78:0/1808472437 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b80d6510 con 0x7f43b800ae50 2024-09-17T03:08:37.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.967+0000 7f43c5961640 1 -- 172.21.15.78:0/1808472437 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b80d6dd0 con 0x7f43b800ae50 2024-09-17T03:08:37.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.967+0000 7ff852ffd640 1 --2- 172.21.15.78:0/342012266 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff85406ee70 0x7ff8540cb400 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff83c000c00 tx=0x7ff83c033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.967+0000 7f6eb508a640 1 -- 172.21.15.78:0/1039607318 shutdown_connections 2024-09-17T03:08:37.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.967+0000 7f834aaec640 1 -- 172.21.15.78:0/1053208726 wait complete. 2024-09-17T03:08:37.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.967+0000 7f0fd2607640 1 -- 172.21.15.78:0/3609255099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fcc0b8500 msgr2=0x7f0fcc0b8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.967+0000 7f0fd2607640 1 --2- 172.21.15.78:0/3609255099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fcc0b8500 0x7f0fcc0b8910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4005fd0 tx=0x7f0fc402a800 comp rx=0 tx=0).stop 2024-09-17T03:08:37.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.968+0000 7f0fd2607640 1 -- 172.21.15.78:0/3609255099 shutdown_connections 2024-09-17T03:08:37.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.968+0000 7f95450c4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9540070f20 0x7f954015a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.968+0000 7f43c5961640 1 -- 172.21.15.78:0/1808472437 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b800b260 con 0x7f43b800ae50 2024-09-17T03:08:37.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.968+0000 7f0fd2607640 1 --2- 172.21.15.78:0/3609255099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fcc0b8500 0x7f0fcc0b8910 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.968+0000 7f0fd2607640 1 --2- 172.21.15.78:0/3609255099 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0fcc0b39a0 0x7f0fcc0b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.968+0000 7f0fd2607640 1 -- 172.21.15.78:0/3609255099 >> 172.21.15.78:0/3609255099 conn(0x7f0fcc08bfc0 msgr2=0x7f0fcc09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:37.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.968+0000 7f95450c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95400cf660 0x7f954015d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.968+0000 7f95450c4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95401f5dc0 0x7f954015d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.968+0000 7f953ed9d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9540070f20 0x7f954015a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.968+0000 7f953ed9d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9540070f20 0x7f954015a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.78:45028/0 (socket says 172.21.15.78:45028) 2024-09-17T03:08:37.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7f99f8d32640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99dc0039f0 0x7f99f40cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7f95450c4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f95400cfd10 con 0x7f95400cf660 2024-09-17T03:08:37.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7f953ed9d640 1 -- 172.21.15.78:0/4267187920 learned_addr learned my addr 172.21.15.78:0/4267187920 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:37.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7f953e59c640 1 --2- 172.21.15.78:0/4267187920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95400cf660 0x7f954015d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7f953f59e640 1 --2- 172.21.15.78:0/4267187920 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95401f5dc0 0x7f954015d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7f95450c4640 1 -- 172.21.15.78:0/4267187920 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f95400cfb90 con 0x7f95401f5dc0 2024-09-17T03:08:37.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7f95450c4640 1 -- 172.21.15.78:0/4267187920 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f95400cfe90 con 0x7f9540070f20 2024-09-17T03:08:37.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.968+0000 7f0fd2607640 1 -- 172.21.15.78:0/3609255099 shutdown_connections 2024-09-17T03:08:37.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.968+0000 7f0fd2607640 1 -- 172.21.15.78:0/3609255099 wait complete. 2024-09-17T03:08:37.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7f70b6171640 1 -- 172.21.15.78:0/4144788600 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70b00cf010 con 0x7f70b0161f70 2024-09-17T03:08:37.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.967+0000 7f6eb508a640 1 -- 172.21.15.78:0/1039607318 wait complete. 2024-09-17T03:08:37.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7f99f8d32640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99f415f330 0x7f99f41f94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7f99f8d32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99f41f99e0 0x7f99f41604d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7f99f8d32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f99f40b3700 con 0x7f99f41f99e0 2024-09-17T03:08:37.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7f99f8d32640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f99f40b3580 con 0x7f99f415f330 2024-09-17T03:08:37.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7f99f8d32640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f99f40b3880 con 0x7f99dc0039f0 2024-09-17T03:08:37.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7f953f59e640 1 -- 172.21.15.78:0/4267187920 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9540070f20 msgr2=0x7f954015a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7f953f59e640 1 --2- 172.21.15.78:0/4267187920 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9540070f20 0x7f954015a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7f953f59e640 1 -- 172.21.15.78:0/4267187920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95400cf660 msgr2=0x7f954015d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7f953f59e640 1 --2- 172.21.15.78:0/4267187920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95400cf660 0x7f954015d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7f953f59e640 1 -- 172.21.15.78:0/4267187920 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95400c69a0 con 0x7f95401f5dc0 2024-09-17T03:08:37.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7f70a7fff640 1 -- 172.21.15.78:0/4144788600 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7098005420 con 0x7f70b0161f70 2024-09-17T03:08:37.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.970+0000 7f834aaec640 1 Processor -- start 2024-09-17T03:08:37.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.970+0000 7f99f2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99f41f99e0 0x7f99f41604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7ff84b7fe640 1 -- 172.21.15.78:0/342012266 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c005c90 con 0x7ff85406ee70 2024-09-17T03:08:37.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.970+0000 7f99f2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99f41f99e0 0x7f99f41604d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34224/0 (socket says 172.21.15.78:34224) 2024-09-17T03:08:37.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.970+0000 7f99f2d9d640 1 -- 172.21.15.78:0/3255353059 learned_addr learned my addr 172.21.15.78:0/3255353059 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:37.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7ff84b7fe640 1 -- 172.21.15.78:0/342012266 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff83c031e50 con 0x7ff85406ee70 2024-09-17T03:08:37.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.969+0000 7ff84b7fe640 1 -- 172.21.15.78:0/342012266 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83c0332f0 con 0x7ff85406ee70 2024-09-17T03:08:37.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.970+0000 7ff853fff640 1 -- 172.21.15.78:0/342012266 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8540ca640 con 0x7ff85406ee70 2024-09-17T03:08:37.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.970+0000 7ff853fff640 1 -- 172.21.15.78:0/342012266 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8540cac00 con 0x7ff85406ee70 2024-09-17T03:08:37.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.970+0000 7f43bd7fa640 1 -- 172.21.15.78:0/1808472437 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f43c0094470 con 0x7f43b800ae50 2024-09-17T03:08:37.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.970+0000 7f99f1d9b640 1 --2- 172.21.15.78:0/3255353059 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99f415f330 0x7f99f41f94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.970+0000 7f6eb508a640 1 Processor -- start 2024-09-17T03:08:37.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.970+0000 7f6eb508a640 1 -- start start 2024-09-17T03:08:37.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.970+0000 7f834aaec640 1 -- start start 2024-09-17T03:08:37.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.970+0000 7f70a7fff640 1 --2- 172.21.15.78:0/4144788600 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7090078b90 0x7f709007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.970+0000 7f70a7fff640 1 -- 172.21.15.78:0/4144788600 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f709809b700 con 0x7f70b0161f70 2024-09-17T03:08:37.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.970+0000 7f953f59e640 1 --2- 172.21.15.78:0/4267187920 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95401f5dc0 0x7f954015d8d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f953800ed50 tx=0x7f953800c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.970+0000 7f43bd7fa640 1 --2- 172.21.15.78:0/1808472437 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f43a4078bc0 0x7f43a407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.970+0000 7f99f2d9d640 1 -- 172.21.15.78:0/3255353059 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99dc0039f0 msgr2=0x7f99f40cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.971+0000 7f43bffff640 1 --2- 172.21.15.78:0/1808472437 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f43a4078bc0 0x7f43a407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.971+0000 7f70af7fe640 1 --2- 172.21.15.78:0/4144788600 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7090078b90 0x7f709007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.971+0000 7f0fd2607640 1 Processor -- start 2024-09-17T03:08:37.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.970+0000 7f99f2d9d640 1 --2- 172.21.15.78:0/3255353059 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99dc0039f0 0x7f99f40cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.970+0000 7f99f2d9d640 1 -- 172.21.15.78:0/3255353059 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99f415f330 msgr2=0x7f99f41f94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:37.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.970+0000 7f99f2d9d640 1 --2- 172.21.15.78:0/3255353059 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99f415f330 0x7f99f41f94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:37.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.970+0000 7f99f2d9d640 1 -- 172.21.15.78:0/3255353059 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99f415e140 con 0x7f99f41f99e0 2024-09-17T03:08:37.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.971+0000 7f43bd7fa640 1 -- 172.21.15.78:0/1808472437 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f43c0116140 con 0x7f43b800ae50 2024-09-17T03:08:37.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.971+0000 7f0fd2607640 1 -- start start 2024-09-17T03:08:37.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.971+0000 7f99f2d9d640 1 --2- 172.21.15.78:0/3255353059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99f41f99e0 0x7f99f41604d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f99f408cc10 tx=0x7f99e400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.971+0000 7f43bffff640 1 --2- 172.21.15.78:0/1808472437 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f43a4078bc0 0x7f43a407b0d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f43b80225c0 tx=0x7f43ac004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.972+0000 7ff8497fa640 1 -- 172.21.15.78:0/342012266 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff82c005290 con 0x7ff85406ee70 2024-09-17T03:08:37.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.972+0000 7f99e2ffd640 1 -- 172.21.15.78:0/3255353059 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e4007480 con 0x7f99f41f99e0 2024-09-17T03:08:37.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.972+0000 7f99e2ffd640 1 -- 172.21.15.78:0/3255353059 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99e4004020 con 0x7f99f41f99e0 2024-09-17T03:08:37.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.972+0000 7f99e2ffd640 1 -- 172.21.15.78:0/3255353059 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e4004430 con 0x7f99f41f99e0 2024-09-17T03:08:37.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.972+0000 7f99f8d32640 1 -- 172.21.15.78:0/3255353059 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99f415e420 con 0x7f99f41f99e0 2024-09-17T03:08:37.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.972+0000 7f99f8d32640 1 -- 172.21.15.78:0/3255353059 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99f415e9e0 con 0x7f99f41f99e0 2024-09-17T03:08:37.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.972+0000 7f70af7fe640 1 --2- 172.21.15.78:0/4144788600 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7090078b90 0x7f709007b0a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f70a0000f60 tx=0x7f70a0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:37.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.972+0000 7ff84b7fe640 1 -- 172.21.15.78:0/342012266 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff83c033490 con 0x7ff85406ee70 2024-09-17T03:08:37.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7f0fd2607640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fcc0b39a0 0x7f0fcc0c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7f6eb508a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ea80d1a30 0x7f6ea80d13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7f6eb508a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ea80d1f60 0x7f6ea804dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7f834aaec640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f834406e3c0 0x7f83441f68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7ff84b7fe640 1 --2- 172.21.15.78:0/342012266 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff834078c10 0x7ff83407b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7f0fd2607640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fcc0b8500 0x7f0fcc1f9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7f834aaec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83440b3a60 0x7f834415af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7f834aaec640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83440d0e10 0x7f83440a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:37.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7f0fcbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fcc0b39a0 0x7f0fcc0c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7f834aaec640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f83440d2c40 con 0x7f83440b3a60 2024-09-17T03:08:37.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7f834aaec640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f83440d2ac0 con 0x7f834406e3c0 2024-09-17T03:08:37.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7f834aaec640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f83440d2dc0 con 0x7f83440d0e10 2024-09-17T03:08:37.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7f6eaffff640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ea80d1a30 0x7f6ea80d13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:37.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7f6eaffff640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ea80d1a30 0x7f6ea80d13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.78:45050/0 (socket says 172.21.15.78:45050) 2024-09-17T03:08:38.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7ff84b7fe640 1 -- 172.21.15.78:0/342012266 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff83c0bbeb0 con 0x7ff85406ee70 2024-09-17T03:08:38.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7f0fcbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fcc0b39a0 0x7f0fcc0c8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34240/0 (socket says 172.21.15.78:34240) 2024-09-17T03:08:38.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7f0fcbfff640 1 -- 172.21.15.78:0/1497108741 learned_addr learned my addr 172.21.15.78:0/1497108741 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:38.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7f6eaffff640 1 -- 172.21.15.78:0/1397657906 learned_addr learned my addr 172.21.15.78:0/1397657906 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:38.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7f0fcb7fe640 1 --2- 172.21.15.78:0/1497108741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fcc0b8500 0x7f0fcc1f9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:38.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7ff8527fc640 1 --2- 172.21.15.78:0/342012266 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff834078c10 0x7ff83407b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:38.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7f6eb508a640 1 --2- 172.21.15.78:0/1397657906 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ea804e0f0 0x7f6ea804fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:38.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f6eaf7fe640 1 --2- 172.21.15.78:0/1397657906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ea80d1f60 0x7f6ea804dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:38.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.973+0000 7f0fd2607640 1 --2- 172.21.15.78:0/1497108741 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0fcc0d43c0 0x7f0fcc1e75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:38.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f0fd2607640 1 -- 172.21.15.78:0/1497108741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0fcc0b9290 con 0x7f0fcc0b39a0 2024-09-17T03:08:38.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f0fd2607640 1 -- 172.21.15.78:0/1497108741 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0fcc0b9110 con 0x7f0fcc0b8500 2024-09-17T03:08:38.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f0fd2607640 1 -- 172.21.15.78:0/1497108741 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0fcc0b9410 con 0x7f0fcc0d43c0 2024-09-17T03:08:38.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f6eb508a640 1 -- 172.21.15.78:0/1397657906 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea8037a20 con 0x7f6ea80d1f60 2024-09-17T03:08:38.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f6eb508a640 1 -- 172.21.15.78:0/1397657906 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea80e6ee0 con 0x7f6ea804e0f0 2024-09-17T03:08:38.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f8343fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83440b3a60 0x7f834415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:38.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f8343fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83440b3a60 0x7f834415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34252/0 (socket says 172.21.15.78:34252) 2024-09-17T03:08:38.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f8343fff640 1 -- 172.21.15.78:0/4133865836 learned_addr learned my addr 172.21.15.78:0/4133865836 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:38.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f8349089640 1 --2- 172.21.15.78:0/4133865836 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83440d0e10 0x7f83440a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:38.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f8348888640 1 --2- 172.21.15.78:0/4133865836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f834406e3c0 0x7f83441f68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:38.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f6eb508a640 1 -- 172.21.15.78:0/1397657906 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea8037ba0 con 0x7f6ea80d1a30 2024-09-17T03:08:38.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f99f8d32640 1 -- 172.21.15.78:0/3255353059 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99f406f600 con 0x7f99f41f99e0 2024-09-17T03:08:38.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f6eb4889640 1 --2- 172.21.15.78:0/1397657906 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ea804e0f0 0x7f6ea804fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:38.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f0fd0ba4640 1 --2- 172.21.15.78:0/1497108741 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0fcc0d43c0 0x7f0fcc1e75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:38.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7ff8527fc640 1 --2- 172.21.15.78:0/342012266 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff834078c10 0x7ff83407b120 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff84c007d60 tx=0x7ff84c007cf0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:38.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f6eaf7fe640 1 -- 172.21.15.78:0/1397657906 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ea80d1a30 msgr2=0x7f6ea80d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f6eaf7fe640 1 --2- 172.21.15.78:0/1397657906 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ea80d1a30 0x7f6ea80d13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f6eaf7fe640 1 -- 172.21.15.78:0/1397657906 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ea804e0f0 msgr2=0x7f6ea804fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f6eaf7fe640 1 --2- 172.21.15.78:0/1397657906 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ea804e0f0 0x7f6ea804fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f8343fff640 1 -- 172.21.15.78:0/4133865836 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83440d0e10 msgr2=0x7f83440a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f8343fff640 1 --2- 172.21.15.78:0/4133865836 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83440d0e10 0x7f83440a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f8343fff640 1 -- 172.21.15.78:0/4133865836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f834406e3c0 msgr2=0x7f83441f68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f8343fff640 1 --2- 172.21.15.78:0/4133865836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f834406e3c0 0x7f83441f68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f8343fff640 1 -- 172.21.15.78:0/4133865836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83440a2290 con 0x7f83440b3a60 2024-09-17T03:08:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f6eaf7fe640 1 -- 172.21.15.78:0/1397657906 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea803ae10 con 0x7f6ea80d1f60 2024-09-17T03:08:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f0fcb7fe640 1 -- 172.21.15.78:0/1497108741 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0fcc0d43c0 msgr2=0x7f0fcc1e75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f0fcb7fe640 1 --2- 172.21.15.78:0/1497108741 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0fcc0d43c0 0x7f0fcc1e75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f0fcb7fe640 1 -- 172.21.15.78:0/1497108741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fcc0b39a0 msgr2=0x7f0fcc0c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f0fcb7fe640 1 --2- 172.21.15.78:0/1497108741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fcc0b39a0 0x7f0fcc0c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f0fcb7fe640 1 -- 172.21.15.78:0/1497108741 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fcc1f9e30 con 0x7f0fcc0b8500 2024-09-17T03:08:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.974+0000 7f0fcbfff640 1 --2- 172.21.15.78:0/1497108741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fcc0b39a0 0x7f0fcc0c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:38.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.975+0000 7f6eaf7fe640 1 --2- 172.21.15.78:0/1397657906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ea80d1f60 0x7f6ea804dbb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40117b0 tx=0x7f6ea4011c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:38.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.975+0000 7f8343fff640 1 --2- 172.21.15.78:0/4133865836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83440b3a60 0x7f834415af00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f833c000f80 tx=0x7f833c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:38.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.975+0000 7f6eacff9640 1 -- 172.21.15.78:0/1397657906 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea400f940 con 0x7f6ea80d1f60 2024-09-17T03:08:38.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.975+0000 7f99e2ffd640 1 -- 172.21.15.78:0/3255353059 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f99e4011070 con 0x7f99f41f99e0 2024-09-17T03:08:38.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.975+0000 7f6eacff9640 1 -- 172.21.15.78:0/1397657906 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ea400fae0 con 0x7f6ea80d1f60 2024-09-17T03:08:38.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.975+0000 7f0fcb7fe640 1 --2- 172.21.15.78:0/1497108741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fcc0b8500 0x7f0fcc1f9320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00c440 tx=0x7f0fbc00c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.975+0000 7f6eacff9640 1 -- 172.21.15.78:0/1397657906 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40035f0 con 0x7f6ea80d1f60 2024-09-17T03:08:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.975+0000 7f6eb508a640 1 -- 172.21.15.78:0/1397657906 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea803b0f0 con 0x7f6ea80d1f60 2024-09-17T03:08:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.975+0000 7f6eb508a640 1 -- 172.21.15.78:0/1397657906 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea804e880 con 0x7f6ea80d1f60 2024-09-17T03:08:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.975+0000 7f99e2ffd640 1 --2- 172.21.15.78:0/3255353059 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f99d4078b90 0x7f99d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:38.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.976+0000 7f83417fa640 1 -- 172.21.15.78:0/4133865836 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c033050 con 0x7f83440b3a60 2024-09-17T03:08:38.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.976+0000 7f83417fa640 1 -- 172.21.15.78:0/4133865836 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f833c004450 con 0x7f83440b3a60 2024-09-17T03:08:38.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.976+0000 7f834aaec640 1 -- 172.21.15.78:0/4133865836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83441f5e90 con 0x7f83440b3a60 2024-09-17T03:08:38.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.976+0000 7f0fc8ff9640 1 -- 172.21.15.78:0/1497108741 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc017070 con 0x7f0fcc0b8500 2024-09-17T03:08:38.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.976+0000 7f834aaec640 1 -- 172.21.15.78:0/4133865836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83441f6450 con 0x7f83440b3a60 2024-09-17T03:08:38.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.976+0000 7f0fc8ff9640 1 -- 172.21.15.78:0/1497108741 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fbc0035f0 con 0x7f0fcc0b8500 2024-09-17T03:08:38.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.976+0000 7f70a7fff640 1 -- 172.21.15.78:0/4144788600 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7098063b30 con 0x7f70b0161f70 2024-09-17T03:08:38.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.976+0000 7f99e2ffd640 1 -- 172.21.15.78:0/3255353059 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f99e4099a40 con 0x7f99f41f99e0 2024-09-17T03:08:38.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.976+0000 7f99f259c640 1 --2- 172.21.15.78:0/3255353059 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f99d4078b90 0x7f99d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:38.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.976+0000 7f0fd2607640 1 -- 172.21.15.78:0/1497108741 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fcc1fa110 con 0x7f0fcc0b8500 2024-09-17T03:08:38.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.976+0000 7f95277fe640 1 -- 172.21.15.78:0/4267187920 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9538004d20 con 0x7f95401f5dc0 2024-09-17T03:08:38.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.976+0000 7f95450c4640 1 -- 172.21.15.78:0/4267187920 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95400c6f60 con 0x7f95401f5dc0 2024-09-17T03:08:38.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.976+0000 7f95450c4640 1 -- 172.21.15.78:0/4267187920 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f954009d520 con 0x7f95401f5dc0 2024-09-17T03:08:38.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.976+0000 7f0fd2607640 1 -- 172.21.15.78:0/1497108741 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fcc1fa6d0 con 0x7f0fcc0b8500 2024-09-17T03:08:38.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.976+0000 7f95277fe640 1 -- 172.21.15.78:0/4267187920 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9538003970 con 0x7f95401f5dc0 2024-09-17T03:08:38.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.976+0000 7f95277fe640 1 -- 172.21.15.78:0/4267187920 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9538003e00 con 0x7f95401f5dc0 2024-09-17T03:08:38.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.976+0000 7f0fc8ff9640 1 -- 172.21.15.78:0/1497108741 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fbc003a40 con 0x7f0fcc0b8500 2024-09-17T03:08:38.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.976+0000 7f6eb508a640 1 -- 172.21.15.78:0/1397657906 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea803c910 con 0x7f6ea80d1f60 2024-09-17T03:08:38.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.976+0000 7f83417fa640 1 -- 172.21.15.78:0/4133865836 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833c038450 con 0x7f83440b3a60 2024-09-17T03:08:38.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.977+0000 7f99f259c640 1 --2- 172.21.15.78:0/3255353059 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f99d4078b90 0x7f99d407b0a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f99ec033000 tx=0x7f99ec001d90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:38.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.978+0000 7f43bd7fa640 1 -- 172.21.15.78:0/1808472437 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f43c00de690 con 0x7f43b800ae50 2024-09-17T03:08:38.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.978+0000 7f95450c4640 1 -- 172.21.15.78:0/4267187920 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9520005290 con 0x7f95401f5dc0 2024-09-17T03:08:38.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.978+0000 7f834aaec640 1 -- 172.21.15.78:0/4133865836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83440d32e0 con 0x7f83440b3a60 2024-09-17T03:08:38.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.978+0000 7f95277fe640 1 -- 172.21.15.78:0/4267187920 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f953801d020 con 0x7f95401f5dc0 2024-09-17T03:08:38.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.979+0000 7f0fd2607640 1 -- 172.21.15.78:0/1497108741 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fcc0b3db0 con 0x7f0fcc0b8500 2024-09-17T03:08:38.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.979+0000 7f0fc8ff9640 1 -- 172.21.15.78:0/1497108741 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0fbc01a070 con 0x7f0fcc0b8500 2024-09-17T03:08:38.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.979+0000 7f95277fe640 1 --2- 172.21.15.78:0/4267187920 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f952c078bc0 0x7f952c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:38.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.979+0000 7f0fc8ff9640 1 --2- 172.21.15.78:0/1497108741 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0fb8078b90 0x7f0fb807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:38.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.979+0000 7f95277fe640 1 -- 172.21.15.78:0/4267187920 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f953809b4a0 con 0x7f95401f5dc0 2024-09-17T03:08:38.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.980+0000 7f0fc8ff9640 1 -- 172.21.15.78:0/1497108741 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0fbc099f40 con 0x7f0fcc0b8500 2024-09-17T03:08:38.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.980+0000 7f0fcbfff640 1 --2- 172.21.15.78:0/1497108741 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0fb8078b90 0x7f0fb807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:38.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.980+0000 7f953ed9d640 1 --2- 172.21.15.78:0/4267187920 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f952c078bc0 0x7f952c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:38.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.980+0000 7f0fcbfff640 1 --2- 172.21.15.78:0/1497108741 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0fb8078b90 0x7f0fb807b0a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0005860 tx=0x7f0fc0005f30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:38.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.980+0000 7f953ed9d640 1 --2- 172.21.15.78:0/4267187920 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f952c078bc0 0x7f952c07b0d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f95300095f0 tx=0x7f9530004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:38.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.982+0000 7f99e2ffd640 1 -- 172.21.15.78:0/3255353059 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f99e401a030 con 0x7f99f41f99e0 2024-09-17T03:08:38.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.982+0000 7ff84b7fe640 1 -- 172.21.15.78:0/342012266 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff83c03f030 con 0x7ff85406ee70 2024-09-17T03:08:38.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.984+0000 7f95277fe640 1 -- 172.21.15.78:0/4267187920 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9538063280 con 0x7f95401f5dc0 2024-09-17T03:08:38.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.985+0000 7f6eacff9640 1 -- 172.21.15.78:0/1397657906 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ea4003790 con 0x7f6ea80d1f60 2024-09-17T03:08:38.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.985+0000 7f83417fa640 1 -- 172.21.15.78:0/4133865836 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f833c036070 con 0x7f83440b3a60 2024-09-17T03:08:38.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.986+0000 7f83417fa640 1 --2- 172.21.15.78:0/4133865836 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8330078c90 0x7f833007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:38.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.986+0000 7f6eacff9640 1 --2- 172.21.15.78:0/1397657906 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6e94078b90 0x7f6e9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:38.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.986+0000 7f83417fa640 1 -- 172.21.15.78:0/4133865836 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f833c0bc1d0 con 0x7f83440b3a60 2024-09-17T03:08:38.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.986+0000 7f6eaffff640 1 --2- 172.21.15.78:0/1397657906 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6e94078b90 0x7f6e9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:38.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.986+0000 7f6eacff9640 1 -- 172.21.15.78:0/1397657906 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6ea409c140 con 0x7f6ea80d1f60 2024-09-17T03:08:38.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.987+0000 7f6eaffff640 1 --2- 172.21.15.78:0/1397657906 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6e94078b90 0x7f6e9407b0a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0051d10 tx=0x7f6eb00b1040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:38.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.988+0000 7f8348888640 1 --2- 172.21.15.78:0/4133865836 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8330078c90 0x7f833007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:38.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.988+0000 7f8348888640 1 --2- 172.21.15.78:0/4133865836 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8330078c90 0x7f833007b1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f83340095f0 tx=0x7f8334005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:38.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.988+0000 7f0fc8ff9640 1 -- 172.21.15.78:0/1497108741 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0fcc0d3460 con 0x7f0fcc0b8500 2024-09-17T03:08:38.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:37.991+0000 7f6eacff9640 1 -- 172.21.15.78:0/1397657906 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6ea4063fa0 con 0x7f6ea80d1f60 2024-09-17T03:08:38.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.000+0000 7f83417fa640 1 -- 172.21.15.78:0/4133865836 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f834406fce0 con 0x7f83440b3a60 2024-09-17T03:08:38.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.395+0000 7f70b6171640 1 -- 172.21.15.78:0/4144788600 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f70b01eb500 con 0x7f70b0161f70 2024-09-17T03:08:38.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.396+0000 7f70a7fff640 1 -- 172.21.15.78:0/4144788600 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7098063430 con 0x7f70b0161f70 2024-09-17T03:08:38.396 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-17T03:08:38.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.400+0000 7f70a5ffb640 1 -- 172.21.15.78:0/4144788600 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7090078b90 msgr2=0x7f709007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.400+0000 7f70a5ffb640 1 --2- 172.21.15.78:0/4144788600 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7090078b90 0x7f709007b0a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f70a0000f60 tx=0x7f70a0009040 comp rx=0 tx=0).stop 2024-09-17T03:08:38.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.400+0000 7f70a5ffb640 1 -- 172.21.15.78:0/4144788600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f70b0161f70 msgr2=0x7f70b0158530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.400+0000 7f70a5ffb640 1 --2- 172.21.15.78:0/4144788600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f70b0161f70 0x7f70b0158530 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f709800e920 tx=0x7f709800ede0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.400+0000 7f70a5ffb640 1 -- 172.21.15.78:0/4144788600 shutdown_connections 2024-09-17T03:08:38.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.400+0000 7f70a5ffb640 1 --2- 172.21.15.78:0/4144788600 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f70b0154b00 0x7f70b0158a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.400+0000 7f70a5ffb640 1 --2- 172.21.15.78:0/4144788600 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7090078b90 0x7f709007b0a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.400+0000 7f70a5ffb640 1 --2- 172.21.15.78:0/4144788600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f70b0161f70 0x7f70b0158530 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.400+0000 7f70a5ffb640 1 --2- 172.21.15.78:0/4144788600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f709c005320 0x7f70b0161a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.401+0000 7f70a5ffb640 1 -- 172.21.15.78:0/4144788600 >> 172.21.15.78:0/4144788600 conn(0x7f70b00b1cb0 msgr2=0x7f70b01ea950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:38.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.401+0000 7f43c5961640 1 -- 172.21.15.78:0/1808472437 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f43b80075e0 con 0x7f43b800ae50 2024-09-17T03:08:38.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.401+0000 7f70a5ffb640 1 -- 172.21.15.78:0/4144788600 shutdown_connections 2024-09-17T03:08:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.401+0000 7f70a5ffb640 1 -- 172.21.15.78:0/4144788600 wait complete. 2024-09-17T03:08:38.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.401+0000 7f43bd7fa640 1 -- 172.21.15.78:0/1808472437 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f43c00ddf90 con 0x7f43b800ae50 2024-09-17T03:08:38.402 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2024-09-17T03:08:38.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.405+0000 7f95450c4640 1 -- 172.21.15.78:0/4267187920 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9520005580 con 0x7f95401f5dc0 2024-09-17T03:08:38.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.405+0000 7f43aaffd640 1 -- 172.21.15.78:0/1808472437 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f43a4078bc0 msgr2=0x7f43a407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.405+0000 7f43aaffd640 1 --2- 172.21.15.78:0/1808472437 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f43a4078bc0 0x7f43a407b0d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f43b80225c0 tx=0x7f43ac004730 comp rx=0 tx=0).stop 2024-09-17T03:08:38.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.405+0000 7f43aaffd640 1 -- 172.21.15.78:0/1808472437 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f43b800ae50 msgr2=0x7f43b817eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.405+0000 7f43aaffd640 1 --2- 172.21.15.78:0/1808472437 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f43b800ae50 0x7f43b817eab0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f43c006ad50 tx=0x7f43c0069c30 comp rx=0 tx=0).stop 2024-09-17T03:08:38.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.405+0000 7f43aaffd640 1 -- 172.21.15.78:0/1808472437 shutdown_connections 2024-09-17T03:08:38.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.405+0000 7f43aaffd640 1 --2- 172.21.15.78:0/1808472437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f43b80e35c0 0x7f43b80d8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.405+0000 7f43aaffd640 1 --2- 172.21.15.78:0/1808472437 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f43a4078bc0 0x7f43a407b0d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.405+0000 7f43aaffd640 1 --2- 172.21.15.78:0/1808472437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f43b8053c00 0x7f43b80d8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.405+0000 7f43aaffd640 1 --2- 172.21.15.78:0/1808472437 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f43b800ae50 0x7f43b817eab0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.405+0000 7f43aaffd640 1 -- 172.21.15.78:0/1808472437 >> 172.21.15.78:0/1808472437 conn(0x7f43b8051420 msgr2=0x7f43b8004a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:38.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.405+0000 7f43aaffd640 1 -- 172.21.15.78:0/1808472437 shutdown_connections 2024-09-17T03:08:38.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.405+0000 7f43aaffd640 1 -- 172.21.15.78:0/1808472437 wait complete. 2024-09-17T03:08:38.406 INFO:teuthology.orchestra.run.smithi078.stdout:64424509447 2024-09-17T03:08:38.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.405+0000 7f99f8d32640 1 -- 172.21.15.78:0/3255353059 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f99f40cdb00 con 0x7f99f41f99e0 2024-09-17T03:08:38.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.406+0000 7f99e2ffd640 1 -- 172.21.15.78:0/3255353059 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f99e4061e70 con 0x7f99f41f99e0 2024-09-17T03:08:38.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.406+0000 7f95277fe640 1 -- 172.21.15.78:0/4267187920 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9538067cb0 con 0x7f95401f5dc0 2024-09-17T03:08:38.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.409+0000 7ff8497fa640 1 -- 172.21.15.78:0/342012266 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff82c005850 con 0x7ff85406ee70 2024-09-17T03:08:38.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.409+0000 7f99f8d32640 1 -- 172.21.15.78:0/3255353059 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f99d4078b90 msgr2=0x7f99d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.409+0000 7f99f8d32640 1 --2- 172.21.15.78:0/3255353059 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f99d4078b90 0x7f99d407b0a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f99ec033000 tx=0x7f99ec001d90 comp rx=0 tx=0).stop 2024-09-17T03:08:38.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.409+0000 7f99f8d32640 1 -- 172.21.15.78:0/3255353059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99f41f99e0 msgr2=0x7f99f41604d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.409+0000 7f99f8d32640 1 --2- 172.21.15.78:0/3255353059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99f41f99e0 0x7f99f41604d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f99f408cc10 tx=0x7f99e400c820 comp rx=0 tx=0).stop 2024-09-17T03:08:38.410 INFO:teuthology.orchestra.run.smithi078.stdout:64424509447 2024-09-17T03:08:38.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.410+0000 7ff84b7fe640 1 -- 172.21.15.78:0/342012266 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff83c0843e0 con 0x7ff85406ee70 2024-09-17T03:08:38.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.410+0000 7f99f8d32640 1 -- 172.21.15.78:0/3255353059 shutdown_connections 2024-09-17T03:08:38.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.410+0000 7f99f8d32640 1 --2- 172.21.15.78:0/3255353059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99f41f99e0 0x7f99f41604d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.410+0000 7f99f8d32640 1 --2- 172.21.15.78:0/3255353059 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f99d4078b90 0x7f99d407b0a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.410+0000 7f99f8d32640 1 --2- 172.21.15.78:0/3255353059 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99f415f330 0x7f99f41f94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.410+0000 7f99f8d32640 1 --2- 172.21.15.78:0/3255353059 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99dc0039f0 0x7f99f40cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.410+0000 7f99f8d32640 1 -- 172.21.15.78:0/3255353059 >> 172.21.15.78:0/3255353059 conn(0x7f99f408bfc0 msgr2=0x7f99f4068f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:38.411 INFO:teuthology.orchestra.run.smithi078.stdout:64424509446 2024-09-17T03:08:38.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.411+0000 7f99f8d32640 1 -- 172.21.15.78:0/3255353059 shutdown_connections 2024-09-17T03:08:38.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.411+0000 7f99f8d32640 1 -- 172.21.15.78:0/3255353059 wait complete. 2024-09-17T03:08:38.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.413+0000 7f0fd2607640 1 -- 172.21.15.78:0/1497108741 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0fcc0d4a20 con 0x7f0fcc0b8500 2024-09-17T03:08:38.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.413+0000 7f95450c4640 1 -- 172.21.15.78:0/4267187920 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f952c078bc0 msgr2=0x7f952c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.413+0000 7f95450c4640 1 --2- 172.21.15.78:0/4267187920 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f952c078bc0 0x7f952c07b0d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f95300095f0 tx=0x7f9530004730 comp rx=0 tx=0).stop 2024-09-17T03:08:38.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.413+0000 7f95450c4640 1 -- 172.21.15.78:0/4267187920 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95401f5dc0 msgr2=0x7f954015d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.413+0000 7f95450c4640 1 --2- 172.21.15.78:0/4267187920 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95401f5dc0 0x7f954015d8d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f953800ed50 tx=0x7f953800c740 comp rx=0 tx=0).stop 2024-09-17T03:08:38.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.413+0000 7f95450c4640 1 -- 172.21.15.78:0/4267187920 shutdown_connections 2024-09-17T03:08:38.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.413+0000 7f95450c4640 1 --2- 172.21.15.78:0/4267187920 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f952c078bc0 0x7f952c07b0d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.413+0000 7f95450c4640 1 --2- 172.21.15.78:0/4267187920 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95401f5dc0 0x7f954015d8d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.413+0000 7f95450c4640 1 --2- 172.21.15.78:0/4267187920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95400cf660 0x7f954015d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.413+0000 7f95450c4640 1 --2- 172.21.15.78:0/4267187920 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9540070f20 0x7f954015a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.413+0000 7f95450c4640 1 -- 172.21.15.78:0/4267187920 >> 172.21.15.78:0/4267187920 conn(0x7f95400b1cb0 msgr2=0x7f95400ae570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:38.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.413+0000 7f95450c4640 1 -- 172.21.15.78:0/4267187920 shutdown_connections 2024-09-17T03:08:38.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.413+0000 7f95450c4640 1 -- 172.21.15.78:0/4267187920 wait complete. 2024-09-17T03:08:38.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.414+0000 7f0fc8ff9640 1 -- 172.21.15.78:0/1497108741 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0fbc061df0 con 0x7f0fcc0b8500 2024-09-17T03:08:38.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.414+0000 7f6eb508a640 1 -- 172.21.15.78:0/1397657906 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6ea803c350 con 0x7f6ea80d1f60 2024-09-17T03:08:38.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.414+0000 7ff8497fa640 1 -- 172.21.15.78:0/342012266 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff834078c10 msgr2=0x7ff83407b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.414+0000 7ff8497fa640 1 --2- 172.21.15.78:0/342012266 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff834078c10 0x7ff83407b120 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff84c007d60 tx=0x7ff84c007cf0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.414+0000 7ff8497fa640 1 -- 172.21.15.78:0/342012266 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff85406ee70 msgr2=0x7ff8540cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.414+0000 7ff8497fa640 1 --2- 172.21.15.78:0/342012266 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff85406ee70 0x7ff8540cb400 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff83c000c00 tx=0x7ff83c033c20 comp rx=0 tx=0).stop 2024-09-17T03:08:38.416 INFO:teuthology.orchestra.run.smithi078.stdout:64424509447 2024-09-17T03:08:38.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.414+0000 7ff8497fa640 1 -- 172.21.15.78:0/342012266 shutdown_connections 2024-09-17T03:08:38.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.414+0000 7ff8497fa640 1 --2- 172.21.15.78:0/342012266 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff834078c10 0x7ff83407b120 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.414+0000 7ff8497fa640 1 --2- 172.21.15.78:0/342012266 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff854073160 0x7ff8541471d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.414+0000 7ff8497fa640 1 --2- 172.21.15.78:0/342012266 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff854070d20 0x7ff854146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.414+0000 7ff8497fa640 1 --2- 172.21.15.78:0/342012266 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff85406ee70 0x7ff8540cb400 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.414+0000 7ff8497fa640 1 -- 172.21.15.78:0/342012266 >> 172.21.15.78:0/342012266 conn(0x7ff85406d410 msgr2=0x7ff854159780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:38.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.414+0000 7ff8497fa640 1 -- 172.21.15.78:0/342012266 shutdown_connections 2024-09-17T03:08:38.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.414+0000 7ff8497fa640 1 -- 172.21.15.78:0/342012266 wait complete. 2024-09-17T03:08:38.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.415+0000 7f6eacff9640 1 -- 172.21.15.78:0/1397657906 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6ea40689d0 con 0x7f6ea80d1f60 2024-09-17T03:08:38.418 INFO:teuthology.orchestra.run.smithi078.stdout:64424509447 2024-09-17T03:08:38.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.418+0000 7f0fd2607640 1 -- 172.21.15.78:0/1497108741 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0fb8078b90 msgr2=0x7f0fb807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.418+0000 7f0fd2607640 1 --2- 172.21.15.78:0/1497108741 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0fb8078b90 0x7f0fb807b0a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0005860 tx=0x7f0fc0005f30 comp rx=0 tx=0).stop 2024-09-17T03:08:38.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.418+0000 7f0fd2607640 1 -- 172.21.15.78:0/1497108741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fcc0b8500 msgr2=0x7f0fcc1f9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.418+0000 7f0fd2607640 1 --2- 172.21.15.78:0/1497108741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fcc0b8500 0x7f0fcc1f9320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00c440 tx=0x7f0fbc00c900 comp rx=0 tx=0).stop 2024-09-17T03:08:38.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.418+0000 7f0fd2607640 1 -- 172.21.15.78:0/1497108741 shutdown_connections 2024-09-17T03:08:38.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.418+0000 7f0fd2607640 1 --2- 172.21.15.78:0/1497108741 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0fcc0d43c0 0x7f0fcc1e75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.418+0000 7f0fd2607640 1 --2- 172.21.15.78:0/1497108741 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0fb8078b90 0x7f0fb807b0a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.418+0000 7f0fd2607640 1 --2- 172.21.15.78:0/1497108741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fcc0b8500 0x7f0fcc1f9320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.419+0000 7f0fd2607640 1 --2- 172.21.15.78:0/1497108741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0fcc0b39a0 0x7f0fcc0c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.419+0000 7f0fd2607640 1 -- 172.21.15.78:0/1497108741 >> 172.21.15.78:0/1497108741 conn(0x7f0fcc08bfc0 msgr2=0x7f0fcc0b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:38.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.419+0000 7f6eb508a640 1 -- 172.21.15.78:0/1397657906 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6e94078b90 msgr2=0x7f6e9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.419+0000 7f0fd2607640 1 -- 172.21.15.78:0/1497108741 shutdown_connections 2024-09-17T03:08:38.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.419+0000 7f6eb508a640 1 --2- 172.21.15.78:0/1397657906 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6e94078b90 0x7f6e9407b0a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0051d10 tx=0x7f6eb00b1040 comp rx=0 tx=0).stop 2024-09-17T03:08:38.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.419+0000 7f6eb508a640 1 -- 172.21.15.78:0/1397657906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ea80d1f60 msgr2=0x7f6ea804dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.419+0000 7f6eb508a640 1 --2- 172.21.15.78:0/1397657906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ea80d1f60 0x7f6ea804dbb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40117b0 tx=0x7f6ea4011c70 comp rx=0 tx=0).stop 2024-09-17T03:08:38.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.419+0000 7f6eb508a640 1 -- 172.21.15.78:0/1397657906 shutdown_connections 2024-09-17T03:08:38.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.419+0000 7f6eb508a640 1 --2- 172.21.15.78:0/1397657906 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6e94078b90 0x7f6e9407b0a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.420+0000 7f6eb508a640 1 --2- 172.21.15.78:0/1397657906 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ea804e0f0 0x7f6ea804fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.420+0000 7f6eb508a640 1 --2- 172.21.15.78:0/1397657906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ea80d1f60 0x7f6ea804dbb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.420+0000 7f6eb508a640 1 --2- 172.21.15.78:0/1397657906 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ea80d1a30 0x7f6ea80d13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.420+0000 7f6eb508a640 1 -- 172.21.15.78:0/1397657906 >> 172.21.15.78:0/1397657906 conn(0x7f6ea8055e60 msgr2=0x7f6ea8004a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:38.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.420+0000 7f0fd2607640 1 -- 172.21.15.78:0/1497108741 wait complete. 2024-09-17T03:08:38.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.420+0000 7f6eb508a640 1 -- 172.21.15.78:0/1397657906 shutdown_connections 2024-09-17T03:08:38.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.420+0000 7f6eb508a640 1 -- 172.21.15.78:0/1397657906 wait complete. 2024-09-17T03:08:38.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.420+0000 7f834aaec640 1 -- 172.21.15.78:0/4133865836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f83441f5c20 con 0x7f83440b3a60 2024-09-17T03:08:38.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.2 2024-09-17T03:08:38.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.421+0000 7f83417fa640 1 -- 172.21.15.78:0/4133865836 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f833c083fa0 con 0x7f83440b3a60 2024-09-17T03:08:38.424 INFO:teuthology.orchestra.run.smithi078.stdout:64424509447 2024-09-17T03:08:38.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.425+0000 7f834aaec640 1 -- 172.21.15.78:0/4133865836 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8330078c90 msgr2=0x7f833007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.425+0000 7f834aaec640 1 --2- 172.21.15.78:0/4133865836 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8330078c90 0x7f833007b1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f83340095f0 tx=0x7f8334005f90 comp rx=0 tx=0).stop 2024-09-17T03:08:38.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.425+0000 7f834aaec640 1 -- 172.21.15.78:0/4133865836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83440b3a60 msgr2=0x7f834415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:38.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.425+0000 7f834aaec640 1 --2- 172.21.15.78:0/4133865836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83440b3a60 0x7f834415af00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f833c000f80 tx=0x7f833c003f10 comp rx=0 tx=0).stop 2024-09-17T03:08:38.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.425+0000 7f834aaec640 1 -- 172.21.15.78:0/4133865836 shutdown_connections 2024-09-17T03:08:38.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.425+0000 7f834aaec640 1 --2- 172.21.15.78:0/4133865836 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83440d0e10 0x7f83440a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.425+0000 7f834aaec640 1 --2- 172.21.15.78:0/4133865836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83440b3a60 0x7f834415af00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.426+0000 7f834aaec640 1 --2- 172.21.15.78:0/4133865836 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8330078c90 0x7f833007b1a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.426+0000 7f834aaec640 1 --2- 172.21.15.78:0/4133865836 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f834406e3c0 0x7f83441f68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:38.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.426+0000 7f834aaec640 1 -- 172.21.15.78:0/4133865836 >> 172.21.15.78:0/4133865836 conn(0x7f834408bfc0 msgr2=0x7f83440d3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:38.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.426+0000 7f834aaec640 1 -- 172.21.15.78:0/4133865836 shutdown_connections 2024-09-17T03:08:38.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:38.426+0000 7f834aaec640 1 -- 172.21.15.78:0/4133865836 wait complete. 2024-09-17T03:08:38.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2024-09-17T03:08:38.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.7 2024-09-17T03:08:38.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.0 2024-09-17T03:08:38.436 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.5 2024-09-17T03:08:38.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.6 2024-09-17T03:08:38.441 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.4 2024-09-17T03:08:38.442 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.1 2024-09-17T03:08:39.425 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T03:08:39.427 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T03:08:39.432 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T03:08:39.436 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T03:08:39.437 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T03:08:39.441 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T03:08:39.442 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T03:08:39.443 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T03:08:39.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.611+0000 7f8790b2e640 1 -- 172.21.15.78:0/610214240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87840520b0 msgr2=0x7f8784007c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.611+0000 7f8790b2e640 1 --2- 172.21.15.78:0/610214240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87840520b0 0x7f8784007c60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f878c06ad50 tx=0x7f878c0aecf0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.612+0000 7f8790b2e640 1 -- 172.21.15.78:0/610214240 shutdown_connections 2024-09-17T03:08:39.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.612+0000 7f8790b2e640 1 --2- 172.21.15.78:0/610214240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87840520b0 0x7f8784007c60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.612+0000 7f8790b2e640 1 --2- 172.21.15.78:0/610214240 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8784006fa0 0x7f8784053710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.612+0000 7f8790b2e640 1 -- 172.21.15.78:0/610214240 >> 172.21.15.78:0/610214240 conn(0x7f878401e260 msgr2=0x7f8784039e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:39.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.614+0000 7f6a5f59e640 1 -- 172.21.15.78:0/4093260224 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6a580537f0 msgr2=0x7f6a58054660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.612+0000 7f8790b2e640 1 -- 172.21.15.78:0/610214240 shutdown_connections 2024-09-17T03:08:39.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.612+0000 7f8790b2e640 1 -- 172.21.15.78:0/610214240 wait complete. 2024-09-17T03:08:39.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.614+0000 7f6a5f59e640 1 --2- 172.21.15.78:0/4093260224 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6a580537f0 0x7f6a58054660 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009830 tx=0x7f6a5002a510 comp rx=0 tx=0).stop 2024-09-17T03:08:39.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.615+0000 7f6a5f59e640 1 -- 172.21.15.78:0/4093260224 shutdown_connections 2024-09-17T03:08:39.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.615+0000 7f6a5f59e640 1 --2- 172.21.15.78:0/4093260224 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6a580537f0 0x7f6a58054660 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.615+0000 7f6a5f59e640 1 --2- 172.21.15.78:0/4093260224 >> v2:172.21.15.193:3300/0 conn(0x7f6a580e1010 0x7f6a580532b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.615+0000 7f6a5f59e640 1 -- 172.21.15.78:0/4093260224 >> 172.21.15.78:0/4093260224 conn(0x7f6a5801fbe0 msgr2=0x7f6a58056940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:39.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.616+0000 7f6a5f59e640 1 -- 172.21.15.78:0/4093260224 shutdown_connections 2024-09-17T03:08:39.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.616+0000 7f6a5f59e640 1 -- 172.21.15.78:0/4093260224 wait complete. 2024-09-17T03:08:39.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.619+0000 7f6a5f59e640 1 Processor -- start 2024-09-17T03:08:39.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.616+0000 7f8790b2e640 1 Processor -- start 2024-09-17T03:08:39.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.616+0000 7f8790b2e640 1 -- start start 2024-09-17T03:08:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.619+0000 7f8790b2e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8784006fa0 0x7f878416c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.619+0000 7f878b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8784006fa0 0x7f878416c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.619+0000 7f878b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8784006fa0 0x7f878416c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34268/0 (socket says 172.21.15.78:34268) 2024-09-17T03:08:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.619+0000 7f878b7fe640 1 -- 172.21.15.78:0/657157460 learned_addr learned my addr 172.21.15.78:0/657157460 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.619+0000 7f8790b2e640 1 --2- 172.21.15.78:0/657157460 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f87840df800 0x7f87840e2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.619+0000 7f8790b2e640 1 --2- 172.21.15.78:0/657157460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f878416ec20 0x7f87840e2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.619+0000 7f8790b2e640 1 -- 172.21.15.78:0/657157460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8784053c50 con 0x7f8784006fa0 2024-09-17T03:08:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.619+0000 7f8790b2e640 1 -- 172.21.15.78:0/657157460 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f87840075c0 con 0x7f878416ec20 2024-09-17T03:08:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.619+0000 7f8790b2e640 1 -- 172.21.15.78:0/657157460 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8784053dd0 con 0x7f87840df800 2024-09-17T03:08:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.620+0000 7f878affd640 1 --2- 172.21.15.78:0/657157460 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f87840df800 0x7f87840e2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.620+0000 7f878bfff640 1 --2- 172.21.15.78:0/657157460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f878416ec20 0x7f87840e2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.620+0000 7f6a5f59e640 1 -- start start 2024-09-17T03:08:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.622+0000 7f6a5f59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a580537f0 0x7f6a580e3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.620+0000 7f878b7fe640 1 -- 172.21.15.78:0/657157460 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f87840df800 msgr2=0x7f87840e2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.620+0000 7f878b7fe640 1 --2- 172.21.15.78:0/657157460 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f87840df800 0x7f87840e2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.620+0000 7f878b7fe640 1 -- 172.21.15.78:0/657157460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f878416ec20 msgr2=0x7f87840e2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.620+0000 7f878b7fe640 1 --2- 172.21.15.78:0/657157460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f878416ec20 0x7f87840e2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.620+0000 7f878b7fe640 1 -- 172.21.15.78:0/657157460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87840e1510 con 0x7f8784006fa0 2024-09-17T03:08:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.621+0000 7f878b7fe640 1 --2- 172.21.15.78:0/657157460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8784006fa0 0x7f878416c050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f877800b780 tx=0x7f877800bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.621+0000 7f8777fff640 1 -- 172.21.15.78:0/657157460 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8778019070 con 0x7f8784006fa0 2024-09-17T03:08:39.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.622+0000 7f8790b2e640 1 -- 172.21.15.78:0/657157460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87840e17d0 con 0x7f8784006fa0 2024-09-17T03:08:39.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.622+0000 7f6a5e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a580537f0 0x7f6a580e3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.623+0000 7f6a5e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a580537f0 0x7f6a580e3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34280/0 (socket says 172.21.15.78:34280) 2024-09-17T03:08:39.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.623+0000 7f6a5e59c640 1 -- 172.21.15.78:0/202715208 learned_addr learned my addr 172.21.15.78:0/202715208 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:39.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.623+0000 7f6a5f59e640 1 --2- 172.21.15.78:0/202715208 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6a58054ba0 0x7f6a5818a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.623+0000 7f6a5f59e640 1 --2- 172.21.15.78:0/202715208 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a580e1010 0x7f6a5818a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.623+0000 7f6a5f59e640 1 -- 172.21.15.78:0/202715208 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6a580e5290 con 0x7f6a580537f0 2024-09-17T03:08:39.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.623+0000 7f6a5dd9b640 1 --2- 172.21.15.78:0/202715208 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6a58054ba0 0x7f6a5818a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.623+0000 7f6a5ed9d640 1 --2- 172.21.15.78:0/202715208 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a580e1010 0x7f6a5818a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.623+0000 7f6a5f59e640 1 -- 172.21.15.78:0/202715208 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6a580550f0 con 0x7f6a580e1010 2024-09-17T03:08:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.623+0000 7f6a5f59e640 1 -- 172.21.15.78:0/202715208 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f6a580e5410 con 0x7f6a58054ba0 2024-09-17T03:08:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.624+0000 7f6a5e59c640 1 -- 172.21.15.78:0/202715208 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6a58054ba0 msgr2=0x7f6a5818a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.624+0000 7f6a5e59c640 1 --2- 172.21.15.78:0/202715208 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6a58054ba0 0x7f6a5818a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.624+0000 7f6a5e59c640 1 -- 172.21.15.78:0/202715208 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a580e1010 msgr2=0x7f6a5818a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.624+0000 7f6a5e59c640 1 --2- 172.21.15.78:0/202715208 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a580e1010 0x7f6a5818a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.624+0000 7f6a5e59c640 1 -- 172.21.15.78:0/202715208 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a580e4490 con 0x7f6a580537f0 2024-09-17T03:08:39.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.624+0000 7f6a5e59c640 1 --2- 172.21.15.78:0/202715208 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a580537f0 0x7f6a580e3f50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400e9d0 tx=0x7f6a5400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:39.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.625+0000 7f8790b2e640 1 -- 172.21.15.78:0/657157460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87840e1d90 con 0x7f8784006fa0 2024-09-17T03:08:39.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.621+0000 7f8777fff640 1 -- 172.21.15.78:0/657157460 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f877800c830 con 0x7f8784006fa0 2024-09-17T03:08:39.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.625+0000 7f6a5dd9b640 1 --2- 172.21.15.78:0/202715208 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6a58054ba0 0x7f6a5818a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:39.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.627+0000 7f6a4effd640 1 -- 172.21.15.78:0/202715208 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5400cbd0 con 0x7f6a580537f0 2024-09-17T03:08:39.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.628+0000 7f6a4effd640 1 -- 172.21.15.78:0/202715208 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a5400cd70 con 0x7f6a580537f0 2024-09-17T03:08:39.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.625+0000 7f8777fff640 1 -- 172.21.15.78:0/657157460 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877800cc80 con 0x7f8784006fa0 2024-09-17T03:08:39.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.626+0000 7f8777fff640 1 -- 172.21.15.78:0/657157460 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f877801c070 con 0x7f8784006fa0 2024-09-17T03:08:39.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.627+0000 7f8777fff640 1 --2- 172.21.15.78:0/657157460 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8770078c90 0x7f877007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.627+0000 7f8777fff640 1 -- 172.21.15.78:0/657157460 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f877809a030 con 0x7f8784006fa0 2024-09-17T03:08:39.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.627+0000 7f878affd640 1 --2- 172.21.15.78:0/657157460 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8770078c90 0x7f877007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.629+0000 7f6a5f59e640 1 -- 172.21.15.78:0/202715208 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a58037f80 con 0x7f6a580537f0 2024-09-17T03:08:39.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.629+0000 7f6a5f59e640 1 -- 172.21.15.78:0/202715208 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a58038540 con 0x7f6a580537f0 2024-09-17T03:08:39.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.629+0000 7f6a4effd640 1 -- 172.21.15.78:0/202715208 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54010690 con 0x7f6a580537f0 2024-09-17T03:08:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.629+0000 7f878affd640 1 --2- 172.21.15.78:0/657157460 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8770078c90 0x7f877007b1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f87840361b0 tx=0x7f878c06b3a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:39.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.629+0000 7f8790b2e640 1 -- 172.21.15.78:0/657157460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f876c005290 con 0x7f8784006fa0 2024-09-17T03:08:39.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.632+0000 7f6a4effd640 1 -- 172.21.15.78:0/202715208 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6a54010830 con 0x7f6a580537f0 2024-09-17T03:08:39.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.633+0000 7f6a4effd640 1 --2- 172.21.15.78:0/202715208 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6a40078c90 0x7f6a4007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.633+0000 7f6a5dd9b640 1 --2- 172.21.15.78:0/202715208 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6a40078c90 0x7f6a4007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.633+0000 7f6a4effd640 1 -- 172.21.15.78:0/202715208 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6a5409b560 con 0x7f6a580537f0 2024-09-17T03:08:39.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.634+0000 7f6a5f59e640 1 -- 172.21.15.78:0/202715208 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a58038780 con 0x7f6a580537f0 2024-09-17T03:08:39.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.635+0000 7f6a5dd9b640 1 --2- 172.21.15.78:0/202715208 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6a40078c90 0x7f6a4007b1a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6a50034000 tx=0x7f6a50004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:39.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.640+0000 7f8777fff640 1 -- 172.21.15.78:0/657157460 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f87780625c0 con 0x7f8784006fa0 2024-09-17T03:08:39.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.649+0000 7f6a4effd640 1 -- 172.21.15.78:0/202715208 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6a58038780 con 0x7f6a580537f0 2024-09-17T03:08:39.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.679+0000 7f5ac6a70640 1 -- 172.21.15.78:0/3020766729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ac00cfb50 msgr2=0x7f5ac015f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.679+0000 7f5ac6a70640 1 --2- 172.21.15.78:0/3020766729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ac00cfb50 0x7f5ac015f880 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8005fd0 tx=0x7f5ab802aaa0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.679+0000 7f5ac6a70640 1 -- 172.21.15.78:0/3020766729 shutdown_connections 2024-09-17T03:08:39.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.679+0000 7f5ac6a70640 1 --2- 172.21.15.78:0/3020766729 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5ac01624d0 0x7f5ac00ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.679+0000 7f5ac6a70640 1 --2- 172.21.15.78:0/3020766729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ac00cfb50 0x7f5ac015f880 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8005fd0 tx=0x7f5ab802aaa0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.679+0000 7f5ac6a70640 1 -- 172.21.15.78:0/3020766729 >> 172.21.15.78:0/3020766729 conn(0x7f5ac00b20a0 msgr2=0x7f5ac00b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:39.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.681+0000 7f5ac6a70640 1 -- 172.21.15.78:0/3020766729 shutdown_connections 2024-09-17T03:08:39.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.682+0000 7f3dc8d19640 1 -- 172.21.15.78:0/2361607612 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3dbc055ee0 msgr2=0x7f3dbc006820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.682+0000 7f3dc8d19640 1 --2- 172.21.15.78:0/2361607612 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3dbc055ee0 0x7f3dbc006820 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3db0009830 tx=0x7f3db002a520 comp rx=0 tx=0).stop 2024-09-17T03:08:39.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.681+0000 7f5ac6a70640 1 -- 172.21.15.78:0/3020766729 wait complete. 2024-09-17T03:08:39.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.682+0000 7f3dc8d19640 1 -- 172.21.15.78:0/2361607612 shutdown_connections 2024-09-17T03:08:39.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.682+0000 7f3dc8d19640 1 --2- 172.21.15.78:0/2361607612 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3dbc055ee0 0x7f3dbc006820 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.682+0000 7f3dc8d19640 1 --2- 172.21.15.78:0/2361607612 >> v2:172.21.15.193:3300/0 conn(0x7f3dbc03ae90 0x7f3dbc0dfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.682+0000 7f3dc8d19640 1 -- 172.21.15.78:0/2361607612 >> 172.21.15.78:0/2361607612 conn(0x7f3dbc01eae0 msgr2=0x7f3dbc03a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:39.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.682+0000 7f3dc8d19640 1 -- 172.21.15.78:0/2361607612 shutdown_connections 2024-09-17T03:08:39.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.683+0000 7f3dc8d19640 1 -- 172.21.15.78:0/2361607612 wait complete. 2024-09-17T03:08:39.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.683+0000 7eff14815640 1 -- 172.21.15.78:0/4049960504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7eff100cd240 msgr2=0x7eff100b2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.683+0000 7eff14815640 1 --2- 172.21.15.78:0/4049960504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7eff100cd240 0x7eff100b2fb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7eff100b58f0 tx=0x7eff0802b490 comp rx=0 tx=0).stop 2024-09-17T03:08:39.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.684+0000 7eff14815640 1 -- 172.21.15.78:0/4049960504 shutdown_connections 2024-09-17T03:08:39.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.684+0000 7eff14815640 1 --2- 172.21.15.78:0/4049960504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7eff100cd240 0x7eff100b2fb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.684+0000 7f5ee2cf9640 1 -- 172.21.15.78:0/2405707044 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5ed4036b40 msgr2=0x7f5ed4006660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.684+0000 7f5ee2cf9640 1 --2- 172.21.15.78:0/2405707044 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5ed4036b40 0x7f5ed4006660 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5edc06af90 tx=0x7f5edc0a6ea0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.684+0000 7eff14815640 1 --2- 172.21.15.78:0/4049960504 >> v2:172.21.15.78:3300/0 conn(0x7eff100cf660 0x7eff100cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.684+0000 7eff14815640 1 -- 172.21.15.78:0/4049960504 >> 172.21.15.78:0/4049960504 conn(0x7eff100b1cb0 msgr2=0x7eff100b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:39.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.684+0000 7eff14815640 1 -- 172.21.15.78:0/4049960504 shutdown_connections 2024-09-17T03:08:39.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.684+0000 7f5ee2cf9640 1 -- 172.21.15.78:0/2405707044 shutdown_connections 2024-09-17T03:08:39.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.684+0000 7f5ee2cf9640 1 --2- 172.21.15.78:0/2405707044 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5ed4036b40 0x7f5ed4006660 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.684+0000 7f5ee2cf9640 1 --2- 172.21.15.78:0/2405707044 >> v2:172.21.15.193:3300/0 conn(0x7f5ed4009ba0 0x7f5ed40df180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.684+0000 7f5ee2cf9640 1 -- 172.21.15.78:0/2405707044 >> 172.21.15.78:0/2405707044 conn(0x7f5ed4051420 msgr2=0x7f5ed4051860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:39.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.684+0000 7f5ac6a70640 1 Processor -- start 2024-09-17T03:08:39.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.684+0000 7f5ee2cf9640 1 -- 172.21.15.78:0/2405707044 shutdown_connections 2024-09-17T03:08:39.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.684+0000 7f5ee2cf9640 1 -- 172.21.15.78:0/2405707044 wait complete. 2024-09-17T03:08:39.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.684+0000 7eff14815640 1 -- 172.21.15.78:0/4049960504 wait complete. 2024-09-17T03:08:39.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.685+0000 7f10d4dd7640 1 -- 172.21.15.78:0/1142434512 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10c8052990 msgr2=0x7f10c8037d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.685+0000 7f10d4dd7640 1 --2- 172.21.15.78:0/1142434512 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10c8052990 0x7f10c8037d90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f10c4009830 tx=0x7f10c402a490 comp rx=0 tx=0).stop 2024-09-17T03:08:39.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.684+0000 7f5ac6a70640 1 -- start start 2024-09-17T03:08:39.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.685+0000 7f10d4dd7640 1 -- 172.21.15.78:0/1142434512 shutdown_connections 2024-09-17T03:08:39.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.685+0000 7f10d4dd7640 1 --2- 172.21.15.78:0/1142434512 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10c8052990 0x7f10c8037d90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.685+0000 7f10d4dd7640 1 --2- 172.21.15.78:0/1142434512 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f10c8036830 0x7f10c80068c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.686+0000 7f10d4dd7640 1 -- 172.21.15.78:0/1142434512 >> 172.21.15.78:0/1142434512 conn(0x7f10c801eac0 msgr2=0x7f10c803a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:39.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.686+0000 7f10d4dd7640 1 -- 172.21.15.78:0/1142434512 shutdown_connections 2024-09-17T03:08:39.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.686+0000 7f10d4dd7640 1 -- 172.21.15.78:0/1142434512 wait complete. 2024-09-17T03:08:39.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.686+0000 7f7cb3606640 1 -- 172.21.15.78:0/2312594599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7cac073630 msgr2=0x7f7cac073a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.686+0000 7f7cb3606640 1 --2- 172.21.15.78:0/2312594599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7cac073630 0x7f7cac073a40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7cac072dc0 tx=0x7f7ca402a9c0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.686+0000 7f7cb3606640 1 -- 172.21.15.78:0/2312594599 shutdown_connections 2024-09-17T03:08:39.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.686+0000 7f7cb3606640 1 --2- 172.21.15.78:0/2312594599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7cac073630 0x7f7cac073a40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.686+0000 7f7cb3606640 1 --2- 172.21.15.78:0/2312594599 >> v2:172.21.15.78:3300/0 conn(0x7f7cac15b8c0 0x7f7cac0730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.686+0000 7f7cb3606640 1 -- 172.21.15.78:0/2312594599 >> 172.21.15.78:0/2312594599 conn(0x7f7cac06d410 msgr2=0x7f7cac0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:39.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.686+0000 7f7cb3606640 1 -- 172.21.15.78:0/2312594599 shutdown_connections 2024-09-17T03:08:39.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.687+0000 7f5ac6a70640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5ac01624d0 0x7f5ac0157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.687+0000 7f5ac6a70640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ac01628e0 0x7f5ac00b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.688+0000 7f5ac6a70640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ac0158730 0x7f5ac0158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.688+0000 7f5ac6a70640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac00cd6b0 con 0x7f5ac01628e0 2024-09-17T03:08:39.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.688+0000 7f5ac6a70640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac00cd530 con 0x7f5ac0158730 2024-09-17T03:08:39.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.688+0000 7f5ac6a70640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac00afa50 con 0x7f5ac01624d0 2024-09-17T03:08:39.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.687+0000 7f5ee2cf9640 1 Processor -- start 2024-09-17T03:08:39.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.687+0000 7f5ee2cf9640 1 -- start start 2024-09-17T03:08:39.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.687+0000 7eff14815640 1 Processor -- start 2024-09-17T03:08:39.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.687+0000 7eff14815640 1 -- start start 2024-09-17T03:08:39.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.686+0000 7f3dc8d19640 1 Processor -- start 2024-09-17T03:08:39.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.687+0000 7f3dc8d19640 1 -- start start 2024-09-17T03:08:39.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.686+0000 7f7cb3606640 1 -- 172.21.15.78:0/2312594599 wait complete. 2024-09-17T03:08:39.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.689+0000 7f5abffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ac01628e0 0x7f5ac00b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.689+0000 7f5abffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ac01628e0 0x7f5ac00b5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34314/0 (socket says 172.21.15.78:34314) 2024-09-17T03:08:39.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.689+0000 7f5abffff640 1 -- 172.21.15.78:0/1575446348 learned_addr learned my addr 172.21.15.78:0/1575446348 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:39.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.689+0000 7f5ac500d640 1 --2- 172.21.15.78:0/1575446348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ac0158730 0x7f5ac0158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.689+0000 7f10d4dd7640 1 Processor -- start 2024-09-17T03:08:39.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.689+0000 7f5ac480c640 1 --2- 172.21.15.78:0/1575446348 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5ac01624d0 0x7f5ac0157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.689+0000 7f3dc8d19640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dbc008fa0 0x7f3dbc0ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.689+0000 7f5ac500d640 1 -- 172.21.15.78:0/1575446348 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5ac01624d0 msgr2=0x7f5ac0157b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.689+0000 7f5ac500d640 1 --2- 172.21.15.78:0/1575446348 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5ac01624d0 0x7f5ac0157b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.689+0000 7f5ac500d640 1 -- 172.21.15.78:0/1575446348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ac01628e0 msgr2=0x7f5ac00b5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.689+0000 7f5ac500d640 1 --2- 172.21.15.78:0/1575446348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ac01628e0 0x7f5ac00b5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.689+0000 7f3dc8d19640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3dbc03ae90 0x7f3dbc0e0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.689+0000 7f10d4dd7640 1 -- start start 2024-09-17T03:08:39.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.689+0000 7f5ac500d640 1 -- 172.21.15.78:0/1575446348 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac00b5ea0 con 0x7f5ac0158730 2024-09-17T03:08:39.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.689+0000 7f5abffff640 1 --2- 172.21.15.78:0/1575446348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ac01628e0 0x7f5ac00b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:39.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7f3dc8d19640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dbc0ce0c0 0x7f3dbc0335b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.689+0000 7f5ac500d640 1 --2- 172.21.15.78:0/1575446348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ac0158730 0x7f5ac0158f10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000c390 tx=0x7f5ab000c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:39.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7eff14815640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7eff100cf660 0x7eff10152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7f5ee2cf9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ed4005c60 0x7f5ed402c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7f5abd7fa640 1 -- 172.21.15.78:0/1575446348 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0017070 con 0x7f5ac0158730 2024-09-17T03:08:39.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7f5abd7fa640 1 -- 172.21.15.78:0/1575446348 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ab00053c0 con 0x7f5ac0158730 2024-09-17T03:08:39.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7eff14815640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff100cfb90 0x7eff10155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7f5ee2cf9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ed4009ba0 0x7f5ed40dd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7f5abd7fa640 1 -- 172.21.15.78:0/1575446348 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ab0003850 con 0x7f5ac0158730 2024-09-17T03:08:39.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7f5ac6a70640 1 -- 172.21.15.78:0/1575446348 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac00b3440 con 0x7f5ac0158730 2024-09-17T03:08:39.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7eff0e59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7eff100cf660 0x7eff10152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7eff0e59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7eff100cf660 0x7eff10152630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.78:57850/0 (socket says 172.21.15.78:57850) 2024-09-17T03:08:39.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7f5ee0a95640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ed4005c60 0x7f5ed402c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7f5ee0a95640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ed4005c60 0x7f5ed402c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.78:57858/0 (socket says 172.21.15.78:57858) 2024-09-17T03:08:39.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7eff0e59c640 1 -- 172.21.15.78:0/981908086 learned_addr learned my addr 172.21.15.78:0/981908086 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:39.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7f5ee0a95640 1 -- 172.21.15.78:0/550988725 learned_addr learned my addr 172.21.15.78:0/550988725 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:39.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7eff14815640 1 --2- 172.21.15.78:0/981908086 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7eff101541b0 0x7eff101538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7f5ee2cf9640 1 --2- 172.21.15.78:0/550988725 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5ed4021a50 0x7f5ed401e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7f5ac6a70640 1 -- 172.21.15.78:0/1575446348 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac00aecc0 con 0x7f5ac0158730 2024-09-17T03:08:39.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7f5ee2cf9640 1 -- 172.21.15.78:0/550988725 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed4006ba0 con 0x7f5ed4009ba0 2024-09-17T03:08:39.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7eff14815640 1 -- 172.21.15.78:0/981908086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7eff10070f20 con 0x7eff100cfb90 2024-09-17T03:08:39.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7eff14815640 1 -- 172.21.15.78:0/981908086 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7eff10070660 con 0x7eff100cf660 2024-09-17T03:08:39.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.691+0000 7eff0ed9d640 1 --2- 172.21.15.78:0/981908086 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7eff101541b0 0x7eff101538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.691+0000 7eff0dd9b640 1 --2- 172.21.15.78:0/981908086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff100cfb90 0x7eff10155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.691+0000 7eff14815640 1 -- 172.21.15.78:0/981908086 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7eff100710a0 con 0x7eff101541b0 2024-09-17T03:08:39.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7f5ee2cf9640 1 -- 172.21.15.78:0/550988725 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed400be40 con 0x7f5ed4005c60 2024-09-17T03:08:39.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.691+0000 7f5ee2cf9640 1 -- 172.21.15.78:0/550988725 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5ed4006d20 con 0x7f5ed4021a50 2024-09-17T03:08:39.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.691+0000 7f5ee1296640 1 --2- 172.21.15.78:0/550988725 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5ed4021a50 0x7f5ed401e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7f3dc37fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dbc008fa0 0x7f3dbc0ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.691+0000 7f3dc37fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dbc008fa0 0x7f3dbc0ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.78:57834/0 (socket says 172.21.15.78:57834) 2024-09-17T03:08:39.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.691+0000 7f3dc2ffd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3dbc03ae90 0x7f3dbc0e0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.691+0000 7f5edbfff640 1 --2- 172.21.15.78:0/550988725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ed4009ba0 0x7f5ed40dd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.691+0000 7f3dc2ffd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3dbc03ae90 0x7f3dbc0e0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.78:45150/0 (socket says 172.21.15.78:45150) 2024-09-17T03:08:39.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f3dc8d19640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc006ee0 con 0x7f3dbc0ce0c0 2024-09-17T03:08:39.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f3dc3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dbc0ce0c0 0x7f3dbc0335b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7f7cb3606640 1 Processor -- start 2024-09-17T03:08:39.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.690+0000 7f7cb3606640 1 -- start start 2024-09-17T03:08:39.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f3dc8d19640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc006d60 con 0x7f3dbc008fa0 2024-09-17T03:08:39.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f10d4dd7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10c8034b90 0x7f10c816db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f3dc8d19640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3dbc007060 con 0x7f3dbc03ae90 2024-09-17T03:08:39.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f3dc37fe640 1 -- 172.21.15.78:0/64147667 learned_addr learned my addr 172.21.15.78:0/64147667 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:39.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f5ac6a70640 1 -- 172.21.15.78:0/1575446348 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac00b31b0 con 0x7f5ac0158730 2024-09-17T03:08:39.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f10d4dd7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10c8036830 0x7f10c8179f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f10d4dd7640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f10c817a490 0x7f10c8169e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7eff0e59c640 1 -- 172.21.15.78:0/981908086 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7eff101541b0 msgr2=0x7eff101538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f10cf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10c8034b90 0x7f10c816db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f10cf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10c8034b90 0x7f10c816db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34348/0 (socket says 172.21.15.78:34348) 2024-09-17T03:08:39.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7eff0e59c640 1 --2- 172.21.15.78:0/981908086 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7eff101541b0 0x7eff101538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7eff0e59c640 1 -- 172.21.15.78:0/981908086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff100cfb90 msgr2=0x7eff10155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7eff0e59c640 1 --2- 172.21.15.78:0/981908086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff100cfb90 0x7eff10155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7eff0e59c640 1 -- 172.21.15.78:0/981908086 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1015ab50 con 0x7eff100cf660 2024-09-17T03:08:39.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f5edbfff640 1 -- 172.21.15.78:0/550988725 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5ed4021a50 msgr2=0x7f5ed401e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f5edbfff640 1 --2- 172.21.15.78:0/550988725 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5ed4021a50 0x7f5ed401e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f5edbfff640 1 -- 172.21.15.78:0/550988725 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ed4005c60 msgr2=0x7f5ed402c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f5edbfff640 1 --2- 172.21.15.78:0/550988725 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ed4005c60 0x7f5ed402c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f5edbfff640 1 -- 172.21.15.78:0/550988725 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed40dd950 con 0x7f5ed4009ba0 2024-09-17T03:08:39.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7eff0ed9d640 1 --2- 172.21.15.78:0/981908086 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7eff101541b0 0x7eff101538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:39.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f7cb3606640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7cac073630 0x7f7cac1545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f7cb3606640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7cac0b3a50 0x7f7cac16bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f7cb3606640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cac15b8c0 0x7f7cac1504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f7cb3606640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7cac06f010 con 0x7f7cac15b8c0 2024-09-17T03:08:39.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f7cb3606640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7cac06ee90 con 0x7f7cac073630 2024-09-17T03:08:39.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f7cb3606640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7cac06f190 con 0x7f7cac0b3a50 2024-09-17T03:08:39.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7f7cb13a2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7cac073630 0x7f7cac1545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.692+0000 7eff0dd9b640 1 --2- 172.21.15.78:0/981908086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff100cfb90 0x7eff10155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:39.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f7cb0ba1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7cac0b3a50 0x7f7cac16bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7eff0e59c640 1 --2- 172.21.15.78:0/981908086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7eff100cf660 0x7eff10152630 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7eff0000b440 tx=0x7eff0000b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:39.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f7cb0ba1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7cac0b3a50 0x7f7cac16bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.78:45172/0 (socket says 172.21.15.78:45172) 2024-09-17T03:08:39.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f7cb0ba1640 1 -- 172.21.15.78:0/1133517993 learned_addr learned my addr 172.21.15.78:0/1133517993 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:39.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f10ceffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10c8036830 0x7f10c8179f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f10cf7fe640 1 -- 172.21.15.78:0/4231471226 learned_addr learned my addr 172.21.15.78:0/4231471226 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:39.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f3dc3fff640 1 -- 172.21.15.78:0/64147667 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3dbc03ae90 msgr2=0x7f3dbc0e0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f3dc3fff640 1 --2- 172.21.15.78:0/64147667 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3dbc03ae90 0x7f3dbc0e0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f3dc3fff640 1 -- 172.21.15.78:0/64147667 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dbc008fa0 msgr2=0x7f3dbc0ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f3dc3fff640 1 --2- 172.21.15.78:0/64147667 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dbc008fa0 0x7f3dbc0ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f3dc3fff640 1 -- 172.21.15.78:0/64147667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dbc0327f0 con 0x7f3dbc0ce0c0 2024-09-17T03:08:39.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f10cffff640 1 --2- 172.21.15.78:0/4231471226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f10c817a490 0x7f10c8169e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f7cb0ba1640 1 -- 172.21.15.78:0/1133517993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7cac073630 msgr2=0x7f7cac1545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f10d4dd7640 1 -- 172.21.15.78:0/4231471226 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f10c8035d10 con 0x7f10c8034b90 2024-09-17T03:08:39.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f7cb0ba1640 1 --2- 172.21.15.78:0/1133517993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7cac073630 0x7f7cac1545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f7cb0ba1640 1 -- 172.21.15.78:0/1133517993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cac15b8c0 msgr2=0x7f7cac1504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f7cb0ba1640 1 --2- 172.21.15.78:0/1133517993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cac15b8c0 0x7f7cac1504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f10d4dd7640 1 -- 172.21.15.78:0/4231471226 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f10c8035b90 con 0x7f10c8036830 2024-09-17T03:08:39.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f7cb0ba1640 1 -- 172.21.15.78:0/1133517993 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cac154f10 con 0x7f7cac0b3a50 2024-09-17T03:08:39.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f10d4dd7640 1 -- 172.21.15.78:0/4231471226 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f10c8035e90 con 0x7f10c817a490 2024-09-17T03:08:39.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f3dc3fff640 1 --2- 172.21.15.78:0/64147667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dbc0ce0c0 0x7f3dbc0335b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0e4530 tx=0x7f3db0033f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:39.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f3dc2ffd640 1 --2- 172.21.15.78:0/64147667 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3dbc03ae90 0x7f3dbc0e0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:08:39.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f7cb0ba1640 1 --2- 172.21.15.78:0/1133517993 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7cac0b3a50 0x7f7cac16bfa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800e9f0 tx=0x7f7ca800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:39.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f3daffff640 1 -- 172.21.15.78:0/64147667 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db0031c10 con 0x7f3dbc0ce0c0 2024-09-17T03:08:39.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f3daffff640 1 -- 172.21.15.78:0/64147667 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3db0031db0 con 0x7f3dbc0ce0c0 2024-09-17T03:08:39.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.693+0000 7f3daffff640 1 -- 172.21.15.78:0/64147667 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db0005240 con 0x7f3dbc0ce0c0 2024-09-17T03:08:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.694+0000 7f10ceffd640 1 -- 172.21.15.78:0/4231471226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f10c817a490 msgr2=0x7f10c8169e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.694+0000 7f10ceffd640 1 --2- 172.21.15.78:0/4231471226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f10c817a490 0x7f10c8169e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.694+0000 7f10ceffd640 1 -- 172.21.15.78:0/4231471226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10c8034b90 msgr2=0x7f10c816db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.694+0000 7f10ceffd640 1 --2- 172.21.15.78:0/4231471226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10c8034b90 0x7f10c816db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.694+0000 7f10ceffd640 1 -- 172.21.15.78:0/4231471226 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c81685b0 con 0x7f10c8036830 2024-09-17T03:08:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.694+0000 7f10cf7fe640 1 --2- 172.21.15.78:0/4231471226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10c8034b90 0x7f10c816db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:08:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.694+0000 7f7ca1ffb640 1 -- 172.21.15.78:0/1133517993 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca800cd80 con 0x7f7cac0b3a50 2024-09-17T03:08:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.694+0000 7f7ca1ffb640 1 -- 172.21.15.78:0/1133517993 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ca8004020 con 0x7f7cac0b3a50 2024-09-17T03:08:39.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.694+0000 7f7ca1ffb640 1 -- 172.21.15.78:0/1133517993 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8004470 con 0x7f7cac0b3a50 2024-09-17T03:08:39.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.694+0000 7f7cb3606640 1 -- 172.21.15.78:0/1133517993 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cac205b10 con 0x7f7cac0b3a50 2024-09-17T03:08:39.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.694+0000 7f7cb3606640 1 -- 172.21.15.78:0/1133517993 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cac16c4e0 con 0x7f7cac0b3a50 2024-09-17T03:08:39.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.694+0000 7f5abd7fa640 1 -- 172.21.15.78:0/1575446348 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5ab001a070 con 0x7f5ac0158730 2024-09-17T03:08:39.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.694+0000 7f5edbfff640 1 --2- 172.21.15.78:0/550988725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ed4009ba0 0x7f5ed40dd410 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800c3c0 tx=0x7f5ec800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:39.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.694+0000 7f3dc8d19640 1 -- 172.21.15.78:0/64147667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dbc032ad0 con 0x7f3dbc0ce0c0 2024-09-17T03:08:39.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.694+0000 7f3dc8d19640 1 -- 172.21.15.78:0/64147667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dbc0e1360 con 0x7f3dbc0ce0c0 2024-09-17T03:08:39.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.695+0000 7f5ed97fa640 1 -- 172.21.15.78:0/550988725 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec80052d0 con 0x7f5ed4009ba0 2024-09-17T03:08:39.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.695+0000 7f5ed97fa640 1 -- 172.21.15.78:0/550988725 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ec8007020 con 0x7f5ed4009ba0 2024-09-17T03:08:39.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.695+0000 7f5ed97fa640 1 -- 172.21.15.78:0/550988725 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8007470 con 0x7f5ed4009ba0 2024-09-17T03:08:39.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.695+0000 7f7cb3606640 1 -- 172.21.15.78:0/1133517993 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cac073a40 con 0x7f7cac0b3a50 2024-09-17T03:08:39.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.695+0000 7f5abd7fa640 1 --2- 172.21.15.78:0/1575446348 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5aac078c90 0x7f5aac07b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.695+0000 7f5abd7fa640 1 -- 172.21.15.78:0/1575446348 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5ab009a520 con 0x7f5ac0158730 2024-09-17T03:08:39.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.695+0000 7f3dc8d19640 1 -- 172.21.15.78:0/64147667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dbc0dfe80 con 0x7f3dbc0ce0c0 2024-09-17T03:08:39.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.695+0000 7f10ceffd640 1 --2- 172.21.15.78:0/4231471226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10c8036830 0x7f10c8179f50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f10d006b8e0 tx=0x7f10d006a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:39.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.695+0000 7f5ee2cf9640 1 -- 172.21.15.78:0/550988725 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed4020c90 con 0x7f5ed4009ba0 2024-09-17T03:08:39.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.695+0000 7f5ee2cf9640 1 -- 172.21.15.78:0/550988725 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed4021250 con 0x7f5ed4009ba0 2024-09-17T03:08:39.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.696+0000 7f7ca1ffb640 1 -- 172.21.15.78:0/1133517993 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7ca80035f0 con 0x7f7cac0b3a50 2024-09-17T03:08:39.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.696+0000 7f5ac480c640 1 --2- 172.21.15.78:0/1575446348 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5aac078c90 0x7f5aac07b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.697+0000 7f7ca1ffb640 1 --2- 172.21.15.78:0/1133517993 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7c90078bc0 0x7f7c9007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.697+0000 7f5ee2cf9640 1 -- 172.21.15.78:0/550988725 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ed4036140 con 0x7f5ed4009ba0 2024-09-17T03:08:39.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.697+0000 7f5ac480c640 1 --2- 172.21.15.78:0/1575446348 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5aac078c90 0x7f5aac07b1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8035000 tx=0x7f5ab8004ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:39.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.697+0000 7f7ca1ffb640 1 -- 172.21.15.78:0/1133517993 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7ca809b870 con 0x7f7cac0b3a50 2024-09-17T03:08:39.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.697+0000 7f7cb13a2640 1 --2- 172.21.15.78:0/1133517993 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7c90078bc0 0x7f7c9007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.698+0000 7efefeffd640 1 -- 172.21.15.78:0/981908086 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff00015020 con 0x7eff100cf660 2024-09-17T03:08:39.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.698+0000 7f10bbfff640 1 -- 172.21.15.78:0/4231471226 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d0069250 con 0x7f10c8036830 2024-09-17T03:08:39.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.698+0000 7f10bbfff640 1 -- 172.21.15.78:0/4231471226 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10d00694e0 con 0x7f10c8036830 2024-09-17T03:08:39.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.698+0000 7eff14815640 1 -- 172.21.15.78:0/981908086 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1015a870 con 0x7eff100cf660 2024-09-17T03:08:39.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.698+0000 7f10bbfff640 1 -- 172.21.15.78:0/4231471226 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d0069250 con 0x7f10c8036830 2024-09-17T03:08:39.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.698+0000 7eff14815640 1 -- 172.21.15.78:0/981908086 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff100c6700 con 0x7eff100cf660 2024-09-17T03:08:39.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.698+0000 7efefeffd640 1 -- 172.21.15.78:0/981908086 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff00011940 con 0x7eff100cf660 2024-09-17T03:08:39.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.698+0000 7efefeffd640 1 -- 172.21.15.78:0/981908086 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff00011d90 con 0x7eff100cf660 2024-09-17T03:08:39.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.698+0000 7f3daffff640 1 -- 172.21.15.78:0/64147667 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3db00053e0 con 0x7f3dbc0ce0c0 2024-09-17T03:08:39.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.699+0000 7f3daffff640 1 --2- 172.21.15.78:0/64147667 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3da8078bc0 0x7f3da807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.699+0000 7f5ed97fa640 1 -- 172.21.15.78:0/550988725 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5ec80067d0 con 0x7f5ed4009ba0 2024-09-17T03:08:39.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.699+0000 7f3daffff640 1 -- 172.21.15.78:0/64147667 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3db00bc130 con 0x7f3dbc0ce0c0 2024-09-17T03:08:39.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.700+0000 7f5ed97fa640 1 --2- 172.21.15.78:0/550988725 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5ec0078be0 0x7f5ec007b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.700+0000 7f5ee0a95640 1 --2- 172.21.15.78:0/550988725 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5ec0078be0 0x7f5ec007b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.701+0000 7efefeffd640 1 -- 172.21.15.78:0/981908086 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7eff00018020 con 0x7eff100cf660 2024-09-17T03:08:39.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.698+0000 7f5abd7fa640 1 -- 172.21.15.78:0/1575446348 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5ab0021070 con 0x7f5ac0158730 2024-09-17T03:08:39.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.700+0000 7f3dc37fe640 1 --2- 172.21.15.78:0/64147667 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3da8078bc0 0x7f3da807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.701+0000 7f3dc37fe640 1 --2- 172.21.15.78:0/64147667 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3da8078bc0 0x7f3da807b0d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3db80058c0 tx=0x7f3db800b410 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:39.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.701+0000 7f5ee0a95640 1 --2- 172.21.15.78:0/550988725 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5ec0078be0 0x7f5ec007b0f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009c00 tx=0x7f5ed00091e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:39.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.702+0000 7efefeffd640 1 --2- 172.21.15.78:0/981908086 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efef0078c60 0x7efef007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.702+0000 7f7ca1ffb640 1 -- 172.21.15.78:0/1133517993 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7ca8063c10 con 0x7f7cac0b3a50 2024-09-17T03:08:39.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.702+0000 7f10d4dd7640 1 -- 172.21.15.78:0/4231471226 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c8168890 con 0x7f10c8036830 2024-09-17T03:08:39.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.702+0000 7f10d4dd7640 1 -- 172.21.15.78:0/4231471226 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c8168e50 con 0x7f10c8036830 2024-09-17T03:08:39.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.702+0000 7efefeffd640 1 -- 172.21.15.78:0/981908086 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7eff0009a8c0 con 0x7eff100cf660 2024-09-17T03:08:39.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.702+0000 7eff0dd9b640 1 --2- 172.21.15.78:0/981908086 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efef0078c60 0x7efef007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.703+0000 7eff14815640 1 -- 172.21.15.78:0/981908086 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efef4005290 con 0x7eff100cf660 2024-09-17T03:08:39.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.703+0000 7f7cb13a2640 1 --2- 172.21.15.78:0/1133517993 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7c90078bc0 0x7f7c9007b0d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c000f60 tx=0x7f7c9c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:39.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.703+0000 7f10d4dd7640 1 -- 172.21.15.78:0/4231471226 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10c8036340 con 0x7f10c8036830 2024-09-17T03:08:39.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.704+0000 7eff0dd9b640 1 --2- 172.21.15.78:0/981908086 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efef0078c60 0x7efef007b170 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7eff101583e0 tx=0x7eff04009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:39.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.705+0000 7f10bbfff640 1 -- 172.21.15.78:0/4231471226 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f10d0069690 con 0x7f10c8036830 2024-09-17T03:08:39.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.706+0000 7f10bbfff640 1 --2- 172.21.15.78:0/4231471226 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f10b4078fc0 0x7f10b407b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:39.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.706+0000 7f10bbfff640 1 -- 172.21.15.78:0/4231471226 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f10d00753d0 con 0x7f10c8036830 2024-09-17T03:08:39.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.706+0000 7f3daffff640 1 -- 172.21.15.78:0/64147667 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3db003f030 con 0x7f3dbc0ce0c0 2024-09-17T03:08:39.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.706+0000 7f10cf7fe640 1 --2- 172.21.15.78:0/4231471226 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f10b4078fc0 0x7f10b407b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:39.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.706+0000 7f5ed97fa640 1 -- 172.21.15.78:0/550988725 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5ec8007610 con 0x7f5ed4009ba0 2024-09-17T03:08:39.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.707+0000 7f10cf7fe640 1 --2- 172.21.15.78:0/4231471226 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f10b4078fc0 0x7f10b407b4d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f10bc011440 tx=0x7f10bc005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:39.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.708+0000 7efefeffd640 1 -- 172.21.15.78:0/981908086 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7eff0001f030 con 0x7eff100cf660 2024-09-17T03:08:39.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.714+0000 7f10bbfff640 1 -- 172.21.15.78:0/4231471226 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f10d008f030 con 0x7f10c8036830 2024-09-17T03:08:39.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:39.716+0000 7f5ed97fa640 1 -- 172.21.15.78:0/550988725 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5ed4036140 con 0x7f5ed4009ba0 2024-09-17T03:08:40.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.023+0000 7f8790b2e640 1 -- 172.21.15.78:0/657157460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f876c005850 con 0x7f8784006fa0 2024-09-17T03:08:40.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.024+0000 7f8777fff640 1 -- 172.21.15.78:0/657157460 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f877800ce20 con 0x7f8784006fa0 2024-09-17T03:08:40.024 INFO:teuthology.orchestra.run.smithi078.stdout:55834574856 2024-09-17T03:08:40.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.027+0000 7f8775ffb640 1 -- 172.21.15.78:0/657157460 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8770078c90 msgr2=0x7f877007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.027+0000 7f8775ffb640 1 --2- 172.21.15.78:0/657157460 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8770078c90 0x7f877007b1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f87840361b0 tx=0x7f878c06b3a0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.028+0000 7f8775ffb640 1 -- 172.21.15.78:0/657157460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8784006fa0 msgr2=0x7f878416c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.028+0000 7f8775ffb640 1 --2- 172.21.15.78:0/657157460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8784006fa0 0x7f878416c050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f877800b780 tx=0x7f877800bc40 comp rx=0 tx=0).stop 2024-09-17T03:08:40.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.028+0000 7f8775ffb640 1 -- 172.21.15.78:0/657157460 shutdown_connections 2024-09-17T03:08:40.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.028+0000 7f8775ffb640 1 --2- 172.21.15.78:0/657157460 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8770078c90 0x7f877007b1a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.028+0000 7f8775ffb640 1 --2- 172.21.15.78:0/657157460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f878416ec20 0x7f87840e2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.028+0000 7f8775ffb640 1 --2- 172.21.15.78:0/657157460 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f87840df800 0x7f87840e2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.028+0000 7f8775ffb640 1 --2- 172.21.15.78:0/657157460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8784006fa0 0x7f878416c050 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.028+0000 7f8775ffb640 1 -- 172.21.15.78:0/657157460 >> 172.21.15.78:0/657157460 conn(0x7f878401e260 msgr2=0x7f8784039e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:40.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.029+0000 7f8775ffb640 1 -- 172.21.15.78:0/657157460 shutdown_connections 2024-09-17T03:08:40.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.029+0000 7f8775ffb640 1 -- 172.21.15.78:0/657157460 wait complete. 2024-09-17T03:08:40.045 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.3 2024-09-17T03:08:40.045 DEBUG:teuthology.parallel:result is None 2024-09-17T03:08:40.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.057+0000 7f6a5f59e640 1 -- 172.21.15.78:0/202715208 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6a580e58c0 con 0x7f6a580537f0 2024-09-17T03:08:40.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.058+0000 7f6a4effd640 1 -- 172.21.15.78:0/202715208 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6a54063330 con 0x7f6a580537f0 2024-09-17T03:08:40.058 INFO:teuthology.orchestra.run.smithi078.stdout:64424509449 2024-09-17T03:08:40.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.061+0000 7f6a5f59e640 1 -- 172.21.15.78:0/202715208 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6a40078c90 msgr2=0x7f6a4007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.061+0000 7f6a5f59e640 1 --2- 172.21.15.78:0/202715208 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6a40078c90 0x7f6a4007b1a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6a50034000 tx=0x7f6a50004730 comp rx=0 tx=0).stop 2024-09-17T03:08:40.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.061+0000 7f6a5f59e640 1 -- 172.21.15.78:0/202715208 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a580537f0 msgr2=0x7f6a580e3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.061+0000 7f6a5f59e640 1 --2- 172.21.15.78:0/202715208 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a580537f0 0x7f6a580e3f50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6a5400e9d0 tx=0x7f6a5400ee90 comp rx=0 tx=0).stop 2024-09-17T03:08:40.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.061+0000 7f6a5f59e640 1 -- 172.21.15.78:0/202715208 shutdown_connections 2024-09-17T03:08:40.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.061+0000 7f6a5f59e640 1 --2- 172.21.15.78:0/202715208 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6a40078c90 0x7f6a4007b1a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.061+0000 7f6a5f59e640 1 --2- 172.21.15.78:0/202715208 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a580e1010 0x7f6a5818a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.061+0000 7f6a5f59e640 1 --2- 172.21.15.78:0/202715208 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6a58054ba0 0x7f6a5818a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.061+0000 7f6a5f59e640 1 --2- 172.21.15.78:0/202715208 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a580537f0 0x7f6a580e3f50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.061+0000 7f6a5f59e640 1 -- 172.21.15.78:0/202715208 >> 172.21.15.78:0/202715208 conn(0x7f6a5801fbe0 msgr2=0x7f6a580056c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:40.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.062+0000 7f6a5f59e640 1 -- 172.21.15.78:0/202715208 shutdown_connections 2024-09-17T03:08:40.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.062+0000 7f6a5f59e640 1 -- 172.21.15.78:0/202715208 wait complete. 2024-09-17T03:08:40.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2024-09-17T03:08:40.077 DEBUG:teuthology.parallel:result is None 2024-09-17T03:08:40.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.082+0000 7f5ee2cf9640 1 -- 172.21.15.78:0/550988725 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f5ed402c870 con 0x7f5ed4009ba0 2024-09-17T03:08:40.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.083+0000 7f5ed97fa640 1 -- 172.21.15.78:0/550988725 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5ed4006070 con 0x7f5ed4009ba0 2024-09-17T03:08:40.082 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-17T03:08:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.085+0000 7f5ee2cf9640 1 -- 172.21.15.78:0/550988725 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5ec0078be0 msgr2=0x7f5ec007b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.085+0000 7f5ee2cf9640 1 --2- 172.21.15.78:0/550988725 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5ec0078be0 0x7f5ec007b0f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009c00 tx=0x7f5ed00091e0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.085+0000 7f5ee2cf9640 1 -- 172.21.15.78:0/550988725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ed4009ba0 msgr2=0x7f5ed40dd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.085+0000 7f5ee2cf9640 1 --2- 172.21.15.78:0/550988725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ed4009ba0 0x7f5ed40dd410 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800c3c0 tx=0x7f5ec800c880 comp rx=0 tx=0).stop 2024-09-17T03:08:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.085+0000 7f5ee2cf9640 1 -- 172.21.15.78:0/550988725 shutdown_connections 2024-09-17T03:08:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.085+0000 7f5ee2cf9640 1 --2- 172.21.15.78:0/550988725 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5ed4021a50 0x7f5ed401e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.085+0000 7f5ee2cf9640 1 --2- 172.21.15.78:0/550988725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ed4009ba0 0x7f5ed40dd410 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.085+0000 7f5ee2cf9640 1 --2- 172.21.15.78:0/550988725 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5ec0078be0 0x7f5ec007b0f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.085+0000 7f5ee2cf9640 1 --2- 172.21.15.78:0/550988725 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ed4005c60 0x7f5ed402c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.085+0000 7f5ee2cf9640 1 -- 172.21.15.78:0/550988725 >> 172.21.15.78:0/550988725 conn(0x7f5ed4051420 msgr2=0x7f5ed4052740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:40.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.085+0000 7f5ee2cf9640 1 -- 172.21.15.78:0/550988725 shutdown_connections 2024-09-17T03:08:40.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.085+0000 7f5ee2cf9640 1 -- 172.21.15.78:0/550988725 wait complete. 2024-09-17T03:08:40.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.093+0000 7f7cb3606640 1 -- 172.21.15.78:0/1133517993 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f7cac154ca0 con 0x7f7cac0b3a50 2024-09-17T03:08:40.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.094+0000 7f7ca1ffb640 1 -- 172.21.15.78:0/1133517993 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7ca8063510 con 0x7f7cac0b3a50 2024-09-17T03:08:40.093 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-17T03:08:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.096+0000 7f7cb3606640 1 -- 172.21.15.78:0/1133517993 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7c90078bc0 msgr2=0x7f7c9007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.096+0000 7f7cb3606640 1 --2- 172.21.15.78:0/1133517993 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7c90078bc0 0x7f7c9007b0d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c000f60 tx=0x7f7c9c009040 comp rx=0 tx=0).stop 2024-09-17T03:08:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.096+0000 7f7cb3606640 1 -- 172.21.15.78:0/1133517993 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7cac0b3a50 msgr2=0x7f7cac16bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.096+0000 7f7cb3606640 1 --2- 172.21.15.78:0/1133517993 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7cac0b3a50 0x7f7cac16bfa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800e9f0 tx=0x7f7ca800eeb0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.096+0000 7f7cb3606640 1 -- 172.21.15.78:0/1133517993 shutdown_connections 2024-09-17T03:08:40.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.096+0000 7f7cb3606640 1 --2- 172.21.15.78:0/1133517993 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cac15b8c0 0x7f7cac1504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.096+0000 7f7cb3606640 1 --2- 172.21.15.78:0/1133517993 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7cac0b3a50 0x7f7cac16bfa0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.096+0000 7f7cb3606640 1 --2- 172.21.15.78:0/1133517993 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7c90078bc0 0x7f7c9007b0d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.096+0000 7f7cb3606640 1 --2- 172.21.15.78:0/1133517993 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7cac073630 0x7f7cac1545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.096+0000 7f7cb3606640 1 -- 172.21.15.78:0/1133517993 >> 172.21.15.78:0/1133517993 conn(0x7f7cac06d410 msgr2=0x7f7cac0b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:40.098 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.6 2024-09-17T03:08:40.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.097+0000 7f7cb3606640 1 -- 172.21.15.78:0/1133517993 shutdown_connections 2024-09-17T03:08:40.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.097+0000 7f7cb3606640 1 -- 172.21.15.78:0/1133517993 wait complete. 2024-09-17T03:08:40.098 DEBUG:teuthology.parallel:result is None 2024-09-17T03:08:40.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.0 2024-09-17T03:08:40.107 DEBUG:teuthology.parallel:result is None 2024-09-17T03:08:40.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.109+0000 7f5ac6a70640 1 -- 172.21.15.78:0/1575446348 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f5ac015f880 con 0x7f5ac0158730 2024-09-17T03:08:40.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.109+0000 7f5abd7fa640 1 -- 172.21.15.78:0/1575446348 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5ab0062440 con 0x7f5ac0158730 2024-09-17T03:08:40.109 INFO:teuthology.orchestra.run.smithi078.stdout:64424509447 2024-09-17T03:08:40.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.112+0000 7f5ac6a70640 1 -- 172.21.15.78:0/1575446348 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5aac078c90 msgr2=0x7f5aac07b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.112+0000 7f5ac6a70640 1 --2- 172.21.15.78:0/1575446348 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5aac078c90 0x7f5aac07b1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8035000 tx=0x7f5ab8004ab0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.112+0000 7f5ac6a70640 1 -- 172.21.15.78:0/1575446348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ac0158730 msgr2=0x7f5ac0158f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.112+0000 7f5ac6a70640 1 --2- 172.21.15.78:0/1575446348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ac0158730 0x7f5ac0158f10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000c390 tx=0x7f5ab000c850 comp rx=0 tx=0).stop 2024-09-17T03:08:40.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.113+0000 7f5ac6a70640 1 -- 172.21.15.78:0/1575446348 shutdown_connections 2024-09-17T03:08:40.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.113+0000 7f5ac6a70640 1 --2- 172.21.15.78:0/1575446348 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5aac078c90 0x7f5aac07b1a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.113+0000 7f5ac6a70640 1 --2- 172.21.15.78:0/1575446348 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5ac0158730 0x7f5ac0158f10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.113+0000 7f5ac6a70640 1 --2- 172.21.15.78:0/1575446348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ac01628e0 0x7f5ac00b5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.113+0000 7f5ac6a70640 1 --2- 172.21.15.78:0/1575446348 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5ac01624d0 0x7f5ac0157b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.113+0000 7f5ac6a70640 1 -- 172.21.15.78:0/1575446348 >> 172.21.15.78:0/1575446348 conn(0x7f5ac00b20a0 msgr2=0x7f5ac00b0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:40.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.113+0000 7f5ac6a70640 1 -- 172.21.15.78:0/1575446348 shutdown_connections 2024-09-17T03:08:40.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.113+0000 7f5ac6a70640 1 -- 172.21.15.78:0/1575446348 wait complete. 2024-09-17T03:08:40.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.126+0000 7f10d4dd7640 1 -- 172.21.15.78:0/4231471226 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f10c8056410 con 0x7f10c8036830 2024-09-17T03:08:40.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.127+0000 7f10bbfff640 1 -- 172.21.15.78:0/4231471226 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f10d00dd6d0 con 0x7f10c8036830 2024-09-17T03:08:40.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2024-09-17T03:08:40.127 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-17T03:08:40.127 DEBUG:teuthology.parallel:result is None 2024-09-17T03:08:40.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.129+0000 7f10d4dd7640 1 -- 172.21.15.78:0/4231471226 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f10b4078fc0 msgr2=0x7f10b407b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.129+0000 7f10d4dd7640 1 --2- 172.21.15.78:0/4231471226 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f10b4078fc0 0x7f10b407b4d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f10bc011440 tx=0x7f10bc005f90 comp rx=0 tx=0).stop 2024-09-17T03:08:40.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.129+0000 7f10d4dd7640 1 -- 172.21.15.78:0/4231471226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10c8036830 msgr2=0x7f10c8179f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.129+0000 7f10d4dd7640 1 --2- 172.21.15.78:0/4231471226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10c8036830 0x7f10c8179f50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f10d006b8e0 tx=0x7f10d006a000 comp rx=0 tx=0).stop 2024-09-17T03:08:40.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.129+0000 7f10d4dd7640 1 -- 172.21.15.78:0/4231471226 shutdown_connections 2024-09-17T03:08:40.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.129+0000 7f10d4dd7640 1 --2- 172.21.15.78:0/4231471226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f10c817a490 0x7f10c8169e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.129+0000 7f10d4dd7640 1 --2- 172.21.15.78:0/4231471226 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f10b4078fc0 0x7f10b407b4d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.129+0000 7f10d4dd7640 1 --2- 172.21.15.78:0/4231471226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10c8036830 0x7f10c8179f50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.129+0000 7f10d4dd7640 1 --2- 172.21.15.78:0/4231471226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10c8034b90 0x7f10c816db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.129+0000 7f10d4dd7640 1 -- 172.21.15.78:0/4231471226 >> 172.21.15.78:0/4231471226 conn(0x7f10c801eac0 msgr2=0x7f10c800bab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:40.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.129+0000 7f10d4dd7640 1 -- 172.21.15.78:0/4231471226 shutdown_connections 2024-09-17T03:08:40.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.129+0000 7f10d4dd7640 1 -- 172.21.15.78:0/4231471226 wait complete. 2024-09-17T03:08:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.130+0000 7f3dc8d19640 1 -- 172.21.15.78:0/64147667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3dbc056590 con 0x7f3dbc0ce0c0 2024-09-17T03:08:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.130+0000 7f3daffff640 1 -- 172.21.15.78:0/64147667 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3db0083f00 con 0x7f3dbc0ce0c0 2024-09-17T03:08:40.131 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-17T03:08:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.132+0000 7eff14815640 1 -- 172.21.15.78:0/981908086 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7efef4005580 con 0x7eff100cf660 2024-09-17T03:08:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.132+0000 7efefeffd640 1 -- 172.21.15.78:0/981908086 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7eff00062d70 con 0x7eff100cf660 2024-09-17T03:08:40.132 INFO:teuthology.orchestra.run.smithi078.stdout:64424509448 2024-09-17T03:08:40.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.132+0000 7f3dc8d19640 1 -- 172.21.15.78:0/64147667 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3da8078bc0 msgr2=0x7f3da807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.132+0000 7f3dc8d19640 1 --2- 172.21.15.78:0/64147667 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3da8078bc0 0x7f3da807b0d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3db80058c0 tx=0x7f3db800b410 comp rx=0 tx=0).stop 2024-09-17T03:08:40.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.132+0000 7f3dc8d19640 1 -- 172.21.15.78:0/64147667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dbc0ce0c0 msgr2=0x7f3dbc0335b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.132+0000 7f3dc8d19640 1 --2- 172.21.15.78:0/64147667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dbc0ce0c0 0x7f3dbc0335b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0e4530 tx=0x7f3db0033f10 comp rx=0 tx=0).stop 2024-09-17T03:08:40.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.132+0000 7f3dc8d19640 1 -- 172.21.15.78:0/64147667 shutdown_connections 2024-09-17T03:08:40.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.133+0000 7f3dc8d19640 1 --2- 172.21.15.78:0/64147667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3dbc0ce0c0 0x7f3dbc0335b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.133+0000 7f3dc8d19640 1 --2- 172.21.15.78:0/64147667 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3dbc03ae90 0x7f3dbc0e0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.133+0000 7f3dc8d19640 1 --2- 172.21.15.78:0/64147667 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3da8078bc0 0x7f3da807b0d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.133+0000 7f3dc8d19640 1 --2- 172.21.15.78:0/64147667 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3dbc008fa0 0x7f3dbc0ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.133+0000 7f3dc8d19640 1 -- 172.21.15.78:0/64147667 >> 172.21.15.78:0/64147667 conn(0x7f3dbc01eae0 msgr2=0x7f3dbc0557d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:40.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.133+0000 7f3dc8d19640 1 -- 172.21.15.78:0/64147667 shutdown_connections 2024-09-17T03:08:40.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.133+0000 7f3dc8d19640 1 -- 172.21.15.78:0/64147667 wait complete. 2024-09-17T03:08:40.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.134+0000 7eff14815640 1 -- 172.21.15.78:0/981908086 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efef0078c60 msgr2=0x7efef007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.134+0000 7eff14815640 1 --2- 172.21.15.78:0/981908086 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efef0078c60 0x7efef007b170 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7eff101583e0 tx=0x7eff04009040 comp rx=0 tx=0).stop 2024-09-17T03:08:40.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.134+0000 7eff14815640 1 -- 172.21.15.78:0/981908086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7eff100cf660 msgr2=0x7eff10152630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.134+0000 7eff14815640 1 --2- 172.21.15.78:0/981908086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7eff100cf660 0x7eff10152630 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7eff0000b440 tx=0x7eff0000b900 comp rx=0 tx=0).stop 2024-09-17T03:08:40.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.134+0000 7eff14815640 1 -- 172.21.15.78:0/981908086 shutdown_connections 2024-09-17T03:08:40.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.134+0000 7eff14815640 1 --2- 172.21.15.78:0/981908086 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7eff101541b0 0x7eff101538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.134+0000 7eff14815640 1 --2- 172.21.15.78:0/981908086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff100cfb90 0x7eff10155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.134+0000 7eff14815640 1 --2- 172.21.15.78:0/981908086 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efef0078c60 0x7efef007b170 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.134+0000 7eff14815640 1 --2- 172.21.15.78:0/981908086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7eff100cf660 0x7eff10152630 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.134+0000 7eff14815640 1 -- 172.21.15.78:0/981908086 >> 172.21.15.78:0/981908086 conn(0x7eff100b1cb0 msgr2=0x7eff100b4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:40.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.134+0000 7eff14815640 1 -- 172.21.15.78:0/981908086 shutdown_connections 2024-09-17T03:08:40.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.134+0000 7eff14815640 1 -- 172.21.15.78:0/981908086 wait complete. 2024-09-17T03:08:40.143 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.7 2024-09-17T03:08:40.143 DEBUG:teuthology.parallel:result is None 2024-09-17T03:08:40.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.1 2024-09-17T03:08:40.146 DEBUG:teuthology.parallel:result is None 2024-09-17T03:08:40.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.4 2024-09-17T03:08:40.147 DEBUG:teuthology.parallel:result is None 2024-09-17T03:08:40.147 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:08:40.147 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:08:40.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.299+0000 7f3459771640 1 -- 172.21.15.78:0/1886135962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3454155ce0 msgr2=0x7f34540b45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.299+0000 7f3459771640 1 --2- 172.21.15.78:0/1886135962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3454155ce0 0x7f34540b45a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f344c005fd0 tx=0x7f344c02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.299+0000 7f3459771640 1 -- 172.21.15.78:0/1886135962 shutdown_connections 2024-09-17T03:08:40.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.299+0000 7f3459771640 1 --2- 172.21.15.78:0/1886135962 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3454155ce0 0x7f34540b45a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.299+0000 7f3459771640 1 --2- 172.21.15.78:0/1886135962 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3454074420 0x7f345406fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.299+0000 7f3459771640 1 -- 172.21.15.78:0/1886135962 >> 172.21.15.78:0/1886135962 conn(0x7f345406def0 msgr2=0x7f345406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:40.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.299+0000 7f3459771640 1 -- 172.21.15.78:0/1886135962 shutdown_connections 2024-09-17T03:08:40.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.299+0000 7f3459771640 1 -- 172.21.15.78:0/1886135962 wait complete. 2024-09-17T03:08:40.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.301+0000 7f3459771640 1 Processor -- start 2024-09-17T03:08:40.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.301+0000 7f3459771640 1 -- start start 2024-09-17T03:08:40.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.302+0000 7f3459771640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3454074420 0x7f34541f6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:40.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.302+0000 7f3459771640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3454155ce0 0x7f3454151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:40.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.302+0000 7f3459771640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3454152070 0x7f345406cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:40.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.302+0000 7f3459771640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f34540b5060 con 0x7f3454152070 2024-09-17T03:08:40.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.302+0000 7f3459771640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f34540b4ee0 con 0x7f3454074420 2024-09-17T03:08:40.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.302+0000 7f3459771640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f34540b51e0 con 0x7f3454155ce0 2024-09-17T03:08:40.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.302+0000 7f34537fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3454152070 0x7f345406cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:40.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.303+0000 7f34537fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3454152070 0x7f345406cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34372/0 (socket says 172.21.15.78:34372) 2024-09-17T03:08:40.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.303+0000 7f34537fe640 1 -- 172.21.15.78:0/1582731989 learned_addr learned my addr 172.21.15.78:0/1582731989 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:40.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.303+0000 7f3452ffd640 1 --2- 172.21.15.78:0/1582731989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3454074420 0x7f34541f6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:40.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.303+0000 7f34527fc640 1 --2- 172.21.15.78:0/1582731989 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3454155ce0 0x7f3454151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:40.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.303+0000 7f34537fe640 1 -- 172.21.15.78:0/1582731989 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3454155ce0 msgr2=0x7f3454151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.303+0000 7f34537fe640 1 --2- 172.21.15.78:0/1582731989 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3454155ce0 0x7f3454151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.303+0000 7f34537fe640 1 -- 172.21.15.78:0/1582731989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3454074420 msgr2=0x7f34541f6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.303+0000 7f34537fe640 1 --2- 172.21.15.78:0/1582731989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3454074420 0x7f34541f6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.303+0000 7f34537fe640 1 -- 172.21.15.78:0/1582731989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345415a170 con 0x7f3454152070 2024-09-17T03:08:40.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.303+0000 7f34537fe640 1 --2- 172.21.15.78:0/1582731989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3454152070 0x7f345406cde0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f344c006010 tx=0x7f344c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:40.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.303+0000 7f344b7fe640 1 -- 172.21.15.78:0/1582731989 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c03e030 con 0x7f3454152070 2024-09-17T03:08:40.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.303+0000 7f344b7fe640 1 -- 172.21.15.78:0/1582731989 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f344c003c20 con 0x7f3454152070 2024-09-17T03:08:40.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.303+0000 7f344b7fe640 1 -- 172.21.15.78:0/1582731989 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c035040 con 0x7f3454152070 2024-09-17T03:08:40.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.303+0000 7f3459771640 1 -- 172.21.15.78:0/1582731989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345415a430 con 0x7f3454152070 2024-09-17T03:08:40.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.303+0000 7f3459771640 1 -- 172.21.15.78:0/1582731989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34540c6c20 con 0x7f3454152070 2024-09-17T03:08:40.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.304+0000 7f3459771640 1 -- 172.21.15.78:0/1582731989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34540c6730 con 0x7f3454152070 2024-09-17T03:08:40.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.305+0000 7f344b7fe640 1 -- 172.21.15.78:0/1582731989 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f344c041030 con 0x7f3454152070 2024-09-17T03:08:40.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.306+0000 7f344b7fe640 1 --2- 172.21.15.78:0/1582731989 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3434078bc0 0x7f343407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:40.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.306+0000 7f344b7fe640 1 -- 172.21.15.78:0/1582731989 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f344c0bb290 con 0x7f3454152070 2024-09-17T03:08:40.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.306+0000 7f3452ffd640 1 --2- 172.21.15.78:0/1582731989 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3434078bc0 0x7f343407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:40.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.306+0000 7f3452ffd640 1 --2- 172.21.15.78:0/1582731989 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3434078bc0 0x7f343407b0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3444005fd0 tx=0x7f34440095e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:40.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.310+0000 7f344b7fe640 1 -- 172.21.15.78:0/1582731989 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f344c083080 con 0x7f3454152070 2024-09-17T03:08:40.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.480+0000 7f3459771640 1 -- 172.21.15.78:0/1582731989 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f34540b5700 con 0x7f3434078bc0 2024-09-17T03:08:40.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.485+0000 7f344b7fe640 1 -- 172.21.15.78:0/1582731989 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f34540b5700 con 0x7f3434078bc0 2024-09-17T03:08:40.487 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:40.488 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:08:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.488+0000 7f3459771640 1 -- 172.21.15.78:0/1582731989 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3434078bc0 msgr2=0x7f343407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.488+0000 7f3459771640 1 --2- 172.21.15.78:0/1582731989 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3434078bc0 0x7f343407b0d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3444005fd0 tx=0x7f34440095e0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.488+0000 7f3459771640 1 -- 172.21.15.78:0/1582731989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3454152070 msgr2=0x7f345406cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.488+0000 7f3459771640 1 --2- 172.21.15.78:0/1582731989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3454152070 0x7f345406cde0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f344c006010 tx=0x7f344c003820 comp rx=0 tx=0).stop 2024-09-17T03:08:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.488+0000 7f3459771640 1 -- 172.21.15.78:0/1582731989 shutdown_connections 2024-09-17T03:08:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.488+0000 7f3459771640 1 --2- 172.21.15.78:0/1582731989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3454152070 0x7f345406cde0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.488+0000 7f3459771640 1 --2- 172.21.15.78:0/1582731989 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3454155ce0 0x7f3454151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.488+0000 7f3459771640 1 --2- 172.21.15.78:0/1582731989 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3434078bc0 0x7f343407b0d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.488+0000 7f3459771640 1 --2- 172.21.15.78:0/1582731989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3454074420 0x7f34541f6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.488+0000 7f3459771640 1 -- 172.21.15.78:0/1582731989 >> 172.21.15.78:0/1582731989 conn(0x7f345406def0 msgr2=0x7f34540cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.488+0000 7f3459771640 1 -- 172.21.15.78:0/1582731989 shutdown_connections 2024-09-17T03:08:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.488+0000 7f3459771640 1 -- 172.21.15.78:0/1582731989 wait complete. 2024-09-17T03:08:40.498 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-17T03:08:39.120855+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223440,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751280,"statfs":{"total":773094113280,"available":772865310720,"internally_reserved":0,"allocated":3121152,"data_stored":1842412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002931"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100906+0000","last_change":"2024-09-17T03:08:28.257527+0000","last_active":"2024-09-17T03:08:30.100906+0000","last_peered":"2024-09-17T03:08:30.100906+0000","last_clean":"2024-09-17T03:08:30.100906+0000","last_became_active":"2024-09-17T03:08:28.257066+0000","last_became_peered":"2024-09-17T03:08:28.257066+0000","last_unstale":"2024-09-17T03:08:30.100906+0000","last_undegraded":"2024-09-17T03:08:30.100906+0000","last_fullsized":"2024-09-17T03:08:30.100906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:02.975303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230784+0000","last_change":"2024-09-17T03:08:28.254760+0000","last_active":"2024-09-17T03:08:30.230784+0000","last_peered":"2024-09-17T03:08:30.230784+0000","last_clean":"2024-09-17T03:08:30.230784+0000","last_became_active":"2024-09-17T03:08:28.254472+0000","last_became_peered":"2024-09-17T03:08:28.254472+0000","last_unstale":"2024-09-17T03:08:30.230784+0000","last_undegraded":"2024-09-17T03:08:30.230784+0000","last_fullsized":"2024-09-17T03:08:30.230784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:58.189179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293417+0000","last_change":"2024-09-17T03:08:28.252512+0000","last_active":"2024-09-17T03:08:30.293417+0000","last_peered":"2024-09-17T03:08:30.293417+0000","last_clean":"2024-09-17T03:08:30.293417+0000","last_became_active":"2024-09-17T03:08:28.252206+0000","last_became_peered":"2024-09-17T03:08:28.252206+0000","last_unstale":"2024-09-17T03:08:30.293417+0000","last_undegraded":"2024-09-17T03:08:30.293417+0000","last_fullsized":"2024-09-17T03:08:30.293417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:50.820653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293517+0000","last_change":"2024-09-17T03:08:28.256056+0000","last_active":"2024-09-17T03:08:30.293517+0000","last_peered":"2024-09-17T03:08:30.293517+0000","last_clean":"2024-09-17T03:08:30.293517+0000","last_became_active":"2024-09-17T03:08:28.253346+0000","last_became_peered":"2024-09-17T03:08:28.253346+0000","last_unstale":"2024-09-17T03:08:30.293517+0000","last_undegraded":"2024-09-17T03:08:30.293517+0000","last_fullsized":"2024-09-17T03:08:30.293517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:50.397039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100669+0000","last_change":"2024-09-17T03:08:28.254995+0000","last_active":"2024-09-17T03:08:30.100669+0000","last_peered":"2024-09-17T03:08:30.100669+0000","last_clean":"2024-09-17T03:08:30.100669+0000","last_became_active":"2024-09-17T03:08:28.254698+0000","last_became_peered":"2024-09-17T03:08:28.254698+0000","last_unstale":"2024-09-17T03:08:30.100669+0000","last_undegraded":"2024-09-17T03:08:30.100669+0000","last_fullsized":"2024-09-17T03:08:30.100669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:54.201357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293326+0000","last_change":"2024-09-17T03:08:28.256649+0000","last_active":"2024-09-17T03:08:30.293326+0000","last_peered":"2024-09-17T03:08:30.293326+0000","last_clean":"2024-09-17T03:08:30.293326+0000","last_became_active":"2024-09-17T03:08:28.256251+0000","last_became_peered":"2024-09-17T03:08:28.256251+0000","last_unstale":"2024-09-17T03:08:30.293326+0000","last_undegraded":"2024-09-17T03:08:30.293326+0000","last_fullsized":"2024-09-17T03:08:30.293326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:24.543132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100346+0000","last_change":"2024-09-17T03:08:28.253738+0000","last_active":"2024-09-17T03:08:30.100346+0000","last_peered":"2024-09-17T03:08:30.100346+0000","last_clean":"2024-09-17T03:08:30.100346+0000","last_became_active":"2024-09-17T03:08:28.253409+0000","last_became_peered":"2024-09-17T03:08:28.253409+0000","last_unstale":"2024-09-17T03:08:30.100346+0000","last_undegraded":"2024-09-17T03:08:30.100346+0000","last_fullsized":"2024-09-17T03:08:30.100346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:50.397039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226452+0000","last_change":"2024-09-17T03:08:28.259418+0000","last_active":"2024-09-17T03:08:29.226452+0000","last_peered":"2024-09-17T03:08:29.226452+0000","last_clean":"2024-09-17T03:08:29.226452+0000","last_became_active":"2024-09-17T03:08:28.259145+0000","last_became_peered":"2024-09-17T03:08:28.259145+0000","last_unstale":"2024-09-17T03:08:29.226452+0000","last_undegraded":"2024-09-17T03:08:29.226452+0000","last_fullsized":"2024-09-17T03:08:29.226452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:24.693205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100914+0000","last_change":"2024-09-17T03:08:28.250578+0000","last_active":"2024-09-17T03:08:30.100914+0000","last_peered":"2024-09-17T03:08:30.100914+0000","last_clean":"2024-09-17T03:08:30.100914+0000","last_became_active":"2024-09-17T03:08:28.250237+0000","last_became_peered":"2024-09-17T03:08:28.250237+0000","last_unstale":"2024-09-17T03:08:30.100914+0000","last_undegraded":"2024-09-17T03:08:30.100914+0000","last_fullsized":"2024-09-17T03:08:30.100914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:25.083828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229259+0000","last_change":"2024-09-17T03:08:28.239497+0000","last_active":"2024-09-17T03:08:29.229259+0000","last_peered":"2024-09-17T03:08:29.229259+0000","last_clean":"2024-09-17T03:08:29.229259+0000","last_became_active":"2024-09-17T03:08:28.239187+0000","last_became_peered":"2024-09-17T03:08:28.239187+0000","last_unstale":"2024-09-17T03:08:29.229259+0000","last_undegraded":"2024-09-17T03:08:29.229259+0000","last_fullsized":"2024-09-17T03:08:29.229259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:02.757538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228039+0000","last_change":"2024-09-17T03:08:28.250102+0000","last_active":"2024-09-17T03:08:29.228039+0000","last_peered":"2024-09-17T03:08:29.228039+0000","last_clean":"2024-09-17T03:08:29.228039+0000","last_became_active":"2024-09-17T03:08:28.249797+0000","last_became_peered":"2024-09-17T03:08:28.249797+0000","last_unstale":"2024-09-17T03:08:29.228039+0000","last_undegraded":"2024-09-17T03:08:29.228039+0000","last_fullsized":"2024-09-17T03:08:29.228039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:19.446465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228129+0000","last_change":"2024-09-17T03:08:28.233620+0000","last_active":"2024-09-17T03:08:29.228129+0000","last_peered":"2024-09-17T03:08:29.228129+0000","last_clean":"2024-09-17T03:08:29.228129+0000","last_became_active":"2024-09-17T03:08:28.233312+0000","last_became_peered":"2024-09-17T03:08:28.233312+0000","last_unstale":"2024-09-17T03:08:29.228129+0000","last_undegraded":"2024-09-17T03:08:29.228129+0000","last_fullsized":"2024-09-17T03:08:29.228129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:39.083175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226708+0000","last_change":"2024-09-17T03:08:28.253338+0000","last_active":"2024-09-17T03:08:29.226708+0000","last_peered":"2024-09-17T03:08:29.226708+0000","last_clean":"2024-09-17T03:08:29.226708+0000","last_became_active":"2024-09-17T03:08:28.252284+0000","last_became_peered":"2024-09-17T03:08:28.252284+0000","last_unstale":"2024-09-17T03:08:29.226708+0000","last_undegraded":"2024-09-17T03:08:29.226708+0000","last_fullsized":"2024-09-17T03:08:29.226708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:47.945736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293003+0000","last_change":"2024-09-17T03:08:28.249001+0000","last_active":"2024-09-17T03:08:30.293003+0000","last_peered":"2024-09-17T03:08:30.293003+0000","last_clean":"2024-09-17T03:08:30.293003+0000","last_became_active":"2024-09-17T03:08:28.248702+0000","last_became_peered":"2024-09-17T03:08:28.248702+0000","last_unstale":"2024-09-17T03:08:30.293003+0000","last_undegraded":"2024-09-17T03:08:30.293003+0000","last_fullsized":"2024-09-17T03:08:30.293003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:21.958019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230664+0000","last_change":"2024-09-17T03:08:28.238314+0000","last_active":"2024-09-17T03:08:30.230664+0000","last_peered":"2024-09-17T03:08:30.230664+0000","last_clean":"2024-09-17T03:08:30.230664+0000","last_became_active":"2024-09-17T03:08:28.237653+0000","last_became_peered":"2024-09-17T03:08:28.237653+0000","last_unstale":"2024-09-17T03:08:30.230664+0000","last_undegraded":"2024-09-17T03:08:30.230664+0000","last_fullsized":"2024-09-17T03:08:30.230664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:05.501480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293426+0000","last_change":"2024-09-17T03:08:28.259958+0000","last_active":"2024-09-17T03:08:30.293426+0000","last_peered":"2024-09-17T03:08:30.293426+0000","last_clean":"2024-09-17T03:08:30.293426+0000","last_became_active":"2024-09-17T03:08:28.259595+0000","last_became_peered":"2024-09-17T03:08:28.259595+0000","last_unstale":"2024-09-17T03:08:30.293426+0000","last_undegraded":"2024-09-17T03:08:30.293426+0000","last_fullsized":"2024-09-17T03:08:30.293426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:10.650757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.294099+0000","last_change":"2024-09-17T03:08:28.253047+0000","last_active":"2024-09-17T03:08:30.294099+0000","last_peered":"2024-09-17T03:08:30.294099+0000","last_clean":"2024-09-17T03:08:30.294099+0000","last_became_active":"2024-09-17T03:08:28.252464+0000","last_became_peered":"2024-09-17T03:08:28.252464+0000","last_unstale":"2024-09-17T03:08:30.294099+0000","last_undegraded":"2024-09-17T03:08:30.294099+0000","last_fullsized":"2024-09-17T03:08:30.294099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:46.436651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.292836+0000","last_change":"2024-09-17T03:08:28.236142+0000","last_active":"2024-09-17T03:08:30.292836+0000","last_peered":"2024-09-17T03:08:30.292836+0000","last_clean":"2024-09-17T03:08:30.292836+0000","last_became_active":"2024-09-17T03:08:28.234294+0000","last_became_peered":"2024-09-17T03:08:28.234294+0000","last_unstale":"2024-09-17T03:08:30.292836+0000","last_undegraded":"2024-09-17T03:08:30.292836+0000","last_fullsized":"2024-09-17T03:08:30.292836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:14.380494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100799+0000","last_change":"2024-09-17T03:08:28.253214+0000","last_active":"2024-09-17T03:08:30.100799+0000","last_peered":"2024-09-17T03:08:30.100799+0000","last_clean":"2024-09-17T03:08:30.100799+0000","last_became_active":"2024-09-17T03:08:28.251617+0000","last_became_peered":"2024-09-17T03:08:28.251617+0000","last_unstale":"2024-09-17T03:08:30.100799+0000","last_undegraded":"2024-09-17T03:08:30.100799+0000","last_fullsized":"2024-09-17T03:08:30.100799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:46.436651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228620+0000","last_change":"2024-09-17T03:08:28.234354+0000","last_active":"2024-09-17T03:08:29.228620+0000","last_peered":"2024-09-17T03:08:29.228620+0000","last_clean":"2024-09-17T03:08:29.228620+0000","last_became_active":"2024-09-17T03:08:28.234028+0000","last_became_peered":"2024-09-17T03:08:28.234028+0000","last_unstale":"2024-09-17T03:08:29.228620+0000","last_undegraded":"2024-09-17T03:08:29.228620+0000","last_fullsized":"2024-09-17T03:08:29.228620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:45.993058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293511+0000","last_change":"2024-09-17T03:08:28.254197+0000","last_active":"2024-09-17T03:08:30.293511+0000","last_peered":"2024-09-17T03:08:30.293511+0000","last_clean":"2024-09-17T03:08:30.293511+0000","last_became_active":"2024-09-17T03:08:28.253658+0000","last_became_peered":"2024-09-17T03:08:28.253658+0000","last_unstale":"2024-09-17T03:08:30.293511+0000","last_undegraded":"2024-09-17T03:08:30.293511+0000","last_fullsized":"2024-09-17T03:08:30.293511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:32.455387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293415+0000","last_change":"2024-09-17T03:08:28.251554+0000","last_active":"2024-09-17T03:08:30.293415+0000","last_peered":"2024-09-17T03:08:30.293415+0000","last_clean":"2024-09-17T03:08:30.293415+0000","last_became_active":"2024-09-17T03:08:28.251248+0000","last_became_peered":"2024-09-17T03:08:28.251248+0000","last_unstale":"2024-09-17T03:08:30.293415+0000","last_undegraded":"2024-09-17T03:08:30.293415+0000","last_fullsized":"2024-09-17T03:08:30.293415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:26.430483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226932+0000","last_change":"2024-09-17T03:08:28.251521+0000","last_active":"2024-09-17T03:08:29.226932+0000","last_peered":"2024-09-17T03:08:29.226932+0000","last_clean":"2024-09-17T03:08:29.226932+0000","last_became_active":"2024-09-17T03:08:28.250475+0000","last_became_peered":"2024-09-17T03:08:28.250475+0000","last_unstale":"2024-09-17T03:08:29.226932+0000","last_undegraded":"2024-09-17T03:08:29.226932+0000","last_fullsized":"2024-09-17T03:08:29.226932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:05.560274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293354+0000","last_change":"2024-09-17T03:08:28.252379+0000","last_active":"2024-09-17T03:08:30.293354+0000","last_peered":"2024-09-17T03:08:30.293354+0000","last_clean":"2024-09-17T03:08:30.293354+0000","last_became_active":"2024-09-17T03:08:28.252064+0000","last_became_peered":"2024-09-17T03:08:28.252064+0000","last_unstale":"2024-09-17T03:08:30.293354+0000","last_undegraded":"2024-09-17T03:08:30.293354+0000","last_fullsized":"2024-09-17T03:08:30.293354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:38.557690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226859+0000","last_change":"2024-09-17T03:08:28.251210+0000","last_active":"2024-09-17T03:08:29.226859+0000","last_peered":"2024-09-17T03:08:29.226859+0000","last_clean":"2024-09-17T03:08:29.226859+0000","last_became_active":"2024-09-17T03:08:28.250780+0000","last_became_peered":"2024-09-17T03:08:28.250780+0000","last_unstale":"2024-09-17T03:08:29.226859+0000","last_undegraded":"2024-09-17T03:08:29.226859+0000","last_fullsized":"2024-09-17T03:08:29.226859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:39.174363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229299+0000","last_change":"2024-09-17T03:08:28.245417+0000","last_active":"2024-09-17T03:08:29.229299+0000","last_peered":"2024-09-17T03:08:29.229299+0000","last_clean":"2024-09-17T03:08:29.229299+0000","last_became_active":"2024-09-17T03:08:28.245091+0000","last_became_peered":"2024-09-17T03:08:28.245091+0000","last_unstale":"2024-09-17T03:08:29.229299+0000","last_undegraded":"2024-09-17T03:08:29.229299+0000","last_fullsized":"2024-09-17T03:08:29.229299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:15.100672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230750+0000","last_change":"2024-09-17T03:08:28.244539+0000","last_active":"2024-09-17T03:08:30.230750+0000","last_peered":"2024-09-17T03:08:30.230750+0000","last_clean":"2024-09-17T03:08:30.230750+0000","last_became_active":"2024-09-17T03:08:28.244240+0000","last_became_peered":"2024-09-17T03:08:28.244240+0000","last_unstale":"2024-09-17T03:08:30.230750+0000","last_undegraded":"2024-09-17T03:08:30.230750+0000","last_fullsized":"2024-09-17T03:08:30.230750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:46.318120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.227040+0000","last_change":"2024-09-17T03:08:28.251521+0000","last_active":"2024-09-17T03:08:29.227040+0000","last_peered":"2024-09-17T03:08:29.227040+0000","last_clean":"2024-09-17T03:08:29.227040+0000","last_became_active":"2024-09-17T03:08:28.250298+0000","last_became_peered":"2024-09-17T03:08:28.250298+0000","last_unstale":"2024-09-17T03:08:29.227040+0000","last_undegraded":"2024-09-17T03:08:29.227040+0000","last_fullsized":"2024-09-17T03:08:29.227040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:16.379808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293430+0000","last_change":"2024-09-17T03:08:28.253949+0000","last_active":"2024-09-17T03:08:30.293430+0000","last_peered":"2024-09-17T03:08:30.293430+0000","last_clean":"2024-09-17T03:08:30.293430+0000","last_became_active":"2024-09-17T03:08:28.253392+0000","last_became_peered":"2024-09-17T03:08:28.253392+0000","last_unstale":"2024-09-17T03:08:30.293430+0000","last_undegraded":"2024-09-17T03:08:30.293430+0000","last_fullsized":"2024-09-17T03:08:30.293430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:47.772625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293974+0000","last_change":"2024-09-17T03:08:28.258249+0000","last_active":"2024-09-17T03:08:30.293974+0000","last_peered":"2024-09-17T03:08:30.293974+0000","last_clean":"2024-09-17T03:08:30.293974+0000","last_became_active":"2024-09-17T03:08:28.253257+0000","last_became_peered":"2024-09-17T03:08:28.253257+0000","last_unstale":"2024-09-17T03:08:30.293974+0000","last_undegraded":"2024-09-17T03:08:30.293974+0000","last_fullsized":"2024-09-17T03:08:30.293974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:53.331937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293150+0000","last_change":"2024-09-17T03:08:28.242530+0000","last_active":"2024-09-17T03:08:30.293150+0000","last_peered":"2024-09-17T03:08:30.293150+0000","last_clean":"2024-09-17T03:08:30.293150+0000","last_became_active":"2024-09-17T03:08:28.242194+0000","last_became_peered":"2024-09-17T03:08:28.242194+0000","last_unstale":"2024-09-17T03:08:30.293150+0000","last_undegraded":"2024-09-17T03:08:30.293150+0000","last_fullsized":"2024-09-17T03:08:30.293150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:43.917645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228598+0000","last_change":"2024-09-17T03:08:28.254404+0000","last_active":"2024-09-17T03:08:29.228598+0000","last_peered":"2024-09-17T03:08:29.228598+0000","last_clean":"2024-09-17T03:08:29.228598+0000","last_became_active":"2024-09-17T03:08:28.254120+0000","last_became_peered":"2024-09-17T03:08:28.254120+0000","last_unstale":"2024-09-17T03:08:29.228598+0000","last_undegraded":"2024-09-17T03:08:29.228598+0000","last_fullsized":"2024-09-17T03:08:29.228598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:31.089608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229224+0000","last_change":"2024-09-17T03:08:28.240464+0000","last_active":"2024-09-17T03:08:29.229224+0000","last_peered":"2024-09-17T03:08:29.229224+0000","last_clean":"2024-09-17T03:08:29.229224+0000","last_became_active":"2024-09-17T03:08:28.240126+0000","last_became_peered":"2024-09-17T03:08:28.240126+0000","last_unstale":"2024-09-17T03:08:29.229224+0000","last_undegraded":"2024-09-17T03:08:29.229224+0000","last_fullsized":"2024-09-17T03:08:29.229224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:45.234781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.227135+0000","last_change":"2024-09-17T03:08:27.237198+0000","last_active":"2024-09-17T03:08:29.227135+0000","last_peered":"2024-09-17T03:08:29.227135+0000","last_clean":"2024-09-17T03:08:29.227135+0000","last_became_active":"2024-09-17T03:08:27.236843+0000","last_became_peered":"2024-09-17T03:08:27.236843+0000","last_unstale":"2024-09-17T03:08:29.227135+0000","last_undegraded":"2024-09-17T03:08:29.227135+0000","last_fullsized":"2024-09-17T03:08:29.227135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:37:55.460562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293718+0000","last_change":"2024-09-17T03:08:28.253848+0000","last_active":"2024-09-17T03:08:30.293718+0000","last_peered":"2024-09-17T03:08:30.293718+0000","last_clean":"2024-09-17T03:08:30.293718+0000","last_became_active":"2024-09-17T03:08:28.253338+0000","last_became_peered":"2024-09-17T03:08:28.253338+0000","last_unstale":"2024-09-17T03:08:30.293718+0000","last_undegraded":"2024-09-17T03:08:30.293718+0000","last_fullsized":"2024-09-17T03:08:30.293718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:10.650757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228202+0000","last_change":"2024-09-17T03:08:27.234560+0000","last_active":"2024-09-17T03:08:29.228202+0000","last_peered":"2024-09-17T03:08:29.228202+0000","last_clean":"2024-09-17T03:08:29.228202+0000","last_became_active":"2024-09-17T03:08:27.234229+0000","last_became_peered":"2024-09-17T03:08:27.234229+0000","last_unstale":"2024-09-17T03:08:29.228202+0000","last_undegraded":"2024-09-17T03:08:29.228202+0000","last_fullsized":"2024-09-17T03:08:29.228202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:00.000708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226514+0000","last_change":"2024-09-17T03:08:27.235234+0000","last_active":"2024-09-17T03:08:29.226514+0000","last_peered":"2024-09-17T03:08:29.226514+0000","last_clean":"2024-09-17T03:08:29.226514+0000","last_became_active":"2024-09-17T03:08:27.234619+0000","last_became_peered":"2024-09-17T03:08:27.234619+0000","last_unstale":"2024-09-17T03:08:29.226514+0000","last_undegraded":"2024-09-17T03:08:29.226514+0000","last_fullsized":"2024-09-17T03:08:29.226514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:03.610472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226522+0000","last_change":"2024-09-17T03:08:28.254403+0000","last_active":"2024-09-17T03:08:29.226522+0000","last_peered":"2024-09-17T03:08:29.226522+0000","last_clean":"2024-09-17T03:08:29.226522+0000","last_became_active":"2024-09-17T03:08:28.254108+0000","last_became_peered":"2024-09-17T03:08:28.254108+0000","last_unstale":"2024-09-17T03:08:29.226522+0000","last_undegraded":"2024-09-17T03:08:29.226522+0000","last_fullsized":"2024-09-17T03:08:29.226522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:24.259968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293550+0000","last_change":"2024-09-17T03:08:27.243918+0000","last_active":"2024-09-17T03:08:30.293550+0000","last_peered":"2024-09-17T03:08:30.293550+0000","last_clean":"2024-09-17T03:08:30.293550+0000","last_became_active":"2024-09-17T03:08:27.243599+0000","last_became_peered":"2024-09-17T03:08:27.243599+0000","last_unstale":"2024-09-17T03:08:30.293550+0000","last_undegraded":"2024-09-17T03:08:30.293550+0000","last_fullsized":"2024-09-17T03:08:30.293550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:54.113120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230690+0000","last_change":"2024-09-17T03:08:28.244814+0000","last_active":"2024-09-17T03:08:30.230690+0000","last_peered":"2024-09-17T03:08:30.230690+0000","last_clean":"2024-09-17T03:08:30.230690+0000","last_became_active":"2024-09-17T03:08:28.244535+0000","last_became_peered":"2024-09-17T03:08:28.244535+0000","last_unstale":"2024-09-17T03:08:30.230690+0000","last_undegraded":"2024-09-17T03:08:30.230690+0000","last_fullsized":"2024-09-17T03:08:30.230690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:32.455387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229081+0000","last_change":"2024-09-17T03:08:27.236752+0000","last_active":"2024-09-17T03:08:29.229081+0000","last_peered":"2024-09-17T03:08:29.229081+0000","last_clean":"2024-09-17T03:08:29.229081+0000","last_became_active":"2024-09-17T03:08:27.235857+0000","last_became_peered":"2024-09-17T03:08:27.235857+0000","last_unstale":"2024-09-17T03:08:29.229081+0000","last_undegraded":"2024-09-17T03:08:29.229081+0000","last_fullsized":"2024-09-17T03:08:29.229081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:46.272871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293746+0000","last_change":"2024-09-17T03:08:28.250397+0000","last_active":"2024-09-17T03:08:30.293746+0000","last_peered":"2024-09-17T03:08:30.293746+0000","last_clean":"2024-09-17T03:08:30.293746+0000","last_became_active":"2024-09-17T03:08:28.250087+0000","last_became_peered":"2024-09-17T03:08:28.250087+0000","last_unstale":"2024-09-17T03:08:30.293746+0000","last_undegraded":"2024-09-17T03:08:30.293746+0000","last_fullsized":"2024-09-17T03:08:30.293746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:49.687506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293814+0000","last_change":"2024-09-17T03:08:27.239555+0000","last_active":"2024-09-17T03:08:30.293814+0000","last_peered":"2024-09-17T03:08:30.293814+0000","last_clean":"2024-09-17T03:08:30.293814+0000","last_became_active":"2024-09-17T03:08:27.239051+0000","last_became_peered":"2024-09-17T03:08:27.239051+0000","last_unstale":"2024-09-17T03:08:30.293814+0000","last_undegraded":"2024-09-17T03:08:30.293814+0000","last_fullsized":"2024-09-17T03:08:30.293814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:01.379072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293660+0000","last_change":"2024-09-17T03:08:28.259335+0000","last_active":"2024-09-17T03:08:30.293660+0000","last_peered":"2024-09-17T03:08:30.293660+0000","last_clean":"2024-09-17T03:08:30.293660+0000","last_became_active":"2024-09-17T03:08:28.259026+0000","last_became_peered":"2024-09-17T03:08:28.259026+0000","last_unstale":"2024-09-17T03:08:30.293660+0000","last_undegraded":"2024-09-17T03:08:30.293660+0000","last_fullsized":"2024-09-17T03:08:30.293660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:33:49.370247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230846+0000","last_change":"2024-09-17T03:08:27.240839+0000","last_active":"2024-09-17T03:08:30.230846+0000","last_peered":"2024-09-17T03:08:30.230846+0000","last_clean":"2024-09-17T03:08:30.230846+0000","last_became_active":"2024-09-17T03:08:27.240389+0000","last_became_peered":"2024-09-17T03:08:27.240389+0000","last_unstale":"2024-09-17T03:08:30.230846+0000","last_undegraded":"2024-09-17T03:08:30.230846+0000","last_fullsized":"2024-09-17T03:08:30.230846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:13.374584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228399+0000","last_change":"2024-09-17T03:08:28.243850+0000","last_active":"2024-09-17T03:08:29.228399+0000","last_peered":"2024-09-17T03:08:29.228399+0000","last_clean":"2024-09-17T03:08:29.228399+0000","last_became_active":"2024-09-17T03:08:28.243516+0000","last_became_peered":"2024-09-17T03:08:28.243516+0000","last_unstale":"2024-09-17T03:08:29.228399+0000","last_undegraded":"2024-09-17T03:08:29.228399+0000","last_fullsized":"2024-09-17T03:08:29.228399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:02.105667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228627+0000","last_change":"2024-09-17T03:08:27.233543+0000","last_active":"2024-09-17T03:08:29.228627+0000","last_peered":"2024-09-17T03:08:29.228627+0000","last_clean":"2024-09-17T03:08:29.228627+0000","last_became_active":"2024-09-17T03:08:27.233120+0000","last_became_peered":"2024-09-17T03:08:27.233120+0000","last_unstale":"2024-09-17T03:08:29.228627+0000","last_undegraded":"2024-09-17T03:08:29.228627+0000","last_fullsized":"2024-09-17T03:08:29.228627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:49.898610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100513+0000","last_change":"2024-09-17T03:08:28.249563+0000","last_active":"2024-09-17T03:08:30.100513+0000","last_peered":"2024-09-17T03:08:30.100513+0000","last_clean":"2024-09-17T03:08:30.100513+0000","last_became_active":"2024-09-17T03:08:28.248913+0000","last_became_peered":"2024-09-17T03:08:28.248913+0000","last_unstale":"2024-09-17T03:08:30.100513+0000","last_undegraded":"2024-09-17T03:08:30.100513+0000","last_fullsized":"2024-09-17T03:08:30.100513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:04.018212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293675+0000","last_change":"2024-09-17T03:08:27.238166+0000","last_active":"2024-09-17T03:08:30.293675+0000","last_peered":"2024-09-17T03:08:30.293675+0000","last_clean":"2024-09-17T03:08:30.293675+0000","last_became_active":"2024-09-17T03:08:27.237602+0000","last_became_peered":"2024-09-17T03:08:27.237602+0000","last_unstale":"2024-09-17T03:08:30.293675+0000","last_undegraded":"2024-09-17T03:08:30.293675+0000","last_fullsized":"2024-09-17T03:08:30.293675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:53.340728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293088+0000","last_change":"2024-09-17T03:08:28.248412+0000","last_active":"2024-09-17T03:08:30.293088+0000","last_peered":"2024-09-17T03:08:30.293088+0000","last_clean":"2024-09-17T03:08:30.293088+0000","last_became_active":"2024-09-17T03:08:28.248075+0000","last_became_peered":"2024-09-17T03:08:28.248075+0000","last_unstale":"2024-09-17T03:08:30.293088+0000","last_undegraded":"2024-09-17T03:08:30.293088+0000","last_fullsized":"2024-09-17T03:08:30.293088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:49.394898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293581+0000","last_change":"2024-09-17T03:08:27.242493+0000","last_active":"2024-09-17T03:08:30.293581+0000","last_peered":"2024-09-17T03:08:30.293581+0000","last_clean":"2024-09-17T03:08:30.293581+0000","last_became_active":"2024-09-17T03:08:27.242234+0000","last_became_peered":"2024-09-17T03:08:27.242234+0000","last_unstale":"2024-09-17T03:08:30.293581+0000","last_undegraded":"2024-09-17T03:08:30.293581+0000","last_fullsized":"2024-09-17T03:08:30.293581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:06.000335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100522+0000","last_change":"2024-09-17T03:08:28.254369+0000","last_active":"2024-09-17T03:08:30.100522+0000","last_peered":"2024-09-17T03:08:30.100522+0000","last_clean":"2024-09-17T03:08:30.100522+0000","last_became_active":"2024-09-17T03:08:28.253975+0000","last_became_peered":"2024-09-17T03:08:28.253975+0000","last_unstale":"2024-09-17T03:08:30.100522+0000","last_undegraded":"2024-09-17T03:08:30.100522+0000","last_fullsized":"2024-09-17T03:08:30.100522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:49.687506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228261+0000","last_change":"2024-09-17T03:08:27.235168+0000","last_active":"2024-09-17T03:08:29.228261+0000","last_peered":"2024-09-17T03:08:29.228261+0000","last_clean":"2024-09-17T03:08:29.228261+0000","last_became_active":"2024-09-17T03:08:27.234834+0000","last_became_peered":"2024-09-17T03:08:27.234834+0000","last_unstale":"2024-09-17T03:08:29.228261+0000","last_undegraded":"2024-09-17T03:08:29.228261+0000","last_fullsized":"2024-09-17T03:08:29.228261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:49.599813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228186+0000","last_change":"2024-09-17T03:08:28.253542+0000","last_active":"2024-09-17T03:08:29.228186+0000","last_peered":"2024-09-17T03:08:29.228186+0000","last_clean":"2024-09-17T03:08:29.228186+0000","last_became_active":"2024-09-17T03:08:28.253220+0000","last_became_peered":"2024-09-17T03:08:28.253220+0000","last_unstale":"2024-09-17T03:08:29.228186+0000","last_undegraded":"2024-09-17T03:08:29.228186+0000","last_fullsized":"2024-09-17T03:08:29.228186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:28.459370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293108+0000","last_change":"2024-09-17T03:08:27.235156+0000","last_active":"2024-09-17T03:08:30.293108+0000","last_peered":"2024-09-17T03:08:30.293108+0000","last_clean":"2024-09-17T03:08:30.293108+0000","last_became_active":"2024-09-17T03:08:27.234841+0000","last_became_peered":"2024-09-17T03:08:27.234841+0000","last_unstale":"2024-09-17T03:08:30.293108+0000","last_undegraded":"2024-09-17T03:08:30.293108+0000","last_fullsized":"2024-09-17T03:08:30.293108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:16.837042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100424+0000","last_change":"2024-09-17T03:08:28.250970+0000","last_active":"2024-09-17T03:08:30.100424+0000","last_peered":"2024-09-17T03:08:30.100424+0000","last_clean":"2024-09-17T03:08:30.100424+0000","last_became_active":"2024-09-17T03:08:28.250653+0000","last_became_peered":"2024-09-17T03:08:28.250653+0000","last_unstale":"2024-09-17T03:08:30.100424+0000","last_undegraded":"2024-09-17T03:08:30.100424+0000","last_fullsized":"2024-09-17T03:08:30.100424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:04.627763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229443+0000","last_change":"2024-09-17T03:08:27.239830+0000","last_active":"2024-09-17T03:08:29.229443+0000","last_peered":"2024-09-17T03:08:29.229443+0000","last_clean":"2024-09-17T03:08:29.229443+0000","last_became_active":"2024-09-17T03:08:27.239481+0000","last_became_peered":"2024-09-17T03:08:27.239481+0000","last_unstale":"2024-09-17T03:08:29.229443+0000","last_undegraded":"2024-09-17T03:08:29.229443+0000","last_fullsized":"2024-09-17T03:08:29.229443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:33:35.844983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100795+0000","last_change":"2024-09-17T03:08:28.252808+0000","last_active":"2024-09-17T03:08:30.100795+0000","last_peered":"2024-09-17T03:08:30.100795+0000","last_clean":"2024-09-17T03:08:30.100795+0000","last_became_active":"2024-09-17T03:08:28.251890+0000","last_became_peered":"2024-09-17T03:08:28.251890+0000","last_unstale":"2024-09-17T03:08:30.100795+0000","last_undegraded":"2024-09-17T03:08:30.100795+0000","last_fullsized":"2024-09-17T03:08:30.100795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:53.331937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.292969+0000","last_change":"2024-09-17T03:08:27.234272+0000","last_active":"2024-09-17T03:08:30.292969+0000","last_peered":"2024-09-17T03:08:30.292969+0000","last_clean":"2024-09-17T03:08:30.292969+0000","last_became_active":"2024-09-17T03:08:27.233923+0000","last_became_peered":"2024-09-17T03:08:27.233923+0000","last_unstale":"2024-09-17T03:08:30.292969+0000","last_undegraded":"2024-09-17T03:08:30.292969+0000","last_fullsized":"2024-09-17T03:08:30.292969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:06.000335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.101081+0000","last_change":"2024-09-17T03:08:28.250706+0000","last_active":"2024-09-17T03:08:30.101081+0000","last_peered":"2024-09-17T03:08:30.101081+0000","last_clean":"2024-09-17T03:08:30.101081+0000","last_became_active":"2024-09-17T03:08:28.250367+0000","last_became_peered":"2024-09-17T03:08:28.250367+0000","last_unstale":"2024-09-17T03:08:30.101081+0000","last_undegraded":"2024-09-17T03:08:30.101081+0000","last_fullsized":"2024-09-17T03:08:30.101081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:42.809585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230875+0000","last_change":"2024-09-17T03:08:27.227624+0000","last_active":"2024-09-17T03:08:30.230875+0000","last_peered":"2024-09-17T03:08:30.230875+0000","last_clean":"2024-09-17T03:08:30.230875+0000","last_became_active":"2024-09-17T03:08:27.227272+0000","last_became_peered":"2024-09-17T03:08:27.227272+0000","last_unstale":"2024-09-17T03:08:30.230875+0000","last_undegraded":"2024-09-17T03:08:30.230875+0000","last_fullsized":"2024-09-17T03:08:30.230875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:40.068941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293879+0000","last_change":"2024-09-17T03:08:28.255711+0000","last_active":"2024-09-17T03:08:30.293879+0000","last_peered":"2024-09-17T03:08:30.293879+0000","last_clean":"2024-09-17T03:08:30.293879+0000","last_became_active":"2024-09-17T03:08:28.252986+0000","last_became_peered":"2024-09-17T03:08:28.252986+0000","last_unstale":"2024-09-17T03:08:30.293879+0000","last_undegraded":"2024-09-17T03:08:30.293879+0000","last_fullsized":"2024-09-17T03:08:30.293879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:48.623610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293439+0000","last_change":"2024-09-17T03:08:27.239700+0000","last_active":"2024-09-17T03:08:30.293439+0000","last_peered":"2024-09-17T03:08:30.293439+0000","last_clean":"2024-09-17T03:08:30.293439+0000","last_became_active":"2024-09-17T03:08:27.239372+0000","last_became_peered":"2024-09-17T03:08:27.239372+0000","last_unstale":"2024-09-17T03:08:30.293439+0000","last_undegraded":"2024-09-17T03:08:30.293439+0000","last_fullsized":"2024-09-17T03:08:30.293439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:01.379072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100531+0000","last_change":"2024-09-17T03:08:28.252014+0000","last_active":"2024-09-17T03:08:30.100531+0000","last_peered":"2024-09-17T03:08:30.100531+0000","last_clean":"2024-09-17T03:08:30.100531+0000","last_became_active":"2024-09-17T03:08:28.250240+0000","last_became_peered":"2024-09-17T03:08:28.250240+0000","last_unstale":"2024-09-17T03:08:30.100531+0000","last_undegraded":"2024-09-17T03:08:30.100531+0000","last_fullsized":"2024-09-17T03:08:30.100531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:27.579756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100182+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:08:30.100182+0000","last_peered":"2024-09-17T03:08:30.100182+0000","last_clean":"2024-09-17T03:08:30.100182+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:08:30.100182+0000","last_undegraded":"2024-09-17T03:08:30.100182+0000","last_fullsized":"2024-09-17T03:08:30.100182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293225+0000","last_change":"2024-09-17T03:08:27.241373+0000","last_active":"2024-09-17T03:08:30.293225+0000","last_peered":"2024-09-17T03:08:30.293225+0000","last_clean":"2024-09-17T03:08:30.293225+0000","last_became_active":"2024-09-17T03:08:27.240394+0000","last_became_peered":"2024-09-17T03:08:27.240394+0000","last_unstale":"2024-09-17T03:08:30.293225+0000","last_undegraded":"2024-09-17T03:08:30.293225+0000","last_fullsized":"2024-09-17T03:08:30.293225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:37.172953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226720+0000","last_change":"2024-09-17T03:08:28.262359+0000","last_active":"2024-09-17T03:08:29.226720+0000","last_peered":"2024-09-17T03:08:29.226720+0000","last_clean":"2024-09-17T03:08:29.226720+0000","last_became_active":"2024-09-17T03:08:28.262020+0000","last_became_peered":"2024-09-17T03:08:28.262020+0000","last_unstale":"2024-09-17T03:08:29.226720+0000","last_undegraded":"2024-09-17T03:08:29.226720+0000","last_fullsized":"2024-09-17T03:08:29.226720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:09.171993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.099995+0000","last_change":"2024-09-17T03:08:27.244435+0000","last_active":"2024-09-17T03:08:30.099995+0000","last_peered":"2024-09-17T03:08:30.099995+0000","last_clean":"2024-09-17T03:08:30.099995+0000","last_became_active":"2024-09-17T03:08:27.243833+0000","last_became_peered":"2024-09-17T03:08:27.243833+0000","last_unstale":"2024-09-17T03:08:30.099995+0000","last_undegraded":"2024-09-17T03:08:30.099995+0000","last_fullsized":"2024-09-17T03:08:30.099995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:09.601815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.292828+0000","last_change":"2024-09-17T03:08:28.251066+0000","last_active":"2024-09-17T03:08:30.292828+0000","last_peered":"2024-09-17T03:08:30.292828+0000","last_clean":"2024-09-17T03:08:30.292828+0000","last_became_active":"2024-09-17T03:08:28.250555+0000","last_became_peered":"2024-09-17T03:08:28.250555+0000","last_unstale":"2024-09-17T03:08:30.292828+0000","last_undegraded":"2024-09-17T03:08:30.292828+0000","last_fullsized":"2024-09-17T03:08:30.292828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:41.542823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293285+0000","last_change":"2024-09-17T03:08:27.231665+0000","last_active":"2024-09-17T03:08:30.293285+0000","last_peered":"2024-09-17T03:08:30.293285+0000","last_clean":"2024-09-17T03:08:30.293285+0000","last_became_active":"2024-09-17T03:08:27.231326+0000","last_became_peered":"2024-09-17T03:08:27.231326+0000","last_unstale":"2024-09-17T03:08:30.293285+0000","last_undegraded":"2024-09-17T03:08:30.293285+0000","last_fullsized":"2024-09-17T03:08:30.293285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:40.068941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230630+0000","last_change":"2024-09-17T03:08:28.242273+0000","last_active":"2024-09-17T03:08:30.230630+0000","last_peered":"2024-09-17T03:08:30.230630+0000","last_clean":"2024-09-17T03:08:30.230630+0000","last_became_active":"2024-09-17T03:08:28.241745+0000","last_became_peered":"2024-09-17T03:08:28.241745+0000","last_unstale":"2024-09-17T03:08:30.230630+0000","last_undegraded":"2024-09-17T03:08:30.230630+0000","last_fullsized":"2024-09-17T03:08:30.230630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:47.772625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293927+0000","last_change":"2024-09-17T03:08:27.246886+0000","last_active":"2024-09-17T03:08:30.293927+0000","last_peered":"2024-09-17T03:08:30.293927+0000","last_clean":"2024-09-17T03:08:30.293927+0000","last_became_active":"2024-09-17T03:08:27.246549+0000","last_became_peered":"2024-09-17T03:08:27.246549+0000","last_unstale":"2024-09-17T03:08:30.293927+0000","last_undegraded":"2024-09-17T03:08:30.293927+0000","last_fullsized":"2024-09-17T03:08:30.293927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:54.447491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229198+0000","last_change":"2024-09-17T03:08:28.256574+0000","last_active":"2024-09-17T03:08:29.229198+0000","last_peered":"2024-09-17T03:08:29.229198+0000","last_clean":"2024-09-17T03:08:29.229198+0000","last_became_active":"2024-09-17T03:08:28.255700+0000","last_became_peered":"2024-09-17T03:08:28.255700+0000","last_unstale":"2024-09-17T03:08:29.229198+0000","last_undegraded":"2024-09-17T03:08:29.229198+0000","last_fullsized":"2024-09-17T03:08:29.229198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:51.178653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230655+0000","last_change":"2024-09-17T03:08:27.239229+0000","last_active":"2024-09-17T03:08:30.230655+0000","last_peered":"2024-09-17T03:08:30.230655+0000","last_clean":"2024-09-17T03:08:30.230655+0000","last_became_active":"2024-09-17T03:08:27.238923+0000","last_became_peered":"2024-09-17T03:08:27.238923+0000","last_unstale":"2024-09-17T03:08:30.230655+0000","last_undegraded":"2024-09-17T03:08:30.230655+0000","last_fullsized":"2024-09-17T03:08:30.230655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:01.379072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293818+0000","last_change":"2024-09-17T03:08:28.255621+0000","last_active":"2024-09-17T03:08:30.293818+0000","last_peered":"2024-09-17T03:08:30.293818+0000","last_clean":"2024-09-17T03:08:30.293818+0000","last_became_active":"2024-09-17T03:08:28.255238+0000","last_became_peered":"2024-09-17T03:08:28.255238+0000","last_unstale":"2024-09-17T03:08:30.293818+0000","last_undegraded":"2024-09-17T03:08:30.293818+0000","last_fullsized":"2024-09-17T03:08:30.293818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:27.579756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100826+0000","last_change":"2024-09-17T03:08:27.244240+0000","last_active":"2024-09-17T03:08:30.100826+0000","last_peered":"2024-09-17T03:08:30.100826+0000","last_clean":"2024-09-17T03:08:30.100826+0000","last_became_active":"2024-09-17T03:08:27.243875+0000","last_became_peered":"2024-09-17T03:08:27.243875+0000","last_unstale":"2024-09-17T03:08:30.100826+0000","last_undegraded":"2024-09-17T03:08:30.100826+0000","last_fullsized":"2024-09-17T03:08:30.100826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:22.964776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230744+0000","last_change":"2024-09-17T03:08:28.244841+0000","last_active":"2024-09-17T03:08:30.230744+0000","last_peered":"2024-09-17T03:08:30.230744+0000","last_clean":"2024-09-17T03:08:30.230744+0000","last_became_active":"2024-09-17T03:08:28.244270+0000","last_became_peered":"2024-09-17T03:08:28.244270+0000","last_unstale":"2024-09-17T03:08:30.230744+0000","last_undegraded":"2024-09-17T03:08:30.230744+0000","last_fullsized":"2024-09-17T03:08:30.230744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:33:49.370247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.232271+0000","last_change":"2024-09-17T03:08:27.233708+0000","last_active":"2024-09-17T03:08:30.232271+0000","last_peered":"2024-09-17T03:08:30.232271+0000","last_clean":"2024-09-17T03:08:30.232271+0000","last_became_active":"2024-09-17T03:08:27.233372+0000","last_became_peered":"2024-09-17T03:08:27.233372+0000","last_unstale":"2024-09-17T03:08:30.232271+0000","last_undegraded":"2024-09-17T03:08:30.232271+0000","last_fullsized":"2024-09-17T03:08:30.232271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:54.447491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226938+0000","last_change":"2024-09-17T03:08:28.250727+0000","last_active":"2024-09-17T03:08:29.226938+0000","last_peered":"2024-09-17T03:08:29.226938+0000","last_clean":"2024-09-17T03:08:29.226938+0000","last_became_active":"2024-09-17T03:08:28.250399+0000","last_became_peered":"2024-09-17T03:08:28.250399+0000","last_unstale":"2024-09-17T03:08:29.226938+0000","last_undegraded":"2024-09-17T03:08:29.226938+0000","last_fullsized":"2024-09-17T03:08:29.226938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:27.379811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229217+0000","last_change":"2024-09-17T03:08:27.237826+0000","last_active":"2024-09-17T03:08:29.229217+0000","last_peered":"2024-09-17T03:08:29.229217+0000","last_clean":"2024-09-17T03:08:29.229217+0000","last_became_active":"2024-09-17T03:08:27.237278+0000","last_became_peered":"2024-09-17T03:08:27.237278+0000","last_unstale":"2024-09-17T03:08:29.229217+0000","last_undegraded":"2024-09-17T03:08:29.229217+0000","last_fullsized":"2024-09-17T03:08:29.229217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:54.762062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293785+0000","last_change":"2024-09-17T03:08:28.248479+0000","last_active":"2024-09-17T03:08:30.293785+0000","last_peered":"2024-09-17T03:08:30.293785+0000","last_clean":"2024-09-17T03:08:30.293785+0000","last_became_active":"2024-09-17T03:08:28.248131+0000","last_became_peered":"2024-09-17T03:08:28.248131+0000","last_unstale":"2024-09-17T03:08:30.293785+0000","last_undegraded":"2024-09-17T03:08:30.293785+0000","last_fullsized":"2024-09-17T03:08:30.293785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:58.189179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.099980+0000","last_change":"2024-09-17T03:08:27.241677+0000","last_active":"2024-09-17T03:08:30.099980+0000","last_peered":"2024-09-17T03:08:30.099980+0000","last_clean":"2024-09-17T03:08:30.099980+0000","last_became_active":"2024-09-17T03:08:27.241334+0000","last_became_peered":"2024-09-17T03:08:27.241334+0000","last_unstale":"2024-09-17T03:08:30.099980+0000","last_undegraded":"2024-09-17T03:08:30.099980+0000","last_fullsized":"2024-09-17T03:08:30.099980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:01.099757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228778+0000","last_change":"2024-09-17T03:08:28.237275+0000","last_active":"2024-09-17T03:08:29.228778+0000","last_peered":"2024-09-17T03:08:29.228778+0000","last_clean":"2024-09-17T03:08:29.228778+0000","last_became_active":"2024-09-17T03:08:28.236973+0000","last_became_peered":"2024-09-17T03:08:28.236973+0000","last_unstale":"2024-09-17T03:08:29.228778+0000","last_undegraded":"2024-09-17T03:08:29.228778+0000","last_fullsized":"2024-09-17T03:08:29.228778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:38.240738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230822+0000","last_change":"2024-09-17T03:08:27.238083+0000","last_active":"2024-09-17T03:08:30.230822+0000","last_peered":"2024-09-17T03:08:30.230822+0000","last_clean":"2024-09-17T03:08:30.230822+0000","last_became_active":"2024-09-17T03:08:27.237734+0000","last_became_peered":"2024-09-17T03:08:27.237734+0000","last_unstale":"2024-09-17T03:08:30.230822+0000","last_undegraded":"2024-09-17T03:08:30.230822+0000","last_fullsized":"2024-09-17T03:08:30.230822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:54.113120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226699+0000","last_change":"2024-09-17T03:08:28.240568+0000","last_active":"2024-09-17T03:08:29.226699+0000","last_peered":"2024-09-17T03:08:29.226699+0000","last_clean":"2024-09-17T03:08:29.226699+0000","last_became_active":"2024-09-17T03:08:28.240266+0000","last_became_peered":"2024-09-17T03:08:28.240266+0000","last_unstale":"2024-09-17T03:08:29.226699+0000","last_undegraded":"2024-09-17T03:08:29.226699+0000","last_fullsized":"2024-09-17T03:08:29.226699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:11.049096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230817+0000","last_change":"2024-09-17T03:08:27.229679+0000","last_active":"2024-09-17T03:08:30.230817+0000","last_peered":"2024-09-17T03:08:30.230817+0000","last_clean":"2024-09-17T03:08:30.230817+0000","last_became_active":"2024-09-17T03:08:27.229368+0000","last_became_peered":"2024-09-17T03:08:27.229368+0000","last_unstale":"2024-09-17T03:08:30.230817+0000","last_undegraded":"2024-09-17T03:08:30.230817+0000","last_fullsized":"2024-09-17T03:08:30.230817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:33.251896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.227133+0000","last_change":"2024-09-17T03:08:28.258420+0000","last_active":"2024-09-17T03:08:29.227133+0000","last_peered":"2024-09-17T03:08:29.227133+0000","last_clean":"2024-09-17T03:08:29.227133+0000","last_became_active":"2024-09-17T03:08:28.258108+0000","last_became_peered":"2024-09-17T03:08:28.258108+0000","last_unstale":"2024-09-17T03:08:29.227133+0000","last_undegraded":"2024-09-17T03:08:29.227133+0000","last_fullsized":"2024-09-17T03:08:29.227133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:36.707700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100794+0000","last_change":"2024-09-17T03:08:27.241586+0000","last_active":"2024-09-17T03:08:30.100794+0000","last_peered":"2024-09-17T03:08:30.100794+0000","last_clean":"2024-09-17T03:08:30.100794+0000","last_became_active":"2024-09-17T03:08:27.241222+0000","last_became_peered":"2024-09-17T03:08:27.241222+0000","last_unstale":"2024-09-17T03:08:30.100794+0000","last_undegraded":"2024-09-17T03:08:30.100794+0000","last_fullsized":"2024-09-17T03:08:30.100794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:50.172743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228469+0000","last_change":"2024-09-17T03:08:28.235146+0000","last_active":"2024-09-17T03:08:29.228469+0000","last_peered":"2024-09-17T03:08:29.228469+0000","last_clean":"2024-09-17T03:08:29.228469+0000","last_became_active":"2024-09-17T03:08:28.234806+0000","last_became_peered":"2024-09-17T03:08:28.234806+0000","last_unstale":"2024-09-17T03:08:29.228469+0000","last_undegraded":"2024-09-17T03:08:29.228469+0000","last_fullsized":"2024-09-17T03:08:29.228469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:17.510396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293767+0000","last_change":"2024-09-17T03:08:28.248874+0000","last_active":"2024-09-17T03:08:30.293767+0000","last_peered":"2024-09-17T03:08:30.293767+0000","last_clean":"2024-09-17T03:08:30.293767+0000","last_became_active":"2024-09-17T03:08:28.248556+0000","last_became_peered":"2024-09-17T03:08:28.248556+0000","last_unstale":"2024-09-17T03:08:30.293767+0000","last_undegraded":"2024-09-17T03:08:30.293767+0000","last_fullsized":"2024-09-17T03:08:30.293767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:54.201357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100250+0000","last_change":"2024-09-17T03:08:27.246359+0000","last_active":"2024-09-17T03:08:30.100250+0000","last_peered":"2024-09-17T03:08:30.100250+0000","last_clean":"2024-09-17T03:08:30.100250+0000","last_became_active":"2024-09-17T03:08:27.246057+0000","last_became_peered":"2024-09-17T03:08:27.246057+0000","last_unstale":"2024-09-17T03:08:30.100250+0000","last_undegraded":"2024-09-17T03:08:30.100250+0000","last_fullsized":"2024-09-17T03:08:30.100250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:37.234828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293628+0000","last_change":"2024-09-17T03:08:28.252494+0000","last_active":"2024-09-17T03:08:30.293628+0000","last_peered":"2024-09-17T03:08:30.293628+0000","last_clean":"2024-09-17T03:08:30.293628+0000","last_became_active":"2024-09-17T03:08:28.252160+0000","last_became_peered":"2024-09-17T03:08:28.252160+0000","last_unstale":"2024-09-17T03:08:30.293628+0000","last_undegraded":"2024-09-17T03:08:30.293628+0000","last_fullsized":"2024-09-17T03:08:30.293628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:04.627763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100672+0000","last_change":"2024-09-17T03:08:27.244060+0000","last_active":"2024-09-17T03:08:30.100672+0000","last_peered":"2024-09-17T03:08:30.100672+0000","last_clean":"2024-09-17T03:08:30.100672+0000","last_became_active":"2024-09-17T03:08:27.243722+0000","last_became_peered":"2024-09-17T03:08:27.243722+0000","last_unstale":"2024-09-17T03:08:30.100672+0000","last_undegraded":"2024-09-17T03:08:30.100672+0000","last_fullsized":"2024-09-17T03:08:30.100672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:44.228871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293443+0000","last_change":"2024-09-17T03:08:28.259408+0000","last_active":"2024-09-17T03:08:30.293443+0000","last_peered":"2024-09-17T03:08:30.293443+0000","last_clean":"2024-09-17T03:08:30.293443+0000","last_became_active":"2024-09-17T03:08:28.259101+0000","last_became_peered":"2024-09-17T03:08:28.259101+0000","last_unstale":"2024-09-17T03:08:30.293443+0000","last_undegraded":"2024-09-17T03:08:30.293443+0000","last_fullsized":"2024-09-17T03:08:30.293443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:05.501480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226814+0000","last_change":"2024-09-17T03:08:27.239362+0000","last_active":"2024-09-17T03:08:29.226814+0000","last_peered":"2024-09-17T03:08:29.226814+0000","last_clean":"2024-09-17T03:08:29.226814+0000","last_became_active":"2024-09-17T03:08:27.238941+0000","last_became_peered":"2024-09-17T03:08:27.238941+0000","last_unstale":"2024-09-17T03:08:29.226814+0000","last_undegraded":"2024-09-17T03:08:29.226814+0000","last_fullsized":"2024-09-17T03:08:29.226814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:29.377537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226806+0000","last_change":"2024-09-17T03:08:28.252681+0000","last_active":"2024-09-17T03:08:29.226806+0000","last_peered":"2024-09-17T03:08:29.226806+0000","last_clean":"2024-09-17T03:08:29.226806+0000","last_became_active":"2024-09-17T03:08:28.252248+0000","last_became_peered":"2024-09-17T03:08:28.252248+0000","last_unstale":"2024-09-17T03:08:29.226806+0000","last_undegraded":"2024-09-17T03:08:29.226806+0000","last_fullsized":"2024-09-17T03:08:29.226806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:54.411712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293659+0000","last_change":"2024-09-17T03:08:27.237660+0000","last_active":"2024-09-17T03:08:30.293659+0000","last_peered":"2024-09-17T03:08:30.293659+0000","last_clean":"2024-09-17T03:08:30.293659+0000","last_became_active":"2024-09-17T03:08:27.237311+0000","last_became_peered":"2024-09-17T03:08:27.237311+0000","last_unstale":"2024-09-17T03:08:30.293659+0000","last_undegraded":"2024-09-17T03:08:30.293659+0000","last_fullsized":"2024-09-17T03:08:30.293659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:00.697522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":831488,"data_stored":673057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":83719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":82197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":82233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":82107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":82267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":673113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":245760,"data_stored":83719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:08:40.502 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:08:40.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.650+0000 7f049767f640 1 -- 172.21.15.78:0/2636821241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04901600b0 msgr2=0x7f04900ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.650+0000 7f049767f640 1 --2- 172.21.15.78:0/2636821241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04901600b0 0x7f04900ccbc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0490074af0 tx=0x7f048c02a9d0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.650+0000 7f049767f640 1 -- 172.21.15.78:0/2636821241 shutdown_connections 2024-09-17T03:08:40.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.650+0000 7f049767f640 1 --2- 172.21.15.78:0/2636821241 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f04900cf320 0x7f04900d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.650+0000 7f049767f640 1 --2- 172.21.15.78:0/2636821241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04901600b0 0x7f04900ccbc0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.650+0000 7f049767f640 1 -- 172.21.15.78:0/2636821241 >> 172.21.15.78:0/2636821241 conn(0x7f049006d4f0 msgr2=0x7f0490071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:40.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.650+0000 7f049767f640 1 -- 172.21.15.78:0/2636821241 shutdown_connections 2024-09-17T03:08:40.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.650+0000 7f049767f640 1 -- 172.21.15.78:0/2636821241 wait complete. 2024-09-17T03:08:40.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.651+0000 7f049767f640 1 Processor -- start 2024-09-17T03:08:40.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.652+0000 7f049767f640 1 -- start start 2024-09-17T03:08:40.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.653+0000 7f049767f640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f04900b7cc0 0x7f049014d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:40.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.653+0000 7f049767f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04900cf320 0x7f04901f7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:40.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.653+0000 7f049767f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04901600b0 0x7f04901f7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:40.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.653+0000 7f049767f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f04900d1410 con 0x7f04901600b0 2024-09-17T03:08:40.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.653+0000 7f049767f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f04900d1290 con 0x7f04900cf320 2024-09-17T03:08:40.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.653+0000 7f049767f640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f04900d1590 con 0x7f04900b7cc0 2024-09-17T03:08:40.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.653+0000 7f0495c1c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04901600b0 0x7f04901f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:40.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.653+0000 7f0495c1c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04901600b0 0x7f04901f7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34394/0 (socket says 172.21.15.78:34394) 2024-09-17T03:08:40.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.653+0000 7f0495c1c640 1 -- 172.21.15.78:0/2383054864 learned_addr learned my addr 172.21.15.78:0/2383054864 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:40.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.653+0000 7f049541b640 1 --2- 172.21.15.78:0/2383054864 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f04900b7cc0 0x7f049014d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:40.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.653+0000 7f0494c1a640 1 --2- 172.21.15.78:0/2383054864 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04900cf320 0x7f04901f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:40.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.653+0000 7f0495c1c640 1 -- 172.21.15.78:0/2383054864 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f04900b7cc0 msgr2=0x7f049014d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.653+0000 7f0495c1c640 1 --2- 172.21.15.78:0/2383054864 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f04900b7cc0 0x7f049014d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.653+0000 7f0495c1c640 1 -- 172.21.15.78:0/2383054864 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04900cf320 msgr2=0x7f04901f7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.653+0000 7f0495c1c640 1 --2- 172.21.15.78:0/2383054864 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04900cf320 0x7f04901f7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.653+0000 7f0495c1c640 1 -- 172.21.15.78:0/2383054864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04900c9520 con 0x7f04901600b0 2024-09-17T03:08:40.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.653+0000 7f0495c1c640 1 --2- 172.21.15.78:0/2383054864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04901600b0 0x7f04901f7960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f048800c770 tx=0x7f048800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:40.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.653+0000 7f0485ffb640 1 -- 172.21.15.78:0/2383054864 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488007bb0 con 0x7f04901600b0 2024-09-17T03:08:40.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.654+0000 7f0485ffb640 1 -- 172.21.15.78:0/2383054864 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0488007e40 con 0x7f04901600b0 2024-09-17T03:08:40.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.654+0000 7f049767f640 1 -- 172.21.15.78:0/2383054864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04900c9800 con 0x7f04901600b0 2024-09-17T03:08:40.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.654+0000 7f0485ffb640 1 -- 172.21.15.78:0/2383054864 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488005280 con 0x7f04901600b0 2024-09-17T03:08:40.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.654+0000 7f049767f640 1 -- 172.21.15.78:0/2383054864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f049014dcd0 con 0x7f04901600b0 2024-09-17T03:08:40.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.655+0000 7f049767f640 1 -- 172.21.15.78:0/2383054864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04900d1b20 con 0x7f04901600b0 2024-09-17T03:08:40.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.655+0000 7f0485ffb640 1 -- 172.21.15.78:0/2383054864 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0488005420 con 0x7f04901600b0 2024-09-17T03:08:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.656+0000 7f0485ffb640 1 --2- 172.21.15.78:0/2383054864 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0474078bc0 0x7f047407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.656+0000 7f0485ffb640 1 -- 172.21.15.78:0/2383054864 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f048809afc0 con 0x7f04901600b0 2024-09-17T03:08:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.656+0000 7f049541b640 1 --2- 172.21.15.78:0/2383054864 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0474078bc0 0x7f047407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.656+0000 7f049541b640 1 --2- 172.21.15.78:0/2383054864 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0474078bc0 0x7f047407b0d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f048c035000 tx=0x7f048c03b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:40.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.660+0000 7f0485ffb640 1 -- 172.21.15.78:0/2383054864 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0488014030 con 0x7f04901600b0 2024-09-17T03:08:40.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.832+0000 7f049767f640 1 -- 172.21.15.78:0/2383054864 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f04901f7f40 con 0x7f0474078bc0 2024-09-17T03:08:40.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.836+0000 7f0485ffb640 1 -- 172.21.15.78:0/2383054864 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f04901f7f40 con 0x7f0474078bc0 2024-09-17T03:08:40.838 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:40.840 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:08:40.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.839+0000 7f049767f640 1 -- 172.21.15.78:0/2383054864 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0474078bc0 msgr2=0x7f047407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.839+0000 7f049767f640 1 --2- 172.21.15.78:0/2383054864 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0474078bc0 0x7f047407b0d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f048c035000 tx=0x7f048c03b040 comp rx=0 tx=0).stop 2024-09-17T03:08:40.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.839+0000 7f049767f640 1 -- 172.21.15.78:0/2383054864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04901600b0 msgr2=0x7f04901f7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:40.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.839+0000 7f049767f640 1 --2- 172.21.15.78:0/2383054864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04901600b0 0x7f04901f7960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f048800c770 tx=0x7f048800cc30 comp rx=0 tx=0).stop 2024-09-17T03:08:40.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.840+0000 7f049767f640 1 -- 172.21.15.78:0/2383054864 shutdown_connections 2024-09-17T03:08:40.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.840+0000 7f049767f640 1 --2- 172.21.15.78:0/2383054864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04901600b0 0x7f04901f7960 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.840+0000 7f049767f640 1 --2- 172.21.15.78:0/2383054864 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0474078bc0 0x7f047407b0d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.840+0000 7f049767f640 1 --2- 172.21.15.78:0/2383054864 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04900cf320 0x7f04901f7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.840+0000 7f049767f640 1 --2- 172.21.15.78:0/2383054864 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f04900b7cc0 0x7f049014d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:40.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.840+0000 7f049767f640 1 -- 172.21.15.78:0/2383054864 >> 172.21.15.78:0/2383054864 conn(0x7f049006d4f0 msgr2=0x7f049015f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:40.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.840+0000 7f049767f640 1 -- 172.21.15.78:0/2383054864 shutdown_connections 2024-09-17T03:08:40.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:40.840+0000 7f049767f640 1 -- 172.21.15.78:0/2383054864 wait complete. 2024-09-17T03:08:40.850 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-09-17T03:08:39.120855+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223440,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751280,"statfs":{"total":773094113280,"available":772865310720,"internally_reserved":0,"allocated":3121152,"data_stored":1842412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002931"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100906+0000","last_change":"2024-09-17T03:08:28.257527+0000","last_active":"2024-09-17T03:08:30.100906+0000","last_peered":"2024-09-17T03:08:30.100906+0000","last_clean":"2024-09-17T03:08:30.100906+0000","last_became_active":"2024-09-17T03:08:28.257066+0000","last_became_peered":"2024-09-17T03:08:28.257066+0000","last_unstale":"2024-09-17T03:08:30.100906+0000","last_undegraded":"2024-09-17T03:08:30.100906+0000","last_fullsized":"2024-09-17T03:08:30.100906+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:02.975303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230784+0000","last_change":"2024-09-17T03:08:28.254760+0000","last_active":"2024-09-17T03:08:30.230784+0000","last_peered":"2024-09-17T03:08:30.230784+0000","last_clean":"2024-09-17T03:08:30.230784+0000","last_became_active":"2024-09-17T03:08:28.254472+0000","last_became_peered":"2024-09-17T03:08:28.254472+0000","last_unstale":"2024-09-17T03:08:30.230784+0000","last_undegraded":"2024-09-17T03:08:30.230784+0000","last_fullsized":"2024-09-17T03:08:30.230784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:58.189179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293417+0000","last_change":"2024-09-17T03:08:28.252512+0000","last_active":"2024-09-17T03:08:30.293417+0000","last_peered":"2024-09-17T03:08:30.293417+0000","last_clean":"2024-09-17T03:08:30.293417+0000","last_became_active":"2024-09-17T03:08:28.252206+0000","last_became_peered":"2024-09-17T03:08:28.252206+0000","last_unstale":"2024-09-17T03:08:30.293417+0000","last_undegraded":"2024-09-17T03:08:30.293417+0000","last_fullsized":"2024-09-17T03:08:30.293417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:18:50.820653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293517+0000","last_change":"2024-09-17T03:08:28.256056+0000","last_active":"2024-09-17T03:08:30.293517+0000","last_peered":"2024-09-17T03:08:30.293517+0000","last_clean":"2024-09-17T03:08:30.293517+0000","last_became_active":"2024-09-17T03:08:28.253346+0000","last_became_peered":"2024-09-17T03:08:28.253346+0000","last_unstale":"2024-09-17T03:08:30.293517+0000","last_undegraded":"2024-09-17T03:08:30.293517+0000","last_fullsized":"2024-09-17T03:08:30.293517+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:50.397039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100669+0000","last_change":"2024-09-17T03:08:28.254995+0000","last_active":"2024-09-17T03:08:30.100669+0000","last_peered":"2024-09-17T03:08:30.100669+0000","last_clean":"2024-09-17T03:08:30.100669+0000","last_became_active":"2024-09-17T03:08:28.254698+0000","last_became_peered":"2024-09-17T03:08:28.254698+0000","last_unstale":"2024-09-17T03:08:30.100669+0000","last_undegraded":"2024-09-17T03:08:30.100669+0000","last_fullsized":"2024-09-17T03:08:30.100669+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:54.201357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293326+0000","last_change":"2024-09-17T03:08:28.256649+0000","last_active":"2024-09-17T03:08:30.293326+0000","last_peered":"2024-09-17T03:08:30.293326+0000","last_clean":"2024-09-17T03:08:30.293326+0000","last_became_active":"2024-09-17T03:08:28.256251+0000","last_became_peered":"2024-09-17T03:08:28.256251+0000","last_unstale":"2024-09-17T03:08:30.293326+0000","last_undegraded":"2024-09-17T03:08:30.293326+0000","last_fullsized":"2024-09-17T03:08:30.293326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:06:24.543132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100346+0000","last_change":"2024-09-17T03:08:28.253738+0000","last_active":"2024-09-17T03:08:30.100346+0000","last_peered":"2024-09-17T03:08:30.100346+0000","last_clean":"2024-09-17T03:08:30.100346+0000","last_became_active":"2024-09-17T03:08:28.253409+0000","last_became_peered":"2024-09-17T03:08:28.253409+0000","last_unstale":"2024-09-17T03:08:30.100346+0000","last_undegraded":"2024-09-17T03:08:30.100346+0000","last_fullsized":"2024-09-17T03:08:30.100346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:46:50.397039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226452+0000","last_change":"2024-09-17T03:08:28.259418+0000","last_active":"2024-09-17T03:08:29.226452+0000","last_peered":"2024-09-17T03:08:29.226452+0000","last_clean":"2024-09-17T03:08:29.226452+0000","last_became_active":"2024-09-17T03:08:28.259145+0000","last_became_peered":"2024-09-17T03:08:28.259145+0000","last_unstale":"2024-09-17T03:08:29.226452+0000","last_undegraded":"2024-09-17T03:08:29.226452+0000","last_fullsized":"2024-09-17T03:08:29.226452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:49:24.693205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100914+0000","last_change":"2024-09-17T03:08:28.250578+0000","last_active":"2024-09-17T03:08:30.100914+0000","last_peered":"2024-09-17T03:08:30.100914+0000","last_clean":"2024-09-17T03:08:30.100914+0000","last_became_active":"2024-09-17T03:08:28.250237+0000","last_became_peered":"2024-09-17T03:08:28.250237+0000","last_unstale":"2024-09-17T03:08:30.100914+0000","last_undegraded":"2024-09-17T03:08:30.100914+0000","last_fullsized":"2024-09-17T03:08:30.100914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:25.083828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229259+0000","last_change":"2024-09-17T03:08:28.239497+0000","last_active":"2024-09-17T03:08:29.229259+0000","last_peered":"2024-09-17T03:08:29.229259+0000","last_clean":"2024-09-17T03:08:29.229259+0000","last_became_active":"2024-09-17T03:08:28.239187+0000","last_became_peered":"2024-09-17T03:08:28.239187+0000","last_unstale":"2024-09-17T03:08:29.229259+0000","last_undegraded":"2024-09-17T03:08:29.229259+0000","last_fullsized":"2024-09-17T03:08:29.229259+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:02.757538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228039+0000","last_change":"2024-09-17T03:08:28.250102+0000","last_active":"2024-09-17T03:08:29.228039+0000","last_peered":"2024-09-17T03:08:29.228039+0000","last_clean":"2024-09-17T03:08:29.228039+0000","last_became_active":"2024-09-17T03:08:28.249797+0000","last_became_peered":"2024-09-17T03:08:28.249797+0000","last_unstale":"2024-09-17T03:08:29.228039+0000","last_undegraded":"2024-09-17T03:08:29.228039+0000","last_fullsized":"2024-09-17T03:08:29.228039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:19.446465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228129+0000","last_change":"2024-09-17T03:08:28.233620+0000","last_active":"2024-09-17T03:08:29.228129+0000","last_peered":"2024-09-17T03:08:29.228129+0000","last_clean":"2024-09-17T03:08:29.228129+0000","last_became_active":"2024-09-17T03:08:28.233312+0000","last_became_peered":"2024-09-17T03:08:28.233312+0000","last_unstale":"2024-09-17T03:08:29.228129+0000","last_undegraded":"2024-09-17T03:08:29.228129+0000","last_fullsized":"2024-09-17T03:08:29.228129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:39.083175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226708+0000","last_change":"2024-09-17T03:08:28.253338+0000","last_active":"2024-09-17T03:08:29.226708+0000","last_peered":"2024-09-17T03:08:29.226708+0000","last_clean":"2024-09-17T03:08:29.226708+0000","last_became_active":"2024-09-17T03:08:28.252284+0000","last_became_peered":"2024-09-17T03:08:28.252284+0000","last_unstale":"2024-09-17T03:08:29.226708+0000","last_undegraded":"2024-09-17T03:08:29.226708+0000","last_fullsized":"2024-09-17T03:08:29.226708+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:47.945736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293003+0000","last_change":"2024-09-17T03:08:28.249001+0000","last_active":"2024-09-17T03:08:30.293003+0000","last_peered":"2024-09-17T03:08:30.293003+0000","last_clean":"2024-09-17T03:08:30.293003+0000","last_became_active":"2024-09-17T03:08:28.248702+0000","last_became_peered":"2024-09-17T03:08:28.248702+0000","last_unstale":"2024-09-17T03:08:30.293003+0000","last_undegraded":"2024-09-17T03:08:30.293003+0000","last_fullsized":"2024-09-17T03:08:30.293003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:21.958019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230664+0000","last_change":"2024-09-17T03:08:28.238314+0000","last_active":"2024-09-17T03:08:30.230664+0000","last_peered":"2024-09-17T03:08:30.230664+0000","last_clean":"2024-09-17T03:08:30.230664+0000","last_became_active":"2024-09-17T03:08:28.237653+0000","last_became_peered":"2024-09-17T03:08:28.237653+0000","last_unstale":"2024-09-17T03:08:30.230664+0000","last_undegraded":"2024-09-17T03:08:30.230664+0000","last_fullsized":"2024-09-17T03:08:30.230664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:05.501480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293426+0000","last_change":"2024-09-17T03:08:28.259958+0000","last_active":"2024-09-17T03:08:30.293426+0000","last_peered":"2024-09-17T03:08:30.293426+0000","last_clean":"2024-09-17T03:08:30.293426+0000","last_became_active":"2024-09-17T03:08:28.259595+0000","last_became_peered":"2024-09-17T03:08:28.259595+0000","last_unstale":"2024-09-17T03:08:30.293426+0000","last_undegraded":"2024-09-17T03:08:30.293426+0000","last_fullsized":"2024-09-17T03:08:30.293426+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:10.650757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.294099+0000","last_change":"2024-09-17T03:08:28.253047+0000","last_active":"2024-09-17T03:08:30.294099+0000","last_peered":"2024-09-17T03:08:30.294099+0000","last_clean":"2024-09-17T03:08:30.294099+0000","last_became_active":"2024-09-17T03:08:28.252464+0000","last_became_peered":"2024-09-17T03:08:28.252464+0000","last_unstale":"2024-09-17T03:08:30.294099+0000","last_undegraded":"2024-09-17T03:08:30.294099+0000","last_fullsized":"2024-09-17T03:08:30.294099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:46.436651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.292836+0000","last_change":"2024-09-17T03:08:28.236142+0000","last_active":"2024-09-17T03:08:30.292836+0000","last_peered":"2024-09-17T03:08:30.292836+0000","last_clean":"2024-09-17T03:08:30.292836+0000","last_became_active":"2024-09-17T03:08:28.234294+0000","last_became_peered":"2024-09-17T03:08:28.234294+0000","last_unstale":"2024-09-17T03:08:30.292836+0000","last_undegraded":"2024-09-17T03:08:30.292836+0000","last_fullsized":"2024-09-17T03:08:30.292836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:14.380494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100799+0000","last_change":"2024-09-17T03:08:28.253214+0000","last_active":"2024-09-17T03:08:30.100799+0000","last_peered":"2024-09-17T03:08:30.100799+0000","last_clean":"2024-09-17T03:08:30.100799+0000","last_became_active":"2024-09-17T03:08:28.251617+0000","last_became_peered":"2024-09-17T03:08:28.251617+0000","last_unstale":"2024-09-17T03:08:30.100799+0000","last_undegraded":"2024-09-17T03:08:30.100799+0000","last_fullsized":"2024-09-17T03:08:30.100799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:14:46.436651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228620+0000","last_change":"2024-09-17T03:08:28.234354+0000","last_active":"2024-09-17T03:08:29.228620+0000","last_peered":"2024-09-17T03:08:29.228620+0000","last_clean":"2024-09-17T03:08:29.228620+0000","last_became_active":"2024-09-17T03:08:28.234028+0000","last_became_peered":"2024-09-17T03:08:28.234028+0000","last_unstale":"2024-09-17T03:08:29.228620+0000","last_undegraded":"2024-09-17T03:08:29.228620+0000","last_fullsized":"2024-09-17T03:08:29.228620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:45.993058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293511+0000","last_change":"2024-09-17T03:08:28.254197+0000","last_active":"2024-09-17T03:08:30.293511+0000","last_peered":"2024-09-17T03:08:30.293511+0000","last_clean":"2024-09-17T03:08:30.293511+0000","last_became_active":"2024-09-17T03:08:28.253658+0000","last_became_peered":"2024-09-17T03:08:28.253658+0000","last_unstale":"2024-09-17T03:08:30.293511+0000","last_undegraded":"2024-09-17T03:08:30.293511+0000","last_fullsized":"2024-09-17T03:08:30.293511+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:32.455387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293415+0000","last_change":"2024-09-17T03:08:28.251554+0000","last_active":"2024-09-17T03:08:30.293415+0000","last_peered":"2024-09-17T03:08:30.293415+0000","last_clean":"2024-09-17T03:08:30.293415+0000","last_became_active":"2024-09-17T03:08:28.251248+0000","last_became_peered":"2024-09-17T03:08:28.251248+0000","last_unstale":"2024-09-17T03:08:30.293415+0000","last_undegraded":"2024-09-17T03:08:30.293415+0000","last_fullsized":"2024-09-17T03:08:30.293415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:26.430483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226932+0000","last_change":"2024-09-17T03:08:28.251521+0000","last_active":"2024-09-17T03:08:29.226932+0000","last_peered":"2024-09-17T03:08:29.226932+0000","last_clean":"2024-09-17T03:08:29.226932+0000","last_became_active":"2024-09-17T03:08:28.250475+0000","last_became_peered":"2024-09-17T03:08:28.250475+0000","last_unstale":"2024-09-17T03:08:29.226932+0000","last_undegraded":"2024-09-17T03:08:29.226932+0000","last_fullsized":"2024-09-17T03:08:29.226932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:05.560274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293354+0000","last_change":"2024-09-17T03:08:28.252379+0000","last_active":"2024-09-17T03:08:30.293354+0000","last_peered":"2024-09-17T03:08:30.293354+0000","last_clean":"2024-09-17T03:08:30.293354+0000","last_became_active":"2024-09-17T03:08:28.252064+0000","last_became_peered":"2024-09-17T03:08:28.252064+0000","last_unstale":"2024-09-17T03:08:30.293354+0000","last_undegraded":"2024-09-17T03:08:30.293354+0000","last_fullsized":"2024-09-17T03:08:30.293354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:38.557690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226859+0000","last_change":"2024-09-17T03:08:28.251210+0000","last_active":"2024-09-17T03:08:29.226859+0000","last_peered":"2024-09-17T03:08:29.226859+0000","last_clean":"2024-09-17T03:08:29.226859+0000","last_became_active":"2024-09-17T03:08:28.250780+0000","last_became_peered":"2024-09-17T03:08:28.250780+0000","last_unstale":"2024-09-17T03:08:29.226859+0000","last_undegraded":"2024-09-17T03:08:29.226859+0000","last_fullsized":"2024-09-17T03:08:29.226859+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:39.174363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229299+0000","last_change":"2024-09-17T03:08:28.245417+0000","last_active":"2024-09-17T03:08:29.229299+0000","last_peered":"2024-09-17T03:08:29.229299+0000","last_clean":"2024-09-17T03:08:29.229299+0000","last_became_active":"2024-09-17T03:08:28.245091+0000","last_became_peered":"2024-09-17T03:08:28.245091+0000","last_unstale":"2024-09-17T03:08:29.229299+0000","last_undegraded":"2024-09-17T03:08:29.229299+0000","last_fullsized":"2024-09-17T03:08:29.229299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:15.100672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230750+0000","last_change":"2024-09-17T03:08:28.244539+0000","last_active":"2024-09-17T03:08:30.230750+0000","last_peered":"2024-09-17T03:08:30.230750+0000","last_clean":"2024-09-17T03:08:30.230750+0000","last_became_active":"2024-09-17T03:08:28.244240+0000","last_became_peered":"2024-09-17T03:08:28.244240+0000","last_unstale":"2024-09-17T03:08:30.230750+0000","last_undegraded":"2024-09-17T03:08:30.230750+0000","last_fullsized":"2024-09-17T03:08:30.230750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:46.318120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.227040+0000","last_change":"2024-09-17T03:08:28.251521+0000","last_active":"2024-09-17T03:08:29.227040+0000","last_peered":"2024-09-17T03:08:29.227040+0000","last_clean":"2024-09-17T03:08:29.227040+0000","last_became_active":"2024-09-17T03:08:28.250298+0000","last_became_peered":"2024-09-17T03:08:28.250298+0000","last_unstale":"2024-09-17T03:08:29.227040+0000","last_undegraded":"2024-09-17T03:08:29.227040+0000","last_fullsized":"2024-09-17T03:08:29.227040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:16.379808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293430+0000","last_change":"2024-09-17T03:08:28.253949+0000","last_active":"2024-09-17T03:08:30.293430+0000","last_peered":"2024-09-17T03:08:30.293430+0000","last_clean":"2024-09-17T03:08:30.293430+0000","last_became_active":"2024-09-17T03:08:28.253392+0000","last_became_peered":"2024-09-17T03:08:28.253392+0000","last_unstale":"2024-09-17T03:08:30.293430+0000","last_undegraded":"2024-09-17T03:08:30.293430+0000","last_fullsized":"2024-09-17T03:08:30.293430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:47.772625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293974+0000","last_change":"2024-09-17T03:08:28.258249+0000","last_active":"2024-09-17T03:08:30.293974+0000","last_peered":"2024-09-17T03:08:30.293974+0000","last_clean":"2024-09-17T03:08:30.293974+0000","last_became_active":"2024-09-17T03:08:28.253257+0000","last_became_peered":"2024-09-17T03:08:28.253257+0000","last_unstale":"2024-09-17T03:08:30.293974+0000","last_undegraded":"2024-09-17T03:08:30.293974+0000","last_fullsized":"2024-09-17T03:08:30.293974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:53.331937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293150+0000","last_change":"2024-09-17T03:08:28.242530+0000","last_active":"2024-09-17T03:08:30.293150+0000","last_peered":"2024-09-17T03:08:30.293150+0000","last_clean":"2024-09-17T03:08:30.293150+0000","last_became_active":"2024-09-17T03:08:28.242194+0000","last_became_peered":"2024-09-17T03:08:28.242194+0000","last_unstale":"2024-09-17T03:08:30.293150+0000","last_undegraded":"2024-09-17T03:08:30.293150+0000","last_fullsized":"2024-09-17T03:08:30.293150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:43.917645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228598+0000","last_change":"2024-09-17T03:08:28.254404+0000","last_active":"2024-09-17T03:08:29.228598+0000","last_peered":"2024-09-17T03:08:29.228598+0000","last_clean":"2024-09-17T03:08:29.228598+0000","last_became_active":"2024-09-17T03:08:28.254120+0000","last_became_peered":"2024-09-17T03:08:28.254120+0000","last_unstale":"2024-09-17T03:08:29.228598+0000","last_undegraded":"2024-09-17T03:08:29.228598+0000","last_fullsized":"2024-09-17T03:08:29.228598+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:31.089608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229224+0000","last_change":"2024-09-17T03:08:28.240464+0000","last_active":"2024-09-17T03:08:29.229224+0000","last_peered":"2024-09-17T03:08:29.229224+0000","last_clean":"2024-09-17T03:08:29.229224+0000","last_became_active":"2024-09-17T03:08:28.240126+0000","last_became_peered":"2024-09-17T03:08:28.240126+0000","last_unstale":"2024-09-17T03:08:29.229224+0000","last_undegraded":"2024-09-17T03:08:29.229224+0000","last_fullsized":"2024-09-17T03:08:29.229224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:45.234781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.227135+0000","last_change":"2024-09-17T03:08:27.237198+0000","last_active":"2024-09-17T03:08:29.227135+0000","last_peered":"2024-09-17T03:08:29.227135+0000","last_clean":"2024-09-17T03:08:29.227135+0000","last_became_active":"2024-09-17T03:08:27.236843+0000","last_became_peered":"2024-09-17T03:08:27.236843+0000","last_unstale":"2024-09-17T03:08:29.227135+0000","last_undegraded":"2024-09-17T03:08:29.227135+0000","last_fullsized":"2024-09-17T03:08:29.227135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:37:55.460562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293718+0000","last_change":"2024-09-17T03:08:28.253848+0000","last_active":"2024-09-17T03:08:30.293718+0000","last_peered":"2024-09-17T03:08:30.293718+0000","last_clean":"2024-09-17T03:08:30.293718+0000","last_became_active":"2024-09-17T03:08:28.253338+0000","last_became_peered":"2024-09-17T03:08:28.253338+0000","last_unstale":"2024-09-17T03:08:30.293718+0000","last_undegraded":"2024-09-17T03:08:30.293718+0000","last_fullsized":"2024-09-17T03:08:30.293718+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:10.650757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228202+0000","last_change":"2024-09-17T03:08:27.234560+0000","last_active":"2024-09-17T03:08:29.228202+0000","last_peered":"2024-09-17T03:08:29.228202+0000","last_clean":"2024-09-17T03:08:29.228202+0000","last_became_active":"2024-09-17T03:08:27.234229+0000","last_became_peered":"2024-09-17T03:08:27.234229+0000","last_unstale":"2024-09-17T03:08:29.228202+0000","last_undegraded":"2024-09-17T03:08:29.228202+0000","last_fullsized":"2024-09-17T03:08:29.228202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:00.000708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226514+0000","last_change":"2024-09-17T03:08:27.235234+0000","last_active":"2024-09-17T03:08:29.226514+0000","last_peered":"2024-09-17T03:08:29.226514+0000","last_clean":"2024-09-17T03:08:29.226514+0000","last_became_active":"2024-09-17T03:08:27.234619+0000","last_became_peered":"2024-09-17T03:08:27.234619+0000","last_unstale":"2024-09-17T03:08:29.226514+0000","last_undegraded":"2024-09-17T03:08:29.226514+0000","last_fullsized":"2024-09-17T03:08:29.226514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:03.610472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226522+0000","last_change":"2024-09-17T03:08:28.254403+0000","last_active":"2024-09-17T03:08:29.226522+0000","last_peered":"2024-09-17T03:08:29.226522+0000","last_clean":"2024-09-17T03:08:29.226522+0000","last_became_active":"2024-09-17T03:08:28.254108+0000","last_became_peered":"2024-09-17T03:08:28.254108+0000","last_unstale":"2024-09-17T03:08:29.226522+0000","last_undegraded":"2024-09-17T03:08:29.226522+0000","last_fullsized":"2024-09-17T03:08:29.226522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:24.259968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293550+0000","last_change":"2024-09-17T03:08:27.243918+0000","last_active":"2024-09-17T03:08:30.293550+0000","last_peered":"2024-09-17T03:08:30.293550+0000","last_clean":"2024-09-17T03:08:30.293550+0000","last_became_active":"2024-09-17T03:08:27.243599+0000","last_became_peered":"2024-09-17T03:08:27.243599+0000","last_unstale":"2024-09-17T03:08:30.293550+0000","last_undegraded":"2024-09-17T03:08:30.293550+0000","last_fullsized":"2024-09-17T03:08:30.293550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:54.113120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230690+0000","last_change":"2024-09-17T03:08:28.244814+0000","last_active":"2024-09-17T03:08:30.230690+0000","last_peered":"2024-09-17T03:08:30.230690+0000","last_clean":"2024-09-17T03:08:30.230690+0000","last_became_active":"2024-09-17T03:08:28.244535+0000","last_became_peered":"2024-09-17T03:08:28.244535+0000","last_unstale":"2024-09-17T03:08:30.230690+0000","last_undegraded":"2024-09-17T03:08:30.230690+0000","last_fullsized":"2024-09-17T03:08:30.230690+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:32.455387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229081+0000","last_change":"2024-09-17T03:08:27.236752+0000","last_active":"2024-09-17T03:08:29.229081+0000","last_peered":"2024-09-17T03:08:29.229081+0000","last_clean":"2024-09-17T03:08:29.229081+0000","last_became_active":"2024-09-17T03:08:27.235857+0000","last_became_peered":"2024-09-17T03:08:27.235857+0000","last_unstale":"2024-09-17T03:08:29.229081+0000","last_undegraded":"2024-09-17T03:08:29.229081+0000","last_fullsized":"2024-09-17T03:08:29.229081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:46.272871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293746+0000","last_change":"2024-09-17T03:08:28.250397+0000","last_active":"2024-09-17T03:08:30.293746+0000","last_peered":"2024-09-17T03:08:30.293746+0000","last_clean":"2024-09-17T03:08:30.293746+0000","last_became_active":"2024-09-17T03:08:28.250087+0000","last_became_peered":"2024-09-17T03:08:28.250087+0000","last_unstale":"2024-09-17T03:08:30.293746+0000","last_undegraded":"2024-09-17T03:08:30.293746+0000","last_fullsized":"2024-09-17T03:08:30.293746+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:49.687506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293814+0000","last_change":"2024-09-17T03:08:27.239555+0000","last_active":"2024-09-17T03:08:30.293814+0000","last_peered":"2024-09-17T03:08:30.293814+0000","last_clean":"2024-09-17T03:08:30.293814+0000","last_became_active":"2024-09-17T03:08:27.239051+0000","last_became_peered":"2024-09-17T03:08:27.239051+0000","last_unstale":"2024-09-17T03:08:30.293814+0000","last_undegraded":"2024-09-17T03:08:30.293814+0000","last_fullsized":"2024-09-17T03:08:30.293814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:01.379072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293660+0000","last_change":"2024-09-17T03:08:28.259335+0000","last_active":"2024-09-17T03:08:30.293660+0000","last_peered":"2024-09-17T03:08:30.293660+0000","last_clean":"2024-09-17T03:08:30.293660+0000","last_became_active":"2024-09-17T03:08:28.259026+0000","last_became_peered":"2024-09-17T03:08:28.259026+0000","last_unstale":"2024-09-17T03:08:30.293660+0000","last_undegraded":"2024-09-17T03:08:30.293660+0000","last_fullsized":"2024-09-17T03:08:30.293660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:33:49.370247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230846+0000","last_change":"2024-09-17T03:08:27.240839+0000","last_active":"2024-09-17T03:08:30.230846+0000","last_peered":"2024-09-17T03:08:30.230846+0000","last_clean":"2024-09-17T03:08:30.230846+0000","last_became_active":"2024-09-17T03:08:27.240389+0000","last_became_peered":"2024-09-17T03:08:27.240389+0000","last_unstale":"2024-09-17T03:08:30.230846+0000","last_undegraded":"2024-09-17T03:08:30.230846+0000","last_fullsized":"2024-09-17T03:08:30.230846+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:13.374584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228399+0000","last_change":"2024-09-17T03:08:28.243850+0000","last_active":"2024-09-17T03:08:29.228399+0000","last_peered":"2024-09-17T03:08:29.228399+0000","last_clean":"2024-09-17T03:08:29.228399+0000","last_became_active":"2024-09-17T03:08:28.243516+0000","last_became_peered":"2024-09-17T03:08:28.243516+0000","last_unstale":"2024-09-17T03:08:29.228399+0000","last_undegraded":"2024-09-17T03:08:29.228399+0000","last_fullsized":"2024-09-17T03:08:29.228399+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:02.105667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228627+0000","last_change":"2024-09-17T03:08:27.233543+0000","last_active":"2024-09-17T03:08:29.228627+0000","last_peered":"2024-09-17T03:08:29.228627+0000","last_clean":"2024-09-17T03:08:29.228627+0000","last_became_active":"2024-09-17T03:08:27.233120+0000","last_became_peered":"2024-09-17T03:08:27.233120+0000","last_unstale":"2024-09-17T03:08:29.228627+0000","last_undegraded":"2024-09-17T03:08:29.228627+0000","last_fullsized":"2024-09-17T03:08:29.228627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:49.898610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100513+0000","last_change":"2024-09-17T03:08:28.249563+0000","last_active":"2024-09-17T03:08:30.100513+0000","last_peered":"2024-09-17T03:08:30.100513+0000","last_clean":"2024-09-17T03:08:30.100513+0000","last_became_active":"2024-09-17T03:08:28.248913+0000","last_became_peered":"2024-09-17T03:08:28.248913+0000","last_unstale":"2024-09-17T03:08:30.100513+0000","last_undegraded":"2024-09-17T03:08:30.100513+0000","last_fullsized":"2024-09-17T03:08:30.100513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:04.018212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293675+0000","last_change":"2024-09-17T03:08:27.238166+0000","last_active":"2024-09-17T03:08:30.293675+0000","last_peered":"2024-09-17T03:08:30.293675+0000","last_clean":"2024-09-17T03:08:30.293675+0000","last_became_active":"2024-09-17T03:08:27.237602+0000","last_became_peered":"2024-09-17T03:08:27.237602+0000","last_unstale":"2024-09-17T03:08:30.293675+0000","last_undegraded":"2024-09-17T03:08:30.293675+0000","last_fullsized":"2024-09-17T03:08:30.293675+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:53.340728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293088+0000","last_change":"2024-09-17T03:08:28.248412+0000","last_active":"2024-09-17T03:08:30.293088+0000","last_peered":"2024-09-17T03:08:30.293088+0000","last_clean":"2024-09-17T03:08:30.293088+0000","last_became_active":"2024-09-17T03:08:28.248075+0000","last_became_peered":"2024-09-17T03:08:28.248075+0000","last_unstale":"2024-09-17T03:08:30.293088+0000","last_undegraded":"2024-09-17T03:08:30.293088+0000","last_fullsized":"2024-09-17T03:08:30.293088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:49.394898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293581+0000","last_change":"2024-09-17T03:08:27.242493+0000","last_active":"2024-09-17T03:08:30.293581+0000","last_peered":"2024-09-17T03:08:30.293581+0000","last_clean":"2024-09-17T03:08:30.293581+0000","last_became_active":"2024-09-17T03:08:27.242234+0000","last_became_peered":"2024-09-17T03:08:27.242234+0000","last_unstale":"2024-09-17T03:08:30.293581+0000","last_undegraded":"2024-09-17T03:08:30.293581+0000","last_fullsized":"2024-09-17T03:08:30.293581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:06.000335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100522+0000","last_change":"2024-09-17T03:08:28.254369+0000","last_active":"2024-09-17T03:08:30.100522+0000","last_peered":"2024-09-17T03:08:30.100522+0000","last_clean":"2024-09-17T03:08:30.100522+0000","last_became_active":"2024-09-17T03:08:28.253975+0000","last_became_peered":"2024-09-17T03:08:28.253975+0000","last_unstale":"2024-09-17T03:08:30.100522+0000","last_undegraded":"2024-09-17T03:08:30.100522+0000","last_fullsized":"2024-09-17T03:08:30.100522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:49.687506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228261+0000","last_change":"2024-09-17T03:08:27.235168+0000","last_active":"2024-09-17T03:08:29.228261+0000","last_peered":"2024-09-17T03:08:29.228261+0000","last_clean":"2024-09-17T03:08:29.228261+0000","last_became_active":"2024-09-17T03:08:27.234834+0000","last_became_peered":"2024-09-17T03:08:27.234834+0000","last_unstale":"2024-09-17T03:08:29.228261+0000","last_undegraded":"2024-09-17T03:08:29.228261+0000","last_fullsized":"2024-09-17T03:08:29.228261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:19:49.599813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228186+0000","last_change":"2024-09-17T03:08:28.253542+0000","last_active":"2024-09-17T03:08:29.228186+0000","last_peered":"2024-09-17T03:08:29.228186+0000","last_clean":"2024-09-17T03:08:29.228186+0000","last_became_active":"2024-09-17T03:08:28.253220+0000","last_became_peered":"2024-09-17T03:08:28.253220+0000","last_unstale":"2024-09-17T03:08:29.228186+0000","last_undegraded":"2024-09-17T03:08:29.228186+0000","last_fullsized":"2024-09-17T03:08:29.228186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:04:28.459370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293108+0000","last_change":"2024-09-17T03:08:27.235156+0000","last_active":"2024-09-17T03:08:30.293108+0000","last_peered":"2024-09-17T03:08:30.293108+0000","last_clean":"2024-09-17T03:08:30.293108+0000","last_became_active":"2024-09-17T03:08:27.234841+0000","last_became_peered":"2024-09-17T03:08:27.234841+0000","last_unstale":"2024-09-17T03:08:30.293108+0000","last_undegraded":"2024-09-17T03:08:30.293108+0000","last_fullsized":"2024-09-17T03:08:30.293108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:11:16.837042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100424+0000","last_change":"2024-09-17T03:08:28.250970+0000","last_active":"2024-09-17T03:08:30.100424+0000","last_peered":"2024-09-17T03:08:30.100424+0000","last_clean":"2024-09-17T03:08:30.100424+0000","last_became_active":"2024-09-17T03:08:28.250653+0000","last_became_peered":"2024-09-17T03:08:28.250653+0000","last_unstale":"2024-09-17T03:08:30.100424+0000","last_undegraded":"2024-09-17T03:08:30.100424+0000","last_fullsized":"2024-09-17T03:08:30.100424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:04.627763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229443+0000","last_change":"2024-09-17T03:08:27.239830+0000","last_active":"2024-09-17T03:08:29.229443+0000","last_peered":"2024-09-17T03:08:29.229443+0000","last_clean":"2024-09-17T03:08:29.229443+0000","last_became_active":"2024-09-17T03:08:27.239481+0000","last_became_peered":"2024-09-17T03:08:27.239481+0000","last_unstale":"2024-09-17T03:08:29.229443+0000","last_undegraded":"2024-09-17T03:08:29.229443+0000","last_fullsized":"2024-09-17T03:08:29.229443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:33:35.844983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100795+0000","last_change":"2024-09-17T03:08:28.252808+0000","last_active":"2024-09-17T03:08:30.100795+0000","last_peered":"2024-09-17T03:08:30.100795+0000","last_clean":"2024-09-17T03:08:30.100795+0000","last_became_active":"2024-09-17T03:08:28.251890+0000","last_became_peered":"2024-09-17T03:08:28.251890+0000","last_unstale":"2024-09-17T03:08:30.100795+0000","last_undegraded":"2024-09-17T03:08:30.100795+0000","last_fullsized":"2024-09-17T03:08:30.100795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:53.331937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.292969+0000","last_change":"2024-09-17T03:08:27.234272+0000","last_active":"2024-09-17T03:08:30.292969+0000","last_peered":"2024-09-17T03:08:30.292969+0000","last_clean":"2024-09-17T03:08:30.292969+0000","last_became_active":"2024-09-17T03:08:27.233923+0000","last_became_peered":"2024-09-17T03:08:27.233923+0000","last_unstale":"2024-09-17T03:08:30.292969+0000","last_undegraded":"2024-09-17T03:08:30.292969+0000","last_fullsized":"2024-09-17T03:08:30.292969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:06.000335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.101081+0000","last_change":"2024-09-17T03:08:28.250706+0000","last_active":"2024-09-17T03:08:30.101081+0000","last_peered":"2024-09-17T03:08:30.101081+0000","last_clean":"2024-09-17T03:08:30.101081+0000","last_became_active":"2024-09-17T03:08:28.250367+0000","last_became_peered":"2024-09-17T03:08:28.250367+0000","last_unstale":"2024-09-17T03:08:30.101081+0000","last_undegraded":"2024-09-17T03:08:30.101081+0000","last_fullsized":"2024-09-17T03:08:30.101081+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:15:42.809585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230875+0000","last_change":"2024-09-17T03:08:27.227624+0000","last_active":"2024-09-17T03:08:30.230875+0000","last_peered":"2024-09-17T03:08:30.230875+0000","last_clean":"2024-09-17T03:08:30.230875+0000","last_became_active":"2024-09-17T03:08:27.227272+0000","last_became_peered":"2024-09-17T03:08:27.227272+0000","last_unstale":"2024-09-17T03:08:30.230875+0000","last_undegraded":"2024-09-17T03:08:30.230875+0000","last_fullsized":"2024-09-17T03:08:30.230875+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:40.068941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293879+0000","last_change":"2024-09-17T03:08:28.255711+0000","last_active":"2024-09-17T03:08:30.293879+0000","last_peered":"2024-09-17T03:08:30.293879+0000","last_clean":"2024-09-17T03:08:30.293879+0000","last_became_active":"2024-09-17T03:08:28.252986+0000","last_became_peered":"2024-09-17T03:08:28.252986+0000","last_unstale":"2024-09-17T03:08:30.293879+0000","last_undegraded":"2024-09-17T03:08:30.293879+0000","last_fullsized":"2024-09-17T03:08:30.293879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:48.623610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293439+0000","last_change":"2024-09-17T03:08:27.239700+0000","last_active":"2024-09-17T03:08:30.293439+0000","last_peered":"2024-09-17T03:08:30.293439+0000","last_clean":"2024-09-17T03:08:30.293439+0000","last_became_active":"2024-09-17T03:08:27.239372+0000","last_became_peered":"2024-09-17T03:08:27.239372+0000","last_unstale":"2024-09-17T03:08:30.293439+0000","last_undegraded":"2024-09-17T03:08:30.293439+0000","last_fullsized":"2024-09-17T03:08:30.293439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:01.379072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100531+0000","last_change":"2024-09-17T03:08:28.252014+0000","last_active":"2024-09-17T03:08:30.100531+0000","last_peered":"2024-09-17T03:08:30.100531+0000","last_clean":"2024-09-17T03:08:30.100531+0000","last_became_active":"2024-09-17T03:08:28.250240+0000","last_became_peered":"2024-09-17T03:08:28.250240+0000","last_unstale":"2024-09-17T03:08:30.100531+0000","last_undegraded":"2024-09-17T03:08:30.100531+0000","last_fullsized":"2024-09-17T03:08:30.100531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:27.579756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100182+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:08:30.100182+0000","last_peered":"2024-09-17T03:08:30.100182+0000","last_clean":"2024-09-17T03:08:30.100182+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:08:30.100182+0000","last_undegraded":"2024-09-17T03:08:30.100182+0000","last_fullsized":"2024-09-17T03:08:30.100182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293225+0000","last_change":"2024-09-17T03:08:27.241373+0000","last_active":"2024-09-17T03:08:30.293225+0000","last_peered":"2024-09-17T03:08:30.293225+0000","last_clean":"2024-09-17T03:08:30.293225+0000","last_became_active":"2024-09-17T03:08:27.240394+0000","last_became_peered":"2024-09-17T03:08:27.240394+0000","last_unstale":"2024-09-17T03:08:30.293225+0000","last_undegraded":"2024-09-17T03:08:30.293225+0000","last_fullsized":"2024-09-17T03:08:30.293225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:37.172953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226720+0000","last_change":"2024-09-17T03:08:28.262359+0000","last_active":"2024-09-17T03:08:29.226720+0000","last_peered":"2024-09-17T03:08:29.226720+0000","last_clean":"2024-09-17T03:08:29.226720+0000","last_became_active":"2024-09-17T03:08:28.262020+0000","last_became_peered":"2024-09-17T03:08:28.262020+0000","last_unstale":"2024-09-17T03:08:29.226720+0000","last_undegraded":"2024-09-17T03:08:29.226720+0000","last_fullsized":"2024-09-17T03:08:29.226720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:09.171993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.099995+0000","last_change":"2024-09-17T03:08:27.244435+0000","last_active":"2024-09-17T03:08:30.099995+0000","last_peered":"2024-09-17T03:08:30.099995+0000","last_clean":"2024-09-17T03:08:30.099995+0000","last_became_active":"2024-09-17T03:08:27.243833+0000","last_became_peered":"2024-09-17T03:08:27.243833+0000","last_unstale":"2024-09-17T03:08:30.099995+0000","last_undegraded":"2024-09-17T03:08:30.099995+0000","last_fullsized":"2024-09-17T03:08:30.099995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:09.601815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.292828+0000","last_change":"2024-09-17T03:08:28.251066+0000","last_active":"2024-09-17T03:08:30.292828+0000","last_peered":"2024-09-17T03:08:30.292828+0000","last_clean":"2024-09-17T03:08:30.292828+0000","last_became_active":"2024-09-17T03:08:28.250555+0000","last_became_peered":"2024-09-17T03:08:28.250555+0000","last_unstale":"2024-09-17T03:08:30.292828+0000","last_undegraded":"2024-09-17T03:08:30.292828+0000","last_fullsized":"2024-09-17T03:08:30.292828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:41.542823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293285+0000","last_change":"2024-09-17T03:08:27.231665+0000","last_active":"2024-09-17T03:08:30.293285+0000","last_peered":"2024-09-17T03:08:30.293285+0000","last_clean":"2024-09-17T03:08:30.293285+0000","last_became_active":"2024-09-17T03:08:27.231326+0000","last_became_peered":"2024-09-17T03:08:27.231326+0000","last_unstale":"2024-09-17T03:08:30.293285+0000","last_undegraded":"2024-09-17T03:08:30.293285+0000","last_fullsized":"2024-09-17T03:08:30.293285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:40.068941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230630+0000","last_change":"2024-09-17T03:08:28.242273+0000","last_active":"2024-09-17T03:08:30.230630+0000","last_peered":"2024-09-17T03:08:30.230630+0000","last_clean":"2024-09-17T03:08:30.230630+0000","last_became_active":"2024-09-17T03:08:28.241745+0000","last_became_peered":"2024-09-17T03:08:28.241745+0000","last_unstale":"2024-09-17T03:08:30.230630+0000","last_undegraded":"2024-09-17T03:08:30.230630+0000","last_fullsized":"2024-09-17T03:08:30.230630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:47.772625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293927+0000","last_change":"2024-09-17T03:08:27.246886+0000","last_active":"2024-09-17T03:08:30.293927+0000","last_peered":"2024-09-17T03:08:30.293927+0000","last_clean":"2024-09-17T03:08:30.293927+0000","last_became_active":"2024-09-17T03:08:27.246549+0000","last_became_peered":"2024-09-17T03:08:27.246549+0000","last_unstale":"2024-09-17T03:08:30.293927+0000","last_undegraded":"2024-09-17T03:08:30.293927+0000","last_fullsized":"2024-09-17T03:08:30.293927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:54.447491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229198+0000","last_change":"2024-09-17T03:08:28.256574+0000","last_active":"2024-09-17T03:08:29.229198+0000","last_peered":"2024-09-17T03:08:29.229198+0000","last_clean":"2024-09-17T03:08:29.229198+0000","last_became_active":"2024-09-17T03:08:28.255700+0000","last_became_peered":"2024-09-17T03:08:28.255700+0000","last_unstale":"2024-09-17T03:08:29.229198+0000","last_undegraded":"2024-09-17T03:08:29.229198+0000","last_fullsized":"2024-09-17T03:08:29.229198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:51.178653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230655+0000","last_change":"2024-09-17T03:08:27.239229+0000","last_active":"2024-09-17T03:08:30.230655+0000","last_peered":"2024-09-17T03:08:30.230655+0000","last_clean":"2024-09-17T03:08:30.230655+0000","last_became_active":"2024-09-17T03:08:27.238923+0000","last_became_peered":"2024-09-17T03:08:27.238923+0000","last_unstale":"2024-09-17T03:08:30.230655+0000","last_undegraded":"2024-09-17T03:08:30.230655+0000","last_fullsized":"2024-09-17T03:08:30.230655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:01.379072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293818+0000","last_change":"2024-09-17T03:08:28.255621+0000","last_active":"2024-09-17T03:08:30.293818+0000","last_peered":"2024-09-17T03:08:30.293818+0000","last_clean":"2024-09-17T03:08:30.293818+0000","last_became_active":"2024-09-17T03:08:28.255238+0000","last_became_peered":"2024-09-17T03:08:28.255238+0000","last_unstale":"2024-09-17T03:08:30.293818+0000","last_undegraded":"2024-09-17T03:08:30.293818+0000","last_fullsized":"2024-09-17T03:08:30.293818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:27.579756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100826+0000","last_change":"2024-09-17T03:08:27.244240+0000","last_active":"2024-09-17T03:08:30.100826+0000","last_peered":"2024-09-17T03:08:30.100826+0000","last_clean":"2024-09-17T03:08:30.100826+0000","last_became_active":"2024-09-17T03:08:27.243875+0000","last_became_peered":"2024-09-17T03:08:27.243875+0000","last_unstale":"2024-09-17T03:08:30.100826+0000","last_undegraded":"2024-09-17T03:08:30.100826+0000","last_fullsized":"2024-09-17T03:08:30.100826+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:22.964776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230744+0000","last_change":"2024-09-17T03:08:28.244841+0000","last_active":"2024-09-17T03:08:30.230744+0000","last_peered":"2024-09-17T03:08:30.230744+0000","last_clean":"2024-09-17T03:08:30.230744+0000","last_became_active":"2024-09-17T03:08:28.244270+0000","last_became_peered":"2024-09-17T03:08:28.244270+0000","last_unstale":"2024-09-17T03:08:30.230744+0000","last_undegraded":"2024-09-17T03:08:30.230744+0000","last_fullsized":"2024-09-17T03:08:30.230744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:33:49.370247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.232271+0000","last_change":"2024-09-17T03:08:27.233708+0000","last_active":"2024-09-17T03:08:30.232271+0000","last_peered":"2024-09-17T03:08:30.232271+0000","last_clean":"2024-09-17T03:08:30.232271+0000","last_became_active":"2024-09-17T03:08:27.233372+0000","last_became_peered":"2024-09-17T03:08:27.233372+0000","last_unstale":"2024-09-17T03:08:30.232271+0000","last_undegraded":"2024-09-17T03:08:30.232271+0000","last_fullsized":"2024-09-17T03:08:30.232271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:54.447491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226938+0000","last_change":"2024-09-17T03:08:28.250727+0000","last_active":"2024-09-17T03:08:29.226938+0000","last_peered":"2024-09-17T03:08:29.226938+0000","last_clean":"2024-09-17T03:08:29.226938+0000","last_became_active":"2024-09-17T03:08:28.250399+0000","last_became_peered":"2024-09-17T03:08:28.250399+0000","last_unstale":"2024-09-17T03:08:29.226938+0000","last_undegraded":"2024-09-17T03:08:29.226938+0000","last_fullsized":"2024-09-17T03:08:29.226938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:27.379811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.229217+0000","last_change":"2024-09-17T03:08:27.237826+0000","last_active":"2024-09-17T03:08:29.229217+0000","last_peered":"2024-09-17T03:08:29.229217+0000","last_clean":"2024-09-17T03:08:29.229217+0000","last_became_active":"2024-09-17T03:08:27.237278+0000","last_became_peered":"2024-09-17T03:08:27.237278+0000","last_unstale":"2024-09-17T03:08:29.229217+0000","last_undegraded":"2024-09-17T03:08:29.229217+0000","last_fullsized":"2024-09-17T03:08:29.229217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:54.762062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293785+0000","last_change":"2024-09-17T03:08:28.248479+0000","last_active":"2024-09-17T03:08:30.293785+0000","last_peered":"2024-09-17T03:08:30.293785+0000","last_clean":"2024-09-17T03:08:30.293785+0000","last_became_active":"2024-09-17T03:08:28.248131+0000","last_became_peered":"2024-09-17T03:08:28.248131+0000","last_unstale":"2024-09-17T03:08:30.293785+0000","last_undegraded":"2024-09-17T03:08:30.293785+0000","last_fullsized":"2024-09-17T03:08:30.293785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:58.189179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.099980+0000","last_change":"2024-09-17T03:08:27.241677+0000","last_active":"2024-09-17T03:08:30.099980+0000","last_peered":"2024-09-17T03:08:30.099980+0000","last_clean":"2024-09-17T03:08:30.099980+0000","last_became_active":"2024-09-17T03:08:27.241334+0000","last_became_peered":"2024-09-17T03:08:27.241334+0000","last_unstale":"2024-09-17T03:08:30.099980+0000","last_undegraded":"2024-09-17T03:08:30.099980+0000","last_fullsized":"2024-09-17T03:08:30.099980+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:01.099757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228778+0000","last_change":"2024-09-17T03:08:28.237275+0000","last_active":"2024-09-17T03:08:29.228778+0000","last_peered":"2024-09-17T03:08:29.228778+0000","last_clean":"2024-09-17T03:08:29.228778+0000","last_became_active":"2024-09-17T03:08:28.236973+0000","last_became_peered":"2024-09-17T03:08:28.236973+0000","last_unstale":"2024-09-17T03:08:29.228778+0000","last_undegraded":"2024-09-17T03:08:29.228778+0000","last_fullsized":"2024-09-17T03:08:29.228778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:38.240738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230822+0000","last_change":"2024-09-17T03:08:27.238083+0000","last_active":"2024-09-17T03:08:30.230822+0000","last_peered":"2024-09-17T03:08:30.230822+0000","last_clean":"2024-09-17T03:08:30.230822+0000","last_became_active":"2024-09-17T03:08:27.237734+0000","last_became_peered":"2024-09-17T03:08:27.237734+0000","last_unstale":"2024-09-17T03:08:30.230822+0000","last_undegraded":"2024-09-17T03:08:30.230822+0000","last_fullsized":"2024-09-17T03:08:30.230822+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:54.113120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226699+0000","last_change":"2024-09-17T03:08:28.240568+0000","last_active":"2024-09-17T03:08:29.226699+0000","last_peered":"2024-09-17T03:08:29.226699+0000","last_clean":"2024-09-17T03:08:29.226699+0000","last_became_active":"2024-09-17T03:08:28.240266+0000","last_became_peered":"2024-09-17T03:08:28.240266+0000","last_unstale":"2024-09-17T03:08:29.226699+0000","last_undegraded":"2024-09-17T03:08:29.226699+0000","last_fullsized":"2024-09-17T03:08:29.226699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:11.049096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.230817+0000","last_change":"2024-09-17T03:08:27.229679+0000","last_active":"2024-09-17T03:08:30.230817+0000","last_peered":"2024-09-17T03:08:30.230817+0000","last_clean":"2024-09-17T03:08:30.230817+0000","last_became_active":"2024-09-17T03:08:27.229368+0000","last_became_peered":"2024-09-17T03:08:27.229368+0000","last_unstale":"2024-09-17T03:08:30.230817+0000","last_undegraded":"2024-09-17T03:08:30.230817+0000","last_fullsized":"2024-09-17T03:08:30.230817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:33.251896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.227133+0000","last_change":"2024-09-17T03:08:28.258420+0000","last_active":"2024-09-17T03:08:29.227133+0000","last_peered":"2024-09-17T03:08:29.227133+0000","last_clean":"2024-09-17T03:08:29.227133+0000","last_became_active":"2024-09-17T03:08:28.258108+0000","last_became_peered":"2024-09-17T03:08:28.258108+0000","last_unstale":"2024-09-17T03:08:29.227133+0000","last_undegraded":"2024-09-17T03:08:29.227133+0000","last_fullsized":"2024-09-17T03:08:29.227133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:36.707700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100794+0000","last_change":"2024-09-17T03:08:27.241586+0000","last_active":"2024-09-17T03:08:30.100794+0000","last_peered":"2024-09-17T03:08:30.100794+0000","last_clean":"2024-09-17T03:08:30.100794+0000","last_became_active":"2024-09-17T03:08:27.241222+0000","last_became_peered":"2024-09-17T03:08:27.241222+0000","last_unstale":"2024-09-17T03:08:30.100794+0000","last_undegraded":"2024-09-17T03:08:30.100794+0000","last_fullsized":"2024-09-17T03:08:30.100794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:50.172743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.228469+0000","last_change":"2024-09-17T03:08:28.235146+0000","last_active":"2024-09-17T03:08:29.228469+0000","last_peered":"2024-09-17T03:08:29.228469+0000","last_clean":"2024-09-17T03:08:29.228469+0000","last_became_active":"2024-09-17T03:08:28.234806+0000","last_became_peered":"2024-09-17T03:08:28.234806+0000","last_unstale":"2024-09-17T03:08:29.228469+0000","last_undegraded":"2024-09-17T03:08:29.228469+0000","last_fullsized":"2024-09-17T03:08:29.228469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:17.510396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293767+0000","last_change":"2024-09-17T03:08:28.248874+0000","last_active":"2024-09-17T03:08:30.293767+0000","last_peered":"2024-09-17T03:08:30.293767+0000","last_clean":"2024-09-17T03:08:30.293767+0000","last_became_active":"2024-09-17T03:08:28.248556+0000","last_became_peered":"2024-09-17T03:08:28.248556+0000","last_unstale":"2024-09-17T03:08:30.293767+0000","last_undegraded":"2024-09-17T03:08:30.293767+0000","last_fullsized":"2024-09-17T03:08:30.293767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:54.201357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100250+0000","last_change":"2024-09-17T03:08:27.246359+0000","last_active":"2024-09-17T03:08:30.100250+0000","last_peered":"2024-09-17T03:08:30.100250+0000","last_clean":"2024-09-17T03:08:30.100250+0000","last_became_active":"2024-09-17T03:08:27.246057+0000","last_became_peered":"2024-09-17T03:08:27.246057+0000","last_unstale":"2024-09-17T03:08:30.100250+0000","last_undegraded":"2024-09-17T03:08:30.100250+0000","last_fullsized":"2024-09-17T03:08:30.100250+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:47:37.234828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293628+0000","last_change":"2024-09-17T03:08:28.252494+0000","last_active":"2024-09-17T03:08:30.293628+0000","last_peered":"2024-09-17T03:08:30.293628+0000","last_clean":"2024-09-17T03:08:30.293628+0000","last_became_active":"2024-09-17T03:08:28.252160+0000","last_became_peered":"2024-09-17T03:08:28.252160+0000","last_unstale":"2024-09-17T03:08:30.293628+0000","last_undegraded":"2024-09-17T03:08:30.293628+0000","last_fullsized":"2024-09-17T03:08:30.293628+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:04.627763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.100672+0000","last_change":"2024-09-17T03:08:27.244060+0000","last_active":"2024-09-17T03:08:30.100672+0000","last_peered":"2024-09-17T03:08:30.100672+0000","last_clean":"2024-09-17T03:08:30.100672+0000","last_became_active":"2024-09-17T03:08:27.243722+0000","last_became_peered":"2024-09-17T03:08:27.243722+0000","last_unstale":"2024-09-17T03:08:30.100672+0000","last_undegraded":"2024-09-17T03:08:30.100672+0000","last_fullsized":"2024-09-17T03:08:30.100672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:44.228871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293443+0000","last_change":"2024-09-17T03:08:28.259408+0000","last_active":"2024-09-17T03:08:30.293443+0000","last_peered":"2024-09-17T03:08:30.293443+0000","last_clean":"2024-09-17T03:08:30.293443+0000","last_became_active":"2024-09-17T03:08:28.259101+0000","last_became_peered":"2024-09-17T03:08:28.259101+0000","last_unstale":"2024-09-17T03:08:30.293443+0000","last_undegraded":"2024-09-17T03:08:30.293443+0000","last_fullsized":"2024-09-17T03:08:30.293443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:05.501480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226814+0000","last_change":"2024-09-17T03:08:27.239362+0000","last_active":"2024-09-17T03:08:29.226814+0000","last_peered":"2024-09-17T03:08:29.226814+0000","last_clean":"2024-09-17T03:08:29.226814+0000","last_became_active":"2024-09-17T03:08:27.238941+0000","last_became_peered":"2024-09-17T03:08:27.238941+0000","last_unstale":"2024-09-17T03:08:29.226814+0000","last_undegraded":"2024-09-17T03:08:29.226814+0000","last_fullsized":"2024-09-17T03:08:29.226814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:09:29.377537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:29.226806+0000","last_change":"2024-09-17T03:08:28.252681+0000","last_active":"2024-09-17T03:08:29.226806+0000","last_peered":"2024-09-17T03:08:29.226806+0000","last_clean":"2024-09-17T03:08:29.226806+0000","last_became_active":"2024-09-17T03:08:28.252248+0000","last_became_peered":"2024-09-17T03:08:28.252248+0000","last_unstale":"2024-09-17T03:08:29.226806+0000","last_undegraded":"2024-09-17T03:08:29.226806+0000","last_fullsized":"2024-09-17T03:08:29.226806+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:27.212097+0000","last_clean_scrub_stamp":"2024-09-17T03:08:27.212097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:38:54.411712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T03:08:30.293659+0000","last_change":"2024-09-17T03:08:27.237660+0000","last_active":"2024-09-17T03:08:30.293659+0000","last_peered":"2024-09-17T03:08:30.293659+0000","last_clean":"2024-09-17T03:08:30.293659+0000","last_became_active":"2024-09-17T03:08:27.237311+0000","last_became_peered":"2024-09-17T03:08:27.237311+0000","last_unstale":"2024-09-17T03:08:30.293659+0000","last_undegraded":"2024-09-17T03:08:30.293659+0000","last_fullsized":"2024-09-17T03:08:30.293659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:26.206187+0000","last_clean_scrub_stamp":"2024-09-17T03:08:26.206187+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:00.697522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":831488,"data_stored":673057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":83719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":82197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":245760,"data_stored":82233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":82107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":82267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":673113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31432,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340408,"statfs":{"total":96636764160,"available":96604577792,"internally_reserved":0,"allocated":245760,"data_stored":83719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:08:40.855 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:08:40.855 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T03:08:40.855 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T03:08:40.855 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T03:08:41.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.002+0000 7fe01f48b640 1 -- 172.21.15.78:0/156146580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0180b3a10 msgr2=0x7fe0180d14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:41.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.002+0000 7fe01f48b640 1 --2- 172.21.15.78:0/156146580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0180b3a10 0x7fe0180d14f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe008005fd0 tx=0x7fe00802a540 comp rx=0 tx=0).stop 2024-09-17T03:08:41.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.002+0000 7fe01f48b640 1 -- 172.21.15.78:0/156146580 shutdown_connections 2024-09-17T03:08:41.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.002+0000 7fe01f48b640 1 --2- 172.21.15.78:0/156146580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0180b3a10 0x7fe0180d14f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.002+0000 7fe01f48b640 1 --2- 172.21.15.78:0/156146580 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0180b9b60 0x7fe0180d0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.002+0000 7fe01f48b640 1 -- 172.21.15.78:0/156146580 >> 172.21.15.78:0/156146580 conn(0x7fe01809d8f0 msgr2=0x7fe0180d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:41.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.002+0000 7fe01f48b640 1 -- 172.21.15.78:0/156146580 shutdown_connections 2024-09-17T03:08:41.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.002+0000 7fe01f48b640 1 -- 172.21.15.78:0/156146580 wait complete. 2024-09-17T03:08:41.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.004+0000 7fe01f48b640 1 Processor -- start 2024-09-17T03:08:41.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.004+0000 7fe01f48b640 1 -- start start 2024-09-17T03:08:41.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.005+0000 7fe01f48b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0180b3a10 0x7fe0180ca640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:41.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.005+0000 7fe01f48b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0180b9b60 0x7fe018161300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:41.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.005+0000 7fe01f48b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe018162430 0x7fe018157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:41.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.005+0000 7fe01f48b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe018162f50 con 0x7fe0180b9b60 2024-09-17T03:08:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.005+0000 7fe01f48b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe0180d1fa0 con 0x7fe018162430 2024-09-17T03:08:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.005+0000 7fe01f48b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe0181630d0 con 0x7fe0180b3a10 2024-09-17T03:08:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.005+0000 7fe01ca26640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0180b9b60 0x7fe018161300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.005+0000 7fe01ca26640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0180b9b60 0x7fe018161300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34418/0 (socket says 172.21.15.78:34418) 2024-09-17T03:08:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.005+0000 7fe01ca26640 1 -- 172.21.15.78:0/2913964806 learned_addr learned my addr 172.21.15.78:0/2913964806 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.005+0000 7fe01d227640 1 --2- 172.21.15.78:0/2913964806 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0180b3a10 0x7fe0180ca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.005+0000 7fe01da28640 1 --2- 172.21.15.78:0/2913964806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe018162430 0x7fe018157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.005+0000 7fe01ca26640 1 -- 172.21.15.78:0/2913964806 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0180b3a10 msgr2=0x7fe0180ca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:41.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.005+0000 7fe01ca26640 1 --2- 172.21.15.78:0/2913964806 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0180b3a10 0x7fe0180ca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.005+0000 7fe01ca26640 1 -- 172.21.15.78:0/2913964806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe018162430 msgr2=0x7fe018157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:41.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.005+0000 7fe01ca26640 1 --2- 172.21.15.78:0/2913964806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe018162430 0x7fe018157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.005+0000 7fe01ca26640 1 -- 172.21.15.78:0/2913964806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0180cae90 con 0x7fe0180b9b60 2024-09-17T03:08:41.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.005+0000 7fe01d227640 1 --2- 172.21.15.78:0/2913964806 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0180b3a10 0x7fe0180ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:41.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.005+0000 7fe01da28640 1 --2- 172.21.15.78:0/2913964806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe018162430 0x7fe018157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:41.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.006+0000 7fe01ca26640 1 --2- 172.21.15.78:0/2913964806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0180b9b60 0x7fe018161300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe008034040 tx=0x7fe0080038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:41.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.006+0000 7fe00dffb640 1 -- 172.21.15.78:0/2913964806 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00803e030 con 0x7fe0180b9b60 2024-09-17T03:08:41.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.006+0000 7fe00dffb640 1 -- 172.21.15.78:0/2913964806 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe008003d90 con 0x7fe0180b9b60 2024-09-17T03:08:41.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.006+0000 7fe01f48b640 1 -- 172.21.15.78:0/2913964806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0181f5ab0 con 0x7fe0180b9b60 2024-09-17T03:08:41.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.006+0000 7fe00dffb640 1 -- 172.21.15.78:0/2913964806 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe008035040 con 0x7fe0180b9b60 2024-09-17T03:08:41.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.006+0000 7fe01f48b640 1 -- 172.21.15.78:0/2913964806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0181f6070 con 0x7fe0180b9b60 2024-09-17T03:08:41.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.007+0000 7fe01f48b640 1 -- 172.21.15.78:0/2913964806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0180cac00 con 0x7fe0180b9b60 2024-09-17T03:08:41.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.008+0000 7fe00dffb640 1 -- 172.21.15.78:0/2913964806 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe008041030 con 0x7fe0180b9b60 2024-09-17T03:08:41.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.008+0000 7fe00dffb640 1 --2- 172.21.15.78:0/2913964806 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdffc078b90 0x7fdffc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:41.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.008+0000 7fe00dffb640 1 -- 172.21.15.78:0/2913964806 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe0080bb550 con 0x7fe0180b9b60 2024-09-17T03:08:41.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.008+0000 7fe01d227640 1 --2- 172.21.15.78:0/2913964806 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdffc078b90 0x7fdffc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:41.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.009+0000 7fe01d227640 1 --2- 172.21.15.78:0/2913964806 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdffc078b90 0x7fdffc07b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe014009ab0 tx=0x7fe014005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:41.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.013+0000 7fe00dffb640 1 -- 172.21.15.78:0/2913964806 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe008083910 con 0x7fe0180b9b60 2024-09-17T03:08:41.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.224+0000 7fe01f48b640 1 -- 172.21.15.78:0/2913964806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe018162840 con 0x7fe0180b9b60 2024-09-17T03:08:41.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.224+0000 7fe00dffb640 1 -- 172.21.15.78:0/2913964806 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fe008083210 con 0x7fe0180b9b60 2024-09-17T03:08:41.224 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:41.224 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T03:08:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.226+0000 7fe01f48b640 1 -- 172.21.15.78:0/2913964806 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdffc078b90 msgr2=0x7fdffc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.226+0000 7fe01f48b640 1 --2- 172.21.15.78:0/2913964806 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdffc078b90 0x7fdffc07b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe014009ab0 tx=0x7fe014005f90 comp rx=0 tx=0).stop 2024-09-17T03:08:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.226+0000 7fe01f48b640 1 -- 172.21.15.78:0/2913964806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0180b9b60 msgr2=0x7fe018161300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.226+0000 7fe01f48b640 1 --2- 172.21.15.78:0/2913964806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0180b9b60 0x7fe018161300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe008034040 tx=0x7fe0080038a0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.226+0000 7fe01f48b640 1 -- 172.21.15.78:0/2913964806 shutdown_connections 2024-09-17T03:08:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.226+0000 7fe01f48b640 1 --2- 172.21.15.78:0/2913964806 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdffc078b90 0x7fdffc07b0a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.226+0000 7fe01f48b640 1 --2- 172.21.15.78:0/2913964806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe018162430 0x7fe018157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.226+0000 7fe01f48b640 1 --2- 172.21.15.78:0/2913964806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0180b9b60 0x7fe018161300 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.226+0000 7fe01f48b640 1 --2- 172.21.15.78:0/2913964806 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0180b3a10 0x7fe0180ca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.226+0000 7fe01f48b640 1 -- 172.21.15.78:0/2913964806 >> 172.21.15.78:0/2913964806 conn(0x7fe01809d8f0 msgr2=0x7fe0180d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.226+0000 7fe01f48b640 1 -- 172.21.15.78:0/2913964806 shutdown_connections 2024-09-17T03:08:41.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.226+0000 7fe01f48b640 1 -- 172.21.15.78:0/2913964806 wait complete. 2024-09-17T03:08:41.237 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T03:08:41.238 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:08:41.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.351+0000 7f6dee8c4640 1 -- 172.21.15.78:0/1509989432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6de80cf520 msgr2=0x7f6de80ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:41.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.351+0000 7f6dee8c4640 1 --2- 172.21.15.78:0/1509989432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6de80cf520 0x7f6de80ccad0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6de80d2320 tx=0x7f6de002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.351+0000 7f6dee8c4640 1 -- 172.21.15.78:0/1509989432 shutdown_connections 2024-09-17T03:08:41.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.351+0000 7f6dee8c4640 1 --2- 172.21.15.78:0/1509989432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6de80cf520 0x7f6de80ccad0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.351+0000 7f6dee8c4640 1 --2- 172.21.15.78:0/1509989432 >> v2:172.21.15.193:3300/0 conn(0x7f6de815b900 0x7f6de80ae1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.351+0000 7f6dee8c4640 1 -- 172.21.15.78:0/1509989432 >> 172.21.15.78:0/1509989432 conn(0x7f6de8074170 msgr2=0x7f6de80b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.351+0000 7f6dee8c4640 1 -- 172.21.15.78:0/1509989432 shutdown_connections 2024-09-17T03:08:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.351+0000 7f6dee8c4640 1 -- 172.21.15.78:0/1509989432 wait complete. 2024-09-17T03:08:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.353+0000 7f6dee8c4640 1 Processor -- start 2024-09-17T03:08:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.353+0000 7f6dee8c4640 1 -- start start 2024-09-17T03:08:41.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.354+0000 7f6dee8c4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6de809aa30 0x7f6de8153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.354+0000 7f6dee8c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6de815b900 0x7f6de815e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.354+0000 7f6dee8c4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6de815c690 0x7f6de815e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.354+0000 7f6dee8c4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6de80cd010 con 0x7f6de815b900 2024-09-17T03:08:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.354+0000 7f6dee8c4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6de80cdeb0 con 0x7f6de809aa30 2024-09-17T03:08:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.354+0000 7f6dee8c4640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f6de80cd190 con 0x7f6de815c690 2024-09-17T03:08:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.354+0000 7f6de77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6de815b900 0x7f6de815e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.354+0000 7f6de77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6de815b900 0x7f6de815e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34428/0 (socket says 172.21.15.78:34428) 2024-09-17T03:08:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.354+0000 7f6de77fe640 1 -- 172.21.15.78:0/3219998424 learned_addr learned my addr 172.21.15.78:0/3219998424 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.355+0000 7f6dece61640 1 --2- 172.21.15.78:0/3219998424 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6de815c690 0x7f6de815e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.355+0000 7f6de7fff640 1 --2- 172.21.15.78:0/3219998424 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6de809aa30 0x7f6de8153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.355+0000 7f6de77fe640 1 -- 172.21.15.78:0/3219998424 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6de815c690 msgr2=0x7f6de815e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:41.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.355+0000 7f6de77fe640 1 --2- 172.21.15.78:0/3219998424 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6de815c690 0x7f6de815e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.355+0000 7f6de77fe640 1 -- 172.21.15.78:0/3219998424 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6de809aa30 msgr2=0x7f6de8153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:41.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.355+0000 7f6de77fe640 1 --2- 172.21.15.78:0/3219998424 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6de809aa30 0x7f6de8153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.355+0000 7f6de77fe640 1 -- 172.21.15.78:0/3219998424 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de8153a90 con 0x7f6de815b900 2024-09-17T03:08:41.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.355+0000 7f6de7fff640 1 --2- 172.21.15.78:0/3219998424 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6de809aa30 0x7f6de8153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:41.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.355+0000 7f6dece61640 1 --2- 172.21.15.78:0/3219998424 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6de815c690 0x7f6de815e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:41.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.355+0000 7f6de77fe640 1 --2- 172.21.15.78:0/3219998424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6de815b900 0x7f6de815e1d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc00c3d0 tx=0x7f6ddc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:41.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.355+0000 7f6de4ff9640 1 -- 172.21.15.78:0/3219998424 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc011790 con 0x7f6de815b900 2024-09-17T03:08:41.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.355+0000 7f6de4ff9640 1 -- 172.21.15.78:0/3219998424 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ddc017070 con 0x7f6de815b900 2024-09-17T03:08:41.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.355+0000 7f6de4ff9640 1 -- 172.21.15.78:0/3219998424 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc011cc0 con 0x7f6de815b900 2024-09-17T03:08:41.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.355+0000 7f6dee8c4640 1 -- 172.21.15.78:0/3219998424 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6de815c080 con 0x7f6de815b900 2024-09-17T03:08:41.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.355+0000 7f6dee8c4640 1 -- 172.21.15.78:0/3219998424 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de80b5460 con 0x7f6de815b900 2024-09-17T03:08:41.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.356+0000 7f6dee8c4640 1 -- 172.21.15.78:0/3219998424 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6de80cd640 con 0x7f6de815b900 2024-09-17T03:08:41.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.357+0000 7f6de4ff9640 1 -- 172.21.15.78:0/3219998424 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ddc01c460 con 0x7f6de815b900 2024-09-17T03:08:41.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.357+0000 7f6de4ff9640 1 --2- 172.21.15.78:0/3219998424 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6dd4078bc0 0x7f6dd407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:41.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.357+0000 7f6de4ff9640 1 -- 172.21.15.78:0/3219998424 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6ddc09aa10 con 0x7f6de815b900 2024-09-17T03:08:41.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.357+0000 7f6de7fff640 1 --2- 172.21.15.78:0/3219998424 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6dd4078bc0 0x7f6dd407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:41.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.358+0000 7f6de7fff640 1 --2- 172.21.15.78:0/3219998424 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6dd4078bc0 0x7f6dd407b0d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80058c0 tx=0x7f6dd8005c90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:41.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.362+0000 7f6de4ff9640 1 -- 172.21.15.78:0/3219998424 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6ddc062f70 con 0x7f6de815b900 2024-09-17T03:08:41.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.570+0000 7f6dee8c4640 1 -- 172.21.15.78:0/3219998424 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6de815bdd0 con 0x7f6de815b900 2024-09-17T03:08:41.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.570+0000 7f6de4ff9640 1 -- 172.21.15.78:0/3219998424 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5220 (secure 0 0 0) 0x7f6ddc062870 con 0x7f6de815b900 2024-09-17T03:08:41.570 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:41.571 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":6,"btime":"2024-09-17T03:08:30:244213+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/3111681444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3111681444},{"type":"v1","addr":"172.21.15.78:6833","nonce":3111681444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1920750629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1920750629},{"type":"v1","addr":"172.21.15.193:6836","nonce":1920750629}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4416,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2220463802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2220463802},{"type":"v1","addr":"172.21.15.78:6835","nonce":2220463802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:08:27.583934+0000","modified":"2024-09-17T03:08:29.592351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4425},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4425":{"gid":4425,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6837/934698838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":934698838},{"type":"v1","addr":"172.21.15.193:6837","nonce":934698838}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4425,"qdb_cluster":[4425]},"id":1}]} 2024-09-17T03:08:41.571 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 6 2024-09-17T03:08:41.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.573+0000 7f6dee8c4640 1 -- 172.21.15.78:0/3219998424 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6dd4078bc0 msgr2=0x7f6dd407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:41.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.573+0000 7f6dee8c4640 1 --2- 172.21.15.78:0/3219998424 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6dd4078bc0 0x7f6dd407b0d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6dd80058c0 tx=0x7f6dd8005c90 comp rx=0 tx=0).stop 2024-09-17T03:08:41.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.573+0000 7f6dee8c4640 1 -- 172.21.15.78:0/3219998424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6de815b900 msgr2=0x7f6de815e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:41.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.573+0000 7f6dee8c4640 1 --2- 172.21.15.78:0/3219998424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6de815b900 0x7f6de815e1d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc00c3d0 tx=0x7f6ddc00c890 comp rx=0 tx=0).stop 2024-09-17T03:08:41.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.573+0000 7f6dee8c4640 1 -- 172.21.15.78:0/3219998424 shutdown_connections 2024-09-17T03:08:41.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.573+0000 7f6dee8c4640 1 --2- 172.21.15.78:0/3219998424 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6de815c690 0x7f6de815e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.573+0000 7f6dee8c4640 1 --2- 172.21.15.78:0/3219998424 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6de815b900 0x7f6de815e1d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.573+0000 7f6dee8c4640 1 --2- 172.21.15.78:0/3219998424 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6dd4078bc0 0x7f6dd407b0d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.573+0000 7f6dee8c4640 1 --2- 172.21.15.78:0/3219998424 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6de809aa30 0x7f6de8153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.573+0000 7f6dee8c4640 1 -- 172.21.15.78:0/3219998424 >> 172.21.15.78:0/3219998424 conn(0x7f6de8074170 msgr2=0x7f6de80ae950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:41.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.573+0000 7f6dee8c4640 1 -- 172.21.15.78:0/3219998424 shutdown_connections 2024-09-17T03:08:41.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.573+0000 7f6dee8c4640 1 -- 172.21.15.78:0/3219998424 wait complete. 2024-09-17T03:08:41.584 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:08:41.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.696+0000 7f3f595ba640 1 -- 172.21.15.78:0/1506941283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f540ceb40 msgr2=0x7f3f540cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:41.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.696+0000 7f3f595ba640 1 --2- 172.21.15.78:0/1506941283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f540ceb40 0x7f3f540cef50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c005fd0 tx=0x7f3f4c02aa10 comp rx=0 tx=0).stop 2024-09-17T03:08:41.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.696+0000 7f3f595ba640 1 -- 172.21.15.78:0/1506941283 shutdown_connections 2024-09-17T03:08:41.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.696+0000 7f3f595ba640 1 --2- 172.21.15.78:0/1506941283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f540ceb40 0x7f3f540cef50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.696+0000 7f3f595ba640 1 --2- 172.21.15.78:0/1506941283 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3f5406e170 0x7f3f540b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.696+0000 7f3f595ba640 1 -- 172.21.15.78:0/1506941283 >> 172.21.15.78:0/1506941283 conn(0x7f3f5408bfc0 msgr2=0x7f3f5409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:41.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.696+0000 7f3f595ba640 1 -- 172.21.15.78:0/1506941283 shutdown_connections 2024-09-17T03:08:41.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.696+0000 7f3f595ba640 1 -- 172.21.15.78:0/1506941283 wait complete. 2024-09-17T03:08:41.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.698+0000 7f3f595ba640 1 Processor -- start 2024-09-17T03:08:41.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.698+0000 7f3f595ba640 1 -- start start 2024-09-17T03:08:41.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.699+0000 7f3f595ba640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3f5406f4b0 0x7f3f5409e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:41.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.699+0000 7f3f595ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f540ceb40 0x7f3f5415fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:41.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.699+0000 7f3f595ba640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f541f88d0 0x7f3f541f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:41.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.699+0000 7f3f595ba640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3f540d0e60 con 0x7f3f540ceb40 2024-09-17T03:08:41.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.699+0000 7f3f595ba640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3f540d0ce0 con 0x7f3f541f88d0 2024-09-17T03:08:41.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.699+0000 7f3f595ba640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3f540d0fe0 con 0x7f3f5406f4b0 2024-09-17T03:08:41.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.699+0000 7f3f4a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f540ceb40 0x7f3f5415fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:41.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.699+0000 7f3f4a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f540ceb40 0x7f3f5415fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34452/0 (socket says 172.21.15.78:34452) 2024-09-17T03:08:41.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.699+0000 7f3f4a7fc640 1 -- 172.21.15.78:0/632973662 learned_addr learned my addr 172.21.15.78:0/632973662 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:41.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.699+0000 7f3f52ffd640 1 --2- 172.21.15.78:0/632973662 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3f5406f4b0 0x7f3f5409e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:41.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.699+0000 7f3f537fe640 1 --2- 172.21.15.78:0/632973662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f541f88d0 0x7f3f541f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:41.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.700+0000 7f3f4a7fc640 1 -- 172.21.15.78:0/632973662 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3f5406f4b0 msgr2=0x7f3f5409e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:41.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.700+0000 7f3f4a7fc640 1 --2- 172.21.15.78:0/632973662 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3f5406f4b0 0x7f3f5409e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.700+0000 7f3f4a7fc640 1 -- 172.21.15.78:0/632973662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f541f88d0 msgr2=0x7f3f541f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:41.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.700+0000 7f3f4a7fc640 1 --2- 172.21.15.78:0/632973662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f541f88d0 0x7f3f541f5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.700+0000 7f3f4a7fc640 1 -- 172.21.15.78:0/632973662 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f541f9020 con 0x7f3f540ceb40 2024-09-17T03:08:41.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.700+0000 7f3f4a7fc640 1 --2- 172.21.15.78:0/632973662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f540ceb40 0x7f3f5415fa40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00c370 tx=0x7f3f3c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:41.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.700+0000 7f3f4bfff640 1 -- 172.21.15.78:0/632973662 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c017070 con 0x7f3f540ceb40 2024-09-17T03:08:41.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.700+0000 7f3f4bfff640 1 -- 172.21.15.78:0/632973662 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f3c0053c0 con 0x7f3f540ceb40 2024-09-17T03:08:41.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.700+0000 7f3f595ba640 1 -- 172.21.15.78:0/632973662 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f541f9300 con 0x7f3f540ceb40 2024-09-17T03:08:41.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.700+0000 7f3f4bfff640 1 -- 172.21.15.78:0/632973662 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3c003850 con 0x7f3f540ceb40 2024-09-17T03:08:41.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.700+0000 7f3f595ba640 1 -- 172.21.15.78:0/632973662 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f541f54f0 con 0x7f3f540ceb40 2024-09-17T03:08:41.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.701+0000 7f3f595ba640 1 -- 172.21.15.78:0/632973662 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f541f8d90 con 0x7f3f540ceb40 2024-09-17T03:08:41.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.702+0000 7f3f4bfff640 1 -- 172.21.15.78:0/632973662 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3f3c01a070 con 0x7f3f540ceb40 2024-09-17T03:08:41.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.702+0000 7f3f4bfff640 1 --2- 172.21.15.78:0/632973662 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f34078b90 0x7f3f3407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:41.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.702+0000 7f3f4bfff640 1 -- 172.21.15.78:0/632973662 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3f3c09a100 con 0x7f3f540ceb40 2024-09-17T03:08:41.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.702+0000 7f3f52ffd640 1 --2- 172.21.15.78:0/632973662 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f34078b90 0x7f3f3407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:41.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.703+0000 7f3f52ffd640 1 --2- 172.21.15.78:0/632973662 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f34078b90 0x7f3f3407b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3f44005fd0 tx=0x7f3f44005850 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:41.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.707+0000 7f3f4bfff640 1 -- 172.21.15.78:0/632973662 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3f3c062520 con 0x7f3f540ceb40 2024-09-17T03:08:41.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.913+0000 7f3f595ba640 1 -- 172.21.15.78:0/632973662 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f541f9820 con 0x7f3f540ceb40 2024-09-17T03:08:41.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.914+0000 7f3f4bfff640 1 -- 172.21.15.78:0/632973662 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5220 (secure 0 0 0) 0x7f3f541f9820 con 0x7f3f540ceb40 2024-09-17T03:08:41.914 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:41.914 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":6,"btime":"2024-09-17T03:08:30:244213+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/3111681444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3111681444},{"type":"v1","addr":"172.21.15.78:6833","nonce":3111681444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1920750629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1920750629},{"type":"v1","addr":"172.21.15.193:6836","nonce":1920750629}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4416,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2220463802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2220463802},{"type":"v1","addr":"172.21.15.78:6835","nonce":2220463802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:08:27.583934+0000","modified":"2024-09-17T03:08:29.592351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4425},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4425":{"gid":4425,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6837/934698838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":934698838},{"type":"v1","addr":"172.21.15.193:6837","nonce":934698838}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4425,"qdb_cluster":[4425]},"id":1}]} 2024-09-17T03:08:41.914 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 6 2024-09-17T03:08:41.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.916+0000 7f3f595ba640 1 -- 172.21.15.78:0/632973662 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f34078b90 msgr2=0x7f3f3407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:41.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.916+0000 7f3f595ba640 1 --2- 172.21.15.78:0/632973662 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f34078b90 0x7f3f3407b0a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3f44005fd0 tx=0x7f3f44005850 comp rx=0 tx=0).stop 2024-09-17T03:08:41.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.916+0000 7f3f595ba640 1 -- 172.21.15.78:0/632973662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f540ceb40 msgr2=0x7f3f5415fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:41.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.916+0000 7f3f595ba640 1 --2- 172.21.15.78:0/632973662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f540ceb40 0x7f3f5415fa40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00c370 tx=0x7f3f3c00c830 comp rx=0 tx=0).stop 2024-09-17T03:08:41.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.916+0000 7f3f595ba640 1 -- 172.21.15.78:0/632973662 shutdown_connections 2024-09-17T03:08:41.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.916+0000 7f3f595ba640 1 --2- 172.21.15.78:0/632973662 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f34078b90 0x7f3f3407b0a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.916+0000 7f3f595ba640 1 --2- 172.21.15.78:0/632973662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f541f88d0 0x7f3f541f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.916+0000 7f3f595ba640 1 --2- 172.21.15.78:0/632973662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f540ceb40 0x7f3f5415fa40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.916+0000 7f3f595ba640 1 --2- 172.21.15.78:0/632973662 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3f5406f4b0 0x7f3f5409e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:41.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.916+0000 7f3f595ba640 1 -- 172.21.15.78:0/632973662 >> 172.21.15.78:0/632973662 conn(0x7f3f5408bfc0 msgr2=0x7f3f54161970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:41.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.916+0000 7f3f595ba640 1 -- 172.21.15.78:0/632973662 shutdown_connections 2024-09-17T03:08:41.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:41.916+0000 7f3f595ba640 1 -- 172.21.15.78:0/632973662 wait complete. 2024-09-17T03:08:41.927 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:08:42.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.039+0000 7f46d5c70640 1 -- 172.21.15.78:0/1232167592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46d0074420 msgr2=0x7f46d006fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:42.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.039+0000 7f46d5c70640 1 --2- 172.21.15.78:0/1232167592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46d0074420 0x7f46d006fe30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009830 tx=0x7f46c002a4a0 comp rx=0 tx=0).stop 2024-09-17T03:08:42.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.039+0000 7f46d5c70640 1 -- 172.21.15.78:0/1232167592 shutdown_connections 2024-09-17T03:08:42.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.039+0000 7f46d5c70640 1 --2- 172.21.15.78:0/1232167592 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f46d0155ce0 0x7f46d00b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:42.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.039+0000 7f46d5c70640 1 --2- 172.21.15.78:0/1232167592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46d0074420 0x7f46d006fe30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:42.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.039+0000 7f46d5c70640 1 -- 172.21.15.78:0/1232167592 >> 172.21.15.78:0/1232167592 conn(0x7f46d006def0 msgr2=0x7f46d006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:42.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.039+0000 7f46d5c70640 1 -- 172.21.15.78:0/1232167592 shutdown_connections 2024-09-17T03:08:42.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.039+0000 7f46d5c70640 1 -- 172.21.15.78:0/1232167592 wait complete. 2024-09-17T03:08:42.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.041+0000 7f46d5c70640 1 Processor -- start 2024-09-17T03:08:42.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.041+0000 7f46d5c70640 1 -- start start 2024-09-17T03:08:42.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.042+0000 7f46d5c70640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46d0074420 0x7f46d01f4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:42.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.042+0000 7f46d5c70640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46d0155ce0 0x7f46d006cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:42.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.042+0000 7f46d5c70640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f46d00b39d0 0x7f46d006d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:42.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.042+0000 7f46d5c70640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f46d00b5090 con 0x7f46d0155ce0 2024-09-17T03:08:42.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.042+0000 7f46d5c70640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f46d00b4f10 con 0x7f46d0074420 2024-09-17T03:08:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.042+0000 7f46d5c70640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f46d00b5210 con 0x7f46d00b39d0 2024-09-17T03:08:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.042+0000 7f46ceffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46d0155ce0 0x7f46d006cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.042+0000 7f46ceffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46d0155ce0 0x7f46d006cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34456/0 (socket says 172.21.15.78:34456) 2024-09-17T03:08:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.042+0000 7f46ceffd640 1 -- 172.21.15.78:0/1804375044 learned_addr learned my addr 172.21.15.78:0/1804375044 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.042+0000 7f46cf7fe640 1 --2- 172.21.15.78:0/1804375044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46d0074420 0x7f46d01f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.042+0000 7f46cffff640 1 --2- 172.21.15.78:0/1804375044 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f46d00b39d0 0x7f46d006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.042+0000 7f46ceffd640 1 -- 172.21.15.78:0/1804375044 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f46d00b39d0 msgr2=0x7f46d006d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.042+0000 7f46ceffd640 1 --2- 172.21.15.78:0/1804375044 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f46d00b39d0 0x7f46d006d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.043+0000 7f46ceffd640 1 -- 172.21.15.78:0/1804375044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46d0074420 msgr2=0x7f46d01f4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.043+0000 7f46ceffd640 1 --2- 172.21.15.78:0/1804375044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46d0074420 0x7f46d01f4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.043+0000 7f46ceffd640 1 -- 172.21.15.78:0/1804375044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46d0150640 con 0x7f46d0155ce0 2024-09-17T03:08:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.043+0000 7f46cffff640 1 --2- 172.21.15.78:0/1804375044 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f46d00b39d0 0x7f46d006d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:42.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.043+0000 7f46ceffd640 1 --2- 172.21.15.78:0/1804375044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46d0155ce0 0x7f46d006cde0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f46c400c530 tx=0x7f46c400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:42.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.043+0000 7f46b7fff640 1 -- 172.21.15.78:0/1804375044 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c4016020 con 0x7f46d0155ce0 2024-09-17T03:08:42.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.043+0000 7f46b7fff640 1 -- 172.21.15.78:0/1804375044 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46c4012920 con 0x7f46d0155ce0 2024-09-17T03:08:42.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.043+0000 7f46d5c70640 1 -- 172.21.15.78:0/1804375044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46d0153c70 con 0x7f46d0155ce0 2024-09-17T03:08:42.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.043+0000 7f46b7fff640 1 -- 172.21.15.78:0/1804375044 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c4012d70 con 0x7f46d0155ce0 2024-09-17T03:08:42.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.043+0000 7f46d5c70640 1 -- 172.21.15.78:0/1804375044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46d0153f50 con 0x7f46d0155ce0 2024-09-17T03:08:42.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.044+0000 7f46d5c70640 1 -- 172.21.15.78:0/1804375044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46d00b5770 con 0x7f46d0155ce0 2024-09-17T03:08:42.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.045+0000 7f46b7fff640 1 -- 172.21.15.78:0/1804375044 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f46c4019020 con 0x7f46d0155ce0 2024-09-17T03:08:42.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.045+0000 7f46b7fff640 1 --2- 172.21.15.78:0/1804375044 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f46bc078bc0 0x7f46bc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:42.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.045+0000 7f46b7fff640 1 -- 172.21.15.78:0/1804375044 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f46c409ad80 con 0x7f46d0155ce0 2024-09-17T03:08:42.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.045+0000 7f46cf7fe640 1 --2- 172.21.15.78:0/1804375044 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f46bc078bc0 0x7f46bc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:42.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.046+0000 7f46cf7fe640 1 --2- 172.21.15.78:0/1804375044 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f46bc078bc0 0x7f46bc07b0d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f46c0034000 tx=0x7f46c0004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:42.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.050+0000 7f46b7fff640 1 -- 172.21.15.78:0/1804375044 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f46c4020020 con 0x7f46d0155ce0 2024-09-17T03:08:42.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.227+0000 7f46d5c70640 1 -- 172.21.15.78:0/1804375044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46d015e790 con 0x7f46d0155ce0 2024-09-17T03:08:42.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.228+0000 7f46b7fff640 1 -- 172.21.15.78:0/1804375044 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16641 (secure 0 0 0) 0x7f46c40631c0 con 0x7f46d0155ce0 2024-09-17T03:08:42.228 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:42.229 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:08:29.222925+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:08:25.448752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:08:26.544015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:08:42.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.231+0000 7f46d5c70640 1 -- 172.21.15.78:0/1804375044 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f46bc078bc0 msgr2=0x7f46bc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:42.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.231+0000 7f46d5c70640 1 --2- 172.21.15.78:0/1804375044 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f46bc078bc0 0x7f46bc07b0d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f46c0034000 tx=0x7f46c0004730 comp rx=0 tx=0).stop 2024-09-17T03:08:42.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.231+0000 7f46d5c70640 1 -- 172.21.15.78:0/1804375044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46d0155ce0 msgr2=0x7f46d006cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:42.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.231+0000 7f46d5c70640 1 --2- 172.21.15.78:0/1804375044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46d0155ce0 0x7f46d006cde0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f46c400c530 tx=0x7f46c400c9f0 comp rx=0 tx=0).stop 2024-09-17T03:08:42.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.231+0000 7f46d5c70640 1 -- 172.21.15.78:0/1804375044 shutdown_connections 2024-09-17T03:08:42.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.231+0000 7f46d5c70640 1 --2- 172.21.15.78:0/1804375044 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f46d00b39d0 0x7f46d006d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:42.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.231+0000 7f46d5c70640 1 --2- 172.21.15.78:0/1804375044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46d0155ce0 0x7f46d006cde0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:42.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.231+0000 7f46d5c70640 1 --2- 172.21.15.78:0/1804375044 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f46bc078bc0 0x7f46bc07b0d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:42.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.231+0000 7f46d5c70640 1 --2- 172.21.15.78:0/1804375044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46d0074420 0x7f46d01f4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:42.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.231+0000 7f46d5c70640 1 -- 172.21.15.78:0/1804375044 >> 172.21.15.78:0/1804375044 conn(0x7f46d006def0 msgr2=0x7f46d01e6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:42.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.231+0000 7f46d5c70640 1 -- 172.21.15.78:0/1804375044 shutdown_connections 2024-09-17T03:08:42.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.231+0000 7f46d5c70640 1 -- 172.21.15.78:0/1804375044 wait complete. 2024-09-17T03:08:42.242 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:08:42.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.355+0000 7f75b0a64640 1 -- 172.21.15.78:0/528547066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7598004800 msgr2=0x7f7598004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:42.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.355+0000 7f75b0a64640 1 --2- 172.21.15.78:0/528547066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7598004800 0x7f7598004c10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7594009b50 tx=0x7f7598005830 comp rx=0 tx=0).stop 2024-09-17T03:08:42.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.355+0000 7f75b0a64640 1 -- 172.21.15.78:0/528547066 shutdown_connections 2024-09-17T03:08:42.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.355+0000 7f75b0a64640 1 --2- 172.21.15.78:0/528547066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7598004800 0x7f7598004c10 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:42.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.355+0000 7f75b0a64640 1 -- 172.21.15.78:0/528547066 >> 172.21.15.78:0/528547066 conn(0x7f75ac06d550 msgr2=0x7f75ac071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:42.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.355+0000 7f75b0a64640 1 -- 172.21.15.78:0/528547066 shutdown_connections 2024-09-17T03:08:42.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.355+0000 7f75b0a64640 1 -- 172.21.15.78:0/528547066 wait complete. 2024-09-17T03:08:42.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.357+0000 7f75b0a64640 1 Processor -- start 2024-09-17T03:08:42.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.357+0000 7f75b0a64640 1 -- start start 2024-09-17T03:08:42.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.358+0000 7f75b0a64640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7598004800 0x7f75ac0cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:42.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.358+0000 7f75b0a64640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75ac153790 0x7f75ac15ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:42.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.358+0000 7f75b0a64640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75ac15bf60 0x7f75ac1f8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:42.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.358+0000 7f75b0a64640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac15d4c0 con 0x7f75ac15bf60 2024-09-17T03:08:42.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.359+0000 7f75b0a64640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac15d340 con 0x7f7598004800 2024-09-17T03:08:42.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.359+0000 7f75b0a64640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f75ac0d1f20 con 0x7f75ac153790 2024-09-17T03:08:42.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.359+0000 7f75aad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75ac15bf60 0x7f75ac1f8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:42.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.359+0000 7f75aad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75ac15bf60 0x7f75ac1f8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34478/0 (socket says 172.21.15.78:34478) 2024-09-17T03:08:42.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.359+0000 7f75aad9d640 1 -- 172.21.15.78:0/2887429581 learned_addr learned my addr 172.21.15.78:0/2887429581 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:42.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.359+0000 7f75aa59c640 1 --2- 172.21.15.78:0/2887429581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7598004800 0x7f75ac0cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:42.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.359+0000 7f75a1d9b640 1 --2- 172.21.15.78:0/2887429581 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75ac153790 0x7f75ac15ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:42.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.359+0000 7f75aad9d640 1 -- 172.21.15.78:0/2887429581 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75ac153790 msgr2=0x7f75ac15ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:42.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.359+0000 7f75aad9d640 1 --2- 172.21.15.78:0/2887429581 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75ac153790 0x7f75ac15ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:42.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.359+0000 7f75aad9d640 1 -- 172.21.15.78:0/2887429581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7598004800 msgr2=0x7f75ac0cc320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:42.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.359+0000 7f75aad9d640 1 --2- 172.21.15.78:0/2887429581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7598004800 0x7f75ac0cc320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:42.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.359+0000 7f75aad9d640 1 -- 172.21.15.78:0/2887429581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ac15c370 con 0x7f75ac15bf60 2024-09-17T03:08:42.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.359+0000 7f75aa59c640 1 --2- 172.21.15.78:0/2887429581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7598004800 0x7f75ac0cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:42.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.359+0000 7f75a1d9b640 1 --2- 172.21.15.78:0/2887429581 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75ac153790 0x7f75ac15ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:42.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.359+0000 7f75aad9d640 1 --2- 172.21.15.78:0/2887429581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75ac15bf60 0x7f75ac1f8f60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0d2de0 tx=0x7f75a4001b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:42.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.359+0000 7f75a37fe640 1 -- 172.21.15.78:0/2887429581 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a4010890 con 0x7f75ac15bf60 2024-09-17T03:08:42.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.359+0000 7f75a37fe640 1 -- 172.21.15.78:0/2887429581 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75a4017070 con 0x7f75ac15bf60 2024-09-17T03:08:42.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.359+0000 7f75b0a64640 1 -- 172.21.15.78:0/2887429581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ac1e7320 con 0x7f75ac15bf60 2024-09-17T03:08:42.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.359+0000 7f75a37fe640 1 -- 172.21.15.78:0/2887429581 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a4010dc0 con 0x7f75ac15bf60 2024-09-17T03:08:42.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.359+0000 7f75b0a64640 1 -- 172.21.15.78:0/2887429581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ac1e78e0 con 0x7f75ac15bf60 2024-09-17T03:08:42.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.360+0000 7f75b0a64640 1 -- 172.21.15.78:0/2887429581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75ac0d2480 con 0x7f75ac15bf60 2024-09-17T03:08:42.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.361+0000 7f75a37fe640 1 -- 172.21.15.78:0/2887429581 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f75a401c460 con 0x7f75ac15bf60 2024-09-17T03:08:42.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.361+0000 7f75a37fe640 1 --2- 172.21.15.78:0/2887429581 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f758c078b90 0x7f758c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:42.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.362+0000 7f75a37fe640 1 -- 172.21.15.78:0/2887429581 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f75a409b650 con 0x7f75ac15bf60 2024-09-17T03:08:42.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.362+0000 7f75aa59c640 1 --2- 172.21.15.78:0/2887429581 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f758c078b90 0x7f758c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:42.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.362+0000 7f75aa59c640 1 --2- 172.21.15.78:0/2887429581 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f758c078b90 0x7f758c07b0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f759c000f60 tx=0x7f759c000ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:42.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.366+0000 7f75a37fe640 1 -- 172.21.15.78:0/2887429581 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f75ac15c370 con 0x7f75ac15bf60 2024-09-17T03:08:42.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.573+0000 7f75b0a64640 1 -- 172.21.15.78:0/2887429581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75ac1e70b0 con 0x7f75ac15bf60 2024-09-17T03:08:42.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.574+0000 7f75a37fe640 1 -- 172.21.15.78:0/2887429581 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5220 (secure 0 0 0) 0x7f75a4063b20 con 0x7f75ac15bf60 2024-09-17T03:08:42.574 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:42.574 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":6,"btime":"2024-09-17T03:08:30:244213+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/3111681444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3111681444},{"type":"v1","addr":"172.21.15.78:6833","nonce":3111681444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1920750629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1920750629},{"type":"v1","addr":"172.21.15.193:6836","nonce":1920750629}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4416,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2220463802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2220463802},{"type":"v1","addr":"172.21.15.78:6835","nonce":2220463802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:08:27.583934+0000","modified":"2024-09-17T03:08:29.592351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4425},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4425":{"gid":4425,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6837/934698838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":934698838},{"type":"v1","addr":"172.21.15.193:6837","nonce":934698838}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4425,"qdb_cluster":[4425]},"id":1}]} 2024-09-17T03:08:42.574 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 6 2024-09-17T03:08:42.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.576+0000 7f75b0a64640 1 -- 172.21.15.78:0/2887429581 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f758c078b90 msgr2=0x7f758c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:42.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.576+0000 7f75b0a64640 1 --2- 172.21.15.78:0/2887429581 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f758c078b90 0x7f758c07b0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f759c000f60 tx=0x7f759c000ed0 comp rx=0 tx=0).stop 2024-09-17T03:08:42.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.576+0000 7f75b0a64640 1 -- 172.21.15.78:0/2887429581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75ac15bf60 msgr2=0x7f75ac1f8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:42.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.576+0000 7f75b0a64640 1 --2- 172.21.15.78:0/2887429581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75ac15bf60 0x7f75ac1f8f60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0d2de0 tx=0x7f75a4001b80 comp rx=0 tx=0).stop 2024-09-17T03:08:42.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.576+0000 7f75b0a64640 1 -- 172.21.15.78:0/2887429581 shutdown_connections 2024-09-17T03:08:42.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.576+0000 7f75b0a64640 1 --2- 172.21.15.78:0/2887429581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75ac15bf60 0x7f75ac1f8f60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:42.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.576+0000 7f75b0a64640 1 --2- 172.21.15.78:0/2887429581 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75ac153790 0x7f75ac15ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:42.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.576+0000 7f75b0a64640 1 --2- 172.21.15.78:0/2887429581 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f758c078b90 0x7f758c07b0a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:42.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.576+0000 7f75b0a64640 1 --2- 172.21.15.78:0/2887429581 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7598004800 0x7f75ac0cc320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:42.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.576+0000 7f75b0a64640 1 -- 172.21.15.78:0/2887429581 >> 172.21.15.78:0/2887429581 conn(0x7f75ac06d550 msgr2=0x7f75ac0b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:42.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.576+0000 7f75b0a64640 1 -- 172.21.15.78:0/2887429581 shutdown_connections 2024-09-17T03:08:42.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:42.576+0000 7f75b0a64640 1 -- 172.21.15.78:0/2887429581 wait complete. 2024-09-17T03:08:42.991 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:08:27.583934+0000', 'modified': '2024-09-17T03:08:29.592351+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4425}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4425': {'gid': 4425, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.193:6837/934698838', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6834', 'nonce': 934698838}, {'type': 'v1', 'addr': '172.21.15.193:6837', 'nonce': 934698838}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4425, 'qdb_cluster': [4425]} 2024-09-17T03:08:42.991 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:08:42.991 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T03:08:43.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.107+0000 7f06eb539640 1 -- 172.21.15.78:0/1332816159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e40d1d40 msgr2=0x7f06e40b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:43.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.107+0000 7f06eb539640 1 --2- 172.21.15.78:0/1332816159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e40d1d40 0x7f06e40b5210 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f06e4074550 tx=0x7f06d402aa30 comp rx=0 tx=0).stop 2024-09-17T03:08:43.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.107+0000 7f06eb539640 1 -- 172.21.15.78:0/1332816159 shutdown_connections 2024-09-17T03:08:43.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.107+0000 7f06eb539640 1 --2- 172.21.15.78:0/1332816159 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f06e40ccba0 0x7f06e40ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.107+0000 7f06eb539640 1 --2- 172.21.15.78:0/1332816159 >> v2:172.21.15.193:3300/0 conn(0x7f06e415c6f0 0x7f06e40ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.107+0000 7f06eb539640 1 --2- 172.21.15.78:0/1332816159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e40d1d40 0x7f06e40b5210 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.107+0000 7f06eb539640 1 -- 172.21.15.78:0/1332816159 >> 172.21.15.78:0/1332816159 conn(0x7f06e40b3f10 msgr2=0x7f06e40b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:43.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.107+0000 7f06eb539640 1 -- 172.21.15.78:0/1332816159 shutdown_connections 2024-09-17T03:08:43.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.107+0000 7f06eb539640 1 -- 172.21.15.78:0/1332816159 wait complete. 2024-09-17T03:08:43.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.108+0000 7f06eb539640 1 Processor -- start 2024-09-17T03:08:43.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.109+0000 7f06eb539640 1 -- start start 2024-09-17T03:08:43.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06eb539640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06e40ccba0 0x7f06e414d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06eb539640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e40d1d40 0x7f06e4157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06eb539640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f06e415c6f0 0x7f06e40cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06eb539640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f06e40d11f0 con 0x7f06e40d1d40 2024-09-17T03:08:43.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06eb539640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f06e40d1070 con 0x7f06e40ccba0 2024-09-17T03:08:43.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06eb539640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f06e40d1370 con 0x7f06e415c6f0 2024-09-17T03:08:43.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06e8ad4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e40d1d40 0x7f06e4157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06e8ad4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e40d1d40 0x7f06e4157060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34486/0 (socket says 172.21.15.78:34486) 2024-09-17T03:08:43.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06e8ad4640 1 -- 172.21.15.78:0/3610040509 learned_addr learned my addr 172.21.15.78:0/3610040509 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:43.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06e92d5640 1 --2- 172.21.15.78:0/3610040509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06e40ccba0 0x7f06e414d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06e9ad6640 1 --2- 172.21.15.78:0/3610040509 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f06e415c6f0 0x7f06e40cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06e8ad4640 1 -- 172.21.15.78:0/3610040509 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f06e415c6f0 msgr2=0x7f06e40cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:43.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06e8ad4640 1 --2- 172.21.15.78:0/3610040509 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f06e415c6f0 0x7f06e40cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06e8ad4640 1 -- 172.21.15.78:0/3610040509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06e40ccba0 msgr2=0x7f06e414d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:43.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06e8ad4640 1 --2- 172.21.15.78:0/3610040509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06e40ccba0 0x7f06e414d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06e8ad4640 1 -- 172.21.15.78:0/3610040509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e41575a0 con 0x7f06e40d1d40 2024-09-17T03:08:43.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06e9ad6640 1 --2- 172.21.15.78:0/3610040509 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f06e415c6f0 0x7f06e40cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:43.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06e8ad4640 1 --2- 172.21.15.78:0/3610040509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e40d1d40 0x7f06e4157060 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f06d800d740 tx=0x7f06d800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:43.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06e1ffb640 1 -- 172.21.15.78:0/3610040509 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d8017070 con 0x7f06e40d1d40 2024-09-17T03:08:43.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06e1ffb640 1 -- 172.21.15.78:0/3610040509 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06d8009d20 con 0x7f06e40d1d40 2024-09-17T03:08:43.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.110+0000 7f06eb539640 1 -- 172.21.15.78:0/3610040509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e41f7140 con 0x7f06e40d1d40 2024-09-17T03:08:43.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.111+0000 7f06e1ffb640 1 -- 172.21.15.78:0/3610040509 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d80106c0 con 0x7f06e40d1d40 2024-09-17T03:08:43.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.111+0000 7f06eb539640 1 -- 172.21.15.78:0/3610040509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e41f7700 con 0x7f06e40d1d40 2024-09-17T03:08:43.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.112+0000 7f06e1ffb640 1 -- 172.21.15.78:0/3610040509 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f06d801a070 con 0x7f06e40d1d40 2024-09-17T03:08:43.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.113+0000 7f06e1ffb640 1 --2- 172.21.15.78:0/3610040509 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f06d0078b90 0x7f06d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.113+0000 7f06e1ffb640 1 -- 172.21.15.78:0/3610040509 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f06d809ad00 con 0x7f06e40d1d40 2024-09-17T03:08:43.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.113+0000 7f06e92d5640 1 --2- 172.21.15.78:0/3610040509 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f06d0078b90 0x7f06d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.114+0000 7f06f24aa740 1 Processor -- start 2024-09-17T03:08:43.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.114+0000 7f06f24aa740 1 -- start start 2024-09-17T03:08:43.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.114+0000 7f06e92d5640 1 --2- 172.21.15.78:0/3610040509 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f06d0078b90 0x7f06d007b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f06d4035000 tx=0x7f06d403b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:43.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.115+0000 7f06f24aa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205edd270 0x5572062aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.115+0000 7f06f24aa740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205eb43b0 0x5572062af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.115+0000 7f06f24aa740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205ebc590 0x5572062cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.115+0000 7f06f24aa740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5572061f7820 con 0x557205eb43b0 2024-09-17T03:08:43.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.115+0000 7f06f24aa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5572061e6c50 con 0x557205edd270 2024-09-17T03:08:43.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.115+0000 7f06f24aa740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5572061eaa60 con 0x557205ebc590 2024-09-17T03:08:43.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.115+0000 7f06e8ad4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205eb43b0 0x5572062af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.115+0000 7f06e8ad4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205eb43b0 0x5572062af4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34490/0 (socket says 172.21.15.78:34490) 2024-09-17T03:08:43.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.115+0000 7f06e8ad4640 1 -- 172.21.15.78:0/407962601 learned_addr learned my addr 172.21.15.78:0/407962601 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:43.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.115+0000 7f06e92d5640 1 --2- 172.21.15.78:0/407962601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205edd270 0x5572062aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.115+0000 7f06e8ad4640 1 -- 172.21.15.78:0/407962601 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205ebc590 msgr2=0x5572062cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:08:43.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.115+0000 7f06e9ad6640 1 --2- 172.21.15.78:0/407962601 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205ebc590 0x5572062cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.115+0000 7f06e8ad4640 1 --2- 172.21.15.78:0/407962601 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205ebc590 0x5572062cc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.115+0000 7f06e8ad4640 1 -- 172.21.15.78:0/407962601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205edd270 msgr2=0x5572062aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:08:43.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.115+0000 7f06e8ad4640 1 --2- 172.21.15.78:0/407962601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205edd270 0x5572062aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.115+0000 7f06e8ad4640 1 -- 172.21.15.78:0/407962601 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557205f48850 con 0x557205eb43b0 2024-09-17T03:08:43.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.116+0000 7f06e8ad4640 1 --2- 172.21.15.78:0/407962601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205eb43b0 0x5572062af4e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f06d80992e0 tx=0x7f06d8062410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938bc8452de595d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:43.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.116+0000 7f06caffd640 1 -- 172.21.15.78:0/407962601 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d8021030 con 0x557205eb43b0 2024-09-17T03:08:43.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.116+0000 7f06caffd640 1 -- 172.21.15.78:0/407962601 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06d80676d0 con 0x557205eb43b0 2024-09-17T03:08:43.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.116+0000 7f06caffd640 1 -- 172.21.15.78:0/407962601 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d8062160 con 0x557205eb43b0 2024-09-17T03:08:43.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.116+0000 7f06f24aa740 1 -- 172.21.15.78:0/407962601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205eb43b0 msgr2=0x5572062af4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:43.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.116+0000 7f06f24aa740 1 --2- 172.21.15.78:0/407962601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205eb43b0 0x5572062af4e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f06d80992e0 tx=0x7f06d8062410 comp rx=0 tx=0).stop 2024-09-17T03:08:43.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.117+0000 7f06f24aa740 1 -- 172.21.15.78:0/407962601 shutdown_connections 2024-09-17T03:08:43.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.117+0000 7f06f24aa740 1 --2- 172.21.15.78:0/407962601 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205ebc590 0x5572062cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.117+0000 7f06f24aa740 1 --2- 172.21.15.78:0/407962601 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205eb43b0 0x5572062af4e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.117+0000 7f06f24aa740 1 --2- 172.21.15.78:0/407962601 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205edd270 0x5572062aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.117+0000 7f06f24aa740 1 -- 172.21.15.78:0/407962601 >> 172.21.15.78:0/407962601 conn(0x557205ed13c0 msgr2=0x557206285260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:43.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.117+0000 7f06f24aa740 1 -- 172.21.15.78:0/407962601 shutdown_connections 2024-09-17T03:08:43.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.117+0000 7f06f24aa740 1 -- 172.21.15.78:0/407962601 wait complete. 2024-09-17T03:08:43.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.117+0000 7f06f24aa740 1 -- start start 2024-09-17T03:08:43.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.118+0000 7f06f24aa740 1 Processor -- start 2024-09-17T03:08:43.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.119+0000 7f06f24aa740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205eb43b0 0x5572062c3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.119+0000 7f06f24aa740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205ebc590 0x55720628c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.119+0000 7f06f24aa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205edd270 0x5572062cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.119+0000 7f06f24aa740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557205f57620 con 0x557205ebc590 2024-09-17T03:08:43.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.119+0000 7f06f24aa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55720618c5f0 con 0x557205edd270 2024-09-17T03:08:43.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.119+0000 7f06f24aa740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5572062afa20 con 0x557205eb43b0 2024-09-17T03:08:43.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.119+0000 7f06f24aa740 10 client.0 _ll_register_callbacks cb 0x5572061900a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:08:43.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.119+0000 7f06e8ad4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205ebc590 0x55720628c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.119+0000 7f06e8ad4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205ebc590 0x55720628c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34506/0 (socket says 172.21.15.78:34506) 2024-09-17T03:08:43.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.119+0000 7f06e8ad4640 1 -- 172.21.15.78:0/1515371068 learned_addr learned my addr 172.21.15.78:0/1515371068 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:43.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.119+0000 7f06e92d5640 1 --2- 172.21.15.78:0/1515371068 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205eb43b0 0x5572062c3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.119+0000 7f06e9ad6640 1 --2- 172.21.15.78:0/1515371068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205edd270 0x5572062cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.119+0000 7f06e8ad4640 1 -- 172.21.15.78:0/1515371068 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205eb43b0 msgr2=0x5572062c3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:08:43.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.119+0000 7f06e8ad4640 1 --2- 172.21.15.78:0/1515371068 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205eb43b0 0x5572062c3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.119+0000 7f06e8ad4640 1 -- 172.21.15.78:0/1515371068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205edd270 msgr2=0x5572062cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:08:43.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.119+0000 7f06e8ad4640 1 --2- 172.21.15.78:0/1515371068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205edd270 0x5572062cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.119+0000 7f06e8ad4640 1 -- 172.21.15.78:0/1515371068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557205fbf6b0 con 0x557205ebc590 2024-09-17T03:08:43.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.119+0000 7f06e9ad6640 1 --2- 172.21.15.78:0/1515371068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205edd270 0x5572062cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:08:43.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.119+0000 7f06e8ad4640 1 --2- 172.21.15.78:0/1515371068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205ebc590 0x55720628c3d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f06d809b020 tx=0x7f06d80621b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6bfb291ebce2371 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:43.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.119+0000 7f06c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:08:43.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.120+0000 7f06c3fff640 1 -- 172.21.15.78:0/1515371068 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d8021070 con 0x557205ebc590 2024-09-17T03:08:43.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.120+0000 7f06c3fff640 1 -- 172.21.15.78:0/1515371068 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f06d805e800 con 0x557205ebc590 2024-09-17T03:08:43.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.120+0000 7f06f24aa740 1 -- 172.21.15.78:0/1515371068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06d80676d0 con 0x557205ebc590 2024-09-17T03:08:43.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.120+0000 7f06c3fff640 1 -- 172.21.15.78:0/1515371068 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f06d804e100 con 0x557205ebc590 2024-09-17T03:08:43.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.120+0000 7f06f24aa740 10 client.4734 fetch_fsmap learned FSMap version 6 2024-09-17T03:08:43.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.120+0000 7f06f24aa740 1 -- 172.21.15.78:0/1515371068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55720629add0 con 0x557205ebc590 2024-09-17T03:08:43.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.120+0000 7f06c3fff640 1 -- 172.21.15.78:0/1515371068 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06d80676d0 con 0x557205ebc590 2024-09-17T03:08:43.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.120+0000 7f06c3fff640 1 -- 172.21.15.78:0/1515371068 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f06d8061970 con 0x557205ebc590 2024-09-17T03:08:43.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.120+0000 7f06f24aa740 10 client.4734 fetch_fsmap finished waiting for FSMap version 6 2024-09-17T03:08:43.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.120+0000 7f06f24aa740 10 client.4734 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T03:08:43.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.120+0000 7f06f24aa740 20 client.4734 populate_metadata read hostname 'smithi078' 2024-09-17T03:08:43.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.120+0000 7f06f24aa740 1 --2- 172.21.15.78:0/1515371068 >> [v2:172.21.15.193:6834/934698838,v1:172.21.15.193:6837/934698838] conn(0x557205e9be40 0x5572062dcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.120+0000 7f06f24aa740 4 client.4734 mds_command: new command op to 4425 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:08:43.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.120+0000 7f06f24aa740 1 -- 172.21.15.78:0/1515371068 --> [v2:172.21.15.193:6834/934698838,v1:172.21.15.193:6837/934698838] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572061f9770 con 0x557205e9be40 2024-09-17T03:08:43.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.120+0000 7f06e92d5640 1 --2- 172.21.15.78:0/1515371068 >> [v2:172.21.15.193:6834/934698838,v1:172.21.15.193:6837/934698838] conn(0x557205e9be40 0x5572062dcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.121+0000 7f06e92d5640 1 --2- 172.21.15.78:0/1515371068 >> [v2:172.21.15.193:6834/934698838,v1:172.21.15.193:6837/934698838] conn(0x557205e9be40 0x5572062dcc70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4327e2c35292a0d9 server_cookie=81aab6ca56e484f0 in_seq=0 out_seq=0 2024-09-17T03:08:43.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.121+0000 7f06c3fff640 10 client.4734 ms_handle_connect on v2:172.21.15.193:6834/934698838 2024-09-17T03:08:43.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.122+0000 7f06c3fff640 1 -- 172.21.15.78:0/1515371068 <== mds.0 v2:172.21.15.193:6834/934698838 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5572061f9770 con 0x557205e9be40 2024-09-17T03:08:43.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.122+0000 7f06c3fff640 10 client.4734 handle_command_reply: tid=0 2024-09-17T03:08:43.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.122+0000 7f06f24aa740 1 client.4734 shutdown 2024-09-17T03:08:43.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.122+0000 7f06f24aa740 1 -- 172.21.15.78:0/1515371068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205ebc590 msgr2=0x55720628c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:43.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.122+0000 7f06f24aa740 1 --2- 172.21.15.78:0/1515371068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205ebc590 0x55720628c3d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f06d809b020 tx=0x7f06d80621b0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.122+0000 7f06f24aa740 1 -- 172.21.15.78:0/1515371068 shutdown_connections 2024-09-17T03:08:43.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.122+0000 7f06f24aa740 1 --2- 172.21.15.78:0/1515371068 >> [v2:172.21.15.193:6834/934698838,v1:172.21.15.193:6837/934698838] conn(0x557205e9be40 0x5572062dcc70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.122+0000 7f06f24aa740 1 --2- 172.21.15.78:0/1515371068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205edd270 0x5572062cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.122+0000 7f06c3fff640 0 client.4734 ms_handle_reset on v2:172.21.15.193:6834/934698838 2024-09-17T03:08:43.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.122+0000 7f06f24aa740 1 --2- 172.21.15.78:0/1515371068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205ebc590 0x55720628c3d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.122+0000 7f06f24aa740 1 --2- 172.21.15.78:0/1515371068 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205eb43b0 0x5572062c3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.122+0000 7f06f24aa740 1 -- 172.21.15.78:0/1515371068 >> 172.21.15.78:0/1515371068 conn(0x557205ed13c0 msgr2=0x55720627fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:43.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.122+0000 7f06f24aa740 1 -- 172.21.15.78:0/1515371068 shutdown_connections 2024-09-17T03:08:43.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.122+0000 7f06f24aa740 1 -- 172.21.15.78:0/1515371068 wait complete. 2024-09-17T03:08:43.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.122+0000 7f06f24aa740 20 client.4734 trim_cache size 0 max 16384 2024-09-17T03:08:43.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.140+0000 7f06f24aa740 1 Processor -- start 2024-09-17T03:08:43.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.140+0000 7f06f24aa740 1 -- start start 2024-09-17T03:08:43.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.141+0000 7f06f24aa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205e9be40 0x55720627e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.141+0000 7f06f24aa740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205eb43b0 0x55720627e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.141+0000 7f06f24aa740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205ebc590 0x55720629e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.141+0000 7f06f24aa740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f06e41fefb0 con 0x557205ebc590 2024-09-17T03:08:43.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.141+0000 7f06f24aa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f06e40ca870 con 0x557205e9be40 2024-09-17T03:08:43.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.141+0000 7f06f24aa740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f06e40caec0 con 0x557205eb43b0 2024-09-17T03:08:43.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.141+0000 7f06e9ad6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205ebc590 0x55720629e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.141+0000 7f06e9ad6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205ebc590 0x55720629e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34518/0 (socket says 172.21.15.78:34518) 2024-09-17T03:08:43.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.141+0000 7f06e9ad6640 1 -- 172.21.15.78:0/1175832506 learned_addr learned my addr 172.21.15.78:0/1175832506 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:43.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.142+0000 7f06e92d5640 1 --2- 172.21.15.78:0/1175832506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205e9be40 0x55720627e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.142+0000 7f06e8ad4640 1 --2- 172.21.15.78:0/1175832506 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205eb43b0 0x55720627e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.142+0000 7f06e9ad6640 1 -- 172.21.15.78:0/1175832506 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205eb43b0 msgr2=0x55720627e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:08:43.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.142+0000 7f06e9ad6640 1 --2- 172.21.15.78:0/1175832506 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205eb43b0 0x55720627e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.142+0000 7f06e9ad6640 1 -- 172.21.15.78:0/1175832506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205e9be40 msgr2=0x55720627e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:08:43.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.142+0000 7f06e9ad6640 1 --2- 172.21.15.78:0/1175832506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205e9be40 0x55720627e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.142+0000 7f06e9ad6640 1 -- 172.21.15.78:0/1175832506 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55720629a330 con 0x557205ebc590 2024-09-17T03:08:43.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.142+0000 7f06e9ad6640 1 --2- 172.21.15.78:0/1175832506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205ebc590 0x55720629e920 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00eb40 tx=0x7f06dc010430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0b11beaf4a5b41 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:43.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.142+0000 7f06ca7fc640 1 -- 172.21.15.78:0/1175832506 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc005220 con 0x557205ebc590 2024-09-17T03:08:43.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.142+0000 7f06ca7fc640 1 -- 172.21.15.78:0/1175832506 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06dc0054b0 con 0x557205ebc590 2024-09-17T03:08:43.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.142+0000 7f06ca7fc640 1 -- 172.21.15.78:0/1175832506 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc004a00 con 0x557205ebc590 2024-09-17T03:08:43.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.143+0000 7f06f24aa740 1 -- 172.21.15.78:0/1175832506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205ebc590 msgr2=0x55720629e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:43.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.143+0000 7f06f24aa740 1 --2- 172.21.15.78:0/1175832506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205ebc590 0x55720629e920 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00eb40 tx=0x7f06dc010430 comp rx=0 tx=0).stop 2024-09-17T03:08:43.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.143+0000 7f06f24aa740 1 -- 172.21.15.78:0/1175832506 shutdown_connections 2024-09-17T03:08:43.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.143+0000 7f06f24aa740 1 --2- 172.21.15.78:0/1175832506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205ebc590 0x55720629e920 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.143+0000 7f06f24aa740 1 --2- 172.21.15.78:0/1175832506 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205eb43b0 0x55720627e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.143+0000 7f06f24aa740 1 --2- 172.21.15.78:0/1175832506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205e9be40 0x55720627e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.143+0000 7f06f24aa740 1 -- 172.21.15.78:0/1175832506 >> 172.21.15.78:0/1175832506 conn(0x557205ed13c0 msgr2=0x557206299280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:43.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.143+0000 7f06f24aa740 1 -- 172.21.15.78:0/1175832506 shutdown_connections 2024-09-17T03:08:43.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.143+0000 7f06f24aa740 1 -- 172.21.15.78:0/1175832506 wait complete. 2024-09-17T03:08:43.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.144+0000 7f06f24aa740 1 -- start start 2024-09-17T03:08:43.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.144+0000 7f06f24aa740 1 Processor -- start 2024-09-17T03:08:43.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.145+0000 7f06f24aa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205e9be40 0x557206350520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.145+0000 7f06f24aa740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205eb43b0 0x557206343900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.145+0000 7f06f24aa740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205ebc590 0x557206297a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.145+0000 7f06f24aa740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5572062c3f40 con 0x557205eb43b0 2024-09-17T03:08:43.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.145+0000 7f06f24aa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557205f57620 con 0x557205e9be40 2024-09-17T03:08:43.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.145+0000 7f06f24aa740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55720628cad0 con 0x557205ebc590 2024-09-17T03:08:43.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.145+0000 7f06f24aa740 10 client.0 _ll_register_callbacks cb 0x7f06d806c580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:08:43.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.145+0000 7f06e8ad4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205eb43b0 0x557206343900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.145+0000 7f06e8ad4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205eb43b0 0x557206343900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34532/0 (socket says 172.21.15.78:34532) 2024-09-17T03:08:43.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.145+0000 7f06e8ad4640 1 -- 172.21.15.78:0/3695076664 learned_addr learned my addr 172.21.15.78:0/3695076664 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:43.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.145+0000 7f06e92d5640 1 --2- 172.21.15.78:0/3695076664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205e9be40 0x557206350520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.145+0000 7f06e9ad6640 1 --2- 172.21.15.78:0/3695076664 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205ebc590 0x557206297a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06e8ad4640 1 -- 172.21.15.78:0/3695076664 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205ebc590 msgr2=0x557206297a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:08:43.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06e8ad4640 1 --2- 172.21.15.78:0/3695076664 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205ebc590 0x557206297a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06e8ad4640 1 -- 172.21.15.78:0/3695076664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205e9be40 msgr2=0x557206350520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:08:43.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06e8ad4640 1 --2- 172.21.15.78:0/3695076664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205e9be40 0x557206350520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06e8ad4640 1 -- 172.21.15.78:0/3695076664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572062ecce0 con 0x557205eb43b0 2024-09-17T03:08:43.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06e9ad6640 1 --2- 172.21.15.78:0/3695076664 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205ebc590 0x557206297a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:08:43.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06e8ad4640 1 --2- 172.21.15.78:0/3695076664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205eb43b0 0x557206343900 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f06d800b640 tx=0x7f06d8061ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6caf284b0d1b76 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:43.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:08:43.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06c3fff640 1 -- 172.21.15.78:0/3695076664 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d8021030 con 0x557205eb43b0 2024-09-17T03:08:43.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06c3fff640 1 -- 172.21.15.78:0/3695076664 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f06d80672c0 con 0x557205eb43b0 2024-09-17T03:08:43.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06f24aa740 1 -- 172.21.15.78:0/3695076664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06dc0054b0 con 0x557205eb43b0 2024-09-17T03:08:43.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06c3fff640 1 -- 172.21.15.78:0/3695076664 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f06d8062220 con 0x557205eb43b0 2024-09-17T03:08:43.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06f24aa740 10 client.4740 fetch_fsmap learned FSMap version 6 2024-09-17T03:08:43.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06f24aa740 1 -- 172.21.15.78:0/3695076664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x557206350b60 con 0x557205eb43b0 2024-09-17T03:08:43.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06c3fff640 1 -- 172.21.15.78:0/3695076664 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06dc0054b0 con 0x557205eb43b0 2024-09-17T03:08:43.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06c3fff640 1 -- 172.21.15.78:0/3695076664 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f06d806bac0 con 0x557205eb43b0 2024-09-17T03:08:43.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06f24aa740 10 client.4740 fetch_fsmap finished waiting for FSMap version 6 2024-09-17T03:08:43.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06f24aa740 10 client.4740 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T03:08:43.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06f24aa740 20 client.4740 populate_metadata read hostname 'smithi078' 2024-09-17T03:08:43.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06f24aa740 1 --2- 172.21.15.78:0/3695076664 >> [v2:172.21.15.193:6834/934698838,v1:172.21.15.193:6837/934698838] conn(0x557205e71280 0x5572062855b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06f24aa740 4 client.4740 mds_command: new command op to 4425 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:08:43.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.146+0000 7f06f24aa740 1 -- 172.21.15.78:0/3695076664 --> [v2:172.21.15.193:6834/934698838,v1:172.21.15.193:6837/934698838] -- command(tid 0: {"prefix": "status"}) -- 0x5572062c0220 con 0x557205e71280 2024-09-17T03:08:43.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.147+0000 7f06e92d5640 1 --2- 172.21.15.78:0/3695076664 >> [v2:172.21.15.193:6834/934698838,v1:172.21.15.193:6837/934698838] conn(0x557205e71280 0x5572062855b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.147+0000 7f06c3fff640 10 client.4740 ms_handle_connect on v2:172.21.15.193:6834/934698838 2024-09-17T03:08:43.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.147+0000 7f06e92d5640 1 --2- 172.21.15.78:0/3695076664 >> [v2:172.21.15.193:6834/934698838,v1:172.21.15.193:6837/934698838] conn(0x557205e71280 0x5572062855b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e5be3688bf04136 server_cookie=79c84934b15d0d7c in_seq=0 out_seq=0 2024-09-17T03:08:43.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.147+0000 7f06c3fff640 1 -- 172.21.15.78:0/3695076664 <== mds.0 v2:172.21.15.193:6834/934698838 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x5572062c0220 con 0x557205e71280 2024-09-17T03:08:43.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.147+0000 7f06c3fff640 10 client.4740 handle_command_reply: tid=0 2024-09-17T03:08:43.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.147+0000 7f06f24aa740 1 client.4740 shutdown 2024-09-17T03:08:43.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.147+0000 7f06f24aa740 1 -- 172.21.15.78:0/3695076664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205eb43b0 msgr2=0x557206343900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:43.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.147+0000 7f06f24aa740 1 --2- 172.21.15.78:0/3695076664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205eb43b0 0x557206343900 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f06d800b640 tx=0x7f06d8061ba0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.147+0000 7f06f24aa740 1 -- 172.21.15.78:0/3695076664 shutdown_connections 2024-09-17T03:08:43.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.147+0000 7f06f24aa740 1 --2- 172.21.15.78:0/3695076664 >> [v2:172.21.15.193:6834/934698838,v1:172.21.15.193:6837/934698838] conn(0x557205e71280 0x5572062855b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.147+0000 7f06f24aa740 1 --2- 172.21.15.78:0/3695076664 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557205ebc590 0x557206297a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.147+0000 7f06f24aa740 1 --2- 172.21.15.78:0/3695076664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557205eb43b0 0x557206343900 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.147+0000 7f06c3fff640 0 client.4740 ms_handle_reset on v2:172.21.15.193:6834/934698838 2024-09-17T03:08:43.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.147+0000 7f06f24aa740 1 --2- 172.21.15.78:0/3695076664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557205e9be40 0x557206350520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.147+0000 7f06f24aa740 1 -- 172.21.15.78:0/3695076664 >> 172.21.15.78:0/3695076664 conn(0x557205ed13c0 msgr2=0x55720627a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:43.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.147+0000 7f06f24aa740 1 -- 172.21.15.78:0/3695076664 shutdown_connections 2024-09-17T03:08:43.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.147+0000 7f06f24aa740 1 -- 172.21.15.78:0/3695076664 wait complete. 2024-09-17T03:08:43.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.148+0000 7f06f24aa740 20 client.4740 trim_cache size 0 max 16384 2024-09-17T03:08:43.156 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:08:43.156 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:08:43.156 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-09-17T03:08:43.156 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4425, 2024-09-17T03:08:43.156 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:08:43.156 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:08:43.156 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:08:43.156 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 14.925746888999999, 2024-09-17T03:08:43.157 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 6, 2024-09-17T03:08:43.157 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 23, 2024-09-17T03:08:43.157 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 23, 2024-09-17T03:08:43.157 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 20.93846941 2024-09-17T03:08:43.157 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:08:43.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.148+0000 7f06eb539640 1 -- 172.21.15.78:0/3610040509 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f06d0078b90 msgr2=0x7f06d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:43.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.148+0000 7f06eb539640 1 --2- 172.21.15.78:0/3610040509 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f06d0078b90 0x7f06d007b0a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f06d4035000 tx=0x7f06d403b040 comp rx=0 tx=0).stop 2024-09-17T03:08:43.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.148+0000 7f06eb539640 1 -- 172.21.15.78:0/3610040509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e40d1d40 msgr2=0x7f06e4157060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:43.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.148+0000 7f06eb539640 1 --2- 172.21.15.78:0/3610040509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e40d1d40 0x7f06e4157060 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f06d800d740 tx=0x7f06d800dc00 comp rx=0 tx=0).stop 2024-09-17T03:08:43.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.148+0000 7f06eb539640 1 -- 172.21.15.78:0/3610040509 shutdown_connections 2024-09-17T03:08:43.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.148+0000 7f06eb539640 1 --2- 172.21.15.78:0/3610040509 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f06e415c6f0 0x7f06e40cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.148+0000 7f06eb539640 1 --2- 172.21.15.78:0/3610040509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06e40d1d40 0x7f06e4157060 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.148+0000 7f06eb539640 1 --2- 172.21.15.78:0/3610040509 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f06d0078b90 0x7f06d007b0a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.148+0000 7f06eb539640 1 --2- 172.21.15.78:0/3610040509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06e40ccba0 0x7f06e414d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.148+0000 7f06eb539640 1 -- 172.21.15.78:0/3610040509 >> 172.21.15.78:0/3610040509 conn(0x7f06e40b3f10 msgr2=0x7f06e40b7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:43.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.148+0000 7f06eb539640 1 -- 172.21.15.78:0/3610040509 shutdown_connections 2024-09-17T03:08:43.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.148+0000 7f06eb539640 1 -- 172.21.15.78:0/3610040509 wait complete. 2024-09-17T03:08:43.160 INFO:teuthology.run_tasks:Running task kclient... 2024-09-17T03:08:43.190 INFO:tasks.kclient:Mounting kernel clients... 2024-09-17T03:08:43.190 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-17T03:08:43.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:43.190 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-17T03:08:43.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:43.207 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2024-09-17T03:08:43.273 INFO:teuthology.orchestra.run.smithi078.stderr:Cannot find device "ceph-brx" 2024-09-17T03:08:43.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:08:43.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:43.274 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-17T03:08:43.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:43.331 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2024-09-17T03:08:43.395 INFO:teuthology.orchestra.run.smithi078.stderr:Cannot find device "ceph-brx" 2024-09-17T03:08:43.396 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:08:43.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:43.397 DEBUG:teuthology.orchestra.run.smithi193:> ip netns list 2024-09-17T03:08:43.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:43.417 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link delete ceph-brx 2024-09-17T03:08:43.488 INFO:teuthology.orchestra.run.smithi193.stderr:Cannot find device "ceph-brx" 2024-09-17T03:08:43.490 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:08:43.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:43.490 DEBUG:teuthology.orchestra.run.smithi193:> ip netns list 2024-09-17T03:08:43.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:43.549 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link delete ceph-brx 2024-09-17T03:08:43.617 INFO:teuthology.orchestra.run.smithi193.stderr:Cannot find device "ceph-brx" 2024-09-17T03:08:43.618 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:08:43.619 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-17T03:08:43.619 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T03:08:43.619 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:08:43.619 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:08:43.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.732+0000 7f79f0132640 1 -- 172.21.15.78:0/1236527276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79e8144270 msgr2=0x7f79e80b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.732+0000 7f79f0132640 1 --2- 172.21.15.78:0/1236527276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79e8144270 0x7f79e80b5680 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009830 tx=0x7f79e402a510 comp rx=0 tx=0).stop 2024-09-17T03:08:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.732+0000 7f79f0132640 1 -- 172.21.15.78:0/1236527276 shutdown_connections 2024-09-17T03:08:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.732+0000 7f79f0132640 1 --2- 172.21.15.78:0/1236527276 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79e8074560 0x7f79e80cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.732+0000 7f79f0132640 1 --2- 172.21.15.78:0/1236527276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79e8144270 0x7f79e80b5680 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.732+0000 7f79f0132640 1 -- 172.21.15.78:0/1236527276 >> 172.21.15.78:0/1236527276 conn(0x7f79e80d15f0 msgr2=0x7f79e8073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.732+0000 7f79f0132640 1 -- 172.21.15.78:0/1236527276 shutdown_connections 2024-09-17T03:08:43.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.732+0000 7f79f0132640 1 -- 172.21.15.78:0/1236527276 wait complete. 2024-09-17T03:08:43.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.733+0000 7f79f0132640 1 Processor -- start 2024-09-17T03:08:43.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.733+0000 7f79f0132640 1 -- start start 2024-09-17T03:08:43.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79f0132640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79e8142270 0x7f79e80c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79f0132640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79e8144270 0x7f79e81f6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79f0132640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79e80ccd80 0x7f79e8159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79f0132640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f79e8142800 con 0x7f79e8142270 2024-09-17T03:08:43.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79f0132640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f79e8142680 con 0x7f79e80ccd80 2024-09-17T03:08:43.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79f0132640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f79e8142980 con 0x7f79e8144270 2024-09-17T03:08:43.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79edece640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79e8142270 0x7f79e80c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79edece640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79e8142270 0x7f79e80c6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34540/0 (socket says 172.21.15.78:34540) 2024-09-17T03:08:43.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79edece640 1 -- 172.21.15.78:0/2735284580 learned_addr learned my addr 172.21.15.78:0/2735284580 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:43.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79ed6cd640 1 --2- 172.21.15.78:0/2735284580 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79e8144270 0x7f79e81f6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79ee6cf640 1 --2- 172.21.15.78:0/2735284580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79e80ccd80 0x7f79e8159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79edece640 1 -- 172.21.15.78:0/2735284580 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79e8144270 msgr2=0x7f79e81f6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:43.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79edece640 1 --2- 172.21.15.78:0/2735284580 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79e8144270 0x7f79e81f6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79edece640 1 -- 172.21.15.78:0/2735284580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79e80ccd80 msgr2=0x7f79e8159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:43.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79edece640 1 --2- 172.21.15.78:0/2735284580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79e80ccd80 0x7f79e8159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79edece640 1 -- 172.21.15.78:0/2735284580 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e80cd190 con 0x7f79e8142270 2024-09-17T03:08:43.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79edece640 1 --2- 172.21.15.78:0/2735284580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79e8142270 0x7f79e80c6610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f79e4000c00 tx=0x7f79e4033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:43.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79de7fc640 1 -- 172.21.15.78:0/2735284580 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e4005c90 con 0x7f79e8142270 2024-09-17T03:08:43.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79de7fc640 1 -- 172.21.15.78:0/2735284580 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79e4031e50 con 0x7f79e8142270 2024-09-17T03:08:43.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79f0132640 1 -- 172.21.15.78:0/2735284580 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79e80cbfc0 con 0x7f79e8142270 2024-09-17T03:08:43.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79de7fc640 1 -- 172.21.15.78:0/2735284580 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e40332f0 con 0x7f79e8142270 2024-09-17T03:08:43.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.735+0000 7f79f0132640 1 -- 172.21.15.78:0/2735284580 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e80cc580 con 0x7f79e8142270 2024-09-17T03:08:43.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.736+0000 7f79f0132640 1 -- 172.21.15.78:0/2735284580 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79e80cbd50 con 0x7f79e8142270 2024-09-17T03:08:43.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.737+0000 7f79de7fc640 1 -- 172.21.15.78:0/2735284580 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f79e4033490 con 0x7f79e8142270 2024-09-17T03:08:43.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.738+0000 7f79de7fc640 1 --2- 172.21.15.78:0/2735284580 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f79cc078b90 0x7f79cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:43.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.738+0000 7f79de7fc640 1 -- 172.21.15.78:0/2735284580 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f79e40bc1f0 con 0x7f79e8142270 2024-09-17T03:08:43.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.738+0000 7f79ed6cd640 1 --2- 172.21.15.78:0/2735284580 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f79cc078b90 0x7f79cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:43.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.739+0000 7f79ed6cd640 1 --2- 172.21.15.78:0/2735284580 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f79cc078b90 0x7f79cc07b0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f79e80d0310 tx=0x7f79d8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:43.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.743+0000 7f79de7fc640 1 -- 172.21.15.78:0/2735284580 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f79e403f030 con 0x7f79e8142270 2024-09-17T03:08:43.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.952+0000 7f79f0132640 1 -- 172.21.15.78:0/2735284580 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f79e80d0640 con 0x7f79e8142270 2024-09-17T03:08:43.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.952+0000 7f79de7fc640 1 -- 172.21.15.78:0/2735284580 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f79e40846c0 con 0x7f79e8142270 2024-09-17T03:08:43.952 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:08:43.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.954+0000 7f79f0132640 1 -- 172.21.15.78:0/2735284580 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f79cc078b90 msgr2=0x7f79cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:43.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.954+0000 7f79f0132640 1 --2- 172.21.15.78:0/2735284580 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f79cc078b90 0x7f79cc07b0a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f79e80d0310 tx=0x7f79d8009040 comp rx=0 tx=0).stop 2024-09-17T03:08:43.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.954+0000 7f79f0132640 1 -- 172.21.15.78:0/2735284580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79e8142270 msgr2=0x7f79e80c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:43.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.954+0000 7f79f0132640 1 --2- 172.21.15.78:0/2735284580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79e8142270 0x7f79e80c6610 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f79e4000c00 tx=0x7f79e4033c90 comp rx=0 tx=0).stop 2024-09-17T03:08:43.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.954+0000 7f79f0132640 1 -- 172.21.15.78:0/2735284580 shutdown_connections 2024-09-17T03:08:43.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.954+0000 7f79f0132640 1 --2- 172.21.15.78:0/2735284580 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f79cc078b90 0x7f79cc07b0a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.954+0000 7f79f0132640 1 --2- 172.21.15.78:0/2735284580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79e80ccd80 0x7f79e8159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.954+0000 7f79f0132640 1 --2- 172.21.15.78:0/2735284580 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79e8144270 0x7f79e81f6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.954+0000 7f79f0132640 1 --2- 172.21.15.78:0/2735284580 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79e8142270 0x7f79e80c6610 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:43.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.954+0000 7f79f0132640 1 -- 172.21.15.78:0/2735284580 >> 172.21.15.78:0/2735284580 conn(0x7f79e80d15f0 msgr2=0x7f79e815f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:43.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.954+0000 7f79f0132640 1 -- 172.21.15.78:0/2735284580 shutdown_connections 2024-09-17T03:08:43.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:43.954+0000 7f79f0132640 1 -- 172.21.15.78:0/2735284580 wait complete. 2024-09-17T03:08:43.965 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T03:08:43.965 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:08:43.965 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2024-09-17T03:08:43.965 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:08:43.965 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:08:43.966 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T03:08:43.966 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T03:08:43.966 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:08:43.966 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:08:43.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:43.966 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2024-09-17T03:08:43.981 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:08:43.982 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:08:43.982 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:08:43.982 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:43.982 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2024-09-17T03:08:43.982 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:43.982 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:08:43.982 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:08:43.982 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2024-09-17T03:08:43.982 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:08:43.982 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:08:43.982 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2024-09-17T03:08:43.982 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:08:43.983 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:08:43.983 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:08:43.983 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:08:43.983 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:08:43.983 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42741sec preferred_lft 42741sec 2024-09-17T03:08:43.983 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link noprefixroute 2024-09-17T03:08:43.983 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:43.984 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T03:08:43.984 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:08:43.984 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-17T03:08:43.984 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add name ceph-brx type bridge 2024-09-17T03:08:43.984 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr flush dev ceph-brx 2024-09-17T03:08:43.984 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set ceph-brx up 2024-09-17T03:08:43.984 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T03:08:43.984 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-17T03:08:44.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:44.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:44.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:44.183 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:08:44.209 INFO:teuthology.orchestra.run.smithi078.stdout:1 2024-09-17T03:08:44.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:44.211 DEBUG:teuthology.orchestra.run.smithi078:> route 2024-09-17T03:08:44.279 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2024-09-17T03:08:44.279 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:08:44.279 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:08:44.279 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:08:44.279 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:08:44.280 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:08:44.280 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-17T03:08:44.280 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:08:44.280 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:08:44.280 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:08:44.280 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-17T03:08:44.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:44.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:44.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:44.617 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-17T03:08:44.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:44.634 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2024-09-17T03:08:44.689 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:08:44.689 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-17T03:08:44.690 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:08:44.690 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T03:08:44.690 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-17T03:08:44.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:44.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:44.807 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T03:08:44.807 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:08:44.807 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-17T03:08:44.807 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T03:08:44.807 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T03:08:44.807 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T03:08:44.807 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T03:08:44.807 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T03:08:44.808 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-17T03:08:44.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:44.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:44.930 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:08:44.930 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-17T03:08:44.930 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2024-09-17T03:08:44.930 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T03:08:44.930 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-17T03:08:44.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:45.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:45.006 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:08:45.006 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:08:45.021 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:08:45.021 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:08:45.022 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:08:45.077 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:08:45.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:45.077 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:08:45.189 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:08:45.190 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:08:45.190 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:08:45.324 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:08:45.324 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:08:45.324 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:08:45.324 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-09-17T03:08:45.324 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:08:45.330 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:08:45.330 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:08:45.330 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:08:45.330 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-09-17T03:08:45.330 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:08:45.331 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:6789,172.21.15.193:6789,172.21.15.193:6790" 2024-09-17T03:08:45.331 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.78:6789,172.21.15.193:6789,172.21.15.193:6790:/ 2024-09-17T03:08:45.331 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f3c59ba9-dab4-4ee6-8989-d80d11d430b6" will pass to kernel 2024-09-17T03:08:45.331 INFO:teuthology.orchestra.run.smithi078.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:08:45.331 INFO:teuthology.orchestra.run.smithi078.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:08:45.331 INFO:teuthology.orchestra.run.smithi078.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:08:45.331 INFO:teuthology.orchestra.run.smithi078.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:08:45.331 INFO:teuthology.orchestra.run.smithi078.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:08:45.333 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:08:45.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:45.333 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:08:45.358 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:08:45.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:08:45.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:45.464 INFO:teuthology.orchestra.run.smithi078.stdout:client4669 2024-09-17T03:08:45.464 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:08:45.464 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:08:45.481 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:08:45.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:08:45.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:45.583 INFO:teuthology.orchestra.run.smithi078.stdout:client4669 2024-09-17T03:08:45.584 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:08:45.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:08:45.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:45.647 INFO:teuthology.orchestra.run.smithi078.stdout:client4669 2024-09-17T03:08:45.648 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f3c59ba9-dab4-4ee6-8989-d80d11d430b6.client4669/status') 2024-09-17T03:08:45.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:45.713 INFO:teuthology.orchestra.run.smithi078.stdout:instance: client.4669 (3)172.21.15.78:0/1349605599 2024-09-17T03:08:45.713 INFO:teuthology.orchestra.run.smithi078.stdout:blocklisted: false 2024-09-17T03:08:45.713 INFO:teuthology.orchestra.run.smithi078.stderr:0+1 records in 2024-09-17T03:08:45.713 INFO:teuthology.orchestra.run.smithi078.stderr:0+1 records out 2024-09-17T03:08:45.713 INFO:teuthology.orchestra.run.smithi078.stderr:70 bytes copied, 3.6979e-05 s, 1.9 MB/s 2024-09-17T03:08:45.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:45.720 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-17T03:08:45.720 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T03:08:45.720 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T03:08:45.720 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:08:45.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.834+0000 7fa1530b4640 1 -- 172.21.15.78:0/3615703984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa14c162f60 msgr2=0x7fa14c165380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:45.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.834+0000 7fa1530b4640 1 --2- 172.21.15.78:0/3615703984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa14c162f60 0x7fa14c165380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa144005fd0 tx=0x7fa14402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:08:45.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.834+0000 7fa1530b4640 1 -- 172.21.15.78:0/3615703984 shutdown_connections 2024-09-17T03:08:45.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.834+0000 7fa1530b4640 1 --2- 172.21.15.78:0/3615703984 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa14c162f60 0x7fa14c165380 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:45.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.834+0000 7fa1530b4640 1 --2- 172.21.15.78:0/3615703984 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa14c0b6100 0x7fa14c0b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:45.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.834+0000 7fa1530b4640 1 -- 172.21.15.78:0/3615703984 >> 172.21.15.78:0/3615703984 conn(0x7fa14c0d12a0 msgr2=0x7fa14c0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:45.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.834+0000 7fa1530b4640 1 -- 172.21.15.78:0/3615703984 shutdown_connections 2024-09-17T03:08:45.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.834+0000 7fa1530b4640 1 -- 172.21.15.78:0/3615703984 wait complete. 2024-09-17T03:08:45.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.836+0000 7fa1530b4640 1 Processor -- start 2024-09-17T03:08:45.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.836+0000 7fa1530b4640 1 -- start start 2024-09-17T03:08:45.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.837+0000 7fa1530b4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa14c0b6100 0x7fa14c1f8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:45.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.837+0000 7fa1530b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14c0b6680 0x7fa14c163ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:45.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.837+0000 7fa1530b4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa14c162f60 0x7fa14c15f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:45.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.837+0000 7fa1530b4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa14c165a40 con 0x7fa14c0b6680 2024-09-17T03:08:45.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.837+0000 7fa1530b4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa14c1658c0 con 0x7fa14c0b6100 2024-09-17T03:08:45.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.837+0000 7fa1530b4640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa14c165bc0 con 0x7fa14c162f60 2024-09-17T03:08:45.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.838+0000 7fa143fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14c0b6680 0x7fa14c163ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:45.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.838+0000 7fa143fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14c0b6680 0x7fa14c163ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34544/0 (socket says 172.21.15.78:34544) 2024-09-17T03:08:45.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.838+0000 7fa143fff640 1 -- 172.21.15.78:0/1604906212 learned_addr learned my addr 172.21.15.78:0/1604906212 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:45.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.838+0000 7fa150e50640 1 --2- 172.21.15.78:0/1604906212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa14c0b6100 0x7fa14c1f8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:45.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.838+0000 7fa151651640 1 --2- 172.21.15.78:0/1604906212 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa14c162f60 0x7fa14c15f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:45.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.838+0000 7fa143fff640 1 -- 172.21.15.78:0/1604906212 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa14c162f60 msgr2=0x7fa14c15f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:45.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.838+0000 7fa143fff640 1 --2- 172.21.15.78:0/1604906212 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa14c162f60 0x7fa14c15f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:45.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.838+0000 7fa143fff640 1 -- 172.21.15.78:0/1604906212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa14c0b6100 msgr2=0x7fa14c1f8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:45.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.838+0000 7fa143fff640 1 --2- 172.21.15.78:0/1604906212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa14c0b6100 0x7fa14c1f8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:45.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.838+0000 7fa143fff640 1 -- 172.21.15.78:0/1604906212 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14c1641e0 con 0x7fa14c0b6680 2024-09-17T03:08:45.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.838+0000 7fa150e50640 1 --2- 172.21.15.78:0/1604906212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa14c0b6100 0x7fa14c1f8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:45.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.838+0000 7fa143fff640 1 --2- 172.21.15.78:0/1604906212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14c0b6680 0x7fa14c163ca0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa13c00e9f0 tx=0x7fa13c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:45.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.838+0000 7fa1417fa640 1 -- 172.21.15.78:0/1604906212 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c00cd80 con 0x7fa14c0b6680 2024-09-17T03:08:45.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.838+0000 7fa1417fa640 1 -- 172.21.15.78:0/1604906212 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa13c004020 con 0x7fa14c0b6680 2024-09-17T03:08:45.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.838+0000 7fa1530b4640 1 -- 172.21.15.78:0/1604906212 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa14c1f9670 con 0x7fa14c0b6680 2024-09-17T03:08:45.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.838+0000 7fa1417fa640 1 -- 172.21.15.78:0/1604906212 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c004470 con 0x7fa14c0b6680 2024-09-17T03:08:45.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.838+0000 7fa1530b4640 1 -- 172.21.15.78:0/1604906212 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa14c1634a0 con 0x7fa14c0b6680 2024-09-17T03:08:45.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.839+0000 7fa1530b4640 1 -- 172.21.15.78:0/1604906212 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa14c0b0de0 con 0x7fa14c0b6680 2024-09-17T03:08:45.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.840+0000 7fa1417fa640 1 -- 172.21.15.78:0/1604906212 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa13c0035f0 con 0x7fa14c0b6680 2024-09-17T03:08:45.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.841+0000 7fa1417fa640 1 --2- 172.21.15.78:0/1604906212 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa138078b90 0x7fa13807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:45.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.841+0000 7fa1417fa640 1 -- 172.21.15.78:0/1604906212 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa13c09b630 con 0x7fa14c0b6680 2024-09-17T03:08:45.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.841+0000 7fa150e50640 1 --2- 172.21.15.78:0/1604906212 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa138078b90 0x7fa13807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:45.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.841+0000 7fa150e50640 1 --2- 172.21.15.78:0/1604906212 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa138078b90 0x7fa13807b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa14c0ceda0 tx=0x7fa148009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:45.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:45.845+0000 7fa1417fa640 1 -- 172.21.15.78:0/1604906212 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa13c063b00 con 0x7fa14c0b6680 2024-09-17T03:08:46.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46.056+0000 7fa1530b4640 1 -- 172.21.15.78:0/1604906212 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa14c1f9400 con 0x7fa14c0b6680 2024-09-17T03:08:46.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46.056+0000 7fa1417fa640 1 -- 172.21.15.78:0/1604906212 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fa13c063400 con 0x7fa14c0b6680 2024-09-17T03:08:46.056 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:08:46.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46.058+0000 7fa1530b4640 1 -- 172.21.15.78:0/1604906212 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa138078b90 msgr2=0x7fa13807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:46.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46.058+0000 7fa1530b4640 1 --2- 172.21.15.78:0/1604906212 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa138078b90 0x7fa13807b0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa14c0ceda0 tx=0x7fa148009040 comp rx=0 tx=0).stop 2024-09-17T03:08:46.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46.058+0000 7fa1530b4640 1 -- 172.21.15.78:0/1604906212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14c0b6680 msgr2=0x7fa14c163ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:46.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46.058+0000 7fa1530b4640 1 --2- 172.21.15.78:0/1604906212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14c0b6680 0x7fa14c163ca0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa13c00e9f0 tx=0x7fa13c00eeb0 comp rx=0 tx=0).stop 2024-09-17T03:08:46.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46.059+0000 7fa1530b4640 1 -- 172.21.15.78:0/1604906212 shutdown_connections 2024-09-17T03:08:46.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46.059+0000 7fa1530b4640 1 --2- 172.21.15.78:0/1604906212 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa14c162f60 0x7fa14c15f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:46.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46.059+0000 7fa1530b4640 1 --2- 172.21.15.78:0/1604906212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14c0b6680 0x7fa14c163ca0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:46.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46.059+0000 7fa1530b4640 1 --2- 172.21.15.78:0/1604906212 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa138078b90 0x7fa13807b0a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:46.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46.059+0000 7fa1530b4640 1 --2- 172.21.15.78:0/1604906212 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa14c0b6100 0x7fa14c1f8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:46.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46.059+0000 7fa1530b4640 1 -- 172.21.15.78:0/1604906212 >> 172.21.15.78:0/1604906212 conn(0x7fa14c0d12a0 msgr2=0x7fa14c0b40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:46.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46.059+0000 7fa1530b4640 1 -- 172.21.15.78:0/1604906212 shutdown_connections 2024-09-17T03:08:46.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46.059+0000 7fa1530b4640 1 -- 172.21.15.78:0/1604906212 wait complete. 2024-09-17T03:08:46.069 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T03:08:46.069 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:08:46.070 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2024-09-17T03:08:46.070 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-17T03:08:46.070 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T03:08:46.070 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T03:08:46.070 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T03:08:46.070 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:08:46.070 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-17T03:08:46.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:46.070 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2024-09-17T03:08:46.086 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:08:46.086 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:08:46.086 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:08:46.086 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:46.086 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2024-09-17T03:08:46.086 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:46.086 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:08:46.086 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:08:46.087 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2024-09-17T03:08:46.087 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:08:46.087 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:08:46.087 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2024-09-17T03:08:46.087 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:08:46.087 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:08:46.087 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:08:46.087 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:08:46.087 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:08:46.087 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42739sec preferred_lft 42739sec 2024-09-17T03:08:46.087 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link noprefixroute 2024-09-17T03:08:46.088 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:46.088 INFO:teuthology.orchestra.run.smithi078.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:08:46.088 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether e6:fb:78:d9:ba:75 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:08:46.088 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:08:46.088 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:46.088 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::58a0:47ff:fe97:6de8/64 scope link 2024-09-17T03:08:46.088 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:46.088 INFO:teuthology.orchestra.run.smithi078.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:08:46.088 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether e6:fb:78:d9:ba:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:08:46.088 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::e4fb:78ff:fed9:ba75/64 scope link tentative 2024-09-17T03:08:46.088 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:46.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:46.089 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:08:46.151 INFO:teuthology.orchestra.run.smithi078.stdout:1 2024-09-17T03:08:46.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:46.153 DEBUG:teuthology.orchestra.run.smithi078:> route 2024-09-17T03:08:46.209 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2024-09-17T03:08:46.209 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:08:46.209 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:08:46.209 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:08:46.209 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:08:46.209 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:08:46.209 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-17T03:08:46.209 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:08:46.210 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:08:46.210 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:08:46.210 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-17T03:08:46.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:46.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:46.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:46.334 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-17T03:08:46.350 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:08:46.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:46.350 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2024-09-17T03:08:46.406 INFO:teuthology.orchestra.run.smithi078.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-17T03:08:46.406 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:08:46.406 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-17T03:08:46.406 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:08:46.406 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-17T03:08:46.407 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-17T03:08:46.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:46.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:46.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:46.523 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T03:08:46.547 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:08:46.547 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:08:46.548 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:08:46.548 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:46.548 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2024-09-17T03:08:46.548 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:46.548 INFO:teuthology.orchestra.run.smithi078.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:08:46.548 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 76:f6:25:ba:2e:be brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T03:08:46.548 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T03:08:46.548 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:46.548 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::74f6:25ff:feba:2ebe/64 scope link 2024-09-17T03:08:46.548 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:46.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:46.550 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T03:08:46.614 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:08:46.614 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:08:46.614 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:08:46.614 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:46.614 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2024-09-17T03:08:46.614 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:46.614 INFO:teuthology.orchestra.run.smithi078.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:08:46.614 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 76:f6:25:ba:2e:be brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T03:08:46.614 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T03:08:46.614 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:46.615 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::74f6:25ff:feba:2ebe/64 scope link 2024-09-17T03:08:46.615 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:46.616 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-17T03:08:46.616 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:08:46.616 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-17T03:08:46.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-17T03:08:46.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T03:08:46.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-17T03:08:46.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-17T03:08:46.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-17T03:08:46.616 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-17T03:08:46.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:46.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:46.767 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:08:46.767 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-17T03:08:46.767 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.1 up 2024-09-17T03:08:46.767 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T03:08:46.767 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-17T03:08:46.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:46.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:46.845 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:08:46.845 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-17T03:08:46.861 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-17T03:08:46.861 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:08:46.862 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-17T03:08:46.916 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:08:46.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:46.917 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T03:08:47.010 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T03:08:47.010 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T03:08:47.010 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:08:47.021 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T03:08:47.021 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T03:08:47.021 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:08:47.021 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-09-17T03:08:47.021 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:08:47.027 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-17T03:08:47.027 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-17T03:08:47.027 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:08:47.028 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-09-17T03:08:47.028 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:08:47.028 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:6789,172.21.15.193:6789,172.21.15.193:6790" 2024-09-17T03:08:47.028 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.78:6789,172.21.15.193:6789,172.21.15.193:6790:/ 2024-09-17T03:08:47.028 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=f3c59ba9-dab4-4ee6-8989-d80d11d430b6" will pass to kernel 2024-09-17T03:08:47.028 INFO:teuthology.orchestra.run.smithi078.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-17T03:08:47.028 INFO:teuthology.orchestra.run.smithi078.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:08:47.028 INFO:teuthology.orchestra.run.smithi078.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:08:47.028 INFO:teuthology.orchestra.run.smithi078.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:08:47.029 INFO:teuthology.orchestra.run.smithi078.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:08:47.030 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:08:47.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:47.030 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-17T03:08:47.054 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:08:47.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:08:47.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:47.150 INFO:teuthology.orchestra.run.smithi078.stdout:client4678 2024-09-17T03:08:47.151 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:08:47.151 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:08:47.166 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:08:47.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:08:47.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:47.262 INFO:teuthology.orchestra.run.smithi078.stdout:client4678 2024-09-17T03:08:47.262 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:08:47.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:08:47.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:47.319 INFO:teuthology.orchestra.run.smithi078.stdout:client4678 2024-09-17T03:08:47.319 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f3c59ba9-dab4-4ee6-8989-d80d11d430b6.client4678/status') 2024-09-17T03:08:47.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:47.376 INFO:teuthology.orchestra.run.smithi078.stdout:instance: client.4678 (3)172.21.15.78:0/503434159 2024-09-17T03:08:47.376 INFO:teuthology.orchestra.run.smithi078.stdout:blocklisted: false 2024-09-17T03:08:47.377 INFO:teuthology.orchestra.run.smithi078.stderr:0+1 records in 2024-09-17T03:08:47.377 INFO:teuthology.orchestra.run.smithi078.stderr:0+1 records out 2024-09-17T03:08:47.377 INFO:teuthology.orchestra.run.smithi078.stderr:69 bytes copied, 2.8148e-05 s, 2.5 MB/s 2024-09-17T03:08:47.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:47.383 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-17T03:08:47.383 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T03:08:47.384 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:08:47.384 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:08:47.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.498+0000 7f32b6f7b640 1 -- 172.21.15.78:0/747030759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32b00ccba0 msgr2=0x7f32b00ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:47.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.498+0000 7f32b6f7b640 1 --2- 172.21.15.78:0/747030759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32b00ccba0 0x7f32b00ccfb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f32a8005fd0 tx=0x7f32a802aa00 comp rx=0 tx=0).stop 2024-09-17T03:08:47.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.498+0000 7f32b6f7b640 1 -- 172.21.15.78:0/747030759 shutdown_connections 2024-09-17T03:08:47.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.498+0000 7f32b6f7b640 1 --2- 172.21.15.78:0/747030759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32b00ccba0 0x7f32b00ccfb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:47.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.498+0000 7f32b6f7b640 1 --2- 172.21.15.78:0/747030759 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32b00d1d40 0x7f32b00b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:47.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.498+0000 7f32b6f7b640 1 -- 172.21.15.78:0/747030759 >> 172.21.15.78:0/747030759 conn(0x7f32b00b3f10 msgr2=0x7f32b00b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:47.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.498+0000 7f32b6f7b640 1 -- 172.21.15.78:0/747030759 shutdown_connections 2024-09-17T03:08:47.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.498+0000 7f32b6f7b640 1 -- 172.21.15.78:0/747030759 wait complete. 2024-09-17T03:08:47.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.500+0000 7f32b6f7b640 1 Processor -- start 2024-09-17T03:08:47.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.500+0000 7f32b6f7b640 1 -- start start 2024-09-17T03:08:47.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.501+0000 7f32b6f7b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32b00ccba0 0x7f32b015e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:47.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.501+0000 7f32b6f7b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32b00d1d40 0x7f32b0159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:47.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.501+0000 7f32b6f7b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32b015c6f0 0x7f32b00adf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:47.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.501+0000 7f32b6f7b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f32b00d12e0 con 0x7f32b00d1d40 2024-09-17T03:08:47.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.501+0000 7f32b6f7b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f32b00d1160 con 0x7f32b00ccba0 2024-09-17T03:08:47.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.501+0000 7f32b6f7b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f32b00d1460 con 0x7f32b015c6f0 2024-09-17T03:08:47.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.501+0000 7f32affff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32b00d1d40 0x7f32b0159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:47.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.501+0000 7f32affff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32b00d1d40 0x7f32b0159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51044/0 (socket says 172.21.15.78:51044) 2024-09-17T03:08:47.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.501+0000 7f32affff640 1 -- 172.21.15.78:0/1263128189 learned_addr learned my addr 172.21.15.78:0/1263128189 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:47.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.501+0000 7f32b5518640 1 --2- 172.21.15.78:0/1263128189 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32b015c6f0 0x7f32b00adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:47.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.501+0000 7f32b4d17640 1 --2- 172.21.15.78:0/1263128189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32b00ccba0 0x7f32b015e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:47.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.501+0000 7f32affff640 1 -- 172.21.15.78:0/1263128189 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32b015c6f0 msgr2=0x7f32b00adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:47.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.501+0000 7f32affff640 1 --2- 172.21.15.78:0/1263128189 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32b015c6f0 0x7f32b00adf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:47.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.501+0000 7f32affff640 1 -- 172.21.15.78:0/1263128189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32b00ccba0 msgr2=0x7f32b015e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:47.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.501+0000 7f32affff640 1 --2- 172.21.15.78:0/1263128189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32b00ccba0 0x7f32b015e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:47.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.501+0000 7f32affff640 1 -- 172.21.15.78:0/1263128189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b006f530 con 0x7f32b00d1d40 2024-09-17T03:08:47.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.501+0000 7f32b4d17640 1 --2- 172.21.15.78:0/1263128189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32b00ccba0 0x7f32b015e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:08:47.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.502+0000 7f32affff640 1 --2- 172.21.15.78:0/1263128189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32b00d1d40 0x7f32b0159a70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009fd0 tx=0x7f32a400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:47.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.502+0000 7f32ad7fa640 1 -- 172.21.15.78:0/1263128189 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a4015020 con 0x7f32b00d1d40 2024-09-17T03:08:47.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.502+0000 7f32ad7fa640 1 -- 172.21.15.78:0/1263128189 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32a4011920 con 0x7f32b00d1d40 2024-09-17T03:08:47.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.502+0000 7f32ad7fa640 1 -- 172.21.15.78:0/1263128189 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a4011d50 con 0x7f32b00d1d40 2024-09-17T03:08:47.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.502+0000 7f32b6f7b640 1 -- 172.21.15.78:0/1263128189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b006f810 con 0x7f32b00d1d40 2024-09-17T03:08:47.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.502+0000 7f32b6f7b640 1 -- 172.21.15.78:0/1263128189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b00ada50 con 0x7f32b00d1d40 2024-09-17T03:08:47.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.503+0000 7f32b6f7b640 1 -- 172.21.15.78:0/1263128189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b006f2a0 con 0x7f32b00d1d40 2024-09-17T03:08:47.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.503+0000 7f32ad7fa640 1 -- 172.21.15.78:0/1263128189 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f32a4018020 con 0x7f32b00d1d40 2024-09-17T03:08:47.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.504+0000 7f32ad7fa640 1 --2- 172.21.15.78:0/1263128189 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f329c078bc0 0x7f329c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:47.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.504+0000 7f32ad7fa640 1 -- 172.21.15.78:0/1263128189 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f32a409ab00 con 0x7f32b00d1d40 2024-09-17T03:08:47.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.504+0000 7f32b4d17640 1 --2- 172.21.15.78:0/1263128189 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f329c078bc0 0x7f329c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:47.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.505+0000 7f32b4d17640 1 --2- 172.21.15.78:0/1263128189 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f329c078bc0 0x7f329c07b0d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f32a0005fd0 tx=0x7f32a000f360 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:47.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.509+0000 7f32ad7fa640 1 -- 172.21.15.78:0/1263128189 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f32a401f020 con 0x7f32b00d1d40 2024-09-17T03:08:47.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.721+0000 7f32b6f7b640 1 -- 172.21.15.78:0/1263128189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f32b006fd30 con 0x7f32b00d1d40 2024-09-17T03:08:47.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.722+0000 7f32ad7fa640 1 -- 172.21.15.78:0/1263128189 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f32b006fd30 con 0x7f32b00d1d40 2024-09-17T03:08:47.721 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:08:47.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.724+0000 7f32b6f7b640 1 -- 172.21.15.78:0/1263128189 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f329c078bc0 msgr2=0x7f329c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:47.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.724+0000 7f32b6f7b640 1 --2- 172.21.15.78:0/1263128189 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f329c078bc0 0x7f329c07b0d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f32a0005fd0 tx=0x7f32a000f360 comp rx=0 tx=0).stop 2024-09-17T03:08:47.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.724+0000 7f32b6f7b640 1 -- 172.21.15.78:0/1263128189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32b00d1d40 msgr2=0x7f32b0159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:47.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.724+0000 7f32b6f7b640 1 --2- 172.21.15.78:0/1263128189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32b00d1d40 0x7f32b0159a70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f32a4009fd0 tx=0x7f32a400b870 comp rx=0 tx=0).stop 2024-09-17T03:08:47.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.724+0000 7f32b6f7b640 1 -- 172.21.15.78:0/1263128189 shutdown_connections 2024-09-17T03:08:47.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.724+0000 7f32b6f7b640 1 --2- 172.21.15.78:0/1263128189 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32b015c6f0 0x7f32b00adf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:47.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.724+0000 7f32b6f7b640 1 --2- 172.21.15.78:0/1263128189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32b00d1d40 0x7f32b0159a70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:47.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.724+0000 7f32b6f7b640 1 --2- 172.21.15.78:0/1263128189 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f329c078bc0 0x7f329c07b0d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:47.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.724+0000 7f32b6f7b640 1 --2- 172.21.15.78:0/1263128189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32b00ccba0 0x7f32b015e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:47.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.724+0000 7f32b6f7b640 1 -- 172.21.15.78:0/1263128189 >> 172.21.15.78:0/1263128189 conn(0x7f32b00b3f10 msgr2=0x7f32b00b7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:47.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.724+0000 7f32b6f7b640 1 -- 172.21.15.78:0/1263128189 shutdown_connections 2024-09-17T03:08:47.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:47.724+0000 7f32b6f7b640 1 -- 172.21.15.78:0/1263128189 wait complete. 2024-09-17T03:08:47.735 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T03:08:47.735 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:08:47.735 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi193.front.sepia.ceph.com 2024-09-17T03:08:47.735 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T03:08:47.735 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T03:08:47.735 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T03:08:47.735 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T03:08:47.735 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:08:47.735 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:08:47.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:47.735 DEBUG:teuthology.orchestra.run.smithi193:> ip addr 2024-09-17T03:08:47.755 INFO:teuthology.orchestra.run.smithi193.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:08:47.756 INFO:teuthology.orchestra.run.smithi193.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:08:47.757 INFO:teuthology.orchestra.run.smithi193.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:08:47.757 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:47.757 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 ::1/128 scope host 2024-09-17T03:08:47.757 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:47.757 INFO:teuthology.orchestra.run.smithi193.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:08:47.757 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 0c:c4:7a:d9:38:b6 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:08:47.757 INFO:teuthology.orchestra.run.smithi193.stdout: altname enp7s0f0 2024-09-17T03:08:47.757 INFO:teuthology.orchestra.run.smithi193.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:08:47.757 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 0c:c4:7a:d9:38:b7 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:08:47.757 INFO:teuthology.orchestra.run.smithi193.stdout: altname enp7s0f1 2024-09-17T03:08:47.757 INFO:teuthology.orchestra.run.smithi193.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:08:47.757 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 0c:c4:7a:88:72:52 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:08:47.758 INFO:teuthology.orchestra.run.smithi193.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:08:47.758 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 0c:c4:7a:88:72:53 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:08:47.758 INFO:teuthology.orchestra.run.smithi193.stdout: inet 172.21.15.193/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:08:47.758 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft 42761sec preferred_lft 42761sec 2024-09-17T03:08:47.758 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 fe80::ec4:7aff:fe88:7253/64 scope link noprefixroute 2024-09-17T03:08:47.758 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:47.758 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T03:08:47.758 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:08:47.758 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-09-17T03:08:47.758 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link add name ceph-brx type bridge 2024-09-17T03:08:47.759 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip addr flush dev ceph-brx 2024-09-17T03:08:47.759 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link set ceph-brx up 2024-09-17T03:08:47.759 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T03:08:47.759 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-09-17T03:08:47.851 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:48.011 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:48.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:48.017 DEBUG:teuthology.orchestra.run.smithi193:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:08:48.042 INFO:teuthology.orchestra.run.smithi193.stdout:1 2024-09-17T03:08:48.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:48.044 DEBUG:teuthology.orchestra.run.smithi193:> route 2024-09-17T03:08:48.113 INFO:teuthology.orchestra.run.smithi193.stdout:Kernel IP routing table 2024-09-17T03:08:48.113 INFO:teuthology.orchestra.run.smithi193.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:08:48.113 INFO:teuthology.orchestra.run.smithi193.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:08:48.113 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:08:48.113 INFO:teuthology.orchestra.run.smithi193.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:08:48.113 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:08:48.113 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-09-17T03:08:48.113 DEBUG:teuthology.orchestra.run.smithi193:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:08:48.114 DEBUG:teuthology.orchestra.run.smithi193:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:08:48.114 DEBUG:teuthology.orchestra.run.smithi193:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:08:48.114 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-09-17T03:08:48.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:48.404 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:48.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:48.410 DEBUG:teuthology.orchestra.run.smithi193:> ip netns list 2024-09-17T03:08:48.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:48.425 DEBUG:teuthology.orchestra.run.smithi193:> ip netns list-id 2024-09-17T03:08:48.481 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:08:48.481 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-09-17T03:08:48.481 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:08:48.482 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-17T03:08:48.482 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-09-17T03:08:48.569 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:48.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:48.599 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-17T03:08:48.599 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:08:48.599 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-09-17T03:08:48.599 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-17T03:08:48.599 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T03:08:48.599 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-17T03:08:48.600 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-17T03:08:48.600 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-17T03:08:48.600 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-09-17T03:08:48.647 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:48.718 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:48.725 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:08:48.725 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-09-17T03:08:48.725 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link set brx.0 up 2024-09-17T03:08:48.725 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T03:08:48.725 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-09-17T03:08:48.773 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:48.795 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:48.802 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:08:48.802 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T03:08:48.818 INFO:teuthology.orchestra.run.smithi193.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T03:08:48.818 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:08:48.818 DEBUG:teuthology.orchestra.run.smithi193:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:08:48.872 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:08:48.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:48.873 DEBUG:teuthology.orchestra.run.smithi193:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:08:48.977 INFO:teuthology.orchestra.run.smithi193.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:08:48.977 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:08:48.977 INFO:teuthology.orchestra.run.smithi193.stdout:invalid new device string format 2024-09-17T03:08:49.105 INFO:teuthology.orchestra.run.smithi193.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:08:49.105 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:08:49.105 INFO:teuthology.orchestra.run.smithi193.stdout:invalid new device string format 2024-09-17T03:08:49.105 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-09-17T03:08:49.105 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:08:49.108 INFO:teuthology.orchestra.run.smithi193.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-17T03:08:49.108 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-17T03:08:49.108 INFO:teuthology.orchestra.run.smithi193.stdout:invalid new device string format 2024-09-17T03:08:49.108 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-09-17T03:08:49.108 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:08:49.108 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: resolved to: "172.21.15.78:6789,172.21.15.193:6789,172.21.15.193:6790" 2024-09-17T03:08:49.109 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.78:6789,172.21.15.193:6789,172.21.15.193:6790:/ 2024-09-17T03:08:49.109 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f3c59ba9-dab4-4ee6-8989-d80d11d430b6" will pass to kernel 2024-09-17T03:08:49.109 INFO:teuthology.orchestra.run.smithi193.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-17T03:08:49.109 INFO:teuthology.orchestra.run.smithi193.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:08:49.109 INFO:teuthology.orchestra.run.smithi193.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:08:49.109 INFO:teuthology.orchestra.run.smithi193.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:08:49.109 INFO:teuthology.orchestra.run.smithi193.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:08:49.111 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:08:49.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:49.111 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T03:08:49.141 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:08:49.229 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:08:49.231 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:49.236 INFO:teuthology.orchestra.run.smithi193.stdout:client4761 2024-09-17T03:08:49.237 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:49.237 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:08:49.253 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:08:49.341 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:08:49.343 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:49.348 INFO:teuthology.orchestra.run.smithi193.stdout:client4761 2024-09-17T03:08:49.349 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:08:49.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:08:49.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:49.403 INFO:teuthology.orchestra.run.smithi193.stdout:client4761 2024-09-17T03:08:49.404 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f3c59ba9-dab4-4ee6-8989-d80d11d430b6.client4761/status') 2024-09-17T03:08:49.451 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:49.461 INFO:teuthology.orchestra.run.smithi193.stdout:instance: client.4761 (3)172.21.15.193:0/359075049 2024-09-17T03:08:49.461 INFO:teuthology.orchestra.run.smithi193.stdout:blocklisted: false 2024-09-17T03:08:49.462 INFO:teuthology.orchestra.run.smithi193.stderr:0+1 records in 2024-09-17T03:08:49.462 INFO:teuthology.orchestra.run.smithi193.stderr:0+1 records out 2024-09-17T03:08:49.462 INFO:teuthology.orchestra.run.smithi193.stderr:70 bytes copied, 2.5422e-05 s, 2.8 MB/s 2024-09-17T03:08:49.462 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:49.469 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-17T03:08:49.469 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T03:08:49.469 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T03:08:49.469 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:08:49.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.599+0000 7f16ff8ec640 1 -- 172.21.15.78:0/2730273763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e4003a30 msgr2=0x7f16e4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:49.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.599+0000 7f16ff8ec640 1 --2- 172.21.15.78:0/2730273763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e4003a30 0x7f16e4003ea0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f16f80cfad0 tx=0x7f16e4005830 comp rx=0 tx=0).stop 2024-09-17T03:08:49.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.599+0000 7f16fde89640 1 -- 172.21.15.78:0/2730273763 reap_dead start 2024-09-17T03:08:49.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.599+0000 7f16ff8ec640 1 -- 172.21.15.78:0/2730273763 shutdown_connections 2024-09-17T03:08:49.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.599+0000 7f16ff8ec640 1 -- 172.21.15.78:0/2730273763 >> 172.21.15.78:0/2730273763 conn(0x7f16f80cee20 msgr2=0x7f16f80cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:49.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.599+0000 7f16ff8ec640 1 -- 172.21.15.78:0/2730273763 shutdown_connections 2024-09-17T03:08:49.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.599+0000 7f16ff8ec640 1 -- 172.21.15.78:0/2730273763 wait complete. 2024-09-17T03:08:49.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.600+0000 7f16ff8ec640 1 Processor -- start 2024-09-17T03:08:49.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.601+0000 7f16ff8ec640 1 -- start start 2024-09-17T03:08:49.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.602+0000 7f16ff8ec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e4003a30 0x7f16f815fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:49.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.602+0000 7f16ff8ec640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f16f815a030 0x7f16f815e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:49.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.602+0000 7f16ff8ec640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16f8152c20 0x7f16f815eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:49.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.602+0000 7f16ff8ec640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f16f80d1480 con 0x7f16e4003a30 2024-09-17T03:08:49.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.602+0000 7f16ff8ec640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f16f80d1300 con 0x7f16f8152c20 2024-09-17T03:08:49.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.602+0000 7f16ff8ec640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f16f80d1600 con 0x7f16f815a030 2024-09-17T03:08:49.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.602+0000 7f16fd688640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e4003a30 0x7f16f815fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:49.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.602+0000 7f16fd688640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e4003a30 0x7f16f815fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51064/0 (socket says 172.21.15.78:51064) 2024-09-17T03:08:49.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.602+0000 7f16fd688640 1 -- 172.21.15.78:0/1642320916 learned_addr learned my addr 172.21.15.78:0/1642320916 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:49.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.602+0000 7f16fce87640 1 --2- 172.21.15.78:0/1642320916 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f16f815a030 0x7f16f815e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:49.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.602+0000 7f16fd688640 1 -- 172.21.15.78:0/1642320916 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f16f815a030 msgr2=0x7f16f815e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:49.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.602+0000 7f16fd688640 1 --2- 172.21.15.78:0/1642320916 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f16f815a030 0x7f16f815e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:49.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.602+0000 7f16fde89640 1 --2- 172.21.15.78:0/1642320916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16f8152c20 0x7f16f815eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:49.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.602+0000 7f16fd688640 1 -- 172.21.15.78:0/1642320916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16f8152c20 msgr2=0x7f16f815eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:49.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.602+0000 7f16fd688640 1 --2- 172.21.15.78:0/1642320916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16f8152c20 0x7f16f815eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:49.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.602+0000 7f16fd688640 1 -- 172.21.15.78:0/1642320916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f815ff70 con 0x7f16e4003a30 2024-09-17T03:08:49.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.602+0000 7f16fce87640 1 --2- 172.21.15.78:0/1642320916 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f16f815a030 0x7f16f815e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:49.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.602+0000 7f16fde89640 1 --2- 172.21.15.78:0/1642320916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16f8152c20 0x7f16f815eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:49.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.602+0000 7f16fd688640 1 --2- 172.21.15.78:0/1642320916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e4003a30 0x7f16f815fa30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f16f400bac0 tx=0x7f16f4034c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:49.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.603+0000 7f16edffb640 1 -- 172.21.15.78:0/1642320916 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f4039040 con 0x7f16e4003a30 2024-09-17T03:08:49.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.603+0000 7f16edffb640 1 -- 172.21.15.78:0/1642320916 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16f4005020 con 0x7f16e4003a30 2024-09-17T03:08:49.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.603+0000 7f16edffb640 1 -- 172.21.15.78:0/1642320916 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f400b620 con 0x7f16e4003a30 2024-09-17T03:08:49.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.603+0000 7f16ff8ec640 1 -- 172.21.15.78:0/1642320916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f81f6e90 con 0x7f16e4003a30 2024-09-17T03:08:49.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.603+0000 7f16ff8ec640 1 -- 172.21.15.78:0/1642320916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f81f7450 con 0x7f16e4003a30 2024-09-17T03:08:49.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.604+0000 7f16ff8ec640 1 -- 172.21.15.78:0/1642320916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f80d1b20 con 0x7f16e4003a30 2024-09-17T03:08:49.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.605+0000 7f16edffb640 1 -- 172.21.15.78:0/1642320916 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f16f4044020 con 0x7f16e4003a30 2024-09-17T03:08:49.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.605+0000 7f16edffb640 1 --2- 172.21.15.78:0/1642320916 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f16dc078bc0 0x7f16dc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:49.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.605+0000 7f16edffb640 1 -- 172.21.15.78:0/1642320916 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f16f40bab00 con 0x7f16e4003a30 2024-09-17T03:08:49.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.605+0000 7f16fce87640 1 --2- 172.21.15.78:0/1642320916 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f16dc078bc0 0x7f16dc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:49.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.606+0000 7f16fce87640 1 --2- 172.21.15.78:0/1642320916 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f16dc078bc0 0x7f16dc07b0d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f16f8152490 tx=0x7f16e80067a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:49.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.610+0000 7f16edffb640 1 -- 172.21.15.78:0/1642320916 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f16f815ff70 con 0x7f16e4003a30 2024-09-17T03:08:49.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.821+0000 7f16ff8ec640 1 -- 172.21.15.78:0/1642320916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f16f80b4730 con 0x7f16e4003a30 2024-09-17T03:08:49.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.821+0000 7f16edffb640 1 -- 172.21.15.78:0/1642320916 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f16f4082fd0 con 0x7f16e4003a30 2024-09-17T03:08:49.821 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:08:49.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.824+0000 7f16ff8ec640 1 -- 172.21.15.78:0/1642320916 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f16dc078bc0 msgr2=0x7f16dc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:49.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.824+0000 7f16ff8ec640 1 --2- 172.21.15.78:0/1642320916 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f16dc078bc0 0x7f16dc07b0d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f16f8152490 tx=0x7f16e80067a0 comp rx=0 tx=0).stop 2024-09-17T03:08:49.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.824+0000 7f16ff8ec640 1 -- 172.21.15.78:0/1642320916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e4003a30 msgr2=0x7f16f815fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:49.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.824+0000 7f16ff8ec640 1 --2- 172.21.15.78:0/1642320916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e4003a30 0x7f16f815fa30 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f16f400bac0 tx=0x7f16f4034c90 comp rx=0 tx=0).stop 2024-09-17T03:08:49.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.824+0000 7f16ff8ec640 1 -- 172.21.15.78:0/1642320916 shutdown_connections 2024-09-17T03:08:49.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.824+0000 7f16ff8ec640 1 --2- 172.21.15.78:0/1642320916 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f16dc078bc0 0x7f16dc07b0d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:49.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.824+0000 7f16ff8ec640 1 --2- 172.21.15.78:0/1642320916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16f8152c20 0x7f16f815eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:49.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.824+0000 7f16ff8ec640 1 --2- 172.21.15.78:0/1642320916 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f16f815a030 0x7f16f815e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:49.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.824+0000 7f16ff8ec640 1 --2- 172.21.15.78:0/1642320916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16e4003a30 0x7f16f815fa30 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:49.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.824+0000 7f16ff8ec640 1 -- 172.21.15.78:0/1642320916 >> 172.21.15.78:0/1642320916 conn(0x7f16f80cee20 msgr2=0x7f16f81557f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:49.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.824+0000 7f16ff8ec640 1 -- 172.21.15.78:0/1642320916 shutdown_connections 2024-09-17T03:08:49.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:49.824+0000 7f16ff8ec640 1 -- 172.21.15.78:0/1642320916 wait complete. 2024-09-17T03:08:49.835 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T03:08:49.835 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:08:49.835 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi193.front.sepia.ceph.com 2024-09-17T03:08:49.835 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-17T03:08:49.835 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T03:08:49.835 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T03:08:49.835 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T03:08:49.835 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:08:49.835 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-17T03:08:49.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:49.836 DEBUG:teuthology.orchestra.run.smithi193:> ip addr 2024-09-17T03:08:49.853 INFO:teuthology.orchestra.run.smithi193.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:08:49.853 INFO:teuthology.orchestra.run.smithi193.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:08:49.853 INFO:teuthology.orchestra.run.smithi193.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:08:49.853 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:49.853 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 ::1/128 scope host 2024-09-17T03:08:49.853 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:49.853 INFO:teuthology.orchestra.run.smithi193.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:08:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 0c:c4:7a:d9:38:b6 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:08:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: altname enp7s0f0 2024-09-17T03:08:49.854 INFO:teuthology.orchestra.run.smithi193.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:08:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 0c:c4:7a:d9:38:b7 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:08:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: altname enp7s0f1 2024-09-17T03:08:49.854 INFO:teuthology.orchestra.run.smithi193.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:08:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 0c:c4:7a:88:72:52 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:08:49.854 INFO:teuthology.orchestra.run.smithi193.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:08:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 0c:c4:7a:88:72:53 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:08:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: inet 172.21.15.193/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:08:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft 42759sec preferred_lft 42759sec 2024-09-17T03:08:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 fe80::ec4:7aff:fe88:7253/64 scope link noprefixroute 2024-09-17T03:08:49.854 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:49.854 INFO:teuthology.orchestra.run.smithi193.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:08:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether d6:fe:8d:ff:7e:c7 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:08:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:08:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 fe80::9c15:96ff:fec6:8d9/64 scope link 2024-09-17T03:08:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:49.855 INFO:teuthology.orchestra.run.smithi193.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:08:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether d6:fe:8d:ff:7e:c7 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:08:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 fe80::d4fe:8dff:feff:7ec7/64 scope link tentative 2024-09-17T03:08:49.855 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:49.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:49.855 DEBUG:teuthology.orchestra.run.smithi193:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:08:49.917 INFO:teuthology.orchestra.run.smithi193.stdout:1 2024-09-17T03:08:49.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:49.919 DEBUG:teuthology.orchestra.run.smithi193:> route 2024-09-17T03:08:49.975 INFO:teuthology.orchestra.run.smithi193.stdout:Kernel IP routing table 2024-09-17T03:08:49.975 INFO:teuthology.orchestra.run.smithi193.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:08:49.975 INFO:teuthology.orchestra.run.smithi193.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:08:49.975 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:08:49.975 INFO:teuthology.orchestra.run.smithi193.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:08:49.976 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:08:49.976 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-09-17T03:08:49.976 DEBUG:teuthology.orchestra.run.smithi193:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:08:49.976 DEBUG:teuthology.orchestra.run.smithi193:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:08:49.976 DEBUG:teuthology.orchestra.run.smithi193:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:08:49.976 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-09-17T03:08:50.063 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:50.094 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:50.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:50.100 DEBUG:teuthology.orchestra.run.smithi193:> ip netns list 2024-09-17T03:08:50.115 INFO:teuthology.orchestra.run.smithi193.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:08:50.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:50.116 DEBUG:teuthology.orchestra.run.smithi193:> ip netns list-id 2024-09-17T03:08:50.171 INFO:teuthology.orchestra.run.smithi193.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-17T03:08:50.172 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:08:50.172 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-09-17T03:08:50.172 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:08:50.172 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-17T03:08:50.172 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-09-17T03:08:50.259 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:50.281 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:50.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:50.287 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T03:08:50.313 INFO:teuthology.orchestra.run.smithi193.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:08:50.313 INFO:teuthology.orchestra.run.smithi193.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:08:50.314 INFO:teuthology.orchestra.run.smithi193.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:08:50.314 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:50.314 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 ::1/128 scope host 2024-09-17T03:08:50.314 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:50.314 INFO:teuthology.orchestra.run.smithi193.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:08:50.314 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 42:48:e6:fb:74:8b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T03:08:50.314 INFO:teuthology.orchestra.run.smithi193.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T03:08:50.314 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:50.314 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 fe80::4048:e6ff:fefb:748b/64 scope link tentative 2024-09-17T03:08:50.314 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:50.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:50.315 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T03:08:50.380 INFO:teuthology.orchestra.run.smithi193.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:08:50.380 INFO:teuthology.orchestra.run.smithi193.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:08:50.381 INFO:teuthology.orchestra.run.smithi193.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:08:50.381 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:50.381 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 ::1/128 scope host 2024-09-17T03:08:50.381 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:50.381 INFO:teuthology.orchestra.run.smithi193.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:08:50.381 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 42:48:e6:fb:74:8b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T03:08:50.381 INFO:teuthology.orchestra.run.smithi193.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T03:08:50.381 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:50.381 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 fe80::4048:e6ff:fefb:748b/64 scope link tentative 2024-09-17T03:08:50.381 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:08:50.382 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-17T03:08:50.382 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:08:50.383 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-09-17T03:08:50.383 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-17T03:08:50.383 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T03:08:50.383 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-17T03:08:50.383 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-17T03:08:50.383 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-17T03:08:50.383 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-09-17T03:08:50.470 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:50.528 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:50.534 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:08:50.534 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-09-17T03:08:50.534 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link set brx.1 up 2024-09-17T03:08:50.534 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T03:08:50.534 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-09-17T03:08:50.582 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:50.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:50.611 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:08:50.611 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-17T03:08:50.627 INFO:teuthology.orchestra.run.smithi193.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-17T03:08:50.627 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:08:50.627 DEBUG:teuthology.orchestra.run.smithi193:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-17T03:08:50.681 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:08:50.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:50.682 DEBUG:teuthology.orchestra.run.smithi193:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T03:08:50.776 INFO:teuthology.orchestra.run.smithi193.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T03:08:50.776 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T03:08:50.776 INFO:teuthology.orchestra.run.smithi193.stdout:invalid new device string format 2024-09-17T03:08:50.787 INFO:teuthology.orchestra.run.smithi193.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T03:08:50.787 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T03:08:50.787 INFO:teuthology.orchestra.run.smithi193.stdout:invalid new device string format 2024-09-17T03:08:50.787 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-09-17T03:08:50.787 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:08:50.793 INFO:teuthology.orchestra.run.smithi193.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-17T03:08:50.793 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-17T03:08:50.794 INFO:teuthology.orchestra.run.smithi193.stdout:invalid new device string format 2024-09-17T03:08:50.794 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-09-17T03:08:50.794 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:08:50.794 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: resolved to: "172.21.15.78:6789,172.21.15.193:6789,172.21.15.193:6790" 2024-09-17T03:08:50.794 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.78:6789,172.21.15.193:6789,172.21.15.193:6790:/ 2024-09-17T03:08:50.794 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=f3c59ba9-dab4-4ee6-8989-d80d11d430b6" will pass to kernel 2024-09-17T03:08:50.795 INFO:teuthology.orchestra.run.smithi193.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-17T03:08:50.795 INFO:teuthology.orchestra.run.smithi193.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:08:50.795 INFO:teuthology.orchestra.run.smithi193.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:08:50.795 INFO:teuthology.orchestra.run.smithi193.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:08:50.795 INFO:teuthology.orchestra.run.smithi193.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:08:50.796 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:08:50.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:50.796 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-17T03:08:50.821 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:08:50.909 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:08:50.910 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:50.916 INFO:teuthology.orchestra.run.smithi193.stdout:client4770 2024-09-17T03:08:50.916 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:50.916 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:08:50.932 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:08:51.020 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:08:51.021 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:51.027 INFO:teuthology.orchestra.run.smithi193.stdout:client4770 2024-09-17T03:08:51.027 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:08:51.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:51 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:08:51.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:51.082 INFO:teuthology.orchestra.run.smithi193.stdout:client4770 2024-09-17T03:08:51.082 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f3c59ba9-dab4-4ee6-8989-d80d11d430b6.client4770/status') 2024-09-17T03:08:51.130 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:08:51.140 INFO:teuthology.orchestra.run.smithi193.stdout:instance: client.4770 (3)172.21.15.193:0/3074233391 2024-09-17T03:08:51.140 INFO:teuthology.orchestra.run.smithi193.stdout:blocklisted: false 2024-09-17T03:08:51.140 INFO:teuthology.orchestra.run.smithi193.stderr:0+1 records in 2024-09-17T03:08:51.141 INFO:teuthology.orchestra.run.smithi193.stderr:0+1 records out 2024-09-17T03:08:51.141 INFO:teuthology.orchestra.run.smithi193.stderr:71 bytes copied, 3.0993e-05 s, 2.3 MB/s 2024-09-17T03:08:51.141 INFO:teuthology.orchestra.run.smithi193.stderr:2024-09-17T03:08:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:08:51.148 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-17T03:08:51.190 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_multimds_misc.TestScrub2) 2024-09-17T03:08:51.191 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:08:51.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.318+0000 7f473c2cc640 1 -- 172.21.15.78:0/3389249120 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f47340cf0d0 msgr2=0x7f47340b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:51.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.318+0000 7f473c2cc640 1 --2- 172.21.15.78:0/3389249120 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f47340cf0d0 0x7f47340b4670 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4724005fd0 tx=0x7f472402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.318+0000 7f473c2cc640 1 -- 172.21.15.78:0/3389249120 shutdown_connections 2024-09-17T03:08:51.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.318+0000 7f473c2cc640 1 --2- 172.21.15.78:0/3389249120 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f47340cf0d0 0x7f47340b4670 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.318+0000 7f473c2cc640 1 --2- 172.21.15.78:0/3389249120 >> v2:172.21.15.193:3300/0 conn(0x7f473415b6a0 0x7f47340b5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.318+0000 7f473c2cc640 1 -- 172.21.15.78:0/3389249120 >> 172.21.15.78:0/3389249120 conn(0x7f47340b2160 msgr2=0x7f47340b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:51.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.319+0000 7f473c2cc640 1 -- 172.21.15.78:0/3389249120 shutdown_connections 2024-09-17T03:08:51.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.319+0000 7f473c2cc640 1 -- 172.21.15.78:0/3389249120 wait complete. 2024-09-17T03:08:51.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.320+0000 7f473c2cc640 1 Processor -- start 2024-09-17T03:08:51.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.320+0000 7f473c2cc640 1 -- start start 2024-09-17T03:08:51.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f473c2cc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47340cf0d0 0x7f47341e3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:51.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f473c2cc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47340cf4e0 0x7f4734145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:51.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f473c2cc640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f473415b6a0 0x7f4734154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:51.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f473c2cc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4734070180 con 0x7f47340cf4e0 2024-09-17T03:08:51.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f473c2cc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4734070000 con 0x7f47340cf0d0 2024-09-17T03:08:51.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f473c2cc640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f47340b4bb0 con 0x7f473415b6a0 2024-09-17T03:08:51.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f4739867640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47340cf4e0 0x7f4734145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:51.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f4739867640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47340cf4e0 0x7f4734145e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51076/0 (socket says 172.21.15.78:51076) 2024-09-17T03:08:51.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f4739867640 1 -- 172.21.15.78:0/3877544135 learned_addr learned my addr 172.21.15.78:0/3877544135 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:51.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f473a068640 1 --2- 172.21.15.78:0/3877544135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47340cf0d0 0x7f47341e3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:51.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f473a869640 1 --2- 172.21.15.78:0/3877544135 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f473415b6a0 0x7f4734154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:51.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f4739867640 1 -- 172.21.15.78:0/3877544135 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f473415b6a0 msgr2=0x7f4734154ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:51.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f4739867640 1 --2- 172.21.15.78:0/3877544135 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f473415b6a0 0x7f4734154ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f4739867640 1 -- 172.21.15.78:0/3877544135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47340cf0d0 msgr2=0x7f47341e3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:51.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f4739867640 1 --2- 172.21.15.78:0/3877544135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47340cf0d0 0x7f47341e3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f4739867640 1 -- 172.21.15.78:0/3877544135 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4734158360 con 0x7f47340cf4e0 2024-09-17T03:08:51.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f4739867640 1 --2- 172.21.15.78:0/3877544135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47340cf4e0 0x7f4734145e70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4724009230 tx=0x7f4724005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:51.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f472affd640 1 -- 172.21.15.78:0/3877544135 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4724035040 con 0x7f47340cf4e0 2024-09-17T03:08:51.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f472affd640 1 -- 172.21.15.78:0/3877544135 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f472403e070 con 0x7f47340cf4e0 2024-09-17T03:08:51.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f473c2cc640 1 -- 172.21.15.78:0/3877544135 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4734158640 con 0x7f47340cf4e0 2024-09-17T03:08:51.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.322+0000 7f472affd640 1 -- 172.21.15.78:0/3877544135 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f472403ac70 con 0x7f47340cf4e0 2024-09-17T03:08:51.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.323+0000 7f473c2cc640 1 -- 172.21.15.78:0/3877544135 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4734158c00 con 0x7f47340cf4e0 2024-09-17T03:08:51.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.324+0000 7f473c2cc640 1 -- 172.21.15.78:0/3877544135 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4734158080 con 0x7f47340cf4e0 2024-09-17T03:08:51.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.324+0000 7f472affd640 1 -- 172.21.15.78:0/3877544135 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4724043470 con 0x7f47340cf4e0 2024-09-17T03:08:51.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.325+0000 7f472affd640 1 --2- 172.21.15.78:0/3877544135 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4718078bc0 0x7f471807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:51.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.325+0000 7f472affd640 1 -- 172.21.15.78:0/3877544135 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f47240bd410 con 0x7f47340cf4e0 2024-09-17T03:08:51.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.325+0000 7f473a068640 1 --2- 172.21.15.78:0/3877544135 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4718078bc0 0x7f471807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:51.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.325+0000 7f473a068640 1 --2- 172.21.15.78:0/3877544135 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4718078bc0 0x7f471807b0d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f47300095f0 tx=0x7f4730005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:51.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.329+0000 7f472affd640 1 -- 172.21.15.78:0/3877544135 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4724085200 con 0x7f47340cf4e0 2024-09-17T03:08:51.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.503+0000 7f473c2cc640 1 -- 172.21.15.78:0/3877544135 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47340b1710 con 0x7f47340cf4e0 2024-09-17T03:08:51.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.504+0000 7f472affd640 1 -- 172.21.15.78:0/3877544135 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16641 (secure 0 0 0) 0x7f4724089c30 con 0x7f47340cf4e0 2024-09-17T03:08:51.504 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:51.505 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:08:29.222925+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:08:25.448752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:08:26.544015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:08:51.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.507+0000 7f473c2cc640 1 -- 172.21.15.78:0/3877544135 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4718078bc0 msgr2=0x7f471807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:51.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.507+0000 7f473c2cc640 1 --2- 172.21.15.78:0/3877544135 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4718078bc0 0x7f471807b0d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f47300095f0 tx=0x7f4730005f90 comp rx=0 tx=0).stop 2024-09-17T03:08:51.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.507+0000 7f473c2cc640 1 -- 172.21.15.78:0/3877544135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47340cf4e0 msgr2=0x7f4734145e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:51.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.507+0000 7f473c2cc640 1 --2- 172.21.15.78:0/3877544135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47340cf4e0 0x7f4734145e70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4724009230 tx=0x7f4724005d50 comp rx=0 tx=0).stop 2024-09-17T03:08:51.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.507+0000 7f473c2cc640 1 -- 172.21.15.78:0/3877544135 shutdown_connections 2024-09-17T03:08:51.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.507+0000 7f473c2cc640 1 --2- 172.21.15.78:0/3877544135 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f473415b6a0 0x7f4734154ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.507+0000 7f473c2cc640 1 --2- 172.21.15.78:0/3877544135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47340cf4e0 0x7f4734145e70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.507+0000 7f473c2cc640 1 --2- 172.21.15.78:0/3877544135 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4718078bc0 0x7f471807b0d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.507+0000 7f473c2cc640 1 --2- 172.21.15.78:0/3877544135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47340cf0d0 0x7f47341e3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.507+0000 7f473c2cc640 1 -- 172.21.15.78:0/3877544135 >> 172.21.15.78:0/3877544135 conn(0x7f47340b2160 msgr2=0x7f473415e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:51.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.507+0000 7f473c2cc640 1 -- 172.21.15.78:0/3877544135 shutdown_connections 2024-09-17T03:08:51.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.507+0000 7f473c2cc640 1 -- 172.21.15.78:0/3877544135 wait complete. 2024-09-17T03:08:51.518 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:08:17.135915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T03:08:25.448752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T03:08:26.544015+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:08:51.519 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:08:51.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.634+0000 7fc1fa8bd640 1 -- 172.21.15.78:0/3779081004 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1f415c580 msgr2=0x7fc1f4070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:51.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.634+0000 7fc1fa8bd640 1 --2- 172.21.15.78:0/3779081004 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1f415c580 0x7fc1f4070540 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc1dc009830 tx=0x7fc1dc02a540 comp rx=0 tx=0).stop 2024-09-17T03:08:51.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.634+0000 7fc1fa8bd640 1 -- 172.21.15.78:0/3779081004 shutdown_connections 2024-09-17T03:08:51.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.635+0000 7fc1fa8bd640 1 --2- 172.21.15.78:0/3779081004 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1f415c580 0x7fc1f4070540 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.635+0000 7fc1fa8bd640 1 -- 172.21.15.78:0/3779081004 >> 172.21.15.78:0/3779081004 conn(0x7fc1f406def0 msgr2=0x7fc1f406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:51.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.635+0000 7fc1fa8bd640 1 -- 172.21.15.78:0/3779081004 shutdown_connections 2024-09-17T03:08:51.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.635+0000 7fc1fa8bd640 1 -- 172.21.15.78:0/3779081004 wait complete. 2024-09-17T03:08:51.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.636+0000 7fc1fa8bd640 1 Processor -- start 2024-09-17T03:08:51.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.636+0000 7fc1fa8bd640 1 -- start start 2024-09-17T03:08:51.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.638+0000 7fc1fa8bd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc1f4074420 0x7fc1f415a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:51.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.638+0000 7fc1fa8bd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1f4155ce0 0x7fc1f4152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:51.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.638+0000 7fc1fa8bd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1f41583e0 0x7fc1f41587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:51.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.638+0000 7fc1fa8bd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f40b5280 con 0x7fc1f41583e0 2024-09-17T03:08:51.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.638+0000 7fc1fa8bd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f40b5100 con 0x7fc1f4155ce0 2024-09-17T03:08:51.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.638+0000 7fc1fa8bd640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc1f40b5400 con 0x7fc1f4074420 2024-09-17T03:08:51.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.638+0000 7fc1f8e5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1f41583e0 0x7fc1f41587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:51.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.638+0000 7fc1f8e5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1f41583e0 0x7fc1f41587f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51088/0 (socket says 172.21.15.78:51088) 2024-09-17T03:08:51.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.638+0000 7fc1f8e5a640 1 -- 172.21.15.78:0/632369135 learned_addr learned my addr 172.21.15.78:0/632369135 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:51.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.638+0000 7fc1f37fe640 1 --2- 172.21.15.78:0/632369135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1f4155ce0 0x7fc1f4152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:51.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.638+0000 7fc1f3fff640 1 --2- 172.21.15.78:0/632369135 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc1f4074420 0x7fc1f415a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:51.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.638+0000 7fc1f8e5a640 1 -- 172.21.15.78:0/632369135 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc1f4074420 msgr2=0x7fc1f415a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:51.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.638+0000 7fc1f8e5a640 1 --2- 172.21.15.78:0/632369135 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc1f4074420 0x7fc1f415a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.638+0000 7fc1f8e5a640 1 -- 172.21.15.78:0/632369135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1f4155ce0 msgr2=0x7fc1f4152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:51.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.638+0000 7fc1f8e5a640 1 --2- 172.21.15.78:0/632369135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1f4155ce0 0x7fc1f4152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.638+0000 7fc1f8e5a640 1 -- 172.21.15.78:0/632369135 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f4158d30 con 0x7fc1f41583e0 2024-09-17T03:08:51.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.638+0000 7fc1f8e5a640 1 --2- 172.21.15.78:0/632369135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1f41583e0 0x7fc1f41587f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec001740 tx=0x7fc1ec00c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:51.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.638+0000 7fc1f0ff9640 1 -- 172.21.15.78:0/632369135 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec011880 con 0x7fc1f41583e0 2024-09-17T03:08:51.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.639+0000 7fc1f0ff9640 1 -- 172.21.15.78:0/632369135 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1ec011b10 con 0x7fc1f41583e0 2024-09-17T03:08:51.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.639+0000 7fc1fa8bd640 1 -- 172.21.15.78:0/632369135 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f4157800 con 0x7fc1f41583e0 2024-09-17T03:08:51.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.639+0000 7fc1f0ff9640 1 -- 172.21.15.78:0/632369135 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec00ce10 con 0x7fc1f41583e0 2024-09-17T03:08:51.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.639+0000 7fc1fa8bd640 1 -- 172.21.15.78:0/632369135 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1f4156a40 con 0x7fc1f41583e0 2024-09-17T03:08:51.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.640+0000 7fc1fa8bd640 1 -- 172.21.15.78:0/632369135 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1f415c580 con 0x7fc1f41583e0 2024-09-17T03:08:51.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.640+0000 7fc1f0ff9640 1 -- 172.21.15.78:0/632369135 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc1ec01a400 con 0x7fc1f41583e0 2024-09-17T03:08:51.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.641+0000 7fc1f0ff9640 1 --2- 172.21.15.78:0/632369135 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc1d4078b90 0x7fc1d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:51.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.641+0000 7fc1f0ff9640 1 -- 172.21.15.78:0/632369135 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc1ec09dba0 con 0x7fc1f41583e0 2024-09-17T03:08:51.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.641+0000 7fc1f3fff640 1 --2- 172.21.15.78:0/632369135 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc1d4078b90 0x7fc1d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:51.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.642+0000 7fc1f3fff640 1 --2- 172.21.15.78:0/632369135 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc1d4078b90 0x7fc1d407b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4001120 tx=0x7fc1e4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:51.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.646+0000 7fc1f0ff9640 1 -- 172.21.15.78:0/632369135 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc1f4158d30 con 0x7fc1f41583e0 2024-09-17T03:08:51.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.819+0000 7fc1fa8bd640 1 -- 172.21.15.78:0/632369135 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc1f41e6f90 con 0x7fc1f41583e0 2024-09-17T03:08:51.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.819+0000 7fc1f0ff9640 1 -- 172.21.15.78:0/632369135 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7fc1ec016030 con 0x7fc1f41583e0 2024-09-17T03:08:51.819 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-09-17T03:08:51.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.821+0000 7fc1fa8bd640 1 -- 172.21.15.78:0/632369135 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc1d4078b90 msgr2=0x7fc1d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:51.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.821+0000 7fc1fa8bd640 1 --2- 172.21.15.78:0/632369135 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc1d4078b90 0x7fc1d407b0a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4001120 tx=0x7fc1e4009040 comp rx=0 tx=0).stop 2024-09-17T03:08:51.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.821+0000 7fc1fa8bd640 1 -- 172.21.15.78:0/632369135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1f41583e0 msgr2=0x7fc1f41587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:51.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.821+0000 7fc1fa8bd640 1 --2- 172.21.15.78:0/632369135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1f41583e0 0x7fc1f41587f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec001740 tx=0x7fc1ec00c640 comp rx=0 tx=0).stop 2024-09-17T03:08:51.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.821+0000 7fc1fa8bd640 1 -- 172.21.15.78:0/632369135 shutdown_connections 2024-09-17T03:08:51.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.821+0000 7fc1fa8bd640 1 --2- 172.21.15.78:0/632369135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1f41583e0 0x7fc1f41587f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.821+0000 7fc1fa8bd640 1 --2- 172.21.15.78:0/632369135 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc1d4078b90 0x7fc1d407b0a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.821+0000 7fc1fa8bd640 1 --2- 172.21.15.78:0/632369135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1f4155ce0 0x7fc1f4152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.821+0000 7fc1fa8bd640 1 --2- 172.21.15.78:0/632369135 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc1f4074420 0x7fc1f415a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.821+0000 7fc1fa8bd640 1 -- 172.21.15.78:0/632369135 >> 172.21.15.78:0/632369135 conn(0x7fc1f406def0 msgr2=0x7fc1f406fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:51.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.822+0000 7fc1fa8bd640 1 -- 172.21.15.78:0/632369135 shutdown_connections 2024-09-17T03:08:51.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.822+0000 7fc1fa8bd640 1 -- 172.21.15.78:0/632369135 wait complete. 2024-09-17T03:08:51.833 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-17T03:08:51.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.950+0000 7f50c8cbe640 1 -- 172.21.15.78:0/1802027810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c4074420 msgr2=0x7f50c406fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:51.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.950+0000 7f50c8cbe640 1 --2- 172.21.15.78:0/1802027810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c4074420 0x7f50c406fe30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f50c4075310 tx=0x7f50b402a560 comp rx=0 tx=0).stop 2024-09-17T03:08:51.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.950+0000 7f50c8cbe640 1 -- 172.21.15.78:0/1802027810 shutdown_connections 2024-09-17T03:08:51.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.950+0000 7f50c8cbe640 1 --2- 172.21.15.78:0/1802027810 >> v2:172.21.15.193:3300/0 conn(0x7f50c4155ce0 0x7f50c40708b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.950+0000 7f50c8cbe640 1 --2- 172.21.15.78:0/1802027810 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f50c415c580 0x7f50c4070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.950+0000 7f50c8cbe640 1 --2- 172.21.15.78:0/1802027810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c4074420 0x7f50c406fe30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.950+0000 7f50c8cbe640 1 -- 172.21.15.78:0/1802027810 >> 172.21.15.78:0/1802027810 conn(0x7f50c406def0 msgr2=0x7f50c406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:51.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.950+0000 7f50c8cbe640 1 -- 172.21.15.78:0/1802027810 shutdown_connections 2024-09-17T03:08:51.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.950+0000 7f50c8cbe640 1 -- 172.21.15.78:0/1802027810 wait complete. 2024-09-17T03:08:51.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.952+0000 7f50c8cbe640 1 Processor -- start 2024-09-17T03:08:51.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.952+0000 7f50c8cbe640 1 -- start start 2024-09-17T03:08:51.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50c8cbe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50c4074420 0x7f50c4153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:51.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50c8cbe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c4155ce0 0x7f50c413cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:51.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50c8cbe640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f50c40b4d00 0x7f50c40b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:51.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50c8cbe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f50c415f9b0 con 0x7f50c4155ce0 2024-09-17T03:08:51.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50c8cbe640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f50c415f830 con 0x7f50c4074420 2024-09-17T03:08:51.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50c8cbe640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f50c415fb30 con 0x7f50c40b4d00 2024-09-17T03:08:51.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50b9d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c4155ce0 0x7f50c413cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:51.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50b9d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c4155ce0 0x7f50c413cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51106/0 (socket says 172.21.15.78:51106) 2024-09-17T03:08:51.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50b9d9b640 1 -- 172.21.15.78:0/3533427268 learned_addr learned my addr 172.21.15.78:0/3533427268 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:51.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50c2d9d640 1 --2- 172.21.15.78:0/3533427268 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f50c40b4d00 0x7f50c40b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:51.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50c259c640 1 --2- 172.21.15.78:0/3533427268 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50c4074420 0x7f50c4153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:51.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50b9d9b640 1 -- 172.21.15.78:0/3533427268 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f50c40b4d00 msgr2=0x7f50c40b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:51.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50b9d9b640 1 --2- 172.21.15.78:0/3533427268 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f50c40b4d00 0x7f50c40b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50b9d9b640 1 -- 172.21.15.78:0/3533427268 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50c4074420 msgr2=0x7f50c4153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:51.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50b9d9b640 1 --2- 172.21.15.78:0/3533427268 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50c4074420 0x7f50c4153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:51.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50b9d9b640 1 -- 172.21.15.78:0/3533427268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c413d120 con 0x7f50c4155ce0 2024-09-17T03:08:51.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50b9d9b640 1 --2- 172.21.15.78:0/3533427268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c4155ce0 0x7f50c413cbe0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00e7c0 tx=0x7f50ac00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:51.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50bb7fe640 1 -- 172.21.15.78:0/3533427268 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac00cab0 con 0x7f50c4155ce0 2024-09-17T03:08:51.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50bb7fe640 1 -- 172.21.15.78:0/3533427268 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50ac00cc50 con 0x7f50c4155ce0 2024-09-17T03:08:51.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50c8cbe640 1 -- 172.21.15.78:0/3533427268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c40b5650 con 0x7f50c4155ce0 2024-09-17T03:08:51.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50bb7fe640 1 -- 172.21.15.78:0/3533427268 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ac005020 con 0x7f50c4155ce0 2024-09-17T03:08:51.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.954+0000 7f50c8cbe640 1 -- 172.21.15.78:0/3533427268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c41f7270 con 0x7f50c4155ce0 2024-09-17T03:08:51.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.955+0000 7f50c8cbe640 1 -- 172.21.15.78:0/3533427268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c415c580 con 0x7f50c4155ce0 2024-09-17T03:08:51.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.956+0000 7f50bb7fe640 1 -- 172.21.15.78:0/3533427268 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f50ac0051c0 con 0x7f50c4155ce0 2024-09-17T03:08:51.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.957+0000 7f50bb7fe640 1 --2- 172.21.15.78:0/3533427268 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f50a4078bc0 0x7f50a407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:51.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.957+0000 7f50bb7fe640 1 -- 172.21.15.78:0/3533427268 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f50ac09b5c0 con 0x7f50c4155ce0 2024-09-17T03:08:51.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.957+0000 7f50c259c640 1 --2- 172.21.15.78:0/3533427268 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f50a4078bc0 0x7f50a407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:51.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.958+0000 7f50c259c640 1 --2- 172.21.15.78:0/3533427268 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f50a4078bc0 0x7f50a407b0d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f50b4033000 tx=0x7f50b4004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:51.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:51.961+0000 7f50bb7fe640 1 -- 172.21.15.78:0/3533427268 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f50c40b5650 con 0x7f50c4155ce0 2024-09-17T03:08:52.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.135+0000 7f50c8cbe640 1 -- 172.21.15.78:0/3533427268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f50c406e4a0 con 0x7f50c4155ce0 2024-09-17T03:08:52.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.135+0000 7f50bb7fe640 1 -- 172.21.15.78:0/3533427268 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f50c413d120 con 0x7f50c4155ce0 2024-09-17T03:08:52.134 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2024-09-17T03:08:52.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.137+0000 7f50c8cbe640 1 -- 172.21.15.78:0/3533427268 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f50a4078bc0 msgr2=0x7f50a407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:52.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.137+0000 7f50c8cbe640 1 --2- 172.21.15.78:0/3533427268 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f50a4078bc0 0x7f50a407b0d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f50b4033000 tx=0x7f50b4004730 comp rx=0 tx=0).stop 2024-09-17T03:08:52.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.137+0000 7f50c8cbe640 1 -- 172.21.15.78:0/3533427268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c4155ce0 msgr2=0x7f50c413cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:52.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.137+0000 7f50c8cbe640 1 --2- 172.21.15.78:0/3533427268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c4155ce0 0x7f50c413cbe0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f50ac00e7c0 tx=0x7f50ac00ebc0 comp rx=0 tx=0).stop 2024-09-17T03:08:52.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.137+0000 7f50c8cbe640 1 -- 172.21.15.78:0/3533427268 shutdown_connections 2024-09-17T03:08:52.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.137+0000 7f50c8cbe640 1 --2- 172.21.15.78:0/3533427268 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f50c40b4d00 0x7f50c40b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:52.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.137+0000 7f50c8cbe640 1 --2- 172.21.15.78:0/3533427268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c4155ce0 0x7f50c413cbe0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:52.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.137+0000 7f50c8cbe640 1 --2- 172.21.15.78:0/3533427268 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f50a4078bc0 0x7f50a407b0d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:52.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.137+0000 7f50c8cbe640 1 --2- 172.21.15.78:0/3533427268 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50c4074420 0x7f50c4153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:52.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.137+0000 7f50c8cbe640 1 -- 172.21.15.78:0/3533427268 >> 172.21.15.78:0/3533427268 conn(0x7f50c406def0 msgr2=0x7f50c40cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:52.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.138+0000 7f50c8cbe640 1 -- 172.21.15.78:0/3533427268 shutdown_connections 2024-09-17T03:08:52.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.138+0000 7f50c8cbe640 1 -- 172.21.15.78:0/3533427268 wait complete. 2024-09-17T03:08:52.148 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-17T03:08:52.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.267+0000 7f2ff27e4640 1 -- 172.21.15.78:0/593640400 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2fec06fec0 msgr2=0x7f2fec0702d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:52.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.267+0000 7f2ff27e4640 1 --2- 172.21.15.78:0/593640400 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2fec06fec0 0x7f2fec0702d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0005fd0 tx=0x7f2fe002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:08:52.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.267+0000 7f2ff27e4640 1 -- 172.21.15.78:0/593640400 shutdown_connections 2024-09-17T03:08:52.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.267+0000 7f2ff27e4640 1 --2- 172.21.15.78:0/593640400 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2fec06fec0 0x7f2fec0702d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:52.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.267+0000 7f2ff27e4640 1 --2- 172.21.15.78:0/593640400 >> v2:172.21.15.193:3300/0 conn(0x7f2fec0b4090 0x7f2fec0b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:52.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.267+0000 7f2ff27e4640 1 -- 172.21.15.78:0/593640400 >> 172.21.15.78:0/593640400 conn(0x7f2fec0cdcc0 msgr2=0x7f2fec0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:52.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.267+0000 7f2ff27e4640 1 -- 172.21.15.78:0/593640400 shutdown_connections 2024-09-17T03:08:52.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.267+0000 7f2ff27e4640 1 -- 172.21.15.78:0/593640400 wait complete. 2024-09-17T03:08:52.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.269+0000 7f2ff27e4640 1 Processor -- start 2024-09-17T03:08:52.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.269+0000 7f2ff27e4640 1 -- start start 2024-09-17T03:08:52.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.270+0000 7f2ff27e4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fec06fec0 0x7f2fec0c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:52.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.270+0000 7f2ff27e4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fec0b4090 0x7f2fec0c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:52.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.270+0000 7f2ff27e4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2fec0cfeb0 0x7f2fec09df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:52.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.270+0000 7f2ff27e4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2fec0b4a30 con 0x7f2fec06fec0 2024-09-17T03:08:52.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.270+0000 7f2ff27e4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2fec0b48b0 con 0x7f2fec0b4090 2024-09-17T03:08:52.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.270+0000 7f2ff27e4640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f2fec0b4bb0 con 0x7f2fec0cfeb0 2024-09-17T03:08:52.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.270+0000 7f2febfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fec06fec0 0x7f2fec0c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:52.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.271+0000 7f2febfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fec06fec0 0x7f2fec0c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51118/0 (socket says 172.21.15.78:51118) 2024-09-17T03:08:52.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.271+0000 7f2febfff640 1 -- 172.21.15.78:0/282423947 learned_addr learned my addr 172.21.15.78:0/282423947 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:52.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.271+0000 7f2feb7fe640 1 --2- 172.21.15.78:0/282423947 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fec0b4090 0x7f2fec0c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:52.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.271+0000 7f2ff0d81640 1 --2- 172.21.15.78:0/282423947 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2fec0cfeb0 0x7f2fec09df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:52.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.271+0000 7f2febfff640 1 -- 172.21.15.78:0/282423947 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2fec0cfeb0 msgr2=0x7f2fec09df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:52.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.271+0000 7f2febfff640 1 --2- 172.21.15.78:0/282423947 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2fec0cfeb0 0x7f2fec09df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:52.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.271+0000 7f2febfff640 1 -- 172.21.15.78:0/282423947 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fec0b4090 msgr2=0x7f2fec0c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:52.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.271+0000 7f2febfff640 1 --2- 172.21.15.78:0/282423947 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fec0b4090 0x7f2fec0c77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:52.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.271+0000 7f2febfff640 1 -- 172.21.15.78:0/282423947 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fec0cc800 con 0x7f2fec06fec0 2024-09-17T03:08:52.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.271+0000 7f2febfff640 1 --2- 172.21.15.78:0/282423947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fec06fec0 0x7f2fec0c7260 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00e790 tx=0x7f2fdc00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:52.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.271+0000 7f2fe8ff9640 1 -- 172.21.15.78:0/282423947 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc00eea0 con 0x7f2fec06fec0 2024-09-17T03:08:52.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.271+0000 7f2fe8ff9640 1 -- 172.21.15.78:0/282423947 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2fdc00cd50 con 0x7f2fec06fec0 2024-09-17T03:08:52.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.271+0000 7f2ff27e4640 1 -- 172.21.15.78:0/282423947 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fec150dd0 con 0x7f2fec06fec0 2024-09-17T03:08:52.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.271+0000 7f2fe8ff9640 1 -- 172.21.15.78:0/282423947 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc010690 con 0x7f2fec06fec0 2024-09-17T03:08:52.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.271+0000 7f2ff27e4640 1 -- 172.21.15.78:0/282423947 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fec151390 con 0x7f2fec06fec0 2024-09-17T03:08:52.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.272+0000 7f2ff27e4640 1 -- 172.21.15.78:0/282423947 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fec0b50d0 con 0x7f2fec06fec0 2024-09-17T03:08:52.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.273+0000 7f2fe8ff9640 1 -- 172.21.15.78:0/282423947 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2fdc010830 con 0x7f2fec06fec0 2024-09-17T03:08:52.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.274+0000 7f2fe8ff9640 1 --2- 172.21.15.78:0/282423947 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2fd8078b90 0x7f2fd807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:52.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.274+0000 7f2fe8ff9640 1 -- 172.21.15.78:0/282423947 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2fdc09b650 con 0x7f2fec06fec0 2024-09-17T03:08:52.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.274+0000 7f2feb7fe640 1 --2- 172.21.15.78:0/282423947 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2fd8078b90 0x7f2fd807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:52.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.274+0000 7f2feb7fe640 1 --2- 172.21.15.78:0/282423947 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2fd8078b90 0x7f2fd807b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0033000 tx=0x7f2fe0004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:52.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.278+0000 7f2fe8ff9640 1 -- 172.21.15.78:0/282423947 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2fdc063440 con 0x7f2fec06fec0 2024-09-17T03:08:52.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.453+0000 7f2ff27e4640 1 -- 172.21.15.78:0/282423947 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2fec074cf0 con 0x7f2fec06fec0 2024-09-17T03:08:52.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.454+0000 7f2fe8ff9640 1 -- 172.21.15.78:0/282423947 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f2fdc067e70 con 0x7f2fec06fec0 2024-09-17T03:08:52.453 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2024-09-17T03:08:52.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.456+0000 7f2ff27e4640 1 -- 172.21.15.78:0/282423947 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2fd8078b90 msgr2=0x7f2fd807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:52.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.456+0000 7f2ff27e4640 1 --2- 172.21.15.78:0/282423947 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2fd8078b90 0x7f2fd807b0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0033000 tx=0x7f2fe0004730 comp rx=0 tx=0).stop 2024-09-17T03:08:52.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.456+0000 7f2ff27e4640 1 -- 172.21.15.78:0/282423947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fec06fec0 msgr2=0x7f2fec0c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:52.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.456+0000 7f2ff27e4640 1 --2- 172.21.15.78:0/282423947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fec06fec0 0x7f2fec0c7260 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00e790 tx=0x7f2fdc00ec50 comp rx=0 tx=0).stop 2024-09-17T03:08:52.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.456+0000 7f2ff27e4640 1 -- 172.21.15.78:0/282423947 shutdown_connections 2024-09-17T03:08:52.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.456+0000 7f2ff27e4640 1 --2- 172.21.15.78:0/282423947 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2fec0cfeb0 0x7f2fec09df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:52.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.456+0000 7f2ff27e4640 1 --2- 172.21.15.78:0/282423947 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2fd8078b90 0x7f2fd807b0a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:52.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.456+0000 7f2ff27e4640 1 --2- 172.21.15.78:0/282423947 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fec0b4090 0x7f2fec0c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:52.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.456+0000 7f2ff27e4640 1 --2- 172.21.15.78:0/282423947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fec06fec0 0x7f2fec0c7260 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:52.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.456+0000 7f2ff27e4640 1 -- 172.21.15.78:0/282423947 >> 172.21.15.78:0/282423947 conn(0x7f2fec0cdcc0 msgr2=0x7f2fec15e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:52.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.456+0000 7f2ff27e4640 1 -- 172.21.15.78:0/282423947 shutdown_connections 2024-09-17T03:08:52.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.456+0000 7f2ff27e4640 1 -- 172.21.15.78:0/282423947 wait complete. 2024-09-17T03:08:52.466 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag' 2024-09-17T03:08:52.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.579+0000 7f50d9630640 1 -- 172.21.15.78:0/1682579150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50d40d16f0 msgr2=0x7f50d415d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:52.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.579+0000 7f50d9630640 1 --2- 172.21.15.78:0/1682579150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50d40d16f0 0x7f50d415d900 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f50c4005fd0 tx=0x7f50c402ab20 comp rx=0 tx=0).stop 2024-09-17T03:08:52.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.579+0000 7f50d9630640 1 -- 172.21.15.78:0/1682579150 shutdown_connections 2024-09-17T03:08:52.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.579+0000 7f50d9630640 1 --2- 172.21.15.78:0/1682579150 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f50d40cf3f0 0x7f50d40cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:52.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.579+0000 7f50d9630640 1 --2- 172.21.15.78:0/1682579150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50d40d16f0 0x7f50d415d900 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:52.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.579+0000 7f50d9630640 1 -- 172.21.15.78:0/1682579150 >> 172.21.15.78:0/1682579150 conn(0x7f50d406d5d0 msgr2=0x7f50d4071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:52.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.579+0000 7f50d9630640 1 -- 172.21.15.78:0/1682579150 shutdown_connections 2024-09-17T03:08:52.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.579+0000 7f50d9630640 1 -- 172.21.15.78:0/1682579150 wait complete. 2024-09-17T03:08:52.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.581+0000 7f50d9630640 1 Processor -- start 2024-09-17T03:08:52.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.581+0000 7f50d9630640 1 -- start start 2024-09-17T03:08:52.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.582+0000 7f50d9630640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50d40cf3f0 0x7f50d40b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:52.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.582+0000 7f50d9630640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50d40d16f0 0x7f50d41522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:52.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.582+0000 7f50d9630640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f50d4160550 0x7f50d4159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:52.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.582+0000 7f50d9630640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f50d4160cf0 con 0x7f50d40cf3f0 2024-09-17T03:08:52.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.582+0000 7f50d9630640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f50d4160b70 con 0x7f50d40d16f0 2024-09-17T03:08:52.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.582+0000 7f50d9630640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f50d40d0480 con 0x7f50d4160550 2024-09-17T03:08:52.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.582+0000 7f50d2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50d40cf3f0 0x7f50d40b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:52.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.582+0000 7f50d2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50d40cf3f0 0x7f50d40b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51126/0 (socket says 172.21.15.78:51126) 2024-09-17T03:08:52.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.582+0000 7f50d2ffd640 1 -- 172.21.15.78:0/30224899 learned_addr learned my addr 172.21.15.78:0/30224899 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:52.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.583+0000 7f50d37fe640 1 --2- 172.21.15.78:0/30224899 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f50d4160550 0x7f50d4159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:52.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.583+0000 7f50d27fc640 1 --2- 172.21.15.78:0/30224899 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50d40d16f0 0x7f50d41522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:52.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.583+0000 7f50d2ffd640 1 -- 172.21.15.78:0/30224899 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f50d4160550 msgr2=0x7f50d4159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:52.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.583+0000 7f50d2ffd640 1 --2- 172.21.15.78:0/30224899 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f50d4160550 0x7f50d4159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:52.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.583+0000 7f50d2ffd640 1 -- 172.21.15.78:0/30224899 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50d40d16f0 msgr2=0x7f50d41522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:52.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.583+0000 7f50d2ffd640 1 --2- 172.21.15.78:0/30224899 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50d40d16f0 0x7f50d41522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:52.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.583+0000 7f50d2ffd640 1 -- 172.21.15.78:0/30224899 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50d40b4340 con 0x7f50d40cf3f0 2024-09-17T03:08:52.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.583+0000 7f50d2ffd640 1 --2- 172.21.15.78:0/30224899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50d40cf3f0 0x7f50d40b3e00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f50c4006010 tx=0x7f50c4003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:52.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.583+0000 7f50cb7fe640 1 -- 172.21.15.78:0/30224899 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c4044070 con 0x7f50d40cf3f0 2024-09-17T03:08:52.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.583+0000 7f50cb7fe640 1 -- 172.21.15.78:0/30224899 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f50c4004250 con 0x7f50d40cf3f0 2024-09-17T03:08:52.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.583+0000 7f50d9630640 1 -- 172.21.15.78:0/30224899 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50d41f3c30 con 0x7f50d40cf3f0 2024-09-17T03:08:52.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.583+0000 7f50cb7fe640 1 -- 172.21.15.78:0/30224899 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c4004660 con 0x7f50d40cf3f0 2024-09-17T03:08:52.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.583+0000 7f50d9630640 1 -- 172.21.15.78:0/30224899 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50d40b4850 con 0x7f50d40cf3f0 2024-09-17T03:08:52.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.584+0000 7f50d9630640 1 -- 172.21.15.78:0/30224899 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50d415f2b0 con 0x7f50d40cf3f0 2024-09-17T03:08:52.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.585+0000 7f50cb7fe640 1 -- 172.21.15.78:0/30224899 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f50c4036400 con 0x7f50d40cf3f0 2024-09-17T03:08:52.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.585+0000 7f50cb7fe640 1 --2- 172.21.15.78:0/30224899 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f50b4078b90 0x7f50b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:52.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.586+0000 7f50cb7fe640 1 -- 172.21.15.78:0/30224899 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f50c40bb600 con 0x7f50d40cf3f0 2024-09-17T03:08:52.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.586+0000 7f50d27fc640 1 --2- 172.21.15.78:0/30224899 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f50b4078b90 0x7f50b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:52.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.586+0000 7f50d27fc640 1 --2- 172.21.15.78:0/30224899 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f50b4078b90 0x7f50b407b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f50d40b3a80 tx=0x7f50bc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:52.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.590+0000 7f50cb7fe640 1 -- 172.21.15.78:0/30224899 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f50c4032030 con 0x7f50d40cf3f0 2024-09-17T03:08:52.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:52.831+0000 7f50d9630640 1 -- 172.21.15.78:0/30224899 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag"]} v 0) -- 0x7f50d40d10d0 con 0x7f50d40cf3f0 2024-09-17T03:08:53.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.311+0000 7f50cb7fe640 1 -- 172.21.15.78:0/30224899 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag"]}]=0 v46) ==== 139+0+0 (secure 0 0 0) 0x7f50c4083ad0 con 0x7f50d40cf3f0 2024-09-17T03:08:53.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.314+0000 7f50d9630640 1 -- 172.21.15.78:0/30224899 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f50b4078b90 msgr2=0x7f50b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:53.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.314+0000 7f50d9630640 1 --2- 172.21.15.78:0/30224899 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f50b4078b90 0x7f50b407b0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f50d40b3a80 tx=0x7f50bc009040 comp rx=0 tx=0).stop 2024-09-17T03:08:53.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.314+0000 7f50d9630640 1 -- 172.21.15.78:0/30224899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50d40cf3f0 msgr2=0x7f50d40b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:53.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.314+0000 7f50d9630640 1 --2- 172.21.15.78:0/30224899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50d40cf3f0 0x7f50d40b3e00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f50c4006010 tx=0x7f50c4003ce0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.314+0000 7f50d9630640 1 -- 172.21.15.78:0/30224899 shutdown_connections 2024-09-17T03:08:53.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.314+0000 7f50d9630640 1 --2- 172.21.15.78:0/30224899 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f50d4160550 0x7f50d4159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.314+0000 7f50d9630640 1 --2- 172.21.15.78:0/30224899 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f50b4078b90 0x7f50b407b0a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.314+0000 7f50d9630640 1 --2- 172.21.15.78:0/30224899 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50d40d16f0 0x7f50d41522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.314+0000 7f50d9630640 1 --2- 172.21.15.78:0/30224899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50d40cf3f0 0x7f50d40b3e00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.314+0000 7f50d9630640 1 -- 172.21.15.78:0/30224899 >> 172.21.15.78:0/30224899 conn(0x7f50d406d5d0 msgr2=0x7f50d40d22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:53.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.314+0000 7f50d9630640 1 -- 172.21.15.78:0/30224899 shutdown_connections 2024-09-17T03:08:53.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.314+0000 7f50d9630640 1 -- 172.21.15.78:0/30224899 wait complete. 2024-09-17T03:08:53.325 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:08:53.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.440+0000 7f53a38f9640 1 -- 172.21.15.78:0/1049223732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5388004800 msgr2=0x7f5388004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:53.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.440+0000 7f53a38f9640 1 --2- 172.21.15.78:0/1049223732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5388004800 0x7f5388004c10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f538c009b50 tx=0x7f5388005830 comp rx=0 tx=0).stop 2024-09-17T03:08:53.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.440+0000 7f53a1e96640 1 -- 172.21.15.78:0/1049223732 reap_dead start 2024-09-17T03:08:53.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.440+0000 7f53a38f9640 1 -- 172.21.15.78:0/1049223732 shutdown_connections 2024-09-17T03:08:53.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.440+0000 7f53a38f9640 1 -- 172.21.15.78:0/1049223732 >> 172.21.15.78:0/1049223732 conn(0x7f539c08bfc0 msgr2=0x7f539c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:53.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.440+0000 7f53a38f9640 1 -- 172.21.15.78:0/1049223732 shutdown_connections 2024-09-17T03:08:53.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.440+0000 7f53a38f9640 1 -- 172.21.15.78:0/1049223732 wait complete. 2024-09-17T03:08:53.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.442+0000 7f53a38f9640 1 Processor -- start 2024-09-17T03:08:53.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.442+0000 7f53a38f9640 1 -- start start 2024-09-17T03:08:53.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.443+0000 7f53a38f9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5388004800 0x7f539c1e4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:53.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.443+0000 7f53a38f9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f539c0cd9c0 0x7f539c0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:53.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.443+0000 7f53a38f9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f539c0ca760 0x7f539c0c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:53.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.443+0000 7f53a38f9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f539c0b9020 con 0x7f539c0ca760 2024-09-17T03:08:53.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.443+0000 7f53a38f9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f539c0b4260 con 0x7f539c0cd9c0 2024-09-17T03:08:53.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.443+0000 7f53a38f9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f539c0b91a0 con 0x7f5388004800 2024-09-17T03:08:53.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.443+0000 7f53a1e96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f539c0ca760 0x7f539c0c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:53.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.443+0000 7f53a1e96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f539c0ca760 0x7f539c0c8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51138/0 (socket says 172.21.15.78:51138) 2024-09-17T03:08:53.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.443+0000 7f53a1e96640 1 -- 172.21.15.78:0/1060987249 learned_addr learned my addr 172.21.15.78:0/1060987249 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:53.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.443+0000 7f53a0e94640 1 --2- 172.21.15.78:0/1060987249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f539c0cd9c0 0x7f539c0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:53.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.443+0000 7f53a1695640 1 --2- 172.21.15.78:0/1060987249 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5388004800 0x7f539c1e4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:53.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.443+0000 7f53a1e96640 1 -- 172.21.15.78:0/1060987249 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5388004800 msgr2=0x7f539c1e4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:53.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.443+0000 7f53a1e96640 1 --2- 172.21.15.78:0/1060987249 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5388004800 0x7f539c1e4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.443+0000 7f53a1e96640 1 -- 172.21.15.78:0/1060987249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f539c0cd9c0 msgr2=0x7f539c0c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:53.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.443+0000 7f53a1e96640 1 --2- 172.21.15.78:0/1060987249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f539c0cd9c0 0x7f539c0c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.443+0000 7f53a1e96640 1 -- 172.21.15.78:0/1060987249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f539c1f6af0 con 0x7f539c0ca760 2024-09-17T03:08:53.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.444+0000 7f53a1e96640 1 --2- 172.21.15.78:0/1060987249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f539c0ca760 0x7f539c0c8650 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f539c08d4e0 tx=0x7f53940019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:53.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.444+0000 7f5391ffb640 1 -- 172.21.15.78:0/1060987249 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394015020 con 0x7f539c0ca760 2024-09-17T03:08:53.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.444+0000 7f5391ffb640 1 -- 172.21.15.78:0/1060987249 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5394011980 con 0x7f539c0ca760 2024-09-17T03:08:53.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.444+0000 7f5391ffb640 1 -- 172.21.15.78:0/1060987249 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5394011dd0 con 0x7f539c0ca760 2024-09-17T03:08:53.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.444+0000 7f53a38f9640 1 -- 172.21.15.78:0/1060987249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f539c0ccee0 con 0x7f539c0ca760 2024-09-17T03:08:53.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.444+0000 7f53a38f9640 1 -- 172.21.15.78:0/1060987249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f539c0cd4a0 con 0x7f539c0ca760 2024-09-17T03:08:53.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.445+0000 7f53a38f9640 1 -- 172.21.15.78:0/1060987249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f539c0b96e0 con 0x7f539c0ca760 2024-09-17T03:08:53.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.446+0000 7f5391ffb640 1 -- 172.21.15.78:0/1060987249 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5394018020 con 0x7f539c0ca760 2024-09-17T03:08:53.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.446+0000 7f5391ffb640 1 --2- 172.21.15.78:0/1060987249 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5380078bf0 0x7f538007b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:53.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.446+0000 7f5391ffb640 1 -- 172.21.15.78:0/1060987249 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f539409b360 con 0x7f539c0ca760 2024-09-17T03:08:53.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.446+0000 7f53a1695640 1 --2- 172.21.15.78:0/1060987249 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5380078bf0 0x7f538007b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:53.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.447+0000 7f53a1695640 1 --2- 172.21.15.78:0/1060987249 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5380078bf0 0x7f538007b100 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f53980010e0 tx=0x7f5398000fb0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:53.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.451+0000 7f5391ffb640 1 -- 172.21.15.78:0/1060987249 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f539401f030 con 0x7f539c0ca760 2024-09-17T03:08:53.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.622+0000 7f53a38f9640 1 -- 172.21.15.78:0/1060987249 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f539c0cac90 con 0x7f539c0ca760 2024-09-17T03:08:53.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.623+0000 7f5391ffb640 1 -- 172.21.15.78:0/1060987249 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+2294 (secure 0 0 0) 0x7f53940638c0 con 0x7f539c0ca760 2024-09-17T03:08:53.622 INFO:teuthology.orchestra.run.smithi078.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:08:53.622 INFO:teuthology.orchestra.run.smithi078.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:08:53.622 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:08:53.622 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_client 20/20 2024-09-17T03:08:53.622 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:08:53.622 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:08:53.622 INFO:teuthology.orchestra.run.smithi078.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:08:53.622 INFO:teuthology.orchestra.run.smithi078.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:08:53.623 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4994.035848 2024-09-17T03:08:53.623 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5277.317911 2024-09-17T03:08:53.623 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4833.009828 2024-09-17T03:08:53.623 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7208.562209 2024-09-17T03:08:53.623 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4511.051809 2024-09-17T03:08:53.623 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4237.642218 2024-09-17T03:08:53.623 INFO:teuthology.orchestra.run.smithi078.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 6005.051341 2024-09-17T03:08:53.623 INFO:teuthology.orchestra.run.smithi078.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4677.613119 2024-09-17T03:08:53.623 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_mds 20/20 2024-09-17T03:08:53.623 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:08:53.623 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_ms 2/2 2024-09-17T03:08:53.623 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_debug_frag true 2024-09-17T03:08:53.623 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:08:53.624 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:08:53.624 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_verify_scatter true 2024-09-17T03:08:53.624 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:08:53.624 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:08:53.624 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:08:53.624 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced client_mount_timeout 600 2024-09-17T03:08:53.624 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced debug_client 20/20 2024-09-17T03:08:53.624 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced debug_ms 1/1 2024-09-17T03:08:53.624 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:08:53.624 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:08:53.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.625+0000 7f53a38f9640 1 -- 172.21.15.78:0/1060987249 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5380078bf0 msgr2=0x7f538007b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:53.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.625+0000 7f53a38f9640 1 --2- 172.21.15.78:0/1060987249 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5380078bf0 0x7f538007b100 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f53980010e0 tx=0x7f5398000fb0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.625+0000 7f53a38f9640 1 -- 172.21.15.78:0/1060987249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f539c0ca760 msgr2=0x7f539c0c8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:53.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.625+0000 7f53a38f9640 1 --2- 172.21.15.78:0/1060987249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f539c0ca760 0x7f539c0c8650 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f539c08d4e0 tx=0x7f53940019b0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.625+0000 7f53a38f9640 1 -- 172.21.15.78:0/1060987249 shutdown_connections 2024-09-17T03:08:53.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.625+0000 7f53a38f9640 1 --2- 172.21.15.78:0/1060987249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f539c0ca760 0x7f539c0c8650 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.625+0000 7f53a38f9640 1 --2- 172.21.15.78:0/1060987249 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5380078bf0 0x7f538007b100 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.625+0000 7f53a38f9640 1 --2- 172.21.15.78:0/1060987249 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f539c0cd9c0 0x7f539c0c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.625+0000 7f53a38f9640 1 --2- 172.21.15.78:0/1060987249 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5388004800 0x7f539c1e4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.625+0000 7f53a38f9640 1 -- 172.21.15.78:0/1060987249 >> 172.21.15.78:0/1060987249 conn(0x7f539c08bfc0 msgr2=0x7f539c0d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:53.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.625+0000 7f53a38f9640 1 -- 172.21.15.78:0/1060987249 shutdown_connections 2024-09-17T03:08:53.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.625+0000 7f53a38f9640 1 -- 172.21.15.78:0/1060987249 wait complete. 2024-09-17T03:08:53.635 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:08:53.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.752+0000 7fe34fb57640 1 -- 172.21.15.78:0/2715804927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe34806e170 msgr2=0x7fe3480b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:53.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.752+0000 7fe34fb57640 1 --2- 172.21.15.78:0/2715804927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe34806e170 0x7fe3480b3540 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe3480ba570 tx=0x7fe33802a9a0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.752+0000 7fe34fb57640 1 -- 172.21.15.78:0/2715804927 shutdown_connections 2024-09-17T03:08:53.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.752+0000 7fe34fb57640 1 --2- 172.21.15.78:0/2715804927 >> v2:172.21.15.193:3300/0 conn(0x7fe34806f4b0 0x7fe3480d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.752+0000 7fe34fb57640 1 --2- 172.21.15.78:0/2715804927 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe34806e170 0x7fe3480b3540 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.752+0000 7fe34fb57640 1 -- 172.21.15.78:0/2715804927 >> 172.21.15.78:0/2715804927 conn(0x7fe34808bfc0 msgr2=0x7fe34809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:53.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.752+0000 7fe34fb57640 1 -- 172.21.15.78:0/2715804927 shutdown_connections 2024-09-17T03:08:53.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.752+0000 7fe34fb57640 1 -- 172.21.15.78:0/2715804927 wait complete. 2024-09-17T03:08:53.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.754+0000 7fe34fb57640 1 Processor -- start 2024-09-17T03:08:53.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.754+0000 7fe34fb57640 1 -- start start 2024-09-17T03:08:53.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.755+0000 7fe34fb57640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe34806f4b0 0x7fe3481e9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:53.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.755+0000 7fe34fb57640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe3480d3870 0x7fe3481f6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:53.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.755+0000 7fe34fb57640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3481f5e70 0x7fe3480b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:53.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.755+0000 7fe34fb57640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe3480d0ce0 con 0x7fe34806f4b0 2024-09-17T03:08:53.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.755+0000 7fe34fb57640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe3480cf4e0 con 0x7fe3481f5e70 2024-09-17T03:08:53.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.755+0000 7fe34fb57640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe3480d0e60 con 0x7fe3480d3870 2024-09-17T03:08:53.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.755+0000 7fe34d8f3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe34806f4b0 0x7fe3481e9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:53.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.755+0000 7fe34d8f3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe34806f4b0 0x7fe3481e9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51164/0 (socket says 172.21.15.78:51164) 2024-09-17T03:08:53.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.755+0000 7fe34d8f3640 1 -- 172.21.15.78:0/3329917911 learned_addr learned my addr 172.21.15.78:0/3329917911 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:53.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.756+0000 7fe34d0f2640 1 --2- 172.21.15.78:0/3329917911 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe3480d3870 0x7fe3481f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:53.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.756+0000 7fe34e0f4640 1 --2- 172.21.15.78:0/3329917911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3481f5e70 0x7fe3480b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:53.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.756+0000 7fe34d8f3640 1 -- 172.21.15.78:0/3329917911 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe3480d3870 msgr2=0x7fe3481f6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:53.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.756+0000 7fe34d8f3640 1 --2- 172.21.15.78:0/3329917911 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe3480d3870 0x7fe3481f6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.756+0000 7fe34d8f3640 1 -- 172.21.15.78:0/3329917911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3481f5e70 msgr2=0x7fe3480b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:53.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.756+0000 7fe34d8f3640 1 --2- 172.21.15.78:0/3329917911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3481f5e70 0x7fe3480b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.756+0000 7fe34d8f3640 1 -- 172.21.15.78:0/3329917911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3481e7e20 con 0x7fe34806f4b0 2024-09-17T03:08:53.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.756+0000 7fe34d8f3640 1 --2- 172.21.15.78:0/3329917911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe34806f4b0 0x7fe3481e9ee0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe338033040 tx=0x7fe338031f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:53.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.756+0000 7fe3467fc640 1 -- 172.21.15.78:0/3329917911 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338034040 con 0x7fe34806f4b0 2024-09-17T03:08:53.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.756+0000 7fe3467fc640 1 -- 172.21.15.78:0/3329917911 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe338004560 con 0x7fe34806f4b0 2024-09-17T03:08:53.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.756+0000 7fe34fb57640 1 -- 172.21.15.78:0/3329917911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3481e7460 con 0x7fe34806f4b0 2024-09-17T03:08:53.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.756+0000 7fe3467fc640 1 -- 172.21.15.78:0/3329917911 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe338045480 con 0x7fe34806f4b0 2024-09-17T03:08:53.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.756+0000 7fe34fb57640 1 -- 172.21.15.78:0/3329917911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3481f5670 con 0x7fe34806f4b0 2024-09-17T03:08:53.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.757+0000 7fe34fb57640 1 -- 172.21.15.78:0/3329917911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe34806e170 con 0x7fe34806f4b0 2024-09-17T03:08:53.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.758+0000 7fe3467fc640 1 -- 172.21.15.78:0/3329917911 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe338037020 con 0x7fe34806f4b0 2024-09-17T03:08:53.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.759+0000 7fe3467fc640 1 --2- 172.21.15.78:0/3329917911 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe334078b90 0x7fe33407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:53.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.759+0000 7fe3467fc640 1 -- 172.21.15.78:0/3329917911 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe3380bc650 con 0x7fe34806f4b0 2024-09-17T03:08:53.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.759+0000 7fe34d0f2640 1 --2- 172.21.15.78:0/3329917911 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe334078b90 0x7fe33407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:53.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.759+0000 7fe34d0f2640 1 --2- 172.21.15.78:0/3329917911 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe334078b90 0x7fe33407b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe3481eb260 tx=0x7fe33c00b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:53.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.762+0000 7fe3467fc640 1 -- 172.21.15.78:0/3329917911 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe338054080 con 0x7fe34806f4b0 2024-09-17T03:08:53.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.937+0000 7fe34fb57640 1 -- 172.21.15.78:0/3329917911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fe3481eb290 con 0x7fe34806f4b0 2024-09-17T03:08:53.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.941+0000 7fe3467fc640 1 -- 172.21.15.78:0/3329917911 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7fe338084560 con 0x7fe34806f4b0 2024-09-17T03:08:53.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.943+0000 7fe34fb57640 1 -- 172.21.15.78:0/3329917911 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe334078b90 msgr2=0x7fe33407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:53.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.943+0000 7fe34fb57640 1 --2- 172.21.15.78:0/3329917911 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe334078b90 0x7fe33407b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe3481eb260 tx=0x7fe33c00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.943+0000 7fe34fb57640 1 -- 172.21.15.78:0/3329917911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe34806f4b0 msgr2=0x7fe3481e9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:53.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.943+0000 7fe34fb57640 1 --2- 172.21.15.78:0/3329917911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe34806f4b0 0x7fe3481e9ee0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe338033040 tx=0x7fe338031f80 comp rx=0 tx=0).stop 2024-09-17T03:08:53.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.943+0000 7fe34fb57640 1 -- 172.21.15.78:0/3329917911 shutdown_connections 2024-09-17T03:08:53.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.943+0000 7fe34fb57640 1 --2- 172.21.15.78:0/3329917911 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe334078b90 0x7fe33407b0a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.943+0000 7fe34fb57640 1 --2- 172.21.15.78:0/3329917911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3481f5e70 0x7fe3480b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.943+0000 7fe34fb57640 1 --2- 172.21.15.78:0/3329917911 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe3480d3870 0x7fe3481f6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.943+0000 7fe34fb57640 1 --2- 172.21.15.78:0/3329917911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe34806f4b0 0x7fe3481e9ee0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:53.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.943+0000 7fe34fb57640 1 -- 172.21.15.78:0/3329917911 >> 172.21.15.78:0/3329917911 conn(0x7fe34808bfc0 msgr2=0x7fe34806eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:53.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.943+0000 7fe34fb57640 1 -- 172.21.15.78:0/3329917911 shutdown_connections 2024-09-17T03:08:53.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:53.943+0000 7fe34fb57640 1 -- 172.21.15.78:0/3329917911 wait complete. 2024-09-17T03:08:53.953 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:08:53.954 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:08:53.993 DEBUG:teuthology.orchestra.run.smithi193:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:08:54.038 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:08:54.039 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:08:54.039 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:08:54.054 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:08:54.054 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:08:54.111 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:08:54.111 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:08:54.167 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:08:54.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.326+0000 7ff07749b640 1 -- 172.21.15.78:0/594078562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff07015b900 msgr2=0x7ff0700ae1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:54.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.326+0000 7ff07749b640 1 --2- 172.21.15.78:0/594078562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff07015b900 0x7ff0700ae1b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff070074960 tx=0x7ff06c02a5f0 comp rx=0 tx=0).stop 2024-09-17T03:08:54.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.326+0000 7ff07749b640 1 -- 172.21.15.78:0/594078562 shutdown_connections 2024-09-17T03:08:54.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.326+0000 7ff07749b640 1 --2- 172.21.15.78:0/594078562 >> v2:172.21.15.193:3300/0 conn(0x7ff0700cf520 0x7ff0700ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:54.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.326+0000 7ff07749b640 1 --2- 172.21.15.78:0/594078562 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff07015b900 0x7ff0700ae1b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:54.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.326+0000 7ff07749b640 1 -- 172.21.15.78:0/594078562 >> 172.21.15.78:0/594078562 conn(0x7ff070074170 msgr2=0x7ff0700b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:54.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.326+0000 7ff07749b640 1 -- 172.21.15.78:0/594078562 shutdown_connections 2024-09-17T03:08:54.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.326+0000 7ff07749b640 1 -- 172.21.15.78:0/594078562 wait complete. 2024-09-17T03:08:54.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.328+0000 7ff07749b640 1 Processor -- start 2024-09-17T03:08:54.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.328+0000 7ff07749b640 1 -- start start 2024-09-17T03:08:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.329+0000 7ff07749b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff07009aa30 0x7ff0701545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.329+0000 7ff07749b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff07015b900 0x7ff07006cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.329+0000 7ff07749b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff07015bfb0 0x7ff07006d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.329+0000 7ff07749b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff0700cd010 con 0x7ff07009aa30 2024-09-17T03:08:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.329+0000 7ff07749b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff0700cdeb0 con 0x7ff07015bfb0 2024-09-17T03:08:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.329+0000 7ff07749b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff0700cd190 con 0x7ff07015b900 2024-09-17T03:08:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.329+0000 7ff075237640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff07009aa30 0x7ff0701545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:54.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.330+0000 7ff075237640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff07009aa30 0x7ff0701545e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51174/0 (socket says 172.21.15.78:51174) 2024-09-17T03:08:54.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.330+0000 7ff075237640 1 -- 172.21.15.78:0/3732243652 learned_addr learned my addr 172.21.15.78:0/3732243652 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:54.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.330+0000 7ff075a38640 1 --2- 172.21.15.78:0/3732243652 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff07015bfb0 0x7ff07006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:54.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.330+0000 7ff074a36640 1 --2- 172.21.15.78:0/3732243652 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff07015b900 0x7ff07006cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:54.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.330+0000 7ff075237640 1 -- 172.21.15.78:0/3732243652 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff07015b900 msgr2=0x7ff07006cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:54.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.330+0000 7ff075237640 1 --2- 172.21.15.78:0/3732243652 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff07015b900 0x7ff07006cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:54.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.330+0000 7ff075237640 1 -- 172.21.15.78:0/3732243652 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff07015bfb0 msgr2=0x7ff07006d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:54.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.330+0000 7ff075237640 1 --2- 172.21.15.78:0/3732243652 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff07015bfb0 0x7ff07006d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:54.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.330+0000 7ff075237640 1 -- 172.21.15.78:0/3732243652 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0701e4550 con 0x7ff07009aa30 2024-09-17T03:08:54.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.330+0000 7ff075237640 1 --2- 172.21.15.78:0/3732243652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff07009aa30 0x7ff0701545e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff06c034040 tx=0x7ff06c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:54.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.330+0000 7ff065ffb640 1 -- 172.21.15.78:0/3732243652 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c03e030 con 0x7ff07009aa30 2024-09-17T03:08:54.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.330+0000 7ff065ffb640 1 -- 172.21.15.78:0/3732243652 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff06c003d10 con 0x7ff07009aa30 2024-09-17T03:08:54.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.330+0000 7ff065ffb640 1 -- 172.21.15.78:0/3732243652 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c035040 con 0x7ff07009aa30 2024-09-17T03:08:54.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.330+0000 7ff07749b640 1 -- 172.21.15.78:0/3732243652 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0701f8920 con 0x7ff07009aa30 2024-09-17T03:08:54.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.331+0000 7ff07749b640 1 -- 172.21.15.78:0/3732243652 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0701f8ee0 con 0x7ff07009aa30 2024-09-17T03:08:54.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.331+0000 7ff07749b640 1 -- 172.21.15.78:0/3732243652 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0700cd640 con 0x7ff07009aa30 2024-09-17T03:08:54.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.333+0000 7ff065ffb640 1 -- 172.21.15.78:0/3732243652 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff06c041030 con 0x7ff07009aa30 2024-09-17T03:08:54.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.333+0000 7ff065ffb640 1 --2- 172.21.15.78:0/3732243652 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff054078b90 0x7ff05407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:54.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.333+0000 7ff065ffb640 1 -- 172.21.15.78:0/3732243652 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7ff06c0bb700 con 0x7ff07009aa30 2024-09-17T03:08:54.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.333+0000 7ff074a36640 1 --2- 172.21.15.78:0/3732243652 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff054078b90 0x7ff05407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:54.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.334+0000 7ff074a36640 1 --2- 172.21.15.78:0/3732243652 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff054078b90 0x7ff05407b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff0700ce810 tx=0x7ff060009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:54.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.337+0000 7ff065ffb640 1 -- 172.21.15.78:0/3732243652 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff06c083660 con 0x7ff07009aa30 2024-09-17T03:08:54.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.528+0000 7ff07749b640 1 -- 172.21.15.78:0/3732243652 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff0700ce840 con 0x7ff07009aa30 2024-09-17T03:08:54.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.529+0000 7ff065ffb640 1 -- 172.21.15.78:0/3732243652 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7ff06c0b9e20 con 0x7ff07009aa30 2024-09-17T03:08:54.528 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-09-17T03:08:54.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.531+0000 7ff07749b640 1 -- 172.21.15.78:0/3732243652 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff054078b90 msgr2=0x7ff05407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:54.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.531+0000 7ff07749b640 1 --2- 172.21.15.78:0/3732243652 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff054078b90 0x7ff05407b0a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff0700ce810 tx=0x7ff060009040 comp rx=0 tx=0).stop 2024-09-17T03:08:54.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.531+0000 7ff07749b640 1 -- 172.21.15.78:0/3732243652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff07009aa30 msgr2=0x7ff0701545e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:54.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.531+0000 7ff07749b640 1 --2- 172.21.15.78:0/3732243652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff07009aa30 0x7ff0701545e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff06c034040 tx=0x7ff06c003820 comp rx=0 tx=0).stop 2024-09-17T03:08:54.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.531+0000 7ff07749b640 1 -- 172.21.15.78:0/3732243652 shutdown_connections 2024-09-17T03:08:54.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.531+0000 7ff07749b640 1 --2- 172.21.15.78:0/3732243652 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff054078b90 0x7ff05407b0a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:54.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.531+0000 7ff07749b640 1 --2- 172.21.15.78:0/3732243652 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff07015bfb0 0x7ff07006d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:54.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.531+0000 7ff07749b640 1 --2- 172.21.15.78:0/3732243652 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff07015b900 0x7ff07006cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:54.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.531+0000 7ff07749b640 1 --2- 172.21.15.78:0/3732243652 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff07009aa30 0x7ff0701545e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:54.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.531+0000 7ff07749b640 1 -- 172.21.15.78:0/3732243652 >> 172.21.15.78:0/3732243652 conn(0x7ff070074170 msgr2=0x7ff07015b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:54.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.531+0000 7ff07749b640 1 -- 172.21.15.78:0/3732243652 shutdown_connections 2024-09-17T03:08:54.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.531+0000 7ff07749b640 1 -- 172.21.15.78:0/3732243652 wait complete. 2024-09-17T03:08:54.542 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:08:54.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:54.542 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-17T03:08:54.569 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T03:08:54.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:54.570 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:08:54.632 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:54.632 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:08:54.651 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:54.652 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:08:54.710 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:54.710 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:08:54.719 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:08:54.721 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:08:54.769 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:08:54.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.886+0000 7f7908562640 1 -- 172.21.15.78:0/4131675638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79000ca800 msgr2=0x7f79000cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:54.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.886+0000 7f7908562640 1 --2- 172.21.15.78:0/4131675638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79000ca800 0x7f79000cba00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f78fc005fd0 tx=0x7f78fc02a530 comp rx=0 tx=0).stop 2024-09-17T03:08:54.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.886+0000 7f7908562640 1 -- 172.21.15.78:0/4131675638 shutdown_connections 2024-09-17T03:08:54.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.886+0000 7f7908562640 1 --2- 172.21.15.78:0/4131675638 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79000cad30 0x7f790006ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:54.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.886+0000 7f7908562640 1 --2- 172.21.15.78:0/4131675638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79000ca800 0x7f79000cba00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:54.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.886+0000 7f7908562640 1 -- 172.21.15.78:0/4131675638 >> 172.21.15.78:0/4131675638 conn(0x7f79000b1cb0 msgr2=0x7f79000b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:54.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.886+0000 7f7908562640 1 -- 172.21.15.78:0/4131675638 shutdown_connections 2024-09-17T03:08:54.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.886+0000 7f7908562640 1 -- 172.21.15.78:0/4131675638 wait complete. 2024-09-17T03:08:54.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.888+0000 7f7908562640 1 Processor -- start 2024-09-17T03:08:54.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.888+0000 7f7908562640 1 -- start start 2024-09-17T03:08:54.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.889+0000 7f7908562640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79000704e0 0x7f7900150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:54.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.889+0000 7f7908562640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79000ca800 0x7f790014d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:54.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.890+0000 7f7908562640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79000cad30 0x7f790014efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:54.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.890+0000 7f7908562640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f79000ccf40 con 0x7f79000ca800 2024-09-17T03:08:54.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.890+0000 7f7908562640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f79000747d0 con 0x7f79000cad30 2024-09-17T03:08:54.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.890+0000 7f7908562640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f79000cd0c0 con 0x7f79000704e0 2024-09-17T03:08:54.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.890+0000 7f7905afd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79000ca800 0x7f790014d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:54.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.890+0000 7f7905afd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79000ca800 0x7f790014d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51202/0 (socket says 172.21.15.78:51202) 2024-09-17T03:08:54.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.890+0000 7f7905afd640 1 -- 172.21.15.78:0/1216923838 learned_addr learned my addr 172.21.15.78:0/1216923838 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:54.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.890+0000 7f79062fe640 1 --2- 172.21.15.78:0/1216923838 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79000704e0 0x7f7900150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:54.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.890+0000 7f7906aff640 1 --2- 172.21.15.78:0/1216923838 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79000cad30 0x7f790014efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:54.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.890+0000 7f7905afd640 1 -- 172.21.15.78:0/1216923838 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79000704e0 msgr2=0x7f7900150330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:54.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.890+0000 7f7905afd640 1 --2- 172.21.15.78:0/1216923838 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79000704e0 0x7f7900150330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:54.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.890+0000 7f7905afd640 1 -- 172.21.15.78:0/1216923838 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79000cad30 msgr2=0x7f790014efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:54.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.890+0000 7f7905afd640 1 --2- 172.21.15.78:0/1216923838 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79000cad30 0x7f790014efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:54.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.890+0000 7f7905afd640 1 -- 172.21.15.78:0/1216923838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790014f4e0 con 0x7f79000ca800 2024-09-17T03:08:54.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.890+0000 7f7905afd640 1 --2- 172.21.15.78:0/1216923838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79000ca800 0x7f790014d6d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f78f400c970 tx=0x7f78f400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:54.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.890+0000 7f78f2ffd640 1 -- 172.21.15.78:0/1216923838 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4007bb0 con 0x7f79000ca800 2024-09-17T03:08:54.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.890+0000 7f78f2ffd640 1 -- 172.21.15.78:0/1216923838 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78f4007e40 con 0x7f79000ca800 2024-09-17T03:08:54.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.890+0000 7f7908562640 1 -- 172.21.15.78:0/1216923838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f790014df00 con 0x7f79000ca800 2024-09-17T03:08:54.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.890+0000 7f78f2ffd640 1 -- 172.21.15.78:0/1216923838 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f400f690 con 0x7f79000ca800 2024-09-17T03:08:54.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.890+0000 7f7908562640 1 -- 172.21.15.78:0/1216923838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f790014e4c0 con 0x7f79000ca800 2024-09-17T03:08:54.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.891+0000 7f7908562640 1 -- 172.21.15.78:0/1216923838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79000cd650 con 0x7f79000ca800 2024-09-17T03:08:54.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.892+0000 7f78f2ffd640 1 -- 172.21.15.78:0/1216923838 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f78f400f830 con 0x7f79000ca800 2024-09-17T03:08:54.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.893+0000 7f78f2ffd640 1 --2- 172.21.15.78:0/1216923838 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f78e4078b90 0x7f78e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:54.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.893+0000 7f78f2ffd640 1 -- 172.21.15.78:0/1216923838 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f78f409b3e0 con 0x7f79000ca800 2024-09-17T03:08:54.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.893+0000 7f79062fe640 1 --2- 172.21.15.78:0/1216923838 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f78e4078b90 0x7f78e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:54.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.894+0000 7f79062fe640 1 --2- 172.21.15.78:0/1216923838 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f78e4078b90 0x7f78e407b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f78fc033000 tx=0x7f78fc004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:54.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:54.898+0000 7f78f2ffd640 1 -- 172.21.15.78:0/1216923838 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f78f4014030 con 0x7f79000ca800 2024-09-17T03:08:55.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.090+0000 7f7908562640 1 -- 172.21.15.78:0/1216923838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f79000ce020 con 0x7f79000ca800 2024-09-17T03:08:55.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.090+0000 7f78f2ffd640 1 -- 172.21.15.78:0/1216923838 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f78f40631d0 con 0x7f79000ca800 2024-09-17T03:08:55.089 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-09-17T03:08:55.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.092+0000 7f7908562640 1 -- 172.21.15.78:0/1216923838 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f78e4078b90 msgr2=0x7f78e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:55.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.092+0000 7f7908562640 1 --2- 172.21.15.78:0/1216923838 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f78e4078b90 0x7f78e407b0a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f78fc033000 tx=0x7f78fc004730 comp rx=0 tx=0).stop 2024-09-17T03:08:55.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.092+0000 7f7908562640 1 -- 172.21.15.78:0/1216923838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79000ca800 msgr2=0x7f790014d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:55.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.092+0000 7f7908562640 1 --2- 172.21.15.78:0/1216923838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79000ca800 0x7f790014d6d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f78f400c970 tx=0x7f78f400ce30 comp rx=0 tx=0).stop 2024-09-17T03:08:55.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.092+0000 7f7908562640 1 -- 172.21.15.78:0/1216923838 shutdown_connections 2024-09-17T03:08:55.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.092+0000 7f7908562640 1 --2- 172.21.15.78:0/1216923838 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f78e4078b90 0x7f78e407b0a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:55.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.092+0000 7f7908562640 1 --2- 172.21.15.78:0/1216923838 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79000cad30 0x7f790014efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:55.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.092+0000 7f7908562640 1 --2- 172.21.15.78:0/1216923838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79000ca800 0x7f790014d6d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:55.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.092+0000 7f7908562640 1 --2- 172.21.15.78:0/1216923838 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79000704e0 0x7f7900150330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:55.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.092+0000 7f7908562640 1 -- 172.21.15.78:0/1216923838 >> 172.21.15.78:0/1216923838 conn(0x7f79000b1cb0 msgr2=0x7f79000cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:55.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.092+0000 7f7908562640 1 -- 172.21.15.78:0/1216923838 shutdown_connections 2024-09-17T03:08:55.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.092+0000 7f7908562640 1 -- 172.21.15.78:0/1216923838 wait complete. 2024-09-17T03:08:55.102 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-17T03:08:55.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:55.102 DEBUG:teuthology.orchestra.run.smithi193:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-17T03:08:55.134 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi193.front.sepia.ceph.com 2024-09-17T03:08:55.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:55.134 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T03:08:55.197 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:08:55.198 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:08:55.215 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:08:55.215 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:08:55.271 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:08:55.271 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:08:55.327 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:08:55.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.482+0000 7f5849abd640 1 -- 172.21.15.78:0/3459009298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58440b9b60 msgr2=0x7f58440d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:55.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.482+0000 7f5849abd640 1 --2- 172.21.15.78:0/3459009298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58440b9b60 0x7f58440d4d80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f58340098e0 tx=0x7f583402a4f0 comp rx=0 tx=0).stop 2024-09-17T03:08:55.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.482+0000 7f5849abd640 1 -- 172.21.15.78:0/3459009298 shutdown_connections 2024-09-17T03:08:55.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.482+0000 7f5849abd640 1 --2- 172.21.15.78:0/3459009298 >> v2:172.21.15.193:3300/0 conn(0x7f58440cf540 0x7f58440b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:55.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.482+0000 7f5849abd640 1 --2- 172.21.15.78:0/3459009298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58440b9b60 0x7f58440d4d80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:55.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.482+0000 7f5849abd640 1 -- 172.21.15.78:0/3459009298 >> 172.21.15.78:0/3459009298 conn(0x7f584409d7f0 msgr2=0x7f58440d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:55.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.483+0000 7f5849abd640 1 -- 172.21.15.78:0/3459009298 shutdown_connections 2024-09-17T03:08:55.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.483+0000 7f5849abd640 1 -- 172.21.15.78:0/3459009298 wait complete. 2024-09-17T03:08:55.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.484+0000 7f5849abd640 1 Processor -- start 2024-09-17T03:08:55.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.485+0000 7f5849abd640 1 -- start start 2024-09-17T03:08:55.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.486+0000 7f5849abd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58440b64e0 0x7f584415f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:55.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.486+0000 7f5849abd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58440b9b60 0x7f584414e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:55.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.486+0000 7f5849abd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f58440cf540 0x7f58441f8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:55.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.486+0000 7f5849abd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f58440d2e40 con 0x7f58440b64e0 2024-09-17T03:08:55.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.486+0000 7f5849abd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f58440d2cc0 con 0x7f58440b9b60 2024-09-17T03:08:55.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.486+0000 7f5849abd640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f58440d2fc0 con 0x7f58440cf540 2024-09-17T03:08:55.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.486+0000 7f58437fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58440b64e0 0x7f584415f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:55.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.486+0000 7f58437fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58440b64e0 0x7f584415f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51224/0 (socket says 172.21.15.78:51224) 2024-09-17T03:08:55.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.486+0000 7f58437fe640 1 -- 172.21.15.78:0/3296070605 learned_addr learned my addr 172.21.15.78:0/3296070605 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:55.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.486+0000 7f5842ffd640 1 --2- 172.21.15.78:0/3296070605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58440b9b60 0x7f584414e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:55.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.486+0000 7f5843fff640 1 --2- 172.21.15.78:0/3296070605 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f58440cf540 0x7f58441f8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:55.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.486+0000 7f58437fe640 1 -- 172.21.15.78:0/3296070605 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f58440cf540 msgr2=0x7f58441f8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:55.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.486+0000 7f58437fe640 1 --2- 172.21.15.78:0/3296070605 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f58440cf540 0x7f58441f8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:55.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.486+0000 7f58437fe640 1 -- 172.21.15.78:0/3296070605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58440b9b60 msgr2=0x7f584414e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:55.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.486+0000 7f58437fe640 1 --2- 172.21.15.78:0/3296070605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58440b9b60 0x7f584414e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:55.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.486+0000 7f58437fe640 1 -- 172.21.15.78:0/3296070605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f584415ff90 con 0x7f58440b64e0 2024-09-17T03:08:55.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.487+0000 7f58437fe640 1 --2- 172.21.15.78:0/3296070605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58440b64e0 0x7f584415f4d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f583402aae0 tx=0x7f58340052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:55.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.487+0000 7f582bfff640 1 -- 172.21.15.78:0/3296070605 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f583403f070 con 0x7f58440b64e0 2024-09-17T03:08:55.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.487+0000 7f582bfff640 1 -- 172.21.15.78:0/3296070605 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5834004340 con 0x7f58440b64e0 2024-09-17T03:08:55.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.487+0000 7f5849abd640 1 -- 172.21.15.78:0/3296070605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5844160270 con 0x7f58440b64e0 2024-09-17T03:08:55.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.487+0000 7f582bfff640 1 -- 172.21.15.78:0/3296070605 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5834005cf0 con 0x7f58440b64e0 2024-09-17T03:08:55.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.487+0000 7f5849abd640 1 -- 172.21.15.78:0/3296070605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5844160830 con 0x7f58440b64e0 2024-09-17T03:08:55.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.488+0000 7f5849abd640 1 -- 172.21.15.78:0/3296070605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58440d4d80 con 0x7f58440b64e0 2024-09-17T03:08:55.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.488+0000 7f582bfff640 1 -- 172.21.15.78:0/3296070605 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5834042070 con 0x7f58440b64e0 2024-09-17T03:08:55.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.489+0000 7f582bfff640 1 --2- 172.21.15.78:0/3296070605 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5830078bc0 0x7f583007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:55.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.489+0000 7f582bfff640 1 -- 172.21.15.78:0/3296070605 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f58340bbb80 con 0x7f58440b64e0 2024-09-17T03:08:55.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.489+0000 7f5842ffd640 1 --2- 172.21.15.78:0/3296070605 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5830078bc0 0x7f583007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:55.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.490+0000 7f5842ffd640 1 --2- 172.21.15.78:0/3296070605 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5830078bc0 0x7f583007b0d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f58441f8ed0 tx=0x7f58380095e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:55.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.494+0000 7f582bfff640 1 -- 172.21.15.78:0/3296070605 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5834031770 con 0x7f58440b64e0 2024-09-17T03:08:55.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.678+0000 7f5849abd640 1 -- 172.21.15.78:0/3296070605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f58440d4770 con 0x7f58440b64e0 2024-09-17T03:08:55.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.678+0000 7f582bfff640 1 -- 172.21.15.78:0/3296070605 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f5834083970 con 0x7f58440b64e0 2024-09-17T03:08:55.677 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-09-17T03:08:55.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.680+0000 7f5849abd640 1 -- 172.21.15.78:0/3296070605 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5830078bc0 msgr2=0x7f583007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:55.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.680+0000 7f5849abd640 1 --2- 172.21.15.78:0/3296070605 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5830078bc0 0x7f583007b0d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f58441f8ed0 tx=0x7f58380095e0 comp rx=0 tx=0).stop 2024-09-17T03:08:55.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.680+0000 7f5849abd640 1 -- 172.21.15.78:0/3296070605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58440b64e0 msgr2=0x7f584415f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:55.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.680+0000 7f5849abd640 1 --2- 172.21.15.78:0/3296070605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58440b64e0 0x7f584415f4d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f583402aae0 tx=0x7f58340052f0 comp rx=0 tx=0).stop 2024-09-17T03:08:55.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.680+0000 7f5849abd640 1 -- 172.21.15.78:0/3296070605 shutdown_connections 2024-09-17T03:08:55.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.680+0000 7f5849abd640 1 --2- 172.21.15.78:0/3296070605 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f58440cf540 0x7f58441f8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:55.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.680+0000 7f5849abd640 1 --2- 172.21.15.78:0/3296070605 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5830078bc0 0x7f583007b0d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:55.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.680+0000 7f5849abd640 1 --2- 172.21.15.78:0/3296070605 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58440b9b60 0x7f584414e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:55.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.680+0000 7f5849abd640 1 --2- 172.21.15.78:0/3296070605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f58440b64e0 0x7f584415f4d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:55.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.680+0000 7f5849abd640 1 -- 172.21.15.78:0/3296070605 >> 172.21.15.78:0/3296070605 conn(0x7f584409d7f0 msgr2=0x7f58440b1150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:55.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.680+0000 7f5849abd640 1 -- 172.21.15.78:0/3296070605 shutdown_connections 2024-09-17T03:08:55.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:55.680+0000 7f5849abd640 1 -- 172.21.15.78:0/3296070605 wait complete. 2024-09-17T03:08:55.690 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-17T03:08:55.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:55.691 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-17T03:08:55.717 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T03:08:55.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:55.717 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-17T03:08:55.773 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:55.773 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:08:55.793 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:55.793 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:08:55.856 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:08:55.857 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:08:55.912 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:08:56.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.027+0000 7f0cdf84d640 1 -- 172.21.15.78:0/2469033846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cd80af780 msgr2=0x7f0cd80b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:56.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.027+0000 7f0cdf84d640 1 --2- 172.21.15.78:0/2469033846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cd80af780 0x7f0cd80b39c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4005fd0 tx=0x7f0cd402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:08:56.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.027+0000 7f0cdf84d640 1 -- 172.21.15.78:0/2469033846 shutdown_connections 2024-09-17T03:08:56.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.027+0000 7f0cdf84d640 1 --2- 172.21.15.78:0/2469033846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cd80af780 0x7f0cd80b39c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:56.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.027+0000 7f0cdf84d640 1 -- 172.21.15.78:0/2469033846 >> 172.21.15.78:0/2469033846 conn(0x7f0cd806d7d0 msgr2=0x7f0cd80b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:56.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.027+0000 7f0cdf84d640 1 -- 172.21.15.78:0/2469033846 shutdown_connections 2024-09-17T03:08:56.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.027+0000 7f0cdf84d640 1 -- 172.21.15.78:0/2469033846 wait complete. 2024-09-17T03:08:56.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.029+0000 7f0cdf84d640 1 Processor -- start 2024-09-17T03:08:56.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.029+0000 7f0cdf84d640 1 -- start start 2024-09-17T03:08:56.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.030+0000 7f0cdf84d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0cd8072ff0 0x7f0cd814f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:56.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.030+0000 7f0cdf84d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cd80af780 0x7f0cd80c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:56.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.030+0000 7f0cdf84d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0cd80cd3e0 0x7f0cd8166060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:56.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.030+0000 7f0cdf84d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd8166bf0 con 0x7f0cd80af780 2024-09-17T03:08:56.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.030+0000 7f0cdf84d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0cd80cda00 con 0x7f0cd80cd3e0 2024-09-17T03:08:56.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.030+0000 7f0cdf84d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0cd8166d70 con 0x7f0cd8072ff0 2024-09-17T03:08:56.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.030+0000 7f0cdcde8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cd80af780 0x7f0cd80c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:56.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.030+0000 7f0cdcde8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cd80af780 0x7f0cd80c5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51234/0 (socket says 172.21.15.78:51234) 2024-09-17T03:08:56.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.030+0000 7f0cdcde8640 1 -- 172.21.15.78:0/394364156 learned_addr learned my addr 172.21.15.78:0/394364156 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:56.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.030+0000 7f0cdddea640 1 --2- 172.21.15.78:0/394364156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0cd80cd3e0 0x7f0cd8166060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:56.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.030+0000 7f0cdcde8640 1 -- 172.21.15.78:0/394364156 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0cd8072ff0 msgr2=0x7f0cd814f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:56.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.030+0000 7f0cdcde8640 1 --2- 172.21.15.78:0/394364156 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0cd8072ff0 0x7f0cd814f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:56.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.030+0000 7f0cdcde8640 1 -- 172.21.15.78:0/394364156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0cd80cd3e0 msgr2=0x7f0cd8166060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:56.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.030+0000 7f0cdcde8640 1 --2- 172.21.15.78:0/394364156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0cd80cd3e0 0x7f0cd8166060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:56.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.030+0000 7f0cdcde8640 1 -- 172.21.15.78:0/394364156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cd81f6f80 con 0x7f0cd80af780 2024-09-17T03:08:56.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.031+0000 7f0cdcde8640 1 --2- 172.21.15.78:0/394364156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cd80af780 0x7f0cd80c5630 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800b3c0 tx=0x7f0cc800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:56.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.031+0000 7f0ccdffb640 1 -- 172.21.15.78:0/394364156 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8011830 con 0x7f0cd80af780 2024-09-17T03:08:56.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.031+0000 7f0ccdffb640 1 -- 172.21.15.78:0/394364156 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0cc8016070 con 0x7f0cd80af780 2024-09-17T03:08:56.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.031+0000 7f0cdf84d640 1 -- 172.21.15.78:0/394364156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cd81f7260 con 0x7f0cd80af780 2024-09-17T03:08:56.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.031+0000 7f0ccdffb640 1 -- 172.21.15.78:0/394364156 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc8011da0 con 0x7f0cd80af780 2024-09-17T03:08:56.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.031+0000 7f0cdf84d640 1 -- 172.21.15.78:0/394364156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cd81f7820 con 0x7f0cd80af780 2024-09-17T03:08:56.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.032+0000 7f0cdf84d640 1 -- 172.21.15.78:0/394364156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cd81f6cd0 con 0x7f0cd80af780 2024-09-17T03:08:56.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.033+0000 7f0ccdffb640 1 -- 172.21.15.78:0/394364156 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0cc801b460 con 0x7f0cd80af780 2024-09-17T03:08:56.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.033+0000 7f0ccdffb640 1 --2- 172.21.15.78:0/394364156 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0cbc078b90 0x7f0cbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:56.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.033+0000 7f0ccdffb640 1 -- 172.21.15.78:0/394364156 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0cc809a6e0 con 0x7f0cd80af780 2024-09-17T03:08:56.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.033+0000 7f0cdd5e9640 1 --2- 172.21.15.78:0/394364156 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0cbc078b90 0x7f0cbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:56.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.034+0000 7f0cdd5e9640 1 --2- 172.21.15.78:0/394364156 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0cbc078b90 0x7f0cbc07b0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4033000 tx=0x7f0cd40046c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:56.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.037+0000 7f0ccdffb640 1 -- 172.21.15.78:0/394364156 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0cc8020020 con 0x7f0cd80af780 2024-09-17T03:08:56.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.222+0000 7f0cdf84d640 1 -- 172.21.15.78:0/394364156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0cd80b39c0 con 0x7f0cd80af780 2024-09-17T03:08:56.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.222+0000 7f0ccdffb640 1 -- 172.21.15.78:0/394364156 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f0cc8069080 con 0x7f0cd80af780 2024-09-17T03:08:56.221 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-09-17T03:08:56.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.224+0000 7f0cdf84d640 1 -- 172.21.15.78:0/394364156 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0cbc078b90 msgr2=0x7f0cbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:56.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.224+0000 7f0cdf84d640 1 --2- 172.21.15.78:0/394364156 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0cbc078b90 0x7f0cbc07b0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4033000 tx=0x7f0cd40046c0 comp rx=0 tx=0).stop 2024-09-17T03:08:56.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.224+0000 7f0cdf84d640 1 -- 172.21.15.78:0/394364156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cd80af780 msgr2=0x7f0cd80c5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:56.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.224+0000 7f0cdf84d640 1 --2- 172.21.15.78:0/394364156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cd80af780 0x7f0cd80c5630 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0cc800b3c0 tx=0x7f0cc800b880 comp rx=0 tx=0).stop 2024-09-17T03:08:56.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.224+0000 7f0cdf84d640 1 -- 172.21.15.78:0/394364156 shutdown_connections 2024-09-17T03:08:56.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.224+0000 7f0cdf84d640 1 --2- 172.21.15.78:0/394364156 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0cbc078b90 0x7f0cbc07b0a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:56.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.224+0000 7f0cdf84d640 1 --2- 172.21.15.78:0/394364156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0cd80cd3e0 0x7f0cd8166060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:56.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.224+0000 7f0cdf84d640 1 --2- 172.21.15.78:0/394364156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cd80af780 0x7f0cd80c5630 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:56.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.224+0000 7f0cdf84d640 1 --2- 172.21.15.78:0/394364156 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0cd8072ff0 0x7f0cd814f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:56.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.225+0000 7f0cdf84d640 1 -- 172.21.15.78:0/394364156 >> 172.21.15.78:0/394364156 conn(0x7f0cd806d7d0 msgr2=0x7f0cd8157f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:56.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.225+0000 7f0cdf84d640 1 -- 172.21.15.78:0/394364156 shutdown_connections 2024-09-17T03:08:56.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.225+0000 7f0cdf84d640 1 -- 172.21.15.78:0/394364156 wait complete. 2024-09-17T03:08:56.234 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-17T03:08:56.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:56.235 DEBUG:teuthology.orchestra.run.smithi193:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-17T03:08:56.268 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi193.front.sepia.ceph.com 2024-09-17T03:08:56.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:08:56.268 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-17T03:08:56.327 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:08:56.328 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:08:56.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.441+0000 7fe88d371640 1 -- 172.21.15.78:0/1661756971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe870004000 msgr2=0x7fe870004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:56.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.441+0000 7fe88d371640 1 --2- 172.21.15.78:0/1661756971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe870004000 0x7fe870004800 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe888074550 tx=0x7fe870005830 comp rx=0 tx=0).stop 2024-09-17T03:08:56.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.441+0000 7fe8877fe640 1 -- 172.21.15.78:0/1661756971 reap_dead start 2024-09-17T03:08:56.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.442+0000 7fe88d371640 1 -- 172.21.15.78:0/1661756971 shutdown_connections 2024-09-17T03:08:56.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.442+0000 7fe88d371640 1 -- 172.21.15.78:0/1661756971 >> 172.21.15.78:0/1661756971 conn(0x7fe8880b3f10 msgr2=0x7fe8880b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:56.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.442+0000 7fe88d371640 1 -- 172.21.15.78:0/1661756971 shutdown_connections 2024-09-17T03:08:56.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.442+0000 7fe88d371640 1 -- 172.21.15.78:0/1661756971 wait complete. 2024-09-17T03:08:56.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.443+0000 7fe88d371640 1 Processor -- start 2024-09-17T03:08:56.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.444+0000 7fe88d371640 1 -- start start 2024-09-17T03:08:56.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.445+0000 7fe88d371640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe870004000 0x7fe8880b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:56.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.445+0000 7fe88d371640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8880b6ac0 0x7fe8880b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:56.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.445+0000 7fe88d371640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8881484c0 0x7fe8880b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:56.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.445+0000 7fe88d371640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe8880d0fe0 con 0x7fe8880b6ac0 2024-09-17T03:08:56.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.445+0000 7fe88d371640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe8880d0e60 con 0x7fe8881484c0 2024-09-17T03:08:56.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.445+0000 7fe88d371640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe8880d1160 con 0x7fe870004000 2024-09-17T03:08:56.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.445+0000 7fe8867fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8880b6ac0 0x7fe8880b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:56.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.445+0000 7fe8867fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8880b6ac0 0x7fe8880b0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40808/0 (socket says 172.21.15.78:40808) 2024-09-17T03:08:56.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.445+0000 7fe8867fc640 1 -- 172.21.15.78:0/462743047 learned_addr learned my addr 172.21.15.78:0/462743047 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:56.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.445+0000 7fe886ffd640 1 --2- 172.21.15.78:0/462743047 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe870004000 0x7fe8880b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:56.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.445+0000 7fe8877fe640 1 --2- 172.21.15.78:0/462743047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8881484c0 0x7fe8880b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:56.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.445+0000 7fe8867fc640 1 -- 172.21.15.78:0/462743047 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe870004000 msgr2=0x7fe8880b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:56.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.445+0000 7fe8867fc640 1 --2- 172.21.15.78:0/462743047 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe870004000 0x7fe8880b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:56.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.445+0000 7fe8867fc640 1 -- 172.21.15.78:0/462743047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8881484c0 msgr2=0x7fe8880b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:56.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.445+0000 7fe8867fc640 1 --2- 172.21.15.78:0/462743047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8881484c0 0x7fe8880b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:56.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.445+0000 7fe8867fc640 1 -- 172.21.15.78:0/462743047 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe888159d40 con 0x7fe8880b6ac0 2024-09-17T03:08:56.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.445+0000 7fe8877fe640 1 --2- 172.21.15.78:0/462743047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8881484c0 0x7fe8880b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:08:56.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.445+0000 7fe8867fc640 1 --2- 172.21.15.78:0/462743047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8880b6ac0 0x7fe8880b0b30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe87c001780 tx=0x7fe87c0063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:56.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.446+0000 7fe86f7fe640 1 -- 172.21.15.78:0/462743047 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c038070 con 0x7fe8880b6ac0 2024-09-17T03:08:56.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.446+0000 7fe86f7fe640 1 -- 172.21.15.78:0/462743047 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe87c003af0 con 0x7fe8880b6ac0 2024-09-17T03:08:56.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.446+0000 7fe88d371640 1 -- 172.21.15.78:0/462743047 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8881f2f30 con 0x7fe8880b6ac0 2024-09-17T03:08:56.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.446+0000 7fe86f7fe640 1 -- 172.21.15.78:0/462743047 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe87c03d460 con 0x7fe8880b6ac0 2024-09-17T03:08:56.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.446+0000 7fe88d371640 1 -- 172.21.15.78:0/462743047 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8881f3710 con 0x7fe8880b6ac0 2024-09-17T03:08:56.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.447+0000 7fe88d371640 1 -- 172.21.15.78:0/462743047 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8880d1690 con 0x7fe8880b6ac0 2024-09-17T03:08:56.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.447+0000 7fe86f7fe640 1 -- 172.21.15.78:0/462743047 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe87c030070 con 0x7fe8880b6ac0 2024-09-17T03:08:56.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.448+0000 7fe86f7fe640 1 --2- 172.21.15.78:0/462743047 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe874078b90 0x7fe87407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:56.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.448+0000 7fe86f7fe640 1 -- 172.21.15.78:0/462743047 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe87c0baa00 con 0x7fe8880b6ac0 2024-09-17T03:08:56.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.448+0000 7fe886ffd640 1 --2- 172.21.15.78:0/462743047 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe874078b90 0x7fe87407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:56.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.449+0000 7fe886ffd640 1 --2- 172.21.15.78:0/462743047 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe874078b90 0x7fe87407b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe878005fd0 tx=0x7fe878009500 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:56.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.452+0000 7fe86f7fe640 1 -- 172.21.15.78:0/462743047 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe87c042060 con 0x7fe8880b6ac0 2024-09-17T03:08:56.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.661+0000 7fe88d371640 1 -- 172.21.15.78:0/462743047 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8881f31c0 con 0x7fe8880b6ac0 2024-09-17T03:08:56.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.661+0000 7fe86f7fe640 1 -- 172.21.15.78:0/462743047 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5220 (secure 0 0 0) 0x7fe87c082ed0 con 0x7fe8880b6ac0 2024-09-17T03:08:56.660 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:56.660 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":6,"btime":"2024-09-17T03:08:30:244213+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/3111681444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3111681444},{"type":"v1","addr":"172.21.15.78:6833","nonce":3111681444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1920750629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1920750629},{"type":"v1","addr":"172.21.15.193:6836","nonce":1920750629}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4416,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2220463802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2220463802},{"type":"v1","addr":"172.21.15.78:6835","nonce":2220463802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:08:27.583934+0000","modified":"2024-09-17T03:08:29.592351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4425},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4425":{"gid":4425,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6837/934698838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":934698838},{"type":"v1","addr":"172.21.15.193:6837","nonce":934698838}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4425,"qdb_cluster":[4425]},"id":1}]} 2024-09-17T03:08:56.660 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 6 2024-09-17T03:08:56.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.663+0000 7fe88d371640 1 -- 172.21.15.78:0/462743047 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe874078b90 msgr2=0x7fe87407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:56.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.663+0000 7fe88d371640 1 --2- 172.21.15.78:0/462743047 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe874078b90 0x7fe87407b0a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe878005fd0 tx=0x7fe878009500 comp rx=0 tx=0).stop 2024-09-17T03:08:56.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.663+0000 7fe88d371640 1 -- 172.21.15.78:0/462743047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8880b6ac0 msgr2=0x7fe8880b0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:56.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.663+0000 7fe88d371640 1 --2- 172.21.15.78:0/462743047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8880b6ac0 0x7fe8880b0b30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe87c001780 tx=0x7fe87c0063a0 comp rx=0 tx=0).stop 2024-09-17T03:08:56.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.663+0000 7fe88d371640 1 -- 172.21.15.78:0/462743047 shutdown_connections 2024-09-17T03:08:56.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.663+0000 7fe88d371640 1 --2- 172.21.15.78:0/462743047 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe874078b90 0x7fe87407b0a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:56.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.663+0000 7fe88d371640 1 --2- 172.21.15.78:0/462743047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8881484c0 0x7fe8880b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:56.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.663+0000 7fe88d371640 1 --2- 172.21.15.78:0/462743047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8880b6ac0 0x7fe8880b0b30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:56.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.663+0000 7fe88d371640 1 --2- 172.21.15.78:0/462743047 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe870004000 0x7fe8880b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:56.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.663+0000 7fe88d371640 1 -- 172.21.15.78:0/462743047 >> 172.21.15.78:0/462743047 conn(0x7fe8880b3f10 msgr2=0x7fe8880b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:56.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.663+0000 7fe88d371640 1 -- 172.21.15.78:0/462743047 shutdown_connections 2024-09-17T03:08:56.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.663+0000 7fe88d371640 1 -- 172.21.15.78:0/462743047 wait complete. 2024-09-17T03:08:56.675 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:08:56.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.788+0000 7f754efc6640 1 -- 172.21.15.78:0/3083940006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75480ccba0 msgr2=0x7f75480ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:56.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.788+0000 7f754efc6640 1 --2- 172.21.15.78:0/3083940006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75480ccba0 0x7f75480ccfb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7548074550 tx=0x7f754002aa30 comp rx=0 tx=0).stop 2024-09-17T03:08:56.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.788+0000 7f754efc6640 1 -- 172.21.15.78:0/3083940006 shutdown_connections 2024-09-17T03:08:56.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.788+0000 7f754efc6640 1 --2- 172.21.15.78:0/3083940006 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75480ccba0 0x7f75480ccfb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:56.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.788+0000 7f754efc6640 1 --2- 172.21.15.78:0/3083940006 >> v2:172.21.15.193:3300/0 conn(0x7f75480b5210 0x7f75480ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:56.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.788+0000 7f754efc6640 1 -- 172.21.15.78:0/3083940006 >> 172.21.15.78:0/3083940006 conn(0x7f75480b3f10 msgr2=0x7f75480b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:56.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.788+0000 7f754efc6640 1 -- 172.21.15.78:0/3083940006 shutdown_connections 2024-09-17T03:08:56.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.788+0000 7f754efc6640 1 -- 172.21.15.78:0/3083940006 wait complete. 2024-09-17T03:08:56.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.790+0000 7f754efc6640 1 Processor -- start 2024-09-17T03:08:56.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.790+0000 7f754efc6640 1 -- start start 2024-09-17T03:08:56.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.792+0000 7f754efc6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75480b5210 0x7f7548149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.792+0000 7f754efc6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75480ccba0 0x7f754814a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.792+0000 7f754efc6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75480d1d40 0x7f7548143e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.792+0000 7f754efc6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f75480d11f0 con 0x7f75480d1d40 2024-09-17T03:08:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.792+0000 7f754efc6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f75480d1070 con 0x7f75480ccba0 2024-09-17T03:08:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.792+0000 7f754efc6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f75480d1370 con 0x7f75480b5210 2024-09-17T03:08:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.792+0000 7f754d563640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75480d1d40 0x7f7548143e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.792+0000 7f754d563640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75480d1d40 0x7f7548143e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40832/0 (socket says 172.21.15.78:40832) 2024-09-17T03:08:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.792+0000 7f754d563640 1 -- 172.21.15.78:0/3333161265 learned_addr learned my addr 172.21.15.78:0/3333161265 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.792+0000 7f754cd62640 1 --2- 172.21.15.78:0/3333161265 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75480b5210 0x7f7548149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.792+0000 7f7547fff640 1 --2- 172.21.15.78:0/3333161265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75480ccba0 0x7f754814a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.792+0000 7f754d563640 1 -- 172.21.15.78:0/3333161265 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75480b5210 msgr2=0x7f7548149fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:56.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.792+0000 7f754d563640 1 --2- 172.21.15.78:0/3333161265 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75480b5210 0x7f7548149fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:56.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.792+0000 7f754d563640 1 -- 172.21.15.78:0/3333161265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75480ccba0 msgr2=0x7f754814a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:56.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.792+0000 7f754d563640 1 --2- 172.21.15.78:0/3333161265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75480ccba0 0x7f754814a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:56.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.792+0000 7f754d563640 1 -- 172.21.15.78:0/3333161265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7548155620 con 0x7f75480d1d40 2024-09-17T03:08:56.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.792+0000 7f754d563640 1 --2- 172.21.15.78:0/3333161265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75480d1d40 0x7f7548143e10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7540005fd0 tx=0x7f7540003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:56.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.792+0000 7f75457fa640 1 -- 172.21.15.78:0/3333161265 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7540033050 con 0x7f75480d1d40 2024-09-17T03:08:56.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.792+0000 7f75457fa640 1 -- 172.21.15.78:0/3333161265 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75400045f0 con 0x7f75480d1d40 2024-09-17T03:08:56.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.792+0000 7f754efc6640 1 -- 172.21.15.78:0/3333161265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7548155900 con 0x7f75480d1d40 2024-09-17T03:08:56.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.793+0000 7f75457fa640 1 -- 172.21.15.78:0/3333161265 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7540038450 con 0x7f75480d1d40 2024-09-17T03:08:56.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.793+0000 7f754efc6640 1 -- 172.21.15.78:0/3333161265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7548155ec0 con 0x7f75480d1d40 2024-09-17T03:08:56.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.794+0000 7f754efc6640 1 -- 172.21.15.78:0/3333161265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7548155390 con 0x7f75480d1d40 2024-09-17T03:08:56.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.794+0000 7f75457fa640 1 -- 172.21.15.78:0/3333161265 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7540036070 con 0x7f75480d1d40 2024-09-17T03:08:56.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.795+0000 7f75457fa640 1 --2- 172.21.15.78:0/3333161265 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f752c078b90 0x7f752c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:56.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.795+0000 7f75457fa640 1 -- 172.21.15.78:0/3333161265 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f75400bc290 con 0x7f75480d1d40 2024-09-17T03:08:56.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.795+0000 7f754cd62640 1 --2- 172.21.15.78:0/3333161265 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f752c078b90 0x7f752c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:56.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.796+0000 7f754cd62640 1 --2- 172.21.15.78:0/3333161265 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f752c078b90 0x7f752c07b0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f753c006fd0 tx=0x7f753c009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:56.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:56.799+0000 7f75457fa640 1 -- 172.21.15.78:0/3333161265 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f75480cd4f0 con 0x7f75480d1d40 2024-09-17T03:08:57.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.010+0000 7f754efc6640 1 -- 172.21.15.78:0/3333161265 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75480d1860 con 0x7f75480d1d40 2024-09-17T03:08:57.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.010+0000 7f75457fa640 1 -- 172.21.15.78:0/3333161265 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5220 (secure 0 0 0) 0x7f7540084070 con 0x7f75480d1d40 2024-09-17T03:08:57.009 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:57.009 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":6,"btime":"2024-09-17T03:08:30:244213+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/3111681444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3111681444},{"type":"v1","addr":"172.21.15.78:6833","nonce":3111681444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1920750629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1920750629},{"type":"v1","addr":"172.21.15.193:6836","nonce":1920750629}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4416,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2220463802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2220463802},{"type":"v1","addr":"172.21.15.78:6835","nonce":2220463802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:08:27.583934+0000","modified":"2024-09-17T03:08:29.592351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4425},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4425":{"gid":4425,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6837/934698838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":934698838},{"type":"v1","addr":"172.21.15.193:6837","nonce":934698838}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4425,"qdb_cluster":[4425]},"id":1}]} 2024-09-17T03:08:57.010 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 6 2024-09-17T03:08:57.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.012+0000 7f754efc6640 1 -- 172.21.15.78:0/3333161265 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f752c078b90 msgr2=0x7f752c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:57.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.012+0000 7f754efc6640 1 --2- 172.21.15.78:0/3333161265 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f752c078b90 0x7f752c07b0a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f753c006fd0 tx=0x7f753c009060 comp rx=0 tx=0).stop 2024-09-17T03:08:57.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.012+0000 7f754efc6640 1 -- 172.21.15.78:0/3333161265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75480d1d40 msgr2=0x7f7548143e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:57.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.012+0000 7f754efc6640 1 --2- 172.21.15.78:0/3333161265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75480d1d40 0x7f7548143e10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7540005fd0 tx=0x7f7540003f90 comp rx=0 tx=0).stop 2024-09-17T03:08:57.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.013+0000 7f754efc6640 1 -- 172.21.15.78:0/3333161265 shutdown_connections 2024-09-17T03:08:57.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.013+0000 7f754efc6640 1 --2- 172.21.15.78:0/3333161265 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75480d1d40 0x7f7548143e10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.013+0000 7f754efc6640 1 --2- 172.21.15.78:0/3333161265 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f752c078b90 0x7f752c07b0a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.013+0000 7f754efc6640 1 --2- 172.21.15.78:0/3333161265 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75480ccba0 0x7f754814a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.013+0000 7f754efc6640 1 --2- 172.21.15.78:0/3333161265 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75480b5210 0x7f7548149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.013+0000 7f754efc6640 1 -- 172.21.15.78:0/3333161265 >> 172.21.15.78:0/3333161265 conn(0x7f75480b3f10 msgr2=0x7f754815a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:57.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.013+0000 7f754efc6640 1 -- 172.21.15.78:0/3333161265 shutdown_connections 2024-09-17T03:08:57.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.013+0000 7f754efc6640 1 -- 172.21.15.78:0/3333161265 wait complete. 2024-09-17T03:08:57.023 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:08:57.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.137+0000 7f81a8a39640 1 -- 172.21.15.78:0/3732350343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8190003a00 msgr2=0x7f8190003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:57.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.137+0000 7f81a8a39640 1 --2- 172.21.15.78:0/3732350343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8190003a00 0x7f8190003e70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f819c00c640 tx=0x7f8190005830 comp rx=0 tx=0).stop 2024-09-17T03:08:57.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.137+0000 7f81a2d9d640 1 -- 172.21.15.78:0/3732350343 reap_dead start 2024-09-17T03:08:57.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.137+0000 7f81a8a39640 1 -- 172.21.15.78:0/3732350343 shutdown_connections 2024-09-17T03:08:57.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.137+0000 7f81a8a39640 1 -- 172.21.15.78:0/3732350343 >> 172.21.15.78:0/3732350343 conn(0x7f81a4072ae0 msgr2=0x7f81a4072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:57.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.137+0000 7f81a8a39640 1 -- 172.21.15.78:0/3732350343 shutdown_connections 2024-09-17T03:08:57.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.137+0000 7f81a8a39640 1 -- 172.21.15.78:0/3732350343 wait complete. 2024-09-17T03:08:57.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.139+0000 7f81a8a39640 1 Processor -- start 2024-09-17T03:08:57.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.139+0000 7f81a8a39640 1 -- start start 2024-09-17T03:08:57.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.140+0000 7f81a8a39640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8190003a00 0x7f81a414b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:57.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.140+0000 7f81a8a39640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a4159900 0x7f81a414d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:57.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.140+0000 7f81a8a39640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81a414de20 0x7f81a414e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:57.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.140+0000 7f81a8a39640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f81a40ced70 con 0x7f81a4159900 2024-09-17T03:08:57.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.140+0000 7f81a8a39640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f81a40cebf0 con 0x7f8190003a00 2024-09-17T03:08:57.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.140+0000 7f81a8a39640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f81a40ceef0 con 0x7f81a414de20 2024-09-17T03:08:57.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.140+0000 7f81a1d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a4159900 0x7f81a414d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:57.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.140+0000 7f81a1d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a4159900 0x7f81a414d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40854/0 (socket says 172.21.15.78:40854) 2024-09-17T03:08:57.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.140+0000 7f81a1d9b640 1 -- 172.21.15.78:0/3006464047 learned_addr learned my addr 172.21.15.78:0/3006464047 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:57.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.140+0000 7f81a1d9b640 1 -- 172.21.15.78:0/3006464047 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81a414de20 msgr2=0x7f81a414e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:57.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.140+0000 7f81a1d9b640 1 --2- 172.21.15.78:0/3006464047 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81a414de20 0x7f81a414e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.140+0000 7f81a259c640 1 --2- 172.21.15.78:0/3006464047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8190003a00 0x7f81a414b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:57.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.140+0000 7f81a1d9b640 1 -- 172.21.15.78:0/3006464047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8190003a00 msgr2=0x7f81a414b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:57.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.140+0000 7f81a1d9b640 1 --2- 172.21.15.78:0/3006464047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8190003a00 0x7f81a414b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.140+0000 7f81a1d9b640 1 -- 172.21.15.78:0/3006464047 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a40a9640 con 0x7f81a4159900 2024-09-17T03:08:57.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.141+0000 7f81a1d9b640 1 --2- 172.21.15.78:0/3006464047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a4159900 0x7f81a414d8e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f818c011a30 tx=0x7f818c011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:57.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.141+0000 7f819affd640 1 -- 172.21.15.78:0/3006464047 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c01e070 con 0x7f81a4159900 2024-09-17T03:08:57.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.141+0000 7f819affd640 1 -- 172.21.15.78:0/3006464047 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f818c00fe10 con 0x7f81a4159900 2024-09-17T03:08:57.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.141+0000 7f81a8a39640 1 -- 172.21.15.78:0/3006464047 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a41f7430 con 0x7f81a4159900 2024-09-17T03:08:57.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.141+0000 7f819affd640 1 -- 172.21.15.78:0/3006464047 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c019690 con 0x7f81a4159900 2024-09-17T03:08:57.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.141+0000 7f81a8a39640 1 -- 172.21.15.78:0/3006464047 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a40c83c0 con 0x7f81a4159900 2024-09-17T03:08:57.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.142+0000 7f81a8a39640 1 -- 172.21.15.78:0/3006464047 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a40d0d80 con 0x7f81a4159900 2024-09-17T03:08:57.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.143+0000 7f819affd640 1 -- 172.21.15.78:0/3006464047 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f818c021070 con 0x7f81a4159900 2024-09-17T03:08:57.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.143+0000 7f819affd640 1 --2- 172.21.15.78:0/3006464047 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8184078bc0 0x7f818407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:57.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.143+0000 7f819affd640 1 -- 172.21.15.78:0/3006464047 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f818c09b540 con 0x7f81a4159900 2024-09-17T03:08:57.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.143+0000 7f81a259c640 1 --2- 172.21.15.78:0/3006464047 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8184078bc0 0x7f818407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:57.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.144+0000 7f81a259c640 1 --2- 172.21.15.78:0/3006464047 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8184078bc0 0x7f818407b0d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f819c00c640 tx=0x7f819c02d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:57.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.148+0000 7f819affd640 1 -- 172.21.15.78:0/3006464047 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f818c063450 con 0x7f81a4159900 2024-09-17T03:08:57.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.322+0000 7f81a8a39640 1 -- 172.21.15.78:0/3006464047 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81a40c59f0 con 0x7f81a4159900 2024-09-17T03:08:57.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.324+0000 7f819affd640 1 -- 172.21.15.78:0/3006464047 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16641 (secure 0 0 0) 0x7f818c067e80 con 0x7f81a4159900 2024-09-17T03:08:57.323 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:57.323 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:08:29.222925+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:08:25.448752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:08:26.544015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:08:57.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.326+0000 7f81a8a39640 1 -- 172.21.15.78:0/3006464047 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8184078bc0 msgr2=0x7f818407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:57.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.326+0000 7f81a8a39640 1 --2- 172.21.15.78:0/3006464047 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8184078bc0 0x7f818407b0d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f819c00c640 tx=0x7f819c02d040 comp rx=0 tx=0).stop 2024-09-17T03:08:57.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.326+0000 7f81a8a39640 1 -- 172.21.15.78:0/3006464047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a4159900 msgr2=0x7f81a414d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:57.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.326+0000 7f81a8a39640 1 --2- 172.21.15.78:0/3006464047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a4159900 0x7f81a414d8e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f818c011a30 tx=0x7f818c011ef0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.326+0000 7f81a8a39640 1 -- 172.21.15.78:0/3006464047 shutdown_connections 2024-09-17T03:08:57.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.326+0000 7f81a8a39640 1 --2- 172.21.15.78:0/3006464047 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81a414de20 0x7f81a414e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.326+0000 7f81a8a39640 1 --2- 172.21.15.78:0/3006464047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81a4159900 0x7f81a414d8e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.326+0000 7f81a8a39640 1 --2- 172.21.15.78:0/3006464047 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8184078bc0 0x7f818407b0d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.326+0000 7f81a8a39640 1 --2- 172.21.15.78:0/3006464047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8190003a00 0x7f81a414b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.326+0000 7f81a8a39640 1 -- 172.21.15.78:0/3006464047 >> 172.21.15.78:0/3006464047 conn(0x7f81a4072ae0 msgr2=0x7f81a40b35c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:57.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.326+0000 7f81a8a39640 1 -- 172.21.15.78:0/3006464047 shutdown_connections 2024-09-17T03:08:57.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.326+0000 7f81a8a39640 1 -- 172.21.15.78:0/3006464047 wait complete. 2024-09-17T03:08:57.336 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:08:57.337 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:08:57.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.450+0000 7f0aec4b6640 1 -- 172.21.15.78:0/2687127172 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ad0003c60 msgr2=0x7f0ad00040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:57.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.450+0000 7f0aec4b6640 1 --2- 172.21.15.78:0/2687127172 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ad0003c60 0x7f0ad00040b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0001ea0 tx=0x7f0ad0005830 comp rx=0 tx=0).stop 2024-09-17T03:08:57.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.450+0000 7f0aeaa53640 1 -- 172.21.15.78:0/2687127172 reap_dead start 2024-09-17T03:08:57.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.450+0000 7f0aec4b6640 1 -- 172.21.15.78:0/2687127172 shutdown_connections 2024-09-17T03:08:57.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.450+0000 7f0aec4b6640 1 -- 172.21.15.78:0/2687127172 >> 172.21.15.78:0/2687127172 conn(0x7f0ae40b1cb0 msgr2=0x7f0ae40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:57.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.450+0000 7f0aec4b6640 1 -- 172.21.15.78:0/2687127172 shutdown_connections 2024-09-17T03:08:57.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.450+0000 7f0aec4b6640 1 -- 172.21.15.78:0/2687127172 wait complete. 2024-09-17T03:08:57.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.452+0000 7f0aec4b6640 1 Processor -- start 2024-09-17T03:08:57.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.452+0000 7f0aec4b6640 1 -- start start 2024-09-17T03:08:57.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0aec4b6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ad0003c60 0x7f0ae409b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:57.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0aec4b6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ae4148aa0 0x7f0ae4148390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:57.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0aec4b6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0ae41f5400 0x7f0ae41f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:57.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0aec4b6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae4073cc0 con 0x7f0ae4148aa0 2024-09-17T03:08:57.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0aec4b6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae40cbd90 con 0x7f0ad0003c60 2024-09-17T03:08:57.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0aec4b6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0ae4073e40 con 0x7f0ae41f5400 2024-09-17T03:08:57.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0ae9a51640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ae4148aa0 0x7f0ae4148390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:57.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0ae9a51640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ae4148aa0 0x7f0ae4148390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40878/0 (socket says 172.21.15.78:40878) 2024-09-17T03:08:57.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0ae9a51640 1 -- 172.21.15.78:0/95469688 learned_addr learned my addr 172.21.15.78:0/95469688 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:57.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0aeaa53640 1 --2- 172.21.15.78:0/95469688 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0ae41f5400 0x7f0ae41f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:57.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0aea252640 1 --2- 172.21.15.78:0/95469688 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ad0003c60 0x7f0ae409b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:57.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0ae9a51640 1 -- 172.21.15.78:0/95469688 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0ae41f5400 msgr2=0x7f0ae41f5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:57.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0ae9a51640 1 --2- 172.21.15.78:0/95469688 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0ae41f5400 0x7f0ae41f5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0ae9a51640 1 -- 172.21.15.78:0/95469688 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ad0003c60 msgr2=0x7f0ae409b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:57.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0ae9a51640 1 --2- 172.21.15.78:0/95469688 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ad0003c60 0x7f0ae409b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0ae9a51640 1 -- 172.21.15.78:0/95469688 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae40c7610 con 0x7f0ae4148aa0 2024-09-17T03:08:57.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0ae9a51640 1 --2- 172.21.15.78:0/95469688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ae4148aa0 0x7f0ae4148390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400e540 tx=0x7f0ad400ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:57.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0adaffd640 1 -- 172.21.15.78:0/95469688 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4015070 con 0x7f0ae4148aa0 2024-09-17T03:08:57.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0adaffd640 1 -- 172.21.15.78:0/95469688 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ad400ca00 con 0x7f0ae4148aa0 2024-09-17T03:08:57.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0aec4b6640 1 -- 172.21.15.78:0/95469688 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae40c9d30 con 0x7f0ae4148aa0 2024-09-17T03:08:57.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0adaffd640 1 -- 172.21.15.78:0/95469688 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad400ce50 con 0x7f0ae4148aa0 2024-09-17T03:08:57.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.454+0000 7f0aec4b6640 1 -- 172.21.15.78:0/95469688 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ae40c9fd0 con 0x7f0ae4148aa0 2024-09-17T03:08:57.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.455+0000 7f0aec4b6640 1 -- 172.21.15.78:0/95469688 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ae40c7380 con 0x7f0ae4148aa0 2024-09-17T03:08:57.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.456+0000 7f0adaffd640 1 -- 172.21.15.78:0/95469688 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0ad4018070 con 0x7f0ae4148aa0 2024-09-17T03:08:57.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.457+0000 7f0adaffd640 1 --2- 172.21.15.78:0/95469688 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0ac8078d30 0x7f0ac807b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:57.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.457+0000 7f0adaffd640 1 -- 172.21.15.78:0/95469688 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0ad409b0c0 con 0x7f0ae4148aa0 2024-09-17T03:08:57.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.457+0000 7f0aea252640 1 --2- 172.21.15.78:0/95469688 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0ac8078d30 0x7f0ac807b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:57.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.458+0000 7f0aea252640 1 --2- 172.21.15.78:0/95469688 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0ac8078d30 0x7f0ac807b240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0032000 tx=0x7f0ae00016e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:57.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.461+0000 7f0adaffd640 1 -- 172.21.15.78:0/95469688 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0ad4062f40 con 0x7f0ae4148aa0 2024-09-17T03:08:57.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.669+0000 7f0aec4b6640 1 -- 172.21.15.78:0/95469688 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ae41f1cd0 con 0x7f0ae4148aa0 2024-09-17T03:08:57.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.670+0000 7f0adaffd640 1 -- 172.21.15.78:0/95469688 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5220 (secure 0 0 0) 0x7f0ad4067970 con 0x7f0ae4148aa0 2024-09-17T03:08:57.669 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:57.669 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":6,"btime":"2024-09-17T03:08:30:244213+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/3111681444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3111681444},{"type":"v1","addr":"172.21.15.78:6833","nonce":3111681444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1920750629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1920750629},{"type":"v1","addr":"172.21.15.193:6836","nonce":1920750629}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4416,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2220463802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2220463802},{"type":"v1","addr":"172.21.15.78:6835","nonce":2220463802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:08:27.583934+0000","modified":"2024-09-17T03:08:29.592351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4425},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4425":{"gid":4425,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6837/934698838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":934698838},{"type":"v1","addr":"172.21.15.193:6837","nonce":934698838}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4425,"qdb_cluster":[4425]},"id":1}]} 2024-09-17T03:08:57.669 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 6 2024-09-17T03:08:57.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.672+0000 7f0aec4b6640 1 -- 172.21.15.78:0/95469688 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0ac8078d30 msgr2=0x7f0ac807b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:57.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.672+0000 7f0aec4b6640 1 --2- 172.21.15.78:0/95469688 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0ac8078d30 0x7f0ac807b240 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0032000 tx=0x7f0ae00016e0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.672+0000 7f0aec4b6640 1 -- 172.21.15.78:0/95469688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ae4148aa0 msgr2=0x7f0ae4148390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:57.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.672+0000 7f0aec4b6640 1 --2- 172.21.15.78:0/95469688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ae4148aa0 0x7f0ae4148390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400e540 tx=0x7f0ad400ea00 comp rx=0 tx=0).stop 2024-09-17T03:08:57.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.672+0000 7f0aec4b6640 1 -- 172.21.15.78:0/95469688 shutdown_connections 2024-09-17T03:08:57.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.672+0000 7f0aec4b6640 1 --2- 172.21.15.78:0/95469688 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0ae41f5400 0x7f0ae41f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.672+0000 7f0aec4b6640 1 --2- 172.21.15.78:0/95469688 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0ae4148aa0 0x7f0ae4148390 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.672+0000 7f0aec4b6640 1 --2- 172.21.15.78:0/95469688 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0ac8078d30 0x7f0ac807b240 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.672+0000 7f0aec4b6640 1 --2- 172.21.15.78:0/95469688 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ad0003c60 0x7f0ae409b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.672+0000 7f0aec4b6640 1 -- 172.21.15.78:0/95469688 >> 172.21.15.78:0/95469688 conn(0x7f0ae40b1cb0 msgr2=0x7f0ae41e74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:57.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.672+0000 7f0aec4b6640 1 -- 172.21.15.78:0/95469688 shutdown_connections 2024-09-17T03:08:57.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.672+0000 7f0aec4b6640 1 -- 172.21.15.78:0/95469688 wait complete. 2024-09-17T03:08:57.682 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:08:57.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.795+0000 7f173fb8b640 1 -- 172.21.15.78:0/344655768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17380d05c0 msgr2=0x7f17380b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:57.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.795+0000 7f173fb8b640 1 --2- 172.21.15.78:0/344655768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17380d05c0 0x7f17380b3550 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1730005fd0 tx=0x7f173002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.795+0000 7f173fb8b640 1 -- 172.21.15.78:0/344655768 shutdown_connections 2024-09-17T03:08:57.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.795+0000 7f173fb8b640 1 --2- 172.21.15.78:0/344655768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17380d05c0 0x7f17380b3550 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.795+0000 7f173fb8b640 1 -- 172.21.15.78:0/344655768 >> 172.21.15.78:0/344655768 conn(0x7f17380cdcc0 msgr2=0x7f17380ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:57.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.795+0000 7f173fb8b640 1 -- 172.21.15.78:0/344655768 shutdown_connections 2024-09-17T03:08:57.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.795+0000 7f173fb8b640 1 -- 172.21.15.78:0/344655768 wait complete. 2024-09-17T03:08:57.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.797+0000 7f173fb8b640 1 Processor -- start 2024-09-17T03:08:57.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.797+0000 7f173fb8b640 1 -- start start 2024-09-17T03:08:57.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.798+0000 7f173fb8b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17380b4090 0x7f17380b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:57.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.798+0000 7f173fb8b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17380d05c0 0x7f1738152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:57.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.798+0000 7f173fb8b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17381535c0 0x7f1738159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:57.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.798+0000 7f173fb8b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f17380b4bd0 con 0x7f17381535c0 2024-09-17T03:08:57.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.798+0000 7f173fb8b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f17380b4a50 con 0x7f17380b4090 2024-09-17T03:08:57.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.798+0000 7f173fb8b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f17380b4d50 con 0x7f17380d05c0 2024-09-17T03:08:57.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.798+0000 7f173e128640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17381535c0 0x7f1738159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:57.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.798+0000 7f173e128640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17381535c0 0x7f1738159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40890/0 (socket says 172.21.15.78:40890) 2024-09-17T03:08:57.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.798+0000 7f173e128640 1 -- 172.21.15.78:0/2394027618 learned_addr learned my addr 172.21.15.78:0/2394027618 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:57.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.798+0000 7f173d927640 1 --2- 172.21.15.78:0/2394027618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17380b4090 0x7f17380b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:57.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.798+0000 7f173d126640 1 --2- 172.21.15.78:0/2394027618 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17380d05c0 0x7f1738152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:57.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.798+0000 7f173e128640 1 -- 172.21.15.78:0/2394027618 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17380d05c0 msgr2=0x7f1738152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:57.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.798+0000 7f173e128640 1 --2- 172.21.15.78:0/2394027618 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17380d05c0 0x7f1738152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.798+0000 7f173e128640 1 -- 172.21.15.78:0/2394027618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17380b4090 msgr2=0x7f17380b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:57.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.798+0000 7f173e128640 1 --2- 172.21.15.78:0/2394027618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17380b4090 0x7f17380b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:57.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.798+0000 7f173e128640 1 -- 172.21.15.78:0/2394027618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1738153370 con 0x7f17381535c0 2024-09-17T03:08:57.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.798+0000 7f173d126640 1 --2- 172.21.15.78:0/2394027618 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17380d05c0 0x7f1738152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:08:57.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.799+0000 7f173e128640 1 --2- 172.21.15.78:0/2394027618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17381535c0 0x7f1738159ad0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f173002aea0 tx=0x7f17300039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:57.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.799+0000 7f172e7fc640 1 -- 172.21.15.78:0/2394027618 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730031990 con 0x7f17381535c0 2024-09-17T03:08:57.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.799+0000 7f172e7fc640 1 -- 172.21.15.78:0/2394027618 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1730031c20 con 0x7f17381535c0 2024-09-17T03:08:57.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.799+0000 7f173fb8b640 1 -- 172.21.15.78:0/2394027618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1738153db0 con 0x7f17381535c0 2024-09-17T03:08:57.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.799+0000 7f172e7fc640 1 -- 172.21.15.78:0/2394027618 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17300330d0 con 0x7f17381535c0 2024-09-17T03:08:57.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.799+0000 7f173fb8b640 1 -- 172.21.15.78:0/2394027618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17380b1b20 con 0x7f17381535c0 2024-09-17T03:08:57.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.800+0000 7f173fb8b640 1 -- 172.21.15.78:0/2394027618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17380b3000 con 0x7f17381535c0 2024-09-17T03:08:57.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.800+0000 7f172e7fc640 1 -- 172.21.15.78:0/2394027618 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1730033290 con 0x7f17381535c0 2024-09-17T03:08:57.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.801+0000 7f172e7fc640 1 --2- 172.21.15.78:0/2394027618 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f171c078b90 0x7f171c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:57.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.801+0000 7f172e7fc640 1 -- 172.21.15.78:0/2394027618 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f17300bc2c0 con 0x7f17381535c0 2024-09-17T03:08:57.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.801+0000 7f173d927640 1 --2- 172.21.15.78:0/2394027618 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f171c078b90 0x7f171c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:57.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.802+0000 7f173d927640 1 --2- 172.21.15.78:0/2394027618 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f171c078b90 0x7f171c07b0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1734006fd0 tx=0x7f1734008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:57.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:57.806+0000 7f172e7fc640 1 -- 172.21.15.78:0/2394027618 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f17380b3000 con 0x7f17381535c0 2024-09-17T03:08:58.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.015+0000 7f173fb8b640 1 -- 172.21.15.78:0/2394027618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17380b3550 con 0x7f17381535c0 2024-09-17T03:08:58.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.016+0000 7f172e7fc640 1 -- 172.21.15.78:0/2394027618 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5220 (secure 0 0 0) 0x7f173003f030 con 0x7f17381535c0 2024-09-17T03:08:58.015 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:58.015 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":6,"btime":"2024-09-17T03:08:30:244213+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4307,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/3111681444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3111681444},{"type":"v1","addr":"172.21.15.78:6833","nonce":3111681444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4357,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1920750629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1920750629},{"type":"v1","addr":"172.21.15.193:6836","nonce":1920750629}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4416,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2220463802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2220463802},{"type":"v1","addr":"172.21.15.78:6835","nonce":2220463802}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:08:27.583934+0000","modified":"2024-09-17T03:08:29.592351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4425},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4425":{"gid":4425,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6837/934698838","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":934698838},{"type":"v1","addr":"172.21.15.193:6837","nonce":934698838}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4425,"qdb_cluster":[4425]},"id":1}]} 2024-09-17T03:08:58.015 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 6 2024-09-17T03:08:58.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.018+0000 7f173fb8b640 1 -- 172.21.15.78:0/2394027618 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f171c078b90 msgr2=0x7f171c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:58.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.018+0000 7f173fb8b640 1 --2- 172.21.15.78:0/2394027618 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f171c078b90 0x7f171c07b0a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1734006fd0 tx=0x7f1734008040 comp rx=0 tx=0).stop 2024-09-17T03:08:58.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.018+0000 7f173fb8b640 1 -- 172.21.15.78:0/2394027618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17381535c0 msgr2=0x7f1738159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:58.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.018+0000 7f173fb8b640 1 --2- 172.21.15.78:0/2394027618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17381535c0 0x7f1738159ad0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f173002aea0 tx=0x7f17300039f0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.018+0000 7f173fb8b640 1 -- 172.21.15.78:0/2394027618 shutdown_connections 2024-09-17T03:08:58.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.018+0000 7f173fb8b640 1 --2- 172.21.15.78:0/2394027618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17381535c0 0x7f1738159ad0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.018+0000 7f173fb8b640 1 --2- 172.21.15.78:0/2394027618 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17380d05c0 0x7f1738152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.018+0000 7f173fb8b640 1 --2- 172.21.15.78:0/2394027618 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f171c078b90 0x7f171c07b0a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.018+0000 7f173fb8b640 1 --2- 172.21.15.78:0/2394027618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17380b4090 0x7f17380b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.018+0000 7f173fb8b640 1 -- 172.21.15.78:0/2394027618 >> 172.21.15.78:0/2394027618 conn(0x7f17380cdcc0 msgr2=0x7f17380ae0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:58.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.018+0000 7f173fb8b640 1 -- 172.21.15.78:0/2394027618 shutdown_connections 2024-09-17T03:08:58.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.018+0000 7f173fb8b640 1 -- 172.21.15.78:0/2394027618 wait complete. 2024-09-17T03:08:58.028 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:08:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.141+0000 7fb2a82be640 1 -- 172.21.15.78:0/762967833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2a00d1490 msgr2=0x7fb2a00cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.141+0000 7fb2a82be640 1 --2- 172.21.15.78:0/762967833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2a00d1490 0x7fb2a00cebf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb290005fd0 tx=0x7fb29002aa00 comp rx=0 tx=0).stop 2024-09-17T03:08:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.141+0000 7fb2a82be640 1 -- 172.21.15.78:0/762967833 shutdown_connections 2024-09-17T03:08:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.141+0000 7fb2a82be640 1 --2- 172.21.15.78:0/762967833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2a00d1490 0x7fb2a00cebf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.141+0000 7fb2a82be640 1 --2- 172.21.15.78:0/762967833 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb2a00b51c0 0x7fb2a015c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.141+0000 7fb2a82be640 1 -- 172.21.15.78:0/762967833 >> 172.21.15.78:0/762967833 conn(0x7fb2a0072ae0 msgr2=0x7fb2a0072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.141+0000 7fb2a82be640 1 -- 172.21.15.78:0/762967833 shutdown_connections 2024-09-17T03:08:58.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.141+0000 7fb2a82be640 1 -- 172.21.15.78:0/762967833 wait complete. 2024-09-17T03:08:58.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.143+0000 7fb2a82be640 1 Processor -- start 2024-09-17T03:08:58.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.143+0000 7fb2a82be640 1 -- start start 2024-09-17T03:08:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.144+0000 7fb2a82be640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2a00b51c0 0x7fb2a0156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.144+0000 7fb2a82be640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2a00ccbd0 0x7fb2a01e9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.144+0000 7fb2a82be640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb2a00d1490 0x7fb2a01e9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.144+0000 7fb2a82be640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a00cf2b0 con 0x7fb2a00ccbd0 2024-09-17T03:08:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.144+0000 7fb2a82be640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a00cf130 con 0x7fb2a00b51c0 2024-09-17T03:08:58.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.144+0000 7fb2a82be640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a00cf430 con 0x7fb2a00d1490 2024-09-17T03:08:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.144+0000 7fb2a5859640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2a00ccbd0 0x7fb2a01e9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.144+0000 7fb2a5859640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2a00ccbd0 0x7fb2a01e9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40902/0 (socket says 172.21.15.78:40902) 2024-09-17T03:08:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.144+0000 7fb2a5859640 1 -- 172.21.15.78:0/2497562052 learned_addr learned my addr 172.21.15.78:0/2497562052 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.144+0000 7fb2a685b640 1 --2- 172.21.15.78:0/2497562052 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb2a00d1490 0x7fb2a01e9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.144+0000 7fb2a605a640 1 --2- 172.21.15.78:0/2497562052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2a00b51c0 0x7fb2a0156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.145+0000 7fb2a5859640 1 -- 172.21.15.78:0/2497562052 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb2a00d1490 msgr2=0x7fb2a01e9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.145+0000 7fb2a5859640 1 --2- 172.21.15.78:0/2497562052 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb2a00d1490 0x7fb2a01e9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.145+0000 7fb2a5859640 1 -- 172.21.15.78:0/2497562052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2a00b51c0 msgr2=0x7fb2a0156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.145+0000 7fb2a5859640 1 --2- 172.21.15.78:0/2497562052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2a00b51c0 0x7fb2a0156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.145+0000 7fb2a5859640 1 -- 172.21.15.78:0/2497562052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a00cb770 con 0x7fb2a00ccbd0 2024-09-17T03:08:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.145+0000 7fb2a605a640 1 --2- 172.21.15.78:0/2497562052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2a00b51c0 0x7fb2a0156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:08:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.145+0000 7fb2a685b640 1 --2- 172.21.15.78:0/2497562052 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb2a00d1490 0x7fb2a01e9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:08:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.145+0000 7fb2a5859640 1 --2- 172.21.15.78:0/2497562052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2a00ccbd0 0x7fb2a01e9340 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb29400b3c0 tx=0x7fb29400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:58.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.145+0000 7fb29effd640 1 -- 172.21.15.78:0/2497562052 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb294011830 con 0x7fb2a00ccbd0 2024-09-17T03:08:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.145+0000 7fb29effd640 1 -- 172.21.15.78:0/2497562052 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb294016070 con 0x7fb2a00ccbd0 2024-09-17T03:08:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.145+0000 7fb2a82be640 1 -- 172.21.15.78:0/2497562052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2a00cba30 con 0x7fb2a00ccbd0 2024-09-17T03:08:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.145+0000 7fb29effd640 1 -- 172.21.15.78:0/2497562052 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb294011da0 con 0x7fb2a00ccbd0 2024-09-17T03:08:58.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.145+0000 7fb2a82be640 1 -- 172.21.15.78:0/2497562052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2a01f5770 con 0x7fb2a00ccbd0 2024-09-17T03:08:58.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.146+0000 7fb2a82be640 1 -- 172.21.15.78:0/2497562052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2a00cf8a0 con 0x7fb2a00ccbd0 2024-09-17T03:08:58.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.147+0000 7fb29effd640 1 -- 172.21.15.78:0/2497562052 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb29401b460 con 0x7fb2a00ccbd0 2024-09-17T03:08:58.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.147+0000 7fb29effd640 1 --2- 172.21.15.78:0/2497562052 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb28c078b90 0x7fb28c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:58.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.147+0000 7fb29effd640 1 -- 172.21.15.78:0/2497562052 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb29409a810 con 0x7fb2a00ccbd0 2024-09-17T03:08:58.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.147+0000 7fb2a605a640 1 --2- 172.21.15.78:0/2497562052 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb28c078b90 0x7fb28c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:58.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.148+0000 7fb2a605a640 1 --2- 172.21.15.78:0/2497562052 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb28c078b90 0x7fb28c07b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb298005fd0 tx=0x7fb298005e20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:58.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.152+0000 7fb29effd640 1 -- 172.21.15.78:0/2497562052 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb294020020 con 0x7fb2a00ccbd0 2024-09-17T03:08:58.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.329+0000 7fb2a82be640 1 -- 172.21.15.78:0/2497562052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb2a006e360 con 0x7fb2a00ccbd0 2024-09-17T03:08:58.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.330+0000 7fb29effd640 1 -- 172.21.15.78:0/2497562052 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16641 (secure 0 0 0) 0x7fb294062c50 con 0x7fb2a00ccbd0 2024-09-17T03:08:58.329 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:08:58.330 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:08:29.222925+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:08:25.448752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T03:08:26.544015+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:08:58.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.332+0000 7fb2a82be640 1 -- 172.21.15.78:0/2497562052 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb28c078b90 msgr2=0x7fb28c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:58.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.332+0000 7fb2a82be640 1 --2- 172.21.15.78:0/2497562052 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb28c078b90 0x7fb28c07b0a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb298005fd0 tx=0x7fb298005e20 comp rx=0 tx=0).stop 2024-09-17T03:08:58.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.332+0000 7fb2a82be640 1 -- 172.21.15.78:0/2497562052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2a00ccbd0 msgr2=0x7fb2a01e9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:58.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.332+0000 7fb2a82be640 1 --2- 172.21.15.78:0/2497562052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2a00ccbd0 0x7fb2a01e9340 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb29400b3c0 tx=0x7fb29400b880 comp rx=0 tx=0).stop 2024-09-17T03:08:58.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.333+0000 7fb2a82be640 1 -- 172.21.15.78:0/2497562052 shutdown_connections 2024-09-17T03:08:58.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.333+0000 7fb2a82be640 1 --2- 172.21.15.78:0/2497562052 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb2a00d1490 0x7fb2a01e9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.333+0000 7fb2a82be640 1 --2- 172.21.15.78:0/2497562052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2a00ccbd0 0x7fb2a01e9340 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.333+0000 7fb2a82be640 1 --2- 172.21.15.78:0/2497562052 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb28c078b90 0x7fb28c07b0a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.333+0000 7fb2a82be640 1 --2- 172.21.15.78:0/2497562052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2a00b51c0 0x7fb2a0156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.333+0000 7fb2a82be640 1 -- 172.21.15.78:0/2497562052 >> 172.21.15.78:0/2497562052 conn(0x7fb2a0072ae0 msgr2=0x7fb2a00d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:58.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.333+0000 7fb2a82be640 1 -- 172.21.15.78:0/2497562052 shutdown_connections 2024-09-17T03:08:58.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.333+0000 7fb2a82be640 1 -- 172.21.15.78:0/2497562052 wait complete. 2024-09-17T03:08:58.343 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:08:58.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.457+0000 7f815e3da640 1 -- 172.21.15.78:0/831881039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81580d1a80 msgr2=0x7f81580cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:58.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.457+0000 7f815e3da640 1 --2- 172.21.15.78:0/831881039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81580d1a80 0x7f81580cf090 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f814c009830 tx=0x7f814c02a510 comp rx=0 tx=0).stop 2024-09-17T03:08:58.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.457+0000 7f815e3da640 1 -- 172.21.15.78:0/831881039 shutdown_connections 2024-09-17T03:08:58.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.457+0000 7f815e3da640 1 --2- 172.21.15.78:0/831881039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81580d1a80 0x7f81580cf090 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.457+0000 7f815e3da640 1 -- 172.21.15.78:0/831881039 >> 172.21.15.78:0/831881039 conn(0x7f815808bfc0 msgr2=0x7f815809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:58.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.457+0000 7f815e3da640 1 -- 172.21.15.78:0/831881039 shutdown_connections 2024-09-17T03:08:58.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.457+0000 7f815e3da640 1 -- 172.21.15.78:0/831881039 wait complete. 2024-09-17T03:08:58.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.459+0000 7f815e3da640 1 Processor -- start 2024-09-17T03:08:58.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.459+0000 7f815e3da640 1 -- start start 2024-09-17T03:08:58.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.460+0000 7f815e3da640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81580cf5d0 0x7f81581f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:58.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f815e3da640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81580d1a80 0x7f8158154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:58.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f815e3da640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81580d2ed0 0x7f8158154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:58.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f815e3da640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8158162df0 con 0x7f81580cf5d0 2024-09-17T03:08:58.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f815e3da640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8158162f70 con 0x7f81580d2ed0 2024-09-17T03:08:58.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f815e3da640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f81581630f0 con 0x7f81580d1a80 2024-09-17T03:08:58.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f8157fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81580cf5d0 0x7f81581f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:58.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f8157fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81580cf5d0 0x7f81581f6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40908/0 (socket says 172.21.15.78:40908) 2024-09-17T03:08:58.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f8157fff640 1 -- 172.21.15.78:0/4226037526 learned_addr learned my addr 172.21.15.78:0/4226037526 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:58.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f81577fe640 1 --2- 172.21.15.78:0/4226037526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81580d1a80 0x7f8158154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:58.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f815c977640 1 --2- 172.21.15.78:0/4226037526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81580d2ed0 0x7f8158154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:58.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f8157fff640 1 -- 172.21.15.78:0/4226037526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81580d1a80 msgr2=0x7f8158154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:58.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f8157fff640 1 --2- 172.21.15.78:0/4226037526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81580d1a80 0x7f8158154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f8157fff640 1 -- 172.21.15.78:0/4226037526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81580d2ed0 msgr2=0x7f8158154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:58.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f8157fff640 1 --2- 172.21.15.78:0/4226037526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81580d2ed0 0x7f8158154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f8157fff640 1 -- 172.21.15.78:0/4226037526 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81580c9260 con 0x7f81580cf5d0 2024-09-17T03:08:58.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f81577fe640 1 --2- 172.21.15.78:0/4226037526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81580d1a80 0x7f8158154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:08:58.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f815c977640 1 --2- 172.21.15.78:0/4226037526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81580d2ed0 0x7f8158154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:08:58.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f8157fff640 1 --2- 172.21.15.78:0/4226037526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81580cf5d0 0x7f81581f6b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f814800b3e0 tx=0x7f814800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:58.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f8154ff9640 1 -- 172.21.15.78:0/4226037526 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8148015020 con 0x7f81580cf5d0 2024-09-17T03:08:58.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f8154ff9640 1 -- 172.21.15.78:0/4226037526 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8148011940 con 0x7f81580cf5d0 2024-09-17T03:08:58.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f8154ff9640 1 -- 172.21.15.78:0/4226037526 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8148011dd0 con 0x7f81580cf5d0 2024-09-17T03:08:58.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f815e3da640 1 -- 172.21.15.78:0/4226037526 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81580c9500 con 0x7f81580cf5d0 2024-09-17T03:08:58.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.461+0000 7f815e3da640 1 -- 172.21.15.78:0/4226037526 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81580c9ac0 con 0x7f81580cf5d0 2024-09-17T03:08:58.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.462+0000 7f815e3da640 1 -- 172.21.15.78:0/4226037526 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81580cf090 con 0x7f81580cf5d0 2024-09-17T03:08:58.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.463+0000 7f8154ff9640 1 -- 172.21.15.78:0/4226037526 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8148018020 con 0x7f81580cf5d0 2024-09-17T03:08:58.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.464+0000 7f8154ff9640 1 --2- 172.21.15.78:0/4226037526 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8144078b90 0x7f814407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:58.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.464+0000 7f8154ff9640 1 -- 172.21.15.78:0/4226037526 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f814809ab10 con 0x7f81580cf5d0 2024-09-17T03:08:58.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.464+0000 7f81577fe640 1 --2- 172.21.15.78:0/4226037526 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8144078b90 0x7f814407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:58.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.465+0000 7f81577fe640 1 --2- 172.21.15.78:0/4226037526 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8144078b90 0x7f814407b0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f814c034000 tx=0x7f814c004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:58.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.468+0000 7f8154ff9640 1 -- 172.21.15.78:0/4226037526 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8148062f50 con 0x7f81580cf5d0 2024-09-17T03:08:58.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.677+0000 7f815e3da640 1 -- 172.21.15.78:0/4226037526 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f81581f7040 con 0x7f81580cf5d0 2024-09-17T03:08:58.676 INFO:tasks.ceph.mon.a.smithi078.stderr:2024-09-17T03:08:58.677+0000 7f192af78640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:08:58.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.679+0000 7f8154ff9640 1 -- 172.21.15.78:0/4226037526 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7f8148062850 con 0x7f81580cf5d0 2024-09-17T03:08:58.678 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:08:58.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.682+0000 7f815e3da640 1 -- 172.21.15.78:0/4226037526 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8144078b90 msgr2=0x7f814407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:58.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.682+0000 7f815e3da640 1 --2- 172.21.15.78:0/4226037526 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8144078b90 0x7f814407b0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f814c034000 tx=0x7f814c004730 comp rx=0 tx=0).stop 2024-09-17T03:08:58.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.682+0000 7f815e3da640 1 -- 172.21.15.78:0/4226037526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81580cf5d0 msgr2=0x7f81581f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:58.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.682+0000 7f815e3da640 1 --2- 172.21.15.78:0/4226037526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81580cf5d0 0x7f81581f6b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f814800b3e0 tx=0x7f814800b8a0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.682+0000 7f815e3da640 1 -- 172.21.15.78:0/4226037526 shutdown_connections 2024-09-17T03:08:58.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.682+0000 7f815e3da640 1 --2- 172.21.15.78:0/4226037526 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8144078b90 0x7f814407b0a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.682+0000 7f815e3da640 1 --2- 172.21.15.78:0/4226037526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81580d2ed0 0x7f8158154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.682+0000 7f815e3da640 1 --2- 172.21.15.78:0/4226037526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81580d1a80 0x7f8158154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.682+0000 7f815e3da640 1 --2- 172.21.15.78:0/4226037526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81580cf5d0 0x7f81581f6b00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.682+0000 7f815e3da640 1 -- 172.21.15.78:0/4226037526 >> 172.21.15.78:0/4226037526 conn(0x7f815808bfc0 msgr2=0x7f81580b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:58.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.682+0000 7f815e3da640 1 -- 172.21.15.78:0/4226037526 shutdown_connections 2024-09-17T03:08:58.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.682+0000 7f815e3da640 1 -- 172.21.15.78:0/4226037526 wait complete. 2024-09-17T03:08:58.687 INFO:tasks.ceph.mds.b.smithi193.stderr: -6857> 2024-09-17T03:08:33.207+0000 7f66d9542640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:08:58.692 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:08:58.746 INFO:tasks.ceph.mds.b.smithi193.stdout:starting mds.b at 2024-09-17T03:08:58.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.808+0000 7f3d7924d640 1 -- 172.21.15.78:0/40387010 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d741600b0 msgr2=0x7f3d740ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:58.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.808+0000 7f3d7924d640 1 --2- 172.21.15.78:0/40387010 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d741600b0 0x7f3d740ccbc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3d64009830 tx=0x7f3d6402a540 comp rx=0 tx=0).stop 2024-09-17T03:08:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.808+0000 7f3d7924d640 1 -- 172.21.15.78:0/40387010 shutdown_connections 2024-09-17T03:08:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.808+0000 7f3d7924d640 1 --2- 172.21.15.78:0/40387010 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d741600b0 0x7f3d740ccbc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.808+0000 7f3d7924d640 1 -- 172.21.15.78:0/40387010 >> 172.21.15.78:0/40387010 conn(0x7f3d7406d4f0 msgr2=0x7f3d74071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.808+0000 7f3d7924d640 1 -- 172.21.15.78:0/40387010 shutdown_connections 2024-09-17T03:08:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.808+0000 7f3d7924d640 1 -- 172.21.15.78:0/40387010 wait complete. 2024-09-17T03:08:58.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.810+0000 7f3d7924d640 1 Processor -- start 2024-09-17T03:08:58.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.810+0000 7f3d7924d640 1 -- start start 2024-09-17T03:08:58.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.812+0000 7f3d7924d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3d740b7cc0 0x7f3d74155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:58.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.812+0000 7f3d7924d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d740cf320 0x7f3d7415ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:58.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.812+0000 7f3d7924d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d741600b0 0x7f3d7415f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:58.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.812+0000 7f3d7924d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3d740d15b0 con 0x7f3d740cf320 2024-09-17T03:08:58.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.812+0000 7f3d7924d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3d740d1430 con 0x7f3d741600b0 2024-09-17T03:08:58.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.812+0000 7f3d7924d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3d740d1730 con 0x7f3d740b7cc0 2024-09-17T03:08:58.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.812+0000 7f3d7259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d740cf320 0x7f3d7415ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:58.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.812+0000 7f3d7259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d740cf320 0x7f3d7415ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40914/0 (socket says 172.21.15.78:40914) 2024-09-17T03:08:58.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.812+0000 7f3d7259c640 1 -- 172.21.15.78:0/268584751 learned_addr learned my addr 172.21.15.78:0/268584751 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.812+0000 7f3d72d9d640 1 --2- 172.21.15.78:0/268584751 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3d740b7cc0 0x7f3d74155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.812+0000 7f3d7359e640 1 --2- 172.21.15.78:0/268584751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d741600b0 0x7f3d7415f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.812+0000 7f3d7259c640 1 -- 172.21.15.78:0/268584751 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3d740b7cc0 msgr2=0x7f3d74155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.812+0000 7f3d7259c640 1 --2- 172.21.15.78:0/268584751 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3d740b7cc0 0x7f3d74155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.812+0000 7f3d7259c640 1 -- 172.21.15.78:0/268584751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d741600b0 msgr2=0x7f3d7415f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.812+0000 7f3d7259c640 1 --2- 172.21.15.78:0/268584751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d741600b0 0x7f3d7415f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.812+0000 7f3d7259c640 1 -- 172.21.15.78:0/268584751 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d741f6ee0 con 0x7f3d740cf320 2024-09-17T03:08:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.812+0000 7f3d7259c640 1 --2- 172.21.15.78:0/268584751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d740cf320 0x7f3d7415ecc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800c4b0 tx=0x7f3d6800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.812+0000 7f3d5b7fe640 1 -- 172.21.15.78:0/268584751 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d68016020 con 0x7f3d740cf320 2024-09-17T03:08:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.813+0000 7f3d5b7fe640 1 -- 172.21.15.78:0/268584751 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3d68012920 con 0x7f3d740cf320 2024-09-17T03:08:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.813+0000 7f3d7924d640 1 -- 172.21.15.78:0/268584751 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d741f71c0 con 0x7f3d740cf320 2024-09-17T03:08:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.813+0000 7f3d5b7fe640 1 -- 172.21.15.78:0/268584751 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d68012d70 con 0x7f3d740cf320 2024-09-17T03:08:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.813+0000 7f3d7924d640 1 -- 172.21.15.78:0/268584751 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d741f7780 con 0x7f3d740cf320 2024-09-17T03:08:58.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.814+0000 7f3d7924d640 1 -- 172.21.15.78:0/268584751 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d740ccbc0 con 0x7f3d740cf320 2024-09-17T03:08:58.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.814+0000 7f3d5b7fe640 1 -- 172.21.15.78:0/268584751 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3d68019020 con 0x7f3d740cf320 2024-09-17T03:08:58.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.815+0000 7f3d5b7fe640 1 --2- 172.21.15.78:0/268584751 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3d60078b90 0x7f3d6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:58.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.815+0000 7f3d5b7fe640 1 -- 172.21.15.78:0/268584751 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5795+0+0 (secure 0 0 0) 0x7f3d6809abb0 con 0x7f3d740cf320 2024-09-17T03:08:58.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.815+0000 7f3d72d9d640 1 --2- 172.21.15.78:0/268584751 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3d60078b90 0x7f3d6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:58.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.816+0000 7f3d72d9d640 1 --2- 172.21.15.78:0/268584751 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3d60078b90 0x7f3d6007b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3d64034000 tx=0x7f3d64004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:58.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:58.820+0000 7f3d5b7fe640 1 -- 172.21.15.78:0/268584751 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3d68020020 con 0x7f3d740cf320 2024-09-17T03:08:59.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.030+0000 7f3d7924d640 1 -- 172.21.15.78:0/268584751 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3d740b77f0 con 0x7f3d740cf320 2024-09-17T03:08:59.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.684+0000 7f3d5b7fe640 1 -- 172.21.15.78:0/268584751 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f3d680629d0 con 0x7f3d740cf320 2024-09-17T03:08:59.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.686+0000 7f3d7924d640 1 -- 172.21.15.78:0/268584751 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3d60078b90 msgr2=0x7f3d6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:59.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.686+0000 7f3d7924d640 1 --2- 172.21.15.78:0/268584751 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3d60078b90 0x7f3d6007b0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3d64034000 tx=0x7f3d64004730 comp rx=0 tx=0).stop 2024-09-17T03:08:59.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.686+0000 7f3d7924d640 1 -- 172.21.15.78:0/268584751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d740cf320 msgr2=0x7f3d7415ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:59.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.686+0000 7f3d7924d640 1 --2- 172.21.15.78:0/268584751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d740cf320 0x7f3d7415ecc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3d6800c4b0 tx=0x7f3d6800c970 comp rx=0 tx=0).stop 2024-09-17T03:08:59.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.686+0000 7f3d7924d640 1 -- 172.21.15.78:0/268584751 shutdown_connections 2024-09-17T03:08:59.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.686+0000 7f3d7924d640 1 --2- 172.21.15.78:0/268584751 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3d60078b90 0x7f3d6007b0a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:59.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.686+0000 7f3d7924d640 1 --2- 172.21.15.78:0/268584751 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3d741600b0 0x7f3d7415f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:59.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.686+0000 7f3d7924d640 1 --2- 172.21.15.78:0/268584751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d740cf320 0x7f3d7415ecc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:59.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.686+0000 7f3d7924d640 1 --2- 172.21.15.78:0/268584751 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3d740b7cc0 0x7f3d74155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:59.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.686+0000 7f3d7924d640 1 -- 172.21.15.78:0/268584751 >> 172.21.15.78:0/268584751 conn(0x7f3d7406d4f0 msgr2=0x7f3d74160540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:59.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.687+0000 7f3d7924d640 1 -- 172.21.15.78:0/268584751 shutdown_connections 2024-09-17T03:08:59.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.687+0000 7f3d7924d640 1 -- 172.21.15.78:0/268584751 wait complete. 2024-09-17T03:08:59.697 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:08:59.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.816+0000 7f9c01fa1640 1 -- 172.21.15.78:0/629898369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bfc0ccc60 msgr2=0x7f9bfc0cd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:59.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.816+0000 7f9c01fa1640 1 --2- 172.21.15.78:0/629898369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bfc0ccc60 0x7f9bfc0cd070 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0009830 tx=0x7f9bf002a510 comp rx=0 tx=0).stop 2024-09-17T03:08:59.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.816+0000 7f9c01fa1640 1 -- 172.21.15.78:0/629898369 shutdown_connections 2024-09-17T03:08:59.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.816+0000 7f9c01fa1640 1 --2- 172.21.15.78:0/629898369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bfc0ccc60 0x7f9bfc0cd070 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:59.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.816+0000 7f9c01fa1640 1 --2- 172.21.15.78:0/629898369 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9bfc0c5ec0 0x7f9bfc0c62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:59.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.816+0000 7f9c01fa1640 1 -- 172.21.15.78:0/629898369 >> 172.21.15.78:0/629898369 conn(0x7f9bfc0710b0 msgr2=0x7f9bfc0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:08:59.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.816+0000 7f9c01fa1640 1 -- 172.21.15.78:0/629898369 shutdown_connections 2024-09-17T03:08:59.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.816+0000 7f9c01fa1640 1 -- 172.21.15.78:0/629898369 wait complete. 2024-09-17T03:08:59.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.818+0000 7f9c01fa1640 1 Processor -- start 2024-09-17T03:08:59.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.818+0000 7f9c01fa1640 1 -- start start 2024-09-17T03:08:59.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.819+0000 7f9c01fa1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bfc0c5ec0 0x7f9bfc153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:59.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.819+0000 7f9c01fa1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9bfc0ccc60 0x7f9bfc152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:59.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.819+0000 7f9c01fa1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9bfc15c6f0 0x7f9bfc158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:59.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.819+0000 7f9c01fa1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9bfc0c6990 con 0x7f9bfc0c5ec0 2024-09-17T03:08:59.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.819+0000 7f9c01fa1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9bfc0c6810 con 0x7f9bfc15c6f0 2024-09-17T03:08:59.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.819+0000 7f9c01fa1640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f9bfc0c6b10 con 0x7f9bfc0ccc60 2024-09-17T03:08:59.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.819+0000 7f9bfb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bfc0c5ec0 0x7f9bfc153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:59.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.819+0000 7f9bfb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bfc0c5ec0 0x7f9bfc153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40924/0 (socket says 172.21.15.78:40924) 2024-09-17T03:08:59.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.819+0000 7f9bfb7fe640 1 -- 172.21.15.78:0/3322501422 learned_addr learned my addr 172.21.15.78:0/3322501422 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:08:59.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.819+0000 7f9bfaffd640 1 --2- 172.21.15.78:0/3322501422 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9bfc0ccc60 0x7f9bfc152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:59.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.819+0000 7f9bfbfff640 1 --2- 172.21.15.78:0/3322501422 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9bfc15c6f0 0x7f9bfc158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:59.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.820+0000 7f9bfb7fe640 1 -- 172.21.15.78:0/3322501422 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9bfc0ccc60 msgr2=0x7f9bfc152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:59.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.820+0000 7f9bfb7fe640 1 --2- 172.21.15.78:0/3322501422 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9bfc0ccc60 0x7f9bfc152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:59.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.820+0000 7f9bfb7fe640 1 -- 172.21.15.78:0/3322501422 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9bfc15c6f0 msgr2=0x7f9bfc158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:08:59.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.820+0000 7f9bfb7fe640 1 --2- 172.21.15.78:0/3322501422 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9bfc15c6f0 0x7f9bfc158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:08:59.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.820+0000 7f9bfb7fe640 1 -- 172.21.15.78:0/3322501422 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bfc152d50 con 0x7f9bfc0c5ec0 2024-09-17T03:08:59.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.820+0000 7f9bfbfff640 1 --2- 172.21.15.78:0/3322501422 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9bfc15c6f0 0x7f9bfc158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:08:59.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.820+0000 7f9bfb7fe640 1 --2- 172.21.15.78:0/3322501422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bfc0c5ec0 0x7f9bfc153df0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9bec00c3c0 tx=0x7f9bec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:59.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.820+0000 7f9be3fff640 1 -- 172.21.15.78:0/3322501422 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec017070 con 0x7f9bfc0c5ec0 2024-09-17T03:08:59.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.820+0000 7f9be3fff640 1 -- 172.21.15.78:0/3322501422 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9bec0035f0 con 0x7f9bfc0c5ec0 2024-09-17T03:08:59.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.820+0000 7f9c01fa1640 1 -- 172.21.15.78:0/3322501422 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bfc153030 con 0x7f9bfc0c5ec0 2024-09-17T03:08:59.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.820+0000 7f9be3fff640 1 -- 172.21.15.78:0/3322501422 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec003a80 con 0x7f9bfc0c5ec0 2024-09-17T03:08:59.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.820+0000 7f9c01fa1640 1 -- 172.21.15.78:0/3322501422 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bfc1535f0 con 0x7f9bfc0c5ec0 2024-09-17T03:08:59.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.821+0000 7f9c01fa1640 1 -- 172.21.15.78:0/3322501422 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bfc06a670 con 0x7f9bfc0c5ec0 2024-09-17T03:08:59.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.822+0000 7f9be3fff640 1 -- 172.21.15.78:0/3322501422 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9bec01a070 con 0x7f9bfc0c5ec0 2024-09-17T03:08:59.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.822+0000 7f9be3fff640 1 --2- 172.21.15.78:0/3322501422 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9be8078b90 0x7f9be807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:08:59.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.822+0000 7f9be3fff640 1 -- 172.21.15.78:0/3322501422 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5795+0+0 (secure 0 0 0) 0x7f9bec099f50 con 0x7f9bfc0c5ec0 2024-09-17T03:08:59.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.823+0000 7f9bfaffd640 1 --2- 172.21.15.78:0/3322501422 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9be8078b90 0x7f9be807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:08:59.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.823+0000 7f9bfaffd640 1 --2- 172.21.15.78:0/3322501422 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9be8078b90 0x7f9be807b0a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0034000 tx=0x7f9bf0004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:08:59.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:08:59.827+0000 7f9be3fff640 1 -- 172.21.15.78:0/3322501422 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9bfc06a670 con 0x7f9bfc0c5ec0 2024-09-17T03:09:00.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.003+0000 7f9c01fa1640 1 -- 172.21.15.78:0/3322501422 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9bfc0c6fe0 con 0x7f9bfc0c5ec0 2024-09-17T03:09:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.686+0000 7f9be3fff640 1 -- 172.21.15.78:0/3322501422 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7f9bfc0d1010 con 0x7f9bfc0c5ec0 2024-09-17T03:09:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:09:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.689+0000 7f9c01fa1640 1 -- 172.21.15.78:0/3322501422 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9be8078b90 msgr2=0x7f9be807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.689+0000 7f9c01fa1640 1 --2- 172.21.15.78:0/3322501422 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9be8078b90 0x7f9be807b0a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9bf0034000 tx=0x7f9bf0004730 comp rx=0 tx=0).stop 2024-09-17T03:09:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.689+0000 7f9c01fa1640 1 -- 172.21.15.78:0/3322501422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bfc0c5ec0 msgr2=0x7f9bfc153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.689+0000 7f9c01fa1640 1 --2- 172.21.15.78:0/3322501422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bfc0c5ec0 0x7f9bfc153df0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9bec00c3c0 tx=0x7f9bec00c880 comp rx=0 tx=0).stop 2024-09-17T03:09:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.689+0000 7f9c01fa1640 1 -- 172.21.15.78:0/3322501422 shutdown_connections 2024-09-17T03:09:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.689+0000 7f9c01fa1640 1 --2- 172.21.15.78:0/3322501422 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9be8078b90 0x7f9be807b0a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:00.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.689+0000 7f9c01fa1640 1 --2- 172.21.15.78:0/3322501422 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9bfc15c6f0 0x7f9bfc158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:00.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.689+0000 7f9c01fa1640 1 --2- 172.21.15.78:0/3322501422 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9bfc0ccc60 0x7f9bfc152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:00.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.689+0000 7f9c01fa1640 1 --2- 172.21.15.78:0/3322501422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bfc0c5ec0 0x7f9bfc153df0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:00.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.689+0000 7f9c01fa1640 1 -- 172.21.15.78:0/3322501422 >> 172.21.15.78:0/3322501422 conn(0x7f9bfc0710b0 msgr2=0x7f9bfc15b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:00.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.690+0000 7f9c01fa1640 1 -- 172.21.15.78:0/3322501422 shutdown_connections 2024-09-17T03:09:00.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.690+0000 7f9c01fa1640 1 -- 172.21.15.78:0/3322501422 wait complete. 2024-09-17T03:09:00.707 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:09:00.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.825+0000 7f78f3bad640 1 -- 172.21.15.78:0/1794285479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78ec0c6ed0 msgr2=0x7f78ec167300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:00.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.825+0000 7f78f3bad640 1 --2- 172.21.15.78:0/1794285479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78ec0c6ed0 0x7f78ec167300 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f78e4005fd0 tx=0x7f78e402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:09:00.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.825+0000 7f78f3bad640 1 -- 172.21.15.78:0/1794285479 shutdown_connections 2024-09-17T03:09:00.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.825+0000 7f78f3bad640 1 --2- 172.21.15.78:0/1794285479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78ec0c6ed0 0x7f78ec167300 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:00.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.825+0000 7f78f3bad640 1 -- 172.21.15.78:0/1794285479 >> 172.21.15.78:0/1794285479 conn(0x7f78ec0710b0 msgr2=0x7f78ec0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:00.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.825+0000 7f78f3bad640 1 -- 172.21.15.78:0/1794285479 shutdown_connections 2024-09-17T03:09:00.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.825+0000 7f78f3bad640 1 -- 172.21.15.78:0/1794285479 wait complete. 2024-09-17T03:09:00.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.827+0000 7f78f3bad640 1 Processor -- start 2024-09-17T03:09:00.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.827+0000 7f78f3bad640 1 -- start start 2024-09-17T03:09:00.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.828+0000 7f78f3bad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78ec0c6ed0 0x7f78ec14c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:00.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.828+0000 7f78f3bad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78ec0ccc60 0x7f78ec0b7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:00.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78f3bad640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78ec15c6f0 0x7f78ec0b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:00.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78f3bad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec167bd0 con 0x7f78ec0ccc60 2024-09-17T03:09:00.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78f3bad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f78ec167a50 con 0x7f78ec0c6ed0 2024-09-17T03:09:00.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78f3bad640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f78ec167d50 con 0x7f78ec15c6f0 2024-09-17T03:09:00.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78f1148640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78ec0ccc60 0x7f78ec0b7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:00.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78f1148640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78ec0ccc60 0x7f78ec0b7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40930/0 (socket says 172.21.15.78:40930) 2024-09-17T03:09:00.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78f1148640 1 -- 172.21.15.78:0/380746837 learned_addr learned my addr 172.21.15.78:0/380746837 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:00.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78f1949640 1 --2- 172.21.15.78:0/380746837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78ec0c6ed0 0x7f78ec14c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:00.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78f214a640 1 --2- 172.21.15.78:0/380746837 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78ec15c6f0 0x7f78ec0b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:00.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78f1148640 1 -- 172.21.15.78:0/380746837 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78ec15c6f0 msgr2=0x7f78ec0b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:00.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78f1148640 1 --2- 172.21.15.78:0/380746837 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78ec15c6f0 0x7f78ec0b0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:00.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78f1148640 1 -- 172.21.15.78:0/380746837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78ec0c6ed0 msgr2=0x7f78ec14c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:00.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78f1148640 1 --2- 172.21.15.78:0/380746837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78ec0c6ed0 0x7f78ec14c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:00.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78f1148640 1 -- 172.21.15.78:0/380746837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78ec15b4b0 con 0x7f78ec0ccc60 2024-09-17T03:09:00.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78f214a640 1 --2- 172.21.15.78:0/380746837 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78ec15c6f0 0x7f78ec0b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:09:00.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78f1148640 1 --2- 172.21.15.78:0/380746837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78ec0ccc60 0x7f78ec0b7590 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00c3a0 tx=0x7f78dc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:00.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78e27fc640 1 -- 172.21.15.78:0/380746837 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78dc011790 con 0x7f78ec0ccc60 2024-09-17T03:09:00.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78e27fc640 1 -- 172.21.15.78:0/380746837 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78dc017070 con 0x7f78ec0ccc60 2024-09-17T03:09:00.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78f3bad640 1 -- 172.21.15.78:0/380746837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78ec15b790 con 0x7f78ec0ccc60 2024-09-17T03:09:00.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78e27fc640 1 -- 172.21.15.78:0/380746837 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78dc011cc0 con 0x7f78ec0ccc60 2024-09-17T03:09:00.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.829+0000 7f78f3bad640 1 -- 172.21.15.78:0/380746837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78ec15bd50 con 0x7f78ec0ccc60 2024-09-17T03:09:00.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.830+0000 7f78f3bad640 1 -- 172.21.15.78:0/380746837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78ec0b7dc0 con 0x7f78ec0ccc60 2024-09-17T03:09:00.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.831+0000 7f78e27fc640 1 -- 172.21.15.78:0/380746837 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f78dc01c460 con 0x7f78ec0ccc60 2024-09-17T03:09:00.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.832+0000 7f78e27fc640 1 --2- 172.21.15.78:0/380746837 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f78d0078b90 0x7f78d007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:00.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.832+0000 7f78e27fc640 1 -- 172.21.15.78:0/380746837 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5357+0+0 (secure 0 0 0) 0x7f78dc09a9d0 con 0x7f78ec0ccc60 2024-09-17T03:09:00.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.832+0000 7f78f1949640 1 --2- 172.21.15.78:0/380746837 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f78d0078b90 0x7f78d007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:00.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.832+0000 7f78f1949640 1 --2- 172.21.15.78:0/380746837 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f78d0078b90 0x7f78d007b0a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f78e8006fd0 tx=0x7f78e8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:00.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:00.836+0000 7f78e27fc640 1 -- 172.21.15.78:0/380746837 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f78ec0d1010 con 0x7f78ec0ccc60 2024-09-17T03:09:01.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.010+0000 7f78f3bad640 1 -- 172.21.15.78:0/380746837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f78ec0cef60 con 0x7f78ec0ccc60 2024-09-17T03:09:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.691+0000 7f78e27fc640 1 -- 172.21.15.78:0/380746837 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7f78dc062f70 con 0x7f78ec0ccc60 2024-09-17T03:09:01.690 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2024-09-17T03:09:01.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.694+0000 7f78f3bad640 1 -- 172.21.15.78:0/380746837 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f78d0078b90 msgr2=0x7f78d007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:01.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.694+0000 7f78f3bad640 1 --2- 172.21.15.78:0/380746837 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f78d0078b90 0x7f78d007b0a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f78e8006fd0 tx=0x7f78e8008040 comp rx=0 tx=0).stop 2024-09-17T03:09:01.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.694+0000 7f78f3bad640 1 -- 172.21.15.78:0/380746837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78ec0ccc60 msgr2=0x7f78ec0b7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:01.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.694+0000 7f78f3bad640 1 --2- 172.21.15.78:0/380746837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78ec0ccc60 0x7f78ec0b7590 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00c3a0 tx=0x7f78dc00c860 comp rx=0 tx=0).stop 2024-09-17T03:09:01.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.694+0000 7f78f3bad640 1 -- 172.21.15.78:0/380746837 shutdown_connections 2024-09-17T03:09:01.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.694+0000 7f78f3bad640 1 --2- 172.21.15.78:0/380746837 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78ec15c6f0 0x7f78ec0b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:01.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.694+0000 7f78f3bad640 1 --2- 172.21.15.78:0/380746837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78ec0ccc60 0x7f78ec0b7590 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:01.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.694+0000 7f78f3bad640 1 --2- 172.21.15.78:0/380746837 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f78d0078b90 0x7f78d007b0a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:01.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.694+0000 7f78f3bad640 1 --2- 172.21.15.78:0/380746837 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78ec0c6ed0 0x7f78ec14c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:01.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.694+0000 7f78f3bad640 1 -- 172.21.15.78:0/380746837 >> 172.21.15.78:0/380746837 conn(0x7f78ec0710b0 msgr2=0x7f78ec0b2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:01.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.694+0000 7f78f3bad640 1 -- 172.21.15.78:0/380746837 shutdown_connections 2024-09-17T03:09:01.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.694+0000 7f78f3bad640 1 -- 172.21.15.78:0/380746837 wait complete. 2024-09-17T03:09:01.709 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:09:01.709 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:09:01.709 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:09:01.709 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:09:01.710 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:09:01.710 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:09:01.710 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:09:01.710 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:09:01.710 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:09:01.710 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:09:01.711 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:09:01.711 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:09:01.711 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:09:01.711 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:09:01.711 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:09:01.711 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:09:01.720 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:09:01.720 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:09:01.721 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:09:01.721 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:09:01.723 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:09:01.723 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:09:01.725 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:09:01.725 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:09:01.763 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:09:01.763 DEBUG:teuthology.parallel:result is None 2024-09-17T03:09:01.764 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:09:01.764 DEBUG:teuthology.parallel:result is None 2024-09-17T03:09:01.767 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:09:01.767 DEBUG:teuthology.parallel:result is None 2024-09-17T03:09:01.769 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:09:01.769 DEBUG:teuthology.parallel:result is None 2024-09-17T03:09:01.769 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:09:01.858 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2024-09-17T03:09:01.859 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-09-17T03:09:01.865 INFO:tasks.ceph.mds.b.smithi193.stdout:starting mds.b at 2024-09-17T03:09:01.865 INFO:tasks.ceph.mds.d.smithi193.stdout:starting mds.d at 2024-09-17T03:09:01.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.898+0000 7f8b33664640 1 -- 172.21.15.78:0/2721775456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b2c0b6680 msgr2=0x7f8b2c0b0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:01.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.898+0000 7f8b33664640 1 --2- 172.21.15.78:0/2721775456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b2c0b6680 0x7f8b2c0b0de0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009820 tx=0x7f8b2802a510 comp rx=0 tx=0).stop 2024-09-17T03:09:01.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.898+0000 7f8b33664640 1 -- 172.21.15.78:0/2721775456 shutdown_connections 2024-09-17T03:09:01.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.898+0000 7f8b33664640 1 --2- 172.21.15.78:0/2721775456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b2c0b6680 0x7f8b2c0b0de0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:01.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.898+0000 7f8b33664640 1 -- 172.21.15.78:0/2721775456 >> 172.21.15.78:0/2721775456 conn(0x7f8b2c0d12a0 msgr2=0x7f8b2c0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:01.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.898+0000 7f8b33664640 1 -- 172.21.15.78:0/2721775456 shutdown_connections 2024-09-17T03:09:01.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.898+0000 7f8b33664640 1 -- 172.21.15.78:0/2721775456 wait complete. 2024-09-17T03:09:01.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.900+0000 7f8b33664640 1 Processor -- start 2024-09-17T03:09:01.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.900+0000 7f8b33664640 1 -- start start 2024-09-17T03:09:01.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.901+0000 7f8b33664640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b2c0b6100 0x7f8b2c1610b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:01.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.901+0000 7f8b33664640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b2c0b6680 0x7f8b2c159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:01.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.901+0000 7f8b33664640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b2c162f60 0x7f8b2c15d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:01.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.901+0000 7f8b33664640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c166c20 con 0x7f8b2c0b6680 2024-09-17T03:09:01.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.901+0000 7f8b33664640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c166aa0 con 0x7f8b2c162f60 2024-09-17T03:09:01.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.901+0000 7f8b33664640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8b2c166da0 con 0x7f8b2c0b6100 2024-09-17T03:09:01.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.902+0000 7f8b30bff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b2c0b6680 0x7f8b2c159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:01.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.902+0000 7f8b30bff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b2c0b6680 0x7f8b2c159100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40980/0 (socket says 172.21.15.78:40980) 2024-09-17T03:09:01.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.902+0000 7f8b30bff640 1 -- 172.21.15.78:0/3950900799 learned_addr learned my addr 172.21.15.78:0/3950900799 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:01.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.902+0000 7f8b31c01640 1 --2- 172.21.15.78:0/3950900799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b2c162f60 0x7f8b2c15d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:01.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.902+0000 7f8b31400640 1 --2- 172.21.15.78:0/3950900799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b2c0b6100 0x7f8b2c1610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:01.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.902+0000 7f8b30bff640 1 -- 172.21.15.78:0/3950900799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b2c0b6100 msgr2=0x7f8b2c1610b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:01.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.902+0000 7f8b30bff640 1 --2- 172.21.15.78:0/3950900799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b2c0b6100 0x7f8b2c1610b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:01.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.902+0000 7f8b30bff640 1 -- 172.21.15.78:0/3950900799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b2c162f60 msgr2=0x7f8b2c15d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:01.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.902+0000 7f8b30bff640 1 --2- 172.21.15.78:0/3950900799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b2c162f60 0x7f8b2c15d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:01.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.902+0000 7f8b30bff640 1 -- 172.21.15.78:0/3950900799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b2c159640 con 0x7f8b2c0b6680 2024-09-17T03:09:01.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.902+0000 7f8b30bff640 1 --2- 172.21.15.78:0/3950900799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b2c0b6680 0x7f8b2c159100 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00c3f0 tx=0x7f8b1c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:01.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.902+0000 7f8b21ffb640 1 -- 172.21.15.78:0/3950900799 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c011790 con 0x7f8b2c0b6680 2024-09-17T03:09:01.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.902+0000 7f8b21ffb640 1 -- 172.21.15.78:0/3950900799 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b1c017070 con 0x7f8b2c0b6680 2024-09-17T03:09:01.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.902+0000 7f8b21ffb640 1 -- 172.21.15.78:0/3950900799 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c011ca0 con 0x7f8b2c0b6680 2024-09-17T03:09:01.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.902+0000 7f8b33664640 1 -- 172.21.15.78:0/3950900799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b2c0cb240 con 0x7f8b2c0b6680 2024-09-17T03:09:01.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.903+0000 7f8b33664640 1 -- 172.21.15.78:0/3950900799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b2c0c8c40 con 0x7f8b2c0b6680 2024-09-17T03:09:01.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.903+0000 7f8b33664640 1 -- 172.21.15.78:0/3950900799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b2c0b0de0 con 0x7f8b2c0b6680 2024-09-17T03:09:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.904+0000 7f8b21ffb640 1 -- 172.21.15.78:0/3950900799 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b1c01c460 con 0x7f8b2c0b6680 2024-09-17T03:09:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.904+0000 7f8b21ffb640 1 --2- 172.21.15.78:0/3950900799 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b10078bc0 0x7f8b1007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.905+0000 7f8b21ffb640 1 -- 172.21.15.78:0/3950900799 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4943+0+0 (secure 0 0 0) 0x7f8b1c09a5b0 con 0x7f8b2c0b6680 2024-09-17T03:09:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.905+0000 7f8b31400640 1 --2- 172.21.15.78:0/3950900799 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b10078bc0 0x7f8b1007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:01.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.906+0000 7f8b31400640 1 --2- 172.21.15.78:0/3950900799 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b10078bc0 0x7f8b1007b0d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8b28034000 tx=0x7f8b28004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:01.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:01.909+0000 7f8b21ffb640 1 -- 172.21.15.78:0/3950900799 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8b1c0626a0 con 0x7f8b2c0b6680 2024-09-17T03:09:02.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.095+0000 7f8b33664640 1 -- 172.21.15.78:0/3950900799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f8b2c0b40d0 con 0x7f8b2c0b6680 2024-09-17T03:09:02.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.707+0000 7f8b21ffb640 1 -- 172.21.15.78:0/3950900799 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) ==== 97+0+0 (secure 0 0 0) 0x7f8b1c0670d0 con 0x7f8b2c0b6680 2024-09-17T03:09:02.706 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2024-09-17T03:09:02.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.710+0000 7f8b33664640 1 -- 172.21.15.78:0/3950900799 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b10078bc0 msgr2=0x7f8b1007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:02.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.710+0000 7f8b33664640 1 --2- 172.21.15.78:0/3950900799 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b10078bc0 0x7f8b1007b0d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8b28034000 tx=0x7f8b28004730 comp rx=0 tx=0).stop 2024-09-17T03:09:02.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.710+0000 7f8b33664640 1 -- 172.21.15.78:0/3950900799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b2c0b6680 msgr2=0x7f8b2c159100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:02.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.710+0000 7f8b33664640 1 --2- 172.21.15.78:0/3950900799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b2c0b6680 0x7f8b2c159100 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00c3f0 tx=0x7f8b1c00c8b0 comp rx=0 tx=0).stop 2024-09-17T03:09:02.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.710+0000 7f8b33664640 1 -- 172.21.15.78:0/3950900799 shutdown_connections 2024-09-17T03:09:02.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.710+0000 7f8b33664640 1 --2- 172.21.15.78:0/3950900799 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b10078bc0 0x7f8b1007b0d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:02.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.710+0000 7f8b33664640 1 --2- 172.21.15.78:0/3950900799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b2c162f60 0x7f8b2c15d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:02.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.710+0000 7f8b33664640 1 --2- 172.21.15.78:0/3950900799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b2c0b6680 0x7f8b2c159100 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:02.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.710+0000 7f8b33664640 1 --2- 172.21.15.78:0/3950900799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b2c0b6100 0x7f8b2c1610b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:02.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.710+0000 7f8b33664640 1 -- 172.21.15.78:0/3950900799 >> 172.21.15.78:0/3950900799 conn(0x7f8b2c0d12a0 msgr2=0x7f8b2c0cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:02.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.710+0000 7f8b33664640 1 -- 172.21.15.78:0/3950900799 shutdown_connections 2024-09-17T03:09:02.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.711+0000 7f8b33664640 1 -- 172.21.15.78:0/3950900799 wait complete. 2024-09-17T03:09:02.724 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:09:02.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.843+0000 7f97cf41d640 1 -- 172.21.15.78:0/1121182381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97c80d3870 msgr2=0x7f97c80ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:02.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.843+0000 7f97cf41d640 1 --2- 172.21.15.78:0/1121182381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97c80d3870 0x7f97c80ceb40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f97c0009900 tx=0x7f97c002a580 comp rx=0 tx=0).stop 2024-09-17T03:09:02.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.843+0000 7f97cf41d640 1 -- 172.21.15.78:0/1121182381 shutdown_connections 2024-09-17T03:09:02.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.843+0000 7f97cf41d640 1 --2- 172.21.15.78:0/1121182381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97c80d3870 0x7f97c80ceb40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:02.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.843+0000 7f97cf41d640 1 --2- 172.21.15.78:0/1121182381 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97c80b3540 0x7f97c80d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:02.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.843+0000 7f97cf41d640 1 -- 172.21.15.78:0/1121182381 >> 172.21.15.78:0/1121182381 conn(0x7f97c808bfc0 msgr2=0x7f97c809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:02.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.843+0000 7f97cf41d640 1 -- 172.21.15.78:0/1121182381 shutdown_connections 2024-09-17T03:09:02.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.843+0000 7f97cf41d640 1 -- 172.21.15.78:0/1121182381 wait complete. 2024-09-17T03:09:02.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.845+0000 7f97cf41d640 1 Processor -- start 2024-09-17T03:09:02.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.845+0000 7f97cf41d640 1 -- start start 2024-09-17T03:09:02.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.846+0000 7f97cf41d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97c80b3540 0x7f97c8154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:02.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.846+0000 7f97cf41d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97c80d3870 0x7f97c8151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:02.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.846+0000 7f97cf41d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97c80cdc30 0x7f97c8151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:02.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.846+0000 7f97cf41d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f97c80d0e60 con 0x7f97c80d3870 2024-09-17T03:09:02.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.846+0000 7f97cf41d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f97c80d0ce0 con 0x7f97c80cdc30 2024-09-17T03:09:02.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.846+0000 7f97cf41d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f97c80d0fe0 con 0x7f97c80b3540 2024-09-17T03:09:02.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.846+0000 7f97cc9b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97c80d3870 0x7f97c8151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:02.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.847+0000 7f97cc9b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97c80d3870 0x7f97c8151810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40994/0 (socket says 172.21.15.78:40994) 2024-09-17T03:09:02.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.847+0000 7f97cc9b8640 1 -- 172.21.15.78:0/207730343 learned_addr learned my addr 172.21.15.78:0/207730343 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:02.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.847+0000 7f97cd1b9640 1 --2- 172.21.15.78:0/207730343 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97c80b3540 0x7f97c8154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:02.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.847+0000 7f97cd9ba640 1 --2- 172.21.15.78:0/207730343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97c80cdc30 0x7f97c8151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:02.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.847+0000 7f97cc9b8640 1 -- 172.21.15.78:0/207730343 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97c80b3540 msgr2=0x7f97c8154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.847+0000 7f97cc9b8640 1 --2- 172.21.15.78:0/207730343 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97c80b3540 0x7f97c8154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.847+0000 7f97cc9b8640 1 -- 172.21.15.78:0/207730343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97c80cdc30 msgr2=0x7f97c8151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.847+0000 7f97cc9b8640 1 --2- 172.21.15.78:0/207730343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97c80cdc30 0x7f97c8151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.847+0000 7f97cc9b8640 1 -- 172.21.15.78:0/207730343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c81547c0 con 0x7f97c80d3870 2024-09-17T03:09:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.847+0000 7f97cd1b9640 1 --2- 172.21.15.78:0/207730343 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97c80b3540 0x7f97c8154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.847+0000 7f97cd9ba640 1 --2- 172.21.15.78:0/207730343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97c80cdc30 0x7f97c8151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.847+0000 7f97cc9b8640 1 --2- 172.21.15.78:0/207730343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97c80d3870 0x7f97c8151810 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f97bc00c7a0 tx=0x7f97bc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.847+0000 7f97c5ffb640 1 -- 172.21.15.78:0/207730343 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc007bb0 con 0x7f97c80d3870 2024-09-17T03:09:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.847+0000 7f97c5ffb640 1 -- 172.21.15.78:0/207730343 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97bc005020 con 0x7f97c80d3870 2024-09-17T03:09:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.847+0000 7f97cf41d640 1 -- 172.21.15.78:0/207730343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c80ccb90 con 0x7f97c80d3870 2024-09-17T03:09:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.847+0000 7f97c5ffb640 1 -- 172.21.15.78:0/207730343 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc007e60 con 0x7f97c80d3870 2024-09-17T03:09:02.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.847+0000 7f97cf41d640 1 -- 172.21.15.78:0/207730343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c80cd150 con 0x7f97c80d3870 2024-09-17T03:09:02.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.848+0000 7f97cf41d640 1 -- 172.21.15.78:0/207730343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c80d1520 con 0x7f97c80d3870 2024-09-17T03:09:02.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.849+0000 7f97c5ffb640 1 -- 172.21.15.78:0/207730343 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f97bc005470 con 0x7f97c80d3870 2024-09-17T03:09:02.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.849+0000 7f97c5ffb640 1 --2- 172.21.15.78:0/207730343 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f97b4078bc0 0x7f97b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:02.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.850+0000 7f97c5ffb640 1 -- 172.21.15.78:0/207730343 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f97bc09ae50 con 0x7f97c80d3870 2024-09-17T03:09:02.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.850+0000 7f97cd1b9640 1 --2- 172.21.15.78:0/207730343 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f97b4078bc0 0x7f97b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:02.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.850+0000 7f97cd1b9640 1 --2- 172.21.15.78:0/207730343 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f97b4078bc0 0x7f97b407b0d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f97b80012e0 tx=0x7f97b8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:02.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:02.854+0000 7f97c5ffb640 1 -- 172.21.15.78:0/207730343 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f97bc014030 con 0x7f97c80d3870 2024-09-17T03:09:03.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.094+0000 7f97cf41d640 1 -- 172.21.15.78:0/207730343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f97c80cf630 con 0x7f97c80d3870 2024-09-17T03:09:03.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.094+0000 7f97c5ffb640 1 -- 172.21.15.78:0/207730343 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7f97bc0635e0 con 0x7f97c80d3870 2024-09-17T03:09:03.093 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:09:03.093 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:09:03.093 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2024-09-17T03:09:03.093 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.093 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2024-09-17T03:09:03.093 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmF3icCRAAZEAXi3RiY/e4JSSr1nd2sQ==", 2024-09-17T03:09:03.094 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.094 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:09:03.094 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:09:03.094 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:09:03.094 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:09:03.094 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.094 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.094 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.094 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2024-09-17T03:09:03.094 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmzFPWFhAAptFKHxH9Xy3l9q0gxLARBQ==", 2024-09-17T03:09:03.094 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.094 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:09:03.094 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:09:03.095 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:09:03.095 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:09:03.095 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.095 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.095 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.095 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2024-09-17T03:09:03.095 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmFoc7ERAAlPpal3pKHjPKFotpPiJ9dA==", 2024-09-17T03:09:03.095 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.095 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:09:03.095 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:09:03.095 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:09:03.095 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:09:03.095 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.095 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.096 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.096 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2024-09-17T03:09:03.096 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmYJ2aHhAAhG6Sw6iZDy6s0qpiSLc//A==", 2024-09-17T03:09:03.096 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.096 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:09:03.096 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:09:03.096 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:09:03.096 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:09:03.096 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.096 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.096 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.096 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2024-09-17T03:09:03.096 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBy8uhmiaXeOhAAbhD0AqPz5JYg9CvycMk6cQ==", 2024-09-17T03:09:03.097 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.097 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:09:03.097 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:09:03.097 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:09:03.097 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.097 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.097 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.097 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2024-09-17T03:09:03.097 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB28uhmWT32HxAAATHdxAa6QOLYGnpPCx72iA==", 2024-09-17T03:09:03.097 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.097 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:09:03.097 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:09:03.097 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:09:03.097 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.098 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.098 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.098 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2024-09-17T03:09:03.098 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB58uhmTOOMMBAA4YSlpqeuxlIXypxCpxDJ+Q==", 2024-09-17T03:09:03.098 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.098 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:09:03.098 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:09:03.098 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:09:03.098 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.098 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.098 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.098 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2024-09-17T03:09:03.098 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB88uhmSgx6MxAAKHGCbjfVZTyeb0nX2xKkSQ==", 2024-09-17T03:09:03.098 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.099 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:09:03.099 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:09:03.099 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:09:03.099 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.099 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.099 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.099 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2024-09-17T03:09:03.099 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCD8uhmNKZkBBAAZwn1Xf+fd3GNeP4etvNePg==", 2024-09-17T03:09:03.099 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.099 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:09:03.099 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:09:03.099 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:09:03.099 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.099 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.100 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.100 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2024-09-17T03:09:03.100 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCG8uhmDTyzBhAAzeipRWM5M2fjCQt7xDGBwA==", 2024-09-17T03:09:03.100 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.100 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:09:03.100 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:09:03.100 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:09:03.100 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.100 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.100 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.100 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2024-09-17T03:09:03.100 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCJ8uhmDsZLGBAAB3VNeHQoty+fQwvYpRkltw==", 2024-09-17T03:09:03.100 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.101 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:09:03.101 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:09:03.101 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:09:03.101 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.101 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.101 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.101 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2024-09-17T03:09:03.101 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCM8uhm3PkQKRAAjJV2xFyyoACLkA3f/lFhWw==", 2024-09-17T03:09:03.101 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.101 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:09:03.101 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:09:03.101 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:09:03.101 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.101 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.101 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.102 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2024-09-17T03:09:03.102 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmn+c/IxAALXG+Qkwye7zc6PjcLBsk1g==", 2024-09-17T03:09:03.102 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.102 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:09:03.102 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2024-09-17T03:09:03.102 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2024-09-17T03:09:03.102 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2024-09-17T03:09:03.102 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.102 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.102 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.102 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2024-09-17T03:09:03.102 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmbzjQKhAAr/DB8TDsiWPsLHnsvUaTiw==", 2024-09-17T03:09:03.102 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.102 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:09:03.103 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2024-09-17T03:09:03.103 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2024-09-17T03:09:03.103 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2024-09-17T03:09:03.103 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.103 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.103 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.103 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.2", 2024-09-17T03:09:03.103 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmB9ABJxAATgS37nY3a3bX8wK1H3S/8A==", 2024-09-17T03:09:03.103 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.103 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:09:03.103 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2024-09-17T03:09:03.103 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2024-09-17T03:09:03.103 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2024-09-17T03:09:03.103 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.104 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.104 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.104 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.3", 2024-09-17T03:09:03.104 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmyhGmLhAAIfkcz3KW+qZ1qDOqQdPS5g==", 2024-09-17T03:09:03.104 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.104 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:09:03.104 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2024-09-17T03:09:03.104 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2024-09-17T03:09:03.104 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2024-09-17T03:09:03.104 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.104 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.104 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.104 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2024-09-17T03:09:03.105 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBu8uhmBgTvJxAAP2vhORVoAAnDSVpnLukIaA==", 2024-09-17T03:09:03.105 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.105 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2024-09-17T03:09:03.105 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:09:03.105 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:09:03.105 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:09:03.105 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.105 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.105 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.105 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-mds", 2024-09-17T03:09:03.105 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCS8uhmTYTGLxAA6rhA6EYexUI4WlYhayJy7Q==", 2024-09-17T03:09:03.105 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.105 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-mds" 2024-09-17T03:09:03.105 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.106 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.106 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.106 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-mgr", 2024-09-17T03:09:03.106 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCS8uhmPIzGLxAAOH3wuL8fKKxfiEyurofy5w==", 2024-09-17T03:09:03.106 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.106 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-17T03:09:03.106 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.106 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.106 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.106 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-osd", 2024-09-17T03:09:03.106 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCS8uhmepPGLxAAoJeCL/1TyVgBCXM9yxyYfA==", 2024-09-17T03:09:03.106 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.106 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-osd" 2024-09-17T03:09:03.106 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.107 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.107 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.107 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-rbd", 2024-09-17T03:09:03.107 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCS8uhmaZrGLxAA572wIjrjkEtlWIvW4TUppw==", 2024-09-17T03:09:03.107 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.107 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-17T03:09:03.107 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.107 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.107 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.107 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-17T03:09:03.107 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCS8uhmoqHGLxAAb85Y6tbktGV1J4D2ZP+Ezw==", 2024-09-17T03:09:03.107 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.107 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-17T03:09:03.108 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.108 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.108 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.108 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-rgw", 2024-09-17T03:09:03.108 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCS8uhm1KjGLxAAl/9jGutZHNTT6TZRv21DiA==", 2024-09-17T03:09:03.108 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.108 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-17T03:09:03.108 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.108 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.108 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.108 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2024-09-17T03:09:03.108 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmcpvVBRAA2JTbv0LrIc7seMyOmOIBmA==", 2024-09-17T03:09:03.108 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.108 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2024-09-17T03:09:03.109 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2024-09-17T03:09:03.109 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:09:03.109 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.109 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:03.109 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:03.109 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2024-09-17T03:09:03.109 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhm1SeKARAA2hyytqNjqToQ0K+RgQ8Tbg==", 2024-09-17T03:09:03.109 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:09:03.109 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2024-09-17T03:09:03.109 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2024-09-17T03:09:03.109 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:09:03.109 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.109 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:03.109 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-17T03:09:03.110 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:09:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.096+0000 7f97cf41d640 1 -- 172.21.15.78:0/207730343 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f97b4078bc0 msgr2=0x7f97b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.096+0000 7f97cf41d640 1 --2- 172.21.15.78:0/207730343 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f97b4078bc0 0x7f97b407b0d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f97b80012e0 tx=0x7f97b8009040 comp rx=0 tx=0).stop 2024-09-17T03:09:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.096+0000 7f97cf41d640 1 -- 172.21.15.78:0/207730343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97c80d3870 msgr2=0x7f97c8151810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.096+0000 7f97cf41d640 1 --2- 172.21.15.78:0/207730343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97c80d3870 0x7f97c8151810 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f97bc00c7a0 tx=0x7f97bc00cc60 comp rx=0 tx=0).stop 2024-09-17T03:09:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.097+0000 7f97cf41d640 1 -- 172.21.15.78:0/207730343 shutdown_connections 2024-09-17T03:09:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.097+0000 7f97cf41d640 1 --2- 172.21.15.78:0/207730343 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f97b4078bc0 0x7f97b407b0d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.097+0000 7f97cf41d640 1 --2- 172.21.15.78:0/207730343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97c80cdc30 0x7f97c8151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.097+0000 7f97cf41d640 1 --2- 172.21.15.78:0/207730343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97c80d3870 0x7f97c8151810 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.097+0000 7f97cf41d640 1 --2- 172.21.15.78:0/207730343 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97c80b3540 0x7f97c8154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.097+0000 7f97cf41d640 1 -- 172.21.15.78:0/207730343 >> 172.21.15.78:0/207730343 conn(0x7f97c808bfc0 msgr2=0x7f97c806f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.097+0000 7f97cf41d640 1 -- 172.21.15.78:0/207730343 shutdown_connections 2024-09-17T03:09:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.097+0000 7f97cf41d640 1 -- 172.21.15.78:0/207730343 wait complete. 2024-09-17T03:09:03.112 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-17T03:09:03.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.227+0000 7f462ea0e640 1 -- 172.21.15.78:0/606805048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4610004800 msgr2=0x7f4610004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:03.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.227+0000 7f462ea0e640 1 --2- 172.21.15.78:0/606805048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4610004800 0x7f4610004c10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f461c0016c0 tx=0x7f4610005830 comp rx=0 tx=0).stop 2024-09-17T03:09:03.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.228+0000 7f462cfab640 1 -- 172.21.15.78:0/606805048 reap_dead start 2024-09-17T03:09:03.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.228+0000 7f462ea0e640 1 -- 172.21.15.78:0/606805048 shutdown_connections 2024-09-17T03:09:03.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.228+0000 7f462ea0e640 1 -- 172.21.15.78:0/606805048 >> 172.21.15.78:0/606805048 conn(0x7f46280b1cb0 msgr2=0x7f46280b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:03.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.228+0000 7f462ea0e640 1 -- 172.21.15.78:0/606805048 shutdown_connections 2024-09-17T03:09:03.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.228+0000 7f462ea0e640 1 -- 172.21.15.78:0/606805048 wait complete. 2024-09-17T03:09:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.229+0000 7f462ea0e640 1 Processor -- start 2024-09-17T03:09:03.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.230+0000 7f462ea0e640 1 -- start start 2024-09-17T03:09:03.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.231+0000 7f462ea0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4610004800 0x7f462815a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.231+0000 7f462ea0e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f462809d2c0 0x7f462809ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.231+0000 7f462ea0e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4628159160 0x7f4628157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.231+0000 7f462ea0e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f46280705b0 con 0x7f4610004800 2024-09-17T03:09:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.231+0000 7f462ea0e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f46280cf7b0 con 0x7f4628159160 2024-09-17T03:09:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.231+0000 7f462ea0e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4628070730 con 0x7f462809d2c0 2024-09-17T03:09:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.231+0000 7f4627fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4610004800 0x7f462815a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.231+0000 7f4627fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4610004800 0x7f462815a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41022/0 (socket says 172.21.15.78:41022) 2024-09-17T03:09:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.231+0000 7f4627fff640 1 -- 172.21.15.78:0/2630964020 learned_addr learned my addr 172.21.15.78:0/2630964020 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.231+0000 7f46277fe640 1 --2- 172.21.15.78:0/2630964020 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f462809d2c0 0x7f462809ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.231+0000 7f462cfab640 1 --2- 172.21.15.78:0/2630964020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4628159160 0x7f4628157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.231+0000 7f4627fff640 1 -- 172.21.15.78:0/2630964020 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f462809d2c0 msgr2=0x7f462809ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.231+0000 7f4627fff640 1 --2- 172.21.15.78:0/2630964020 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f462809d2c0 0x7f462809ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.231+0000 7f4627fff640 1 -- 172.21.15.78:0/2630964020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4628159160 msgr2=0x7f4628157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.231+0000 7f4627fff640 1 --2- 172.21.15.78:0/2630964020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4628159160 0x7f4628157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.231+0000 7f4627fff640 1 -- 172.21.15.78:0/2630964020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f462809ba50 con 0x7f4610004800 2024-09-17T03:09:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.231+0000 7f462cfab640 1 --2- 172.21.15.78:0/2630964020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4628159160 0x7f4628157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.231+0000 7f4627fff640 1 --2- 172.21.15.78:0/2630964020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4610004800 0x7f462815a8f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4618011ae0 tx=0x7f4618009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.231+0000 7f4624ff9640 1 -- 172.21.15.78:0/2630964020 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461801e070 con 0x7f4610004800 2024-09-17T03:09:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.232+0000 7f4624ff9640 1 -- 172.21.15.78:0/2630964020 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f461800fe70 con 0x7f4610004800 2024-09-17T03:09:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.232+0000 7f462ea0e640 1 -- 172.21.15.78:0/2630964020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f462809bcd0 con 0x7f4610004800 2024-09-17T03:09:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.232+0000 7f4624ff9640 1 -- 172.21.15.78:0/2630964020 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4618004290 con 0x7f4610004800 2024-09-17T03:09:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.232+0000 7f462ea0e640 1 -- 172.21.15.78:0/2630964020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f462809c290 con 0x7f4610004800 2024-09-17T03:09:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.233+0000 7f462ea0e640 1 -- 172.21.15.78:0/2630964020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46280717b0 con 0x7f4610004800 2024-09-17T03:09:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.233+0000 7f4624ff9640 1 -- 172.21.15.78:0/2630964020 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4618021070 con 0x7f4610004800 2024-09-17T03:09:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.234+0000 7f4624ff9640 1 --2- 172.21.15.78:0/2630964020 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4614078b90 0x7f461407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.234+0000 7f4624ff9640 1 -- 172.21.15.78:0/2630964020 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f461809b440 con 0x7f4610004800 2024-09-17T03:09:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.234+0000 7f46277fe640 1 --2- 172.21.15.78:0/2630964020 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4614078b90 0x7f461407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.235+0000 7f46277fe640 1 --2- 172.21.15.78:0/2630964020 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4614078b90 0x7f461407b0a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f461c032000 tx=0x7f461c001190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:03.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.239+0000 7f4624ff9640 1 -- 172.21.15.78:0/2630964020 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f46280717b0 con 0x7f4610004800 2024-09-17T03:09:03.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.481+0000 7f462ea0e640 1 -- 172.21.15.78:0/2630964020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f462815c0e0 con 0x7f4610004800 2024-09-17T03:09:03.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.484+0000 7f4624ff9640 1 -- 172.21.15.78:0/2630964020 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f462809ba50 con 0x7f4610004800 2024-09-17T03:09:03.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.486+0000 7f462ea0e640 1 -- 172.21.15.78:0/2630964020 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4614078b90 msgr2=0x7f461407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:03.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.486+0000 7f462ea0e640 1 --2- 172.21.15.78:0/2630964020 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4614078b90 0x7f461407b0a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f461c032000 tx=0x7f461c001190 comp rx=0 tx=0).stop 2024-09-17T03:09:03.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.486+0000 7f462ea0e640 1 -- 172.21.15.78:0/2630964020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4610004800 msgr2=0x7f462815a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:03.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.486+0000 7f462ea0e640 1 --2- 172.21.15.78:0/2630964020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4610004800 0x7f462815a8f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4618011ae0 tx=0x7f4618009e90 comp rx=0 tx=0).stop 2024-09-17T03:09:03.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.486+0000 7f462ea0e640 1 -- 172.21.15.78:0/2630964020 shutdown_connections 2024-09-17T03:09:03.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.486+0000 7f462ea0e640 1 --2- 172.21.15.78:0/2630964020 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4614078b90 0x7f461407b0a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:03.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.486+0000 7f462ea0e640 1 --2- 172.21.15.78:0/2630964020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4628159160 0x7f4628157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:03.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.486+0000 7f462ea0e640 1 --2- 172.21.15.78:0/2630964020 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f462809d2c0 0x7f462809ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:03.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.486+0000 7f462ea0e640 1 --2- 172.21.15.78:0/2630964020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4610004800 0x7f462815a8f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:03.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.486+0000 7f462ea0e640 1 -- 172.21.15.78:0/2630964020 >> 172.21.15.78:0/2630964020 conn(0x7f46280b1cb0 msgr2=0x7f46280acf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:03.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.486+0000 7f462ea0e640 1 -- 172.21.15.78:0/2630964020 shutdown_connections 2024-09-17T03:09:03.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.486+0000 7f462ea0e640 1 -- 172.21.15.78:0/2630964020 wait complete. 2024-09-17T03:09:03.496 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-17T03:09:03.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.611+0000 7fb703e4d640 1 -- 172.21.15.78:0/670924282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6fc15d840 msgr2=0x7fb6fc0b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:03.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.611+0000 7fb703e4d640 1 --2- 172.21.15.78:0/670924282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6fc15d840 0x7fb6fc0b7490 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4005fd0 tx=0x7fb6f402aa90 comp rx=0 tx=0).stop 2024-09-17T03:09:03.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.611+0000 7fb703e4d640 1 -- 172.21.15.78:0/670924282 shutdown_connections 2024-09-17T03:09:03.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.611+0000 7fb703e4d640 1 --2- 172.21.15.78:0/670924282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6fc15d840 0x7fb6fc0b7490 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:03.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.611+0000 7fb703e4d640 1 --2- 172.21.15.78:0/670924282 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6fc1570e0 0x7fb6fc0d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:03.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.611+0000 7fb703e4d640 1 -- 172.21.15.78:0/670924282 >> 172.21.15.78:0/670924282 conn(0x7fb6fc06d550 msgr2=0x7fb6fc071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:03.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.611+0000 7fb703e4d640 1 -- 172.21.15.78:0/670924282 shutdown_connections 2024-09-17T03:09:03.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.611+0000 7fb703e4d640 1 -- 172.21.15.78:0/670924282 wait complete. 2024-09-17T03:09:03.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.613+0000 7fb703e4d640 1 Processor -- start 2024-09-17T03:09:03.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.613+0000 7fb703e4d640 1 -- start start 2024-09-17T03:09:03.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.614+0000 7fb703e4d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6fc0d2460 0x7fb6fc1f6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:03.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.614+0000 7fb703e4d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6fc1570e0 0x7fb6fc157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:03.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.614+0000 7fb703e4d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6fc15d840 0x7fb6fc159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:03.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.614+0000 7fb703e4d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc0b7d60 con 0x7fb6fc1570e0 2024-09-17T03:09:03.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.614+0000 7fb703e4d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc0b7be0 con 0x7fb6fc0d2460 2024-09-17T03:09:03.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.614+0000 7fb703e4d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb6fc0b7ee0 con 0x7fb6fc15d840 2024-09-17T03:09:03.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.614+0000 7fb7013e8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6fc1570e0 0x7fb6fc157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:03.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.614+0000 7fb7013e8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6fc1570e0 0x7fb6fc157610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41034/0 (socket says 172.21.15.78:41034) 2024-09-17T03:09:03.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.614+0000 7fb7013e8640 1 -- 172.21.15.78:0/1531216221 learned_addr learned my addr 172.21.15.78:0/1531216221 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:03.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.614+0000 7fb7023ea640 1 --2- 172.21.15.78:0/1531216221 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6fc15d840 0x7fb6fc159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:03.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.614+0000 7fb701be9640 1 --2- 172.21.15.78:0/1531216221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6fc0d2460 0x7fb6fc1f6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:03.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.614+0000 7fb7013e8640 1 -- 172.21.15.78:0/1531216221 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6fc15d840 msgr2=0x7fb6fc159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:03.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.614+0000 7fb7013e8640 1 --2- 172.21.15.78:0/1531216221 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6fc15d840 0x7fb6fc159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:03.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.614+0000 7fb7013e8640 1 -- 172.21.15.78:0/1531216221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6fc0d2460 msgr2=0x7fb6fc1f6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:03.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.614+0000 7fb7013e8640 1 --2- 172.21.15.78:0/1531216221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6fc0d2460 0x7fb6fc1f6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:03.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.614+0000 7fb7013e8640 1 -- 172.21.15.78:0/1531216221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6fc157b50 con 0x7fb6fc1570e0 2024-09-17T03:09:03.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.615+0000 7fb7013e8640 1 --2- 172.21.15.78:0/1531216221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6fc1570e0 0x7fb6fc157610 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000c3a0 tx=0x7fb6f000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:03.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.615+0000 7fb6fa7fc640 1 -- 172.21.15.78:0/1531216221 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0017070 con 0x7fb6fc1570e0 2024-09-17T03:09:03.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.615+0000 7fb6fa7fc640 1 -- 172.21.15.78:0/1531216221 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6f00053c0 con 0x7fb6fc1570e0 2024-09-17T03:09:03.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.615+0000 7fb703e4d640 1 -- 172.21.15.78:0/1531216221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6fc1f7450 con 0x7fb6fc1570e0 2024-09-17T03:09:03.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.615+0000 7fb6fa7fc640 1 -- 172.21.15.78:0/1531216221 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0003850 con 0x7fb6fc1570e0 2024-09-17T03:09:03.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.615+0000 7fb703e4d640 1 -- 172.21.15.78:0/1531216221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6fc1f7a10 con 0x7fb6fc1570e0 2024-09-17T03:09:03.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.616+0000 7fb703e4d640 1 -- 172.21.15.78:0/1531216221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6fc0d1ed0 con 0x7fb6fc1570e0 2024-09-17T03:09:03.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.617+0000 7fb6fa7fc640 1 -- 172.21.15.78:0/1531216221 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb6f001a070 con 0x7fb6fc1570e0 2024-09-17T03:09:03.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.617+0000 7fb6fa7fc640 1 --2- 172.21.15.78:0/1531216221 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb6e8078b90 0x7fb6e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:03.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.617+0000 7fb6fa7fc640 1 -- 172.21.15.78:0/1531216221 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fb6f0099c50 con 0x7fb6fc1570e0 2024-09-17T03:09:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.617+0000 7fb701be9640 1 --2- 172.21.15.78:0/1531216221 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb6e8078b90 0x7fb6e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:03.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.618+0000 7fb701be9640 1 --2- 172.21.15.78:0/1531216221 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb6e8078b90 0x7fb6e807b0a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00bb50 tx=0x7fb6ec00b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:03.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.622+0000 7fb6fa7fc640 1 -- 172.21.15.78:0/1531216221 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb6f009f020 con 0x7fb6fc1570e0 2024-09-17T03:09:03.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.872+0000 7fb703e4d640 1 -- 172.21.15.78:0/1531216221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fb6fc159a60 con 0x7fb6fc1570e0 2024-09-17T03:09:03.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.875+0000 7fb6fa7fc640 1 -- 172.21.15.78:0/1531216221 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fb6fc0d2870 con 0x7fb6fc1570e0 2024-09-17T03:09:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.877+0000 7fb703e4d640 1 -- 172.21.15.78:0/1531216221 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb6e8078b90 msgr2=0x7fb6e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.877+0000 7fb703e4d640 1 --2- 172.21.15.78:0/1531216221 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb6e8078b90 0x7fb6e807b0a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00bb50 tx=0x7fb6ec00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:09:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.877+0000 7fb703e4d640 1 -- 172.21.15.78:0/1531216221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6fc1570e0 msgr2=0x7fb6fc157610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.877+0000 7fb703e4d640 1 --2- 172.21.15.78:0/1531216221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6fc1570e0 0x7fb6fc157610 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb6f000c3a0 tx=0x7fb6f000c860 comp rx=0 tx=0).stop 2024-09-17T03:09:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.877+0000 7fb703e4d640 1 -- 172.21.15.78:0/1531216221 shutdown_connections 2024-09-17T03:09:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.877+0000 7fb703e4d640 1 --2- 172.21.15.78:0/1531216221 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6fc15d840 0x7fb6fc159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.877+0000 7fb703e4d640 1 --2- 172.21.15.78:0/1531216221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6fc1570e0 0x7fb6fc157610 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.877+0000 7fb703e4d640 1 --2- 172.21.15.78:0/1531216221 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb6e8078b90 0x7fb6e807b0a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:03.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.877+0000 7fb703e4d640 1 --2- 172.21.15.78:0/1531216221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6fc0d2460 0x7fb6fc1f6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:03.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.877+0000 7fb703e4d640 1 -- 172.21.15.78:0/1531216221 >> 172.21.15.78:0/1531216221 conn(0x7fb6fc06d550 msgr2=0x7fb6fc0b5f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:03.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.877+0000 7fb703e4d640 1 -- 172.21.15.78:0/1531216221 shutdown_connections 2024-09-17T03:09:03.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:03.877+0000 7fb703e4d640 1 -- 172.21.15.78:0/1531216221 wait complete. 2024-09-17T03:09:03.887 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-17T03:09:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.002+0000 7f1548b6e640 1 -- 172.21.15.78:0/3273733964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1530004d40 msgr2=0x7f15300051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.002+0000 7f1548b6e640 1 --2- 172.21.15.78:0/3273733964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1530004d40 0x7f15300051f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f153c009b50 tx=0x7f1530005830 comp rx=0 tx=0).stop 2024-09-17T03:09:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.002+0000 7f1542d9d640 1 -- 172.21.15.78:0/3273733964 reap_dead start 2024-09-17T03:09:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.002+0000 7f1548b6e640 1 -- 172.21.15.78:0/3273733964 shutdown_connections 2024-09-17T03:09:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.002+0000 7f1548b6e640 1 -- 172.21.15.78:0/3273733964 >> 172.21.15.78:0/3273733964 conn(0x7f154406def0 msgr2=0x7f154406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.002+0000 7f1548b6e640 1 -- 172.21.15.78:0/3273733964 shutdown_connections 2024-09-17T03:09:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.002+0000 7f1548b6e640 1 -- 172.21.15.78:0/3273733964 wait complete. 2024-09-17T03:09:04.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.004+0000 7f1548b6e640 1 Processor -- start 2024-09-17T03:09:04.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.004+0000 7f1548b6e640 1 -- start start 2024-09-17T03:09:04.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.005+0000 7f1548b6e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1530004d40 0x7f1544148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:04.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.005+0000 7f1548b6e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15441f6200 0x7f15440b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:04.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.005+0000 7f1548b6e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15440b3780 0x7f154414d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:04.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.005+0000 7f1548b6e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1544164640 con 0x7f15440b3780 2024-09-17T03:09:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.005+0000 7f1548b6e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f15441644c0 con 0x7f15441f6200 2024-09-17T03:09:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.005+0000 7f1548b6e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f15441647c0 con 0x7f1530004d40 2024-09-17T03:09:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.005+0000 7f1542d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15440b3780 0x7f154414d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.005+0000 7f1542d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15440b3780 0x7f154414d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41062/0 (socket says 172.21.15.78:41062) 2024-09-17T03:09:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.005+0000 7f1542d9d640 1 -- 172.21.15.78:0/3921447791 learned_addr learned my addr 172.21.15.78:0/3921447791 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.005+0000 7f1541d9b640 1 --2- 172.21.15.78:0/3921447791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15441f6200 0x7f15440b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.005+0000 7f154259c640 1 --2- 172.21.15.78:0/3921447791 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1530004d40 0x7f1544148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.005+0000 7f1542d9d640 1 -- 172.21.15.78:0/3921447791 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1530004d40 msgr2=0x7f1544148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.005+0000 7f1542d9d640 1 --2- 172.21.15.78:0/3921447791 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1530004d40 0x7f1544148c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.005+0000 7f1542d9d640 1 -- 172.21.15.78:0/3921447791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15441f6200 msgr2=0x7f15440b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.005+0000 7f1542d9d640 1 --2- 172.21.15.78:0/3921447791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15441f6200 0x7f15440b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.005+0000 7f1542d9d640 1 -- 172.21.15.78:0/3921447791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15440b3b90 con 0x7f15440b3780 2024-09-17T03:09:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.006+0000 7f1542d9d640 1 --2- 172.21.15.78:0/3921447791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15440b3780 0x7f154414d950 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f153c036040 tx=0x7f153c033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:04.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.006+0000 7f153affd640 1 -- 172.21.15.78:0/3921447791 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c038040 con 0x7f15440b3780 2024-09-17T03:09:04.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.006+0000 7f153affd640 1 -- 172.21.15.78:0/3921447791 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f153c004110 con 0x7f15440b3780 2024-09-17T03:09:04.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.006+0000 7f1548b6e640 1 -- 172.21.15.78:0/3921447791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f154414b1f0 con 0x7f15440b3780 2024-09-17T03:09:04.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.006+0000 7f153affd640 1 -- 172.21.15.78:0/3921447791 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c0336e0 con 0x7f15440b3780 2024-09-17T03:09:04.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.006+0000 7f1548b6e640 1 -- 172.21.15.78:0/3921447791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15441f5720 con 0x7f15440b3780 2024-09-17T03:09:04.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.007+0000 7f1548b6e640 1 -- 172.21.15.78:0/3921447791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f154414ac80 con 0x7f15440b3780 2024-09-17T03:09:04.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.008+0000 7f153affd640 1 -- 172.21.15.78:0/3921447791 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f153c033880 con 0x7f15440b3780 2024-09-17T03:09:04.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.008+0000 7f153affd640 1 --2- 172.21.15.78:0/3921447791 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1524078b90 0x7f152407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:04.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.008+0000 7f153affd640 1 -- 172.21.15.78:0/3921447791 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f153c0ba970 con 0x7f15440b3780 2024-09-17T03:09:04.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.008+0000 7f154259c640 1 --2- 172.21.15.78:0/3921447791 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1524078b90 0x7f152407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:04.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.009+0000 7f154259c640 1 --2- 172.21.15.78:0/3921447791 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1524078b90 0x7f152407b0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1534002230 tx=0x7f1534001ff0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:04.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.013+0000 7f153affd640 1 -- 172.21.15.78:0/3921447791 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f15440b3b90 con 0x7f15440b3780 2024-09-17T03:09:04.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.253+0000 7f1548b6e640 1 -- 172.21.15.78:0/3921447791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f154415c580 con 0x7f15440b3780 2024-09-17T03:09:04.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.255+0000 7f153affd640 1 -- 172.21.15.78:0/3921447791 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f153c083100 con 0x7f15440b3780 2024-09-17T03:09:04.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.258+0000 7f1548b6e640 1 -- 172.21.15.78:0/3921447791 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1524078b90 msgr2=0x7f152407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:04.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.258+0000 7f1548b6e640 1 --2- 172.21.15.78:0/3921447791 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1524078b90 0x7f152407b0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1534002230 tx=0x7f1534001ff0 comp rx=0 tx=0).stop 2024-09-17T03:09:04.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.258+0000 7f1548b6e640 1 -- 172.21.15.78:0/3921447791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15440b3780 msgr2=0x7f154414d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:04.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.258+0000 7f1548b6e640 1 --2- 172.21.15.78:0/3921447791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15440b3780 0x7f154414d950 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f153c036040 tx=0x7f153c033670 comp rx=0 tx=0).stop 2024-09-17T03:09:04.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.258+0000 7f1548b6e640 1 -- 172.21.15.78:0/3921447791 shutdown_connections 2024-09-17T03:09:04.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.258+0000 7f1548b6e640 1 --2- 172.21.15.78:0/3921447791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15440b3780 0x7f154414d950 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:04.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.258+0000 7f1548b6e640 1 --2- 172.21.15.78:0/3921447791 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1524078b90 0x7f152407b0a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:04.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.258+0000 7f1548b6e640 1 --2- 172.21.15.78:0/3921447791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15441f6200 0x7f15440b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:04.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.258+0000 7f1548b6e640 1 --2- 172.21.15.78:0/3921447791 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1530004d40 0x7f1544148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:04.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.258+0000 7f1548b6e640 1 -- 172.21.15.78:0/3921447791 >> 172.21.15.78:0/3921447791 conn(0x7f154406def0 msgr2=0x7f154415e350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:04.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.258+0000 7f1548b6e640 1 -- 172.21.15.78:0/3921447791 shutdown_connections 2024-09-17T03:09:04.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.258+0000 7f1548b6e640 1 -- 172.21.15.78:0/3921447791 wait complete. 2024-09-17T03:09:04.268 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-17T03:09:04.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.382+0000 7fca099ba640 1 -- 172.21.15.78:0/3900126689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9ec004020 msgr2=0x7fc9ec004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:04.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.382+0000 7fca099ba640 1 --2- 172.21.15.78:0/3900126689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9ec004020 0x7fc9ec004800 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8009b20 tx=0x7fc9ec005830 comp rx=0 tx=0).stop 2024-09-17T03:09:04.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.382+0000 7fca037fe640 1 -- 172.21.15.78:0/3900126689 reap_dead start 2024-09-17T03:09:04.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.382+0000 7fca099ba640 1 -- 172.21.15.78:0/3900126689 shutdown_connections 2024-09-17T03:09:04.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.382+0000 7fca099ba640 1 -- 172.21.15.78:0/3900126689 >> 172.21.15.78:0/3900126689 conn(0x7fca0408bfc0 msgr2=0x7fca0409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:04.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.382+0000 7fca099ba640 1 -- 172.21.15.78:0/3900126689 shutdown_connections 2024-09-17T03:09:04.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.382+0000 7fca099ba640 1 -- 172.21.15.78:0/3900126689 wait complete. 2024-09-17T03:09:04.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.384+0000 7fca099ba640 1 Processor -- start 2024-09-17T03:09:04.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.384+0000 7fca099ba640 1 -- start start 2024-09-17T03:09:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.386+0000 7fca099ba640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc9ec004020 0x7fca0415fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.386+0000 7fca099ba640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fca040ce460 0x7fca0415f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.386+0000 7fca099ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca041f8d60 0x7fca041f9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.386+0000 7fca099ba640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fca040d3540 con 0x7fca041f8d60 2024-09-17T03:09:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.386+0000 7fca099ba640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fca040cf520 con 0x7fc9ec004020 2024-09-17T03:09:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.386+0000 7fca099ba640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fca040d36c0 con 0x7fca040ce460 2024-09-17T03:09:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.386+0000 7fca037fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca041f8d60 0x7fca041f9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.386+0000 7fca037fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca041f8d60 0x7fca041f9170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41080/0 (socket says 172.21.15.78:41080) 2024-09-17T03:09:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.386+0000 7fca037fe640 1 -- 172.21.15.78:0/282683171 learned_addr learned my addr 172.21.15.78:0/282683171 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.386+0000 7fca02ffd640 1 --2- 172.21.15.78:0/282683171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc9ec004020 0x7fca0415fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.386+0000 7fca027fc640 1 --2- 172.21.15.78:0/282683171 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fca040ce460 0x7fca0415f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.386+0000 7fca037fe640 1 -- 172.21.15.78:0/282683171 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fca040ce460 msgr2=0x7fca0415f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.386+0000 7fca037fe640 1 --2- 172.21.15.78:0/282683171 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fca040ce460 0x7fca0415f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:04.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.386+0000 7fca037fe640 1 -- 172.21.15.78:0/282683171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc9ec004020 msgr2=0x7fca0415fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:04.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.386+0000 7fca037fe640 1 --2- 172.21.15.78:0/282683171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc9ec004020 0x7fca0415fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:04.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.386+0000 7fca037fe640 1 -- 172.21.15.78:0/282683171 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca040cb6d0 con 0x7fca041f8d60 2024-09-17T03:09:04.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.386+0000 7fca037fe640 1 --2- 172.21.15.78:0/282683171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca041f8d60 0x7fca041f9170 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc001eb0 tx=0x7fc9fc00e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:04.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.386+0000 7fc9ebfff640 1 -- 172.21.15.78:0/282683171 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc010890 con 0x7fca041f8d60 2024-09-17T03:09:04.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.386+0000 7fc9ebfff640 1 -- 172.21.15.78:0/282683171 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9fc017070 con 0x7fca041f8d60 2024-09-17T03:09:04.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.386+0000 7fca099ba640 1 -- 172.21.15.78:0/282683171 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca040cb9b0 con 0x7fca041f8d60 2024-09-17T03:09:04.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.387+0000 7fc9ebfff640 1 -- 172.21.15.78:0/282683171 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc010dc0 con 0x7fca041f8d60 2024-09-17T03:09:04.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.387+0000 7fca099ba640 1 -- 172.21.15.78:0/282683171 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca0415faa0 con 0x7fca041f8d60 2024-09-17T03:09:04.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.387+0000 7fca099ba640 1 -- 172.21.15.78:0/282683171 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca040cbbf0 con 0x7fca041f8d60 2024-09-17T03:09:04.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.388+0000 7fc9ebfff640 1 -- 172.21.15.78:0/282683171 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc9fc01c460 con 0x7fca041f8d60 2024-09-17T03:09:04.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.389+0000 7fc9ebfff640 1 --2- 172.21.15.78:0/282683171 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc9f0078b90 0x7fc9f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:04.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.389+0000 7fc9ebfff640 1 -- 172.21.15.78:0/282683171 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fc9fc09ac30 con 0x7fca041f8d60 2024-09-17T03:09:04.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.389+0000 7fca02ffd640 1 --2- 172.21.15.78:0/282683171 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc9f0078b90 0x7fc9f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:04.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.390+0000 7fca02ffd640 1 --2- 172.21.15.78:0/282683171 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc9f0078b90 0x7fc9f007b0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4004fd0 tx=0x7fc9f4004ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:04.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.393+0000 7fc9ebfff640 1 -- 172.21.15.78:0/282683171 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fca040cbbf0 con 0x7fca041f8d60 2024-09-17T03:09:04.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.636+0000 7fca099ba640 1 -- 172.21.15.78:0/282683171 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fca0406e170 con 0x7fca041f8d60 2024-09-17T03:09:04.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.638+0000 7fc9ebfff640 1 -- 172.21.15.78:0/282683171 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7fc9fc062d80 con 0x7fca041f8d60 2024-09-17T03:09:04.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.641+0000 7fca099ba640 1 -- 172.21.15.78:0/282683171 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc9f0078b90 msgr2=0x7fc9f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:04.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.641+0000 7fca099ba640 1 --2- 172.21.15.78:0/282683171 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc9f0078b90 0x7fc9f007b0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4004fd0 tx=0x7fc9f4004ab0 comp rx=0 tx=0).stop 2024-09-17T03:09:04.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.641+0000 7fca099ba640 1 -- 172.21.15.78:0/282683171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca041f8d60 msgr2=0x7fca041f9170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:04.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.641+0000 7fca099ba640 1 --2- 172.21.15.78:0/282683171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca041f8d60 0x7fca041f9170 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc001eb0 tx=0x7fc9fc00e9a0 comp rx=0 tx=0).stop 2024-09-17T03:09:04.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.641+0000 7fca099ba640 1 -- 172.21.15.78:0/282683171 shutdown_connections 2024-09-17T03:09:04.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.641+0000 7fca099ba640 1 --2- 172.21.15.78:0/282683171 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca041f8d60 0x7fca041f9170 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:04.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.641+0000 7fca099ba640 1 --2- 172.21.15.78:0/282683171 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fca040ce460 0x7fca0415f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:04.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.641+0000 7fca099ba640 1 --2- 172.21.15.78:0/282683171 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc9f0078b90 0x7fc9f007b0a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:04.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.641+0000 7fca099ba640 1 --2- 172.21.15.78:0/282683171 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc9ec004020 0x7fca0415fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:04.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.641+0000 7fca099ba640 1 -- 172.21.15.78:0/282683171 >> 172.21.15.78:0/282683171 conn(0x7fca0408bfc0 msgr2=0x7fca040b8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:04.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.641+0000 7fca099ba640 1 -- 172.21.15.78:0/282683171 shutdown_connections 2024-09-17T03:09:04.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.641+0000 7fca099ba640 1 -- 172.21.15.78:0/282683171 wait complete. 2024-09-17T03:09:04.651 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-17T03:09:04.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.767+0000 7feee6913640 1 -- 172.21.15.78:0/3151698080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feee01600a0 msgr2=0x7feee0071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:04.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.767+0000 7feee6913640 1 --2- 172.21.15.78:0/3151698080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feee01600a0 0x7feee0071250 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7feed0009830 tx=0x7feed002a5a0 comp rx=0 tx=0).stop 2024-09-17T03:09:04.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.767+0000 7feee6913640 1 -- 172.21.15.78:0/3151698080 shutdown_connections 2024-09-17T03:09:04.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.767+0000 7feee6913640 1 --2- 172.21.15.78:0/3151698080 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feee00ce7d0 0x7feee006cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:04.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.767+0000 7feee6913640 1 --2- 172.21.15.78:0/3151698080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feee01600a0 0x7feee0071250 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:04.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.767+0000 7feee6913640 1 -- 172.21.15.78:0/3151698080 >> 172.21.15.78:0/3151698080 conn(0x7feee00cdcb0 msgr2=0x7feee00ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:04.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.767+0000 7feee6913640 1 -- 172.21.15.78:0/3151698080 shutdown_connections 2024-09-17T03:09:04.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.767+0000 7feee6913640 1 -- 172.21.15.78:0/3151698080 wait complete. 2024-09-17T03:09:04.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.769+0000 7feee6913640 1 Processor -- start 2024-09-17T03:09:04.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.769+0000 7feee6913640 1 -- start start 2024-09-17T03:09:04.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.770+0000 7feee6913640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feee0070360 0x7feee009e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:04.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.770+0000 7feee6913640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feee00ce7d0 0x7feee01f2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:04.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.770+0000 7feee6913640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feee01600a0 0x7feee00b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:04.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.770+0000 7feee6913640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feee00b33c0 con 0x7feee00ce7d0 2024-09-17T03:09:04.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.770+0000 7feee6913640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7feee006d700 con 0x7feee0070360 2024-09-17T03:09:04.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.770+0000 7feee6913640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7feee00b3540 con 0x7feee01600a0 2024-09-17T03:09:04.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.770+0000 7feedf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feee00ce7d0 0x7feee01f2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.770+0000 7feedf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feee00ce7d0 0x7feee01f2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41102/0 (socket says 172.21.15.78:41102) 2024-09-17T03:09:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.770+0000 7feedf7fe640 1 -- 172.21.15.78:0/1675244646 learned_addr learned my addr 172.21.15.78:0/1675244646 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.770+0000 7feedffff640 1 --2- 172.21.15.78:0/1675244646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feee0070360 0x7feee009e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.770+0000 7feee4eb0640 1 --2- 172.21.15.78:0/1675244646 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feee01600a0 0x7feee00b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.770+0000 7feedf7fe640 1 -- 172.21.15.78:0/1675244646 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feee01600a0 msgr2=0x7feee00b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.770+0000 7feedf7fe640 1 --2- 172.21.15.78:0/1675244646 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feee01600a0 0x7feee00b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.770+0000 7feedf7fe640 1 -- 172.21.15.78:0/1675244646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feee0070360 msgr2=0x7feee009e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.770+0000 7feedf7fe640 1 --2- 172.21.15.78:0/1675244646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feee0070360 0x7feee009e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.770+0000 7feedf7fe640 1 -- 172.21.15.78:0/1675244646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee009d7a0 con 0x7feee00ce7d0 2024-09-17T03:09:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.770+0000 7feee4eb0640 1 --2- 172.21.15.78:0/1675244646 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feee01600a0 0x7feee00b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:09:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.771+0000 7feedf7fe640 1 --2- 172.21.15.78:0/1675244646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feee00ce7d0 0x7feee01f2e40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7feed400d650 tx=0x7feed400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.771+0000 7feedcff9640 1 -- 172.21.15.78:0/1675244646 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4017070 con 0x7feee00ce7d0 2024-09-17T03:09:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.771+0000 7feedcff9640 1 -- 172.21.15.78:0/1675244646 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feed4009b10 con 0x7feee00ce7d0 2024-09-17T03:09:04.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.771+0000 7feee6913640 1 -- 172.21.15.78:0/1675244646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee009da80 con 0x7feee00ce7d0 2024-09-17T03:09:04.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.771+0000 7feedcff9640 1 -- 172.21.15.78:0/1675244646 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4010460 con 0x7feee00ce7d0 2024-09-17T03:09:04.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.771+0000 7feee6913640 1 -- 172.21.15.78:0/1675244646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee009e040 con 0x7feee00ce7d0 2024-09-17T03:09:04.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.772+0000 7feee6913640 1 -- 172.21.15.78:0/1675244646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee015f4b0 con 0x7feee00ce7d0 2024-09-17T03:09:04.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.773+0000 7feedcff9640 1 -- 172.21.15.78:0/1675244646 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feed401a070 con 0x7feee00ce7d0 2024-09-17T03:09:04.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.773+0000 7feedcff9640 1 --2- 172.21.15.78:0/1675244646 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feecc078bc0 0x7feecc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:04.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.773+0000 7feedcff9640 1 -- 172.21.15.78:0/1675244646 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7feed409aa60 con 0x7feee00ce7d0 2024-09-17T03:09:04.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.773+0000 7feedffff640 1 --2- 172.21.15.78:0/1675244646 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feecc078bc0 0x7feecc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:04.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.774+0000 7feedffff640 1 --2- 172.21.15.78:0/1675244646 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feecc078bc0 0x7feecc07b0d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feed0034000 tx=0x7feed0004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:04.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:04.778+0000 7feedcff9640 1 -- 172.21.15.78:0/1675244646 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feed4063280 con 0x7feee00ce7d0 2024-09-17T03:09:05.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.025+0000 7feee6913640 1 -- 172.21.15.78:0/1675244646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7feee00b3960 con 0x7feee00ce7d0 2024-09-17T03:09:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.028+0000 7feedcff9640 1 -- 172.21.15.78:0/1675244646 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7feed4062b80 con 0x7feee00ce7d0 2024-09-17T03:09:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.030+0000 7feee6913640 1 -- 172.21.15.78:0/1675244646 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feecc078bc0 msgr2=0x7feecc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.030+0000 7feee6913640 1 --2- 172.21.15.78:0/1675244646 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feecc078bc0 0x7feecc07b0d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7feed0034000 tx=0x7feed0004730 comp rx=0 tx=0).stop 2024-09-17T03:09:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.030+0000 7feee6913640 1 -- 172.21.15.78:0/1675244646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feee00ce7d0 msgr2=0x7feee01f2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.030+0000 7feee6913640 1 --2- 172.21.15.78:0/1675244646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feee00ce7d0 0x7feee01f2e40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7feed400d650 tx=0x7feed400db10 comp rx=0 tx=0).stop 2024-09-17T03:09:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.030+0000 7feee6913640 1 -- 172.21.15.78:0/1675244646 shutdown_connections 2024-09-17T03:09:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.030+0000 7feee6913640 1 --2- 172.21.15.78:0/1675244646 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feee01600a0 0x7feee00b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.030+0000 7feee6913640 1 --2- 172.21.15.78:0/1675244646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feee00ce7d0 0x7feee01f2e40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.030+0000 7feee6913640 1 --2- 172.21.15.78:0/1675244646 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feecc078bc0 0x7feecc07b0d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.030+0000 7feee6913640 1 --2- 172.21.15.78:0/1675244646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feee0070360 0x7feee009e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.030+0000 7feee6913640 1 -- 172.21.15.78:0/1675244646 >> 172.21.15.78:0/1675244646 conn(0x7feee00cdcb0 msgr2=0x7feee00b58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.030+0000 7feee6913640 1 -- 172.21.15.78:0/1675244646 shutdown_connections 2024-09-17T03:09:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.030+0000 7feee6913640 1 -- 172.21.15.78:0/1675244646 wait complete. 2024-09-17T03:09:05.040 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-17T03:09:05.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.155+0000 7f39ec72b640 1 -- 172.21.15.78:0/3242923958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39d0005250 msgr2=0x7f39d000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:05.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.155+0000 7f39ec72b640 1 --2- 172.21.15.78:0/3242923958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39d0005250 0x7f39d000b9c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f39dc001dc0 tx=0x7f39d0005830 comp rx=0 tx=0).stop 2024-09-17T03:09:05.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.155+0000 7f39ec72b640 1 -- 172.21.15.78:0/3242923958 shutdown_connections 2024-09-17T03:09:05.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.155+0000 7f39ec72b640 1 --2- 172.21.15.78:0/3242923958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39d0005250 0x7f39d000b9c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.155+0000 7f39ec72b640 1 -- 172.21.15.78:0/3242923958 >> 172.21.15.78:0/3242923958 conn(0x7f39e40cdcb0 msgr2=0x7f39e40ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:05.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.155+0000 7f39ec72b640 1 -- 172.21.15.78:0/3242923958 shutdown_connections 2024-09-17T03:09:05.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.155+0000 7f39ec72b640 1 -- 172.21.15.78:0/3242923958 wait complete. 2024-09-17T03:09:05.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.157+0000 7f39ec72b640 1 Processor -- start 2024-09-17T03:09:05.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.157+0000 7f39ec72b640 1 -- start start 2024-09-17T03:09:05.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.158+0000 7f39ec72b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f39d0005250 0x7f39e40cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:05.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.158+0000 7f39ec72b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39e41f71b0 0x7f39e406cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:05.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.158+0000 7f39ec72b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39e406d320 0x7f39e409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:05.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.158+0000 7f39ec72b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f39e40b30c0 con 0x7f39e406d320 2024-09-17T03:09:05.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.158+0000 7f39ec72b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f39e40b0a60 con 0x7f39e41f71b0 2024-09-17T03:09:05.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.158+0000 7f39ec72b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f39e40b3240 con 0x7f39d0005250 2024-09-17T03:09:05.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.159+0000 7f39eacc8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39e406d320 0x7f39e409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:05.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.159+0000 7f39eacc8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39e406d320 0x7f39e409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41120/0 (socket says 172.21.15.78:41120) 2024-09-17T03:09:05.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.159+0000 7f39eacc8640 1 -- 172.21.15.78:0/201304752 learned_addr learned my addr 172.21.15.78:0/201304752 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:05.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.159+0000 7f39ea4c7640 1 --2- 172.21.15.78:0/201304752 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f39d0005250 0x7f39e40cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:05.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.159+0000 7f39e9cc6640 1 --2- 172.21.15.78:0/201304752 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39e41f71b0 0x7f39e406cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:05.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.159+0000 7f39eacc8640 1 -- 172.21.15.78:0/201304752 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f39d0005250 msgr2=0x7f39e40cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:05.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.159+0000 7f39eacc8640 1 --2- 172.21.15.78:0/201304752 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f39d0005250 0x7f39e40cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.159+0000 7f39eacc8640 1 -- 172.21.15.78:0/201304752 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39e41f71b0 msgr2=0x7f39e406cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:05.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.159+0000 7f39eacc8640 1 --2- 172.21.15.78:0/201304752 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39e41f71b0 0x7f39e406cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.159+0000 7f39eacc8640 1 -- 172.21.15.78:0/201304752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39e406d730 con 0x7f39e406d320 2024-09-17T03:09:05.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.159+0000 7f39eacc8640 1 --2- 172.21.15.78:0/201304752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39e406d320 0x7f39e409aa30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f39dc001eb0 tx=0x7f39dc006ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:05.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.159+0000 7f39daffd640 1 -- 172.21.15.78:0/201304752 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc003d80 con 0x7f39e406d320 2024-09-17T03:09:05.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.159+0000 7f39daffd640 1 -- 172.21.15.78:0/201304752 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39dc005b00 con 0x7f39e406d320 2024-09-17T03:09:05.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.159+0000 7f39ec72b640 1 -- 172.21.15.78:0/201304752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39e40c5140 con 0x7f39e406d320 2024-09-17T03:09:05.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.159+0000 7f39daffd640 1 -- 172.21.15.78:0/201304752 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39dc005f50 con 0x7f39e406d320 2024-09-17T03:09:05.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.159+0000 7f39ec72b640 1 -- 172.21.15.78:0/201304752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39e409c320 con 0x7f39e406d320 2024-09-17T03:09:05.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.160+0000 7f39ec72b640 1 -- 172.21.15.78:0/201304752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39e40c4eb0 con 0x7f39e406d320 2024-09-17T03:09:05.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.161+0000 7f39daffd640 1 -- 172.21.15.78:0/201304752 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f39dc005030 con 0x7f39e406d320 2024-09-17T03:09:05.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.161+0000 7f39daffd640 1 --2- 172.21.15.78:0/201304752 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f39c8078b90 0x7f39c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:05.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.161+0000 7f39daffd640 1 -- 172.21.15.78:0/201304752 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f39dc0bab20 con 0x7f39e406d320 2024-09-17T03:09:05.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.162+0000 7f39ea4c7640 1 --2- 172.21.15.78:0/201304752 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f39c8078b90 0x7f39c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:05.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.162+0000 7f39ea4c7640 1 --2- 172.21.15.78:0/201304752 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f39c8078b90 0x7f39c807b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f39e40cdb90 tx=0x7f39e00067d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:05.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.166+0000 7f39daffd640 1 -- 172.21.15.78:0/201304752 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f39dc043060 con 0x7f39e406d320 2024-09-17T03:09:05.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.410+0000 7f39ec72b640 1 -- 172.21.15.78:0/201304752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f39e4071650 con 0x7f39e406d320 2024-09-17T03:09:05.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.412+0000 7f39daffd640 1 -- 172.21.15.78:0/201304752 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f39e406d730 con 0x7f39e406d320 2024-09-17T03:09:05.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.415+0000 7f39ec72b640 1 -- 172.21.15.78:0/201304752 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f39c8078b90 msgr2=0x7f39c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:05.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.415+0000 7f39ec72b640 1 --2- 172.21.15.78:0/201304752 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f39c8078b90 0x7f39c807b0a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f39e40cdb90 tx=0x7f39e00067d0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.415+0000 7f39ec72b640 1 -- 172.21.15.78:0/201304752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39e406d320 msgr2=0x7f39e409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:05.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.415+0000 7f39ec72b640 1 --2- 172.21.15.78:0/201304752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39e406d320 0x7f39e409aa30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f39dc001eb0 tx=0x7f39dc006ca0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.415+0000 7f39ec72b640 1 -- 172.21.15.78:0/201304752 shutdown_connections 2024-09-17T03:09:05.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.415+0000 7f39ec72b640 1 --2- 172.21.15.78:0/201304752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39e406d320 0x7f39e409aa30 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.415+0000 7f39ec72b640 1 --2- 172.21.15.78:0/201304752 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f39c8078b90 0x7f39c807b0a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.415+0000 7f39ec72b640 1 --2- 172.21.15.78:0/201304752 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39e41f71b0 0x7f39e406cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.415+0000 7f39ec72b640 1 --2- 172.21.15.78:0/201304752 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f39d0005250 0x7f39e40cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.415+0000 7f39ec72b640 1 -- 172.21.15.78:0/201304752 >> 172.21.15.78:0/201304752 conn(0x7f39e40cdcb0 msgr2=0x7f39e40ae710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:05.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.415+0000 7f39ec72b640 1 -- 172.21.15.78:0/201304752 shutdown_connections 2024-09-17T03:09:05.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.415+0000 7f39ec72b640 1 -- 172.21.15.78:0/201304752 wait complete. 2024-09-17T03:09:05.425 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:09:05.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.542+0000 7fe0825da640 1 -- 172.21.15.78:0/346301945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe07c0b6100 msgr2=0x7fe07c0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:05.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.542+0000 7fe0825da640 1 --2- 172.21.15.78:0/346301945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe07c0b6100 0x7fe07c0b1320 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe07c073eb0 tx=0x7fe07002a580 comp rx=0 tx=0).stop 2024-09-17T03:09:05.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.543+0000 7fe0825da640 1 -- 172.21.15.78:0/346301945 shutdown_connections 2024-09-17T03:09:05.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.543+0000 7fe0825da640 1 --2- 172.21.15.78:0/346301945 >> v2:172.21.15.193:3300/0 conn(0x7fe07c161f50 0x7fe07c164370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.543+0000 7fe0825da640 1 --2- 172.21.15.78:0/346301945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe07c0b6100 0x7fe07c0b1320 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.543+0000 7fe0825da640 1 --2- 172.21.15.78:0/346301945 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe07c0b6680 0x7fe07c0b0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.543+0000 7fe0825da640 1 -- 172.21.15.78:0/346301945 >> 172.21.15.78:0/346301945 conn(0x7fe07c0d12a0 msgr2=0x7fe07c0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:05.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.543+0000 7fe0825da640 1 -- 172.21.15.78:0/346301945 shutdown_connections 2024-09-17T03:09:05.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.543+0000 7fe0825da640 1 -- 172.21.15.78:0/346301945 wait complete. 2024-09-17T03:09:05.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.544+0000 7fe0825da640 1 Processor -- start 2024-09-17T03:09:05.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.545+0000 7fe0825da640 1 -- start start 2024-09-17T03:09:05.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.546+0000 7fe0825da640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe07c0b6100 0x7fe07c1f6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:05.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.546+0000 7fe0825da640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe07c0b6680 0x7fe07c14ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:05.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.546+0000 7fe0825da640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe07c161f50 0x7fe07c1f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:05.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.546+0000 7fe0825da640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c0b20d0 con 0x7fe07c0b6100 2024-09-17T03:09:05.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.546+0000 7fe0825da640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c0b19a0 con 0x7fe07c161f50 2024-09-17T03:09:05.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.546+0000 7fe0825da640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe07c1648b0 con 0x7fe07c0b6680 2024-09-17T03:09:05.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.546+0000 7fe07bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe07c0b6100 0x7fe07c1f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:05.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.546+0000 7fe07bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe07c0b6100 0x7fe07c1f6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41136/0 (socket says 172.21.15.78:41136) 2024-09-17T03:09:05.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.546+0000 7fe07bfff640 1 -- 172.21.15.78:0/1898965646 learned_addr learned my addr 172.21.15.78:0/1898965646 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:05.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.546+0000 7fe07b7fe640 1 --2- 172.21.15.78:0/1898965646 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe07c0b6680 0x7fe07c14ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:05.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.546+0000 7fe080b77640 1 --2- 172.21.15.78:0/1898965646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe07c161f50 0x7fe07c1f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:05.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.547+0000 7fe07bfff640 1 -- 172.21.15.78:0/1898965646 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe07c0b6680 msgr2=0x7fe07c14ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:05.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.547+0000 7fe07bfff640 1 --2- 172.21.15.78:0/1898965646 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe07c0b6680 0x7fe07c14ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.547+0000 7fe07bfff640 1 -- 172.21.15.78:0/1898965646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe07c161f50 msgr2=0x7fe07c1f8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:05.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.547+0000 7fe07bfff640 1 --2- 172.21.15.78:0/1898965646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe07c161f50 0x7fe07c1f8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.547+0000 7fe07bfff640 1 -- 172.21.15.78:0/1898965646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe07c1f6850 con 0x7fe07c0b6100 2024-09-17T03:09:05.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.547+0000 7fe07bfff640 1 --2- 172.21.15.78:0/1898965646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe07c0b6100 0x7fe07c1f6310 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00c8f0 tx=0x7fe06c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:05.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.547+0000 7fe078ff9640 1 -- 172.21.15.78:0/1898965646 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c00ae60 con 0x7fe07c0b6100 2024-09-17T03:09:05.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.547+0000 7fe078ff9640 1 -- 172.21.15.78:0/1898965646 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe06c004330 con 0x7fe07c0b6100 2024-09-17T03:09:05.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.547+0000 7fe0825da640 1 -- 172.21.15.78:0/1898965646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe07c0cd230 con 0x7fe07c0b6100 2024-09-17T03:09:05.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.547+0000 7fe078ff9640 1 -- 172.21.15.78:0/1898965646 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c007c10 con 0x7fe07c0b6100 2024-09-17T03:09:05.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.547+0000 7fe0825da640 1 -- 172.21.15.78:0/1898965646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe07c0cd7f0 con 0x7fe07c0b6100 2024-09-17T03:09:05.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.548+0000 7fe0825da640 1 -- 172.21.15.78:0/1898965646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe07c0b0de0 con 0x7fe07c0b6100 2024-09-17T03:09:05.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.549+0000 7fe078ff9640 1 -- 172.21.15.78:0/1898965646 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe06c003610 con 0x7fe07c0b6100 2024-09-17T03:09:05.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.549+0000 7fe078ff9640 1 --2- 172.21.15.78:0/1898965646 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe068078bc0 0x7fe06807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:05.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.550+0000 7fe078ff9640 1 -- 172.21.15.78:0/1898965646 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fe06c09abd0 con 0x7fe07c0b6100 2024-09-17T03:09:05.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.550+0000 7fe07b7fe640 1 --2- 172.21.15.78:0/1898965646 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe068078bc0 0x7fe06807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:05.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.550+0000 7fe07b7fe640 1 --2- 172.21.15.78:0/1898965646 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe068078bc0 0x7fe06807b0d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe070033000 tx=0x7fe070004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:05.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.554+0000 7fe078ff9640 1 -- 172.21.15.78:0/1898965646 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe07c1f6850 con 0x7fe07c0b6100 2024-09-17T03:09:05.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.732+0000 7fe0825da640 1 -- 172.21.15.78:0/1898965646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe07c06d310 con 0x7fe07c0b6100 2024-09-17T03:09:05.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.733+0000 7fe078ff9640 1 -- 172.21.15.78:0/1898965646 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) ==== 84+0+65 (secure 0 0 0) 0x7fe06c014030 con 0x7fe07c0b6100 2024-09-17T03:09:05.732 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:09:05.732 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2024-09-17T03:09:05.732 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:09:05.732 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2024-09-17T03:09:05.732 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2024-09-17T03:09:05.732 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:05.732 INFO:teuthology.orchestra.run.smithi078.stdout:] 2024-09-17T03:09:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.735+0000 7fe0825da640 1 -- 172.21.15.78:0/1898965646 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe068078bc0 msgr2=0x7fe06807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.735+0000 7fe0825da640 1 --2- 172.21.15.78:0/1898965646 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe068078bc0 0x7fe06807b0d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe070033000 tx=0x7fe070004730 comp rx=0 tx=0).stop 2024-09-17T03:09:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.735+0000 7fe0825da640 1 -- 172.21.15.78:0/1898965646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe07c0b6100 msgr2=0x7fe07c1f6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.735+0000 7fe0825da640 1 --2- 172.21.15.78:0/1898965646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe07c0b6100 0x7fe07c1f6310 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe06c00c8f0 tx=0x7fe06c00cdb0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.735+0000 7fe0825da640 1 -- 172.21.15.78:0/1898965646 shutdown_connections 2024-09-17T03:09:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.735+0000 7fe0825da640 1 --2- 172.21.15.78:0/1898965646 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe068078bc0 0x7fe06807b0d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.735+0000 7fe0825da640 1 --2- 172.21.15.78:0/1898965646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe07c161f50 0x7fe07c1f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.735+0000 7fe0825da640 1 --2- 172.21.15.78:0/1898965646 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe07c0b6680 0x7fe07c14ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.735+0000 7fe0825da640 1 --2- 172.21.15.78:0/1898965646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe07c0b6100 0x7fe07c1f6310 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.735+0000 7fe0825da640 1 -- 172.21.15.78:0/1898965646 >> 172.21.15.78:0/1898965646 conn(0x7fe07c0d12a0 msgr2=0x7fe07c0b51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:05.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.735+0000 7fe0825da640 1 -- 172.21.15.78:0/1898965646 shutdown_connections 2024-09-17T03:09:05.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.735+0000 7fe0825da640 1 -- 172.21.15.78:0/1898965646 wait complete. 2024-09-17T03:09:05.745 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:09:05.745 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:09:05.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.864+0000 7f776f82e640 1 -- 172.21.15.78:0/2960467683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77680d2c70 msgr2=0x7f77680d3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:05.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.864+0000 7f776f82e640 1 --2- 172.21.15.78:0/2960467683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77680d2c70 0x7f77680d3080 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f776808cef0 tx=0x7f776002aa30 comp rx=0 tx=0).stop 2024-09-17T03:09:05.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.864+0000 7f776f82e640 1 -- 172.21.15.78:0/2960467683 shutdown_connections 2024-09-17T03:09:05.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.864+0000 7f776f82e640 1 --2- 172.21.15.78:0/2960467683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77680d2c70 0x7f77680d3080 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.864+0000 7f776f82e640 1 --2- 172.21.15.78:0/2960467683 >> v2:172.21.15.193:3300/0 conn(0x7f77680d0e20 0x7f77680d1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.864+0000 7f776f82e640 1 -- 172.21.15.78:0/2960467683 >> 172.21.15.78:0/2960467683 conn(0x7f776809d800 msgr2=0x7f776808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:05.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.864+0000 7f776f82e640 1 -- 172.21.15.78:0/2960467683 shutdown_connections 2024-09-17T03:09:05.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.864+0000 7f776f82e640 1 -- 172.21.15.78:0/2960467683 wait complete. 2024-09-17T03:09:05.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.866+0000 7f776f82e640 1 Processor -- start 2024-09-17T03:09:05.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.866+0000 7f776f82e640 1 -- start start 2024-09-17T03:09:05.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.867+0000 7f776f82e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f776806e0f0 0x7f77681f5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:05.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.867+0000 7f776f82e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f77680d0e20 0x7f77681e3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:05.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.867+0000 7f776f82e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77680d2c70 0x7f77680cd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:05.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.867+0000 7f776f82e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f77680d3950 con 0x7f776806e0f0 2024-09-17T03:09:05.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.867+0000 7f776f82e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f77680d37d0 con 0x7f77680d2c70 2024-09-17T03:09:05.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.867+0000 7f776f82e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f77680d3ad0 con 0x7f77680d0e20 2024-09-17T03:09:05.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.867+0000 7f776d5ca640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f776806e0f0 0x7f77681f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:05.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.867+0000 7f776d5ca640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f776806e0f0 0x7f77681f5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41152/0 (socket says 172.21.15.78:41152) 2024-09-17T03:09:05.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.867+0000 7f776d5ca640 1 -- 172.21.15.78:0/2468618243 learned_addr learned my addr 172.21.15.78:0/2468618243 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:05.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.867+0000 7f776ddcb640 1 --2- 172.21.15.78:0/2468618243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77680d2c70 0x7f77680cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:05.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.867+0000 7f776cdc9640 1 --2- 172.21.15.78:0/2468618243 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f77680d0e20 0x7f77681e3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:05.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.867+0000 7f776d5ca640 1 -- 172.21.15.78:0/2468618243 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f77680d0e20 msgr2=0x7f77681e3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:05.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.867+0000 7f776d5ca640 1 --2- 172.21.15.78:0/2468618243 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f77680d0e20 0x7f77681e3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.867+0000 7f776d5ca640 1 -- 172.21.15.78:0/2468618243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77680d2c70 msgr2=0x7f77680cd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:05.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.867+0000 7f776d5ca640 1 --2- 172.21.15.78:0/2468618243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77680d2c70 0x7f77680cd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:05.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.867+0000 7f776d5ca640 1 -- 172.21.15.78:0/2468618243 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77681e41d0 con 0x7f776806e0f0 2024-09-17T03:09:05.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.868+0000 7f776d5ca640 1 --2- 172.21.15.78:0/2468618243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f776806e0f0 0x7f77681f5450 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f776400c390 tx=0x7f776400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:05.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.868+0000 7f775dffb640 1 -- 172.21.15.78:0/2468618243 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7764017070 con 0x7f776806e0f0 2024-09-17T03:09:05.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.868+0000 7f775dffb640 1 -- 172.21.15.78:0/2468618243 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77640035f0 con 0x7f776806e0f0 2024-09-17T03:09:05.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.868+0000 7f775dffb640 1 -- 172.21.15.78:0/2468618243 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7764003a20 con 0x7f776806e0f0 2024-09-17T03:09:05.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.868+0000 7f776f82e640 1 -- 172.21.15.78:0/2468618243 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77680c8fb0 con 0x7f776806e0f0 2024-09-17T03:09:05.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.868+0000 7f776f82e640 1 -- 172.21.15.78:0/2468618243 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77680c89f0 con 0x7f776806e0f0 2024-09-17T03:09:05.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.869+0000 7f776f82e640 1 -- 172.21.15.78:0/2468618243 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77680d1230 con 0x7f776806e0f0 2024-09-17T03:09:05.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.869+0000 7f775dffb640 1 -- 172.21.15.78:0/2468618243 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f776401a070 con 0x7f776806e0f0 2024-09-17T03:09:05.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.870+0000 7f775dffb640 1 --2- 172.21.15.78:0/2468618243 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f774c078b90 0x7f774c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:05.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.870+0000 7f775dffb640 1 -- 172.21.15.78:0/2468618243 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f7764099c20 con 0x7f776806e0f0 2024-09-17T03:09:05.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.870+0000 7f776cdc9640 1 --2- 172.21.15.78:0/2468618243 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f774c078b90 0x7f774c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:05.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.871+0000 7f776cdc9640 1 --2- 172.21.15.78:0/2468618243 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f774c078b90 0x7f774c07b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f77680ce5f0 tx=0x7f775800b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:05.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:05.875+0000 7f775dffb640 1 -- 172.21.15.78:0/2468618243 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f77681e41d0 con 0x7f776806e0f0 2024-09-17T03:09:06.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:06.050+0000 7f776f82e640 1 -- 172.21.15.78:0/2468618243 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f77680d3200 con 0x7f776806e0f0 2024-09-17T03:09:07.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.031+0000 7f775dffb640 1 -- 172.21.15.78:0/2468618243 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) ==== 138+0+0 (secure 0 0 0) 0x7f77680d1770 con 0x7f776806e0f0 2024-09-17T03:09:07.030 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2024-09-17T03:09:07.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.034+0000 7f776f82e640 1 -- 172.21.15.78:0/2468618243 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f774c078b90 msgr2=0x7f774c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:07.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.034+0000 7f776f82e640 1 --2- 172.21.15.78:0/2468618243 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f774c078b90 0x7f774c07b0a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f77680ce5f0 tx=0x7f775800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:09:07.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.034+0000 7f776f82e640 1 -- 172.21.15.78:0/2468618243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f776806e0f0 msgr2=0x7f77681f5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:07.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.034+0000 7f776f82e640 1 --2- 172.21.15.78:0/2468618243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f776806e0f0 0x7f77681f5450 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f776400c390 tx=0x7f776400c850 comp rx=0 tx=0).stop 2024-09-17T03:09:07.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.035+0000 7f776f82e640 1 -- 172.21.15.78:0/2468618243 shutdown_connections 2024-09-17T03:09:07.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.035+0000 7f776f82e640 1 --2- 172.21.15.78:0/2468618243 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f774c078b90 0x7f774c07b0a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:07.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.035+0000 7f776f82e640 1 --2- 172.21.15.78:0/2468618243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77680d2c70 0x7f77680cd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:07.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.035+0000 7f776f82e640 1 --2- 172.21.15.78:0/2468618243 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f77680d0e20 0x7f77681e3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:07.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.035+0000 7f776f82e640 1 --2- 172.21.15.78:0/2468618243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f776806e0f0 0x7f77681f5450 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:07.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.035+0000 7f776f82e640 1 -- 172.21.15.78:0/2468618243 >> 172.21.15.78:0/2468618243 conn(0x7f776809d800 msgr2=0x7f77680b90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:07.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.035+0000 7f776f82e640 1 -- 172.21.15.78:0/2468618243 shutdown_connections 2024-09-17T03:09:07.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.035+0000 7f776f82e640 1 -- 172.21.15.78:0/2468618243 wait complete. 2024-09-17T03:09:07.051 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:09:07.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.179+0000 7fe8c3df1640 1 -- 172.21.15.78:0/2628889546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8a40040b0 msgr2=0x7fe8a4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:07.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.179+0000 7fe8c3df1640 1 --2- 172.21.15.78:0/2628889546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8a40040b0 0x7fe8a4004800 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000c290 tx=0x7fe8a4005830 comp rx=0 tx=0).stop 2024-09-17T03:09:07.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.179+0000 7fe8c238e640 1 -- 172.21.15.78:0/2628889546 reap_dead start 2024-09-17T03:09:07.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.179+0000 7fe8c3df1640 1 -- 172.21.15.78:0/2628889546 shutdown_connections 2024-09-17T03:09:07.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.179+0000 7fe8c3df1640 1 -- 172.21.15.78:0/2628889546 >> 172.21.15.78:0/2628889546 conn(0x7fe8bc0d1210 msgr2=0x7fe8bc073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:07.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.179+0000 7fe8c3df1640 1 -- 172.21.15.78:0/2628889546 shutdown_connections 2024-09-17T03:09:07.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.179+0000 7fe8c3df1640 1 -- 172.21.15.78:0/2628889546 wait complete. 2024-09-17T03:09:07.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.181+0000 7fe8c3df1640 1 Processor -- start 2024-09-17T03:09:07.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.181+0000 7fe8c3df1640 1 -- start start 2024-09-17T03:09:07.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.182+0000 7fe8c3df1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8a40040b0 0x7fe8bc1f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:07.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.182+0000 7fe8c3df1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe8bc13eee0 0x7fe8bc1547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:07.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.182+0000 7fe8c3df1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8bc154d20 0x7fe8bc141550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:07.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.182+0000 7fe8c3df1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe8bc151c00 con 0x7fe8bc154d20 2024-09-17T03:09:07.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.182+0000 7fe8c3df1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe8bc071ea0 con 0x7fe8a40040b0 2024-09-17T03:09:07.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.182+0000 7fe8c3df1640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe8bc151d80 con 0x7fe8bc13eee0 2024-09-17T03:09:07.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.182+0000 7fe8c238e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8bc154d20 0x7fe8bc141550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:07.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.182+0000 7fe8c238e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8bc154d20 0x7fe8bc141550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39228/0 (socket says 172.21.15.78:39228) 2024-09-17T03:09:07.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.182+0000 7fe8c238e640 1 -- 172.21.15.78:0/3955686604 learned_addr learned my addr 172.21.15.78:0/3955686604 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:07.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.182+0000 7fe8c138c640 1 --2- 172.21.15.78:0/3955686604 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe8bc13eee0 0x7fe8bc1547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:07.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.182+0000 7fe8c1b8d640 1 --2- 172.21.15.78:0/3955686604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8a40040b0 0x7fe8bc1f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:07.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.182+0000 7fe8c238e640 1 -- 172.21.15.78:0/3955686604 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe8bc13eee0 msgr2=0x7fe8bc1547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:07.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.182+0000 7fe8c238e640 1 --2- 172.21.15.78:0/3955686604 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe8bc13eee0 0x7fe8bc1547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:07.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.182+0000 7fe8c238e640 1 -- 172.21.15.78:0/3955686604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8a40040b0 msgr2=0x7fe8bc1f6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:07.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.182+0000 7fe8c238e640 1 --2- 172.21.15.78:0/3955686604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8a40040b0 0x7fe8bc1f6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:07.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.182+0000 7fe8c238e640 1 -- 172.21.15.78:0/3955686604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8bc155130 con 0x7fe8bc154d20 2024-09-17T03:09:07.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.183+0000 7fe8c238e640 1 --2- 172.21.15.78:0/3955686604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8bc154d20 0x7fe8bc141550 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0cdb70 tx=0x7fe8b400d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:07.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.183+0000 7fe8ba7fc640 1 -- 172.21.15.78:0/3955686604 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b401a070 con 0x7fe8bc154d20 2024-09-17T03:09:07.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.183+0000 7fe8ba7fc640 1 -- 172.21.15.78:0/3955686604 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8b4004340 con 0x7fe8bc154d20 2024-09-17T03:09:07.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.183+0000 7fe8c3df1640 1 -- 172.21.15.78:0/3955686604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8bc1566b0 con 0x7fe8bc154d20 2024-09-17T03:09:07.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.183+0000 7fe8ba7fc640 1 -- 172.21.15.78:0/3955686604 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b400f8f0 con 0x7fe8bc154d20 2024-09-17T03:09:07.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.183+0000 7fe8c3df1640 1 -- 172.21.15.78:0/3955686604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8bc156c70 con 0x7fe8bc154d20 2024-09-17T03:09:07.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.184+0000 7fe8c3df1640 1 -- 172.21.15.78:0/3955686604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8bc13f500 con 0x7fe8bc154d20 2024-09-17T03:09:07.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.185+0000 7fe8ba7fc640 1 -- 172.21.15.78:0/3955686604 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe8b401d070 con 0x7fe8bc154d20 2024-09-17T03:09:07.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.185+0000 7fe8ba7fc640 1 --2- 172.21.15.78:0/3955686604 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe8a8078b90 0x7fe8a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:07.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.185+0000 7fe8ba7fc640 1 -- 172.21.15.78:0/3955686604 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5227+0+0 (secure 0 0 0) 0x7fe8b4099d20 con 0x7fe8bc154d20 2024-09-17T03:09:07.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.185+0000 7fe8c1b8d640 1 --2- 172.21.15.78:0/3955686604 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe8a8078b90 0x7fe8a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:07.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.186+0000 7fe8c1b8d640 1 --2- 172.21.15.78:0/3955686604 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe8a8078b90 0x7fe8a807b0a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac005fd0 tx=0x7fe8ac009530 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:07.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.190+0000 7fe8ba7fc640 1 -- 172.21.15.78:0/3955686604 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe8bc155130 con 0x7fe8bc154d20 2024-09-17T03:09:07.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:07.364+0000 7fe8c3df1640 1 -- 172.21.15.78:0/3955686604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe8bc072020 con 0x7fe8bc154d20 2024-09-17T03:09:08.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.039+0000 7fe8ba7fc640 1 -- 172.21.15.78:0/3955686604 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) ==== 170+0+0 (secure 0 0 0) 0x7fe8b4061d80 con 0x7fe8bc154d20 2024-09-17T03:09:08.038 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2024-09-17T03:09:08.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.042+0000 7fe8c3df1640 1 -- 172.21.15.78:0/3955686604 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe8a8078b90 msgr2=0x7fe8a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:08.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.042+0000 7fe8c3df1640 1 --2- 172.21.15.78:0/3955686604 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe8a8078b90 0x7fe8a807b0a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac005fd0 tx=0x7fe8ac009530 comp rx=0 tx=0).stop 2024-09-17T03:09:08.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.042+0000 7fe8c3df1640 1 -- 172.21.15.78:0/3955686604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8bc154d20 msgr2=0x7fe8bc141550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:08.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.042+0000 7fe8c3df1640 1 --2- 172.21.15.78:0/3955686604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8bc154d20 0x7fe8bc141550 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc0cdb70 tx=0x7fe8b400d9a0 comp rx=0 tx=0).stop 2024-09-17T03:09:08.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.042+0000 7fe8c3df1640 1 -- 172.21.15.78:0/3955686604 shutdown_connections 2024-09-17T03:09:08.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.042+0000 7fe8c3df1640 1 --2- 172.21.15.78:0/3955686604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8bc154d20 0x7fe8bc141550 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:08.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.042+0000 7fe8c3df1640 1 --2- 172.21.15.78:0/3955686604 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe8bc13eee0 0x7fe8bc1547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:08.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.042+0000 7fe8c3df1640 1 --2- 172.21.15.78:0/3955686604 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe8a8078b90 0x7fe8a807b0a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:08.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.042+0000 7fe8c3df1640 1 --2- 172.21.15.78:0/3955686604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8a40040b0 0x7fe8bc1f6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:08.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.042+0000 7fe8c3df1640 1 -- 172.21.15.78:0/3955686604 >> 172.21.15.78:0/3955686604 conn(0x7fe8bc0d1210 msgr2=0x7fe8bc15d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:08.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.042+0000 7fe8c3df1640 1 -- 172.21.15.78:0/3955686604 shutdown_connections 2024-09-17T03:09:08.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.042+0000 7fe8c3df1640 1 -- 172.21.15.78:0/3955686604 wait complete. 2024-09-17T03:09:08.066 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:09:08.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.188+0000 7f1e05dba640 1 -- 172.21.15.78:0/3095186431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1de80041c0 msgr2=0x7f1de8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:08.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.188+0000 7f1e05dba640 1 --2- 172.21.15.78:0/3095186431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1de80041c0 0x7f1de8004800 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1df4001800 tx=0x7f1de8005830 comp rx=0 tx=0).stop 2024-09-17T03:09:08.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.188+0000 7f1dfffff640 1 -- 172.21.15.78:0/3095186431 reap_dead start 2024-09-17T03:09:08.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.188+0000 7f1e05dba640 1 -- 172.21.15.78:0/3095186431 shutdown_connections 2024-09-17T03:09:08.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.188+0000 7f1e05dba640 1 -- 172.21.15.78:0/3095186431 >> 172.21.15.78:0/3095186431 conn(0x7f1e0006d4f0 msgr2=0x7f1e00071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:08.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.188+0000 7f1e05dba640 1 -- 172.21.15.78:0/3095186431 shutdown_connections 2024-09-17T03:09:08.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.188+0000 7f1e05dba640 1 -- 172.21.15.78:0/3095186431 wait complete. 2024-09-17T03:09:08.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.190+0000 7f1e05dba640 1 Processor -- start 2024-09-17T03:09:08.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.190+0000 7f1e05dba640 1 -- start start 2024-09-17T03:09:08.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.191+0000 7f1e05dba640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1de80041c0 0x7f1e0006def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:08.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.191+0000 7f1e05dba640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e001576c0 0x7f1e001f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:08.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.191+0000 7f1e05dba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e0006f520 0x7f1e0006f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:08.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.191+0000 7f1e05dba640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1e000d0530 con 0x7f1e0006f520 2024-09-17T03:09:08.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.191+0000 7f1e05dba640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1e000ccff0 con 0x7f1e001576c0 2024-09-17T03:09:08.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.191+0000 7f1e05dba640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f1e000d06b0 con 0x7f1de80041c0 2024-09-17T03:09:08.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.191+0000 7f1dfffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e0006f520 0x7f1e0006f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:08.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.191+0000 7f1dfffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e0006f520 0x7f1e0006f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39244/0 (socket says 172.21.15.78:39244) 2024-09-17T03:09:08.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.191+0000 7f1dfffff640 1 -- 172.21.15.78:0/3266752169 learned_addr learned my addr 172.21.15.78:0/3266752169 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:08.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.191+0000 7f1dff7fe640 1 --2- 172.21.15.78:0/3266752169 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1de80041c0 0x7f1e0006def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:08.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.191+0000 7f1dfeffd640 1 --2- 172.21.15.78:0/3266752169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e001576c0 0x7f1e001f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:08.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.191+0000 7f1dfffff640 1 -- 172.21.15.78:0/3266752169 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1de80041c0 msgr2=0x7f1e0006def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:08.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.191+0000 7f1dfffff640 1 --2- 172.21.15.78:0/3266752169 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1de80041c0 0x7f1e0006def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:08.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.192+0000 7f1dfffff640 1 -- 172.21.15.78:0/3266752169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e001576c0 msgr2=0x7f1e001f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:08.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.192+0000 7f1dfffff640 1 --2- 172.21.15.78:0/3266752169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e001576c0 0x7f1e001f5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:08.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.192+0000 7f1dfffff640 1 -- 172.21.15.78:0/3266752169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e001f69d0 con 0x7f1e0006f520 2024-09-17T03:09:08.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.192+0000 7f1dff7fe640 1 --2- 172.21.15.78:0/3266752169 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1de80041c0 0x7f1e0006def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:09:08.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.192+0000 7f1dfffff640 1 --2- 172.21.15.78:0/3266752169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e0006f520 0x7f1e0006f930 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1e000cdff0 tx=0x7f1df8006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:08.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.192+0000 7f1de7fff640 1 -- 172.21.15.78:0/3266752169 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df8015070 con 0x7f1e0006f520 2024-09-17T03:09:08.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.192+0000 7f1de7fff640 1 -- 172.21.15.78:0/3266752169 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1df800fa20 con 0x7f1e0006f520 2024-09-17T03:09:08.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.192+0000 7f1e05dba640 1 -- 172.21.15.78:0/3266752169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e000b1050 con 0x7f1e0006f520 2024-09-17T03:09:08.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.192+0000 7f1de7fff640 1 -- 172.21.15.78:0/3266752169 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df800fe70 con 0x7f1e0006f520 2024-09-17T03:09:08.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.192+0000 7f1e05dba640 1 -- 172.21.15.78:0/3266752169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e000cb220 con 0x7f1e0006f520 2024-09-17T03:09:08.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.193+0000 7f1e05dba640 1 -- 172.21.15.78:0/3266752169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e000cb480 con 0x7f1e0006f520 2024-09-17T03:09:08.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.194+0000 7f1de7fff640 1 -- 172.21.15.78:0/3266752169 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1df801b460 con 0x7f1e0006f520 2024-09-17T03:09:08.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.194+0000 7f1de7fff640 1 --2- 172.21.15.78:0/3266752169 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1dec078b90 0x7f1dec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:08.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.194+0000 7f1de7fff640 1 -- 172.21.15.78:0/3266752169 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5609+0+0 (secure 0 0 0) 0x7f1df809bb40 con 0x7f1e0006f520 2024-09-17T03:09:08.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.194+0000 7f1dff7fe640 1 --2- 172.21.15.78:0/3266752169 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1dec078b90 0x7f1dec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:08.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.195+0000 7f1dff7fe640 1 --2- 172.21.15.78:0/3266752169 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1dec078b90 0x7f1dec07b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1df0009ab0 tx=0x7f1df0005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:08.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.199+0000 7f1de7fff640 1 -- 172.21.15.78:0/3266752169 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1df8064100 con 0x7f1e0006f520 2024-09-17T03:09:08.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:08.410+0000 7f1e05dba640 1 -- 172.21.15.78:0/3266752169 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1e000b0e40 con 0x7f1e0006f520 2024-09-17T03:09:09.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.040+0000 7f1de7fff640 1 -- 172.21.15.78:0/3266752169 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) ==== 172+0+0 (secure 0 0 0) 0x7f1df8063a00 con 0x7f1e0006f520 2024-09-17T03:09:09.039 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 4 and data pool 5 2024-09-17T03:09:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.044+0000 7f1e05dba640 1 -- 172.21.15.78:0/3266752169 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1dec078b90 msgr2=0x7f1dec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.044+0000 7f1e05dba640 1 --2- 172.21.15.78:0/3266752169 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1dec078b90 0x7f1dec07b0a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1df0009ab0 tx=0x7f1df0005f90 comp rx=0 tx=0).stop 2024-09-17T03:09:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.044+0000 7f1e05dba640 1 -- 172.21.15.78:0/3266752169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e0006f520 msgr2=0x7f1e0006f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.044+0000 7f1e05dba640 1 --2- 172.21.15.78:0/3266752169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e0006f520 0x7f1e0006f930 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1e000cdff0 tx=0x7f1df8006720 comp rx=0 tx=0).stop 2024-09-17T03:09:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.044+0000 7f1e05dba640 1 -- 172.21.15.78:0/3266752169 shutdown_connections 2024-09-17T03:09:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.044+0000 7f1e05dba640 1 --2- 172.21.15.78:0/3266752169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e0006f520 0x7f1e0006f930 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.044+0000 7f1e05dba640 1 --2- 172.21.15.78:0/3266752169 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1dec078b90 0x7f1dec07b0a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.044+0000 7f1e05dba640 1 --2- 172.21.15.78:0/3266752169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e001576c0 0x7f1e001f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.044+0000 7f1e05dba640 1 --2- 172.21.15.78:0/3266752169 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1de80041c0 0x7f1e0006def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.044+0000 7f1e05dba640 1 -- 172.21.15.78:0/3266752169 >> 172.21.15.78:0/3266752169 conn(0x7f1e0006d4f0 msgr2=0x7f1e0015c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.044+0000 7f1e05dba640 1 -- 172.21.15.78:0/3266752169 shutdown_connections 2024-09-17T03:09:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.044+0000 7f1e05dba640 1 -- 172.21.15.78:0/3266752169 wait complete. 2024-09-17T03:09:09.068 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:09:09.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.186+0000 7f2d723eb640 1 -- 172.21.15.78:0/672207638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d6c0cfeb0 msgr2=0x7f2d6c0d02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:09.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.186+0000 7f2d723eb640 1 --2- 172.21.15.78:0/672207638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d6c0cfeb0 0x7f2d6c0d02c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c15f310 tx=0x7f2d6402aac0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.187+0000 7f2d723eb640 1 -- 172.21.15.78:0/672207638 shutdown_connections 2024-09-17T03:09:09.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.187+0000 7f2d723eb640 1 --2- 172.21.15.78:0/672207638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d6c0cfeb0 0x7f2d6c0d02c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.187+0000 7f2d723eb640 1 --2- 172.21.15.78:0/672207638 >> v2:172.21.15.193:3300/0 conn(0x7f2d6c0705d0 0x7f2d6c0b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.187+0000 7f2d723eb640 1 -- 172.21.15.78:0/672207638 >> 172.21.15.78:0/672207638 conn(0x7f2d6c0cdcc0 msgr2=0x7f2d6c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:09.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.187+0000 7f2d723eb640 1 -- 172.21.15.78:0/672207638 shutdown_connections 2024-09-17T03:09:09.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.187+0000 7f2d723eb640 1 -- 172.21.15.78:0/672207638 wait complete. 2024-09-17T03:09:09.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.188+0000 7f2d723eb640 1 Processor -- start 2024-09-17T03:09:09.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.189+0000 7f2d723eb640 1 -- start start 2024-09-17T03:09:09.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.190+0000 7f2d723eb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2d6c0b4090 0x7f2d6c09d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:09.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.190+0000 7f2d723eb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d6c0cfeb0 0x7f2d6c1f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:09.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.190+0000 7f2d723eb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d6c1f65d0 0x7f2d6c1f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:09.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.190+0000 7f2d723eb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c0b4a30 con 0x7f2d6c0cfeb0 2024-09-17T03:09:09.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.190+0000 7f2d723eb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c0b48b0 con 0x7f2d6c1f65d0 2024-09-17T03:09:09.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.190+0000 7f2d723eb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f2d6c0b4bb0 con 0x7f2d6c0b4090 2024-09-17T03:09:09.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.190+0000 7f2d6b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d6c0cfeb0 0x7f2d6c1f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:09.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.190+0000 7f2d6b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d6c0cfeb0 0x7f2d6c1f2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39260/0 (socket says 172.21.15.78:39260) 2024-09-17T03:09:09.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.190+0000 7f2d6b7fe640 1 -- 172.21.15.78:0/2822819488 learned_addr learned my addr 172.21.15.78:0/2822819488 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:09.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.190+0000 7f2d70988640 1 --2- 172.21.15.78:0/2822819488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d6c1f65d0 0x7f2d6c1f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:09.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.190+0000 7f2d6bfff640 1 --2- 172.21.15.78:0/2822819488 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2d6c0b4090 0x7f2d6c09d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:09.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.190+0000 7f2d6b7fe640 1 -- 172.21.15.78:0/2822819488 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2d6c0b4090 msgr2=0x7f2d6c09d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:09.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.190+0000 7f2d6b7fe640 1 --2- 172.21.15.78:0/2822819488 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2d6c0b4090 0x7f2d6c09d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.190+0000 7f2d6b7fe640 1 -- 172.21.15.78:0/2822819488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d6c1f65d0 msgr2=0x7f2d6c1f69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:09.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.190+0000 7f2d6b7fe640 1 --2- 172.21.15.78:0/2822819488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d6c1f65d0 0x7f2d6c1f69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.190+0000 7f2d6b7fe640 1 -- 172.21.15.78:0/2822819488 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6c1f2eb0 con 0x7f2d6c0cfeb0 2024-09-17T03:09:09.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.190+0000 7f2d6bfff640 1 --2- 172.21.15.78:0/2822819488 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2d6c0b4090 0x7f2d6c09d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:09.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.190+0000 7f2d70988640 1 --2- 172.21.15.78:0/2822819488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d6c1f65d0 0x7f2d6c1f69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:09.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.190+0000 7f2d6b7fe640 1 --2- 172.21.15.78:0/2822819488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d6c0cfeb0 0x7f2d6c1f2970 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000e7c0 tx=0x7f2d6000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:09.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.191+0000 7f2d68ff9640 1 -- 172.21.15.78:0/2822819488 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6000ccc0 con 0x7f2d6c0cfeb0 2024-09-17T03:09:09.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.191+0000 7f2d68ff9640 1 -- 172.21.15.78:0/2822819488 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d6000ee70 con 0x7f2d6c0cfeb0 2024-09-17T03:09:09.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.191+0000 7f2d723eb640 1 -- 172.21.15.78:0/2822819488 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d6c1f7190 con 0x7f2d6c0cfeb0 2024-09-17T03:09:09.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.191+0000 7f2d68ff9640 1 -- 172.21.15.78:0/2822819488 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60010690 con 0x7f2d6c0cfeb0 2024-09-17T03:09:09.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.191+0000 7f2d723eb640 1 -- 172.21.15.78:0/2822819488 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d6c09cce0 con 0x7f2d6c0cfeb0 2024-09-17T03:09:09.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.192+0000 7f2d723eb640 1 -- 172.21.15.78:0/2822819488 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d6c09d400 con 0x7f2d6c0cfeb0 2024-09-17T03:09:09.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.192+0000 7f2d68ff9640 1 -- 172.21.15.78:0/2822819488 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2d60010830 con 0x7f2d6c0cfeb0 2024-09-17T03:09:09.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.193+0000 7f2d68ff9640 1 --2- 172.21.15.78:0/2822819488 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2d58078b90 0x7f2d5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:09.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.193+0000 7f2d68ff9640 1 -- 172.21.15.78:0/2822819488 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f2d6009b720 con 0x7f2d6c0cfeb0 2024-09-17T03:09:09.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.193+0000 7f2d6bfff640 1 --2- 172.21.15.78:0/2822819488 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2d58078b90 0x7f2d5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:09.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.194+0000 7f2d6bfff640 1 --2- 172.21.15.78:0/2822819488 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2d58078b90 0x7f2d5807b0a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c007fd0 tx=0x7f2d5c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:09.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.198+0000 7f2d68ff9640 1 -- 172.21.15.78:0/2822819488 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2d60063b60 con 0x7f2d6c0cfeb0 2024-09-17T03:09:09.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.372+0000 7f2d723eb640 1 -- 172.21.15.78:0/2822819488 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2d6c1f6f20 con 0x7f2d6c0cfeb0 2024-09-17T03:09:09.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.373+0000 7f2d68ff9640 1 -- 172.21.15.78:0/2822819488 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16718 (secure 0 0 0) 0x7f2d60063460 con 0x7f2d6c0cfeb0 2024-09-17T03:09:09.372 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:09:09.373 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":33,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:09:08.411521+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:09:06.055293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T03:09:07.368417+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:09:09.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.376+0000 7f2d723eb640 1 -- 172.21.15.78:0/2822819488 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2d58078b90 msgr2=0x7f2d5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:09.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.376+0000 7f2d723eb640 1 --2- 172.21.15.78:0/2822819488 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2d58078b90 0x7f2d5807b0a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c007fd0 tx=0x7f2d5c009040 comp rx=0 tx=0).stop 2024-09-17T03:09:09.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.376+0000 7f2d723eb640 1 -- 172.21.15.78:0/2822819488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d6c0cfeb0 msgr2=0x7f2d6c1f2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:09.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.376+0000 7f2d723eb640 1 --2- 172.21.15.78:0/2822819488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d6c0cfeb0 0x7f2d6c1f2970 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000e7c0 tx=0x7f2d6000ec80 comp rx=0 tx=0).stop 2024-09-17T03:09:09.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.376+0000 7f2d723eb640 1 -- 172.21.15.78:0/2822819488 shutdown_connections 2024-09-17T03:09:09.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.376+0000 7f2d723eb640 1 --2- 172.21.15.78:0/2822819488 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2d58078b90 0x7f2d5807b0a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.376+0000 7f2d723eb640 1 --2- 172.21.15.78:0/2822819488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2d6c1f65d0 0x7f2d6c1f69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.376+0000 7f2d723eb640 1 --2- 172.21.15.78:0/2822819488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d6c0cfeb0 0x7f2d6c1f2970 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.376+0000 7f2d723eb640 1 --2- 172.21.15.78:0/2822819488 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2d6c0b4090 0x7f2d6c09d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.376+0000 7f2d723eb640 1 -- 172.21.15.78:0/2822819488 >> 172.21.15.78:0/2822819488 conn(0x7f2d6c0cdcc0 msgr2=0x7f2d6c0adf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:09.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.376+0000 7f2d723eb640 1 -- 172.21.15.78:0/2822819488 shutdown_connections 2024-09-17T03:09:09.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.376+0000 7f2d723eb640 1 -- 172.21.15.78:0/2822819488 wait complete. 2024-09-17T03:09:09.386 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:09:09.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.499+0000 7fcea730b640 1 -- 172.21.15.78:0/1638516361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcea015e8b0 msgr2=0x7fcea015f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:09.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.499+0000 7fcea730b640 1 --2- 172.21.15.78:0/1638516361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcea015e8b0 0x7fcea015f630 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcea0162450 tx=0x7fce9002a560 comp rx=0 tx=0).stop 2024-09-17T03:09:09.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.499+0000 7fcea730b640 1 -- 172.21.15.78:0/1638516361 shutdown_connections 2024-09-17T03:09:09.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.499+0000 7fcea730b640 1 --2- 172.21.15.78:0/1638516361 >> v2:172.21.15.193:3300/0 conn(0x7fcea015fb70 0x7fcea00b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.499+0000 7fcea730b640 1 --2- 172.21.15.78:0/1638516361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcea015e8b0 0x7fcea015f630 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.499+0000 7fcea730b640 1 -- 172.21.15.78:0/1638516361 >> 172.21.15.78:0/1638516361 conn(0x7fcea00d15f0 msgr2=0x7fcea0073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:09.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.499+0000 7fcea730b640 1 -- 172.21.15.78:0/1638516361 shutdown_connections 2024-09-17T03:09:09.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.499+0000 7fcea730b640 1 -- 172.21.15.78:0/1638516361 wait complete. 2024-09-17T03:09:09.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.501+0000 7fcea730b640 1 Processor -- start 2024-09-17T03:09:09.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.501+0000 7fcea730b640 1 -- start start 2024-09-17T03:09:09.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.502+0000 7fcea730b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcea00b4f80 0x7fcea01f58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:09.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.502+0000 7fcea730b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcea015e8b0 0x7fcea00c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:09.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.502+0000 7fcea730b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcea015fb70 0x7fcea0157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:09.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.502+0000 7fcea730b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcea0073e50 con 0x7fcea00b4f80 2024-09-17T03:09:09.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.502+0000 7fcea730b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcea00b42f0 con 0x7fcea015e8b0 2024-09-17T03:09:09.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.502+0000 7fcea730b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fcea0073fd0 con 0x7fcea015fb70 2024-09-17T03:09:09.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.503+0000 7fcea50a7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcea00b4f80 0x7fcea01f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:09.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.503+0000 7fcea50a7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcea00b4f80 0x7fcea01f58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39280/0 (socket says 172.21.15.78:39280) 2024-09-17T03:09:09.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.503+0000 7fcea50a7640 1 -- 172.21.15.78:0/2832928561 learned_addr learned my addr 172.21.15.78:0/2832928561 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:09.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.503+0000 7fcea48a6640 1 --2- 172.21.15.78:0/2832928561 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcea015e8b0 0x7fcea00c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:09.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.503+0000 7fcea58a8640 1 --2- 172.21.15.78:0/2832928561 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcea015fb70 0x7fcea0157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:09.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.503+0000 7fcea50a7640 1 -- 172.21.15.78:0/2832928561 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcea015fb70 msgr2=0x7fcea0157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:09.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.503+0000 7fcea50a7640 1 --2- 172.21.15.78:0/2832928561 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcea015fb70 0x7fcea0157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.503+0000 7fcea50a7640 1 -- 172.21.15.78:0/2832928561 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcea015e8b0 msgr2=0x7fcea00c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:09.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.503+0000 7fcea50a7640 1 --2- 172.21.15.78:0/2832928561 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcea015e8b0 0x7fcea00c5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.503+0000 7fcea50a7640 1 -- 172.21.15.78:0/2832928561 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea01f6070 con 0x7fcea00b4f80 2024-09-17T03:09:09.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.503+0000 7fcea48a6640 1 --2- 172.21.15.78:0/2832928561 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcea015e8b0 0x7fcea00c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:09.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.503+0000 7fcea50a7640 1 --2- 172.21.15.78:0/2832928561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcea00b4f80 0x7fcea01f58b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fce9c00c3c0 tx=0x7fce9c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:09.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.503+0000 7fce95ffb640 1 -- 172.21.15.78:0/2832928561 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c017070 con 0x7fcea00b4f80 2024-09-17T03:09:09.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.503+0000 7fce95ffb640 1 -- 172.21.15.78:0/2832928561 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce9c0035f0 con 0x7fcea00b4f80 2024-09-17T03:09:09.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.503+0000 7fcea730b640 1 -- 172.21.15.78:0/2832928561 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcea01f6350 con 0x7fcea00b4f80 2024-09-17T03:09:09.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.503+0000 7fce95ffb640 1 -- 172.21.15.78:0/2832928561 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c003a80 con 0x7fcea00b4f80 2024-09-17T03:09:09.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.503+0000 7fcea730b640 1 -- 172.21.15.78:0/2832928561 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea0157eb0 con 0x7fcea00b4f80 2024-09-17T03:09:09.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.504+0000 7fcea730b640 1 -- 172.21.15.78:0/2832928561 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcea01f6870 con 0x7fcea00b4f80 2024-09-17T03:09:09.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.505+0000 7fce95ffb640 1 -- 172.21.15.78:0/2832928561 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce9c01a070 con 0x7fcea00b4f80 2024-09-17T03:09:09.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.506+0000 7fce95ffb640 1 --2- 172.21.15.78:0/2832928561 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fce84078bc0 0x7fce8407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:09.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.506+0000 7fce95ffb640 1 -- 172.21.15.78:0/2832928561 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7fce9c099fe0 con 0x7fcea00b4f80 2024-09-17T03:09:09.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.506+0000 7fcea48a6640 1 --2- 172.21.15.78:0/2832928561 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fce84078bc0 0x7fce8407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:09.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.506+0000 7fcea48a6640 1 --2- 172.21.15.78:0/2832928561 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fce84078bc0 0x7fce8407b0d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fce90033000 tx=0x7fce90004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:09.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.510+0000 7fce95ffb640 1 -- 172.21.15.78:0/2832928561 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcea01f6870 con 0x7fcea00b4f80 2024-09-17T03:09:09.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.686+0000 7fcea730b640 1 -- 172.21.15.78:0/2832928561 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcea0070010 con 0x7fcea00b4f80 2024-09-17T03:09:09.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.687+0000 7fce95ffb640 1 -- 172.21.15.78:0/2832928561 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16718 (secure 0 0 0) 0x7fcea0070010 con 0x7fcea00b4f80 2024-09-17T03:09:09.686 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:09:09.686 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":33,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:09:08.411521+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:09:06.055293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T03:09:07.368417+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:09:09.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.689+0000 7fcea730b640 1 -- 172.21.15.78:0/2832928561 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fce84078bc0 msgr2=0x7fce8407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:09.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.689+0000 7fcea730b640 1 --2- 172.21.15.78:0/2832928561 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fce84078bc0 0x7fce8407b0d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fce90033000 tx=0x7fce90004730 comp rx=0 tx=0).stop 2024-09-17T03:09:09.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.689+0000 7fcea730b640 1 -- 172.21.15.78:0/2832928561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcea00b4f80 msgr2=0x7fcea01f58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:09.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.689+0000 7fcea730b640 1 --2- 172.21.15.78:0/2832928561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcea00b4f80 0x7fcea01f58b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fce9c00c3c0 tx=0x7fce9c00c880 comp rx=0 tx=0).stop 2024-09-17T03:09:09.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.689+0000 7fcea730b640 1 -- 172.21.15.78:0/2832928561 shutdown_connections 2024-09-17T03:09:09.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.689+0000 7fcea730b640 1 --2- 172.21.15.78:0/2832928561 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcea015fb70 0x7fcea0157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.689+0000 7fcea730b640 1 --2- 172.21.15.78:0/2832928561 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fce84078bc0 0x7fce8407b0d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.689+0000 7fcea730b640 1 --2- 172.21.15.78:0/2832928561 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcea015e8b0 0x7fcea00c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.689+0000 7fcea730b640 1 --2- 172.21.15.78:0/2832928561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcea00b4f80 0x7fcea01f58b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.689+0000 7fcea730b640 1 -- 172.21.15.78:0/2832928561 >> 172.21.15.78:0/2832928561 conn(0x7fcea00d15f0 msgr2=0x7fcea006f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:09.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.689+0000 7fcea730b640 1 -- 172.21.15.78:0/2832928561 shutdown_connections 2024-09-17T03:09:09.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.689+0000 7fcea730b640 1 -- 172.21.15.78:0/2832928561 wait complete. 2024-09-17T03:09:09.699 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:09:09.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.817+0000 7f0df43c3640 1 -- 172.21.15.78:0/3597909747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd8004800 msgr2=0x7f0dd8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:09.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.817+0000 7f0df43c3640 1 --2- 172.21.15.78:0/3597909747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd8004800 0x7f0dd8004c10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc006fd0 tx=0x7f0dd8005830 comp rx=0 tx=0).stop 2024-09-17T03:09:09.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.817+0000 7f0df43c3640 1 -- 172.21.15.78:0/3597909747 shutdown_connections 2024-09-17T03:09:09.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.817+0000 7f0df43c3640 1 --2- 172.21.15.78:0/3597909747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd8004800 0x7f0dd8004c10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.817+0000 7f0df43c3640 1 -- 172.21.15.78:0/3597909747 >> 172.21.15.78:0/3597909747 conn(0x7f0dec09d880 msgr2=0x7f0dec08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:09.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.817+0000 7f0df43c3640 1 -- 172.21.15.78:0/3597909747 shutdown_connections 2024-09-17T03:09:09.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.817+0000 7f0df43c3640 1 -- 172.21.15.78:0/3597909747 wait complete. 2024-09-17T03:09:09.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.819+0000 7f0df43c3640 1 Processor -- start 2024-09-17T03:09:09.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.819+0000 7f0df43c3640 1 -- start start 2024-09-17T03:09:09.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.820+0000 7f0df43c3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0dd8004800 0x7f0dec0b2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:09.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.820+0000 7f0df43c3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dec15cbe0 0x7f0dec149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:09.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.820+0000 7f0df43c3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0dec160350 0x7f0dec160760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:09.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.820+0000 7f0df43c3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec0d1200 con 0x7f0dec15cbe0 2024-09-17T03:09:09.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.820+0000 7f0df43c3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec0d1080 con 0x7f0dec160350 2024-09-17T03:09:09.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.820+0000 7f0df43c3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0dec0d1380 con 0x7f0dd8004800 2024-09-17T03:09:09.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.820+0000 7f0df195e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dec15cbe0 0x7f0dec149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:09.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.820+0000 7f0df195e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dec15cbe0 0x7f0dec149390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39298/0 (socket says 172.21.15.78:39298) 2024-09-17T03:09:09.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.820+0000 7f0df195e640 1 -- 172.21.15.78:0/2885723068 learned_addr learned my addr 172.21.15.78:0/2885723068 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:09.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.820+0000 7f0df215f640 1 --2- 172.21.15.78:0/2885723068 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0dd8004800 0x7f0dec0b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:09.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.820+0000 7f0df195e640 1 -- 172.21.15.78:0/2885723068 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0dd8004800 msgr2=0x7f0dec0b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:09.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.820+0000 7f0df2960640 1 --2- 172.21.15.78:0/2885723068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0dec160350 0x7f0dec160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:09.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.821+0000 7f0df195e640 1 --2- 172.21.15.78:0/2885723068 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0dd8004800 0x7f0dec0b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.821+0000 7f0df195e640 1 -- 172.21.15.78:0/2885723068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0dec160350 msgr2=0x7f0dec160760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:09.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.821+0000 7f0df195e640 1 --2- 172.21.15.78:0/2885723068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0dec160350 0x7f0dec160760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:09.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.821+0000 7f0df195e640 1 -- 172.21.15.78:0/2885723068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dec160ca0 con 0x7f0dec15cbe0 2024-09-17T03:09:09.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.821+0000 7f0df215f640 1 --2- 172.21.15.78:0/2885723068 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0dd8004800 0x7f0dec0b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:09:09.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.821+0000 7f0df2960640 1 --2- 172.21.15.78:0/2885723068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0dec160350 0x7f0dec160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:09:09.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.821+0000 7f0df195e640 1 --2- 172.21.15.78:0/2885723068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dec15cbe0 0x7f0dec149390 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00c350 tx=0x7f0ddc006ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:09.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.821+0000 7f0de2ffd640 1 -- 172.21.15.78:0/2885723068 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc032030 con 0x7f0dec15cbe0 2024-09-17T03:09:09.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.821+0000 7f0de2ffd640 1 -- 172.21.15.78:0/2885723068 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ddc0038e0 con 0x7f0dec15cbe0 2024-09-17T03:09:09.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.821+0000 7f0de2ffd640 1 -- 172.21.15.78:0/2885723068 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc003cf0 con 0x7f0dec15cbe0 2024-09-17T03:09:09.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.821+0000 7f0df43c3640 1 -- 172.21.15.78:0/2885723068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dec0b2980 con 0x7f0dec15cbe0 2024-09-17T03:09:09.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.821+0000 7f0df43c3640 1 -- 172.21.15.78:0/2885723068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dec0b2f40 con 0x7f0dec15cbe0 2024-09-17T03:09:09.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.822+0000 7f0df43c3640 1 -- 172.21.15.78:0/2885723068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dec0cf120 con 0x7f0dec15cbe0 2024-09-17T03:09:09.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.823+0000 7f0de2ffd640 1 -- 172.21.15.78:0/2885723068 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0ddc035020 con 0x7f0dec15cbe0 2024-09-17T03:09:09.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.823+0000 7f0de2ffd640 1 --2- 172.21.15.78:0/2885723068 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0dd0078b90 0x7f0dd007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:09.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.823+0000 7f0de2ffd640 1 -- 172.21.15.78:0/2885723068 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f0ddc0bb240 con 0x7f0dec15cbe0 2024-09-17T03:09:09.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.823+0000 7f0df215f640 1 --2- 172.21.15.78:0/2885723068 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0dd0078b90 0x7f0dd007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:09.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.824+0000 7f0df215f640 1 --2- 172.21.15.78:0/2885723068 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0dd0078b90 0x7f0dd007b0a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0de8006de0 tx=0x7f0de80061a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:09.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:09.828+0000 7f0de2ffd640 1 -- 172.21.15.78:0/2885723068 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0ddc047030 con 0x7f0dec15cbe0 2024-09-17T03:09:10.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.041+0000 7f0df43c3640 1 -- 172.21.15.78:0/2885723068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0dec0b2710 con 0x7f0dec15cbe0 2024-09-17T03:09:10.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.059+0000 7f0de2ffd640 1 -- 172.21.15.78:0/2885723068 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) ==== 118+0+0 (secure 0 0 0) 0x7f0dec160ca0 con 0x7f0dec15cbe0 2024-09-17T03:09:10.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.062+0000 7f0df43c3640 1 -- 172.21.15.78:0/2885723068 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0dd0078b90 msgr2=0x7f0dd007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:10.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.062+0000 7f0df43c3640 1 --2- 172.21.15.78:0/2885723068 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0dd0078b90 0x7f0dd007b0a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0de8006de0 tx=0x7f0de80061a0 comp rx=0 tx=0).stop 2024-09-17T03:09:10.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.062+0000 7f0df43c3640 1 -- 172.21.15.78:0/2885723068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dec15cbe0 msgr2=0x7f0dec149390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:10.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.062+0000 7f0df43c3640 1 --2- 172.21.15.78:0/2885723068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dec15cbe0 0x7f0dec149390 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00c350 tx=0x7f0ddc006ce0 comp rx=0 tx=0).stop 2024-09-17T03:09:10.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.062+0000 7f0df43c3640 1 -- 172.21.15.78:0/2885723068 shutdown_connections 2024-09-17T03:09:10.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.062+0000 7f0df43c3640 1 --2- 172.21.15.78:0/2885723068 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0dd0078b90 0x7f0dd007b0a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:10.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.062+0000 7f0df43c3640 1 --2- 172.21.15.78:0/2885723068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0dec160350 0x7f0dec160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:10.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.062+0000 7f0df43c3640 1 --2- 172.21.15.78:0/2885723068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dec15cbe0 0x7f0dec149390 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:10.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.062+0000 7f0df43c3640 1 --2- 172.21.15.78:0/2885723068 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0dd8004800 0x7f0dec0b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:10.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.062+0000 7f0df43c3640 1 -- 172.21.15.78:0/2885723068 >> 172.21.15.78:0/2885723068 conn(0x7f0dec09d880 msgr2=0x7f0dec0b95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:10.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.062+0000 7f0df43c3640 1 -- 172.21.15.78:0/2885723068 shutdown_connections 2024-09-17T03:09:10.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.062+0000 7f0df43c3640 1 -- 172.21.15.78:0/2885723068 wait complete. 2024-09-17T03:09:10.072 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:09:10.072 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:09:10.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.189+0000 7f30574b6640 1 -- 172.21.15.78:0/3380771649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c0039e0 msgr2=0x7f303c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:10.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.189+0000 7f30574b6640 1 --2- 172.21.15.78:0/3380771649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c0039e0 0x7f303c003e10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f304c009b30 tx=0x7f303c005830 comp rx=0 tx=0).stop 2024-09-17T03:09:10.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.189+0000 7f3055a53640 1 -- 172.21.15.78:0/3380771649 reap_dead start 2024-09-17T03:09:10.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.190+0000 7f30574b6640 1 -- 172.21.15.78:0/3380771649 shutdown_connections 2024-09-17T03:09:10.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.190+0000 7f30574b6640 1 -- 172.21.15.78:0/3380771649 >> 172.21.15.78:0/3380771649 conn(0x7f30500cdcb0 msgr2=0x7f30500ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:10.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.190+0000 7f30574b6640 1 -- 172.21.15.78:0/3380771649 shutdown_connections 2024-09-17T03:09:10.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.190+0000 7f30574b6640 1 -- 172.21.15.78:0/3380771649 wait complete. 2024-09-17T03:09:10.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.191+0000 7f30574b6640 1 Processor -- start 2024-09-17T03:09:10.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.191+0000 7f30574b6640 1 -- start start 2024-09-17T03:09:10.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f30574b6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c0039e0 0x7f305006cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:10.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f30574b6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f305014c0a0 0x7f305006d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:10.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f30574b6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30501f34e0 0x7f30501f38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:10.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f30574b6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f30500715e0 con 0x7f303c0039e0 2024-09-17T03:09:10.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f30574b6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3050071460 con 0x7f305014c0a0 2024-09-17T03:09:10.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f30574b6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f30500706c0 con 0x7f30501f34e0 2024-09-17T03:09:10.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f3055252640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c0039e0 0x7f305006cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:10.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f3055252640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c0039e0 0x7f305006cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39310/0 (socket says 172.21.15.78:39310) 2024-09-17T03:09:10.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f3055252640 1 -- 172.21.15.78:0/1811752117 learned_addr learned my addr 172.21.15.78:0/1811752117 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:10.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f3055a53640 1 --2- 172.21.15.78:0/1811752117 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30501f34e0 0x7f30501f38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:10.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f3054a51640 1 --2- 172.21.15.78:0/1811752117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f305014c0a0 0x7f305006d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:10.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f3055252640 1 -- 172.21.15.78:0/1811752117 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30501f34e0 msgr2=0x7f30501f38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:10.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f3055252640 1 --2- 172.21.15.78:0/1811752117 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30501f34e0 0x7f30501f38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:10.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f3055252640 1 -- 172.21.15.78:0/1811752117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f305014c0a0 msgr2=0x7f305006d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:10.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f3055252640 1 --2- 172.21.15.78:0/1811752117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f305014c0a0 0x7f305006d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:10.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f3055252640 1 -- 172.21.15.78:0/1811752117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30501f2fe0 con 0x7f303c0039e0 2024-09-17T03:09:10.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f3055252640 1 --2- 172.21.15.78:0/1811752117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c0039e0 0x7f305006cde0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f304c035040 tx=0x7f304c02b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:10.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f3045ffb640 1 -- 172.21.15.78:0/1811752117 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304c041070 con 0x7f303c0039e0 2024-09-17T03:09:10.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f3045ffb640 1 -- 172.21.15.78:0/1811752117 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f304c0047a0 con 0x7f303c0039e0 2024-09-17T03:09:10.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f3045ffb640 1 -- 172.21.15.78:0/1811752117 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f304c004bd0 con 0x7f303c0039e0 2024-09-17T03:09:10.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.193+0000 7f30574b6640 1 -- 172.21.15.78:0/1811752117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f305014e5f0 con 0x7f303c0039e0 2024-09-17T03:09:10.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.194+0000 7f30574b6640 1 -- 172.21.15.78:0/1811752117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f305014ebb0 con 0x7f303c0039e0 2024-09-17T03:09:10.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.195+0000 7f30574b6640 1 -- 172.21.15.78:0/1811752117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30500d0740 con 0x7f303c0039e0 2024-09-17T03:09:10.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.195+0000 7f3045ffb640 1 -- 172.21.15.78:0/1811752117 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f304c044070 con 0x7f303c0039e0 2024-09-17T03:09:10.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.196+0000 7f3045ffb640 1 --2- 172.21.15.78:0/1811752117 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3034078b90 0x7f303407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:10.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.196+0000 7f3045ffb640 1 -- 172.21.15.78:0/1811752117 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f304c0bbd00 con 0x7f303c0039e0 2024-09-17T03:09:10.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.196+0000 7f3054a51640 1 --2- 172.21.15.78:0/1811752117 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3034078b90 0x7f303407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:10.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.197+0000 7f3054a51640 1 --2- 172.21.15.78:0/1811752117 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3034078b90 0x7f303407b0a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f305009deb0 tx=0x7f3040006b30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:10.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.201+0000 7f3045ffb640 1 -- 172.21.15.78:0/1811752117 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f304c083c10 con 0x7f303c0039e0 2024-09-17T03:09:10.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:10.416+0000 7f30574b6640 1 -- 172.21.15.78:0/1811752117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f30500cb5a0 con 0x7f303c0039e0 2024-09-17T03:09:11.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.064+0000 7f3045ffb640 1 -- 172.21.15.78:0/1811752117 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) ==== 122+0+0 (secure 0 0 0) 0x7f304c088640 con 0x7f303c0039e0 2024-09-17T03:09:11.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.067+0000 7f30574b6640 1 -- 172.21.15.78:0/1811752117 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3034078b90 msgr2=0x7f303407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:11.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.067+0000 7f30574b6640 1 --2- 172.21.15.78:0/1811752117 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3034078b90 0x7f303407b0a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f305009deb0 tx=0x7f3040006b30 comp rx=0 tx=0).stop 2024-09-17T03:09:11.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.067+0000 7f30574b6640 1 -- 172.21.15.78:0/1811752117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c0039e0 msgr2=0x7f305006cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:11.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.067+0000 7f30574b6640 1 --2- 172.21.15.78:0/1811752117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c0039e0 0x7f305006cde0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f304c035040 tx=0x7f304c02b9c0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.067+0000 7f30574b6640 1 -- 172.21.15.78:0/1811752117 shutdown_connections 2024-09-17T03:09:11.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.067+0000 7f30574b6640 1 --2- 172.21.15.78:0/1811752117 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30501f34e0 0x7f30501f38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.067+0000 7f30574b6640 1 --2- 172.21.15.78:0/1811752117 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3034078b90 0x7f303407b0a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.067+0000 7f30574b6640 1 --2- 172.21.15.78:0/1811752117 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f305014c0a0 0x7f305006d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.067+0000 7f30574b6640 1 --2- 172.21.15.78:0/1811752117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c0039e0 0x7f305006cde0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.067+0000 7f30574b6640 1 -- 172.21.15.78:0/1811752117 >> 172.21.15.78:0/1811752117 conn(0x7f30500cdcb0 msgr2=0x7f305015d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:11.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.067+0000 7f30574b6640 1 -- 172.21.15.78:0/1811752117 shutdown_connections 2024-09-17T03:09:11.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.067+0000 7f30574b6640 1 -- 172.21.15.78:0/1811752117 wait complete. 2024-09-17T03:09:11.078 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:09:11.078 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:09:11.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.194+0000 7fb02ce15640 1 -- 172.21.15.78:0/1472148779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0100041c0 msgr2=0x7fb010004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:11.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.194+0000 7fb02ce15640 1 --2- 172.21.15.78:0/1472148779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0100041c0 0x7fb010004800 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb028074550 tx=0x7fb010005830 comp rx=0 tx=0).stop 2024-09-17T03:09:11.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.194+0000 7fb026d9d640 1 -- 172.21.15.78:0/1472148779 reap_dead start 2024-09-17T03:09:11.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.194+0000 7fb02ce15640 1 -- 172.21.15.78:0/1472148779 shutdown_connections 2024-09-17T03:09:11.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.194+0000 7fb02ce15640 1 -- 172.21.15.78:0/1472148779 >> 172.21.15.78:0/1472148779 conn(0x7fb0280b3f10 msgr2=0x7fb0280b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:11.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.194+0000 7fb02ce15640 1 -- 172.21.15.78:0/1472148779 shutdown_connections 2024-09-17T03:09:11.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.194+0000 7fb02ce15640 1 -- 172.21.15.78:0/1472148779 wait complete. 2024-09-17T03:09:11.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.196+0000 7fb02ce15640 1 Processor -- start 2024-09-17T03:09:11.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.196+0000 7fb02ce15640 1 -- start start 2024-09-17T03:09:11.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.197+0000 7fb02ce15640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0100041c0 0x7fb0281f7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:11.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.197+0000 7fb02ce15640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb028159820 0x7fb0281f2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:11.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.197+0000 7fb02ce15640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb0281f2c50 0x7fb0280b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:11.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.197+0000 7fb02ce15640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb0280d0fe0 con 0x7fb028159820 2024-09-17T03:09:11.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.197+0000 7fb02ce15640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb0280d0e60 con 0x7fb0100041c0 2024-09-17T03:09:11.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.197+0000 7fb02ce15640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb0280d1160 con 0x7fb0281f2c50 2024-09-17T03:09:11.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.197+0000 7fb025d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb028159820 0x7fb0281f2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:11.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.197+0000 7fb025d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb028159820 0x7fb0281f2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39340/0 (socket says 172.21.15.78:39340) 2024-09-17T03:09:11.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.197+0000 7fb025d9b640 1 -- 172.21.15.78:0/1974109871 learned_addr learned my addr 172.21.15.78:0/1974109871 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:11.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.197+0000 7fb026d9d640 1 --2- 172.21.15.78:0/1974109871 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb0281f2c50 0x7fb0280b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:11.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.197+0000 7fb025d9b640 1 -- 172.21.15.78:0/1974109871 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb0281f2c50 msgr2=0x7fb0280b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:11.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.197+0000 7fb025d9b640 1 --2- 172.21.15.78:0/1974109871 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb0281f2c50 0x7fb0280b2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.197+0000 7fb025d9b640 1 -- 172.21.15.78:0/1974109871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0100041c0 msgr2=0x7fb0281f7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:11.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.197+0000 7fb02659c640 1 --2- 172.21.15.78:0/1974109871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0100041c0 0x7fb0281f7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:11.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.197+0000 7fb025d9b640 1 --2- 172.21.15.78:0/1974109871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0100041c0 0x7fb0281f7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.197+0000 7fb025d9b640 1 -- 172.21.15.78:0/1974109871 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb028159f50 con 0x7fb028159820 2024-09-17T03:09:11.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.198+0000 7fb025d9b640 1 --2- 172.21.15.78:0/1974109871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb028159820 0x7fb0281f2710 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb01c036040 tx=0x7fb01c033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:11.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.198+0000 7fb016ffd640 1 -- 172.21.15.78:0/1974109871 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c038040 con 0x7fb028159820 2024-09-17T03:09:11.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.198+0000 7fb016ffd640 1 -- 172.21.15.78:0/1974109871 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb01c041070 con 0x7fb028159820 2024-09-17T03:09:11.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.198+0000 7fb02ce15640 1 -- 172.21.15.78:0/1974109871 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0281f32a0 con 0x7fb028159820 2024-09-17T03:09:11.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.198+0000 7fb016ffd640 1 -- 172.21.15.78:0/1974109871 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb01c033d10 con 0x7fb028159820 2024-09-17T03:09:11.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.198+0000 7fb02ce15640 1 -- 172.21.15.78:0/1974109871 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb028157b60 con 0x7fb028159820 2024-09-17T03:09:11.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.199+0000 7fb02ce15640 1 -- 172.21.15.78:0/1974109871 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb028159cc0 con 0x7fb028159820 2024-09-17T03:09:11.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.200+0000 7fb016ffd640 1 -- 172.21.15.78:0/1974109871 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb01c02b820 con 0x7fb028159820 2024-09-17T03:09:11.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.200+0000 7fb016ffd640 1 --2- 172.21.15.78:0/1974109871 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb008078bc0 0x7fb00807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:11.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.200+0000 7fb016ffd640 1 -- 172.21.15.78:0/1974109871 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb01c0bc0e0 con 0x7fb028159820 2024-09-17T03:09:11.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.201+0000 7fb02659c640 1 --2- 172.21.15.78:0/1974109871 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb008078bc0 0x7fb00807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:11.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.201+0000 7fb02659c640 1 --2- 172.21.15.78:0/1974109871 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb008078bc0 0x7fb00807b0d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb018006110 tx=0x7fb018004a70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:11.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.204+0000 7fb016ffd640 1 -- 172.21.15.78:0/1974109871 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb01c084690 con 0x7fb028159820 2024-09-17T03:09:11.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.412+0000 7fb02ce15640 1 -- 172.21.15.78:0/1974109871 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0280d16f0 con 0x7fb028159820 2024-09-17T03:09:11.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.413+0000 7fb016ffd640 1 -- 172.21.15.78:0/1974109871 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5228 (secure 0 0 0) 0x7fb01c083f90 con 0x7fb028159820 2024-09-17T03:09:11.411 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:09:11.412 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":13,"btime":"2024-09-17T03:09:11:060312+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2234221933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2234221933},{"type":"v1","addr":"172.21.15.193:6836","nonce":2234221933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/2343001441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2343001441},{"type":"v1","addr":"172.21.15.193:6837","nonce":2343001441}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4929,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/2730690660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2730690660},{"type":"v1","addr":"172.21.15.78:6833","nonce":2730690660}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:09:08.411464+0000","modified":"2024-09-17T03:09:10.417439+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/2663458793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2663458793},{"type":"v1","addr":"172.21.15.78:6835","nonce":2663458793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4938,"qdb_cluster":[4938]},"id":2}]} 2024-09-17T03:09:11.412 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 13 2024-09-17T03:09:11.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.415+0000 7fb02ce15640 1 -- 172.21.15.78:0/1974109871 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb008078bc0 msgr2=0x7fb00807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:11.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.415+0000 7fb02ce15640 1 --2- 172.21.15.78:0/1974109871 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb008078bc0 0x7fb00807b0d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb018006110 tx=0x7fb018004a70 comp rx=0 tx=0).stop 2024-09-17T03:09:11.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.415+0000 7fb02ce15640 1 -- 172.21.15.78:0/1974109871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb028159820 msgr2=0x7fb0281f2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:11.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.415+0000 7fb02ce15640 1 --2- 172.21.15.78:0/1974109871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb028159820 0x7fb0281f2710 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb01c036040 tx=0x7fb01c033670 comp rx=0 tx=0).stop 2024-09-17T03:09:11.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.415+0000 7fb02ce15640 1 -- 172.21.15.78:0/1974109871 shutdown_connections 2024-09-17T03:09:11.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.415+0000 7fb02ce15640 1 --2- 172.21.15.78:0/1974109871 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb0281f2c50 0x7fb0280b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.415+0000 7fb02ce15640 1 --2- 172.21.15.78:0/1974109871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb028159820 0x7fb0281f2710 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.415+0000 7fb02ce15640 1 --2- 172.21.15.78:0/1974109871 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb008078bc0 0x7fb00807b0d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.415+0000 7fb02ce15640 1 --2- 172.21.15.78:0/1974109871 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0100041c0 0x7fb0281f7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.415+0000 7fb02ce15640 1 -- 172.21.15.78:0/1974109871 >> 172.21.15.78:0/1974109871 conn(0x7fb0280b3f10 msgr2=0x7fb0280cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:11.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.415+0000 7fb02ce15640 1 -- 172.21.15.78:0/1974109871 shutdown_connections 2024-09-17T03:09:11.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.415+0000 7fb02ce15640 1 -- 172.21.15.78:0/1974109871 wait complete. 2024-09-17T03:09:11.425 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:09:11.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.539+0000 7fc37697b640 1 -- 172.21.15.78:0/912950263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3700ccba0 msgr2=0x7fc3700ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:11.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.539+0000 7fc37697b640 1 --2- 172.21.15.78:0/912950263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3700ccba0 0x7fc3700ccfb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc368005fd0 tx=0x7fc36802a940 comp rx=0 tx=0).stop 2024-09-17T03:09:11.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.539+0000 7fc37697b640 1 -- 172.21.15.78:0/912950263 shutdown_connections 2024-09-17T03:09:11.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.539+0000 7fc37697b640 1 --2- 172.21.15.78:0/912950263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3700ccba0 0x7fc3700ccfb0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.539+0000 7fc37697b640 1 -- 172.21.15.78:0/912950263 >> 172.21.15.78:0/912950263 conn(0x7fc3700b3f10 msgr2=0x7fc3700b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:11.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.539+0000 7fc37697b640 1 -- 172.21.15.78:0/912950263 shutdown_connections 2024-09-17T03:09:11.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.539+0000 7fc37697b640 1 -- 172.21.15.78:0/912950263 wait complete. 2024-09-17T03:09:11.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.541+0000 7fc37697b640 1 Processor -- start 2024-09-17T03:09:11.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.541+0000 7fc37697b640 1 -- start start 2024-09-17T03:09:11.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.542+0000 7fc37697b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3700b5210 0x7fc3701565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:11.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.542+0000 7fc37697b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3700ccba0 0x7fc3701ec1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:11.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.542+0000 7fc37697b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc3700d1d40 0x7fc3701f8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:11.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.542+0000 7fc37697b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc3700d1440 con 0x7fc3700b5210 2024-09-17T03:09:11.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.542+0000 7fc37697b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc3700d12c0 con 0x7fc3700ccba0 2024-09-17T03:09:11.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.542+0000 7fc37697b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc3700d15c0 con 0x7fc3700d1d40 2024-09-17T03:09:11.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.542+0000 7fc36ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3700b5210 0x7fc3701565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:11.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.542+0000 7fc36ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3700b5210 0x7fc3701565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39354/0 (socket says 172.21.15.78:39354) 2024-09-17T03:09:11.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.542+0000 7fc36ffff640 1 -- 172.21.15.78:0/2241287485 learned_addr learned my addr 172.21.15.78:0/2241287485 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:11.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.542+0000 7fc36f7fe640 1 --2- 172.21.15.78:0/2241287485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3700ccba0 0x7fc3701ec1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:11.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.542+0000 7fc374f18640 1 --2- 172.21.15.78:0/2241287485 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc3700d1d40 0x7fc3701f8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:11.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.543+0000 7fc36ffff640 1 -- 172.21.15.78:0/2241287485 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc3700d1d40 msgr2=0x7fc3701f8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:11.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.543+0000 7fc36ffff640 1 --2- 172.21.15.78:0/2241287485 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc3700d1d40 0x7fc3701f8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.543+0000 7fc36ffff640 1 -- 172.21.15.78:0/2241287485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3700ccba0 msgr2=0x7fc3701ec1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:11.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.543+0000 7fc36ffff640 1 --2- 172.21.15.78:0/2241287485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3700ccba0 0x7fc3701ec1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.543+0000 7fc36ffff640 1 -- 172.21.15.78:0/2241287485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc370154420 con 0x7fc3700b5210 2024-09-17T03:09:11.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.543+0000 7fc36ffff640 1 --2- 172.21.15.78:0/2241287485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3700b5210 0x7fc3701565c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc36000c400 tx=0x7fc36000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:11.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.543+0000 7fc36cff9640 1 -- 172.21.15.78:0/2241287485 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360011790 con 0x7fc3700b5210 2024-09-17T03:09:11.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.543+0000 7fc36cff9640 1 -- 172.21.15.78:0/2241287485 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc360017070 con 0x7fc3700b5210 2024-09-17T03:09:11.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.543+0000 7fc37697b640 1 -- 172.21.15.78:0/2241287485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3700b10e0 con 0x7fc3700b5210 2024-09-17T03:09:11.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.543+0000 7fc36cff9640 1 -- 172.21.15.78:0/2241287485 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360011ca0 con 0x7fc3700b5210 2024-09-17T03:09:11.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.543+0000 7fc37697b640 1 -- 172.21.15.78:0/2241287485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc37006df20 con 0x7fc3700b5210 2024-09-17T03:09:11.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.544+0000 7fc37697b640 1 -- 172.21.15.78:0/2241287485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3700b0ed0 con 0x7fc3700b5210 2024-09-17T03:09:11.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.545+0000 7fc36cff9640 1 -- 172.21.15.78:0/2241287485 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc36001c460 con 0x7fc3700b5210 2024-09-17T03:09:11.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.545+0000 7fc36cff9640 1 --2- 172.21.15.78:0/2241287485 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc35c078bc0 0x7fc35c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:11.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.545+0000 7fc36cff9640 1 -- 172.21.15.78:0/2241287485 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc36009aa20 con 0x7fc3700b5210 2024-09-17T03:09:11.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.546+0000 7fc36f7fe640 1 --2- 172.21.15.78:0/2241287485 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc35c078bc0 0x7fc35c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:11.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.546+0000 7fc36f7fe640 1 --2- 172.21.15.78:0/2241287485 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc35c078bc0 0x7fc35c07b0d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc370157d40 tx=0x7fc364009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:11.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.550+0000 7fc36cff9640 1 -- 172.21.15.78:0/2241287485 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc3700cd4f0 con 0x7fc3700b5210 2024-09-17T03:09:11.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.726+0000 7fc37697b640 1 -- 172.21.15.78:0/2241287485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc3700ccfb0 con 0x7fc3700b5210 2024-09-17T03:09:11.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.727+0000 7fc36cff9640 1 -- 172.21.15.78:0/2241287485 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16705 (secure 0 0 0) 0x7fc360062810 con 0x7fc3700b5210 2024-09-17T03:09:11.726 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:09:11.726 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":34,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:09:10.053417+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:09:06.055293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T03:09:07.368417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:09:11.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.729+0000 7fc37697b640 1 -- 172.21.15.78:0/2241287485 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc35c078bc0 msgr2=0x7fc35c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:11.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.729+0000 7fc37697b640 1 --2- 172.21.15.78:0/2241287485 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc35c078bc0 0x7fc35c07b0d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc370157d40 tx=0x7fc364009040 comp rx=0 tx=0).stop 2024-09-17T03:09:11.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.729+0000 7fc37697b640 1 -- 172.21.15.78:0/2241287485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3700b5210 msgr2=0x7fc3701565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:11.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.729+0000 7fc37697b640 1 --2- 172.21.15.78:0/2241287485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3700b5210 0x7fc3701565c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc36000c400 tx=0x7fc36000c8c0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.729+0000 7fc37697b640 1 -- 172.21.15.78:0/2241287485 shutdown_connections 2024-09-17T03:09:11.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.729+0000 7fc37697b640 1 --2- 172.21.15.78:0/2241287485 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc3700d1d40 0x7fc3701f8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.729+0000 7fc37697b640 1 --2- 172.21.15.78:0/2241287485 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc35c078bc0 0x7fc35c07b0d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.729+0000 7fc37697b640 1 --2- 172.21.15.78:0/2241287485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc3700ccba0 0x7fc3701ec1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.729+0000 7fc37697b640 1 --2- 172.21.15.78:0/2241287485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc3700b5210 0x7fc3701565c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.729+0000 7fc37697b640 1 -- 172.21.15.78:0/2241287485 >> 172.21.15.78:0/2241287485 conn(0x7fc3700b3f10 msgr2=0x7fc3700cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:11.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.729+0000 7fc37697b640 1 -- 172.21.15.78:0/2241287485 shutdown_connections 2024-09-17T03:09:11.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.729+0000 7fc37697b640 1 -- 172.21.15.78:0/2241287485 wait complete. 2024-09-17T03:09:11.740 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:09:11.740 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:09:11.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.853+0000 7f52efebd640 1 -- 172.21.15.78:0/1370757135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52e80b4110 msgr2=0x7f52e80b4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:11.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.853+0000 7f52efebd640 1 --2- 172.21.15.78:0/1370757135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52e80b4110 0x7f52e80b4520 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f52d8005fd0 tx=0x7f52d802a540 comp rx=0 tx=0).stop 2024-09-17T03:09:11.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.853+0000 7f52efebd640 1 -- 172.21.15.78:0/1370757135 shutdown_connections 2024-09-17T03:09:11.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.853+0000 7f52efebd640 1 --2- 172.21.15.78:0/1370757135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52e80b4110 0x7f52e80b4520 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.853+0000 7f52efebd640 1 -- 172.21.15.78:0/1370757135 >> 172.21.15.78:0/1370757135 conn(0x7f52e806def0 msgr2=0x7f52e806e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:11.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.853+0000 7f52efebd640 1 -- 172.21.15.78:0/1370757135 shutdown_connections 2024-09-17T03:09:11.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.853+0000 7f52efebd640 1 -- 172.21.15.78:0/1370757135 wait complete. 2024-09-17T03:09:11.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.855+0000 7f52efebd640 1 Processor -- start 2024-09-17T03:09:11.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.855+0000 7f52efebd640 1 -- start start 2024-09-17T03:09:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.856+0000 7f52efebd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52e806cde0 0x7f52e81e7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.856+0000 7f52efebd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52e80b4110 0x7f52e80d1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.856+0000 7f52efebd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52e81559b0 0x7f52e8143cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.856+0000 7f52efebd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f52e8074b60 con 0x7f52e806cde0 2024-09-17T03:09:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.856+0000 7f52efebd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f52e80749e0 con 0x7f52e81559b0 2024-09-17T03:09:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.856+0000 7f52efebd640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f52e8074ce0 con 0x7f52e80b4110 2024-09-17T03:09:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.857+0000 7f52edc59640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52e806cde0 0x7f52e81e7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:11.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.857+0000 7f52edc59640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52e806cde0 0x7f52e81e7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39372/0 (socket says 172.21.15.78:39372) 2024-09-17T03:09:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.857+0000 7f52edc59640 1 -- 172.21.15.78:0/759303839 learned_addr learned my addr 172.21.15.78:0/759303839 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.857+0000 7f52ee45a640 1 --2- 172.21.15.78:0/759303839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52e81559b0 0x7f52e8143cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.857+0000 7f52ed458640 1 --2- 172.21.15.78:0/759303839 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52e80b4110 0x7f52e80d1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.857+0000 7f52edc59640 1 -- 172.21.15.78:0/759303839 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52e80b4110 msgr2=0x7f52e80d1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.857+0000 7f52edc59640 1 --2- 172.21.15.78:0/759303839 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52e80b4110 0x7f52e80d1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.857+0000 7f52edc59640 1 -- 172.21.15.78:0/759303839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52e81559b0 msgr2=0x7f52e8143cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.857+0000 7f52edc59640 1 --2- 172.21.15.78:0/759303839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52e81559b0 0x7f52e8143cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.857+0000 7f52edc59640 1 -- 172.21.15.78:0/759303839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e80d0ab0 con 0x7f52e806cde0 2024-09-17T03:09:11.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.857+0000 7f52ee45a640 1 --2- 172.21.15.78:0/759303839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52e81559b0 0x7f52e8143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:11.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.857+0000 7f52edc59640 1 --2- 172.21.15.78:0/759303839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52e806cde0 0x7f52e81e7100 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f52e400b3f0 tx=0x7f52e400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:11.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.857+0000 7f52de7fc640 1 -- 172.21.15.78:0/759303839 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e4015020 con 0x7f52e806cde0 2024-09-17T03:09:11.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.857+0000 7f52de7fc640 1 -- 172.21.15.78:0/759303839 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52e4011920 con 0x7f52e806cde0 2024-09-17T03:09:11.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.857+0000 7f52efebd640 1 -- 172.21.15.78:0/759303839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e80d0d90 con 0x7f52e806cde0 2024-09-17T03:09:11.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.857+0000 7f52de7fc640 1 -- 172.21.15.78:0/759303839 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e4011d70 con 0x7f52e806cde0 2024-09-17T03:09:11.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.857+0000 7f52efebd640 1 -- 172.21.15.78:0/759303839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e80d1350 con 0x7f52e806cde0 2024-09-17T03:09:11.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.858+0000 7f52efebd640 1 -- 172.21.15.78:0/759303839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52e80b4520 con 0x7f52e806cde0 2024-09-17T03:09:11.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.859+0000 7f52de7fc640 1 -- 172.21.15.78:0/759303839 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f52e4018020 con 0x7f52e806cde0 2024-09-17T03:09:11.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.860+0000 7f52de7fc640 1 --2- 172.21.15.78:0/759303839 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f52cc078b90 0x7f52cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:11.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.860+0000 7f52de7fc640 1 -- 172.21.15.78:0/759303839 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f52e409acd0 con 0x7f52e806cde0 2024-09-17T03:09:11.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.860+0000 7f52ed458640 1 --2- 172.21.15.78:0/759303839 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f52cc078b90 0x7f52cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:11.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.860+0000 7f52ed458640 1 --2- 172.21.15.78:0/759303839 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f52cc078b90 0x7f52cc07b0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f52d8033000 tx=0x7f52d8004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:11.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:11.864+0000 7f52de7fc640 1 -- 172.21.15.78:0/759303839 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f52e401f020 con 0x7f52e806cde0 2024-09-17T03:09:12.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.036+0000 7f52efebd640 1 -- 172.21.15.78:0/759303839 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f52e8070660 con 0x7f52cc078b90 2024-09-17T03:09:12.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.040+0000 7f52de7fc640 1 -- 172.21.15.78:0/759303839 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238790 (secure 0 0 0) 0x7f52e8070660 con 0x7f52cc078b90 2024-09-17T03:09:12.042 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:09:12.043 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:09:12.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.043+0000 7f52efebd640 1 -- 172.21.15.78:0/759303839 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f52cc078b90 msgr2=0x7f52cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:12.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.043+0000 7f52efebd640 1 --2- 172.21.15.78:0/759303839 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f52cc078b90 0x7f52cc07b0a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f52d8033000 tx=0x7f52d8004730 comp rx=0 tx=0).stop 2024-09-17T03:09:12.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.043+0000 7f52efebd640 1 -- 172.21.15.78:0/759303839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52e806cde0 msgr2=0x7f52e81e7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:12.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.043+0000 7f52efebd640 1 --2- 172.21.15.78:0/759303839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52e806cde0 0x7f52e81e7100 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f52e400b3f0 tx=0x7f52e400b8b0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.043+0000 7f52efebd640 1 -- 172.21.15.78:0/759303839 shutdown_connections 2024-09-17T03:09:12.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.043+0000 7f52efebd640 1 --2- 172.21.15.78:0/759303839 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f52cc078b90 0x7f52cc07b0a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.043+0000 7f52efebd640 1 --2- 172.21.15.78:0/759303839 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52e81559b0 0x7f52e8143cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.043+0000 7f52efebd640 1 --2- 172.21.15.78:0/759303839 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52e80b4110 0x7f52e80d1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.043+0000 7f52efebd640 1 --2- 172.21.15.78:0/759303839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52e806cde0 0x7f52e81e7100 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.043+0000 7f52efebd640 1 -- 172.21.15.78:0/759303839 >> 172.21.15.78:0/759303839 conn(0x7f52e806def0 msgr2=0x7f52e806d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:12.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.043+0000 7f52efebd640 1 -- 172.21.15.78:0/759303839 shutdown_connections 2024-09-17T03:09:12.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.043+0000 7f52efebd640 1 -- 172.21.15.78:0/759303839 wait complete. 2024-09-17T03:09:12.053 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-17T03:09:11.127984+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":36,"acting":36,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":224160,"kb_used_data":3732,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750560,"statfs":{"total":773094113280,"available":772864573440,"internally_reserved":0,"allocated":3821568,"data_stored":2147673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.094044"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.052252+0000","last_change":"2024-09-17T03:09:08.052252+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.052252+0000","last_undegraded":"2024-09-17T03:09:08.052252+0000","last_fullsized":"2024-09-17T03:09:08.052252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.052691+0000","last_change":"2024-09-17T03:09:08.052691+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.052691+0000","last_undegraded":"2024-09-17T03:09:08.052691+0000","last_fullsized":"2024-09-17T03:09:08.052691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.050502+0000","last_change":"2024-09-17T03:09:08.050502+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.050502+0000","last_undegraded":"2024-09-17T03:09:08.050502+0000","last_fullsized":"2024-09-17T03:09:08.050502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.051070+0000","last_change":"2024-09-17T03:09:08.051070+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.051070+0000","last_undegraded":"2024-09-17T03:09:08.051070+0000","last_fullsized":"2024-09-17T03:09:08.051070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.048645+0000","last_change":"2024-09-17T03:09:08.048645+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.048645+0000","last_undegraded":"2024-09-17T03:09:08.048645+0000","last_fullsized":"2024-09-17T03:09:08.048645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.048203+0000","last_change":"2024-09-17T03:09:08.048203+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.048203+0000","last_undegraded":"2024-09-17T03:09:08.048203+0000","last_fullsized":"2024-09-17T03:09:08.048203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.065314+0000","last_change":"2024-09-17T03:09:08.063470+0000","last_active":"2024-09-17T03:09:08.065314+0000","last_peered":"2024-09-17T03:09:08.065314+0000","last_clean":"2024-09-17T03:09:08.065314+0000","last_became_active":"2024-09-17T03:09:08.063167+0000","last_became_peered":"2024-09-17T03:09:08.063167+0000","last_unstale":"2024-09-17T03:09:08.065314+0000","last_undegraded":"2024-09-17T03:09:08.065314+0000","last_fullsized":"2024-09-17T03:09:08.065314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:41.473395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.062444+0000","last_change":"2024-09-17T03:09:08.056853+0000","last_active":"2024-09-17T03:09:08.062444+0000","last_peered":"2024-09-17T03:09:08.062444+0000","last_clean":"2024-09-17T03:09:08.062444+0000","last_became_active":"2024-09-17T03:09:08.055877+0000","last_became_peered":"2024-09-17T03:09:08.055877+0000","last_unstale":"2024-09-17T03:09:08.062444+0000","last_undegraded":"2024-09-17T03:09:08.062444+0000","last_fullsized":"2024-09-17T03:09:08.062444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:54.777021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.063712+0000","last_change":"2024-09-17T03:09:08.060540+0000","last_active":"2024-09-17T03:09:08.063712+0000","last_peered":"2024-09-17T03:09:08.063712+0000","last_clean":"2024-09-17T03:09:08.063712+0000","last_became_active":"2024-09-17T03:09:08.060242+0000","last_became_peered":"2024-09-17T03:09:08.060242+0000","last_unstale":"2024-09-17T03:09:08.063712+0000","last_undegraded":"2024-09-17T03:09:08.063712+0000","last_fullsized":"2024-09-17T03:09:08.063712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:30.592642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.048265+0000","last_change":"2024-09-17T03:09:08.048265+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.048265+0000","last_undegraded":"2024-09-17T03:09:08.048265+0000","last_fullsized":"2024-09-17T03:09:08.048265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.047493+0000","last_change":"2024-09-17T03:09:08.047493+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.047493+0000","last_undegraded":"2024-09-17T03:09:08.047493+0000","last_fullsized":"2024-09-17T03:09:08.047493+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.066079+0000","last_change":"2024-09-17T03:09:08.064681+0000","last_active":"2024-09-17T03:09:08.066079+0000","last_peered":"2024-09-17T03:09:08.066079+0000","last_clean":"2024-09-17T03:09:08.066079+0000","last_became_active":"2024-09-17T03:09:08.064261+0000","last_became_peered":"2024-09-17T03:09:08.064261+0000","last_unstale":"2024-09-17T03:09:08.066079+0000","last_undegraded":"2024-09-17T03:09:08.066079+0000","last_fullsized":"2024-09-17T03:09:08.066079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:09.600555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.048426+0000","last_change":"2024-09-17T03:09:08.048426+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.048426+0000","last_undegraded":"2024-09-17T03:09:08.048426+0000","last_fullsized":"2024-09-17T03:09:08.048426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.063739+0000","last_change":"2024-09-17T03:09:08.061406+0000","last_active":"2024-09-17T03:09:08.063739+0000","last_peered":"2024-09-17T03:09:08.063739+0000","last_clean":"2024-09-17T03:09:08.063739+0000","last_became_active":"2024-09-17T03:09:08.061113+0000","last_became_peered":"2024-09-17T03:09:08.061113+0000","last_unstale":"2024-09-17T03:09:08.063739+0000","last_undegraded":"2024-09-17T03:09:08.063739+0000","last_fullsized":"2024-09-17T03:09:08.063739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:42.509000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.065280+0000","last_change":"2024-09-17T03:09:08.063624+0000","last_active":"2024-09-17T03:09:08.065280+0000","last_peered":"2024-09-17T03:09:08.065280+0000","last_clean":"2024-09-17T03:09:08.065280+0000","last_became_active":"2024-09-17T03:09:08.063309+0000","last_became_peered":"2024-09-17T03:09:08.063309+0000","last_unstale":"2024-09-17T03:09:08.065280+0000","last_undegraded":"2024-09-17T03:09:08.065280+0000","last_fullsized":"2024-09-17T03:09:08.065280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:24.663278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.047509+0000","last_change":"2024-09-17T03:09:08.047509+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.047509+0000","last_undegraded":"2024-09-17T03:09:08.047509+0000","last_fullsized":"2024-09-17T03:09:08.047509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.065164+0000","last_change":"2024-09-17T03:09:08.062609+0000","last_active":"2024-09-17T03:09:08.065164+0000","last_peered":"2024-09-17T03:09:08.065164+0000","last_clean":"2024-09-17T03:09:08.065164+0000","last_became_active":"2024-09-17T03:09:08.062155+0000","last_became_peered":"2024-09-17T03:09:08.062155+0000","last_unstale":"2024-09-17T03:09:08.065164+0000","last_undegraded":"2024-09-17T03:09:08.065164+0000","last_fullsized":"2024-09-17T03:09:08.065164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:27.472946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":122,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T03:09:03.346572+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:09:03.346572+0000","last_peered":"2024-09-17T03:09:03.346572+0000","last_clean":"2024-09-17T03:09:03.346572+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:09:03.346572+0000","last_undegraded":"2024-09-17T03:09:03.346572+0000","last_fullsized":"2024-09-17T03:09:03.346572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":921600,"data_stored":710508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27368,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":327680,"data_stored":120140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27360,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":327680,"data_stored":120140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27356,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":327680,"data_stored":120140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":710508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":339968,"data_stored":125957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:09:12.057 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:09:12.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.208+0000 7fdbddf19640 1 -- 172.21.15.78:0/607550408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc4004d40 msgr2=0x7fdbc4005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:12.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.208+0000 7fdbddf19640 1 --2- 172.21.15.78:0/607550408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc4004d40 0x7fdbc4005150 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80b2bd0 tx=0x7fdbc4005830 comp rx=0 tx=0).stop 2024-09-17T03:09:12.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.208+0000 7fdbd7fff640 1 -- 172.21.15.78:0/607550408 reap_dead start 2024-09-17T03:09:12.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.208+0000 7fdbddf19640 1 -- 172.21.15.78:0/607550408 shutdown_connections 2024-09-17T03:09:12.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.208+0000 7fdbddf19640 1 -- 172.21.15.78:0/607550408 >> 172.21.15.78:0/607550408 conn(0x7fdbd806d7d0 msgr2=0x7fdbd80b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:12.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.208+0000 7fdbddf19640 1 -- 172.21.15.78:0/607550408 shutdown_connections 2024-09-17T03:09:12.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.208+0000 7fdbddf19640 1 -- 172.21.15.78:0/607550408 wait complete. 2024-09-17T03:09:12.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.210+0000 7fdbddf19640 1 Processor -- start 2024-09-17T03:09:12.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.210+0000 7fdbddf19640 1 -- start start 2024-09-17T03:09:12.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.211+0000 7fdbddf19640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdbc4004d40 0x7fdbd8146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:12.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.211+0000 7fdbddf19640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdbd81f65f0 0x7fdbd81f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:12.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.211+0000 7fdbddf19640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbd81f6f40 0x7fdbd8148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:12.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.211+0000 7fdbddf19640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd80ccbc0 con 0x7fdbd81f6f40 2024-09-17T03:09:12.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.211+0000 7fdbddf19640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdbd80709b0 con 0x7fdbc4004d40 2024-09-17T03:09:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.211+0000 7fdbddf19640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fdbd80ccd40 con 0x7fdbd81f65f0 2024-09-17T03:09:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.211+0000 7fdbd7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbd81f6f40 0x7fdbd8148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.211+0000 7fdbd7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbd81f6f40 0x7fdbd8148bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39394/0 (socket says 172.21.15.78:39394) 2024-09-17T03:09:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.211+0000 7fdbd7fff640 1 -- 172.21.15.78:0/446868556 learned_addr learned my addr 172.21.15.78:0/446868556 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.211+0000 7fdbd6ffd640 1 --2- 172.21.15.78:0/446868556 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdbd81f65f0 0x7fdbd81f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.212+0000 7fdbd77fe640 1 --2- 172.21.15.78:0/446868556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdbc4004d40 0x7fdbd8146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.212+0000 7fdbd7fff640 1 -- 172.21.15.78:0/446868556 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdbd81f65f0 msgr2=0x7fdbd81f6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.212+0000 7fdbd7fff640 1 --2- 172.21.15.78:0/446868556 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdbd81f65f0 0x7fdbd81f6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.212+0000 7fdbd7fff640 1 -- 172.21.15.78:0/446868556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdbc4004d40 msgr2=0x7fdbd8146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.212+0000 7fdbd7fff640 1 --2- 172.21.15.78:0/446868556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdbc4004d40 0x7fdbd8146320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.212+0000 7fdbd7fff640 1 -- 172.21.15.78:0/446868556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbd8146c10 con 0x7fdbd81f6f40 2024-09-17T03:09:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.212+0000 7fdbd7fff640 1 --2- 172.21.15.78:0/446868556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbd81f6f40 0x7fdbd8148bc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0005fd0 tx=0x7fdbd000ab20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.212+0000 7fdbcffff640 1 -- 172.21.15.78:0/446868556 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0039040 con 0x7fdbd81f6f40 2024-09-17T03:09:12.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.212+0000 7fdbcffff640 1 -- 172.21.15.78:0/446868556 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbd0004b20 con 0x7fdbd81f6f40 2024-09-17T03:09:12.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.212+0000 7fdbddf19640 1 -- 172.21.15.78:0/446868556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbd8146860 con 0x7fdbd81f6f40 2024-09-17T03:09:12.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.212+0000 7fdbcffff640 1 -- 172.21.15.78:0/446868556 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd000a310 con 0x7fdbd81f6f40 2024-09-17T03:09:12.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.212+0000 7fdbddf19640 1 -- 172.21.15.78:0/446868556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbd809cd50 con 0x7fdbd81f6f40 2024-09-17T03:09:12.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.213+0000 7fdbddf19640 1 -- 172.21.15.78:0/446868556 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbd809c7e0 con 0x7fdbd81f6f40 2024-09-17T03:09:12.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.214+0000 7fdbcffff640 1 -- 172.21.15.78:0/446868556 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdbd0046030 con 0x7fdbd81f6f40 2024-09-17T03:09:12.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.214+0000 7fdbcffff640 1 --2- 172.21.15.78:0/446868556 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdbb8078b90 0x7fdbb807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:12.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.214+0000 7fdbcffff640 1 -- 172.21.15.78:0/446868556 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fdbd00bbb00 con 0x7fdbd81f6f40 2024-09-17T03:09:12.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.214+0000 7fdbd77fe640 1 --2- 172.21.15.78:0/446868556 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdbb8078b90 0x7fdbb807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:12.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.215+0000 7fdbd77fe640 1 --2- 172.21.15.78:0/446868556 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdbb8078b90 0x7fdbb807b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009cd0 tx=0x7fdbc8005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:12.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.219+0000 7fdbcffff640 1 -- 172.21.15.78:0/446868556 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdbd004d060 con 0x7fdbd81f6f40 2024-09-17T03:09:12.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.391+0000 7fdbddf19640 1 -- 172.21.15.78:0/446868556 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdbd80b4d90 con 0x7fdbb8078b90 2024-09-17T03:09:12.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.395+0000 7fdbcffff640 1 -- 172.21.15.78:0/446868556 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238790 (secure 0 0 0) 0x7fdbc805b4e0 con 0x7fdbb8078b90 2024-09-17T03:09:12.396 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:09:12.397 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:09:12.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.398+0000 7fdbddf19640 1 -- 172.21.15.78:0/446868556 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdbb8078b90 msgr2=0x7fdbb807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:12.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.398+0000 7fdbddf19640 1 --2- 172.21.15.78:0/446868556 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdbb8078b90 0x7fdbb807b0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009cd0 tx=0x7fdbc8005f90 comp rx=0 tx=0).stop 2024-09-17T03:09:12.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.398+0000 7fdbddf19640 1 -- 172.21.15.78:0/446868556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbd81f6f40 msgr2=0x7fdbd8148bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:12.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.398+0000 7fdbddf19640 1 --2- 172.21.15.78:0/446868556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbd81f6f40 0x7fdbd8148bc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0005fd0 tx=0x7fdbd000ab20 comp rx=0 tx=0).stop 2024-09-17T03:09:12.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.398+0000 7fdbddf19640 1 -- 172.21.15.78:0/446868556 shutdown_connections 2024-09-17T03:09:12.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.398+0000 7fdbddf19640 1 --2- 172.21.15.78:0/446868556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbd81f6f40 0x7fdbd8148bc0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.398+0000 7fdbddf19640 1 --2- 172.21.15.78:0/446868556 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdbd81f65f0 0x7fdbd81f6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.398+0000 7fdbddf19640 1 --2- 172.21.15.78:0/446868556 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdbb8078b90 0x7fdbb807b0a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.398+0000 7fdbddf19640 1 --2- 172.21.15.78:0/446868556 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdbc4004d40 0x7fdbd8146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.398+0000 7fdbddf19640 1 -- 172.21.15.78:0/446868556 >> 172.21.15.78:0/446868556 conn(0x7fdbd806d7d0 msgr2=0x7fdbd8073420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:12.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.399+0000 7fdbddf19640 1 -- 172.21.15.78:0/446868556 shutdown_connections 2024-09-17T03:09:12.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.399+0000 7fdbddf19640 1 -- 172.21.15.78:0/446868556 wait complete. 2024-09-17T03:09:12.408 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-17T03:09:11.127984+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":36,"acting":36,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":224160,"kb_used_data":3732,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750560,"statfs":{"total":773094113280,"available":772864573440,"internally_reserved":0,"allocated":3821568,"data_stored":2147673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.094044"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.052252+0000","last_change":"2024-09-17T03:09:08.052252+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.052252+0000","last_undegraded":"2024-09-17T03:09:08.052252+0000","last_fullsized":"2024-09-17T03:09:08.052252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.052691+0000","last_change":"2024-09-17T03:09:08.052691+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.052691+0000","last_undegraded":"2024-09-17T03:09:08.052691+0000","last_fullsized":"2024-09-17T03:09:08.052691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.050502+0000","last_change":"2024-09-17T03:09:08.050502+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.050502+0000","last_undegraded":"2024-09-17T03:09:08.050502+0000","last_fullsized":"2024-09-17T03:09:08.050502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.051070+0000","last_change":"2024-09-17T03:09:08.051070+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.051070+0000","last_undegraded":"2024-09-17T03:09:08.051070+0000","last_fullsized":"2024-09-17T03:09:08.051070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.048645+0000","last_change":"2024-09-17T03:09:08.048645+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.048645+0000","last_undegraded":"2024-09-17T03:09:08.048645+0000","last_fullsized":"2024-09-17T03:09:08.048645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.048203+0000","last_change":"2024-09-17T03:09:08.048203+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.048203+0000","last_undegraded":"2024-09-17T03:09:08.048203+0000","last_fullsized":"2024-09-17T03:09:08.048203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.065314+0000","last_change":"2024-09-17T03:09:08.063470+0000","last_active":"2024-09-17T03:09:08.065314+0000","last_peered":"2024-09-17T03:09:08.065314+0000","last_clean":"2024-09-17T03:09:08.065314+0000","last_became_active":"2024-09-17T03:09:08.063167+0000","last_became_peered":"2024-09-17T03:09:08.063167+0000","last_unstale":"2024-09-17T03:09:08.065314+0000","last_undegraded":"2024-09-17T03:09:08.065314+0000","last_fullsized":"2024-09-17T03:09:08.065314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:41.473395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.062444+0000","last_change":"2024-09-17T03:09:08.056853+0000","last_active":"2024-09-17T03:09:08.062444+0000","last_peered":"2024-09-17T03:09:08.062444+0000","last_clean":"2024-09-17T03:09:08.062444+0000","last_became_active":"2024-09-17T03:09:08.055877+0000","last_became_peered":"2024-09-17T03:09:08.055877+0000","last_unstale":"2024-09-17T03:09:08.062444+0000","last_undegraded":"2024-09-17T03:09:08.062444+0000","last_fullsized":"2024-09-17T03:09:08.062444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:54.777021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.063712+0000","last_change":"2024-09-17T03:09:08.060540+0000","last_active":"2024-09-17T03:09:08.063712+0000","last_peered":"2024-09-17T03:09:08.063712+0000","last_clean":"2024-09-17T03:09:08.063712+0000","last_became_active":"2024-09-17T03:09:08.060242+0000","last_became_peered":"2024-09-17T03:09:08.060242+0000","last_unstale":"2024-09-17T03:09:08.063712+0000","last_undegraded":"2024-09-17T03:09:08.063712+0000","last_fullsized":"2024-09-17T03:09:08.063712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:30.592642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.048265+0000","last_change":"2024-09-17T03:09:08.048265+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.048265+0000","last_undegraded":"2024-09-17T03:09:08.048265+0000","last_fullsized":"2024-09-17T03:09:08.048265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.047493+0000","last_change":"2024-09-17T03:09:08.047493+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.047493+0000","last_undegraded":"2024-09-17T03:09:08.047493+0000","last_fullsized":"2024-09-17T03:09:08.047493+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.066079+0000","last_change":"2024-09-17T03:09:08.064681+0000","last_active":"2024-09-17T03:09:08.066079+0000","last_peered":"2024-09-17T03:09:08.066079+0000","last_clean":"2024-09-17T03:09:08.066079+0000","last_became_active":"2024-09-17T03:09:08.064261+0000","last_became_peered":"2024-09-17T03:09:08.064261+0000","last_unstale":"2024-09-17T03:09:08.066079+0000","last_undegraded":"2024-09-17T03:09:08.066079+0000","last_fullsized":"2024-09-17T03:09:08.066079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:09.600555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.048426+0000","last_change":"2024-09-17T03:09:08.048426+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.048426+0000","last_undegraded":"2024-09-17T03:09:08.048426+0000","last_fullsized":"2024-09-17T03:09:08.048426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.063739+0000","last_change":"2024-09-17T03:09:08.061406+0000","last_active":"2024-09-17T03:09:08.063739+0000","last_peered":"2024-09-17T03:09:08.063739+0000","last_clean":"2024-09-17T03:09:08.063739+0000","last_became_active":"2024-09-17T03:09:08.061113+0000","last_became_peered":"2024-09-17T03:09:08.061113+0000","last_unstale":"2024-09-17T03:09:08.063739+0000","last_undegraded":"2024-09-17T03:09:08.063739+0000","last_fullsized":"2024-09-17T03:09:08.063739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:42.509000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.065280+0000","last_change":"2024-09-17T03:09:08.063624+0000","last_active":"2024-09-17T03:09:08.065280+0000","last_peered":"2024-09-17T03:09:08.065280+0000","last_clean":"2024-09-17T03:09:08.065280+0000","last_became_active":"2024-09-17T03:09:08.063309+0000","last_became_peered":"2024-09-17T03:09:08.063309+0000","last_unstale":"2024-09-17T03:09:08.065280+0000","last_undegraded":"2024-09-17T03:09:08.065280+0000","last_fullsized":"2024-09-17T03:09:08.065280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:24.663278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.047509+0000","last_change":"2024-09-17T03:09:08.047509+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.047509+0000","last_undegraded":"2024-09-17T03:09:08.047509+0000","last_fullsized":"2024-09-17T03:09:08.047509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.065164+0000","last_change":"2024-09-17T03:09:08.062609+0000","last_active":"2024-09-17T03:09:08.065164+0000","last_peered":"2024-09-17T03:09:08.065164+0000","last_clean":"2024-09-17T03:09:08.065164+0000","last_became_active":"2024-09-17T03:09:08.062155+0000","last_became_peered":"2024-09-17T03:09:08.062155+0000","last_unstale":"2024-09-17T03:09:08.065164+0000","last_undegraded":"2024-09-17T03:09:08.065164+0000","last_fullsized":"2024-09-17T03:09:08.065164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:27.472946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":122,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T03:09:03.346572+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:09:03.346572+0000","last_peered":"2024-09-17T03:09:03.346572+0000","last_clean":"2024-09-17T03:09:03.346572+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:09:03.346572+0000","last_undegraded":"2024-09-17T03:09:03.346572+0000","last_fullsized":"2024-09-17T03:09:03.346572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":921600,"data_stored":710508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27368,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":327680,"data_stored":120140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27360,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":327680,"data_stored":120140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27356,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":327680,"data_stored":120140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":710508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":339968,"data_stored":125957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:09:12.412 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:09:12.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.562+0000 7fef1f713640 1 -- 172.21.15.78:0/329933105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef180cd3e0 msgr2=0x7fef18070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:12.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.562+0000 7fef1f713640 1 --2- 172.21.15.78:0/329933105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef180cd3e0 0x7fef18070180 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fef0c005fd0 tx=0x7fef0c02a4a0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.562+0000 7fef1f713640 1 -- 172.21.15.78:0/329933105 shutdown_connections 2024-09-17T03:09:12.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.562+0000 7fef1f713640 1 --2- 172.21.15.78:0/329933105 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fef180706c0 0x7fef18072ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.562+0000 7fef1f713640 1 --2- 172.21.15.78:0/329933105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef180cd3e0 0x7fef18070180 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.562+0000 7fef1f713640 1 -- 172.21.15.78:0/329933105 >> 172.21.15.78:0/329933105 conn(0x7fef1806d7d0 msgr2=0x7fef180b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:12.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.562+0000 7fef1f713640 1 -- 172.21.15.78:0/329933105 shutdown_connections 2024-09-17T03:09:12.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.562+0000 7fef1f713640 1 -- 172.21.15.78:0/329933105 wait complete. 2024-09-17T03:09:12.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.564+0000 7fef1f713640 1 Processor -- start 2024-09-17T03:09:12.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.564+0000 7fef1f713640 1 -- start start 2024-09-17T03:09:12.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.565+0000 7fef1f713640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef180706c0 0x7fef181f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:12.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.565+0000 7fef1f713640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef180af780 0x7fef1814cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:12.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.565+0000 7fef1f713640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fef180cd3e0 0x7fef1815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:12.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.565+0000 7fef1f713640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fef18073b80 con 0x7fef180af780 2024-09-17T03:09:12.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.565+0000 7fef1f713640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fef18073a00 con 0x7fef180706c0 2024-09-17T03:09:12.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.565+0000 7fef1f713640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fef1809c4d0 con 0x7fef180cd3e0 2024-09-17T03:09:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.565+0000 7fef1ccae640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef180af780 0x7fef1814cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.565+0000 7fef1ccae640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef180af780 0x7fef1814cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39418/0 (socket says 172.21.15.78:39418) 2024-09-17T03:09:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.565+0000 7fef1ccae640 1 -- 172.21.15.78:0/3425498606 learned_addr learned my addr 172.21.15.78:0/3425498606 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.565+0000 7fef1d4af640 1 --2- 172.21.15.78:0/3425498606 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef180706c0 0x7fef181f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.565+0000 7fef1dcb0640 1 --2- 172.21.15.78:0/3425498606 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fef180cd3e0 0x7fef1815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.565+0000 7fef1ccae640 1 -- 172.21.15.78:0/3425498606 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fef180cd3e0 msgr2=0x7fef1815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.565+0000 7fef1ccae640 1 --2- 172.21.15.78:0/3425498606 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fef180cd3e0 0x7fef1815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.565+0000 7fef1ccae640 1 -- 172.21.15.78:0/3425498606 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef180706c0 msgr2=0x7fef181f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.565+0000 7fef1ccae640 1 --2- 172.21.15.78:0/3425498606 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef180706c0 0x7fef181f33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.565+0000 7fef1ccae640 1 -- 172.21.15.78:0/3425498606 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef181f3c00 con 0x7fef180af780 2024-09-17T03:09:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.565+0000 7fef1dcb0640 1 --2- 172.21.15.78:0/3425498606 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fef180cd3e0 0x7fef1815cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:09:12.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.566+0000 7fef1ccae640 1 --2- 172.21.15.78:0/3425498606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef180af780 0x7fef1814cb00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fef0c034040 tx=0x7fef0c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:12.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.566+0000 7fef15ffb640 1 -- 172.21.15.78:0/3425498606 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c03e030 con 0x7fef180af780 2024-09-17T03:09:12.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.566+0000 7fef15ffb640 1 -- 172.21.15.78:0/3425498606 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef0c0047a0 con 0x7fef180af780 2024-09-17T03:09:12.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.566+0000 7fef15ffb640 1 -- 172.21.15.78:0/3425498606 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0c035040 con 0x7fef180af780 2024-09-17T03:09:12.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.566+0000 7fef1f713640 1 -- 172.21.15.78:0/3425498606 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef181f3ee0 con 0x7fef180af780 2024-09-17T03:09:12.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.566+0000 7fef1f713640 1 -- 172.21.15.78:0/3425498606 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef1809ac40 con 0x7fef180af780 2024-09-17T03:09:12.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.567+0000 7fef1f713640 1 -- 172.21.15.78:0/3425498606 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef181f3970 con 0x7fef180af780 2024-09-17T03:09:12.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.568+0000 7fef15ffb640 1 -- 172.21.15.78:0/3425498606 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fef0c041030 con 0x7fef180af780 2024-09-17T03:09:12.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.568+0000 7fef15ffb640 1 --2- 172.21.15.78:0/3425498606 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fef04078b90 0x7fef0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:12.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.569+0000 7fef15ffb640 1 -- 172.21.15.78:0/3425498606 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fef0c0bb650 con 0x7fef180af780 2024-09-17T03:09:12.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.569+0000 7fef1d4af640 1 --2- 172.21.15.78:0/3425498606 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fef04078b90 0x7fef0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.569+0000 7fef1d4af640 1 --2- 172.21.15.78:0/3425498606 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fef04078b90 0x7fef0407b0a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fef08006fd0 tx=0x7fef08008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:12.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.573+0000 7fef15ffb640 1 -- 172.21.15.78:0/3425498606 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fef0c083a90 con 0x7fef180af780 2024-09-17T03:09:12.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.743+0000 7fef1f713640 1 -- 172.21.15.78:0/3425498606 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fef1809aa30 con 0x7fef04078b90 2024-09-17T03:09:12.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.747+0000 7fef15ffb640 1 -- 172.21.15.78:0/3425498606 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+238790 (secure 0 0 0) 0x7fef1809aa30 con 0x7fef04078b90 2024-09-17T03:09:12.748 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:09:12.749 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:09:12.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.750+0000 7fef1f713640 1 -- 172.21.15.78:0/3425498606 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fef04078b90 msgr2=0x7fef0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:12.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.750+0000 7fef1f713640 1 --2- 172.21.15.78:0/3425498606 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fef04078b90 0x7fef0407b0a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fef08006fd0 tx=0x7fef08008040 comp rx=0 tx=0).stop 2024-09-17T03:09:12.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.750+0000 7fef1f713640 1 -- 172.21.15.78:0/3425498606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef180af780 msgr2=0x7fef1814cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:12.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.750+0000 7fef1f713640 1 --2- 172.21.15.78:0/3425498606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef180af780 0x7fef1814cb00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fef0c034040 tx=0x7fef0c0039e0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.750+0000 7fef1f713640 1 -- 172.21.15.78:0/3425498606 shutdown_connections 2024-09-17T03:09:12.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.750+0000 7fef1f713640 1 --2- 172.21.15.78:0/3425498606 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fef180cd3e0 0x7fef1815cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.750+0000 7fef1f713640 1 --2- 172.21.15.78:0/3425498606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fef180af780 0x7fef1814cb00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.750+0000 7fef1f713640 1 --2- 172.21.15.78:0/3425498606 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fef04078b90 0x7fef0407b0a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.750+0000 7fef1f713640 1 --2- 172.21.15.78:0/3425498606 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fef180706c0 0x7fef181f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.750+0000 7fef1f713640 1 -- 172.21.15.78:0/3425498606 >> 172.21.15.78:0/3425498606 conn(0x7fef1806d7d0 msgr2=0x7fef180b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:12.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.750+0000 7fef1f713640 1 -- 172.21.15.78:0/3425498606 shutdown_connections 2024-09-17T03:09:12.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.750+0000 7fef1f713640 1 -- 172.21.15.78:0/3425498606 wait complete. 2024-09-17T03:09:12.760 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-17T03:09:11.127984+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":36,"acting":36,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":224160,"kb_used_data":3732,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750560,"statfs":{"total":773094113280,"available":772864573440,"internally_reserved":0,"allocated":3821568,"data_stored":2147673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.094044"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.052252+0000","last_change":"2024-09-17T03:09:08.052252+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.052252+0000","last_undegraded":"2024-09-17T03:09:08.052252+0000","last_fullsized":"2024-09-17T03:09:08.052252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.052691+0000","last_change":"2024-09-17T03:09:08.052691+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.052691+0000","last_undegraded":"2024-09-17T03:09:08.052691+0000","last_fullsized":"2024-09-17T03:09:08.052691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.050502+0000","last_change":"2024-09-17T03:09:08.050502+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.050502+0000","last_undegraded":"2024-09-17T03:09:08.050502+0000","last_fullsized":"2024-09-17T03:09:08.050502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.051070+0000","last_change":"2024-09-17T03:09:08.051070+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.051070+0000","last_undegraded":"2024-09-17T03:09:08.051070+0000","last_fullsized":"2024-09-17T03:09:08.051070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.048645+0000","last_change":"2024-09-17T03:09:08.048645+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.048645+0000","last_undegraded":"2024-09-17T03:09:08.048645+0000","last_fullsized":"2024-09-17T03:09:08.048645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.048203+0000","last_change":"2024-09-17T03:09:08.048203+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.048203+0000","last_undegraded":"2024-09-17T03:09:08.048203+0000","last_fullsized":"2024-09-17T03:09:08.048203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.065314+0000","last_change":"2024-09-17T03:09:08.063470+0000","last_active":"2024-09-17T03:09:08.065314+0000","last_peered":"2024-09-17T03:09:08.065314+0000","last_clean":"2024-09-17T03:09:08.065314+0000","last_became_active":"2024-09-17T03:09:08.063167+0000","last_became_peered":"2024-09-17T03:09:08.063167+0000","last_unstale":"2024-09-17T03:09:08.065314+0000","last_undegraded":"2024-09-17T03:09:08.065314+0000","last_fullsized":"2024-09-17T03:09:08.065314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:41.473395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.062444+0000","last_change":"2024-09-17T03:09:08.056853+0000","last_active":"2024-09-17T03:09:08.062444+0000","last_peered":"2024-09-17T03:09:08.062444+0000","last_clean":"2024-09-17T03:09:08.062444+0000","last_became_active":"2024-09-17T03:09:08.055877+0000","last_became_peered":"2024-09-17T03:09:08.055877+0000","last_unstale":"2024-09-17T03:09:08.062444+0000","last_undegraded":"2024-09-17T03:09:08.062444+0000","last_fullsized":"2024-09-17T03:09:08.062444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:54.777021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.063712+0000","last_change":"2024-09-17T03:09:08.060540+0000","last_active":"2024-09-17T03:09:08.063712+0000","last_peered":"2024-09-17T03:09:08.063712+0000","last_clean":"2024-09-17T03:09:08.063712+0000","last_became_active":"2024-09-17T03:09:08.060242+0000","last_became_peered":"2024-09-17T03:09:08.060242+0000","last_unstale":"2024-09-17T03:09:08.063712+0000","last_undegraded":"2024-09-17T03:09:08.063712+0000","last_fullsized":"2024-09-17T03:09:08.063712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:30.592642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.048265+0000","last_change":"2024-09-17T03:09:08.048265+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.048265+0000","last_undegraded":"2024-09-17T03:09:08.048265+0000","last_fullsized":"2024-09-17T03:09:08.048265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.047493+0000","last_change":"2024-09-17T03:09:08.047493+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.047493+0000","last_undegraded":"2024-09-17T03:09:08.047493+0000","last_fullsized":"2024-09-17T03:09:08.047493+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.066079+0000","last_change":"2024-09-17T03:09:08.064681+0000","last_active":"2024-09-17T03:09:08.066079+0000","last_peered":"2024-09-17T03:09:08.066079+0000","last_clean":"2024-09-17T03:09:08.066079+0000","last_became_active":"2024-09-17T03:09:08.064261+0000","last_became_peered":"2024-09-17T03:09:08.064261+0000","last_unstale":"2024-09-17T03:09:08.066079+0000","last_undegraded":"2024-09-17T03:09:08.066079+0000","last_fullsized":"2024-09-17T03:09:08.066079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:09.600555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.048426+0000","last_change":"2024-09-17T03:09:08.048426+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.048426+0000","last_undegraded":"2024-09-17T03:09:08.048426+0000","last_fullsized":"2024-09-17T03:09:08.048426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.063739+0000","last_change":"2024-09-17T03:09:08.061406+0000","last_active":"2024-09-17T03:09:08.063739+0000","last_peered":"2024-09-17T03:09:08.063739+0000","last_clean":"2024-09-17T03:09:08.063739+0000","last_became_active":"2024-09-17T03:09:08.061113+0000","last_became_peered":"2024-09-17T03:09:08.061113+0000","last_unstale":"2024-09-17T03:09:08.063739+0000","last_undegraded":"2024-09-17T03:09:08.063739+0000","last_fullsized":"2024-09-17T03:09:08.063739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:42.509000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.065280+0000","last_change":"2024-09-17T03:09:08.063624+0000","last_active":"2024-09-17T03:09:08.065280+0000","last_peered":"2024-09-17T03:09:08.065280+0000","last_clean":"2024-09-17T03:09:08.065280+0000","last_became_active":"2024-09-17T03:09:08.063309+0000","last_became_peered":"2024-09-17T03:09:08.063309+0000","last_unstale":"2024-09-17T03:09:08.065280+0000","last_undegraded":"2024-09-17T03:09:08.065280+0000","last_fullsized":"2024-09-17T03:09:08.065280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:24.663278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.047509+0000","last_change":"2024-09-17T03:09:08.047509+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.047509+0000","last_undegraded":"2024-09-17T03:09:08.047509+0000","last_fullsized":"2024-09-17T03:09:08.047509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.065164+0000","last_change":"2024-09-17T03:09:08.062609+0000","last_active":"2024-09-17T03:09:08.065164+0000","last_peered":"2024-09-17T03:09:08.065164+0000","last_clean":"2024-09-17T03:09:08.065164+0000","last_became_active":"2024-09-17T03:09:08.062155+0000","last_became_peered":"2024-09-17T03:09:08.062155+0000","last_unstale":"2024-09-17T03:09:08.065164+0000","last_undegraded":"2024-09-17T03:09:08.065164+0000","last_fullsized":"2024-09-17T03:09:08.065164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:27.472946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:08.032499+0000","last_change":"2024-09-17T03:09:08.032499+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.032499+0000","last_undegraded":"2024-09-17T03:09:08.032499+0000","last_fullsized":"2024-09-17T03:09:08.032499+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:09:07.030085+0000","last_change":"2024-09-17T03:09:07.030085+0000","last_active":"2024-09-17T03:09:07.030085+0000","last_peered":"2024-09-17T03:09:07.030085+0000","last_clean":"2024-09-17T03:09:07.030085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:07.030085+0000","last_undegraded":"2024-09-17T03:09:07.030085+0000","last_fullsized":"2024-09-17T03:09:07.030085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":122,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-09-17T03:09:03.346572+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:09:03.346572+0000","last_peered":"2024-09-17T03:09:03.346572+0000","last_clean":"2024-09-17T03:09:03.346572+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:09:03.346572+0000","last_undegraded":"2024-09-17T03:09:03.346572+0000","last_fullsized":"2024-09-17T03:09:03.346572+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":14,"acting":14,"num_store_stats":1},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":921600,"data_stored":710508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27368,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":327680,"data_stored":120140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27360,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344480,"statfs":{"total":96636764160,"available":96608747520,"internally_reserved":0,"allocated":327680,"data_stored":120140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27356,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":327680,"data_stored":120140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":120140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":710508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":339968,"data_stored":125957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:09:12.764 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3f is not active+clean 2024-09-17T03:09:12.764 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.764 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-09-17T03:09:12.764 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:09:08.052252+0000', 'last_change': '2024-09-17T03:09:08.052252+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.052252+0000', 'last_undegraded': '2024-09-17T03:09:08.052252+0000', 'last_fullsized': '2024-09-17T03:09:08.052252+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:09:12.764 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-09-17T03:09:12.765 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.765 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-09-17T03:09:12.765 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.765 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3b is not active+clean 2024-09-17T03:09:12.765 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.765 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-09-17T03:09:12.765 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:09:08.052691+0000', 'last_change': '2024-09-17T03:09:08.052691+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.052691+0000', 'last_undegraded': '2024-09-17T03:09:08.052691+0000', 'last_fullsized': '2024-09-17T03:09:08.052691+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:09:12.765 INFO:tasks.ceph.ceph_manager.ceph:PG 5.39 is not active+clean 2024-09-17T03:09:12.765 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.765 INFO:tasks.ceph.ceph_manager.ceph:PG 5.38 is not active+clean 2024-09-17T03:09:12.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.766 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-09-17T03:09:12.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.766 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-09-17T03:09:12.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.766 INFO:tasks.ceph.ceph_manager.ceph:PG 5.35 is not active+clean 2024-09-17T03:09:12.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.766 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-09-17T03:09:12.766 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.767 INFO:tasks.ceph.ceph_manager.ceph:PG 5.33 is not active+clean 2024-09-17T03:09:12.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.767 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-09-17T03:09:12.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:09:08.050502+0000', 'last_change': '2024-09-17T03:09:08.050502+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.050502+0000', 'last_undegraded': '2024-09-17T03:09:08.050502+0000', 'last_fullsized': '2024-09-17T03:09:08.050502+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:09:12.767 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-09-17T03:09:12.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.767 INFO:tasks.ceph.ceph_manager.ceph:PG 5.30 is not active+clean 2024-09-17T03:09:12.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.767 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2f is not active+clean 2024-09-17T03:09:12.767 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.768 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-09-17T03:09:12.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:09:08.051070+0000', 'last_change': '2024-09-17T03:09:08.051070+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.051070+0000', 'last_undegraded': '2024-09-17T03:09:08.051070+0000', 'last_fullsized': '2024-09-17T03:09:08.051070+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:09:12.768 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-09-17T03:09:12.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:09:08.048645+0000', 'last_change': '2024-09-17T03:09:08.048645+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.048645+0000', 'last_undegraded': '2024-09-17T03:09:08.048645+0000', 'last_fullsized': '2024-09-17T03:09:08.048645+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:09:12.768 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2c is not active+clean 2024-09-17T03:09:12.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.768 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-09-17T03:09:12.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.768 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2a is not active+clean 2024-09-17T03:09:12.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.769 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-09-17T03:09:12.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.769 INFO:tasks.ceph.ceph_manager.ceph:PG 5.28 is not active+clean 2024-09-17T03:09:12.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.769 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-09-17T03:09:12.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.769 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-09-17T03:09:12.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:09:08.048203+0000', 'last_change': '2024-09-17T03:09:08.048203+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.048203+0000', 'last_undegraded': '2024-09-17T03:09:08.048203+0000', 'last_fullsized': '2024-09-17T03:09:08.048203+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:09:12.769 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-09-17T03:09:12.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.770 INFO:tasks.ceph.ceph_manager.ceph:PG 5.24 is not active+clean 2024-09-17T03:09:12.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.770 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-09-17T03:09:12.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.770 INFO:tasks.ceph.ceph_manager.ceph:PG 5.22 is not active+clean 2024-09-17T03:09:12.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.770 INFO:tasks.ceph.ceph_manager.ceph:PG 5.21 is not active+clean 2024-09-17T03:09:12.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.770 INFO:tasks.ceph.ceph_manager.ceph:PG 5.20 is not active+clean 2024-09-17T03:09:12.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.771 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-09-17T03:09:12.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.771 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-09-17T03:09:12.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.771 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-09-17T03:09:12.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.771 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1e is not active+clean 2024-09-17T03:09:12.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.771 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-09-17T03:09:12.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.772 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-09-17T03:09:12.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.772 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-09-17T03:09:12.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.773 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-09-17T03:09:12.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.773 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-09-17T03:09:12.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.773 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-09-17T03:09:12.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.773 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1a is not active+clean 2024-09-17T03:09:12.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.773 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-09-17T03:09:12.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.774 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-09-17T03:09:12.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.774 INFO:tasks.ceph.ceph_manager.ceph:PG 4.18 is not active+clean 2024-09-17T03:09:12.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.774 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-09-17T03:09:12.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.774 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-09-17T03:09:12.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:09:08.048265+0000', 'last_change': '2024-09-17T03:09:08.048265+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.048265+0000', 'last_undegraded': '2024-09-17T03:09:08.048265+0000', 'last_fullsized': '2024-09-17T03:09:08.048265+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:09:12.774 INFO:tasks.ceph.ceph_manager.ceph:PG 4.16 is not active+clean 2024-09-17T03:09:12.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.775 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-09-17T03:09:12.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:09:08.047493+0000', 'last_change': '2024-09-17T03:09:08.047493+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.047493+0000', 'last_undegraded': '2024-09-17T03:09:08.047493+0000', 'last_fullsized': '2024-09-17T03:09:08.047493+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:09:12.775 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-09-17T03:09:12.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.775 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-09-17T03:09:12.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.775 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-09-17T03:09:12.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.775 INFO:tasks.ceph.ceph_manager.ceph:PG 4.13 is not active+clean 2024-09-17T03:09:12.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.776 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-09-17T03:09:12.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:09:08.048426+0000', 'last_change': '2024-09-17T03:09:08.048426+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.048426+0000', 'last_undegraded': '2024-09-17T03:09:08.048426+0000', 'last_fullsized': '2024-09-17T03:09:08.048426+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:09:12.776 INFO:tasks.ceph.ceph_manager.ceph:PG 4.12 is not active+clean 2024-09-17T03:09:12.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.776 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-09-17T03:09:12.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.776 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-09-17T03:09:12.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.776 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-09-17T03:09:12.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.777 INFO:tasks.ceph.ceph_manager.ceph:PG 4.f is not active+clean 2024-09-17T03:09:12.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.777 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-09-17T03:09:12.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.777 INFO:tasks.ceph.ceph_manager.ceph:PG 4.e is not active+clean 2024-09-17T03:09:12.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.777 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-17T03:09:12.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.777 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-09-17T03:09:12.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.778 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-09-17T03:09:12.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.778 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-09-17T03:09:12.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.778 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-09-17T03:09:12.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.778 INFO:tasks.ceph.ceph_manager.ceph:PG 4.b is not active+clean 2024-09-17T03:09:12.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.779 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-09-17T03:09:12.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.779 INFO:tasks.ceph.ceph_manager.ceph:PG 4.a is not active+clean 2024-09-17T03:09:12.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.779 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-09-17T03:09:12.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.779 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-09-17T03:09:12.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.779 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-09-17T03:09:12.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.779 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-09-17T03:09:12.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.780 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-09-17T03:09:12.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.780 INFO:tasks.ceph.ceph_manager.ceph:PG 4.7 is not active+clean 2024-09-17T03:09:12.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.780 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-09-17T03:09:12.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.780 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-09-17T03:09:12.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.781 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-17T03:09:12.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.781 INFO:tasks.ceph.ceph_manager.ceph:PG 4.4 is not active+clean 2024-09-17T03:09:12.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.781 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-09-17T03:09:12.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.781 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-09-17T03:09:12.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.781 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-09-17T03:09:12.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.782 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2 is not active+clean 2024-09-17T03:09:12.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.782 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-09-17T03:09:12.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 32, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:09:08.047509+0000', 'last_change': '2024-09-17T03:09:08.047509+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.047509+0000', 'last_undegraded': '2024-09-17T03:09:08.047509+0000', 'last_fullsized': '2024-09-17T03:09:08.047509+0000', 'mapping_epoch': 32, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 32, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T03:09:12.782 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-09-17T03:09:12.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.782 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-09-17T03:09:12.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.782 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-09-17T03:09:12.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:08.032499+0000', 'last_change': '2024-09-17T03:09:08.032499+0000', 'last_active': '2024-09-17T03:09:08.032499+0000', 'last_peered': '2024-09-17T03:09:08.032499+0000', 'last_clean': '2024-09-17T03:09:08.032499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:08.032499+0000', 'last_undegraded': '2024-09-17T03:09:08.032499+0000', 'last_fullsized': '2024-09-17T03:09:08.032499+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:08.032499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.783 INFO:tasks.ceph.ceph_manager.ceph:PG 4.5 is not active+clean 2024-09-17T03:09:12.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:09:07.030085+0000', 'last_change': '2024-09-17T03:09:07.030085+0000', 'last_active': '2024-09-17T03:09:07.030085+0000', 'last_peered': '2024-09-17T03:09:07.030085+0000', 'last_clean': '2024-09-17T03:09:07.030085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:09:07.030085+0000', 'last_undegraded': '2024-09-17T03:09:07.030085+0000', 'last_fullsized': '2024-09-17T03:09:07.030085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'last_clean_scrub_stamp': '2024-09-17T03:09:07.030085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:09:12.783 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:09:12.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.913+0000 7fd3051ed640 1 -- 172.21.15.78:0/1397861403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3000cf540 msgr2=0x7fd3000b5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:12.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.913+0000 7fd3051ed640 1 --2- 172.21.15.78:0/1397861403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3000cf540 0x7fd3000b5fa0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd3000b6e20 tx=0x7fd2e802a440 comp rx=0 tx=0).stop 2024-09-17T03:09:12.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.913+0000 7fd3051ed640 1 -- 172.21.15.78:0/1397861403 shutdown_connections 2024-09-17T03:09:12.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.913+0000 7fd3051ed640 1 --2- 172.21.15.78:0/1397861403 >> v2:172.21.15.193:3300/0 conn(0x7fd3000b64e0 0x7fd3000d25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.913+0000 7fd3051ed640 1 --2- 172.21.15.78:0/1397861403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3000cf540 0x7fd3000b5fa0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.913+0000 7fd3051ed640 1 --2- 172.21.15.78:0/1397861403 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd3000b9b60 0x7fd3000d4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.913+0000 7fd3051ed640 1 -- 172.21.15.78:0/1397861403 >> 172.21.15.78:0/1397861403 conn(0x7fd30009d7f0 msgr2=0x7fd3000d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.913+0000 7fd3051ed640 1 -- 172.21.15.78:0/1397861403 shutdown_connections 2024-09-17T03:09:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.913+0000 7fd3051ed640 1 -- 172.21.15.78:0/1397861403 wait complete. 2024-09-17T03:09:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.915+0000 7fd3051ed640 1 Processor -- start 2024-09-17T03:09:12.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.915+0000 7fd3051ed640 1 -- start start 2024-09-17T03:09:12.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.916+0000 7fd3051ed640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd3000b64e0 0x7fd3000a00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:12.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.916+0000 7fd3051ed640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3000b9b60 0x7fd3001578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:12.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.916+0000 7fd3051ed640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd3000cf540 0x7fd300160a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.916+0000 7fd3051ed640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd3000d2f30 con 0x7fd3000b9b60 2024-09-17T03:09:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.916+0000 7fd3051ed640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd3000d2db0 con 0x7fd3000cf540 2024-09-17T03:09:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.916+0000 7fd3051ed640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd3000d30b0 con 0x7fd3000b64e0 2024-09-17T03:09:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.916+0000 7fd2f659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3000b9b60 0x7fd3001578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.916+0000 7fd2f659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3000b9b60 0x7fd3001578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39438/0 (socket says 172.21.15.78:39438) 2024-09-17T03:09:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.916+0000 7fd2f659c640 1 -- 172.21.15.78:0/2223579461 learned_addr learned my addr 172.21.15.78:0/2223579461 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.917+0000 7fd2ff59e640 1 --2- 172.21.15.78:0/2223579461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd3000cf540 0x7fd300160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.917+0000 7fd2fed9d640 1 --2- 172.21.15.78:0/2223579461 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd3000b64e0 0x7fd3000a00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.917+0000 7fd2f659c640 1 -- 172.21.15.78:0/2223579461 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd3000b64e0 msgr2=0x7fd3000a00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.917+0000 7fd2f659c640 1 --2- 172.21.15.78:0/2223579461 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd3000b64e0 0x7fd3000a00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.917+0000 7fd2f659c640 1 -- 172.21.15.78:0/2223579461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd3000cf540 msgr2=0x7fd300160a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.917+0000 7fd2f659c640 1 --2- 172.21.15.78:0/2223579461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd3000cf540 0x7fd300160a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:12.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.917+0000 7fd2f659c640 1 -- 172.21.15.78:0/2223579461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3000a09d0 con 0x7fd3000b9b60 2024-09-17T03:09:12.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.917+0000 7fd2ff59e640 1 --2- 172.21.15.78:0/2223579461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd3000cf540 0x7fd300160a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:09:12.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.917+0000 7fd2fed9d640 1 --2- 172.21.15.78:0/2223579461 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd3000b64e0 0x7fd3000a00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:09:12.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.917+0000 7fd2f659c640 1 --2- 172.21.15.78:0/2223579461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3000b9b60 0x7fd3001578f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8034040 tx=0x7fd2e80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:12.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.917+0000 7fd2f7fff640 1 -- 172.21.15.78:0/2223579461 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e803e030 con 0x7fd3000b9b60 2024-09-17T03:09:12.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.917+0000 7fd2f7fff640 1 -- 172.21.15.78:0/2223579461 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2e8003ca0 con 0x7fd3000b9b60 2024-09-17T03:09:12.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.917+0000 7fd2f7fff640 1 -- 172.21.15.78:0/2223579461 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8035040 con 0x7fd3000b9b60 2024-09-17T03:09:12.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.917+0000 7fd3051ed640 1 -- 172.21.15.78:0/2223579461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3000a0cb0 con 0x7fd3000b9b60 2024-09-17T03:09:12.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.917+0000 7fd3051ed640 1 -- 172.21.15.78:0/2223579461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3000a1270 con 0x7fd3000b9b60 2024-09-17T03:09:12.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.918+0000 7fd3051ed640 1 -- 172.21.15.78:0/2223579461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3000a0740 con 0x7fd3000b9b60 2024-09-17T03:09:12.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.919+0000 7fd2f7fff640 1 -- 172.21.15.78:0/2223579461 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd2e8041030 con 0x7fd3000b9b60 2024-09-17T03:09:12.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.919+0000 7fd2f7fff640 1 --2- 172.21.15.78:0/2223579461 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd2e0078b90 0x7fd2e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:12.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.919+0000 7fd2f7fff640 1 -- 172.21.15.78:0/2223579461 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd2e80bb480 con 0x7fd3000b9b60 2024-09-17T03:09:12.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.919+0000 7fd2fed9d640 1 --2- 172.21.15.78:0/2223579461 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd2e0078b90 0x7fd2e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:12.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.920+0000 7fd2fed9d640 1 --2- 172.21.15.78:0/2223579461 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd2e0078b90 0x7fd2e007b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009aa0 tx=0x7fd2f0005f30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:12.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:12.924+0000 7fd2f7fff640 1 -- 172.21.15.78:0/2223579461 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd2e80838c0 con 0x7fd3000b9b60 2024-09-17T03:09:13.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.167+0000 7fd3051ed640 1 -- 172.21.15.78:0/2223579461 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd3000d4d80 con 0x7fd3000b9b60 2024-09-17T03:09:13.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.167+0000 7fd2f7fff640 1 -- 172.21.15.78:0/2223579461 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2763 (secure 0 0 0) 0x7fd2e80831c0 con 0x7fd3000b9b60 2024-09-17T03:09:13.166 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:09:13.166 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":70,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":79},{"state_name":"creating+peering","count":10},{"state_name":"active+clean","count":8}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":229539840,"bytes_avail":772864573440,"bytes_total":773094113280,"unknown_pgs_ratio":0.81443297863006592,"inactive_pgs_ratio":0.10309278219938278},"fsmap":{"epoch":13,"btime":"2024-09-17T03:09:11:060312+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4938}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-09-17T03:09:09.127559+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:09:13.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.169+0000 7fd3051ed640 1 -- 172.21.15.78:0/2223579461 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd2e0078b90 msgr2=0x7fd2e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:13.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.169+0000 7fd3051ed640 1 --2- 172.21.15.78:0/2223579461 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd2e0078b90 0x7fd2e007b0a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0009aa0 tx=0x7fd2f0005f30 comp rx=0 tx=0).stop 2024-09-17T03:09:13.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.169+0000 7fd3051ed640 1 -- 172.21.15.78:0/2223579461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3000b9b60 msgr2=0x7fd3001578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:13.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.169+0000 7fd3051ed640 1 --2- 172.21.15.78:0/2223579461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3000b9b60 0x7fd3001578f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8034040 tx=0x7fd2e80038a0 comp rx=0 tx=0).stop 2024-09-17T03:09:13.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.169+0000 7fd3051ed640 1 -- 172.21.15.78:0/2223579461 shutdown_connections 2024-09-17T03:09:13.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.169+0000 7fd3051ed640 1 --2- 172.21.15.78:0/2223579461 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd2e0078b90 0x7fd2e007b0a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:13.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.169+0000 7fd3051ed640 1 --2- 172.21.15.78:0/2223579461 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd3000cf540 0x7fd300160a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:13.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.169+0000 7fd3051ed640 1 --2- 172.21.15.78:0/2223579461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3000b9b60 0x7fd3001578f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:13.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.169+0000 7fd3051ed640 1 --2- 172.21.15.78:0/2223579461 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd3000b64e0 0x7fd3000a00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:13.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.169+0000 7fd3051ed640 1 -- 172.21.15.78:0/2223579461 >> 172.21.15.78:0/2223579461 conn(0x7fd30009d7f0 msgr2=0x7fd3000b7ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:13.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.169+0000 7fd3051ed640 1 -- 172.21.15.78:0/2223579461 shutdown_connections 2024-09-17T03:09:13.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.169+0000 7fd3051ed640 1 -- 172.21.15.78:0/2223579461 wait complete. 2024-09-17T03:09:13.179 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:09:13.180 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:09:13.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.292+0000 7ff9181ad640 1 -- 172.21.15.78:0/705164643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9100cfb00 msgr2=0x7ff91015bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:13.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.292+0000 7ff9181ad640 1 --2- 172.21.15.78:0/705164643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9100cfb00 0x7ff91015bf20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff910071270 tx=0x7ff90c02a560 comp rx=0 tx=0).stop 2024-09-17T03:09:13.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.292+0000 7ff9181ad640 1 -- 172.21.15.78:0/705164643 shutdown_connections 2024-09-17T03:09:13.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.292+0000 7ff9181ad640 1 --2- 172.21.15.78:0/705164643 >> v2:172.21.15.193:3300/0 conn(0x7ff9100cf570 0x7ff9100caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:13.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.292+0000 7ff9181ad640 1 --2- 172.21.15.78:0/705164643 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9100cf160 0x7ff9100ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:13.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.292+0000 7ff9181ad640 1 --2- 172.21.15.78:0/705164643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9100cfb00 0x7ff91015bf20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:13.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.292+0000 7ff9181ad640 1 -- 172.21.15.78:0/705164643 >> 172.21.15.78:0/705164643 conn(0x7ff9100b1cb0 msgr2=0x7ff9100b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:13.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.292+0000 7ff9181ad640 1 -- 172.21.15.78:0/705164643 shutdown_connections 2024-09-17T03:09:13.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.292+0000 7ff9181ad640 1 -- 172.21.15.78:0/705164643 wait complete. 2024-09-17T03:09:13.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.294+0000 7ff9181ad640 1 Processor -- start 2024-09-17T03:09:13.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.294+0000 7ff9181ad640 1 -- start start 2024-09-17T03:09:13.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff9181ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9100cf160 0x7ff910142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:13.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff9181ad640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9100cf570 0x7ff910155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:13.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff9181ad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9100cfb00 0x7ff91009d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:13.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff9181ad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff9100ccf30 con 0x7ff9100cf160 2024-09-17T03:09:13.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff9181ad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff9100ccdb0 con 0x7ff9100cfb00 2024-09-17T03:09:13.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff9181ad640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff9100cd0b0 con 0x7ff9100cf570 2024-09-17T03:09:13.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff915f49640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9100cf160 0x7ff910142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:13.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff915f49640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9100cf160 0x7ff910142a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39454/0 (socket says 172.21.15.78:39454) 2024-09-17T03:09:13.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff915f49640 1 -- 172.21.15.78:0/1066298584 learned_addr learned my addr 172.21.15.78:0/1066298584 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff915748640 1 --2- 172.21.15.78:0/1066298584 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9100cf570 0x7ff910155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff91674a640 1 --2- 172.21.15.78:0/1066298584 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9100cfb00 0x7ff91009d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff915f49640 1 -- 172.21.15.78:0/1066298584 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9100cf570 msgr2=0x7ff910155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff915f49640 1 --2- 172.21.15.78:0/1066298584 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9100cf570 0x7ff910155ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff915f49640 1 -- 172.21.15.78:0/1066298584 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9100cfb00 msgr2=0x7ff91009d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff915f49640 1 --2- 172.21.15.78:0/1066298584 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9100cfb00 0x7ff91009d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff915f49640 1 -- 172.21.15.78:0/1066298584 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91009dc30 con 0x7ff9100cf160 2024-09-17T03:09:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff915f49640 1 --2- 172.21.15.78:0/1066298584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9100cf160 0x7ff910142a80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0099c0 tx=0x7ff90c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff9067fc640 1 -- 172.21.15.78:0/1066298584 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c03e030 con 0x7ff9100cf160 2024-09-17T03:09:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff9067fc640 1 -- 172.21.15.78:0/1066298584 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff90c0047a0 con 0x7ff9100cf160 2024-09-17T03:09:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff9067fc640 1 -- 172.21.15.78:0/1066298584 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c035040 con 0x7ff9100cf160 2024-09-17T03:09:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.296+0000 7ff9181ad640 1 -- 172.21.15.78:0/1066298584 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff91009c650 con 0x7ff9100cf160 2024-09-17T03:09:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.297+0000 7ff9181ad640 1 -- 172.21.15.78:0/1066298584 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff91009cc10 con 0x7ff9100cf160 2024-09-17T03:09:13.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.297+0000 7ff9181ad640 1 -- 172.21.15.78:0/1066298584 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff91015bf20 con 0x7ff9100cf160 2024-09-17T03:09:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.298+0000 7ff9067fc640 1 -- 172.21.15.78:0/1066298584 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff90c041030 con 0x7ff9100cf160 2024-09-17T03:09:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.299+0000 7ff9067fc640 1 --2- 172.21.15.78:0/1066298584 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff8f4078b90 0x7ff8f407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:13.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.299+0000 7ff9067fc640 1 -- 172.21.15.78:0/1066298584 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ff90c0bb5c0 con 0x7ff9100cf160 2024-09-17T03:09:13.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.299+0000 7ff915748640 1 --2- 172.21.15.78:0/1066298584 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff8f4078b90 0x7ff8f407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:13.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.300+0000 7ff915748640 1 --2- 172.21.15.78:0/1066298584 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff8f4078b90 0x7ff8f407b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff9100b2230 tx=0x7ff90000c3c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:13.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.303+0000 7ff9067fc640 1 -- 172.21.15.78:0/1066298584 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff90c083a90 con 0x7ff9100cf160 2024-09-17T03:09:13.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.472+0000 7ff9181ad640 1 -- 172.21.15.78:0/1066298584 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff910166830 con 0x7ff8f4078b90 2024-09-17T03:09:13.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.476+0000 7ff9067fc640 1 -- 172.21.15.78:0/1066298584 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251108 (secure 0 0 0) 0x7ff910166830 con 0x7ff8f4078b90 2024-09-17T03:09:13.478 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:09:13.479 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:09:13.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.479+0000 7ff9181ad640 1 -- 172.21.15.78:0/1066298584 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff8f4078b90 msgr2=0x7ff8f407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:13.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.479+0000 7ff9181ad640 1 --2- 172.21.15.78:0/1066298584 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff8f4078b90 0x7ff8f407b0a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff9100b2230 tx=0x7ff90000c3c0 comp rx=0 tx=0).stop 2024-09-17T03:09:13.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.479+0000 7ff9181ad640 1 -- 172.21.15.78:0/1066298584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9100cf160 msgr2=0x7ff910142a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:13.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.479+0000 7ff9181ad640 1 --2- 172.21.15.78:0/1066298584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9100cf160 0x7ff910142a80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0099c0 tx=0x7ff90c0039e0 comp rx=0 tx=0).stop 2024-09-17T03:09:13.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.479+0000 7ff9181ad640 1 -- 172.21.15.78:0/1066298584 shutdown_connections 2024-09-17T03:09:13.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.479+0000 7ff9181ad640 1 --2- 172.21.15.78:0/1066298584 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff8f4078b90 0x7ff8f407b0a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:13.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.479+0000 7ff9181ad640 1 --2- 172.21.15.78:0/1066298584 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9100cfb00 0x7ff91009d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:13.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.479+0000 7ff9181ad640 1 --2- 172.21.15.78:0/1066298584 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9100cf570 0x7ff910155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:13.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.479+0000 7ff9181ad640 1 --2- 172.21.15.78:0/1066298584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9100cf160 0x7ff910142a80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:13.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.479+0000 7ff9181ad640 1 -- 172.21.15.78:0/1066298584 >> 172.21.15.78:0/1066298584 conn(0x7ff9100b1cb0 msgr2=0x7ff9100d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:13.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.479+0000 7ff9181ad640 1 -- 172.21.15.78:0/1066298584 shutdown_connections 2024-09-17T03:09:13.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:13.479+0000 7ff9181ad640 1 -- 172.21.15.78:0/1066298584 wait complete. 2024-09-17T03:09:13.491 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-09-17T03:09:13.128501+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":125,"num_write_kb":1639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":228668,"kb_used_data":4092,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754746052,"statfs":{"total":773094113280,"available":772859957248,"internally_reserved":0,"allocated":4190208,"data_stored":2314372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001410"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399400+0000","last_change":"2024-09-17T03:09:09.065135+0000","last_active":"2024-09-17T03:09:10.399400+0000","last_peered":"2024-09-17T03:09:10.399400+0000","last_clean":"2024-09-17T03:09:10.399400+0000","last_became_active":"2024-09-17T03:09:09.064806+0000","last_became_peered":"2024-09-17T03:09:09.064806+0000","last_unstale":"2024-09-17T03:09:10.399400+0000","last_undegraded":"2024-09-17T03:09:10.399400+0000","last_fullsized":"2024-09-17T03:09:10.399400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:12.488505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.052252+0000","last_change":"2024-09-17T03:09:08.052252+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.052252+0000","last_undegraded":"2024-09-17T03:09:08.052252+0000","last_fullsized":"2024-09-17T03:09:08.052252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399300+0000","last_change":"2024-09-17T03:09:09.075157+0000","last_active":"2024-09-17T03:09:10.399300+0000","last_peered":"2024-09-17T03:09:10.399300+0000","last_clean":"2024-09-17T03:09:10.399300+0000","last_became_active":"2024-09-17T03:09:09.074792+0000","last_became_peered":"2024-09-17T03:09:09.074792+0000","last_unstale":"2024-09-17T03:09:10.399300+0000","last_undegraded":"2024-09-17T03:09:10.399300+0000","last_fullsized":"2024-09-17T03:09:10.399300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:42.805805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398412+0000","last_change":"2024-09-17T03:09:09.068769+0000","last_active":"2024-09-17T03:09:10.398412+0000","last_peered":"2024-09-17T03:09:10.398412+0000","last_clean":"2024-09-17T03:09:10.398412+0000","last_became_active":"2024-09-17T03:09:09.068477+0000","last_became_peered":"2024-09-17T03:09:09.068477+0000","last_unstale":"2024-09-17T03:09:10.398412+0000","last_undegraded":"2024-09-17T03:09:10.398412+0000","last_fullsized":"2024-09-17T03:09:10.398412+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:51.182218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398983+0000","last_change":"2024-09-17T03:09:09.078877+0000","last_active":"2024-09-17T03:09:10.398983+0000","last_peered":"2024-09-17T03:09:10.398983+0000","last_clean":"2024-09-17T03:09:10.398983+0000","last_became_active":"2024-09-17T03:09:09.078540+0000","last_became_peered":"2024-09-17T03:09:09.078540+0000","last_unstale":"2024-09-17T03:09:10.398983+0000","last_undegraded":"2024-09-17T03:09:10.398983+0000","last_fullsized":"2024-09-17T03:09:10.398983+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:44.838613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.052691+0000","last_change":"2024-09-17T03:09:08.052691+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.052691+0000","last_undegraded":"2024-09-17T03:09:08.052691+0000","last_fullsized":"2024-09-17T03:09:08.052691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063735+0000","last_change":"2024-09-17T03:09:09.069039+0000","last_active":"2024-09-17T03:09:10.063735+0000","last_peered":"2024-09-17T03:09:10.063735+0000","last_clean":"2024-09-17T03:09:10.063735+0000","last_became_active":"2024-09-17T03:09:09.068710+0000","last_became_peered":"2024-09-17T03:09:09.068710+0000","last_unstale":"2024-09-17T03:09:10.063735+0000","last_undegraded":"2024-09-17T03:09:10.063735+0000","last_fullsized":"2024-09-17T03:09:10.063735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:12.758336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063340+0000","last_change":"2024-09-17T03:09:09.070509+0000","last_active":"2024-09-17T03:09:10.063340+0000","last_peered":"2024-09-17T03:09:10.063340+0000","last_clean":"2024-09-17T03:09:10.063340+0000","last_became_active":"2024-09-17T03:09:09.070187+0000","last_became_peered":"2024-09-17T03:09:09.070187+0000","last_unstale":"2024-09-17T03:09:10.063340+0000","last_undegraded":"2024-09-17T03:09:10.063340+0000","last_fullsized":"2024-09-17T03:09:10.063340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:58.128694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064978+0000","last_change":"2024-09-17T03:09:09.058231+0000","last_active":"2024-09-17T03:09:10.064978+0000","last_peered":"2024-09-17T03:09:10.064978+0000","last_clean":"2024-09-17T03:09:10.064978+0000","last_became_active":"2024-09-17T03:09:09.057919+0000","last_became_peered":"2024-09-17T03:09:09.057919+0000","last_unstale":"2024-09-17T03:09:10.064978+0000","last_undegraded":"2024-09-17T03:09:10.064978+0000","last_fullsized":"2024-09-17T03:09:10.064978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:01.344544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398084+0000","last_change":"2024-09-17T03:09:09.072383+0000","last_active":"2024-09-17T03:09:10.398084+0000","last_peered":"2024-09-17T03:09:10.398084+0000","last_clean":"2024-09-17T03:09:10.398084+0000","last_became_active":"2024-09-17T03:09:09.071845+0000","last_became_peered":"2024-09-17T03:09:09.071845+0000","last_unstale":"2024-09-17T03:09:10.398084+0000","last_undegraded":"2024-09-17T03:09:10.398084+0000","last_fullsized":"2024-09-17T03:09:10.398084+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:28.840205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063916+0000","last_change":"2024-09-17T03:09:09.059941+0000","last_active":"2024-09-17T03:09:10.063916+0000","last_peered":"2024-09-17T03:09:10.063916+0000","last_clean":"2024-09-17T03:09:10.063916+0000","last_became_active":"2024-09-17T03:09:09.059614+0000","last_became_peered":"2024-09-17T03:09:09.059614+0000","last_unstale":"2024-09-17T03:09:10.063916+0000","last_undegraded":"2024-09-17T03:09:10.063916+0000","last_fullsized":"2024-09-17T03:09:10.063916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:16.171276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398804+0000","last_change":"2024-09-17T03:09:09.072398+0000","last_active":"2024-09-17T03:09:10.398804+0000","last_peered":"2024-09-17T03:09:10.398804+0000","last_clean":"2024-09-17T03:09:10.398804+0000","last_became_active":"2024-09-17T03:09:09.072058+0000","last_became_peered":"2024-09-17T03:09:09.072058+0000","last_unstale":"2024-09-17T03:09:10.398804+0000","last_undegraded":"2024-09-17T03:09:10.398804+0000","last_fullsized":"2024-09-17T03:09:10.398804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:12.758336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399367+0000","last_change":"2024-09-17T03:09:09.071269+0000","last_active":"2024-09-17T03:09:10.399367+0000","last_peered":"2024-09-17T03:09:10.399367+0000","last_clean":"2024-09-17T03:09:10.399367+0000","last_became_active":"2024-09-17T03:09:09.070949+0000","last_became_peered":"2024-09-17T03:09:09.070949+0000","last_unstale":"2024-09-17T03:09:10.399367+0000","last_undegraded":"2024-09-17T03:09:10.399367+0000","last_fullsized":"2024-09-17T03:09:10.399367+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:30.582938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.050502+0000","last_change":"2024-09-17T03:09:08.050502+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.050502+0000","last_undegraded":"2024-09-17T03:09:08.050502+0000","last_fullsized":"2024-09-17T03:09:08.050502+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398377+0000","last_change":"2024-09-17T03:09:09.074994+0000","last_active":"2024-09-17T03:09:10.398377+0000","last_peered":"2024-09-17T03:09:10.398377+0000","last_clean":"2024-09-17T03:09:10.398377+0000","last_became_active":"2024-09-17T03:09:09.074621+0000","last_became_peered":"2024-09-17T03:09:09.074621+0000","last_unstale":"2024-09-17T03:09:10.398377+0000","last_undegraded":"2024-09-17T03:09:10.398377+0000","last_fullsized":"2024-09-17T03:09:10.398377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:37.353848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063786+0000","last_change":"2024-09-17T03:09:09.079992+0000","last_active":"2024-09-17T03:09:10.063786+0000","last_peered":"2024-09-17T03:09:10.063786+0000","last_clean":"2024-09-17T03:09:10.063786+0000","last_became_active":"2024-09-17T03:09:09.079655+0000","last_became_peered":"2024-09-17T03:09:09.079655+0000","last_unstale":"2024-09-17T03:09:10.063786+0000","last_undegraded":"2024-09-17T03:09:10.063786+0000","last_fullsized":"2024-09-17T03:09:10.063786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:51.790145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064478+0000","last_change":"2024-09-17T03:09:09.075273+0000","last_active":"2024-09-17T03:09:10.064478+0000","last_peered":"2024-09-17T03:09:10.064478+0000","last_clean":"2024-09-17T03:09:10.064478+0000","last_became_active":"2024-09-17T03:09:09.074973+0000","last_became_peered":"2024-09-17T03:09:09.074973+0000","last_unstale":"2024-09-17T03:09:10.064478+0000","last_undegraded":"2024-09-17T03:09:10.064478+0000","last_fullsized":"2024-09-17T03:09:10.064478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:07.265233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.051070+0000","last_change":"2024-09-17T03:09:08.051070+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.051070+0000","last_undegraded":"2024-09-17T03:09:08.051070+0000","last_fullsized":"2024-09-17T03:09:08.051070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.048645+0000","last_change":"2024-09-17T03:09:08.048645+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.048645+0000","last_undegraded":"2024-09-17T03:09:08.048645+0000","last_fullsized":"2024-09-17T03:09:08.048645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399547+0000","last_change":"2024-09-17T03:09:09.068960+0000","last_active":"2024-09-17T03:09:10.399547+0000","last_peered":"2024-09-17T03:09:10.399547+0000","last_clean":"2024-09-17T03:09:10.399547+0000","last_became_active":"2024-09-17T03:09:09.068638+0000","last_became_peered":"2024-09-17T03:09:09.068638+0000","last_unstale":"2024-09-17T03:09:10.399547+0000","last_undegraded":"2024-09-17T03:09:10.399547+0000","last_fullsized":"2024-09-17T03:09:10.399547+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:05.546436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064930+0000","last_change":"2024-09-17T03:09:09.057605+0000","last_active":"2024-09-17T03:09:10.064930+0000","last_peered":"2024-09-17T03:09:10.064930+0000","last_clean":"2024-09-17T03:09:10.064930+0000","last_became_active":"2024-09-17T03:09:09.057192+0000","last_became_peered":"2024-09-17T03:09:09.057192+0000","last_unstale":"2024-09-17T03:09:10.064930+0000","last_undegraded":"2024-09-17T03:09:10.064930+0000","last_fullsized":"2024-09-17T03:09:10.064930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:31.326248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064358+0000","last_change":"2024-09-17T03:09:09.064382+0000","last_active":"2024-09-17T03:09:10.064358+0000","last_peered":"2024-09-17T03:09:10.064358+0000","last_clean":"2024-09-17T03:09:10.064358+0000","last_became_active":"2024-09-17T03:09:09.064019+0000","last_became_peered":"2024-09-17T03:09:09.064019+0000","last_unstale":"2024-09-17T03:09:10.064358+0000","last_undegraded":"2024-09-17T03:09:10.064358+0000","last_fullsized":"2024-09-17T03:09:10.064358+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:40.561271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.397833+0000","last_change":"2024-09-17T03:09:09.059525+0000","last_active":"2024-09-17T03:09:10.397833+0000","last_peered":"2024-09-17T03:09:10.397833+0000","last_clean":"2024-09-17T03:09:10.397833+0000","last_became_active":"2024-09-17T03:09:09.059231+0000","last_became_peered":"2024-09-17T03:09:09.059231+0000","last_unstale":"2024-09-17T03:09:10.397833+0000","last_undegraded":"2024-09-17T03:09:10.397833+0000","last_fullsized":"2024-09-17T03:09:10.397833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:58.745257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398300+0000","last_change":"2024-09-17T03:09:09.073368+0000","last_active":"2024-09-17T03:09:10.398300+0000","last_peered":"2024-09-17T03:09:10.398300+0000","last_clean":"2024-09-17T03:09:10.398300+0000","last_became_active":"2024-09-17T03:09:09.073083+0000","last_became_peered":"2024-09-17T03:09:09.073083+0000","last_unstale":"2024-09-17T03:09:10.398300+0000","last_undegraded":"2024-09-17T03:09:10.398300+0000","last_fullsized":"2024-09-17T03:09:10.398300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:26.611517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398352+0000","last_change":"2024-09-17T03:09:09.060548+0000","last_active":"2024-09-17T03:09:10.398352+0000","last_peered":"2024-09-17T03:09:10.398352+0000","last_clean":"2024-09-17T03:09:10.398352+0000","last_became_active":"2024-09-17T03:09:09.060283+0000","last_became_peered":"2024-09-17T03:09:09.060283+0000","last_unstale":"2024-09-17T03:09:10.398352+0000","last_undegraded":"2024-09-17T03:09:10.398352+0000","last_fullsized":"2024-09-17T03:09:10.398352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:42.350999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.048203+0000","last_change":"2024-09-17T03:09:08.048203+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.048203+0000","last_undegraded":"2024-09-17T03:09:08.048203+0000","last_fullsized":"2024-09-17T03:09:08.048203+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398497+0000","last_change":"2024-09-17T03:09:09.068233+0000","last_active":"2024-09-17T03:09:10.398497+0000","last_peered":"2024-09-17T03:09:10.398497+0000","last_clean":"2024-09-17T03:09:10.398497+0000","last_became_active":"2024-09-17T03:09:09.067932+0000","last_became_peered":"2024-09-17T03:09:09.067932+0000","last_unstale":"2024-09-17T03:09:10.398497+0000","last_undegraded":"2024-09-17T03:09:10.398497+0000","last_fullsized":"2024-09-17T03:09:10.398497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:43.473821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399076+0000","last_change":"2024-09-17T03:09:09.062636+0000","last_active":"2024-09-17T03:09:10.399076+0000","last_peered":"2024-09-17T03:09:10.399076+0000","last_clean":"2024-09-17T03:09:10.399076+0000","last_became_active":"2024-09-17T03:09:09.062332+0000","last_became_peered":"2024-09-17T03:09:09.062332+0000","last_unstale":"2024-09-17T03:09:10.399076+0000","last_undegraded":"2024-09-17T03:09:10.399076+0000","last_fullsized":"2024-09-17T03:09:10.399076+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:56.404367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.065099+0000","last_change":"2024-09-17T03:09:09.066806+0000","last_active":"2024-09-17T03:09:10.065099+0000","last_peered":"2024-09-17T03:09:10.065099+0000","last_clean":"2024-09-17T03:09:10.065099+0000","last_became_active":"2024-09-17T03:09:09.066455+0000","last_became_peered":"2024-09-17T03:09:09.066455+0000","last_unstale":"2024-09-17T03:09:10.065099+0000","last_undegraded":"2024-09-17T03:09:10.065099+0000","last_fullsized":"2024-09-17T03:09:10.065099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:44.437673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064258+0000","last_change":"2024-09-17T03:09:09.068504+0000","last_active":"2024-09-17T03:09:10.064258+0000","last_peered":"2024-09-17T03:09:10.064258+0000","last_clean":"2024-09-17T03:09:10.064258+0000","last_became_active":"2024-09-17T03:09:09.067738+0000","last_became_peered":"2024-09-17T03:09:09.067738+0000","last_unstale":"2024-09-17T03:09:10.064258+0000","last_undegraded":"2024-09-17T03:09:10.064258+0000","last_fullsized":"2024-09-17T03:09:10.064258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:42.805805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398300+0000","last_change":"2024-09-17T03:09:09.072152+0000","last_active":"2024-09-17T03:09:10.398300+0000","last_peered":"2024-09-17T03:09:10.398300+0000","last_clean":"2024-09-17T03:09:10.398300+0000","last_became_active":"2024-09-17T03:09:09.071842+0000","last_became_peered":"2024-09-17T03:09:09.071842+0000","last_unstale":"2024-09-17T03:09:10.398300+0000","last_undegraded":"2024-09-17T03:09:10.398300+0000","last_fullsized":"2024-09-17T03:09:10.398300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:33.181609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063402+0000","last_change":"2024-09-17T03:09:09.065893+0000","last_active":"2024-09-17T03:09:10.063402+0000","last_peered":"2024-09-17T03:09:10.063402+0000","last_clean":"2024-09-17T03:09:10.063402+0000","last_became_active":"2024-09-17T03:09:09.065562+0000","last_became_peered":"2024-09-17T03:09:09.065562+0000","last_unstale":"2024-09-17T03:09:10.063402+0000","last_undegraded":"2024-09-17T03:09:10.063402+0000","last_fullsized":"2024-09-17T03:09:10.063402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:26.611517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398322+0000","last_change":"2024-09-17T03:09:09.060502+0000","last_active":"2024-09-17T03:09:10.398322+0000","last_peered":"2024-09-17T03:09:10.398322+0000","last_clean":"2024-09-17T03:09:10.398322+0000","last_became_active":"2024-09-17T03:09:09.060184+0000","last_became_peered":"2024-09-17T03:09:09.060184+0000","last_unstale":"2024-09-17T03:09:10.398322+0000","last_undegraded":"2024-09-17T03:09:10.398322+0000","last_fullsized":"2024-09-17T03:09:10.398322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:40.561271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399251+0000","last_change":"2024-09-17T03:09:08.053451+0000","last_active":"2024-09-17T03:09:10.399251+0000","last_peered":"2024-09-17T03:09:10.399251+0000","last_clean":"2024-09-17T03:09:10.399251+0000","last_became_active":"2024-09-17T03:09:08.053061+0000","last_became_peered":"2024-09-17T03:09:08.053061+0000","last_unstale":"2024-09-17T03:09:10.399251+0000","last_undegraded":"2024-09-17T03:09:10.399251+0000","last_fullsized":"2024-09-17T03:09:10.399251+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:51:48.639447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399113+0000","last_change":"2024-09-17T03:09:09.053343+0000","last_active":"2024-09-17T03:09:10.399113+0000","last_peered":"2024-09-17T03:09:10.399113+0000","last_clean":"2024-09-17T03:09:10.399113+0000","last_became_active":"2024-09-17T03:09:09.053009+0000","last_became_peered":"2024-09-17T03:09:09.053009+0000","last_unstale":"2024-09-17T03:09:10.399113+0000","last_undegraded":"2024-09-17T03:09:10.399113+0000","last_fullsized":"2024-09-17T03:09:10.399113+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:20.680095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398385+0000","last_change":"2024-09-17T03:09:08.061966+0000","last_active":"2024-09-17T03:09:10.398385+0000","last_peered":"2024-09-17T03:09:10.398385+0000","last_clean":"2024-09-17T03:09:10.398385+0000","last_became_active":"2024-09-17T03:09:08.061339+0000","last_became_peered":"2024-09-17T03:09:08.061339+0000","last_unstale":"2024-09-17T03:09:10.398385+0000","last_undegraded":"2024-09-17T03:09:10.398385+0000","last_fullsized":"2024-09-17T03:09:10.398385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:06.066233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.065006+0000","last_change":"2024-09-17T03:09:09.068097+0000","last_active":"2024-09-17T03:09:10.065006+0000","last_peered":"2024-09-17T03:09:10.065006+0000","last_clean":"2024-09-17T03:09:10.065006+0000","last_became_active":"2024-09-17T03:09:09.067740+0000","last_became_peered":"2024-09-17T03:09:09.067740+0000","last_unstale":"2024-09-17T03:09:10.065006+0000","last_undegraded":"2024-09-17T03:09:10.065006+0000","last_fullsized":"2024-09-17T03:09:10.065006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:31.152317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.065314+0000","last_change":"2024-09-17T03:09:08.063470+0000","last_active":"2024-09-17T03:09:08.065314+0000","last_peered":"2024-09-17T03:09:08.065314+0000","last_clean":"2024-09-17T03:09:08.065314+0000","last_became_active":"2024-09-17T03:09:08.063167+0000","last_became_peered":"2024-09-17T03:09:08.063167+0000","last_unstale":"2024-09-17T03:09:08.065314+0000","last_undegraded":"2024-09-17T03:09:08.065314+0000","last_fullsized":"2024-09-17T03:09:08.065314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:41.473395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398597+0000","last_change":"2024-09-17T03:09:09.058646+0000","last_active":"2024-09-17T03:09:10.398597+0000","last_peered":"2024-09-17T03:09:10.398597+0000","last_clean":"2024-09-17T03:09:10.398597+0000","last_became_active":"2024-09-17T03:09:09.058178+0000","last_became_peered":"2024-09-17T03:09:09.058178+0000","last_unstale":"2024-09-17T03:09:10.398597+0000","last_undegraded":"2024-09-17T03:09:10.398597+0000","last_fullsized":"2024-09-17T03:09:10.398597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:13.553036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399393+0000","last_change":"2024-09-17T03:09:08.059405+0000","last_active":"2024-09-17T03:09:10.399393+0000","last_peered":"2024-09-17T03:09:10.399393+0000","last_clean":"2024-09-17T03:09:10.399393+0000","last_became_active":"2024-09-17T03:09:08.059055+0000","last_became_peered":"2024-09-17T03:09:08.059055+0000","last_unstale":"2024-09-17T03:09:10.399393+0000","last_undegraded":"2024-09-17T03:09:10.399393+0000","last_fullsized":"2024-09-17T03:09:10.399393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:45.319468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064330+0000","last_change":"2024-09-17T03:09:09.062953+0000","last_active":"2024-09-17T03:09:10.064330+0000","last_peered":"2024-09-17T03:09:10.064330+0000","last_clean":"2024-09-17T03:09:10.064330+0000","last_became_active":"2024-09-17T03:09:09.062566+0000","last_became_peered":"2024-09-17T03:09:09.062566+0000","last_unstale":"2024-09-17T03:09:10.064330+0000","last_undegraded":"2024-09-17T03:09:10.064330+0000","last_fullsized":"2024-09-17T03:09:10.064330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:43.534220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.065079+0000","last_change":"2024-09-17T03:09:08.063533+0000","last_active":"2024-09-17T03:09:10.065079+0000","last_peered":"2024-09-17T03:09:10.065079+0000","last_clean":"2024-09-17T03:09:10.065079+0000","last_became_active":"2024-09-17T03:09:08.063043+0000","last_became_peered":"2024-09-17T03:09:08.063043+0000","last_unstale":"2024-09-17T03:09:10.065079+0000","last_undegraded":"2024-09-17T03:09:10.065079+0000","last_fullsized":"2024-09-17T03:09:10.065079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:04.544022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398715+0000","last_change":"2024-09-17T03:09:09.063107+0000","last_active":"2024-09-17T03:09:10.398715+0000","last_peered":"2024-09-17T03:09:10.398715+0000","last_clean":"2024-09-17T03:09:10.398715+0000","last_became_active":"2024-09-17T03:09:09.062676+0000","last_became_peered":"2024-09-17T03:09:09.062676+0000","last_unstale":"2024-09-17T03:09:10.398715+0000","last_undegraded":"2024-09-17T03:09:10.398715+0000","last_fullsized":"2024-09-17T03:09:10.398715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:53.501404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064478+0000","last_change":"2024-09-17T03:09:08.057250+0000","last_active":"2024-09-17T03:09:10.064478+0000","last_peered":"2024-09-17T03:09:10.064478+0000","last_clean":"2024-09-17T03:09:10.064478+0000","last_became_active":"2024-09-17T03:09:08.056483+0000","last_became_peered":"2024-09-17T03:09:08.056483+0000","last_unstale":"2024-09-17T03:09:10.064478+0000","last_undegraded":"2024-09-17T03:09:10.064478+0000","last_fullsized":"2024-09-17T03:09:10.064478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:52.050173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063351+0000","last_change":"2024-09-17T03:09:09.052601+0000","last_active":"2024-09-17T03:09:10.063351+0000","last_peered":"2024-09-17T03:09:10.063351+0000","last_clean":"2024-09-17T03:09:10.063351+0000","last_became_active":"2024-09-17T03:09:09.052290+0000","last_became_peered":"2024-09-17T03:09:09.052290+0000","last_unstale":"2024-09-17T03:09:10.063351+0000","last_undegraded":"2024-09-17T03:09:10.063351+0000","last_fullsized":"2024-09-17T03:09:10.063351+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:58.745257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.062444+0000","last_change":"2024-09-17T03:09:08.056853+0000","last_active":"2024-09-17T03:09:08.062444+0000","last_peered":"2024-09-17T03:09:08.062444+0000","last_clean":"2024-09-17T03:09:08.062444+0000","last_became_active":"2024-09-17T03:09:08.055877+0000","last_became_peered":"2024-09-17T03:09:08.055877+0000","last_unstale":"2024-09-17T03:09:08.062444+0000","last_undegraded":"2024-09-17T03:09:08.062444+0000","last_fullsized":"2024-09-17T03:09:08.062444+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:54.777021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398050+0000","last_change":"2024-09-17T03:09:09.067603+0000","last_active":"2024-09-17T03:09:10.398050+0000","last_peered":"2024-09-17T03:09:10.398050+0000","last_clean":"2024-09-17T03:09:10.398050+0000","last_became_active":"2024-09-17T03:09:09.067278+0000","last_became_peered":"2024-09-17T03:09:09.067278+0000","last_unstale":"2024-09-17T03:09:10.398050+0000","last_undegraded":"2024-09-17T03:09:10.398050+0000","last_fullsized":"2024-09-17T03:09:10.398050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:33.280606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063372+0000","last_change":"2024-09-17T03:09:08.057693+0000","last_active":"2024-09-17T03:09:10.063372+0000","last_peered":"2024-09-17T03:09:10.063372+0000","last_clean":"2024-09-17T03:09:10.063372+0000","last_became_active":"2024-09-17T03:09:08.056574+0000","last_became_peered":"2024-09-17T03:09:08.056574+0000","last_unstale":"2024-09-17T03:09:10.063372+0000","last_undegraded":"2024-09-17T03:09:10.063372+0000","last_fullsized":"2024-09-17T03:09:10.063372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:43.836200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398956+0000","last_change":"2024-09-17T03:09:09.072417+0000","last_active":"2024-09-17T03:09:10.398956+0000","last_peered":"2024-09-17T03:09:10.398956+0000","last_clean":"2024-09-17T03:09:10.398956+0000","last_became_active":"2024-09-17T03:09:09.072123+0000","last_became_peered":"2024-09-17T03:09:09.072123+0000","last_unstale":"2024-09-17T03:09:10.398956+0000","last_undegraded":"2024-09-17T03:09:10.398956+0000","last_fullsized":"2024-09-17T03:09:10.398956+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:51.790145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.063712+0000","last_change":"2024-09-17T03:09:08.060540+0000","last_active":"2024-09-17T03:09:08.063712+0000","last_peered":"2024-09-17T03:09:08.063712+0000","last_clean":"2024-09-17T03:09:08.063712+0000","last_became_active":"2024-09-17T03:09:08.060242+0000","last_became_peered":"2024-09-17T03:09:08.060242+0000","last_unstale":"2024-09-17T03:09:08.063712+0000","last_undegraded":"2024-09-17T03:09:08.063712+0000","last_fullsized":"2024-09-17T03:09:08.063712+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:30.592642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.048265+0000","last_change":"2024-09-17T03:09:08.048265+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.048265+0000","last_undegraded":"2024-09-17T03:09:08.048265+0000","last_fullsized":"2024-09-17T03:09:08.048265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398442+0000","last_change":"2024-09-17T03:09:08.057341+0000","last_active":"2024-09-17T03:09:10.398442+0000","last_peered":"2024-09-17T03:09:10.398442+0000","last_clean":"2024-09-17T03:09:10.398442+0000","last_became_active":"2024-09-17T03:09:08.056698+0000","last_became_peered":"2024-09-17T03:09:08.056698+0000","last_unstale":"2024-09-17T03:09:10.398442+0000","last_undegraded":"2024-09-17T03:09:10.398442+0000","last_fullsized":"2024-09-17T03:09:10.398442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:38.119644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.047493+0000","last_change":"2024-09-17T03:09:08.047493+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.047493+0000","last_undegraded":"2024-09-17T03:09:08.047493+0000","last_fullsized":"2024-09-17T03:09:08.047493+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399253+0000","last_change":"2024-09-17T03:09:08.059378+0000","last_active":"2024-09-17T03:09:10.399253+0000","last_peered":"2024-09-17T03:09:10.399253+0000","last_clean":"2024-09-17T03:09:10.399253+0000","last_became_active":"2024-09-17T03:09:08.059036+0000","last_became_peered":"2024-09-17T03:09:08.059036+0000","last_unstale":"2024-09-17T03:09:10.399253+0000","last_undegraded":"2024-09-17T03:09:10.399253+0000","last_fullsized":"2024-09-17T03:09:10.399253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:41.341210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399030+0000","last_change":"2024-09-17T03:09:09.076754+0000","last_active":"2024-09-17T03:09:10.399030+0000","last_peered":"2024-09-17T03:09:10.399030+0000","last_clean":"2024-09-17T03:09:10.399030+0000","last_became_active":"2024-09-17T03:09:09.076456+0000","last_became_peered":"2024-09-17T03:09:09.076456+0000","last_unstale":"2024-09-17T03:09:10.399030+0000","last_undegraded":"2024-09-17T03:09:10.399030+0000","last_fullsized":"2024-09-17T03:09:10.399030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:16.171276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.066079+0000","last_change":"2024-09-17T03:09:08.064681+0000","last_active":"2024-09-17T03:09:08.066079+0000","last_peered":"2024-09-17T03:09:08.066079+0000","last_clean":"2024-09-17T03:09:08.066079+0000","last_became_active":"2024-09-17T03:09:08.064261+0000","last_became_peered":"2024-09-17T03:09:08.064261+0000","last_unstale":"2024-09-17T03:09:08.066079+0000","last_undegraded":"2024-09-17T03:09:08.066079+0000","last_fullsized":"2024-09-17T03:09:08.066079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:09.600555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.397934+0000","last_change":"2024-09-17T03:09:09.069589+0000","last_active":"2024-09-17T03:09:10.397934+0000","last_peered":"2024-09-17T03:09:10.397934+0000","last_clean":"2024-09-17T03:09:10.397934+0000","last_became_active":"2024-09-17T03:09:09.068937+0000","last_became_peered":"2024-09-17T03:09:09.068937+0000","last_unstale":"2024-09-17T03:09:10.397934+0000","last_undegraded":"2024-09-17T03:09:10.397934+0000","last_fullsized":"2024-09-17T03:09:10.397934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:25.581359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.065192+0000","last_change":"2024-09-17T03:09:08.058056+0000","last_active":"2024-09-17T03:09:10.065192+0000","last_peered":"2024-09-17T03:09:10.065192+0000","last_clean":"2024-09-17T03:09:10.065192+0000","last_became_active":"2024-09-17T03:09:08.057289+0000","last_became_peered":"2024-09-17T03:09:08.057289+0000","last_unstale":"2024-09-17T03:09:10.065192+0000","last_undegraded":"2024-09-17T03:09:10.065192+0000","last_fullsized":"2024-09-17T03:09:10.065192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:53.710433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.048426+0000","last_change":"2024-09-17T03:09:08.048426+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.048426+0000","last_undegraded":"2024-09-17T03:09:08.048426+0000","last_fullsized":"2024-09-17T03:09:08.048426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398058+0000","last_change":"2024-09-17T03:09:08.062488+0000","last_active":"2024-09-17T03:09:10.398058+0000","last_peered":"2024-09-17T03:09:10.398058+0000","last_clean":"2024-09-17T03:09:10.398058+0000","last_became_active":"2024-09-17T03:09:08.062169+0000","last_became_peered":"2024-09-17T03:09:08.062169+0000","last_unstale":"2024-09-17T03:09:10.398058+0000","last_undegraded":"2024-09-17T03:09:10.398058+0000","last_fullsized":"2024-09-17T03:09:10.398058+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:24.391021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063583+0000","last_change":"2024-09-17T03:09:09.065818+0000","last_active":"2024-09-17T03:09:10.063583+0000","last_peered":"2024-09-17T03:09:10.063583+0000","last_clean":"2024-09-17T03:09:10.063583+0000","last_became_active":"2024-09-17T03:09:09.065497+0000","last_became_peered":"2024-09-17T03:09:09.065497+0000","last_unstale":"2024-09-17T03:09:10.063583+0000","last_undegraded":"2024-09-17T03:09:10.063583+0000","last_fullsized":"2024-09-17T03:09:10.063583+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:53.501404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.063739+0000","last_change":"2024-09-17T03:09:08.061406+0000","last_active":"2024-09-17T03:09:08.063739+0000","last_peered":"2024-09-17T03:09:08.063739+0000","last_clean":"2024-09-17T03:09:08.063739+0000","last_became_active":"2024-09-17T03:09:08.061113+0000","last_became_peered":"2024-09-17T03:09:08.061113+0000","last_unstale":"2024-09-17T03:09:08.063739+0000","last_undegraded":"2024-09-17T03:09:08.063739+0000","last_fullsized":"2024-09-17T03:09:08.063739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:34:42.509000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398628+0000","last_change":"2024-09-17T03:09:09.053985+0000","last_active":"2024-09-17T03:09:10.398628+0000","last_peered":"2024-09-17T03:09:10.398628+0000","last_clean":"2024-09-17T03:09:10.398628+0000","last_became_active":"2024-09-17T03:09:09.053570+0000","last_became_peered":"2024-09-17T03:09:09.053570+0000","last_unstale":"2024-09-17T03:09:10.398628+0000","last_undegraded":"2024-09-17T03:09:10.398628+0000","last_fullsized":"2024-09-17T03:09:10.398628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:44.231320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.065280+0000","last_change":"2024-09-17T03:09:08.063624+0000","last_active":"2024-09-17T03:09:08.065280+0000","last_peered":"2024-09-17T03:09:08.065280+0000","last_clean":"2024-09-17T03:09:08.065280+0000","last_became_active":"2024-09-17T03:09:08.063309+0000","last_became_peered":"2024-09-17T03:09:08.063309+0000","last_unstale":"2024-09-17T03:09:08.065280+0000","last_undegraded":"2024-09-17T03:09:08.065280+0000","last_fullsized":"2024-09-17T03:09:08.065280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:24.663278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064720+0000","last_change":"2024-09-17T03:09:09.063058+0000","last_active":"2024-09-17T03:09:10.064720+0000","last_peered":"2024-09-17T03:09:10.064720+0000","last_clean":"2024-09-17T03:09:10.064720+0000","last_became_active":"2024-09-17T03:09:09.062719+0000","last_became_peered":"2024-09-17T03:09:09.062719+0000","last_unstale":"2024-09-17T03:09:10.064720+0000","last_undegraded":"2024-09-17T03:09:10.064720+0000","last_fullsized":"2024-09-17T03:09:10.064720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:46.600239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398560+0000","last_change":"2024-09-17T03:09:08.063387+0000","last_active":"2024-09-17T03:09:10.398560+0000","last_peered":"2024-09-17T03:09:10.398560+0000","last_clean":"2024-09-17T03:09:10.398560+0000","last_became_active":"2024-09-17T03:09:08.063007+0000","last_became_peered":"2024-09-17T03:09:08.063007+0000","last_unstale":"2024-09-17T03:09:10.398560+0000","last_undegraded":"2024-09-17T03:09:10.398560+0000","last_fullsized":"2024-09-17T03:09:10.398560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:22.627573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399483+0000","last_change":"2024-09-17T03:09:09.071547+0000","last_active":"2024-09-17T03:09:10.399483+0000","last_peered":"2024-09-17T03:09:10.399483+0000","last_clean":"2024-09-17T03:09:10.399483+0000","last_became_active":"2024-09-17T03:09:09.071140+0000","last_became_peered":"2024-09-17T03:09:09.071140+0000","last_unstale":"2024-09-17T03:09:10.399483+0000","last_undegraded":"2024-09-17T03:09:10.399483+0000","last_fullsized":"2024-09-17T03:09:10.399483+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:43.534220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064669+0000","last_change":"2024-09-17T03:09:08.057279+0000","last_active":"2024-09-17T03:09:10.064669+0000","last_peered":"2024-09-17T03:09:10.064669+0000","last_clean":"2024-09-17T03:09:10.064669+0000","last_became_active":"2024-09-17T03:09:08.056908+0000","last_became_peered":"2024-09-17T03:09:08.056908+0000","last_unstale":"2024-09-17T03:09:10.064669+0000","last_undegraded":"2024-09-17T03:09:10.064669+0000","last_fullsized":"2024-09-17T03:09:10.064669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:28.765247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398691+0000","last_change":"2024-09-17T03:09:09.058087+0000","last_active":"2024-09-17T03:09:10.398691+0000","last_peered":"2024-09-17T03:09:10.398691+0000","last_clean":"2024-09-17T03:09:10.398691+0000","last_became_active":"2024-09-17T03:09:09.057564+0000","last_became_peered":"2024-09-17T03:09:09.057564+0000","last_unstale":"2024-09-17T03:09:10.398691+0000","last_undegraded":"2024-09-17T03:09:10.398691+0000","last_fullsized":"2024-09-17T03:09:10.398691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:58.128694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064681+0000","last_change":"2024-09-17T03:09:08.059458+0000","last_active":"2024-09-17T03:09:10.064681+0000","last_peered":"2024-09-17T03:09:10.064681+0000","last_clean":"2024-09-17T03:09:10.064681+0000","last_became_active":"2024-09-17T03:09:08.059154+0000","last_became_peered":"2024-09-17T03:09:08.059154+0000","last_unstale":"2024-09-17T03:09:10.064681+0000","last_undegraded":"2024-09-17T03:09:10.064681+0000","last_fullsized":"2024-09-17T03:09:10.064681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:37.260736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399609+0000","last_change":"2024-09-17T03:09:09.068686+0000","last_active":"2024-09-17T03:09:10.399609+0000","last_peered":"2024-09-17T03:09:10.399609+0000","last_clean":"2024-09-17T03:09:10.399609+0000","last_became_active":"2024-09-17T03:09:09.068379+0000","last_became_peered":"2024-09-17T03:09:09.068379+0000","last_unstale":"2024-09-17T03:09:10.399609+0000","last_undegraded":"2024-09-17T03:09:10.399609+0000","last_fullsized":"2024-09-17T03:09:10.399609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:49.038974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064901+0000","last_change":"2024-09-17T03:09:08.063762+0000","last_active":"2024-09-17T03:09:10.064901+0000","last_peered":"2024-09-17T03:09:10.064901+0000","last_clean":"2024-09-17T03:09:10.064901+0000","last_became_active":"2024-09-17T03:09:08.062961+0000","last_became_peered":"2024-09-17T03:09:08.062961+0000","last_unstale":"2024-09-17T03:09:10.064901+0000","last_undegraded":"2024-09-17T03:09:10.064901+0000","last_fullsized":"2024-09-17T03:09:10.064901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:48.036560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399275+0000","last_change":"2024-09-17T03:09:09.073022+0000","last_active":"2024-09-17T03:09:10.399275+0000","last_peered":"2024-09-17T03:09:10.399275+0000","last_clean":"2024-09-17T03:09:10.399275+0000","last_became_active":"2024-09-17T03:09:09.072707+0000","last_became_peered":"2024-09-17T03:09:09.072707+0000","last_unstale":"2024-09-17T03:09:10.399275+0000","last_undegraded":"2024-09-17T03:09:10.399275+0000","last_fullsized":"2024-09-17T03:09:10.399275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:29.767661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398833+0000","last_change":"2024-09-17T03:09:08.057529+0000","last_active":"2024-09-17T03:09:10.398833+0000","last_peered":"2024-09-17T03:09:10.398833+0000","last_clean":"2024-09-17T03:09:10.398833+0000","last_became_active":"2024-09-17T03:09:08.057217+0000","last_became_peered":"2024-09-17T03:09:08.057217+0000","last_unstale":"2024-09-17T03:09:10.398833+0000","last_undegraded":"2024-09-17T03:09:10.398833+0000","last_fullsized":"2024-09-17T03:09:10.398833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:48.036560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399407+0000","last_change":"2024-09-17T03:09:09.069460+0000","last_active":"2024-09-17T03:09:10.399407+0000","last_peered":"2024-09-17T03:09:10.399407+0000","last_clean":"2024-09-17T03:09:10.399407+0000","last_became_active":"2024-09-17T03:09:09.069124+0000","last_became_peered":"2024-09-17T03:09:09.069124+0000","last_unstale":"2024-09-17T03:09:10.399407+0000","last_undegraded":"2024-09-17T03:09:10.399407+0000","last_fullsized":"2024-09-17T03:09:10.399407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:53.052587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398879+0000","last_change":"2024-09-17T03:09:08.060468+0000","last_active":"2024-09-17T03:09:10.398879+0000","last_peered":"2024-09-17T03:09:10.398879+0000","last_clean":"2024-09-17T03:09:10.398879+0000","last_became_active":"2024-09-17T03:09:08.060102+0000","last_became_peered":"2024-09-17T03:09:08.060102+0000","last_unstale":"2024-09-17T03:09:10.398879+0000","last_undegraded":"2024-09-17T03:09:10.398879+0000","last_fullsized":"2024-09-17T03:09:10.398879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:50.441311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398964+0000","last_change":"2024-09-17T03:09:09.067434+0000","last_active":"2024-09-17T03:09:10.398964+0000","last_peered":"2024-09-17T03:09:10.398964+0000","last_clean":"2024-09-17T03:09:10.398964+0000","last_became_active":"2024-09-17T03:09:09.067094+0000","last_became_peered":"2024-09-17T03:09:09.067094+0000","last_unstale":"2024-09-17T03:09:10.398964+0000","last_undegraded":"2024-09-17T03:09:10.398964+0000","last_fullsized":"2024-09-17T03:09:10.398964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:02.789448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063742+0000","last_change":"2024-09-17T03:09:08.063727+0000","last_active":"2024-09-17T03:09:10.063742+0000","last_peered":"2024-09-17T03:09:10.063742+0000","last_clean":"2024-09-17T03:09:10.063742+0000","last_became_active":"2024-09-17T03:09:08.063397+0000","last_became_peered":"2024-09-17T03:09:08.063397+0000","last_unstale":"2024-09-17T03:09:10.063742+0000","last_undegraded":"2024-09-17T03:09:10.063742+0000","last_fullsized":"2024-09-17T03:09:10.063742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:01.787034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063443+0000","last_change":"2024-09-17T03:09:09.068161+0000","last_active":"2024-09-17T03:09:10.063443+0000","last_peered":"2024-09-17T03:09:10.063443+0000","last_clean":"2024-09-17T03:09:10.063443+0000","last_became_active":"2024-09-17T03:09:09.067848+0000","last_became_peered":"2024-09-17T03:09:09.067848+0000","last_unstale":"2024-09-17T03:09:10.063443+0000","last_undegraded":"2024-09-17T03:09:10.063443+0000","last_fullsized":"2024-09-17T03:09:10.063443+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:37.353848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398207+0000","last_change":"2024-09-17T03:09:08.061649+0000","last_active":"2024-09-17T03:09:10.398207+0000","last_peered":"2024-09-17T03:09:10.398207+0000","last_clean":"2024-09-17T03:09:10.398207+0000","last_became_active":"2024-09-17T03:09:08.061266+0000","last_became_peered":"2024-09-17T03:09:08.061266+0000","last_unstale":"2024-09-17T03:09:10.398207+0000","last_undegraded":"2024-09-17T03:09:10.398207+0000","last_fullsized":"2024-09-17T03:09:10.398207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:57.742843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399488+0000","last_change":"2024-09-17T03:09:09.068117+0000","last_active":"2024-09-17T03:09:10.399488+0000","last_peered":"2024-09-17T03:09:10.399488+0000","last_clean":"2024-09-17T03:09:10.399488+0000","last_became_active":"2024-09-17T03:09:09.067796+0000","last_became_peered":"2024-09-17T03:09:09.067796+0000","last_unstale":"2024-09-17T03:09:10.399488+0000","last_undegraded":"2024-09-17T03:09:10.399488+0000","last_fullsized":"2024-09-17T03:09:10.399488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:54.712846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398643+0000","last_change":"2024-09-17T03:09:08.063699+0000","last_active":"2024-09-17T03:09:10.398643+0000","last_peered":"2024-09-17T03:09:10.398643+0000","last_clean":"2024-09-17T03:09:10.398643+0000","last_became_active":"2024-09-17T03:09:08.063369+0000","last_became_peered":"2024-09-17T03:09:08.063369+0000","last_unstale":"2024-09-17T03:09:10.398643+0000","last_undegraded":"2024-09-17T03:09:10.398643+0000","last_fullsized":"2024-09-17T03:09:10.398643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:07.142563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399550+0000","last_change":"2024-09-17T03:09:09.074289+0000","last_active":"2024-09-17T03:09:10.399550+0000","last_peered":"2024-09-17T03:09:10.399550+0000","last_clean":"2024-09-17T03:09:10.399550+0000","last_became_active":"2024-09-17T03:09:09.073997+0000","last_became_peered":"2024-09-17T03:09:09.073997+0000","last_unstale":"2024-09-17T03:09:10.399550+0000","last_undegraded":"2024-09-17T03:09:10.399550+0000","last_fullsized":"2024-09-17T03:09:10.399550+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:07.265233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:11.046702+0000","last_change":"2024-09-17T03:09:08.057660+0000","last_active":"2024-09-17T03:09:11.046702+0000","last_peered":"2024-09-17T03:09:11.046702+0000","last_clean":"2024-09-17T03:09:11.046702+0000","last_became_active":"2024-09-17T03:09:08.057073+0000","last_became_peered":"2024-09-17T03:09:08.057073+0000","last_unstale":"2024-09-17T03:09:11.046702+0000","last_undegraded":"2024-09-17T03:09:11.046702+0000","last_fullsized":"2024-09-17T03:09:11.046702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:56.615625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398093+0000","last_change":"2024-09-17T03:09:09.067267+0000","last_active":"2024-09-17T03:09:10.398093+0000","last_peered":"2024-09-17T03:09:10.398093+0000","last_clean":"2024-09-17T03:09:10.398093+0000","last_became_active":"2024-09-17T03:09:09.066974+0000","last_became_peered":"2024-09-17T03:09:09.066974+0000","last_unstale":"2024-09-17T03:09:10.398093+0000","last_undegraded":"2024-09-17T03:09:10.398093+0000","last_fullsized":"2024-09-17T03:09:10.398093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:49.551254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398652+0000","last_change":"2024-09-17T03:09:08.057147+0000","last_active":"2024-09-17T03:09:10.398652+0000","last_peered":"2024-09-17T03:09:10.398652+0000","last_clean":"2024-09-17T03:09:10.398652+0000","last_became_active":"2024-09-17T03:09:08.056824+0000","last_became_peered":"2024-09-17T03:09:08.056824+0000","last_unstale":"2024-09-17T03:09:10.398652+0000","last_undegraded":"2024-09-17T03:09:10.398652+0000","last_fullsized":"2024-09-17T03:09:10.398652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:59:04.901816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398874+0000","last_change":"2024-09-17T03:09:09.054908+0000","last_active":"2024-09-17T03:09:10.398874+0000","last_peered":"2024-09-17T03:09:10.398874+0000","last_clean":"2024-09-17T03:09:10.398874+0000","last_became_active":"2024-09-17T03:09:09.054575+0000","last_became_peered":"2024-09-17T03:09:09.054575+0000","last_unstale":"2024-09-17T03:09:10.398874+0000","last_undegraded":"2024-09-17T03:09:10.398874+0000","last_fullsized":"2024-09-17T03:09:10.398874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:07.225499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399005+0000","last_change":"2024-09-17T03:09:08.054377+0000","last_active":"2024-09-17T03:09:10.399005+0000","last_peered":"2024-09-17T03:09:10.399005+0000","last_clean":"2024-09-17T03:09:10.399005+0000","last_became_active":"2024-09-17T03:09:08.054048+0000","last_became_peered":"2024-09-17T03:09:08.054048+0000","last_unstale":"2024-09-17T03:09:10.399005+0000","last_undegraded":"2024-09-17T03:09:10.399005+0000","last_fullsized":"2024-09-17T03:09:10.399005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:27.059986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398914+0000","last_change":"2024-09-17T03:09:09.050873+0000","last_active":"2024-09-17T03:09:10.398914+0000","last_peered":"2024-09-17T03:09:10.398914+0000","last_clean":"2024-09-17T03:09:10.398914+0000","last_became_active":"2024-09-17T03:09:09.050511+0000","last_became_peered":"2024-09-17T03:09:09.050511+0000","last_unstale":"2024-09-17T03:09:10.398914+0000","last_undegraded":"2024-09-17T03:09:10.398914+0000","last_fullsized":"2024-09-17T03:09:10.398914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:46.600239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398165+0000","last_change":"2024-09-17T03:09:08.063491+0000","last_active":"2024-09-17T03:09:10.398165+0000","last_peered":"2024-09-17T03:09:10.398165+0000","last_clean":"2024-09-17T03:09:10.398165+0000","last_became_active":"2024-09-17T03:09:08.063182+0000","last_became_peered":"2024-09-17T03:09:08.063182+0000","last_unstale":"2024-09-17T03:09:10.398165+0000","last_undegraded":"2024-09-17T03:09:10.398165+0000","last_fullsized":"2024-09-17T03:09:10.398165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:17.411826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2024-09-17T03:09:08.047509+0000","last_change":"2024-09-17T03:09:08.047509+0000","last_active":"2024-09-17T03:09:08.032499+0000","last_peered":"2024-09-17T03:09:08.032499+0000","last_clean":"2024-09-17T03:09:08.032499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:09:08.047509+0000","last_undegraded":"2024-09-17T03:09:08.047509+0000","last_fullsized":"2024-09-17T03:09:08.047509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063851+0000","last_change":"2024-09-17T03:09:08.056515+0000","last_active":"2024-09-17T03:09:10.063851+0000","last_peered":"2024-09-17T03:09:10.063851+0000","last_clean":"2024-09-17T03:09:10.063851+0000","last_became_active":"2024-09-17T03:09:08.056181+0000","last_became_peered":"2024-09-17T03:09:08.056181+0000","last_unstale":"2024-09-17T03:09:10.063851+0000","last_undegraded":"2024-09-17T03:09:10.063851+0000","last_fullsized":"2024-09-17T03:09:10.063851+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:29.580524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063617+0000","last_change":"2024-09-17T03:09:09.066357+0000","last_active":"2024-09-17T03:09:10.063617+0000","last_peered":"2024-09-17T03:09:10.063617+0000","last_clean":"2024-09-17T03:09:10.063617+0000","last_became_active":"2024-09-17T03:09:09.066001+0000","last_became_peered":"2024-09-17T03:09:09.066001+0000","last_unstale":"2024-09-17T03:09:10.063617+0000","last_undegraded":"2024-09-17T03:09:10.063617+0000","last_fullsized":"2024-09-17T03:09:10.063617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:49.551254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-17T03:09:08.065164+0000","last_change":"2024-09-17T03:09:08.062609+0000","last_active":"2024-09-17T03:09:08.065164+0000","last_peered":"2024-09-17T03:09:08.065164+0000","last_clean":"2024-09-17T03:09:08.065164+0000","last_became_active":"2024-09-17T03:09:08.062155+0000","last_became_peered":"2024-09-17T03:09:08.062155+0000","last_unstale":"2024-09-17T03:09:08.065164+0000","last_undegraded":"2024-09-17T03:09:08.065164+0000","last_fullsized":"2024-09-17T03:09:08.065164+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:41:27.472946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064065+0000","last_change":"2024-09-17T03:09:09.070601+0000","last_active":"2024-09-17T03:09:10.064065+0000","last_peered":"2024-09-17T03:09:10.064065+0000","last_clean":"2024-09-17T03:09:10.064065+0000","last_became_active":"2024-09-17T03:09:09.070169+0000","last_became_peered":"2024-09-17T03:09:09.070169+0000","last_unstale":"2024-09-17T03:09:10.064065+0000","last_undegraded":"2024-09-17T03:09:10.064065+0000","last_fullsized":"2024-09-17T03:09:10.064065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:56.404367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398718+0000","last_change":"2024-09-17T03:09:08.052626+0000","last_active":"2024-09-17T03:09:10.398718+0000","last_peered":"2024-09-17T03:09:10.398718+0000","last_clean":"2024-09-17T03:09:10.398718+0000","last_became_active":"2024-09-17T03:09:08.052258+0000","last_became_peered":"2024-09-17T03:09:08.052258+0000","last_unstale":"2024-09-17T03:09:10.398718+0000","last_undegraded":"2024-09-17T03:09:10.398718+0000","last_fullsized":"2024-09-17T03:09:10.398718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:33.963979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":130,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063658+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:09:10.063658+0000","last_peered":"2024-09-17T03:09:10.063658+0000","last_clean":"2024-09-17T03:09:10.063658+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:09:10.063658+0000","last_undegraded":"2024-09-17T03:09:10.063658+0000","last_fullsized":"2024-09-17T03:09:10.063658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":974848,"data_stored":735757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":372736,"data_stored":139615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":385024,"data_stored":145971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":385024,"data_stored":145403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":380928,"data_stored":145369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":140633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":970752,"data_stored":735667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":339968,"data_stored":125957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:09:13.719 INFO:tasks.ceph.mds.a.smithi078.stderr:2024-09-17T03:09:13.721+0000 7f7e8d854640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:09:16.496 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:09:16.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.622+0000 7f0af240a640 1 -- 172.21.15.78:0/140825373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aec0d0e50 msgr2=0x7f0aec0d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:16.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.622+0000 7f0af240a640 1 --2- 172.21.15.78:0/140825373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aec0d0e50 0x7f0aec0d1260 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4005fd0 tx=0x7f0ae402a8d0 comp rx=0 tx=0).stop 2024-09-17T03:09:16.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.622+0000 7f0af240a640 1 -- 172.21.15.78:0/140825373 shutdown_connections 2024-09-17T03:09:16.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.622+0000 7f0af240a640 1 --2- 172.21.15.78:0/140825373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aec0d0e50 0x7f0aec0d1260 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:16.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.622+0000 7f0af240a640 1 --2- 172.21.15.78:0/140825373 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0aec06e0a0 0x7f0aec0b97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:16.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.622+0000 7f0af240a640 1 -- 172.21.15.78:0/140825373 >> 172.21.15.78:0/140825373 conn(0x7f0aec09d840 msgr2=0x7f0aec08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:16.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.622+0000 7f0af240a640 1 -- 172.21.15.78:0/140825373 shutdown_connections 2024-09-17T03:09:16.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.622+0000 7f0af240a640 1 -- 172.21.15.78:0/140825373 wait complete. 2024-09-17T03:09:16.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.624+0000 7f0af240a640 1 Processor -- start 2024-09-17T03:09:16.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.624+0000 7f0af240a640 1 -- start start 2024-09-17T03:09:16.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.626+0000 7f0af240a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0aec06e0a0 0x7f0aec160830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:16.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.626+0000 7f0af240a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0aec06f6e0 0x7f0aec151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:16.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.626+0000 7f0af240a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aec0d0e50 0x7f0aec0b6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:16.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.626+0000 7f0af240a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec0cfea0 con 0x7f0aec0d0e50 2024-09-17T03:09:16.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.626+0000 7f0af240a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec0cfd20 con 0x7f0aec06e0a0 2024-09-17T03:09:16.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.626+0000 7f0af240a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0aec0d0020 con 0x7f0aec06f6e0 2024-09-17T03:09:16.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.626+0000 7f0af09a7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aec0d0e50 0x7f0aec0b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:16.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.626+0000 7f0af09a7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aec0d0e50 0x7f0aec0b6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55946/0 (socket says 172.21.15.78:55946) 2024-09-17T03:09:16.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.626+0000 7f0aebfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0aec06e0a0 0x7f0aec160830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:16.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.626+0000 7f0af09a7640 1 -- 172.21.15.78:0/1681152234 learned_addr learned my addr 172.21.15.78:0/1681152234 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:16.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.626+0000 7f0aeb7fe640 1 --2- 172.21.15.78:0/1681152234 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0aec06f6e0 0x7f0aec151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:16.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.626+0000 7f0af09a7640 1 -- 172.21.15.78:0/1681152234 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0aec06f6e0 msgr2=0x7f0aec151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.626+0000 7f0af09a7640 1 --2- 172.21.15.78:0/1681152234 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0aec06f6e0 0x7f0aec151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.626+0000 7f0af09a7640 1 -- 172.21.15.78:0/1681152234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0aec06e0a0 msgr2=0x7f0aec160830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.626+0000 7f0af09a7640 1 --2- 172.21.15.78:0/1681152234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0aec06e0a0 0x7f0aec160830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.626+0000 7f0af09a7640 1 -- 172.21.15.78:0/1681152234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aec1520f0 con 0x7f0aec0d0e50 2024-09-17T03:09:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.626+0000 7f0af09a7640 1 --2- 172.21.15.78:0/1681152234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aec0d0e50 0x7f0aec0b6060 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4009d90 tx=0x7f0ae4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.626+0000 7f0ae8ff9640 1 -- 172.21.15.78:0/1681152234 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4004040 con 0x7f0aec0d0e50 2024-09-17T03:09:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.626+0000 7f0ae8ff9640 1 -- 172.21.15.78:0/1681152234 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ae40041e0 con 0x7f0aec0d0e50 2024-09-17T03:09:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.627+0000 7f0af240a640 1 -- 172.21.15.78:0/1681152234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aec159f70 con 0x7f0aec0d0e50 2024-09-17T03:09:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.627+0000 7f0ae8ff9640 1 -- 172.21.15.78:0/1681152234 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ae40045f0 con 0x7f0aec0d0e50 2024-09-17T03:09:16.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.627+0000 7f0af240a640 1 -- 172.21.15.78:0/1681152234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aec1f93f0 con 0x7f0aec0d0e50 2024-09-17T03:09:16.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.628+0000 7f0af240a640 1 -- 172.21.15.78:0/1681152234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aec1f91e0 con 0x7f0aec0d0e50 2024-09-17T03:09:16.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.628+0000 7f0ae8ff9640 1 -- 172.21.15.78:0/1681152234 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0ae4031460 con 0x7f0aec0d0e50 2024-09-17T03:09:16.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.629+0000 7f0ae8ff9640 1 --2- 172.21.15.78:0/1681152234 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0ad8078b90 0x7f0ad807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:16.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.629+0000 7f0ae8ff9640 1 -- 172.21.15.78:0/1681152234 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0ae40bc4c0 con 0x7f0aec0d0e50 2024-09-17T03:09:16.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.629+0000 7f0aebfff640 1 --2- 172.21.15.78:0/1681152234 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0ad8078b90 0x7f0ad807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:16.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.630+0000 7f0aebfff640 1 --2- 172.21.15.78:0/1681152234 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0ad8078b90 0x7f0ad807b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0adc005860 tx=0x7f0adc005f50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:16.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.633+0000 7f0ae8ff9640 1 -- 172.21.15.78:0/1681152234 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0aec1520f0 con 0x7f0aec0d0e50 2024-09-17T03:09:16.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.803+0000 7f0af240a640 1 -- 172.21.15.78:0/1681152234 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0aec0d04b0 con 0x7f0ad8078b90 2024-09-17T03:09:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.808+0000 7f0ae8ff9640 1 -- 172.21.15.78:0/1681152234 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251940 (secure 0 0 0) 0x7f0aec0d04b0 con 0x7f0ad8078b90 2024-09-17T03:09:16.813 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:09:16.815 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:09:16.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.811+0000 7f0af240a640 1 -- 172.21.15.78:0/1681152234 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0ad8078b90 msgr2=0x7f0ad807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:16.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.811+0000 7f0af240a640 1 --2- 172.21.15.78:0/1681152234 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0ad8078b90 0x7f0ad807b0a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0adc005860 tx=0x7f0adc005f50 comp rx=0 tx=0).stop 2024-09-17T03:09:16.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.811+0000 7f0af240a640 1 -- 172.21.15.78:0/1681152234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aec0d0e50 msgr2=0x7f0aec0b6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:16.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.811+0000 7f0af240a640 1 --2- 172.21.15.78:0/1681152234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aec0d0e50 0x7f0aec0b6060 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0ae4009d90 tx=0x7f0ae4003ba0 comp rx=0 tx=0).stop 2024-09-17T03:09:16.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.811+0000 7f0af240a640 1 -- 172.21.15.78:0/1681152234 shutdown_connections 2024-09-17T03:09:16.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.811+0000 7f0af240a640 1 --2- 172.21.15.78:0/1681152234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0aec0d0e50 0x7f0aec0b6060 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:16.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.811+0000 7f0af240a640 1 --2- 172.21.15.78:0/1681152234 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0aec06f6e0 0x7f0aec151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:16.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.811+0000 7f0af240a640 1 --2- 172.21.15.78:0/1681152234 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0ad8078b90 0x7f0ad807b0a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:16.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.811+0000 7f0af240a640 1 --2- 172.21.15.78:0/1681152234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0aec06e0a0 0x7f0aec160830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:16.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.811+0000 7f0af240a640 1 -- 172.21.15.78:0/1681152234 >> 172.21.15.78:0/1681152234 conn(0x7f0aec09d840 msgr2=0x7f0aec068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:16.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.811+0000 7f0af240a640 1 -- 172.21.15.78:0/1681152234 shutdown_connections 2024-09-17T03:09:16.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.811+0000 7f0af240a640 1 -- 172.21.15.78:0/1681152234 wait complete. 2024-09-17T03:09:16.821 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-09-17T03:09:15.129084+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":228728,"kb_used_data":4144,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745992,"statfs":{"total":773094113280,"available":772859895808,"internally_reserved":0,"allocated":4243456,"data_stored":2335348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.088304"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399400+0000","last_change":"2024-09-17T03:09:09.065135+0000","last_active":"2024-09-17T03:09:10.399400+0000","last_peered":"2024-09-17T03:09:10.399400+0000","last_clean":"2024-09-17T03:09:10.399400+0000","last_became_active":"2024-09-17T03:09:09.064806+0000","last_became_peered":"2024-09-17T03:09:09.064806+0000","last_unstale":"2024-09-17T03:09:10.399400+0000","last_undegraded":"2024-09-17T03:09:10.399400+0000","last_fullsized":"2024-09-17T03:09:10.399400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:12.488505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.062091+0000","last_change":"2024-09-17T03:09:09.070540+0000","last_active":"2024-09-17T03:09:10.062091+0000","last_peered":"2024-09-17T03:09:10.062091+0000","last_clean":"2024-09-17T03:09:10.062091+0000","last_became_active":"2024-09-17T03:09:09.065732+0000","last_became_peered":"2024-09-17T03:09:09.065732+0000","last_unstale":"2024-09-17T03:09:10.062091+0000","last_undegraded":"2024-09-17T03:09:10.062091+0000","last_fullsized":"2024-09-17T03:09:10.062091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:11.891298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399300+0000","last_change":"2024-09-17T03:09:09.075157+0000","last_active":"2024-09-17T03:09:10.399300+0000","last_peered":"2024-09-17T03:09:10.399300+0000","last_clean":"2024-09-17T03:09:10.399300+0000","last_became_active":"2024-09-17T03:09:09.074792+0000","last_became_peered":"2024-09-17T03:09:09.074792+0000","last_unstale":"2024-09-17T03:09:10.399300+0000","last_undegraded":"2024-09-17T03:09:10.399300+0000","last_fullsized":"2024-09-17T03:09:10.399300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:42.805805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398412+0000","last_change":"2024-09-17T03:09:09.068769+0000","last_active":"2024-09-17T03:09:10.398412+0000","last_peered":"2024-09-17T03:09:10.398412+0000","last_clean":"2024-09-17T03:09:10.398412+0000","last_became_active":"2024-09-17T03:09:09.068477+0000","last_became_peered":"2024-09-17T03:09:09.068477+0000","last_unstale":"2024-09-17T03:09:10.398412+0000","last_undegraded":"2024-09-17T03:09:10.398412+0000","last_fullsized":"2024-09-17T03:09:10.398412+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:50:51.182218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398983+0000","last_change":"2024-09-17T03:09:09.078877+0000","last_active":"2024-09-17T03:09:10.398983+0000","last_peered":"2024-09-17T03:09:10.398983+0000","last_clean":"2024-09-17T03:09:10.398983+0000","last_became_active":"2024-09-17T03:09:09.078540+0000","last_became_peered":"2024-09-17T03:09:09.078540+0000","last_unstale":"2024-09-17T03:09:10.398983+0000","last_undegraded":"2024-09-17T03:09:10.398983+0000","last_fullsized":"2024-09-17T03:09:10.398983+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:44.838613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.061913+0000","last_change":"2024-09-17T03:09:09.064488+0000","last_active":"2024-09-17T03:09:10.061913+0000","last_peered":"2024-09-17T03:09:10.061913+0000","last_clean":"2024-09-17T03:09:10.061913+0000","last_became_active":"2024-09-17T03:09:09.064180+0000","last_became_peered":"2024-09-17T03:09:09.064180+0000","last_unstale":"2024-09-17T03:09:10.061913+0000","last_undegraded":"2024-09-17T03:09:10.061913+0000","last_fullsized":"2024-09-17T03:09:10.061913+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:39.232996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063735+0000","last_change":"2024-09-17T03:09:09.069039+0000","last_active":"2024-09-17T03:09:10.063735+0000","last_peered":"2024-09-17T03:09:10.063735+0000","last_clean":"2024-09-17T03:09:10.063735+0000","last_became_active":"2024-09-17T03:09:09.068710+0000","last_became_peered":"2024-09-17T03:09:09.068710+0000","last_unstale":"2024-09-17T03:09:10.063735+0000","last_undegraded":"2024-09-17T03:09:10.063735+0000","last_fullsized":"2024-09-17T03:09:10.063735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:12.758336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063340+0000","last_change":"2024-09-17T03:09:09.070509+0000","last_active":"2024-09-17T03:09:10.063340+0000","last_peered":"2024-09-17T03:09:10.063340+0000","last_clean":"2024-09-17T03:09:10.063340+0000","last_became_active":"2024-09-17T03:09:09.070187+0000","last_became_peered":"2024-09-17T03:09:09.070187+0000","last_unstale":"2024-09-17T03:09:10.063340+0000","last_undegraded":"2024-09-17T03:09:10.063340+0000","last_fullsized":"2024-09-17T03:09:10.063340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:58.128694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064978+0000","last_change":"2024-09-17T03:09:09.058231+0000","last_active":"2024-09-17T03:09:10.064978+0000","last_peered":"2024-09-17T03:09:10.064978+0000","last_clean":"2024-09-17T03:09:10.064978+0000","last_became_active":"2024-09-17T03:09:09.057919+0000","last_became_peered":"2024-09-17T03:09:09.057919+0000","last_unstale":"2024-09-17T03:09:10.064978+0000","last_undegraded":"2024-09-17T03:09:10.064978+0000","last_fullsized":"2024-09-17T03:09:10.064978+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:01.344544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398084+0000","last_change":"2024-09-17T03:09:09.072383+0000","last_active":"2024-09-17T03:09:10.398084+0000","last_peered":"2024-09-17T03:09:10.398084+0000","last_clean":"2024-09-17T03:09:10.398084+0000","last_became_active":"2024-09-17T03:09:09.071845+0000","last_became_peered":"2024-09-17T03:09:09.071845+0000","last_unstale":"2024-09-17T03:09:10.398084+0000","last_undegraded":"2024-09-17T03:09:10.398084+0000","last_fullsized":"2024-09-17T03:09:10.398084+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:28.840205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063916+0000","last_change":"2024-09-17T03:09:09.059941+0000","last_active":"2024-09-17T03:09:10.063916+0000","last_peered":"2024-09-17T03:09:10.063916+0000","last_clean":"2024-09-17T03:09:10.063916+0000","last_became_active":"2024-09-17T03:09:09.059614+0000","last_became_peered":"2024-09-17T03:09:09.059614+0000","last_unstale":"2024-09-17T03:09:10.063916+0000","last_undegraded":"2024-09-17T03:09:10.063916+0000","last_fullsized":"2024-09-17T03:09:10.063916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:16.171276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398804+0000","last_change":"2024-09-17T03:09:09.072398+0000","last_active":"2024-09-17T03:09:10.398804+0000","last_peered":"2024-09-17T03:09:10.398804+0000","last_clean":"2024-09-17T03:09:10.398804+0000","last_became_active":"2024-09-17T03:09:09.072058+0000","last_became_peered":"2024-09-17T03:09:09.072058+0000","last_unstale":"2024-09-17T03:09:10.398804+0000","last_undegraded":"2024-09-17T03:09:10.398804+0000","last_fullsized":"2024-09-17T03:09:10.398804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:12.758336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399367+0000","last_change":"2024-09-17T03:09:09.071269+0000","last_active":"2024-09-17T03:09:10.399367+0000","last_peered":"2024-09-17T03:09:10.399367+0000","last_clean":"2024-09-17T03:09:10.399367+0000","last_became_active":"2024-09-17T03:09:09.070949+0000","last_became_peered":"2024-09-17T03:09:09.070949+0000","last_unstale":"2024-09-17T03:09:10.399367+0000","last_undegraded":"2024-09-17T03:09:10.399367+0000","last_fullsized":"2024-09-17T03:09:10.399367+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:30.582938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.062251+0000","last_change":"2024-09-17T03:09:09.070952+0000","last_active":"2024-09-17T03:09:10.062251+0000","last_peered":"2024-09-17T03:09:10.062251+0000","last_clean":"2024-09-17T03:09:10.062251+0000","last_became_active":"2024-09-17T03:09:09.070634+0000","last_became_peered":"2024-09-17T03:09:09.070634+0000","last_unstale":"2024-09-17T03:09:10.062251+0000","last_undegraded":"2024-09-17T03:09:10.062251+0000","last_fullsized":"2024-09-17T03:09:10.062251+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:20.267858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398377+0000","last_change":"2024-09-17T03:09:09.074994+0000","last_active":"2024-09-17T03:09:10.398377+0000","last_peered":"2024-09-17T03:09:10.398377+0000","last_clean":"2024-09-17T03:09:10.398377+0000","last_became_active":"2024-09-17T03:09:09.074621+0000","last_became_peered":"2024-09-17T03:09:09.074621+0000","last_unstale":"2024-09-17T03:09:10.398377+0000","last_undegraded":"2024-09-17T03:09:10.398377+0000","last_fullsized":"2024-09-17T03:09:10.398377+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:37.353848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063786+0000","last_change":"2024-09-17T03:09:09.079992+0000","last_active":"2024-09-17T03:09:10.063786+0000","last_peered":"2024-09-17T03:09:10.063786+0000","last_clean":"2024-09-17T03:09:10.063786+0000","last_became_active":"2024-09-17T03:09:09.079655+0000","last_became_peered":"2024-09-17T03:09:09.079655+0000","last_unstale":"2024-09-17T03:09:10.063786+0000","last_undegraded":"2024-09-17T03:09:10.063786+0000","last_fullsized":"2024-09-17T03:09:10.063786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:51.790145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064478+0000","last_change":"2024-09-17T03:09:09.075273+0000","last_active":"2024-09-17T03:09:10.064478+0000","last_peered":"2024-09-17T03:09:10.064478+0000","last_clean":"2024-09-17T03:09:10.064478+0000","last_became_active":"2024-09-17T03:09:09.074973+0000","last_became_peered":"2024-09-17T03:09:09.074973+0000","last_unstale":"2024-09-17T03:09:10.064478+0000","last_undegraded":"2024-09-17T03:09:10.064478+0000","last_fullsized":"2024-09-17T03:09:10.064478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:07.265233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.062368+0000","last_change":"2024-09-17T03:09:09.070449+0000","last_active":"2024-09-17T03:09:10.062368+0000","last_peered":"2024-09-17T03:09:10.062368+0000","last_clean":"2024-09-17T03:09:10.062368+0000","last_became_active":"2024-09-17T03:09:09.065412+0000","last_became_peered":"2024-09-17T03:09:09.065412+0000","last_unstale":"2024-09-17T03:09:10.062368+0000","last_undegraded":"2024-09-17T03:09:10.062368+0000","last_fullsized":"2024-09-17T03:09:10.062368+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:49.687760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.061998+0000","last_change":"2024-09-17T03:09:09.063750+0000","last_active":"2024-09-17T03:09:10.061998+0000","last_peered":"2024-09-17T03:09:10.061998+0000","last_clean":"2024-09-17T03:09:10.061998+0000","last_became_active":"2024-09-17T03:09:09.063463+0000","last_became_peered":"2024-09-17T03:09:09.063463+0000","last_unstale":"2024-09-17T03:09:10.061998+0000","last_undegraded":"2024-09-17T03:09:10.061998+0000","last_fullsized":"2024-09-17T03:09:10.061998+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:42.190895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399547+0000","last_change":"2024-09-17T03:09:09.068960+0000","last_active":"2024-09-17T03:09:10.399547+0000","last_peered":"2024-09-17T03:09:10.399547+0000","last_clean":"2024-09-17T03:09:10.399547+0000","last_became_active":"2024-09-17T03:09:09.068638+0000","last_became_peered":"2024-09-17T03:09:09.068638+0000","last_unstale":"2024-09-17T03:09:10.399547+0000","last_undegraded":"2024-09-17T03:09:10.399547+0000","last_fullsized":"2024-09-17T03:09:10.399547+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:05.546436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064930+0000","last_change":"2024-09-17T03:09:09.057605+0000","last_active":"2024-09-17T03:09:10.064930+0000","last_peered":"2024-09-17T03:09:10.064930+0000","last_clean":"2024-09-17T03:09:10.064930+0000","last_became_active":"2024-09-17T03:09:09.057192+0000","last_became_peered":"2024-09-17T03:09:09.057192+0000","last_unstale":"2024-09-17T03:09:10.064930+0000","last_undegraded":"2024-09-17T03:09:10.064930+0000","last_fullsized":"2024-09-17T03:09:10.064930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:31.326248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064358+0000","last_change":"2024-09-17T03:09:09.064382+0000","last_active":"2024-09-17T03:09:10.064358+0000","last_peered":"2024-09-17T03:09:10.064358+0000","last_clean":"2024-09-17T03:09:10.064358+0000","last_became_active":"2024-09-17T03:09:09.064019+0000","last_became_peered":"2024-09-17T03:09:09.064019+0000","last_unstale":"2024-09-17T03:09:10.064358+0000","last_undegraded":"2024-09-17T03:09:10.064358+0000","last_fullsized":"2024-09-17T03:09:10.064358+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:40.561271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.397833+0000","last_change":"2024-09-17T03:09:09.059525+0000","last_active":"2024-09-17T03:09:10.397833+0000","last_peered":"2024-09-17T03:09:10.397833+0000","last_clean":"2024-09-17T03:09:10.397833+0000","last_became_active":"2024-09-17T03:09:09.059231+0000","last_became_peered":"2024-09-17T03:09:09.059231+0000","last_unstale":"2024-09-17T03:09:10.397833+0000","last_undegraded":"2024-09-17T03:09:10.397833+0000","last_fullsized":"2024-09-17T03:09:10.397833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:58.745257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398300+0000","last_change":"2024-09-17T03:09:09.073368+0000","last_active":"2024-09-17T03:09:10.398300+0000","last_peered":"2024-09-17T03:09:10.398300+0000","last_clean":"2024-09-17T03:09:10.398300+0000","last_became_active":"2024-09-17T03:09:09.073083+0000","last_became_peered":"2024-09-17T03:09:09.073083+0000","last_unstale":"2024-09-17T03:09:10.398300+0000","last_undegraded":"2024-09-17T03:09:10.398300+0000","last_fullsized":"2024-09-17T03:09:10.398300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:26.611517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398352+0000","last_change":"2024-09-17T03:09:09.060548+0000","last_active":"2024-09-17T03:09:10.398352+0000","last_peered":"2024-09-17T03:09:10.398352+0000","last_clean":"2024-09-17T03:09:10.398352+0000","last_became_active":"2024-09-17T03:09:09.060283+0000","last_became_peered":"2024-09-17T03:09:09.060283+0000","last_unstale":"2024-09-17T03:09:10.398352+0000","last_undegraded":"2024-09-17T03:09:10.398352+0000","last_fullsized":"2024-09-17T03:09:10.398352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:42.350999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.062527+0000","last_change":"2024-09-17T03:09:09.064472+0000","last_active":"2024-09-17T03:09:10.062527+0000","last_peered":"2024-09-17T03:09:10.062527+0000","last_clean":"2024-09-17T03:09:10.062527+0000","last_became_active":"2024-09-17T03:09:09.064197+0000","last_became_peered":"2024-09-17T03:09:09.064197+0000","last_unstale":"2024-09-17T03:09:10.062527+0000","last_undegraded":"2024-09-17T03:09:10.062527+0000","last_fullsized":"2024-09-17T03:09:10.062527+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:14.041521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398497+0000","last_change":"2024-09-17T03:09:09.068233+0000","last_active":"2024-09-17T03:09:10.398497+0000","last_peered":"2024-09-17T03:09:10.398497+0000","last_clean":"2024-09-17T03:09:10.398497+0000","last_became_active":"2024-09-17T03:09:09.067932+0000","last_became_peered":"2024-09-17T03:09:09.067932+0000","last_unstale":"2024-09-17T03:09:10.398497+0000","last_undegraded":"2024-09-17T03:09:10.398497+0000","last_fullsized":"2024-09-17T03:09:10.398497+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:43.473821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399076+0000","last_change":"2024-09-17T03:09:09.062636+0000","last_active":"2024-09-17T03:09:10.399076+0000","last_peered":"2024-09-17T03:09:10.399076+0000","last_clean":"2024-09-17T03:09:10.399076+0000","last_became_active":"2024-09-17T03:09:09.062332+0000","last_became_peered":"2024-09-17T03:09:09.062332+0000","last_unstale":"2024-09-17T03:09:10.399076+0000","last_undegraded":"2024-09-17T03:09:10.399076+0000","last_fullsized":"2024-09-17T03:09:10.399076+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:56.404367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.065099+0000","last_change":"2024-09-17T03:09:09.066806+0000","last_active":"2024-09-17T03:09:10.065099+0000","last_peered":"2024-09-17T03:09:10.065099+0000","last_clean":"2024-09-17T03:09:10.065099+0000","last_became_active":"2024-09-17T03:09:09.066455+0000","last_became_peered":"2024-09-17T03:09:09.066455+0000","last_unstale":"2024-09-17T03:09:10.065099+0000","last_undegraded":"2024-09-17T03:09:10.065099+0000","last_fullsized":"2024-09-17T03:09:10.065099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:44.437673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064258+0000","last_change":"2024-09-17T03:09:09.068504+0000","last_active":"2024-09-17T03:09:10.064258+0000","last_peered":"2024-09-17T03:09:10.064258+0000","last_clean":"2024-09-17T03:09:10.064258+0000","last_became_active":"2024-09-17T03:09:09.067738+0000","last_became_peered":"2024-09-17T03:09:09.067738+0000","last_unstale":"2024-09-17T03:09:10.064258+0000","last_undegraded":"2024-09-17T03:09:10.064258+0000","last_fullsized":"2024-09-17T03:09:10.064258+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:42.805805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398300+0000","last_change":"2024-09-17T03:09:09.072152+0000","last_active":"2024-09-17T03:09:10.398300+0000","last_peered":"2024-09-17T03:09:10.398300+0000","last_clean":"2024-09-17T03:09:10.398300+0000","last_became_active":"2024-09-17T03:09:09.071842+0000","last_became_peered":"2024-09-17T03:09:09.071842+0000","last_unstale":"2024-09-17T03:09:10.398300+0000","last_undegraded":"2024-09-17T03:09:10.398300+0000","last_fullsized":"2024-09-17T03:09:10.398300+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:11:33.181609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063402+0000","last_change":"2024-09-17T03:09:09.065893+0000","last_active":"2024-09-17T03:09:10.063402+0000","last_peered":"2024-09-17T03:09:10.063402+0000","last_clean":"2024-09-17T03:09:10.063402+0000","last_became_active":"2024-09-17T03:09:09.065562+0000","last_became_peered":"2024-09-17T03:09:09.065562+0000","last_unstale":"2024-09-17T03:09:10.063402+0000","last_undegraded":"2024-09-17T03:09:10.063402+0000","last_fullsized":"2024-09-17T03:09:10.063402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:26.611517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398322+0000","last_change":"2024-09-17T03:09:09.060502+0000","last_active":"2024-09-17T03:09:10.398322+0000","last_peered":"2024-09-17T03:09:10.398322+0000","last_clean":"2024-09-17T03:09:10.398322+0000","last_became_active":"2024-09-17T03:09:09.060184+0000","last_became_peered":"2024-09-17T03:09:09.060184+0000","last_unstale":"2024-09-17T03:09:10.398322+0000","last_undegraded":"2024-09-17T03:09:10.398322+0000","last_fullsized":"2024-09-17T03:09:10.398322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:40.561271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399251+0000","last_change":"2024-09-17T03:09:08.053451+0000","last_active":"2024-09-17T03:09:10.399251+0000","last_peered":"2024-09-17T03:09:10.399251+0000","last_clean":"2024-09-17T03:09:10.399251+0000","last_became_active":"2024-09-17T03:09:08.053061+0000","last_became_peered":"2024-09-17T03:09:08.053061+0000","last_unstale":"2024-09-17T03:09:10.399251+0000","last_undegraded":"2024-09-17T03:09:10.399251+0000","last_fullsized":"2024-09-17T03:09:10.399251+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:51:48.639447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399113+0000","last_change":"2024-09-17T03:09:09.053343+0000","last_active":"2024-09-17T03:09:10.399113+0000","last_peered":"2024-09-17T03:09:10.399113+0000","last_clean":"2024-09-17T03:09:10.399113+0000","last_became_active":"2024-09-17T03:09:09.053009+0000","last_became_peered":"2024-09-17T03:09:09.053009+0000","last_unstale":"2024-09-17T03:09:10.399113+0000","last_undegraded":"2024-09-17T03:09:10.399113+0000","last_fullsized":"2024-09-17T03:09:10.399113+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:20.680095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398385+0000","last_change":"2024-09-17T03:09:08.061966+0000","last_active":"2024-09-17T03:09:10.398385+0000","last_peered":"2024-09-17T03:09:10.398385+0000","last_clean":"2024-09-17T03:09:10.398385+0000","last_became_active":"2024-09-17T03:09:08.061339+0000","last_became_peered":"2024-09-17T03:09:08.061339+0000","last_unstale":"2024-09-17T03:09:10.398385+0000","last_undegraded":"2024-09-17T03:09:10.398385+0000","last_fullsized":"2024-09-17T03:09:10.398385+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:06.066233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.065006+0000","last_change":"2024-09-17T03:09:09.068097+0000","last_active":"2024-09-17T03:09:10.065006+0000","last_peered":"2024-09-17T03:09:10.065006+0000","last_clean":"2024-09-17T03:09:10.065006+0000","last_became_active":"2024-09-17T03:09:09.067740+0000","last_became_peered":"2024-09-17T03:09:09.067740+0000","last_unstale":"2024-09-17T03:09:10.065006+0000","last_undegraded":"2024-09-17T03:09:10.065006+0000","last_fullsized":"2024-09-17T03:09:10.065006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:31.152317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.062060+0000","last_change":"2024-09-17T03:09:08.063470+0000","last_active":"2024-09-17T03:09:10.062060+0000","last_peered":"2024-09-17T03:09:10.062060+0000","last_clean":"2024-09-17T03:09:10.062060+0000","last_became_active":"2024-09-17T03:09:08.063167+0000","last_became_peered":"2024-09-17T03:09:08.063167+0000","last_unstale":"2024-09-17T03:09:10.062060+0000","last_undegraded":"2024-09-17T03:09:10.062060+0000","last_fullsized":"2024-09-17T03:09:10.062060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:14.292860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398597+0000","last_change":"2024-09-17T03:09:09.058646+0000","last_active":"2024-09-17T03:09:10.398597+0000","last_peered":"2024-09-17T03:09:10.398597+0000","last_clean":"2024-09-17T03:09:10.398597+0000","last_became_active":"2024-09-17T03:09:09.058178+0000","last_became_peered":"2024-09-17T03:09:09.058178+0000","last_unstale":"2024-09-17T03:09:10.398597+0000","last_undegraded":"2024-09-17T03:09:10.398597+0000","last_fullsized":"2024-09-17T03:09:10.398597+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:13.553036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399393+0000","last_change":"2024-09-17T03:09:08.059405+0000","last_active":"2024-09-17T03:09:10.399393+0000","last_peered":"2024-09-17T03:09:10.399393+0000","last_clean":"2024-09-17T03:09:10.399393+0000","last_became_active":"2024-09-17T03:09:08.059055+0000","last_became_peered":"2024-09-17T03:09:08.059055+0000","last_unstale":"2024-09-17T03:09:10.399393+0000","last_undegraded":"2024-09-17T03:09:10.399393+0000","last_fullsized":"2024-09-17T03:09:10.399393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:45.319468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064330+0000","last_change":"2024-09-17T03:09:09.062953+0000","last_active":"2024-09-17T03:09:10.064330+0000","last_peered":"2024-09-17T03:09:10.064330+0000","last_clean":"2024-09-17T03:09:10.064330+0000","last_became_active":"2024-09-17T03:09:09.062566+0000","last_became_peered":"2024-09-17T03:09:09.062566+0000","last_unstale":"2024-09-17T03:09:10.064330+0000","last_undegraded":"2024-09-17T03:09:10.064330+0000","last_fullsized":"2024-09-17T03:09:10.064330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:43.534220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.065079+0000","last_change":"2024-09-17T03:09:08.063533+0000","last_active":"2024-09-17T03:09:10.065079+0000","last_peered":"2024-09-17T03:09:10.065079+0000","last_clean":"2024-09-17T03:09:10.065079+0000","last_became_active":"2024-09-17T03:09:08.063043+0000","last_became_peered":"2024-09-17T03:09:08.063043+0000","last_unstale":"2024-09-17T03:09:10.065079+0000","last_undegraded":"2024-09-17T03:09:10.065079+0000","last_fullsized":"2024-09-17T03:09:10.065079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:04.544022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398715+0000","last_change":"2024-09-17T03:09:09.063107+0000","last_active":"2024-09-17T03:09:10.398715+0000","last_peered":"2024-09-17T03:09:10.398715+0000","last_clean":"2024-09-17T03:09:10.398715+0000","last_became_active":"2024-09-17T03:09:09.062676+0000","last_became_peered":"2024-09-17T03:09:09.062676+0000","last_unstale":"2024-09-17T03:09:10.398715+0000","last_undegraded":"2024-09-17T03:09:10.398715+0000","last_fullsized":"2024-09-17T03:09:10.398715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:53.501404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064478+0000","last_change":"2024-09-17T03:09:08.057250+0000","last_active":"2024-09-17T03:09:10.064478+0000","last_peered":"2024-09-17T03:09:10.064478+0000","last_clean":"2024-09-17T03:09:10.064478+0000","last_became_active":"2024-09-17T03:09:08.056483+0000","last_became_peered":"2024-09-17T03:09:08.056483+0000","last_unstale":"2024-09-17T03:09:10.064478+0000","last_undegraded":"2024-09-17T03:09:10.064478+0000","last_fullsized":"2024-09-17T03:09:10.064478+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:52.050173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063351+0000","last_change":"2024-09-17T03:09:09.052601+0000","last_active":"2024-09-17T03:09:10.063351+0000","last_peered":"2024-09-17T03:09:10.063351+0000","last_clean":"2024-09-17T03:09:10.063351+0000","last_became_active":"2024-09-17T03:09:09.052290+0000","last_became_peered":"2024-09-17T03:09:09.052290+0000","last_unstale":"2024-09-17T03:09:10.063351+0000","last_undegraded":"2024-09-17T03:09:10.063351+0000","last_fullsized":"2024-09-17T03:09:10.063351+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:58.745257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.061700+0000","last_change":"2024-09-17T03:09:08.056853+0000","last_active":"2024-09-17T03:09:10.061700+0000","last_peered":"2024-09-17T03:09:10.061700+0000","last_clean":"2024-09-17T03:09:10.061700+0000","last_became_active":"2024-09-17T03:09:08.055877+0000","last_became_peered":"2024-09-17T03:09:08.055877+0000","last_unstale":"2024-09-17T03:09:10.061700+0000","last_undegraded":"2024-09-17T03:09:10.061700+0000","last_fullsized":"2024-09-17T03:09:10.061700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:25:45.945238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398050+0000","last_change":"2024-09-17T03:09:09.067603+0000","last_active":"2024-09-17T03:09:10.398050+0000","last_peered":"2024-09-17T03:09:10.398050+0000","last_clean":"2024-09-17T03:09:10.398050+0000","last_became_active":"2024-09-17T03:09:09.067278+0000","last_became_peered":"2024-09-17T03:09:09.067278+0000","last_unstale":"2024-09-17T03:09:10.398050+0000","last_undegraded":"2024-09-17T03:09:10.398050+0000","last_fullsized":"2024-09-17T03:09:10.398050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:33.280606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063372+0000","last_change":"2024-09-17T03:09:08.057693+0000","last_active":"2024-09-17T03:09:10.063372+0000","last_peered":"2024-09-17T03:09:10.063372+0000","last_clean":"2024-09-17T03:09:10.063372+0000","last_became_active":"2024-09-17T03:09:08.056574+0000","last_became_peered":"2024-09-17T03:09:08.056574+0000","last_unstale":"2024-09-17T03:09:10.063372+0000","last_undegraded":"2024-09-17T03:09:10.063372+0000","last_fullsized":"2024-09-17T03:09:10.063372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:43.836200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398956+0000","last_change":"2024-09-17T03:09:09.072417+0000","last_active":"2024-09-17T03:09:10.398956+0000","last_peered":"2024-09-17T03:09:10.398956+0000","last_clean":"2024-09-17T03:09:10.398956+0000","last_became_active":"2024-09-17T03:09:09.072123+0000","last_became_peered":"2024-09-17T03:09:09.072123+0000","last_unstale":"2024-09-17T03:09:10.398956+0000","last_undegraded":"2024-09-17T03:09:10.398956+0000","last_fullsized":"2024-09-17T03:09:10.398956+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:51.790145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.062069+0000","last_change":"2024-09-17T03:09:08.060540+0000","last_active":"2024-09-17T03:09:10.062069+0000","last_peered":"2024-09-17T03:09:10.062069+0000","last_clean":"2024-09-17T03:09:10.062069+0000","last_became_active":"2024-09-17T03:09:08.060242+0000","last_became_peered":"2024-09-17T03:09:08.060242+0000","last_unstale":"2024-09-17T03:09:10.062069+0000","last_undegraded":"2024-09-17T03:09:10.062069+0000","last_fullsized":"2024-09-17T03:09:10.062069+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:46.126075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.062204+0000","last_change":"2024-09-17T03:09:09.064253+0000","last_active":"2024-09-17T03:09:10.062204+0000","last_peered":"2024-09-17T03:09:10.062204+0000","last_clean":"2024-09-17T03:09:10.062204+0000","last_became_active":"2024-09-17T03:09:09.063959+0000","last_became_peered":"2024-09-17T03:09:09.063959+0000","last_unstale":"2024-09-17T03:09:10.062204+0000","last_undegraded":"2024-09-17T03:09:10.062204+0000","last_fullsized":"2024-09-17T03:09:10.062204+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:01:47.521333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398442+0000","last_change":"2024-09-17T03:09:08.057341+0000","last_active":"2024-09-17T03:09:10.398442+0000","last_peered":"2024-09-17T03:09:10.398442+0000","last_clean":"2024-09-17T03:09:10.398442+0000","last_became_active":"2024-09-17T03:09:08.056698+0000","last_became_peered":"2024-09-17T03:09:08.056698+0000","last_unstale":"2024-09-17T03:09:10.398442+0000","last_undegraded":"2024-09-17T03:09:10.398442+0000","last_fullsized":"2024-09-17T03:09:10.398442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:38.119644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.062217+0000","last_change":"2024-09-17T03:09:09.077626+0000","last_active":"2024-09-17T03:09:10.062217+0000","last_peered":"2024-09-17T03:09:10.062217+0000","last_clean":"2024-09-17T03:09:10.062217+0000","last_became_active":"2024-09-17T03:09:09.077306+0000","last_became_peered":"2024-09-17T03:09:09.077306+0000","last_unstale":"2024-09-17T03:09:10.062217+0000","last_undegraded":"2024-09-17T03:09:10.062217+0000","last_fullsized":"2024-09-17T03:09:10.062217+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:42.351118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399253+0000","last_change":"2024-09-17T03:09:08.059378+0000","last_active":"2024-09-17T03:09:10.399253+0000","last_peered":"2024-09-17T03:09:10.399253+0000","last_clean":"2024-09-17T03:09:10.399253+0000","last_became_active":"2024-09-17T03:09:08.059036+0000","last_became_peered":"2024-09-17T03:09:08.059036+0000","last_unstale":"2024-09-17T03:09:10.399253+0000","last_undegraded":"2024-09-17T03:09:10.399253+0000","last_fullsized":"2024-09-17T03:09:10.399253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:01:41.341210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399030+0000","last_change":"2024-09-17T03:09:09.076754+0000","last_active":"2024-09-17T03:09:10.399030+0000","last_peered":"2024-09-17T03:09:10.399030+0000","last_clean":"2024-09-17T03:09:10.399030+0000","last_became_active":"2024-09-17T03:09:09.076456+0000","last_became_peered":"2024-09-17T03:09:09.076456+0000","last_unstale":"2024-09-17T03:09:10.399030+0000","last_undegraded":"2024-09-17T03:09:10.399030+0000","last_fullsized":"2024-09-17T03:09:10.399030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:16.171276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.062384+0000","last_change":"2024-09-17T03:09:08.064681+0000","last_active":"2024-09-17T03:09:10.062384+0000","last_peered":"2024-09-17T03:09:10.062384+0000","last_clean":"2024-09-17T03:09:10.062384+0000","last_became_active":"2024-09-17T03:09:08.064261+0000","last_became_peered":"2024-09-17T03:09:08.064261+0000","last_unstale":"2024-09-17T03:09:10.062384+0000","last_undegraded":"2024-09-17T03:09:10.062384+0000","last_fullsized":"2024-09-17T03:09:10.062384+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:12.443668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.397934+0000","last_change":"2024-09-17T03:09:09.069589+0000","last_active":"2024-09-17T03:09:10.397934+0000","last_peered":"2024-09-17T03:09:10.397934+0000","last_clean":"2024-09-17T03:09:10.397934+0000","last_became_active":"2024-09-17T03:09:09.068937+0000","last_became_peered":"2024-09-17T03:09:09.068937+0000","last_unstale":"2024-09-17T03:09:10.397934+0000","last_undegraded":"2024-09-17T03:09:10.397934+0000","last_fullsized":"2024-09-17T03:09:10.397934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:25.581359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.065192+0000","last_change":"2024-09-17T03:09:08.058056+0000","last_active":"2024-09-17T03:09:10.065192+0000","last_peered":"2024-09-17T03:09:10.065192+0000","last_clean":"2024-09-17T03:09:10.065192+0000","last_became_active":"2024-09-17T03:09:08.057289+0000","last_became_peered":"2024-09-17T03:09:08.057289+0000","last_unstale":"2024-09-17T03:09:10.065192+0000","last_undegraded":"2024-09-17T03:09:10.065192+0000","last_fullsized":"2024-09-17T03:09:10.065192+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:53.710433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.062082+0000","last_change":"2024-09-17T03:09:09.063081+0000","last_active":"2024-09-17T03:09:10.062082+0000","last_peered":"2024-09-17T03:09:10.062082+0000","last_clean":"2024-09-17T03:09:10.062082+0000","last_became_active":"2024-09-17T03:09:09.062755+0000","last_became_peered":"2024-09-17T03:09:09.062755+0000","last_unstale":"2024-09-17T03:09:10.062082+0000","last_undegraded":"2024-09-17T03:09:10.062082+0000","last_fullsized":"2024-09-17T03:09:10.062082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:08.425343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398058+0000","last_change":"2024-09-17T03:09:08.062488+0000","last_active":"2024-09-17T03:09:10.398058+0000","last_peered":"2024-09-17T03:09:10.398058+0000","last_clean":"2024-09-17T03:09:10.398058+0000","last_became_active":"2024-09-17T03:09:08.062169+0000","last_became_peered":"2024-09-17T03:09:08.062169+0000","last_unstale":"2024-09-17T03:09:10.398058+0000","last_undegraded":"2024-09-17T03:09:10.398058+0000","last_fullsized":"2024-09-17T03:09:10.398058+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:24.391021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063583+0000","last_change":"2024-09-17T03:09:09.065818+0000","last_active":"2024-09-17T03:09:10.063583+0000","last_peered":"2024-09-17T03:09:10.063583+0000","last_clean":"2024-09-17T03:09:10.063583+0000","last_became_active":"2024-09-17T03:09:09.065497+0000","last_became_peered":"2024-09-17T03:09:09.065497+0000","last_unstale":"2024-09-17T03:09:10.063583+0000","last_undegraded":"2024-09-17T03:09:10.063583+0000","last_fullsized":"2024-09-17T03:09:10.063583+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:53.501404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.061755+0000","last_change":"2024-09-17T03:09:08.061406+0000","last_active":"2024-09-17T03:09:10.061755+0000","last_peered":"2024-09-17T03:09:10.061755+0000","last_clean":"2024-09-17T03:09:10.061755+0000","last_became_active":"2024-09-17T03:09:08.061113+0000","last_became_peered":"2024-09-17T03:09:08.061113+0000","last_unstale":"2024-09-17T03:09:10.061755+0000","last_undegraded":"2024-09-17T03:09:10.061755+0000","last_fullsized":"2024-09-17T03:09:10.061755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:02.493056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398628+0000","last_change":"2024-09-17T03:09:09.053985+0000","last_active":"2024-09-17T03:09:10.398628+0000","last_peered":"2024-09-17T03:09:10.398628+0000","last_clean":"2024-09-17T03:09:10.398628+0000","last_became_active":"2024-09-17T03:09:09.053570+0000","last_became_peered":"2024-09-17T03:09:09.053570+0000","last_unstale":"2024-09-17T03:09:10.398628+0000","last_undegraded":"2024-09-17T03:09:10.398628+0000","last_fullsized":"2024-09-17T03:09:10.398628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:44.231320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.062343+0000","last_change":"2024-09-17T03:09:08.063624+0000","last_active":"2024-09-17T03:09:10.062343+0000","last_peered":"2024-09-17T03:09:10.062343+0000","last_clean":"2024-09-17T03:09:10.062343+0000","last_became_active":"2024-09-17T03:09:08.063309+0000","last_became_peered":"2024-09-17T03:09:08.063309+0000","last_unstale":"2024-09-17T03:09:10.062343+0000","last_undegraded":"2024-09-17T03:09:10.062343+0000","last_fullsized":"2024-09-17T03:09:10.062343+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:24.058296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064720+0000","last_change":"2024-09-17T03:09:09.063058+0000","last_active":"2024-09-17T03:09:10.064720+0000","last_peered":"2024-09-17T03:09:10.064720+0000","last_clean":"2024-09-17T03:09:10.064720+0000","last_became_active":"2024-09-17T03:09:09.062719+0000","last_became_peered":"2024-09-17T03:09:09.062719+0000","last_unstale":"2024-09-17T03:09:10.064720+0000","last_undegraded":"2024-09-17T03:09:10.064720+0000","last_fullsized":"2024-09-17T03:09:10.064720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:46.600239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398560+0000","last_change":"2024-09-17T03:09:08.063387+0000","last_active":"2024-09-17T03:09:10.398560+0000","last_peered":"2024-09-17T03:09:10.398560+0000","last_clean":"2024-09-17T03:09:10.398560+0000","last_became_active":"2024-09-17T03:09:08.063007+0000","last_became_peered":"2024-09-17T03:09:08.063007+0000","last_unstale":"2024-09-17T03:09:10.398560+0000","last_undegraded":"2024-09-17T03:09:10.398560+0000","last_fullsized":"2024-09-17T03:09:10.398560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:22.627573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399483+0000","last_change":"2024-09-17T03:09:09.071547+0000","last_active":"2024-09-17T03:09:10.399483+0000","last_peered":"2024-09-17T03:09:10.399483+0000","last_clean":"2024-09-17T03:09:10.399483+0000","last_became_active":"2024-09-17T03:09:09.071140+0000","last_became_peered":"2024-09-17T03:09:09.071140+0000","last_unstale":"2024-09-17T03:09:10.399483+0000","last_undegraded":"2024-09-17T03:09:10.399483+0000","last_fullsized":"2024-09-17T03:09:10.399483+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:43.534220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064669+0000","last_change":"2024-09-17T03:09:08.057279+0000","last_active":"2024-09-17T03:09:10.064669+0000","last_peered":"2024-09-17T03:09:10.064669+0000","last_clean":"2024-09-17T03:09:10.064669+0000","last_became_active":"2024-09-17T03:09:08.056908+0000","last_became_peered":"2024-09-17T03:09:08.056908+0000","last_unstale":"2024-09-17T03:09:10.064669+0000","last_undegraded":"2024-09-17T03:09:10.064669+0000","last_fullsized":"2024-09-17T03:09:10.064669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:28.765247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398691+0000","last_change":"2024-09-17T03:09:09.058087+0000","last_active":"2024-09-17T03:09:10.398691+0000","last_peered":"2024-09-17T03:09:10.398691+0000","last_clean":"2024-09-17T03:09:10.398691+0000","last_became_active":"2024-09-17T03:09:09.057564+0000","last_became_peered":"2024-09-17T03:09:09.057564+0000","last_unstale":"2024-09-17T03:09:10.398691+0000","last_undegraded":"2024-09-17T03:09:10.398691+0000","last_fullsized":"2024-09-17T03:09:10.398691+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:05:58.128694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064681+0000","last_change":"2024-09-17T03:09:08.059458+0000","last_active":"2024-09-17T03:09:10.064681+0000","last_peered":"2024-09-17T03:09:10.064681+0000","last_clean":"2024-09-17T03:09:10.064681+0000","last_became_active":"2024-09-17T03:09:08.059154+0000","last_became_peered":"2024-09-17T03:09:08.059154+0000","last_unstale":"2024-09-17T03:09:10.064681+0000","last_undegraded":"2024-09-17T03:09:10.064681+0000","last_fullsized":"2024-09-17T03:09:10.064681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:37.260736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399609+0000","last_change":"2024-09-17T03:09:09.068686+0000","last_active":"2024-09-17T03:09:10.399609+0000","last_peered":"2024-09-17T03:09:10.399609+0000","last_clean":"2024-09-17T03:09:10.399609+0000","last_became_active":"2024-09-17T03:09:09.068379+0000","last_became_peered":"2024-09-17T03:09:09.068379+0000","last_unstale":"2024-09-17T03:09:10.399609+0000","last_undegraded":"2024-09-17T03:09:10.399609+0000","last_fullsized":"2024-09-17T03:09:10.399609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:49.038974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064901+0000","last_change":"2024-09-17T03:09:08.063762+0000","last_active":"2024-09-17T03:09:10.064901+0000","last_peered":"2024-09-17T03:09:10.064901+0000","last_clean":"2024-09-17T03:09:10.064901+0000","last_became_active":"2024-09-17T03:09:08.062961+0000","last_became_peered":"2024-09-17T03:09:08.062961+0000","last_unstale":"2024-09-17T03:09:10.064901+0000","last_undegraded":"2024-09-17T03:09:10.064901+0000","last_fullsized":"2024-09-17T03:09:10.064901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:48.036560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399275+0000","last_change":"2024-09-17T03:09:09.073022+0000","last_active":"2024-09-17T03:09:10.399275+0000","last_peered":"2024-09-17T03:09:10.399275+0000","last_clean":"2024-09-17T03:09:10.399275+0000","last_became_active":"2024-09-17T03:09:09.072707+0000","last_became_peered":"2024-09-17T03:09:09.072707+0000","last_unstale":"2024-09-17T03:09:10.399275+0000","last_undegraded":"2024-09-17T03:09:10.399275+0000","last_fullsized":"2024-09-17T03:09:10.399275+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:29.767661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398833+0000","last_change":"2024-09-17T03:09:08.057529+0000","last_active":"2024-09-17T03:09:10.398833+0000","last_peered":"2024-09-17T03:09:10.398833+0000","last_clean":"2024-09-17T03:09:10.398833+0000","last_became_active":"2024-09-17T03:09:08.057217+0000","last_became_peered":"2024-09-17T03:09:08.057217+0000","last_unstale":"2024-09-17T03:09:10.398833+0000","last_undegraded":"2024-09-17T03:09:10.398833+0000","last_fullsized":"2024-09-17T03:09:10.398833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:48.036560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399407+0000","last_change":"2024-09-17T03:09:09.069460+0000","last_active":"2024-09-17T03:09:10.399407+0000","last_peered":"2024-09-17T03:09:10.399407+0000","last_clean":"2024-09-17T03:09:10.399407+0000","last_became_active":"2024-09-17T03:09:09.069124+0000","last_became_peered":"2024-09-17T03:09:09.069124+0000","last_unstale":"2024-09-17T03:09:10.399407+0000","last_undegraded":"2024-09-17T03:09:10.399407+0000","last_fullsized":"2024-09-17T03:09:10.399407+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:53.052587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398879+0000","last_change":"2024-09-17T03:09:08.060468+0000","last_active":"2024-09-17T03:09:10.398879+0000","last_peered":"2024-09-17T03:09:10.398879+0000","last_clean":"2024-09-17T03:09:10.398879+0000","last_became_active":"2024-09-17T03:09:08.060102+0000","last_became_peered":"2024-09-17T03:09:08.060102+0000","last_unstale":"2024-09-17T03:09:10.398879+0000","last_undegraded":"2024-09-17T03:09:10.398879+0000","last_fullsized":"2024-09-17T03:09:10.398879+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:50.441311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398964+0000","last_change":"2024-09-17T03:09:09.067434+0000","last_active":"2024-09-17T03:09:10.398964+0000","last_peered":"2024-09-17T03:09:10.398964+0000","last_clean":"2024-09-17T03:09:10.398964+0000","last_became_active":"2024-09-17T03:09:09.067094+0000","last_became_peered":"2024-09-17T03:09:09.067094+0000","last_unstale":"2024-09-17T03:09:10.398964+0000","last_undegraded":"2024-09-17T03:09:10.398964+0000","last_fullsized":"2024-09-17T03:09:10.398964+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:02.789448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063742+0000","last_change":"2024-09-17T03:09:08.063727+0000","last_active":"2024-09-17T03:09:10.063742+0000","last_peered":"2024-09-17T03:09:10.063742+0000","last_clean":"2024-09-17T03:09:10.063742+0000","last_became_active":"2024-09-17T03:09:08.063397+0000","last_became_peered":"2024-09-17T03:09:08.063397+0000","last_unstale":"2024-09-17T03:09:10.063742+0000","last_undegraded":"2024-09-17T03:09:10.063742+0000","last_fullsized":"2024-09-17T03:09:10.063742+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:01.787034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063443+0000","last_change":"2024-09-17T03:09:09.068161+0000","last_active":"2024-09-17T03:09:10.063443+0000","last_peered":"2024-09-17T03:09:10.063443+0000","last_clean":"2024-09-17T03:09:10.063443+0000","last_became_active":"2024-09-17T03:09:09.067848+0000","last_became_peered":"2024-09-17T03:09:09.067848+0000","last_unstale":"2024-09-17T03:09:10.063443+0000","last_undegraded":"2024-09-17T03:09:10.063443+0000","last_fullsized":"2024-09-17T03:09:10.063443+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:37.353848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398207+0000","last_change":"2024-09-17T03:09:08.061649+0000","last_active":"2024-09-17T03:09:10.398207+0000","last_peered":"2024-09-17T03:09:10.398207+0000","last_clean":"2024-09-17T03:09:10.398207+0000","last_became_active":"2024-09-17T03:09:08.061266+0000","last_became_peered":"2024-09-17T03:09:08.061266+0000","last_unstale":"2024-09-17T03:09:10.398207+0000","last_undegraded":"2024-09-17T03:09:10.398207+0000","last_fullsized":"2024-09-17T03:09:10.398207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:21:57.742843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399488+0000","last_change":"2024-09-17T03:09:09.068117+0000","last_active":"2024-09-17T03:09:10.399488+0000","last_peered":"2024-09-17T03:09:10.399488+0000","last_clean":"2024-09-17T03:09:10.399488+0000","last_became_active":"2024-09-17T03:09:09.067796+0000","last_became_peered":"2024-09-17T03:09:09.067796+0000","last_unstale":"2024-09-17T03:09:10.399488+0000","last_undegraded":"2024-09-17T03:09:10.399488+0000","last_fullsized":"2024-09-17T03:09:10.399488+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:54.712846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398643+0000","last_change":"2024-09-17T03:09:08.063699+0000","last_active":"2024-09-17T03:09:10.398643+0000","last_peered":"2024-09-17T03:09:10.398643+0000","last_clean":"2024-09-17T03:09:10.398643+0000","last_became_active":"2024-09-17T03:09:08.063369+0000","last_became_peered":"2024-09-17T03:09:08.063369+0000","last_unstale":"2024-09-17T03:09:10.398643+0000","last_undegraded":"2024-09-17T03:09:10.398643+0000","last_fullsized":"2024-09-17T03:09:10.398643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:07.142563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399550+0000","last_change":"2024-09-17T03:09:09.074289+0000","last_active":"2024-09-17T03:09:10.399550+0000","last_peered":"2024-09-17T03:09:10.399550+0000","last_clean":"2024-09-17T03:09:10.399550+0000","last_became_active":"2024-09-17T03:09:09.073997+0000","last_became_peered":"2024-09-17T03:09:09.073997+0000","last_unstale":"2024-09-17T03:09:10.399550+0000","last_undegraded":"2024-09-17T03:09:10.399550+0000","last_fullsized":"2024-09-17T03:09:10.399550+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:43:07.265233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:11.046702+0000","last_change":"2024-09-17T03:09:08.057660+0000","last_active":"2024-09-17T03:09:11.046702+0000","last_peered":"2024-09-17T03:09:11.046702+0000","last_clean":"2024-09-17T03:09:11.046702+0000","last_became_active":"2024-09-17T03:09:08.057073+0000","last_became_peered":"2024-09-17T03:09:08.057073+0000","last_unstale":"2024-09-17T03:09:11.046702+0000","last_undegraded":"2024-09-17T03:09:11.046702+0000","last_fullsized":"2024-09-17T03:09:11.046702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:10:56.615625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398093+0000","last_change":"2024-09-17T03:09:09.067267+0000","last_active":"2024-09-17T03:09:10.398093+0000","last_peered":"2024-09-17T03:09:10.398093+0000","last_clean":"2024-09-17T03:09:10.398093+0000","last_became_active":"2024-09-17T03:09:09.066974+0000","last_became_peered":"2024-09-17T03:09:09.066974+0000","last_unstale":"2024-09-17T03:09:10.398093+0000","last_undegraded":"2024-09-17T03:09:10.398093+0000","last_fullsized":"2024-09-17T03:09:10.398093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:49.551254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398652+0000","last_change":"2024-09-17T03:09:08.057147+0000","last_active":"2024-09-17T03:09:10.398652+0000","last_peered":"2024-09-17T03:09:10.398652+0000","last_clean":"2024-09-17T03:09:10.398652+0000","last_became_active":"2024-09-17T03:09:08.056824+0000","last_became_peered":"2024-09-17T03:09:08.056824+0000","last_unstale":"2024-09-17T03:09:10.398652+0000","last_undegraded":"2024-09-17T03:09:10.398652+0000","last_fullsized":"2024-09-17T03:09:10.398652+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:59:04.901816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398874+0000","last_change":"2024-09-17T03:09:09.054908+0000","last_active":"2024-09-17T03:09:10.398874+0000","last_peered":"2024-09-17T03:09:10.398874+0000","last_clean":"2024-09-17T03:09:10.398874+0000","last_became_active":"2024-09-17T03:09:09.054575+0000","last_became_peered":"2024-09-17T03:09:09.054575+0000","last_unstale":"2024-09-17T03:09:10.398874+0000","last_undegraded":"2024-09-17T03:09:10.398874+0000","last_fullsized":"2024-09-17T03:09:10.398874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:07.225499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.399005+0000","last_change":"2024-09-17T03:09:08.054377+0000","last_active":"2024-09-17T03:09:10.399005+0000","last_peered":"2024-09-17T03:09:10.399005+0000","last_clean":"2024-09-17T03:09:10.399005+0000","last_became_active":"2024-09-17T03:09:08.054048+0000","last_became_peered":"2024-09-17T03:09:08.054048+0000","last_unstale":"2024-09-17T03:09:10.399005+0000","last_undegraded":"2024-09-17T03:09:10.399005+0000","last_fullsized":"2024-09-17T03:09:10.399005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:27.059986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398914+0000","last_change":"2024-09-17T03:09:09.050873+0000","last_active":"2024-09-17T03:09:10.398914+0000","last_peered":"2024-09-17T03:09:10.398914+0000","last_clean":"2024-09-17T03:09:10.398914+0000","last_became_active":"2024-09-17T03:09:09.050511+0000","last_became_peered":"2024-09-17T03:09:09.050511+0000","last_unstale":"2024-09-17T03:09:10.398914+0000","last_undegraded":"2024-09-17T03:09:10.398914+0000","last_fullsized":"2024-09-17T03:09:10.398914+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:46.600239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398165+0000","last_change":"2024-09-17T03:09:08.063491+0000","last_active":"2024-09-17T03:09:10.398165+0000","last_peered":"2024-09-17T03:09:10.398165+0000","last_clean":"2024-09-17T03:09:10.398165+0000","last_became_active":"2024-09-17T03:09:08.063182+0000","last_became_peered":"2024-09-17T03:09:08.063182+0000","last_unstale":"2024-09-17T03:09:10.398165+0000","last_undegraded":"2024-09-17T03:09:10.398165+0000","last_fullsized":"2024-09-17T03:09:10.398165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:17.411826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.061713+0000","last_change":"2024-09-17T03:09:09.077272+0000","last_active":"2024-09-17T03:09:10.061713+0000","last_peered":"2024-09-17T03:09:10.061713+0000","last_clean":"2024-09-17T03:09:10.061713+0000","last_became_active":"2024-09-17T03:09:09.076882+0000","last_became_peered":"2024-09-17T03:09:09.076882+0000","last_unstale":"2024-09-17T03:09:10.061713+0000","last_undegraded":"2024-09-17T03:09:10.061713+0000","last_fullsized":"2024-09-17T03:09:10.061713+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:00:14.181015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063851+0000","last_change":"2024-09-17T03:09:08.056515+0000","last_active":"2024-09-17T03:09:10.063851+0000","last_peered":"2024-09-17T03:09:10.063851+0000","last_clean":"2024-09-17T03:09:10.063851+0000","last_became_active":"2024-09-17T03:09:08.056181+0000","last_became_peered":"2024-09-17T03:09:08.056181+0000","last_unstale":"2024-09-17T03:09:10.063851+0000","last_undegraded":"2024-09-17T03:09:10.063851+0000","last_fullsized":"2024-09-17T03:09:10.063851+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:29.580524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063617+0000","last_change":"2024-09-17T03:09:09.066357+0000","last_active":"2024-09-17T03:09:10.063617+0000","last_peered":"2024-09-17T03:09:10.063617+0000","last_clean":"2024-09-17T03:09:10.063617+0000","last_became_active":"2024-09-17T03:09:09.066001+0000","last_became_peered":"2024-09-17T03:09:09.066001+0000","last_unstale":"2024-09-17T03:09:10.063617+0000","last_undegraded":"2024-09-17T03:09:10.063617+0000","last_fullsized":"2024-09-17T03:09:10.063617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:49.551254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.062211+0000","last_change":"2024-09-17T03:09:08.062609+0000","last_active":"2024-09-17T03:09:10.062211+0000","last_peered":"2024-09-17T03:09:10.062211+0000","last_clean":"2024-09-17T03:09:10.062211+0000","last_became_active":"2024-09-17T03:09:08.062155+0000","last_became_peered":"2024-09-17T03:09:08.062155+0000","last_unstale":"2024-09-17T03:09:10.062211+0000","last_undegraded":"2024-09-17T03:09:10.062211+0000","last_fullsized":"2024-09-17T03:09:10.062211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:17.884117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.064065+0000","last_change":"2024-09-17T03:09:09.070601+0000","last_active":"2024-09-17T03:09:10.064065+0000","last_peered":"2024-09-17T03:09:10.064065+0000","last_clean":"2024-09-17T03:09:10.064065+0000","last_became_active":"2024-09-17T03:09:09.070169+0000","last_became_peered":"2024-09-17T03:09:09.070169+0000","last_unstale":"2024-09-17T03:09:10.064065+0000","last_undegraded":"2024-09-17T03:09:10.064065+0000","last_fullsized":"2024-09-17T03:09:10.064065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:08.032499+0000","last_clean_scrub_stamp":"2024-09-17T03:09:08.032499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:56.404367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.398718+0000","last_change":"2024-09-17T03:09:08.052626+0000","last_active":"2024-09-17T03:09:10.398718+0000","last_peered":"2024-09-17T03:09:10.398718+0000","last_clean":"2024-09-17T03:09:10.398718+0000","last_became_active":"2024-09-17T03:09:08.052258+0000","last_became_peered":"2024-09-17T03:09:08.052258+0000","last_unstale":"2024-09-17T03:09:10.398718+0000","last_undegraded":"2024-09-17T03:09:10.398718+0000","last_fullsized":"2024-09-17T03:09:10.398718+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:09:07.030085+0000","last_clean_scrub_stamp":"2024-09-17T03:09:07.030085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:33.963979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":130,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T03:09:10.063658+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:09:10.063658+0000","last_peered":"2024-09-17T03:09:10.063658+0000","last_clean":"2024-09-17T03:09:10.063658+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:09:10.063658+0000","last_undegraded":"2024-09-17T03:09:10.063658+0000","last_fullsized":"2024-09-17T03:09:10.063658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":974848,"data_stored":735757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":372736,"data_stored":139615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":385024,"data_stored":145971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":385024,"data_stored":145403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":380928,"data_stored":145369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509455,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":140633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":970752,"data_stored":735667,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":393216,"data_stored":146933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:09:16.826 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:09:16.827 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:09:16.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.982+0000 7fd5aa58b640 1 -- 172.21.15.78:0/762244959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5a4070030 msgr2=0x7fd5a4074640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:16.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.982+0000 7fd5aa58b640 1 --2- 172.21.15.78:0/762244959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5a4070030 0x7fd5a4074640 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd598005fd0 tx=0x7fd59802a530 comp rx=0 tx=0).stop 2024-09-17T03:09:16.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.982+0000 7fd5aa58b640 1 -- 172.21.15.78:0/762244959 shutdown_connections 2024-09-17T03:09:16.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.982+0000 7fd5aa58b640 1 --2- 172.21.15.78:0/762244959 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd5a4070440 0x7fd5a4074b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:16.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.982+0000 7fd5aa58b640 1 --2- 172.21.15.78:0/762244959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5a4070030 0x7fd5a4074640 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:16.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.982+0000 7fd5aa58b640 1 -- 172.21.15.78:0/762244959 >> 172.21.15.78:0/762244959 conn(0x7fd5a40b1cb0 msgr2=0x7fd5a40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:16.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.982+0000 7fd5aa58b640 1 -- 172.21.15.78:0/762244959 shutdown_connections 2024-09-17T03:09:16.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.982+0000 7fd5aa58b640 1 -- 172.21.15.78:0/762244959 wait complete. 2024-09-17T03:09:16.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.984+0000 7fd5aa58b640 1 Processor -- start 2024-09-17T03:09:16.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.984+0000 7fd5aa58b640 1 -- start start 2024-09-17T03:09:16.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.985+0000 7fd5aa58b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5a4070030 0x7fd5a414b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:16.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.985+0000 7fd5aa58b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5a4070440 0x7fd5a41f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:16.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.985+0000 7fd5aa58b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd5a4073170 0x7fd5a40d0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:16.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.985+0000 7fd5aa58b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a40b3a60 con 0x7fd5a4070440 2024-09-17T03:09:16.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.985+0000 7fd5aa58b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a40b38e0 con 0x7fd5a4070030 2024-09-17T03:09:16.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.985+0000 7fd5aa58b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a40b3be0 con 0x7fd5a4073170 2024-09-17T03:09:16.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.985+0000 7fd5a37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5a4070440 0x7fd5a41f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:16.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.985+0000 7fd5a37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5a4070440 0x7fd5a41f71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55970/0 (socket says 172.21.15.78:55970) 2024-09-17T03:09:16.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.985+0000 7fd5a37fe640 1 -- 172.21.15.78:0/3390964457 learned_addr learned my addr 172.21.15.78:0/3390964457 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:16.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.985+0000 7fd5a3fff640 1 --2- 172.21.15.78:0/3390964457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5a4070030 0x7fd5a414b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:16.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.985+0000 7fd5a37fe640 1 -- 172.21.15.78:0/3390964457 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd5a4073170 msgr2=0x7fd5a40d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:16.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.985+0000 7fd5a37fe640 1 --2- 172.21.15.78:0/3390964457 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd5a4073170 0x7fd5a40d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:16.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.985+0000 7fd5a37fe640 1 -- 172.21.15.78:0/3390964457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5a4070030 msgr2=0x7fd5a414b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:16.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.985+0000 7fd5a37fe640 1 --2- 172.21.15.78:0/3390964457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5a4070030 0x7fd5a414b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:16.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.985+0000 7fd5a37fe640 1 -- 172.21.15.78:0/3390964457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a41f7e60 con 0x7fd5a4070440 2024-09-17T03:09:16.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.986+0000 7fd5a37fe640 1 --2- 172.21.15.78:0/3390964457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5a4070440 0x7fd5a41f71a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd598034040 tx=0x7fd5980039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:16.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.986+0000 7fd5a0ff9640 1 -- 172.21.15.78:0/3390964457 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59803e030 con 0x7fd5a4070440 2024-09-17T03:09:16.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.986+0000 7fd5a0ff9640 1 -- 172.21.15.78:0/3390964457 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5980047a0 con 0x7fd5a4070440 2024-09-17T03:09:16.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.986+0000 7fd5aa58b640 1 -- 172.21.15.78:0/3390964457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a41f3dc0 con 0x7fd5a4070440 2024-09-17T03:09:16.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.986+0000 7fd5a0ff9640 1 -- 172.21.15.78:0/3390964457 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd598035040 con 0x7fd5a4070440 2024-09-17T03:09:16.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.986+0000 7fd5aa58b640 1 -- 172.21.15.78:0/3390964457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a41f76e0 con 0x7fd5a4070440 2024-09-17T03:09:16.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.987+0000 7fd5aa58b640 1 -- 172.21.15.78:0/3390964457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5a41f7970 con 0x7fd5a4070440 2024-09-17T03:09:16.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.988+0000 7fd5a0ff9640 1 -- 172.21.15.78:0/3390964457 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd598041030 con 0x7fd5a4070440 2024-09-17T03:09:16.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.988+0000 7fd5a0ff9640 1 --2- 172.21.15.78:0/3390964457 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd590078b90 0x7fd59007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:16.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.988+0000 7fd5a0ff9640 1 -- 172.21.15.78:0/3390964457 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd5980bb720 con 0x7fd5a4070440 2024-09-17T03:09:16.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.988+0000 7fd5a3fff640 1 --2- 172.21.15.78:0/3390964457 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd590078b90 0x7fd59007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:16.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.989+0000 7fd5a3fff640 1 --2- 172.21.15.78:0/3390964457 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd590078b90 0x7fd59007b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd59400a750 tx=0x7fd594008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:16.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:16.992+0000 7fd5a0ff9640 1 -- 172.21.15.78:0/3390964457 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd598083ae0 con 0x7fd5a4070440 2024-09-17T03:09:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.243+0000 7fd5aa58b640 1 -- 172.21.15.78:0/3390964457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fd5a41f3bb0 con 0x7fd5a4070440 2024-09-17T03:09:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.247+0000 7fd5a0ff9640 1 -- 172.21.15.78:0/3390964457 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fd5980833e0 con 0x7fd5a4070440 2024-09-17T03:09:17.247 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2024-09-17T03:09:17.247 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBv8uhmn+c/IxAALXG+Qkwye7zc6PjcLBsk1g== 2024-09-17T03:09:17.247 INFO:teuthology.orchestra.run.smithi078.stdout: caps mds = "allow" 2024-09-17T03:09:17.247 INFO:teuthology.orchestra.run.smithi078.stdout: caps mon = "allow r" 2024-09-17T03:09:17.247 INFO:teuthology.orchestra.run.smithi078.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:09:17.248 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2024-09-17T03:09:17.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.250+0000 7fd5aa58b640 1 -- 172.21.15.78:0/3390964457 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd590078b90 msgr2=0x7fd59007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:17.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.250+0000 7fd5aa58b640 1 --2- 172.21.15.78:0/3390964457 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd590078b90 0x7fd59007b0a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd59400a750 tx=0x7fd594008040 comp rx=0 tx=0).stop 2024-09-17T03:09:17.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.250+0000 7fd5aa58b640 1 -- 172.21.15.78:0/3390964457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5a4070440 msgr2=0x7fd5a41f71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:17.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.250+0000 7fd5aa58b640 1 --2- 172.21.15.78:0/3390964457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5a4070440 0x7fd5a41f71a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd598034040 tx=0x7fd5980039e0 comp rx=0 tx=0).stop 2024-09-17T03:09:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.250+0000 7fd5aa58b640 1 -- 172.21.15.78:0/3390964457 shutdown_connections 2024-09-17T03:09:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.250+0000 7fd5aa58b640 1 --2- 172.21.15.78:0/3390964457 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd5a4073170 0x7fd5a40d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.250+0000 7fd5aa58b640 1 --2- 172.21.15.78:0/3390964457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5a4070440 0x7fd5a41f71a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.250+0000 7fd5aa58b640 1 --2- 172.21.15.78:0/3390964457 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd590078b90 0x7fd59007b0a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.250+0000 7fd5aa58b640 1 --2- 172.21.15.78:0/3390964457 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd5a4070030 0x7fd5a414b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.250+0000 7fd5aa58b640 1 -- 172.21.15.78:0/3390964457 >> 172.21.15.78:0/3390964457 conn(0x7fd5a40b1cb0 msgr2=0x7fd5a415ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.250+0000 7fd5aa58b640 1 -- 172.21.15.78:0/3390964457 shutdown_connections 2024-09-17T03:09:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.250+0000 7fd5aa58b640 1 -- 172.21.15.78:0/3390964457 wait complete. 2024-09-17T03:09:17.261 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:09:17.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.376+0000 7f15f0519640 1 -- 172.21.15.78:0/1369391782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15d4003a00 msgr2=0x7f15d4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:17.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.376+0000 7f15f0519640 1 --2- 172.21.15.78:0/1369391782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15d4003a00 0x7f15d4003e30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009b50 tx=0x7f15d4005830 comp rx=0 tx=0).stop 2024-09-17T03:09:17.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.376+0000 7f15f0519640 1 -- 172.21.15.78:0/1369391782 shutdown_connections 2024-09-17T03:09:17.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.376+0000 7f15f0519640 1 --2- 172.21.15.78:0/1369391782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15d4003a00 0x7f15d4003e30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:17.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.376+0000 7f15f0519640 1 -- 172.21.15.78:0/1369391782 >> 172.21.15.78:0/1369391782 conn(0x7f15e808bfc0 msgr2=0x7f15e809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:17.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.376+0000 7f15f0519640 1 -- 172.21.15.78:0/1369391782 shutdown_connections 2024-09-17T03:09:17.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.376+0000 7f15f0519640 1 -- 172.21.15.78:0/1369391782 wait complete. 2024-09-17T03:09:17.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.378+0000 7f15f0519640 1 Processor -- start 2024-09-17T03:09:17.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.378+0000 7f15f0519640 1 -- start start 2024-09-17T03:09:17.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.379+0000 7f15f0519640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15d4003a00 0x7f15e815ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:17.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.379+0000 7f15f0519640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15e815baf0 0x7f15e81e9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:17.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.379+0000 7f15f0519640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15e815b510 0x7f15e81e9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:17.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.379+0000 7f15f0519640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f15e80b36c0 con 0x7f15d4003a00 2024-09-17T03:09:17.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.379+0000 7f15f0519640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f15e80b3540 con 0x7f15e815baf0 2024-09-17T03:09:17.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.379+0000 7f15f0519640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f15e80b3840 con 0x7f15e815b510 2024-09-17T03:09:17.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.379+0000 7f15ee2b5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15d4003a00 0x7f15e815ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:17.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.379+0000 7f15ee2b5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15d4003a00 0x7f15e815ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55992/0 (socket says 172.21.15.78:55992) 2024-09-17T03:09:17.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.379+0000 7f15ee2b5640 1 -- 172.21.15.78:0/200333341 learned_addr learned my addr 172.21.15.78:0/200333341 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:17.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.379+0000 7f15eeab6640 1 --2- 172.21.15.78:0/200333341 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15e815b510 0x7f15e81e9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:17.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.379+0000 7f15edab4640 1 --2- 172.21.15.78:0/200333341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15e815baf0 0x7f15e81e9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:17.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.379+0000 7f15ee2b5640 1 -- 172.21.15.78:0/200333341 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15e815b510 msgr2=0x7f15e81e9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:17.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.379+0000 7f15ee2b5640 1 --2- 172.21.15.78:0/200333341 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15e815b510 0x7f15e81e9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:17.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.379+0000 7f15ee2b5640 1 -- 172.21.15.78:0/200333341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15e815baf0 msgr2=0x7f15e81e9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:17.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.379+0000 7f15ee2b5640 1 --2- 172.21.15.78:0/200333341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15e815baf0 0x7f15e81e9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:17.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.379+0000 7f15ee2b5640 1 -- 172.21.15.78:0/200333341 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e815b2c0 con 0x7f15d4003a00 2024-09-17T03:09:17.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.379+0000 7f15ee2b5640 1 --2- 172.21.15.78:0/200333341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15d4003a00 0x7f15e815ad80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009a70 tx=0x7f15e40336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:17.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.380+0000 7f15deffd640 1 -- 172.21.15.78:0/200333341 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e4038040 con 0x7f15d4003a00 2024-09-17T03:09:17.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.380+0000 7f15deffd640 1 -- 172.21.15.78:0/200333341 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15e40338e0 con 0x7f15d4003a00 2024-09-17T03:09:17.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.380+0000 7f15deffd640 1 -- 172.21.15.78:0/200333341 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15e4033d30 con 0x7f15d4003a00 2024-09-17T03:09:17.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.380+0000 7f15f0519640 1 -- 172.21.15.78:0/200333341 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15e80ce300 con 0x7f15d4003a00 2024-09-17T03:09:17.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.380+0000 7f15f0519640 1 -- 172.21.15.78:0/200333341 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15e81e8150 con 0x7f15d4003a00 2024-09-17T03:09:17.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.381+0000 7f15f0519640 1 -- 172.21.15.78:0/200333341 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15e80cf110 con 0x7f15d4003a00 2024-09-17T03:09:17.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.381+0000 7f15deffd640 1 -- 172.21.15.78:0/200333341 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f15e4043020 con 0x7f15d4003a00 2024-09-17T03:09:17.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.382+0000 7f15deffd640 1 --2- 172.21.15.78:0/200333341 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f15cc078bc0 0x7f15cc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:17.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.382+0000 7f15deffd640 1 -- 172.21.15.78:0/200333341 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f15e40bae40 con 0x7f15d4003a00 2024-09-17T03:09:17.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.382+0000 7f15edab4640 1 --2- 172.21.15.78:0/200333341 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f15cc078bc0 0x7f15cc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:17.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.383+0000 7f15edab4640 1 --2- 172.21.15.78:0/200333341 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f15cc078bc0 0x7f15cc07b0d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f15e81f8af0 tx=0x7f15d8006ac0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:17.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.386+0000 7f15deffd640 1 -- 172.21.15.78:0/200333341 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f15e404a020 con 0x7f15d4003a00 2024-09-17T03:09:17.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.594+0000 7f15f0519640 1 -- 172.21.15.78:0/200333341 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15e8161f60 con 0x7f15d4003a00 2024-09-17T03:09:17.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.595+0000 7f15deffd640 1 -- 172.21.15.78:0/200333341 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5228 (secure 0 0 0) 0x7f15e4083200 con 0x7f15d4003a00 2024-09-17T03:09:17.597 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:09:17.597 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":13,"btime":"2024-09-17T03:09:11:060312+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2234221933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2234221933},{"type":"v1","addr":"172.21.15.193:6836","nonce":2234221933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/2343001441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2343001441},{"type":"v1","addr":"172.21.15.193:6837","nonce":2343001441}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4929,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/2730690660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2730690660},{"type":"v1","addr":"172.21.15.78:6833","nonce":2730690660}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:09:08.411464+0000","modified":"2024-09-17T03:09:10.417439+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/2663458793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2663458793},{"type":"v1","addr":"172.21.15.78:6835","nonce":2663458793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4938,"qdb_cluster":[4938]},"id":2}]} 2024-09-17T03:09:17.599 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 13 2024-09-17T03:09:17.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.597+0000 7f15f0519640 1 -- 172.21.15.78:0/200333341 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f15cc078bc0 msgr2=0x7f15cc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:17.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.597+0000 7f15f0519640 1 --2- 172.21.15.78:0/200333341 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f15cc078bc0 0x7f15cc07b0d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f15e81f8af0 tx=0x7f15d8006ac0 comp rx=0 tx=0).stop 2024-09-17T03:09:17.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.597+0000 7f15f0519640 1 -- 172.21.15.78:0/200333341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15d4003a00 msgr2=0x7f15e815ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:17.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.597+0000 7f15f0519640 1 --2- 172.21.15.78:0/200333341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15d4003a00 0x7f15e815ad80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f15e4009a70 tx=0x7f15e40336f0 comp rx=0 tx=0).stop 2024-09-17T03:09:17.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.597+0000 7f15f0519640 1 -- 172.21.15.78:0/200333341 shutdown_connections 2024-09-17T03:09:17.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.597+0000 7f15f0519640 1 --2- 172.21.15.78:0/200333341 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15e815b510 0x7f15e81e9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:17.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.597+0000 7f15f0519640 1 --2- 172.21.15.78:0/200333341 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f15cc078bc0 0x7f15cc07b0d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:17.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.597+0000 7f15f0519640 1 --2- 172.21.15.78:0/200333341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15e815baf0 0x7f15e81e9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:17.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.597+0000 7f15f0519640 1 --2- 172.21.15.78:0/200333341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15d4003a00 0x7f15e815ad80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:17.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.597+0000 7f15f0519640 1 -- 172.21.15.78:0/200333341 >> 172.21.15.78:0/200333341 conn(0x7f15e808bfc0 msgr2=0x7f15e80d3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:17.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.597+0000 7f15f0519640 1 -- 172.21.15.78:0/200333341 shutdown_connections 2024-09-17T03:09:17.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:17.597+0000 7f15f0519640 1 -- 172.21.15.78:0/200333341 wait complete. 2024-09-17T03:09:18.011 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:09:08.411464+0000', 'modified': '2024-09-17T03:09:10.417439+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4938}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4938': {'gid': 4938, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6835/2663458793', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6834', 'nonce': 2663458793}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 2663458793}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4938, 'qdb_cluster': [4938]} 2024-09-17T03:09:18.011 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:09:18.012 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:09:18.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.128+0000 7f8cb2694640 1 -- 172.21.15.78:0/1271641070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cac0cff70 msgr2=0x7f8cac15c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:18.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.128+0000 7f8cb2694640 1 --2- 172.21.15.78:0/1271641070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cac0cff70 0x7f8cac15c830 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8cac1601e0 tx=0x7f8c9c02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.128+0000 7f8cb2694640 1 -- 172.21.15.78:0/1271641070 shutdown_connections 2024-09-17T03:09:18.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.128+0000 7f8cb2694640 1 --2- 172.21.15.78:0/1271641070 >> v2:172.21.15.193:3300/0 conn(0x7f8cac160c90 0x7f8cac0b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.128+0000 7f8cb2694640 1 --2- 172.21.15.78:0/1271641070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cac0cff70 0x7f8cac15c830 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.128+0000 7f8cb2694640 1 -- 172.21.15.78:0/1271641070 >> 172.21.15.78:0/1271641070 conn(0x7f8cac0cee20 msgr2=0x7f8cac0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:18.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.128+0000 7f8cb2694640 1 -- 172.21.15.78:0/1271641070 shutdown_connections 2024-09-17T03:09:18.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.128+0000 7f8cb2694640 1 -- 172.21.15.78:0/1271641070 wait complete. 2024-09-17T03:09:18.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.130+0000 7f8cb2694640 1 Processor -- start 2024-09-17T03:09:18.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.130+0000 7f8cb2694640 1 -- start start 2024-09-17T03:09:18.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.131+0000 7f8cb2694640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cac0b4360 0x7f8cac15c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.131+0000 7f8cb2694640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8cac0cff70 0x7f8cac1f6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.131+0000 7f8cb2694640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8cac160c90 0x7f8cac1f7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.131+0000 7f8cb2694640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac072ef0 con 0x7f8cac0b4360 2024-09-17T03:09:18.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.131+0000 7f8cb2694640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac0d1e50 con 0x7f8cac160c90 2024-09-17T03:09:18.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.131+0000 7f8cb2694640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8cac073070 con 0x7f8cac0cff70 2024-09-17T03:09:18.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.131+0000 7f8cabfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cac0b4360 0x7f8cac15c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.131+0000 7f8cabfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cac0b4360 0x7f8cac15c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56008/0 (socket says 172.21.15.78:56008) 2024-09-17T03:09:18.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.131+0000 7f8cabfff640 1 -- 172.21.15.78:0/2815324579 learned_addr learned my addr 172.21.15.78:0/2815324579 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:18.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.132+0000 7f8cabfff640 1 -- 172.21.15.78:0/2815324579 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8cac0cff70 msgr2=0x7f8cac1f6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:18.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.132+0000 7f8cabfff640 1 --2- 172.21.15.78:0/2815324579 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8cac0cff70 0x7f8cac1f6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.132+0000 7f8cb0c31640 1 --2- 172.21.15.78:0/2815324579 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8cac160c90 0x7f8cac1f7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.132+0000 7f8cabfff640 1 -- 172.21.15.78:0/2815324579 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8cac160c90 msgr2=0x7f8cac1f7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:18.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.132+0000 7f8cabfff640 1 --2- 172.21.15.78:0/2815324579 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8cac160c90 0x7f8cac1f7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.132+0000 7f8cabfff640 1 -- 172.21.15.78:0/2815324579 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cac0c6f20 con 0x7f8cac0b4360 2024-09-17T03:09:18.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.132+0000 7f8cabfff640 1 --2- 172.21.15.78:0/2815324579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cac0b4360 0x7f8cac15c8a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c02aac0 tx=0x7f8c9c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:18.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.132+0000 7f8ca97fa640 1 -- 172.21.15.78:0/2815324579 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c03e030 con 0x7f8cac0b4360 2024-09-17T03:09:18.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.132+0000 7f8ca97fa640 1 -- 172.21.15.78:0/2815324579 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c9c0047a0 con 0x7f8cac0b4360 2024-09-17T03:09:18.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.132+0000 7f8cb2694640 1 -- 172.21.15.78:0/2815324579 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cac0c71e0 con 0x7f8cac0b4360 2024-09-17T03:09:18.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.132+0000 7f8ca97fa640 1 -- 172.21.15.78:0/2815324579 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c035040 con 0x7f8cac0b4360 2024-09-17T03:09:18.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.132+0000 7f8cb2694640 1 -- 172.21.15.78:0/2815324579 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cac0c77a0 con 0x7f8cac0b4360 2024-09-17T03:09:18.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.134+0000 7f8ca97fa640 1 -- 172.21.15.78:0/2815324579 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8c9c041030 con 0x7f8cac0b4360 2024-09-17T03:09:18.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.134+0000 7f8ca97fa640 1 --2- 172.21.15.78:0/2815324579 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c8c078b90 0x7f8c8c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.135+0000 7f8ca97fa640 1 -- 172.21.15.78:0/2815324579 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8c9c0bb620 con 0x7f8cac0b4360 2024-09-17T03:09:18.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.135+0000 7f8ca3fff640 1 --2- 172.21.15.78:0/2815324579 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c8c078b90 0x7f8c8c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.135+0000 7f8ca3fff640 1 --2- 172.21.15.78:0/2815324579 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c8c078b90 0x7f8c8c07b0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400a860 tx=0x7f8c94005b50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:18.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.135+0000 7f8cb9605740 1 Processor -- start 2024-09-17T03:09:18.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.135+0000 7f8cb9605740 1 -- start start 2024-09-17T03:09:18.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.137+0000 7f8cb9605740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c84c3270 0x5599c8894fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.137+0000 7f8cb9605740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c849a3b0 0x5599c88954e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.137+0000 7f8cb9605740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84a2590 0x5599c88b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.137+0000 7f8cb9605740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5599c87dd820 con 0x5599c84a2590 2024-09-17T03:09:18.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.137+0000 7f8cb9605740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5599c87ccc50 con 0x5599c84c3270 2024-09-17T03:09:18.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.137+0000 7f8cb9605740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5599c87d0a60 con 0x5599c849a3b0 2024-09-17T03:09:18.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.137+0000 7f8cb0c31640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84a2590 0x5599c88b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.137+0000 7f8cb0c31640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84a2590 0x5599c88b23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56012/0 (socket says 172.21.15.78:56012) 2024-09-17T03:09:18.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.137+0000 7f8cb0c31640 1 -- 172.21.15.78:0/4157444917 learned_addr learned my addr 172.21.15.78:0/4157444917 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:18.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.137+0000 7f8ca3fff640 1 --2- 172.21.15.78:0/4157444917 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c849a3b0 0x5599c88954e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.137+0000 7f8cabfff640 1 --2- 172.21.15.78:0/4157444917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c84c3270 0x5599c8894fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.137+0000 7f8cb0c31640 1 -- 172.21.15.78:0/4157444917 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c849a3b0 msgr2=0x5599c88954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:18.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.137+0000 7f8cb0c31640 1 --2- 172.21.15.78:0/4157444917 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c849a3b0 0x5599c88954e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.137+0000 7f8cb0c31640 1 -- 172.21.15.78:0/4157444917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c84c3270 msgr2=0x5599c8894fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:18.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.137+0000 7f8cb0c31640 1 --2- 172.21.15.78:0/4157444917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c84c3270 0x5599c8894fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.137+0000 7f8cb0c31640 1 -- 172.21.15.78:0/4157444917 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599c852e850 con 0x5599c84a2590 2024-09-17T03:09:18.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.137+0000 7f8cb0c31640 1 --2- 172.21.15.78:0/4157444917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84a2590 0x5599c88b23e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4007d60 tx=0x7f8ca400c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d4f5fe61710d7b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:18.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.137+0000 7f8ca1ffb640 1 -- 172.21.15.78:0/4157444917 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4015020 con 0x5599c84a2590 2024-09-17T03:09:18.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.137+0000 7f8ca1ffb640 1 -- 172.21.15.78:0/4157444917 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ca4011410 con 0x5599c84a2590 2024-09-17T03:09:18.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.137+0000 7f8ca1ffb640 1 -- 172.21.15.78:0/4157444917 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca400d040 con 0x5599c84a2590 2024-09-17T03:09:18.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.138+0000 7f8cb9605740 1 -- 172.21.15.78:0/4157444917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84a2590 msgr2=0x5599c88b23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:18.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.138+0000 7f8cb9605740 1 --2- 172.21.15.78:0/4157444917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84a2590 0x5599c88b23e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4007d60 tx=0x7f8ca400c540 comp rx=0 tx=0).stop 2024-09-17T03:09:18.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.138+0000 7f8cb9605740 1 -- 172.21.15.78:0/4157444917 shutdown_connections 2024-09-17T03:09:18.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.138+0000 7f8cb9605740 1 --2- 172.21.15.78:0/4157444917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84a2590 0x5599c88b23e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.138+0000 7f8cb9605740 1 --2- 172.21.15.78:0/4157444917 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c849a3b0 0x5599c88954e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.138+0000 7f8cb9605740 1 --2- 172.21.15.78:0/4157444917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c84c3270 0x5599c8894fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.138+0000 7f8cb9605740 1 -- 172.21.15.78:0/4157444917 >> 172.21.15.78:0/4157444917 conn(0x5599c84b73c0 msgr2=0x5599c886b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:18.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.138+0000 7f8cb9605740 1 -- 172.21.15.78:0/4157444917 shutdown_connections 2024-09-17T03:09:18.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.138+0000 7f8cb9605740 1 -- 172.21.15.78:0/4157444917 wait complete. 2024-09-17T03:09:18.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.139+0000 7f8cb9605740 1 -- start start 2024-09-17T03:09:18.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.139+0000 7f8cb9605740 1 Processor -- start 2024-09-17T03:09:18.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8cb9605740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c849a3b0 0x5599c88bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8cb9605740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c84a2590 0x5599c887f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8cb9605740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84c3270 0x5599c887e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8cb9605740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5599c853d620 con 0x5599c84c3270 2024-09-17T03:09:18.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8cb9605740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5599c87725f0 con 0x5599c849a3b0 2024-09-17T03:09:18.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8cb9605740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5599c8895a20 con 0x5599c84a2590 2024-09-17T03:09:18.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8cb9605740 10 client.0 _ll_register_callbacks cb 0x5599c87760a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:09:18.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8cb0c31640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84c3270 0x5599c887e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8cb0c31640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84c3270 0x5599c887e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56028/0 (socket says 172.21.15.78:56028) 2024-09-17T03:09:18.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8cb0c31640 1 -- 172.21.15.78:0/2089599515 learned_addr learned my addr 172.21.15.78:0/2089599515 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:18.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8cabfff640 1 --2- 172.21.15.78:0/2089599515 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c849a3b0 0x5599c88bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8cb0c31640 1 -- 172.21.15.78:0/2089599515 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c84a2590 msgr2=0x5599c887f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:18.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8ca3fff640 1 --2- 172.21.15.78:0/2089599515 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c84a2590 0x5599c887f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8cb0c31640 1 --2- 172.21.15.78:0/2089599515 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c84a2590 0x5599c887f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8cb0c31640 1 -- 172.21.15.78:0/2089599515 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c849a3b0 msgr2=0x5599c88bfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:18.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8cb0c31640 1 --2- 172.21.15.78:0/2089599515 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c849a3b0 0x5599c88bfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8cb0c31640 1 -- 172.21.15.78:0/2089599515 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599c85a56b0 con 0x5599c84c3270 2024-09-17T03:09:18.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8cabfff640 1 --2- 172.21.15.78:0/2089599515 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c849a3b0 0x5599c88bfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:09:18.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8cb0c31640 1 --2- 172.21.15.78:0/2089599515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84c3270 0x5599c887e000 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4000f80 tx=0x7f8ca40070e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c20391cfe9cdc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:18.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8c8affd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:09:18.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8c8affd640 1 -- 172.21.15.78:0/2089599515 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4004040 con 0x5599c84c3270 2024-09-17T03:09:18.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8c8affd640 1 -- 172.21.15.78:0/2089599515 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8ca4025ae0 con 0x5599c84c3270 2024-09-17T03:09:18.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.141+0000 7f8cb9605740 1 -- 172.21.15.78:0/2089599515 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ca4011410 con 0x5599c84c3270 2024-09-17T03:09:18.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.142+0000 7f8c8affd640 1 -- 172.21.15.78:0/2089599515 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f8ca4015020 con 0x5599c84c3270 2024-09-17T03:09:18.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.142+0000 7f8cb9605740 10 client.5130 fetch_fsmap learned FSMap version 13 2024-09-17T03:09:18.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.142+0000 7f8cb9605740 1 -- 172.21.15.78:0/2089599515 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x5599c88c3800 con 0x5599c84c3270 2024-09-17T03:09:18.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.142+0000 7f8c8affd640 1 -- 172.21.15.78:0/2089599515 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8ca4011410 con 0x5599c84c3270 2024-09-17T03:09:18.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.142+0000 7f8c8affd640 1 -- 172.21.15.78:0/2089599515 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 13) ==== 3502+0+0 (secure 0 0 0) 0x7f8ca4010050 con 0x5599c84c3270 2024-09-17T03:09:18.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.142+0000 7f8cb9605740 10 client.5130 fetch_fsmap finished waiting for FSMap version 13 2024-09-17T03:09:18.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.142+0000 7f8cb9605740 10 client.5130 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:09:18.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.142+0000 7f8cb9605740 20 client.5130 populate_metadata read hostname 'smithi078' 2024-09-17T03:09:18.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.142+0000 7f8cb9605740 1 --2- 172.21.15.78:0/2089599515 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x5599c8481e40 0x5599c88a6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.142+0000 7f8cb9605740 4 client.5130 mds_command: new command op to 4938 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:09:18.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.142+0000 7f8cb9605740 1 -- 172.21.15.78:0/2089599515 --> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599c87df770 con 0x5599c8481e40 2024-09-17T03:09:18.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.142+0000 7f8cabfff640 1 --2- 172.21.15.78:0/2089599515 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x5599c8481e40 0x5599c88a6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.142+0000 7f8c8affd640 10 client.5130 ms_handle_connect on v2:172.21.15.78:6834/2663458793 2024-09-17T03:09:18.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.142+0000 7f8cabfff640 1 --2- 172.21.15.78:0/2089599515 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x5599c8481e40 0x5599c88a6f20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=163ad2b086d190f9 server_cookie=3ce0b033931e4cc7 in_seq=0 out_seq=0 2024-09-17T03:09:18.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.143+0000 7f8c8affd640 1 -- 172.21.15.78:0/2089599515 <== mds.0 v2:172.21.15.78:6834/2663458793 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5599c87df770 con 0x5599c8481e40 2024-09-17T03:09:18.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.143+0000 7f8c8affd640 10 client.5130 handle_command_reply: tid=0 2024-09-17T03:09:18.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.143+0000 7f8cb9605740 1 client.5130 shutdown 2024-09-17T03:09:18.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.143+0000 7f8cb9605740 1 -- 172.21.15.78:0/2089599515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84c3270 msgr2=0x5599c887e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:18.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.143+0000 7f8cb9605740 1 --2- 172.21.15.78:0/2089599515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84c3270 0x5599c887e000 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4000f80 tx=0x7f8ca40070e0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.143+0000 7f8cb9605740 1 -- 172.21.15.78:0/2089599515 shutdown_connections 2024-09-17T03:09:18.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.143+0000 7f8cb9605740 1 --2- 172.21.15.78:0/2089599515 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x5599c8481e40 0x5599c88a6f20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.143+0000 7f8cb9605740 1 --2- 172.21.15.78:0/2089599515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84c3270 0x5599c887e000 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.143+0000 7f8cb9605740 1 --2- 172.21.15.78:0/2089599515 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c84a2590 0x5599c887f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.143+0000 7f8c8affd640 0 client.5130 ms_handle_reset on v2:172.21.15.78:6834/2663458793 2024-09-17T03:09:18.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.143+0000 7f8cb9605740 1 --2- 172.21.15.78:0/2089599515 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c849a3b0 0x5599c88bfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.143+0000 7f8cb9605740 1 -- 172.21.15.78:0/2089599515 >> 172.21.15.78:0/2089599515 conn(0x5599c84b73c0 msgr2=0x5599c8865cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:18.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.143+0000 7f8cb9605740 1 -- 172.21.15.78:0/2089599515 shutdown_connections 2024-09-17T03:09:18.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.143+0000 7f8cb9605740 1 -- 172.21.15.78:0/2089599515 wait complete. 2024-09-17T03:09:18.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.143+0000 7f8cb9605740 20 client.5130 trim_cache size 0 max 16384 2024-09-17T03:09:18.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.162+0000 7f8cb9605740 1 Processor -- start 2024-09-17T03:09:18.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.162+0000 7f8cb9605740 1 -- start start 2024-09-17T03:09:18.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.163+0000 7f8cb9605740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c84b73c0 0x5599c88a8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.163+0000 7f8cb9605740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c849a3b0 0x5599c88c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.163+0000 7f8cb9605740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c84a2590 0x5599c886c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.163+0000 7f8cb9605740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac1fffa0 con 0x5599c849a3b0 2024-09-17T03:09:18.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.163+0000 7f8cb9605740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac1f46b0 con 0x5599c84a2590 2024-09-17T03:09:18.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.163+0000 7f8cb9605740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8cac1f3a60 con 0x5599c84b73c0 2024-09-17T03:09:18.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.163+0000 7f8ca3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c849a3b0 0x5599c88c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.163+0000 7f8ca3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c849a3b0 0x5599c88c2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56030/0 (socket says 172.21.15.78:56030) 2024-09-17T03:09:18.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.163+0000 7f8ca3fff640 1 -- 172.21.15.78:0/3175058071 learned_addr learned my addr 172.21.15.78:0/3175058071 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:18.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.163+0000 7f8cabfff640 1 --2- 172.21.15.78:0/3175058071 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c84b73c0 0x5599c88a8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.163+0000 7f8cb0c31640 1 --2- 172.21.15.78:0/3175058071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c84a2590 0x5599c886c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.163+0000 7f8ca3fff640 1 -- 172.21.15.78:0/3175058071 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c84b73c0 msgr2=0x5599c88a8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:18.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.163+0000 7f8ca3fff640 1 --2- 172.21.15.78:0/3175058071 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c84b73c0 0x5599c88a8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.163+0000 7f8ca3fff640 1 -- 172.21.15.78:0/3175058071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c84a2590 msgr2=0x5599c886c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:18.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.163+0000 7f8ca3fff640 1 --2- 172.21.15.78:0/3175058071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c84a2590 0x5599c886c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.163+0000 7f8ca3fff640 1 -- 172.21.15.78:0/3175058071 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599c88c2bb0 con 0x5599c849a3b0 2024-09-17T03:09:18.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.163+0000 7f8cabfff640 1 --2- 172.21.15.78:0/3175058071 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c84b73c0 0x5599c88a8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:09:18.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.163+0000 7f8ca3fff640 1 --2- 172.21.15.78:0/3175058071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c849a3b0 0x5599c88c2f10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400cca0 tx=0x7f8c9400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd12f9235d12d0a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:18.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.164+0000 7f8ca17fa640 1 -- 172.21.15.78:0/3175058071 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c94022070 con 0x5599c849a3b0 2024-09-17T03:09:18.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.164+0000 7f8ca17fa640 1 -- 172.21.15.78:0/3175058071 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c94016040 con 0x5599c849a3b0 2024-09-17T03:09:18.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.164+0000 7f8ca17fa640 1 -- 172.21.15.78:0/3175058071 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c940035f0 con 0x5599c849a3b0 2024-09-17T03:09:18.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.164+0000 7f8cb9605740 1 -- 172.21.15.78:0/3175058071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c849a3b0 msgr2=0x5599c88c2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:18.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.164+0000 7f8cb9605740 1 --2- 172.21.15.78:0/3175058071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c849a3b0 0x5599c88c2f10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400cca0 tx=0x7f8c9400f000 comp rx=0 tx=0).stop 2024-09-17T03:09:18.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.164+0000 7f8cb9605740 1 -- 172.21.15.78:0/3175058071 shutdown_connections 2024-09-17T03:09:18.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.164+0000 7f8cb9605740 1 --2- 172.21.15.78:0/3175058071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c84a2590 0x5599c886c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.164+0000 7f8cb9605740 1 --2- 172.21.15.78:0/3175058071 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c849a3b0 0x5599c88c2f10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.164+0000 7f8cb9605740 1 --2- 172.21.15.78:0/3175058071 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c84b73c0 0x5599c88a8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.164+0000 7f8cb9605740 1 -- 172.21.15.78:0/3175058071 >> 172.21.15.78:0/3175058071 conn(0x5599c88a8e30 msgr2=0x5599c8865d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:18.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.164+0000 7f8cb9605740 1 -- 172.21.15.78:0/3175058071 shutdown_connections 2024-09-17T03:09:18.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.164+0000 7f8cb9605740 1 -- 172.21.15.78:0/3175058071 wait complete. 2024-09-17T03:09:18.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.165+0000 7f8cb9605740 1 -- start start 2024-09-17T03:09:18.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.165+0000 7f8cb9605740 1 Processor -- start 2024-09-17T03:09:18.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.167+0000 7f8cb9605740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c849a3b0 0x5599c8932d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.167+0000 7f8cb9605740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84a2590 0x5599c8926100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.167+0000 7f8cb9605740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c84b73c0 0x5599c8881700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.167+0000 7f8cb9605740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5599c887ea90 con 0x5599c84a2590 2024-09-17T03:09:18.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.167+0000 7f8cb9605740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac1f4060 con 0x5599c849a3b0 2024-09-17T03:09:18.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.167+0000 7f8cb9605740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5599c8882b40 con 0x5599c84b73c0 2024-09-17T03:09:18.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.167+0000 7f8cb9605740 10 client.0 _ll_register_callbacks cb 0x7f8c9c003ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:09:18.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.167+0000 7f8ca3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84a2590 0x5599c8926100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.167+0000 7f8ca3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84a2590 0x5599c8926100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56034/0 (socket says 172.21.15.78:56034) 2024-09-17T03:09:18.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.167+0000 7f8ca3fff640 1 -- 172.21.15.78:0/2464068216 learned_addr learned my addr 172.21.15.78:0/2464068216 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:18.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.167+0000 7f8cb0c31640 1 --2- 172.21.15.78:0/2464068216 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c84b73c0 0x5599c8881700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.167+0000 7f8cabfff640 1 --2- 172.21.15.78:0/2464068216 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c849a3b0 0x5599c8932d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.167+0000 7f8ca3fff640 1 -- 172.21.15.78:0/2464068216 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c84b73c0 msgr2=0x5599c8881700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:18.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.167+0000 7f8ca3fff640 1 --2- 172.21.15.78:0/2464068216 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c84b73c0 0x5599c8881700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.167+0000 7f8ca3fff640 1 -- 172.21.15.78:0/2464068216 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c849a3b0 msgr2=0x5599c8932d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:18.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.167+0000 7f8ca3fff640 1 --2- 172.21.15.78:0/2464068216 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c849a3b0 0x5599c8932d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.167+0000 7f8ca3fff640 1 -- 172.21.15.78:0/2464068216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599c88be0b0 con 0x5599c84a2590 2024-09-17T03:09:18.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.167+0000 7f8ca3fff640 1 --2- 172.21.15.78:0/2464068216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84a2590 0x5599c8926100 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400fcb0 tx=0x7f8c940266c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51082981199a5c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:18.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.167+0000 7f8c8affd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:09:18.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.167+0000 7f8c8affd640 1 -- 172.21.15.78:0/2464068216 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c94022040 con 0x5599c84a2590 2024-09-17T03:09:18.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.168+0000 7f8c8affd640 1 -- 172.21.15.78:0/2464068216 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8c94026c40 con 0x5599c84a2590 2024-09-17T03:09:18.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.168+0000 7f8cb9605740 1 -- 172.21.15.78:0/2464068216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c94016040 con 0x5599c84a2590 2024-09-17T03:09:18.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.168+0000 7f8c8affd640 1 -- 172.21.15.78:0/2464068216 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f8c94037050 con 0x5599c84a2590 2024-09-17T03:09:18.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.168+0000 7f8cb9605740 10 client.5136 fetch_fsmap learned FSMap version 13 2024-09-17T03:09:18.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.168+0000 7f8cb9605740 1 -- 172.21.15.78:0/2464068216 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x5599c8933440 con 0x5599c84a2590 2024-09-17T03:09:18.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.168+0000 7f8c8affd640 1 -- 172.21.15.78:0/2464068216 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c94016040 con 0x5599c84a2590 2024-09-17T03:09:18.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.168+0000 7f8c8affd640 1 -- 172.21.15.78:0/2464068216 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 13) ==== 3502+0+0 (secure 0 0 0) 0x7f8c9403a020 con 0x5599c84a2590 2024-09-17T03:09:18.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.168+0000 7f8cb9605740 10 client.5136 fetch_fsmap finished waiting for FSMap version 13 2024-09-17T03:09:18.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.168+0000 7f8cb9605740 10 client.5136 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:09:18.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.168+0000 7f8cb9605740 20 client.5136 populate_metadata read hostname 'smithi078' 2024-09-17T03:09:18.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.168+0000 7f8cb9605740 1 --2- 172.21.15.78:0/2464068216 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x5599c8457280 0x5599c8883a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.168+0000 7f8cb9605740 4 client.5136 mds_command: new command op to 4938 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:09:18.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.168+0000 7f8cb9605740 1 -- 172.21.15.78:0/2464068216 --> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] -- command(tid 0: {"prefix": "status"}) -- 0x5599c87db220 con 0x5599c8457280 2024-09-17T03:09:18.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.168+0000 7f8cabfff640 1 --2- 172.21.15.78:0/2464068216 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x5599c8457280 0x5599c8883a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.168+0000 7f8c8affd640 10 client.5136 ms_handle_connect on v2:172.21.15.78:6834/2663458793 2024-09-17T03:09:18.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.169+0000 7f8cabfff640 1 --2- 172.21.15.78:0/2464068216 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x5599c8457280 0x5599c8883a60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd31911f4d9a84fc server_cookie=94bbd8819e193e0a in_seq=0 out_seq=0 2024-09-17T03:09:18.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.169+0000 7f8c8affd640 1 -- 172.21.15.78:0/2464068216 <== mds.0 v2:172.21.15.78:6834/2663458793 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5599c87db220 con 0x5599c8457280 2024-09-17T03:09:18.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.169+0000 7f8c8affd640 10 client.5136 handle_command_reply: tid=0 2024-09-17T03:09:18.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.169+0000 7f8cb9605740 1 client.5136 shutdown 2024-09-17T03:09:18.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.169+0000 7f8cb9605740 1 -- 172.21.15.78:0/2464068216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84a2590 msgr2=0x5599c8926100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:18.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.169+0000 7f8cb9605740 1 --2- 172.21.15.78:0/2464068216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84a2590 0x5599c8926100 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400fcb0 tx=0x7f8c940266c0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.169+0000 7f8cb9605740 1 -- 172.21.15.78:0/2464068216 shutdown_connections 2024-09-17T03:09:18.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.169+0000 7f8cb9605740 1 --2- 172.21.15.78:0/2464068216 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x5599c8457280 0x5599c8883a60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.169+0000 7f8cb9605740 1 --2- 172.21.15.78:0/2464068216 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5599c84b73c0 0x5599c8881700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.169+0000 7f8c8affd640 0 client.5136 ms_handle_reset on v2:172.21.15.78:6834/2663458793 2024-09-17T03:09:18.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.169+0000 7f8cb9605740 1 --2- 172.21.15.78:0/2464068216 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5599c84a2590 0x5599c8926100 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.169+0000 7f8cb9605740 1 --2- 172.21.15.78:0/2464068216 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5599c849a3b0 0x5599c8932d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.169+0000 7f8cb9605740 1 -- 172.21.15.78:0/2464068216 >> 172.21.15.78:0/2464068216 conn(0x5599c88a8e30 msgr2=0x5599c88b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:18.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.169+0000 7f8cb9605740 1 -- 172.21.15.78:0/2464068216 shutdown_connections 2024-09-17T03:09:18.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.169+0000 7f8cb9605740 1 -- 172.21.15.78:0/2464068216 wait complete. 2024-09-17T03:09:18.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.169+0000 7f8cb9605740 20 client.5136 trim_cache size 0 max 16384 2024-09-17T03:09:18.175 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:09:18.175 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:09:18.175 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-09-17T03:09:18.175 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4938, 2024-09-17T03:09:18.175 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:09:18.175 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:09:18.175 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:09:18.175 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 9.1281190060000004, 2024-09-17T03:09:18.175 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 13, 2024-09-17T03:09:18.176 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 34, 2024-09-17T03:09:18.176 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 34, 2024-09-17T03:09:18.176 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 16.306558356 2024-09-17T03:09:18.176 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:09:18.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.170+0000 7f8cb2694640 1 -- 172.21.15.78:0/2815324579 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c8c078b90 msgr2=0x7f8c8c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:18.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.170+0000 7f8cb2694640 1 --2- 172.21.15.78:0/2815324579 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c8c078b90 0x7f8c8c07b0a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400a860 tx=0x7f8c94005b50 comp rx=0 tx=0).stop 2024-09-17T03:09:18.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.170+0000 7f8cb2694640 1 -- 172.21.15.78:0/2815324579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cac0b4360 msgr2=0x7f8cac15c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:18.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.170+0000 7f8cb2694640 1 --2- 172.21.15.78:0/2815324579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cac0b4360 0x7f8cac15c8a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c02aac0 tx=0x7f8c9c0039e0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.170+0000 7f8cb2694640 1 -- 172.21.15.78:0/2815324579 shutdown_connections 2024-09-17T03:09:18.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.170+0000 7f8cb2694640 1 --2- 172.21.15.78:0/2815324579 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c8c078b90 0x7f8c8c07b0a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.170+0000 7f8cb2694640 1 --2- 172.21.15.78:0/2815324579 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8cac160c90 0x7f8cac1f7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.170+0000 7f8cb2694640 1 --2- 172.21.15.78:0/2815324579 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8cac0cff70 0x7f8cac1f6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.170+0000 7f8cb2694640 1 --2- 172.21.15.78:0/2815324579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8cac0b4360 0x7f8cac15c8a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.170+0000 7f8cb2694640 1 -- 172.21.15.78:0/2815324579 >> 172.21.15.78:0/2815324579 conn(0x7f8cac0cee20 msgr2=0x7f8cac158520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:18.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.170+0000 7f8cb2694640 1 -- 172.21.15.78:0/2815324579 shutdown_connections 2024-09-17T03:09:18.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.170+0000 7f8cb2694640 1 -- 172.21.15.78:0/2815324579 wait complete. 2024-09-17T03:09:18.180 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:09:18.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.293+0000 7f1bc144d640 1 -- 172.21.15.78:0/2744174782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bbc0cf7a0 msgr2=0x7f1bbc1626e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:18.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.293+0000 7f1bc144d640 1 --2- 172.21.15.78:0/2744174782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bbc0cf7a0 0x7f1bbc1626e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc08d4e0 tx=0x7f1bb402a5f0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.293+0000 7f1bc144d640 1 -- 172.21.15.78:0/2744174782 shutdown_connections 2024-09-17T03:09:18.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.293+0000 7f1bc144d640 1 --2- 172.21.15.78:0/2744174782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bbc0cf7a0 0x7f1bbc1626e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.293+0000 7f1bc144d640 1 --2- 172.21.15.78:0/2744174782 >> v2:172.21.15.193:3300/0 conn(0x7f1bbc0d2ed0 0x7f1bbc0d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.293+0000 7f1bc144d640 1 -- 172.21.15.78:0/2744174782 >> 172.21.15.78:0/2744174782 conn(0x7f1bbc08bfc0 msgr2=0x7f1bbc09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:18.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.293+0000 7f1bc144d640 1 -- 172.21.15.78:0/2744174782 shutdown_connections 2024-09-17T03:09:18.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.293+0000 7f1bc144d640 1 -- 172.21.15.78:0/2744174782 wait complete. 2024-09-17T03:09:18.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.295+0000 7f1bc144d640 1 Processor -- start 2024-09-17T03:09:18.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.295+0000 7f1bc144d640 1 -- start start 2024-09-17T03:09:18.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.296+0000 7f1bc144d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1bbc0b9b70 0x7f1bbc1f9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.296+0000 7f1bc144d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bbc0cf7a0 0x7f1bbc0cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.296+0000 7f1bc144d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bbc0d2ed0 0x7f1bbc0ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.296+0000 7f1bc144d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc162c20 con 0x7f1bbc0d2ed0 2024-09-17T03:09:18.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.296+0000 7f1bc144d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1bbc0cfed0 con 0x7f1bbc0cf7a0 2024-09-17T03:09:18.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.296+0000 7f1bc144d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f1bbc162da0 con 0x7f1bbc0b9b70 2024-09-17T03:09:18.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.296+0000 7f1bbb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bbc0d2ed0 0x7f1bbc0ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.296+0000 7f1bbb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bbc0d2ed0 0x7f1bbc0ce3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56042/0 (socket says 172.21.15.78:56042) 2024-09-17T03:09:18.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.296+0000 7f1bbb7fe640 1 -- 172.21.15.78:0/623143447 learned_addr learned my addr 172.21.15.78:0/623143447 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:18.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.297+0000 7f1bba7fc640 1 --2- 172.21.15.78:0/623143447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bbc0cf7a0 0x7f1bbc0cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.297+0000 7f1bbaffd640 1 --2- 172.21.15.78:0/623143447 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1bbc0b9b70 0x7f1bbc1f9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.297+0000 7f1bbb7fe640 1 -- 172.21.15.78:0/623143447 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1bbc0b9b70 msgr2=0x7f1bbc1f9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:18.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.297+0000 7f1bbb7fe640 1 --2- 172.21.15.78:0/623143447 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1bbc0b9b70 0x7f1bbc1f9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.297+0000 7f1bbb7fe640 1 -- 172.21.15.78:0/623143447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bbc0cf7a0 msgr2=0x7f1bbc0cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:18.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.297+0000 7f1bbb7fe640 1 --2- 172.21.15.78:0/623143447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bbc0cf7a0 0x7f1bbc0cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.297+0000 7f1bbb7fe640 1 -- 172.21.15.78:0/623143447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bbc0c9c60 con 0x7f1bbc0d2ed0 2024-09-17T03:09:18.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.297+0000 7f1bba7fc640 1 --2- 172.21.15.78:0/623143447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bbc0cf7a0 0x7f1bbc0cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:09:18.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.297+0000 7f1bbaffd640 1 --2- 172.21.15.78:0/623143447 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1bbc0b9b70 0x7f1bbc1f9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:09:18.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.297+0000 7f1bbb7fe640 1 --2- 172.21.15.78:0/623143447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bbc0d2ed0 0x7f1bbc0ce3c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40099c0 tx=0x7f1bb40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:18.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.297+0000 7f1ba37fe640 1 -- 172.21.15.78:0/623143447 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb403e030 con 0x7f1bbc0d2ed0 2024-09-17T03:09:18.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.297+0000 7f1ba37fe640 1 -- 172.21.15.78:0/623143447 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bb40047a0 con 0x7f1bbc0d2ed0 2024-09-17T03:09:18.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.297+0000 7f1bc144d640 1 -- 172.21.15.78:0/623143447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bbc1f93c0 con 0x7f1bbc0d2ed0 2024-09-17T03:09:18.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.297+0000 7f1ba37fe640 1 -- 172.21.15.78:0/623143447 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4035040 con 0x7f1bbc0d2ed0 2024-09-17T03:09:18.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.297+0000 7f1bc144d640 1 -- 172.21.15.78:0/623143447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bbc1f9980 con 0x7f1bbc0d2ed0 2024-09-17T03:09:18.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.298+0000 7f1bc144d640 1 -- 172.21.15.78:0/623143447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bbc163370 con 0x7f1bbc0d2ed0 2024-09-17T03:09:18.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.299+0000 7f1ba37fe640 1 -- 172.21.15.78:0/623143447 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1bb4041030 con 0x7f1bbc0d2ed0 2024-09-17T03:09:18.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.299+0000 7f1ba37fe640 1 --2- 172.21.15.78:0/623143447 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1ba8078b90 0x7f1ba807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:18.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.299+0000 7f1ba37fe640 1 -- 172.21.15.78:0/623143447 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1bb40bb590 con 0x7f1bbc0d2ed0 2024-09-17T03:09:18.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.300+0000 7f1bbaffd640 1 --2- 172.21.15.78:0/623143447 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1ba8078b90 0x7f1ba807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:18.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.300+0000 7f1bbaffd640 1 --2- 172.21.15.78:0/623143447 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1ba8078b90 0x7f1ba807b0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1bac007eb0 tx=0x7f1bac0073c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:18.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.304+0000 7f1ba37fe640 1 -- 172.21.15.78:0/623143447 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1bb40839e0 con 0x7f1bbc0d2ed0 2024-09-17T03:09:18.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.511+0000 7f1bc144d640 1 -- 172.21.15.78:0/623143447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1bbc0c99f0 con 0x7f1bbc0d2ed0 2024-09-17T03:09:18.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.511+0000 7f1ba37fe640 1 -- 172.21.15.78:0/623143447 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) ==== 53+0+73 (secure 0 0 0) 0x7f1bb40832e0 con 0x7f1bbc0d2ed0 2024-09-17T03:09:18.510 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:09:18.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.514+0000 7f1bc144d640 1 -- 172.21.15.78:0/623143447 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1ba8078b90 msgr2=0x7f1ba807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:18.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.514+0000 7f1bc144d640 1 --2- 172.21.15.78:0/623143447 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1ba8078b90 0x7f1ba807b0a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1bac007eb0 tx=0x7f1bac0073c0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.514+0000 7f1bc144d640 1 -- 172.21.15.78:0/623143447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bbc0d2ed0 msgr2=0x7f1bbc0ce3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:18.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.514+0000 7f1bc144d640 1 --2- 172.21.15.78:0/623143447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bbc0d2ed0 0x7f1bbc0ce3c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40099c0 tx=0x7f1bb40039e0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.514+0000 7f1bc144d640 1 -- 172.21.15.78:0/623143447 shutdown_connections 2024-09-17T03:09:18.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.514+0000 7f1bc144d640 1 --2- 172.21.15.78:0/623143447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bbc0d2ed0 0x7f1bbc0ce3c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.514+0000 7f1bc144d640 1 --2- 172.21.15.78:0/623143447 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1ba8078b90 0x7f1ba807b0a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.514+0000 7f1bc144d640 1 --2- 172.21.15.78:0/623143447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bbc0cf7a0 0x7f1bbc0cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.514+0000 7f1bc144d640 1 --2- 172.21.15.78:0/623143447 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1bbc0b9b70 0x7f1bbc1f9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:18.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.514+0000 7f1bc144d640 1 -- 172.21.15.78:0/623143447 >> 172.21.15.78:0/623143447 conn(0x7f1bbc08bfc0 msgr2=0x7f1bbc0b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:18.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.514+0000 7f1bc144d640 1 -- 172.21.15.78:0/623143447 shutdown_connections 2024-09-17T03:09:18.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18.514+0000 7f1bc144d640 1 -- 172.21.15.78:0/623143447 wait complete. 2024-09-17T03:09:18.523 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:09:18.524 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:09:18.524 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2024-09-17T03:09:18.524 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:09:18.524 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:09:18.524 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:09:18.524 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:09:18.524 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:09:18.524 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:09:18.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:09:18.524 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2024-09-17T03:09:18.540 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:09:18.540 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:09:18.540 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:09:18.540 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:09:18.540 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2024-09-17T03:09:18.541 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:09:18.541 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:09:18.541 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:09:18.541 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2024-09-17T03:09:18.541 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:09:18.541 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:09:18.541 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2024-09-17T03:09:18.541 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:09:18.541 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:09:18.541 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:09:18.541 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:09:18.541 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:09:18.541 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42707sec preferred_lft 42707sec 2024-09-17T03:09:18.542 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link noprefixroute 2024-09-17T03:09:18.542 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:09:18.542 INFO:teuthology.orchestra.run.smithi078.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:09:18.542 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0e:9b:80:f7:8b:c2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:09:18.542 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:09:18.542 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:09:18.542 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::58a0:47ff:fe97:6de8/64 scope link 2024-09-17T03:09:18.542 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:09:18.542 INFO:teuthology.orchestra.run.smithi078.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:09:18.542 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether e6:fb:78:d9:ba:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:09:18.542 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::e4fb:78ff:fed9:ba75/64 scope link 2024-09-17T03:09:18.542 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:09:18.542 INFO:teuthology.orchestra.run.smithi078.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:09:18.543 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0e:9b:80:f7:8b:c2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:09:18.543 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::c9b:80ff:fef7:8bc2/64 scope link 2024-09-17T03:09:18.543 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:09:18.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:09:18.543 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:09:18.604 INFO:teuthology.orchestra.run.smithi078.stdout:1 2024-09-17T03:09:18.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:09:18.606 DEBUG:teuthology.orchestra.run.smithi078:> route 2024-09-17T03:09:18.663 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2024-09-17T03:09:18.663 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:09:18.663 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:09:18.663 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:09:18.663 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:09:18.663 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:09:18.664 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-17T03:09:18.664 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:09:18.664 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:09:18.664 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:09:18.664 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-17T03:09:18.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:09:18.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:09:18.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:09:18.790 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-17T03:09:18.805 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:09:18.805 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:09:18.805 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:09:18.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:09:18.805 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2024-09-17T03:09:18.871 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:09:18.872 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:09:18.927 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:09:18.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:09:18.927 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:09:18.983 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:09:18.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:09:18.983 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:09:19.078 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:09:19.078 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:09:19.078 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:09:19.089 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:09:19.089 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:09:19.089 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:09:19.089 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-09-17T03:09:19.089 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:09:19.095 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:09:19.095 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:09:19.095 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:09:19.095 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-09-17T03:09:19.096 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:09:19.096 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:6789,172.21.15.193:6789,172.21.15.193:6790" 2024-09-17T03:09:19.096 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.78:6789,172.21.15.193:6789,172.21.15.193:6790:/ 2024-09-17T03:09:19.096 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f3c59ba9-dab4-4ee6-8989-d80d11d430b6" will pass to kernel 2024-09-17T03:09:19.096 INFO:teuthology.orchestra.run.smithi078.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:09:19.096 INFO:teuthology.orchestra.run.smithi078.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:09:19.096 INFO:teuthology.orchestra.run.smithi078.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:09:19.096 INFO:teuthology.orchestra.run.smithi078.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:09:19.096 INFO:teuthology.orchestra.run.smithi078.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:09:19.098 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:09:19.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:09:19.098 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:09:19.123 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:09:19.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:09:19.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:09:19.224 INFO:teuthology.orchestra.run.smithi078.stdout:client4760 2024-09-17T03:09:19.224 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:09:19.224 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:09:19.241 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-17T03:09:19.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.398+0000 7f8097a38640 1 -- 172.21.15.78:0/1932939761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f807c0039e0 msgr2=0x7f807c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:19.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.398+0000 7f8097a38640 1 --2- 172.21.15.78:0/1932939761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f807c0039e0 0x7f807c003e30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f808c001eb0 tx=0x7f807c005830 comp rx=0 tx=0).stop 2024-09-17T03:09:19.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.398+0000 7f8095fd5640 1 -- 172.21.15.78:0/1932939761 reap_dead start 2024-09-17T03:09:19.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.398+0000 7f8097a38640 1 -- 172.21.15.78:0/1932939761 shutdown_connections 2024-09-17T03:09:19.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.398+0000 7f8097a38640 1 -- 172.21.15.78:0/1932939761 >> 172.21.15.78:0/1932939761 conn(0x7f809008bfc0 msgr2=0x7f809009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:19.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.398+0000 7f8097a38640 1 -- 172.21.15.78:0/1932939761 shutdown_connections 2024-09-17T03:09:19.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.398+0000 7f8097a38640 1 -- 172.21.15.78:0/1932939761 wait complete. 2024-09-17T03:09:19.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.400+0000 7f8097a38640 1 Processor -- start 2024-09-17T03:09:19.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.400+0000 7f8097a38640 1 -- start start 2024-09-17T03:09:19.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.401+0000 7f8097a38640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f807c0039e0 0x7f8090160850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:19.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.401+0000 7f8097a38640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80900cae90 0x7f8090160d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:19.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.401+0000 7f8097a38640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80901f4ff0 0x7f80901f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:19.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.401+0000 7f8097a38640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f80900cf2e0 con 0x7f80901f4ff0 2024-09-17T03:09:19.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.401+0000 7f8097a38640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f80900cf160 con 0x7f807c0039e0 2024-09-17T03:09:19.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.401+0000 7f8097a38640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f80900d0ce0 con 0x7f80900cae90 2024-09-17T03:09:19.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.401+0000 7f8095fd5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80901f4ff0 0x7f80901f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:19.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.401+0000 7f8095fd5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80901f4ff0 0x7f80901f5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56054/0 (socket says 172.21.15.78:56054) 2024-09-17T03:09:19.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.401+0000 7f8095fd5640 1 -- 172.21.15.78:0/3398042786 learned_addr learned my addr 172.21.15.78:0/3398042786 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:19.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.402+0000 7f8095fd5640 1 -- 172.21.15.78:0/3398042786 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80900cae90 msgr2=0x7f8090160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:19.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.402+0000 7f8094fd3640 1 --2- 172.21.15.78:0/3398042786 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80900cae90 0x7f8090160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:19.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.402+0000 7f80957d4640 1 --2- 172.21.15.78:0/3398042786 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f807c0039e0 0x7f8090160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:19.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.402+0000 7f8095fd5640 1 --2- 172.21.15.78:0/3398042786 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80900cae90 0x7f8090160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:19.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.402+0000 7f8095fd5640 1 -- 172.21.15.78:0/3398042786 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f807c0039e0 msgr2=0x7f8090160850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:19.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.402+0000 7f8095fd5640 1 --2- 172.21.15.78:0/3398042786 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f807c0039e0 0x7f8090160850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:19.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.402+0000 7f8095fd5640 1 -- 172.21.15.78:0/3398042786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80900c8a30 con 0x7f80901f4ff0 2024-09-17T03:09:19.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.402+0000 7f8094fd3640 1 --2- 172.21.15.78:0/3398042786 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80900cae90 0x7f8090160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:09:19.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.402+0000 7f80957d4640 1 --2- 172.21.15.78:0/3398042786 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f807c0039e0 0x7f8090160850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:09:19.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.402+0000 7f8095fd5640 1 --2- 172.21.15.78:0/3398042786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80901f4ff0 0x7f80901f5400 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8088005fd0 tx=0x7f8088009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:19.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.402+0000 7f8085ffb640 1 -- 172.21.15.78:0/3398042786 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8088004b20 con 0x7f80901f4ff0 2024-09-17T03:09:19.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.402+0000 7f8085ffb640 1 -- 172.21.15.78:0/3398042786 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8088004db0 con 0x7f80901f4ff0 2024-09-17T03:09:19.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.402+0000 7f8085ffb640 1 -- 172.21.15.78:0/3398042786 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f808800f9d0 con 0x7f80901f4ff0 2024-09-17T03:09:19.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.402+0000 7f8097a38640 1 -- 172.21.15.78:0/3398042786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80900ca3d0 con 0x7f80901f4ff0 2024-09-17T03:09:19.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.402+0000 7f8097a38640 1 -- 172.21.15.78:0/3398042786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80900ca990 con 0x7f80901f4ff0 2024-09-17T03:09:19.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.403+0000 7f8097a38640 1 -- 172.21.15.78:0/3398042786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f809006e170 con 0x7f80901f4ff0 2024-09-17T03:09:19.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.404+0000 7f8085ffb640 1 -- 172.21.15.78:0/3398042786 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f808801b020 con 0x7f80901f4ff0 2024-09-17T03:09:19.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.404+0000 7f8085ffb640 1 --2- 172.21.15.78:0/3398042786 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8074078bc0 0x7f807407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:19.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.404+0000 7f8085ffb640 1 -- 172.21.15.78:0/3398042786 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f808809ae00 con 0x7f80901f4ff0 2024-09-17T03:09:19.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.405+0000 7f80957d4640 1 --2- 172.21.15.78:0/3398042786 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8074078bc0 0x7f807407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:19.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.405+0000 7f80957d4640 1 --2- 172.21.15.78:0/3398042786 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8074078bc0 0x7f807407b0d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f808c033000 tx=0x7f808c001a30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:19.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.409+0000 7f8085ffb640 1 -- 172.21.15.78:0/3398042786 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f80880631c0 con 0x7f80901f4ff0 2024-09-17T03:09:19.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:19.618+0000 7f8097a38640 1 -- 172.21.15.78:0/3398042786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f80900c87c0 con 0x7f80901f4ff0 2024-09-17T03:09:20.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.208+0000 7f8085ffb640 1 -- 172.21.15.78:0/3398042786 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v14) ==== 105+0+0 (secure 0 0 0) 0x7f8088062ac0 con 0x7f80901f4ff0 2024-09-17T03:09:20.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.211+0000 7f8097a38640 1 -- 172.21.15.78:0/3398042786 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8074078bc0 msgr2=0x7f807407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:20.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.211+0000 7f8097a38640 1 --2- 172.21.15.78:0/3398042786 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8074078bc0 0x7f807407b0d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f808c033000 tx=0x7f808c001a30 comp rx=0 tx=0).stop 2024-09-17T03:09:20.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.211+0000 7f8097a38640 1 -- 172.21.15.78:0/3398042786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80901f4ff0 msgr2=0x7f80901f5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:20.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.211+0000 7f8097a38640 1 --2- 172.21.15.78:0/3398042786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80901f4ff0 0x7f80901f5400 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8088005fd0 tx=0x7f8088009b00 comp rx=0 tx=0).stop 2024-09-17T03:09:20.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.211+0000 7f8097a38640 1 -- 172.21.15.78:0/3398042786 shutdown_connections 2024-09-17T03:09:20.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.211+0000 7f8097a38640 1 --2- 172.21.15.78:0/3398042786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80901f4ff0 0x7f80901f5400 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:20.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.211+0000 7f8097a38640 1 --2- 172.21.15.78:0/3398042786 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80900cae90 0x7f8090160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:20.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.211+0000 7f8097a38640 1 --2- 172.21.15.78:0/3398042786 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8074078bc0 0x7f807407b0d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:20.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.211+0000 7f8097a38640 1 --2- 172.21.15.78:0/3398042786 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f807c0039e0 0x7f8090160850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:20.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.211+0000 7f8097a38640 1 -- 172.21.15.78:0/3398042786 >> 172.21.15.78:0/3398042786 conn(0x7f809008bfc0 msgr2=0x7f80900b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:20.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.211+0000 7f8097a38640 1 -- 172.21.15.78:0/3398042786 shutdown_connections 2024-09-17T03:09:20.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.211+0000 7f8097a38640 1 -- 172.21.15.78:0/3398042786 wait complete. 2024-09-17T03:09:20.227 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:09:20.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.340+0000 7f749b4b6640 1 -- 172.21.15.78:0/214146644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749415b8f0 msgr2=0x7f74940cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:20.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.340+0000 7f749b4b6640 1 --2- 172.21.15.78:0/214146644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749415b8f0 0x7f74940cf130 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7490009900 tx=0x7f749002a610 comp rx=0 tx=0).stop 2024-09-17T03:09:20.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.340+0000 7f749b4b6640 1 -- 172.21.15.78:0/214146644 shutdown_connections 2024-09-17T03:09:20.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.340+0000 7f749b4b6640 1 --2- 172.21.15.78:0/214146644 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74940b2cb0 0x7f74940b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:20.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.340+0000 7f749b4b6640 1 --2- 172.21.15.78:0/214146644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749415b8f0 0x7f74940cf130 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:20.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.340+0000 7f749b4b6640 1 -- 172.21.15.78:0/214146644 >> 172.21.15.78:0/214146644 conn(0x7f74940cdcb0 msgr2=0x7f74940ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:20.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.340+0000 7f749b4b6640 1 -- 172.21.15.78:0/214146644 shutdown_connections 2024-09-17T03:09:20.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.340+0000 7f749b4b6640 1 -- 172.21.15.78:0/214146644 wait complete. 2024-09-17T03:09:20.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.342+0000 7f749b4b6640 1 Processor -- start 2024-09-17T03:09:20.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.342+0000 7f749b4b6640 1 -- start start 2024-09-17T03:09:20.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.343+0000 7f749b4b6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74940b0520 0x7f74941e0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:20.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.343+0000 7f749b4b6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74940b2cb0 0x7f749415a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:20.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.343+0000 7f749b4b6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749415b8f0 0x7f74941f7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:20.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.344+0000 7f749b4b6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f74940ae330 con 0x7f749415b8f0 2024-09-17T03:09:20.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.344+0000 7f749b4b6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f74940ae1b0 con 0x7f74940b2cb0 2024-09-17T03:09:20.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.344+0000 7f749b4b6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f74940ae4b0 con 0x7f74940b0520 2024-09-17T03:09:20.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.344+0000 7f7499a53640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749415b8f0 0x7f74941f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:20.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.344+0000 7f7499a53640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749415b8f0 0x7f74941f7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56070/0 (socket says 172.21.15.78:56070) 2024-09-17T03:09:20.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.344+0000 7f7499a53640 1 -- 172.21.15.78:0/842243194 learned_addr learned my addr 172.21.15.78:0/842243194 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:20.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.344+0000 7f7499252640 1 --2- 172.21.15.78:0/842243194 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74940b0520 0x7f74941e0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:20.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.344+0000 7f7498a51640 1 --2- 172.21.15.78:0/842243194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74940b2cb0 0x7f749415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:20.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.344+0000 7f7499a53640 1 -- 172.21.15.78:0/842243194 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74940b0520 msgr2=0x7f74941e0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.344+0000 7f7499a53640 1 --2- 172.21.15.78:0/842243194 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74940b0520 0x7f74941e0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.344+0000 7f7499a53640 1 -- 172.21.15.78:0/842243194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74940b2cb0 msgr2=0x7f749415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.344+0000 7f7499a53640 1 --2- 172.21.15.78:0/842243194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74940b2cb0 0x7f749415a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.344+0000 7f7499a53640 1 -- 172.21.15.78:0/842243194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f749409aad0 con 0x7f749415b8f0 2024-09-17T03:09:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.344+0000 7f7499252640 1 --2- 172.21.15.78:0/842243194 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74940b0520 0x7f74941e0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.344+0000 7f7499a53640 1 --2- 172.21.15.78:0/842243194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749415b8f0 0x7f74941f7190 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f748c00e960 tx=0x7f748c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.344+0000 7f7489ffb640 1 -- 172.21.15.78:0/842243194 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748c004d20 con 0x7f749415b8f0 2024-09-17T03:09:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.344+0000 7f7489ffb640 1 -- 172.21.15.78:0/842243194 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f748c00cac0 con 0x7f749415b8f0 2024-09-17T03:09:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.344+0000 7f749b4b6640 1 -- 172.21.15.78:0/842243194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f749409adb0 con 0x7f749415b8f0 2024-09-17T03:09:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.344+0000 7f7489ffb640 1 -- 172.21.15.78:0/842243194 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748c005020 con 0x7f749415b8f0 2024-09-17T03:09:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.345+0000 7f749b4b6640 1 -- 172.21.15.78:0/842243194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f749409b370 con 0x7f749415b8f0 2024-09-17T03:09:20.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.346+0000 7f749b4b6640 1 -- 172.21.15.78:0/842243194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74941e10c0 con 0x7f749415b8f0 2024-09-17T03:09:20.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.346+0000 7f7489ffb640 1 -- 172.21.15.78:0/842243194 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f748c0051c0 con 0x7f749415b8f0 2024-09-17T03:09:20.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.347+0000 7f7489ffb640 1 --2- 172.21.15.78:0/842243194 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7478078b90 0x7f747807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:20.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.347+0000 7f7489ffb640 1 -- 172.21.15.78:0/842243194 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f748c09b6b0 con 0x7f749415b8f0 2024-09-17T03:09:20.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.347+0000 7f7499252640 1 --2- 172.21.15.78:0/842243194 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7478078b90 0x7f747807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:20.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.348+0000 7f7499252640 1 --2- 172.21.15.78:0/842243194 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7478078b90 0x7f747807b0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7490033000 tx=0x7f7490004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:20.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.351+0000 7f7489ffb640 1 -- 172.21.15.78:0/842243194 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f748c016030 con 0x7f749415b8f0 2024-09-17T03:09:20.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.559+0000 7f749b4b6640 1 -- 172.21.15.78:0/842243194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74940b30c0 con 0x7f749415b8f0 2024-09-17T03:09:20.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.560+0000 7f7489ffb640 1 -- 172.21.15.78:0/842243194 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5245 (secure 0 0 0) 0x7f748c063af0 con 0x7f749415b8f0 2024-09-17T03:09:20.560 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:09:20.560 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":15,"btime":"2024-09-17T03:09:20:211933+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2234221933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2234221933},{"type":"v1","addr":"172.21.15.193:6836","nonce":2234221933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4661,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/2343001441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2343001441},{"type":"v1","addr":"172.21.15.193:6837","nonce":2343001441}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:09:08.411464+0000","modified":"2024-09-17T03:09:20.211920+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":4938,"mds_1":4929},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4929":{"gid":4929,"name":"c","rank":1,"incarnation":15,"state":"up:creating","state_seq":1,"addr":"172.21.15.78:6833/2730690660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2730690660},{"type":"v1","addr":"172.21.15.78:6833","nonce":2730690660}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/2663458793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2663458793},{"type":"v1","addr":"172.21.15.78:6835","nonce":2663458793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4938,"qdb_cluster":[4938]},"id":2}]} 2024-09-17T03:09:20.560 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 15 2024-09-17T03:09:20.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.562+0000 7f749b4b6640 1 -- 172.21.15.78:0/842243194 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7478078b90 msgr2=0x7f747807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:20.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.562+0000 7f749b4b6640 1 --2- 172.21.15.78:0/842243194 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7478078b90 0x7f747807b0a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7490033000 tx=0x7f7490004730 comp rx=0 tx=0).stop 2024-09-17T03:09:20.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.562+0000 7f749b4b6640 1 -- 172.21.15.78:0/842243194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749415b8f0 msgr2=0x7f74941f7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:20.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.562+0000 7f749b4b6640 1 --2- 172.21.15.78:0/842243194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749415b8f0 0x7f74941f7190 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f748c00e960 tx=0x7f748c00ee20 comp rx=0 tx=0).stop 2024-09-17T03:09:20.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.562+0000 7f749b4b6640 1 -- 172.21.15.78:0/842243194 shutdown_connections 2024-09-17T03:09:20.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.562+0000 7f749b4b6640 1 --2- 172.21.15.78:0/842243194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f749415b8f0 0x7f74941f7190 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:20.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.562+0000 7f749b4b6640 1 --2- 172.21.15.78:0/842243194 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7478078b90 0x7f747807b0a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:20.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.562+0000 7f749b4b6640 1 --2- 172.21.15.78:0/842243194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74940b2cb0 0x7f749415a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:20.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.562+0000 7f749b4b6640 1 --2- 172.21.15.78:0/842243194 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74940b0520 0x7f74941e0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:20.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.563+0000 7f749b4b6640 1 -- 172.21.15.78:0/842243194 >> 172.21.15.78:0/842243194 conn(0x7f74940cdcb0 msgr2=0x7f74940d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:20.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.563+0000 7f749b4b6640 1 -- 172.21.15.78:0/842243194 shutdown_connections 2024-09-17T03:09:20.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:20.563+0000 7f749b4b6640 1 -- 172.21.15.78:0/842243194 wait complete. 2024-09-17T03:09:20.976 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:09:08.411464+0000', 'modified': '2024-09-17T03:09:20.211920+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 4938, 'mds_1': 4929}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4929': {'gid': 4929, 'name': 'c', 'rank': 1, 'incarnation': 15, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.78:6833/2730690660', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6832', 'nonce': 2730690660}, {'type': 'v1', 'addr': '172.21.15.78:6833', 'nonce': 2730690660}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4938': {'gid': 4938, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6835/2663458793', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6834', 'nonce': 2663458793}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 2663458793}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4938, 'qdb_cluster': [4938]} 2024-09-17T03:09:20.976 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4929:up:creating 2024-09-17T03:09:21.977 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:09:22.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.112+0000 7f7146320640 1 -- 172.21.15.78:0/2307350306 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7140142270 msgr2=0x7f7140073e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:22.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.112+0000 7f7146320640 1 --2- 172.21.15.78:0/2307350306 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7140142270 0x7f7140073e50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7134009830 tx=0x7f713402a510 comp rx=0 tx=0).stop 2024-09-17T03:09:22.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.112+0000 7f7146320640 1 -- 172.21.15.78:0/2307350306 shutdown_connections 2024-09-17T03:09:22.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.112+0000 7f7146320640 1 --2- 172.21.15.78:0/2307350306 >> v2:172.21.15.193:3300/0 conn(0x7f7140142680 0x7f7140074390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.112+0000 7f7146320640 1 --2- 172.21.15.78:0/2307350306 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7140142270 0x7f7140073e50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.112+0000 7f7146320640 1 -- 172.21.15.78:0/2307350306 >> 172.21.15.78:0/2307350306 conn(0x7f71400d15f0 msgr2=0x7f7140073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:22.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.112+0000 7f7146320640 1 -- 172.21.15.78:0/2307350306 shutdown_connections 2024-09-17T03:09:22.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.112+0000 7f7146320640 1 -- 172.21.15.78:0/2307350306 wait complete. 2024-09-17T03:09:22.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.113+0000 7f7146320640 1 Processor -- start 2024-09-17T03:09:22.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.114+0000 7f7146320640 1 -- start start 2024-09-17T03:09:22.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.115+0000 7f7146320640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7140142270 0x7f7140157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.115+0000 7f7146320640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7140142680 0x7f71400c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.115+0000 7f7146320640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7140144270 0x7f71400b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.115+0000 7f7146320640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f71400d01f0 con 0x7f7140144270 2024-09-17T03:09:22.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.115+0000 7f7146320640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f71400d0070 con 0x7f7140142680 2024-09-17T03:09:22.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.115+0000 7f7146320640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f71400d0370 con 0x7f7140142270 2024-09-17T03:09:22.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.115+0000 7f71448bd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7140144270 0x7f71400b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:22.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.115+0000 7f71448bd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7140144270 0x7f71400b3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56078/0 (socket says 172.21.15.78:56078) 2024-09-17T03:09:22.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.115+0000 7f71448bd640 1 -- 172.21.15.78:0/2744988200 learned_addr learned my addr 172.21.15.78:0/2744988200 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:22.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.115+0000 7f713f7fe640 1 --2- 172.21.15.78:0/2744988200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7140142680 0x7f71400c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:22.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.115+0000 7f713ffff640 1 --2- 172.21.15.78:0/2744988200 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7140142270 0x7f7140157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:22.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.115+0000 7f71448bd640 1 -- 172.21.15.78:0/2744988200 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7140142270 msgr2=0x7f7140157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:22.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.115+0000 7f71448bd640 1 --2- 172.21.15.78:0/2744988200 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7140142270 0x7f7140157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.115+0000 7f71448bd640 1 -- 172.21.15.78:0/2744988200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7140142680 msgr2=0x7f71400c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:22.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.115+0000 7f71448bd640 1 --2- 172.21.15.78:0/2744988200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7140142680 0x7f71400c59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.115+0000 7f71448bd640 1 -- 172.21.15.78:0/2744988200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71400c6650 con 0x7f7140144270 2024-09-17T03:09:22.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.115+0000 7f713ffff640 1 --2- 172.21.15.78:0/2744988200 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7140142270 0x7f7140157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:22.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.116+0000 7f71448bd640 1 --2- 172.21.15.78:0/2744988200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7140144270 0x7f71400b3b60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7138009fd0 tx=0x7f713800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:22.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.116+0000 7f713cff9640 1 -- 172.21.15.78:0/2744988200 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7138003970 con 0x7f7140144270 2024-09-17T03:09:22.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.116+0000 7f713cff9640 1 -- 172.21.15.78:0/2744988200 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7138003c20 con 0x7f7140144270 2024-09-17T03:09:22.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.116+0000 7f7146320640 1 -- 172.21.15.78:0/2744988200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71401f3850 con 0x7f7140144270 2024-09-17T03:09:22.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.116+0000 7f713cff9640 1 -- 172.21.15.78:0/2744988200 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7138004280 con 0x7f7140144270 2024-09-17T03:09:22.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.116+0000 7f7146320640 1 -- 172.21.15.78:0/2744988200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71401f3e10 con 0x7f7140144270 2024-09-17T03:09:22.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.117+0000 7f7146320640 1 -- 172.21.15.78:0/2744988200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71400b5680 con 0x7f7140144270 2024-09-17T03:09:22.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.118+0000 7f713cff9640 1 -- 172.21.15.78:0/2744988200 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7138004420 con 0x7f7140144270 2024-09-17T03:09:22.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.118+0000 7f713cff9640 1 --2- 172.21.15.78:0/2744988200 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f712c078b90 0x7f712c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.118+0000 7f713cff9640 1 -- 172.21.15.78:0/2744988200 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f713809b610 con 0x7f7140144270 2024-09-17T03:09:22.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.118+0000 7f713ffff640 1 --2- 172.21.15.78:0/2744988200 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f712c078b90 0x7f712c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:22.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.119+0000 7f713ffff640 1 --2- 172.21.15.78:0/2744988200 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f712c078b90 0x7f712c07b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7130007fd0 tx=0x7f7130009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:22.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.123+0000 7f713cff9640 1 -- 172.21.15.78:0/2744988200 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f71380639d0 con 0x7f7140144270 2024-09-17T03:09:22.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.333+0000 7f7146320640 1 -- 172.21.15.78:0/2744988200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71400c63e0 con 0x7f7140144270 2024-09-17T03:09:22.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.333+0000 7f713cff9640 1 -- 172.21.15.78:0/2744988200 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5267 (secure 0 0 0) 0x7f71380632d0 con 0x7f7140144270 2024-09-17T03:09:22.332 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:09:22.333 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":18,"btime":"2024-09-17T03:09:22:224108+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2234221933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2234221933},{"type":"v1","addr":"172.21.15.193:6836","nonce":2234221933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:09:08.411464+0000","modified":"2024-09-17T03:09:22.224101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4938,"mds_1":4929,"mds_2":4661},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4661":{"gid":4661,"name":"d","rank":2,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6837/2343001441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2343001441},{"type":"v1","addr":"172.21.15.193:6837","nonce":2343001441}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4929":{"gid":4929,"name":"c","rank":1,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.78:6833/2730690660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2730690660},{"type":"v1","addr":"172.21.15.78:6833","nonce":2730690660}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/2663458793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2663458793},{"type":"v1","addr":"172.21.15.78:6835","nonce":2663458793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4938,"qdb_cluster":[4661,4929,4938]},"id":2}]} 2024-09-17T03:09:22.333 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 18 2024-09-17T03:09:22.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.336+0000 7f7146320640 1 -- 172.21.15.78:0/2744988200 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f712c078b90 msgr2=0x7f712c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:22.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.336+0000 7f7146320640 1 --2- 172.21.15.78:0/2744988200 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f712c078b90 0x7f712c07b0a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7130007fd0 tx=0x7f7130009040 comp rx=0 tx=0).stop 2024-09-17T03:09:22.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.336+0000 7f7146320640 1 -- 172.21.15.78:0/2744988200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7140144270 msgr2=0x7f71400b3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:22.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.336+0000 7f7146320640 1 --2- 172.21.15.78:0/2744988200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7140144270 0x7f71400b3b60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7138009fd0 tx=0x7f713800c740 comp rx=0 tx=0).stop 2024-09-17T03:09:22.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.336+0000 7f7146320640 1 -- 172.21.15.78:0/2744988200 shutdown_connections 2024-09-17T03:09:22.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.336+0000 7f7146320640 1 --2- 172.21.15.78:0/2744988200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7140144270 0x7f71400b3b60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.336+0000 7f7146320640 1 --2- 172.21.15.78:0/2744988200 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f712c078b90 0x7f712c07b0a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.336+0000 7f7146320640 1 --2- 172.21.15.78:0/2744988200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7140142680 0x7f71400c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.336+0000 7f7146320640 1 --2- 172.21.15.78:0/2744988200 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7140142270 0x7f7140157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.336+0000 7f7146320640 1 -- 172.21.15.78:0/2744988200 >> 172.21.15.78:0/2744988200 conn(0x7f71400d15f0 msgr2=0x7f7140073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:22.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.336+0000 7f7146320640 1 -- 172.21.15.78:0/2744988200 shutdown_connections 2024-09-17T03:09:22.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.336+0000 7f7146320640 1 -- 172.21.15.78:0/2744988200 wait complete. 2024-09-17T03:09:22.750 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:09:08.411464+0000', 'modified': '2024-09-17T03:09:22.224101+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4938, 'mds_1': 4929, 'mds_2': 4661}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4661': {'gid': 4661, 'name': 'd', 'rank': 2, 'incarnation': 17, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.193:6837/2343001441', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6835', 'nonce': 2343001441}, {'type': 'v1', 'addr': '172.21.15.193:6837', 'nonce': 2343001441}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4929': {'gid': 4929, 'name': 'c', 'rank': 1, 'incarnation': 15, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.78:6833/2730690660', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6832', 'nonce': 2730690660}, {'type': 'v1', 'addr': '172.21.15.78:6833', 'nonce': 2730690660}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4938': {'gid': 4938, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6835/2663458793', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6834', 'nonce': 2663458793}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 2663458793}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4938, 'qdb_cluster': [4661, 4929, 4938]} 2024-09-17T03:09:22.750 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-17T03:09:22.750 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T03:09:22.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.868+0000 7f909f2e5640 1 -- 172.21.15.78:0/4109318456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90980b4d90 msgr2=0x7f9098072e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:22.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.868+0000 7f909f2e5640 1 --2- 172.21.15.78:0/4109318456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90980b4d90 0x7f9098072e30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9094009830 tx=0x7f909402a510 comp rx=0 tx=0).stop 2024-09-17T03:09:22.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.868+0000 7f909f2e5640 1 -- 172.21.15.78:0/4109318456 shutdown_connections 2024-09-17T03:09:22.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.868+0000 7f909f2e5640 1 --2- 172.21.15.78:0/4109318456 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f90980cf940 0x7f909806fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.868+0000 7f909f2e5640 1 --2- 172.21.15.78:0/4109318456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90980b4d90 0x7f9098072e30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.868+0000 7f909f2e5640 1 -- 172.21.15.78:0/4109318456 >> 172.21.15.78:0/4109318456 conn(0x7f909806d7d0 msgr2=0x7f90980b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:22.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.868+0000 7f909f2e5640 1 -- 172.21.15.78:0/4109318456 shutdown_connections 2024-09-17T03:09:22.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.868+0000 7f909f2e5640 1 -- 172.21.15.78:0/4109318456 wait complete. 2024-09-17T03:09:22.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.870+0000 7f909f2e5640 1 Processor -- start 2024-09-17T03:09:22.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.870+0000 7f909f2e5640 1 -- start start 2024-09-17T03:09:22.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.871+0000 7f909f2e5640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f90980701c0 0x7f90981f7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.871+0000 7f909f2e5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90980cf940 0x7f909809c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.871+0000 7f909f2e5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f909809ce30 0x7f90981ecd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.871+0000 7f909f2e5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f90980ccbc0 con 0x7f90980cf940 2024-09-17T03:09:22.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.871+0000 7f909f2e5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9098070980 con 0x7f909809ce30 2024-09-17T03:09:22.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.871+0000 7f909f2e5640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f90980ccd40 con 0x7f90980701c0 2024-09-17T03:09:22.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.871+0000 7f909c880640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90980cf940 0x7f909809c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:22.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.871+0000 7f909c880640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90980cf940 0x7f909809c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56106/0 (socket says 172.21.15.78:56106) 2024-09-17T03:09:22.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.871+0000 7f909c880640 1 -- 172.21.15.78:0/3465601895 learned_addr learned my addr 172.21.15.78:0/3465601895 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:22.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.871+0000 7f909d081640 1 --2- 172.21.15.78:0/3465601895 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f90980701c0 0x7f90981f7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:22.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.871+0000 7f909d882640 1 --2- 172.21.15.78:0/3465601895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f909809ce30 0x7f90981ecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:22.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.871+0000 7f909c880640 1 -- 172.21.15.78:0/3465601895 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f90980701c0 msgr2=0x7f90981f7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:22.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.871+0000 7f909c880640 1 --2- 172.21.15.78:0/3465601895 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f90980701c0 0x7f90981f7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.871+0000 7f909c880640 1 -- 172.21.15.78:0/3465601895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f909809ce30 msgr2=0x7f90981ecd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:22.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.871+0000 7f909c880640 1 --2- 172.21.15.78:0/3465601895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f909809ce30 0x7f90981ecd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.871+0000 7f909c880640 1 -- 172.21.15.78:0/3465601895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90981f3870 con 0x7f90980cf940 2024-09-17T03:09:22.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.871+0000 7f909d882640 1 --2- 172.21.15.78:0/3465601895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f909809ce30 0x7f90981ecd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:22.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.871+0000 7f909c880640 1 --2- 172.21.15.78:0/3465601895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90980cf940 0x7f909809c8f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f908800da50 tx=0x7f908800df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:22.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.872+0000 7f908dffb640 1 -- 172.21.15.78:0/3465601895 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908800ada0 con 0x7f90980cf940 2024-09-17T03:09:22.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.872+0000 7f908dffb640 1 -- 172.21.15.78:0/3465601895 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9088005110 con 0x7f90980cf940 2024-09-17T03:09:22.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.872+0000 7f909f2e5640 1 -- 172.21.15.78:0/3465601895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90981f3b50 con 0x7f90980cf940 2024-09-17T03:09:22.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.872+0000 7f908dffb640 1 -- 172.21.15.78:0/3465601895 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088005540 con 0x7f90980cf940 2024-09-17T03:09:22.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.872+0000 7f909f2e5640 1 -- 172.21.15.78:0/3465601895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90981f4110 con 0x7f90980cf940 2024-09-17T03:09:22.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.874+0000 7f908dffb640 1 -- 172.21.15.78:0/3465601895 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f90880047a0 con 0x7f90980cf940 2024-09-17T03:09:22.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.874+0000 7f908dffb640 1 --2- 172.21.15.78:0/3465601895 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f907c078b90 0x7f907c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.874+0000 7f908dffb640 1 -- 172.21.15.78:0/3465601895 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f908809b1d0 con 0x7f90980cf940 2024-09-17T03:09:22.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.874+0000 7f909d081640 1 --2- 172.21.15.78:0/3465601895 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f907c078b90 0x7f907c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:22.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.875+0000 7f909d081640 1 --2- 172.21.15.78:0/3465601895 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f907c078b90 0x7f907c07b0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9094034000 tx=0x7f9094004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:22.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.875+0000 7f90a6256740 1 Processor -- start 2024-09-17T03:09:22.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.875+0000 7f90a6256740 1 -- start start 2024-09-17T03:09:22.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.876+0000 7f90a6256740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d99296270 0x557d99667fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.876+0000 7f90a6256740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d9926d3b0 0x557d996684e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.876+0000 7f90a6256740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99275590 0x557d996853e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.876+0000 7f90a6256740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557d995b0820 con 0x557d9926d3b0 2024-09-17T03:09:22.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.876+0000 7f90a6256740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557d9959fc50 con 0x557d99275590 2024-09-17T03:09:22.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.876+0000 7f90a6256740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x557d995a3a60 con 0x557d99296270 2024-09-17T03:09:22.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.876+0000 7f909c880640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d9926d3b0 0x557d996684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:22.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.876+0000 7f909c880640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d9926d3b0 0x557d996684e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56114/0 (socket says 172.21.15.78:56114) 2024-09-17T03:09:22.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.876+0000 7f909c880640 1 -- 172.21.15.78:0/255573820 learned_addr learned my addr 172.21.15.78:0/255573820 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:22.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.876+0000 7f909d081640 1 --2- 172.21.15.78:0/255573820 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d99296270 0x557d99667fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:22.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.876+0000 7f909d882640 1 --2- 172.21.15.78:0/255573820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99275590 0x557d996853e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:22.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.877+0000 7f909c880640 1 -- 172.21.15.78:0/255573820 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d99296270 msgr2=0x557d99667fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:22.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.877+0000 7f909c880640 1 --2- 172.21.15.78:0/255573820 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d99296270 0x557d99667fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.877+0000 7f909c880640 1 -- 172.21.15.78:0/255573820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99275590 msgr2=0x557d996853e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:22.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.877+0000 7f909c880640 1 --2- 172.21.15.78:0/255573820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99275590 0x557d996853e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.877+0000 7f909c880640 1 -- 172.21.15.78:0/255573820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d99301850 con 0x557d9926d3b0 2024-09-17T03:09:22.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.877+0000 7f909d882640 1 --2- 172.21.15.78:0/255573820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99275590 0x557d996853e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:22.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.877+0000 7f909c880640 1 --2- 172.21.15.78:0/255573820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d9926d3b0 0x557d996684e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9088062f50 tx=0x7f9088062a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa23cc5d802a60c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:22.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.877+0000 7f9082ffd640 1 -- 172.21.15.78:0/255573820 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90880679f0 con 0x557d9926d3b0 2024-09-17T03:09:22.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.877+0000 7f9082ffd640 1 -- 172.21.15.78:0/255573820 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f908806c930 con 0x557d9926d3b0 2024-09-17T03:09:22.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.877+0000 7f9082ffd640 1 -- 172.21.15.78:0/255573820 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908806c4a0 con 0x557d9926d3b0 2024-09-17T03:09:22.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.878+0000 7f90a6256740 1 -- 172.21.15.78:0/255573820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d9926d3b0 msgr2=0x557d996684e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:22.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.878+0000 7f90a6256740 1 --2- 172.21.15.78:0/255573820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d9926d3b0 0x557d996684e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9088062f50 tx=0x7f9088062a40 comp rx=0 tx=0).stop 2024-09-17T03:09:22.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.878+0000 7f90a6256740 1 -- 172.21.15.78:0/255573820 shutdown_connections 2024-09-17T03:09:22.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.878+0000 7f90a6256740 1 --2- 172.21.15.78:0/255573820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99275590 0x557d996853e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.878+0000 7f90a6256740 1 --2- 172.21.15.78:0/255573820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d9926d3b0 0x557d996684e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.878+0000 7f90a6256740 1 --2- 172.21.15.78:0/255573820 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d99296270 0x557d99667fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.878+0000 7f90a6256740 1 -- 172.21.15.78:0/255573820 >> 172.21.15.78:0/255573820 conn(0x557d9928a3c0 msgr2=0x557d9963e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:22.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.878+0000 7f90a6256740 1 -- 172.21.15.78:0/255573820 shutdown_connections 2024-09-17T03:09:22.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.878+0000 7f90a6256740 1 -- 172.21.15.78:0/255573820 wait complete. 2024-09-17T03:09:22.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.879+0000 7f90a6256740 1 -- start start 2024-09-17T03:09:22.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.879+0000 7f90a6256740 1 Processor -- start 2024-09-17T03:09:22.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.880+0000 7f90a6256740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d9926d3b0 0x557d99662af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.880+0000 7f90a6256740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d99275590 0x557d99694590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.880+0000 7f90a6256740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99296270 0x557d99694ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.880+0000 7f90a6256740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557d99310620 con 0x557d9926d3b0 2024-09-17T03:09:22.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.880+0000 7f90a6256740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557d995455f0 con 0x557d99296270 2024-09-17T03:09:22.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.880+0000 7f90a6256740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x557d99668a20 con 0x557d99275590 2024-09-17T03:09:22.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.880+0000 7f90a6256740 10 client.0 _ll_register_callbacks cb 0x557d995490a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:09:22.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.880+0000 7f909d081640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d9926d3b0 0x557d99662af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:22.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.880+0000 7f909d081640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d9926d3b0 0x557d99662af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56128/0 (socket says 172.21.15.78:56128) 2024-09-17T03:09:22.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.880+0000 7f909d081640 1 -- 172.21.15.78:0/1777448207 learned_addr learned my addr 172.21.15.78:0/1777448207 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:22.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.881+0000 7f909d882640 1 --2- 172.21.15.78:0/1777448207 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99296270 0x557d99694ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:22.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.881+0000 7f909c880640 1 --2- 172.21.15.78:0/1777448207 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d99275590 0x557d99694590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:22.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.881+0000 7f909d081640 1 -- 172.21.15.78:0/1777448207 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d99275590 msgr2=0x557d99694590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:22.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.881+0000 7f909d081640 1 --2- 172.21.15.78:0/1777448207 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d99275590 0x557d99694590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.881+0000 7f909d081640 1 -- 172.21.15.78:0/1777448207 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99296270 msgr2=0x557d99694ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:22.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.881+0000 7f909d081640 1 --2- 172.21.15.78:0/1777448207 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99296270 0x557d99694ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.881+0000 7f909d081640 1 -- 172.21.15.78:0/1777448207 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d993786b0 con 0x557d9926d3b0 2024-09-17T03:09:22.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.881+0000 7f909d882640 1 --2- 172.21.15.78:0/1777448207 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99296270 0x557d99694ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:22.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.881+0000 7f909d081640 1 --2- 172.21.15.78:0/1777448207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d9926d3b0 0x557d99662af0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9094009830 tx=0x7f9094005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46be790feb37ce2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:22.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.881+0000 7f9077fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:09:22.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.881+0000 7f9077fff640 1 -- 172.21.15.78:0/1777448207 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9094048d90 con 0x557d9926d3b0 2024-09-17T03:09:22.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.881+0000 7f9077fff640 1 -- 172.21.15.78:0/1777448207 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9094052af0 con 0x557d9926d3b0 2024-09-17T03:09:22.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.881+0000 7f90a6256740 1 -- 172.21.15.78:0/1777448207 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f908806c930 con 0x557d9926d3b0 2024-09-17T03:09:22.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.881+0000 7f9077fff640 1 -- 172.21.15.78:0/1777448207 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f9094052cf0 con 0x557d9926d3b0 2024-09-17T03:09:22.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.881+0000 7f90a6256740 10 client.5178 fetch_fsmap learned FSMap version 18 2024-09-17T03:09:22.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.881+0000 7f90a6256740 1 -- 172.21.15.78:0/1777448207 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x557d99693130 con 0x557d9926d3b0 2024-09-17T03:09:22.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.881+0000 7f9077fff640 1 -- 172.21.15.78:0/1777448207 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f908806c930 con 0x557d9926d3b0 2024-09-17T03:09:22.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.881+0000 7f9077fff640 1 -- 172.21.15.78:0/1777448207 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 18) ==== 3542+0+0 (secure 0 0 0) 0x7f9094059050 con 0x557d9926d3b0 2024-09-17T03:09:22.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.881+0000 7f90a6256740 10 client.5178 fetch_fsmap finished waiting for FSMap version 18 2024-09-17T03:09:22.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.882+0000 7f90a6256740 10 client.5178 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:09:22.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.882+0000 7f90a6256740 20 client.5178 populate_metadata read hostname 'smithi078' 2024-09-17T03:09:22.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.882+0000 7f90a6256740 1 --2- 172.21.15.78:0/1777448207 >> [v2:172.21.15.193:6835/2343001441,v1:172.21.15.193:6837/2343001441] conn(0x557d99254e40 0x557d9967b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.882+0000 7f90a6256740 4 client.5178 mds_command: new command op to 4661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:09:22.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.882+0000 7f90a6256740 1 -- 172.21.15.78:0/1777448207 --> [v2:172.21.15.193:6835/2343001441,v1:172.21.15.193:6837/2343001441] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d995b2770 con 0x557d99254e40 2024-09-17T03:09:22.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.882+0000 7f909c880640 1 --2- 172.21.15.78:0/1777448207 >> [v2:172.21.15.193:6835/2343001441,v1:172.21.15.193:6837/2343001441] conn(0x557d99254e40 0x557d9967b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:22.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.882+0000 7f909c880640 1 --2- 172.21.15.78:0/1777448207 >> [v2:172.21.15.193:6835/2343001441,v1:172.21.15.193:6837/2343001441] conn(0x557d99254e40 0x557d9967b890 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5b2120e14b6849c2 server_cookie=1505f8f8a221788c in_seq=0 out_seq=0 2024-09-17T03:09:22.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.882+0000 7f9077fff640 10 client.5178 ms_handle_connect on v2:172.21.15.193:6835/2343001441 2024-09-17T03:09:22.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.883+0000 7f9077fff640 1 -- 172.21.15.78:0/1777448207 <== mds.2 v2:172.21.15.193:6835/2343001441 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557d995b2770 con 0x557d99254e40 2024-09-17T03:09:22.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.883+0000 7f9077fff640 10 client.5178 handle_command_reply: tid=0 2024-09-17T03:09:22.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.883+0000 7f90a6256740 1 client.5178 shutdown 2024-09-17T03:09:22.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.883+0000 7f90a6256740 1 -- 172.21.15.78:0/1777448207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d9926d3b0 msgr2=0x557d99662af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:22.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.883+0000 7f90a6256740 1 --2- 172.21.15.78:0/1777448207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d9926d3b0 0x557d99662af0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9094009830 tx=0x7f9094005f90 comp rx=0 tx=0).stop 2024-09-17T03:09:22.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.883+0000 7f90a6256740 1 -- 172.21.15.78:0/1777448207 shutdown_connections 2024-09-17T03:09:22.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.883+0000 7f90a6256740 1 --2- 172.21.15.78:0/1777448207 >> [v2:172.21.15.193:6835/2343001441,v1:172.21.15.193:6837/2343001441] conn(0x557d99254e40 0x557d9967b890 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.883+0000 7f90a6256740 1 --2- 172.21.15.78:0/1777448207 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99296270 0x557d99694ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.883+0000 7f90a6256740 1 --2- 172.21.15.78:0/1777448207 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d99275590 0x557d99694590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.883+0000 7f90a6256740 1 --2- 172.21.15.78:0/1777448207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d9926d3b0 0x557d99662af0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.883+0000 7f90a6256740 1 -- 172.21.15.78:0/1777448207 >> 172.21.15.78:0/1777448207 conn(0x557d9928a3c0 msgr2=0x557d99657760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:22.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.883+0000 7f9077fff640 0 client.5178 ms_handle_reset on v2:172.21.15.193:6835/2343001441 2024-09-17T03:09:22.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.883+0000 7f90a6256740 1 -- 172.21.15.78:0/1777448207 shutdown_connections 2024-09-17T03:09:22.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.883+0000 7f90a6256740 1 -- 172.21.15.78:0/1777448207 wait complete. 2024-09-17T03:09:22.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.884+0000 7f90a6256740 20 client.5178 trim_cache size 0 max 16384 2024-09-17T03:09:22.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.902+0000 7f90a6256740 1 Processor -- start 2024-09-17T03:09:22.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.902+0000 7f90a6256740 1 -- start start 2024-09-17T03:09:22.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.903+0000 7f90a6256740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d9926d3b0 0x557d99683a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.903+0000 7f90a6256740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99275590 0x557d99678eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.903+0000 7f90a6256740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d99296270 0x557d9963e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.903+0000 7f90a6256740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f90981ff380 con 0x557d99296270 2024-09-17T03:09:22.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.903+0000 7f90a6256740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f90981ffa30 con 0x557d99275590 2024-09-17T03:09:22.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.903+0000 7f90a6256740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f90980c5cc0 con 0x557d9926d3b0 2024-09-17T03:09:22.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.903+0000 7f909d882640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d99296270 0x557d9963e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:22.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.903+0000 7f909d882640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d99296270 0x557d9963e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56144/0 (socket says 172.21.15.78:56144) 2024-09-17T03:09:22.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.903+0000 7f909d882640 1 -- 172.21.15.78:0/3391232945 learned_addr learned my addr 172.21.15.78:0/3391232945 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:22.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.904+0000 7f909d882640 1 -- 172.21.15.78:0/3391232945 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d9926d3b0 msgr2=0x557d99683a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:22.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.904+0000 7f909d882640 1 --2- 172.21.15.78:0/3391232945 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d9926d3b0 0x557d99683a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.904+0000 7f909d882640 1 -- 172.21.15.78:0/3391232945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99275590 msgr2=0x557d99678eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:22.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.904+0000 7f909d882640 1 --2- 172.21.15.78:0/3391232945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99275590 0x557d99678eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.904+0000 7f909d882640 1 -- 172.21.15.78:0/3391232945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d99692f50 con 0x557d99296270 2024-09-17T03:09:22.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.904+0000 7f909d882640 1 --2- 172.21.15.78:0/3391232945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d99296270 0x557d9963e0f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f90900020c0 tx=0x7f9090012630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56358cdad2902755 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:22.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.904+0000 7f90827fc640 1 -- 172.21.15.78:0/3391232945 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909001a070 con 0x557d99296270 2024-09-17T03:09:22.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.904+0000 7f90827fc640 1 -- 172.21.15.78:0/3391232945 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9090012e70 con 0x557d99296270 2024-09-17T03:09:22.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.904+0000 7f90827fc640 1 -- 172.21.15.78:0/3391232945 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9090016680 con 0x557d99296270 2024-09-17T03:09:22.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.904+0000 7f90a6256740 1 -- 172.21.15.78:0/3391232945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d99296270 msgr2=0x557d9963e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:22.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.904+0000 7f90a6256740 1 --2- 172.21.15.78:0/3391232945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d99296270 0x557d9963e0f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f90900020c0 tx=0x7f9090012630 comp rx=0 tx=0).stop 2024-09-17T03:09:22.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.905+0000 7f90a6256740 1 -- 172.21.15.78:0/3391232945 shutdown_connections 2024-09-17T03:09:22.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.905+0000 7f90a6256740 1 --2- 172.21.15.78:0/3391232945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d99296270 0x557d9963e0f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.905+0000 7f90a6256740 1 --2- 172.21.15.78:0/3391232945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99275590 0x557d99678eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.905+0000 7f90a6256740 1 --2- 172.21.15.78:0/3391232945 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d9926d3b0 0x557d99683a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.905+0000 7f90a6256740 1 -- 172.21.15.78:0/3391232945 >> 172.21.15.78:0/3391232945 conn(0x557d9928a3c0 msgr2=0x557d99683380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:22.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.905+0000 7f90a6256740 1 -- 172.21.15.78:0/3391232945 shutdown_connections 2024-09-17T03:09:22.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.905+0000 7f90a6256740 1 -- 172.21.15.78:0/3391232945 wait complete. 2024-09-17T03:09:22.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.905+0000 7f90a6256740 1 -- start start 2024-09-17T03:09:22.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.906+0000 7f90a6256740 1 Processor -- start 2024-09-17T03:09:22.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.907+0000 7f90a6256740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d9926d3b0 0x557d99637f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.907+0000 7f90a6256740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99275590 0x557d99667af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.907+0000 7f90a6256740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d99296270 0x557d996a7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.907+0000 7f90a6256740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557d99665360 con 0x557d99296270 2024-09-17T03:09:22.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.907+0000 7f90a6256740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557d99663030 con 0x557d99275590 2024-09-17T03:09:22.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.907+0000 7f90a6256740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x557d99695a00 con 0x557d9926d3b0 2024-09-17T03:09:22.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.907+0000 7f90a6256740 10 client.0 _ll_register_callbacks cb 0x7f90940044c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:09:22.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.907+0000 7f909d882640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d99296270 0x557d996a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:22.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.907+0000 7f909d882640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d99296270 0x557d996a7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56146/0 (socket says 172.21.15.78:56146) 2024-09-17T03:09:22.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.907+0000 7f909d882640 1 -- 172.21.15.78:0/2051815917 learned_addr learned my addr 172.21.15.78:0/2051815917 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:22.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.907+0000 7f909d081640 1 --2- 172.21.15.78:0/2051815917 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d9926d3b0 0x557d99637f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.907+0000 7f909c880640 1 --2- 172.21.15.78:0/2051815917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99275590 0x557d99667af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.907+0000 7f909d882640 1 -- 172.21.15.78:0/2051815917 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d9926d3b0 msgr2=0x557d99637f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.907+0000 7f909d882640 1 --2- 172.21.15.78:0/2051815917 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d9926d3b0 0x557d99637f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.907+0000 7f909d882640 1 -- 172.21.15.78:0/2051815917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99275590 msgr2=0x557d99667af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.907+0000 7f909d882640 1 --2- 172.21.15.78:0/2051815917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99275590 0x557d99667af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.907+0000 7f909d882640 1 -- 172.21.15.78:0/2051815917 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d99668030 con 0x557d99296270 2024-09-17T03:09:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.907+0000 7f909d882640 1 --2- 172.21.15.78:0/2051815917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d99296270 0x557d996a7200 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9090009010 tx=0x7f9090005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd8934d47ff1579 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.907+0000 7f9077fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:09:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.908+0000 7f9077fff640 1 -- 172.21.15.78:0/2051815917 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909001a050 con 0x557d99296270 2024-09-17T03:09:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.908+0000 7f9077fff640 1 -- 172.21.15.78:0/2051815917 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9090005660 con 0x557d99296270 2024-09-17T03:09:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.908+0000 7f90a6256740 1 -- 172.21.15.78:0/2051815917 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9090012e70 con 0x557d99296270 2024-09-17T03:09:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.908+0000 7f9077fff640 1 -- 172.21.15.78:0/2051815917 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f9090005860 con 0x557d99296270 2024-09-17T03:09:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.908+0000 7f90a6256740 10 client.5184 fetch_fsmap learned FSMap version 18 2024-09-17T03:09:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.908+0000 7f90a6256740 1 -- 172.21.15.78:0/2051815917 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x557d996f9730 con 0x557d99296270 2024-09-17T03:09:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.908+0000 7f9077fff640 1 -- 172.21.15.78:0/2051815917 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9090012e70 con 0x557d99296270 2024-09-17T03:09:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.908+0000 7f9077fff640 1 -- 172.21.15.78:0/2051815917 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 18) ==== 3542+0+0 (secure 0 0 0) 0x7f9090028560 con 0x557d99296270 2024-09-17T03:09:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.908+0000 7f90a6256740 10 client.5184 fetch_fsmap finished waiting for FSMap version 18 2024-09-17T03:09:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.908+0000 7f90a6256740 10 client.5184 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:09:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.908+0000 7f90a6256740 20 client.5184 populate_metadata read hostname 'smithi078' 2024-09-17T03:09:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.908+0000 7f90a6256740 1 --2- 172.21.15.78:0/2051815917 >> [v2:172.21.15.193:6835/2343001441,v1:172.21.15.193:6837/2343001441] conn(0x557d9963e560 0x557d99679b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.908+0000 7f90a6256740 4 client.5184 mds_command: new command op to 4661 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:09:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.908+0000 7f90a6256740 1 -- 172.21.15.78:0/2051815917 --> [v2:172.21.15.193:6835/2343001441,v1:172.21.15.193:6837/2343001441] -- command(tid 0: {"prefix": "status"}) -- 0x557d99633f80 con 0x557d9963e560 2024-09-17T03:09:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.908+0000 7f909d081640 1 --2- 172.21.15.78:0/2051815917 >> [v2:172.21.15.193:6835/2343001441,v1:172.21.15.193:6837/2343001441] conn(0x557d9963e560 0x557d99679b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.909+0000 7f9077fff640 10 client.5184 ms_handle_connect on v2:172.21.15.193:6835/2343001441 2024-09-17T03:09:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.909+0000 7f909d081640 1 --2- 172.21.15.78:0/2051815917 >> [v2:172.21.15.193:6835/2343001441,v1:172.21.15.193:6837/2343001441] conn(0x557d9963e560 0x557d99679b90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dfb4df53b894003d server_cookie=7f38fcb5efcbf95a in_seq=0 out_seq=0 2024-09-17T03:09:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.909+0000 7f9077fff640 1 -- 172.21.15.78:0/2051815917 <== mds.2 v2:172.21.15.193:6835/2343001441 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x557d99633f80 con 0x557d9963e560 2024-09-17T03:09:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.909+0000 7f9077fff640 10 client.5184 handle_command_reply: tid=0 2024-09-17T03:09:22.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.909+0000 7f90a6256740 1 client.5184 shutdown 2024-09-17T03:09:22.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.909+0000 7f90a6256740 1 -- 172.21.15.78:0/2051815917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d99296270 msgr2=0x557d996a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:22.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.909+0000 7f90a6256740 1 --2- 172.21.15.78:0/2051815917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d99296270 0x557d996a7200 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9090009010 tx=0x7f9090005270 comp rx=0 tx=0).stop 2024-09-17T03:09:22.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.909+0000 7f90a6256740 1 -- 172.21.15.78:0/2051815917 shutdown_connections 2024-09-17T03:09:22.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.909+0000 7f90a6256740 1 --2- 172.21.15.78:0/2051815917 >> [v2:172.21.15.193:6835/2343001441,v1:172.21.15.193:6837/2343001441] conn(0x557d9963e560 0x557d99679b90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.909+0000 7f90a6256740 1 --2- 172.21.15.78:0/2051815917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d99296270 0x557d996a7200 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.909+0000 7f9077fff640 0 client.5184 ms_handle_reset on v2:172.21.15.193:6835/2343001441 2024-09-17T03:09:22.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.909+0000 7f90a6256740 1 --2- 172.21.15.78:0/2051815917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d99275590 0x557d99667af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.909+0000 7f90a6256740 1 --2- 172.21.15.78:0/2051815917 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d9926d3b0 0x557d99637f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.909+0000 7f90a6256740 1 -- 172.21.15.78:0/2051815917 >> 172.21.15.78:0/2051815917 conn(0x557d9928a3c0 msgr2=0x557d9965fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:22.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.909+0000 7f90a6256740 1 -- 172.21.15.78:0/2051815917 shutdown_connections 2024-09-17T03:09:22.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.909+0000 7f90a6256740 1 -- 172.21.15.78:0/2051815917 wait complete. 2024-09-17T03:09:22.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.909+0000 7f90a6256740 20 client.5184 trim_cache size 0 max 16384 2024-09-17T03:09:22.931 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:09:22.931 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:09:22.931 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 2, 2024-09-17T03:09:22.931 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4661, 2024-09-17T03:09:22.931 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:09:22.931 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:09:22.931 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:09:22.931 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 1.685200349, 2024-09-17T03:09:22.931 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 18, 2024-09-17T03:09:22.931 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 34, 2024-09-17T03:09:22.931 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 34, 2024-09-17T03:09:22.931 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 21.040758920999998 2024-09-17T03:09:22.932 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:09:22.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.910+0000 7f909f2e5640 1 -- 172.21.15.78:0/3465601895 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f907c078b90 msgr2=0x7f907c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:22.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.910+0000 7f909f2e5640 1 --2- 172.21.15.78:0/3465601895 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f907c078b90 0x7f907c07b0a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9094034000 tx=0x7f9094004730 comp rx=0 tx=0).stop 2024-09-17T03:09:22.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.910+0000 7f909f2e5640 1 -- 172.21.15.78:0/3465601895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90980cf940 msgr2=0x7f909809c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:22.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.910+0000 7f909f2e5640 1 --2- 172.21.15.78:0/3465601895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90980cf940 0x7f909809c8f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f908800da50 tx=0x7f908800df10 comp rx=0 tx=0).stop 2024-09-17T03:09:22.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.910+0000 7f909f2e5640 1 -- 172.21.15.78:0/3465601895 shutdown_connections 2024-09-17T03:09:22.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.910+0000 7f909f2e5640 1 --2- 172.21.15.78:0/3465601895 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f907c078b90 0x7f907c07b0a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.910+0000 7f909f2e5640 1 --2- 172.21.15.78:0/3465601895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f909809ce30 0x7f90981ecd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.910+0000 7f909f2e5640 1 --2- 172.21.15.78:0/3465601895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90980cf940 0x7f909809c8f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.910+0000 7f909f2e5640 1 --2- 172.21.15.78:0/3465601895 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f90980701c0 0x7f90981f7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:22.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.910+0000 7f909f2e5640 1 -- 172.21.15.78:0/3465601895 >> 172.21.15.78:0/3465601895 conn(0x7f909806d7d0 msgr2=0x7f90980b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:22.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.910+0000 7f909f2e5640 1 -- 172.21.15.78:0/3465601895 shutdown_connections 2024-09-17T03:09:22.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:22.910+0000 7f909f2e5640 1 -- 172.21.15.78:0/3465601895 wait complete. 2024-09-17T03:09:22.934 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:09:23.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.049+0000 7f33e2789640 1 -- 172.21.15.78:0/2422380953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33c4003f90 msgr2=0x7f33c4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.049+0000 7f33e2789640 1 --2- 172.21.15.78:0/2422380953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33c4003f90 0x7f33c4004800 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0b7120 tx=0x7f33c4005830 comp rx=0 tx=0).stop 2024-09-17T03:09:23.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.049+0000 7f33e0d26640 1 -- 172.21.15.78:0/2422380953 reap_dead start 2024-09-17T03:09:23.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.049+0000 7f33e2789640 1 -- 172.21.15.78:0/2422380953 shutdown_connections 2024-09-17T03:09:23.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.049+0000 7f33e2789640 1 -- 172.21.15.78:0/2422380953 >> 172.21.15.78:0/2422380953 conn(0x7f33dc08bfc0 msgr2=0x7f33dc09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:23.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.049+0000 7f33e2789640 1 -- 172.21.15.78:0/2422380953 shutdown_connections 2024-09-17T03:09:23.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.049+0000 7f33e2789640 1 -- 172.21.15.78:0/2422380953 wait complete. 2024-09-17T03:09:23.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.051+0000 7f33e2789640 1 Processor -- start 2024-09-17T03:09:23.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.051+0000 7f33e2789640 1 -- start start 2024-09-17T03:09:23.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.052+0000 7f33e2789640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33c4003f90 0x7f33dc160ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.052+0000 7f33e2789640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f33dc09e200 0x7f33dc0cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.052+0000 7f33e2789640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f33dc09ec10 0x7f33dc0ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.052+0000 7f33e2789640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f33dc0cfd70 con 0x7f33c4003f90 2024-09-17T03:09:23.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.052+0000 7f33e2789640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f33dc0cfbf0 con 0x7f33dc09ec10 2024-09-17T03:09:23.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.052+0000 7f33e2789640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f33dc0cfef0 con 0x7f33dc09e200 2024-09-17T03:09:23.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.053+0000 7f33dbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33c4003f90 0x7f33dc160ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.053+0000 7f33dbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33c4003f90 0x7f33dc160ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56154/0 (socket says 172.21.15.78:56154) 2024-09-17T03:09:23.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.053+0000 7f33dbfff640 1 -- 172.21.15.78:0/2488972412 learned_addr learned my addr 172.21.15.78:0/2488972412 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:23.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.053+0000 7f33e0d26640 1 --2- 172.21.15.78:0/2488972412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f33dc09ec10 0x7f33dc0ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.053+0000 7f33db7fe640 1 --2- 172.21.15.78:0/2488972412 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f33dc09e200 0x7f33dc0cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.053+0000 7f33dbfff640 1 -- 172.21.15.78:0/2488972412 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f33dc09e200 msgr2=0x7f33dc0cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.053+0000 7f33dbfff640 1 --2- 172.21.15.78:0/2488972412 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f33dc09e200 0x7f33dc0cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.053+0000 7f33dbfff640 1 -- 172.21.15.78:0/2488972412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f33dc09ec10 msgr2=0x7f33dc0ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.053+0000 7f33dbfff640 1 --2- 172.21.15.78:0/2488972412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f33dc09ec10 0x7f33dc0ce0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.053+0000 7f33dbfff640 1 -- 172.21.15.78:0/2488972412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33dc0a03c0 con 0x7f33c4003f90 2024-09-17T03:09:23.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.053+0000 7f33db7fe640 1 --2- 172.21.15.78:0/2488972412 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f33dc09e200 0x7f33dc0cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:23.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.053+0000 7f33dbfff640 1 --2- 172.21.15.78:0/2488972412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33c4003f90 0x7f33dc160ec0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f33cc003f10 tx=0x7f33cc001700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:23.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.053+0000 7f33d8ff9640 1 -- 172.21.15.78:0/2488972412 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc015070 con 0x7f33c4003f90 2024-09-17T03:09:23.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.053+0000 7f33d8ff9640 1 -- 172.21.15.78:0/2488972412 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33cc011840 con 0x7f33c4003f90 2024-09-17T03:09:23.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.053+0000 7f33d8ff9640 1 -- 172.21.15.78:0/2488972412 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33cc011c70 con 0x7f33c4003f90 2024-09-17T03:09:23.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.053+0000 7f33e2789640 1 -- 172.21.15.78:0/2488972412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33dc1f6000 con 0x7f33c4003f90 2024-09-17T03:09:23.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.053+0000 7f33e2789640 1 -- 172.21.15.78:0/2488972412 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33dc1f65c0 con 0x7f33c4003f90 2024-09-17T03:09:23.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.055+0000 7f33d8ff9640 1 -- 172.21.15.78:0/2488972412 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f33cc018070 con 0x7f33c4003f90 2024-09-17T03:09:23.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.056+0000 7f33d8ff9640 1 --2- 172.21.15.78:0/2488972412 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f33c8078b90 0x7f33c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.056+0000 7f33d8ff9640 1 -- 172.21.15.78:0/2488972412 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f33cc09b9d0 con 0x7f33c4003f90 2024-09-17T03:09:23.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.056+0000 7f33db7fe640 1 --2- 172.21.15.78:0/2488972412 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f33c8078b90 0x7f33c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.057+0000 7f33e97d2740 1 Processor -- start 2024-09-17T03:09:23.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.057+0000 7f33e97d2740 1 -- start start 2024-09-17T03:09:23.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.057+0000 7f33db7fe640 1 --2- 172.21.15.78:0/2488972412 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f33c8078b90 0x7f33c807b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f33d0035000 tx=0x7f33d00046c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:23.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.058+0000 7f33e97d2740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b6c270 0x559db6f3dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.058+0000 7f33e97d2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b433b0 0x559db6f3e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.058+0000 7f33e97d2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b4b590 0x559db6f5b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.058+0000 7f33e97d2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x559db6e86820 con 0x559db6b433b0 2024-09-17T03:09:23.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.058+0000 7f33e97d2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559db6e75c50 con 0x559db6b4b590 2024-09-17T03:09:23.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.058+0000 7f33e97d2740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x559db6e79a60 con 0x559db6b6c270 2024-09-17T03:09:23.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.058+0000 7f33db7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b433b0 0x559db6f3e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.058+0000 7f33db7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b433b0 0x559db6f3e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56156/0 (socket says 172.21.15.78:56156) 2024-09-17T03:09:23.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.058+0000 7f33db7fe640 1 -- 172.21.15.78:0/2838334037 learned_addr learned my addr 172.21.15.78:0/2838334037 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:23.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.058+0000 7f33db7fe640 1 -- 172.21.15.78:0/2838334037 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b6c270 msgr2=0x559db6f3dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:23.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.058+0000 7f33e0d26640 1 --2- 172.21.15.78:0/2838334037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b4b590 0x559db6f5b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.058+0000 7f33dbfff640 1 --2- 172.21.15.78:0/2838334037 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b6c270 0x559db6f3dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.058+0000 7f33db7fe640 1 --2- 172.21.15.78:0/2838334037 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b6c270 0x559db6f3dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.058+0000 7f33db7fe640 1 -- 172.21.15.78:0/2838334037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b4b590 msgr2=0x559db6f5b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:23.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.058+0000 7f33db7fe640 1 --2- 172.21.15.78:0/2838334037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b4b590 0x559db6f5b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.058+0000 7f33db7fe640 1 -- 172.21.15.78:0/2838334037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559db6bd7850 con 0x559db6b433b0 2024-09-17T03:09:23.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.058+0000 7f33db7fe640 1 --2- 172.21.15.78:0/2838334037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b433b0 0x559db6f3e500 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f33d002b460 tx=0x7f33d003a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee74a7ac9f898418 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:23.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.059+0000 7f33c1ffb640 1 -- 172.21.15.78:0/2838334037 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d0044040 con 0x559db6b433b0 2024-09-17T03:09:23.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.059+0000 7f33c1ffb640 1 -- 172.21.15.78:0/2838334037 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33d004d070 con 0x559db6b433b0 2024-09-17T03:09:23.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.059+0000 7f33c1ffb640 1 -- 172.21.15.78:0/2838334037 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d0038040 con 0x559db6b433b0 2024-09-17T03:09:23.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.059+0000 7f33e97d2740 1 -- 172.21.15.78:0/2838334037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b433b0 msgr2=0x559db6f3e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.059+0000 7f33e97d2740 1 --2- 172.21.15.78:0/2838334037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b433b0 0x559db6f3e500 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f33d002b460 tx=0x7f33d003a000 comp rx=0 tx=0).stop 2024-09-17T03:09:23.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.059+0000 7f33e97d2740 1 -- 172.21.15.78:0/2838334037 shutdown_connections 2024-09-17T03:09:23.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.059+0000 7f33e97d2740 1 --2- 172.21.15.78:0/2838334037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b4b590 0x559db6f5b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.059+0000 7f33e97d2740 1 --2- 172.21.15.78:0/2838334037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b433b0 0x559db6f3e500 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.059+0000 7f33e97d2740 1 --2- 172.21.15.78:0/2838334037 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b6c270 0x559db6f3dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.059+0000 7f33e97d2740 1 -- 172.21.15.78:0/2838334037 >> 172.21.15.78:0/2838334037 conn(0x559db6b603c0 msgr2=0x559db6f14280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:23.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.059+0000 7f33e97d2740 1 -- 172.21.15.78:0/2838334037 shutdown_connections 2024-09-17T03:09:23.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.060+0000 7f33e97d2740 1 -- 172.21.15.78:0/2838334037 wait complete. 2024-09-17T03:09:23.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.060+0000 7f33e97d2740 1 -- start start 2024-09-17T03:09:23.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.061+0000 7f33e97d2740 1 Processor -- start 2024-09-17T03:09:23.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33e97d2740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b433b0 0x559db6f2b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33e97d2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b4b590 0x559db6f52070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33e97d2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b6c270 0x559db6f525b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33e97d2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x559db6be6620 con 0x559db6b6c270 2024-09-17T03:09:23.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33e97d2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559db6e1b5f0 con 0x559db6b4b590 2024-09-17T03:09:23.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33e97d2740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x559db6f3ea40 con 0x559db6b433b0 2024-09-17T03:09:23.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33e97d2740 10 client.0 _ll_register_callbacks cb 0x559db6e1f0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:09:23.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33e0d26640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b6c270 0x559db6f525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33e0d26640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b6c270 0x559db6f525b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56168/0 (socket says 172.21.15.78:56168) 2024-09-17T03:09:23.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33e0d26640 1 -- 172.21.15.78:0/505253743 learned_addr learned my addr 172.21.15.78:0/505253743 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:23.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33dbfff640 1 --2- 172.21.15.78:0/505253743 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b433b0 0x559db6f2b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33db7fe640 1 --2- 172.21.15.78:0/505253743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b4b590 0x559db6f52070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33e0d26640 1 -- 172.21.15.78:0/505253743 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b433b0 msgr2=0x559db6f2b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:23.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33e0d26640 1 --2- 172.21.15.78:0/505253743 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b433b0 0x559db6f2b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33e0d26640 1 -- 172.21.15.78:0/505253743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b4b590 msgr2=0x559db6f52070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:23.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33e0d26640 1 --2- 172.21.15.78:0/505253743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b4b590 0x559db6f52070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33e0d26640 1 -- 172.21.15.78:0/505253743 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559db6c4e6b0 con 0x559db6b6c270 2024-09-17T03:09:23.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33db7fe640 1 --2- 172.21.15.78:0/505253743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b4b590 0x559db6f52070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:09:23.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33dbfff640 1 --2- 172.21.15.78:0/505253743 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b433b0 0x559db6f2b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:09:23.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33e0d26640 1 --2- 172.21.15.78:0/505253743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b6c270 0x559db6f525b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f33c4004780 tx=0x7f33d4006410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89af9e352abb3318 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:23.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.062+0000 7f33baffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:09:23.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.063+0000 7f33baffd640 1 -- 172.21.15.78:0/505253743 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d400f950 con 0x559db6b6c270 2024-09-17T03:09:23.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.063+0000 7f33baffd640 1 -- 172.21.15.78:0/505253743 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f33d400faf0 con 0x559db6b6c270 2024-09-17T03:09:23.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.063+0000 7f33e97d2740 1 -- 172.21.15.78:0/505253743 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33d004d070 con 0x559db6b6c270 2024-09-17T03:09:23.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.063+0000 7f33baffd640 1 -- 172.21.15.78:0/505253743 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f33d4021050 con 0x559db6b6c270 2024-09-17T03:09:23.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.063+0000 7f33e97d2740 10 client.5196 fetch_fsmap learned FSMap version 18 2024-09-17T03:09:23.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.063+0000 7f33e97d2740 1 -- 172.21.15.78:0/505253743 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x559db6f2be80 con 0x559db6b6c270 2024-09-17T03:09:23.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.063+0000 7f33baffd640 1 -- 172.21.15.78:0/505253743 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33d004d070 con 0x559db6b6c270 2024-09-17T03:09:23.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.063+0000 7f33baffd640 1 -- 172.21.15.78:0/505253743 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 18) ==== 3542+0+0 (secure 0 0 0) 0x7f33d4024020 con 0x559db6b6c270 2024-09-17T03:09:23.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.063+0000 7f33e97d2740 10 client.5196 fetch_fsmap finished waiting for FSMap version 18 2024-09-17T03:09:23.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.063+0000 7f33e97d2740 10 client.5196 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:09:23.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.063+0000 7f33e97d2740 20 client.5196 populate_metadata read hostname 'smithi078' 2024-09-17T03:09:23.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.063+0000 7f33e97d2740 1 --2- 172.21.15.78:0/505253743 >> [v2:172.21.15.78:6832/2730690660,v1:172.21.15.78:6833/2730690660] conn(0x559db6b2ae40 0x559db6f4fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.063+0000 7f33e97d2740 4 client.5196 mds_command: new command op to 4929 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:09:23.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.063+0000 7f33e97d2740 1 -- 172.21.15.78:0/505253743 --> [v2:172.21.15.78:6832/2730690660,v1:172.21.15.78:6833/2730690660] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559db6e88770 con 0x559db6b2ae40 2024-09-17T03:09:23.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.063+0000 7f33dbfff640 1 --2- 172.21.15.78:0/505253743 >> [v2:172.21.15.78:6832/2730690660,v1:172.21.15.78:6833/2730690660] conn(0x559db6b2ae40 0x559db6f4fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.064+0000 7f33baffd640 10 client.5196 ms_handle_connect on v2:172.21.15.78:6832/2730690660 2024-09-17T03:09:23.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.064+0000 7f33dbfff640 1 --2- 172.21.15.78:0/505253743 >> [v2:172.21.15.78:6832/2730690660,v1:172.21.15.78:6833/2730690660] conn(0x559db6b2ae40 0x559db6f4fe00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3eb038d14c0464a9 server_cookie=a10fe4bcb0a74663 in_seq=0 out_seq=0 2024-09-17T03:09:23.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.064+0000 7f33baffd640 1 -- 172.21.15.78:0/505253743 <== mds.1 v2:172.21.15.78:6832/2730690660 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559db6e88770 con 0x559db6b2ae40 2024-09-17T03:09:23.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.064+0000 7f33baffd640 10 client.5196 handle_command_reply: tid=0 2024-09-17T03:09:23.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.064+0000 7f33e97d2740 1 client.5196 shutdown 2024-09-17T03:09:23.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.065+0000 7f33e97d2740 1 -- 172.21.15.78:0/505253743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b6c270 msgr2=0x559db6f525b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.065+0000 7f33e97d2740 1 --2- 172.21.15.78:0/505253743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b6c270 0x559db6f525b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f33c4004780 tx=0x7f33d4006410 comp rx=0 tx=0).stop 2024-09-17T03:09:23.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.065+0000 7f33e97d2740 1 -- 172.21.15.78:0/505253743 shutdown_connections 2024-09-17T03:09:23.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.065+0000 7f33e97d2740 1 --2- 172.21.15.78:0/505253743 >> [v2:172.21.15.78:6832/2730690660,v1:172.21.15.78:6833/2730690660] conn(0x559db6b2ae40 0x559db6f4fe00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.065+0000 7f33e97d2740 1 --2- 172.21.15.78:0/505253743 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b6c270 0x559db6f525b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.065+0000 7f33baffd640 0 client.5196 ms_handle_reset on v2:172.21.15.78:6832/2730690660 2024-09-17T03:09:23.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.065+0000 7f33e97d2740 1 --2- 172.21.15.78:0/505253743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b4b590 0x559db6f52070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.065+0000 7f33e97d2740 1 --2- 172.21.15.78:0/505253743 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b433b0 0x559db6f2b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.065+0000 7f33e97d2740 1 -- 172.21.15.78:0/505253743 >> 172.21.15.78:0/505253743 conn(0x559db6b603c0 msgr2=0x559db6f5a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:23.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.065+0000 7f33e97d2740 1 -- 172.21.15.78:0/505253743 shutdown_connections 2024-09-17T03:09:23.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.065+0000 7f33e97d2740 1 -- 172.21.15.78:0/505253743 wait complete. 2024-09-17T03:09:23.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.065+0000 7f33e97d2740 20 client.5196 trim_cache size 0 max 16384 2024-09-17T03:09:23.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.083+0000 7f33e97d2740 1 Processor -- start 2024-09-17T03:09:23.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.083+0000 7f33e97d2740 1 -- start start 2024-09-17T03:09:23.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.084+0000 7f33e97d2740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b433b0 0x559db6f4f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.084+0000 7f33e97d2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b4b590 0x559db6f7c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.084+0000 7f33e97d2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b6c270 0x559db6f7c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.084+0000 7f33e97d2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f33dc2018e0 con 0x559db6b6c270 2024-09-17T03:09:23.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.084+0000 7f33e97d2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f33dc201f70 con 0x559db6b4b590 2024-09-17T03:09:23.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.084+0000 7f33e97d2740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f33dc0a11e0 con 0x559db6b433b0 2024-09-17T03:09:23.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.085+0000 7f33e0d26640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b6c270 0x559db6f7c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.085+0000 7f33e0d26640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b6c270 0x559db6f7c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56182/0 (socket says 172.21.15.78:56182) 2024-09-17T03:09:23.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.085+0000 7f33e0d26640 1 -- 172.21.15.78:0/3728309899 learned_addr learned my addr 172.21.15.78:0/3728309899 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:23.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.085+0000 7f33dbfff640 1 --2- 172.21.15.78:0/3728309899 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b433b0 0x559db6f4f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.085+0000 7f33db7fe640 1 --2- 172.21.15.78:0/3728309899 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b4b590 0x559db6f7c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.085+0000 7f33e0d26640 1 -- 172.21.15.78:0/3728309899 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b433b0 msgr2=0x559db6f4f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:23.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.085+0000 7f33e0d26640 1 --2- 172.21.15.78:0/3728309899 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b433b0 0x559db6f4f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.085+0000 7f33e0d26640 1 -- 172.21.15.78:0/3728309899 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b4b590 msgr2=0x559db6f7c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:23.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.085+0000 7f33e0d26640 1 --2- 172.21.15.78:0/3728309899 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b4b590 0x559db6f7c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.085+0000 7f33e0d26640 1 -- 172.21.15.78:0/3728309899 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559db6f3ea30 con 0x559db6b6c270 2024-09-17T03:09:23.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.085+0000 7f33dbfff640 1 --2- 172.21.15.78:0/3728309899 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b433b0 0x559db6f4f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:23.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.085+0000 7f33db7fe640 1 --2- 172.21.15.78:0/3728309899 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b4b590 0x559db6f7c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:23.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.085+0000 7f33e0d26640 1 --2- 172.21.15.78:0/3728309899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b6c270 0x559db6f7c7c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f33d4000f80 tx=0x7f33d400f9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6883510f690bee server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:23.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.085+0000 7f33c17fa640 1 -- 172.21.15.78:0/3728309899 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d400fb20 con 0x559db6b6c270 2024-09-17T03:09:23.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.085+0000 7f33c17fa640 1 -- 172.21.15.78:0/3728309899 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33d4011570 con 0x559db6b6c270 2024-09-17T03:09:23.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.085+0000 7f33c17fa640 1 -- 172.21.15.78:0/3728309899 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d4011960 con 0x559db6b6c270 2024-09-17T03:09:23.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.086+0000 7f33e97d2740 1 -- 172.21.15.78:0/3728309899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b6c270 msgr2=0x559db6f7c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.086+0000 7f33e97d2740 1 --2- 172.21.15.78:0/3728309899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b6c270 0x559db6f7c7c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f33d4000f80 tx=0x7f33d400f9b0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.086+0000 7f33e97d2740 1 -- 172.21.15.78:0/3728309899 shutdown_connections 2024-09-17T03:09:23.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.086+0000 7f33e97d2740 1 --2- 172.21.15.78:0/3728309899 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b6c270 0x559db6f7c7c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.086+0000 7f33e97d2740 1 --2- 172.21.15.78:0/3728309899 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b4b590 0x559db6f7c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.086+0000 7f33e97d2740 1 --2- 172.21.15.78:0/3728309899 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b433b0 0x559db6f4f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.086+0000 7f33e97d2740 1 -- 172.21.15.78:0/3728309899 >> 172.21.15.78:0/3728309899 conn(0x559db6b603c0 msgr2=0x559db6f2b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:23.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.086+0000 7f33e97d2740 1 -- 172.21.15.78:0/3728309899 shutdown_connections 2024-09-17T03:09:23.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.086+0000 7f33e97d2740 1 -- 172.21.15.78:0/3728309899 wait complete. 2024-09-17T03:09:23.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.087+0000 7f33e97d2740 1 -- start start 2024-09-17T03:09:23.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.087+0000 7f33e97d2740 1 Processor -- start 2024-09-17T03:09:23.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.088+0000 7f33e97d2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b433b0 0x559db6f3da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.088+0000 7f33e97d2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b4b590 0x559db6f11e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.088+0000 7f33e97d2740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b6c270 0x559db6fd8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.088+0000 7f33e97d2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x559db6f2c2e0 con 0x559db6b4b590 2024-09-17T03:09:23.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.088+0000 7f33e97d2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559db6f50de0 con 0x559db6b433b0 2024-09-17T03:09:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.088+0000 7f33e97d2740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x559db6f6c210 con 0x559db6b6c270 2024-09-17T03:09:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.088+0000 7f33e97d2740 10 client.0 _ll_register_callbacks cb 0x7f33d4001830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:09:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.088+0000 7f33db7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b4b590 0x559db6f11e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.088+0000 7f33db7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b4b590 0x559db6f11e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56192/0 (socket says 172.21.15.78:56192) 2024-09-17T03:09:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.088+0000 7f33db7fe640 1 -- 172.21.15.78:0/247315143 learned_addr learned my addr 172.21.15.78:0/247315143 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.089+0000 7f33db7fe640 1 -- 172.21.15.78:0/247315143 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b6c270 msgr2=0x559db6fd8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.089+0000 7f33db7fe640 1 --2- 172.21.15.78:0/247315143 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b6c270 0x559db6fd8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.089+0000 7f33db7fe640 1 -- 172.21.15.78:0/247315143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b433b0 msgr2=0x559db6f3da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.089+0000 7f33db7fe640 1 --2- 172.21.15.78:0/247315143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b433b0 0x559db6f3da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.089+0000 7f33db7fe640 1 -- 172.21.15.78:0/247315143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559db6fdc670 con 0x559db6b4b590 2024-09-17T03:09:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.089+0000 7f33db7fe640 1 --2- 172.21.15.78:0/247315143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b4b590 0x559db6f11e70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f33d0009be0 tx=0x7f33d0033930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc52e0c4d8fc964f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.089+0000 7f33baffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:09:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.089+0000 7f33baffd640 1 -- 172.21.15.78:0/247315143 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33d0056060 con 0x559db6b4b590 2024-09-17T03:09:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.089+0000 7f33baffd640 1 -- 172.21.15.78:0/247315143 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f33d0033c60 con 0x559db6b4b590 2024-09-17T03:09:23.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.089+0000 7f33e97d2740 1 -- 172.21.15.78:0/247315143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33d4011570 con 0x559db6b4b590 2024-09-17T03:09:23.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.089+0000 7f33baffd640 1 -- 172.21.15.78:0/247315143 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f33d005c050 con 0x559db6b4b590 2024-09-17T03:09:23.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.089+0000 7f33e97d2740 10 client.5202 fetch_fsmap learned FSMap version 18 2024-09-17T03:09:23.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.089+0000 7f33e97d2740 1 -- 172.21.15.78:0/247315143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x559db6fbb630 con 0x559db6b4b590 2024-09-17T03:09:23.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.089+0000 7f33baffd640 1 -- 172.21.15.78:0/247315143 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33d4011570 con 0x559db6b4b590 2024-09-17T03:09:23.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.089+0000 7f33baffd640 1 -- 172.21.15.78:0/247315143 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 18) ==== 3542+0+0 (secure 0 0 0) 0x7f33d005f020 con 0x559db6b4b590 2024-09-17T03:09:23.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.089+0000 7f33e97d2740 10 client.5202 fetch_fsmap finished waiting for FSMap version 18 2024-09-17T03:09:23.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.089+0000 7f33e97d2740 10 client.5202 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:09:23.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.090+0000 7f33e97d2740 20 client.5202 populate_metadata read hostname 'smithi078' 2024-09-17T03:09:23.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.090+0000 7f33e97d2740 1 --2- 172.21.15.78:0/247315143 >> [v2:172.21.15.78:6832/2730690660,v1:172.21.15.78:6833/2730690660] conn(0x559db6f5b0a0 0x559db6f7c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.090+0000 7f33e97d2740 4 client.5202 mds_command: new command op to 4929 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:09:23.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.090+0000 7f33e97d2740 1 -- 172.21.15.78:0/247315143 --> [v2:172.21.15.78:6832/2730690660,v1:172.21.15.78:6833/2730690660] -- command(tid 0: {"prefix": "status"}) -- 0x559db6e84220 con 0x559db6f5b0a0 2024-09-17T03:09:23.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.090+0000 7f33dbfff640 1 --2- 172.21.15.78:0/247315143 >> [v2:172.21.15.78:6832/2730690660,v1:172.21.15.78:6833/2730690660] conn(0x559db6f5b0a0 0x559db6f7c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.090+0000 7f33baffd640 10 client.5202 ms_handle_connect on v2:172.21.15.78:6832/2730690660 2024-09-17T03:09:23.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.090+0000 7f33dbfff640 1 --2- 172.21.15.78:0/247315143 >> [v2:172.21.15.78:6832/2730690660,v1:172.21.15.78:6833/2730690660] conn(0x559db6f5b0a0 0x559db6f7c280 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=876537a06ebb8c52 server_cookie=6378c6f20eb9063b in_seq=0 out_seq=0 2024-09-17T03:09:23.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.090+0000 7f33baffd640 1 -- 172.21.15.78:0/247315143 <== mds.1 v2:172.21.15.78:6832/2730690660 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x559db6e84220 con 0x559db6f5b0a0 2024-09-17T03:09:23.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.090+0000 7f33baffd640 10 client.5202 handle_command_reply: tid=0 2024-09-17T03:09:23.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.090+0000 7f33e97d2740 1 client.5202 shutdown 2024-09-17T03:09:23.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.090+0000 7f33e97d2740 1 -- 172.21.15.78:0/247315143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b4b590 msgr2=0x559db6f11e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.090+0000 7f33e97d2740 1 --2- 172.21.15.78:0/247315143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b4b590 0x559db6f11e70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f33d0009be0 tx=0x7f33d0033930 comp rx=0 tx=0).stop 2024-09-17T03:09:23.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e97d2740 1 -- 172.21.15.78:0/247315143 shutdown_connections 2024-09-17T03:09:23.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e97d2740 1 --2- 172.21.15.78:0/247315143 >> [v2:172.21.15.78:6832/2730690660,v1:172.21.15.78:6833/2730690660] conn(0x559db6f5b0a0 0x559db6f7c280 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e97d2740 1 --2- 172.21.15.78:0/247315143 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559db6b6c270 0x559db6fd8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e97d2740 1 --2- 172.21.15.78:0/247315143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559db6b4b590 0x559db6f11e70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e97d2740 1 --2- 172.21.15.78:0/247315143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559db6b433b0 0x559db6f3da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33baffd640 0 client.5202 ms_handle_reset on v2:172.21.15.78:6832/2730690660 2024-09-17T03:09:23.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e97d2740 1 -- 172.21.15.78:0/247315143 >> 172.21.15.78:0/247315143 conn(0x559db6b603c0 msgr2=0x559db6f39cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:23.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e97d2740 1 -- 172.21.15.78:0/247315143 shutdown_connections 2024-09-17T03:09:23.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e97d2740 1 -- 172.21.15.78:0/247315143 wait complete. 2024-09-17T03:09:23.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e97d2740 20 client.5202 trim_cache size 0 max 16384 2024-09-17T03:09:23.095 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:09:23.095 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:09:23.095 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 1, 2024-09-17T03:09:23.095 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4929, 2024-09-17T03:09:23.095 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:09:23.095 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:09:23.095 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:09:23.095 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 2.8759275940000002, 2024-09-17T03:09:23.095 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 18, 2024-09-17T03:09:23.096 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 34, 2024-09-17T03:09:23.096 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 34, 2024-09-17T03:09:23.096 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 21.229140381000001 2024-09-17T03:09:23.096 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:09:23.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e2789640 1 -- 172.21.15.78:0/2488972412 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f33c8078b90 msgr2=0x7f33c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e2789640 1 --2- 172.21.15.78:0/2488972412 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f33c8078b90 0x7f33c807b0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f33d0035000 tx=0x7f33d00046c0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e2789640 1 -- 172.21.15.78:0/2488972412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33c4003f90 msgr2=0x7f33dc160ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e2789640 1 --2- 172.21.15.78:0/2488972412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33c4003f90 0x7f33dc160ec0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f33cc003f10 tx=0x7f33cc001700 comp rx=0 tx=0).stop 2024-09-17T03:09:23.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e2789640 1 -- 172.21.15.78:0/2488972412 shutdown_connections 2024-09-17T03:09:23.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e2789640 1 --2- 172.21.15.78:0/2488972412 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f33c8078b90 0x7f33c807b0a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e2789640 1 --2- 172.21.15.78:0/2488972412 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f33dc09ec10 0x7f33dc0ce0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e2789640 1 --2- 172.21.15.78:0/2488972412 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f33dc09e200 0x7f33dc0cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e2789640 1 --2- 172.21.15.78:0/2488972412 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33c4003f90 0x7f33dc160ec0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e2789640 1 -- 172.21.15.78:0/2488972412 >> 172.21.15.78:0/2488972412 conn(0x7f33dc08bfc0 msgr2=0x7f33dc068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:23.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e2789640 1 -- 172.21.15.78:0/2488972412 shutdown_connections 2024-09-17T03:09:23.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.091+0000 7f33e2789640 1 -- 172.21.15.78:0/2488972412 wait complete. 2024-09-17T03:09:23.101 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:09:23.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.216+0000 7fdd0b67e640 1 -- 172.21.15.78:0/3719695528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd040cf320 msgr2=0x7fdd040ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.216+0000 7fdd0b67e640 1 --2- 172.21.15.78:0/3719695528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd040cf320 0x7fdd040ccbc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdd040b7c50 tx=0x7fdcf402a530 comp rx=0 tx=0).stop 2024-09-17T03:09:23.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.216+0000 7fdd0b67e640 1 -- 172.21.15.78:0/3719695528 shutdown_connections 2024-09-17T03:09:23.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.216+0000 7fdd0b67e640 1 --2- 172.21.15.78:0/3719695528 >> v2:172.21.15.193:3300/0 conn(0x7fdd040b7cc0 0x7fdd040d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.216+0000 7fdd0b67e640 1 --2- 172.21.15.78:0/3719695528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd040cf320 0x7fdd040ccbc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.216+0000 7fdd0b67e640 1 -- 172.21.15.78:0/3719695528 >> 172.21.15.78:0/3719695528 conn(0x7fdd0406d4f0 msgr2=0x7fdd04071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:23.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.216+0000 7fdd0b67e640 1 -- 172.21.15.78:0/3719695528 shutdown_connections 2024-09-17T03:09:23.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.216+0000 7fdd0b67e640 1 -- 172.21.15.78:0/3719695528 wait complete. 2024-09-17T03:09:23.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.218+0000 7fdd0b67e640 1 Processor -- start 2024-09-17T03:09:23.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.218+0000 7fdd0b67e640 1 -- start start 2024-09-17T03:09:23.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.219+0000 7fdd0b67e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd040b7cc0 0x7fdd040c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.219+0000 7fdd0b67e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd040cf320 0x7fdd041f9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.219+0000 7fdd0b67e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd041600b0 0x7fdd0406ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.219+0000 7fdd0b67e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdd040d13c0 con 0x7fdd040b7cc0 2024-09-17T03:09:23.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.219+0000 7fdd0b67e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdd040d1240 con 0x7fdd040cf320 2024-09-17T03:09:23.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.219+0000 7fdd0b67e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fdd040d1540 con 0x7fdd041600b0 2024-09-17T03:09:23.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.219+0000 7fdd0941a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd040b7cc0 0x7fdd040c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.219+0000 7fdd0941a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd040b7cc0 0x7fdd040c9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56214/0 (socket says 172.21.15.78:56214) 2024-09-17T03:09:23.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.219+0000 7fdd0941a640 1 -- 172.21.15.78:0/742623518 learned_addr learned my addr 172.21.15.78:0/742623518 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:23.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.220+0000 7fdd0941a640 1 -- 172.21.15.78:0/742623518 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd041600b0 msgr2=0x7fdd0406ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.220+0000 7fdd09c1b640 1 --2- 172.21.15.78:0/742623518 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd041600b0 0x7fdd0406ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.220+0000 7fdd08c19640 1 --2- 172.21.15.78:0/742623518 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd040cf320 0x7fdd041f9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.220+0000 7fdd0941a640 1 --2- 172.21.15.78:0/742623518 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd041600b0 0x7fdd0406ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.220+0000 7fdd0941a640 1 -- 172.21.15.78:0/742623518 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd040cf320 msgr2=0x7fdd041f9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.220+0000 7fdd0941a640 1 --2- 172.21.15.78:0/742623518 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd040cf320 0x7fdd041f9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.220+0000 7fdd0941a640 1 -- 172.21.15.78:0/742623518 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd040b2fb0 con 0x7fdd040b7cc0 2024-09-17T03:09:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.220+0000 7fdd0941a640 1 --2- 172.21.15.78:0/742623518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd040b7cc0 0x7fdd040c9380 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000c3f0 tx=0x7fdd0000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.220+0000 7fdcf9ffb640 1 -- 172.21.15.78:0/742623518 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd00017070 con 0x7fdd040b7cc0 2024-09-17T03:09:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.220+0000 7fdcf9ffb640 1 -- 172.21.15.78:0/742623518 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd000035f0 con 0x7fdd040b7cc0 2024-09-17T03:09:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.220+0000 7fdd0b67e640 1 -- 172.21.15.78:0/742623518 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd040cbc50 con 0x7fdd040b7cc0 2024-09-17T03:09:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.220+0000 7fdcf9ffb640 1 -- 172.21.15.78:0/742623518 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd00003a40 con 0x7fdd040b7cc0 2024-09-17T03:09:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.220+0000 7fdd0b67e640 1 -- 172.21.15.78:0/742623518 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd040b4680 con 0x7fdd040b7cc0 2024-09-17T03:09:23.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.223+0000 7fdcf9ffb640 1 -- 172.21.15.78:0/742623518 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdd0001a070 con 0x7fdd040b7cc0 2024-09-17T03:09:23.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.223+0000 7fdcf9ffb640 1 --2- 172.21.15.78:0/742623518 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdce8078bc0 0x7fdce807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.223+0000 7fdcf9ffb640 1 -- 172.21.15.78:0/742623518 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fdd0009a040 con 0x7fdd040b7cc0 2024-09-17T03:09:23.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.224+0000 7fdd08c19640 1 --2- 172.21.15.78:0/742623518 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdce8078bc0 0x7fdce807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.224+0000 7fdd125e9740 1 Processor -- start 2024-09-17T03:09:23.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.224+0000 7fdd125e9740 1 -- start start 2024-09-17T03:09:23.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.224+0000 7fdd08c19640 1 --2- 172.21.15.78:0/742623518 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdce8078bc0 0x7fdce807b0d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4034000 tx=0x7fdcf4004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:23.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.225+0000 7fdd125e9740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263d0c270 0x5572640ddfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.225+0000 7fdd125e9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263ce33b0 0x5572640de500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.225+0000 7fdd125e9740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 0x5572640fb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.225+0000 7fdd125e9740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557264026820 con 0x557263ceb590 2024-09-17T03:09:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.225+0000 7fdd125e9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557264015c50 con 0x557263ce33b0 2024-09-17T03:09:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.225+0000 7fdd125e9740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x557264019a60 con 0x557263d0c270 2024-09-17T03:09:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.225+0000 7fdd09c1b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 0x5572640fb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.225+0000 7fdd09c1b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 0x5572640fb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56226/0 (socket says 172.21.15.78:56226) 2024-09-17T03:09:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.225+0000 7fdd09c1b640 1 -- 172.21.15.78:0/350056296 learned_addr learned my addr 172.21.15.78:0/350056296 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.225+0000 7fdd0941a640 1 --2- 172.21.15.78:0/350056296 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263d0c270 0x5572640ddfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.225+0000 7fdd08c19640 1 --2- 172.21.15.78:0/350056296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263ce33b0 0x5572640de500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.226+0000 7fdd09c1b640 1 -- 172.21.15.78:0/350056296 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263d0c270 msgr2=0x5572640ddfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.226+0000 7fdd09c1b640 1 --2- 172.21.15.78:0/350056296 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263d0c270 0x5572640ddfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.226+0000 7fdd09c1b640 1 -- 172.21.15.78:0/350056296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263ce33b0 msgr2=0x5572640de500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.226+0000 7fdd09c1b640 1 --2- 172.21.15.78:0/350056296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263ce33b0 0x5572640de500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.226+0000 7fdd09c1b640 1 -- 172.21.15.78:0/350056296 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557263d77850 con 0x557263ceb590 2024-09-17T03:09:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.226+0000 7fdd08c19640 1 --2- 172.21.15.78:0/350056296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263ce33b0 0x5572640de500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.226+0000 7fdd09c1b640 1 --2- 172.21.15.78:0/350056296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 0x5572640fb400 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc009d10 tx=0x7fdcfc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45260d64f5dbdbb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.226+0000 7fdceeffd640 1 -- 172.21.15.78:0/350056296 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc003970 con 0x557263ceb590 2024-09-17T03:09:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.226+0000 7fdceeffd640 1 -- 172.21.15.78:0/350056296 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcfc003c00 con 0x557263ceb590 2024-09-17T03:09:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.226+0000 7fdceeffd640 1 -- 172.21.15.78:0/350056296 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc004030 con 0x557263ceb590 2024-09-17T03:09:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.227+0000 7fdd125e9740 1 -- 172.21.15.78:0/350056296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 msgr2=0x5572640fb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.227+0000 7fdd125e9740 1 --2- 172.21.15.78:0/350056296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 0x5572640fb400 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc009d10 tx=0x7fdcfc00f730 comp rx=0 tx=0).stop 2024-09-17T03:09:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.227+0000 7fdd125e9740 1 -- 172.21.15.78:0/350056296 shutdown_connections 2024-09-17T03:09:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.227+0000 7fdd125e9740 1 --2- 172.21.15.78:0/350056296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 0x5572640fb400 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.227+0000 7fdd125e9740 1 --2- 172.21.15.78:0/350056296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263ce33b0 0x5572640de500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.227+0000 7fdd125e9740 1 --2- 172.21.15.78:0/350056296 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263d0c270 0x5572640ddfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.227+0000 7fdd125e9740 1 -- 172.21.15.78:0/350056296 >> 172.21.15.78:0/350056296 conn(0x557263d003c0 msgr2=0x5572640b4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:23.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.227+0000 7fdd125e9740 1 -- 172.21.15.78:0/350056296 shutdown_connections 2024-09-17T03:09:23.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.227+0000 7fdd125e9740 1 -- 172.21.15.78:0/350056296 wait complete. 2024-09-17T03:09:23.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.228+0000 7fdd125e9740 1 -- start start 2024-09-17T03:09:23.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.228+0000 7fdd125e9740 1 Processor -- start 2024-09-17T03:09:23.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.230+0000 7fdd125e9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263ce33b0 0x55726410b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.230+0000 7fdd125e9740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263ceb590 0x5572640f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.230+0000 7fdd125e9740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263d0c270 0x5572640dd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.230+0000 7fdd125e9740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557263d86620 con 0x557263d0c270 2024-09-17T03:09:23.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.230+0000 7fdd125e9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557263fbb5f0 con 0x557263ce33b0 2024-09-17T03:09:23.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.230+0000 7fdd125e9740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5572640dea40 con 0x557263ceb590 2024-09-17T03:09:23.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.230+0000 7fdd125e9740 10 client.0 _ll_register_callbacks cb 0x557263fbf0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:09:23.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.230+0000 7fdd09c1b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263d0c270 0x5572640dd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.230+0000 7fdd09c1b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263d0c270 0x5572640dd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56230/0 (socket says 172.21.15.78:56230) 2024-09-17T03:09:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.230+0000 7fdd09c1b640 1 -- 172.21.15.78:0/2157566782 learned_addr learned my addr 172.21.15.78:0/2157566782 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.230+0000 7fdd08c19640 1 --2- 172.21.15.78:0/2157566782 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263ceb590 0x5572640f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.230+0000 7fdd0941a640 1 --2- 172.21.15.78:0/2157566782 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263ce33b0 0x55726410b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.230+0000 7fdd09c1b640 1 -- 172.21.15.78:0/2157566782 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263ceb590 msgr2=0x5572640f3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.230+0000 7fdd09c1b640 1 --2- 172.21.15.78:0/2157566782 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263ceb590 0x5572640f3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.230+0000 7fdd09c1b640 1 -- 172.21.15.78:0/2157566782 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263ce33b0 msgr2=0x55726410b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.230+0000 7fdd09c1b640 1 --2- 172.21.15.78:0/2157566782 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263ce33b0 0x55726410b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.230+0000 7fdd09c1b640 1 -- 172.21.15.78:0/2157566782 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557263dee6b0 con 0x557263d0c270 2024-09-17T03:09:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.230+0000 7fdd09c1b640 1 --2- 172.21.15.78:0/2157566782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263d0c270 0x5572640dd020 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc015000 tx=0x7fdcfc003e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b2355b84d39eea server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.230+0000 7fdce3fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:09:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.231+0000 7fdce3fff640 1 -- 172.21.15.78:0/2157566782 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc028060 con 0x557263d0c270 2024-09-17T03:09:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.231+0000 7fdce3fff640 1 -- 172.21.15.78:0/2157566782 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fdcfc004000 con 0x557263d0c270 2024-09-17T03:09:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.231+0000 7fdd125e9740 1 -- 172.21.15.78:0/2157566782 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcfc003c00 con 0x557263d0c270 2024-09-17T03:09:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.231+0000 7fdce3fff640 1 -- 172.21.15.78:0/2157566782 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fdcfc004200 con 0x557263d0c270 2024-09-17T03:09:23.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.231+0000 7fdd125e9740 10 client.5217 fetch_fsmap learned FSMap version 18 2024-09-17T03:09:23.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.231+0000 7fdd125e9740 1 -- 172.21.15.78:0/2157566782 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5572640f1d70 con 0x557263d0c270 2024-09-17T03:09:23.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.231+0000 7fdce3fff640 1 -- 172.21.15.78:0/2157566782 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcfc003c00 con 0x557263d0c270 2024-09-17T03:09:23.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.231+0000 7fdce3fff640 1 -- 172.21.15.78:0/2157566782 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 18) ==== 3542+0+0 (secure 0 0 0) 0x7fdcfc0043a0 con 0x557263d0c270 2024-09-17T03:09:23.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.231+0000 7fdd125e9740 10 client.5217 fetch_fsmap finished waiting for FSMap version 18 2024-09-17T03:09:23.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.231+0000 7fdd125e9740 10 client.5217 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:09:23.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.231+0000 7fdd125e9740 20 client.5217 populate_metadata read hostname 'smithi078' 2024-09-17T03:09:23.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.231+0000 7fdd125e9740 1 --2- 172.21.15.78:0/2157566782 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x557263ccae40 0x5572640f2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.231+0000 7fdd125e9740 4 client.5217 mds_command: new command op to 4938 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:09:23.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.231+0000 7fdd125e9740 1 -- 172.21.15.78:0/2157566782 --> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557264028770 con 0x557263ccae40 2024-09-17T03:09:23.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.232+0000 7fdd0941a640 1 --2- 172.21.15.78:0/2157566782 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x557263ccae40 0x5572640f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.232+0000 7fdce3fff640 10 client.5217 ms_handle_connect on v2:172.21.15.78:6834/2663458793 2024-09-17T03:09:23.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.232+0000 7fdd0941a640 1 --2- 172.21.15.78:0/2157566782 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x557263ccae40 0x5572640f2290 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e61a258ce4c97e46 server_cookie=e3dd96aec22c95cf in_seq=0 out_seq=0 2024-09-17T03:09:23.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.233+0000 7fdce3fff640 1 -- 172.21.15.78:0/2157566782 <== mds.0 v2:172.21.15.78:6834/2663458793 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557264028770 con 0x557263ccae40 2024-09-17T03:09:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.233+0000 7fdce3fff640 10 client.5217 handle_command_reply: tid=0 2024-09-17T03:09:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.233+0000 7fdd125e9740 1 client.5217 shutdown 2024-09-17T03:09:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.233+0000 7fdd125e9740 1 -- 172.21.15.78:0/2157566782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263d0c270 msgr2=0x5572640dd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.233+0000 7fdd125e9740 1 --2- 172.21.15.78:0/2157566782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263d0c270 0x5572640dd020 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc015000 tx=0x7fdcfc003e40 comp rx=0 tx=0).stop 2024-09-17T03:09:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.233+0000 7fdd125e9740 1 -- 172.21.15.78:0/2157566782 shutdown_connections 2024-09-17T03:09:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.233+0000 7fdd125e9740 1 --2- 172.21.15.78:0/2157566782 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x557263ccae40 0x5572640f2290 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.233+0000 7fdd125e9740 1 --2- 172.21.15.78:0/2157566782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263d0c270 0x5572640dd020 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.233+0000 7fdd125e9740 1 --2- 172.21.15.78:0/2157566782 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263ceb590 0x5572640f3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.233+0000 7fdd125e9740 1 --2- 172.21.15.78:0/2157566782 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263ce33b0 0x55726410b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.233+0000 7fdce3fff640 0 client.5217 ms_handle_reset on v2:172.21.15.78:6834/2663458793 2024-09-17T03:09:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.233+0000 7fdd125e9740 1 -- 172.21.15.78:0/2157566782 >> 172.21.15.78:0/2157566782 conn(0x557263d003c0 msgr2=0x5572640ae910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.233+0000 7fdd125e9740 1 -- 172.21.15.78:0/2157566782 shutdown_connections 2024-09-17T03:09:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.233+0000 7fdd125e9740 1 -- 172.21.15.78:0/2157566782 wait complete. 2024-09-17T03:09:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.233+0000 7fdd125e9740 20 client.5217 trim_cache size 0 max 16384 2024-09-17T03:09:23.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.253+0000 7fdd125e9740 1 Processor -- start 2024-09-17T03:09:23.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.253+0000 7fdd125e9740 1 -- start start 2024-09-17T03:09:23.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.254+0000 7fdd125e9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263ce33b0 0x5572640a9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.254+0000 7fdd125e9740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 0x5572640eeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.254+0000 7fdd125e9740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263d0c270 0x5572640ef410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.254+0000 7fdd125e9740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdd041f68a0 con 0x557263ceb590 2024-09-17T03:09:23.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.254+0000 7fdd125e9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdd040b3f30 con 0x557263ce33b0 2024-09-17T03:09:23.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.254+0000 7fdd125e9740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fdd040b7800 con 0x557263d0c270 2024-09-17T03:09:23.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.255+0000 7fdd08c19640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 0x5572640eeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.255+0000 7fdd08c19640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 0x5572640eeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56238/0 (socket says 172.21.15.78:56238) 2024-09-17T03:09:23.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.255+0000 7fdd08c19640 1 -- 172.21.15.78:0/389067691 learned_addr learned my addr 172.21.15.78:0/389067691 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:23.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.255+0000 7fdd09c1b640 1 --2- 172.21.15.78:0/389067691 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263d0c270 0x5572640ef410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.255+0000 7fdd0941a640 1 --2- 172.21.15.78:0/389067691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263ce33b0 0x5572640a9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.255+0000 7fdd08c19640 1 -- 172.21.15.78:0/389067691 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263d0c270 msgr2=0x5572640ef410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:23.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.255+0000 7fdd08c19640 1 --2- 172.21.15.78:0/389067691 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263d0c270 0x5572640ef410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.255+0000 7fdd08c19640 1 -- 172.21.15.78:0/389067691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263ce33b0 msgr2=0x5572640a9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:23.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.255+0000 7fdd08c19640 1 --2- 172.21.15.78:0/389067691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263ce33b0 0x5572640a9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.255+0000 7fdd08c19640 1 -- 172.21.15.78:0/389067691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572640a9ea0 con 0x557263ceb590 2024-09-17T03:09:23.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.255+0000 7fdd09c1b640 1 --2- 172.21.15.78:0/389067691 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263d0c270 0x5572640ef410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:23.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.255+0000 7fdd0941a640 1 --2- 172.21.15.78:0/389067691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263ce33b0 0x5572640a9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:23.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.255+0000 7fdd08c19640 1 --2- 172.21.15.78:0/389067691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 0x5572640eeed0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40098f0 tx=0x7fdcf403c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd96e9a18768ead server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:23.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.255+0000 7fdcee7fc640 1 -- 172.21.15.78:0/389067691 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf404d070 con 0x557263ceb590 2024-09-17T03:09:23.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.255+0000 7fdcee7fc640 1 -- 172.21.15.78:0/389067691 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcf4003c90 con 0x557263ceb590 2024-09-17T03:09:23.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.255+0000 7fdcee7fc640 1 -- 172.21.15.78:0/389067691 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4005020 con 0x557263ceb590 2024-09-17T03:09:23.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.256+0000 7fdd125e9740 1 -- 172.21.15.78:0/389067691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 msgr2=0x5572640eeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.256+0000 7fdd125e9740 1 --2- 172.21.15.78:0/389067691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 0x5572640eeed0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40098f0 tx=0x7fdcf403c000 comp rx=0 tx=0).stop 2024-09-17T03:09:23.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.256+0000 7fdd125e9740 1 -- 172.21.15.78:0/389067691 shutdown_connections 2024-09-17T03:09:23.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.256+0000 7fdd125e9740 1 --2- 172.21.15.78:0/389067691 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263d0c270 0x5572640ef410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.256+0000 7fdd125e9740 1 --2- 172.21.15.78:0/389067691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 0x5572640eeed0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.256+0000 7fdd125e9740 1 --2- 172.21.15.78:0/389067691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263ce33b0 0x5572640a9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.256+0000 7fdd125e9740 1 -- 172.21.15.78:0/389067691 >> 172.21.15.78:0/389067691 conn(0x557263d003c0 msgr2=0x5572640ae910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:23.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.256+0000 7fdd125e9740 1 -- 172.21.15.78:0/389067691 shutdown_connections 2024-09-17T03:09:23.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.256+0000 7fdd125e9740 1 -- 172.21.15.78:0/389067691 wait complete. 2024-09-17T03:09:23.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.257+0000 7fdd125e9740 1 -- start start 2024-09-17T03:09:23.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.257+0000 7fdd125e9740 1 Processor -- start 2024-09-17T03:09:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd125e9740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263ce33b0 0x5572640f2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd125e9740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 0x5572640f2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd125e9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263d0c270 0x5572641086d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd125e9740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5572640f4110 con 0x557263ceb590 2024-09-17T03:09:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd125e9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5572641084f0 con 0x557263d0c270 2024-09-17T03:09:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd125e9740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5572640cc1c0 con 0x557263ce33b0 2024-09-17T03:09:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd125e9740 10 client.0 _ll_register_callbacks cb 0x7fdd000011a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:09:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd08c19640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 0x5572640f2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd08c19640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 0x5572640f2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56254/0 (socket says 172.21.15.78:56254) 2024-09-17T03:09:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd08c19640 1 -- 172.21.15.78:0/1792863282 learned_addr learned my addr 172.21.15.78:0/1792863282 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd0941a640 1 --2- 172.21.15.78:0/1792863282 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263ce33b0 0x5572640f2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd09c1b640 1 --2- 172.21.15.78:0/1792863282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263d0c270 0x5572641086d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd08c19640 1 -- 172.21.15.78:0/1792863282 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263ce33b0 msgr2=0x5572640f2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd08c19640 1 --2- 172.21.15.78:0/1792863282 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263ce33b0 0x5572640f2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd08c19640 1 -- 172.21.15.78:0/1792863282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263d0c270 msgr2=0x5572641086d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd08c19640 1 --2- 172.21.15.78:0/1792863282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263d0c270 0x5572641086d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd08c19640 1 -- 172.21.15.78:0/1792863282 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572640f0560 con 0x557263ceb590 2024-09-17T03:09:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd0941a640 1 --2- 172.21.15.78:0/1792863282 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263ce33b0 0x5572640f2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:09:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd08c19640 1 --2- 172.21.15.78:0/1792863282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 0x5572640f2ad0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009780 tx=0x7fdcf4049c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853a7f537213603 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdce3fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:09:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdce3fff640 1 -- 172.21.15.78:0/1792863282 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4058070 con 0x557263ceb590 2024-09-17T03:09:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdce3fff640 1 -- 172.21.15.78:0/1792863282 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fdcf40039a0 con 0x557263ceb590 2024-09-17T03:09:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd125e9740 1 -- 172.21.15.78:0/1792863282 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcf4003c90 con 0x557263ceb590 2024-09-17T03:09:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdce3fff640 1 -- 172.21.15.78:0/1792863282 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fdcf4063050 con 0x557263ceb590 2024-09-17T03:09:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd125e9740 10 client.5223 fetch_fsmap learned FSMap version 18 2024-09-17T03:09:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.259+0000 7fdd125e9740 1 -- 172.21.15.78:0/1792863282 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x5572640efc20 con 0x557263ceb590 2024-09-17T03:09:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.260+0000 7fdce3fff640 1 -- 172.21.15.78:0/1792863282 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcf4003c90 con 0x557263ceb590 2024-09-17T03:09:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.260+0000 7fdce3fff640 1 -- 172.21.15.78:0/1792863282 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 18) ==== 3542+0+0 (secure 0 0 0) 0x7fdcf4066020 con 0x557263ceb590 2024-09-17T03:09:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.260+0000 7fdd125e9740 10 client.5223 fetch_fsmap finished waiting for FSMap version 18 2024-09-17T03:09:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.260+0000 7fdd125e9740 10 client.5223 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:09:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.260+0000 7fdd125e9740 20 client.5223 populate_metadata read hostname 'smithi078' 2024-09-17T03:09:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.260+0000 7fdd125e9740 1 --2- 172.21.15.78:0/1792863282 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x557264108d90 0x557264177a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.260+0000 7fdd125e9740 4 client.5223 mds_command: new command op to 4938 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:09:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.260+0000 7fdd125e9740 1 -- 172.21.15.78:0/1792863282 --> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] -- command(tid 0: {"prefix": "status"}) -- 0x557264024220 con 0x557264108d90 2024-09-17T03:09:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.260+0000 7fdd0941a640 1 --2- 172.21.15.78:0/1792863282 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x557264108d90 0x557264177a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.260+0000 7fdce3fff640 10 client.5223 ms_handle_connect on v2:172.21.15.78:6834/2663458793 2024-09-17T03:09:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.260+0000 7fdd0941a640 1 --2- 172.21.15.78:0/1792863282 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x557264108d90 0x557264177a20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6a3bd047511af84 server_cookie=6eeeda1a4aa85532 in_seq=0 out_seq=0 2024-09-17T03:09:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.261+0000 7fdce3fff640 1 -- 172.21.15.78:0/1792863282 <== mds.0 v2:172.21.15.78:6834/2663458793 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x557264024220 con 0x557264108d90 2024-09-17T03:09:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.261+0000 7fdce3fff640 10 client.5223 handle_command_reply: tid=0 2024-09-17T03:09:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.261+0000 7fdd125e9740 1 client.5223 shutdown 2024-09-17T03:09:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.261+0000 7fdd125e9740 1 -- 172.21.15.78:0/1792863282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 msgr2=0x5572640f2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.261+0000 7fdd125e9740 1 --2- 172.21.15.78:0/1792863282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 0x5572640f2ad0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009780 tx=0x7fdcf4049c00 comp rx=0 tx=0).stop 2024-09-17T03:09:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.261+0000 7fdd125e9740 1 -- 172.21.15.78:0/1792863282 shutdown_connections 2024-09-17T03:09:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.261+0000 7fdd125e9740 1 --2- 172.21.15.78:0/1792863282 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x557264108d90 0x557264177a20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.261+0000 7fdd125e9740 1 --2- 172.21.15.78:0/1792863282 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557263d0c270 0x5572641086d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.261+0000 7fdd125e9740 1 --2- 172.21.15.78:0/1792863282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557263ceb590 0x5572640f2ad0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.261+0000 7fdce3fff640 0 client.5223 ms_handle_reset on v2:172.21.15.78:6834/2663458793 2024-09-17T03:09:23.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.261+0000 7fdd125e9740 1 --2- 172.21.15.78:0/1792863282 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557263ce33b0 0x5572640f2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.261+0000 7fdd125e9740 1 -- 172.21.15.78:0/1792863282 >> 172.21.15.78:0/1792863282 conn(0x557263d003c0 msgr2=0x5572640ae910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:23.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.261+0000 7fdd125e9740 1 -- 172.21.15.78:0/1792863282 shutdown_connections 2024-09-17T03:09:23.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.261+0000 7fdd125e9740 1 -- 172.21.15.78:0/1792863282 wait complete. 2024-09-17T03:09:23.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.261+0000 7fdd125e9740 20 client.5223 trim_cache size 0 max 16384 2024-09-17T03:09:23.265 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:09:23.265 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:09:23.265 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-09-17T03:09:23.265 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4938, 2024-09-17T03:09:23.265 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:09:23.266 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:09:23.266 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:09:23.266 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 14.219882917, 2024-09-17T03:09:23.266 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 18, 2024-09-17T03:09:23.266 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 34, 2024-09-17T03:09:23.266 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 34, 2024-09-17T03:09:23.266 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 21.398323016999999 2024-09-17T03:09:23.266 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:09:23.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.262+0000 7fdd0b67e640 1 -- 172.21.15.78:0/742623518 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdce8078bc0 msgr2=0x7fdce807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.262+0000 7fdd0b67e640 1 --2- 172.21.15.78:0/742623518 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdce8078bc0 0x7fdce807b0d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4034000 tx=0x7fdcf4004730 comp rx=0 tx=0).stop 2024-09-17T03:09:23.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.262+0000 7fdd0b67e640 1 -- 172.21.15.78:0/742623518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd040b7cc0 msgr2=0x7fdd040c9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.262+0000 7fdd0b67e640 1 --2- 172.21.15.78:0/742623518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd040b7cc0 0x7fdd040c9380 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000c3f0 tx=0x7fdd0000c8b0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.262+0000 7fdd0b67e640 1 -- 172.21.15.78:0/742623518 shutdown_connections 2024-09-17T03:09:23.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.262+0000 7fdd0b67e640 1 --2- 172.21.15.78:0/742623518 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd041600b0 0x7fdd0406ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.262+0000 7fdd0b67e640 1 --2- 172.21.15.78:0/742623518 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdce8078bc0 0x7fdce807b0d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.262+0000 7fdd0b67e640 1 --2- 172.21.15.78:0/742623518 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd040cf320 0x7fdd041f9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.262+0000 7fdd0b67e640 1 --2- 172.21.15.78:0/742623518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd040b7cc0 0x7fdd040c9380 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.262+0000 7fdd0b67e640 1 -- 172.21.15.78:0/742623518 >> 172.21.15.78:0/742623518 conn(0x7fdd0406d4f0 msgr2=0x7fdd0415d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:23.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.262+0000 7fdd0b67e640 1 -- 172.21.15.78:0/742623518 shutdown_connections 2024-09-17T03:09:23.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.262+0000 7fdd0b67e640 1 -- 172.21.15.78:0/742623518 wait complete. 2024-09-17T03:09:23.271 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:09:23.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.385+0000 7fc2f0b19640 1 -- 172.21.15.78:0/1819001344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2ec0cfeb0 msgr2=0x7fc2ec0d02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.385+0000 7fc2f0b19640 1 --2- 172.21.15.78:0/1819001344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2ec0cfeb0 0x7fc2ec0d02c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec15f310 tx=0x7fc2e402a5f0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.385+0000 7fc2f0b19640 1 -- 172.21.15.78:0/1819001344 shutdown_connections 2024-09-17T03:09:23.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.385+0000 7fc2f0b19640 1 --2- 172.21.15.78:0/1819001344 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2ec0cfeb0 0x7fc2ec0d02c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.385+0000 7fc2f0b19640 1 --2- 172.21.15.78:0/1819001344 >> v2:172.21.15.193:3300/0 conn(0x7fc2ec0705d0 0x7fc2ec0b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.385+0000 7fc2f0b19640 1 -- 172.21.15.78:0/1819001344 >> 172.21.15.78:0/1819001344 conn(0x7fc2ec0cdcc0 msgr2=0x7fc2ec0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:23.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.385+0000 7fc2f0b19640 1 -- 172.21.15.78:0/1819001344 shutdown_connections 2024-09-17T03:09:23.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.385+0000 7fc2f0b19640 1 -- 172.21.15.78:0/1819001344 wait complete. 2024-09-17T03:09:23.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.387+0000 7fc2f0b19640 1 Processor -- start 2024-09-17T03:09:23.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.387+0000 7fc2f0b19640 1 -- start start 2024-09-17T03:09:23.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.388+0000 7fc2f0b19640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2ec0b4090 0x7fc2ec1f6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.388+0000 7fc2f0b19640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc2ec0cfeb0 0x7fc2ec149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.388+0000 7fc2f0b19640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2ec14a4d0 0x7fc2ec0adf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.388+0000 7fc2f0b19640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec0b4a30 con 0x7fc2ec14a4d0 2024-09-17T03:09:23.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.388+0000 7fc2f0b19640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec0b48b0 con 0x7fc2ec0b4090 2024-09-17T03:09:23.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.388+0000 7fc2f0b19640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc2ec0b4bb0 con 0x7fc2ec0cfeb0 2024-09-17T03:09:23.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.388+0000 7fc2ead9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2ec14a4d0 0x7fc2ec0adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.389+0000 7fc2ead9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2ec14a4d0 0x7fc2ec0adf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56274/0 (socket says 172.21.15.78:56274) 2024-09-17T03:09:23.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.389+0000 7fc2ead9d640 1 -- 172.21.15.78:0/2303576808 learned_addr learned my addr 172.21.15.78:0/2303576808 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:23.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.389+0000 7fc2ea59c640 1 --2- 172.21.15.78:0/2303576808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2ec0b4090 0x7fc2ec1f6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.389+0000 7fc2e9d9b640 1 --2- 172.21.15.78:0/2303576808 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc2ec0cfeb0 0x7fc2ec149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.389+0000 7fc2ead9d640 1 -- 172.21.15.78:0/2303576808 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc2ec0cfeb0 msgr2=0x7fc2ec149f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.389+0000 7fc2ead9d640 1 --2- 172.21.15.78:0/2303576808 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc2ec0cfeb0 0x7fc2ec149f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.389+0000 7fc2ead9d640 1 -- 172.21.15.78:0/2303576808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2ec0b4090 msgr2=0x7fc2ec1f6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.389+0000 7fc2ead9d640 1 --2- 172.21.15.78:0/2303576808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2ec0b4090 0x7fc2ec1f6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.389+0000 7fc2ead9d640 1 -- 172.21.15.78:0/2303576808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2ec1f68a0 con 0x7fc2ec14a4d0 2024-09-17T03:09:23.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.389+0000 7fc2ead9d640 1 --2- 172.21.15.78:0/2303576808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2ec14a4d0 0x7fc2ec0adf30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40099c0 tx=0x7fc2e4003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:23.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.389+0000 7fc2daffd640 1 -- 172.21.15.78:0/2303576808 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e403e030 con 0x7fc2ec14a4d0 2024-09-17T03:09:23.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.389+0000 7fc2daffd640 1 -- 172.21.15.78:0/2303576808 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2e4003e40 con 0x7fc2ec14a4d0 2024-09-17T03:09:23.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.389+0000 7fc2f0b19640 1 -- 172.21.15.78:0/2303576808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2ec1f9170 con 0x7fc2ec14a4d0 2024-09-17T03:09:23.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.389+0000 7fc2daffd640 1 -- 172.21.15.78:0/2303576808 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4035040 con 0x7fc2ec14a4d0 2024-09-17T03:09:23.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.389+0000 7fc2f0b19640 1 -- 172.21.15.78:0/2303576808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2ec1f9730 con 0x7fc2ec14a4d0 2024-09-17T03:09:23.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.390+0000 7fc2f0b19640 1 -- 172.21.15.78:0/2303576808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2ec1f8ed0 con 0x7fc2ec14a4d0 2024-09-17T03:09:23.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.391+0000 7fc2daffd640 1 -- 172.21.15.78:0/2303576808 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc2e4041030 con 0x7fc2ec14a4d0 2024-09-17T03:09:23.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.391+0000 7fc2daffd640 1 --2- 172.21.15.78:0/2303576808 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc2cc078b90 0x7fc2cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:23.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.392+0000 7fc2daffd640 1 -- 172.21.15.78:0/2303576808 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc2e40bb470 con 0x7fc2ec14a4d0 2024-09-17T03:09:23.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.392+0000 7fc2ea59c640 1 --2- 172.21.15.78:0/2303576808 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc2cc078b90 0x7fc2cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:23.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.392+0000 7fc2ea59c640 1 --2- 172.21.15.78:0/2303576808 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc2cc078b90 0x7fc2cc07b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc001e20 tx=0x7fc2dc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:23.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.396+0000 7fc2daffd640 1 -- 172.21.15.78:0/2303576808 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc2ec1f8ed0 con 0x7fc2ec14a4d0 2024-09-17T03:09:23.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.605+0000 7fc2f0b19640 1 -- 172.21.15.78:0/2303576808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2ec0b5060 con 0x7fc2ec14a4d0 2024-09-17T03:09:23.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.605+0000 7fc2daffd640 1 -- 172.21.15.78:0/2303576808 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5267 (secure 0 0 0) 0x7fc2ec1f68a0 con 0x7fc2ec14a4d0 2024-09-17T03:09:23.604 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:09:23.605 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":18,"btime":"2024-09-17T03:09:22:224108+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2234221933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2234221933},{"type":"v1","addr":"172.21.15.193:6836","nonce":2234221933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:09:08.411464+0000","modified":"2024-09-17T03:09:22.224101+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4938,"mds_1":4929,"mds_2":4661},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4661":{"gid":4661,"name":"d","rank":2,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6837/2343001441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2343001441},{"type":"v1","addr":"172.21.15.193:6837","nonce":2343001441}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4929":{"gid":4929,"name":"c","rank":1,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.78:6833/2730690660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2730690660},{"type":"v1","addr":"172.21.15.78:6833","nonce":2730690660}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/2663458793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2663458793},{"type":"v1","addr":"172.21.15.78:6835","nonce":2663458793}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4938,"qdb_cluster":[4661,4929,4938]},"id":2}]} 2024-09-17T03:09:23.605 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 18 2024-09-17T03:09:23.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.607+0000 7fc2f0b19640 1 -- 172.21.15.78:0/2303576808 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc2cc078b90 msgr2=0x7fc2cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.608+0000 7fc2f0b19640 1 --2- 172.21.15.78:0/2303576808 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc2cc078b90 0x7fc2cc07b0a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc001e20 tx=0x7fc2dc009040 comp rx=0 tx=0).stop 2024-09-17T03:09:23.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.608+0000 7fc2f0b19640 1 -- 172.21.15.78:0/2303576808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2ec14a4d0 msgr2=0x7fc2ec0adf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:23.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.608+0000 7fc2f0b19640 1 --2- 172.21.15.78:0/2303576808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2ec14a4d0 0x7fc2ec0adf30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40099c0 tx=0x7fc2e4003910 comp rx=0 tx=0).stop 2024-09-17T03:09:23.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.608+0000 7fc2f0b19640 1 -- 172.21.15.78:0/2303576808 shutdown_connections 2024-09-17T03:09:23.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.608+0000 7fc2f0b19640 1 --2- 172.21.15.78:0/2303576808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2ec14a4d0 0x7fc2ec0adf30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.608+0000 7fc2f0b19640 1 --2- 172.21.15.78:0/2303576808 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc2ec0cfeb0 0x7fc2ec149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.608+0000 7fc2f0b19640 1 --2- 172.21.15.78:0/2303576808 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc2cc078b90 0x7fc2cc07b0a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.608+0000 7fc2f0b19640 1 --2- 172.21.15.78:0/2303576808 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2ec0b4090 0x7fc2ec1f6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:23.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.608+0000 7fc2f0b19640 1 -- 172.21.15.78:0/2303576808 >> 172.21.15.78:0/2303576808 conn(0x7fc2ec0cdcc0 msgr2=0x7fc2ec0c77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:23.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.608+0000 7fc2f0b19640 1 -- 172.21.15.78:0/2303576808 shutdown_connections 2024-09-17T03:09:23.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:23.608+0000 7fc2f0b19640 1 -- 172.21.15.78:0/2303576808 wait complete. 2024-09-17T03:09:23.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:09:23.618 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-17T03:09:23.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:09:23.642 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-17T03:09:23.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:09:23.702 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2024-09-17T03:09:23.720 INFO:tasks.ceph.mds.a.smithi078.stderr:2024-09-17T03:09:23.721+0000 7f7e8d854640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-17T03:09:23.720 INFO:tasks.ceph.mds.a.smithi078.stderr:2024-09-17T03:09:23.721+0000 7f7e8d854640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-17T03:09:23.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:09:23.748 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2024-09-17T03:09:23.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:09:23.805 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2024-09-17T03:09:23.862 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:09:24.024 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:09:24.025 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:09:24.025 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:09:24.801 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:09:24.804 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:09:26.026 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:09:26.162 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:09:26.163 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:09:26.163 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:09:28.164 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:09:28.302 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:09:28.303 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:09:28.303 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:09:30.305 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:09:30.443 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:09:30.443 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:09:30.443 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:09:32.444 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:09:32.579 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:09:32.580 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:09:32.580 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:09:32.580 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:09:32.701 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-17T03:09:32.702 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:09:32.702 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:09:34.703 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:09:34.846 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-17T03:09:34.847 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:09:34.847 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:09:36.848 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:09:36.988 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-17T03:09:36.989 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:09:36.989 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:09:38.990 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:09:39.126 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-17T03:09:39.127 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:09:39.127 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:09:39.127 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-17T03:09:39.266 INFO:teuthology.orchestra.run.smithi193.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}}] 2024-09-17T03:09:39.267 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-17T03:09:39.267 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:09:39.267 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 flush journal 2024-09-17T03:09:39.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.385+0000 7f18b8719640 1 -- 172.21.15.78:0/1008745583 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f189c004800 msgr2=0x7f189c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.385+0000 7f18b8719640 1 --2- 172.21.15.78:0/1008745583 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f189c004800 0x7f189c004c50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f18b00cd1a0 tx=0x7f189c005830 comp rx=0 tx=0).stop 2024-09-17T03:09:39.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.385+0000 7f18b6cb6640 1 -- 172.21.15.78:0/1008745583 reap_dead start 2024-09-17T03:09:39.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.385+0000 7f18b8719640 1 -- 172.21.15.78:0/1008745583 shutdown_connections 2024-09-17T03:09:39.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.385+0000 7f18b8719640 1 -- 172.21.15.78:0/1008745583 >> 172.21.15.78:0/1008745583 conn(0x7f18b006def0 msgr2=0x7f18b006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:39.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.385+0000 7f18b8719640 1 -- 172.21.15.78:0/1008745583 shutdown_connections 2024-09-17T03:09:39.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.385+0000 7f18b8719640 1 -- 172.21.15.78:0/1008745583 wait complete. 2024-09-17T03:09:39.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.387+0000 7f18b8719640 1 Processor -- start 2024-09-17T03:09:39.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.387+0000 7f18b8719640 1 -- start start 2024-09-17T03:09:39.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.388+0000 7f18b8719640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f189c004800 0x7f18b00b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.388+0000 7f18b8719640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b014bec0 0x7f18b015a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.388+0000 7f18b8719640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18b015ab60 0x7f18b006cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.388+0000 7f18b8719640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f18b0164640 con 0x7f18b014bec0 2024-09-17T03:09:39.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.388+0000 7f18b8719640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f18b01644c0 con 0x7f18b015ab60 2024-09-17T03:09:39.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.388+0000 7f18b8719640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f18b01647c0 con 0x7f189c004800 2024-09-17T03:09:39.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.388+0000 7f18b5cb4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b014bec0 0x7f18b015a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.388+0000 7f18b5cb4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b014bec0 0x7f18b015a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53224/0 (socket says 172.21.15.78:53224) 2024-09-17T03:09:39.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.388+0000 7f18b5cb4640 1 -- 172.21.15.78:0/3649602106 learned_addr learned my addr 172.21.15.78:0/3649602106 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:39.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.389+0000 7f18b64b5640 1 --2- 172.21.15.78:0/3649602106 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f189c004800 0x7f18b00b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.389+0000 7f18b6cb6640 1 --2- 172.21.15.78:0/3649602106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18b015ab60 0x7f18b006cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.389+0000 7f18b5cb4640 1 -- 172.21.15.78:0/3649602106 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f189c004800 msgr2=0x7f18b00b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.389+0000 7f18b5cb4640 1 --2- 172.21.15.78:0/3649602106 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f189c004800 0x7f18b00b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.389+0000 7f18b5cb4640 1 -- 172.21.15.78:0/3649602106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18b015ab60 msgr2=0x7f18b006cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.389+0000 7f18b5cb4640 1 --2- 172.21.15.78:0/3649602106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18b015ab60 0x7f18b006cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.389+0000 7f18b5cb4640 1 -- 172.21.15.78:0/3649602106 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b015af70 con 0x7f18b014bec0 2024-09-17T03:09:39.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.389+0000 7f18b5cb4640 1 --2- 172.21.15.78:0/3649602106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b014bec0 0x7f18b015a620 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f18a000c260 tx=0x7f18a00017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:39.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.389+0000 7f18a6ffd640 1 -- 172.21.15.78:0/3649602106 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a0003a00 con 0x7f18b014bec0 2024-09-17T03:09:39.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.389+0000 7f18a6ffd640 1 -- 172.21.15.78:0/3649602106 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18a003f070 con 0x7f18b014bec0 2024-09-17T03:09:39.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.389+0000 7f18b8719640 1 -- 172.21.15.78:0/3649602106 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b00b1480 con 0x7f18b014bec0 2024-09-17T03:09:39.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.389+0000 7f18a6ffd640 1 -- 172.21.15.78:0/3649602106 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a0006b20 con 0x7f18b014bec0 2024-09-17T03:09:39.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.389+0000 7f18b8719640 1 -- 172.21.15.78:0/3649602106 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b00b1a40 con 0x7f18b014bec0 2024-09-17T03:09:39.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.391+0000 7f18a6ffd640 1 -- 172.21.15.78:0/3649602106 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f18a0044470 con 0x7f18b014bec0 2024-09-17T03:09:39.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.391+0000 7f18a6ffd640 1 --2- 172.21.15.78:0/3649602106 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1894078bc0 0x7f189407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.392+0000 7f18a6ffd640 1 -- 172.21.15.78:0/3649602106 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f18a00bc330 con 0x7f18b014bec0 2024-09-17T03:09:39.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.392+0000 7f18b64b5640 1 --2- 172.21.15.78:0/3649602106 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1894078bc0 0x7f189407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.392+0000 7f18b64b5640 1 --2- 172.21.15.78:0/3649602106 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1894078bc0 0x7f189407b0d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0064e0 tx=0x7f18ac006b10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:39.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.392+0000 7f18bf685740 1 Processor -- start 2024-09-17T03:09:39.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.392+0000 7f18bf685740 1 -- start start 2024-09-17T03:09:39.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.394+0000 7f18bf685740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a50440e390 0x55a5047faa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.394+0000 7f18bf685740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043e54d0 0x55a5047cf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.394+0000 7f18bf685740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5043ed6b0 0x55a5047cfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.394+0000 7f18bf685740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a504728a60 con 0x55a5043e54d0 2024-09-17T03:09:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.394+0000 7f18bf685740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a504717e90 con 0x55a5043ed6b0 2024-09-17T03:09:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.394+0000 7f18bf685740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a50471bca0 con 0x55a50440e390 2024-09-17T03:09:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.394+0000 7f18b5cb4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043e54d0 0x55a5047cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.394+0000 7f18b5cb4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043e54d0 0x55a5047cf860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53234/0 (socket says 172.21.15.78:53234) 2024-09-17T03:09:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.394+0000 7f18b5cb4640 1 -- 172.21.15.78:0/2481766891 learned_addr learned my addr 172.21.15.78:0/2481766891 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.394+0000 7f18b64b5640 1 --2- 172.21.15.78:0/2481766891 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a50440e390 0x55a5047faa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.394+0000 7f18b6cb6640 1 --2- 172.21.15.78:0/2481766891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5043ed6b0 0x55a5047cfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.394+0000 7f18b5cb4640 1 -- 172.21.15.78:0/2481766891 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a50440e390 msgr2=0x55a5047faa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.394+0000 7f18b5cb4640 1 --2- 172.21.15.78:0/2481766891 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a50440e390 0x55a5047faa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.394+0000 7f18b5cb4640 1 -- 172.21.15.78:0/2481766891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5043ed6b0 msgr2=0x55a5047cfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.394+0000 7f18b5cb4640 1 --2- 172.21.15.78:0/2481766891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5043ed6b0 0x55a5047cfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.394+0000 7f18b5cb4640 1 -- 172.21.15.78:0/2481766891 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5044f07d0 con 0x55a5043e54d0 2024-09-17T03:09:39.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.394+0000 7f18b5cb4640 1 --2- 172.21.15.78:0/2481766891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043e54d0 0x55a5047cf860 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f18a00ba7a0 tx=0x7f18a0083f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43bd5decfbceb997 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:39.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.394+0000 7f1893fff640 1 -- 172.21.15.78:0/2481766891 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a0083ca0 con 0x55a5043e54d0 2024-09-17T03:09:39.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.394+0000 7f1893fff640 1 -- 172.21.15.78:0/2481766891 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18a0034040 con 0x55a5043e54d0 2024-09-17T03:09:39.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.394+0000 7f1893fff640 1 -- 172.21.15.78:0/2481766891 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a0084890 con 0x55a5043e54d0 2024-09-17T03:09:39.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.395+0000 7f18bf685740 1 -- 172.21.15.78:0/2481766891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043e54d0 msgr2=0x55a5047cf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.395+0000 7f18bf685740 1 --2- 172.21.15.78:0/2481766891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043e54d0 0x55a5047cf860 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f18a00ba7a0 tx=0x7f18a0083f60 comp rx=0 tx=0).stop 2024-09-17T03:09:39.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.395+0000 7f18bf685740 1 -- 172.21.15.78:0/2481766891 shutdown_connections 2024-09-17T03:09:39.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.395+0000 7f18bf685740 1 --2- 172.21.15.78:0/2481766891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a5043ed6b0 0x55a5047cfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.395+0000 7f18bf685740 1 --2- 172.21.15.78:0/2481766891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043e54d0 0x55a5047cf860 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.395+0000 7f18bf685740 1 --2- 172.21.15.78:0/2481766891 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a50440e390 0x55a5047faa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.395+0000 7f18bf685740 1 -- 172.21.15.78:0/2481766891 >> 172.21.15.78:0/2481766891 conn(0x55a5044024e0 msgr2=0x55a5047b5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:39.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.395+0000 7f18bf685740 1 -- 172.21.15.78:0/2481766891 shutdown_connections 2024-09-17T03:09:39.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.395+0000 7f18bf685740 1 -- 172.21.15.78:0/2481766891 wait complete. 2024-09-17T03:09:39.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.396+0000 7f18bf685740 1 -- start start 2024-09-17T03:09:39.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.396+0000 7f18bf685740 1 Processor -- start 2024-09-17T03:09:39.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18bf685740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a5043e54d0 0x55a5047f7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18bf685740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043ed6b0 0x55a5047dddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18bf685740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50440e390 0x55a5047f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18bf685740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a504488740 con 0x55a5043ed6b0 2024-09-17T03:09:39.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18bf685740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a5046bd970 con 0x55a50440e390 2024-09-17T03:09:39.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18bf685740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a504717e90 con 0x55a5043e54d0 2024-09-17T03:09:39.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18bf685740 10 client.0 _ll_register_callbacks cb 0x55a5046cc780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:09:39.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18b5cb4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043ed6b0 0x55a5047dddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18b5cb4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043ed6b0 0x55a5047dddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53240/0 (socket says 172.21.15.78:53240) 2024-09-17T03:09:39.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18b5cb4640 1 -- 172.21.15.78:0/3813523509 learned_addr learned my addr 172.21.15.78:0/3813523509 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:39.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18b6cb6640 1 --2- 172.21.15.78:0/3813523509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50440e390 0x55a5047f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18b64b5640 1 --2- 172.21.15.78:0/3813523509 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a5043e54d0 0x55a5047f7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18b5cb4640 1 -- 172.21.15.78:0/3813523509 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a5043e54d0 msgr2=0x55a5047f7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18b5cb4640 1 --2- 172.21.15.78:0/3813523509 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a5043e54d0 0x55a5047f7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18b5cb4640 1 -- 172.21.15.78:0/3813523509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50440e390 msgr2=0x55a5047f4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18b5cb4640 1 --2- 172.21.15.78:0/3813523509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50440e390 0x55a5047f4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18b5cb4640 1 -- 172.21.15.78:0/3813523509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a504479970 con 0x55a5043ed6b0 2024-09-17T03:09:39.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18b5cb4640 1 --2- 172.21.15.78:0/3813523509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043ed6b0 0x55a5047dddf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f18a00ba8b0 tx=0x7f18a0083be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945df5e878017270 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:39.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18917fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:09:39.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18917fa640 1 -- 172.21.15.78:0/3813523509 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a0084890 con 0x55a5043ed6b0 2024-09-17T03:09:39.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18917fa640 1 -- 172.21.15.78:0/3813523509 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f18a0080400 con 0x55a5043ed6b0 2024-09-17T03:09:39.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18bf685740 1 -- 172.21.15.78:0/3813523509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18a0034040 con 0x55a5043ed6b0 2024-09-17T03:09:39.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18917fa640 1 -- 172.21.15.78:0/3813523509 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f18a0084190 con 0x55a5043ed6b0 2024-09-17T03:09:39.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18bf685740 10 client.5241 fetch_fsmap learned FSMap version 20 2024-09-17T03:09:39.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.398+0000 7f18bf685740 1 -- 172.21.15.78:0/3813523509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55a5044576a0 con 0x55a5043ed6b0 2024-09-17T03:09:39.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.399+0000 7f18917fa640 1 -- 172.21.15.78:0/3813523509 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18a0034040 con 0x55a5043ed6b0 2024-09-17T03:09:39.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.399+0000 7f18917fa640 1 -- 172.21.15.78:0/3813523509 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 3554+0+0 (secure 0 0 0) 0x7f18a004c070 con 0x55a5043ed6b0 2024-09-17T03:09:39.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.399+0000 7f18bf685740 10 client.5241 fetch_fsmap finished waiting for FSMap version 20 2024-09-17T03:09:39.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.399+0000 7f18bf685740 10 client.5241 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-17T03:09:39.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.399+0000 7f18bf685740 20 client.5241 populate_metadata read hostname 'smithi078' 2024-09-17T03:09:39.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.399+0000 7f18bf685740 1 --2- 172.21.15.78:0/3813523509 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x55a5043ccf60 0x55a5047f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.399+0000 7f18bf685740 4 client.5241 mds_command: new command op to 4938 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:09:39.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.399+0000 7f18bf685740 1 -- 172.21.15.78:0/3813523509 --> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a50472a9b0 con 0x55a5043ccf60 2024-09-17T03:09:39.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.399+0000 7f18b64b5640 1 --2- 172.21.15.78:0/3813523509 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x55a5043ccf60 0x55a5047f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.399+0000 7f18917fa640 10 client.5241 ms_handle_connect on v2:172.21.15.78:6834/2663458793 2024-09-17T03:09:39.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.399+0000 7f18b64b5640 1 --2- 172.21.15.78:0/3813523509 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x55a5043ccf60 0x55a5047f5e70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82ddbcb74bac83ad server_cookie=81dc780f5b2cb215 in_seq=0 out_seq=0 2024-09-17T03:09:39.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.400+0000 7f18917fa640 1 -- 172.21.15.78:0/3813523509 <== mds.0 v2:172.21.15.78:6834/2663458793 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a50472a9b0 con 0x55a5043ccf60 2024-09-17T03:09:39.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.400+0000 7f18917fa640 10 client.5241 handle_command_reply: tid=0 2024-09-17T03:09:39.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.400+0000 7f18bf685740 1 client.5241 shutdown 2024-09-17T03:09:39.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.400+0000 7f18bf685740 1 -- 172.21.15.78:0/3813523509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043ed6b0 msgr2=0x55a5047dddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.400+0000 7f18bf685740 1 --2- 172.21.15.78:0/3813523509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043ed6b0 0x55a5047dddf0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f18a00ba8b0 tx=0x7f18a0083be0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.400+0000 7f18bf685740 1 -- 172.21.15.78:0/3813523509 shutdown_connections 2024-09-17T03:09:39.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.400+0000 7f18bf685740 1 --2- 172.21.15.78:0/3813523509 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x55a5043ccf60 0x55a5047f5e70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.400+0000 7f18bf685740 1 --2- 172.21.15.78:0/3813523509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50440e390 0x55a5047f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.400+0000 7f18bf685740 1 --2- 172.21.15.78:0/3813523509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043ed6b0 0x55a5047dddf0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.400+0000 7f18917fa640 0 client.5241 ms_handle_reset on v2:172.21.15.78:6834/2663458793 2024-09-17T03:09:39.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.400+0000 7f18bf685740 1 --2- 172.21.15.78:0/3813523509 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a5043e54d0 0x55a5047f7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.400+0000 7f18bf685740 1 -- 172.21.15.78:0/3813523509 >> 172.21.15.78:0/3813523509 conn(0x55a5044024e0 msgr2=0x55a5047faa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:39.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.400+0000 7f18bf685740 1 -- 172.21.15.78:0/3813523509 shutdown_connections 2024-09-17T03:09:39.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.400+0000 7f18bf685740 1 -- 172.21.15.78:0/3813523509 wait complete. 2024-09-17T03:09:39.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.400+0000 7f18bf685740 20 client.5241 trim_cache size 0 max 16384 2024-09-17T03:09:39.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.415+0000 7f18bf685740 1 Processor -- start 2024-09-17T03:09:39.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.415+0000 7f18bf685740 1 -- start start 2024-09-17T03:09:39.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.416+0000 7f18bf685740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043e54d0 0x55a5047db680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.416+0000 7f18bf685740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a5043ed6b0 0x55a50481dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.416+0000 7f18bf685740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50440e390 0x55a504808c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.416+0000 7f18bf685740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f18b02023e0 con 0x55a5043e54d0 2024-09-17T03:09:39.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.416+0000 7f18bf685740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f18b02015b0 con 0x55a50440e390 2024-09-17T03:09:39.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.416+0000 7f18bf685740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f18b0201cb0 con 0x55a5043ed6b0 2024-09-17T03:09:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.416+0000 7f18b64b5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043e54d0 0x55a5047db680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.416+0000 7f18b64b5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043e54d0 0x55a5047db680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53254/0 (socket says 172.21.15.78:53254) 2024-09-17T03:09:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.416+0000 7f18b64b5640 1 -- 172.21.15.78:0/1441898089 learned_addr learned my addr 172.21.15.78:0/1441898089 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.417+0000 7f18b6cb6640 1 --2- 172.21.15.78:0/1441898089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50440e390 0x55a504808c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.417+0000 7f18b5cb4640 1 --2- 172.21.15.78:0/1441898089 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a5043ed6b0 0x55a50481dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.417+0000 7f18b64b5640 1 -- 172.21.15.78:0/1441898089 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a5043ed6b0 msgr2=0x55a50481dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.417+0000 7f18b64b5640 1 --2- 172.21.15.78:0/1441898089 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a5043ed6b0 0x55a50481dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.417+0000 7f18b64b5640 1 -- 172.21.15.78:0/1441898089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50440e390 msgr2=0x55a504808c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.417+0000 7f18b64b5640 1 --2- 172.21.15.78:0/1441898089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50440e390 0x55a504808c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.417+0000 7f18b64b5640 1 -- 172.21.15.78:0/1441898089 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5047fc2f0 con 0x55a5043e54d0 2024-09-17T03:09:39.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.417+0000 7f18b64b5640 1 --2- 172.21.15.78:0/1441898089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043e54d0 0x55a5047db680 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f18ac001cb0 tx=0x7f18ac00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bef8c60a81436f9d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.417+0000 7f18937fe640 1 -- 172.21.15.78:0/1441898089 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac012b40 con 0x55a5043e54d0 2024-09-17T03:09:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.417+0000 7f18937fe640 1 -- 172.21.15.78:0/1441898089 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18ac012ce0 con 0x55a5043e54d0 2024-09-17T03:09:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.417+0000 7f18937fe640 1 -- 172.21.15.78:0/1441898089 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac02b690 con 0x55a5043e54d0 2024-09-17T03:09:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.418+0000 7f18bf685740 1 -- 172.21.15.78:0/1441898089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043e54d0 msgr2=0x55a5047db680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.418+0000 7f18bf685740 1 --2- 172.21.15.78:0/1441898089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043e54d0 0x55a5047db680 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f18ac001cb0 tx=0x7f18ac00c000 comp rx=0 tx=0).stop 2024-09-17T03:09:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.418+0000 7f18bf685740 1 -- 172.21.15.78:0/1441898089 shutdown_connections 2024-09-17T03:09:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.418+0000 7f18bf685740 1 --2- 172.21.15.78:0/1441898089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50440e390 0x55a504808c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.418+0000 7f18bf685740 1 --2- 172.21.15.78:0/1441898089 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a5043ed6b0 0x55a50481dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.418+0000 7f18bf685740 1 --2- 172.21.15.78:0/1441898089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043e54d0 0x55a5047db680 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.418+0000 7f18bf685740 1 -- 172.21.15.78:0/1441898089 >> 172.21.15.78:0/1441898089 conn(0x55a5044024e0 msgr2=0x55a5047dbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:39.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.418+0000 7f18bf685740 1 -- 172.21.15.78:0/1441898089 shutdown_connections 2024-09-17T03:09:39.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.418+0000 7f18bf685740 1 -- 172.21.15.78:0/1441898089 wait complete. 2024-09-17T03:09:39.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.419+0000 7f18bf685740 1 -- start start 2024-09-17T03:09:39.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.419+0000 7f18bf685740 1 Processor -- start 2024-09-17T03:09:39.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.420+0000 7f18bf685740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a5043e54d0 0x55a50487d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.420+0000 7f18bf685740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043ed6b0 0x55a5047fa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.420+0000 7f18bf685740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50440e390 0x55a5047faa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.420+0000 7f18bf685740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a504728a60 con 0x55a5043ed6b0 2024-09-17T03:09:39.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.420+0000 7f18bf685740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f18b0200650 con 0x55a50440e390 2024-09-17T03:09:39.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.420+0000 7f18bf685740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a50480a370 con 0x55a5043e54d0 2024-09-17T03:09:39.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.420+0000 7f18bf685740 10 client.0 _ll_register_callbacks cb 0x7f18a00a9070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:09:39.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.420+0000 7f18b5cb4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043ed6b0 0x55a5047fa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.420+0000 7f18b5cb4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043ed6b0 0x55a5047fa4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53262/0 (socket says 172.21.15.78:53262) 2024-09-17T03:09:39.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.420+0000 7f18b5cb4640 1 -- 172.21.15.78:0/3816176044 learned_addr learned my addr 172.21.15.78:0/3816176044 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:39.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.420+0000 7f18b64b5640 1 --2- 172.21.15.78:0/3816176044 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a5043e54d0 0x55a50487d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.420+0000 7f18b6cb6640 1 --2- 172.21.15.78:0/3816176044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50440e390 0x55a5047faa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18b5cb4640 1 -- 172.21.15.78:0/3816176044 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a5043e54d0 msgr2=0x55a50487d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18b5cb4640 1 --2- 172.21.15.78:0/3816176044 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a5043e54d0 0x55a50487d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18b5cb4640 1 -- 172.21.15.78:0/3816176044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50440e390 msgr2=0x55a5047faa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18b5cb4640 1 --2- 172.21.15.78:0/3816176044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50440e390 0x55a5047faa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18b5cb4640 1 -- 172.21.15.78:0/3816176044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a504879370 con 0x55a5043ed6b0 2024-09-17T03:09:39.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18b5cb4640 1 --2- 172.21.15.78:0/3816176044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043ed6b0 0x55a5047fa4e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f18a0084350 tx=0x7f18a008d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d7982851301f24 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:39.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18917fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:09:39.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18917fa640 1 -- 172.21.15.78:0/3816176044 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a0084890 con 0x55a5043ed6b0 2024-09-17T03:09:39.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18917fa640 1 -- 172.21.15.78:0/3816176044 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f18a0080400 con 0x55a5043ed6b0 2024-09-17T03:09:39.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18bf685740 1 -- 172.21.15.78:0/3816176044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18ac012ce0 con 0x55a5043ed6b0 2024-09-17T03:09:39.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18917fa640 1 -- 172.21.15.78:0/3816176044 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f18a00af050 con 0x55a5043ed6b0 2024-09-17T03:09:39.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18bf685740 10 client.5247 fetch_fsmap learned FSMap version 20 2024-09-17T03:09:39.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18bf685740 1 -- 172.21.15.78:0/3816176044 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55a504879370 con 0x55a5043ed6b0 2024-09-17T03:09:39.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18917fa640 1 -- 172.21.15.78:0/3816176044 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18ac012ce0 con 0x55a5043ed6b0 2024-09-17T03:09:39.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18917fa640 1 -- 172.21.15.78:0/3816176044 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 3554+0+0 (secure 0 0 0) 0x7f18a004c040 con 0x55a5043ed6b0 2024-09-17T03:09:39.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18bf685740 10 client.5247 fetch_fsmap finished waiting for FSMap version 20 2024-09-17T03:09:39.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18bf685740 10 client.5247 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-17T03:09:39.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18bf685740 20 client.5247 populate_metadata read hostname 'smithi078' 2024-09-17T03:09:39.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18bf685740 1 --2- 172.21.15.78:0/3816176044 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x55a5047f0330 0x55a5047f0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18bf685740 4 client.5247 mds_command: new command op to 4938 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T03:09:39.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18bf685740 1 -- 172.21.15.78:0/3816176044 --> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a504726460 con 0x55a5047f0330 2024-09-17T03:09:39.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.421+0000 7f18b64b5640 1 --2- 172.21.15.78:0/3816176044 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x55a5047f0330 0x55a5047f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.422+0000 7f18917fa640 10 client.5247 ms_handle_connect on v2:172.21.15.78:6834/2663458793 2024-09-17T03:09:39.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.422+0000 7f18b64b5640 1 --2- 172.21.15.78:0/3816176044 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x55a5047f0330 0x55a5047f0740 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=856861ebfa4a669b server_cookie=1be7684c7b43a9e3 in_seq=0 out_seq=0 2024-09-17T03:09:39.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.434+0000 7f18917fa640 1 -- 172.21.15.78:0/3816176044 <== mds.0 v2:172.21.15.78:6834/2663458793 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a504726460 con 0x55a5047f0330 2024-09-17T03:09:39.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.434+0000 7f18917fa640 10 client.5247 handle_command_reply: tid=0 2024-09-17T03:09:39.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.434+0000 7f18bf685740 1 client.5247 shutdown 2024-09-17T03:09:39.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.434+0000 7f18bf685740 1 -- 172.21.15.78:0/3816176044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043ed6b0 msgr2=0x55a5047fa4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.434+0000 7f18bf685740 1 --2- 172.21.15.78:0/3816176044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043ed6b0 0x55a5047fa4e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f18a0084350 tx=0x7f18a008d8c0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.434+0000 7f18bf685740 1 -- 172.21.15.78:0/3816176044 shutdown_connections 2024-09-17T03:09:39.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.434+0000 7f18bf685740 1 --2- 172.21.15.78:0/3816176044 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x55a5047f0330 0x55a5047f0740 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.434+0000 7f18bf685740 1 --2- 172.21.15.78:0/3816176044 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a50440e390 0x55a5047faa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.434+0000 7f18917fa640 0 client.5247 ms_handle_reset on v2:172.21.15.78:6834/2663458793 2024-09-17T03:09:39.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.434+0000 7f18bf685740 1 --2- 172.21.15.78:0/3816176044 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a5043ed6b0 0x55a5047fa4e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.434+0000 7f18bf685740 1 --2- 172.21.15.78:0/3816176044 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a5043e54d0 0x55a50487d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.434+0000 7f18bf685740 1 -- 172.21.15.78:0/3816176044 >> 172.21.15.78:0/3816176044 conn(0x55a5044024e0 msgr2=0x55a5047dbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:39.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.434+0000 7f18bf685740 1 -- 172.21.15.78:0/3816176044 shutdown_connections 2024-09-17T03:09:39.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.434+0000 7f18bf685740 1 -- 172.21.15.78:0/3816176044 wait complete. 2024-09-17T03:09:39.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.435+0000 7f18bf685740 20 client.5247 trim_cache size 0 max 16384 2024-09-17T03:09:39.436 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:09:39.437 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:09:39.437 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:09:39.437 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:09:39.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.435+0000 7f18b8719640 1 -- 172.21.15.78:0/3649602106 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1894078bc0 msgr2=0x7f189407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.435+0000 7f18b8719640 1 --2- 172.21.15.78:0/3649602106 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1894078bc0 0x7f189407b0d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f18ac0064e0 tx=0x7f18ac006b10 comp rx=0 tx=0).stop 2024-09-17T03:09:39.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.435+0000 7f18b8719640 1 -- 172.21.15.78:0/3649602106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b014bec0 msgr2=0x7f18b015a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.435+0000 7f18b8719640 1 --2- 172.21.15.78:0/3649602106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b014bec0 0x7f18b015a620 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f18a000c260 tx=0x7f18a00017a0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.435+0000 7f18b8719640 1 -- 172.21.15.78:0/3649602106 shutdown_connections 2024-09-17T03:09:39.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.435+0000 7f18b8719640 1 --2- 172.21.15.78:0/3649602106 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1894078bc0 0x7f189407b0d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.435+0000 7f18b8719640 1 --2- 172.21.15.78:0/3649602106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18b015ab60 0x7f18b006cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.435+0000 7f18b8719640 1 --2- 172.21.15.78:0/3649602106 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18b014bec0 0x7f18b015a620 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.435+0000 7f18b8719640 1 --2- 172.21.15.78:0/3649602106 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f189c004800 0x7f18b00b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.435+0000 7f18b8719640 1 -- 172.21.15.78:0/3649602106 >> 172.21.15.78:0/3649602106 conn(0x7f18b006def0 msgr2=0x7f18b015e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:39.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.435+0000 7f18b8719640 1 -- 172.21.15.78:0/3649602106 shutdown_connections 2024-09-17T03:09:39.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.435+0000 7f18b8719640 1 -- 172.21.15.78:0/3649602106 wait complete. 2024-09-17T03:09:39.445 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:1 flush journal 2024-09-17T03:09:39.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.561+0000 7f34d6152640 1 -- 172.21.15.78:0/241939027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d00cf320 msgr2=0x7f34d00ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.561+0000 7f34d6152640 1 --2- 172.21.15.78:0/241939027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d00cf320 0x7f34d00ccbc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f34c4005fd0 tx=0x7f34c402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.561+0000 7f34d6152640 1 -- 172.21.15.78:0/241939027 shutdown_connections 2024-09-17T03:09:39.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.561+0000 7f34d6152640 1 --2- 172.21.15.78:0/241939027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d00cf320 0x7f34d00ccbc0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.561+0000 7f34d6152640 1 --2- 172.21.15.78:0/241939027 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f34d00b7cc0 0x7f34d00d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.561+0000 7f34d6152640 1 -- 172.21.15.78:0/241939027 >> 172.21.15.78:0/241939027 conn(0x7f34d006d4f0 msgr2=0x7f34d0071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:39.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.561+0000 7f34d6152640 1 -- 172.21.15.78:0/241939027 shutdown_connections 2024-09-17T03:09:39.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.561+0000 7f34d6152640 1 -- 172.21.15.78:0/241939027 wait complete. 2024-09-17T03:09:39.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.562+0000 7f34d6152640 1 Processor -- start 2024-09-17T03:09:39.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.563+0000 7f34d6152640 1 -- start start 2024-09-17T03:09:39.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.564+0000 7f34d6152640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f34d00b7cc0 0x7f34d00b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.564+0000 7f34d6152640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d00cf320 0x7f34d01441b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.564+0000 7f34d6152640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34d01600b0 0x7f34d01469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.564+0000 7f34d6152640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f34d00d1410 con 0x7f34d00cf320 2024-09-17T03:09:39.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.564+0000 7f34d6152640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f34d00d1290 con 0x7f34d01600b0 2024-09-17T03:09:39.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.564+0000 7f34d6152640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f34d00d1590 con 0x7f34d00b7cc0 2024-09-17T03:09:39.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.564+0000 7f34ceffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d00cf320 0x7f34d01441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.564+0000 7f34ceffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d00cf320 0x7f34d01441b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53278/0 (socket says 172.21.15.78:53278) 2024-09-17T03:09:39.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.564+0000 7f34ceffd640 1 -- 172.21.15.78:0/3537850354 learned_addr learned my addr 172.21.15.78:0/3537850354 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:39.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.564+0000 7f34cf7fe640 1 --2- 172.21.15.78:0/3537850354 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f34d00b7cc0 0x7f34d00b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.564+0000 7f34cffff640 1 --2- 172.21.15.78:0/3537850354 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34d01600b0 0x7f34d01469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.564+0000 7f34ceffd640 1 -- 172.21.15.78:0/3537850354 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f34d00b7cc0 msgr2=0x7f34d00b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.564+0000 7f34ceffd640 1 --2- 172.21.15.78:0/3537850354 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f34d00b7cc0 0x7f34d00b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.564+0000 7f34ceffd640 1 -- 172.21.15.78:0/3537850354 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34d01600b0 msgr2=0x7f34d01469a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.564+0000 7f34ceffd640 1 --2- 172.21.15.78:0/3537850354 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34d01600b0 0x7f34d01469a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.564+0000 7f34ceffd640 1 -- 172.21.15.78:0/3537850354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d00b2f90 con 0x7f34d00cf320 2024-09-17T03:09:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.564+0000 7f34cffff640 1 --2- 172.21.15.78:0/3537850354 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34d01600b0 0x7f34d01469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.564+0000 7f34ceffd640 1 --2- 172.21.15.78:0/3537850354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d00cf320 0x7f34d01441b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f34c4034040 tx=0x7f34c40035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.565+0000 7f34b7fff640 1 -- 172.21.15.78:0/3537850354 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c403e030 con 0x7f34d00cf320 2024-09-17T03:09:39.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.565+0000 7f34b7fff640 1 -- 172.21.15.78:0/3537850354 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34c4003ae0 con 0x7f34d00cf320 2024-09-17T03:09:39.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.565+0000 7f34d6152640 1 -- 172.21.15.78:0/3537850354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d00b3270 con 0x7f34d00cf320 2024-09-17T03:09:39.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.565+0000 7f34b7fff640 1 -- 172.21.15.78:0/3537850354 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4035040 con 0x7f34d00cf320 2024-09-17T03:09:39.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.565+0000 7f34d6152640 1 -- 172.21.15.78:0/3537850354 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d00ca6e0 con 0x7f34d00cf320 2024-09-17T03:09:39.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.567+0000 7f34b7fff640 1 -- 172.21.15.78:0/3537850354 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f34c4041030 con 0x7f34d00cf320 2024-09-17T03:09:39.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.567+0000 7f34b7fff640 1 --2- 172.21.15.78:0/3537850354 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f34bc078bc0 0x7f34bc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.567+0000 7f34b7fff640 1 -- 172.21.15.78:0/3537850354 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f34c40bb540 con 0x7f34d00cf320 2024-09-17T03:09:39.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.567+0000 7f34cf7fe640 1 --2- 172.21.15.78:0/3537850354 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f34bc078bc0 0x7f34bc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.568+0000 7f34cf7fe640 1 --2- 172.21.15.78:0/3537850354 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f34bc078bc0 0x7f34bc07b0d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f34c0000f60 tx=0x7f34c0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.568+0000 7f34dd0b7740 1 Processor -- start 2024-09-17T03:09:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.568+0000 7f34dd0b7740 1 -- start start 2024-09-17T03:09:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.569+0000 7f34dd0b7740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ba5ce390 0x5603ba9baa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.569+0000 7f34dd0b7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5a54d0 0x5603ba98f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.569+0000 7f34dd0b7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5ad6b0 0x5603ba98fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.569+0000 7f34dd0b7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5603ba8e8a60 con 0x5603ba5ad6b0 2024-09-17T03:09:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.569+0000 7f34dd0b7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5603ba8d7e90 con 0x5603ba5a54d0 2024-09-17T03:09:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.569+0000 7f34dd0b7740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5603ba8dbca0 con 0x5603ba5ce390 2024-09-17T03:09:39.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.569+0000 7f34cffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5ad6b0 0x5603ba98fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.569+0000 7f34cffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5ad6b0 0x5603ba98fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53294/0 (socket says 172.21.15.78:53294) 2024-09-17T03:09:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.569+0000 7f34cffff640 1 -- 172.21.15.78:0/2370356851 learned_addr learned my addr 172.21.15.78:0/2370356851 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.569+0000 7f34cf7fe640 1 --2- 172.21.15.78:0/2370356851 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ba5ce390 0x5603ba9baa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.569+0000 7f34ceffd640 1 --2- 172.21.15.78:0/2370356851 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5a54d0 0x5603ba98f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.570+0000 7f34cffff640 1 -- 172.21.15.78:0/2370356851 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ba5ce390 msgr2=0x5603ba9baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.570+0000 7f34cffff640 1 --2- 172.21.15.78:0/2370356851 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ba5ce390 0x5603ba9baa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.570+0000 7f34cffff640 1 -- 172.21.15.78:0/2370356851 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5a54d0 msgr2=0x5603ba98f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.570+0000 7f34cffff640 1 --2- 172.21.15.78:0/2370356851 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5a54d0 0x5603ba98f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.570+0000 7f34cffff640 1 -- 172.21.15.78:0/2370356851 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603ba6b07d0 con 0x5603ba5ad6b0 2024-09-17T03:09:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.570+0000 7f34ceffd640 1 --2- 172.21.15.78:0/2370356851 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5a54d0 0x5603ba98f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:09:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.570+0000 7f34cffff640 1 --2- 172.21.15.78:0/2370356851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5ad6b0 0x5603ba98fda0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009fc0 tx=0x7f34c8010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3de9dc18916f7d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.570+0000 7f34b57fa640 1 -- 172.21.15.78:0/2370356851 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8011700 con 0x5603ba5ad6b0 2024-09-17T03:09:39.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.570+0000 7f34b57fa640 1 -- 172.21.15.78:0/2370356851 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34c8011990 con 0x5603ba5ad6b0 2024-09-17T03:09:39.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.570+0000 7f34b57fa640 1 -- 172.21.15.78:0/2370356851 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8011de0 con 0x5603ba5ad6b0 2024-09-17T03:09:39.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.571+0000 7f34dd0b7740 1 -- 172.21.15.78:0/2370356851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5ad6b0 msgr2=0x5603ba98fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.571+0000 7f34dd0b7740 1 --2- 172.21.15.78:0/2370356851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5ad6b0 0x5603ba98fda0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009fc0 tx=0x7f34c8010860 comp rx=0 tx=0).stop 2024-09-17T03:09:39.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.571+0000 7f34dd0b7740 1 -- 172.21.15.78:0/2370356851 shutdown_connections 2024-09-17T03:09:39.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.571+0000 7f34dd0b7740 1 --2- 172.21.15.78:0/2370356851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5ad6b0 0x5603ba98fda0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.571+0000 7f34dd0b7740 1 --2- 172.21.15.78:0/2370356851 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5a54d0 0x5603ba98f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.571+0000 7f34dd0b7740 1 --2- 172.21.15.78:0/2370356851 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ba5ce390 0x5603ba9baa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.571+0000 7f34dd0b7740 1 -- 172.21.15.78:0/2370356851 >> 172.21.15.78:0/2370356851 conn(0x5603ba5c24e0 msgr2=0x5603ba975d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:39.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.571+0000 7f34dd0b7740 1 -- 172.21.15.78:0/2370356851 shutdown_connections 2024-09-17T03:09:39.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.571+0000 7f34dd0b7740 1 -- 172.21.15.78:0/2370356851 wait complete. 2024-09-17T03:09:39.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.572+0000 7f34dd0b7740 1 -- start start 2024-09-17T03:09:39.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.572+0000 7f34dd0b7740 1 Processor -- start 2024-09-17T03:09:39.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.573+0000 7f34dd0b7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5a54d0 0x5603ba9c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.573+0000 7f34dd0b7740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ba5ad6b0 0x5603ba9c6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.573+0000 7f34dd0b7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5ce390 0x5603ba9b6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.573+0000 7f34dd0b7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5603ba648740 con 0x5603ba5ce390 2024-09-17T03:09:39.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.573+0000 7f34dd0b7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5603ba87d970 con 0x5603ba5a54d0 2024-09-17T03:09:39.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.573+0000 7f34dd0b7740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5603ba9cb4b0 con 0x5603ba5ad6b0 2024-09-17T03:09:39.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.573+0000 7f34dd0b7740 10 client.0 _ll_register_callbacks cb 0x5603ba88c780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:09:39.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.573+0000 7f34cffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5ce390 0x5603ba9b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.573+0000 7f34cffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5ce390 0x5603ba9b6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53296/0 (socket says 172.21.15.78:53296) 2024-09-17T03:09:39.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.573+0000 7f34cffff640 1 -- 172.21.15.78:0/3400384526 learned_addr learned my addr 172.21.15.78:0/3400384526 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:39.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.573+0000 7f34cf7fe640 1 --2- 172.21.15.78:0/3400384526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5a54d0 0x5603ba9c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.573+0000 7f34ceffd640 1 --2- 172.21.15.78:0/3400384526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ba5ad6b0 0x5603ba9c6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34cffff640 1 -- 172.21.15.78:0/3400384526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ba5ad6b0 msgr2=0x5603ba9c6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34cffff640 1 --2- 172.21.15.78:0/3400384526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ba5ad6b0 0x5603ba9c6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34cffff640 1 -- 172.21.15.78:0/3400384526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5a54d0 msgr2=0x5603ba9c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34cffff640 1 --2- 172.21.15.78:0/3400384526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5a54d0 0x5603ba9c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34cffff640 1 -- 172.21.15.78:0/3400384526 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603ba639970 con 0x5603ba5ce390 2024-09-17T03:09:39.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34cffff640 1 --2- 172.21.15.78:0/3400384526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5ce390 0x5603ba9b6530 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f34c8011010 tx=0x7f34c8009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51305af9392b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:39.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34ae7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:09:39.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34ae7fc640 1 -- 172.21.15.78:0/3400384526 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c8004d20 con 0x5603ba5ce390 2024-09-17T03:09:39.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3400384526 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34c8011990 con 0x5603ba5ce390 2024-09-17T03:09:39.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34ae7fc640 1 -- 172.21.15.78:0/3400384526 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f34c8005020 con 0x5603ba5ce390 2024-09-17T03:09:39.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34ae7fc640 1 -- 172.21.15.78:0/3400384526 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f34c802f050 con 0x5603ba5ce390 2024-09-17T03:09:39.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34dd0b7740 10 client.5262 fetch_fsmap learned FSMap version 20 2024-09-17T03:09:39.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3400384526 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5603ba6176a0 con 0x5603ba5ce390 2024-09-17T03:09:39.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34ae7fc640 1 -- 172.21.15.78:0/3400384526 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34c8011990 con 0x5603ba5ce390 2024-09-17T03:09:39.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34ae7fc640 1 -- 172.21.15.78:0/3400384526 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 3554+0+0 (secure 0 0 0) 0x7f34c8032020 con 0x5603ba5ce390 2024-09-17T03:09:39.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34dd0b7740 10 client.5262 fetch_fsmap finished waiting for FSMap version 20 2024-09-17T03:09:39.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34dd0b7740 10 client.5262 resolve_mds: resolved 2:1 to role '2:1' aka daemon mds.c 2024-09-17T03:09:39.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34dd0b7740 20 client.5262 populate_metadata read hostname 'smithi078' 2024-09-17T03:09:39.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34dd0b7740 1 --2- 172.21.15.78:0/3400384526 >> [v2:172.21.15.78:6832/2730690660,v1:172.21.15.78:6833/2730690660] conn(0x5603ba58cf60 0x5603ba9cad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34dd0b7740 4 client.5262 mds_command: new command op to 4929 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:09:39.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.574+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3400384526 --> [v2:172.21.15.78:6832/2730690660,v1:172.21.15.78:6833/2730690660] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603ba8ea9b0 con 0x5603ba58cf60 2024-09-17T03:09:39.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.575+0000 7f34cf7fe640 1 --2- 172.21.15.78:0/3400384526 >> [v2:172.21.15.78:6832/2730690660,v1:172.21.15.78:6833/2730690660] conn(0x5603ba58cf60 0x5603ba9cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.575+0000 7f34ae7fc640 10 client.5262 ms_handle_connect on v2:172.21.15.78:6832/2730690660 2024-09-17T03:09:39.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.575+0000 7f34cf7fe640 1 --2- 172.21.15.78:0/3400384526 >> [v2:172.21.15.78:6832/2730690660,v1:172.21.15.78:6833/2730690660] conn(0x5603ba58cf60 0x5603ba9cad40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=822ec4550ffe90a6 server_cookie=6b74c76051c97837 in_seq=0 out_seq=0 2024-09-17T03:09:39.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.576+0000 7f34ae7fc640 1 -- 172.21.15.78:0/3400384526 <== mds.1 v2:172.21.15.78:6832/2730690660 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5603ba8ea9b0 con 0x5603ba58cf60 2024-09-17T03:09:39.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.576+0000 7f34ae7fc640 10 client.5262 handle_command_reply: tid=0 2024-09-17T03:09:39.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.576+0000 7f34dd0b7740 1 client.5262 shutdown 2024-09-17T03:09:39.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.576+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3400384526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5ce390 msgr2=0x5603ba9b6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.576+0000 7f34dd0b7740 1 --2- 172.21.15.78:0/3400384526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5ce390 0x5603ba9b6530 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f34c8011010 tx=0x7f34c8009280 comp rx=0 tx=0).stop 2024-09-17T03:09:39.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.576+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3400384526 shutdown_connections 2024-09-17T03:09:39.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.576+0000 7f34dd0b7740 1 --2- 172.21.15.78:0/3400384526 >> [v2:172.21.15.78:6832/2730690660,v1:172.21.15.78:6833/2730690660] conn(0x5603ba58cf60 0x5603ba9cad40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.576+0000 7f34dd0b7740 1 --2- 172.21.15.78:0/3400384526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5ce390 0x5603ba9b6530 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.576+0000 7f34dd0b7740 1 --2- 172.21.15.78:0/3400384526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ba5ad6b0 0x5603ba9c6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.576+0000 7f34dd0b7740 1 --2- 172.21.15.78:0/3400384526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5a54d0 0x5603ba9c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.576+0000 7f34ae7fc640 0 client.5262 ms_handle_reset on v2:172.21.15.78:6832/2730690660 2024-09-17T03:09:39.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.576+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3400384526 >> 172.21.15.78:0/3400384526 conn(0x5603ba5c24e0 msgr2=0x5603ba99ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:39.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.576+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3400384526 shutdown_connections 2024-09-17T03:09:39.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.576+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3400384526 wait complete. 2024-09-17T03:09:39.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.576+0000 7f34dd0b7740 20 client.5262 trim_cache size 0 max 16384 2024-09-17T03:09:39.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.591+0000 7f34dd0b7740 1 Processor -- start 2024-09-17T03:09:39.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.591+0000 7f34dd0b7740 1 -- start start 2024-09-17T03:09:39.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.592+0000 7f34dd0b7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5a54d0 0x5603ba9d3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.592+0000 7f34dd0b7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5ad6b0 0x5603ba9d3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.592+0000 7f34dd0b7740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ba5ce390 0x5603ba9b83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.592+0000 7f34dd0b7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5603ba975e50 con 0x5603ba5a54d0 2024-09-17T03:09:39.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.592+0000 7f34dd0b7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f34d01ffe60 con 0x5603ba5ad6b0 2024-09-17T03:09:39.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.592+0000 7f34dd0b7740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f34d00b2c80 con 0x5603ba5ce390 2024-09-17T03:09:39.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.592+0000 7f34cf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5a54d0 0x5603ba9d3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.592+0000 7f34cf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5a54d0 0x5603ba9d3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53300/0 (socket says 172.21.15.78:53300) 2024-09-17T03:09:39.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.592+0000 7f34cf7fe640 1 -- 172.21.15.78:0/3130616256 learned_addr learned my addr 172.21.15.78:0/3130616256 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:39.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.592+0000 7f34ceffd640 1 --2- 172.21.15.78:0/3130616256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5ad6b0 0x5603ba9d3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.592+0000 7f34cffff640 1 --2- 172.21.15.78:0/3130616256 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ba5ce390 0x5603ba9b83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.592+0000 7f34cf7fe640 1 -- 172.21.15.78:0/3130616256 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ba5ce390 msgr2=0x5603ba9b83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.592+0000 7f34cf7fe640 1 --2- 172.21.15.78:0/3130616256 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ba5ce390 0x5603ba9b83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.592+0000 7f34cf7fe640 1 -- 172.21.15.78:0/3130616256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5ad6b0 msgr2=0x5603ba9d3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.592+0000 7f34cf7fe640 1 --2- 172.21.15.78:0/3130616256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5ad6b0 0x5603ba9d3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.592+0000 7f34cf7fe640 1 -- 172.21.15.78:0/3130616256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603ba972860 con 0x5603ba5a54d0 2024-09-17T03:09:39.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.592+0000 7f34ceffd640 1 --2- 172.21.15.78:0/3130616256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5ad6b0 0x5603ba9d3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:39.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.593+0000 7f34cf7fe640 1 --2- 172.21.15.78:0/3130616256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5a54d0 0x5603ba9d3870 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f34c000fce0 tx=0x7f34c0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec50f5c4bd2e5cd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:39.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.593+0000 7f34b4ff9640 1 -- 172.21.15.78:0/3130616256 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c000fdd0 con 0x5603ba5a54d0 2024-09-17T03:09:39.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.593+0000 7f34b4ff9640 1 -- 172.21.15.78:0/3130616256 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34c001b040 con 0x5603ba5a54d0 2024-09-17T03:09:39.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.593+0000 7f34b4ff9640 1 -- 172.21.15.78:0/3130616256 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c0023450 con 0x5603ba5a54d0 2024-09-17T03:09:39.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.594+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3130616256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5a54d0 msgr2=0x5603ba9d3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.594+0000 7f34dd0b7740 1 --2- 172.21.15.78:0/3130616256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5a54d0 0x5603ba9d3870 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f34c000fce0 tx=0x7f34c0012000 comp rx=0 tx=0).stop 2024-09-17T03:09:39.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.594+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3130616256 shutdown_connections 2024-09-17T03:09:39.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.594+0000 7f34dd0b7740 1 --2- 172.21.15.78:0/3130616256 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ba5ce390 0x5603ba9b83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.594+0000 7f34dd0b7740 1 --2- 172.21.15.78:0/3130616256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5ad6b0 0x5603ba9d3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.594+0000 7f34dd0b7740 1 --2- 172.21.15.78:0/3130616256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5a54d0 0x5603ba9d3870 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.594+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3130616256 >> 172.21.15.78:0/3130616256 conn(0x5603ba5c24e0 msgr2=0x5603ba970820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:39.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.594+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3130616256 shutdown_connections 2024-09-17T03:09:39.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.594+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3130616256 wait complete. 2024-09-17T03:09:39.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.594+0000 7f34dd0b7740 1 -- start start 2024-09-17T03:09:39.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.595+0000 7f34dd0b7740 1 Processor -- start 2024-09-17T03:09:39.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.596+0000 7f34dd0b7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5a54d0 0x5603baa35150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.596+0000 7f34dd0b7740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ba5ad6b0 0x5603ba9b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.596+0000 7f34dd0b7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5ce390 0x5603ba9dcaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.596+0000 7f34dd0b7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f34d00b1d80 con 0x5603ba5a54d0 2024-09-17T03:09:39.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.596+0000 7f34dd0b7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f34d01ff730 con 0x5603ba5ce390 2024-09-17T03:09:39.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.596+0000 7f34dd0b7740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5603ba9dd490 con 0x5603ba5ad6b0 2024-09-17T03:09:39.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.596+0000 7f34dd0b7740 10 client.0 _ll_register_callbacks cb 0x7f34c4003ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:09:39.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.596+0000 7f34cf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5a54d0 0x5603baa35150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.596+0000 7f34cf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5a54d0 0x5603baa35150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53316/0 (socket says 172.21.15.78:53316) 2024-09-17T03:09:39.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.596+0000 7f34cf7fe640 1 -- 172.21.15.78:0/3113440680 learned_addr learned my addr 172.21.15.78:0/3113440680 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:39.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.596+0000 7f34ceffd640 1 --2- 172.21.15.78:0/3113440680 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ba5ad6b0 0x5603ba9b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.596+0000 7f34cffff640 1 --2- 172.21.15.78:0/3113440680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5ce390 0x5603ba9dcaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.596+0000 7f34cf7fe640 1 -- 172.21.15.78:0/3113440680 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ba5ad6b0 msgr2=0x5603ba9b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.596+0000 7f34cf7fe640 1 --2- 172.21.15.78:0/3113440680 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ba5ad6b0 0x5603ba9b60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.596+0000 7f34cf7fe640 1 -- 172.21.15.78:0/3113440680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5ce390 msgr2=0x5603ba9dcaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.596+0000 7f34cf7fe640 1 --2- 172.21.15.78:0/3113440680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5ce390 0x5603ba9dcaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.596+0000 7f34cf7fe640 1 -- 172.21.15.78:0/3113440680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603ba9c6bc0 con 0x5603ba5a54d0 2024-09-17T03:09:39.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.596+0000 7f34cf7fe640 1 --2- 172.21.15.78:0/3113440680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5a54d0 0x5603baa35150 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f34c0001eb0 tx=0x7f34c0024710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f08674845495c89 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:39.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.596+0000 7f34ae7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:09:39.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.597+0000 7f34ae7fc640 1 -- 172.21.15.78:0/3113440680 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c0039060 con 0x5603ba5a54d0 2024-09-17T03:09:39.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.597+0000 7f34ae7fc640 1 -- 172.21.15.78:0/3113440680 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f34c0029040 con 0x5603ba5a54d0 2024-09-17T03:09:39.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.597+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3113440680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34c001b040 con 0x5603ba5a54d0 2024-09-17T03:09:39.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.597+0000 7f34ae7fc640 1 -- 172.21.15.78:0/3113440680 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f34c003f050 con 0x5603ba5a54d0 2024-09-17T03:09:39.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.597+0000 7f34dd0b7740 10 client.5268 fetch_fsmap learned FSMap version 20 2024-09-17T03:09:39.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.597+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3113440680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5603ba9b9e10 con 0x5603ba5a54d0 2024-09-17T03:09:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.597+0000 7f34ae7fc640 1 -- 172.21.15.78:0/3113440680 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34c001b040 con 0x5603ba5a54d0 2024-09-17T03:09:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.597+0000 7f34ae7fc640 1 -- 172.21.15.78:0/3113440680 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 3554+0+0 (secure 0 0 0) 0x7f34c0042020 con 0x5603ba5a54d0 2024-09-17T03:09:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.597+0000 7f34dd0b7740 10 client.5268 fetch_fsmap finished waiting for FSMap version 20 2024-09-17T03:09:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.597+0000 7f34dd0b7740 10 client.5268 resolve_mds: resolved 2:1 to role '2:1' aka daemon mds.c 2024-09-17T03:09:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.597+0000 7f34dd0b7740 20 client.5268 populate_metadata read hostname 'smithi078' 2024-09-17T03:09:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.597+0000 7f34dd0b7740 1 --2- 172.21.15.78:0/3113440680 >> [v2:172.21.15.78:6832/2730690660,v1:172.21.15.78:6833/2730690660] conn(0x5603ba9dcfe0 0x5603ba9b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.597+0000 7f34dd0b7740 4 client.5268 mds_command: new command op to 4929 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T03:09:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.597+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3113440680 --> [v2:172.21.15.78:6832/2730690660,v1:172.21.15.78:6833/2730690660] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5603ba8e6460 con 0x5603ba9dcfe0 2024-09-17T03:09:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.597+0000 7f34ceffd640 1 --2- 172.21.15.78:0/3113440680 >> [v2:172.21.15.78:6832/2730690660,v1:172.21.15.78:6833/2730690660] conn(0x5603ba9dcfe0 0x5603ba9b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.598+0000 7f34ae7fc640 10 client.5268 ms_handle_connect on v2:172.21.15.78:6832/2730690660 2024-09-17T03:09:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.598+0000 7f34ceffd640 1 --2- 172.21.15.78:0/3113440680 >> [v2:172.21.15.78:6832/2730690660,v1:172.21.15.78:6833/2730690660] conn(0x5603ba9dcfe0 0x5603ba9b4f50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b031bf7de3619658 server_cookie=148e781858a39752 in_seq=0 out_seq=0 2024-09-17T03:09:39.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.605+0000 7f34ae7fc640 1 -- 172.21.15.78:0/3113440680 <== mds.1 v2:172.21.15.78:6832/2730690660 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5603ba8e6460 con 0x5603ba9dcfe0 2024-09-17T03:09:39.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.605+0000 7f34ae7fc640 10 client.5268 handle_command_reply: tid=0 2024-09-17T03:09:39.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.605+0000 7f34dd0b7740 1 client.5268 shutdown 2024-09-17T03:09:39.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.605+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3113440680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5a54d0 msgr2=0x5603baa35150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.605+0000 7f34dd0b7740 1 --2- 172.21.15.78:0/3113440680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5a54d0 0x5603baa35150 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f34c0001eb0 tx=0x7f34c0024710 comp rx=0 tx=0).stop 2024-09-17T03:09:39.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.605+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3113440680 shutdown_connections 2024-09-17T03:09:39.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.605+0000 7f34dd0b7740 1 --2- 172.21.15.78:0/3113440680 >> [v2:172.21.15.78:6832/2730690660,v1:172.21.15.78:6833/2730690660] conn(0x5603ba9dcfe0 0x5603ba9b4f50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.605+0000 7f34dd0b7740 1 --2- 172.21.15.78:0/3113440680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ba5ce390 0x5603ba9dcaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.605+0000 7f34dd0b7740 1 --2- 172.21.15.78:0/3113440680 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ba5ad6b0 0x5603ba9b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.605+0000 7f34ae7fc640 0 client.5268 ms_handle_reset on v2:172.21.15.78:6832/2730690660 2024-09-17T03:09:39.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.605+0000 7f34dd0b7740 1 --2- 172.21.15.78:0/3113440680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ba5a54d0 0x5603baa35150 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.605+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3113440680 >> 172.21.15.78:0/3113440680 conn(0x5603ba5c24e0 msgr2=0x5603ba9b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:39.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.606+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3113440680 shutdown_connections 2024-09-17T03:09:39.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.606+0000 7f34dd0b7740 1 -- 172.21.15.78:0/3113440680 wait complete. 2024-09-17T03:09:39.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.606+0000 7f34dd0b7740 20 client.5268 trim_cache size 0 max 16384 2024-09-17T03:09:39.606 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:09:39.606 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:09:39.606 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:09:39.606 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:09:39.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.606+0000 7f34d6152640 1 -- 172.21.15.78:0/3537850354 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f34bc078bc0 msgr2=0x7f34bc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.606+0000 7f34d6152640 1 --2- 172.21.15.78:0/3537850354 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f34bc078bc0 0x7f34bc07b0d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f34c0000f60 tx=0x7f34c0009040 comp rx=0 tx=0).stop 2024-09-17T03:09:39.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.606+0000 7f34d6152640 1 -- 172.21.15.78:0/3537850354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d00cf320 msgr2=0x7f34d01441b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.606+0000 7f34d6152640 1 --2- 172.21.15.78:0/3537850354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d00cf320 0x7f34d01441b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f34c4034040 tx=0x7f34c40035f0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.606+0000 7f34d6152640 1 -- 172.21.15.78:0/3537850354 shutdown_connections 2024-09-17T03:09:39.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.606+0000 7f34d6152640 1 --2- 172.21.15.78:0/3537850354 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f34bc078bc0 0x7f34bc07b0d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.606+0000 7f34d6152640 1 --2- 172.21.15.78:0/3537850354 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34d01600b0 0x7f34d01469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.606+0000 7f34d6152640 1 --2- 172.21.15.78:0/3537850354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34d00cf320 0x7f34d01441b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.606+0000 7f34d6152640 1 --2- 172.21.15.78:0/3537850354 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f34d00b7cc0 0x7f34d00b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.606+0000 7f34d6152640 1 -- 172.21.15.78:0/3537850354 >> 172.21.15.78:0/3537850354 conn(0x7f34d006d4f0 msgr2=0x7f34d015d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:39.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.606+0000 7f34d6152640 1 -- 172.21.15.78:0/3537850354 shutdown_connections 2024-09-17T03:09:39.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.606+0000 7f34d6152640 1 -- 172.21.15.78:0/3537850354 wait complete. 2024-09-17T03:09:39.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:2 flush journal 2024-09-17T03:09:39.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.731+0000 7efd82ac5640 1 -- 172.21.15.78:0/1476213293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7c145f90 msgr2=0x7efd7c06cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.731+0000 7efd82ac5640 1 --2- 172.21.15.78:0/1476213293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7c145f90 0x7efd7c06cde0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efd78005fd0 tx=0x7efd7802a540 comp rx=0 tx=0).stop 2024-09-17T03:09:39.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.731+0000 7efd82ac5640 1 -- 172.21.15.78:0/1476213293 shutdown_connections 2024-09-17T03:09:39.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.731+0000 7efd82ac5640 1 --2- 172.21.15.78:0/1476213293 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efd7c0d09c0 0x7efd7c0cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.731+0000 7efd82ac5640 1 --2- 172.21.15.78:0/1476213293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7c145f90 0x7efd7c06cde0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.731+0000 7efd82ac5640 1 -- 172.21.15.78:0/1476213293 >> 172.21.15.78:0/1476213293 conn(0x7efd7c0b2e10 msgr2=0x7efd7c0b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:39.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.731+0000 7efd82ac5640 1 -- 172.21.15.78:0/1476213293 shutdown_connections 2024-09-17T03:09:39.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.731+0000 7efd82ac5640 1 -- 172.21.15.78:0/1476213293 wait complete. 2024-09-17T03:09:39.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.733+0000 7efd82ac5640 1 Processor -- start 2024-09-17T03:09:39.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.733+0000 7efd82ac5640 1 -- start start 2024-09-17T03:09:39.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.734+0000 7efd82ac5640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efd7c06d320 0x7efd7c1526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.734+0000 7efd82ac5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd7c0d09c0 0x7efd7c1f6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.734+0000 7efd82ac5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7c145f90 0x7efd7c1f7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.734+0000 7efd82ac5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c0ce4e0 con 0x7efd7c145f90 2024-09-17T03:09:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.734+0000 7efd82ac5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c0ce360 con 0x7efd7c0d09c0 2024-09-17T03:09:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.734+0000 7efd82ac5640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7efd7c0ce660 con 0x7efd7c06d320 2024-09-17T03:09:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.734+0000 7efd81062640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7c145f90 0x7efd7c1f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.734+0000 7efd81062640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7c145f90 0x7efd7c1f7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53340/0 (socket says 172.21.15.78:53340) 2024-09-17T03:09:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.734+0000 7efd81062640 1 -- 172.21.15.78:0/231561830 learned_addr learned my addr 172.21.15.78:0/231561830 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.734+0000 7efd80861640 1 --2- 172.21.15.78:0/231561830 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efd7c06d320 0x7efd7c1526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.734+0000 7efd73fff640 1 --2- 172.21.15.78:0/231561830 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd7c0d09c0 0x7efd7c1f6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.735+0000 7efd81062640 1 -- 172.21.15.78:0/231561830 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efd7c06d320 msgr2=0x7efd7c1526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.735+0000 7efd81062640 1 --2- 172.21.15.78:0/231561830 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efd7c06d320 0x7efd7c1526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.735+0000 7efd81062640 1 -- 172.21.15.78:0/231561830 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd7c0d09c0 msgr2=0x7efd7c1f6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.735+0000 7efd81062640 1 --2- 172.21.15.78:0/231561830 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd7c0d09c0 0x7efd7c1f6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.735+0000 7efd81062640 1 -- 172.21.15.78:0/231561830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd7c1e9890 con 0x7efd7c145f90 2024-09-17T03:09:39.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.735+0000 7efd81062640 1 --2- 172.21.15.78:0/231561830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7c145f90 0x7efd7c1f7450 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efd7400ea10 tx=0x7efd7400eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:39.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.735+0000 7efd717fa640 1 -- 172.21.15.78:0/231561830 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7400cde0 con 0x7efd7c145f90 2024-09-17T03:09:39.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.735+0000 7efd717fa640 1 -- 172.21.15.78:0/231561830 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd74004c10 con 0x7efd7c145f90 2024-09-17T03:09:39.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.735+0000 7efd717fa640 1 -- 172.21.15.78:0/231561830 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74005020 con 0x7efd7c145f90 2024-09-17T03:09:39.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.735+0000 7efd82ac5640 1 -- 172.21.15.78:0/231561830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd7c1e3600 con 0x7efd7c145f90 2024-09-17T03:09:39.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.735+0000 7efd82ac5640 1 -- 172.21.15.78:0/231561830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd7c1e3bc0 con 0x7efd7c145f90 2024-09-17T03:09:39.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.737+0000 7efd717fa640 1 -- 172.21.15.78:0/231561830 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efd740051c0 con 0x7efd7c145f90 2024-09-17T03:09:39.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.738+0000 7efd717fa640 1 --2- 172.21.15.78:0/231561830 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efd68078b90 0x7efd6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.738+0000 7efd717fa640 1 -- 172.21.15.78:0/231561830 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7efd7409baa0 con 0x7efd7c145f90 2024-09-17T03:09:39.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.738+0000 7efd80861640 1 --2- 172.21.15.78:0/231561830 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efd68078b90 0x7efd6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.738+0000 7efd80861640 1 --2- 172.21.15.78:0/231561830 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efd68078b90 0x7efd6807b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efd78033000 tx=0x7efd78004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:39.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.738+0000 7efd89a35740 1 Processor -- start 2024-09-17T03:09:39.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.738+0000 7efd89a35740 1 -- start start 2024-09-17T03:09:39.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd89a35740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e3584390 0x5565e3970a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd89a35740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e355b4d0 0x5565e3945860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd89a35740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5565e35636b0 0x5565e3945da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd89a35740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5565e389ea60 con 0x5565e355b4d0 2024-09-17T03:09:39.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd89a35740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5565e388de90 con 0x5565e3584390 2024-09-17T03:09:39.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd89a35740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5565e3891ca0 con 0x5565e35636b0 2024-09-17T03:09:39.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd73fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e355b4d0 0x5565e3945860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd80861640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e3584390 0x5565e3970a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd80861640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e3584390 0x5565e3970a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.78:49736/0 (socket says 172.21.15.78:49736) 2024-09-17T03:09:39.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd80861640 1 -- 172.21.15.78:0/3701251745 learned_addr learned my addr 172.21.15.78:0/3701251745 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:39.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd73fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e355b4d0 0x5565e3945860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53342/0 (socket says 172.21.15.78:53342) 2024-09-17T03:09:39.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd81062640 1 --2- 172.21.15.78:0/3701251745 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5565e35636b0 0x5565e3945da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd73fff640 1 -- 172.21.15.78:0/3701251745 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5565e35636b0 msgr2=0x5565e3945da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd73fff640 1 --2- 172.21.15.78:0/3701251745 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5565e35636b0 0x5565e3945da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd73fff640 1 -- 172.21.15.78:0/3701251745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e3584390 msgr2=0x5565e3970a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd73fff640 1 --2- 172.21.15.78:0/3701251745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e3584390 0x5565e3970a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd73fff640 1 -- 172.21.15.78:0/3701251745 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565e36667d0 con 0x5565e355b4d0 2024-09-17T03:09:39.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd80861640 1 --2- 172.21.15.78:0/3701251745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e3584390 0x5565e3970a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:09:39.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd73fff640 1 --2- 172.21.15.78:0/3701251745 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e355b4d0 0x5565e3945860 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efd6c001700 tx=0x7efd6c007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676ebff4123f0adf server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:39.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd627fc640 1 -- 172.21.15.78:0/3701251745 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c0052e0 con 0x5565e355b4d0 2024-09-17T03:09:39.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd627fc640 1 -- 172.21.15.78:0/3701251745 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd6c018070 con 0x5565e355b4d0 2024-09-17T03:09:39.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.740+0000 7efd627fc640 1 -- 172.21.15.78:0/3701251745 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c00fa10 con 0x5565e355b4d0 2024-09-17T03:09:39.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.741+0000 7efd89a35740 1 -- 172.21.15.78:0/3701251745 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e355b4d0 msgr2=0x5565e3945860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.741+0000 7efd89a35740 1 --2- 172.21.15.78:0/3701251745 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e355b4d0 0x5565e3945860 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7efd6c001700 tx=0x7efd6c007e30 comp rx=0 tx=0).stop 2024-09-17T03:09:39.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.741+0000 7efd89a35740 1 -- 172.21.15.78:0/3701251745 shutdown_connections 2024-09-17T03:09:39.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.741+0000 7efd89a35740 1 --2- 172.21.15.78:0/3701251745 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5565e35636b0 0x5565e3945da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.741+0000 7efd89a35740 1 --2- 172.21.15.78:0/3701251745 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e355b4d0 0x5565e3945860 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.741+0000 7efd89a35740 1 --2- 172.21.15.78:0/3701251745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e3584390 0x5565e3970a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.741+0000 7efd89a35740 1 -- 172.21.15.78:0/3701251745 >> 172.21.15.78:0/3701251745 conn(0x5565e35784e0 msgr2=0x5565e392bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:39.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.741+0000 7efd89a35740 1 -- 172.21.15.78:0/3701251745 shutdown_connections 2024-09-17T03:09:39.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.741+0000 7efd89a35740 1 -- 172.21.15.78:0/3701251745 wait complete. 2024-09-17T03:09:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.742+0000 7efd89a35740 1 -- start start 2024-09-17T03:09:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.742+0000 7efd89a35740 1 Processor -- start 2024-09-17T03:09:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd89a35740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e355b4d0 0x5565e396d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd89a35740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5565e35636b0 0x5565e3943db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd89a35740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e3584390 0x5565e3969640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd89a35740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5565e35fe740 con 0x5565e3584390 2024-09-17T03:09:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd89a35740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5565e3833970 con 0x5565e355b4d0 2024-09-17T03:09:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd89a35740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5565e3944c90 con 0x5565e35636b0 2024-09-17T03:09:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd89a35740 10 client.0 _ll_register_callbacks cb 0x5565e3842780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:09:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd81062640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e3584390 0x5565e3969640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd81062640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e3584390 0x5565e3969640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53352/0 (socket says 172.21.15.78:53352) 2024-09-17T03:09:39.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd81062640 1 -- 172.21.15.78:0/35254611 learned_addr learned my addr 172.21.15.78:0/35254611 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:39.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd73fff640 1 --2- 172.21.15.78:0/35254611 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5565e35636b0 0x5565e3943db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd80861640 1 --2- 172.21.15.78:0/35254611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e355b4d0 0x5565e396d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd81062640 1 -- 172.21.15.78:0/35254611 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5565e35636b0 msgr2=0x5565e3943db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd81062640 1 --2- 172.21.15.78:0/35254611 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5565e35636b0 0x5565e3943db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd81062640 1 -- 172.21.15.78:0/35254611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e355b4d0 msgr2=0x5565e396d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd81062640 1 --2- 172.21.15.78:0/35254611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e355b4d0 0x5565e396d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd81062640 1 -- 172.21.15.78:0/35254611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565e35ef970 con 0x5565e3584390 2024-09-17T03:09:39.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd81062640 1 --2- 172.21.15.78:0/35254611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e3584390 0x5565e3969640 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7efd74009000 tx=0x7efd74063380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d321c4144f1c947c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:39.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd5b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:09:39.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd5b7fe640 1 -- 172.21.15.78:0/35254611 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74082060 con 0x5565e3584390 2024-09-17T03:09:39.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd5b7fe640 1 -- 172.21.15.78:0/35254611 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7efd74062b80 con 0x5565e3584390 2024-09-17T03:09:39.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.744+0000 7efd89a35740 1 -- 172.21.15.78:0/35254611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd6c018070 con 0x5565e3584390 2024-09-17T03:09:39.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.745+0000 7efd5b7fe640 1 -- 172.21.15.78:0/35254611 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7efd7407d070 con 0x5565e3584390 2024-09-17T03:09:39.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.745+0000 7efd89a35740 10 client.5280 fetch_fsmap learned FSMap version 20 2024-09-17T03:09:39.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.745+0000 7efd89a35740 1 -- 172.21.15.78:0/35254611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5565e35cd6a0 con 0x5565e3584390 2024-09-17T03:09:39.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.745+0000 7efd5b7fe640 1 -- 172.21.15.78:0/35254611 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd6c018070 con 0x5565e3584390 2024-09-17T03:09:39.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.745+0000 7efd5b7fe640 1 -- 172.21.15.78:0/35254611 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 3554+0+0 (secure 0 0 0) 0x7efd74020030 con 0x5565e3584390 2024-09-17T03:09:39.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.745+0000 7efd89a35740 10 client.5280 fetch_fsmap finished waiting for FSMap version 20 2024-09-17T03:09:39.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.745+0000 7efd89a35740 10 client.5280 resolve_mds: resolved 2:2 to role '2:2' aka daemon mds.d 2024-09-17T03:09:39.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.745+0000 7efd89a35740 20 client.5280 populate_metadata read hostname 'smithi078' 2024-09-17T03:09:39.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.745+0000 7efd89a35740 1 --2- 172.21.15.78:0/35254611 >> [v2:172.21.15.193:6835/2343001441,v1:172.21.15.193:6837/2343001441] conn(0x5565e3542f60 0x5565e3969b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.745+0000 7efd89a35740 4 client.5280 mds_command: new command op to 4661 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:09:39.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.745+0000 7efd89a35740 1 -- 172.21.15.78:0/35254611 --> [v2:172.21.15.193:6835/2343001441,v1:172.21.15.193:6837/2343001441] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565e38a09b0 con 0x5565e3542f60 2024-09-17T03:09:39.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.745+0000 7efd80861640 1 --2- 172.21.15.78:0/35254611 >> [v2:172.21.15.193:6835/2343001441,v1:172.21.15.193:6837/2343001441] conn(0x5565e3542f60 0x5565e3969b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.746+0000 7efd5b7fe640 10 client.5280 ms_handle_connect on v2:172.21.15.193:6835/2343001441 2024-09-17T03:09:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.746+0000 7efd80861640 1 --2- 172.21.15.78:0/35254611 >> [v2:172.21.15.193:6835/2343001441,v1:172.21.15.193:6837/2343001441] conn(0x5565e3542f60 0x5565e3969b80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=43755e7e8f4957dc server_cookie=a3d9b670c54d0347 in_seq=0 out_seq=0 2024-09-17T03:09:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.746+0000 7efd5b7fe640 1 -- 172.21.15.78:0/35254611 <== mds.2 v2:172.21.15.193:6835/2343001441 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5565e38a09b0 con 0x5565e3542f60 2024-09-17T03:09:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.746+0000 7efd5b7fe640 10 client.5280 handle_command_reply: tid=0 2024-09-17T03:09:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.746+0000 7efd89a35740 1 client.5280 shutdown 2024-09-17T03:09:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.746+0000 7efd89a35740 1 -- 172.21.15.78:0/35254611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e3584390 msgr2=0x5565e3969640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.746+0000 7efd89a35740 1 --2- 172.21.15.78:0/35254611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e3584390 0x5565e3969640 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7efd74009000 tx=0x7efd74063380 comp rx=0 tx=0).stop 2024-09-17T03:09:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.746+0000 7efd89a35740 1 -- 172.21.15.78:0/35254611 shutdown_connections 2024-09-17T03:09:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.746+0000 7efd89a35740 1 --2- 172.21.15.78:0/35254611 >> [v2:172.21.15.193:6835/2343001441,v1:172.21.15.193:6837/2343001441] conn(0x5565e3542f60 0x5565e3969b80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.746+0000 7efd89a35740 1 --2- 172.21.15.78:0/35254611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e3584390 0x5565e3969640 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.746+0000 7efd5b7fe640 0 client.5280 ms_handle_reset on v2:172.21.15.193:6835/2343001441 2024-09-17T03:09:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.746+0000 7efd89a35740 1 --2- 172.21.15.78:0/35254611 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5565e35636b0 0x5565e3943db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.746+0000 7efd89a35740 1 --2- 172.21.15.78:0/35254611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e355b4d0 0x5565e396d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.746+0000 7efd89a35740 1 -- 172.21.15.78:0/35254611 >> 172.21.15.78:0/35254611 conn(0x5565e35784e0 msgr2=0x5565e3926a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:39.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.747+0000 7efd89a35740 1 -- 172.21.15.78:0/35254611 shutdown_connections 2024-09-17T03:09:39.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.747+0000 7efd89a35740 1 -- 172.21.15.78:0/35254611 wait complete. 2024-09-17T03:09:39.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.747+0000 7efd89a35740 20 client.5280 trim_cache size 0 max 16384 2024-09-17T03:09:39.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.761+0000 7efd89a35740 1 Processor -- start 2024-09-17T03:09:39.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.761+0000 7efd89a35740 1 -- start start 2024-09-17T03:09:39.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.762+0000 7efd89a35740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5565e355b4d0 0x5565e392b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.763+0000 7efd89a35740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e35636b0 0x5565e39665e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.763+0000 7efd89a35740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e3584390 0x5565e3966b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.763+0000 7efd89a35740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c200310 con 0x5565e3584390 2024-09-17T03:09:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.763+0000 7efd89a35740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c1ff4e0 con 0x5565e35636b0 2024-09-17T03:09:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.763+0000 7efd89a35740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7efd7c1ffbe0 con 0x5565e355b4d0 2024-09-17T03:09:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.763+0000 7efd81062640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e3584390 0x5565e3966b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.763+0000 7efd81062640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e3584390 0x5565e3966b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53358/0 (socket says 172.21.15.78:53358) 2024-09-17T03:09:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.763+0000 7efd81062640 1 -- 172.21.15.78:0/377406167 learned_addr learned my addr 172.21.15.78:0/377406167 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.763+0000 7efd73fff640 1 --2- 172.21.15.78:0/377406167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e35636b0 0x5565e39665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.763+0000 7efd80861640 1 --2- 172.21.15.78:0/377406167 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5565e355b4d0 0x5565e392b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.763+0000 7efd81062640 1 -- 172.21.15.78:0/377406167 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5565e355b4d0 msgr2=0x5565e392b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.763+0000 7efd81062640 1 --2- 172.21.15.78:0/377406167 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5565e355b4d0 0x5565e392b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.763+0000 7efd81062640 1 -- 172.21.15.78:0/377406167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e35636b0 msgr2=0x5565e39665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.763+0000 7efd81062640 1 --2- 172.21.15.78:0/377406167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e35636b0 0x5565e39665e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.763+0000 7efd81062640 1 -- 172.21.15.78:0/377406167 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565e3921910 con 0x5565e3584390 2024-09-17T03:09:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.763+0000 7efd81062640 1 --2- 172.21.15.78:0/377406167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e3584390 0x5565e3966b20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7efd74060b90 tx=0x7efd74005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84329c421c994439 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.763+0000 7efd61ffb640 1 -- 172.21.15.78:0/377406167 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd74062b80 con 0x5565e3584390 2024-09-17T03:09:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.763+0000 7efd61ffb640 1 -- 172.21.15.78:0/377406167 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd740054b0 con 0x5565e3584390 2024-09-17T03:09:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.763+0000 7efd61ffb640 1 -- 172.21.15.78:0/377406167 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd740056e0 con 0x5565e3584390 2024-09-17T03:09:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.764+0000 7efd89a35740 1 -- 172.21.15.78:0/377406167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e3584390 msgr2=0x5565e3966b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.764+0000 7efd89a35740 1 --2- 172.21.15.78:0/377406167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e3584390 0x5565e3966b20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7efd74060b90 tx=0x7efd74005f40 comp rx=0 tx=0).stop 2024-09-17T03:09:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.764+0000 7efd89a35740 1 -- 172.21.15.78:0/377406167 shutdown_connections 2024-09-17T03:09:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.764+0000 7efd89a35740 1 --2- 172.21.15.78:0/377406167 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e3584390 0x5565e3966b20 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.764+0000 7efd89a35740 1 --2- 172.21.15.78:0/377406167 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e35636b0 0x5565e39665e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.764+0000 7efd89a35740 1 --2- 172.21.15.78:0/377406167 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5565e355b4d0 0x5565e392b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.764+0000 7efd89a35740 1 -- 172.21.15.78:0/377406167 >> 172.21.15.78:0/377406167 conn(0x5565e35784e0 msgr2=0x5565e3952650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:39.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.764+0000 7efd89a35740 1 -- 172.21.15.78:0/377406167 shutdown_connections 2024-09-17T03:09:39.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.764+0000 7efd89a35740 1 -- 172.21.15.78:0/377406167 wait complete. 2024-09-17T03:09:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.765+0000 7efd89a35740 1 -- start start 2024-09-17T03:09:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.765+0000 7efd89a35740 1 Processor -- start 2024-09-17T03:09:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.766+0000 7efd89a35740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5565e355b4d0 0x5565e39f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.766+0000 7efd89a35740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e35636b0 0x5565e39257a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.766+0000 7efd89a35740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e3584390 0x5565e3925ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.766+0000 7efd89a35740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5565e3926c30 con 0x5565e35636b0 2024-09-17T03:09:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.766+0000 7efd89a35740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efd7c1e8870 con 0x5565e3584390 2024-09-17T03:09:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.766+0000 7efd89a35740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5565e39677f0 con 0x5565e355b4d0 2024-09-17T03:09:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.766+0000 7efd89a35740 10 client.0 _ll_register_callbacks cb 0x7efd74005b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:09:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.766+0000 7efd73fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e35636b0 0x5565e39257a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.767+0000 7efd73fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e35636b0 0x5565e39257a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53360/0 (socket says 172.21.15.78:53360) 2024-09-17T03:09:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.767+0000 7efd80861640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5565e355b4d0 0x5565e39f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.767+0000 7efd73fff640 1 -- 172.21.15.78:0/1795195413 learned_addr learned my addr 172.21.15.78:0/1795195413 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.767+0000 7efd81062640 1 --2- 172.21.15.78:0/1795195413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e3584390 0x5565e3925ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.767+0000 7efd73fff640 1 -- 172.21.15.78:0/1795195413 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5565e355b4d0 msgr2=0x5565e39f2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.767+0000 7efd73fff640 1 --2- 172.21.15.78:0/1795195413 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5565e355b4d0 0x5565e39f2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.767+0000 7efd73fff640 1 -- 172.21.15.78:0/1795195413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e3584390 msgr2=0x5565e3925ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.767+0000 7efd73fff640 1 --2- 172.21.15.78:0/1795195413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e3584390 0x5565e3925ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.767+0000 7efd73fff640 1 -- 172.21.15.78:0/1795195413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565e39938d0 con 0x5565e35636b0 2024-09-17T03:09:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.767+0000 7efd73fff640 1 --2- 172.21.15.78:0/1795195413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e35636b0 0x5565e39257a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7efd6c014000 tx=0x7efd6c007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae301de4f9370fd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.767+0000 7efd5b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:09:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.767+0000 7efd5b7fe640 1 -- 172.21.15.78:0/1795195413 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd6c007400 con 0x5565e35636b0 2024-09-17T03:09:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.767+0000 7efd5b7fe640 1 -- 172.21.15.78:0/1795195413 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7efd6c0075a0 con 0x5565e35636b0 2024-09-17T03:09:39.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.767+0000 7efd89a35740 1 -- 172.21.15.78:0/1795195413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd740054b0 con 0x5565e35636b0 2024-09-17T03:09:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.767+0000 7efd5b7fe640 1 -- 172.21.15.78:0/1795195413 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7efd6c030050 con 0x5565e35636b0 2024-09-17T03:09:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.767+0000 7efd89a35740 10 client.5286 fetch_fsmap learned FSMap version 20 2024-09-17T03:09:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.767+0000 7efd89a35740 1 -- 172.21.15.78:0/1795195413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5565e3985000 con 0x5565e35636b0 2024-09-17T03:09:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.767+0000 7efd5b7fe640 1 -- 172.21.15.78:0/1795195413 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd740054b0 con 0x5565e35636b0 2024-09-17T03:09:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.768+0000 7efd5b7fe640 1 -- 172.21.15.78:0/1795195413 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 3554+0+0 (secure 0 0 0) 0x7efd6c033020 con 0x5565e35636b0 2024-09-17T03:09:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.768+0000 7efd89a35740 10 client.5286 fetch_fsmap finished waiting for FSMap version 20 2024-09-17T03:09:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.768+0000 7efd89a35740 10 client.5286 resolve_mds: resolved 2:2 to role '2:2' aka daemon mds.d 2024-09-17T03:09:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.768+0000 7efd89a35740 20 client.5286 populate_metadata read hostname 'smithi078' 2024-09-17T03:09:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.768+0000 7efd89a35740 1 --2- 172.21.15.78:0/1795195413 >> [v2:172.21.15.193:6835/2343001441,v1:172.21.15.193:6837/2343001441] conn(0x5565e3984bc0 0x5565e39665e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.768+0000 7efd89a35740 4 client.5286 mds_command: new command op to 4661 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T03:09:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.768+0000 7efd89a35740 1 -- 172.21.15.78:0/1795195413 --> [v2:172.21.15.193:6835/2343001441,v1:172.21.15.193:6837/2343001441] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5565e389c460 con 0x5565e3984bc0 2024-09-17T03:09:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.768+0000 7efd80861640 1 --2- 172.21.15.78:0/1795195413 >> [v2:172.21.15.193:6835/2343001441,v1:172.21.15.193:6837/2343001441] conn(0x5565e3984bc0 0x5565e39665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.768+0000 7efd5b7fe640 10 client.5286 ms_handle_connect on v2:172.21.15.193:6835/2343001441 2024-09-17T03:09:39.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.768+0000 7efd80861640 1 --2- 172.21.15.78:0/1795195413 >> [v2:172.21.15.193:6835/2343001441,v1:172.21.15.193:6837/2343001441] conn(0x5565e3984bc0 0x5565e39665e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c0ddd853c5d698f5 server_cookie=b93bbd671d35d08 in_seq=0 out_seq=0 2024-09-17T03:09:39.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.774+0000 7efd5b7fe640 1 -- 172.21.15.78:0/1795195413 <== mds.2 v2:172.21.15.193:6835/2343001441 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5565e389c460 con 0x5565e3984bc0 2024-09-17T03:09:39.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.774+0000 7efd5b7fe640 10 client.5286 handle_command_reply: tid=0 2024-09-17T03:09:39.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.774+0000 7efd89a35740 1 client.5286 shutdown 2024-09-17T03:09:39.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.775+0000 7efd89a35740 1 -- 172.21.15.78:0/1795195413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e35636b0 msgr2=0x5565e39257a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.775+0000 7efd89a35740 1 --2- 172.21.15.78:0/1795195413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e35636b0 0x5565e39257a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7efd6c014000 tx=0x7efd6c007040 comp rx=0 tx=0).stop 2024-09-17T03:09:39.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.775+0000 7efd89a35740 1 -- 172.21.15.78:0/1795195413 shutdown_connections 2024-09-17T03:09:39.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.775+0000 7efd89a35740 1 --2- 172.21.15.78:0/1795195413 >> [v2:172.21.15.193:6835/2343001441,v1:172.21.15.193:6837/2343001441] conn(0x5565e3984bc0 0x5565e39665e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.775+0000 7efd89a35740 1 --2- 172.21.15.78:0/1795195413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5565e3584390 0x5565e3925ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.775+0000 7efd89a35740 1 --2- 172.21.15.78:0/1795195413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5565e35636b0 0x5565e39257a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.775+0000 7efd5b7fe640 0 client.5286 ms_handle_reset on v2:172.21.15.193:6835/2343001441 2024-09-17T03:09:39.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.775+0000 7efd89a35740 1 --2- 172.21.15.78:0/1795195413 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5565e355b4d0 0x5565e39f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.775+0000 7efd89a35740 1 -- 172.21.15.78:0/1795195413 >> 172.21.15.78:0/1795195413 conn(0x5565e35784e0 msgr2=0x5565e3968530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:39.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.775+0000 7efd89a35740 1 -- 172.21.15.78:0/1795195413 shutdown_connections 2024-09-17T03:09:39.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.775+0000 7efd89a35740 1 -- 172.21.15.78:0/1795195413 wait complete. 2024-09-17T03:09:39.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.775+0000 7efd89a35740 20 client.5286 trim_cache size 0 max 16384 2024-09-17T03:09:39.776 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:09:39.776 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:09:39.776 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:09:39.776 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:09:39.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.775+0000 7efd82ac5640 1 -- 172.21.15.78:0/231561830 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efd68078b90 msgr2=0x7efd6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.775+0000 7efd82ac5640 1 --2- 172.21.15.78:0/231561830 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efd68078b90 0x7efd6807b0a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efd78033000 tx=0x7efd78004730 comp rx=0 tx=0).stop 2024-09-17T03:09:39.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.775+0000 7efd82ac5640 1 -- 172.21.15.78:0/231561830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7c145f90 msgr2=0x7efd7c1f7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:39.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.775+0000 7efd82ac5640 1 --2- 172.21.15.78:0/231561830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7c145f90 0x7efd7c1f7450 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7efd7400ea10 tx=0x7efd7400eed0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.776+0000 7efd82ac5640 1 -- 172.21.15.78:0/231561830 shutdown_connections 2024-09-17T03:09:39.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.776+0000 7efd82ac5640 1 --2- 172.21.15.78:0/231561830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd7c145f90 0x7efd7c1f7450 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.776+0000 7efd82ac5640 1 --2- 172.21.15.78:0/231561830 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efd68078b90 0x7efd6807b0a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.776+0000 7efd82ac5640 1 --2- 172.21.15.78:0/231561830 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd7c0d09c0 0x7efd7c1f6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.776+0000 7efd82ac5640 1 --2- 172.21.15.78:0/231561830 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efd7c06d320 0x7efd7c1526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:39.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.776+0000 7efd82ac5640 1 -- 172.21.15.78:0/231561830 >> 172.21.15.78:0/231561830 conn(0x7efd7c0b2e10 msgr2=0x7efd7c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:39.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.776+0000 7efd82ac5640 1 -- 172.21.15.78:0/231561830 shutdown_connections 2024-09-17T03:09:39.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39.776+0000 7efd82ac5640 1 -- 172.21.15.78:0/231561830 wait complete. 2024-09-17T03:09:39.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:09:39.786 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2024-09-17T03:09:39.808 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/ 2024-09-17T03:09:39.808 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4 2024-09-17T03:09:39.808 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4/d5 2024-09-17T03:09:39.808 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4/d5/d6 2024-09-17T03:09:39.808 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4/d5/d6/d7 2024-09-17T03:09:39.809 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2024-09-17T03:09:39.809 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:09:39.809 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:09:39.809 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:09:39.809 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:09:39.810 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2024-09-17T03:09:39.810 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:09:39.913 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627778 2024-09-17T03:09:39.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:09:39.922 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:09:39.922 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:09:39.922 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:09:39.922 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:09:39.922 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2024-09-17T03:09:39.922 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:09:40.027 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627779 2024-09-17T03:09:40.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:09:40.037 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:09:40.037 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:09:40.037 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:09:40.037 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:09:40.037 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2024-09-17T03:09:40.037 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:09:40.141 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627780 2024-09-17T03:09:40.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:09:40.150 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:09:40.150 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:09:40.150 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:09:40.151 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:09:40.151 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2024-09-17T03:09:40.151 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:09:40.255 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627781 2024-09-17T03:09:40.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:09:40.263 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:09:40.263 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:09:40.263 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:09:40.263 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:09:40.263 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2024-09-17T03:09:40.264 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:09:40.368 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627782 2024-09-17T03:09:40.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:09:40.376 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:09:40.376 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:09:40.376 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:09:40.376 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:09:40.376 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2024-09-17T03:09:40.376 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:09:40.481 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627783 2024-09-17T03:09:40.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:09:40.490 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 tag path /d1/d2/d3 tag123 2024-09-17T03:09:40.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.647+0000 7f30fbaf9640 1 -- 172.21.15.78:0/1472229447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f41601c0 msgr2=0x7f30f40d1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:40.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.647+0000 7f30fbaf9640 1 --2- 172.21.15.78:0/1472229447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f41601c0 0x7f30f40d1b60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f30f41605d0 tx=0x7f30f002a530 comp rx=0 tx=0).stop 2024-09-17T03:09:40.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.647+0000 7f30fbaf9640 1 -- 172.21.15.78:0/1472229447 shutdown_connections 2024-09-17T03:09:40.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.647+0000 7f30fbaf9640 1 --2- 172.21.15.78:0/1472229447 >> v2:172.21.15.193:3300/0 conn(0x7f30f40d0340 0x7f30f40ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.647+0000 7f30fbaf9640 1 --2- 172.21.15.78:0/1472229447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f41601c0 0x7f30f40d1b60 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.647+0000 7f30fbaf9640 1 -- 172.21.15.78:0/1472229447 >> 172.21.15.78:0/1472229447 conn(0x7f30f4072a90 msgr2=0x7f30f4072ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:40.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.647+0000 7f30fbaf9640 1 -- 172.21.15.78:0/1472229447 shutdown_connections 2024-09-17T03:09:40.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.647+0000 7f30fbaf9640 1 -- 172.21.15.78:0/1472229447 wait complete. 2024-09-17T03:09:40.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.648+0000 7f30fbaf9640 1 Processor -- start 2024-09-17T03:09:40.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.649+0000 7f30fbaf9640 1 -- start start 2024-09-17T03:09:40.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.650+0000 7f30fbaf9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f30f40cff30 0x7f30f406f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.650+0000 7f30fbaf9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30f40d0340 0x7f30f414fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.650+0000 7f30fbaf9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f41601c0 0x7f30f4150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.650+0000 7f30fbaf9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f30f415d460 con 0x7f30f41601c0 2024-09-17T03:09:40.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.650+0000 7f30fbaf9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f30f415d2e0 con 0x7f30f40cff30 2024-09-17T03:09:40.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.650+0000 7f30fbaf9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f30f415d5e0 con 0x7f30f40d0340 2024-09-17T03:09:40.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.650+0000 7f30fa096640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f41601c0 0x7f30f4150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.650+0000 7f30fa096640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f41601c0 0x7f30f4150430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53378/0 (socket says 172.21.15.78:53378) 2024-09-17T03:09:40.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.650+0000 7f30fa096640 1 -- 172.21.15.78:0/2435761746 learned_addr learned my addr 172.21.15.78:0/2435761746 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:40.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.650+0000 7f30f9094640 1 --2- 172.21.15.78:0/2435761746 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30f40d0340 0x7f30f414fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.650+0000 7f30f9895640 1 --2- 172.21.15.78:0/2435761746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f30f40cff30 0x7f30f406f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.650+0000 7f30fa096640 1 -- 172.21.15.78:0/2435761746 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30f40d0340 msgr2=0x7f30f414fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:40.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.650+0000 7f30fa096640 1 --2- 172.21.15.78:0/2435761746 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30f40d0340 0x7f30f414fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.650+0000 7f30fa096640 1 -- 172.21.15.78:0/2435761746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f30f40cff30 msgr2=0x7f30f406f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:40.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.650+0000 7f30fa096640 1 --2- 172.21.15.78:0/2435761746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f30f40cff30 0x7f30f406f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.650+0000 7f30fa096640 1 -- 172.21.15.78:0/2435761746 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f40b2870 con 0x7f30f41601c0 2024-09-17T03:09:40.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.650+0000 7f30f9094640 1 --2- 172.21.15.78:0/2435761746 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30f40d0340 0x7f30f414fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:09:40.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.650+0000 7f30fa096640 1 --2- 172.21.15.78:0/2435761746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f41601c0 0x7f30f4150430 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00ba10 tx=0x7f30ec00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:40.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.651+0000 7f30ea7fc640 1 -- 172.21.15.78:0/2435761746 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec019070 con 0x7f30f41601c0 2024-09-17T03:09:40.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.651+0000 7f30ea7fc640 1 -- 172.21.15.78:0/2435761746 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30ec00cbf0 con 0x7f30f41601c0 2024-09-17T03:09:40.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.651+0000 7f30fbaf9640 1 -- 172.21.15.78:0/2435761746 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f40b42c0 con 0x7f30f41601c0 2024-09-17T03:09:40.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.651+0000 7f30ea7fc640 1 -- 172.21.15.78:0/2435761746 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec014440 con 0x7f30f41601c0 2024-09-17T03:09:40.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.651+0000 7f30fbaf9640 1 -- 172.21.15.78:0/2435761746 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f40b52c0 con 0x7f30f41601c0 2024-09-17T03:09:40.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.652+0000 7f30ea7fc640 1 -- 172.21.15.78:0/2435761746 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f30ec01c070 con 0x7f30f41601c0 2024-09-17T03:09:40.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.653+0000 7f30ea7fc640 1 --2- 172.21.15.78:0/2435761746 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f30d8078b90 0x7f30d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.653+0000 7f30ea7fc640 1 -- 172.21.15.78:0/2435761746 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f30ec09a9d0 con 0x7f30f41601c0 2024-09-17T03:09:40.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.653+0000 7f30f9895640 1 --2- 172.21.15.78:0/2435761746 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f30d8078b90 0x7f30d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.654+0000 7f3102a69740 1 Processor -- start 2024-09-17T03:09:40.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.654+0000 7f30f9895640 1 --2- 172.21.15.78:0/2435761746 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f30d8078b90 0x7f30d807b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f30f0034000 tx=0x7f30f0004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:40.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.654+0000 7f3102a69740 1 -- start start 2024-09-17T03:09:40.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.655+0000 7f3102a69740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b5f5b0 0x558278f4e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.655+0000 7f3102a69740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558278b366f0 0x558278f30d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.655+0000 7f3102a69740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558278b3e8d0 0x558278f31280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.655+0000 7f3102a69740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x558278e79a80 con 0x558278b5f5b0 2024-09-17T03:09:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.655+0000 7f3102a69740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558278e68eb0 con 0x558278b3e8d0 2024-09-17T03:09:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.655+0000 7f3102a69740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x558278e6ccc0 con 0x558278b366f0 2024-09-17T03:09:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.655+0000 7f30f9895640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b5f5b0 0x558278f4e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.655+0000 7f30f9895640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b5f5b0 0x558278f4e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53384/0 (socket says 172.21.15.78:53384) 2024-09-17T03:09:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.655+0000 7f30f9895640 1 -- 172.21.15.78:0/3887203114 learned_addr learned my addr 172.21.15.78:0/3887203114 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.655+0000 7f30fa096640 1 --2- 172.21.15.78:0/3887203114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558278b3e8d0 0x558278f31280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.655+0000 7f30f9094640 1 --2- 172.21.15.78:0/3887203114 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558278b366f0 0x558278f30d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.656+0000 7f30f9895640 1 -- 172.21.15.78:0/3887203114 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558278b366f0 msgr2=0x558278f30d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:40.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.656+0000 7f30f9895640 1 --2- 172.21.15.78:0/3887203114 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558278b366f0 0x558278f30d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.656+0000 7f30f9895640 1 -- 172.21.15.78:0/3887203114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558278b3e8d0 msgr2=0x558278f31280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.656+0000 7f30f9895640 1 --2- 172.21.15.78:0/3887203114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558278b3e8d0 0x558278f31280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.656+0000 7f30f9895640 1 -- 172.21.15.78:0/3887203114 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558278c43a20 con 0x558278b5f5b0 2024-09-17T03:09:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.656+0000 7f30f9895640 1 --2- 172.21.15.78:0/3887203114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b5f5b0 0x558278f4e070 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f30f0004560 tx=0x7f30f003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b41f1ca9fcb234b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.656+0000 7f30d77fe640 1 -- 172.21.15.78:0/3887203114 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f004d070 con 0x558278b5f5b0 2024-09-17T03:09:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.656+0000 7f30d77fe640 1 -- 172.21.15.78:0/3887203114 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30f0049450 con 0x558278b5f5b0 2024-09-17T03:09:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.656+0000 7f30d77fe640 1 -- 172.21.15.78:0/3887203114 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0049840 con 0x558278b5f5b0 2024-09-17T03:09:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.657+0000 7f3102a69740 1 -- 172.21.15.78:0/3887203114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b5f5b0 msgr2=0x558278f4e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.657+0000 7f3102a69740 1 --2- 172.21.15.78:0/3887203114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b5f5b0 0x558278f4e070 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f30f0004560 tx=0x7f30f003d000 comp rx=0 tx=0).stop 2024-09-17T03:09:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.657+0000 7f3102a69740 1 -- 172.21.15.78:0/3887203114 shutdown_connections 2024-09-17T03:09:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.657+0000 7f3102a69740 1 --2- 172.21.15.78:0/3887203114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558278b3e8d0 0x558278f31280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.657+0000 7f3102a69740 1 --2- 172.21.15.78:0/3887203114 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558278b366f0 0x558278f30d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.657+0000 7f3102a69740 1 --2- 172.21.15.78:0/3887203114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b5f5b0 0x558278f4e070 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.657+0000 7f3102a69740 1 -- 172.21.15.78:0/3887203114 >> 172.21.15.78:0/3887203114 conn(0x558278b53700 msgr2=0x558278f06f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:40.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.657+0000 7f3102a69740 1 -- 172.21.15.78:0/3887203114 shutdown_connections 2024-09-17T03:09:40.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.657+0000 7f3102a69740 1 -- 172.21.15.78:0/3887203114 wait complete. 2024-09-17T03:09:40.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.658+0000 7f3102a69740 1 -- start start 2024-09-17T03:09:40.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.658+0000 7f3102a69740 1 Processor -- start 2024-09-17T03:09:40.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.659+0000 7f3102a69740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558278b366f0 0x558278f1ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.659+0000 7f3102a69740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b3e8d0 0x558278f5f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.659+0000 7f3102a69740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558278b5f5b0 0x558278f2a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.659+0000 7f3102a69740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x558278bd9960 con 0x558278b3e8d0 2024-09-17T03:09:40.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.659+0000 7f3102a69740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558278def670 con 0x558278b366f0 2024-09-17T03:09:40.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.659+0000 7f3102a69740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x558278f2c8b0 con 0x558278b5f5b0 2024-09-17T03:09:40.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.659+0000 7f3102a69740 10 client.0 _ll_register_callbacks cb 0x558278e623e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:09:40.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.659+0000 7f30f9094640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b3e8d0 0x558278f5f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.659+0000 7f30f9094640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b3e8d0 0x558278f5f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53398/0 (socket says 172.21.15.78:53398) 2024-09-17T03:09:40.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.659+0000 7f30f9094640 1 -- 172.21.15.78:0/2415254492 learned_addr learned my addr 172.21.15.78:0/2415254492 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:40.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f30fa096640 1 --2- 172.21.15.78:0/2415254492 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558278b5f5b0 0x558278f2a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f30f9895640 1 --2- 172.21.15.78:0/2415254492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558278b366f0 0x558278f1ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f30f9094640 1 -- 172.21.15.78:0/2415254492 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558278b5f5b0 msgr2=0x558278f2a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:40.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f30f9094640 1 --2- 172.21.15.78:0/2415254492 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558278b5f5b0 0x558278f2a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f30f9094640 1 -- 172.21.15.78:0/2415254492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558278b366f0 msgr2=0x558278f1ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:40.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f30f9094640 1 --2- 172.21.15.78:0/2415254492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558278b366f0 0x558278f1ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f30f9094640 1 -- 172.21.15.78:0/2415254492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558278ba88c0 con 0x558278b3e8d0 2024-09-17T03:09:40.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f30f9094640 1 --2- 172.21.15.78:0/2415254492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b3e8d0 0x558278f5f830 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f30e4001e40 tx=0x7f30e4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a69f6429ba63796 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:40.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f30d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:09:40.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f30d4ff9640 1 -- 172.21.15.78:0/2415254492 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e4010e90 con 0x558278b3e8d0 2024-09-17T03:09:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f30d4ff9640 1 -- 172.21.15.78:0/2415254492 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f30e40035f0 con 0x558278b3e8d0 2024-09-17T03:09:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f3102a69740 1 -- 172.21.15.78:0/2415254492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30f0049450 con 0x558278b3e8d0 2024-09-17T03:09:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f30d4ff9640 1 -- 172.21.15.78:0/2415254492 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f30e4021050 con 0x558278b3e8d0 2024-09-17T03:09:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f3102a69740 10 client.5301 fetch_fsmap learned FSMap version 20 2024-09-17T03:09:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f3102a69740 1 -- 172.21.15.78:0/2415254492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x558278ca41b0 con 0x558278b3e8d0 2024-09-17T03:09:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f30d4ff9640 1 -- 172.21.15.78:0/2415254492 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30f0049450 con 0x558278b3e8d0 2024-09-17T03:09:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f30d4ff9640 1 -- 172.21.15.78:0/2415254492 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 3554+0+0 (secure 0 0 0) 0x7f30e4024020 con 0x558278b3e8d0 2024-09-17T03:09:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f3102a69740 10 client.5301 fetch_fsmap finished waiting for FSMap version 20 2024-09-17T03:09:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f3102a69740 10 client.5301 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-17T03:09:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f3102a69740 20 client.5301 populate_metadata read hostname 'smithi078' 2024-09-17T03:09:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f3102a69740 1 --2- 172.21.15.78:0/2415254492 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x558278b1e180 0x558278f29070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f3102a69740 4 client.5301 mds_command: new command op to 4938 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:09:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.660+0000 7f3102a69740 1 -- 172.21.15.78:0/2415254492 --> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558278e7b9d0 con 0x558278b1e180 2024-09-17T03:09:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.661+0000 7f30f9895640 1 --2- 172.21.15.78:0/2415254492 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x558278b1e180 0x558278f29070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.661+0000 7f30d4ff9640 10 client.5301 ms_handle_connect on v2:172.21.15.78:6834/2663458793 2024-09-17T03:09:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.661+0000 7f30f9895640 1 --2- 172.21.15.78:0/2415254492 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x558278b1e180 0x558278f29070 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfce6096cd18a6b5 server_cookie=d0acc813bc5736ac in_seq=0 out_seq=0 2024-09-17T03:09:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.662+0000 7f30d4ff9640 1 -- 172.21.15.78:0/2415254492 <== mds.0 v2:172.21.15.78:6834/2663458793 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558278e7b9d0 con 0x558278b1e180 2024-09-17T03:09:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.662+0000 7f30d4ff9640 10 client.5301 handle_command_reply: tid=0 2024-09-17T03:09:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.662+0000 7f3102a69740 1 client.5301 shutdown 2024-09-17T03:09:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.662+0000 7f3102a69740 1 -- 172.21.15.78:0/2415254492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b3e8d0 msgr2=0x558278f5f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.662+0000 7f3102a69740 1 --2- 172.21.15.78:0/2415254492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b3e8d0 0x558278f5f830 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f30e4001e40 tx=0x7f30e4001e70 comp rx=0 tx=0).stop 2024-09-17T03:09:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.662+0000 7f3102a69740 1 -- 172.21.15.78:0/2415254492 shutdown_connections 2024-09-17T03:09:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.662+0000 7f3102a69740 1 --2- 172.21.15.78:0/2415254492 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x558278b1e180 0x558278f29070 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.662+0000 7f3102a69740 1 --2- 172.21.15.78:0/2415254492 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558278b5f5b0 0x558278f2a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.662+0000 7f3102a69740 1 --2- 172.21.15.78:0/2415254492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b3e8d0 0x558278f5f830 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.662+0000 7f30d4ff9640 0 client.5301 ms_handle_reset on v2:172.21.15.78:6834/2663458793 2024-09-17T03:09:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.662+0000 7f3102a69740 1 --2- 172.21.15.78:0/2415254492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558278b366f0 0x558278f1ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.662+0000 7f3102a69740 1 -- 172.21.15.78:0/2415254492 >> 172.21.15.78:0/2415254492 conn(0x558278b53700 msgr2=0x558278f07060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:40.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.662+0000 7f3102a69740 1 -- 172.21.15.78:0/2415254492 shutdown_connections 2024-09-17T03:09:40.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.662+0000 7f3102a69740 1 -- 172.21.15.78:0/2415254492 wait complete. 2024-09-17T03:09:40.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.662+0000 7f3102a69740 20 client.5301 trim_cache size 0 max 16384 2024-09-17T03:09:40.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.681+0000 7f3102a69740 1 Processor -- start 2024-09-17T03:09:40.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.681+0000 7f3102a69740 1 -- start start 2024-09-17T03:09:40.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.682+0000 7f3102a69740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558278b366f0 0x558278f06d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.682+0000 7f3102a69740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b3e8d0 0x558278f07c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.682+0000 7f3102a69740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558278b5f5b0 0x558278f284c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.682+0000 7f3102a69740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f30f4202070 con 0x558278b3e8d0 2024-09-17T03:09:40.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.682+0000 7f3102a69740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f30f4201260 con 0x558278b5f5b0 2024-09-17T03:09:40.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.682+0000 7f3102a69740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f30f4201940 con 0x558278b366f0 2024-09-17T03:09:40.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.682+0000 7f30f9094640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b3e8d0 0x558278f07c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.682+0000 7f30f9094640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b3e8d0 0x558278f07c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53410/0 (socket says 172.21.15.78:53410) 2024-09-17T03:09:40.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.682+0000 7f30f9094640 1 -- 172.21.15.78:0/593954183 learned_addr learned my addr 172.21.15.78:0/593954183 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:40.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.682+0000 7f30f9895640 1 --2- 172.21.15.78:0/593954183 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558278b366f0 0x558278f06d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.682+0000 7f30fa096640 1 --2- 172.21.15.78:0/593954183 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558278b5f5b0 0x558278f284c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.682+0000 7f30f9094640 1 -- 172.21.15.78:0/593954183 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558278b366f0 msgr2=0x558278f06d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:40.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.682+0000 7f30f9094640 1 --2- 172.21.15.78:0/593954183 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558278b366f0 0x558278f06d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.682+0000 7f30f9094640 1 -- 172.21.15.78:0/593954183 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558278b5f5b0 msgr2=0x558278f284c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:40.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.682+0000 7f30f9094640 1 --2- 172.21.15.78:0/593954183 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558278b5f5b0 0x558278f284c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.682+0000 7f30f9094640 1 -- 172.21.15.78:0/593954183 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558278c41d20 con 0x558278b3e8d0 2024-09-17T03:09:40.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.682+0000 7f30fa096640 1 --2- 172.21.15.78:0/593954183 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558278b5f5b0 0x558278f284c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:40.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.683+0000 7f30f9094640 1 --2- 172.21.15.78:0/593954183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b3e8d0 0x558278f07c40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f30e4001e10 tx=0x7f30e4003af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe17f20fb3cf47b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:40.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.683+0000 7f30d6ffd640 1 -- 172.21.15.78:0/593954183 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e4010e90 con 0x558278b3e8d0 2024-09-17T03:09:40.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.683+0000 7f30d6ffd640 1 -- 172.21.15.78:0/593954183 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30e4029070 con 0x558278b3e8d0 2024-09-17T03:09:40.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.683+0000 7f30d6ffd640 1 -- 172.21.15.78:0/593954183 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e4010b60 con 0x558278b3e8d0 2024-09-17T03:09:40.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.683+0000 7f3102a69740 1 -- 172.21.15.78:0/593954183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b3e8d0 msgr2=0x558278f07c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:40.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.683+0000 7f3102a69740 1 --2- 172.21.15.78:0/593954183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b3e8d0 0x558278f07c40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f30e4001e10 tx=0x7f30e4003af0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.684+0000 7f3102a69740 1 -- 172.21.15.78:0/593954183 shutdown_connections 2024-09-17T03:09:40.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.684+0000 7f3102a69740 1 --2- 172.21.15.78:0/593954183 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558278b5f5b0 0x558278f284c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.684+0000 7f3102a69740 1 --2- 172.21.15.78:0/593954183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b3e8d0 0x558278f07c40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.684+0000 7f3102a69740 1 --2- 172.21.15.78:0/593954183 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558278b366f0 0x558278f06d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.684+0000 7f3102a69740 1 -- 172.21.15.78:0/593954183 >> 172.21.15.78:0/593954183 conn(0x558278b53700 msgr2=0x558278f44980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:40.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.684+0000 7f3102a69740 1 -- 172.21.15.78:0/593954183 shutdown_connections 2024-09-17T03:09:40.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.684+0000 7f3102a69740 1 -- 172.21.15.78:0/593954183 wait complete. 2024-09-17T03:09:40.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.684+0000 7f3102a69740 1 -- start start 2024-09-17T03:09:40.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.684+0000 7f3102a69740 1 Processor -- start 2024-09-17T03:09:40.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.686+0000 7f3102a69740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558278b366f0 0x558278f291f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.686+0000 7f3102a69740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558278b3e8d0 0x558278f42290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.686+0000 7f3102a69740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b5f5b0 0x558278f427d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.686+0000 7f3102a69740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x558278f438a0 con 0x558278b5f5b0 2024-09-17T03:09:40.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.686+0000 7f3102a69740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f30f41f5cb0 con 0x558278b3e8d0 2024-09-17T03:09:40.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.686+0000 7f3102a69740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x558278f03ac0 con 0x558278b366f0 2024-09-17T03:09:40.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.686+0000 7f3102a69740 10 client.0 _ll_register_callbacks cb 0x7f30e4007bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:09:40.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.686+0000 7f30fa096640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b5f5b0 0x558278f427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.686+0000 7f30fa096640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b5f5b0 0x558278f427d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53424/0 (socket says 172.21.15.78:53424) 2024-09-17T03:09:40.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.686+0000 7f30fa096640 1 -- 172.21.15.78:0/2274609113 learned_addr learned my addr 172.21.15.78:0/2274609113 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:40.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.686+0000 7f30f9895640 1 --2- 172.21.15.78:0/2274609113 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558278b366f0 0x558278f291f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.686+0000 7f30fa096640 1 -- 172.21.15.78:0/2274609113 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558278b366f0 msgr2=0x558278f291f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:40.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.686+0000 7f30fa096640 1 --2- 172.21.15.78:0/2274609113 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558278b366f0 0x558278f291f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.686+0000 7f30fa096640 1 -- 172.21.15.78:0/2274609113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558278b3e8d0 msgr2=0x558278f42290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:40.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.686+0000 7f30fa096640 1 --2- 172.21.15.78:0/2274609113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558278b3e8d0 0x558278f42290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.686+0000 7f30fa096640 1 -- 172.21.15.78:0/2274609113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558278f70020 con 0x558278b5f5b0 2024-09-17T03:09:40.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.686+0000 7f30fa096640 1 --2- 172.21.15.78:0/2274609113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b5f5b0 0x558278f427d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f30ec009f60 tx=0x7f30ec062dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b4ccb8a705c7c41 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:40.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.686+0000 7f30d4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:09:40.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.687+0000 7f30d4ff9640 1 -- 172.21.15.78:0/2274609113 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec06c130 con 0x558278b5f5b0 2024-09-17T03:09:40.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.687+0000 7f30d4ff9640 1 -- 172.21.15.78:0/2274609113 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f30ec05e0f0 con 0x558278b5f5b0 2024-09-17T03:09:40.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.687+0000 7f3102a69740 1 -- 172.21.15.78:0/2274609113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30e4029070 con 0x558278b5f5b0 2024-09-17T03:09:40.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.687+0000 7f30d4ff9640 1 -- 172.21.15.78:0/2274609113 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f30ec05e2f0 con 0x558278b5f5b0 2024-09-17T03:09:40.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.687+0000 7f3102a69740 10 client.5307 fetch_fsmap learned FSMap version 20 2024-09-17T03:09:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.687+0000 7f3102a69740 1 -- 172.21.15.78:0/2274609113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x558278f29730 con 0x558278b5f5b0 2024-09-17T03:09:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.687+0000 7f30d4ff9640 1 -- 172.21.15.78:0/2274609113 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30e4029070 con 0x558278b5f5b0 2024-09-17T03:09:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.687+0000 7f30d4ff9640 1 -- 172.21.15.78:0/2274609113 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 3554+0+0 (secure 0 0 0) 0x7f30ec063ad0 con 0x558278b5f5b0 2024-09-17T03:09:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.687+0000 7f3102a69740 10 client.5307 fetch_fsmap finished waiting for FSMap version 20 2024-09-17T03:09:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.687+0000 7f3102a69740 10 client.5307 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-17T03:09:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.687+0000 7f3102a69740 20 client.5307 populate_metadata read hostname 'smithi078' 2024-09-17T03:09:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.687+0000 7f3102a69740 1 --2- 172.21.15.78:0/2274609113 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x558278f01060 0x558278f01470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.687+0000 7f3102a69740 4 client.5307 mds_command: new command op to 4938 tid=0 multi_id=0 [{"prefix": "tag path", "path": "/d1/d2/d3", "tag": "tag123"}] 2024-09-17T03:09:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.687+0000 7f3102a69740 1 -- 172.21.15.78:0/2274609113 --> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] -- command(tid 0: {"prefix": "tag path", "path": "/d1/d2/d3", "tag": "tag123"}) -- 0x558278e77480 con 0x558278f01060 2024-09-17T03:09:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.687+0000 7f30f9895640 1 --2- 172.21.15.78:0/2274609113 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x558278f01060 0x558278f01470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.688+0000 7f30d4ff9640 10 client.5307 ms_handle_connect on v2:172.21.15.78:6834/2663458793 2024-09-17T03:09:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.688+0000 7f30f9895640 1 --2- 172.21.15.78:0/2274609113 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x558278f01060 0x558278f01470 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c29733559f11319 server_cookie=8df6e966e2d189f0 in_seq=0 out_seq=0 2024-09-17T03:09:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.688+0000 7f30d4ff9640 1 -- 172.21.15.78:0/2274609113 <== mds.0 v2:172.21.15.78:6834/2663458793 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x558278e77480 con 0x558278f01060 2024-09-17T03:09:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.688+0000 7f30d4ff9640 10 client.5307 handle_command_reply: tid=0 2024-09-17T03:09:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.689+0000 7f3102a69740 1 client.5307 shutdown 2024-09-17T03:09:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.689+0000 7f3102a69740 1 -- 172.21.15.78:0/2274609113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b5f5b0 msgr2=0x558278f427d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.689+0000 7f3102a69740 1 --2- 172.21.15.78:0/2274609113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b5f5b0 0x558278f427d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f30ec009f60 tx=0x7f30ec062dc0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.689+0000 7f3102a69740 1 -- 172.21.15.78:0/2274609113 shutdown_connections 2024-09-17T03:09:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.689+0000 7f3102a69740 1 --2- 172.21.15.78:0/2274609113 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x558278f01060 0x558278f01470 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.689+0000 7f3102a69740 1 --2- 172.21.15.78:0/2274609113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558278b5f5b0 0x558278f427d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.689+0000 7f3102a69740 1 --2- 172.21.15.78:0/2274609113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558278b3e8d0 0x558278f42290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.689+0000 7f3102a69740 1 --2- 172.21.15.78:0/2274609113 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558278b366f0 0x558278f291f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.689+0000 7f3102a69740 1 -- 172.21.15.78:0/2274609113 >> 172.21.15.78:0/2274609113 conn(0x558278b53700 msgr2=0x558278f5ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.689+0000 7f30d4ff9640 0 client.5307 ms_handle_reset on v2:172.21.15.78:6834/2663458793 2024-09-17T03:09:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.689+0000 7f3102a69740 1 -- 172.21.15.78:0/2274609113 shutdown_connections 2024-09-17T03:09:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.689+0000 7f3102a69740 1 -- 172.21.15.78:0/2274609113 wait complete. 2024-09-17T03:09:40.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.689+0000 7f3102a69740 20 client.5307 trim_cache size 0 max 16384 2024-09-17T03:09:40.695 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:09:40.695 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-17T03:09:40.695 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "tag123", 2024-09-17T03:09:40.695 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-17T03:09:40.695 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:09:40.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.690+0000 7f30fbaf9640 1 -- 172.21.15.78:0/2435761746 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f30d8078b90 msgr2=0x7f30d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:40.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.690+0000 7f30fbaf9640 1 --2- 172.21.15.78:0/2435761746 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f30d8078b90 0x7f30d807b0a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f30f0034000 tx=0x7f30f0004730 comp rx=0 tx=0).stop 2024-09-17T03:09:40.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.690+0000 7f30fbaf9640 1 -- 172.21.15.78:0/2435761746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f41601c0 msgr2=0x7f30f4150430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:40.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.690+0000 7f30fbaf9640 1 --2- 172.21.15.78:0/2435761746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f41601c0 0x7f30f4150430 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00ba10 tx=0x7f30ec00bed0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.690+0000 7f30fbaf9640 1 -- 172.21.15.78:0/2435761746 shutdown_connections 2024-09-17T03:09:40.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.690+0000 7f30fbaf9640 1 --2- 172.21.15.78:0/2435761746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30f41601c0 0x7f30f4150430 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.690+0000 7f30fbaf9640 1 --2- 172.21.15.78:0/2435761746 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30f40d0340 0x7f30f414fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.690+0000 7f30fbaf9640 1 --2- 172.21.15.78:0/2435761746 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f30d8078b90 0x7f30d807b0a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.690+0000 7f30fbaf9640 1 --2- 172.21.15.78:0/2435761746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f30f40cff30 0x7f30f406f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.690+0000 7f30fbaf9640 1 -- 172.21.15.78:0/2435761746 >> 172.21.15.78:0/2435761746 conn(0x7f30f4072a90 msgr2=0x7f30f40c66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:40.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.691+0000 7f30fbaf9640 1 -- 172.21.15.78:0/2435761746 shutdown_connections 2024-09-17T03:09:40.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.691+0000 7f30fbaf9640 1 -- 172.21.15.78:0/2435761746 wait complete. 2024-09-17T03:09:40.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:09:40.702 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-17T03:09:40.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.816+0000 7f94841ad640 1 -- 172.21.15.78:0/3583332382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f947c0ced10 msgr2=0x7f947c070550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:40.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.816+0000 7f94841ad640 1 --2- 172.21.15.78:0/3583332382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f947c0ced10 0x7f947c070550 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9474005fd0 tx=0x7f947402a5f0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.816+0000 7f94841ad640 1 -- 172.21.15.78:0/3583332382 shutdown_connections 2024-09-17T03:09:40.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.816+0000 7f94841ad640 1 --2- 172.21.15.78:0/3583332382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f947c0ced10 0x7f947c070550 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.816+0000 7f94841ad640 1 -- 172.21.15.78:0/3583332382 >> 172.21.15.78:0/3583332382 conn(0x7f947c0cd4b0 msgr2=0x7f947c0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:40.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.816+0000 7f94841ad640 1 -- 172.21.15.78:0/3583332382 shutdown_connections 2024-09-17T03:09:40.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.816+0000 7f94841ad640 1 -- 172.21.15.78:0/3583332382 wait complete. 2024-09-17T03:09:40.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.818+0000 7f94841ad640 1 Processor -- start 2024-09-17T03:09:40.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.818+0000 7f94841ad640 1 -- start start 2024-09-17T03:09:40.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.819+0000 7f94841ad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f947c06e100 0x7f947c0c7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.819+0000 7f94841ad640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f947c0afd70 0x7f947c14ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.819+0000 7f94841ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f947c1f6bd0 0x7f947c0b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.819+0000 7f94841ad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f947c070c10 con 0x7f947c1f6bd0 2024-09-17T03:09:40.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.819+0000 7f94841ad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f947c070a90 con 0x7f947c06e100 2024-09-17T03:09:40.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.819+0000 7f94841ad640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f947c070d90 con 0x7f947c0afd70 2024-09-17T03:09:40.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.819+0000 7f948274a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f947c1f6bd0 0x7f947c0b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.819+0000 7f948274a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f947c1f6bd0 0x7f947c0b4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53442/0 (socket says 172.21.15.78:53442) 2024-09-17T03:09:40.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.819+0000 7f948274a640 1 -- 172.21.15.78:0/3648415920 learned_addr learned my addr 172.21.15.78:0/3648415920 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:40.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.820+0000 7f9481748640 1 --2- 172.21.15.78:0/3648415920 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f947c0afd70 0x7f947c14ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.820+0000 7f9481f49640 1 --2- 172.21.15.78:0/3648415920 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f947c06e100 0x7f947c0c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.820+0000 7f948274a640 1 -- 172.21.15.78:0/3648415920 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f947c0afd70 msgr2=0x7f947c14ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:40.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.820+0000 7f948274a640 1 --2- 172.21.15.78:0/3648415920 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f947c0afd70 0x7f947c14ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.820+0000 7f948274a640 1 -- 172.21.15.78:0/3648415920 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f947c06e100 msgr2=0x7f947c0c7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:40.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.820+0000 7f948274a640 1 --2- 172.21.15.78:0/3648415920 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f947c06e100 0x7f947c0c7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.820+0000 7f948274a640 1 -- 172.21.15.78:0/3648415920 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f947c1f73b0 con 0x7f947c1f6bd0 2024-09-17T03:09:40.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.820+0000 7f948274a640 1 --2- 172.21.15.78:0/3648415920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f947c1f6bd0 0x7f947c0b4930 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9474006010 tx=0x7f9474003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:40.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.820+0000 7f947a7fc640 1 -- 172.21.15.78:0/3648415920 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947403e030 con 0x7f947c1f6bd0 2024-09-17T03:09:40.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.820+0000 7f947a7fc640 1 -- 172.21.15.78:0/3648415920 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9474003e50 con 0x7f947c1f6bd0 2024-09-17T03:09:40.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.820+0000 7f94841ad640 1 -- 172.21.15.78:0/3648415920 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f947c1f7690 con 0x7f947c1f6bd0 2024-09-17T03:09:40.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.820+0000 7f947a7fc640 1 -- 172.21.15.78:0/3648415920 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474035040 con 0x7f947c1f6bd0 2024-09-17T03:09:40.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.820+0000 7f94841ad640 1 -- 172.21.15.78:0/3648415920 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f947c153ca0 con 0x7f947c1f6bd0 2024-09-17T03:09:40.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.822+0000 7f947a7fc640 1 -- 172.21.15.78:0/3648415920 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9474041030 con 0x7f947c1f6bd0 2024-09-17T03:09:40.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.823+0000 7f947a7fc640 1 --2- 172.21.15.78:0/3648415920 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9468078b90 0x7f946807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.823+0000 7f947a7fc640 1 -- 172.21.15.78:0/3648415920 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f94740bb4f0 con 0x7f947c1f6bd0 2024-09-17T03:09:40.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.823+0000 7f9481f49640 1 --2- 172.21.15.78:0/3648415920 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9468078b90 0x7f946807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.823+0000 7f9481f49640 1 --2- 172.21.15.78:0/3648415920 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9468078b90 0x7f946807b0a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f946c0012e0 tx=0x7f946c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:40.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.823+0000 7f948b1fa740 1 Processor -- start 2024-09-17T03:09:40.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.823+0000 7f948b1fa740 1 -- start start 2024-09-17T03:09:40.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.825+0000 7f948b1fa740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46c4390 0x5584b4ab0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.825+0000 7f948b1fa740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b469b4d0 0x5584b4a85860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.825+0000 7f948b1fa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b46a36b0 0x5584b4a85da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.825+0000 7f948b1fa740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5584b49dea60 con 0x5584b469b4d0 2024-09-17T03:09:40.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.825+0000 7f948b1fa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5584b49cde90 con 0x5584b46a36b0 2024-09-17T03:09:40.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.825+0000 7f948b1fa740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5584b49d1ca0 con 0x5584b46c4390 2024-09-17T03:09:40.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.825+0000 7f9481748640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b469b4d0 0x5584b4a85860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.825+0000 7f9481f49640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46c4390 0x5584b4ab0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.825+0000 7f9481f49640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46c4390 0x5584b4ab0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.78:47736/0 (socket says 172.21.15.78:47736) 2024-09-17T03:09:40.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.825+0000 7f9481748640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b469b4d0 0x5584b4a85860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53444/0 (socket says 172.21.15.78:53444) 2024-09-17T03:09:40.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.825+0000 7f9481f49640 1 -- 172.21.15.78:0/3305426361 learned_addr learned my addr 172.21.15.78:0/3305426361 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:40.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.825+0000 7f948274a640 1 --2- 172.21.15.78:0/3305426361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b46a36b0 0x5584b4a85da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.825+0000 7f9481f49640 1 -- 172.21.15.78:0/3305426361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b46a36b0 msgr2=0x5584b4a85da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:40.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.825+0000 7f9481f49640 1 --2- 172.21.15.78:0/3305426361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b46a36b0 0x5584b4a85da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.825+0000 7f9481f49640 1 -- 172.21.15.78:0/3305426361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b469b4d0 msgr2=0x5584b4a85860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:40.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.825+0000 7f9481f49640 1 --2- 172.21.15.78:0/3305426361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b469b4d0 0x5584b4a85860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.825+0000 7f9481f49640 1 -- 172.21.15.78:0/3305426361 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b47a67d0 con 0x5584b46c4390 2024-09-17T03:09:40.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.825+0000 7f9481748640 1 --2- 172.21.15.78:0/3305426361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b469b4d0 0x5584b4a85860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:09:40.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.825+0000 7f9481f49640 1 --2- 172.21.15.78:0/3305426361 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46c4390 0x5584b4ab0a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f946c002000 tx=0x7f946c012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65457ca054dd965f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:40.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.826+0000 7f94637fe640 1 -- 172.21.15.78:0/3305426361 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c025070 con 0x5584b46c4390 2024-09-17T03:09:40.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.826+0000 7f94637fe640 1 -- 172.21.15.78:0/3305426361 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f946c01b050 con 0x5584b46c4390 2024-09-17T03:09:40.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.826+0000 7f94637fe640 1 -- 172.21.15.78:0/3305426361 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c020630 con 0x5584b46c4390 2024-09-17T03:09:40.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.826+0000 7f948b1fa740 1 -- 172.21.15.78:0/3305426361 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46c4390 msgr2=0x5584b4ab0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:40.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.826+0000 7f948b1fa740 1 --2- 172.21.15.78:0/3305426361 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46c4390 0x5584b4ab0a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f946c002000 tx=0x7f946c012000 comp rx=0 tx=0).stop 2024-09-17T03:09:40.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.826+0000 7f948b1fa740 1 -- 172.21.15.78:0/3305426361 shutdown_connections 2024-09-17T03:09:40.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.826+0000 7f948b1fa740 1 --2- 172.21.15.78:0/3305426361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b46a36b0 0x5584b4a85da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.826+0000 7f948b1fa740 1 --2- 172.21.15.78:0/3305426361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b469b4d0 0x5584b4a85860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.826+0000 7f948b1fa740 1 --2- 172.21.15.78:0/3305426361 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46c4390 0x5584b4ab0a10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.826+0000 7f948b1fa740 1 -- 172.21.15.78:0/3305426361 >> 172.21.15.78:0/3305426361 conn(0x5584b46b84e0 msgr2=0x5584b4a6bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:40.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.826+0000 7f948b1fa740 1 -- 172.21.15.78:0/3305426361 shutdown_connections 2024-09-17T03:09:40.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.826+0000 7f948b1fa740 1 -- 172.21.15.78:0/3305426361 wait complete. 2024-09-17T03:09:40.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.827+0000 7f948b1fa740 1 -- start start 2024-09-17T03:09:40.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.827+0000 7f948b1fa740 1 Processor -- start 2024-09-17T03:09:40.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.829+0000 7f948b1fa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b469b4d0 0x5584b4a93e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.829+0000 7f948b1fa740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46a36b0 0x5584b4abf490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.829+0000 7f948b1fa740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b46c4390 0x5584b4aaa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.829+0000 7f948b1fa740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5584b473e740 con 0x5584b46c4390 2024-09-17T03:09:40.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.829+0000 7f948b1fa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5584b4973970 con 0x5584b469b4d0 2024-09-17T03:09:40.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.829+0000 7f948b1fa740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5584b4a94900 con 0x5584b46a36b0 2024-09-17T03:09:40.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.829+0000 7f948b1fa740 10 client.0 _ll_register_callbacks cb 0x5584b4982780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:09:40.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.829+0000 7f948274a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b46c4390 0x5584b4aaa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.829+0000 7f948274a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b46c4390 0x5584b4aaa4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53452/0 (socket says 172.21.15.78:53452) 2024-09-17T03:09:40.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.829+0000 7f948274a640 1 -- 172.21.15.78:0/1015630763 learned_addr learned my addr 172.21.15.78:0/1015630763 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:40.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.829+0000 7f9481f49640 1 --2- 172.21.15.78:0/1015630763 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b469b4d0 0x5584b4a93e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.829+0000 7f9481748640 1 --2- 172.21.15.78:0/1015630763 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46a36b0 0x5584b4abf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.829+0000 7f948274a640 1 -- 172.21.15.78:0/1015630763 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46a36b0 msgr2=0x5584b4abf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:40.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.829+0000 7f948274a640 1 --2- 172.21.15.78:0/1015630763 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46a36b0 0x5584b4abf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.829+0000 7f948274a640 1 -- 172.21.15.78:0/1015630763 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b469b4d0 msgr2=0x5584b4a93e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:40.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.829+0000 7f948274a640 1 --2- 172.21.15.78:0/1015630763 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b469b4d0 0x5584b4a93e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.829+0000 7f948274a640 1 -- 172.21.15.78:0/1015630763 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584b472f970 con 0x5584b46c4390 2024-09-17T03:09:40.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.829+0000 7f948274a640 1 --2- 172.21.15.78:0/1015630763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b46c4390 0x5584b4aaa4b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9474080550 tx=0x7f947407f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d66f3c92e96f53 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:40.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.829+0000 7f9460ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:09:40.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.830+0000 7f9460ff9640 1 -- 172.21.15.78:0/1015630763 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474048040 con 0x5584b46c4390 2024-09-17T03:09:40.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.830+0000 7f9460ff9640 1 -- 172.21.15.78:0/1015630763 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f947408c7c0 con 0x5584b46c4390 2024-09-17T03:09:40.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.830+0000 7f948b1fa740 1 -- 172.21.15.78:0/1015630763 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f946c01b050 con 0x5584b46c4390 2024-09-17T03:09:40.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.830+0000 7f9460ff9640 1 -- 172.21.15.78:0/1015630763 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f94740832e0 con 0x5584b46c4390 2024-09-17T03:09:40.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.830+0000 7f948b1fa740 10 client.5322 fetch_fsmap learned FSMap version 20 2024-09-17T03:09:40.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.830+0000 7f948b1fa740 1 -- 172.21.15.78:0/1015630763 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5584b470d6a0 con 0x5584b46c4390 2024-09-17T03:09:40.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.830+0000 7f9460ff9640 1 -- 172.21.15.78:0/1015630763 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f946c01b050 con 0x5584b46c4390 2024-09-17T03:09:40.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.830+0000 7f9460ff9640 1 -- 172.21.15.78:0/1015630763 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 3554+0+0 (secure 0 0 0) 0x7f9474082540 con 0x5584b46c4390 2024-09-17T03:09:40.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.830+0000 7f948b1fa740 10 client.5322 fetch_fsmap finished waiting for FSMap version 20 2024-09-17T03:09:40.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.830+0000 7f948b1fa740 10 client.5322 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-17T03:09:40.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.830+0000 7f948b1fa740 20 client.5322 populate_metadata read hostname 'smithi078' 2024-09-17T03:09:40.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.830+0000 7f948b1fa740 1 --2- 172.21.15.78:0/1015630763 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x5584b4682f60 0x5584b4aa7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.830+0000 7f948b1fa740 4 client.5322 mds_command: new command op to 4938 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:09:40.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.830+0000 7f948b1fa740 1 -- 172.21.15.78:0/1015630763 --> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584b49e09b0 con 0x5584b4682f60 2024-09-17T03:09:40.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.830+0000 7f9481f49640 1 --2- 172.21.15.78:0/1015630763 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x5584b4682f60 0x5584b4aa7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.831+0000 7f9460ff9640 10 client.5322 ms_handle_connect on v2:172.21.15.78:6834/2663458793 2024-09-17T03:09:40.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.831+0000 7f9481f49640 1 --2- 172.21.15.78:0/1015630763 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x5584b4682f60 0x5584b4aa7970 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc1b652884b2590f server_cookie=f185cf05c9a1b39d in_seq=0 out_seq=0 2024-09-17T03:09:40.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.831+0000 7f9460ff9640 1 -- 172.21.15.78:0/1015630763 <== mds.0 v2:172.21.15.78:6834/2663458793 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5584b49e09b0 con 0x5584b4682f60 2024-09-17T03:09:40.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.831+0000 7f9460ff9640 10 client.5322 handle_command_reply: tid=0 2024-09-17T03:09:40.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.831+0000 7f948b1fa740 1 client.5322 shutdown 2024-09-17T03:09:40.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.831+0000 7f948b1fa740 1 -- 172.21.15.78:0/1015630763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b46c4390 msgr2=0x5584b4aaa4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:40.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.831+0000 7f948b1fa740 1 --2- 172.21.15.78:0/1015630763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b46c4390 0x5584b4aaa4b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9474080550 tx=0x7f947407f7d0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.832+0000 7f948b1fa740 1 -- 172.21.15.78:0/1015630763 shutdown_connections 2024-09-17T03:09:40.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.832+0000 7f948b1fa740 1 --2- 172.21.15.78:0/1015630763 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x5584b4682f60 0x5584b4aa7970 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.832+0000 7f948b1fa740 1 --2- 172.21.15.78:0/1015630763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b46c4390 0x5584b4aaa4b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.832+0000 7f948b1fa740 1 --2- 172.21.15.78:0/1015630763 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46a36b0 0x5584b4abf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.832+0000 7f9460ff9640 0 client.5322 ms_handle_reset on v2:172.21.15.78:6834/2663458793 2024-09-17T03:09:40.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.832+0000 7f948b1fa740 1 --2- 172.21.15.78:0/1015630763 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b469b4d0 0x5584b4a93e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.832+0000 7f948b1fa740 1 -- 172.21.15.78:0/1015630763 >> 172.21.15.78:0/1015630763 conn(0x5584b46b84e0 msgr2=0x5584b4a85e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:40.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.832+0000 7f948b1fa740 1 -- 172.21.15.78:0/1015630763 shutdown_connections 2024-09-17T03:09:40.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.832+0000 7f948b1fa740 1 -- 172.21.15.78:0/1015630763 wait complete. 2024-09-17T03:09:40.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.832+0000 7f948b1fa740 20 client.5322 trim_cache size 0 max 16384 2024-09-17T03:09:40.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.849+0000 7f948b1fa740 1 Processor -- start 2024-09-17T03:09:40.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.849+0000 7f948b1fa740 1 -- start start 2024-09-17T03:09:40.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f948b1fa740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b469b4d0 0x5584b4a66c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f948b1fa740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46a36b0 0x5584b4a91930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f948b1fa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b46c4390 0x5584b4a91e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f948b1fa740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f947c1fff40 con 0x5584b469b4d0 2024-09-17T03:09:40.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f948b1fa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f947c1ff110 con 0x5584b46c4390 2024-09-17T03:09:40.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f948b1fa740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f947c1ff810 con 0x5584b46a36b0 2024-09-17T03:09:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f9481f49640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b469b4d0 0x5584b4a66c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f9481f49640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b469b4d0 0x5584b4a66c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53458/0 (socket says 172.21.15.78:53458) 2024-09-17T03:09:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f9481f49640 1 -- 172.21.15.78:0/3427692907 learned_addr learned my addr 172.21.15.78:0/3427692907 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f9481748640 1 --2- 172.21.15.78:0/3427692907 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46a36b0 0x5584b4a91930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f948274a640 1 --2- 172.21.15.78:0/3427692907 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b46c4390 0x5584b4a91e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f9481f49640 1 -- 172.21.15.78:0/3427692907 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46a36b0 msgr2=0x5584b4a91930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f9481f49640 1 --2- 172.21.15.78:0/3427692907 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46a36b0 0x5584b4a91930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f9481f49640 1 -- 172.21.15.78:0/3427692907 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b46c4390 msgr2=0x5584b4a91e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f9481f49640 1 --2- 172.21.15.78:0/3427692907 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b46c4390 0x5584b4a91e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f9481f49640 1 -- 172.21.15.78:0/3427692907 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584b4a93310 con 0x5584b469b4d0 2024-09-17T03:09:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f9481748640 1 --2- 172.21.15.78:0/3427692907 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46a36b0 0x5584b4a91930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:09:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f9481f49640 1 --2- 172.21.15.78:0/3427692907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b469b4d0 0x5584b4a66c10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f946c00ffd0 tx=0x7f946c001400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f51b6d03e2da6ad server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f9462ffd640 1 -- 172.21.15.78:0/3427692907 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c025040 con 0x5584b469b4d0 2024-09-17T03:09:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f9462ffd640 1 -- 172.21.15.78:0/3427692907 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f946c01b040 con 0x5584b469b4d0 2024-09-17T03:09:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.851+0000 7f9462ffd640 1 -- 172.21.15.78:0/3427692907 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946c020b20 con 0x5584b469b4d0 2024-09-17T03:09:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.852+0000 7f948b1fa740 1 -- 172.21.15.78:0/3427692907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b469b4d0 msgr2=0x5584b4a66c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.852+0000 7f948b1fa740 1 --2- 172.21.15.78:0/3427692907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b469b4d0 0x5584b4a66c10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f946c00ffd0 tx=0x7f946c001400 comp rx=0 tx=0).stop 2024-09-17T03:09:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.852+0000 7f948b1fa740 1 -- 172.21.15.78:0/3427692907 shutdown_connections 2024-09-17T03:09:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.852+0000 7f948b1fa740 1 --2- 172.21.15.78:0/3427692907 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b46c4390 0x5584b4a91e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.852+0000 7f948b1fa740 1 --2- 172.21.15.78:0/3427692907 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46a36b0 0x5584b4a91930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.852+0000 7f948b1fa740 1 --2- 172.21.15.78:0/3427692907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b469b4d0 0x5584b4a66c10 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.852+0000 7f948b1fa740 1 -- 172.21.15.78:0/3427692907 >> 172.21.15.78:0/3427692907 conn(0x5584b46b84e0 msgr2=0x5584b4a614f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.852+0000 7f948b1fa740 1 -- 172.21.15.78:0/3427692907 shutdown_connections 2024-09-17T03:09:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.852+0000 7f948b1fa740 1 -- 172.21.15.78:0/3427692907 wait complete. 2024-09-17T03:09:40.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.853+0000 7f948b1fa740 1 -- start start 2024-09-17T03:09:40.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.853+0000 7f948b1fa740 1 Processor -- start 2024-09-17T03:09:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.854+0000 7f948b1fa740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b469b4d0 0x5584b4a91930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.854+0000 7f948b1fa740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b46a36b0 0x5584b4b16220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.854+0000 7f948b1fa740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46c4390 0x5584b4b33af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.854+0000 7f948b1fa740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5584b4abf6e0 con 0x5584b46a36b0 2024-09-17T03:09:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.854+0000 7f948b1fa740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f947c06db60 con 0x5584b469b4d0 2024-09-17T03:09:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.854+0000 7f948b1fa740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5584b4b348f0 con 0x5584b46c4390 2024-09-17T03:09:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.855+0000 7f948b1fa740 10 client.0 _ll_register_callbacks cb 0x7f947407f980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:09:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.855+0000 7f9481748640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b46a36b0 0x5584b4b16220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.855+0000 7f9481748640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b46a36b0 0x5584b4b16220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53468/0 (socket says 172.21.15.78:53468) 2024-09-17T03:09:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.855+0000 7f9481748640 1 -- 172.21.15.78:0/2292882292 learned_addr learned my addr 172.21.15.78:0/2292882292 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:09:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.855+0000 7f948274a640 1 --2- 172.21.15.78:0/2292882292 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46c4390 0x5584b4b33af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.855+0000 7f9481f49640 1 --2- 172.21.15.78:0/2292882292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b469b4d0 0x5584b4a91930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.855+0000 7f9481748640 1 -- 172.21.15.78:0/2292882292 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46c4390 msgr2=0x5584b4b33af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:40.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.855+0000 7f9481748640 1 --2- 172.21.15.78:0/2292882292 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46c4390 0x5584b4b33af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.855+0000 7f9481748640 1 -- 172.21.15.78:0/2292882292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b469b4d0 msgr2=0x5584b4a91930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:09:40.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.855+0000 7f9481748640 1 --2- 172.21.15.78:0/2292882292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b469b4d0 0x5584b4a91930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.855+0000 7f9481748640 1 -- 172.21.15.78:0/2292882292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584b4a850e0 con 0x5584b46a36b0 2024-09-17T03:09:40.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.855+0000 7f9481f49640 1 --2- 172.21.15.78:0/2292882292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b469b4d0 0x5584b4a91930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:09:40.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.855+0000 7f9481748640 1 --2- 172.21.15.78:0/2292882292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b46a36b0 0x5584b4b16220 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9470000f60 tx=0x7f9470001850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1581f569382644b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:09:40.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.855+0000 7f9460ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:09:40.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.855+0000 7f9460ff9640 1 -- 172.21.15.78:0/2292882292 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470016630 con 0x5584b46a36b0 2024-09-17T03:09:40.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.855+0000 7f9460ff9640 1 -- 172.21.15.78:0/2292882292 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f94700167d0 con 0x5584b46a36b0 2024-09-17T03:09:40.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.855+0000 7f948b1fa740 1 -- 172.21.15.78:0/2292882292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f946c01b040 con 0x5584b46a36b0 2024-09-17T03:09:40.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.855+0000 7f9460ff9640 1 -- 172.21.15.78:0/2292882292 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f9470027050 con 0x5584b46a36b0 2024-09-17T03:09:40.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.855+0000 7f948b1fa740 10 client.5328 fetch_fsmap learned FSMap version 20 2024-09-17T03:09:40.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.855+0000 7f948b1fa740 1 -- 172.21.15.78:0/2292882292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x5584b4b34630 con 0x5584b46a36b0 2024-09-17T03:09:40.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.856+0000 7f9460ff9640 1 -- 172.21.15.78:0/2292882292 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f946c01b040 con 0x5584b46a36b0 2024-09-17T03:09:40.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.856+0000 7f9460ff9640 1 -- 172.21.15.78:0/2292882292 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 20) ==== 3554+0+0 (secure 0 0 0) 0x7f947002a020 con 0x5584b46a36b0 2024-09-17T03:09:40.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.856+0000 7f948b1fa740 10 client.5328 fetch_fsmap finished waiting for FSMap version 20 2024-09-17T03:09:40.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.856+0000 7f948b1fa740 10 client.5328 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-17T03:09:40.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.856+0000 7f948b1fa740 20 client.5328 populate_metadata read hostname 'smithi078' 2024-09-17T03:09:40.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.856+0000 7f948b1fa740 1 --2- 172.21.15.78:0/2292882292 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x5584b4b311a0 0x5584b4b34030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:09:40.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.856+0000 7f948b1fa740 4 client.5328 mds_command: new command op to 4938 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:09:40.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.856+0000 7f948b1fa740 1 -- 172.21.15.78:0/2292882292 --> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5584b49dc460 con 0x5584b4b311a0 2024-09-17T03:09:40.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.856+0000 7f9481f49640 1 --2- 172.21.15.78:0/2292882292 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x5584b4b311a0 0x5584b4b34030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:09:40.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.856+0000 7f9460ff9640 10 client.5328 ms_handle_connect on v2:172.21.15.78:6834/2663458793 2024-09-17T03:09:40.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.856+0000 7f9481f49640 1 --2- 172.21.15.78:0/2292882292 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x5584b4b311a0 0x5584b4b34030 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7dd7cff3d004e45 server_cookie=a93fa9778021ddd7 in_seq=0 out_seq=0 2024-09-17T03:09:40.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.856+0000 7f9460ff9640 1 -- 172.21.15.78:0/2292882292 <== mds.0 v2:172.21.15.78:6834/2663458793 1 ==== command_reply(tid 0: 0 ) ==== 8+0+496 (crc 0 0 0) 0x5584b49dc460 con 0x5584b4b311a0 2024-09-17T03:09:40.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.856+0000 7f9460ff9640 10 client.5328 handle_command_reply: tid=0 2024-09-17T03:09:40.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.856+0000 7f948b1fa740 1 client.5328 shutdown 2024-09-17T03:09:40.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f948b1fa740 1 -- 172.21.15.78:0/2292882292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b46a36b0 msgr2=0x5584b4b16220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:40.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f948b1fa740 1 --2- 172.21.15.78:0/2292882292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b46a36b0 0x5584b4b16220 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9470000f60 tx=0x7f9470001850 comp rx=0 tx=0).stop 2024-09-17T03:09:40.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f948b1fa740 1 -- 172.21.15.78:0/2292882292 shutdown_connections 2024-09-17T03:09:40.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f948b1fa740 1 --2- 172.21.15.78:0/2292882292 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x5584b4b311a0 0x5584b4b34030 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f948b1fa740 1 --2- 172.21.15.78:0/2292882292 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584b46c4390 0x5584b4b33af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f948b1fa740 1 --2- 172.21.15.78:0/2292882292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584b46a36b0 0x5584b4b16220 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f9460ff9640 0 client.5328 ms_handle_reset on v2:172.21.15.78:6834/2663458793 2024-09-17T03:09:40.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f948b1fa740 1 --2- 172.21.15.78:0/2292882292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584b469b4d0 0x5584b4a91930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f948b1fa740 1 -- 172.21.15.78:0/2292882292 >> 172.21.15.78:0/2292882292 conn(0x5584b46b84e0 msgr2=0x5584b4a95b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:40.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f948b1fa740 1 -- 172.21.15.78:0/2292882292 shutdown_connections 2024-09-17T03:09:40.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f948b1fa740 1 -- 172.21.15.78:0/2292882292 wait complete. 2024-09-17T03:09:40.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f948b1fa740 20 client.5328 trim_cache size 0 max 16384 2024-09-17T03:09:40.863 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:09:40.863 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T03:09:40.863 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:09:40.863 INFO:teuthology.orchestra.run.smithi078.stdout: "tag123": { 2024-09-17T03:09:40.863 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:09:40.863 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "tag123", 2024-09-17T03:09:40.863 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:09:40.863 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:40.864 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:09:40.864 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-17T03:09:40.864 INFO:teuthology.orchestra.run.smithi078.stdout: "tag123": { 2024-09-17T03:09:40.864 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-17T03:09:40.688984+0000", 2024-09-17T03:09:40.864 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:09:40.864 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-17T03:09:40.864 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-17T03:09:40.864 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-17T03:09:40.864 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-17T03:09:40.864 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:40.864 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:09:40.864 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:09:40.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f94841ad640 1 -- 172.21.15.78:0/3648415920 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9468078b90 msgr2=0x7f946807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:40.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f94841ad640 1 --2- 172.21.15.78:0/3648415920 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9468078b90 0x7f946807b0a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f946c0012e0 tx=0x7f946c009040 comp rx=0 tx=0).stop 2024-09-17T03:09:40.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f94841ad640 1 -- 172.21.15.78:0/3648415920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f947c1f6bd0 msgr2=0x7f947c0b4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:09:40.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f94841ad640 1 --2- 172.21.15.78:0/3648415920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f947c1f6bd0 0x7f947c0b4930 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9474006010 tx=0x7f9474003960 comp rx=0 tx=0).stop 2024-09-17T03:09:40.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f94841ad640 1 -- 172.21.15.78:0/3648415920 shutdown_connections 2024-09-17T03:09:40.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f94841ad640 1 --2- 172.21.15.78:0/3648415920 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f947c1f6bd0 0x7f947c0b4930 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f94841ad640 1 --2- 172.21.15.78:0/3648415920 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f947c0afd70 0x7f947c14ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f94841ad640 1 --2- 172.21.15.78:0/3648415920 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9468078b90 0x7f946807b0a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f94841ad640 1 --2- 172.21.15.78:0/3648415920 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f947c06e100 0x7f947c0c7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:09:40.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.857+0000 7f94841ad640 1 -- 172.21.15.78:0/3648415920 >> 172.21.15.78:0/3648415920 conn(0x7f947c0cd4b0 msgr2=0x7f947c0b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:09:40.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.858+0000 7f94841ad640 1 -- 172.21.15.78:0/3648415920 shutdown_connections 2024-09-17T03:09:40.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:09:40.858+0000 7f94841ad640 1 -- 172.21.15.78:0/3648415920 wait complete. 2024-09-17T03:09:40.868 INFO:tasks.cephfs.filesystem:scrub status for tag:tag123 - {'path': '/d1/d2/d3', 'tag': 'tag123', 'options': 'recursive,force'} 2024-09-17T03:09:54.870 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:09:54.873 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:10:10.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:10:10.869 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.2:0 scrub status 2024-09-17T03:10:10.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:10.998+0000 7f3cc2d90640 1 -- 172.21.15.78:0/3381960588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cbc072ff0 msgr2=0x7f3cbc073400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:10.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:10.998+0000 7f3cc2d90640 1 --2- 172.21.15.78:0/3381960588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cbc072ff0 0x7f3cbc073400 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4005fd0 tx=0x7f3cb402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:10:10.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:10.998+0000 7f3cc2d90640 1 -- 172.21.15.78:0/3381960588 shutdown_connections 2024-09-17T03:10:10.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:10.998+0000 7f3cc2d90640 1 --2- 172.21.15.78:0/3381960588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cbc072ff0 0x7f3cbc073400 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:10.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:10.998+0000 7f3cc2d90640 1 --2- 172.21.15.78:0/3381960588 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3cbc0af780 0x7f3cbc0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:10.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:10.998+0000 7f3cc2d90640 1 -- 172.21.15.78:0/3381960588 >> 172.21.15.78:0/3381960588 conn(0x7f3cbc06d7d0 msgr2=0x7f3cbc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:10.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:10.998+0000 7f3cc2d90640 1 -- 172.21.15.78:0/3381960588 shutdown_connections 2024-09-17T03:10:10.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:10.998+0000 7f3cc2d90640 1 -- 172.21.15.78:0/3381960588 wait complete. 2024-09-17T03:10:10.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.000+0000 7f3cc2d90640 1 Processor -- start 2024-09-17T03:10:10.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.000+0000 7f3cc2d90640 1 -- start start 2024-09-17T03:10:11.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.001+0000 7f3cc2d90640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3cbc072ff0 0x7f3cbc150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.001+0000 7f3cc2d90640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cbc0af780 0x7f3cbc1508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.001+0000 7f3cc2d90640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3cbc0cd3e0 0x7f3cbc150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.001+0000 7f3cc2d90640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3cbc073d10 con 0x7f3cbc0af780 2024-09-17T03:10:11.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.001+0000 7f3cc2d90640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3cbc073b90 con 0x7f3cbc072ff0 2024-09-17T03:10:11.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.001+0000 7f3cc2d90640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3cbc15f930 con 0x7f3cbc0cd3e0 2024-09-17T03:10:11.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.001+0000 7f3cbbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cbc0af780 0x7f3cbc1508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.001+0000 7f3cbbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cbc0af780 0x7f3cbc1508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32778/0 (socket says 172.21.15.78:32778) 2024-09-17T03:10:11.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.001+0000 7f3cbbfff640 1 -- 172.21.15.78:0/1507107144 learned_addr learned my addr 172.21.15.78:0/1507107144 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:11.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.001+0000 7f3cc132d640 1 --2- 172.21.15.78:0/1507107144 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3cbc0cd3e0 0x7f3cbc150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.001+0000 7f3cc0b2c640 1 --2- 172.21.15.78:0/1507107144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3cbc072ff0 0x7f3cbc150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.001+0000 7f3cbbfff640 1 -- 172.21.15.78:0/1507107144 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3cbc0cd3e0 msgr2=0x7f3cbc150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.001+0000 7f3cbbfff640 1 --2- 172.21.15.78:0/1507107144 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3cbc0cd3e0 0x7f3cbc150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.002+0000 7f3cbbfff640 1 -- 172.21.15.78:0/1507107144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3cbc072ff0 msgr2=0x7f3cbc150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.002+0000 7f3cbbfff640 1 --2- 172.21.15.78:0/1507107144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3cbc072ff0 0x7f3cbc150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.002+0000 7f3cbbfff640 1 -- 172.21.15.78:0/1507107144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cbc0c7450 con 0x7f3cbc0af780 2024-09-17T03:10:11.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.002+0000 7f3cbbfff640 1 --2- 172.21.15.78:0/1507107144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cbc0af780 0x7f3cbc1508b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000c3a0 tx=0x7f3cb000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.002+0000 7f3cb97fa640 1 -- 172.21.15.78:0/1507107144 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0011790 con 0x7f3cbc0af780 2024-09-17T03:10:11.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.002+0000 7f3cb97fa640 1 -- 172.21.15.78:0/1507107144 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cb0017070 con 0x7f3cbc0af780 2024-09-17T03:10:11.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.002+0000 7f3cc2d90640 1 -- 172.21.15.78:0/1507107144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cbc0c7730 con 0x7f3cbc0af780 2024-09-17T03:10:11.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.002+0000 7f3cb97fa640 1 -- 172.21.15.78:0/1507107144 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0011cc0 con 0x7f3cbc0af780 2024-09-17T03:10:11.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.002+0000 7f3cc2d90640 1 -- 172.21.15.78:0/1507107144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cbc1513f0 con 0x7f3cbc0af780 2024-09-17T03:10:11.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.004+0000 7f3cb97fa640 1 -- 172.21.15.78:0/1507107144 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3cb001c460 con 0x7f3cbc0af780 2024-09-17T03:10:11.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.005+0000 7f3cb97fa640 1 --2- 172.21.15.78:0/1507107144 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3ca8078b90 0x7f3ca807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.005+0000 7f3cb97fa640 1 -- 172.21.15.78:0/1507107144 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3cb009a9f0 con 0x7f3cbc0af780 2024-09-17T03:10:11.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.005+0000 7f3cc0b2c640 1 --2- 172.21.15.78:0/1507107144 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3ca8078b90 0x7f3ca807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.005+0000 7f3cc9ddc740 1 Processor -- start 2024-09-17T03:10:11.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.006+0000 7f3cc9ddc740 1 -- start start 2024-09-17T03:10:11.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.006+0000 7f3cc0b2c640 1 --2- 172.21.15.78:0/1507107144 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3ca8078b90 0x7f3ca807b0a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3cac005fd0 tx=0x7f3cac005850 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.007+0000 7f3cc9ddc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e32390 0x55a7e621fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.007+0000 7f3cc9ddc740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e094d0 0x55a7e61d5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.007+0000 7f3cc9ddc740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 0x55a7e6200810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.007+0000 7f3cc9ddc740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a7e614ca60 con 0x55a7e5e116b0 2024-09-17T03:10:11.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.007+0000 7f3cc9ddc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a7e613be90 con 0x55a7e5e32390 2024-09-17T03:10:11.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.007+0000 7f3cc9ddc740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a7e613fca0 con 0x55a7e5e094d0 2024-09-17T03:10:11.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.007+0000 7f3cc132d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 0x55a7e6200810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.007+0000 7f3cc132d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 0x55a7e6200810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32788/0 (socket says 172.21.15.78:32788) 2024-09-17T03:10:11.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.007+0000 7f3cc132d640 1 -- 172.21.15.78:0/4202313760 learned_addr learned my addr 172.21.15.78:0/4202313760 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:11.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.007+0000 7f3cc0b2c640 1 --2- 172.21.15.78:0/4202313760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e32390 0x55a7e621fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.007+0000 7f3cbbfff640 1 --2- 172.21.15.78:0/4202313760 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e094d0 0x55a7e61d5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.007+0000 7f3cc132d640 1 -- 172.21.15.78:0/4202313760 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e094d0 msgr2=0x55a7e61d5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:11.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.007+0000 7f3cc132d640 1 --2- 172.21.15.78:0/4202313760 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e094d0 0x55a7e61d5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.007+0000 7f3cc132d640 1 -- 172.21.15.78:0/4202313760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e32390 msgr2=0x55a7e621fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:11.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.007+0000 7f3cc132d640 1 --2- 172.21.15.78:0/4202313760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e32390 0x55a7e621fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.007+0000 7f3cc132d640 1 -- 172.21.15.78:0/4202313760 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7e5f147d0 con 0x55a7e5e116b0 2024-09-17T03:10:11.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.007+0000 7f3cbbfff640 1 --2- 172.21.15.78:0/4202313760 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e094d0 0x55a7e61d5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:11.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.007+0000 7f3cc132d640 1 --2- 172.21.15.78:0/4202313760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 0x55a7e6200810 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4006010 tx=0x7f3cb4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a96512d1b0fce6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.008+0000 7f3ca27fc640 1 -- 172.21.15.78:0/4202313760 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4004040 con 0x55a7e5e116b0 2024-09-17T03:10:11.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.008+0000 7f3ca27fc640 1 -- 172.21.15.78:0/4202313760 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cb4040070 con 0x55a7e5e116b0 2024-09-17T03:10:11.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.008+0000 7f3ca27fc640 1 -- 172.21.15.78:0/4202313760 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4004570 con 0x55a7e5e116b0 2024-09-17T03:10:11.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.008+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/4202313760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 msgr2=0x55a7e6200810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.008+0000 7f3cc9ddc740 1 --2- 172.21.15.78:0/4202313760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 0x55a7e6200810 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4006010 tx=0x7f3cb4004a40 comp rx=0 tx=0).stop 2024-09-17T03:10:11.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.008+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/4202313760 shutdown_connections 2024-09-17T03:10:11.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.008+0000 7f3cc9ddc740 1 --2- 172.21.15.78:0/4202313760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 0x55a7e6200810 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.008+0000 7f3cc9ddc740 1 --2- 172.21.15.78:0/4202313760 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e094d0 0x55a7e61d5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.008+0000 7f3cc9ddc740 1 --2- 172.21.15.78:0/4202313760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e32390 0x55a7e621fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.008+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/4202313760 >> 172.21.15.78:0/4202313760 conn(0x55a7e5e264e0 msgr2=0x55a7e61d9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:11.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.008+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/4202313760 shutdown_connections 2024-09-17T03:10:11.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.008+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/4202313760 wait complete. 2024-09-17T03:10:11.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.009+0000 7f3cc9ddc740 1 -- start start 2024-09-17T03:10:11.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.010+0000 7f3cc9ddc740 1 Processor -- start 2024-09-17T03:10:11.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.011+0000 7f3cc9ddc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e094d0 0x55a7e62043c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.011+0000 7f3cc9ddc740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e116b0 0x55a7e6217290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.011+0000 7f3cc9ddc740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e32390 0x55a7e62177d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.011+0000 7f3cc9ddc740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a7e5eac740 con 0x55a7e5e32390 2024-09-17T03:10:11.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.011+0000 7f3cc9ddc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a7e60e1970 con 0x55a7e5e094d0 2024-09-17T03:10:11.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.011+0000 7f3cc9ddc740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a7e6203d80 con 0x55a7e5e116b0 2024-09-17T03:10:11.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.011+0000 7f3cc9ddc740 10 client.0 _ll_register_callbacks cb 0x55a7e60f0780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:10:11.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.011+0000 7f3cc132d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e32390 0x55a7e62177d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.011+0000 7f3cc132d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e32390 0x55a7e62177d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32798/0 (socket says 172.21.15.78:32798) 2024-09-17T03:10:11.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.011+0000 7f3cc132d640 1 -- 172.21.15.78:0/2792124484 learned_addr learned my addr 172.21.15.78:0/2792124484 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:11.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.011+0000 7f3cbbfff640 1 --2- 172.21.15.78:0/2792124484 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e116b0 0x55a7e6217290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.011+0000 7f3cc0b2c640 1 --2- 172.21.15.78:0/2792124484 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e094d0 0x55a7e62043c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.011+0000 7f3cc132d640 1 -- 172.21.15.78:0/2792124484 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e116b0 msgr2=0x55a7e6217290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:11.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.011+0000 7f3cc132d640 1 --2- 172.21.15.78:0/2792124484 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e116b0 0x55a7e6217290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.011+0000 7f3cc132d640 1 -- 172.21.15.78:0/2792124484 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e094d0 msgr2=0x55a7e62043c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:11.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.011+0000 7f3cc132d640 1 --2- 172.21.15.78:0/2792124484 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e094d0 0x55a7e62043c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.011+0000 7f3cc132d640 1 -- 172.21.15.78:0/2792124484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7e5e9d970 con 0x55a7e5e32390 2024-09-17T03:10:11.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.011+0000 7f3cc132d640 1 --2- 172.21.15.78:0/2792124484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e32390 0x55a7e62177d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4009ca0 tx=0x7f3cb4009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d826361c08bf664c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.011+0000 7f3c9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:10:11.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.012+0000 7f3c9b7fe640 1 -- 172.21.15.78:0/2792124484 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4004760 con 0x55a7e5e32390 2024-09-17T03:10:11.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.012+0000 7f3c9b7fe640 1 -- 172.21.15.78:0/2792124484 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3cb4045470 con 0x55a7e5e32390 2024-09-17T03:10:11.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.012+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/2792124484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cb4040070 con 0x55a7e5e32390 2024-09-17T03:10:11.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.012+0000 7f3c9b7fe640 1 -- 172.21.15.78:0/2792124484 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3cb4059050 con 0x55a7e5e32390 2024-09-17T03:10:11.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.012+0000 7f3cc9ddc740 10 client.5343 fetch_fsmap learned FSMap version 21 2024-09-17T03:10:11.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.012+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/2792124484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55a7e5e7b6a0 con 0x55a7e5e32390 2024-09-17T03:10:11.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.012+0000 7f3c9b7fe640 1 -- 172.21.15.78:0/2792124484 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cb4040070 con 0x55a7e5e32390 2024-09-17T03:10:11.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.012+0000 7f3c9b7fe640 1 -- 172.21.15.78:0/2792124484 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 21) ==== 3558+0+0 (secure 0 0 0) 0x7f3cb405c020 con 0x55a7e5e32390 2024-09-17T03:10:11.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.012+0000 7f3cc9ddc740 10 client.5343 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:10:11.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.012+0000 7f3cc9ddc740 10 client.5343 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-17T03:10:11.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.012+0000 7f3cc9ddc740 20 client.5343 populate_metadata read hostname 'smithi078' 2024-09-17T03:10:11.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.012+0000 7f3cc9ddc740 1 --2- 172.21.15.78:0/2792124484 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x55a7e5df0f60 0x55a7e6235f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.012+0000 7f3cc9ddc740 4 client.5343 mds_command: new command op to 4938 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:10:11.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.012+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/2792124484 --> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7e614e9b0 con 0x55a7e5df0f60 2024-09-17T03:10:11.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.012+0000 7f3cc0b2c640 1 --2- 172.21.15.78:0/2792124484 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x55a7e5df0f60 0x55a7e6235f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.013+0000 7f3c9b7fe640 10 client.5343 ms_handle_connect on v2:172.21.15.78:6834/2663458793 2024-09-17T03:10:11.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.013+0000 7f3cc0b2c640 1 --2- 172.21.15.78:0/2792124484 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x55a7e5df0f60 0x55a7e6235f90 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8d4de477b4a35a9 server_cookie=8d4a68406add809e in_seq=0 out_seq=0 2024-09-17T03:10:11.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.013+0000 7f3c9b7fe640 1 -- 172.21.15.78:0/2792124484 <== mds.0 v2:172.21.15.78:6834/2663458793 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a7e614e9b0 con 0x55a7e5df0f60 2024-09-17T03:10:11.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.013+0000 7f3c9b7fe640 10 client.5343 handle_command_reply: tid=0 2024-09-17T03:10:11.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.013+0000 7f3cc9ddc740 1 client.5343 shutdown 2024-09-17T03:10:11.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.013+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/2792124484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e32390 msgr2=0x55a7e62177d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.013+0000 7f3cc9ddc740 1 --2- 172.21.15.78:0/2792124484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e32390 0x55a7e62177d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4009ca0 tx=0x7f3cb4009340 comp rx=0 tx=0).stop 2024-09-17T03:10:11.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.013+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/2792124484 shutdown_connections 2024-09-17T03:10:11.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.013+0000 7f3cc9ddc740 1 --2- 172.21.15.78:0/2792124484 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x55a7e5df0f60 0x55a7e6235f90 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.013+0000 7f3cc9ddc740 1 --2- 172.21.15.78:0/2792124484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e32390 0x55a7e62177d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.013+0000 7f3cc9ddc740 1 --2- 172.21.15.78:0/2792124484 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e116b0 0x55a7e6217290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.013+0000 7f3c9b7fe640 0 client.5343 ms_handle_reset on v2:172.21.15.78:6834/2663458793 2024-09-17T03:10:11.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.013+0000 7f3cc9ddc740 1 --2- 172.21.15.78:0/2792124484 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e094d0 0x55a7e62043c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.013+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/2792124484 >> 172.21.15.78:0/2792124484 conn(0x55a7e5e264e0 msgr2=0x55a7e6220ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:11.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.014+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/2792124484 shutdown_connections 2024-09-17T03:10:11.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.014+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/2792124484 wait complete. 2024-09-17T03:10:11.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.014+0000 7f3cc9ddc740 20 client.5343 trim_cache size 0 max 16384 2024-09-17T03:10:11.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.031+0000 7f3cc9ddc740 1 Processor -- start 2024-09-17T03:10:11.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.031+0000 7f3cc9ddc740 1 -- start start 2024-09-17T03:10:11.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.032+0000 7f3cc9ddc740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e094d0 0x55a7e6204100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.032+0000 7f3cc9ddc740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 0x55a7e61d56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.032+0000 7f3cc9ddc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e32390 0x55a7e61d5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.032+0000 7f3cc9ddc740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3cbc1fde10 con 0x55a7e5e116b0 2024-09-17T03:10:11.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.032+0000 7f3cc9ddc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3cbc1fcfb0 con 0x55a7e5e32390 2024-09-17T03:10:11.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.032+0000 7f3cc9ddc740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3cbc1fd6e0 con 0x55a7e5e094d0 2024-09-17T03:10:11.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.033+0000 7f3cbbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 0x55a7e61d56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.033+0000 7f3cbbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 0x55a7e61d56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32808/0 (socket says 172.21.15.78:32808) 2024-09-17T03:10:11.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.033+0000 7f3cbbfff640 1 -- 172.21.15.78:0/262396355 learned_addr learned my addr 172.21.15.78:0/262396355 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:11.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.033+0000 7f3cbbfff640 1 -- 172.21.15.78:0/262396355 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e094d0 msgr2=0x55a7e6204100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:11.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.033+0000 7f3cc0b2c640 1 --2- 172.21.15.78:0/262396355 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e094d0 0x55a7e6204100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.033+0000 7f3cbbfff640 1 --2- 172.21.15.78:0/262396355 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e094d0 0x55a7e6204100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.033+0000 7f3cc132d640 1 --2- 172.21.15.78:0/262396355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e32390 0x55a7e61d5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.033+0000 7f3cbbfff640 1 -- 172.21.15.78:0/262396355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e32390 msgr2=0x55a7e61d5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:11.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.033+0000 7f3cbbfff640 1 --2- 172.21.15.78:0/262396355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e32390 0x55a7e61d5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.033+0000 7f3cbbfff640 1 -- 172.21.15.78:0/262396355 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7e621f330 con 0x55a7e5e116b0 2024-09-17T03:10:11.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.033+0000 7f3cc0b2c640 1 --2- 172.21.15.78:0/262396355 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e094d0 0x55a7e6204100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:10:11.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.033+0000 7f3cbbfff640 1 --2- 172.21.15.78:0/262396355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 0x55a7e61d56f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000cd60 tx=0x7f3cb0062360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a79ec4feb57a71 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.033+0000 7f3ca1ffb640 1 -- 172.21.15.78:0/262396355 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0062850 con 0x55a7e5e116b0 2024-09-17T03:10:11.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.033+0000 7f3ca1ffb640 1 -- 172.21.15.78:0/262396355 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cb0067330 con 0x55a7e5e116b0 2024-09-17T03:10:11.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.033+0000 7f3ca1ffb640 1 -- 172.21.15.78:0/262396355 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb006c1e0 con 0x55a7e5e116b0 2024-09-17T03:10:11.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.034+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/262396355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 msgr2=0x55a7e61d56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.034+0000 7f3cc9ddc740 1 --2- 172.21.15.78:0/262396355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 0x55a7e61d56f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000cd60 tx=0x7f3cb0062360 comp rx=0 tx=0).stop 2024-09-17T03:10:11.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.034+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/262396355 shutdown_connections 2024-09-17T03:10:11.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.034+0000 7f3cc9ddc740 1 --2- 172.21.15.78:0/262396355 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e32390 0x55a7e61d5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.034+0000 7f3cc9ddc740 1 --2- 172.21.15.78:0/262396355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 0x55a7e61d56f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.034+0000 7f3cc9ddc740 1 --2- 172.21.15.78:0/262396355 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e094d0 0x55a7e6204100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.034+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/262396355 >> 172.21.15.78:0/262396355 conn(0x55a7e5e264e0 msgr2=0x55a7e61f25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:11.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.034+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/262396355 shutdown_connections 2024-09-17T03:10:11.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.034+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/262396355 wait complete. 2024-09-17T03:10:11.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.035+0000 7f3cc9ddc740 1 -- start start 2024-09-17T03:10:11.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.035+0000 7f3cc9ddc740 1 Processor -- start 2024-09-17T03:10:11.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.036+0000 7f3cc9ddc740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e094d0 0x55a7e62a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.036+0000 7f3cc9ddc740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 0x55a7e6220ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.036+0000 7f3cc9ddc740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e32390 0x55a7e6221410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.036+0000 7f3cc9ddc740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a7e61f2100 con 0x55a7e5e116b0 2024-09-17T03:10:11.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.036+0000 7f3cc9ddc740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3cbc0c68c0 con 0x55a7e5e32390 2024-09-17T03:10:11.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.036+0000 7f3cc9ddc740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a7e6218630 con 0x55a7e5e094d0 2024-09-17T03:10:11.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.036+0000 7f3cc9ddc740 10 client.0 _ll_register_callbacks cb 0x7f3cac015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:10:11.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.037+0000 7f3cbbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 0x55a7e6220ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.037+0000 7f3cbbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 0x55a7e6220ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32814/0 (socket says 172.21.15.78:32814) 2024-09-17T03:10:11.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.037+0000 7f3cbbfff640 1 -- 172.21.15.78:0/2650851136 learned_addr learned my addr 172.21.15.78:0/2650851136 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:11.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.037+0000 7f3cc0b2c640 1 --2- 172.21.15.78:0/2650851136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e094d0 0x55a7e62a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.037+0000 7f3cc132d640 1 --2- 172.21.15.78:0/2650851136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e32390 0x55a7e6221410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.037+0000 7f3cbbfff640 1 -- 172.21.15.78:0/2650851136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e094d0 msgr2=0x55a7e62a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:11.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.037+0000 7f3cbbfff640 1 --2- 172.21.15.78:0/2650851136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e094d0 0x55a7e62a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.037+0000 7f3cbbfff640 1 -- 172.21.15.78:0/2650851136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e32390 msgr2=0x55a7e6221410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.037+0000 7f3cbbfff640 1 --2- 172.21.15.78:0/2650851136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e32390 0x55a7e6221410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.037+0000 7f3cbbfff640 1 -- 172.21.15.78:0/2650851136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7e62353a0 con 0x55a7e5e116b0 2024-09-17T03:10:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.037+0000 7f3cc132d640 1 --2- 172.21.15.78:0/2650851136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e32390 0x55a7e6221410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.037+0000 7f3cbbfff640 1 --2- 172.21.15.78:0/2650851136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 0x55a7e6220ed0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0086040 tx=0x7f3cb006c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58538ea44a278f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.037+0000 7f3c9b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:10:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.037+0000 7f3c9b7fe640 1 -- 172.21.15.78:0/2650851136 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0063b80 con 0x55a7e5e116b0 2024-09-17T03:10:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.037+0000 7f3c9b7fe640 1 -- 172.21.15.78:0/2650851136 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f3cb0063d20 con 0x55a7e5e116b0 2024-09-17T03:10:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.037+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/2650851136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cb0067330 con 0x55a7e5e116b0 2024-09-17T03:10:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.037+0000 7f3c9b7fe640 1 -- 172.21.15.78:0/2650851136 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3cb0061ab0 con 0x55a7e5e116b0 2024-09-17T03:10:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.037+0000 7f3cc9ddc740 10 client.5349 fetch_fsmap learned FSMap version 21 2024-09-17T03:10:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.037+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/2650851136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55a7e62190a0 con 0x55a7e5e116b0 2024-09-17T03:10:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.038+0000 7f3c9b7fe640 1 -- 172.21.15.78:0/2650851136 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cb0067330 con 0x55a7e5e116b0 2024-09-17T03:10:11.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.038+0000 7f3c9b7fe640 1 -- 172.21.15.78:0/2650851136 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 21) ==== 3558+0+0 (secure 0 0 0) 0x7f3cb005e1a0 con 0x55a7e5e116b0 2024-09-17T03:10:11.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.038+0000 7f3cc9ddc740 10 client.5349 fetch_fsmap finished waiting for FSMap version 21 2024-09-17T03:10:11.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.038+0000 7f3cc9ddc740 10 client.5349 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.a 2024-09-17T03:10:11.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.038+0000 7f3cc9ddc740 20 client.5349 populate_metadata read hostname 'smithi078' 2024-09-17T03:10:11.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.038+0000 7f3cc9ddc740 1 --2- 172.21.15.78:0/2650851136 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x55a7e61fba30 0x55a7e62a5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.038+0000 7f3cc9ddc740 4 client.5349 mds_command: new command op to 4938 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:10:11.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.038+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/2650851136 --> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a7e614a460 con 0x55a7e61fba30 2024-09-17T03:10:11.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.038+0000 7f3cc0b2c640 1 --2- 172.21.15.78:0/2650851136 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x55a7e61fba30 0x55a7e62a5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.038+0000 7f3c9b7fe640 10 client.5349 ms_handle_connect on v2:172.21.15.78:6834/2663458793 2024-09-17T03:10:11.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.038+0000 7f3cc0b2c640 1 --2- 172.21.15.78:0/2650851136 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x55a7e61fba30 0x55a7e62a5ae0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb5f229cb839da4e server_cookie=b57e9efec1f93a12 in_seq=0 out_seq=0 2024-09-17T03:10:11.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.038+0000 7f3c9b7fe640 1 -- 172.21.15.78:0/2650851136 <== mds.0 v2:172.21.15.78:6834/2663458793 1 ==== command_reply(tid 0: 0 ) ==== 8+0+352 (crc 0 0 0) 0x55a7e614a460 con 0x55a7e61fba30 2024-09-17T03:10:11.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.038+0000 7f3c9b7fe640 10 client.5349 handle_command_reply: tid=0 2024-09-17T03:10:11.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.038+0000 7f3cc9ddc740 1 client.5349 shutdown 2024-09-17T03:10:11.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.039+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/2650851136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 msgr2=0x55a7e6220ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.039+0000 7f3cc9ddc740 1 --2- 172.21.15.78:0/2650851136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 0x55a7e6220ed0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0086040 tx=0x7f3cb006c260 comp rx=0 tx=0).stop 2024-09-17T03:10:11.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.039+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/2650851136 shutdown_connections 2024-09-17T03:10:11.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.039+0000 7f3cc9ddc740 1 --2- 172.21.15.78:0/2650851136 >> [v2:172.21.15.78:6834/2663458793,v1:172.21.15.78:6835/2663458793] conn(0x55a7e61fba30 0x55a7e62a5ae0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.039+0000 7f3cc9ddc740 1 --2- 172.21.15.78:0/2650851136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e5e32390 0x55a7e6221410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.039+0000 7f3cc9ddc740 1 --2- 172.21.15.78:0/2650851136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e5e116b0 0x55a7e6220ed0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.039+0000 7f3c9b7fe640 0 client.5349 ms_handle_reset on v2:172.21.15.78:6834/2663458793 2024-09-17T03:10:11.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.039+0000 7f3cc9ddc740 1 --2- 172.21.15.78:0/2650851136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e5e094d0 0x55a7e62a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.039+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/2650851136 >> 172.21.15.78:0/2650851136 conn(0x55a7e5e264e0 msgr2=0x55a7e6204290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:11.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.039+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/2650851136 shutdown_connections 2024-09-17T03:10:11.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.039+0000 7f3cc9ddc740 1 -- 172.21.15.78:0/2650851136 wait complete. 2024-09-17T03:10:11.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.039+0000 7f3cc9ddc740 20 client.5349 trim_cache size 0 max 16384 2024-09-17T03:10:11.044 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:10:11.044 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-17T03:10:11.044 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-17T03:10:11.044 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-17T03:10:11.044 INFO:teuthology.orchestra.run.smithi078.stdout: "tag123": { 2024-09-17T03:10:11.044 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-17T03:09:40.688984+0000", 2024-09-17T03:10:11.044 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:10:11.044 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-17T03:10:11.044 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-17T03:10:11.044 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-17T03:10:11.044 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-17T03:10:11.044 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:11.045 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:11.045 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:10:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.039+0000 7f3cc2d90640 1 -- 172.21.15.78:0/1507107144 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3ca8078b90 msgr2=0x7f3ca807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.039+0000 7f3cc2d90640 1 --2- 172.21.15.78:0/1507107144 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3ca8078b90 0x7f3ca807b0a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3cac005fd0 tx=0x7f3cac005850 comp rx=0 tx=0).stop 2024-09-17T03:10:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.039+0000 7f3cc2d90640 1 -- 172.21.15.78:0/1507107144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cbc0af780 msgr2=0x7f3cbc1508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.039+0000 7f3cc2d90640 1 --2- 172.21.15.78:0/1507107144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cbc0af780 0x7f3cbc1508b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000c3a0 tx=0x7f3cb000c860 comp rx=0 tx=0).stop 2024-09-17T03:10:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.040+0000 7f3cc2d90640 1 -- 172.21.15.78:0/1507107144 shutdown_connections 2024-09-17T03:10:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.040+0000 7f3cc2d90640 1 --2- 172.21.15.78:0/1507107144 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3cbc0cd3e0 0x7f3cbc150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.040+0000 7f3cc2d90640 1 --2- 172.21.15.78:0/1507107144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cbc0af780 0x7f3cbc1508b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.040+0000 7f3cc2d90640 1 --2- 172.21.15.78:0/1507107144 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3ca8078b90 0x7f3ca807b0a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.040+0000 7f3cc2d90640 1 --2- 172.21.15.78:0/1507107144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3cbc072ff0 0x7f3cbc150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.040+0000 7f3cc2d90640 1 -- 172.21.15.78:0/1507107144 >> 172.21.15.78:0/1507107144 conn(0x7f3cbc06d7d0 msgr2=0x7f3cbc0afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.040+0000 7f3cc2d90640 1 -- 172.21.15.78:0/1507107144 shutdown_connections 2024-09-17T03:10:11.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.040+0000 7f3cc2d90640 1 -- 172.21.15.78:0/1507107144 wait complete. 2024-09-17T03:10:11.049 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:10:11.050 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000002.00000000 scrub_tag 2024-09-17T03:10:11.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.106+0000 7f81632b2f40 1 Processor -- start 2024-09-17T03:10:11.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.106+0000 7f81632b2f40 1 -- start start 2024-09-17T03:10:11.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.108+0000 7f81632b2f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8148002320 0x560e42e110a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.108+0000 7f81632b2f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e42e8da40 0x560e42ea2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.108+0000 7f81632b2f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560e42f3ad30 0x560e42f3d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.108+0000 7f81632b2f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x560e42d80430 con 0x560e42e8da40 2024-09-17T03:10:11.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.108+0000 7f81632b2f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560e42d8d1f0 con 0x7f8148002320 2024-09-17T03:10:11.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.108+0000 7f81632b2f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x560e42d21d60 con 0x560e42f3ad30 2024-09-17T03:10:11.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.108+0000 7f815456d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e42e8da40 0x560e42ea2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.108+0000 7f815456d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e42e8da40 0x560e42ea2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32836/0 (socket says 172.21.15.78:32836) 2024-09-17T03:10:11.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.108+0000 7f815456d640 1 -- 172.21.15.78:0/2894081815 learned_addr learned my addr 172.21.15.78:0/2894081815 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:11.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.108+0000 7f815cd6e640 1 --2- 172.21.15.78:0/2894081815 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8148002320 0x560e42e110a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.108+0000 7f815d56f640 1 --2- 172.21.15.78:0/2894081815 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560e42f3ad30 0x560e42f3d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.108+0000 7f815456d640 1 -- 172.21.15.78:0/2894081815 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560e42f3ad30 msgr2=0x560e42f3d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:11.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.108+0000 7f815456d640 1 --2- 172.21.15.78:0/2894081815 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560e42f3ad30 0x560e42f3d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.108+0000 7f815456d640 1 -- 172.21.15.78:0/2894081815 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8148002320 msgr2=0x560e42e110a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:11.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.108+0000 7f815456d640 1 --2- 172.21.15.78:0/2894081815 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8148002320 0x560e42e110a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.108+0000 7f815456d640 1 -- 172.21.15.78:0/2894081815 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e42e00250 con 0x560e42e8da40 2024-09-17T03:10:11.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.108+0000 7f815456d640 1 --2- 172.21.15.78:0/2894081815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e42e8da40 0x560e42ea2a20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8144002ea0 tx=0x7f8144002f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249b5d2615948b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.108+0000 7f81577fe640 1 -- 172.21.15.78:0/2894081815 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8144016420 con 0x560e42e8da40 2024-09-17T03:10:11.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.108+0000 7f81577fe640 1 -- 172.21.15.78:0/2894081815 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81440165c0 con 0x560e42e8da40 2024-09-17T03:10:11.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.108+0000 7f81577fe640 1 -- 172.21.15.78:0/2894081815 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81440169f0 con 0x560e42e8da40 2024-09-17T03:10:11.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.109+0000 7f81632b2f40 1 -- 172.21.15.78:0/2894081815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e42e8da40 msgr2=0x560e42ea2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.109+0000 7f81632b2f40 1 --2- 172.21.15.78:0/2894081815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e42e8da40 0x560e42ea2a20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8144002ea0 tx=0x7f8144002f90 comp rx=0 tx=0).stop 2024-09-17T03:10:11.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.109+0000 7f81632b2f40 1 -- 172.21.15.78:0/2894081815 shutdown_connections 2024-09-17T03:10:11.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.109+0000 7f81632b2f40 1 --2- 172.21.15.78:0/2894081815 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560e42f3ad30 0x560e42f3d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.109+0000 7f81632b2f40 1 --2- 172.21.15.78:0/2894081815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560e42e8da40 0x560e42ea2a20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.109+0000 7f81632b2f40 1 --2- 172.21.15.78:0/2894081815 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8148002320 0x560e42e110a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.109+0000 7f81632b2f40 1 -- 172.21.15.78:0/2894081815 >> 172.21.15.78:0/2894081815 conn(0x560e42cf2ac0 msgr2=0x560e42ea3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:11.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.109+0000 7f81632b2f40 1 -- 172.21.15.78:0/2894081815 shutdown_connections 2024-09-17T03:10:11.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.109+0000 7f81632b2f40 1 -- 172.21.15.78:0/2894081815 wait complete. 2024-09-17T03:10:11.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.110+0000 7f81632b2f40 1 Processor -- start 2024-09-17T03:10:11.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.110+0000 7f81632b2f40 1 -- start start 2024-09-17T03:10:11.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.111+0000 7f81632b2f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560e42e8da40 0x560e42e85d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.111+0000 7f81632b2f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560e42f3ad30 0x560e42dd0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.111+0000 7f81632b2f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8148002320 0x560e42dd11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.111+0000 7f81632b2f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x560e42e00810 con 0x7f8148002320 2024-09-17T03:10:11.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.111+0000 7f81632b2f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560e42e00530 con 0x560e42e8da40 2024-09-17T03:10:11.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.111+0000 7f81632b2f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x560e42ea47a0 con 0x560e42f3ad30 2024-09-17T03:10:11.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.111+0000 7f815d56f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8148002320 0x560e42dd11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.111+0000 7f815d56f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8148002320 0x560e42dd11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32842/0 (socket says 172.21.15.78:32842) 2024-09-17T03:10:11.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.111+0000 7f815d56f640 1 -- 172.21.15.78:0/2083495091 learned_addr learned my addr 172.21.15.78:0/2083495091 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:11.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.111+0000 7f815d56f640 1 -- 172.21.15.78:0/2083495091 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560e42f3ad30 msgr2=0x560e42dd0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.111+0000 7f815d56f640 1 --2- 172.21.15.78:0/2083495091 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560e42f3ad30 0x560e42dd0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.111+0000 7f815d56f640 1 -- 172.21.15.78:0/2083495091 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560e42e8da40 msgr2=0x560e42e85d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.111+0000 7f815d56f640 1 --2- 172.21.15.78:0/2083495091 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560e42e8da40 0x560e42e85d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.111+0000 7f815d56f640 1 -- 172.21.15.78:0/2083495091 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e42e17240 con 0x7f8148002320 2024-09-17T03:10:11.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.112+0000 7f815d56f640 1 --2- 172.21.15.78:0/2083495091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8148002320 0x560e42dd11b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x560e42e1ab60 tx=0x7f8158005920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.112+0000 7f81567fc640 1 -- 172.21.15.78:0/2083495091 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8158003460 con 0x7f8148002320 2024-09-17T03:10:11.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.112+0000 7f81567fc640 1 -- 172.21.15.78:0/2083495091 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8158003600 con 0x7f8148002320 2024-09-17T03:10:11.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.112+0000 7f81632b2f40 1 -- 172.21.15.78:0/2083495091 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560e42e15120 con 0x7f8148002320 2024-09-17T03:10:11.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.112+0000 7f81567fc640 1 -- 172.21.15.78:0/2083495091 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8158003a50 con 0x7f8148002320 2024-09-17T03:10:11.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.112+0000 7f81632b2f40 1 -- 172.21.15.78:0/2083495091 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e42e156e0 con 0x7f8148002320 2024-09-17T03:10:11.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.113+0000 7f81567fc640 1 -- 172.21.15.78:0/2083495091 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8158003bf0 con 0x7f8148002320 2024-09-17T03:10:11.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.114+0000 7f81567fc640 1 --2- 172.21.15.78:0/2083495091 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f813c0775a0 0x7f813c079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.114+0000 7f81567fc640 1 -- 172.21.15.78:0/2083495091 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8158098ec0 con 0x7f8148002320 2024-09-17T03:10:11.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.114+0000 7f815cd6e640 1 --2- 172.21.15.78:0/2083495091 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f813c0775a0 0x7f813c079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.114+0000 7f81632b2f40 1 --2- 172.21.15.78:0/2083495091 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x560e42e166d0 0x560e42e16ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.114+0000 7f81632b2f40 1 -- 172.21.15.78:0/2083495091 --> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] -- osd_op(unknown.0.0:1 4.12 4:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x560e42e14a20 con 0x560e42e166d0 2024-09-17T03:10:11.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.114+0000 7f815456d640 1 --2- 172.21.15.78:0/2083495091 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x560e42e166d0 0x560e42e16ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.115+0000 7f815456d640 1 --2- 172.21.15.78:0/2083495091 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x560e42e166d0 0x560e42e16ae0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.115+0000 7f815cd6e640 1 --2- 172.21.15.78:0/2083495091 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f813c0775a0 0x7f813c079ab0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f814c055000 tx=0x7f814c003020 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.115+0000 7f815456d640 1 -- 172.21.15.78:0/2083495091 <== osd.1 v2:172.21.15.78:6808/607587433 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr (10) out=10b] v0'0 uv8 ondisk = 0) ==== 164+0+10 (crc 0 0 0) 0x7f8144016680 con 0x560e42e166d0 2024-09-17T03:10:11.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.115+0000 7f81632b2f40 1 -- 172.21.15.78:0/2083495091 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x560e42e166d0 msgr2=0x560e42e16ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.115+0000 7f81632b2f40 1 --2- 172.21.15.78:0/2083495091 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x560e42e166d0 0x560e42e16ae0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.115+0000 7f81632b2f40 1 -- 172.21.15.78:0/2083495091 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f813c0775a0 msgr2=0x7f813c079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.115+0000 7f81632b2f40 1 --2- 172.21.15.78:0/2083495091 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f813c0775a0 0x7f813c079ab0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f814c055000 tx=0x7f814c003020 comp rx=0 tx=0).stop 2024-09-17T03:10:11.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.115+0000 7f81632b2f40 1 -- 172.21.15.78:0/2083495091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8148002320 msgr2=0x560e42dd11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.115+0000 7f81632b2f40 1 --2- 172.21.15.78:0/2083495091 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8148002320 0x560e42dd11b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x560e42e1ab60 tx=0x7f8158005920 comp rx=0 tx=0).stop 2024-09-17T03:10:11.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.115+0000 7f815d56f640 1 -- 172.21.15.78:0/2083495091 reap_dead start 2024-09-17T03:10:11.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.115+0000 7f81632b2f40 1 -- 172.21.15.78:0/2083495091 shutdown_connections 2024-09-17T03:10:11.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.115+0000 7f81632b2f40 1 -- 172.21.15.78:0/2083495091 >> 172.21.15.78:0/2083495091 conn(0x560e42cf2ac0 msgr2=0x560e42ea3a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:11.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.115+0000 7f81632b2f40 1 -- 172.21.15.78:0/2083495091 shutdown_connections 2024-09-17T03:10:11.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.115+0000 7f81632b2f40 1 -- 172.21.15.78:0/2083495091 wait complete. 2024-09-17T03:10:11.118 INFO:teuthology.orchestra.run.smithi078.stdout:tag123 2024-09-17T03:10:11.118 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000003.00000000 scrub_tag 2024-09-17T03:10:11.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.174+0000 7f7769c68f40 1 Processor -- start 2024-09-17T03:10:11.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.174+0000 7f7769c68f40 1 -- start start 2024-09-17T03:10:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.176+0000 7f7769c68f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557199f843d0 0x55719a04e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.176+0000 7f7769c68f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557199f85ea0 0x55719a055f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.176+0000 7f7769c68f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557199f87e60 0x55719a050540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.176+0000 7f7769c68f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557199f87380 con 0x557199f87e60 2024-09-17T03:10:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.176+0000 7f7769c68f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557199ed5d60 con 0x557199f843d0 2024-09-17T03:10:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.176+0000 7f7769c68f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x557199f87660 con 0x557199f85ea0 2024-09-17T03:10:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.176+0000 7f7763f23640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557199f87e60 0x55719a050540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.176+0000 7f7763f23640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557199f87e60 0x55719a050540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32856/0 (socket says 172.21.15.78:32856) 2024-09-17T03:10:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.176+0000 7f7763f23640 1 -- 172.21.15.78:0/3892436152 learned_addr learned my addr 172.21.15.78:0/3892436152 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:11.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.176+0000 7f7763722640 1 --2- 172.21.15.78:0/3892436152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557199f843d0 0x55719a04e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.176+0000 7f7762f21640 1 --2- 172.21.15.78:0/3892436152 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557199f85ea0 0x55719a055f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.176+0000 7f7763f23640 1 -- 172.21.15.78:0/3892436152 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557199f85ea0 msgr2=0x55719a055f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.176+0000 7f7763f23640 1 --2- 172.21.15.78:0/3892436152 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557199f85ea0 0x55719a055f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.176+0000 7f7763f23640 1 -- 172.21.15.78:0/3892436152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557199f843d0 msgr2=0x55719a04e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.176+0000 7f7763f23640 1 --2- 172.21.15.78:0/3892436152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557199f843d0 0x55719a04e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.176+0000 7f7763f23640 1 -- 172.21.15.78:0/3892436152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55719a04ecd0 con 0x557199f87e60 2024-09-17T03:10:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.176+0000 7f7763f23640 1 --2- 172.21.15.78:0/3892436152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557199f87e60 0x55719a050540 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f775c00c6e0 tx=0x7f775c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad661a575f0122d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.176+0000 7f7761f1f640 1 -- 172.21.15.78:0/3892436152 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c004020 con 0x557199f87e60 2024-09-17T03:10:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.176+0000 7f7761f1f640 1 -- 172.21.15.78:0/3892436152 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f775c0042b0 con 0x557199f87e60 2024-09-17T03:10:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.177+0000 7f7761f1f640 1 -- 172.21.15.78:0/3892436152 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c00aa20 con 0x557199f87e60 2024-09-17T03:10:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.177+0000 7f7769c68f40 1 -- 172.21.15.78:0/3892436152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557199f87e60 msgr2=0x55719a050540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.177+0000 7f7769c68f40 1 --2- 172.21.15.78:0/3892436152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557199f87e60 0x55719a050540 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f775c00c6e0 tx=0x7f775c00cba0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.177+0000 7f7769c68f40 1 -- 172.21.15.78:0/3892436152 shutdown_connections 2024-09-17T03:10:11.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.177+0000 7f7769c68f40 1 --2- 172.21.15.78:0/3892436152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557199f87e60 0x55719a050540 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.177+0000 7f7769c68f40 1 --2- 172.21.15.78:0/3892436152 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557199f85ea0 0x55719a055f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.177+0000 7f7769c68f40 1 --2- 172.21.15.78:0/3892436152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557199f843d0 0x55719a04e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.177+0000 7f7769c68f40 1 -- 172.21.15.78:0/3892436152 >> 172.21.15.78:0/3892436152 conn(0x557199ea6ac0 msgr2=0x55719a055810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:11.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.177+0000 7f7769c68f40 1 -- 172.21.15.78:0/3892436152 shutdown_connections 2024-09-17T03:10:11.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.177+0000 7f7769c68f40 1 -- 172.21.15.78:0/3892436152 wait complete. 2024-09-17T03:10:11.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.178+0000 7f7769c68f40 1 Processor -- start 2024-09-17T03:10:11.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.178+0000 7f7769c68f40 1 -- start start 2024-09-17T03:10:11.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.179+0000 7f7769c68f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557199f843d0 0x55719a04a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.179+0000 7f7769c68f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557199f85ea0 0x55719a0e8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.179+0000 7f7769c68f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557199f87e60 0x55719a057aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.179+0000 7f7769c68f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55719a056b10 con 0x557199f85ea0 2024-09-17T03:10:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.179+0000 7f7769c68f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557199fb1f50 con 0x557199f843d0 2024-09-17T03:10:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.179+0000 7f7769c68f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55719a058570 con 0x557199f87e60 2024-09-17T03:10:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.179+0000 7f7762f21640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557199f85ea0 0x55719a0e8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.179+0000 7f7762f21640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557199f85ea0 0x55719a0e8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32858/0 (socket says 172.21.15.78:32858) 2024-09-17T03:10:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.179+0000 7f7762f21640 1 -- 172.21.15.78:0/1049559792 learned_addr learned my addr 172.21.15.78:0/1049559792 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.180+0000 7f7763f23640 1 --2- 172.21.15.78:0/1049559792 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557199f87e60 0x55719a057aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.180+0000 7f7763722640 1 --2- 172.21.15.78:0/1049559792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557199f843d0 0x55719a04a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.180+0000 7f7762f21640 1 -- 172.21.15.78:0/1049559792 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557199f87e60 msgr2=0x55719a057aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.180+0000 7f7762f21640 1 --2- 172.21.15.78:0/1049559792 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557199f87e60 0x55719a057aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.180+0000 7f7762f21640 1 -- 172.21.15.78:0/1049559792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557199f843d0 msgr2=0x55719a04a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.180+0000 7f7762f21640 1 --2- 172.21.15.78:0/1049559792 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557199f843d0 0x55719a04a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.180+0000 7f7762f21640 1 -- 172.21.15.78:0/1049559792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557199fb59b0 con 0x557199f85ea0 2024-09-17T03:10:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.180+0000 7f7762f21640 1 --2- 172.21.15.78:0/1049559792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557199f85ea0 0x55719a0e8d10 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7758046580 tx=0x7f775804d7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.180+0000 7f7760f1d640 1 -- 172.21.15.78:0/1049559792 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7758063480 con 0x557199f85ea0 2024-09-17T03:10:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.180+0000 7f7760f1d640 1 -- 172.21.15.78:0/1049559792 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7758063710 con 0x557199f85ea0 2024-09-17T03:10:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.180+0000 7f7769c68f40 1 -- 172.21.15.78:0/1049559792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557199fb56d0 con 0x557199f85ea0 2024-09-17T03:10:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.180+0000 7f7760f1d640 1 -- 172.21.15.78:0/1049559792 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7758063b40 con 0x557199f85ea0 2024-09-17T03:10:11.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.180+0000 7f7769c68f40 1 -- 172.21.15.78:0/1049559792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55719a0e8510 con 0x557199f85ea0 2024-09-17T03:10:11.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.182+0000 7f7760f1d640 1 -- 172.21.15.78:0/1049559792 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7758063ce0 con 0x557199f85ea0 2024-09-17T03:10:11.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.182+0000 7f7760f1d640 1 --2- 172.21.15.78:0/1049559792 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7750077570 0x7f7750079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.182+0000 7f7760f1d640 1 -- 172.21.15.78:0/1049559792 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f77580dd7f0 con 0x557199f85ea0 2024-09-17T03:10:11.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.183+0000 7f7769c68f40 1 --2- 172.21.15.78:0/1049559792 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x55719a05d320 0x55719a05d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.183+0000 7f7769c68f40 1 -- 172.21.15.78:0/1049559792 --> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] -- osd_op(unknown.0.0:1 4.12 4:4def72d4:::10000000003.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55719a100f80 con 0x55719a05d320 2024-09-17T03:10:11.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.183+0000 7f7763722640 1 --2- 172.21.15.78:0/1049559792 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7750077570 0x7f7750079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.183+0000 7f7763f23640 1 --2- 172.21.15.78:0/1049559792 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x55719a05d320 0x55719a05d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.183+0000 7f7763f23640 1 --2- 172.21.15.78:0/1049559792 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x55719a05d320 0x55719a05d730 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.183+0000 7f7763722640 1 --2- 172.21.15.78:0/1049559792 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7750077570 0x7f7750079a80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f775400c720 tx=0x7f775400e040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.183+0000 7f7763f23640 1 -- 172.21.15.78:0/1049559792 <== osd.1 v2:172.21.15.78:6808/607587433 1 ==== osd_op_reply(1 10000000003.00000000 [getxattr (10) out=10b] v0'0 uv9 ondisk = 0) ==== 164+0+10 (crc 0 0 0) 0x7f775c00b040 con 0x55719a05d320 2024-09-17T03:10:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.183+0000 7f7769c68f40 1 -- 172.21.15.78:0/1049559792 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x55719a05d320 msgr2=0x55719a05d730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.183+0000 7f7769c68f40 1 --2- 172.21.15.78:0/1049559792 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x55719a05d320 0x55719a05d730 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.184+0000 7f7769c68f40 1 -- 172.21.15.78:0/1049559792 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7750077570 msgr2=0x7f7750079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.184+0000 7f7769c68f40 1 --2- 172.21.15.78:0/1049559792 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7750077570 0x7f7750079a80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f775400c720 tx=0x7f775400e040 comp rx=0 tx=0).stop 2024-09-17T03:10:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.184+0000 7f7769c68f40 1 -- 172.21.15.78:0/1049559792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557199f85ea0 msgr2=0x55719a0e8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.184+0000 7f7769c68f40 1 --2- 172.21.15.78:0/1049559792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557199f85ea0 0x55719a0e8d10 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7758046580 tx=0x7f775804d7f0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.184+0000 7f7763f23640 1 -- 172.21.15.78:0/1049559792 reap_dead start 2024-09-17T03:10:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.184+0000 7f7769c68f40 1 -- 172.21.15.78:0/1049559792 shutdown_connections 2024-09-17T03:10:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.184+0000 7f7769c68f40 1 -- 172.21.15.78:0/1049559792 >> 172.21.15.78:0/1049559792 conn(0x557199ea6ac0 msgr2=0x557199fb0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.184+0000 7f7769c68f40 1 -- 172.21.15.78:0/1049559792 shutdown_connections 2024-09-17T03:10:11.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.184+0000 7f7769c68f40 1 -- 172.21.15.78:0/1049559792 wait complete. 2024-09-17T03:10:11.186 INFO:teuthology.orchestra.run.smithi078.stdout:tag123 2024-09-17T03:10:11.186 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000004.00000000 scrub_tag 2024-09-17T03:10:11.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.243+0000 7f6bba60cf40 1 Processor -- start 2024-09-17T03:10:11.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.243+0000 7f6bba60cf40 1 -- start start 2024-09-17T03:10:11.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.244+0000 7f6bba60cf40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55577dc2bd90 0x55577dc5a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.244+0000 7f6bba60cf40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55577dd02e00 0x55577dcfc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.244+0000 7f6bba60cf40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55577dd05970 0x55577dcfcf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.244+0000 7f6bba60cf40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55577dd03210 con 0x55577dd05970 2024-09-17T03:10:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.244+0000 7f6bba60cf40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55577db7cd60 con 0x55577dd02e00 2024-09-17T03:10:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.244+0000 7f6bba60cf40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55577dcf3240 con 0x55577dc2bd90 2024-09-17T03:10:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.244+0000 7f6bb3c7a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55577dd05970 0x55577dcfcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.244+0000 7f6bb3c7a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55577dd05970 0x55577dcfcf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32880/0 (socket says 172.21.15.78:32880) 2024-09-17T03:10:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.244+0000 7f6bb3c7a640 1 -- 172.21.15.78:0/3962272916 learned_addr learned my addr 172.21.15.78:0/3962272916 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.244+0000 7f6babfff640 1 --2- 172.21.15.78:0/3962272916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55577dd02e00 0x55577dcfc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.244+0000 7f6bb3479640 1 --2- 172.21.15.78:0/3962272916 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55577dc2bd90 0x55577dc5a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.244+0000 7f6bb3c7a640 1 -- 172.21.15.78:0/3962272916 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55577dc2bd90 msgr2=0x55577dc5a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.244+0000 7f6bb3c7a640 1 --2- 172.21.15.78:0/3962272916 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55577dc2bd90 0x55577dc5a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.244+0000 7f6bb3c7a640 1 -- 172.21.15.78:0/3962272916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55577dd02e00 msgr2=0x55577dcfc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.244+0000 7f6bb3c7a640 1 --2- 172.21.15.78:0/3962272916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55577dd02e00 0x55577dcfc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.244+0000 7f6bb3c7a640 1 -- 172.21.15.78:0/3962272916 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55577dcfdfb0 con 0x55577dd05970 2024-09-17T03:10:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.244+0000 7f6bb3c7a640 1 --2- 172.21.15.78:0/3962272916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55577dd05970 0x55577dcfcf10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6bac025e10 tx=0x7f6bac003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308fd233a223d27f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.245+0000 7f6bb2477640 1 -- 172.21.15.78:0/3962272916 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac064030 con 0x55577dd05970 2024-09-17T03:10:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.245+0000 7f6bb2477640 1 -- 172.21.15.78:0/3962272916 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6bac004020 con 0x55577dd05970 2024-09-17T03:10:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.245+0000 7f6bb2477640 1 -- 172.21.15.78:0/3962272916 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bac004270 con 0x55577dd05970 2024-09-17T03:10:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.245+0000 7f6bba60cf40 1 -- 172.21.15.78:0/3962272916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55577dd05970 msgr2=0x55577dcfcf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.245+0000 7f6bba60cf40 1 --2- 172.21.15.78:0/3962272916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55577dd05970 0x55577dcfcf10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6bac025e10 tx=0x7f6bac003330 comp rx=0 tx=0).stop 2024-09-17T03:10:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.245+0000 7f6bba60cf40 1 -- 172.21.15.78:0/3962272916 shutdown_connections 2024-09-17T03:10:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.245+0000 7f6bba60cf40 1 --2- 172.21.15.78:0/3962272916 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55577dd05970 0x55577dcfcf10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.245+0000 7f6bba60cf40 1 --2- 172.21.15.78:0/3962272916 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55577dd02e00 0x55577dcfc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.245+0000 7f6bba60cf40 1 --2- 172.21.15.78:0/3962272916 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55577dc2bd90 0x55577dc5a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.245+0000 7f6bba60cf40 1 -- 172.21.15.78:0/3962272916 >> 172.21.15.78:0/3962272916 conn(0x55577db4dac0 msgr2=0x55577dcfbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.245+0000 7f6bba60cf40 1 -- 172.21.15.78:0/3962272916 shutdown_connections 2024-09-17T03:10:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.245+0000 7f6bba60cf40 1 -- 172.21.15.78:0/3962272916 wait complete. 2024-09-17T03:10:11.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.246+0000 7f6bba60cf40 1 Processor -- start 2024-09-17T03:10:11.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.246+0000 7f6bba60cf40 1 -- start start 2024-09-17T03:10:11.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.247+0000 7f6bba60cf40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55577dc2bd90 0x55577dc55eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.247+0000 7f6bba60cf40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55577dd02e00 0x55577dc2dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.247+0000 7f6bba60cf40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55577dd05970 0x55577dcf33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.247+0000 7f6bba60cf40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55577dc75930 con 0x55577dd02e00 2024-09-17T03:10:11.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.247+0000 7f6bba60cf40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55577dcf40c0 con 0x55577dc2bd90 2024-09-17T03:10:11.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.247+0000 7f6bba60cf40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55577dc563f0 con 0x55577dd05970 2024-09-17T03:10:11.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.248+0000 7f6babfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55577dd02e00 0x55577dc2dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.248+0000 7f6babfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55577dd02e00 0x55577dc2dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32892/0 (socket says 172.21.15.78:32892) 2024-09-17T03:10:11.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.248+0000 7f6babfff640 1 -- 172.21.15.78:0/540242380 learned_addr learned my addr 172.21.15.78:0/540242380 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:11.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.248+0000 7f6bb3479640 1 --2- 172.21.15.78:0/540242380 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55577dc2bd90 0x55577dc55eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.248+0000 7f6bb3c7a640 1 --2- 172.21.15.78:0/540242380 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55577dd05970 0x55577dcf33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.248+0000 7f6babfff640 1 -- 172.21.15.78:0/540242380 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55577dd05970 msgr2=0x55577dcf33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.248+0000 7f6babfff640 1 --2- 172.21.15.78:0/540242380 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55577dd05970 0x55577dcf33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.248+0000 7f6babfff640 1 -- 172.21.15.78:0/540242380 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55577dc2bd90 msgr2=0x55577dc55eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.248+0000 7f6babfff640 1 --2- 172.21.15.78:0/540242380 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55577dc2bd90 0x55577dc55eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.248+0000 7f6babfff640 1 -- 172.21.15.78:0/540242380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55577dc2e140 con 0x55577dd02e00 2024-09-17T03:10:11.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.248+0000 7f6babfff640 1 --2- 172.21.15.78:0/540242380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55577dd02e00 0x55577dc2dc00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009420 tx=0x7f6b9c009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.248+0000 7f6bb1475640 1 -- 172.21.15.78:0/540242380 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c019070 con 0x55577dd02e00 2024-09-17T03:10:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.248+0000 7f6bb1475640 1 -- 172.21.15.78:0/540242380 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b9c014410 con 0x55577dd02e00 2024-09-17T03:10:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.248+0000 7f6bba60cf40 1 -- 172.21.15.78:0/540242380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55577dcfd080 con 0x55577dd02e00 2024-09-17T03:10:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.248+0000 7f6bb1475640 1 -- 172.21.15.78:0/540242380 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c014840 con 0x55577dd02e00 2024-09-17T03:10:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.248+0000 7f6bba60cf40 1 -- 172.21.15.78:0/540242380 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55577dc2e9c0 con 0x55577dd02e00 2024-09-17T03:10:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.250+0000 7f6bb1475640 1 -- 172.21.15.78:0/540242380 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6b9c01c070 con 0x55577dd02e00 2024-09-17T03:10:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.250+0000 7f6bb1475640 1 --2- 172.21.15.78:0/540242380 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6b94077570 0x7f6b94079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.250+0000 7f6bb1475640 1 -- 172.21.15.78:0/540242380 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f6b9c0991c0 con 0x55577dd02e00 2024-09-17T03:10:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.250+0000 7f6bb3479640 1 --2- 172.21.15.78:0/540242380 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6b94077570 0x7f6b94079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.251+0000 7f6bba60cf40 1 --2- 172.21.15.78:0/540242380 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x55577dd9f1f0 0x55577dd9f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.251+0000 7f6bba60cf40 1 -- 172.21.15.78:0/540242380 --> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] -- osd_op(unknown.0.0:1 4.5 4:a367a3e8:::10000000004.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55577dda7d70 con 0x55577dd9f1f0 2024-09-17T03:10:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.251+0000 7f6bb3c7a640 1 --2- 172.21.15.78:0/540242380 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x55577dd9f1f0 0x55577dd9f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.251+0000 7f6bb3479640 1 --2- 172.21.15.78:0/540242380 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6b94077570 0x7f6b94079a80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40041b0 tx=0x7f6ba4006740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.251+0000 7f6bb3c7a640 1 --2- 172.21.15.78:0/540242380 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x55577dd9f1f0 0x55577dd9f600 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.252+0000 7f6bb3c7a640 1 -- 172.21.15.78:0/540242380 <== osd.6 v2:172.21.15.193:6818/2885678262 1 ==== osd_op_reply(1 10000000004.00000000 [getxattr (10) out=10b] v0'0 uv6 ondisk = 0) ==== 164+0+10 (crc 0 0 0) 0x7f6bac00b040 con 0x55577dd9f1f0 2024-09-17T03:10:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.252+0000 7f6bba60cf40 1 -- 172.21.15.78:0/540242380 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x55577dd9f1f0 msgr2=0x55577dd9f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.252+0000 7f6bba60cf40 1 --2- 172.21.15.78:0/540242380 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x55577dd9f1f0 0x55577dd9f600 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.252+0000 7f6bba60cf40 1 -- 172.21.15.78:0/540242380 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6b94077570 msgr2=0x7f6b94079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.252+0000 7f6bba60cf40 1 --2- 172.21.15.78:0/540242380 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6b94077570 0x7f6b94079a80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40041b0 tx=0x7f6ba4006740 comp rx=0 tx=0).stop 2024-09-17T03:10:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.252+0000 7f6bba60cf40 1 -- 172.21.15.78:0/540242380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55577dd02e00 msgr2=0x55577dc2dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.252+0000 7f6bba60cf40 1 --2- 172.21.15.78:0/540242380 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55577dd02e00 0x55577dc2dc00 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c009420 tx=0x7f6b9c009510 comp rx=0 tx=0).stop 2024-09-17T03:10:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.252+0000 7f6bb3c7a640 1 -- 172.21.15.78:0/540242380 reap_dead start 2024-09-17T03:10:11.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.252+0000 7f6bba60cf40 1 -- 172.21.15.78:0/540242380 shutdown_connections 2024-09-17T03:10:11.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.252+0000 7f6bba60cf40 1 -- 172.21.15.78:0/540242380 >> 172.21.15.78:0/540242380 conn(0x55577db4dac0 msgr2=0x55577dcfb600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:11.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.252+0000 7f6bba60cf40 1 -- 172.21.15.78:0/540242380 shutdown_connections 2024-09-17T03:10:11.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.252+0000 7f6bba60cf40 1 -- 172.21.15.78:0/540242380 wait complete. 2024-09-17T03:10:11.258 INFO:teuthology.orchestra.run.smithi078.stdout:tag123 2024-09-17T03:10:11.258 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000005.00000000 scrub_tag 2024-09-17T03:10:11.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.315+0000 7f4e94329f40 1 Processor -- start 2024-09-17T03:10:11.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.315+0000 7f4e94329f40 1 -- start start 2024-09-17T03:10:11.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.316+0000 7f4e94329f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e7c0030f0 0x55b7b56aaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.316+0000 7f4e94329f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b7b56ac640 0x55b7b56aca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.316+0000 7f4e94329f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7b5606d60 0x55b7b5607170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.316+0000 7f4e94329f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55b7b5587430 con 0x55b7b5606d60 2024-09-17T03:10:11.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.316+0000 7f4e94329f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b7b55941f0 con 0x7f4e7c0030f0 2024-09-17T03:10:11.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.316+0000 7f4e94329f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55b7b5528d60 con 0x55b7b56ac640 2024-09-17T03:10:11.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.317+0000 7f4e8e5e4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7b5606d60 0x55b7b5607170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.317+0000 7f4e8e5e4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7b5606d60 0x55b7b5607170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32902/0 (socket says 172.21.15.78:32902) 2024-09-17T03:10:11.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.317+0000 7f4e8e5e4640 1 -- 172.21.15.78:0/3439545892 learned_addr learned my addr 172.21.15.78:0/3439545892 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:11.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.317+0000 7f4e855e2640 1 --2- 172.21.15.78:0/3439545892 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b7b56ac640 0x55b7b56aca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.317+0000 7f4e8dde3640 1 --2- 172.21.15.78:0/3439545892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e7c0030f0 0x55b7b56aaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.317+0000 7f4e8e5e4640 1 -- 172.21.15.78:0/3439545892 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b7b56ac640 msgr2=0x55b7b56aca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:11.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.317+0000 7f4e8e5e4640 1 --2- 172.21.15.78:0/3439545892 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b7b56ac640 0x55b7b56aca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.317+0000 7f4e8e5e4640 1 -- 172.21.15.78:0/3439545892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e7c0030f0 msgr2=0x55b7b56aaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:11.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.317+0000 7f4e8e5e4640 1 --2- 172.21.15.78:0/3439545892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e7c0030f0 0x55b7b56aaa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.317+0000 7f4e8e5e4640 1 -- 172.21.15.78:0/3439545892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7b56aaf40 con 0x55b7b5606d60 2024-09-17T03:10:11.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.317+0000 7f4e855e2640 1 --2- 172.21.15.78:0/3439545892 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b7b56ac640 0x55b7b56aca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:11.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.317+0000 7f4e8e5e4640 1 --2- 172.21.15.78:0/3439545892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7b5606d60 0x55b7b5607170 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x55b7b56228f0 tx=0x7f4e8800dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69a67d56bc7a06c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.317+0000 7f4e8cde1640 1 -- 172.21.15.78:0/3439545892 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e88004220 con 0x55b7b5606d60 2024-09-17T03:10:11.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.317+0000 7f4e8cde1640 1 -- 172.21.15.78:0/3439545892 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e88014070 con 0x55b7b5606d60 2024-09-17T03:10:11.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.317+0000 7f4e8cde1640 1 -- 172.21.15.78:0/3439545892 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e8800fb60 con 0x55b7b5606d60 2024-09-17T03:10:11.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.318+0000 7f4e94329f40 1 -- 172.21.15.78:0/3439545892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7b5606d60 msgr2=0x55b7b5607170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.318+0000 7f4e94329f40 1 --2- 172.21.15.78:0/3439545892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7b5606d60 0x55b7b5607170 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x55b7b56228f0 tx=0x7f4e8800dbc0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.318+0000 7f4e94329f40 1 -- 172.21.15.78:0/3439545892 shutdown_connections 2024-09-17T03:10:11.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.318+0000 7f4e94329f40 1 --2- 172.21.15.78:0/3439545892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7b5606d60 0x55b7b5607170 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.318+0000 7f4e94329f40 1 --2- 172.21.15.78:0/3439545892 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b7b56ac640 0x55b7b56aca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.318+0000 7f4e94329f40 1 --2- 172.21.15.78:0/3439545892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e7c0030f0 0x55b7b56aaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.318+0000 7f4e94329f40 1 -- 172.21.15.78:0/3439545892 >> 172.21.15.78:0/3439545892 conn(0x55b7b54f9ac0 msgr2=0x55b7b5606130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:11.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.318+0000 7f4e94329f40 1 -- 172.21.15.78:0/3439545892 shutdown_connections 2024-09-17T03:10:11.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.318+0000 7f4e94329f40 1 -- 172.21.15.78:0/3439545892 wait complete. 2024-09-17T03:10:11.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.319+0000 7f4e94329f40 1 Processor -- start 2024-09-17T03:10:11.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.319+0000 7f4e94329f40 1 -- start start 2024-09-17T03:10:11.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.320+0000 7f4e94329f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7b5606d60 0x55b7b56a2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.320+0000 7f4e94329f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7b56ac640 0x55b7b56ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.320+0000 7f4e94329f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4e7c0030f0 0x55b7b56ad900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.320+0000 7f4e94329f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55b7b56026d0 con 0x55b7b56ac640 2024-09-17T03:10:11.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.320+0000 7f4e94329f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b7b56ab840 con 0x55b7b5606d60 2024-09-17T03:10:11.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.320+0000 7f4e94329f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55b7b56a6bd0 con 0x7f4e7c0030f0 2024-09-17T03:10:11.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.320+0000 7f4e855e2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7b56ac640 0x55b7b56ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.320+0000 7f4e855e2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7b56ac640 0x55b7b56ad3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32912/0 (socket says 172.21.15.78:32912) 2024-09-17T03:10:11.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.320+0000 7f4e855e2640 1 -- 172.21.15.78:0/801461818 learned_addr learned my addr 172.21.15.78:0/801461818 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:11.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.320+0000 7f4e8e5e4640 1 --2- 172.21.15.78:0/801461818 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4e7c0030f0 0x55b7b56ad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.320+0000 7f4e8dde3640 1 --2- 172.21.15.78:0/801461818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7b5606d60 0x55b7b56a2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.320+0000 7f4e855e2640 1 -- 172.21.15.78:0/801461818 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4e7c0030f0 msgr2=0x55b7b56ad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.320+0000 7f4e855e2640 1 --2- 172.21.15.78:0/801461818 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4e7c0030f0 0x55b7b56ad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.320+0000 7f4e855e2640 1 -- 172.21.15.78:0/801461818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7b5606d60 msgr2=0x55b7b56a2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.320+0000 7f4e855e2640 1 --2- 172.21.15.78:0/801461818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b7b5606d60 0x55b7b56a2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.320+0000 7f4e855e2640 1 -- 172.21.15.78:0/801461818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7b56a90b0 con 0x55b7b56ac640 2024-09-17T03:10:11.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.320+0000 7f4e8e5e4640 1 --2- 172.21.15.78:0/801461818 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4e7c0030f0 0x55b7b56ad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:11.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.321+0000 7f4e855e2640 1 --2- 172.21.15.78:0/801461818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7b56ac640 0x55b7b56ad3c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4e780260a0 tx=0x7f4e78009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.321+0000 7f4e877fe640 1 -- 172.21.15.78:0/801461818 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e78065020 con 0x55b7b56ac640 2024-09-17T03:10:11.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.321+0000 7f4e877fe640 1 -- 172.21.15.78:0/801461818 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e7804dbf0 con 0x55b7b56ac640 2024-09-17T03:10:11.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.321+0000 7f4e94329f40 1 -- 172.21.15.78:0/801461818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7b56ab280 con 0x55b7b56ac640 2024-09-17T03:10:11.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.321+0000 7f4e877fe640 1 -- 172.21.15.78:0/801461818 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e78061470 con 0x55b7b56ac640 2024-09-17T03:10:11.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.321+0000 7f4e94329f40 1 -- 172.21.15.78:0/801461818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7b56a9350 con 0x55b7b56ac640 2024-09-17T03:10:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.323+0000 7f4e877fe640 1 -- 172.21.15.78:0/801461818 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4e78068020 con 0x55b7b56ac640 2024-09-17T03:10:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.323+0000 7f4e877fe640 1 --2- 172.21.15.78:0/801461818 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4e700775a0 0x7f4e70079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.323+0000 7f4e877fe640 1 -- 172.21.15.78:0/801461818 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4e780dd800 con 0x55b7b56ac640 2024-09-17T03:10:11.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.323+0000 7f4e94329f40 1 --2- 172.21.15.78:0/801461818 >> [v2:172.21.15.193:6826/443819515,v1:172.21.15.193:6827/443819515] conn(0x55b7b56a5770 0x55b7b56a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.323+0000 7f4e94329f40 1 -- 172.21.15.78:0/801461818 --> [v2:172.21.15.193:6826/443819515,v1:172.21.15.193:6827/443819515] -- osd_op(unknown.0.0:1 4.9 4:9258b67d:::10000000005.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x55b7b5751e00 con 0x55b7b56a5770 2024-09-17T03:10:11.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.323+0000 7f4e8dde3640 1 --2- 172.21.15.78:0/801461818 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4e700775a0 0x7f4e70079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.323+0000 7f4e8e5e4640 1 --2- 172.21.15.78:0/801461818 >> [v2:172.21.15.193:6826/443819515,v1:172.21.15.193:6827/443819515] conn(0x55b7b56a5770 0x55b7b56a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.324+0000 7f4e8dde3640 1 --2- 172.21.15.78:0/801461818 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4e700775a0 0x7f4e70079ab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4e800104a0 tx=0x7f4e80002ae0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.324+0000 7f4e8e5e4640 1 --2- 172.21.15.78:0/801461818 >> [v2:172.21.15.193:6826/443819515,v1:172.21.15.193:6827/443819515] conn(0x55b7b56a5770 0x55b7b56a5b80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.324+0000 7f4e8e5e4640 1 -- 172.21.15.78:0/801461818 <== osd.4 v2:172.21.15.193:6826/443819515 1 ==== osd_op_reply(1 10000000005.00000000 [getxattr (10) out=10b] v0'0 uv6 ondisk = 0) ==== 164+0+10 (crc 0 0 0) 0x7f4e8800b040 con 0x55b7b56a5770 2024-09-17T03:10:11.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.324+0000 7f4e94329f40 1 -- 172.21.15.78:0/801461818 >> [v2:172.21.15.193:6826/443819515,v1:172.21.15.193:6827/443819515] conn(0x55b7b56a5770 msgr2=0x55b7b56a5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.324+0000 7f4e94329f40 1 --2- 172.21.15.78:0/801461818 >> [v2:172.21.15.193:6826/443819515,v1:172.21.15.193:6827/443819515] conn(0x55b7b56a5770 0x55b7b56a5b80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.324+0000 7f4e94329f40 1 -- 172.21.15.78:0/801461818 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4e700775a0 msgr2=0x7f4e70079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.324+0000 7f4e94329f40 1 --2- 172.21.15.78:0/801461818 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4e700775a0 0x7f4e70079ab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4e800104a0 tx=0x7f4e80002ae0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.325+0000 7f4e94329f40 1 -- 172.21.15.78:0/801461818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7b56ac640 msgr2=0x55b7b56ad3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.325+0000 7f4e94329f40 1 --2- 172.21.15.78:0/801461818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b7b56ac640 0x55b7b56ad3c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f4e780260a0 tx=0x7f4e78009790 comp rx=0 tx=0).stop 2024-09-17T03:10:11.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.325+0000 7f4e8e5e4640 1 -- 172.21.15.78:0/801461818 reap_dead start 2024-09-17T03:10:11.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.325+0000 7f4e94329f40 1 -- 172.21.15.78:0/801461818 shutdown_connections 2024-09-17T03:10:11.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.325+0000 7f4e94329f40 1 -- 172.21.15.78:0/801461818 >> 172.21.15.78:0/801461818 conn(0x55b7b54f9ac0 msgr2=0x55b7b56aca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:11.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.325+0000 7f4e94329f40 1 -- 172.21.15.78:0/801461818 shutdown_connections 2024-09-17T03:10:11.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.325+0000 7f4e94329f40 1 -- 172.21.15.78:0/801461818 wait complete. 2024-09-17T03:10:11.327 INFO:teuthology.orchestra.run.smithi078.stdout:tag123 2024-09-17T03:10:11.327 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000006.00000000 scrub_tag 2024-09-17T03:10:11.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.384+0000 7f59f624af40 1 Processor -- start 2024-09-17T03:10:11.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.384+0000 7f59f624af40 1 -- start start 2024-09-17T03:10:11.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.385+0000 7f59f624af40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5596c25952c0 0x5596c26349a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.385+0000 7f59f624af40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596c263a300 0x5596c2566fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.385+0000 7f59f624af40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596c263ac50 0x5596c2566300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.385+0000 7f59f624af40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5596c24b5d60 con 0x5596c263a300 2024-09-17T03:10:11.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.385+0000 7f59f624af40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5596c2514430 con 0x5596c263ac50 2024-09-17T03:10:11.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.385+0000 7f59f624af40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5596c25aea50 con 0x5596c25952c0 2024-09-17T03:10:11.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.385+0000 7f59e7505640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596c263a300 0x5596c2566fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.385+0000 7f59e7505640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596c263a300 0x5596c2566fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32934/0 (socket says 172.21.15.78:32934) 2024-09-17T03:10:11.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.385+0000 7f59e7505640 1 -- 172.21.15.78:0/3067566445 learned_addr learned my addr 172.21.15.78:0/3067566445 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:11.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.386+0000 7f59e7505640 1 -- 172.21.15.78:0/3067566445 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5596c25952c0 msgr2=0x5596c26349a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:11.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.386+0000 7f59efd06640 1 --2- 172.21.15.78:0/3067566445 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5596c25952c0 0x5596c26349a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.386+0000 7f59e7505640 1 --2- 172.21.15.78:0/3067566445 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5596c25952c0 0x5596c26349a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.386+0000 7f59e7505640 1 -- 172.21.15.78:0/3067566445 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596c263ac50 msgr2=0x5596c2566300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:11.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.386+0000 7f59e7505640 1 --2- 172.21.15.78:0/3067566445 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596c263ac50 0x5596c2566300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.386+0000 7f59e7505640 1 -- 172.21.15.78:0/3067566445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596c26c27c0 con 0x5596c263a300 2024-09-17T03:10:11.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.386+0000 7f59e7505640 1 --2- 172.21.15.78:0/3067566445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596c263a300 0x5596c2566fb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f59d800b4f0 tx=0x7f59d800b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aae66b034f6c003 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.386+0000 7f59eed04640 1 -- 172.21.15.78:0/3067566445 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d80099d0 con 0x5596c263a300 2024-09-17T03:10:11.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.386+0000 7f59eed04640 1 -- 172.21.15.78:0/3067566445 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59d8009b70 con 0x5596c263a300 2024-09-17T03:10:11.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.386+0000 7f59eed04640 1 -- 172.21.15.78:0/3067566445 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d8014440 con 0x5596c263a300 2024-09-17T03:10:11.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.387+0000 7f59f624af40 1 -- 172.21.15.78:0/3067566445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596c263a300 msgr2=0x5596c2566fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.387+0000 7f59f624af40 1 --2- 172.21.15.78:0/3067566445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596c263a300 0x5596c2566fb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f59d800b4f0 tx=0x7f59d800b9b0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.387+0000 7f59f624af40 1 -- 172.21.15.78:0/3067566445 shutdown_connections 2024-09-17T03:10:11.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.387+0000 7f59f624af40 1 --2- 172.21.15.78:0/3067566445 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596c263ac50 0x5596c2566300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.387+0000 7f59f624af40 1 --2- 172.21.15.78:0/3067566445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596c263a300 0x5596c2566fb0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.387+0000 7f59f624af40 1 --2- 172.21.15.78:0/3067566445 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5596c25952c0 0x5596c26349a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.387+0000 7f59f624af40 1 -- 172.21.15.78:0/3067566445 >> 172.21.15.78:0/3067566445 conn(0x5596c2486ac0 msgr2=0x5596c2567e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:11.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.387+0000 7f59f624af40 1 -- 172.21.15.78:0/3067566445 shutdown_connections 2024-09-17T03:10:11.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.387+0000 7f59f624af40 1 -- 172.21.15.78:0/3067566445 wait complete. 2024-09-17T03:10:11.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.387+0000 7f59f624af40 1 Processor -- start 2024-09-17T03:10:11.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.388+0000 7f59f624af40 1 -- start start 2024-09-17T03:10:11.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.389+0000 7f59f624af40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5596c25952c0 0x5596c25ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.389+0000 7f59f624af40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596c263a300 0x5596c26249c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.389+0000 7f59f624af40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596c263ac50 0x5596c2624f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.389+0000 7f59f624af40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5596c25acce0 con 0x5596c263ac50 2024-09-17T03:10:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.389+0000 7f59f624af40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5596c2592fb0 con 0x5596c263a300 2024-09-17T03:10:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.389+0000 7f59f624af40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5596c25acf30 con 0x5596c25952c0 2024-09-17T03:10:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.389+0000 7f59f0507640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596c263ac50 0x5596c2624f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.389+0000 7f59f0507640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596c263ac50 0x5596c2624f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32944/0 (socket says 172.21.15.78:32944) 2024-09-17T03:10:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.389+0000 7f59f0507640 1 -- 172.21.15.78:0/3211058741 learned_addr learned my addr 172.21.15.78:0/3211058741 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.389+0000 7f59e7505640 1 --2- 172.21.15.78:0/3211058741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596c263a300 0x5596c26249c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.389+0000 7f59efd06640 1 --2- 172.21.15.78:0/3211058741 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5596c25952c0 0x5596c25ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.389+0000 7f59f0507640 1 -- 172.21.15.78:0/3211058741 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5596c25952c0 msgr2=0x5596c25ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.389+0000 7f59f0507640 1 --2- 172.21.15.78:0/3211058741 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5596c25952c0 0x5596c25ac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.389+0000 7f59f0507640 1 -- 172.21.15.78:0/3211058741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596c263a300 msgr2=0x5596c26249c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.389+0000 7f59f0507640 1 --2- 172.21.15.78:0/3211058741 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5596c263a300 0x5596c26249c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.389+0000 7f59f0507640 1 -- 172.21.15.78:0/3211058741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596c26244e0 con 0x5596c263ac50 2024-09-17T03:10:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.389+0000 7f59efd06640 1 --2- 172.21.15.78:0/3211058741 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5596c25952c0 0x5596c25ac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.389+0000 7f59f0507640 1 --2- 172.21.15.78:0/3211058741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596c263ac50 0x5596c2624f00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f59e8002020 tx=0x7f59e800b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.389+0000 7f59edd02640 1 -- 172.21.15.78:0/3211058741 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8016070 con 0x5596c263ac50 2024-09-17T03:10:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.389+0000 7f59edd02640 1 -- 172.21.15.78:0/3211058741 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59e8011400 con 0x5596c263ac50 2024-09-17T03:10:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.390+0000 7f59f624af40 1 -- 172.21.15.78:0/3211058741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5596c2626fa0 con 0x5596c263ac50 2024-09-17T03:10:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.390+0000 7f59edd02640 1 -- 172.21.15.78:0/3211058741 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e8011870 con 0x5596c263ac50 2024-09-17T03:10:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.390+0000 7f59f624af40 1 -- 172.21.15.78:0/3211058741 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596c2627560 con 0x5596c263ac50 2024-09-17T03:10:11.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.391+0000 7f59edd02640 1 -- 172.21.15.78:0/3211058741 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f59e8019070 con 0x5596c263ac50 2024-09-17T03:10:11.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.392+0000 7f59edd02640 1 --2- 172.21.15.78:0/3211058741 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f59d0077570 0x7f59d0079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.392+0000 7f59edd02640 1 -- 172.21.15.78:0/3211058741 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f59e8098c40 con 0x5596c263ac50 2024-09-17T03:10:11.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.392+0000 7f59efd06640 1 --2- 172.21.15.78:0/3211058741 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f59d0077570 0x7f59d0079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.392+0000 7f59f624af40 1 --2- 172.21.15.78:0/3211058741 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x5596c2623f10 0x5596c26d5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.392+0000 7f59f624af40 1 -- 172.21.15.78:0/3211058741 --> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] -- osd_op(unknown.0.0:1 4.5 4:a5feb6f3:::10000000006.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x5596c26d6250 con 0x5596c2623f10 2024-09-17T03:10:11.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.392+0000 7f59e7505640 1 --2- 172.21.15.78:0/3211058741 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x5596c2623f10 0x5596c26d5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.393+0000 7f59efd06640 1 --2- 172.21.15.78:0/3211058741 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f59d0077570 0x7f59d0079a80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f59e0055000 tx=0x7f59e0058040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.393+0000 7f59e7505640 1 --2- 172.21.15.78:0/3211058741 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x5596c2623f10 0x5596c26d5d10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.393+0000 7f59e7505640 1 -- 172.21.15.78:0/3211058741 <== osd.6 v2:172.21.15.193:6818/2885678262 1 ==== osd_op_reply(1 10000000006.00000000 [getxattr (10) out=10b] v0'0 uv7 ondisk = 0) ==== 164+0+10 (crc 0 0 0) 0x7f59d8009ac0 con 0x5596c2623f10 2024-09-17T03:10:11.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.393+0000 7f59f624af40 1 -- 172.21.15.78:0/3211058741 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x5596c2623f10 msgr2=0x5596c26d5d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.393+0000 7f59f624af40 1 --2- 172.21.15.78:0/3211058741 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x5596c2623f10 0x5596c26d5d10 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.393+0000 7f59f624af40 1 -- 172.21.15.78:0/3211058741 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f59d0077570 msgr2=0x7f59d0079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.393+0000 7f59f624af40 1 --2- 172.21.15.78:0/3211058741 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f59d0077570 0x7f59d0079a80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f59e0055000 tx=0x7f59e0058040 comp rx=0 tx=0).stop 2024-09-17T03:10:11.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.393+0000 7f59f624af40 1 -- 172.21.15.78:0/3211058741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596c263ac50 msgr2=0x5596c2624f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.393+0000 7f59f624af40 1 --2- 172.21.15.78:0/3211058741 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5596c263ac50 0x5596c2624f00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f59e8002020 tx=0x7f59e800b4b0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.393+0000 7f59f0507640 1 -- 172.21.15.78:0/3211058741 reap_dead start 2024-09-17T03:10:11.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.393+0000 7f59f624af40 1 -- 172.21.15.78:0/3211058741 shutdown_connections 2024-09-17T03:10:11.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.393+0000 7f59f624af40 1 -- 172.21.15.78:0/3211058741 >> 172.21.15.78:0/3211058741 conn(0x5596c2486ac0 msgr2=0x5596c262ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:11.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.393+0000 7f59f624af40 1 -- 172.21.15.78:0/3211058741 shutdown_connections 2024-09-17T03:10:11.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.393+0000 7f59f624af40 1 -- 172.21.15.78:0/3211058741 wait complete. 2024-09-17T03:10:11.396 INFO:teuthology.orchestra.run.smithi078.stdout:tag123 2024-09-17T03:10:11.396 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000007.00000000 scrub_tag 2024-09-17T03:10:11.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.452+0000 7fd5540b0f40 1 Processor -- start 2024-09-17T03:10:11.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.453+0000 7fd5540b0f40 1 -- start start 2024-09-17T03:10:11.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.454+0000 7fd5540b0f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557faf78d900 0x557faf83cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.454+0000 7fd5540b0f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557faf841d10 0x557faf7d4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.454+0000 7fd5540b0f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557faf85fa70 0x557faf7d39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.454+0000 7fd5540b0f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557faf6d9d60 con 0x557faf841d10 2024-09-17T03:10:11.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.454+0000 7fd5540b0f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557faf738430 con 0x557faf85fa70 2024-09-17T03:10:11.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.454+0000 7fd5540b0f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x557faf7cc010 con 0x557faf78d900 2024-09-17T03:10:11.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.454+0000 7fd547fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557faf841d10 0x557faf7d4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.454+0000 7fd547fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557faf841d10 0x557faf7d4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32948/0 (socket says 172.21.15.78:32948) 2024-09-17T03:10:11.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.454+0000 7fd547fff640 1 -- 172.21.15.78:0/659623082 learned_addr learned my addr 172.21.15.78:0/659623082 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:11.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.454+0000 7fd54db6a640 1 --2- 172.21.15.78:0/659623082 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557faf78d900 0x557faf83cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.454+0000 7fd54e36b640 1 --2- 172.21.15.78:0/659623082 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557faf85fa70 0x557faf7d39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.454+0000 7fd547fff640 1 -- 172.21.15.78:0/659623082 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557faf78d900 msgr2=0x557faf83cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:11.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.454+0000 7fd547fff640 1 --2- 172.21.15.78:0/659623082 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557faf78d900 0x557faf83cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.454+0000 7fd547fff640 1 -- 172.21.15.78:0/659623082 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557faf85fa70 msgr2=0x557faf7d39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:11.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.454+0000 7fd547fff640 1 --2- 172.21.15.78:0/659623082 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557faf85fa70 0x557faf7d39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.454+0000 7fd547fff640 1 -- 172.21.15.78:0/659623082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557faf85edd0 con 0x557faf841d10 2024-09-17T03:10:11.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.454+0000 7fd547fff640 1 --2- 172.21.15.78:0/659623082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557faf841d10 0x557faf7d4e20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd53800b7c0 tx=0x7fd53800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc116693e48e68e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.454+0000 7fd54cb68640 1 -- 172.21.15.78:0/659623082 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53800aae0 con 0x557faf841d10 2024-09-17T03:10:11.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.455+0000 7fd54cb68640 1 -- 172.21.15.78:0/659623082 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd53800ac80 con 0x557faf841d10 2024-09-17T03:10:11.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.455+0000 7fd54cb68640 1 -- 172.21.15.78:0/659623082 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd538015680 con 0x557faf841d10 2024-09-17T03:10:11.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.455+0000 7fd5540b0f40 1 -- 172.21.15.78:0/659623082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557faf841d10 msgr2=0x557faf7d4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.455+0000 7fd5540b0f40 1 --2- 172.21.15.78:0/659623082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557faf841d10 0x557faf7d4e20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd53800b7c0 tx=0x7fd53800bc80 comp rx=0 tx=0).stop 2024-09-17T03:10:11.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.455+0000 7fd5540b0f40 1 -- 172.21.15.78:0/659623082 shutdown_connections 2024-09-17T03:10:11.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.455+0000 7fd5540b0f40 1 --2- 172.21.15.78:0/659623082 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557faf85fa70 0x557faf7d39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.455+0000 7fd5540b0f40 1 --2- 172.21.15.78:0/659623082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557faf841d10 0x557faf7d4e20 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.455+0000 7fd5540b0f40 1 --2- 172.21.15.78:0/659623082 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557faf78d900 0x557faf83cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.455+0000 7fd5540b0f40 1 -- 172.21.15.78:0/659623082 >> 172.21.15.78:0/659623082 conn(0x557faf6aaac0 msgr2=0x557faf7cc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:11.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.455+0000 7fd5540b0f40 1 -- 172.21.15.78:0/659623082 shutdown_connections 2024-09-17T03:10:11.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.455+0000 7fd5540b0f40 1 -- 172.21.15.78:0/659623082 wait complete. 2024-09-17T03:10:11.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.456+0000 7fd5540b0f40 1 Processor -- start 2024-09-17T03:10:11.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.456+0000 7fd5540b0f40 1 -- start start 2024-09-17T03:10:11.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.457+0000 7fd5540b0f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557faf78d900 0x557faf8350c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.457+0000 7fd5540b0f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557faf841d10 0x557faf7d2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.457+0000 7fd5540b0f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557faf85fa70 0x557faf7d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.457+0000 7fd5540b0f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557faf841440 con 0x557faf78d900 2024-09-17T03:10:11.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.457+0000 7fd5540b0f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557faf78b450 con 0x557faf841d10 2024-09-17T03:10:11.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.457+0000 7fd5540b0f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x557faf8f8890 con 0x557faf85fa70 2024-09-17T03:10:11.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.457+0000 7fd54db6a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557faf78d900 0x557faf8350c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.457+0000 7fd54db6a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557faf78d900 0x557faf8350c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32952/0 (socket says 172.21.15.78:32952) 2024-09-17T03:10:11.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.457+0000 7fd54db6a640 1 -- 172.21.15.78:0/1912721131 learned_addr learned my addr 172.21.15.78:0/1912721131 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:11.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.458+0000 7fd54db6a640 1 -- 172.21.15.78:0/1912721131 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557faf85fa70 msgr2=0x557faf7d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.458+0000 7fd54db6a640 1 --2- 172.21.15.78:0/1912721131 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557faf85fa70 0x557faf7d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.458+0000 7fd54db6a640 1 -- 172.21.15.78:0/1912721131 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557faf841d10 msgr2=0x557faf7d2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.458+0000 7fd54db6a640 1 --2- 172.21.15.78:0/1912721131 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557faf841d10 0x557faf7d2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.458+0000 7fd54db6a640 1 -- 172.21.15.78:0/1912721131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557faf8f9640 con 0x557faf78d900 2024-09-17T03:10:11.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.458+0000 7fd54db6a640 1 --2- 172.21.15.78:0/1912721131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557faf78d900 0x557faf8350c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd540004f40 tx=0x7fd54004d7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.458+0000 7fd546ffd640 1 -- 172.21.15.78:0/1912721131 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd540056530 con 0x557faf78d900 2024-09-17T03:10:11.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.458+0000 7fd546ffd640 1 -- 172.21.15.78:0/1912721131 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5400567c0 con 0x557faf78d900 2024-09-17T03:10:11.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.458+0000 7fd546ffd640 1 -- 172.21.15.78:0/1912721131 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd540056c10 con 0x557faf78d900 2024-09-17T03:10:11.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.458+0000 7fd5540b0f40 1 -- 172.21.15.78:0/1912721131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557faf835600 con 0x557faf78d900 2024-09-17T03:10:11.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.458+0000 7fd5540b0f40 1 -- 172.21.15.78:0/1912721131 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557faf8391c0 con 0x557faf78d900 2024-09-17T03:10:11.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.460+0000 7fd546ffd640 1 -- 172.21.15.78:0/1912721131 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd54006a060 con 0x557faf78d900 2024-09-17T03:10:11.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.460+0000 7fd546ffd640 1 --2- 172.21.15.78:0/1912721131 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd530077570 0x7fd530079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.460+0000 7fd546ffd640 1 -- 172.21.15.78:0/1912721131 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd5400dd5d0 con 0x557faf78d900 2024-09-17T03:10:11.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.460+0000 7fd5540b0f40 1 --2- 172.21.15.78:0/1912721131 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x557faf839ca0 0x557faf904bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.460+0000 7fd5540b0f40 1 -- 172.21.15.78:0/1912721131 --> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] -- osd_op(unknown.0.0:1 4.1d 4:bbf5850a:::10000000007.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) -- 0x557faf7cc560 con 0x557faf839ca0 2024-09-17T03:10:11.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.460+0000 7fd547fff640 1 --2- 172.21.15.78:0/1912721131 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd530077570 0x7fd530079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.460+0000 7fd54e36b640 1 --2- 172.21.15.78:0/1912721131 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x557faf839ca0 0x557faf904bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.461+0000 7fd54e36b640 1 --2- 172.21.15.78:0/1912721131 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x557faf839ca0 0x557faf904bd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.461+0000 7fd547fff640 1 --2- 172.21.15.78:0/1912721131 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd530077570 0x7fd530079a80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x557faf83ca30 tx=0x7fd538003020 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.461+0000 7fd54e36b640 1 -- 172.21.15.78:0/1912721131 <== osd.3 v2:172.21.15.78:6800/2433795738 1 ==== osd_op_reply(1 10000000007.00000000 [getxattr (10) out=10b] v0'0 uv7 ondisk = 0) ==== 164+0+10 (crc 0 0 0) 0x7fd548002040 con 0x557faf839ca0 2024-09-17T03:10:11.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.461+0000 7fd5540b0f40 1 -- 172.21.15.78:0/1912721131 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x557faf839ca0 msgr2=0x557faf904bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.461+0000 7fd5540b0f40 1 --2- 172.21.15.78:0/1912721131 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x557faf839ca0 0x557faf904bd0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.461+0000 7fd5540b0f40 1 -- 172.21.15.78:0/1912721131 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd530077570 msgr2=0x7fd530079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.461+0000 7fd5540b0f40 1 --2- 172.21.15.78:0/1912721131 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd530077570 0x7fd530079a80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x557faf83ca30 tx=0x7fd538003020 comp rx=0 tx=0).stop 2024-09-17T03:10:11.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.461+0000 7fd5540b0f40 1 -- 172.21.15.78:0/1912721131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557faf78d900 msgr2=0x557faf8350c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.461+0000 7fd5540b0f40 1 --2- 172.21.15.78:0/1912721131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557faf78d900 0x557faf8350c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd540004f40 tx=0x7fd54004d7d0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.461+0000 7fd54e36b640 1 -- 172.21.15.78:0/1912721131 reap_dead start 2024-09-17T03:10:11.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.461+0000 7fd5540b0f40 1 -- 172.21.15.78:0/1912721131 shutdown_connections 2024-09-17T03:10:11.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.461+0000 7fd5540b0f40 1 -- 172.21.15.78:0/1912721131 >> 172.21.15.78:0/1912721131 conn(0x557faf6aaac0 msgr2=0x557faf855920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:11.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.461+0000 7fd5540b0f40 1 -- 172.21.15.78:0/1912721131 shutdown_connections 2024-09-17T03:10:11.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.461+0000 7fd5540b0f40 1 -- 172.21.15.78:0/1912721131 wait complete. 2024-09-17T03:10:11.464 INFO:teuthology.orchestra.run.smithi078.stdout:tag123 2024-09-17T03:10:11.464 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:10:11.464 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:10:11.516 DEBUG:teuthology.orchestra.run.smithi193:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:10:11.558 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:10:11.559 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:10:11.559 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:10:11.559 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:10:11.575 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:10:11.575 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:10:11.631 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:10:11.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.787+0000 7fba188f2640 1 -- 172.21.15.78:0/4182395292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba00005150 msgr2=0x7fba0000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.787+0000 7fba188f2640 1 --2- 172.21.15.78:0/4182395292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba00005150 0x7fba0000b9c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00c610 tx=0x7fba00005830 comp rx=0 tx=0).stop 2024-09-17T03:10:11.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.787+0000 7fba12d9d640 1 -- 172.21.15.78:0/4182395292 reap_dead start 2024-09-17T03:10:11.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.787+0000 7fba188f2640 1 -- 172.21.15.78:0/4182395292 shutdown_connections 2024-09-17T03:10:11.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.787+0000 7fba188f2640 1 -- 172.21.15.78:0/4182395292 >> 172.21.15.78:0/4182395292 conn(0x7fba1408bfc0 msgr2=0x7fba1409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:11.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.787+0000 7fba188f2640 1 -- 172.21.15.78:0/4182395292 shutdown_connections 2024-09-17T03:10:11.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.787+0000 7fba188f2640 1 -- 172.21.15.78:0/4182395292 wait complete. 2024-09-17T03:10:11.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.789+0000 7fba188f2640 1 Processor -- start 2024-09-17T03:10:11.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.789+0000 7fba188f2640 1 -- start start 2024-09-17T03:10:11.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.790+0000 7fba188f2640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba00005150 0x7fba1414e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.790+0000 7fba188f2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba140cb5c0 0x7fba141e88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.790+0000 7fba188f2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba141e8e10 0x7fba140cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.790+0000 7fba188f2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fba140b3540 con 0x7fba140cb5c0 2024-09-17T03:10:11.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.790+0000 7fba188f2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fba1406e380 con 0x7fba141e8e10 2024-09-17T03:10:11.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.790+0000 7fba188f2640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fba140b36c0 con 0x7fba00005150 2024-09-17T03:10:11.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.790+0000 7fba0bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba140cb5c0 0x7fba141e88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.790+0000 7fba0bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba140cb5c0 0x7fba141e88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32972/0 (socket says 172.21.15.78:32972) 2024-09-17T03:10:11.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.790+0000 7fba0bfff640 1 -- 172.21.15.78:0/3966384121 learned_addr learned my addr 172.21.15.78:0/3966384121 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:11.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.791+0000 7fba1259c640 1 --2- 172.21.15.78:0/3966384121 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba00005150 0x7fba1414e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.791+0000 7fba12d9d640 1 --2- 172.21.15.78:0/3966384121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba141e8e10 0x7fba140cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.791+0000 7fba0bfff640 1 -- 172.21.15.78:0/3966384121 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba00005150 msgr2=0x7fba1414e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.791+0000 7fba0bfff640 1 --2- 172.21.15.78:0/3966384121 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba00005150 0x7fba1414e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.791+0000 7fba0bfff640 1 -- 172.21.15.78:0/3966384121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba141e8e10 msgr2=0x7fba140cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.791+0000 7fba0bfff640 1 --2- 172.21.15.78:0/3966384121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba141e8e10 0x7fba140cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.791+0000 7fba0bfff640 1 -- 172.21.15.78:0/3966384121 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba140ce200 con 0x7fba140cb5c0 2024-09-17T03:10:11.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.791+0000 7fba12d9d640 1 --2- 172.21.15.78:0/3966384121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba141e8e10 0x7fba140cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:10:11.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.791+0000 7fba0bfff640 1 --2- 172.21.15.78:0/3966384121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba140cb5c0 0x7fba141e88d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc004e20 tx=0x7fb9fc001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.791+0000 7fba0affd640 1 -- 172.21.15.78:0/3966384121 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc0107d0 con 0x7fba140cb5c0 2024-09-17T03:10:11.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.791+0000 7fba0affd640 1 -- 172.21.15.78:0/3966384121 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9fc016070 con 0x7fba140cb5c0 2024-09-17T03:10:11.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.791+0000 7fba188f2640 1 -- 172.21.15.78:0/3966384121 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba140ce4e0 con 0x7fba140cb5c0 2024-09-17T03:10:11.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.791+0000 7fba0affd640 1 -- 172.21.15.78:0/3966384121 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc010ca0 con 0x7fba140cb5c0 2024-09-17T03:10:11.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.791+0000 7fba188f2640 1 -- 172.21.15.78:0/3966384121 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba14160230 con 0x7fba140cb5c0 2024-09-17T03:10:11.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.792+0000 7fba188f2640 1 -- 172.21.15.78:0/3966384121 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba140d3330 con 0x7fba140cb5c0 2024-09-17T03:10:11.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.793+0000 7fba0affd640 1 -- 172.21.15.78:0/3966384121 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb9fc01b460 con 0x7fba140cb5c0 2024-09-17T03:10:11.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.793+0000 7fba0affd640 1 --2- 172.21.15.78:0/3966384121 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb9f4078bc0 0x7fb9f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:11.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.793+0000 7fba0affd640 1 -- 172.21.15.78:0/3966384121 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fb9fc09b550 con 0x7fba140cb5c0 2024-09-17T03:10:11.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.793+0000 7fba1259c640 1 --2- 172.21.15.78:0/3966384121 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb9f4078bc0 0x7fb9f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:11.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.794+0000 7fba1259c640 1 --2- 172.21.15.78:0/3966384121 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb9f4078bc0 0x7fb9f407b0d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fba04009aa0 tx=0x7fba04005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:11.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.798+0000 7fba0affd640 1 -- 172.21.15.78:0/3966384121 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb9fc063a20 con 0x7fba140cb5c0 2024-09-17T03:10:11.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.985+0000 7fba188f2640 1 -- 172.21.15.78:0/3966384121 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fba140b6dd0 con 0x7fba140cb5c0 2024-09-17T03:10:11.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.985+0000 7fba0affd640 1 -- 172.21.15.78:0/3966384121 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7fb9fc063320 con 0x7fba140cb5c0 2024-09-17T03:10:11.984 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-09-17T03:10:11.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.988+0000 7fba188f2640 1 -- 172.21.15.78:0/3966384121 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb9f4078bc0 msgr2=0x7fb9f407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.988+0000 7fba188f2640 1 --2- 172.21.15.78:0/3966384121 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb9f4078bc0 0x7fb9f407b0d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fba04009aa0 tx=0x7fba04005f90 comp rx=0 tx=0).stop 2024-09-17T03:10:11.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.988+0000 7fba188f2640 1 -- 172.21.15.78:0/3966384121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba140cb5c0 msgr2=0x7fba141e88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:11.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.988+0000 7fba188f2640 1 --2- 172.21.15.78:0/3966384121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba140cb5c0 0x7fba141e88d0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc004e20 tx=0x7fb9fc001630 comp rx=0 tx=0).stop 2024-09-17T03:10:11.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.988+0000 7fba188f2640 1 -- 172.21.15.78:0/3966384121 shutdown_connections 2024-09-17T03:10:11.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.988+0000 7fba188f2640 1 --2- 172.21.15.78:0/3966384121 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb9f4078bc0 0x7fb9f407b0d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.988+0000 7fba188f2640 1 --2- 172.21.15.78:0/3966384121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba141e8e10 0x7fba140cd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.988+0000 7fba188f2640 1 --2- 172.21.15.78:0/3966384121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba140cb5c0 0x7fba141e88d0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.988+0000 7fba188f2640 1 --2- 172.21.15.78:0/3966384121 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba00005150 0x7fba1414e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:11.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.988+0000 7fba188f2640 1 -- 172.21.15.78:0/3966384121 >> 172.21.15.78:0/3966384121 conn(0x7fba1408bfc0 msgr2=0x7fba140b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:11.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.988+0000 7fba188f2640 1 -- 172.21.15.78:0/3966384121 shutdown_connections 2024-09-17T03:10:11.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:11.988+0000 7fba188f2640 1 -- 172.21.15.78:0/3966384121 wait complete. 2024-09-17T03:10:11.998 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:10:11.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:10:11.998 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:10:12.027 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T03:10:12.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:10:12.027 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:10:12.083 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:10:12.083 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:10:12.083 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:10:12.103 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:10:12.103 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:10:12.103 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:10:12.104 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:10:12.138 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056010,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1013 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:10:12.139 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:10:12.139 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:10:12.139 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:10:12.161 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:10:12.161 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:10:12.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.293+0000 7fbbc99c3640 1 -- 172.21.15.78:0/1436353002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbc40ceb40 msgr2=0x7fbbc40cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:12.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.293+0000 7fbbc99c3640 1 --2- 172.21.15.78:0/1436353002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbc40ceb40 0x7fbbc40cef50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40ba570 tx=0x7fbbbc02aa70 comp rx=0 tx=0).stop 2024-09-17T03:10:12.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.294+0000 7fbbc99c3640 1 -- 172.21.15.78:0/1436353002 shutdown_connections 2024-09-17T03:10:12.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.294+0000 7fbbc99c3640 1 --2- 172.21.15.78:0/1436353002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbc40ceb40 0x7fbbc40cef50 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:12.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.294+0000 7fbbc99c3640 1 --2- 172.21.15.78:0/1436353002 >> v2:172.21.15.193:3300/0 conn(0x7fbbc406e170 0x7fbbc40b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:12.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.294+0000 7fbbc99c3640 1 -- 172.21.15.78:0/1436353002 >> 172.21.15.78:0/1436353002 conn(0x7fbbc408bfc0 msgr2=0x7fbbc409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:12.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.294+0000 7fbbc99c3640 1 -- 172.21.15.78:0/1436353002 shutdown_connections 2024-09-17T03:10:12.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.294+0000 7fbbc99c3640 1 -- 172.21.15.78:0/1436353002 wait complete. 2024-09-17T03:10:12.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.295+0000 7fbbc99c3640 1 Processor -- start 2024-09-17T03:10:12.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.295+0000 7fbbc99c3640 1 -- start start 2024-09-17T03:10:12.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbc99c3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbbc406f4b0 0x7fbbc40b87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:12.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbc99c3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbc40ceb40 0x7fbbc41f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:12.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbc99c3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbbc4151670 0x7fbbc4151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:12.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbc99c3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc40d0e60 con 0x7fbbc40ceb40 2024-09-17T03:10:12.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbc99c3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc40d0ce0 con 0x7fbbc406f4b0 2024-09-17T03:10:12.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbc99c3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc40d0fe0 con 0x7fbbc4151670 2024-09-17T03:10:12.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbbbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbc40ceb40 0x7fbbc41f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:12.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbbbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbc40ceb40 0x7fbbc41f5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32986/0 (socket says 172.21.15.78:32986) 2024-09-17T03:10:12.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbbbfff640 1 -- 172.21.15.78:0/3002832209 learned_addr learned my addr 172.21.15.78:0/3002832209 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbc37fe640 1 --2- 172.21.15.78:0/3002832209 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbbc4151670 0x7fbbc4151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbc2ffd640 1 --2- 172.21.15.78:0/3002832209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbbc406f4b0 0x7fbbc40b87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbbbfff640 1 -- 172.21.15.78:0/3002832209 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbbc4151670 msgr2=0x7fbbc4151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbbbfff640 1 --2- 172.21.15.78:0/3002832209 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbbc4151670 0x7fbbc4151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbbbfff640 1 -- 172.21.15.78:0/3002832209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbbc406f4b0 msgr2=0x7fbbc40b87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbbbfff640 1 --2- 172.21.15.78:0/3002832209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbbc406f4b0 0x7fbbc40b87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbbbfff640 1 -- 172.21.15.78:0/3002832209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc40b7720 con 0x7fbbc40ceb40 2024-09-17T03:10:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbc37fe640 1 --2- 172.21.15.78:0/3002832209 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbbc4151670 0x7fbbc4151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbbbfff640 1 --2- 172.21.15.78:0/3002832209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbc40ceb40 0x7fbbc41f5c80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00c370 tx=0x7fbbac00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbc0ff9640 1 -- 172.21.15.78:0/3002832209 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac017070 con 0x7fbbc40ceb40 2024-09-17T03:10:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbc0ff9640 1 -- 172.21.15.78:0/3002832209 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbbac0053c0 con 0x7fbbc40ceb40 2024-09-17T03:10:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbc0ff9640 1 -- 172.21.15.78:0/3002832209 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbac003870 con 0x7fbbc40ceb40 2024-09-17T03:10:12.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.297+0000 7fbbc99c3640 1 -- 172.21.15.78:0/3002832209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc40b7a00 con 0x7fbbc40ceb40 2024-09-17T03:10:12.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.298+0000 7fbbc99c3640 1 -- 172.21.15.78:0/3002832209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc40b7fc0 con 0x7fbbc40ceb40 2024-09-17T03:10:12.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.298+0000 7fbbc99c3640 1 -- 172.21.15.78:0/3002832209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbc40d1570 con 0x7fbbc40ceb40 2024-09-17T03:10:12.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.299+0000 7fbbc0ff9640 1 -- 172.21.15.78:0/3002832209 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbbac01a070 con 0x7fbbc40ceb40 2024-09-17T03:10:12.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.300+0000 7fbbc0ff9640 1 --2- 172.21.15.78:0/3002832209 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbba4078b90 0x7fbba407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:12.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.300+0000 7fbbc0ff9640 1 -- 172.21.15.78:0/3002832209 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fbbac09a410 con 0x7fbbc40ceb40 2024-09-17T03:10:12.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.300+0000 7fbbc2ffd640 1 --2- 172.21.15.78:0/3002832209 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbba4078b90 0x7fbba407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:12.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.301+0000 7fbbc2ffd640 1 --2- 172.21.15.78:0/3002832209 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbba4078b90 0x7fbba407b0a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400b810 tx=0x7fbbb4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:12.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.303+0000 7fbbc0ff9640 1 -- 172.21.15.78:0/3002832209 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbbac021020 con 0x7fbbc40ceb40 2024-09-17T03:10:12.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.512+0000 7fbbc99c3640 1 -- 172.21.15.78:0/3002832209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbbc40b74b0 con 0x7fbbc40ceb40 2024-09-17T03:10:12.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.512+0000 7fbbc0ff9640 1 -- 172.21.15.78:0/3002832209 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5273 (secure 0 0 0) 0x7fbbac0629c0 con 0x7fbbc40ceb40 2024-09-17T03:10:12.511 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:12.511 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":21,"btime":"2024-09-17T03:09:42:290395+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2234221933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2234221933},{"type":"v1","addr":"172.21.15.193:6836","nonce":2234221933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:09:08.411464+0000","modified":"2024-09-17T03:09:41.865870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4938,"mds_1":4929,"mds_2":4661},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4661":{"gid":4661,"name":"d","rank":2,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6837/2343001441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2343001441},{"type":"v1","addr":"172.21.15.193:6837","nonce":2343001441}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4929":{"gid":4929,"name":"c","rank":1,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.78:6833/2730690660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2730690660},{"type":"v1","addr":"172.21.15.78:6833","nonce":2730690660}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/2663458793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2663458793},{"type":"v1","addr":"172.21.15.78:6835","nonce":2663458793}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4938,"qdb_cluster":[4938,4929,4661]},"id":2}]} 2024-09-17T03:10:12.512 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 21 2024-09-17T03:10:12.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.514+0000 7fbbc99c3640 1 -- 172.21.15.78:0/3002832209 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbba4078b90 msgr2=0x7fbba407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:12.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.514+0000 7fbbc99c3640 1 --2- 172.21.15.78:0/3002832209 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbba4078b90 0x7fbba407b0a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400b810 tx=0x7fbbb4008040 comp rx=0 tx=0).stop 2024-09-17T03:10:12.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.514+0000 7fbbc99c3640 1 -- 172.21.15.78:0/3002832209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbc40ceb40 msgr2=0x7fbbc41f5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:12.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.514+0000 7fbbc99c3640 1 --2- 172.21.15.78:0/3002832209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbc40ceb40 0x7fbbc41f5c80 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fbbac00c370 tx=0x7fbbac00c830 comp rx=0 tx=0).stop 2024-09-17T03:10:12.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.514+0000 7fbbc99c3640 1 -- 172.21.15.78:0/3002832209 shutdown_connections 2024-09-17T03:10:12.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.514+0000 7fbbc99c3640 1 --2- 172.21.15.78:0/3002832209 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbbc4151670 0x7fbbc4151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:12.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.514+0000 7fbbc99c3640 1 --2- 172.21.15.78:0/3002832209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbc40ceb40 0x7fbbc41f5c80 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:12.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.514+0000 7fbbc99c3640 1 --2- 172.21.15.78:0/3002832209 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbba4078b90 0x7fbba407b0a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:12.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.514+0000 7fbbc99c3640 1 --2- 172.21.15.78:0/3002832209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbbc406f4b0 0x7fbbc40b87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:12.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.514+0000 7fbbc99c3640 1 -- 172.21.15.78:0/3002832209 >> 172.21.15.78:0/3002832209 conn(0x7fbbc408bfc0 msgr2=0x7fbbc40b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:12.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.515+0000 7fbbc99c3640 1 -- 172.21.15.78:0/3002832209 shutdown_connections 2024-09-17T03:10:12.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.515+0000 7fbbc99c3640 1 -- 172.21.15.78:0/3002832209 wait complete. 2024-09-17T03:10:12.525 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:10:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.638+0000 7f1ed06f4640 1 -- 172.21.15.78:0/2997345029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ec80cad30 msgr2=0x7f1ec80735b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.638+0000 7f1ed06f4640 1 --2- 172.21.15.78:0/2997345029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ec80cad30 0x7f1ec80735b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1ec809e2e0 tx=0x7f1ec002aac0 comp rx=0 tx=0).stop 2024-09-17T03:10:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.638+0000 7f1ed06f4640 1 -- 172.21.15.78:0/2997345029 shutdown_connections 2024-09-17T03:10:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.638+0000 7f1ed06f4640 1 --2- 172.21.15.78:0/2997345029 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ec80cad30 0x7f1ec80735b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.638+0000 7f1ed06f4640 1 --2- 172.21.15.78:0/2997345029 >> v2:172.21.15.193:3300/0 conn(0x7f1ec80706b0 0x7f1ec80cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.638+0000 7f1ed06f4640 1 -- 172.21.15.78:0/2997345029 >> 172.21.15.78:0/2997345029 conn(0x7f1ec80b1cb0 msgr2=0x7f1ec80b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.638+0000 7f1ed06f4640 1 -- 172.21.15.78:0/2997345029 shutdown_connections 2024-09-17T03:10:12.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.638+0000 7f1ed06f4640 1 -- 172.21.15.78:0/2997345029 wait complete. 2024-09-17T03:10:12.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.640+0000 7f1ed06f4640 1 Processor -- start 2024-09-17T03:10:12.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.640+0000 7f1ed06f4640 1 -- start start 2024-09-17T03:10:12.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.641+0000 7f1ed06f4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ec80ca800 0x7f1ec81f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:12.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.641+0000 7f1ed06f4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ec80cad30 0x7f1ec80c4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:12.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.641+0000 7f1ed06f4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1ec815b670 0x7f1ec80af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:12.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.641+0000 7f1ed06f4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec8073ef0 con 0x7f1ec80ca800 2024-09-17T03:10:12.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.641+0000 7f1ed06f4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec8073d70 con 0x7f1ec80cad30 2024-09-17T03:10:12.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.641+0000 7f1ed06f4640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f1ec8074070 con 0x7f1ec815b670 2024-09-17T03:10:12.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.641+0000 7f1ece490640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ec80ca800 0x7f1ec81f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:12.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.641+0000 7f1ece490640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ec80ca800 0x7f1ec81f5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33018/0 (socket says 172.21.15.78:33018) 2024-09-17T03:10:12.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.641+0000 7f1ece490640 1 -- 172.21.15.78:0/1838279448 learned_addr learned my addr 172.21.15.78:0/1838279448 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:12.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.641+0000 7f1ecdc8f640 1 --2- 172.21.15.78:0/1838279448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ec80cad30 0x7f1ec80c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:12.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.641+0000 7f1ecec91640 1 --2- 172.21.15.78:0/1838279448 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1ec815b670 0x7f1ec80af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:12.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.641+0000 7f1ece490640 1 -- 172.21.15.78:0/1838279448 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1ec815b670 msgr2=0x7f1ec80af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:12.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.641+0000 7f1ece490640 1 --2- 172.21.15.78:0/1838279448 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1ec815b670 0x7f1ec80af9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:12.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.641+0000 7f1ece490640 1 -- 172.21.15.78:0/1838279448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ec80cad30 msgr2=0x7f1ec80c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:12.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.641+0000 7f1ece490640 1 --2- 172.21.15.78:0/1838279448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ec80cad30 0x7f1ec80c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:12.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.641+0000 7f1ece490640 1 -- 172.21.15.78:0/1838279448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec81f52e0 con 0x7f1ec80ca800 2024-09-17T03:10:12.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.641+0000 7f1ecdc8f640 1 --2- 172.21.15.78:0/1838279448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ec80cad30 0x7f1ec80c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:12.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.642+0000 7f1ece490640 1 --2- 172.21.15.78:0/1838279448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ec80ca800 0x7f1ec81f5d50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800c370 tx=0x7f1eb800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:12.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.642+0000 7f1ec6ffd640 1 -- 172.21.15.78:0/1838279448 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8017070 con 0x7f1ec80ca800 2024-09-17T03:10:12.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.642+0000 7f1ec6ffd640 1 -- 172.21.15.78:0/1838279448 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1eb80053c0 con 0x7f1ec80ca800 2024-09-17T03:10:12.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.642+0000 7f1ed06f4640 1 -- 172.21.15.78:0/1838279448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec80c4840 con 0x7f1ec80ca800 2024-09-17T03:10:12.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.642+0000 7f1ec6ffd640 1 -- 172.21.15.78:0/1838279448 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb8003850 con 0x7f1ec80ca800 2024-09-17T03:10:12.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.642+0000 7f1ed06f4640 1 -- 172.21.15.78:0/1838279448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec81f5550 con 0x7f1ec80ca800 2024-09-17T03:10:12.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.643+0000 7f1ed06f4640 1 -- 172.21.15.78:0/1838279448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec8074600 con 0x7f1ec80ca800 2024-09-17T03:10:12.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.644+0000 7f1ec6ffd640 1 -- 172.21.15.78:0/1838279448 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1eb801a070 con 0x7f1ec80ca800 2024-09-17T03:10:12.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.644+0000 7f1ec6ffd640 1 --2- 172.21.15.78:0/1838279448 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1eb4078bc0 0x7f1eb407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:12.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.644+0000 7f1ec6ffd640 1 -- 172.21.15.78:0/1838279448 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f1eb809a090 con 0x7f1ec80ca800 2024-09-17T03:10:12.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.644+0000 7f1ecdc8f640 1 --2- 172.21.15.78:0/1838279448 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1eb4078bc0 0x7f1eb407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:12.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.645+0000 7f1ecdc8f640 1 --2- 172.21.15.78:0/1838279448 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1eb4078bc0 0x7f1eb407b0d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1ec80b25c0 tx=0x7f1ebc005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:12.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.649+0000 7f1ec6ffd640 1 -- 172.21.15.78:0/1838279448 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1eb8062560 con 0x7f1ec80ca800 2024-09-17T03:10:12.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.859+0000 7f1ed06f4640 1 -- 172.21.15.78:0/1838279448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ec80b2310 con 0x7f1ec80ca800 2024-09-17T03:10:12.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.860+0000 7f1ec6ffd640 1 -- 172.21.15.78:0/1838279448 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5273 (secure 0 0 0) 0x7f1eb8061e60 con 0x7f1ec80ca800 2024-09-17T03:10:12.859 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:12.859 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":21,"btime":"2024-09-17T03:09:42:290395+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2234221933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2234221933},{"type":"v1","addr":"172.21.15.193:6836","nonce":2234221933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:09:08.411464+0000","modified":"2024-09-17T03:09:41.865870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4938,"mds_1":4929,"mds_2":4661},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4661":{"gid":4661,"name":"d","rank":2,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6837/2343001441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2343001441},{"type":"v1","addr":"172.21.15.193:6837","nonce":2343001441}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4929":{"gid":4929,"name":"c","rank":1,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.78:6833/2730690660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2730690660},{"type":"v1","addr":"172.21.15.78:6833","nonce":2730690660}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/2663458793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2663458793},{"type":"v1","addr":"172.21.15.78:6835","nonce":2663458793}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4938,"qdb_cluster":[4938,4929,4661]},"id":2}]} 2024-09-17T03:10:12.859 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 21 2024-09-17T03:10:12.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.862+0000 7f1ed06f4640 1 -- 172.21.15.78:0/1838279448 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1eb4078bc0 msgr2=0x7f1eb407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:12.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.862+0000 7f1ed06f4640 1 --2- 172.21.15.78:0/1838279448 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1eb4078bc0 0x7f1eb407b0d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1ec80b25c0 tx=0x7f1ebc005f90 comp rx=0 tx=0).stop 2024-09-17T03:10:12.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.862+0000 7f1ed06f4640 1 -- 172.21.15.78:0/1838279448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ec80ca800 msgr2=0x7f1ec81f5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:12.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.862+0000 7f1ed06f4640 1 --2- 172.21.15.78:0/1838279448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ec80ca800 0x7f1ec81f5d50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800c370 tx=0x7f1eb800c830 comp rx=0 tx=0).stop 2024-09-17T03:10:12.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.862+0000 7f1ed06f4640 1 -- 172.21.15.78:0/1838279448 shutdown_connections 2024-09-17T03:10:12.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.862+0000 7f1ed06f4640 1 --2- 172.21.15.78:0/1838279448 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1ec815b670 0x7f1ec80af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:12.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.862+0000 7f1ed06f4640 1 --2- 172.21.15.78:0/1838279448 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1eb4078bc0 0x7f1eb407b0d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:12.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.862+0000 7f1ed06f4640 1 --2- 172.21.15.78:0/1838279448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ec80cad30 0x7f1ec80c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:12.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.862+0000 7f1ed06f4640 1 --2- 172.21.15.78:0/1838279448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ec80ca800 0x7f1ec81f5d50 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:12.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.862+0000 7f1ed06f4640 1 -- 172.21.15.78:0/1838279448 >> 172.21.15.78:0/1838279448 conn(0x7f1ec80b1cb0 msgr2=0x7f1ec80d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:12.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.862+0000 7f1ed06f4640 1 -- 172.21.15.78:0/1838279448 shutdown_connections 2024-09-17T03:10:12.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.862+0000 7f1ed06f4640 1 -- 172.21.15.78:0/1838279448 wait complete. 2024-09-17T03:10:12.872 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:10:12.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.986+0000 7efcb7b94640 1 -- 172.21.15.78:0/1127927063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc98003a50 msgr2=0x7efc98003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:12.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.986+0000 7efcb7b94640 1 --2- 172.21.15.78:0/1127927063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc98003a50 0x7efc98003ec0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7efca0001dc0 tx=0x7efc98005830 comp rx=0 tx=0).stop 2024-09-17T03:10:12.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.986+0000 7efcb7b94640 1 -- 172.21.15.78:0/1127927063 shutdown_connections 2024-09-17T03:10:12.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.986+0000 7efcb7b94640 1 --2- 172.21.15.78:0/1127927063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc98003a50 0x7efc98003ec0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:12.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.986+0000 7efcb7b94640 1 -- 172.21.15.78:0/1127927063 >> 172.21.15.78:0/1127927063 conn(0x7efcb008bfc0 msgr2=0x7efcb009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:12.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.987+0000 7efcb7b94640 1 -- 172.21.15.78:0/1127927063 shutdown_connections 2024-09-17T03:10:12.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.987+0000 7efcb7b94640 1 -- 172.21.15.78:0/1127927063 wait complete. 2024-09-17T03:10:12.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.988+0000 7efcb7b94640 1 Processor -- start 2024-09-17T03:10:12.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.988+0000 7efcb7b94640 1 -- start start 2024-09-17T03:10:12.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcb7b94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc98003a50 0x7efcb00ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:12.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcb7b94640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efcb01f6100 0x7efcb01f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:12.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcb7b94640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcb00cd330 0x7efcb00cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:12.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcb7b94640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efcb00d34b0 con 0x7efc98003a50 2024-09-17T03:10:12.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcb7b94640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efcb00d3330 con 0x7efcb00cd330 2024-09-17T03:10:12.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcb7b94640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7efcb00d3630 con 0x7efcb01f6100 2024-09-17T03:10:12.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcb5930640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc98003a50 0x7efcb00ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:12.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcb5930640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc98003a50 0x7efcb00ca8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33038/0 (socket says 172.21.15.78:33038) 2024-09-17T03:10:12.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcb5930640 1 -- 172.21.15.78:0/3917363471 learned_addr learned my addr 172.21.15.78:0/3917363471 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:12.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcb512f640 1 --2- 172.21.15.78:0/3917363471 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efcb01f6100 0x7efcb01f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:12.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcb6131640 1 --2- 172.21.15.78:0/3917363471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcb00cd330 0x7efcb00cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:12.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcb5930640 1 -- 172.21.15.78:0/3917363471 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efcb01f6100 msgr2=0x7efcb01f2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:12.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcb5930640 1 --2- 172.21.15.78:0/3917363471 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efcb01f6100 0x7efcb01f2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:12.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcb5930640 1 -- 172.21.15.78:0/3917363471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcb00cd330 msgr2=0x7efcb00cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:12.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcb5930640 1 --2- 172.21.15.78:0/3917363471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcb00cd330 0x7efcb00cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:12.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcb5930640 1 -- 172.21.15.78:0/3917363471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb00cdc80 con 0x7efc98003a50 2024-09-17T03:10:12.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcb6131640 1 --2- 172.21.15.78:0/3917363471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcb00cd330 0x7efcb00cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:12.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcb5930640 1 --2- 172.21.15.78:0/3917363471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc98003a50 0x7efcb00ca8d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7efca0001ee0 tx=0x7efca0003aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:12.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcae7fc640 1 -- 172.21.15.78:0/3917363471 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca0006460 con 0x7efc98003a50 2024-09-17T03:10:12.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcae7fc640 1 -- 172.21.15.78:0/3917363471 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efca00066f0 con 0x7efc98003a50 2024-09-17T03:10:12.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcb7b94640 1 -- 172.21.15.78:0/3917363471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb00cc700 con 0x7efc98003a50 2024-09-17T03:10:12.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcae7fc640 1 -- 172.21.15.78:0/3917363471 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efca00068c0 con 0x7efc98003a50 2024-09-17T03:10:12.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.990+0000 7efcb7b94640 1 -- 172.21.15.78:0/3917363471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb00cb940 con 0x7efc98003a50 2024-09-17T03:10:12.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.991+0000 7efcb7b94640 1 -- 172.21.15.78:0/3917363471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb00b9520 con 0x7efc98003a50 2024-09-17T03:10:12.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.992+0000 7efcae7fc640 1 -- 172.21.15.78:0/3917363471 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efca00336e0 con 0x7efc98003a50 2024-09-17T03:10:12.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.992+0000 7efcae7fc640 1 --2- 172.21.15.78:0/3917363471 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efc9c078bc0 0x7efc9c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:12.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.993+0000 7efcae7fc640 1 -- 172.21.15.78:0/3917363471 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7efca00bad90 con 0x7efc98003a50 2024-09-17T03:10:12.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.993+0000 7efcb512f640 1 --2- 172.21.15.78:0/3917363471 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efc9c078bc0 0x7efc9c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:12.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.993+0000 7efcb512f640 1 --2- 172.21.15.78:0/3917363471 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efc9c078bc0 0x7efc9c07b0d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efcb00ceaa0 tx=0x7efca4005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:12.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:12.997+0000 7efcae7fc640 1 -- 172.21.15.78:0/3917363471 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efcb00b9520 con 0x7efc98003a50 2024-09-17T03:10:13.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.178+0000 7efcb7b94640 1 -- 172.21.15.78:0/3917363471 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efcb006f830 con 0x7efc98003a50 2024-09-17T03:10:13.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.179+0000 7efcae7fc640 1 -- 172.21.15.78:0/3917363471 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16705 (secure 0 0 0) 0x7efcb00cdc80 con 0x7efc98003a50 2024-09-17T03:10:13.178 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:13.178 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":34,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:09:10.053417+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:09:06.055293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T03:09:07.368417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:10:13.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.181+0000 7efcb7b94640 1 -- 172.21.15.78:0/3917363471 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efc9c078bc0 msgr2=0x7efc9c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:13.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.181+0000 7efcb7b94640 1 --2- 172.21.15.78:0/3917363471 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efc9c078bc0 0x7efc9c07b0d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7efcb00ceaa0 tx=0x7efca4005f90 comp rx=0 tx=0).stop 2024-09-17T03:10:13.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.181+0000 7efcb7b94640 1 -- 172.21.15.78:0/3917363471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc98003a50 msgr2=0x7efcb00ca8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:13.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.181+0000 7efcb7b94640 1 --2- 172.21.15.78:0/3917363471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc98003a50 0x7efcb00ca8d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7efca0001ee0 tx=0x7efca0003aa0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.181+0000 7efcb7b94640 1 -- 172.21.15.78:0/3917363471 shutdown_connections 2024-09-17T03:10:13.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.181+0000 7efcb7b94640 1 --2- 172.21.15.78:0/3917363471 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efc9c078bc0 0x7efc9c07b0d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.181+0000 7efcb7b94640 1 --2- 172.21.15.78:0/3917363471 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efcb00cd330 0x7efcb00cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.181+0000 7efcb7b94640 1 --2- 172.21.15.78:0/3917363471 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efcb01f6100 0x7efcb01f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.181+0000 7efcb7b94640 1 --2- 172.21.15.78:0/3917363471 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efc98003a50 0x7efcb00ca8d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.181+0000 7efcb7b94640 1 -- 172.21.15.78:0/3917363471 >> 172.21.15.78:0/3917363471 conn(0x7efcb008bfc0 msgr2=0x7efcb00b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.181+0000 7efcb7b94640 1 -- 172.21.15.78:0/3917363471 shutdown_connections 2024-09-17T03:10:13.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.181+0000 7efcb7b94640 1 -- 172.21.15.78:0/3917363471 wait complete. 2024-09-17T03:10:13.191 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:10:13.192 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:10:13.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.306+0000 7fbd4ba94640 1 -- 172.21.15.78:0/1314779476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd300040b0 msgr2=0x7fbd30004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:13.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.306+0000 7fbd4ba94640 1 --2- 172.21.15.78:0/1314779476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd300040b0 0x7fbd30004800 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400baf0 tx=0x7fbd30005830 comp rx=0 tx=0).stop 2024-09-17T03:10:13.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.306+0000 7fbd4a031640 1 -- 172.21.15.78:0/1314779476 reap_dead start 2024-09-17T03:10:13.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.306+0000 7fbd4ba94640 1 -- 172.21.15.78:0/1314779476 shutdown_connections 2024-09-17T03:10:13.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.306+0000 7fbd4ba94640 1 -- 172.21.15.78:0/1314779476 >> 172.21.15.78:0/1314779476 conn(0x7fbd44072ae0 msgr2=0x7fbd44072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:13.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.306+0000 7fbd4ba94640 1 -- 172.21.15.78:0/1314779476 shutdown_connections 2024-09-17T03:10:13.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.306+0000 7fbd4ba94640 1 -- 172.21.15.78:0/1314779476 wait complete. 2024-09-17T03:10:13.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.308+0000 7fbd4ba94640 1 Processor -- start 2024-09-17T03:10:13.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.308+0000 7fbd4ba94640 1 -- start start 2024-09-17T03:10:13.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.309+0000 7fbd4ba94640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbd300040b0 0x7fbd4414bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:13.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.309+0000 7fbd4ba94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd440ad780 0x7fbd441f6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:13.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.309+0000 7fbd4ba94640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd44149400 0x7fbd44149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:13.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.309+0000 7fbd4ba94640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbd440d1a60 con 0x7fbd440ad780 2024-09-17T03:10:13.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.309+0000 7fbd4ba94640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbd440d18e0 con 0x7fbd44149400 2024-09-17T03:10:13.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.309+0000 7fbd4ba94640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fbd440d10e0 con 0x7fbd300040b0 2024-09-17T03:10:13.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.309+0000 7fbd4902f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd440ad780 0x7fbd441f6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:13.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.309+0000 7fbd4902f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd440ad780 0x7fbd441f6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33058/0 (socket says 172.21.15.78:33058) 2024-09-17T03:10:13.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.309+0000 7fbd4902f640 1 -- 172.21.15.78:0/3769967189 learned_addr learned my addr 172.21.15.78:0/3769967189 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:13.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.309+0000 7fbd49830640 1 --2- 172.21.15.78:0/3769967189 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbd300040b0 0x7fbd4414bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:13.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.309+0000 7fbd4a031640 1 --2- 172.21.15.78:0/3769967189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd44149400 0x7fbd44149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:13.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.309+0000 7fbd4902f640 1 -- 172.21.15.78:0/3769967189 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbd300040b0 msgr2=0x7fbd4414bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:13.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.309+0000 7fbd4902f640 1 --2- 172.21.15.78:0/3769967189 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbd300040b0 0x7fbd4414bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.309+0000 7fbd4902f640 1 -- 172.21.15.78:0/3769967189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd44149400 msgr2=0x7fbd44149810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:13.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.309+0000 7fbd4902f640 1 --2- 172.21.15.78:0/3769967189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd44149400 0x7fbd44149810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.309+0000 7fbd4902f640 1 -- 172.21.15.78:0/3769967189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd441f7330 con 0x7fbd440ad780 2024-09-17T03:10:13.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.309+0000 7fbd4902f640 1 --2- 172.21.15.78:0/3769967189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd440ad780 0x7fbd441f6890 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400baf0 tx=0x7fbd3400b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:13.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.310+0000 7fbd3a7fc640 1 -- 172.21.15.78:0/3769967189 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd34040070 con 0x7fbd440ad780 2024-09-17T03:10:13.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.310+0000 7fbd3a7fc640 1 -- 172.21.15.78:0/3769967189 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd3403a920 con 0x7fbd440ad780 2024-09-17T03:10:13.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.310+0000 7fbd4ba94640 1 -- 172.21.15.78:0/3769967189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd441f7610 con 0x7fbd440ad780 2024-09-17T03:10:13.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.310+0000 7fbd3a7fc640 1 -- 172.21.15.78:0/3769967189 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd34035040 con 0x7fbd440ad780 2024-09-17T03:10:13.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.310+0000 7fbd4ba94640 1 -- 172.21.15.78:0/3769967189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd44149dc0 con 0x7fbd440ad780 2024-09-17T03:10:13.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.311+0000 7fbd4ba94640 1 -- 172.21.15.78:0/3769967189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd440cebf0 con 0x7fbd440ad780 2024-09-17T03:10:13.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.311+0000 7fbd3a7fc640 1 -- 172.21.15.78:0/3769967189 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbd34038020 con 0x7fbd440ad780 2024-09-17T03:10:13.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.312+0000 7fbd3a7fc640 1 --2- 172.21.15.78:0/3769967189 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbd28078bc0 0x7fbd2807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:13.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.312+0000 7fbd3a7fc640 1 -- 172.21.15.78:0/3769967189 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fbd340bb950 con 0x7fbd440ad780 2024-09-17T03:10:13.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.312+0000 7fbd49830640 1 --2- 172.21.15.78:0/3769967189 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbd28078bc0 0x7fbd2807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:13.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.313+0000 7fbd49830640 1 --2- 172.21.15.78:0/3769967189 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbd28078bc0 0x7fbd2807b0d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbd40000c00 tx=0x7fbd40006b70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:13.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.317+0000 7fbd3a7fc640 1 -- 172.21.15.78:0/3769967189 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbd34083e30 con 0x7fbd440ad780 2024-09-17T03:10:13.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.528+0000 7fbd4ba94640 1 -- 172.21.15.78:0/3769967189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd440cc6f0 con 0x7fbd440ad780 2024-09-17T03:10:13.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.528+0000 7fbd3a7fc640 1 -- 172.21.15.78:0/3769967189 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5273 (secure 0 0 0) 0x7fbd34083730 con 0x7fbd440ad780 2024-09-17T03:10:13.527 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:13.527 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":21,"btime":"2024-09-17T03:09:42:290395+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2234221933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2234221933},{"type":"v1","addr":"172.21.15.193:6836","nonce":2234221933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:09:08.411464+0000","modified":"2024-09-17T03:09:41.865870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4938,"mds_1":4929,"mds_2":4661},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4661":{"gid":4661,"name":"d","rank":2,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6837/2343001441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2343001441},{"type":"v1","addr":"172.21.15.193:6837","nonce":2343001441}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4929":{"gid":4929,"name":"c","rank":1,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.78:6833/2730690660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2730690660},{"type":"v1","addr":"172.21.15.78:6833","nonce":2730690660}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/2663458793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2663458793},{"type":"v1","addr":"172.21.15.78:6835","nonce":2663458793}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4938,"qdb_cluster":[4938,4929,4661]},"id":2}]} 2024-09-17T03:10:13.528 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 21 2024-09-17T03:10:13.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.531+0000 7fbd4ba94640 1 -- 172.21.15.78:0/3769967189 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbd28078bc0 msgr2=0x7fbd2807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:13.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.531+0000 7fbd4ba94640 1 --2- 172.21.15.78:0/3769967189 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbd28078bc0 0x7fbd2807b0d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbd40000c00 tx=0x7fbd40006b70 comp rx=0 tx=0).stop 2024-09-17T03:10:13.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.531+0000 7fbd4ba94640 1 -- 172.21.15.78:0/3769967189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd440ad780 msgr2=0x7fbd441f6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:13.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.531+0000 7fbd4ba94640 1 --2- 172.21.15.78:0/3769967189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd440ad780 0x7fbd441f6890 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400baf0 tx=0x7fbd3400b710 comp rx=0 tx=0).stop 2024-09-17T03:10:13.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.531+0000 7fbd4ba94640 1 -- 172.21.15.78:0/3769967189 shutdown_connections 2024-09-17T03:10:13.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.531+0000 7fbd4ba94640 1 --2- 172.21.15.78:0/3769967189 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbd28078bc0 0x7fbd2807b0d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.531+0000 7fbd4ba94640 1 --2- 172.21.15.78:0/3769967189 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd44149400 0x7fbd44149810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.531+0000 7fbd4ba94640 1 --2- 172.21.15.78:0/3769967189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd440ad780 0x7fbd441f6890 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.531+0000 7fbd4ba94640 1 --2- 172.21.15.78:0/3769967189 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbd300040b0 0x7fbd4414bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.531+0000 7fbd4ba94640 1 -- 172.21.15.78:0/3769967189 >> 172.21.15.78:0/3769967189 conn(0x7fbd44072ae0 msgr2=0x7fbd440b6e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:13.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.531+0000 7fbd4ba94640 1 -- 172.21.15.78:0/3769967189 shutdown_connections 2024-09-17T03:10:13.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.531+0000 7fbd4ba94640 1 -- 172.21.15.78:0/3769967189 wait complete. 2024-09-17T03:10:13.541 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:10:13.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.654+0000 7fc1ae158640 1 -- 172.21.15.78:0/1627895576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a80cad30 msgr2=0x7fc1a80735b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:13.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.654+0000 7fc1ae158640 1 --2- 172.21.15.78:0/1627895576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a80cad30 0x7fc1a80735b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0005fd0 tx=0x7fc1a002a530 comp rx=0 tx=0).stop 2024-09-17T03:10:13.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.654+0000 7fc1ae158640 1 -- 172.21.15.78:0/1627895576 shutdown_connections 2024-09-17T03:10:13.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.654+0000 7fc1ae158640 1 --2- 172.21.15.78:0/1627895576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a80cad30 0x7fc1a80735b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.654+0000 7fc1ae158640 1 --2- 172.21.15.78:0/1627895576 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc1a80706b0 0x7fc1a80cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.654+0000 7fc1ae158640 1 -- 172.21.15.78:0/1627895576 >> 172.21.15.78:0/1627895576 conn(0x7fc1a80b1cb0 msgr2=0x7fc1a80b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:13.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.654+0000 7fc1ae158640 1 -- 172.21.15.78:0/1627895576 shutdown_connections 2024-09-17T03:10:13.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.654+0000 7fc1ae158640 1 -- 172.21.15.78:0/1627895576 wait complete. 2024-09-17T03:10:13.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.656+0000 7fc1ae158640 1 Processor -- start 2024-09-17T03:10:13.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.656+0000 7fc1ae158640 1 -- start start 2024-09-17T03:10:13.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.657+0000 7fc1ae158640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1a80ca800 0x7fc1a81f7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:13.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.657+0000 7fc1ae158640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a80cad30 0x7fc1a81e5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:13.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.657+0000 7fc1ae158640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc1a8159bb0 0x7fc1a8159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:13.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.657+0000 7fc1ae158640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a8073f00 con 0x7fc1a80cad30 2024-09-17T03:10:13.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.657+0000 7fc1ae158640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a8073d80 con 0x7fc1a80ca800 2024-09-17T03:10:13.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.657+0000 7fc1ae158640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc1a8074080 con 0x7fc1a8159bb0 2024-09-17T03:10:13.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.657+0000 7fc1a6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a80cad30 0x7fc1a81e5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:13.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.657+0000 7fc1a6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a80cad30 0x7fc1a81e5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33088/0 (socket says 172.21.15.78:33088) 2024-09-17T03:10:13.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.657+0000 7fc1a6ffd640 1 -- 172.21.15.78:0/3537541186 learned_addr learned my addr 172.21.15.78:0/3537541186 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:13.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.657+0000 7fc1a77fe640 1 --2- 172.21.15.78:0/3537541186 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1a80ca800 0x7fc1a81f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:13.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.657+0000 7fc1a7fff640 1 --2- 172.21.15.78:0/3537541186 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc1a8159bb0 0x7fc1a8159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:13.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.658+0000 7fc1a6ffd640 1 -- 172.21.15.78:0/3537541186 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc1a8159bb0 msgr2=0x7fc1a8159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:13.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.658+0000 7fc1a6ffd640 1 --2- 172.21.15.78:0/3537541186 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc1a8159bb0 0x7fc1a8159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.658+0000 7fc1a6ffd640 1 -- 172.21.15.78:0/3537541186 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1a80ca800 msgr2=0x7fc1a81f7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:13.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.658+0000 7fc1a6ffd640 1 --2- 172.21.15.78:0/3537541186 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1a80ca800 0x7fc1a81f7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.658+0000 7fc1a6ffd640 1 -- 172.21.15.78:0/3537541186 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a81e5b50 con 0x7fc1a80cad30 2024-09-17T03:10:13.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.658+0000 7fc1a77fe640 1 --2- 172.21.15.78:0/3537541186 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1a80ca800 0x7fc1a81f7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:13.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.658+0000 7fc1a7fff640 1 --2- 172.21.15.78:0/3537541186 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc1a8159bb0 0x7fc1a8159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:13.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.658+0000 7fc1a6ffd640 1 --2- 172.21.15.78:0/3537541186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a80cad30 0x7fc1a81e5610 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00ea20 tx=0x7fc19c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:13.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.658+0000 7fc18ffff640 1 -- 172.21.15.78:0/3537541186 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c00cde0 con 0x7fc1a80cad30 2024-09-17T03:10:13.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.658+0000 7fc18ffff640 1 -- 172.21.15.78:0/3537541186 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc19c004c10 con 0x7fc1a80cad30 2024-09-17T03:10:13.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.658+0000 7fc18ffff640 1 -- 172.21.15.78:0/3537541186 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19c005020 con 0x7fc1a80cad30 2024-09-17T03:10:13.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.658+0000 7fc1ae158640 1 -- 172.21.15.78:0/3537541186 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a81f3260 con 0x7fc1a80cad30 2024-09-17T03:10:13.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.658+0000 7fc1ae158640 1 -- 172.21.15.78:0/3537541186 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a809bd40 con 0x7fc1a80cad30 2024-09-17T03:10:13.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.659+0000 7fc1ae158640 1 -- 172.21.15.78:0/3537541186 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a80745b0 con 0x7fc1a80cad30 2024-09-17T03:10:13.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.660+0000 7fc18ffff640 1 -- 172.21.15.78:0/3537541186 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc19c0051c0 con 0x7fc1a80cad30 2024-09-17T03:10:13.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.660+0000 7fc18ffff640 1 --2- 172.21.15.78:0/3537541186 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc194078b90 0x7fc19407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:13.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.660+0000 7fc18ffff640 1 -- 172.21.15.78:0/3537541186 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc19c09b710 con 0x7fc1a80cad30 2024-09-17T03:10:13.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.661+0000 7fc1a77fe640 1 --2- 172.21.15.78:0/3537541186 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc194078b90 0x7fc19407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:13.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.661+0000 7fc1a77fe640 1 --2- 172.21.15.78:0/3537541186 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc194078b90 0x7fc19407b0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc198006fd0 tx=0x7fc198008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:13.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.665+0000 7fc18ffff640 1 -- 172.21.15.78:0/3537541186 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc19c016030 con 0x7fc1a80cad30 2024-09-17T03:10:13.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.872+0000 7fc1ae158640 1 -- 172.21.15.78:0/3537541186 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1a81f7770 con 0x7fc1a80cad30 2024-09-17T03:10:13.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.873+0000 7fc18ffff640 1 -- 172.21.15.78:0/3537541186 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5273 (secure 0 0 0) 0x7fc19c063b50 con 0x7fc1a80cad30 2024-09-17T03:10:13.872 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:13.872 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":21,"btime":"2024-09-17T03:09:42:290395+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2234221933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2234221933},{"type":"v1","addr":"172.21.15.193:6836","nonce":2234221933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:09:08.411464+0000","modified":"2024-09-17T03:09:41.865870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4938,"mds_1":4929,"mds_2":4661},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4661":{"gid":4661,"name":"d","rank":2,"incarnation":17,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6837/2343001441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2343001441},{"type":"v1","addr":"172.21.15.193:6837","nonce":2343001441}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4929":{"gid":4929,"name":"c","rank":1,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.78:6833/2730690660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2730690660},{"type":"v1","addr":"172.21.15.78:6833","nonce":2730690660}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/2663458793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2663458793},{"type":"v1","addr":"172.21.15.78:6835","nonce":2663458793}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4938,"qdb_cluster":[4938,4929,4661]},"id":2}]} 2024-09-17T03:10:13.872 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 21 2024-09-17T03:10:13.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.875+0000 7fc1ae158640 1 -- 172.21.15.78:0/3537541186 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc194078b90 msgr2=0x7fc19407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:13.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.875+0000 7fc1ae158640 1 --2- 172.21.15.78:0/3537541186 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc194078b90 0x7fc19407b0a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc198006fd0 tx=0x7fc198008040 comp rx=0 tx=0).stop 2024-09-17T03:10:13.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.875+0000 7fc1ae158640 1 -- 172.21.15.78:0/3537541186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a80cad30 msgr2=0x7fc1a81e5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:13.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.875+0000 7fc1ae158640 1 --2- 172.21.15.78:0/3537541186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a80cad30 0x7fc1a81e5610 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00ea20 tx=0x7fc19c00eee0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.875+0000 7fc1ae158640 1 -- 172.21.15.78:0/3537541186 shutdown_connections 2024-09-17T03:10:13.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.875+0000 7fc1ae158640 1 --2- 172.21.15.78:0/3537541186 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc1a8159bb0 0x7fc1a8159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.875+0000 7fc1ae158640 1 --2- 172.21.15.78:0/3537541186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a80cad30 0x7fc1a81e5610 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.875+0000 7fc1ae158640 1 --2- 172.21.15.78:0/3537541186 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc194078b90 0x7fc19407b0a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.875+0000 7fc1ae158640 1 --2- 172.21.15.78:0/3537541186 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1a80ca800 0x7fc1a81f7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.875+0000 7fc1ae158640 1 -- 172.21.15.78:0/3537541186 >> 172.21.15.78:0/3537541186 conn(0x7fc1a80b1cb0 msgr2=0x7fc1a80aefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:13.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.875+0000 7fc1ae158640 1 -- 172.21.15.78:0/3537541186 shutdown_connections 2024-09-17T03:10:13.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.875+0000 7fc1ae158640 1 -- 172.21.15.78:0/3537541186 wait complete. 2024-09-17T03:10:13.885 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:10:13.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.999+0000 7f5296620640 1 -- 172.21.15.78:0/642361340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f527c004800 msgr2=0x7f527c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:13.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.999+0000 7f5296620640 1 --2- 172.21.15.78:0/642361340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f527c004800 0x7f527c004c10 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f52900d1c00 tx=0x7f527c005830 comp rx=0 tx=0).stop 2024-09-17T03:10:13.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.999+0000 7f5296620640 1 -- 172.21.15.78:0/642361340 shutdown_connections 2024-09-17T03:10:13.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.999+0000 7f5296620640 1 --2- 172.21.15.78:0/642361340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f527c004800 0x7f527c004c10 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:13.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.999+0000 7f5296620640 1 -- 172.21.15.78:0/642361340 >> 172.21.15.78:0/642361340 conn(0x7f529008bfc0 msgr2=0x7f529009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:13.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.999+0000 7f5296620640 1 -- 172.21.15.78:0/642361340 shutdown_connections 2024-09-17T03:10:13.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:13.999+0000 7f5296620640 1 -- 172.21.15.78:0/642361340 wait complete. 2024-09-17T03:10:13.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.001+0000 7f5296620640 1 Processor -- start 2024-09-17T03:10:13.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.001+0000 7f5296620640 1 -- start start 2024-09-17T03:10:14.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.002+0000 7f5296620640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f527c004800 0x7f52901f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:14.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.002+0000 7f5296620640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52900ca800 0x7f52900cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:14.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.002+0000 7f5296620640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52900cc0f0 0x7f52900cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:14.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.002+0000 7f5296620640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f52900cef50 con 0x7f527c004800 2024-09-17T03:10:14.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.002+0000 7f5296620640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f529006e3d0 con 0x7f52900cc0f0 2024-09-17T03:10:14.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.002+0000 7f5296620640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f52900cf0d0 con 0x7f52900ca800 2024-09-17T03:10:14.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.002+0000 7f528ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f527c004800 0x7f52901f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:14.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.002+0000 7f528ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f527c004800 0x7f52901f4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33100/0 (socket says 172.21.15.78:33100) 2024-09-17T03:10:14.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.002+0000 7f528ffff640 1 -- 172.21.15.78:0/1643088365 learned_addr learned my addr 172.21.15.78:0/1643088365 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:14.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.002+0000 7f5294bbd640 1 --2- 172.21.15.78:0/1643088365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52900cc0f0 0x7f52900cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:14.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.002+0000 7f528f7fe640 1 --2- 172.21.15.78:0/1643088365 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52900ca800 0x7f52900cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:14.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.003+0000 7f528ffff640 1 -- 172.21.15.78:0/1643088365 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52900ca800 msgr2=0x7f52900cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:14.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.003+0000 7f528ffff640 1 --2- 172.21.15.78:0/1643088365 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52900ca800 0x7f52900cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:14.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.003+0000 7f528ffff640 1 -- 172.21.15.78:0/1643088365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52900cc0f0 msgr2=0x7f52900cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:14.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.003+0000 7f528ffff640 1 --2- 172.21.15.78:0/1643088365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52900cc0f0 0x7f52900cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:14.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.003+0000 7f528ffff640 1 -- 172.21.15.78:0/1643088365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52900b6dd0 con 0x7f527c004800 2024-09-17T03:10:14.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.003+0000 7f528f7fe640 1 --2- 172.21.15.78:0/1643088365 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52900ca800 0x7f52900cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:10:14.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.003+0000 7f5294bbd640 1 --2- 172.21.15.78:0/1643088365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52900cc0f0 0x7f52900cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:10:14.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.003+0000 7f528ffff640 1 --2- 172.21.15.78:0/1643088365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f527c004800 0x7f52901f4c40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f528000e5c0 tx=0x7f528000ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:14.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.003+0000 7f528cff9640 1 -- 172.21.15.78:0/1643088365 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5280015070 con 0x7f527c004800 2024-09-17T03:10:14.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.003+0000 7f528cff9640 1 -- 172.21.15.78:0/1643088365 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f528000ca60 con 0x7f527c004800 2024-09-17T03:10:14.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.003+0000 7f5296620640 1 -- 172.21.15.78:0/1643088365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52900caef0 con 0x7f527c004800 2024-09-17T03:10:14.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.003+0000 7f528cff9640 1 -- 172.21.15.78:0/1643088365 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528000ce70 con 0x7f527c004800 2024-09-17T03:10:14.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.003+0000 7f5296620640 1 -- 172.21.15.78:0/1643088365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52900b6400 con 0x7f527c004800 2024-09-17T03:10:14.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.004+0000 7f5296620640 1 -- 172.21.15.78:0/1643088365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52900b5f10 con 0x7f527c004800 2024-09-17T03:10:14.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.005+0000 7f528cff9640 1 -- 172.21.15.78:0/1643088365 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5280018070 con 0x7f527c004800 2024-09-17T03:10:14.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.005+0000 7f528cff9640 1 --2- 172.21.15.78:0/1643088365 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5270078b90 0x7f527007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:14.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.006+0000 7f528cff9640 1 -- 172.21.15.78:0/1643088365 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f528009b410 con 0x7f527c004800 2024-09-17T03:10:14.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.006+0000 7f528f7fe640 1 --2- 172.21.15.78:0/1643088365 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5270078b90 0x7f527007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:14.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.006+0000 7f528f7fe640 1 --2- 172.21.15.78:0/1643088365 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5270078b90 0x7f527007b0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5278032000 tx=0x7f5278001190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:14.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.009+0000 7f528cff9640 1 -- 172.21.15.78:0/1643088365 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5280063a50 con 0x7f527c004800 2024-09-17T03:10:14.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.185+0000 7f5296620640 1 -- 172.21.15.78:0/1643088365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f529006f670 con 0x7f527c004800 2024-09-17T03:10:14.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.186+0000 7f528cff9640 1 -- 172.21.15.78:0/1643088365 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16705 (secure 0 0 0) 0x7f5280063350 con 0x7f527c004800 2024-09-17T03:10:14.185 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:14.185 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":34,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:09:10.053417+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:09:06.055293+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T03:09:07.368417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:10:14.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.188+0000 7f5296620640 1 -- 172.21.15.78:0/1643088365 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5270078b90 msgr2=0x7f527007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:14.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.188+0000 7f5296620640 1 --2- 172.21.15.78:0/1643088365 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5270078b90 0x7f527007b0a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5278032000 tx=0x7f5278001190 comp rx=0 tx=0).stop 2024-09-17T03:10:14.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.188+0000 7f5296620640 1 -- 172.21.15.78:0/1643088365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f527c004800 msgr2=0x7f52901f4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:14.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.188+0000 7f5296620640 1 --2- 172.21.15.78:0/1643088365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f527c004800 0x7f52901f4c40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f528000e5c0 tx=0x7f528000ea80 comp rx=0 tx=0).stop 2024-09-17T03:10:14.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.188+0000 7f5296620640 1 -- 172.21.15.78:0/1643088365 shutdown_connections 2024-09-17T03:10:14.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.188+0000 7f5296620640 1 --2- 172.21.15.78:0/1643088365 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5270078b90 0x7f527007b0a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:14.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.188+0000 7f5296620640 1 --2- 172.21.15.78:0/1643088365 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52900cc0f0 0x7f52900cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:14.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.188+0000 7f5296620640 1 --2- 172.21.15.78:0/1643088365 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52900ca800 0x7f52900cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:14.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.188+0000 7f5296620640 1 --2- 172.21.15.78:0/1643088365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f527c004800 0x7f52901f4c40 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:14.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.188+0000 7f5296620640 1 -- 172.21.15.78:0/1643088365 >> 172.21.15.78:0/1643088365 conn(0x7f529008bfc0 msgr2=0x7f52900b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:14.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.188+0000 7f5296620640 1 -- 172.21.15.78:0/1643088365 shutdown_connections 2024-09-17T03:10:14.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.188+0000 7f5296620640 1 -- 172.21.15.78:0/1643088365 wait complete. 2024-09-17T03:10:14.198 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:10:14.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.312+0000 7f0c465f9640 1 -- 172.21.15.78:0/1676501826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c400b3a60 msgr2=0x7f0c400cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:14.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.312+0000 7f0c465f9640 1 --2- 172.21.15.78:0/1676501826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c400b3a60 0x7f0c400cfb70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0c4008c950 tx=0x7f0c3002a540 comp rx=0 tx=0).stop 2024-09-17T03:10:14.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.312+0000 7f0c465f9640 1 -- 172.21.15.78:0/1676501826 shutdown_connections 2024-09-17T03:10:14.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.312+0000 7f0c465f9640 1 --2- 172.21.15.78:0/1676501826 >> v2:172.21.15.193:3300/0 conn(0x7f0c4006e3c0 0x7f0c4006f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:14.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.312+0000 7f0c465f9640 1 --2- 172.21.15.78:0/1676501826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c400b3a60 0x7f0c400cfb70 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:14.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.312+0000 7f0c465f9640 1 -- 172.21.15.78:0/1676501826 >> 172.21.15.78:0/1676501826 conn(0x7f0c4008bfc0 msgr2=0x7f0c4009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:14.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.313+0000 7f0c465f9640 1 -- 172.21.15.78:0/1676501826 shutdown_connections 2024-09-17T03:10:14.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.313+0000 7f0c465f9640 1 -- 172.21.15.78:0/1676501826 wait complete. 2024-09-17T03:10:14.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.314+0000 7f0c465f9640 1 Processor -- start 2024-09-17T03:10:14.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.315+0000 7f0c465f9640 1 -- start start 2024-09-17T03:10:14.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.316+0000 7f0c465f9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c4006e3c0 0x7f0c400a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:14.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.316+0000 7f0c465f9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c400b3a60 0x7f0c40150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:14.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.316+0000 7f0c465f9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c400d0e10 0x7f0c40150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:14.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.316+0000 7f0c465f9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0c400d2c40 con 0x7f0c400b3a60 2024-09-17T03:10:14.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.316+0000 7f0c465f9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0c400d2ac0 con 0x7f0c400d0e10 2024-09-17T03:10:14.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.316+0000 7f0c465f9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0c400d2dc0 con 0x7f0c4006e3c0 2024-09-17T03:10:14.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.316+0000 7f0c3f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c400b3a60 0x7f0c40150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:14.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.316+0000 7f0c3f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c400b3a60 0x7f0c40150530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33118/0 (socket says 172.21.15.78:33118) 2024-09-17T03:10:14.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.316+0000 7f0c3f7fe640 1 -- 172.21.15.78:0/1229267639 learned_addr learned my addr 172.21.15.78:0/1229267639 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:14.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.316+0000 7f0c3ffff640 1 --2- 172.21.15.78:0/1229267639 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c4006e3c0 0x7f0c400a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:14.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.316+0000 7f0c44b96640 1 --2- 172.21.15.78:0/1229267639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c400d0e10 0x7f0c40150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:14.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.316+0000 7f0c3f7fe640 1 -- 172.21.15.78:0/1229267639 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c4006e3c0 msgr2=0x7f0c400a1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:14.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.316+0000 7f0c3f7fe640 1 --2- 172.21.15.78:0/1229267639 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c4006e3c0 0x7f0c400a1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:14.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.316+0000 7f0c3f7fe640 1 -- 172.21.15.78:0/1229267639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c400d0e10 msgr2=0x7f0c40150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:14.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.316+0000 7f0c3f7fe640 1 --2- 172.21.15.78:0/1229267639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c400d0e10 0x7f0c40150a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:14.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.316+0000 7f0c3f7fe640 1 -- 172.21.15.78:0/1229267639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c400b5bd0 con 0x7f0c400b3a60 2024-09-17T03:10:14.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.316+0000 7f0c3ffff640 1 --2- 172.21.15.78:0/1229267639 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c4006e3c0 0x7f0c400a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:14.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.316+0000 7f0c44b96640 1 --2- 172.21.15.78:0/1229267639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c400d0e10 0x7f0c40150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:14.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.316+0000 7f0c3f7fe640 1 --2- 172.21.15.78:0/1229267639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c400b3a60 0x7f0c40150530 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400c970 tx=0x7f0c3400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:14.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.317+0000 7f0c3cff9640 1 -- 172.21.15.78:0/1229267639 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c34007bb0 con 0x7f0c400b3a60 2024-09-17T03:10:14.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.317+0000 7f0c3cff9640 1 -- 172.21.15.78:0/1229267639 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c34005020 con 0x7f0c400b3a60 2024-09-17T03:10:14.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.317+0000 7f0c465f9640 1 -- 172.21.15.78:0/1229267639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c400b5eb0 con 0x7f0c400b3a60 2024-09-17T03:10:14.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.317+0000 7f0c3cff9640 1 -- 172.21.15.78:0/1229267639 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c34007e60 con 0x7f0c400b3a60 2024-09-17T03:10:14.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.317+0000 7f0c465f9640 1 -- 172.21.15.78:0/1229267639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c400b6470 con 0x7f0c400b3a60 2024-09-17T03:10:14.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.318+0000 7f0c465f9640 1 -- 172.21.15.78:0/1229267639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c400d32b0 con 0x7f0c400b3a60 2024-09-17T03:10:14.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.318+0000 7f0c3cff9640 1 -- 172.21.15.78:0/1229267639 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0c34005470 con 0x7f0c400b3a60 2024-09-17T03:10:14.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.319+0000 7f0c3cff9640 1 --2- 172.21.15.78:0/1229267639 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0c2c078bc0 0x7f0c2c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:14.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.319+0000 7f0c3cff9640 1 -- 172.21.15.78:0/1229267639 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0c3409b150 con 0x7f0c400b3a60 2024-09-17T03:10:14.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.319+0000 7f0c3ffff640 1 --2- 172.21.15.78:0/1229267639 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0c2c078bc0 0x7f0c2c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:14.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.320+0000 7f0c3ffff640 1 --2- 172.21.15.78:0/1229267639 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0c2c078bc0 0x7f0c2c07b0d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0c30033000 tx=0x7f0c30004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:14.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.324+0000 7f0c3cff9640 1 -- 172.21.15.78:0/1229267639 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0c34014030 con 0x7f0c400b3a60 2024-09-17T03:10:14.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.535+0000 7f0c465f9640 1 -- 172.21.15.78:0/1229267639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0c400d35f0 con 0x7f0c400b3a60 2024-09-17T03:10:14.534 INFO:tasks.ceph.mon.a.smithi078.stderr:2024-09-17T03:10:14.536+0000 7f192af78640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:10:14.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.537+0000 7f0c3cff9640 1 -- 172.21.15.78:0/1229267639 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) ==== 161+0+0 (secure 0 0 0) 0x7f0c34063620 con 0x7f0c400b3a60 2024-09-17T03:10:14.536 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:10:14.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.540+0000 7f0c465f9640 1 -- 172.21.15.78:0/1229267639 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0c2c078bc0 msgr2=0x7f0c2c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:14.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.540+0000 7f0c465f9640 1 --2- 172.21.15.78:0/1229267639 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0c2c078bc0 0x7f0c2c07b0d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0c30033000 tx=0x7f0c30004730 comp rx=0 tx=0).stop 2024-09-17T03:10:14.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.540+0000 7f0c465f9640 1 -- 172.21.15.78:0/1229267639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c400b3a60 msgr2=0x7f0c40150530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:14.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.540+0000 7f0c465f9640 1 --2- 172.21.15.78:0/1229267639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c400b3a60 0x7f0c40150530 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400c970 tx=0x7f0c3400ce30 comp rx=0 tx=0).stop 2024-09-17T03:10:14.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.541+0000 7f0c465f9640 1 -- 172.21.15.78:0/1229267639 shutdown_connections 2024-09-17T03:10:14.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.541+0000 7f0c465f9640 1 --2- 172.21.15.78:0/1229267639 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0c2c078bc0 0x7f0c2c07b0d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:14.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.541+0000 7f0c465f9640 1 --2- 172.21.15.78:0/1229267639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c400d0e10 0x7f0c40150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:14.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.541+0000 7f0c465f9640 1 --2- 172.21.15.78:0/1229267639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0c400b3a60 0x7f0c40150530 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:14.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.541+0000 7f0c465f9640 1 --2- 172.21.15.78:0/1229267639 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c4006e3c0 0x7f0c400a1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:14.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.541+0000 7f0c465f9640 1 -- 172.21.15.78:0/1229267639 >> 172.21.15.78:0/1229267639 conn(0x7f0c4008bfc0 msgr2=0x7f0c400d3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:14.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.541+0000 7f0c465f9640 1 -- 172.21.15.78:0/1229267639 shutdown_connections 2024-09-17T03:10:14.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.541+0000 7f0c465f9640 1 -- 172.21.15.78:0/1229267639 wait complete. 2024-09-17T03:10:14.544 INFO:tasks.ceph.mds.a.smithi078.stderr: -8934> 2024-09-17T03:09:23.721+0000 7f7e8d854640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-17T03:10:14.545 INFO:tasks.ceph.mds.a.smithi078.stderr: -8932> 2024-09-17T03:09:23.721+0000 7f7e8d854640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-17T03:10:14.552 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:10:14.602 INFO:tasks.ceph.mds.d.smithi193.stdout:starting mds.d at 2024-09-17T03:10:14.605 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2024-09-17T03:10:14.610 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-09-17T03:10:14.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.676+0000 7f66ff719640 1 -- 172.21.15.78:0/3916509919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66e4004d40 msgr2=0x7f66e4005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:14.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.676+0000 7f66ff719640 1 --2- 172.21.15.78:0/3916509919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66e4004d40 0x7f66e4005150 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f66f806dc80 tx=0x7f66e4005830 comp rx=0 tx=0).stop 2024-09-17T03:10:14.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.676+0000 7f66fdcb6640 1 -- 172.21.15.78:0/3916509919 reap_dead start 2024-09-17T03:10:14.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.676+0000 7f66ff719640 1 -- 172.21.15.78:0/3916509919 shutdown_connections 2024-09-17T03:10:14.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.676+0000 7f66ff719640 1 -- 172.21.15.78:0/3916509919 >> 172.21.15.78:0/3916509919 conn(0x7f66f80cdcc0 msgr2=0x7f66f80ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:14.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.676+0000 7f66ff719640 1 -- 172.21.15.78:0/3916509919 shutdown_connections 2024-09-17T03:10:14.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.676+0000 7f66ff719640 1 -- 172.21.15.78:0/3916509919 wait complete. 2024-09-17T03:10:14.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.678+0000 7f66ff719640 1 Processor -- start 2024-09-17T03:10:14.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.678+0000 7f66ff719640 1 -- start start 2024-09-17T03:10:14.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.679+0000 7f66ff719640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66f815bd30 0x7f66f80ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:14.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.679+0000 7f66ff719640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66f80ca810 0x7f66f80c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:14.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.679+0000 7f66ff719640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f66f80c5a00 0x7f66f81f8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:14.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.679+0000 7f66ff719640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f66f80b07f0 con 0x7f66f80ca810 2024-09-17T03:10:14.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.679+0000 7f66ff719640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f66f80b0520 con 0x7f66f815bd30 2024-09-17T03:10:14.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.679+0000 7f66ff719640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f66f80b4100 con 0x7f66f80c5a00 2024-09-17T03:10:14.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.679+0000 7f66fccb4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66f80ca810 0x7f66f80c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:14.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.679+0000 7f66fccb4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66f80ca810 0x7f66f80c54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33166/0 (socket says 172.21.15.78:33166) 2024-09-17T03:10:14.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.679+0000 7f66fccb4640 1 -- 172.21.15.78:0/4111099625 learned_addr learned my addr 172.21.15.78:0/4111099625 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:14.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.680+0000 7f66fd4b5640 1 --2- 172.21.15.78:0/4111099625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66f815bd30 0x7f66f80ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:14.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.680+0000 7f66fccb4640 1 -- 172.21.15.78:0/4111099625 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f66f80c5a00 msgr2=0x7f66f81f8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:14.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.680+0000 7f66fccb4640 1 --2- 172.21.15.78:0/4111099625 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f66f80c5a00 0x7f66f81f8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:14.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.680+0000 7f66fccb4640 1 -- 172.21.15.78:0/4111099625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66f815bd30 msgr2=0x7f66f80ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:14.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.680+0000 7f66fccb4640 1 --2- 172.21.15.78:0/4111099625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66f815bd30 0x7f66f80ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:14.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.680+0000 7f66fccb4640 1 -- 172.21.15.78:0/4111099625 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f80cd1a0 con 0x7f66f80ca810 2024-09-17T03:10:14.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.680+0000 7f66fccb4640 1 --2- 172.21.15.78:0/4111099625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66f80ca810 0x7f66f80c54c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f66e8000ff0 tx=0x7f66e80049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:14.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.680+0000 7f66edffb640 1 -- 172.21.15.78:0/4111099625 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8015020 con 0x7f66f80ca810 2024-09-17T03:10:14.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.680+0000 7f66edffb640 1 -- 172.21.15.78:0/4111099625 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66e8011960 con 0x7f66f80ca810 2024-09-17T03:10:14.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.680+0000 7f66ff719640 1 -- 172.21.15.78:0/4111099625 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f80cbc20 con 0x7f66f80ca810 2024-09-17T03:10:14.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.680+0000 7f66edffb640 1 -- 172.21.15.78:0/4111099625 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e8011d90 con 0x7f66f80ca810 2024-09-17T03:10:14.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.680+0000 7f66ff719640 1 -- 172.21.15.78:0/4111099625 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f80cc460 con 0x7f66f80ca810 2024-09-17T03:10:14.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.681+0000 7f66ff719640 1 -- 172.21.15.78:0/4111099625 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f8162040 con 0x7f66f80ca810 2024-09-17T03:10:14.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.682+0000 7f66edffb640 1 -- 172.21.15.78:0/4111099625 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f66e8018020 con 0x7f66f80ca810 2024-09-17T03:10:14.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.682+0000 7f66edffb640 1 --2- 172.21.15.78:0/4111099625 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f66dc078b90 0x7f66dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:14.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.682+0000 7f66edffb640 1 -- 172.21.15.78:0/4111099625 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5967+0+0 (secure 0 0 0) 0x7f66e809b940 con 0x7f66f80ca810 2024-09-17T03:10:14.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.683+0000 7f66fd4b5640 1 --2- 172.21.15.78:0/4111099625 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f66dc078b90 0x7f66dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:14.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.683+0000 7f66fd4b5640 1 --2- 172.21.15.78:0/4111099625 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f66dc078b90 0x7f66dc07b0a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009a60 tx=0x7f66f4005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:14.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.687+0000 7f66edffb640 1 -- 172.21.15.78:0/4111099625 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f66e801f020 con 0x7f66f80ca810 2024-09-17T03:10:14.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:14.896+0000 7f66ff719640 1 -- 172.21.15.78:0/4111099625 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f66f80cea20 con 0x7f66f80ca810 2024-09-17T03:10:15.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.542+0000 7f66edffb640 1 -- 172.21.15.78:0/4111099625 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7f66f80cbc20 con 0x7f66f80ca810 2024-09-17T03:10:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.545+0000 7f66ff719640 1 -- 172.21.15.78:0/4111099625 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f66dc078b90 msgr2=0x7f66dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.545+0000 7f66ff719640 1 --2- 172.21.15.78:0/4111099625 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f66dc078b90 0x7f66dc07b0a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f66f4009a60 tx=0x7f66f4005f90 comp rx=0 tx=0).stop 2024-09-17T03:10:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.545+0000 7f66ff719640 1 -- 172.21.15.78:0/4111099625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66f80ca810 msgr2=0x7f66f80c54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.545+0000 7f66ff719640 1 --2- 172.21.15.78:0/4111099625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66f80ca810 0x7f66f80c54c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f66e8000ff0 tx=0x7f66e80049d0 comp rx=0 tx=0).stop 2024-09-17T03:10:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.545+0000 7f66ff719640 1 -- 172.21.15.78:0/4111099625 shutdown_connections 2024-09-17T03:10:15.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.545+0000 7f66ff719640 1 --2- 172.21.15.78:0/4111099625 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f66f80c5a00 0x7f66f81f8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.545+0000 7f66ff719640 1 --2- 172.21.15.78:0/4111099625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f66f80ca810 0x7f66f80c54c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.545+0000 7f66ff719640 1 --2- 172.21.15.78:0/4111099625 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f66dc078b90 0x7f66dc07b0a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.545+0000 7f66ff719640 1 --2- 172.21.15.78:0/4111099625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66f815bd30 0x7f66f80ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.545+0000 7f66ff719640 1 -- 172.21.15.78:0/4111099625 >> 172.21.15.78:0/4111099625 conn(0x7f66f80cdcc0 msgr2=0x7f66f80b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.545+0000 7f66ff719640 1 -- 172.21.15.78:0/4111099625 shutdown_connections 2024-09-17T03:10:15.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.545+0000 7f66ff719640 1 -- 172.21.15.78:0/4111099625 wait complete. 2024-09-17T03:10:15.558 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:10:15.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.679+0000 7f908849b640 1 -- 172.21.15.78:0/3754336684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f908015cc30 msgr2=0x7f9080160a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:15.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.679+0000 7f908849b640 1 --2- 172.21.15.78:0/3754336684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f908015cc30 0x7f9080160a00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9070009830 tx=0x7f907002a510 comp rx=0 tx=0).stop 2024-09-17T03:10:15.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.679+0000 7f908849b640 1 -- 172.21.15.78:0/3754336684 shutdown_connections 2024-09-17T03:10:15.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.679+0000 7f908849b640 1 --2- 172.21.15.78:0/3754336684 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f908015cc30 0x7f9080160a00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:15.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.679+0000 7f908849b640 1 --2- 172.21.15.78:0/3754336684 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f908015a310 0x7f90800d1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:15.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.679+0000 7f908849b640 1 -- 172.21.15.78:0/3754336684 >> 172.21.15.78:0/3754336684 conn(0x7f90800ced50 msgr2=0x7f90800cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:15.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.679+0000 7f908849b640 1 -- 172.21.15.78:0/3754336684 shutdown_connections 2024-09-17T03:10:15.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.679+0000 7f908849b640 1 -- 172.21.15.78:0/3754336684 wait complete. 2024-09-17T03:10:15.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.681+0000 7f908849b640 1 Processor -- start 2024-09-17T03:10:15.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.681+0000 7f908849b640 1 -- start start 2024-09-17T03:10:15.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.682+0000 7f908849b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9080071090 0x7f90801f4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.682+0000 7f908849b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f908015a310 0x7f9080148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.682+0000 7f908849b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f908015cc30 0x7f90800ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.682+0000 7f908849b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f90800d01a0 con 0x7f908015cc30 2024-09-17T03:10:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.682+0000 7f908849b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f90800d0020 con 0x7f908015a310 2024-09-17T03:10:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.682+0000 7f908849b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f90800d0320 con 0x7f9080071090 2024-09-17T03:10:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.682+0000 7f9086a38640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f908015cc30 0x7f90800ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.682+0000 7f9086a38640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f908015cc30 0x7f90800ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33168/0 (socket says 172.21.15.78:33168) 2024-09-17T03:10:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.682+0000 7f9086a38640 1 -- 172.21.15.78:0/3120756293 learned_addr learned my addr 172.21.15.78:0/3120756293 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.682+0000 7f9086237640 1 --2- 172.21.15.78:0/3120756293 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9080071090 0x7f90801f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.682+0000 7f9085a36640 1 --2- 172.21.15.78:0/3120756293 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f908015a310 0x7f9080148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.682+0000 7f9086a38640 1 -- 172.21.15.78:0/3120756293 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9080071090 msgr2=0x7f90801f4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.682+0000 7f9086a38640 1 --2- 172.21.15.78:0/3120756293 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9080071090 0x7f90801f4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.682+0000 7f9086a38640 1 -- 172.21.15.78:0/3120756293 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f908015a310 msgr2=0x7f9080148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.682+0000 7f9086a38640 1 --2- 172.21.15.78:0/3120756293 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f908015a310 0x7f9080148280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.682+0000 7f9086a38640 1 -- 172.21.15.78:0/3120756293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90801f4770 con 0x7f908015cc30 2024-09-17T03:10:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.682+0000 7f9085a36640 1 --2- 172.21.15.78:0/3120756293 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f908015a310 0x7f9080148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.683+0000 7f9086a38640 1 --2- 172.21.15.78:0/3120756293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f908015cc30 0x7f90800ca4a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f907800cb10 tx=0x7f907800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.683+0000 7f9076ffd640 1 -- 172.21.15.78:0/3120756293 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078016020 con 0x7f908015cc30 2024-09-17T03:10:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.683+0000 7f908849b640 1 -- 172.21.15.78:0/3120756293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90800c9440 con 0x7f908015cc30 2024-09-17T03:10:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.683+0000 7f9076ffd640 1 -- 172.21.15.78:0/3120756293 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f907800ad00 con 0x7f908015cc30 2024-09-17T03:10:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.683+0000 7f9076ffd640 1 -- 172.21.15.78:0/3120756293 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078012680 con 0x7f908015cc30 2024-09-17T03:10:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.683+0000 7f908849b640 1 -- 172.21.15.78:0/3120756293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90800c99c0 con 0x7f908015cc30 2024-09-17T03:10:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.684+0000 7f908849b640 1 -- 172.21.15.78:0/3120756293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90800ca0e0 con 0x7f908015cc30 2024-09-17T03:10:15.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.685+0000 7f9076ffd640 1 -- 172.21.15.78:0/3120756293 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9078019020 con 0x7f908015cc30 2024-09-17T03:10:15.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.685+0000 7f9076ffd640 1 --2- 172.21.15.78:0/3120756293 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9064078bc0 0x7f906407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:15.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.685+0000 7f9076ffd640 1 -- 172.21.15.78:0/3120756293 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5967+0+0 (secure 0 0 0) 0x7f907809b020 con 0x7f908015cc30 2024-09-17T03:10:15.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.685+0000 7f9086237640 1 --2- 172.21.15.78:0/3120756293 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9064078bc0 0x7f906407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:15.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.686+0000 7f9086237640 1 --2- 172.21.15.78:0/3120756293 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9064078bc0 0x7f906407b0d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f907c0095f0 tx=0x7f907c005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:15.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.690+0000 7f9076ffd640 1 -- 172.21.15.78:0/3120756293 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9078020030 con 0x7f908015cc30 2024-09-17T03:10:15.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:15.867+0000 7f908849b640 1 -- 172.21.15.78:0/3120756293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f90800d07d0 con 0x7f908015cc30 2024-09-17T03:10:16.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.544+0000 7f9076ffd640 1 -- 172.21.15.78:0/3120756293 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7f90801f4770 con 0x7f908015cc30 2024-09-17T03:10:16.543 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:10:16.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.547+0000 7f908849b640 1 -- 172.21.15.78:0/3120756293 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9064078bc0 msgr2=0x7f906407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:16.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.547+0000 7f908849b640 1 --2- 172.21.15.78:0/3120756293 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9064078bc0 0x7f906407b0d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f907c0095f0 tx=0x7f907c005f90 comp rx=0 tx=0).stop 2024-09-17T03:10:16.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.547+0000 7f908849b640 1 -- 172.21.15.78:0/3120756293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f908015cc30 msgr2=0x7f90800ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:16.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.547+0000 7f908849b640 1 --2- 172.21.15.78:0/3120756293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f908015cc30 0x7f90800ca4a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f907800cb10 tx=0x7f907800a060 comp rx=0 tx=0).stop 2024-09-17T03:10:16.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.547+0000 7f908849b640 1 -- 172.21.15.78:0/3120756293 shutdown_connections 2024-09-17T03:10:16.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.547+0000 7f908849b640 1 --2- 172.21.15.78:0/3120756293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f908015cc30 0x7f90800ca4a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.547+0000 7f908849b640 1 --2- 172.21.15.78:0/3120756293 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9064078bc0 0x7f906407b0d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.547+0000 7f908849b640 1 --2- 172.21.15.78:0/3120756293 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f908015a310 0x7f9080148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.547+0000 7f908849b640 1 --2- 172.21.15.78:0/3120756293 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9080071090 0x7f90801f4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.547+0000 7f908849b640 1 -- 172.21.15.78:0/3120756293 >> 172.21.15.78:0/3120756293 conn(0x7f90800ced50 msgr2=0x7f908015c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.547+0000 7f908849b640 1 -- 172.21.15.78:0/3120756293 shutdown_connections 2024-09-17T03:10:16.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.548+0000 7f908849b640 1 -- 172.21.15.78:0/3120756293 wait complete. 2024-09-17T03:10:16.559 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:10:16.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.680+0000 7ff464b32640 1 -- 172.21.15.78:0/1652874408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff46015cc30 msgr2=0x7ff460160a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:16.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.680+0000 7ff464b32640 1 --2- 172.21.15.78:0/1652874408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff46015cc30 0x7ff460160a00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff460071f50 tx=0x7ff45402a530 comp rx=0 tx=0).stop 2024-09-17T03:10:16.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.680+0000 7ff464b32640 1 -- 172.21.15.78:0/1652874408 shutdown_connections 2024-09-17T03:10:16.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.680+0000 7ff464b32640 1 --2- 172.21.15.78:0/1652874408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff46015cc30 0x7ff460160a00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:16.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.680+0000 7ff464b32640 1 --2- 172.21.15.78:0/1652874408 >> v2:172.21.15.193:3300/0 conn(0x7ff46015a310 0x7ff4600d1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:16.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.680+0000 7ff464b32640 1 -- 172.21.15.78:0/1652874408 >> 172.21.15.78:0/1652874408 conn(0x7ff4600ced50 msgr2=0x7ff4600cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:16.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.680+0000 7ff464b32640 1 -- 172.21.15.78:0/1652874408 shutdown_connections 2024-09-17T03:10:16.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.680+0000 7ff464b32640 1 -- 172.21.15.78:0/1652874408 wait complete. 2024-09-17T03:10:16.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.682+0000 7ff464b32640 1 Processor -- start 2024-09-17T03:10:16.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.682+0000 7ff464b32640 1 -- start start 2024-09-17T03:10:16.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.683+0000 7ff464b32640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff460071090 0x7ff4601f3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:16.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.683+0000 7ff464b32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff46015a310 0x7ff460152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:16.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.684+0000 7ff464b32640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff46015cc30 0x7ff4601f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:16.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.684+0000 7ff464b32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff4600d01a0 con 0x7ff46015a310 2024-09-17T03:10:16.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.684+0000 7ff464b32640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff4600d0020 con 0x7ff46015cc30 2024-09-17T03:10:16.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.684+0000 7ff464b32640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff4600d0320 con 0x7ff460071090 2024-09-17T03:10:16.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.684+0000 7ff45dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff46015a310 0x7ff460152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:16.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.684+0000 7ff45dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff46015a310 0x7ff460152770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54974/0 (socket says 172.21.15.78:54974) 2024-09-17T03:10:16.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.684+0000 7ff45dd9b640 1 -- 172.21.15.78:0/2873223264 learned_addr learned my addr 172.21.15.78:0/2873223264 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:16.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.684+0000 7ff45ed9d640 1 --2- 172.21.15.78:0/2873223264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff46015cc30 0x7ff4601f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:16.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.684+0000 7ff45e59c640 1 --2- 172.21.15.78:0/2873223264 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff460071090 0x7ff4601f3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:16.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.684+0000 7ff45dd9b640 1 -- 172.21.15.78:0/2873223264 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff460071090 msgr2=0x7ff4601f3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:16.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.684+0000 7ff45dd9b640 1 --2- 172.21.15.78:0/2873223264 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff460071090 0x7ff4601f3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:16.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.684+0000 7ff45dd9b640 1 -- 172.21.15.78:0/2873223264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff46015cc30 msgr2=0x7ff4601f78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:16.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.684+0000 7ff45dd9b640 1 --2- 172.21.15.78:0/2873223264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff46015cc30 0x7ff4601f78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:16.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.684+0000 7ff45dd9b640 1 -- 172.21.15.78:0/2873223264 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4601f70e0 con 0x7ff46015a310 2024-09-17T03:10:16.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.684+0000 7ff45dd9b640 1 --2- 172.21.15.78:0/2873223264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff46015a310 0x7ff460152770 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff454009780 tx=0x7ff454033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:16.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.684+0000 7ff44effd640 1 -- 172.21.15.78:0/2873223264 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff454031d60 con 0x7ff46015a310 2024-09-17T03:10:16.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.684+0000 7ff44effd640 1 -- 172.21.15.78:0/2873223264 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff454005020 con 0x7ff46015a310 2024-09-17T03:10:16.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.684+0000 7ff464b32640 1 -- 172.21.15.78:0/2873223264 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4601f43d0 con 0x7ff46015a310 2024-09-17T03:10:16.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.684+0000 7ff44effd640 1 -- 172.21.15.78:0/2873223264 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff454005470 con 0x7ff46015a310 2024-09-17T03:10:16.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.685+0000 7ff464b32640 1 -- 172.21.15.78:0/2873223264 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4601f4990 con 0x7ff46015a310 2024-09-17T03:10:16.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.686+0000 7ff464b32640 1 -- 172.21.15.78:0/2873223264 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4600d07d0 con 0x7ff46015a310 2024-09-17T03:10:16.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.686+0000 7ff44effd640 1 -- 172.21.15.78:0/2873223264 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff4540047a0 con 0x7ff46015a310 2024-09-17T03:10:16.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.687+0000 7ff44effd640 1 --2- 172.21.15.78:0/2873223264 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff440078bf0 0x7ff44007b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:16.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.687+0000 7ff44effd640 1 -- 172.21.15.78:0/2873223264 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5529+0+0 (secure 0 0 0) 0x7ff4540bbe10 con 0x7ff46015a310 2024-09-17T03:10:16.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.687+0000 7ff45e59c640 1 --2- 172.21.15.78:0/2873223264 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff440078bf0 0x7ff44007b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:16.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.687+0000 7ff45e59c640 1 --2- 172.21.15.78:0/2873223264 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff440078bf0 0x7ff44007b100 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff4600ce780 tx=0x7ff45000a2d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:16.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.691+0000 7ff44effd640 1 -- 172.21.15.78:0/2873223264 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff45403f030 con 0x7ff46015a310 2024-09-17T03:10:16.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:16.863+0000 7ff464b32640 1 -- 172.21.15.78:0/2873223264 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff4600b1760 con 0x7ff46015a310 2024-09-17T03:10:17.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.550+0000 7ff44effd640 1 -- 172.21.15.78:0/2873223264 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7ff454083d40 con 0x7ff46015a310 2024-09-17T03:10:17.549 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2024-09-17T03:10:17.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.555+0000 7ff464b32640 1 -- 172.21.15.78:0/2873223264 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff440078bf0 msgr2=0x7ff44007b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:17.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.555+0000 7ff464b32640 1 --2- 172.21.15.78:0/2873223264 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff440078bf0 0x7ff44007b100 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff4600ce780 tx=0x7ff45000a2d0 comp rx=0 tx=0).stop 2024-09-17T03:10:17.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.555+0000 7ff464b32640 1 -- 172.21.15.78:0/2873223264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff46015a310 msgr2=0x7ff460152770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:17.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.555+0000 7ff464b32640 1 --2- 172.21.15.78:0/2873223264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff46015a310 0x7ff460152770 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff454009780 tx=0x7ff454033d60 comp rx=0 tx=0).stop 2024-09-17T03:10:17.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.555+0000 7ff464b32640 1 -- 172.21.15.78:0/2873223264 shutdown_connections 2024-09-17T03:10:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.555+0000 7ff464b32640 1 --2- 172.21.15.78:0/2873223264 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff440078bf0 0x7ff44007b100 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.555+0000 7ff464b32640 1 --2- 172.21.15.78:0/2873223264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff46015cc30 0x7ff4601f78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.555+0000 7ff464b32640 1 --2- 172.21.15.78:0/2873223264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff46015a310 0x7ff460152770 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.555+0000 7ff464b32640 1 --2- 172.21.15.78:0/2873223264 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff460071090 0x7ff4601f3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.555+0000 7ff464b32640 1 -- 172.21.15.78:0/2873223264 >> 172.21.15.78:0/2873223264 conn(0x7ff4600ced50 msgr2=0x7ff4600d1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.555+0000 7ff464b32640 1 -- 172.21.15.78:0/2873223264 shutdown_connections 2024-09-17T03:10:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.555+0000 7ff464b32640 1 -- 172.21.15.78:0/2873223264 wait complete. 2024-09-17T03:10:17.567 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:10:17.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.685+0000 7f2cec40e640 1 -- 172.21.15.78:0/2801828885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ce4141780 msgr2=0x7f2ce40cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:17.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.685+0000 7f2cec40e640 1 --2- 172.21.15.78:0/2801828885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ce4141780 0x7f2ce40cea70 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40749e0 tx=0x7f2cdc02a980 comp rx=0 tx=0).stop 2024-09-17T03:10:17.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.685+0000 7f2cec40e640 1 -- 172.21.15.78:0/2801828885 shutdown_connections 2024-09-17T03:10:17.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.685+0000 7f2cec40e640 1 --2- 172.21.15.78:0/2801828885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ce4141780 0x7f2ce40cea70 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:17.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.685+0000 7f2cec40e640 1 --2- 172.21.15.78:0/2801828885 >> v2:172.21.15.193:3300/0 conn(0x7f2ce415c700 0x7f2ce4074030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:17.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.685+0000 7f2cec40e640 1 -- 172.21.15.78:0/2801828885 >> 172.21.15.78:0/2801828885 conn(0x7f2ce40d15f0 msgr2=0x7f2ce4073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:17.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.685+0000 7f2cec40e640 1 -- 172.21.15.78:0/2801828885 shutdown_connections 2024-09-17T03:10:17.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.685+0000 7f2cec40e640 1 -- 172.21.15.78:0/2801828885 wait complete. 2024-09-17T03:10:17.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.687+0000 7f2cec40e640 1 Processor -- start 2024-09-17T03:10:17.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.687+0000 7f2cec40e640 1 -- start start 2024-09-17T03:10:17.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.688+0000 7f2cec40e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce4074570 0x7f2ce4071760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:17.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.688+0000 7f2cec40e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ce4141780 0x7f2ce414f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:17.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.688+0000 7f2cec40e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ce415c700 0x7f2ce4133f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:17.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.688+0000 7f2cec40e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce40cefb0 con 0x7f2ce4141780 2024-09-17T03:10:17.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.688+0000 7f2cec40e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2ce40cf130 con 0x7f2ce415c700 2024-09-17T03:10:17.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.688+0000 7f2cec40e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f2ce40cf2b0 con 0x7f2ce4074570 2024-09-17T03:10:17.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.688+0000 7f2ce99a9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ce4141780 0x7f2ce414f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:17.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.688+0000 7f2ce99a9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ce4141780 0x7f2ce414f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54982/0 (socket says 172.21.15.78:54982) 2024-09-17T03:10:17.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.688+0000 7f2ce99a9640 1 -- 172.21.15.78:0/207314737 learned_addr learned my addr 172.21.15.78:0/207314737 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:17.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.688+0000 7f2cea9ab640 1 --2- 172.21.15.78:0/207314737 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ce415c700 0x7f2ce4133f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:17.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.688+0000 7f2cea1aa640 1 --2- 172.21.15.78:0/207314737 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce4074570 0x7f2ce4071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:17.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.689+0000 7f2ce99a9640 1 -- 172.21.15.78:0/207314737 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce4074570 msgr2=0x7f2ce4071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:17.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.689+0000 7f2ce99a9640 1 --2- 172.21.15.78:0/207314737 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce4074570 0x7f2ce4071760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:17.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.689+0000 7f2ce99a9640 1 -- 172.21.15.78:0/207314737 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ce415c700 msgr2=0x7f2ce4133f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:17.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.689+0000 7f2ce99a9640 1 --2- 172.21.15.78:0/207314737 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ce415c700 0x7f2ce4133f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:17.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.689+0000 7f2ce99a9640 1 -- 172.21.15.78:0/207314737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ce40706c0 con 0x7f2ce4141780 2024-09-17T03:10:17.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.689+0000 7f2ce99a9640 1 --2- 172.21.15.78:0/207314737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ce4141780 0x7f2ce414f920 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400b420 tx=0x7f2cd400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:17.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.689+0000 7f2cdaffd640 1 -- 172.21.15.78:0/207314737 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4011830 con 0x7f2ce4141780 2024-09-17T03:10:17.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.689+0000 7f2cdaffd640 1 -- 172.21.15.78:0/207314737 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2cd4016070 con 0x7f2ce4141780 2024-09-17T03:10:17.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.689+0000 7f2cdaffd640 1 -- 172.21.15.78:0/207314737 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4011d60 con 0x7f2ce4141780 2024-09-17T03:10:17.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.689+0000 7f2cec40e640 1 -- 172.21.15.78:0/207314737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ce40709a0 con 0x7f2ce4141780 2024-09-17T03:10:17.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.689+0000 7f2cec40e640 1 -- 172.21.15.78:0/207314737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ce41f3280 con 0x7f2ce4141780 2024-09-17T03:10:17.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.690+0000 7f2cec40e640 1 -- 172.21.15.78:0/207314737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ce4070d50 con 0x7f2ce4141780 2024-09-17T03:10:17.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.691+0000 7f2cdaffd640 1 -- 172.21.15.78:0/207314737 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2cd401b460 con 0x7f2ce4141780 2024-09-17T03:10:17.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.691+0000 7f2cdaffd640 1 --2- 172.21.15.78:0/207314737 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2cc8078b90 0x7f2cc807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:17.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.691+0000 7f2cdaffd640 1 -- 172.21.15.78:0/207314737 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5115+0+0 (secure 0 0 0) 0x7f2cd409a4c0 con 0x7f2ce4141780 2024-09-17T03:10:17.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.692+0000 7f2cea1aa640 1 --2- 172.21.15.78:0/207314737 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2cc8078b90 0x7f2cc807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:17.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.692+0000 7f2cea1aa640 1 --2- 172.21.15.78:0/207314737 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2cc8078b90 0x7f2cc807b0a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000bb50 tx=0x7f2ce000b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:17.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.696+0000 7f2cdaffd640 1 -- 172.21.15.78:0/207314737 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2cd4020020 con 0x7f2ce4141780 2024-09-17T03:10:17.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.870+0000 7f2cec40e640 1 -- 172.21.15.78:0/207314737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f2ce4070450 con 0x7f2ce4141780 2024-09-17T03:10:17.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.874+0000 7f2cdaffd640 1 -- 172.21.15.78:0/207314737 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v33) ==== 71+0+0 (secure 0 0 0) 0x7f2cd4062500 con 0x7f2ce4141780 2024-09-17T03:10:17.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.876+0000 7f2cec40e640 1 -- 172.21.15.78:0/207314737 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2cc8078b90 msgr2=0x7f2cc807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:17.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.876+0000 7f2cec40e640 1 --2- 172.21.15.78:0/207314737 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2cc8078b90 0x7f2cc807b0a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000bb50 tx=0x7f2ce000b2e0 comp rx=0 tx=0).stop 2024-09-17T03:10:17.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.876+0000 7f2cec40e640 1 -- 172.21.15.78:0/207314737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ce4141780 msgr2=0x7f2ce414f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:17.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.876+0000 7f2cec40e640 1 --2- 172.21.15.78:0/207314737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ce4141780 0x7f2ce414f920 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400b420 tx=0x7f2cd400b8e0 comp rx=0 tx=0).stop 2024-09-17T03:10:17.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.877+0000 7f2cec40e640 1 -- 172.21.15.78:0/207314737 shutdown_connections 2024-09-17T03:10:17.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.877+0000 7f2cec40e640 1 --2- 172.21.15.78:0/207314737 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2cc8078b90 0x7f2cc807b0a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:17.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.877+0000 7f2cec40e640 1 --2- 172.21.15.78:0/207314737 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2ce415c700 0x7f2ce4133f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:17.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.877+0000 7f2cec40e640 1 --2- 172.21.15.78:0/207314737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ce4141780 0x7f2ce414f920 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:17.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.877+0000 7f2cec40e640 1 --2- 172.21.15.78:0/207314737 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2ce4074570 0x7f2ce4071760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:17.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.877+0000 7f2cec40e640 1 -- 172.21.15.78:0/207314737 >> 172.21.15.78:0/207314737 conn(0x7f2ce40d15f0 msgr2=0x7f2ce415ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:17.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.877+0000 7f2cec40e640 1 -- 172.21.15.78:0/207314737 shutdown_connections 2024-09-17T03:10:17.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:17.877+0000 7f2cec40e640 1 -- 172.21.15.78:0/207314737 wait complete. 2024-09-17T03:10:17.886 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag' 2024-09-17T03:10:17.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.000+0000 7f9a0c2d3640 1 -- 172.21.15.78:0/3467794924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a040cd360 msgr2=0x7f9a040cecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:17.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.000+0000 7f9a0c2d3640 1 --2- 172.21.15.78:0/3467794924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a040cd360 0x7f9a040cecb0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f99f8009830 tx=0x7f99f802a510 comp rx=0 tx=0).stop 2024-09-17T03:10:17.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.000+0000 7f9a0c2d3640 1 -- 172.21.15.78:0/3467794924 shutdown_connections 2024-09-17T03:10:17.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.000+0000 7f9a0c2d3640 1 --2- 172.21.15.78:0/3467794924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a040cd360 0x7f9a040cecb0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:18.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.000+0000 7f9a0c2d3640 1 --2- 172.21.15.78:0/3467794924 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9a0415ca20 0x7f9a040cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:18.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.000+0000 7f9a0c2d3640 1 -- 172.21.15.78:0/3467794924 >> 172.21.15.78:0/3467794924 conn(0x7f9a04073190 msgr2=0x7f9a04071180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:18.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.000+0000 7f9a0c2d3640 1 -- 172.21.15.78:0/3467794924 shutdown_connections 2024-09-17T03:10:18.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.000+0000 7f9a0c2d3640 1 -- 172.21.15.78:0/3467794924 wait complete. 2024-09-17T03:10:18.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.002+0000 7f9a0c2d3640 1 Processor -- start 2024-09-17T03:10:18.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.002+0000 7f9a0c2d3640 1 -- start start 2024-09-17T03:10:18.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.003+0000 7f9a0c2d3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a040cd360 0x7f9a04148730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:18.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.003+0000 7f9a0c2d3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9a040cf1f0 0x7f9a04152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:18.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.003+0000 7f9a0c2d3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9a0415ca20 0x7f9a041510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:18.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.003+0000 7f9a0c2d3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9a040b45d0 con 0x7f9a040cd360 2024-09-17T03:10:18.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.003+0000 7f9a0c2d3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9a040b4450 con 0x7f9a0415ca20 2024-09-17T03:10:18.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.003+0000 7f9a0c2d3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f9a040b4750 con 0x7f9a040cf1f0 2024-09-17T03:10:18.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.003+0000 7f9a0a06f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a040cd360 0x7f9a04148730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:18.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.003+0000 7f9a0a06f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a040cd360 0x7f9a04148730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55002/0 (socket says 172.21.15.78:55002) 2024-09-17T03:10:18.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.003+0000 7f9a0a06f640 1 -- 172.21.15.78:0/3266840028 learned_addr learned my addr 172.21.15.78:0/3266840028 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:18.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.003+0000 7f9a0a06f640 1 -- 172.21.15.78:0/3266840028 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9a040cf1f0 msgr2=0x7f9a04152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:18.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.003+0000 7f9a0a06f640 1 --2- 172.21.15.78:0/3266840028 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9a040cf1f0 0x7f9a04152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:18.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.003+0000 7f9a0a06f640 1 -- 172.21.15.78:0/3266840028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9a0415ca20 msgr2=0x7f9a041510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:18.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.003+0000 7f9a0a06f640 1 --2- 172.21.15.78:0/3266840028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9a0415ca20 0x7f9a041510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:18.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.003+0000 7f9a0a06f640 1 -- 172.21.15.78:0/3266840028 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a04151890 con 0x7f9a040cd360 2024-09-17T03:10:18.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.004+0000 7f9a0a06f640 1 --2- 172.21.15.78:0/3266840028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a040cd360 0x7f9a04148730 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f99f400d770 tx=0x7f99f400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:18.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.004+0000 7f9a02ffd640 1 -- 172.21.15.78:0/3266840028 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f4017070 con 0x7f9a040cd360 2024-09-17T03:10:18.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.004+0000 7f9a02ffd640 1 -- 172.21.15.78:0/3266840028 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99f4009cc0 con 0x7f9a040cd360 2024-09-17T03:10:18.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.004+0000 7f9a02ffd640 1 -- 172.21.15.78:0/3266840028 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f40106c0 con 0x7f9a040cd360 2024-09-17T03:10:18.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.004+0000 7f9a0c2d3640 1 -- 172.21.15.78:0/3266840028 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a04151b70 con 0x7f9a040cd360 2024-09-17T03:10:18.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.004+0000 7f9a0c2d3640 1 -- 172.21.15.78:0/3266840028 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a04152130 con 0x7f9a040cd360 2024-09-17T03:10:18.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.005+0000 7f9a0c2d3640 1 -- 172.21.15.78:0/3266840028 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a04071ec0 con 0x7f9a040cd360 2024-09-17T03:10:18.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.006+0000 7f9a02ffd640 1 -- 172.21.15.78:0/3266840028 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f99f401a070 con 0x7f9a040cd360 2024-09-17T03:10:18.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.006+0000 7f9a02ffd640 1 --2- 172.21.15.78:0/3266840028 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f99f0078b90 0x7f99f007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:18.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.006+0000 7f9a02ffd640 1 -- 172.21.15.78:0/3266840028 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5115+0+0 (secure 0 0 0) 0x7f99f409ac00 con 0x7f9a040cd360 2024-09-17T03:10:18.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.006+0000 7f9a0986e640 1 --2- 172.21.15.78:0/3266840028 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f99f0078b90 0x7f99f007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:18.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.007+0000 7f9a0986e640 1 --2- 172.21.15.78:0/3266840028 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f99f0078b90 0x7f99f007b0a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f99f8034000 tx=0x7f99f80046c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:18.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.011+0000 7f9a02ffd640 1 -- 172.21.15.78:0/3266840028 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9a04071ec0 con 0x7f9a040cd360 2024-09-17T03:10:18.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.252+0000 7f9a0c2d3640 1 -- 172.21.15.78:0/3266840028 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag"]} v 0) -- 0x7f9a040cecb0 con 0x7f9a040cd360 2024-09-17T03:10:18.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.552+0000 7f9a02ffd640 1 -- 172.21.15.78:0/3266840028 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_apply_tag"]}]=0 v108) ==== 136+0+0 (secure 0 0 0) 0x7f99f40a1080 con 0x7f9a040cd360 2024-09-17T03:10:18.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.554+0000 7f9a0c2d3640 1 -- 172.21.15.78:0/3266840028 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f99f0078b90 msgr2=0x7f99f007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:18.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.554+0000 7f9a0c2d3640 1 --2- 172.21.15.78:0/3266840028 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f99f0078b90 0x7f99f007b0a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f99f8034000 tx=0x7f99f80046c0 comp rx=0 tx=0).stop 2024-09-17T03:10:18.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.554+0000 7f9a0c2d3640 1 -- 172.21.15.78:0/3266840028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a040cd360 msgr2=0x7f9a04148730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:18.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.554+0000 7f9a0c2d3640 1 --2- 172.21.15.78:0/3266840028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a040cd360 0x7f9a04148730 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f99f400d770 tx=0x7f99f400dc30 comp rx=0 tx=0).stop 2024-09-17T03:10:18.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.554+0000 7f9a0c2d3640 1 -- 172.21.15.78:0/3266840028 shutdown_connections 2024-09-17T03:10:18.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.554+0000 7f9a0c2d3640 1 --2- 172.21.15.78:0/3266840028 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f99f0078b90 0x7f99f007b0a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:18.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.554+0000 7f9a0c2d3640 1 --2- 172.21.15.78:0/3266840028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9a0415ca20 0x7f9a041510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:18.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.554+0000 7f9a0c2d3640 1 --2- 172.21.15.78:0/3266840028 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9a040cf1f0 0x7f9a04152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:18.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.554+0000 7f9a0c2d3640 1 --2- 172.21.15.78:0/3266840028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a040cd360 0x7f9a04148730 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:18.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.554+0000 7f9a0c2d3640 1 -- 172.21.15.78:0/3266840028 >> 172.21.15.78:0/3266840028 conn(0x7f9a04073190 msgr2=0x7f9a04158360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:18.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.555+0000 7f9a0c2d3640 1 -- 172.21.15.78:0/3266840028 shutdown_connections 2024-09-17T03:10:18.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.555+0000 7f9a0c2d3640 1 -- 172.21.15.78:0/3266840028 wait complete. 2024-09-17T03:10:18.565 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2024-09-17T03:10:18.565 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) 2024-09-17T03:10:18.566 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:10:18.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.681+0000 7fc843007640 1 -- 172.21.15.78:0/2353262703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc824004800 msgr2=0x7fc824004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:18.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.681+0000 7fc843007640 1 --2- 172.21.15.78:0/2353262703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc824004800 0x7fc824004c10 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc83c0ced00 tx=0x7fc824005830 comp rx=0 tx=0).stop 2024-09-17T03:10:18.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.681+0000 7fc843007640 1 -- 172.21.15.78:0/2353262703 shutdown_connections 2024-09-17T03:10:18.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.681+0000 7fc843007640 1 --2- 172.21.15.78:0/2353262703 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc824004800 0x7fc824004c10 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:18.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.681+0000 7fc843007640 1 -- 172.21.15.78:0/2353262703 >> 172.21.15.78:0/2353262703 conn(0x7fc83c0cdcc0 msgr2=0x7fc83c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:18.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.681+0000 7fc843007640 1 -- 172.21.15.78:0/2353262703 shutdown_connections 2024-09-17T03:10:18.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.681+0000 7fc843007640 1 -- 172.21.15.78:0/2353262703 wait complete. 2024-09-17T03:10:18.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.683+0000 7fc843007640 1 Processor -- start 2024-09-17T03:10:18.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.683+0000 7fc843007640 1 -- start start 2024-09-17T03:10:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.684+0000 7fc843007640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc824004800 0x7fc83c06cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.684+0000 7fc843007640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc83c06d320 0x7fc83c149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.684+0000 7fc843007640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc83c149ba0 0x7fc83c15b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.684+0000 7fc843007640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc83c0d02c0 con 0x7fc83c06d320 2024-09-17T03:10:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.684+0000 7fc843007640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc83c0b3a30 con 0x7fc83c149ba0 2024-09-17T03:10:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.684+0000 7fc843007640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc83c0d0440 con 0x7fc824004800 2024-09-17T03:10:18.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.684+0000 7fc83bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc83c06d320 0x7fc83c149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.684+0000 7fc83bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc83c06d320 0x7fc83c149660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55022/0 (socket says 172.21.15.78:55022) 2024-09-17T03:10:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.684+0000 7fc83bfff640 1 -- 172.21.15.78:0/2859149595 learned_addr learned my addr 172.21.15.78:0/2859149595 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.684+0000 7fc8415a4640 1 --2- 172.21.15.78:0/2859149595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc83c149ba0 0x7fc83c15b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.684+0000 7fc840da3640 1 --2- 172.21.15.78:0/2859149595 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc824004800 0x7fc83c06cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.684+0000 7fc83bfff640 1 -- 172.21.15.78:0/2859149595 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc824004800 msgr2=0x7fc83c06cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.684+0000 7fc83bfff640 1 --2- 172.21.15.78:0/2859149595 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc824004800 0x7fc83c06cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.684+0000 7fc83bfff640 1 -- 172.21.15.78:0/2859149595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc83c149ba0 msgr2=0x7fc83c15b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.684+0000 7fc83bfff640 1 --2- 172.21.15.78:0/2859149595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc83c149ba0 0x7fc83c15b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.684+0000 7fc83bfff640 1 -- 172.21.15.78:0/2859149595 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc83c06d730 con 0x7fc83c06d320 2024-09-17T03:10:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.685+0000 7fc83bfff640 1 --2- 172.21.15.78:0/2859149595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc83c06d320 0x7fc83c149660 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc83002b460 tx=0x7fc8300336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.685+0000 7fc8397fa640 1 -- 172.21.15.78:0/2859149595 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc830038040 con 0x7fc83c06d320 2024-09-17T03:10:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.685+0000 7fc8397fa640 1 -- 172.21.15.78:0/2859149595 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc830041070 con 0x7fc83c06d320 2024-09-17T03:10:18.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.685+0000 7fc843007640 1 -- 172.21.15.78:0/2859149595 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc83c1f41d0 con 0x7fc83c06d320 2024-09-17T03:10:18.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.685+0000 7fc8397fa640 1 -- 172.21.15.78:0/2859149595 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc83003c430 con 0x7fc83c06d320 2024-09-17T03:10:18.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.685+0000 7fc843007640 1 -- 172.21.15.78:0/2859149595 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc83c1f3410 con 0x7fc83c06d320 2024-09-17T03:10:18.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.686+0000 7fc843007640 1 -- 172.21.15.78:0/2859149595 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc83c0d0f80 con 0x7fc83c06d320 2024-09-17T03:10:18.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.687+0000 7fc8397fa640 1 -- 172.21.15.78:0/2859149595 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc83003c5d0 con 0x7fc83c06d320 2024-09-17T03:10:18.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.687+0000 7fc8397fa640 1 --2- 172.21.15.78:0/2859149595 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc828078bc0 0x7fc82807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:18.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.687+0000 7fc8397fa640 1 -- 172.21.15.78:0/2859149595 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5115+0+0 (secure 0 0 0) 0x7fc8300bb590 con 0x7fc83c06d320 2024-09-17T03:10:18.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.687+0000 7fc840da3640 1 --2- 172.21.15.78:0/2859149595 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc828078bc0 0x7fc82807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:18.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.688+0000 7fc840da3640 1 --2- 172.21.15.78:0/2859149595 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc828078bc0 0x7fc82807b0d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc82c000fb0 tx=0x7fc82c006720 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:18.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.692+0000 7fc8397fa640 1 -- 172.21.15.78:0/2859149595 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc83c0d0f80 con 0x7fc83c06d320 2024-09-17T03:10:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.867+0000 7fc843007640 1 -- 172.21.15.78:0/2859149595 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc83c06fec0 con 0x7fc83c06d320 2024-09-17T03:10:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.868+0000 7fc8397fa640 1 -- 172.21.15.78:0/2859149595 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+13270 (secure 0 0 0) 0x7fc83c06d730 con 0x7fc83c06d320 2024-09-17T03:10:18.867 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:18.867 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":37,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:10:17.545496+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6835/2663458793":"2024-09-18T03:10:14.536658+0000","172.21.15.78:6834/2663458793":"2024-09-18T03:10:14.536658+0000","172.21.15.78:6833/2730690660":"2024-09-18T03:10:14.536653+0000","172.21.15.78:6832/2730690660":"2024-09-18T03:10:14.536653+0000","172.21.15.193:6837/2343001441":"2024-09-18T03:10:14.536635+0000","172.21.15.193:6835/2343001441":"2024-09-18T03:10:14.536635+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:10:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.871+0000 7fc843007640 1 -- 172.21.15.78:0/2859149595 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc828078bc0 msgr2=0x7fc82807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.871+0000 7fc843007640 1 --2- 172.21.15.78:0/2859149595 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc828078bc0 0x7fc82807b0d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc82c000fb0 tx=0x7fc82c006720 comp rx=0 tx=0).stop 2024-09-17T03:10:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.871+0000 7fc843007640 1 -- 172.21.15.78:0/2859149595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc83c06d320 msgr2=0x7fc83c149660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.871+0000 7fc843007640 1 --2- 172.21.15.78:0/2859149595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc83c06d320 0x7fc83c149660 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc83002b460 tx=0x7fc8300336f0 comp rx=0 tx=0).stop 2024-09-17T03:10:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.871+0000 7fc843007640 1 -- 172.21.15.78:0/2859149595 shutdown_connections 2024-09-17T03:10:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.871+0000 7fc843007640 1 --2- 172.21.15.78:0/2859149595 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc828078bc0 0x7fc82807b0d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.871+0000 7fc843007640 1 --2- 172.21.15.78:0/2859149595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc83c149ba0 0x7fc83c15b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.871+0000 7fc843007640 1 --2- 172.21.15.78:0/2859149595 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc83c06d320 0x7fc83c149660 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.871+0000 7fc843007640 1 --2- 172.21.15.78:0/2859149595 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc824004800 0x7fc83c06cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.871+0000 7fc843007640 1 -- 172.21.15.78:0/2859149595 >> 172.21.15.78:0/2859149595 conn(0x7fc83c0cdcc0 msgr2=0x7fc83c158c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.871+0000 7fc843007640 1 -- 172.21.15.78:0/2859149595 shutdown_connections 2024-09-17T03:10:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.871+0000 7fc843007640 1 -- 172.21.15.78:0/2859149595 wait complete. 2024-09-17T03:10:18.881 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:08:17.135915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:10:18.881 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:10:19.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.999+0000 7fab7dbe4640 1 -- 172.21.15.78:0/1795338809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab60004800 msgr2=0x7fab60004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:19.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.999+0000 7fab7dbe4640 1 --2- 172.21.15.78:0/1795338809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab60004800 0x7fab60004c10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fab6c001050 tx=0x7fab60005830 comp rx=0 tx=0).stop 2024-09-17T03:10:19.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.999+0000 7fab77fff640 1 -- 172.21.15.78:0/1795338809 reap_dead start 2024-09-17T03:10:19.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.999+0000 7fab7dbe4640 1 -- 172.21.15.78:0/1795338809 shutdown_connections 2024-09-17T03:10:19.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.999+0000 7fab7dbe4640 1 -- 172.21.15.78:0/1795338809 >> 172.21.15.78:0/1795338809 conn(0x7fab780710b0 msgr2=0x7fab780714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:19.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.999+0000 7fab7dbe4640 1 -- 172.21.15.78:0/1795338809 shutdown_connections 2024-09-17T03:10:19.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:18.999+0000 7fab7dbe4640 1 -- 172.21.15.78:0/1795338809 wait complete. 2024-09-17T03:10:19.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.001+0000 7fab7dbe4640 1 Processor -- start 2024-09-17T03:10:19.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.001+0000 7fab7dbe4640 1 -- start start 2024-09-17T03:10:19.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.002+0000 7fab7dbe4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab60004800 0x7fab7815e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:19.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.002+0000 7fab7dbe4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab7806eb30 0x7fab7815b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:19.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.002+0000 7fab7dbe4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fab780cb280 0x7fab780cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:19.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.002+0000 7fab7dbe4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fab780d0a20 con 0x7fab60004800 2024-09-17T03:10:19.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.002+0000 7fab7dbe4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fab780d08a0 con 0x7fab7806eb30 2024-09-17T03:10:19.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.002+0000 7fab7dbe4640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fab780d0ba0 con 0x7fab780cb280 2024-09-17T03:10:19.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.002+0000 7fab777fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab60004800 0x7fab7815e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:19.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.002+0000 7fab777fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab60004800 0x7fab7815e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55038/0 (socket says 172.21.15.78:55038) 2024-09-17T03:10:19.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.002+0000 7fab777fe640 1 -- 172.21.15.78:0/2369197938 learned_addr learned my addr 172.21.15.78:0/2369197938 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:19.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.002+0000 7fab77fff640 1 --2- 172.21.15.78:0/2369197938 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fab780cb280 0x7fab780cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:19.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.002+0000 7fab777fe640 1 -- 172.21.15.78:0/2369197938 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fab780cb280 msgr2=0x7fab780cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:19.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.002+0000 7fab76ffd640 1 --2- 172.21.15.78:0/2369197938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab7806eb30 0x7fab7815b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:19.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.002+0000 7fab777fe640 1 --2- 172.21.15.78:0/2369197938 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fab780cb280 0x7fab780cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:19.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.002+0000 7fab777fe640 1 -- 172.21.15.78:0/2369197938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab7806eb30 msgr2=0x7fab7815b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:19.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.002+0000 7fab777fe640 1 --2- 172.21.15.78:0/2369197938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab7806eb30 0x7fab7815b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:19.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.002+0000 7fab777fe640 1 -- 172.21.15.78:0/2369197938 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab780cbbd0 con 0x7fab60004800 2024-09-17T03:10:19.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.002+0000 7fab77fff640 1 --2- 172.21.15.78:0/2369197938 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fab780cb280 0x7fab780cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:10:19.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.003+0000 7fab777fe640 1 --2- 172.21.15.78:0/2369197938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab60004800 0x7fab7815e530 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fab68004df0 tx=0x7fab68001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:19.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.003+0000 7fab5ffff640 1 -- 172.21.15.78:0/2369197938 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68001d40 con 0x7fab60004800 2024-09-17T03:10:19.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.003+0000 7fab5ffff640 1 -- 172.21.15.78:0/2369197938 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab68016070 con 0x7fab60004800 2024-09-17T03:10:19.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.003+0000 7fab7dbe4640 1 -- 172.21.15.78:0/2369197938 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab781f8820 con 0x7fab60004800 2024-09-17T03:10:19.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.003+0000 7fab5ffff640 1 -- 172.21.15.78:0/2369197938 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab68010ac0 con 0x7fab60004800 2024-09-17T03:10:19.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.003+0000 7fab7dbe4640 1 -- 172.21.15.78:0/2369197938 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab781f9080 con 0x7fab60004800 2024-09-17T03:10:19.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.004+0000 7fab7dbe4640 1 -- 172.21.15.78:0/2369197938 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab781f89f0 con 0x7fab60004800 2024-09-17T03:10:19.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.004+0000 7fab5ffff640 1 -- 172.21.15.78:0/2369197938 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fab68010c60 con 0x7fab60004800 2024-09-17T03:10:19.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.005+0000 7fab5ffff640 1 --2- 172.21.15.78:0/2369197938 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fab64078b90 0x7fab6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:19.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.005+0000 7fab5ffff640 1 -- 172.21.15.78:0/2369197938 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5115+0+0 (secure 0 0 0) 0x7fab6809b3a0 con 0x7fab60004800 2024-09-17T03:10:19.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.005+0000 7fab76ffd640 1 --2- 172.21.15.78:0/2369197938 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fab64078b90 0x7fab6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:19.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.006+0000 7fab76ffd640 1 --2- 172.21.15.78:0/2369197938 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fab64078b90 0x7fab6407b0a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fab6c033000 tx=0x7fab6c0019f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:19.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.009+0000 7fab5ffff640 1 -- 172.21.15.78:0/2369197938 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fab781f89f0 con 0x7fab60004800 2024-09-17T03:10:19.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.183+0000 7fab7dbe4640 1 -- 172.21.15.78:0/2369197938 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fab780b6650 con 0x7fab60004800 2024-09-17T03:10:19.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.184+0000 7fab5ffff640 1 -- 172.21.15.78:0/2369197938 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7fab780cbbd0 con 0x7fab60004800 2024-09-17T03:10:19.183 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-09-17T03:10:19.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.186+0000 7fab7dbe4640 1 -- 172.21.15.78:0/2369197938 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fab64078b90 msgr2=0x7fab6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:19.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.186+0000 7fab7dbe4640 1 --2- 172.21.15.78:0/2369197938 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fab64078b90 0x7fab6407b0a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fab6c033000 tx=0x7fab6c0019f0 comp rx=0 tx=0).stop 2024-09-17T03:10:19.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.186+0000 7fab7dbe4640 1 -- 172.21.15.78:0/2369197938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab60004800 msgr2=0x7fab7815e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:19.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.186+0000 7fab7dbe4640 1 --2- 172.21.15.78:0/2369197938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab60004800 0x7fab7815e530 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fab68004df0 tx=0x7fab68001630 comp rx=0 tx=0).stop 2024-09-17T03:10:19.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.186+0000 7fab7dbe4640 1 -- 172.21.15.78:0/2369197938 shutdown_connections 2024-09-17T03:10:19.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.186+0000 7fab7dbe4640 1 --2- 172.21.15.78:0/2369197938 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fab780cb280 0x7fab780cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:19.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.186+0000 7fab7dbe4640 1 --2- 172.21.15.78:0/2369197938 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fab64078b90 0x7fab6407b0a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:19.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.186+0000 7fab7dbe4640 1 --2- 172.21.15.78:0/2369197938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab7806eb30 0x7fab7815b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:19.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.186+0000 7fab7dbe4640 1 --2- 172.21.15.78:0/2369197938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fab60004800 0x7fab7815e530 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:19.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.186+0000 7fab7dbe4640 1 -- 172.21.15.78:0/2369197938 >> 172.21.15.78:0/2369197938 conn(0x7fab780710b0 msgr2=0x7fab780b5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:19.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.186+0000 7fab7dbe4640 1 -- 172.21.15.78:0/2369197938 shutdown_connections 2024-09-17T03:10:19.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.186+0000 7fab7dbe4640 1 -- 172.21.15.78:0/2369197938 wait complete. 2024-09-17T03:10:19.196 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0' 2024-09-17T03:10:19.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.316+0000 7ff9e88b6640 1 -- 172.21.15.78:0/2922202114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9cc004800 msgr2=0x7ff9cc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:19.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.316+0000 7ff9e88b6640 1 --2- 172.21.15.78:0/2922202114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9cc004800 0x7ff9cc004c10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff9e40b67a0 tx=0x7ff9cc005830 comp rx=0 tx=0).stop 2024-09-17T03:10:19.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.316+0000 7ff9e2d9d640 1 -- 172.21.15.78:0/2922202114 reap_dead start 2024-09-17T03:10:19.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.316+0000 7ff9e88b6640 1 -- 172.21.15.78:0/2922202114 shutdown_connections 2024-09-17T03:10:19.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.316+0000 7ff9e88b6640 1 -- 172.21.15.78:0/2922202114 >> 172.21.15.78:0/2922202114 conn(0x7ff9e4074170 msgr2=0x7ff9e40b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:19.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.316+0000 7ff9e88b6640 1 -- 172.21.15.78:0/2922202114 shutdown_connections 2024-09-17T03:10:19.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.316+0000 7ff9e88b6640 1 -- 172.21.15.78:0/2922202114 wait complete. 2024-09-17T03:10:19.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.318+0000 7ff9e88b6640 1 Processor -- start 2024-09-17T03:10:19.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.318+0000 7ff9e88b6640 1 -- start start 2024-09-17T03:10:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.319+0000 7ff9e88b6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9cc004800 0x7ff9e41545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.319+0000 7ff9e88b6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9e40b2040 0x7ff9e40ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.319+0000 7ff9e88b6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9e40caa90 0x7ff9e41f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.319+0000 7ff9e88b6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e40cdd70 con 0x7ff9cc004800 2024-09-17T03:10:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.319+0000 7ff9e88b6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e40cdbf0 con 0x7ff9e40b2040 2024-09-17T03:10:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.319+0000 7ff9e88b6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff9e40cdef0 con 0x7ff9e40caa90 2024-09-17T03:10:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.319+0000 7ff9e259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9cc004800 0x7ff9e41545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.319+0000 7ff9e259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9cc004800 0x7ff9e41545e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55054/0 (socket says 172.21.15.78:55054) 2024-09-17T03:10:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.319+0000 7ff9e259c640 1 -- 172.21.15.78:0/3438467604 learned_addr learned my addr 172.21.15.78:0/3438467604 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.320+0000 7ff9e1d9b640 1 --2- 172.21.15.78:0/3438467604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9e40b2040 0x7ff9e40ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.320+0000 7ff9e259c640 1 -- 172.21.15.78:0/3438467604 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9e40caa90 msgr2=0x7ff9e41f52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.320+0000 7ff9e259c640 1 --2- 172.21.15.78:0/3438467604 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9e40caa90 0x7ff9e41f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.320+0000 7ff9e259c640 1 -- 172.21.15.78:0/3438467604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9e40b2040 msgr2=0x7ff9e40ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.320+0000 7ff9e259c640 1 --2- 172.21.15.78:0/3438467604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9e40b2040 0x7ff9e40ca550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.320+0000 7ff9e259c640 1 -- 172.21.15.78:0/3438467604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e40caea0 con 0x7ff9cc004800 2024-09-17T03:10:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.320+0000 7ff9e259c640 1 --2- 172.21.15.78:0/3438467604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9cc004800 0x7ff9e41545e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff9d40014e0 tx=0x7ff9d4006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.320+0000 7ff9d2ffd640 1 -- 172.21.15.78:0/3438467604 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4015070 con 0x7ff9cc004800 2024-09-17T03:10:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.320+0000 7ff9d2ffd640 1 -- 172.21.15.78:0/3438467604 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9d400fcc0 con 0x7ff9cc004800 2024-09-17T03:10:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.320+0000 7ff9d2ffd640 1 -- 172.21.15.78:0/3438467604 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9d4011690 con 0x7ff9cc004800 2024-09-17T03:10:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.320+0000 7ff9e88b6640 1 -- 172.21.15.78:0/3438467604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e41f8890 con 0x7ff9cc004800 2024-09-17T03:10:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.320+0000 7ff9e88b6640 1 -- 172.21.15.78:0/3438467604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e41f8e50 con 0x7ff9cc004800 2024-09-17T03:10:19.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.321+0000 7ff9e88b6640 1 -- 172.21.15.78:0/3438467604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e41f9510 con 0x7ff9cc004800 2024-09-17T03:10:19.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.322+0000 7ff9d2ffd640 1 -- 172.21.15.78:0/3438467604 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff9d4011830 con 0x7ff9cc004800 2024-09-17T03:10:19.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.322+0000 7ff9d2ffd640 1 --2- 172.21.15.78:0/3438467604 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff9c4078b90 0x7ff9c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:19.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.322+0000 7ff9d2ffd640 1 -- 172.21.15.78:0/3438467604 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5115+0+0 (secure 0 0 0) 0x7ff9d409baf0 con 0x7ff9cc004800 2024-09-17T03:10:19.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.323+0000 7ff9e1d9b640 1 --2- 172.21.15.78:0/3438467604 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff9c4078b90 0x7ff9c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:19.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.323+0000 7ff9e1d9b640 1 --2- 172.21.15.78:0/3438467604 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff9c4078b90 0x7ff9c407b0a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8036000 tx=0x7ff9d80046c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:19.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.327+0000 7ff9d2ffd640 1 -- 172.21.15.78:0/3438467604 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff9e41f9510 con 0x7ff9cc004800 2024-09-17T03:10:19.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:19.574+0000 7ff9e88b6640 1 -- 172.21.15.78:0/3438467604 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0"]} v 0) -- 0x7ff9e41f4f80 con 0x7ff9cc004800 2024-09-17T03:10:20.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.559+0000 7ff9d2ffd640 1 -- 172.21.15.78:0/3438467604 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0"]}]=0 v110) ==== 146+0+0 (secure 0 0 0) 0x7ff9e40caea0 con 0x7ff9cc004800 2024-09-17T03:10:20.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.562+0000 7ff9e88b6640 1 -- 172.21.15.78:0/3438467604 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff9c4078b90 msgr2=0x7ff9c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:20.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.562+0000 7ff9e88b6640 1 --2- 172.21.15.78:0/3438467604 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff9c4078b90 0x7ff9c407b0a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8036000 tx=0x7ff9d80046c0 comp rx=0 tx=0).stop 2024-09-17T03:10:20.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.562+0000 7ff9e88b6640 1 -- 172.21.15.78:0/3438467604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9cc004800 msgr2=0x7ff9e41545e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:20.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.562+0000 7ff9e88b6640 1 --2- 172.21.15.78:0/3438467604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9cc004800 0x7ff9e41545e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff9d40014e0 tx=0x7ff9d4006720 comp rx=0 tx=0).stop 2024-09-17T03:10:20.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.562+0000 7ff9e88b6640 1 -- 172.21.15.78:0/3438467604 shutdown_connections 2024-09-17T03:10:20.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.562+0000 7ff9e88b6640 1 --2- 172.21.15.78:0/3438467604 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9e40caa90 0x7ff9e41f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:20.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.562+0000 7ff9e88b6640 1 --2- 172.21.15.78:0/3438467604 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff9c4078b90 0x7ff9c407b0a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:20.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.562+0000 7ff9e88b6640 1 --2- 172.21.15.78:0/3438467604 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9e40b2040 0x7ff9e40ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:20.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.562+0000 7ff9e88b6640 1 --2- 172.21.15.78:0/3438467604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9cc004800 0x7ff9e41545e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:20.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.562+0000 7ff9e88b6640 1 -- 172.21.15.78:0/3438467604 >> 172.21.15.78:0/3438467604 conn(0x7ff9e4074170 msgr2=0x7ff9e41599c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:20.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.562+0000 7ff9e88b6640 1 -- 172.21.15.78:0/3438467604 shutdown_connections 2024-09-17T03:10:20.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.562+0000 7ff9e88b6640 1 -- 172.21.15.78:0/3438467604 wait complete. 2024-09-17T03:10:20.576 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:10:20.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.697+0000 7f81c16b4640 1 -- 172.21.15.78:0/2544482970 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81bc0cf5d0 msgr2=0x7f81bc0cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:20.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.697+0000 7f81c16b4640 1 --2- 172.21.15.78:0/2544482970 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81bc0cf5d0 0x7f81bc0cf9e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f81b4005fd0 tx=0x7f81b402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:10:20.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.697+0000 7f81c16b4640 1 -- 172.21.15.78:0/2544482970 shutdown_connections 2024-09-17T03:10:20.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.697+0000 7f81c16b4640 1 --2- 172.21.15.78:0/2544482970 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81bc0cf5d0 0x7f81bc0cf9e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:20.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.697+0000 7f81c16b4640 1 --2- 172.21.15.78:0/2544482970 >> v2:172.21.15.193:3300/0 conn(0x7f81bc0d1a80 0x7f81bc0cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:20.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.697+0000 7f81c16b4640 1 -- 172.21.15.78:0/2544482970 >> 172.21.15.78:0/2544482970 conn(0x7f81bc08bfc0 msgr2=0x7f81bc09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:20.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.697+0000 7f81c16b4640 1 -- 172.21.15.78:0/2544482970 shutdown_connections 2024-09-17T03:10:20.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.697+0000 7f81c16b4640 1 -- 172.21.15.78:0/2544482970 wait complete. 2024-09-17T03:10:20.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.699+0000 7f81c16b4640 1 Processor -- start 2024-09-17T03:10:20.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.699+0000 7f81c16b4640 1 -- start start 2024-09-17T03:10:20.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.701+0000 7f81c16b4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81bc0cf5d0 0x7f81bc1e8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:20.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.701+0000 7f81c16b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81bc0d1a80 0x7f81bc1f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:20.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.701+0000 7f81c16b4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81bc0d2ed0 0x7f81bc0c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:20.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.701+0000 7f81c16b4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc162c60 con 0x7f81bc0d1a80 2024-09-17T03:10:20.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.701+0000 7f81c16b4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc162ae0 con 0x7f81bc0cf5d0 2024-09-17T03:10:20.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.701+0000 7f81c16b4640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f81bc162de0 con 0x7f81bc0d2ed0 2024-09-17T03:10:20.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.701+0000 7f81ba7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81bc0d1a80 0x7f81bc1f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:20.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.701+0000 7f81ba7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81bc0d1a80 0x7f81bc1f5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55068/0 (socket says 172.21.15.78:55068) 2024-09-17T03:10:20.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.701+0000 7f81ba7fc640 1 -- 172.21.15.78:0/118039719 learned_addr learned my addr 172.21.15.78:0/118039719 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:20.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.701+0000 7f81baffd640 1 --2- 172.21.15.78:0/118039719 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81bc0cf5d0 0x7f81bc1e8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:20.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.701+0000 7f81bb7fe640 1 --2- 172.21.15.78:0/118039719 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81bc0d2ed0 0x7f81bc0c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:20.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.701+0000 7f81ba7fc640 1 -- 172.21.15.78:0/118039719 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81bc0d2ed0 msgr2=0x7f81bc0c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:20.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.701+0000 7f81ba7fc640 1 --2- 172.21.15.78:0/118039719 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81bc0d2ed0 0x7f81bc0c9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:20.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.701+0000 7f81ba7fc640 1 -- 172.21.15.78:0/118039719 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81bc0cf5d0 msgr2=0x7f81bc1e8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:20.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.701+0000 7f81ba7fc640 1 --2- 172.21.15.78:0/118039719 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81bc0cf5d0 0x7f81bc1e8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:20.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.701+0000 7f81ba7fc640 1 -- 172.21.15.78:0/118039719 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81bc1e8c00 con 0x7f81bc0d1a80 2024-09-17T03:10:20.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.701+0000 7f81ba7fc640 1 --2- 172.21.15.78:0/118039719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81bc0d1a80 0x7f81bc1f5b80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f81b000e9f0 tx=0x7f81b000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:20.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.702+0000 7f81a37fe640 1 -- 172.21.15.78:0/118039719 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b000cd20 con 0x7f81bc0d1a80 2024-09-17T03:10:20.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.702+0000 7f81a37fe640 1 -- 172.21.15.78:0/118039719 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81b0004020 con 0x7f81bc0d1a80 2024-09-17T03:10:20.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.702+0000 7f81c16b4640 1 -- 172.21.15.78:0/118039719 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81bc1fa580 con 0x7f81bc0d1a80 2024-09-17T03:10:20.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.702+0000 7f81a37fe640 1 -- 172.21.15.78:0/118039719 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b0004470 con 0x7f81bc0d1a80 2024-09-17T03:10:20.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.702+0000 7f81c16b4640 1 -- 172.21.15.78:0/118039719 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81bc0cc650 con 0x7f81bc0d1a80 2024-09-17T03:10:20.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.703+0000 7f81c16b4640 1 -- 172.21.15.78:0/118039719 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81bc06ee40 con 0x7f81bc0d1a80 2024-09-17T03:10:20.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.704+0000 7f81a37fe640 1 -- 172.21.15.78:0/118039719 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f81b00035f0 con 0x7f81bc0d1a80 2024-09-17T03:10:20.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.704+0000 7f81a37fe640 1 --2- 172.21.15.78:0/118039719 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f81a8078b90 0x7f81a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:20.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.704+0000 7f81a37fe640 1 -- 172.21.15.78:0/118039719 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5115+0+0 (secure 0 0 0) 0x7f81b009b1e0 con 0x7f81bc0d1a80 2024-09-17T03:10:20.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.704+0000 7f81baffd640 1 --2- 172.21.15.78:0/118039719 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f81a8078b90 0x7f81a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:20.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.705+0000 7f81baffd640 1 --2- 172.21.15.78:0/118039719 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f81a8078b90 0x7f81a807b0a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f81ac001e10 tx=0x7f81ac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:20.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.709+0000 7f81a37fe640 1 -- 172.21.15.78:0/118039719 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f81bc06ee40 con 0x7f81bc0d1a80 2024-09-17T03:10:20.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.887+0000 7f81c16b4640 1 -- 172.21.15.78:0/118039719 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f81bc1e8e90 con 0x7f81bc0d1a80 2024-09-17T03:10:20.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.887+0000 7f81a37fe640 1 -- 172.21.15.78:0/118039719 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+2294 (secure 0 0 0) 0x7f81b00632b0 con 0x7f81bc0d1a80 2024-09-17T03:10:20.887 INFO:teuthology.orchestra.run.smithi078.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:10:20.887 INFO:teuthology.orchestra.run.smithi078.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:10:20.887 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:10:20.887 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_client 20/20 2024-09-17T03:10:20.887 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:10:20.887 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:10:20.888 INFO:teuthology.orchestra.run.smithi078.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:10:20.888 INFO:teuthology.orchestra.run.smithi078.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:10:20.888 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4994.035848 2024-09-17T03:10:20.888 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5277.317911 2024-09-17T03:10:20.889 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4833.009828 2024-09-17T03:10:20.889 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7208.562209 2024-09-17T03:10:20.889 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4511.051809 2024-09-17T03:10:20.889 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4237.642218 2024-09-17T03:10:20.889 INFO:teuthology.orchestra.run.smithi078.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 6005.051341 2024-09-17T03:10:20.889 INFO:teuthology.orchestra.run.smithi078.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4677.613119 2024-09-17T03:10:20.889 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_mds 20/20 2024-09-17T03:10:20.889 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:10:20.889 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_ms 2/2 2024-09-17T03:10:20.889 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_debug_frag true 2024-09-17T03:10:20.889 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:10:20.889 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:10:20.889 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_verify_scatter true 2024-09-17T03:10:20.890 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:10:20.890 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:10:20.890 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:10:20.890 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced client_mount_timeout 600 2024-09-17T03:10:20.890 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced debug_client 20/20 2024-09-17T03:10:20.890 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced debug_ms 1/1 2024-09-17T03:10:20.890 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:10:20.890 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:10:20.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.889+0000 7f81c16b4640 1 -- 172.21.15.78:0/118039719 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f81a8078b90 msgr2=0x7f81a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:20.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.889+0000 7f81c16b4640 1 --2- 172.21.15.78:0/118039719 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f81a8078b90 0x7f81a807b0a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f81ac001e10 tx=0x7f81ac009040 comp rx=0 tx=0).stop 2024-09-17T03:10:20.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.889+0000 7f81c16b4640 1 -- 172.21.15.78:0/118039719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81bc0d1a80 msgr2=0x7f81bc1f5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:20.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.889+0000 7f81c16b4640 1 --2- 172.21.15.78:0/118039719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81bc0d1a80 0x7f81bc1f5b80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f81b000e9f0 tx=0x7f81b000eeb0 comp rx=0 tx=0).stop 2024-09-17T03:10:20.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.889+0000 7f81c16b4640 1 -- 172.21.15.78:0/118039719 shutdown_connections 2024-09-17T03:10:20.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.889+0000 7f81c16b4640 1 --2- 172.21.15.78:0/118039719 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81bc0d2ed0 0x7f81bc0c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:20.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.889+0000 7f81c16b4640 1 --2- 172.21.15.78:0/118039719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81bc0d1a80 0x7f81bc1f5b80 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:20.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.889+0000 7f81c16b4640 1 --2- 172.21.15.78:0/118039719 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f81a8078b90 0x7f81a807b0a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:20.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.889+0000 7f81c16b4640 1 --2- 172.21.15.78:0/118039719 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81bc0cf5d0 0x7f81bc1e8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:20.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.889+0000 7f81c16b4640 1 -- 172.21.15.78:0/118039719 >> 172.21.15.78:0/118039719 conn(0x7f81bc08bfc0 msgr2=0x7f81bc0d24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:20.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.889+0000 7f81c16b4640 1 -- 172.21.15.78:0/118039719 shutdown_connections 2024-09-17T03:10:20.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:20.889+0000 7f81c16b4640 1 -- 172.21.15.78:0/118039719 wait complete. 2024-09-17T03:10:20.899 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:10:21.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.016+0000 7f8ba629b640 1 -- 172.21.15.78:0/360845841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b88003a30 msgr2=0x7f8b88003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:21.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.016+0000 7f8ba629b640 1 --2- 172.21.15.78:0/360845841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b88003a30 0x7f8b88003ea0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8b90009b50 tx=0x7f8b88005830 comp rx=0 tx=0).stop 2024-09-17T03:10:21.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.016+0000 7f8ba4838640 1 -- 172.21.15.78:0/360845841 reap_dead start 2024-09-17T03:10:21.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.016+0000 7f8ba629b640 1 -- 172.21.15.78:0/360845841 shutdown_connections 2024-09-17T03:10:21.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.016+0000 7f8ba629b640 1 -- 172.21.15.78:0/360845841 >> 172.21.15.78:0/360845841 conn(0x7f8ba00b1cb0 msgr2=0x7f8ba00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:21.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.016+0000 7f8ba629b640 1 -- 172.21.15.78:0/360845841 shutdown_connections 2024-09-17T03:10:21.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.016+0000 7f8ba629b640 1 -- 172.21.15.78:0/360845841 wait complete. 2024-09-17T03:10:21.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.018+0000 7f8ba629b640 1 Processor -- start 2024-09-17T03:10:21.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.018+0000 7f8ba629b640 1 -- start start 2024-09-17T03:10:21.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.019+0000 7f8ba629b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b88003a30 0x7f8ba01f3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:21.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.019+0000 7f8ba629b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ba014f590 0x7f8ba00d0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:21.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.019+0000 7f8ba629b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ba00d0760 0x7f8ba009d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:21.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.019+0000 7f8ba629b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba00b37a0 con 0x7f8ba00d0760 2024-09-17T03:10:21.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.019+0000 7f8ba629b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba015cd20 con 0x7f8ba014f590 2024-09-17T03:10:21.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.019+0000 7f8ba629b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba00b3920 con 0x7f8b88003a30 2024-09-17T03:10:21.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.019+0000 7f8ba4838640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ba00d0760 0x7f8ba009d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:21.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.019+0000 7f8ba4838640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ba00d0760 0x7f8ba009d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55084/0 (socket says 172.21.15.78:55084) 2024-09-17T03:10:21.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.019+0000 7f8ba4838640 1 -- 172.21.15.78:0/2809925722 learned_addr learned my addr 172.21.15.78:0/2809925722 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:21.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.019+0000 7f8b9f7fe640 1 --2- 172.21.15.78:0/2809925722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ba014f590 0x7f8ba00d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:21.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.019+0000 7f8b9ffff640 1 --2- 172.21.15.78:0/2809925722 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b88003a30 0x7f8ba01f3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:21.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.020+0000 7f8ba4838640 1 -- 172.21.15.78:0/2809925722 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b88003a30 msgr2=0x7f8ba01f3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:21.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.020+0000 7f8ba4838640 1 --2- 172.21.15.78:0/2809925722 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b88003a30 0x7f8ba01f3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:21.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.020+0000 7f8ba4838640 1 -- 172.21.15.78:0/2809925722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ba014f590 msgr2=0x7f8ba00d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:21.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.020+0000 7f8ba4838640 1 --2- 172.21.15.78:0/2809925722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ba014f590 0x7f8ba00d0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:21.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.020+0000 7f8ba4838640 1 -- 172.21.15.78:0/2809925722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba00d0b70 con 0x7f8ba00d0760 2024-09-17T03:10:21.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.020+0000 7f8b9ffff640 1 --2- 172.21.15.78:0/2809925722 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b88003a30 0x7f8ba01f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:21.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.020+0000 7f8ba4838640 1 --2- 172.21.15.78:0/2809925722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ba00d0760 0x7f8ba009d050 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0073600 tx=0x7f8b980019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:21.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.020+0000 7f8b9cff9640 1 -- 172.21.15.78:0/2809925722 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b98011870 con 0x7f8ba00d0760 2024-09-17T03:10:21.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.020+0000 7f8b9cff9640 1 -- 172.21.15.78:0/2809925722 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b98017070 con 0x7f8ba00d0760 2024-09-17T03:10:21.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.020+0000 7f8ba629b640 1 -- 172.21.15.78:0/2809925722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba009c870 con 0x7f8ba00d0760 2024-09-17T03:10:21.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.020+0000 7f8b9cff9640 1 -- 172.21.15.78:0/2809925722 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b98011da0 con 0x7f8ba00d0760 2024-09-17T03:10:21.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.020+0000 7f8ba629b640 1 -- 172.21.15.78:0/2809925722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba01f47b0 con 0x7f8ba00d0760 2024-09-17T03:10:21.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.021+0000 7f8ba629b640 1 -- 172.21.15.78:0/2809925722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba01f4240 con 0x7f8ba00d0760 2024-09-17T03:10:21.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.022+0000 7f8b9cff9640 1 -- 172.21.15.78:0/2809925722 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b9801c460 con 0x7f8ba00d0760 2024-09-17T03:10:21.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.022+0000 7f8b9cff9640 1 --2- 172.21.15.78:0/2809925722 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b8c078b90 0x7f8b8c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:21.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.022+0000 7f8b9cff9640 1 -- 172.21.15.78:0/2809925722 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5115+0+0 (secure 0 0 0) 0x7f8b9809b2a0 con 0x7f8ba00d0760 2024-09-17T03:10:21.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.022+0000 7f8b9ffff640 1 --2- 172.21.15.78:0/2809925722 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b8c078b90 0x7f8b8c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:21.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.023+0000 7f8b9ffff640 1 --2- 172.21.15.78:0/2809925722 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b8c078b90 0x7f8b8c07b0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8b90035000 tx=0x7f8b9002d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:21.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.026+0000 7f8b9cff9640 1 -- 172.21.15.78:0/2809925722 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8ba00d0b70 con 0x7f8ba00d0760 2024-09-17T03:10:21.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.204+0000 7f8ba629b640 1 -- 172.21.15.78:0/2809925722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8ba0074640 con 0x7f8ba00d0760 2024-09-17T03:10:21.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.208+0000 7f8b9cff9640 1 -- 172.21.15.78:0/2809925722 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f8b980639c0 con 0x7f8ba00d0760 2024-09-17T03:10:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.211+0000 7f8ba629b640 1 -- 172.21.15.78:0/2809925722 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b8c078b90 msgr2=0x7f8b8c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.211+0000 7f8ba629b640 1 --2- 172.21.15.78:0/2809925722 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b8c078b90 0x7f8b8c07b0a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8b90035000 tx=0x7f8b9002d040 comp rx=0 tx=0).stop 2024-09-17T03:10:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.211+0000 7f8ba629b640 1 -- 172.21.15.78:0/2809925722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ba00d0760 msgr2=0x7f8ba009d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.211+0000 7f8ba629b640 1 --2- 172.21.15.78:0/2809925722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ba00d0760 0x7f8ba009d050 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0073600 tx=0x7f8b980019b0 comp rx=0 tx=0).stop 2024-09-17T03:10:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.211+0000 7f8ba629b640 1 -- 172.21.15.78:0/2809925722 shutdown_connections 2024-09-17T03:10:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.211+0000 7f8ba629b640 1 --2- 172.21.15.78:0/2809925722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ba00d0760 0x7f8ba009d050 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.211+0000 7f8ba629b640 1 --2- 172.21.15.78:0/2809925722 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b8c078b90 0x7f8b8c07b0a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.211+0000 7f8ba629b640 1 --2- 172.21.15.78:0/2809925722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ba014f590 0x7f8ba00d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.211+0000 7f8ba629b640 1 --2- 172.21.15.78:0/2809925722 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b88003a30 0x7f8ba01f3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.211+0000 7f8ba629b640 1 -- 172.21.15.78:0/2809925722 >> 172.21.15.78:0/2809925722 conn(0x7f8ba00b1cb0 msgr2=0x7f8ba015bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.211+0000 7f8ba629b640 1 -- 172.21.15.78:0/2809925722 shutdown_connections 2024-09-17T03:10:21.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.211+0000 7f8ba629b640 1 -- 172.21.15.78:0/2809925722 wait complete. 2024-09-17T03:10:21.220 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:10:21.221 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:10:21.258 DEBUG:teuthology.orchestra.run.smithi193:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:10:21.308 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:10:21.309 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:10:21.309 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:10:21.324 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056010,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1013 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:10:21.325 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:10:21.325 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:10:21.343 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:10:21.343 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:10:21.343 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:10:21.380 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056010,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1013 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:10:21.381 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:10:21.381 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:10:21.399 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:10:21.400 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:10:21.400 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:10:21.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.534+0000 7f6efd9eb640 1 -- 172.21.15.78:0/1639749833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ee4004800 msgr2=0x7f6ee4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:21.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.534+0000 7f6efd9eb640 1 --2- 172.21.15.78:0/1639749833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ee4004800 0x7f6ee4004c10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6ee0006fc0 tx=0x7f6ee4005830 comp rx=0 tx=0).stop 2024-09-17T03:10:21.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.534+0000 7f6efd9eb640 1 -- 172.21.15.78:0/1639749833 shutdown_connections 2024-09-17T03:10:21.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.534+0000 7f6efd9eb640 1 --2- 172.21.15.78:0/1639749833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ee4004800 0x7f6ee4004c10 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:21.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.534+0000 7f6efd9eb640 1 -- 172.21.15.78:0/1639749833 >> 172.21.15.78:0/1639749833 conn(0x7f6ef80cd530 msgr2=0x7f6ef80cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:21.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.534+0000 7f6efd9eb640 1 -- 172.21.15.78:0/1639749833 shutdown_connections 2024-09-17T03:10:21.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.534+0000 7f6efd9eb640 1 -- 172.21.15.78:0/1639749833 wait complete. 2024-09-17T03:10:21.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.536+0000 7f6efd9eb640 1 Processor -- start 2024-09-17T03:10:21.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.536+0000 7f6efd9eb640 1 -- start start 2024-09-17T03:10:21.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.537+0000 7f6efd9eb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ee4004800 0x7f6ef81e8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:21.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.537+0000 7f6efd9eb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ef81e7580 0x7f6ef81e5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:21.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.537+0000 7f6efd9eb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef81e5590 0x7f6ef81f6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:21.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.537+0000 7f6efd9eb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef806e650 con 0x7f6ef81e5590 2024-09-17T03:10:21.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.537+0000 7f6efd9eb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef806e4d0 con 0x7f6ef81e7580 2024-09-17T03:10:21.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.537+0000 7f6efd9eb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef815f2a0 con 0x7f6ee4004800 2024-09-17T03:10:21.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.538+0000 7f6ef77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef81e5590 0x7f6ef81f6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:21.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.538+0000 7f6ef77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef81e5590 0x7f6ef81f6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55110/0 (socket says 172.21.15.78:55110) 2024-09-17T03:10:21.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.538+0000 7f6ef77fe640 1 -- 172.21.15.78:0/3471194643 learned_addr learned my addr 172.21.15.78:0/3471194643 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:21.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.538+0000 7f6eee7fc640 1 --2- 172.21.15.78:0/3471194643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ef81e7580 0x7f6ef81e5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:21.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.538+0000 7f6ef6ffd640 1 --2- 172.21.15.78:0/3471194643 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ee4004800 0x7f6ef81e8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:21.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.538+0000 7f6ef77fe640 1 -- 172.21.15.78:0/3471194643 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ee4004800 msgr2=0x7f6ef81e8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:21.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.538+0000 7f6ef77fe640 1 --2- 172.21.15.78:0/3471194643 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ee4004800 0x7f6ef81e8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:21.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.538+0000 7f6ef77fe640 1 -- 172.21.15.78:0/3471194643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ef81e7580 msgr2=0x7f6ef81e5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:21.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.538+0000 7f6ef77fe640 1 --2- 172.21.15.78:0/3471194643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ef81e7580 0x7f6ef81e5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:21.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.538+0000 7f6ef77fe640 1 -- 172.21.15.78:0/3471194643 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef81e8080 con 0x7f6ef81e5590 2024-09-17T03:10:21.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.538+0000 7f6ef77fe640 1 --2- 172.21.15.78:0/3471194643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef81e5590 0x7f6ef81f6b10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0005fd0 tx=0x7f6ef0010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:21.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.538+0000 7f6ef4ff9640 1 -- 172.21.15.78:0/3471194643 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0017070 con 0x7f6ef81e5590 2024-09-17T03:10:21.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.538+0000 7f6ef4ff9640 1 -- 172.21.15.78:0/3471194643 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ef0015070 con 0x7f6ef81e5590 2024-09-17T03:10:21.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.538+0000 7f6efd9eb640 1 -- 172.21.15.78:0/3471194643 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef81e8360 con 0x7f6ef81e5590 2024-09-17T03:10:21.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.538+0000 7f6ef4ff9640 1 -- 172.21.15.78:0/3471194643 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ef001c7f0 con 0x7f6ef81e5590 2024-09-17T03:10:21.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.538+0000 7f6efd9eb640 1 -- 172.21.15.78:0/3471194643 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef81e59a0 con 0x7f6ef81e5590 2024-09-17T03:10:21.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.539+0000 7f6efd9eb640 1 -- 172.21.15.78:0/3471194643 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef815f7b0 con 0x7f6ef81e5590 2024-09-17T03:10:21.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.540+0000 7f6ef4ff9640 1 -- 172.21.15.78:0/3471194643 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ef001c990 con 0x7f6ef81e5590 2024-09-17T03:10:21.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.540+0000 7f6ef4ff9640 1 --2- 172.21.15.78:0/3471194643 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6ed8078b90 0x7f6ed807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:21.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.541+0000 7f6ef4ff9640 1 -- 172.21.15.78:0/3471194643 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5115+0+0 (secure 0 0 0) 0x7f6ef009b640 con 0x7f6ef81e5590 2024-09-17T03:10:21.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.541+0000 7f6ef6ffd640 1 --2- 172.21.15.78:0/3471194643 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6ed8078b90 0x7f6ed807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:21.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.541+0000 7f6ef6ffd640 1 --2- 172.21.15.78:0/3471194643 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6ed8078b90 0x7f6ed807b0a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8052910 tx=0x7f6ee8006c60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:21.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.545+0000 7f6ef4ff9640 1 -- 172.21.15.78:0/3471194643 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6ef0063710 con 0x7f6ef81e5590 2024-09-17T03:10:21.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.753+0000 7f6efd9eb640 1 -- 172.21.15.78:0/3471194643 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ef81e7a80 con 0x7f6ef81e5590 2024-09-17T03:10:21.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.754+0000 7f6ef4ff9640 1 -- 172.21.15.78:0/3471194643 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+3917 (secure 0 0 0) 0x7f6ef0068140 con 0x7f6ef81e5590 2024-09-17T03:10:21.753 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:21.753 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":23,"btime":"2024-09-17T03:10:15:539049+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4658,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2234221933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2234221933},{"type":"v1","addr":"172.21.15.193:6836","nonce":2234221933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4973,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/2353865622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2353865622},{"type":"v1","addr":"172.21.15.193:6837","nonce":2353865622}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5472,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/4102609291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":4102609291},{"type":"v1","addr":"172.21.15.78:6833","nonce":4102609291}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":5475,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1464139381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1464139381},{"type":"v1","addr":"172.21.15.78:6835","nonce":1464139381}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[]} 2024-09-17T03:10:21.753 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 23 2024-09-17T03:10:21.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.756+0000 7f6efd9eb640 1 -- 172.21.15.78:0/3471194643 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6ed8078b90 msgr2=0x7f6ed807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:21.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.756+0000 7f6efd9eb640 1 --2- 172.21.15.78:0/3471194643 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6ed8078b90 0x7f6ed807b0a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8052910 tx=0x7f6ee8006c60 comp rx=0 tx=0).stop 2024-09-17T03:10:21.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.756+0000 7f6efd9eb640 1 -- 172.21.15.78:0/3471194643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef81e5590 msgr2=0x7f6ef81f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:21.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.756+0000 7f6efd9eb640 1 --2- 172.21.15.78:0/3471194643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef81e5590 0x7f6ef81f6b10 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0005fd0 tx=0x7f6ef0010f40 comp rx=0 tx=0).stop 2024-09-17T03:10:21.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.756+0000 7f6efd9eb640 1 -- 172.21.15.78:0/3471194643 shutdown_connections 2024-09-17T03:10:21.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.756+0000 7f6efd9eb640 1 --2- 172.21.15.78:0/3471194643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6ef81e5590 0x7f6ef81f6b10 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:21.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.756+0000 7f6efd9eb640 1 --2- 172.21.15.78:0/3471194643 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6ed8078b90 0x7f6ed807b0a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:21.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.756+0000 7f6efd9eb640 1 --2- 172.21.15.78:0/3471194643 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ef81e7580 0x7f6ef81e5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:21.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.756+0000 7f6efd9eb640 1 --2- 172.21.15.78:0/3471194643 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ee4004800 0x7f6ef81e8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:21.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.756+0000 7f6efd9eb640 1 -- 172.21.15.78:0/3471194643 >> 172.21.15.78:0/3471194643 conn(0x7f6ef80cd530 msgr2=0x7f6ef80ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:21.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.756+0000 7f6efd9eb640 1 -- 172.21.15.78:0/3471194643 shutdown_connections 2024-09-17T03:10:21.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.756+0000 7f6efd9eb640 1 -- 172.21.15.78:0/3471194643 wait complete. 2024-09-17T03:10:21.766 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:10:21.766 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:10:21.766 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:10:21.766 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:10:21.766 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:10:21.766 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:10:21.767 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:10:21.767 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:10:21.767 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:10:21.767 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:10:21.767 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:10:21.767 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:10:21.768 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:10:21.768 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:10:21.768 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:10:21.768 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:10:21.778 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:10:21.779 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:10:21.779 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:10:21.780 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:10:21.781 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:10:21.781 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:10:21.782 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:10:21.782 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:10:21.821 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:10:21.821 DEBUG:teuthology.parallel:result is None 2024-09-17T03:10:21.822 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:10:21.822 DEBUG:teuthology.parallel:result is None 2024-09-17T03:10:21.824 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:10:21.824 DEBUG:teuthology.parallel:result is None 2024-09-17T03:10:21.825 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:10:21.826 DEBUG:teuthology.parallel:result is None 2024-09-17T03:10:21.826 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:10:21.908 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-09-17T03:10:21.908 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2024-09-17T03:10:21.916 INFO:tasks.ceph.mds.b.smithi193.stdout:starting mds.b at 2024-09-17T03:10:21.916 INFO:tasks.ceph.mds.d.smithi193.stdout:starting mds.d at 2024-09-17T03:10:21.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.947+0000 7fe385270640 1 -- 172.21.15.78:0/4013038754 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe3800d1520 msgr2=0x7fe3800cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:21.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.947+0000 7fe385270640 1 --2- 172.21.15.78:0/4013038754 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe3800d1520 0x7fe3800cfb70 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe378009b60 tx=0x7fe37802a7c0 comp rx=0 tx=0).stop 2024-09-17T03:10:21.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.947+0000 7fe385270640 1 -- 172.21.15.78:0/4013038754 shutdown_connections 2024-09-17T03:10:21.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.947+0000 7fe385270640 1 --2- 172.21.15.78:0/4013038754 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe3800d1520 0x7fe3800cfb70 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:21.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.947+0000 7fe385270640 1 -- 172.21.15.78:0/4013038754 >> 172.21.15.78:0/4013038754 conn(0x7fe38008bfc0 msgr2=0x7fe38009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:21.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.947+0000 7fe385270640 1 -- 172.21.15.78:0/4013038754 shutdown_connections 2024-09-17T03:10:21.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.947+0000 7fe385270640 1 -- 172.21.15.78:0/4013038754 wait complete. 2024-09-17T03:10:21.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.949+0000 7fe385270640 1 Processor -- start 2024-09-17T03:10:21.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.949+0000 7fe385270640 1 -- start start 2024-09-17T03:10:21.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.950+0000 7fe385270640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe38006e3c0 0x7fe38015d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:21.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.950+0000 7fe385270640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3800b3a60 0x7fe3800a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:21.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.951+0000 7fe385270640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe3800d1520 0x7fe3800a1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:21.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.951+0000 7fe385270640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe3800d2ee0 con 0x7fe3800b3a60 2024-09-17T03:10:21.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.951+0000 7fe385270640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe3800d2d60 con 0x7fe38006e3c0 2024-09-17T03:10:21.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.951+0000 7fe385270640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe3800d3060 con 0x7fe3800d1520 2024-09-17T03:10:21.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.951+0000 7fe37e7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3800b3a60 0x7fe3800a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:21.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.951+0000 7fe37e7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3800b3a60 0x7fe3800a1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55182/0 (socket says 172.21.15.78:55182) 2024-09-17T03:10:21.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.951+0000 7fe37e7fc640 1 -- 172.21.15.78:0/3596827668 learned_addr learned my addr 172.21.15.78:0/3596827668 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:21.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.951+0000 7fe37f7fe640 1 --2- 172.21.15.78:0/3596827668 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe3800d1520 0x7fe3800a1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:21.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.951+0000 7fe37effd640 1 --2- 172.21.15.78:0/3596827668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe38006e3c0 0x7fe38015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:21.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.951+0000 7fe37e7fc640 1 -- 172.21.15.78:0/3596827668 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe3800d1520 msgr2=0x7fe3800a1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:21.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.951+0000 7fe37e7fc640 1 --2- 172.21.15.78:0/3596827668 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe3800d1520 0x7fe3800a1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:21.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.951+0000 7fe37e7fc640 1 -- 172.21.15.78:0/3596827668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe38006e3c0 msgr2=0x7fe38015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:21.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.951+0000 7fe37e7fc640 1 --2- 172.21.15.78:0/3596827668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe38006e3c0 0x7fe38015d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:21.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.951+0000 7fe37e7fc640 1 -- 172.21.15.78:0/3596827668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38015de50 con 0x7fe3800b3a60 2024-09-17T03:10:21.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.951+0000 7fe37e7fc640 1 --2- 172.21.15.78:0/3596827668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3800b3a60 0x7fe3800a1830 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe37400c460 tx=0x7fe37400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:21.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.951+0000 7fe3677fe640 1 -- 172.21.15.78:0/3596827668 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374016020 con 0x7fe3800b3a60 2024-09-17T03:10:21.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.951+0000 7fe3677fe640 1 -- 172.21.15.78:0/3596827668 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe374012940 con 0x7fe3800b3a60 2024-09-17T03:10:21.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.951+0000 7fe385270640 1 -- 172.21.15.78:0/3596827668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3801f5ef0 con 0x7fe3800b3a60 2024-09-17T03:10:21.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.951+0000 7fe3677fe640 1 -- 172.21.15.78:0/3596827668 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe374012d90 con 0x7fe3800b3a60 2024-09-17T03:10:21.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.951+0000 7fe385270640 1 -- 172.21.15.78:0/3596827668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3801f64b0 con 0x7fe3800b3a60 2024-09-17T03:10:21.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.952+0000 7fe385270640 1 -- 172.21.15.78:0/3596827668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3800b3410 con 0x7fe3800b3a60 2024-09-17T03:10:21.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.953+0000 7fe3677fe640 1 -- 172.21.15.78:0/3596827668 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe374019020 con 0x7fe3800b3a60 2024-09-17T03:10:21.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.954+0000 7fe3677fe640 1 --2- 172.21.15.78:0/3596827668 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe36c078b90 0x7fe36c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:21.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.954+0000 7fe3677fe640 1 -- 172.21.15.78:0/3596827668 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5115+0+0 (secure 0 0 0) 0x7fe37409a590 con 0x7fe3800b3a60 2024-09-17T03:10:21.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.954+0000 7fe37effd640 1 --2- 172.21.15.78:0/3596827668 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe36c078b90 0x7fe36c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:21.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.954+0000 7fe37effd640 1 --2- 172.21.15.78:0/3596827668 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe36c078b90 0x7fe36c07b0a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe370000f60 tx=0x7fe370009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:21.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:21.958+0000 7fe3677fe640 1 -- 172.21.15.78:0/3596827668 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe3800b3410 con 0x7fe3800b3a60 2024-09-17T03:10:22.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.142+0000 7fe385270640 1 -- 172.21.15.78:0/3596827668 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe3800b3000 con 0x7fe3800b3a60 2024-09-17T03:10:22.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.579+0000 7fe3677fe640 1 -- 172.21.15.78:0/3596827668 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v39) ==== 97+0+0 (secure 0 0 0) 0x7fe3800b3000 con 0x7fe3800b3a60 2024-09-17T03:10:22.578 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2024-09-17T03:10:22.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.581+0000 7fe385270640 1 -- 172.21.15.78:0/3596827668 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe36c078b90 msgr2=0x7fe36c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:22.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.581+0000 7fe385270640 1 --2- 172.21.15.78:0/3596827668 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe36c078b90 0x7fe36c07b0a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe370000f60 tx=0x7fe370009040 comp rx=0 tx=0).stop 2024-09-17T03:10:22.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.581+0000 7fe385270640 1 -- 172.21.15.78:0/3596827668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3800b3a60 msgr2=0x7fe3800a1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:22.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.581+0000 7fe385270640 1 --2- 172.21.15.78:0/3596827668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3800b3a60 0x7fe3800a1830 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe37400c460 tx=0x7fe37400c920 comp rx=0 tx=0).stop 2024-09-17T03:10:22.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.581+0000 7fe385270640 1 -- 172.21.15.78:0/3596827668 shutdown_connections 2024-09-17T03:10:22.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.581+0000 7fe385270640 1 --2- 172.21.15.78:0/3596827668 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe3800d1520 0x7fe3800a1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:22.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.581+0000 7fe385270640 1 --2- 172.21.15.78:0/3596827668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3800b3a60 0x7fe3800a1830 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:22.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.581+0000 7fe385270640 1 --2- 172.21.15.78:0/3596827668 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe36c078b90 0x7fe36c07b0a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:22.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.581+0000 7fe385270640 1 --2- 172.21.15.78:0/3596827668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe38006e3c0 0x7fe38015d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:22.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.581+0000 7fe385270640 1 -- 172.21.15.78:0/3596827668 >> 172.21.15.78:0/3596827668 conn(0x7fe38008bfc0 msgr2=0x7fe3800d3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:22.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.581+0000 7fe385270640 1 -- 172.21.15.78:0/3596827668 shutdown_connections 2024-09-17T03:10:22.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.581+0000 7fe385270640 1 -- 172.21.15.78:0/3596827668 wait complete. 2024-09-17T03:10:22.593 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:10:22.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.706+0000 7fa2e8b5f640 1 -- 172.21.15.78:0/2417854456 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2e4146200 msgr2=0x7fa2e40737c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:22.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.706+0000 7fa2e8b5f640 1 --2- 172.21.15.78:0/2417854456 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2e4146200 0x7fa2e40737c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc009830 tx=0x7fa2cc02a510 comp rx=0 tx=0).stop 2024-09-17T03:10:22.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.706+0000 7fa2e8b5f640 1 -- 172.21.15.78:0/2417854456 shutdown_connections 2024-09-17T03:10:22.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.706+0000 7fa2e8b5f640 1 --2- 172.21.15.78:0/2417854456 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2e4146200 0x7fa2e40737c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:22.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.706+0000 7fa2e8b5f640 1 --2- 172.21.15.78:0/2417854456 >> v2:172.21.15.193:3300/0 conn(0x7fa2e4071420 0x7fa2e4073280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:22.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.706+0000 7fa2e8b5f640 1 -- 172.21.15.78:0/2417854456 >> 172.21.15.78:0/2417854456 conn(0x7fa2e40b2160 msgr2=0x7fa2e40b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:22.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.706+0000 7fa2e8b5f640 1 -- 172.21.15.78:0/2417854456 shutdown_connections 2024-09-17T03:10:22.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.706+0000 7fa2e8b5f640 1 -- 172.21.15.78:0/2417854456 wait complete. 2024-09-17T03:10:22.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.708+0000 7fa2e8b5f640 1 Processor -- start 2024-09-17T03:10:22.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.708+0000 7fa2e8b5f640 1 -- start start 2024-09-17T03:10:22.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.710+0000 7fa2e8b5f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2e4071420 0x7fa2e4141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:22.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.710+0000 7fa2e8b5f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2e40cd980 0x7fa2e4141b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:22.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.710+0000 7fa2e8b5f640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2e4146200 0x7fa2e40aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:22.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.710+0000 7fa2e8b5f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e4160a00 con 0x7fa2e4071420 2024-09-17T03:10:22.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.710+0000 7fa2e8b5f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e40b4b10 con 0x7fa2e40cd980 2024-09-17T03:10:22.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.710+0000 7fa2e8b5f640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa2e4160b80 con 0x7fa2e4146200 2024-09-17T03:10:22.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.710+0000 7fa2e259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2e4071420 0x7fa2e4141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:22.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.710+0000 7fa2e259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2e4071420 0x7fa2e4141640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55192/0 (socket says 172.21.15.78:55192) 2024-09-17T03:10:22.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.710+0000 7fa2e259c640 1 -- 172.21.15.78:0/4107055947 learned_addr learned my addr 172.21.15.78:0/4107055947 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:22.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.710+0000 7fa2d9d9b640 1 --2- 172.21.15.78:0/4107055947 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2e40cd980 0x7fa2e4141b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:22.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.710+0000 7fa2e2d9d640 1 --2- 172.21.15.78:0/4107055947 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2e4146200 0x7fa2e40aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:22.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.710+0000 7fa2e259c640 1 -- 172.21.15.78:0/4107055947 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2e4146200 msgr2=0x7fa2e40aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:22.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.710+0000 7fa2e259c640 1 --2- 172.21.15.78:0/4107055947 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2e4146200 0x7fa2e40aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:22.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.710+0000 7fa2e259c640 1 -- 172.21.15.78:0/4107055947 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2e40cd980 msgr2=0x7fa2e4141b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:22.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.710+0000 7fa2e259c640 1 --2- 172.21.15.78:0/4107055947 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2e40cd980 0x7fa2e4141b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:22.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.710+0000 7fa2e259c640 1 -- 172.21.15.78:0/4107055947 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e40ada50 con 0x7fa2e4071420 2024-09-17T03:10:22.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.710+0000 7fa2e259c640 1 --2- 172.21.15.78:0/4107055947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2e4071420 0x7fa2e4141640 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400e9f0 tx=0x7fa2d400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:22.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.710+0000 7fa2db7fe640 1 -- 172.21.15.78:0/4107055947 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d400cd80 con 0x7fa2e4071420 2024-09-17T03:10:22.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.710+0000 7fa2e8b5f640 1 -- 172.21.15.78:0/4107055947 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2e40c6050 con 0x7fa2e4071420 2024-09-17T03:10:22.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.710+0000 7fa2db7fe640 1 -- 172.21.15.78:0/4107055947 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2d4004020 con 0x7fa2e4071420 2024-09-17T03:10:22.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.711+0000 7fa2db7fe640 1 -- 172.21.15.78:0/4107055947 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4004470 con 0x7fa2e4071420 2024-09-17T03:10:22.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.711+0000 7fa2e8b5f640 1 -- 172.21.15.78:0/4107055947 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2e40adfd0 con 0x7fa2e4071420 2024-09-17T03:10:22.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.712+0000 7fa2e8b5f640 1 -- 172.21.15.78:0/4107055947 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2e4161000 con 0x7fa2e4071420 2024-09-17T03:10:22.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.712+0000 7fa2db7fe640 1 -- 172.21.15.78:0/4107055947 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa2d40035f0 con 0x7fa2e4071420 2024-09-17T03:10:22.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.713+0000 7fa2db7fe640 1 --2- 172.21.15.78:0/4107055947 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa2c4078b90 0x7fa2c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:22.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.713+0000 7fa2db7fe640 1 -- 172.21.15.78:0/4107055947 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7fa2d409b2b0 con 0x7fa2e4071420 2024-09-17T03:10:22.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.713+0000 7fa2d9d9b640 1 --2- 172.21.15.78:0/4107055947 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa2c4078b90 0x7fa2c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:22.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.714+0000 7fa2d9d9b640 1 --2- 172.21.15.78:0/4107055947 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa2c4078b90 0x7fa2c407b0a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc034000 tx=0x7fa2cc004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:22.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.717+0000 7fa2db7fe640 1 -- 172.21.15.78:0/4107055947 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa2d4063400 con 0x7fa2e4071420 2024-09-17T03:10:22.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.960+0000 7fa2e8b5f640 1 -- 172.21.15.78:0/4107055947 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa2e40d0e30 con 0x7fa2e4071420 2024-09-17T03:10:22.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.960+0000 7fa2db7fe640 1 -- 172.21.15.78:0/4107055947 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7fa2d4067e30 con 0x7fa2e4071420 2024-09-17T03:10:22.960 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:22.960 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:10:22.960 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2024-09-17T03:10:22.960 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:10:22.960 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2024-09-17T03:10:22.960 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmF3icCRAAZEAXi3RiY/e4JSSr1nd2sQ==", 2024-09-17T03:10:22.960 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:10:22.960 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:10:22.960 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:10:22.961 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:10:22.961 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:10:22.961 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:22.961 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:10:22.961 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:10:22.961 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2024-09-17T03:10:22.961 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmzFPWFhAAptFKHxH9Xy3l9q0gxLARBQ==", 2024-09-17T03:10:22.961 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:10:22.961 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:10:22.961 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:10:22.961 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:10:22.961 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:10:22.961 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:22.961 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:10:22.962 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:10:22.962 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2024-09-17T03:10:22.962 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmFoc7ERAAlPpal3pKHjPKFotpPiJ9dA==", 2024-09-17T03:10:22.962 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:10:22.962 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:10:22.962 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:10:22.962 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:10:22.962 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:10:22.962 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:22.962 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:10:22.962 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:10:22.962 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2024-09-17T03:10:22.962 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmYJ2aHhAAhG6Sw6iZDy6s0qpiSLc//A==", 2024-09-17T03:10:22.962 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:10:22.963 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:10:22.963 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:10:22.963 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:10:22.963 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:10:22.963 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:22.963 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:10:22.963 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:10:22.963 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2024-09-17T03:10:22.963 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBy8uhmiaXeOhAAbhD0AqPz5JYg9CvycMk6cQ==", 2024-09-17T03:10:22.963 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:10:22.963 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:10:22.963 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:10:22.963 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:10:22.963 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:22.964 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:10:22.964 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:10:22.964 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2024-09-17T03:10:22.964 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB28uhmWT32HxAAATHdxAa6QOLYGnpPCx72iA==", 2024-09-17T03:10:22.964 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:10:22.964 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:10:22.964 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:10:22.964 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:10:22.964 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:22.964 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:10:22.964 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:10:22.964 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2024-09-17T03:10:22.964 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB58uhmTOOMMBAA4YSlpqeuxlIXypxCpxDJ+Q==", 2024-09-17T03:10:22.964 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:10:22.965 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:10:22.965 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:10:22.965 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:10:22.965 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:22.965 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:10:22.965 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:10:22.965 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2024-09-17T03:10:22.965 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB88uhmSgx6MxAAKHGCbjfVZTyeb0nX2xKkSQ==", 2024-09-17T03:10:22.965 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:10:22.965 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:10:22.965 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:10:22.965 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:10:22.965 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:22.965 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:10:22.966 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:10:22.966 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2024-09-17T03:10:22.966 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCD8uhmNKZkBBAAZwn1Xf+fd3GNeP4etvNePg==", 2024-09-17T03:10:22.966 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:10:22.966 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:10:22.966 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:10:22.966 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:10:22.966 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:22.966 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:10:22.967 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:10:22.967 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2024-09-17T03:10:22.967 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCG8uhmDTyzBhAAzeipRWM5M2fjCQt7xDGBwA==", 2024-09-17T03:10:22.967 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:10:22.967 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:10:22.967 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:10:22.967 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:10:22.967 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:22.967 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:10:22.967 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:10:22.967 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2024-09-17T03:10:22.968 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCJ8uhmDsZLGBAAB3VNeHQoty+fQwvYpRkltw==", 2024-09-17T03:10:22.968 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:10:22.968 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:10:22.968 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:10:22.968 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:10:22.968 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:22.968 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:10:22.968 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:10:22.968 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2024-09-17T03:10:22.968 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCM8uhm3PkQKRAAjJV2xFyyoACLkA3f/lFhWw==", 2024-09-17T03:10:22.968 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:10:22.968 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:10:22.968 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:10:22.968 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:10:22.969 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:22.969 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:10:22.969 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:10:22.969 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2024-09-17T03:10:22.969 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmn+c/IxAALXG+Qkwye7zc6PjcLBsk1g==", 2024-09-17T03:10:22.969 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:10:22.969 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:10:22.969 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow r", 2024-09-17T03:10:22.969 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:10:22.969 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:22.969 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:10:22.969 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:10:22.969 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2024-09-17T03:10:22.970 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmbzjQKhAAr/DB8TDsiWPsLHnsvUaTiw==", 2024-09-17T03:10:22.970 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:10:22.970 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:10:22.970 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2024-09-17T03:10:22.970 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2024-09-17T03:10:22.970 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2024-09-17T03:10:22.970 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:22.970 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:10:22.970 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:10:22.970 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.2", 2024-09-17T03:10:22.970 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmB9ABJxAATgS37nY3a3bX8wK1H3S/8A==", 2024-09-17T03:10:22.970 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:10:22.970 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:10:22.971 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2024-09-17T03:10:22.971 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2024-09-17T03:10:22.971 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2024-09-17T03:10:22.971 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:22.971 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:10:22.971 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:10:22.971 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.3", 2024-09-17T03:10:22.971 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmyhGmLhAAIfkcz3KW+qZ1qDOqQdPS5g==", 2024-09-17T03:10:22.971 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:10:22.971 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:10:22.971 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2024-09-17T03:10:22.971 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2024-09-17T03:10:22.971 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2024-09-17T03:10:22.971 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:22.972 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:10:22.972 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:10:22.972 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2024-09-17T03:10:22.972 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBu8uhmBgTvJxAAP2vhORVoAAnDSVpnLukIaA==", 2024-09-17T03:10:22.972 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:10:22.972 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2024-09-17T03:10:22.972 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:10:22.972 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:10:22.972 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:10:22.972 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:22.972 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:10:22.972 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:10:22.972 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2024-09-17T03:10:22.972 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmcpvVBRAA2JTbv0LrIc7seMyOmOIBmA==", 2024-09-17T03:10:22.972 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:10:22.973 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2024-09-17T03:10:22.973 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2024-09-17T03:10:22.973 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:10:22.973 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:22.973 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:10:22.973 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:10:22.973 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2024-09-17T03:10:22.973 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhm1SeKARAA2hyytqNjqToQ0K+RgQ8Tbg==", 2024-09-17T03:10:22.973 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:10:22.973 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2024-09-17T03:10:22.973 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2024-09-17T03:10:22.973 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:10:22.973 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:22.973 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:22.974 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-17T03:10:22.974 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:10:22.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.962+0000 7fa2e8b5f640 1 -- 172.21.15.78:0/4107055947 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa2c4078b90 msgr2=0x7fa2c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:22.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.962+0000 7fa2e8b5f640 1 --2- 172.21.15.78:0/4107055947 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa2c4078b90 0x7fa2c407b0a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc034000 tx=0x7fa2cc004730 comp rx=0 tx=0).stop 2024-09-17T03:10:22.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.962+0000 7fa2e8b5f640 1 -- 172.21.15.78:0/4107055947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2e4071420 msgr2=0x7fa2e4141640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:22.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.962+0000 7fa2e8b5f640 1 --2- 172.21.15.78:0/4107055947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2e4071420 0x7fa2e4141640 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fa2d400e9f0 tx=0x7fa2d400eeb0 comp rx=0 tx=0).stop 2024-09-17T03:10:22.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.963+0000 7fa2e8b5f640 1 -- 172.21.15.78:0/4107055947 shutdown_connections 2024-09-17T03:10:22.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.963+0000 7fa2e8b5f640 1 --2- 172.21.15.78:0/4107055947 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2e4146200 0x7fa2e40aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:22.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.963+0000 7fa2e8b5f640 1 --2- 172.21.15.78:0/4107055947 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa2c4078b90 0x7fa2c407b0a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:22.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.963+0000 7fa2e8b5f640 1 --2- 172.21.15.78:0/4107055947 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2e40cd980 0x7fa2e4141b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:22.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.963+0000 7fa2e8b5f640 1 --2- 172.21.15.78:0/4107055947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2e4071420 0x7fa2e4141640 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:22.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.963+0000 7fa2e8b5f640 1 -- 172.21.15.78:0/4107055947 >> 172.21.15.78:0/4107055947 conn(0x7fa2e40b2160 msgr2=0x7fa2e415d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:22.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.963+0000 7fa2e8b5f640 1 -- 172.21.15.78:0/4107055947 shutdown_connections 2024-09-17T03:10:22.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:22.963+0000 7fa2e8b5f640 1 -- 172.21.15.78:0/4107055947 wait complete. 2024-09-17T03:10:22.977 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:10:23.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.090+0000 7f321dad3640 1 -- 172.21.15.78:0/3006913568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32180cd360 msgr2=0x7f321815c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:23.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.090+0000 7f321dad3640 1 --2- 172.21.15.78:0/3006913568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32180cd360 0x7f321815c6a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3208005fd0 tx=0x7f320802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:10:23.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.090+0000 7f321dad3640 1 -- 172.21.15.78:0/3006913568 shutdown_connections 2024-09-17T03:10:23.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.090+0000 7f321dad3640 1 --2- 172.21.15.78:0/3006913568 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32180cf440 0x7f32180d0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:23.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.090+0000 7f321dad3640 1 --2- 172.21.15.78:0/3006913568 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32180cd360 0x7f321815c6a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:23.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.090+0000 7f321dad3640 1 -- 172.21.15.78:0/3006913568 >> 172.21.15.78:0/3006913568 conn(0x7f32180710b0 msgr2=0x7f32180714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:23.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.090+0000 7f321dad3640 1 -- 172.21.15.78:0/3006913568 shutdown_connections 2024-09-17T03:10:23.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.090+0000 7f321dad3640 1 -- 172.21.15.78:0/3006913568 wait complete. 2024-09-17T03:10:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.092+0000 7f321dad3640 1 Processor -- start 2024-09-17T03:10:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.092+0000 7f321dad3640 1 -- start start 2024-09-17T03:10:23.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f321dad3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32180b7fe0 0x7f32180c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:23.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f321dad3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32180cd360 0x7f32181599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:23.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f321dad3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f321806def0 0x7f321815e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:23.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f321dad3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f32180d0c50 con 0x7f321806def0 2024-09-17T03:10:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f321dad3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f32180d0ad0 con 0x7f32180cd360 2024-09-17T03:10:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f321dad3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f32180d0dd0 con 0x7f32180b7fe0 2024-09-17T03:10:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f3217fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f321806def0 0x7f321815e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f3217fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f321806def0 0x7f321815e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55206/0 (socket says 172.21.15.78:55206) 2024-09-17T03:10:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f3217fff640 1 -- 172.21.15.78:0/202810476 learned_addr learned my addr 172.21.15.78:0/202810476 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f32177fe640 1 --2- 172.21.15.78:0/202810476 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32180b7fe0 0x7f32180c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f3216ffd640 1 --2- 172.21.15.78:0/202810476 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32180cd360 0x7f32181599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f3217fff640 1 -- 172.21.15.78:0/202810476 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32180b7fe0 msgr2=0x7f32180c7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f3217fff640 1 --2- 172.21.15.78:0/202810476 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32180b7fe0 0x7f32180c7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f3217fff640 1 -- 172.21.15.78:0/202810476 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32180cd360 msgr2=0x7f32181599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f3217fff640 1 --2- 172.21.15.78:0/202810476 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32180cd360 0x7f32181599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f3217fff640 1 -- 172.21.15.78:0/202810476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32180c8cb0 con 0x7f321806def0 2024-09-17T03:10:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f3217fff640 1 --2- 172.21.15.78:0/202810476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f321806def0 0x7f321815e6b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f321000e960 tx=0x7f321000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f31fffff640 1 -- 172.21.15.78:0/202810476 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3210004d20 con 0x7f321806def0 2024-09-17T03:10:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f31fffff640 1 -- 172.21.15.78:0/202810476 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f321000cb20 con 0x7f321806def0 2024-09-17T03:10:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f321dad3640 1 -- 172.21.15.78:0/202810476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f321815def0 con 0x7f321806def0 2024-09-17T03:10:23.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f31fffff640 1 -- 172.21.15.78:0/202810476 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3210005020 con 0x7f321806def0 2024-09-17T03:10:23.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.094+0000 7f321dad3640 1 -- 172.21.15.78:0/202810476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3218159f00 con 0x7f321806def0 2024-09-17T03:10:23.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.096+0000 7f321dad3640 1 -- 172.21.15.78:0/202810476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32180c8460 con 0x7f321806def0 2024-09-17T03:10:23.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.096+0000 7f31fffff640 1 -- 172.21.15.78:0/202810476 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f32100051c0 con 0x7f321806def0 2024-09-17T03:10:23.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.097+0000 7f31fffff640 1 --2- 172.21.15.78:0/202810476 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3204078bc0 0x7f320407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:23.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.097+0000 7f31fffff640 1 -- 172.21.15.78:0/202810476 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f321009b120 con 0x7f321806def0 2024-09-17T03:10:23.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.097+0000 7f32177fe640 1 --2- 172.21.15.78:0/202810476 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3204078bc0 0x7f320407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:23.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.098+0000 7f32177fe640 1 --2- 172.21.15.78:0/202810476 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3204078bc0 0x7f320407b0d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3208033000 tx=0x7f3208004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:23.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.101+0000 7f31fffff640 1 -- 172.21.15.78:0/202810476 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3210016030 con 0x7f321806def0 2024-09-17T03:10:23.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.278+0000 7f321dad3640 1 -- 172.21.15.78:0/202810476 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f32181e80a0 con 0x7f321806def0 2024-09-17T03:10:23.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.279+0000 7f31fffff640 1 -- 172.21.15.78:0/202810476 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) ==== 84+0+65 (secure 0 0 0) 0x7f32181e80a0 con 0x7f321806def0 2024-09-17T03:10:23.278 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:23.278 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2024-09-17T03:10:23.278 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:10:23.278 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2024-09-17T03:10:23.278 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2024-09-17T03:10:23.278 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:10:23.278 INFO:teuthology.orchestra.run.smithi078.stdout:] 2024-09-17T03:10:23.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.281+0000 7f321dad3640 1 -- 172.21.15.78:0/202810476 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3204078bc0 msgr2=0x7f320407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:23.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.281+0000 7f321dad3640 1 --2- 172.21.15.78:0/202810476 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3204078bc0 0x7f320407b0d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3208033000 tx=0x7f3208004730 comp rx=0 tx=0).stop 2024-09-17T03:10:23.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.281+0000 7f321dad3640 1 -- 172.21.15.78:0/202810476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f321806def0 msgr2=0x7f321815e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:23.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.281+0000 7f321dad3640 1 --2- 172.21.15.78:0/202810476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f321806def0 0x7f321815e6b0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f321000e960 tx=0x7f321000ee20 comp rx=0 tx=0).stop 2024-09-17T03:10:23.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.281+0000 7f321dad3640 1 -- 172.21.15.78:0/202810476 shutdown_connections 2024-09-17T03:10:23.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.281+0000 7f321dad3640 1 --2- 172.21.15.78:0/202810476 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f321806def0 0x7f321815e6b0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:23.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.281+0000 7f321dad3640 1 --2- 172.21.15.78:0/202810476 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3204078bc0 0x7f320407b0d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:23.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.281+0000 7f321dad3640 1 --2- 172.21.15.78:0/202810476 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32180cd360 0x7f32181599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:23.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.281+0000 7f321dad3640 1 --2- 172.21.15.78:0/202810476 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32180b7fe0 0x7f32180c7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:23.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.281+0000 7f321dad3640 1 -- 172.21.15.78:0/202810476 >> 172.21.15.78:0/202810476 conn(0x7f32180710b0 msgr2=0x7f32180b3610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:23.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.281+0000 7f321dad3640 1 -- 172.21.15.78:0/202810476 shutdown_connections 2024-09-17T03:10:23.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.281+0000 7f321dad3640 1 -- 172.21.15.78:0/202810476 wait complete. 2024-09-17T03:10:23.291 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:10:23.291 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:10:23.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.409+0000 7f0332fc3640 1 -- 172.21.15.78:0/1817996781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f032c070fc0 msgr2=0x7f032c0b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:23.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.409+0000 7f0332fc3640 1 --2- 172.21.15.78:0/1817996781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f032c070fc0 0x7f032c0b3690 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f032c06de70 tx=0x7f031c02a560 comp rx=0 tx=0).stop 2024-09-17T03:10:23.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.409+0000 7f0332fc3640 1 -- 172.21.15.78:0/1817996781 shutdown_connections 2024-09-17T03:10:23.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.409+0000 7f0332fc3640 1 --2- 172.21.15.78:0/1817996781 >> v2:172.21.15.193:3300/0 conn(0x7f032c06cde0 0x7f032c06d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:23.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.409+0000 7f0332fc3640 1 --2- 172.21.15.78:0/1817996781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f032c070fc0 0x7f032c0b3690 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:23.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.409+0000 7f0332fc3640 1 --2- 172.21.15.78:0/1817996781 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f032c15c7c0 0x7f032c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:23.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.409+0000 7f0332fc3640 1 -- 172.21.15.78:0/1817996781 >> 172.21.15.78:0/1817996781 conn(0x7f032c06e520 msgr2=0x7f032c0cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:23.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.409+0000 7f0332fc3640 1 -- 172.21.15.78:0/1817996781 shutdown_connections 2024-09-17T03:10:23.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.409+0000 7f0332fc3640 1 -- 172.21.15.78:0/1817996781 wait complete. 2024-09-17T03:10:23.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.411+0000 7f0332fc3640 1 Processor -- start 2024-09-17T03:10:23.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.411+0000 7f0332fc3640 1 -- start start 2024-09-17T03:10:23.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.412+0000 7f0332fc3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f032c06cde0 0x7f032c09e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:23.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.412+0000 7f0332fc3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f032c070fc0 0x7f032c15b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:23.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.412+0000 7f0332fc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f032c15c7c0 0x7f032c0c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:23.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.412+0000 7f0332fc3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f032c160520 con 0x7f032c15c7c0 2024-09-17T03:10:23.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.412+0000 7f0332fc3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f032c1603a0 con 0x7f032c06cde0 2024-09-17T03:10:23.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.412+0000 7f0332fc3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f032c1606a0 con 0x7f032c070fc0 2024-09-17T03:10:23.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.412+0000 7f0331560640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f032c15c7c0 0x7f032c0c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:23.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.412+0000 7f0331560640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f032c15c7c0 0x7f032c0c9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55218/0 (socket says 172.21.15.78:55218) 2024-09-17T03:10:23.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.412+0000 7f0331560640 1 -- 172.21.15.78:0/2943920963 learned_addr learned my addr 172.21.15.78:0/2943920963 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:23.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.412+0000 7f0330d5f640 1 --2- 172.21.15.78:0/2943920963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f032c06cde0 0x7f032c09e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:23.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.412+0000 7f0323fff640 1 --2- 172.21.15.78:0/2943920963 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f032c070fc0 0x7f032c15b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:23.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.413+0000 7f0331560640 1 -- 172.21.15.78:0/2943920963 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f032c070fc0 msgr2=0x7f032c15b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:23.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.413+0000 7f0331560640 1 --2- 172.21.15.78:0/2943920963 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f032c070fc0 0x7f032c15b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:23.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.413+0000 7f0331560640 1 -- 172.21.15.78:0/2943920963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f032c06cde0 msgr2=0x7f032c09e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:23.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.413+0000 7f0331560640 1 --2- 172.21.15.78:0/2943920963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f032c06cde0 0x7f032c09e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:23.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.413+0000 7f0331560640 1 -- 172.21.15.78:0/2943920963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032c09eb90 con 0x7f032c15c7c0 2024-09-17T03:10:23.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.413+0000 7f0331560640 1 --2- 172.21.15.78:0/2943920963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f032c15c7c0 0x7f032c0c9e70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f032400e990 tx=0x7f032400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:23.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.413+0000 7f03217fa640 1 -- 172.21.15.78:0/2943920963 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0324004d20 con 0x7f032c15c7c0 2024-09-17T03:10:23.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.413+0000 7f03217fa640 1 -- 172.21.15.78:0/2943920963 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f032400caa0 con 0x7f032c15c7c0 2024-09-17T03:10:23.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.413+0000 7f03217fa640 1 -- 172.21.15.78:0/2943920963 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0324005020 con 0x7f032c15c7c0 2024-09-17T03:10:23.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.413+0000 7f0332fc3640 1 -- 172.21.15.78:0/2943920963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f032c09ba80 con 0x7f032c15c7c0 2024-09-17T03:10:23.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.413+0000 7f0332fc3640 1 -- 172.21.15.78:0/2943920963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f032c09c040 con 0x7f032c15c7c0 2024-09-17T03:10:23.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.414+0000 7f0332fc3640 1 -- 172.21.15.78:0/2943920963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f032c160bf0 con 0x7f032c15c7c0 2024-09-17T03:10:23.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.415+0000 7f03217fa640 1 -- 172.21.15.78:0/2943920963 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f03240051c0 con 0x7f032c15c7c0 2024-09-17T03:10:23.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.415+0000 7f03217fa640 1 --2- 172.21.15.78:0/2943920963 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0318078bc0 0x7f031807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:23.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.415+0000 7f03217fa640 1 -- 172.21.15.78:0/2943920963 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f032409b1c0 con 0x7f032c15c7c0 2024-09-17T03:10:23.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.415+0000 7f0330d5f640 1 --2- 172.21.15.78:0/2943920963 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0318078bc0 0x7f031807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:23.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.416+0000 7f0330d5f640 1 --2- 172.21.15.78:0/2943920963 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0318078bc0 0x7f031807b0d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f03280045b0 tx=0x7f032800b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:23.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.420+0000 7f03217fa640 1 -- 172.21.15.78:0/2943920963 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0324016030 con 0x7f032c15c7c0 2024-09-17T03:10:23.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:23.596+0000 7f0332fc3640 1 -- 172.21.15.78:0/2943920963 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f032c0b5b70 con 0x7f032c15c7c0 2024-09-17T03:10:24.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.595+0000 7f03217fa640 1 -- 172.21.15.78:0/2943920963 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) ==== 138+0+0 (secure 0 0 0) 0x7f0324063390 con 0x7f032c15c7c0 2024-09-17T03:10:24.594 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2024-09-17T03:10:24.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.598+0000 7f0332fc3640 1 -- 172.21.15.78:0/2943920963 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0318078bc0 msgr2=0x7f031807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:24.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.598+0000 7f0332fc3640 1 --2- 172.21.15.78:0/2943920963 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0318078bc0 0x7f031807b0d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f03280045b0 tx=0x7f032800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:10:24.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.598+0000 7f0332fc3640 1 -- 172.21.15.78:0/2943920963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f032c15c7c0 msgr2=0x7f032c0c9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:24.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.598+0000 7f0332fc3640 1 --2- 172.21.15.78:0/2943920963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f032c15c7c0 0x7f032c0c9e70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f032400e990 tx=0x7f032400ee50 comp rx=0 tx=0).stop 2024-09-17T03:10:24.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.598+0000 7f0332fc3640 1 -- 172.21.15.78:0/2943920963 shutdown_connections 2024-09-17T03:10:24.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.598+0000 7f0332fc3640 1 --2- 172.21.15.78:0/2943920963 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f032c15c7c0 0x7f032c0c9e70 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:24.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.598+0000 7f0332fc3640 1 --2- 172.21.15.78:0/2943920963 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f032c070fc0 0x7f032c15b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:24.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.598+0000 7f0332fc3640 1 --2- 172.21.15.78:0/2943920963 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0318078bc0 0x7f031807b0d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:24.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.598+0000 7f0332fc3640 1 --2- 172.21.15.78:0/2943920963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f032c06cde0 0x7f032c09e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:24.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.598+0000 7f0332fc3640 1 -- 172.21.15.78:0/2943920963 >> 172.21.15.78:0/2943920963 conn(0x7f032c06e520 msgr2=0x7f032c0b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:24.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.599+0000 7f0332fc3640 1 -- 172.21.15.78:0/2943920963 shutdown_connections 2024-09-17T03:10:24.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.599+0000 7f0332fc3640 1 -- 172.21.15.78:0/2943920963 wait complete. 2024-09-17T03:10:24.613 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:10:24.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.735+0000 7f67508d3640 1 -- 172.21.15.78:0/2710670433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f674c156f40 msgr2=0x7f674c15d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:24.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.735+0000 7f67508d3640 1 --2- 172.21.15.78:0/2710670433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f674c156f40 0x7f674c15d8f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f674c0cfa60 tx=0x7f673402a480 comp rx=0 tx=0).stop 2024-09-17T03:10:24.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.735+0000 7f67508d3640 1 -- 172.21.15.78:0/2710670433 shutdown_connections 2024-09-17T03:10:24.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.735+0000 7f67508d3640 1 --2- 172.21.15.78:0/2710670433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f674c156f40 0x7f674c15d8f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:24.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.735+0000 7f67508d3640 1 --2- 172.21.15.78:0/2710670433 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f674c0cd3a0 0x7f674c160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:24.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.735+0000 7f67508d3640 1 -- 172.21.15.78:0/2710670433 >> 172.21.15.78:0/2710670433 conn(0x7f674c06d550 msgr2=0x7f674c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:24.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.735+0000 7f67508d3640 1 -- 172.21.15.78:0/2710670433 shutdown_connections 2024-09-17T03:10:24.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.735+0000 7f67508d3640 1 -- 172.21.15.78:0/2710670433 wait complete. 2024-09-17T03:10:24.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.737+0000 7f67508d3640 1 Processor -- start 2024-09-17T03:10:24.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.737+0000 7f67508d3640 1 -- start start 2024-09-17T03:10:24.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.738+0000 7f67508d3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f674c0cd3a0 0x7f674c1f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:24.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.738+0000 7f67508d3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f674c0cecf0 0x7f674c1554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:24.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.738+0000 7f67508d3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f674c156f40 0x7f674c15f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:24.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.738+0000 7f67508d3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f674c0d0960 con 0x7f674c156f40 2024-09-17T03:10:24.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.738+0000 7f67508d3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f674c0d07e0 con 0x7f674c0cd3a0 2024-09-17T03:10:24.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.738+0000 7f67508d3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f674c0d0ae0 con 0x7f674c0cecf0 2024-09-17T03:10:24.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.738+0000 7f674ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f674c156f40 0x7f674c15f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:24.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.739+0000 7f674ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f674c156f40 0x7f674c15f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55240/0 (socket says 172.21.15.78:55240) 2024-09-17T03:10:24.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.739+0000 7f674ad9d640 1 -- 172.21.15.78:0/3489015110 learned_addr learned my addr 172.21.15.78:0/3489015110 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:24.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.739+0000 7f6741d9b640 1 --2- 172.21.15.78:0/3489015110 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f674c0cecf0 0x7f674c1554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:24.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.739+0000 7f674a59c640 1 --2- 172.21.15.78:0/3489015110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f674c0cd3a0 0x7f674c1f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:24.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.739+0000 7f674ad9d640 1 -- 172.21.15.78:0/3489015110 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f674c0cecf0 msgr2=0x7f674c1554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:24.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.739+0000 7f674ad9d640 1 --2- 172.21.15.78:0/3489015110 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f674c0cecf0 0x7f674c1554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:24.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.739+0000 7f674ad9d640 1 -- 172.21.15.78:0/3489015110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f674c0cd3a0 msgr2=0x7f674c1f7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:24.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.739+0000 7f674ad9d640 1 --2- 172.21.15.78:0/3489015110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f674c0cd3a0 0x7f674c1f7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:24.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.739+0000 7f674ad9d640 1 -- 172.21.15.78:0/3489015110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f674c15a3d0 con 0x7f674c156f40 2024-09-17T03:10:24.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.739+0000 7f674ad9d640 1 --2- 172.21.15.78:0/3489015110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f674c156f40 0x7f674c15f570 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f674400b9a0 tx=0x7f674400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:24.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.739+0000 7f67437fe640 1 -- 172.21.15.78:0/3489015110 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6744019070 con 0x7f674c156f40 2024-09-17T03:10:24.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.739+0000 7f67437fe640 1 -- 172.21.15.78:0/3489015110 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f674400cc90 con 0x7f674c156f40 2024-09-17T03:10:24.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.739+0000 7f67508d3640 1 -- 172.21.15.78:0/3489015110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f674c1f3c50 con 0x7f674c156f40 2024-09-17T03:10:24.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.739+0000 7f67437fe640 1 -- 172.21.15.78:0/3489015110 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67440146a0 con 0x7f674c156f40 2024-09-17T03:10:24.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.739+0000 7f67508d3640 1 -- 172.21.15.78:0/3489015110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f674c159270 con 0x7f674c156f40 2024-09-17T03:10:24.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.740+0000 7f67508d3640 1 -- 172.21.15.78:0/3489015110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f674c15a140 con 0x7f674c156f40 2024-09-17T03:10:24.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.741+0000 7f67437fe640 1 -- 172.21.15.78:0/3489015110 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f674401c070 con 0x7f674c156f40 2024-09-17T03:10:24.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.742+0000 7f67437fe640 1 --2- 172.21.15.78:0/3489015110 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f672c078bc0 0x7f672c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:24.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.742+0000 7f67437fe640 1 -- 172.21.15.78:0/3489015110 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5227+0+0 (secure 0 0 0) 0x7f674409a5e0 con 0x7f674c156f40 2024-09-17T03:10:24.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.742+0000 7f674a59c640 1 --2- 172.21.15.78:0/3489015110 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f672c078bc0 0x7f672c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:24.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.742+0000 7f674a59c640 1 --2- 172.21.15.78:0/3489015110 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f672c078bc0 0x7f672c07b0d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f673c005fd0 tx=0x7f673c00a250 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:24.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.746+0000 7f67437fe640 1 -- 172.21.15.78:0/3489015110 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6744062650 con 0x7f674c156f40 2024-09-17T03:10:24.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:24.921+0000 7f67508d3640 1 -- 172.21.15.78:0/3489015110 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f674c0d10a0 con 0x7f674c156f40 2024-09-17T03:10:24.953 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:10:24.956 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:10:25.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.604+0000 7f67437fe640 1 -- 172.21.15.78:0/3489015110 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v43) ==== 170+0+0 (secure 0 0 0) 0x7f6744067080 con 0x7f674c156f40 2024-09-17T03:10:25.603 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2024-09-17T03:10:25.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.606+0000 7f67508d3640 1 -- 172.21.15.78:0/3489015110 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f672c078bc0 msgr2=0x7f672c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:25.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.606+0000 7f67508d3640 1 --2- 172.21.15.78:0/3489015110 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f672c078bc0 0x7f672c07b0d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f673c005fd0 tx=0x7f673c00a250 comp rx=0 tx=0).stop 2024-09-17T03:10:25.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.606+0000 7f67508d3640 1 -- 172.21.15.78:0/3489015110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f674c156f40 msgr2=0x7f674c15f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:25.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.606+0000 7f67508d3640 1 --2- 172.21.15.78:0/3489015110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f674c156f40 0x7f674c15f570 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f674400b9a0 tx=0x7f674400be60 comp rx=0 tx=0).stop 2024-09-17T03:10:25.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.606+0000 7f67508d3640 1 -- 172.21.15.78:0/3489015110 shutdown_connections 2024-09-17T03:10:25.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.606+0000 7f67508d3640 1 --2- 172.21.15.78:0/3489015110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f674c156f40 0x7f674c15f570 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:25.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.606+0000 7f67508d3640 1 --2- 172.21.15.78:0/3489015110 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f674c0cecf0 0x7f674c1554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:25.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.607+0000 7f67508d3640 1 --2- 172.21.15.78:0/3489015110 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f672c078bc0 0x7f672c07b0d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:25.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.607+0000 7f67508d3640 1 --2- 172.21.15.78:0/3489015110 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f674c0cd3a0 0x7f674c1f7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:25.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.607+0000 7f67508d3640 1 -- 172.21.15.78:0/3489015110 >> 172.21.15.78:0/3489015110 conn(0x7f674c06d550 msgr2=0x7f674c0d1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:25.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.607+0000 7f67508d3640 1 -- 172.21.15.78:0/3489015110 shutdown_connections 2024-09-17T03:10:25.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.607+0000 7f67508d3640 1 -- 172.21.15.78:0/3489015110 wait complete. 2024-09-17T03:10:25.633 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:10:25.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.754+0000 7f80a1969640 1 -- 172.21.15.78:0/4003011552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f809c0702f0 msgr2=0x7f809c06ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:25.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.754+0000 7f80a1969640 1 --2- 172.21.15.78:0/4003011552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f809c0702f0 0x7f809c06ddf0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8090005fd0 tx=0x7f809002a540 comp rx=0 tx=0).stop 2024-09-17T03:10:25.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.754+0000 7f80a1969640 1 -- 172.21.15.78:0/4003011552 shutdown_connections 2024-09-17T03:10:25.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.754+0000 7f80a1969640 1 --2- 172.21.15.78:0/4003011552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f809c0702f0 0x7f809c06ddf0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:25.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.754+0000 7f80a1969640 1 --2- 172.21.15.78:0/4003011552 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f809c15fc00 0x7f809c06fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:25.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.754+0000 7f80a1969640 1 -- 172.21.15.78:0/4003011552 >> 172.21.15.78:0/4003011552 conn(0x7f809c0d1210 msgr2=0x7f809c073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:25.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.754+0000 7f80a1969640 1 -- 172.21.15.78:0/4003011552 shutdown_connections 2024-09-17T03:10:25.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.754+0000 7f80a1969640 1 -- 172.21.15.78:0/4003011552 wait complete. 2024-09-17T03:10:25.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.756+0000 7f80a1969640 1 Processor -- start 2024-09-17T03:10:25.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.756+0000 7f80a1969640 1 -- start start 2024-09-17T03:10:25.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.757+0000 7f80a1969640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f809c06e330 0x7f809c1f7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:25.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.757+0000 7f80a1969640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f809c0702f0 0x7f809c15af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:25.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.757+0000 7f80a1969640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f809c15fc00 0x7f809c155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:25.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.757+0000 7f80a1969640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f809c15c3c0 con 0x7f809c15fc00 2024-09-17T03:10:25.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.757+0000 7f80a1969640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f809c15c240 con 0x7f809c0702f0 2024-09-17T03:10:25.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.757+0000 7f80a1969640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f809c15c540 con 0x7f809c06e330 2024-09-17T03:10:25.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.757+0000 7f809b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f809c15fc00 0x7f809c155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:25.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.757+0000 7f809b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f809c15fc00 0x7f809c155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55252/0 (socket says 172.21.15.78:55252) 2024-09-17T03:10:25.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.757+0000 7f809b7fe640 1 -- 172.21.15.78:0/355022369 learned_addr learned my addr 172.21.15.78:0/355022369 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:25.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.757+0000 7f809a7fc640 1 --2- 172.21.15.78:0/355022369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f809c0702f0 0x7f809c15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:25.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.757+0000 7f809affd640 1 --2- 172.21.15.78:0/355022369 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f809c06e330 0x7f809c1f7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:25.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.758+0000 7f809b7fe640 1 -- 172.21.15.78:0/355022369 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f809c06e330 msgr2=0x7f809c1f7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:25.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.758+0000 7f809b7fe640 1 --2- 172.21.15.78:0/355022369 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f809c06e330 0x7f809c1f7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:25.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.758+0000 7f809b7fe640 1 -- 172.21.15.78:0/355022369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f809c0702f0 msgr2=0x7f809c15af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:25.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.758+0000 7f809b7fe640 1 --2- 172.21.15.78:0/355022369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f809c0702f0 0x7f809c15af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:25.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.758+0000 7f809b7fe640 1 -- 172.21.15.78:0/355022369 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809c144910 con 0x7f809c15fc00 2024-09-17T03:10:25.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.758+0000 7f809a7fc640 1 --2- 172.21.15.78:0/355022369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f809c0702f0 0x7f809c15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:25.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.758+0000 7f809b7fe640 1 --2- 172.21.15.78:0/355022369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f809c15fc00 0x7f809c155290 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f809400c760 tx=0x7f809400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:25.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.758+0000 7f8083fff640 1 -- 172.21.15.78:0/355022369 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8094003b70 con 0x7f809c15fc00 2024-09-17T03:10:25.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.758+0000 7f80a1969640 1 -- 172.21.15.78:0/355022369 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809c1f3690 con 0x7f809c15fc00 2024-09-17T03:10:25.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.758+0000 7f8083fff640 1 -- 172.21.15.78:0/355022369 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8094003d10 con 0x7f809c15fc00 2024-09-17T03:10:25.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.758+0000 7f8083fff640 1 -- 172.21.15.78:0/355022369 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80940052d0 con 0x7f809c15fc00 2024-09-17T03:10:25.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.758+0000 7f80a1969640 1 -- 172.21.15.78:0/355022369 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f809c1f3bc0 con 0x7f809c15fc00 2024-09-17T03:10:25.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.759+0000 7f80a1969640 1 -- 172.21.15.78:0/355022369 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f809c06ddf0 con 0x7f809c15fc00 2024-09-17T03:10:25.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.760+0000 7f8083fff640 1 -- 172.21.15.78:0/355022369 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8094005470 con 0x7f809c15fc00 2024-09-17T03:10:25.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.761+0000 7f8083fff640 1 --2- 172.21.15.78:0/355022369 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8088078b90 0x7f808807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:25.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.761+0000 7f8083fff640 1 -- 172.21.15.78:0/355022369 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5609+0+0 (secure 0 0 0) 0x7f809409ab40 con 0x7f809c15fc00 2024-09-17T03:10:25.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.761+0000 7f809affd640 1 --2- 172.21.15.78:0/355022369 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8088078b90 0x7f808807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:25.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.761+0000 7f809affd640 1 --2- 172.21.15.78:0/355022369 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8088078b90 0x7f808807b0a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f808c005fd0 tx=0x7f808c005850 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:25.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.766+0000 7f8083fff640 1 -- 172.21.15.78:0/355022369 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f809c144910 con 0x7f809c15fc00 2024-09-17T03:10:25.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:25.981+0000 7f80a1969640 1 -- 172.21.15.78:0/355022369 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f809c06fb90 con 0x7f809c15fc00 2024-09-17T03:10:26.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.605+0000 7f8083fff640 1 -- 172.21.15.78:0/355022369 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v26) ==== 172+0+0 (secure 0 0 0) 0x7f809c06e740 con 0x7f809c15fc00 2024-09-17T03:10:26.605 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 6 and data pool 7 2024-09-17T03:10:26.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.609+0000 7f80a1969640 1 -- 172.21.15.78:0/355022369 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8088078b90 msgr2=0x7f808807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:26.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.609+0000 7f80a1969640 1 --2- 172.21.15.78:0/355022369 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8088078b90 0x7f808807b0a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f808c005fd0 tx=0x7f808c005850 comp rx=0 tx=0).stop 2024-09-17T03:10:26.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.609+0000 7f80a1969640 1 -- 172.21.15.78:0/355022369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f809c15fc00 msgr2=0x7f809c155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:26.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.609+0000 7f80a1969640 1 --2- 172.21.15.78:0/355022369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f809c15fc00 0x7f809c155290 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f809400c760 tx=0x7f809400cb60 comp rx=0 tx=0).stop 2024-09-17T03:10:26.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.609+0000 7f80a1969640 1 -- 172.21.15.78:0/355022369 shutdown_connections 2024-09-17T03:10:26.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.609+0000 7f80a1969640 1 --2- 172.21.15.78:0/355022369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f809c15fc00 0x7f809c155290 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:26.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.609+0000 7f80a1969640 1 --2- 172.21.15.78:0/355022369 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8088078b90 0x7f808807b0a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:26.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.609+0000 7f80a1969640 1 --2- 172.21.15.78:0/355022369 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f809c0702f0 0x7f809c15af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:26.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.609+0000 7f80a1969640 1 --2- 172.21.15.78:0/355022369 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f809c06e330 0x7f809c1f7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:26.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.609+0000 7f80a1969640 1 -- 172.21.15.78:0/355022369 >> 172.21.15.78:0/355022369 conn(0x7f809c0d1210 msgr2=0x7f809c0b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:26.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.609+0000 7f80a1969640 1 -- 172.21.15.78:0/355022369 shutdown_connections 2024-09-17T03:10:26.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.609+0000 7f80a1969640 1 -- 172.21.15.78:0/355022369 wait complete. 2024-09-17T03:10:26.635 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:10:26.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.750+0000 7fee16e7e640 1 -- 172.21.15.78:0/729600066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee100caee0 msgr2=0x7fee1006ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:26.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.750+0000 7fee16e7e640 1 --2- 172.21.15.78:0/729600066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee100caee0 0x7fee1006ee90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fee10071270 tx=0x7fee0802b860 comp rx=0 tx=0).stop 2024-09-17T03:10:26.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.750+0000 7fee16e7e640 1 -- 172.21.15.78:0/729600066 shutdown_connections 2024-09-17T03:10:26.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.750+0000 7fee16e7e640 1 --2- 172.21.15.78:0/729600066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee100caee0 0x7fee1006ee90 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:26.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.750+0000 7fee16e7e640 1 --2- 172.21.15.78:0/729600066 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee1015bf20 0x7fee100ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:26.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.750+0000 7fee16e7e640 1 -- 172.21.15.78:0/729600066 >> 172.21.15.78:0/729600066 conn(0x7fee100b1cb0 msgr2=0x7fee100b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:26.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.750+0000 7fee16e7e640 1 -- 172.21.15.78:0/729600066 shutdown_connections 2024-09-17T03:10:26.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.750+0000 7fee16e7e640 1 -- 172.21.15.78:0/729600066 wait complete. 2024-09-17T03:10:26.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.752+0000 7fee16e7e640 1 Processor -- start 2024-09-17T03:10:26.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.752+0000 7fee16e7e640 1 -- start start 2024-09-17T03:10:26.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.753+0000 7fee16e7e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee100caee0 0x7fee101f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:26.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.753+0000 7fee16e7e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee100cfb00 0x7fee101f6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:26.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.753+0000 7fee16e7e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee1015bf20 0x7fee101f74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:26.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.753+0000 7fee16e7e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fee1015b310 con 0x7fee100cfb00 2024-09-17T03:10:26.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.753+0000 7fee16e7e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fee1015b190 con 0x7fee100caee0 2024-09-17T03:10:26.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.753+0000 7fee16e7e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fee100ccba0 con 0x7fee1015bf20 2024-09-17T03:10:26.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.753+0000 7fee0ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee100cfb00 0x7fee101f6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:26.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.753+0000 7fee0ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee100cfb00 0x7fee101f6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46762/0 (socket says 172.21.15.78:46762) 2024-09-17T03:10:26.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.753+0000 7fee0ffff640 1 -- 172.21.15.78:0/3185692653 learned_addr learned my addr 172.21.15.78:0/3185692653 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:26.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.753+0000 7fee14c1a640 1 --2- 172.21.15.78:0/3185692653 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee100caee0 0x7fee101f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:26.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.753+0000 7fee1541b640 1 --2- 172.21.15.78:0/3185692653 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee1015bf20 0x7fee101f74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:26.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.753+0000 7fee0ffff640 1 -- 172.21.15.78:0/3185692653 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee1015bf20 msgr2=0x7fee101f74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:26.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.753+0000 7fee0ffff640 1 --2- 172.21.15.78:0/3185692653 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee1015bf20 0x7fee101f74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:26.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.753+0000 7fee0ffff640 1 -- 172.21.15.78:0/3185692653 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee100caee0 msgr2=0x7fee101f0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:26.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.753+0000 7fee0ffff640 1 --2- 172.21.15.78:0/3185692653 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee100caee0 0x7fee101f0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:26.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.753+0000 7fee0ffff640 1 -- 172.21.15.78:0/3185692653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee100c6b40 con 0x7fee100cfb00 2024-09-17T03:10:26.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.754+0000 7fee0ffff640 1 --2- 172.21.15.78:0/3185692653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee100cfb00 0x7fee101f6f70 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fee0400ccb0 tx=0x7fee040075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:26.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.754+0000 7fee0d7fa640 1 -- 172.21.15.78:0/3185692653 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee04004b20 con 0x7fee100cfb00 2024-09-17T03:10:26.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.754+0000 7fee0d7fa640 1 -- 172.21.15.78:0/3185692653 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee04004db0 con 0x7fee100cfb00 2024-09-17T03:10:26.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.754+0000 7fee16e7e640 1 -- 172.21.15.78:0/3185692653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee100c6860 con 0x7fee100cfb00 2024-09-17T03:10:26.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.754+0000 7fee0d7fa640 1 -- 172.21.15.78:0/3185692653 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee04005280 con 0x7fee100cfb00 2024-09-17T03:10:26.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.754+0000 7fee16e7e640 1 -- 172.21.15.78:0/3185692653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee100c58c0 con 0x7fee100cfb00 2024-09-17T03:10:26.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.755+0000 7fee16e7e640 1 -- 172.21.15.78:0/3185692653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee1009ac30 con 0x7fee100cfb00 2024-09-17T03:10:26.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.756+0000 7fee0d7fa640 1 -- 172.21.15.78:0/3185692653 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fee04005420 con 0x7fee100cfb00 2024-09-17T03:10:26.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.756+0000 7fee0d7fa640 1 --2- 172.21.15.78:0/3185692653 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fedfc078b90 0x7fedfc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:26.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.756+0000 7fee0d7fa640 1 -- 172.21.15.78:0/3185692653 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fee0409b900 con 0x7fee100cfb00 2024-09-17T03:10:26.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.756+0000 7fee14c1a640 1 --2- 172.21.15.78:0/3185692653 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fedfc078b90 0x7fedfc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:26.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.757+0000 7fee14c1a640 1 --2- 172.21.15.78:0/3185692653 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fedfc078b90 0x7fedfc07b0a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fee00006fd0 tx=0x7fee00009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:26.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.761+0000 7fee0d7fa640 1 -- 172.21.15.78:0/3185692653 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fee04014070 con 0x7fee100cfb00 2024-09-17T03:10:26.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.936+0000 7fee16e7e640 1 -- 172.21.15.78:0/3185692653 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fee100cd130 con 0x7fee100cfb00 2024-09-17T03:10:26.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.937+0000 7fee0d7fa640 1 -- 172.21.15.78:0/3185692653 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16662 (secure 0 0 0) 0x7fee04063670 con 0x7fee100cfb00 2024-09-17T03:10:26.936 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:26.937 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":44,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:10:25.982230+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:10:23.600479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T03:10:24.925537+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:10:26.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.939+0000 7fee16e7e640 1 -- 172.21.15.78:0/3185692653 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fedfc078b90 msgr2=0x7fedfc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:26.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.940+0000 7fee16e7e640 1 --2- 172.21.15.78:0/3185692653 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fedfc078b90 0x7fedfc07b0a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fee00006fd0 tx=0x7fee00009060 comp rx=0 tx=0).stop 2024-09-17T03:10:26.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.940+0000 7fee16e7e640 1 -- 172.21.15.78:0/3185692653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee100cfb00 msgr2=0x7fee101f6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:26.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.940+0000 7fee16e7e640 1 --2- 172.21.15.78:0/3185692653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee100cfb00 0x7fee101f6f70 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fee0400ccb0 tx=0x7fee040075f0 comp rx=0 tx=0).stop 2024-09-17T03:10:26.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.940+0000 7fee16e7e640 1 -- 172.21.15.78:0/3185692653 shutdown_connections 2024-09-17T03:10:26.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.940+0000 7fee16e7e640 1 --2- 172.21.15.78:0/3185692653 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee1015bf20 0x7fee101f74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:26.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.940+0000 7fee16e7e640 1 --2- 172.21.15.78:0/3185692653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee100cfb00 0x7fee101f6f70 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:26.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.940+0000 7fee16e7e640 1 --2- 172.21.15.78:0/3185692653 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fedfc078b90 0x7fedfc07b0a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:26.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.940+0000 7fee16e7e640 1 --2- 172.21.15.78:0/3185692653 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee100caee0 0x7fee101f0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:26.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.940+0000 7fee16e7e640 1 -- 172.21.15.78:0/3185692653 >> 172.21.15.78:0/3185692653 conn(0x7fee100b1cb0 msgr2=0x7fee100ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:26.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.940+0000 7fee16e7e640 1 -- 172.21.15.78:0/3185692653 shutdown_connections 2024-09-17T03:10:26.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:26.940+0000 7fee16e7e640 1 -- 172.21.15.78:0/3185692653 wait complete. 2024-09-17T03:10:26.950 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:10:27.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.065+0000 7f8360fad640 1 -- 172.21.15.78:0/1934697636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f835c1570e0 msgr2=0x7f835c0d1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:27.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.065+0000 7f8360fad640 1 --2- 172.21.15.78:0/1934697636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f835c1570e0 0x7f835c0d1f20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f834c009830 tx=0x7f834c02a510 comp rx=0 tx=0).stop 2024-09-17T03:10:27.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.065+0000 7f8360fad640 1 -- 172.21.15.78:0/1934697636 shutdown_connections 2024-09-17T03:10:27.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.065+0000 7f8360fad640 1 --2- 172.21.15.78:0/1934697636 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f835c15d840 0x7f835c0b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:27.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.065+0000 7f8360fad640 1 --2- 172.21.15.78:0/1934697636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f835c1570e0 0x7f835c0d1f20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:27.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.065+0000 7f8360fad640 1 -- 172.21.15.78:0/1934697636 >> 172.21.15.78:0/1934697636 conn(0x7f835c06d550 msgr2=0x7f835c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:27.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.065+0000 7f8360fad640 1 -- 172.21.15.78:0/1934697636 shutdown_connections 2024-09-17T03:10:27.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.065+0000 7f8360fad640 1 -- 172.21.15.78:0/1934697636 wait complete. 2024-09-17T03:10:27.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.067+0000 7f8360fad640 1 Processor -- start 2024-09-17T03:10:27.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.067+0000 7f8360fad640 1 -- start start 2024-09-17T03:10:27.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.068+0000 7f8360fad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f835c0d2460 0x7f835c150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:27.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.068+0000 7f8360fad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f835c1570e0 0x7f835c0ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:27.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.068+0000 7f8360fad640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f835c15d840 0x7f835c14c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:27.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.068+0000 7f8360fad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f835c0b7d60 con 0x7f835c0d2460 2024-09-17T03:10:27.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.068+0000 7f8360fad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f835c0b7be0 con 0x7f835c1570e0 2024-09-17T03:10:27.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.068+0000 7f8360fad640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f835c0b7ee0 con 0x7f835c15d840 2024-09-17T03:10:27.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.068+0000 7f835a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f835c0d2460 0x7f835c150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:27.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.068+0000 7f835a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f835c0d2460 0x7f835c150810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46766/0 (socket says 172.21.15.78:46766) 2024-09-17T03:10:27.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.068+0000 7f835a59c640 1 -- 172.21.15.78:0/45686875 learned_addr learned my addr 172.21.15.78:0/45686875 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:27.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.068+0000 7f835ad9d640 1 --2- 172.21.15.78:0/45686875 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f835c15d840 0x7f835c14c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:27.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.068+0000 7f8351d9b640 1 --2- 172.21.15.78:0/45686875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f835c1570e0 0x7f835c0ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:27.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.069+0000 7f835a59c640 1 -- 172.21.15.78:0/45686875 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f835c15d840 msgr2=0x7f835c14c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:27.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.069+0000 7f835a59c640 1 --2- 172.21.15.78:0/45686875 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f835c15d840 0x7f835c14c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:27.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.069+0000 7f835a59c640 1 -- 172.21.15.78:0/45686875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f835c1570e0 msgr2=0x7f835c0ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:27.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.069+0000 7f835a59c640 1 --2- 172.21.15.78:0/45686875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f835c1570e0 0x7f835c0ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:27.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.069+0000 7f835a59c640 1 -- 172.21.15.78:0/45686875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835c14d3c0 con 0x7f835c0d2460 2024-09-17T03:10:27.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.069+0000 7f835a59c640 1 --2- 172.21.15.78:0/45686875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f835c0d2460 0x7f835c150810 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f834c009950 tx=0x7f834c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:27.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.069+0000 7f83537fe640 1 -- 172.21.15.78:0/45686875 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c005c90 con 0x7f835c0d2460 2024-09-17T03:10:27.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.069+0000 7f8360fad640 1 -- 172.21.15.78:0/45686875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f835c14d6a0 con 0x7f835c0d2460 2024-09-17T03:10:27.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.069+0000 7f83537fe640 1 -- 172.21.15.78:0/45686875 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f834c031e50 con 0x7f835c0d2460 2024-09-17T03:10:27.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.069+0000 7f83537fe640 1 -- 172.21.15.78:0/45686875 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f834c005260 con 0x7f835c0d2460 2024-09-17T03:10:27.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.069+0000 7f8360fad640 1 -- 172.21.15.78:0/45686875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f835c14dc60 con 0x7f835c0d2460 2024-09-17T03:10:27.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.070+0000 7f8360fad640 1 -- 172.21.15.78:0/45686875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f835c0d1f20 con 0x7f835c0d2460 2024-09-17T03:10:27.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.071+0000 7f83537fe640 1 -- 172.21.15.78:0/45686875 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f834c005400 con 0x7f835c0d2460 2024-09-17T03:10:27.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.071+0000 7f83537fe640 1 --2- 172.21.15.78:0/45686875 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f833c078bc0 0x7f833c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:27.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.071+0000 7f83537fe640 1 -- 172.21.15.78:0/45686875 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f834c0bbd70 con 0x7f835c0d2460 2024-09-17T03:10:27.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.071+0000 7f8351d9b640 1 --2- 172.21.15.78:0/45686875 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f833c078bc0 0x7f833c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:27.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.072+0000 7f8351d9b640 1 --2- 172.21.15.78:0/45686875 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f833c078bc0 0x7f833c07b0d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f835c1558e0 tx=0x7f8344009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:27.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.076+0000 7f83537fe640 1 -- 172.21.15.78:0/45686875 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f834c03f030 con 0x7f835c0d2460 2024-09-17T03:10:27.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.250+0000 7f8360fad640 1 -- 172.21.15.78:0/45686875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f835c15f1c0 con 0x7f835c0d2460 2024-09-17T03:10:27.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.251+0000 7f83537fe640 1 -- 172.21.15.78:0/45686875 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16662 (secure 0 0 0) 0x7f834c0841c0 con 0x7f835c0d2460 2024-09-17T03:10:27.250 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:27.251 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":44,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:10:25.982230+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:10:23.600479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T03:10:24.925537+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:10:27.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.253+0000 7f8360fad640 1 -- 172.21.15.78:0/45686875 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f833c078bc0 msgr2=0x7f833c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:27.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.253+0000 7f8360fad640 1 --2- 172.21.15.78:0/45686875 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f833c078bc0 0x7f833c07b0d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f835c1558e0 tx=0x7f8344009040 comp rx=0 tx=0).stop 2024-09-17T03:10:27.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.253+0000 7f8360fad640 1 -- 172.21.15.78:0/45686875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f835c0d2460 msgr2=0x7f835c150810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:27.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.253+0000 7f8360fad640 1 --2- 172.21.15.78:0/45686875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f835c0d2460 0x7f835c150810 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f834c009950 tx=0x7f834c033c20 comp rx=0 tx=0).stop 2024-09-17T03:10:27.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.254+0000 7f8360fad640 1 -- 172.21.15.78:0/45686875 shutdown_connections 2024-09-17T03:10:27.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.254+0000 7f8360fad640 1 --2- 172.21.15.78:0/45686875 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f835c15d840 0x7f835c14c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:27.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.254+0000 7f8360fad640 1 --2- 172.21.15.78:0/45686875 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f833c078bc0 0x7f833c07b0d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:27.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.254+0000 7f8360fad640 1 --2- 172.21.15.78:0/45686875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f835c1570e0 0x7f835c0ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:27.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.254+0000 7f8360fad640 1 --2- 172.21.15.78:0/45686875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f835c0d2460 0x7f835c150810 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:27.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.254+0000 7f8360fad640 1 -- 172.21.15.78:0/45686875 >> 172.21.15.78:0/45686875 conn(0x7f835c06d550 msgr2=0x7f835c0b6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:27.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.254+0000 7f8360fad640 1 -- 172.21.15.78:0/45686875 shutdown_connections 2024-09-17T03:10:27.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.254+0000 7f8360fad640 1 -- 172.21.15.78:0/45686875 wait complete. 2024-09-17T03:10:27.265 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:10:27.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.383+0000 7f8a648bd640 1 -- 172.21.15.78:0/2770625824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6015b8f0 msgr2=0x7f8a600cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:27.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.383+0000 7f8a648bd640 1 --2- 172.21.15.78:0/2770625824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6015b8f0 0x7f8a600cf130 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8a60075570 tx=0x7f8a5002a540 comp rx=0 tx=0).stop 2024-09-17T03:10:27.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.383+0000 7f8a648bd640 1 -- 172.21.15.78:0/2770625824 shutdown_connections 2024-09-17T03:10:27.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.383+0000 7f8a648bd640 1 --2- 172.21.15.78:0/2770625824 >> v2:172.21.15.193:3300/0 conn(0x7f8a600b0520 0x7f8a60071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:27.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.383+0000 7f8a648bd640 1 --2- 172.21.15.78:0/2770625824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6015b8f0 0x7f8a600cf130 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:27.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.383+0000 7f8a648bd640 1 -- 172.21.15.78:0/2770625824 >> 172.21.15.78:0/2770625824 conn(0x7f8a600cdcb0 msgr2=0x7f8a600ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:27.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.383+0000 7f8a648bd640 1 -- 172.21.15.78:0/2770625824 shutdown_connections 2024-09-17T03:10:27.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.383+0000 7f8a648bd640 1 -- 172.21.15.78:0/2770625824 wait complete. 2024-09-17T03:10:27.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.385+0000 7f8a648bd640 1 Processor -- start 2024-09-17T03:10:27.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.385+0000 7f8a648bd640 1 -- start start 2024-09-17T03:10:27.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.386+0000 7f8a648bd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8a600b0520 0x7f8a601e2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:27.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.386+0000 7f8a648bd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a600b2cb0 0x7f8a601e4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:27.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.386+0000 7f8a648bd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6015b8f0 0x7f8a6009e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:27.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.386+0000 7f8a648bd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8a600ae120 con 0x7f8a6015b8f0 2024-09-17T03:10:27.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.386+0000 7f8a648bd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8a600adfa0 con 0x7f8a600b2cb0 2024-09-17T03:10:27.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.386+0000 7f8a648bd640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8a600ae2a0 con 0x7f8a600b0520 2024-09-17T03:10:27.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.386+0000 7f8a5ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6015b8f0 0x7f8a6009e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:27.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.386+0000 7f8a5ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6015b8f0 0x7f8a6009e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46778/0 (socket says 172.21.15.78:46778) 2024-09-17T03:10:27.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.386+0000 7f8a5ed9d640 1 -- 172.21.15.78:0/605067881 learned_addr learned my addr 172.21.15.78:0/605067881 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:27.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.386+0000 7f8a5dd9b640 1 --2- 172.21.15.78:0/605067881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a600b2cb0 0x7f8a601e4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:27.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.386+0000 7f8a5e59c640 1 --2- 172.21.15.78:0/605067881 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8a600b0520 0x7f8a601e2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:27.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.387+0000 7f8a5ed9d640 1 -- 172.21.15.78:0/605067881 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8a600b0520 msgr2=0x7f8a601e2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:27.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.387+0000 7f8a5ed9d640 1 --2- 172.21.15.78:0/605067881 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8a600b0520 0x7f8a601e2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:27.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.387+0000 7f8a5ed9d640 1 -- 172.21.15.78:0/605067881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a600b2cb0 msgr2=0x7f8a601e4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:27.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.387+0000 7f8a5ed9d640 1 --2- 172.21.15.78:0/605067881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a600b2cb0 0x7f8a601e4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:27.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.387+0000 7f8a5ed9d640 1 -- 172.21.15.78:0/605067881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a601e52f0 con 0x7f8a6015b8f0 2024-09-17T03:10:27.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.387+0000 7f8a5ed9d640 1 --2- 172.21.15.78:0/605067881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6015b8f0 0x7f8a6009e330 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800b9c0 tx=0x7f8a5800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:27.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.387+0000 7f8a4effd640 1 -- 172.21.15.78:0/605067881 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a58019070 con 0x7f8a6015b8f0 2024-09-17T03:10:27.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.387+0000 7f8a4effd640 1 -- 172.21.15.78:0/605067881 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a5800cc90 con 0x7f8a6015b8f0 2024-09-17T03:10:27.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.387+0000 7f8a648bd640 1 -- 172.21.15.78:0/605067881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a6009d290 con 0x7f8a6015b8f0 2024-09-17T03:10:27.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.387+0000 7f8a4effd640 1 -- 172.21.15.78:0/605067881 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a580146a0 con 0x7f8a6015b8f0 2024-09-17T03:10:27.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.387+0000 7f8a648bd640 1 -- 172.21.15.78:0/605067881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a6009d850 con 0x7f8a6015b8f0 2024-09-17T03:10:27.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.388+0000 7f8a648bd640 1 -- 172.21.15.78:0/605067881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a60072400 con 0x7f8a6015b8f0 2024-09-17T03:10:27.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.389+0000 7f8a4effd640 1 -- 172.21.15.78:0/605067881 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8a5801d3f0 con 0x7f8a6015b8f0 2024-09-17T03:10:27.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.389+0000 7f8a4effd640 1 --2- 172.21.15.78:0/605067881 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8a40078bc0 0x7f8a4007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:27.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.389+0000 7f8a4effd640 1 -- 172.21.15.78:0/605067881 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f8a5809a8e0 con 0x7f8a6015b8f0 2024-09-17T03:10:27.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.390+0000 7f8a5e59c640 1 --2- 172.21.15.78:0/605067881 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8a40078bc0 0x7f8a4007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:27.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.390+0000 7f8a5e59c640 1 --2- 172.21.15.78:0/605067881 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8a40078bc0 0x7f8a4007b0d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8a50033000 tx=0x7f8a50004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.394+0000 7f8a4effd640 1 -- 172.21.15.78:0/605067881 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8a60072400 con 0x7f8a6015b8f0 2024-09-17T03:10:27.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:27.606+0000 7f8a648bd640 1 -- 172.21.15.78:0/605067881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f8a600ae7c0 con 0x7f8a6015b8f0 2024-09-17T03:10:28.583 INFO:tasks.ceph.mds.b.smithi193.stderr:2024-09-17T03:10:28.585+0000 7fe722784640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:10:28.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.607+0000 7f8a4effd640 1 -- 172.21.15.78:0/605067881 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v28) ==== 118+0+0 (secure 0 0 0) 0x7f8a580626d0 con 0x7f8a6015b8f0 2024-09-17T03:10:28.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.611+0000 7f8a648bd640 1 -- 172.21.15.78:0/605067881 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8a40078bc0 msgr2=0x7f8a4007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:28.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.611+0000 7f8a648bd640 1 --2- 172.21.15.78:0/605067881 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8a40078bc0 0x7f8a4007b0d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8a50033000 tx=0x7f8a50004730 comp rx=0 tx=0).stop 2024-09-17T03:10:28.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.611+0000 7f8a648bd640 1 -- 172.21.15.78:0/605067881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6015b8f0 msgr2=0x7f8a6009e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:28.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.611+0000 7f8a648bd640 1 --2- 172.21.15.78:0/605067881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6015b8f0 0x7f8a6009e330 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800b9c0 tx=0x7f8a5800be80 comp rx=0 tx=0).stop 2024-09-17T03:10:28.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.611+0000 7f8a648bd640 1 -- 172.21.15.78:0/605067881 shutdown_connections 2024-09-17T03:10:28.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.611+0000 7f8a648bd640 1 --2- 172.21.15.78:0/605067881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a6015b8f0 0x7f8a6009e330 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:28.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.611+0000 7f8a648bd640 1 --2- 172.21.15.78:0/605067881 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8a40078bc0 0x7f8a4007b0d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:28.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.611+0000 7f8a648bd640 1 --2- 172.21.15.78:0/605067881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8a600b2cb0 0x7f8a601e4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:28.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.611+0000 7f8a648bd640 1 --2- 172.21.15.78:0/605067881 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8a600b0520 0x7f8a601e2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:28.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.611+0000 7f8a648bd640 1 -- 172.21.15.78:0/605067881 >> 172.21.15.78:0/605067881 conn(0x7f8a600cdcb0 msgr2=0x7f8a600cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:28.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.611+0000 7f8a648bd640 1 -- 172.21.15.78:0/605067881 shutdown_connections 2024-09-17T03:10:28.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.611+0000 7f8a648bd640 1 -- 172.21.15.78:0/605067881 wait complete. 2024-09-17T03:10:28.623 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:10:28.624 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:10:28.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.746+0000 7f1a168a9640 1 -- 172.21.15.78:0/336429183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19fc003a00 msgr2=0x7f19fc003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:28.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.746+0000 7f1a168a9640 1 --2- 172.21.15.78:0/336429183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19fc003a00 0x7f19fc003e50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1a0000c4a0 tx=0x7f19fc005830 comp rx=0 tx=0).stop 2024-09-17T03:10:28.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.747+0000 7f1a168a9640 1 -- 172.21.15.78:0/336429183 shutdown_connections 2024-09-17T03:10:28.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.747+0000 7f1a168a9640 1 --2- 172.21.15.78:0/336429183 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19fc003a00 0x7f19fc003e50 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:28.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.747+0000 7f1a168a9640 1 -- 172.21.15.78:0/336429183 >> 172.21.15.78:0/336429183 conn(0x7f1a100b3f10 msgr2=0x7f1a100b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:28.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.747+0000 7f1a168a9640 1 -- 172.21.15.78:0/336429183 shutdown_connections 2024-09-17T03:10:28.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.747+0000 7f1a168a9640 1 -- 172.21.15.78:0/336429183 wait complete. 2024-09-17T03:10:28.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.748+0000 7f1a168a9640 1 Processor -- start 2024-09-17T03:10:28.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.748+0000 7f1a168a9640 1 -- start start 2024-09-17T03:10:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a168a9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19fc003a00 0x7f1a101583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a168a9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a10155a10 0x7f1a10156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a168a9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a10157050 0x7f1a10157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a168a9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1a100b5210 con 0x7f1a10157050 2024-09-17T03:10:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a168a9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1a100d2a90 con 0x7f1a10155a10 2024-09-17T03:10:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a168a9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f1a100b5390 con 0x7f19fc003a00 2024-09-17T03:10:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a14e46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a10157050 0x7f1a10157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a14e46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a10157050 0x7f1a10157460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46802/0 (socket says 172.21.15.78:46802) 2024-09-17T03:10:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a14e46640 1 -- 172.21.15.78:0/3662138550 learned_addr learned my addr 172.21.15.78:0/3662138550 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a0ffff640 1 --2- 172.21.15.78:0/3662138550 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19fc003a00 0x7f1a101583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a07fff640 1 --2- 172.21.15.78:0/3662138550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a10155a10 0x7f1a10156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a14e46640 1 -- 172.21.15.78:0/3662138550 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19fc003a00 msgr2=0x7f1a101583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a14e46640 1 --2- 172.21.15.78:0/3662138550 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19fc003a00 0x7f1a101583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a14e46640 1 -- 172.21.15.78:0/3662138550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a10155a10 msgr2=0x7f1a10156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a14e46640 1 --2- 172.21.15.78:0/3662138550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a10155a10 0x7f1a10156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a14e46640 1 -- 172.21.15.78:0/3662138550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a101579a0 con 0x7f1a10157050 2024-09-17T03:10:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a07fff640 1 --2- 172.21.15.78:0/3662138550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a10155a10 0x7f1a10156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a0ffff640 1 --2- 172.21.15.78:0/3662138550 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19fc003a00 0x7f1a101583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a14e46640 1 --2- 172.21.15.78:0/3662138550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a10157050 0x7f1a10157460 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1a08005fd0 tx=0x7f1a08009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:28.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a0d7fa640 1 -- 172.21.15.78:0/3662138550 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a08004b20 con 0x7f1a10157050 2024-09-17T03:10:28.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a0d7fa640 1 -- 172.21.15.78:0/3662138550 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a08004db0 con 0x7f1a10157050 2024-09-17T03:10:28.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a168a9640 1 -- 172.21.15.78:0/3662138550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a10156350 con 0x7f1a10157050 2024-09-17T03:10:28.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.750+0000 7f1a0d7fa640 1 -- 172.21.15.78:0/3662138550 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a0800fa50 con 0x7f1a10157050 2024-09-17T03:10:28.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.751+0000 7f1a168a9640 1 -- 172.21.15.78:0/3662138550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a1015f330 con 0x7f1a10157050 2024-09-17T03:10:28.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.752+0000 7f1a168a9640 1 -- 172.21.15.78:0/3662138550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a100cf680 con 0x7f1a10157050 2024-09-17T03:10:28.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.752+0000 7f1a0d7fa640 1 -- 172.21.15.78:0/3662138550 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1a0801b020 con 0x7f1a10157050 2024-09-17T03:10:28.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.753+0000 7f1a0d7fa640 1 --2- 172.21.15.78:0/3662138550 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f19f0078bc0 0x7f19f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:28.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.753+0000 7f1a0d7fa640 1 -- 172.21.15.78:0/3662138550 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f1a0809adf0 con 0x7f1a10157050 2024-09-17T03:10:28.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.753+0000 7f1a0ffff640 1 --2- 172.21.15.78:0/3662138550 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f19f0078bc0 0x7f19f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:28.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.754+0000 7f1a0ffff640 1 --2- 172.21.15.78:0/3662138550 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f19f0078bc0 0x7f19f007b0d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1a00033000 tx=0x7f1a0002d070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:28.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.758+0000 7f1a0d7fa640 1 -- 172.21.15.78:0/3662138550 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1a080632c0 con 0x7f1a10157050 2024-09-17T03:10:28.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:28.969+0000 7f1a168a9640 1 -- 172.21.15.78:0/3662138550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f1a100cd5e0 con 0x7f1a10157050 2024-09-17T03:10:29.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.630+0000 7f1a0d7fa640 1 -- 172.21.15.78:0/3662138550 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v29) ==== 122+0+0 (secure 0 0 0) 0x7f1a08062bc0 con 0x7f1a10157050 2024-09-17T03:10:29.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.633+0000 7f1a168a9640 1 -- 172.21.15.78:0/3662138550 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f19f0078bc0 msgr2=0x7f19f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:29.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.633+0000 7f1a168a9640 1 --2- 172.21.15.78:0/3662138550 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f19f0078bc0 0x7f19f007b0d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1a00033000 tx=0x7f1a0002d070 comp rx=0 tx=0).stop 2024-09-17T03:10:29.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.633+0000 7f1a168a9640 1 -- 172.21.15.78:0/3662138550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a10157050 msgr2=0x7f1a10157460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:29.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.633+0000 7f1a168a9640 1 --2- 172.21.15.78:0/3662138550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a10157050 0x7f1a10157460 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1a08005fd0 tx=0x7f1a08009b00 comp rx=0 tx=0).stop 2024-09-17T03:10:29.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.633+0000 7f1a168a9640 1 -- 172.21.15.78:0/3662138550 shutdown_connections 2024-09-17T03:10:29.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.633+0000 7f1a168a9640 1 --2- 172.21.15.78:0/3662138550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a10157050 0x7f1a10157460 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:29.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.633+0000 7f1a168a9640 1 --2- 172.21.15.78:0/3662138550 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f19f0078bc0 0x7f19f007b0d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:29.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.633+0000 7f1a168a9640 1 --2- 172.21.15.78:0/3662138550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a10155a10 0x7f1a10156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:29.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.633+0000 7f1a168a9640 1 --2- 172.21.15.78:0/3662138550 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19fc003a00 0x7f1a101583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:29.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.633+0000 7f1a168a9640 1 -- 172.21.15.78:0/3662138550 >> 172.21.15.78:0/3662138550 conn(0x7f1a100b3f10 msgr2=0x7f1a10068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:29.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.633+0000 7f1a168a9640 1 -- 172.21.15.78:0/3662138550 shutdown_connections 2024-09-17T03:10:29.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.633+0000 7f1a168a9640 1 -- 172.21.15.78:0/3662138550 wait complete. 2024-09-17T03:10:29.645 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:10:29.646 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:10:29.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.763+0000 7f3040e94640 1 -- 172.21.15.78:0/879696464 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f303c0d2ed0 msgr2=0x7f303c0d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:29.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.763+0000 7f3040e94640 1 --2- 172.21.15.78:0/879696464 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f303c0d2ed0 0x7f303c0d1a80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f302c009820 tx=0x7f302c02a510 comp rx=0 tx=0).stop 2024-09-17T03:10:29.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.763+0000 7f3040e94640 1 -- 172.21.15.78:0/879696464 shutdown_connections 2024-09-17T03:10:29.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.763+0000 7f3040e94640 1 --2- 172.21.15.78:0/879696464 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f303c0cf7a0 0x7f303c1626e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:29.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.763+0000 7f3040e94640 1 --2- 172.21.15.78:0/879696464 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f303c0d2ed0 0x7f303c0d1a80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:29.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.764+0000 7f3040e94640 1 -- 172.21.15.78:0/879696464 >> 172.21.15.78:0/879696464 conn(0x7f303c08bfc0 msgr2=0x7f303c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:29.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.764+0000 7f3040e94640 1 -- 172.21.15.78:0/879696464 shutdown_connections 2024-09-17T03:10:29.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.764+0000 7f3040e94640 1 -- 172.21.15.78:0/879696464 wait complete. 2024-09-17T03:10:29.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.766+0000 7f3040e94640 1 Processor -- start 2024-09-17T03:10:29.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.766+0000 7f3040e94640 1 -- start start 2024-09-17T03:10:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.767+0000 7f3040e94640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f303c0b9b70 0x7f303c151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.767+0000 7f3040e94640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f303c0cf7a0 0x7f303c0cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.767+0000 7f3040e94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c0d2ed0 0x7f303c0cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.767+0000 7f3040e94640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f303c162da0 con 0x7f303c0d2ed0 2024-09-17T03:10:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.767+0000 7f3040e94640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f303c162c20 con 0x7f303c0cf7a0 2024-09-17T03:10:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.767+0000 7f3040e94640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f303c162f20 con 0x7f303c0b9b70 2024-09-17T03:10:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.767+0000 7f303ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c0d2ed0 0x7f303c0cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.767+0000 7f303ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c0d2ed0 0x7f303c0cbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46814/0 (socket says 172.21.15.78:46814) 2024-09-17T03:10:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.767+0000 7f303ad9d640 1 -- 172.21.15.78:0/674532235 learned_addr learned my addr 172.21.15.78:0/674532235 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.767+0000 7f3031d9b640 1 --2- 172.21.15.78:0/674532235 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f303c0cf7a0 0x7f303c0cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:29.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.767+0000 7f303a59c640 1 --2- 172.21.15.78:0/674532235 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f303c0b9b70 0x7f303c151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:29.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.768+0000 7f303ad9d640 1 -- 172.21.15.78:0/674532235 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f303c0b9b70 msgr2=0x7f303c151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:29.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.768+0000 7f303ad9d640 1 --2- 172.21.15.78:0/674532235 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f303c0b9b70 0x7f303c151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:29.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.768+0000 7f303ad9d640 1 -- 172.21.15.78:0/674532235 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f303c0cf7a0 msgr2=0x7f303c0cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:29.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.768+0000 7f303ad9d640 1 --2- 172.21.15.78:0/674532235 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f303c0cf7a0 0x7f303c0cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:29.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.768+0000 7f303ad9d640 1 -- 172.21.15.78:0/674532235 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f303c1f70e0 con 0x7f303c0d2ed0 2024-09-17T03:10:29.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.768+0000 7f303ad9d640 1 --2- 172.21.15.78:0/674532235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c0d2ed0 0x7f303c0cbfd0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f303400ec20 tx=0x7f303400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:29.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.768+0000 7f30337fe640 1 -- 172.21.15.78:0/674532235 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3034010630 con 0x7f303c0d2ed0 2024-09-17T03:10:29.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.768+0000 7f30337fe640 1 -- 172.21.15.78:0/674532235 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30340107d0 con 0x7f303c0d2ed0 2024-09-17T03:10:29.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.768+0000 7f30337fe640 1 -- 172.21.15.78:0/674532235 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3034010c20 con 0x7f303c0d2ed0 2024-09-17T03:10:29.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.768+0000 7f3040e94640 1 -- 172.21.15.78:0/674532235 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f303c0cb4f0 con 0x7f303c0d2ed0 2024-09-17T03:10:29.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.768+0000 7f3040e94640 1 -- 172.21.15.78:0/674532235 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f303c0cd060 con 0x7f303c0d2ed0 2024-09-17T03:10:29.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.769+0000 7f3040e94640 1 -- 172.21.15.78:0/674532235 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f303c1f6e50 con 0x7f303c0d2ed0 2024-09-17T03:10:29.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.770+0000 7f30337fe640 1 -- 172.21.15.78:0/674532235 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3034021440 con 0x7f303c0d2ed0 2024-09-17T03:10:29.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.770+0000 7f30337fe640 1 --2- 172.21.15.78:0/674532235 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f301c078bc0 0x7f301c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:29.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.770+0000 7f30337fe640 1 -- 172.21.15.78:0/674532235 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f303409ba90 con 0x7f303c0d2ed0 2024-09-17T03:10:29.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.770+0000 7f303a59c640 1 --2- 172.21.15.78:0/674532235 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f301c078bc0 0x7f301c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:29.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.771+0000 7f303a59c640 1 --2- 172.21.15.78:0/674532235 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f301c078bc0 0x7f301c07b0d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f302c034000 tx=0x7f302c004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:29.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.775+0000 7f30337fe640 1 -- 172.21.15.78:0/674532235 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3034063880 con 0x7f303c0d2ed0 2024-09-17T03:10:29.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.986+0000 7f3040e94640 1 -- 172.21.15.78:0/674532235 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f303c0cd2c0 con 0x7f303c0d2ed0 2024-09-17T03:10:29.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.986+0000 7f30337fe640 1 -- 172.21.15.78:0/674532235 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5229 (secure 0 0 0) 0x7f30340682b0 con 0x7f303c0d2ed0 2024-09-17T03:10:29.985 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:29.985 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":29,"btime":"2024-09-17T03:10:29:624541+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/2973955781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2973955781},{"type":"v1","addr":"172.21.15.78:6834","nonce":2973955781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3629327943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3629327943},{"type":"v1","addr":"172.21.15.78:6835","nonce":3629327943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5039,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/3209848332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":3209848332},{"type":"v1","addr":"172.21.15.193:6837","nonce":3209848332}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:10:25.982190+0000","modified":"2024-09-17T03:10:28.971132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5565":{"gid":5565,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6836/1788096053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1788096053},{"type":"v1","addr":"172.21.15.193:6836","nonce":1788096053}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5565,"qdb_cluster":[5565]},"id":3}]} 2024-09-17T03:10:29.985 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 29 2024-09-17T03:10:29.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.988+0000 7f3040e94640 1 -- 172.21.15.78:0/674532235 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f301c078bc0 msgr2=0x7f301c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:29.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.988+0000 7f3040e94640 1 --2- 172.21.15.78:0/674532235 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f301c078bc0 0x7f301c07b0d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f302c034000 tx=0x7f302c004730 comp rx=0 tx=0).stop 2024-09-17T03:10:29.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.988+0000 7f3040e94640 1 -- 172.21.15.78:0/674532235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c0d2ed0 msgr2=0x7f303c0cbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:29.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.988+0000 7f3040e94640 1 --2- 172.21.15.78:0/674532235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c0d2ed0 0x7f303c0cbfd0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f303400ec20 tx=0x7f303400c6a0 comp rx=0 tx=0).stop 2024-09-17T03:10:29.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.988+0000 7f3040e94640 1 -- 172.21.15.78:0/674532235 shutdown_connections 2024-09-17T03:10:29.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.988+0000 7f3040e94640 1 --2- 172.21.15.78:0/674532235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f303c0d2ed0 0x7f303c0cbfd0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:29.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.988+0000 7f3040e94640 1 --2- 172.21.15.78:0/674532235 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f301c078bc0 0x7f301c07b0d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:29.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.988+0000 7f3040e94640 1 --2- 172.21.15.78:0/674532235 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f303c0cf7a0 0x7f303c0cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:29.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.988+0000 7f3040e94640 1 --2- 172.21.15.78:0/674532235 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f303c0b9b70 0x7f303c151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:29.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.988+0000 7f3040e94640 1 -- 172.21.15.78:0/674532235 >> 172.21.15.78:0/674532235 conn(0x7f303c08bfc0 msgr2=0x7f303c0d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:29.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.988+0000 7f3040e94640 1 -- 172.21.15.78:0/674532235 shutdown_connections 2024-09-17T03:10:29.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:29.988+0000 7f3040e94640 1 -- 172.21.15.78:0/674532235 wait complete. 2024-09-17T03:10:29.998 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:10:30.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.112+0000 7fb0370b2640 1 -- 172.21.15.78:0/2577032111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0300d08e0 msgr2=0x7fb03015f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:30.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.112+0000 7fb0370b2640 1 --2- 172.21.15.78:0/2577032111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0300d08e0 0x7fb03015f0a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb018009830 tx=0x7fb01802a480 comp rx=0 tx=0).stop 2024-09-17T03:10:30.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.112+0000 7fb0370b2640 1 -- 172.21.15.78:0/2577032111 shutdown_connections 2024-09-17T03:10:30.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.112+0000 7fb0370b2640 1 --2- 172.21.15.78:0/2577032111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0300d08e0 0x7fb03015f0a0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:30.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.112+0000 7fb0370b2640 1 -- 172.21.15.78:0/2577032111 >> 172.21.15.78:0/2577032111 conn(0x7fb03006d4f0 msgr2=0x7fb030071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:30.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.112+0000 7fb0370b2640 1 -- 172.21.15.78:0/2577032111 shutdown_connections 2024-09-17T03:10:30.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.112+0000 7fb0370b2640 1 -- 172.21.15.78:0/2577032111 wait complete. 2024-09-17T03:10:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.113+0000 7fb0370b2640 1 Processor -- start 2024-09-17T03:10:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.114+0000 7fb0370b2640 1 -- start start 2024-09-17T03:10:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.115+0000 7fb0370b2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0300cf050 0x7fb03015da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.115+0000 7fb0370b2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb030147a10 0x7fb030147e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.115+0000 7fb0370b2640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb030157570 0x7fb030157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.115+0000 7fb0370b2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb030160440 con 0x7fb030147a10 2024-09-17T03:10:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.115+0000 7fb0370b2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb0301602c0 con 0x7fb0300cf050 2024-09-17T03:10:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.115+0000 7fb0370b2640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb0301605c0 con 0x7fb030157570 2024-09-17T03:10:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.115+0000 7fb02ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb030147a10 0x7fb030147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.115+0000 7fb02ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb030147a10 0x7fb030147e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46832/0 (socket says 172.21.15.78:46832) 2024-09-17T03:10:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.115+0000 7fb02ffff640 1 -- 172.21.15.78:0/2635913972 learned_addr learned my addr 172.21.15.78:0/2635913972 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.115+0000 7fb034e4e640 1 --2- 172.21.15.78:0/2635913972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0300cf050 0x7fb03015da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.115+0000 7fb03564f640 1 --2- 172.21.15.78:0/2635913972 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb030157570 0x7fb030157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.115+0000 7fb02ffff640 1 -- 172.21.15.78:0/2635913972 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb030157570 msgr2=0x7fb030157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.115+0000 7fb02ffff640 1 --2- 172.21.15.78:0/2635913972 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb030157570 0x7fb030157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.115+0000 7fb02ffff640 1 -- 172.21.15.78:0/2635913972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0300cf050 msgr2=0x7fb03015da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.115+0000 7fb02ffff640 1 --2- 172.21.15.78:0/2635913972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0300cf050 0x7fb03015da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.115+0000 7fb02ffff640 1 -- 172.21.15.78:0/2635913972 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb030157ec0 con 0x7fb030147a10 2024-09-17T03:10:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.115+0000 7fb03564f640 1 --2- 172.21.15.78:0/2635913972 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb030157570 0x7fb030157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.116+0000 7fb02ffff640 1 --2- 172.21.15.78:0/2635913972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb030147a10 0x7fb030147e20 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb02000cb40 tx=0x7fb02000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.116+0000 7fb02d7fa640 1 -- 172.21.15.78:0/2635913972 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020016020 con 0x7fb030147a10 2024-09-17T03:10:30.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.116+0000 7fb02d7fa640 1 -- 172.21.15.78:0/2635913972 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb02000adb0 con 0x7fb030147a10 2024-09-17T03:10:30.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.116+0000 7fb02d7fa640 1 -- 172.21.15.78:0/2635913972 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb020012680 con 0x7fb030147a10 2024-09-17T03:10:30.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.116+0000 7fb0370b2640 1 -- 172.21.15.78:0/2635913972 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb030159870 con 0x7fb030147a10 2024-09-17T03:10:30.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.116+0000 7fb0370b2640 1 -- 172.21.15.78:0/2635913972 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb030159e30 con 0x7fb030147a10 2024-09-17T03:10:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.117+0000 7fb0370b2640 1 -- 172.21.15.78:0/2635913972 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0301484f0 con 0x7fb030147a10 2024-09-17T03:10:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.118+0000 7fb02d7fa640 1 -- 172.21.15.78:0/2635913972 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb020019020 con 0x7fb030147a10 2024-09-17T03:10:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.118+0000 7fb02d7fa640 1 --2- 172.21.15.78:0/2635913972 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb010078bc0 0x7fb01007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.118+0000 7fb02d7fa640 1 -- 172.21.15.78:0/2635913972 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fb02009b230 con 0x7fb030147a10 2024-09-17T03:10:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.118+0000 7fb034e4e640 1 --2- 172.21.15.78:0/2635913972 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb010078bc0 0x7fb01007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.119+0000 7fb034e4e640 1 --2- 172.21.15.78:0/2635913972 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb010078bc0 0x7fb01007b0d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb028006fd0 tx=0x7fb028009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:30.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.123+0000 7fb02d7fa640 1 -- 172.21.15.78:0/2635913972 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb020020020 con 0x7fb030147a10 2024-09-17T03:10:30.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.296+0000 7fb0370b2640 1 -- 172.21.15.78:0/2635913972 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb030161cc0 con 0x7fb030147a10 2024-09-17T03:10:30.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.297+0000 7fb02d7fa640 1 -- 172.21.15.78:0/2635913972 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16649 (secure 0 0 0) 0x7fb030157ec0 con 0x7fb030147a10 2024-09-17T03:10:30.296 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:30.296 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":45,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:10:27.618489+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:10:23.600479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T03:10:24.925537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:10:30.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.299+0000 7fb0370b2640 1 -- 172.21.15.78:0/2635913972 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb010078bc0 msgr2=0x7fb01007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:30.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.299+0000 7fb0370b2640 1 --2- 172.21.15.78:0/2635913972 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb010078bc0 0x7fb01007b0d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb028006fd0 tx=0x7fb028009060 comp rx=0 tx=0).stop 2024-09-17T03:10:30.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.299+0000 7fb0370b2640 1 -- 172.21.15.78:0/2635913972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb030147a10 msgr2=0x7fb030147e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:30.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.299+0000 7fb0370b2640 1 --2- 172.21.15.78:0/2635913972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb030147a10 0x7fb030147e20 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb02000cb40 tx=0x7fb02000a060 comp rx=0 tx=0).stop 2024-09-17T03:10:30.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.299+0000 7fb0370b2640 1 -- 172.21.15.78:0/2635913972 shutdown_connections 2024-09-17T03:10:30.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.299+0000 7fb0370b2640 1 --2- 172.21.15.78:0/2635913972 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb030157570 0x7fb030157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:30.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.299+0000 7fb0370b2640 1 --2- 172.21.15.78:0/2635913972 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb030147a10 0x7fb030147e20 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:30.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.299+0000 7fb0370b2640 1 --2- 172.21.15.78:0/2635913972 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb010078bc0 0x7fb01007b0d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:30.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.299+0000 7fb0370b2640 1 --2- 172.21.15.78:0/2635913972 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0300cf050 0x7fb03015da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:30.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.299+0000 7fb0370b2640 1 -- 172.21.15.78:0/2635913972 >> 172.21.15.78:0/2635913972 conn(0x7fb03006d4f0 msgr2=0x7fb030158650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:30.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.299+0000 7fb0370b2640 1 -- 172.21.15.78:0/2635913972 shutdown_connections 2024-09-17T03:10:30.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.299+0000 7fb0370b2640 1 -- 172.21.15.78:0/2635913972 wait complete. 2024-09-17T03:10:30.310 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:10:30.310 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:10:30.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.423+0000 7f34031c3640 1 -- 172.21.15.78:0/3768064749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33fc06fec0 msgr2=0x7f33fc0702d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:30.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.423+0000 7f34031c3640 1 --2- 172.21.15.78:0/3768064749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33fc06fec0 0x7f33fc0702d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f33fc15f2e0 tx=0x7f33ec02a560 comp rx=0 tx=0).stop 2024-09-17T03:10:30.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.423+0000 7f34031c3640 1 -- 172.21.15.78:0/3768064749 shutdown_connections 2024-09-17T03:10:30.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.423+0000 7f34031c3640 1 --2- 172.21.15.78:0/3768064749 >> v2:172.21.15.193:3300/0 conn(0x7f33fc0cfeb0 0x7f33fc0d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:30.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.423+0000 7f34031c3640 1 --2- 172.21.15.78:0/3768064749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33fc06fec0 0x7f33fc0702d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:30.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.423+0000 7f34031c3640 1 --2- 172.21.15.78:0/3768064749 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f33fc0b4090 0x7f33fc0b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:30.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.423+0000 7f34031c3640 1 -- 172.21.15.78:0/3768064749 >> 172.21.15.78:0/3768064749 conn(0x7f33fc0cdcc0 msgr2=0x7f33fc0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:30.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.423+0000 7f34031c3640 1 -- 172.21.15.78:0/3768064749 shutdown_connections 2024-09-17T03:10:30.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.423+0000 7f34031c3640 1 -- 172.21.15.78:0/3768064749 wait complete. 2024-09-17T03:10:30.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.425+0000 7f34031c3640 1 Processor -- start 2024-09-17T03:10:30.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.425+0000 7f34031c3640 1 -- start start 2024-09-17T03:10:30.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.426+0000 7f34031c3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f33fc06fec0 0x7f33fc14e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:30.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.426+0000 7f34031c3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33fc0b4090 0x7f33fc09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:30.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.426+0000 7f34031c3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f33fc0cfeb0 0x7f33fc1f7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:30.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.426+0000 7f34031c3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc0b46a0 con 0x7f33fc0b4090 2024-09-17T03:10:30.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.426+0000 7f34031c3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc0b4820 con 0x7f33fc06fec0 2024-09-17T03:10:30.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.426+0000 7f34031c3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f33fc0b49a0 con 0x7f33fc0cfeb0 2024-09-17T03:10:30.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.426+0000 7f33f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33fc0b4090 0x7f33fc09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:30.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.426+0000 7f33f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33fc0b4090 0x7f33fc09aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46852/0 (socket says 172.21.15.78:46852) 2024-09-17T03:10:30.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.426+0000 7f33f3fff640 1 -- 172.21.15.78:0/1113052372 learned_addr learned my addr 172.21.15.78:0/1113052372 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:30.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.426+0000 7f3400f5f640 1 --2- 172.21.15.78:0/1113052372 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f33fc06fec0 0x7f33fc14e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:30.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.427+0000 7f3401760640 1 --2- 172.21.15.78:0/1113052372 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f33fc0cfeb0 0x7f33fc1f7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:30.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.427+0000 7f33f3fff640 1 -- 172.21.15.78:0/1113052372 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f33fc0cfeb0 msgr2=0x7f33fc1f7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:30.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.427+0000 7f33f3fff640 1 --2- 172.21.15.78:0/1113052372 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f33fc0cfeb0 0x7f33fc1f7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:30.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.427+0000 7f33f3fff640 1 -- 172.21.15.78:0/1113052372 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f33fc06fec0 msgr2=0x7f33fc14e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:30.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.427+0000 7f33f3fff640 1 --2- 172.21.15.78:0/1113052372 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f33fc06fec0 0x7f33fc14e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:30.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.427+0000 7f33f3fff640 1 -- 172.21.15.78:0/1113052372 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33fc09e7a0 con 0x7f33fc0b4090 2024-09-17T03:10:30.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.427+0000 7f33f3fff640 1 --2- 172.21.15.78:0/1113052372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33fc0b4090 0x7f33fc09aa30 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f33ec034040 tx=0x7f33ec0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:30.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.427+0000 7f33f17fa640 1 -- 172.21.15.78:0/1113052372 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec03e030 con 0x7f33fc0b4090 2024-09-17T03:10:30.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.427+0000 7f33f17fa640 1 -- 172.21.15.78:0/1113052372 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f33ec0047a0 con 0x7f33fc0b4090 2024-09-17T03:10:30.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.427+0000 7f33f17fa640 1 -- 172.21.15.78:0/1113052372 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec035040 con 0x7f33fc0b4090 2024-09-17T03:10:30.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.427+0000 7f34031c3640 1 -- 172.21.15.78:0/1113052372 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33fc09ea80 con 0x7f33fc0b4090 2024-09-17T03:10:30.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.427+0000 7f34031c3640 1 -- 172.21.15.78:0/1113052372 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33fc1f6c00 con 0x7f33fc0b4090 2024-09-17T03:10:30.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.428+0000 7f34031c3640 1 -- 172.21.15.78:0/1113052372 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33fc0b3550 con 0x7f33fc0b4090 2024-09-17T03:10:30.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.429+0000 7f33f17fa640 1 -- 172.21.15.78:0/1113052372 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f33ec041030 con 0x7f33fc0b4090 2024-09-17T03:10:30.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.429+0000 7f33f17fa640 1 --2- 172.21.15.78:0/1113052372 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f33e8078bc0 0x7f33e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:30.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.429+0000 7f33f17fa640 1 -- 172.21.15.78:0/1113052372 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f33ec0bb4c0 con 0x7f33fc0b4090 2024-09-17T03:10:30.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.429+0000 7f3400f5f640 1 --2- 172.21.15.78:0/1113052372 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f33e8078bc0 0x7f33e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:30.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.430+0000 7f3400f5f640 1 --2- 172.21.15.78:0/1113052372 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f33e8078bc0 0x7f33e807b0d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f33f80098e0 tx=0x7f33f8009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:30.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.434+0000 7f33f17fa640 1 -- 172.21.15.78:0/1113052372 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f33ec083340 con 0x7f33fc0b4090 2024-09-17T03:10:30.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.603+0000 7f34031c3640 1 -- 172.21.15.78:0/1113052372 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f33fc14ece0 con 0x7f33e8078bc0 2024-09-17T03:10:30.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.608+0000 7f33f17fa640 1 -- 172.21.15.78:0/1113052372 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247415 (secure 0 0 0) 0x7f33fc14ece0 con 0x7f33e8078bc0 2024-09-17T03:10:30.610 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:30.611 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:10:30.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.611+0000 7f34031c3640 1 -- 172.21.15.78:0/1113052372 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f33e8078bc0 msgr2=0x7f33e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:30.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.611+0000 7f34031c3640 1 --2- 172.21.15.78:0/1113052372 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f33e8078bc0 0x7f33e807b0d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f33f80098e0 tx=0x7f33f8009060 comp rx=0 tx=0).stop 2024-09-17T03:10:30.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.611+0000 7f34031c3640 1 -- 172.21.15.78:0/1113052372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33fc0b4090 msgr2=0x7f33fc09aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:30.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.611+0000 7f34031c3640 1 --2- 172.21.15.78:0/1113052372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33fc0b4090 0x7f33fc09aa30 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f33ec034040 tx=0x7f33ec0039e0 comp rx=0 tx=0).stop 2024-09-17T03:10:30.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.611+0000 7f34031c3640 1 -- 172.21.15.78:0/1113052372 shutdown_connections 2024-09-17T03:10:30.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.611+0000 7f34031c3640 1 --2- 172.21.15.78:0/1113052372 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f33fc0cfeb0 0x7f33fc1f7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:30.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.611+0000 7f34031c3640 1 --2- 172.21.15.78:0/1113052372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33fc0b4090 0x7f33fc09aa30 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:30.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.611+0000 7f34031c3640 1 --2- 172.21.15.78:0/1113052372 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f33e8078bc0 0x7f33e807b0d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:30.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.611+0000 7f34031c3640 1 --2- 172.21.15.78:0/1113052372 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f33fc06fec0 0x7f33fc14e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:30.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.611+0000 7f34031c3640 1 -- 172.21.15.78:0/1113052372 >> 172.21.15.78:0/1113052372 conn(0x7f33fc0cdcc0 msgr2=0x7f33fc0ae140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:30.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.611+0000 7f34031c3640 1 -- 172.21.15.78:0/1113052372 shutdown_connections 2024-09-17T03:10:30.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.611+0000 7f34031c3640 1 -- 172.21.15.78:0/1113052372 wait complete. 2024-09-17T03:10:30.622 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2024-09-17T03:10:29.150302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":110,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229584,"kb_used_data":5020,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745136,"statfs":{"total":773094113280,"available":772859019264,"internally_reserved":0,"allocated":5140480,"data_stored":2740676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.545682"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615402+0000","last_change":"2024-09-17T03:10:25.615402+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615402+0000","last_undegraded":"2024-09-17T03:10:25.615402+0000","last_fullsized":"2024-09-17T03:10:25.615402+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616162+0000","last_change":"2024-09-17T03:10:25.616162+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616162+0000","last_undegraded":"2024-09-17T03:10:25.616162+0000","last_fullsized":"2024-09-17T03:10:25.616162+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.609754+0000","last_change":"2024-09-17T03:10:25.609754+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.609754+0000","last_undegraded":"2024-09-17T03:10:25.609754+0000","last_fullsized":"2024-09-17T03:10:25.609754+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.618870+0000","last_change":"2024-09-17T03:10:25.618870+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.618870+0000","last_undegraded":"2024-09-17T03:10:25.618870+0000","last_fullsized":"2024-09-17T03:10:25.618870+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614129+0000","last_change":"2024-09-17T03:10:25.614129+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614129+0000","last_undegraded":"2024-09-17T03:10:25.614129+0000","last_fullsized":"2024-09-17T03:10:25.614129+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.633121+0000","last_change":"2024-09-17T03:10:26.627225+0000","last_active":"2024-09-17T03:10:26.633121+0000","last_peered":"2024-09-17T03:10:26.633121+0000","last_clean":"2024-09-17T03:10:26.633121+0000","last_became_active":"2024-09-17T03:10:26.626923+0000","last_became_peered":"2024-09-17T03:10:26.626923+0000","last_unstale":"2024-09-17T03:10:26.633121+0000","last_undegraded":"2024-09-17T03:10:26.633121+0000","last_fullsized":"2024-09-17T03:10:26.633121+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:56.586793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615319+0000","last_change":"2024-09-17T03:10:25.615319+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615319+0000","last_undegraded":"2024-09-17T03:10:25.615319+0000","last_fullsized":"2024-09-17T03:10:25.615319+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616535+0000","last_change":"2024-09-17T03:10:25.616535+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616535+0000","last_undegraded":"2024-09-17T03:10:25.616535+0000","last_fullsized":"2024-09-17T03:10:25.616535+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616079+0000","last_change":"2024-09-17T03:10:25.616079+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616079+0000","last_undegraded":"2024-09-17T03:10:25.616079+0000","last_fullsized":"2024-09-17T03:10:25.616079+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615559+0000","last_change":"2024-09-17T03:10:25.615559+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615559+0000","last_undegraded":"2024-09-17T03:10:25.615559+0000","last_fullsized":"2024-09-17T03:10:25.615559+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615839+0000","last_change":"2024-09-17T03:10:25.615839+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615839+0000","last_undegraded":"2024-09-17T03:10:25.615839+0000","last_fullsized":"2024-09-17T03:10:25.615839+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615631+0000","last_change":"2024-09-17T03:10:25.615631+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615631+0000","last_undegraded":"2024-09-17T03:10:25.615631+0000","last_fullsized":"2024-09-17T03:10:25.615631+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616737+0000","last_change":"2024-09-17T03:10:25.616737+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616737+0000","last_undegraded":"2024-09-17T03:10:25.616737+0000","last_fullsized":"2024-09-17T03:10:25.616737+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615070+0000","last_change":"2024-09-17T03:10:25.615070+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615070+0000","last_undegraded":"2024-09-17T03:10:25.615070+0000","last_fullsized":"2024-09-17T03:10:25.615070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.632804+0000","last_change":"2024-09-17T03:10:26.626832+0000","last_active":"2024-09-17T03:10:26.632804+0000","last_peered":"2024-09-17T03:10:26.632804+0000","last_clean":"2024-09-17T03:10:26.632804+0000","last_became_active":"2024-09-17T03:10:26.625618+0000","last_became_peered":"2024-09-17T03:10:26.625618+0000","last_unstale":"2024-09-17T03:10:26.632804+0000","last_undegraded":"2024-09-17T03:10:26.632804+0000","last_fullsized":"2024-09-17T03:10:26.632804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:11.569131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614248+0000","last_change":"2024-09-17T03:10:25.614248+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614248+0000","last_undegraded":"2024-09-17T03:10:25.614248+0000","last_fullsized":"2024-09-17T03:10:25.614248+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.608846+0000","last_change":"2024-09-17T03:10:25.608846+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.608846+0000","last_undegraded":"2024-09-17T03:10:25.608846+0000","last_fullsized":"2024-09-17T03:10:25.608846+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.610584+0000","last_change":"2024-09-17T03:10:25.610584+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.610584+0000","last_undegraded":"2024-09-17T03:10:25.610584+0000","last_fullsized":"2024-09-17T03:10:25.610584+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.611206+0000","last_change":"2024-09-17T03:10:25.611206+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.611206+0000","last_undegraded":"2024-09-17T03:10:25.611206+0000","last_fullsized":"2024-09-17T03:10:25.611206+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616259+0000","last_change":"2024-09-17T03:10:25.616259+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616259+0000","last_undegraded":"2024-09-17T03:10:25.616259+0000","last_fullsized":"2024-09-17T03:10:25.616259+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.640384+0000","last_change":"2024-09-17T03:10:26.636653+0000","last_active":"2024-09-17T03:10:26.640384+0000","last_peered":"2024-09-17T03:10:26.640384+0000","last_clean":"2024-09-17T03:10:26.640384+0000","last_became_active":"2024-09-17T03:10:26.636103+0000","last_became_peered":"2024-09-17T03:10:26.636103+0000","last_unstale":"2024-09-17T03:10:26.640384+0000","last_undegraded":"2024-09-17T03:10:26.640384+0000","last_fullsized":"2024-09-17T03:10:26.640384+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:07.048273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614516+0000","last_change":"2024-09-17T03:10:25.614516+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614516+0000","last_undegraded":"2024-09-17T03:10:25.614516+0000","last_fullsized":"2024-09-17T03:10:25.614516+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.612876+0000","last_change":"2024-09-17T03:10:25.612876+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.612876+0000","last_undegraded":"2024-09-17T03:10:25.612876+0000","last_fullsized":"2024-09-17T03:10:25.612876+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.612070+0000","last_change":"2024-09-17T03:10:25.612070+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.612070+0000","last_undegraded":"2024-09-17T03:10:25.612070+0000","last_fullsized":"2024-09-17T03:10:25.612070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614092+0000","last_change":"2024-09-17T03:10:25.614092+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614092+0000","last_undegraded":"2024-09-17T03:10:25.614092+0000","last_fullsized":"2024-09-17T03:10:25.614092+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615695+0000","last_change":"2024-09-17T03:10:25.615695+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615695+0000","last_undegraded":"2024-09-17T03:10:25.615695+0000","last_fullsized":"2024-09-17T03:10:25.615695+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.609226+0000","last_change":"2024-09-17T03:10:25.609226+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.609226+0000","last_undegraded":"2024-09-17T03:10:25.609226+0000","last_fullsized":"2024-09-17T03:10:25.609226+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615144+0000","last_change":"2024-09-17T03:10:25.615144+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615144+0000","last_undegraded":"2024-09-17T03:10:25.615144+0000","last_fullsized":"2024-09-17T03:10:25.615144+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.610015+0000","last_change":"2024-09-17T03:10:25.610015+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.610015+0000","last_undegraded":"2024-09-17T03:10:25.610015+0000","last_fullsized":"2024-09-17T03:10:25.610015+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.610387+0000","last_change":"2024-09-17T03:10:25.610387+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.610387+0000","last_undegraded":"2024-09-17T03:10:25.610387+0000","last_fullsized":"2024-09-17T03:10:25.610387+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.640234+0000","last_change":"2024-09-17T03:10:26.632798+0000","last_active":"2024-09-17T03:10:26.640234+0000","last_peered":"2024-09-17T03:10:26.640234+0000","last_clean":"2024-09-17T03:10:26.640234+0000","last_became_active":"2024-09-17T03:10:26.632513+0000","last_became_peered":"2024-09-17T03:10:26.632513+0000","last_unstale":"2024-09-17T03:10:26.640234+0000","last_undegraded":"2024-09-17T03:10:26.640234+0000","last_fullsized":"2024-09-17T03:10:26.640234+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:16.049381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615186+0000","last_change":"2024-09-17T03:10:25.615186+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615186+0000","last_undegraded":"2024-09-17T03:10:25.615186+0000","last_fullsized":"2024-09-17T03:10:25.615186+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615543+0000","last_change":"2024-09-17T03:10:25.615543+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615543+0000","last_undegraded":"2024-09-17T03:10:25.615543+0000","last_fullsized":"2024-09-17T03:10:25.615543+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.639313+0000","last_change":"2024-09-17T03:10:25.630050+0000","last_active":"2024-09-17T03:10:26.639313+0000","last_peered":"2024-09-17T03:10:26.639313+0000","last_clean":"2024-09-17T03:10:26.639313+0000","last_became_active":"2024-09-17T03:10:25.629738+0000","last_became_peered":"2024-09-17T03:10:25.629738+0000","last_unstale":"2024-09-17T03:10:26.639313+0000","last_undegraded":"2024-09-17T03:10:26.639313+0000","last_fullsized":"2024-09-17T03:10:26.639313+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:34.296787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613567+0000","last_change":"2024-09-17T03:10:25.613567+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613567+0000","last_undegraded":"2024-09-17T03:10:25.613567+0000","last_fullsized":"2024-09-17T03:10:25.613567+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.621731+0000","last_change":"2024-09-17T03:10:25.616451+0000","last_active":"2024-09-17T03:10:25.621731+0000","last_peered":"2024-09-17T03:10:25.621731+0000","last_clean":"2024-09-17T03:10:25.621731+0000","last_became_active":"2024-09-17T03:10:25.616110+0000","last_became_peered":"2024-09-17T03:10:25.616110+0000","last_unstale":"2024-09-17T03:10:25.621731+0000","last_undegraded":"2024-09-17T03:10:25.621731+0000","last_fullsized":"2024-09-17T03:10:25.621731+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:23.827138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614645+0000","last_change":"2024-09-17T03:10:25.614645+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614645+0000","last_undegraded":"2024-09-17T03:10:25.614645+0000","last_fullsized":"2024-09-17T03:10:25.614645+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.631530+0000","last_change":"2024-09-17T03:10:25.626520+0000","last_active":"2024-09-17T03:10:25.631530+0000","last_peered":"2024-09-17T03:10:25.631530+0000","last_clean":"2024-09-17T03:10:25.631530+0000","last_became_active":"2024-09-17T03:10:25.626229+0000","last_became_peered":"2024-09-17T03:10:25.626229+0000","last_unstale":"2024-09-17T03:10:25.631530+0000","last_undegraded":"2024-09-17T03:10:25.631530+0000","last_fullsized":"2024-09-17T03:10:25.631530+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:18.573372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616315+0000","last_change":"2024-09-17T03:10:25.616315+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616315+0000","last_undegraded":"2024-09-17T03:10:25.616315+0000","last_fullsized":"2024-09-17T03:10:25.616315+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.628587+0000","last_change":"2024-09-17T03:10:25.626034+0000","last_active":"2024-09-17T03:10:25.628587+0000","last_peered":"2024-09-17T03:10:25.628587+0000","last_clean":"2024-09-17T03:10:25.628587+0000","last_became_active":"2024-09-17T03:10:25.625671+0000","last_became_peered":"2024-09-17T03:10:25.625671+0000","last_unstale":"2024-09-17T03:10:25.628587+0000","last_undegraded":"2024-09-17T03:10:25.628587+0000","last_fullsized":"2024-09-17T03:10:25.628587+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:51.028351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.609800+0000","last_change":"2024-09-17T03:10:25.609800+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.609800+0000","last_undegraded":"2024-09-17T03:10:25.609800+0000","last_fullsized":"2024-09-17T03:10:25.609800+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.630431+0000","last_change":"2024-09-17T03:10:25.627030+0000","last_active":"2024-09-17T03:10:26.630431+0000","last_peered":"2024-09-17T03:10:26.630431+0000","last_clean":"2024-09-17T03:10:26.630431+0000","last_became_active":"2024-09-17T03:10:25.626746+0000","last_became_peered":"2024-09-17T03:10:25.626746+0000","last_unstale":"2024-09-17T03:10:26.630431+0000","last_undegraded":"2024-09-17T03:10:26.630431+0000","last_fullsized":"2024-09-17T03:10:26.630431+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:20.215142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614407+0000","last_change":"2024-09-17T03:10:25.614407+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614407+0000","last_undegraded":"2024-09-17T03:10:25.614407+0000","last_fullsized":"2024-09-17T03:10:25.614407+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.626927+0000","last_change":"2024-09-17T03:10:25.624581+0000","last_active":"2024-09-17T03:10:25.626927+0000","last_peered":"2024-09-17T03:10:25.626927+0000","last_clean":"2024-09-17T03:10:25.626927+0000","last_became_active":"2024-09-17T03:10:25.623625+0000","last_became_peered":"2024-09-17T03:10:25.623625+0000","last_unstale":"2024-09-17T03:10:25.626927+0000","last_undegraded":"2024-09-17T03:10:25.626927+0000","last_fullsized":"2024-09-17T03:10:25.626927+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:32.576616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613970+0000","last_change":"2024-09-17T03:10:25.613970+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613970+0000","last_undegraded":"2024-09-17T03:10:25.613970+0000","last_fullsized":"2024-09-17T03:10:25.613970+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.630138+0000","last_change":"2024-09-17T03:10:25.625253+0000","last_active":"2024-09-17T03:10:25.630138+0000","last_peered":"2024-09-17T03:10:25.630138+0000","last_clean":"2024-09-17T03:10:25.630138+0000","last_became_active":"2024-09-17T03:10:25.624870+0000","last_became_peered":"2024-09-17T03:10:25.624870+0000","last_unstale":"2024-09-17T03:10:25.630138+0000","last_undegraded":"2024-09-17T03:10:25.630138+0000","last_fullsized":"2024-09-17T03:10:25.630138+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:16.507885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613828+0000","last_change":"2024-09-17T03:10:25.613828+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613828+0000","last_undegraded":"2024-09-17T03:10:25.613828+0000","last_fullsized":"2024-09-17T03:10:25.613828+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.634039+0000","last_change":"2024-09-17T03:10:25.628027+0000","last_active":"2024-09-17T03:10:25.634039+0000","last_peered":"2024-09-17T03:10:25.634039+0000","last_clean":"2024-09-17T03:10:25.634039+0000","last_became_active":"2024-09-17T03:10:25.624938+0000","last_became_peered":"2024-09-17T03:10:25.624938+0000","last_unstale":"2024-09-17T03:10:25.634039+0000","last_undegraded":"2024-09-17T03:10:25.634039+0000","last_fullsized":"2024-09-17T03:10:25.634039+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:24.615797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.609938+0000","last_change":"2024-09-17T03:10:25.609938+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.609938+0000","last_undegraded":"2024-09-17T03:10:25.609938+0000","last_fullsized":"2024-09-17T03:10:25.609938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.621285+0000","last_change":"2024-09-17T03:10:25.619136+0000","last_active":"2024-09-17T03:10:25.621285+0000","last_peered":"2024-09-17T03:10:25.621285+0000","last_clean":"2024-09-17T03:10:25.621285+0000","last_became_active":"2024-09-17T03:10:25.618816+0000","last_became_peered":"2024-09-17T03:10:25.618816+0000","last_unstale":"2024-09-17T03:10:25.621285+0000","last_undegraded":"2024-09-17T03:10:25.621285+0000","last_fullsized":"2024-09-17T03:10:25.621285+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:47.735636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613992+0000","last_change":"2024-09-17T03:10:25.613992+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613992+0000","last_undegraded":"2024-09-17T03:10:25.613992+0000","last_fullsized":"2024-09-17T03:10:25.613992+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.627651+0000","last_change":"2024-09-17T03:10:25.623416+0000","last_active":"2024-09-17T03:10:25.627651+0000","last_peered":"2024-09-17T03:10:25.627651+0000","last_clean":"2024-09-17T03:10:25.627651+0000","last_became_active":"2024-09-17T03:10:25.623090+0000","last_became_peered":"2024-09-17T03:10:25.623090+0000","last_unstale":"2024-09-17T03:10:25.627651+0000","last_undegraded":"2024-09-17T03:10:25.627651+0000","last_fullsized":"2024-09-17T03:10:25.627651+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:20.799970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.632253+0000","last_change":"2024-09-17T03:10:26.626795+0000","last_active":"2024-09-17T03:10:26.632253+0000","last_peered":"2024-09-17T03:10:26.632253+0000","last_clean":"2024-09-17T03:10:26.632253+0000","last_became_active":"2024-09-17T03:10:26.625634+0000","last_became_peered":"2024-09-17T03:10:26.625634+0000","last_unstale":"2024-09-17T03:10:26.632253+0000","last_undegraded":"2024-09-17T03:10:26.632253+0000","last_fullsized":"2024-09-17T03:10:26.632253+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:40.332682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.628554+0000","last_change":"2024-09-17T03:10:25.625282+0000","last_active":"2024-09-17T03:10:25.628554+0000","last_peered":"2024-09-17T03:10:25.628554+0000","last_clean":"2024-09-17T03:10:25.628554+0000","last_became_active":"2024-09-17T03:10:25.624893+0000","last_became_peered":"2024-09-17T03:10:25.624893+0000","last_unstale":"2024-09-17T03:10:25.628554+0000","last_undegraded":"2024-09-17T03:10:25.628554+0000","last_fullsized":"2024-09-17T03:10:25.628554+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:16.507885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614580+0000","last_change":"2024-09-17T03:10:25.614580+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614580+0000","last_undegraded":"2024-09-17T03:10:25.614580+0000","last_fullsized":"2024-09-17T03:10:25.614580+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.621247+0000","last_change":"2024-09-17T03:10:25.614140+0000","last_active":"2024-09-17T03:10:25.621247+0000","last_peered":"2024-09-17T03:10:25.621247+0000","last_clean":"2024-09-17T03:10:25.621247+0000","last_became_active":"2024-09-17T03:10:25.613844+0000","last_became_peered":"2024-09-17T03:10:25.613844+0000","last_unstale":"2024-09-17T03:10:25.621247+0000","last_undegraded":"2024-09-17T03:10:25.621247+0000","last_fullsized":"2024-09-17T03:10:25.621247+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:49.842511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.609410+0000","last_change":"2024-09-17T03:10:25.609410+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.609410+0000","last_undegraded":"2024-09-17T03:10:25.609410+0000","last_fullsized":"2024-09-17T03:10:25.609410+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.632428+0000","last_change":"2024-09-17T03:10:25.630508+0000","last_active":"2024-09-17T03:10:26.632428+0000","last_peered":"2024-09-17T03:10:26.632428+0000","last_clean":"2024-09-17T03:10:26.632428+0000","last_became_active":"2024-09-17T03:10:25.630209+0000","last_became_peered":"2024-09-17T03:10:25.630209+0000","last_unstale":"2024-09-17T03:10:26.632428+0000","last_undegraded":"2024-09-17T03:10:26.632428+0000","last_fullsized":"2024-09-17T03:10:26.632428+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:15.757991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613962+0000","last_change":"2024-09-17T03:10:25.613962+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613962+0000","last_undegraded":"2024-09-17T03:10:25.613962+0000","last_fullsized":"2024-09-17T03:10:25.613962+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.632215+0000","last_change":"2024-09-17T03:10:25.628330+0000","last_active":"2024-09-17T03:10:25.632215+0000","last_peered":"2024-09-17T03:10:25.632215+0000","last_clean":"2024-09-17T03:10:25.632215+0000","last_became_active":"2024-09-17T03:10:25.627919+0000","last_became_peered":"2024-09-17T03:10:25.627919+0000","last_unstale":"2024-09-17T03:10:25.632215+0000","last_undegraded":"2024-09-17T03:10:25.632215+0000","last_fullsized":"2024-09-17T03:10:25.632215+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:14.190956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.637269+0000","last_change":"2024-09-17T03:10:26.630787+0000","last_active":"2024-09-17T03:10:26.637269+0000","last_peered":"2024-09-17T03:10:26.637269+0000","last_clean":"2024-09-17T03:10:26.637269+0000","last_became_active":"2024-09-17T03:10:26.629999+0000","last_became_peered":"2024-09-17T03:10:26.629999+0000","last_unstale":"2024-09-17T03:10:26.637269+0000","last_undegraded":"2024-09-17T03:10:26.637269+0000","last_fullsized":"2024-09-17T03:10:26.637269+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:54.370486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.614340+0000","last_change":"2024-09-17T03:10:25.625455+0000","last_active":"2024-09-17T03:10:26.614340+0000","last_peered":"2024-09-17T03:10:26.614340+0000","last_clean":"2024-09-17T03:10:26.614340+0000","last_became_active":"2024-09-17T03:10:25.625151+0000","last_became_peered":"2024-09-17T03:10:25.625151+0000","last_unstale":"2024-09-17T03:10:26.614340+0000","last_undegraded":"2024-09-17T03:10:26.614340+0000","last_fullsized":"2024-09-17T03:10:26.614340+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:24.800733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613788+0000","last_change":"2024-09-17T03:10:25.613788+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613788+0000","last_undegraded":"2024-09-17T03:10:25.613788+0000","last_fullsized":"2024-09-17T03:10:25.613788+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.627892+0000","last_change":"2024-09-17T03:10:25.623870+0000","last_active":"2024-09-17T03:10:25.627892+0000","last_peered":"2024-09-17T03:10:25.627892+0000","last_clean":"2024-09-17T03:10:25.627892+0000","last_became_active":"2024-09-17T03:10:25.622936+0000","last_became_peered":"2024-09-17T03:10:25.622936+0000","last_unstale":"2024-09-17T03:10:25.627892+0000","last_undegraded":"2024-09-17T03:10:25.627892+0000","last_fullsized":"2024-09-17T03:10:25.627892+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:36.802376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614663+0000","last_change":"2024-09-17T03:10:25.614663+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614663+0000","last_undegraded":"2024-09-17T03:10:25.614663+0000","last_fullsized":"2024-09-17T03:10:25.614663+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.636862+0000","last_change":"2024-09-17T03:10:25.627052+0000","last_active":"2024-09-17T03:10:25.636862+0000","last_peered":"2024-09-17T03:10:25.636862+0000","last_clean":"2024-09-17T03:10:25.636862+0000","last_became_active":"2024-09-17T03:10:25.626732+0000","last_became_peered":"2024-09-17T03:10:25.626732+0000","last_unstale":"2024-09-17T03:10:25.636862+0000","last_undegraded":"2024-09-17T03:10:25.636862+0000","last_fullsized":"2024-09-17T03:10:25.636862+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:45.402110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614027+0000","last_change":"2024-09-17T03:10:25.614027+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614027+0000","last_undegraded":"2024-09-17T03:10:25.614027+0000","last_fullsized":"2024-09-17T03:10:25.614027+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.626596+0000","last_change":"2024-09-17T03:10:25.622889+0000","last_active":"2024-09-17T03:10:25.626596+0000","last_peered":"2024-09-17T03:10:25.626596+0000","last_clean":"2024-09-17T03:10:25.626596+0000","last_became_active":"2024-09-17T03:10:25.622552+0000","last_became_peered":"2024-09-17T03:10:25.622552+0000","last_unstale":"2024-09-17T03:10:25.626596+0000","last_undegraded":"2024-09-17T03:10:25.626596+0000","last_fullsized":"2024-09-17T03:10:25.626596+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:57.309006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.610556+0000","last_change":"2024-09-17T03:10:25.610556+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.610556+0000","last_undegraded":"2024-09-17T03:10:25.610556+0000","last_fullsized":"2024-09-17T03:10:25.610556+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.630021+0000","last_change":"2024-09-17T03:10:25.625213+0000","last_active":"2024-09-17T03:10:25.630021+0000","last_peered":"2024-09-17T03:10:25.630021+0000","last_clean":"2024-09-17T03:10:25.630021+0000","last_became_active":"2024-09-17T03:10:25.624885+0000","last_became_peered":"2024-09-17T03:10:25.624885+0000","last_unstale":"2024-09-17T03:10:25.630021+0000","last_undegraded":"2024-09-17T03:10:25.630021+0000","last_fullsized":"2024-09-17T03:10:25.630021+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:40.794606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.612590+0000","last_change":"2024-09-17T03:10:25.612590+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.612590+0000","last_undegraded":"2024-09-17T03:10:25.612590+0000","last_fullsized":"2024-09-17T03:10:25.612590+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.616186+0000","last_change":"2024-09-17T03:10:25.626305+0000","last_active":"2024-09-17T03:10:26.616186+0000","last_peered":"2024-09-17T03:10:26.616186+0000","last_clean":"2024-09-17T03:10:26.616186+0000","last_became_active":"2024-09-17T03:10:25.626021+0000","last_became_peered":"2024-09-17T03:10:25.626021+0000","last_unstale":"2024-09-17T03:10:26.616186+0000","last_undegraded":"2024-09-17T03:10:26.616186+0000","last_fullsized":"2024-09-17T03:10:26.616186+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:20.547659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.637228+0000","last_change":"2024-09-17T03:10:26.628582+0000","last_active":"2024-09-17T03:10:26.637228+0000","last_peered":"2024-09-17T03:10:26.637228+0000","last_clean":"2024-09-17T03:10:26.637228+0000","last_became_active":"2024-09-17T03:10:26.628003+0000","last_became_peered":"2024-09-17T03:10:26.628003+0000","last_unstale":"2024-09-17T03:10:26.637228+0000","last_undegraded":"2024-09-17T03:10:26.637228+0000","last_fullsized":"2024-09-17T03:10:26.637228+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:48.501354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.630505+0000","last_change":"2024-09-17T03:10:25.628379+0000","last_active":"2024-09-17T03:10:26.630505+0000","last_peered":"2024-09-17T03:10:26.630505+0000","last_clean":"2024-09-17T03:10:26.630505+0000","last_became_active":"2024-09-17T03:10:25.628078+0000","last_became_peered":"2024-09-17T03:10:25.628078+0000","last_unstale":"2024-09-17T03:10:26.630505+0000","last_undegraded":"2024-09-17T03:10:26.630505+0000","last_fullsized":"2024-09-17T03:10:26.630505+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:23.877248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614989+0000","last_change":"2024-09-17T03:10:25.614989+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614989+0000","last_undegraded":"2024-09-17T03:10:25.614989+0000","last_fullsized":"2024-09-17T03:10:25.614989+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.630033+0000","last_change":"2024-09-17T03:10:25.626068+0000","last_active":"2024-09-17T03:10:25.630033+0000","last_peered":"2024-09-17T03:10:25.630033+0000","last_clean":"2024-09-17T03:10:25.630033+0000","last_became_active":"2024-09-17T03:10:25.625744+0000","last_became_peered":"2024-09-17T03:10:25.625744+0000","last_unstale":"2024-09-17T03:10:25.630033+0000","last_undegraded":"2024-09-17T03:10:25.630033+0000","last_fullsized":"2024-09-17T03:10:25.630033+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:51.028351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614118+0000","last_change":"2024-09-17T03:10:25.614118+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614118+0000","last_undegraded":"2024-09-17T03:10:25.614118+0000","last_fullsized":"2024-09-17T03:10:25.614118+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.627537+0000","last_change":"2024-09-17T03:10:25.622607+0000","last_active":"2024-09-17T03:10:25.627537+0000","last_peered":"2024-09-17T03:10:25.627537+0000","last_clean":"2024-09-17T03:10:25.627537+0000","last_became_active":"2024-09-17T03:10:25.622323+0000","last_became_peered":"2024-09-17T03:10:25.622323+0000","last_unstale":"2024-09-17T03:10:25.627537+0000","last_undegraded":"2024-09-17T03:10:25.627537+0000","last_fullsized":"2024-09-17T03:10:25.627537+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:40.437500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613466+0000","last_change":"2024-09-17T03:10:25.613466+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613466+0000","last_undegraded":"2024-09-17T03:10:25.613466+0000","last_fullsized":"2024-09-17T03:10:25.613466+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.632220+0000","last_change":"2024-09-17T03:10:25.628191+0000","last_active":"2024-09-17T03:10:25.632220+0000","last_peered":"2024-09-17T03:10:25.632220+0000","last_clean":"2024-09-17T03:10:25.632220+0000","last_became_active":"2024-09-17T03:10:25.627726+0000","last_became_peered":"2024-09-17T03:10:25.627726+0000","last_unstale":"2024-09-17T03:10:25.632220+0000","last_undegraded":"2024-09-17T03:10:25.632220+0000","last_fullsized":"2024-09-17T03:10:25.632220+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:21.661328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.612910+0000","last_change":"2024-09-17T03:10:25.612910+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.612910+0000","last_undegraded":"2024-09-17T03:10:25.612910+0000","last_fullsized":"2024-09-17T03:10:25.612910+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.613158+0000","last_change":"2024-09-17T03:10:25.629315+0000","last_active":"2024-09-17T03:10:27.613158+0000","last_peered":"2024-09-17T03:10:27.613158+0000","last_clean":"2024-09-17T03:10:27.613158+0000","last_became_active":"2024-09-17T03:10:25.629015+0000","last_became_peered":"2024-09-17T03:10:25.629015+0000","last_unstale":"2024-09-17T03:10:27.613158+0000","last_undegraded":"2024-09-17T03:10:27.613158+0000","last_fullsized":"2024-09-17T03:10:27.613158+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:30.992821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613385+0000","last_change":"2024-09-17T03:10:25.613385+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613385+0000","last_undegraded":"2024-09-17T03:10:25.613385+0000","last_fullsized":"2024-09-17T03:10:25.613385+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.630605+0000","last_change":"2024-09-17T03:10:25.627561+0000","last_active":"2024-09-17T03:10:25.630605+0000","last_peered":"2024-09-17T03:10:25.630605+0000","last_clean":"2024-09-17T03:10:25.630605+0000","last_became_active":"2024-09-17T03:10:25.627173+0000","last_became_peered":"2024-09-17T03:10:25.627173+0000","last_unstale":"2024-09-17T03:10:25.630605+0000","last_undegraded":"2024-09-17T03:10:25.630605+0000","last_fullsized":"2024-09-17T03:10:25.630605+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:28.504300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613721+0000","last_change":"2024-09-17T03:10:25.613721+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613721+0000","last_undegraded":"2024-09-17T03:10:25.613721+0000","last_fullsized":"2024-09-17T03:10:25.613721+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.626996+0000","last_change":"2024-09-17T03:10:25.622690+0000","last_active":"2024-09-17T03:10:25.626996+0000","last_peered":"2024-09-17T03:10:25.626996+0000","last_clean":"2024-09-17T03:10:25.626996+0000","last_became_active":"2024-09-17T03:10:25.622386+0000","last_became_peered":"2024-09-17T03:10:25.622386+0000","last_unstale":"2024-09-17T03:10:25.626996+0000","last_undegraded":"2024-09-17T03:10:25.626996+0000","last_fullsized":"2024-09-17T03:10:25.626996+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:32.576616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.637199+0000","last_change":"2024-09-17T03:10:26.628270+0000","last_active":"2024-09-17T03:10:26.637199+0000","last_peered":"2024-09-17T03:10:26.637199+0000","last_clean":"2024-09-17T03:10:26.637199+0000","last_became_active":"2024-09-17T03:10:26.627647+0000","last_became_peered":"2024-09-17T03:10:26.627647+0000","last_unstale":"2024-09-17T03:10:26.637199+0000","last_undegraded":"2024-09-17T03:10:26.637199+0000","last_fullsized":"2024-09-17T03:10:26.637199+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:38.953959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.626902+0000","last_change":"2024-09-17T03:10:25.623065+0000","last_active":"2024-09-17T03:10:25.626902+0000","last_peered":"2024-09-17T03:10:25.626902+0000","last_clean":"2024-09-17T03:10:25.626902+0000","last_became_active":"2024-09-17T03:10:25.621840+0000","last_became_peered":"2024-09-17T03:10:25.621840+0000","last_unstale":"2024-09-17T03:10:25.626902+0000","last_undegraded":"2024-09-17T03:10:25.626902+0000","last_fullsized":"2024-09-17T03:10:25.626902+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:40.794606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.632322+0000","last_change":"2024-09-17T03:10:26.625644+0000","last_active":"2024-09-17T03:10:26.632322+0000","last_peered":"2024-09-17T03:10:26.632322+0000","last_clean":"2024-09-17T03:10:26.632322+0000","last_became_active":"2024-09-17T03:10:26.625302+0000","last_became_peered":"2024-09-17T03:10:26.625302+0000","last_unstale":"2024-09-17T03:10:26.632322+0000","last_undegraded":"2024-09-17T03:10:26.632322+0000","last_fullsized":"2024-09-17T03:10:26.632322+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:41.524955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.630548+0000","last_change":"2024-09-17T03:10:25.629526+0000","last_active":"2024-09-17T03:10:25.630548+0000","last_peered":"2024-09-17T03:10:25.630548+0000","last_clean":"2024-09-17T03:10:25.630548+0000","last_became_active":"2024-09-17T03:10:25.629138+0000","last_became_peered":"2024-09-17T03:10:25.629138+0000","last_unstale":"2024-09-17T03:10:25.630548+0000","last_undegraded":"2024-09-17T03:10:25.630548+0000","last_fullsized":"2024-09-17T03:10:25.630548+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:31.396010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613526+0000","last_change":"2024-09-17T03:10:25.613526+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613526+0000","last_undegraded":"2024-09-17T03:10:25.613526+0000","last_fullsized":"2024-09-17T03:10:25.613526+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.631522+0000","last_change":"2024-09-17T03:10:25.625114+0000","last_active":"2024-09-17T03:10:25.631522+0000","last_peered":"2024-09-17T03:10:25.631522+0000","last_clean":"2024-09-17T03:10:25.631522+0000","last_became_active":"2024-09-17T03:10:25.624791+0000","last_became_peered":"2024-09-17T03:10:25.624791+0000","last_unstale":"2024-09-17T03:10:25.631522+0000","last_undegraded":"2024-09-17T03:10:25.631522+0000","last_fullsized":"2024-09-17T03:10:25.631522+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:31.396010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.611619+0000","last_change":"2024-09-17T03:10:25.611619+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.611619+0000","last_undegraded":"2024-09-17T03:10:25.611619+0000","last_fullsized":"2024-09-17T03:10:25.611619+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.634008+0000","last_change":"2024-09-17T03:10:25.625645+0000","last_active":"2024-09-17T03:10:25.634008+0000","last_peered":"2024-09-17T03:10:25.634008+0000","last_clean":"2024-09-17T03:10:25.634008+0000","last_became_active":"2024-09-17T03:10:25.625291+0000","last_became_peered":"2024-09-17T03:10:25.625291+0000","last_unstale":"2024-09-17T03:10:25.634008+0000","last_undegraded":"2024-09-17T03:10:25.634008+0000","last_fullsized":"2024-09-17T03:10:25.634008+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:30.515112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613500+0000","last_change":"2024-09-17T03:10:25.613500+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613500+0000","last_undegraded":"2024-09-17T03:10:25.613500+0000","last_fullsized":"2024-09-17T03:10:25.613500+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.631751+0000","last_change":"2024-09-17T03:10:25.627675+0000","last_active":"2024-09-17T03:10:25.631751+0000","last_peered":"2024-09-17T03:10:25.631751+0000","last_clean":"2024-09-17T03:10:25.631751+0000","last_became_active":"2024-09-17T03:10:25.627236+0000","last_became_peered":"2024-09-17T03:10:25.627236+0000","last_unstale":"2024-09-17T03:10:25.631751+0000","last_undegraded":"2024-09-17T03:10:25.631751+0000","last_fullsized":"2024-09-17T03:10:25.631751+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:28.504300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":146,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.616638+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:10:25.616638+0000","last_peered":"2024-09-17T03:10:25.616638+0000","last_clean":"2024-09-17T03:10:25.616638+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:10:25.616638+0000","last_undegraded":"2024-09-17T03:10:25.616638+0000","last_fullsized":"2024-09-17T03:10:25.616638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1077248,"data_stored":780517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":495616,"data_stored":196416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":196416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":196416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":190149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":190149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1089536,"data_stored":786784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":520192,"data_stored":203829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:10:30.704 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:10:30.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.817+0000 7f7521733640 1 -- 172.21.15.78:0/2881627664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f751c0d2ed0 msgr2=0x7f751c0d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:30.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.817+0000 7f7521733640 1 --2- 172.21.15.78:0/2881627664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f751c0d2ed0 0x7f751c0d1a80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f750c009820 tx=0x7f750c02a510 comp rx=0 tx=0).stop 2024-09-17T03:10:30.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.818+0000 7f7521733640 1 -- 172.21.15.78:0/2881627664 shutdown_connections 2024-09-17T03:10:30.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.818+0000 7f7521733640 1 --2- 172.21.15.78:0/2881627664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f751c0d2ed0 0x7f751c0d1a80 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:30.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.818+0000 7f7521733640 1 -- 172.21.15.78:0/2881627664 >> 172.21.15.78:0/2881627664 conn(0x7f751c08bfc0 msgr2=0x7f751c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:30.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.818+0000 7f7521733640 1 -- 172.21.15.78:0/2881627664 shutdown_connections 2024-09-17T03:10:30.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.818+0000 7f7521733640 1 -- 172.21.15.78:0/2881627664 wait complete. 2024-09-17T03:10:30.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.819+0000 7f7521733640 1 Processor -- start 2024-09-17T03:10:30.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.819+0000 7f7521733640 1 -- start start 2024-09-17T03:10:30.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.821+0000 7f7521733640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f751c0b9b70 0x7f751c160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:30.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.821+0000 7f7521733640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f751c0cf7a0 0x7f751c0ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:30.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.821+0000 7f7521733640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f751c0d2ed0 0x7f751c0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:30.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.821+0000 7f7521733640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f751c162f70 con 0x7f751c0cf7a0 2024-09-17T03:10:30.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.821+0000 7f7521733640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f751c162df0 con 0x7f751c0d2ed0 2024-09-17T03:10:30.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.821+0000 7f7521733640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f751c1630f0 con 0x7f751c0b9b70 2024-09-17T03:10:30.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.821+0000 7f75127fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f751c0cf7a0 0x7f751c0ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:30.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.821+0000 7f75127fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f751c0cf7a0 0x7f751c0ce2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46866/0 (socket says 172.21.15.78:46866) 2024-09-17T03:10:30.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.821+0000 7f75127fc640 1 -- 172.21.15.78:0/458710453 learned_addr learned my addr 172.21.15.78:0/458710453 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:30.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.821+0000 7f751affd640 1 --2- 172.21.15.78:0/458710453 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f751c0b9b70 0x7f751c160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:30.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.821+0000 7f751b7fe640 1 --2- 172.21.15.78:0/458710453 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f751c0d2ed0 0x7f751c0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:30.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.821+0000 7f75127fc640 1 -- 172.21.15.78:0/458710453 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f751c0b9b70 msgr2=0x7f751c160ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:30.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.821+0000 7f75127fc640 1 --2- 172.21.15.78:0/458710453 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f751c0b9b70 0x7f751c160ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:30.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.821+0000 7f75127fc640 1 -- 172.21.15.78:0/458710453 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f751c0d2ed0 msgr2=0x7f751c0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:30.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.821+0000 7f75127fc640 1 --2- 172.21.15.78:0/458710453 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f751c0d2ed0 0x7f751c0cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:30.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.821+0000 7f75127fc640 1 -- 172.21.15.78:0/458710453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f751c0a04f0 con 0x7f751c0cf7a0 2024-09-17T03:10:30.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.821+0000 7f751b7fe640 1 --2- 172.21.15.78:0/458710453 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f751c0d2ed0 0x7f751c0cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:30.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.821+0000 7f75127fc640 1 --2- 172.21.15.78:0/458710453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f751c0cf7a0 0x7f751c0ce2d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f750400b3e0 tx=0x7f750400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:30.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.822+0000 7f7513fff640 1 -- 172.21.15.78:0/458710453 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7504015020 con 0x7f751c0cf7a0 2024-09-17T03:10:30.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.822+0000 7f7513fff640 1 -- 172.21.15.78:0/458710453 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7504011940 con 0x7f751c0cf7a0 2024-09-17T03:10:30.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.822+0000 7f7521733640 1 -- 172.21.15.78:0/458710453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f751c0a07d0 con 0x7f751c0cf7a0 2024-09-17T03:10:30.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.822+0000 7f7513fff640 1 -- 172.21.15.78:0/458710453 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7504011d90 con 0x7f751c0cf7a0 2024-09-17T03:10:30.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.822+0000 7f7521733640 1 -- 172.21.15.78:0/458710453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f751c0a0d90 con 0x7f751c0cf7a0 2024-09-17T03:10:30.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.823+0000 7f7521733640 1 -- 172.21.15.78:0/458710453 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f751c0a0240 con 0x7f751c0cf7a0 2024-09-17T03:10:30.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.823+0000 7f7513fff640 1 -- 172.21.15.78:0/458710453 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7504018020 con 0x7f751c0cf7a0 2024-09-17T03:10:30.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.824+0000 7f7513fff640 1 --2- 172.21.15.78:0/458710453 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74fc078b90 0x7f74fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:30.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.824+0000 7f7513fff640 1 -- 172.21.15.78:0/458710453 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f750409ab80 con 0x7f751c0cf7a0 2024-09-17T03:10:30.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.824+0000 7f751affd640 1 --2- 172.21.15.78:0/458710453 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74fc078b90 0x7f74fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:30.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.825+0000 7f751affd640 1 --2- 172.21.15.78:0/458710453 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74fc078b90 0x7f74fc07b0a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f750c034000 tx=0x7f750c004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:30.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:30.828+0000 7f7513fff640 1 -- 172.21.15.78:0/458710453 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f750401f020 con 0x7f751c0cf7a0 2024-09-17T03:10:30.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.000+0000 7f7521733640 1 -- 172.21.15.78:0/458710453 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f751c0d1a80 con 0x7f74fc078b90 2024-09-17T03:10:31.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.005+0000 7f7513fff640 1 -- 172.21.15.78:0/458710453 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247415 (secure 0 0 0) 0x7f751c0d1a80 con 0x7f74fc078b90 2024-09-17T03:10:31.007 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:31.008 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:10:31.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.008+0000 7f7521733640 1 -- 172.21.15.78:0/458710453 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74fc078b90 msgr2=0x7f74fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:31.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.008+0000 7f7521733640 1 --2- 172.21.15.78:0/458710453 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74fc078b90 0x7f74fc07b0a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f750c034000 tx=0x7f750c004730 comp rx=0 tx=0).stop 2024-09-17T03:10:31.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.008+0000 7f7521733640 1 -- 172.21.15.78:0/458710453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f751c0cf7a0 msgr2=0x7f751c0ce2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:31.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.008+0000 7f7521733640 1 --2- 172.21.15.78:0/458710453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f751c0cf7a0 0x7f751c0ce2d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f750400b3e0 tx=0x7f750400b8a0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.008+0000 7f7521733640 1 -- 172.21.15.78:0/458710453 shutdown_connections 2024-09-17T03:10:31.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.008+0000 7f7521733640 1 --2- 172.21.15.78:0/458710453 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74fc078b90 0x7f74fc07b0a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.008+0000 7f7521733640 1 --2- 172.21.15.78:0/458710453 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f751c0d2ed0 0x7f751c0cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.008+0000 7f7521733640 1 --2- 172.21.15.78:0/458710453 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f751c0cf7a0 0x7f751c0ce2d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.008+0000 7f7521733640 1 --2- 172.21.15.78:0/458710453 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f751c0b9b70 0x7f751c160ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.008+0000 7f7521733640 1 -- 172.21.15.78:0/458710453 >> 172.21.15.78:0/458710453 conn(0x7f751c08bfc0 msgr2=0x7f751c06ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:31.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.008+0000 7f7521733640 1 -- 172.21.15.78:0/458710453 shutdown_connections 2024-09-17T03:10:31.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.008+0000 7f7521733640 1 -- 172.21.15.78:0/458710453 wait complete. 2024-09-17T03:10:31.018 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2024-09-17T03:10:29.150302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":110,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229584,"kb_used_data":5020,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745136,"statfs":{"total":773094113280,"available":772859019264,"internally_reserved":0,"allocated":5140480,"data_stored":2740676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.545682"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615402+0000","last_change":"2024-09-17T03:10:25.615402+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615402+0000","last_undegraded":"2024-09-17T03:10:25.615402+0000","last_fullsized":"2024-09-17T03:10:25.615402+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616162+0000","last_change":"2024-09-17T03:10:25.616162+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616162+0000","last_undegraded":"2024-09-17T03:10:25.616162+0000","last_fullsized":"2024-09-17T03:10:25.616162+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.609754+0000","last_change":"2024-09-17T03:10:25.609754+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.609754+0000","last_undegraded":"2024-09-17T03:10:25.609754+0000","last_fullsized":"2024-09-17T03:10:25.609754+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.618870+0000","last_change":"2024-09-17T03:10:25.618870+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.618870+0000","last_undegraded":"2024-09-17T03:10:25.618870+0000","last_fullsized":"2024-09-17T03:10:25.618870+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614129+0000","last_change":"2024-09-17T03:10:25.614129+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614129+0000","last_undegraded":"2024-09-17T03:10:25.614129+0000","last_fullsized":"2024-09-17T03:10:25.614129+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.633121+0000","last_change":"2024-09-17T03:10:26.627225+0000","last_active":"2024-09-17T03:10:26.633121+0000","last_peered":"2024-09-17T03:10:26.633121+0000","last_clean":"2024-09-17T03:10:26.633121+0000","last_became_active":"2024-09-17T03:10:26.626923+0000","last_became_peered":"2024-09-17T03:10:26.626923+0000","last_unstale":"2024-09-17T03:10:26.633121+0000","last_undegraded":"2024-09-17T03:10:26.633121+0000","last_fullsized":"2024-09-17T03:10:26.633121+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:56.586793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615319+0000","last_change":"2024-09-17T03:10:25.615319+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615319+0000","last_undegraded":"2024-09-17T03:10:25.615319+0000","last_fullsized":"2024-09-17T03:10:25.615319+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616535+0000","last_change":"2024-09-17T03:10:25.616535+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616535+0000","last_undegraded":"2024-09-17T03:10:25.616535+0000","last_fullsized":"2024-09-17T03:10:25.616535+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616079+0000","last_change":"2024-09-17T03:10:25.616079+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616079+0000","last_undegraded":"2024-09-17T03:10:25.616079+0000","last_fullsized":"2024-09-17T03:10:25.616079+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615559+0000","last_change":"2024-09-17T03:10:25.615559+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615559+0000","last_undegraded":"2024-09-17T03:10:25.615559+0000","last_fullsized":"2024-09-17T03:10:25.615559+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615839+0000","last_change":"2024-09-17T03:10:25.615839+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615839+0000","last_undegraded":"2024-09-17T03:10:25.615839+0000","last_fullsized":"2024-09-17T03:10:25.615839+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615631+0000","last_change":"2024-09-17T03:10:25.615631+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615631+0000","last_undegraded":"2024-09-17T03:10:25.615631+0000","last_fullsized":"2024-09-17T03:10:25.615631+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616737+0000","last_change":"2024-09-17T03:10:25.616737+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616737+0000","last_undegraded":"2024-09-17T03:10:25.616737+0000","last_fullsized":"2024-09-17T03:10:25.616737+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615070+0000","last_change":"2024-09-17T03:10:25.615070+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615070+0000","last_undegraded":"2024-09-17T03:10:25.615070+0000","last_fullsized":"2024-09-17T03:10:25.615070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.632804+0000","last_change":"2024-09-17T03:10:26.626832+0000","last_active":"2024-09-17T03:10:26.632804+0000","last_peered":"2024-09-17T03:10:26.632804+0000","last_clean":"2024-09-17T03:10:26.632804+0000","last_became_active":"2024-09-17T03:10:26.625618+0000","last_became_peered":"2024-09-17T03:10:26.625618+0000","last_unstale":"2024-09-17T03:10:26.632804+0000","last_undegraded":"2024-09-17T03:10:26.632804+0000","last_fullsized":"2024-09-17T03:10:26.632804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:11.569131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614248+0000","last_change":"2024-09-17T03:10:25.614248+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614248+0000","last_undegraded":"2024-09-17T03:10:25.614248+0000","last_fullsized":"2024-09-17T03:10:25.614248+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.608846+0000","last_change":"2024-09-17T03:10:25.608846+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.608846+0000","last_undegraded":"2024-09-17T03:10:25.608846+0000","last_fullsized":"2024-09-17T03:10:25.608846+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.610584+0000","last_change":"2024-09-17T03:10:25.610584+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.610584+0000","last_undegraded":"2024-09-17T03:10:25.610584+0000","last_fullsized":"2024-09-17T03:10:25.610584+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.611206+0000","last_change":"2024-09-17T03:10:25.611206+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.611206+0000","last_undegraded":"2024-09-17T03:10:25.611206+0000","last_fullsized":"2024-09-17T03:10:25.611206+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616259+0000","last_change":"2024-09-17T03:10:25.616259+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616259+0000","last_undegraded":"2024-09-17T03:10:25.616259+0000","last_fullsized":"2024-09-17T03:10:25.616259+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.640384+0000","last_change":"2024-09-17T03:10:26.636653+0000","last_active":"2024-09-17T03:10:26.640384+0000","last_peered":"2024-09-17T03:10:26.640384+0000","last_clean":"2024-09-17T03:10:26.640384+0000","last_became_active":"2024-09-17T03:10:26.636103+0000","last_became_peered":"2024-09-17T03:10:26.636103+0000","last_unstale":"2024-09-17T03:10:26.640384+0000","last_undegraded":"2024-09-17T03:10:26.640384+0000","last_fullsized":"2024-09-17T03:10:26.640384+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:07.048273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614516+0000","last_change":"2024-09-17T03:10:25.614516+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614516+0000","last_undegraded":"2024-09-17T03:10:25.614516+0000","last_fullsized":"2024-09-17T03:10:25.614516+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.612876+0000","last_change":"2024-09-17T03:10:25.612876+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.612876+0000","last_undegraded":"2024-09-17T03:10:25.612876+0000","last_fullsized":"2024-09-17T03:10:25.612876+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.612070+0000","last_change":"2024-09-17T03:10:25.612070+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.612070+0000","last_undegraded":"2024-09-17T03:10:25.612070+0000","last_fullsized":"2024-09-17T03:10:25.612070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614092+0000","last_change":"2024-09-17T03:10:25.614092+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614092+0000","last_undegraded":"2024-09-17T03:10:25.614092+0000","last_fullsized":"2024-09-17T03:10:25.614092+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615695+0000","last_change":"2024-09-17T03:10:25.615695+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615695+0000","last_undegraded":"2024-09-17T03:10:25.615695+0000","last_fullsized":"2024-09-17T03:10:25.615695+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.609226+0000","last_change":"2024-09-17T03:10:25.609226+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.609226+0000","last_undegraded":"2024-09-17T03:10:25.609226+0000","last_fullsized":"2024-09-17T03:10:25.609226+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615144+0000","last_change":"2024-09-17T03:10:25.615144+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615144+0000","last_undegraded":"2024-09-17T03:10:25.615144+0000","last_fullsized":"2024-09-17T03:10:25.615144+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.610015+0000","last_change":"2024-09-17T03:10:25.610015+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.610015+0000","last_undegraded":"2024-09-17T03:10:25.610015+0000","last_fullsized":"2024-09-17T03:10:25.610015+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.610387+0000","last_change":"2024-09-17T03:10:25.610387+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.610387+0000","last_undegraded":"2024-09-17T03:10:25.610387+0000","last_fullsized":"2024-09-17T03:10:25.610387+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.640234+0000","last_change":"2024-09-17T03:10:26.632798+0000","last_active":"2024-09-17T03:10:26.640234+0000","last_peered":"2024-09-17T03:10:26.640234+0000","last_clean":"2024-09-17T03:10:26.640234+0000","last_became_active":"2024-09-17T03:10:26.632513+0000","last_became_peered":"2024-09-17T03:10:26.632513+0000","last_unstale":"2024-09-17T03:10:26.640234+0000","last_undegraded":"2024-09-17T03:10:26.640234+0000","last_fullsized":"2024-09-17T03:10:26.640234+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:16.049381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615186+0000","last_change":"2024-09-17T03:10:25.615186+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615186+0000","last_undegraded":"2024-09-17T03:10:25.615186+0000","last_fullsized":"2024-09-17T03:10:25.615186+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615543+0000","last_change":"2024-09-17T03:10:25.615543+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615543+0000","last_undegraded":"2024-09-17T03:10:25.615543+0000","last_fullsized":"2024-09-17T03:10:25.615543+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.639313+0000","last_change":"2024-09-17T03:10:25.630050+0000","last_active":"2024-09-17T03:10:26.639313+0000","last_peered":"2024-09-17T03:10:26.639313+0000","last_clean":"2024-09-17T03:10:26.639313+0000","last_became_active":"2024-09-17T03:10:25.629738+0000","last_became_peered":"2024-09-17T03:10:25.629738+0000","last_unstale":"2024-09-17T03:10:26.639313+0000","last_undegraded":"2024-09-17T03:10:26.639313+0000","last_fullsized":"2024-09-17T03:10:26.639313+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:34.296787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613567+0000","last_change":"2024-09-17T03:10:25.613567+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613567+0000","last_undegraded":"2024-09-17T03:10:25.613567+0000","last_fullsized":"2024-09-17T03:10:25.613567+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.621731+0000","last_change":"2024-09-17T03:10:25.616451+0000","last_active":"2024-09-17T03:10:25.621731+0000","last_peered":"2024-09-17T03:10:25.621731+0000","last_clean":"2024-09-17T03:10:25.621731+0000","last_became_active":"2024-09-17T03:10:25.616110+0000","last_became_peered":"2024-09-17T03:10:25.616110+0000","last_unstale":"2024-09-17T03:10:25.621731+0000","last_undegraded":"2024-09-17T03:10:25.621731+0000","last_fullsized":"2024-09-17T03:10:25.621731+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:23.827138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614645+0000","last_change":"2024-09-17T03:10:25.614645+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614645+0000","last_undegraded":"2024-09-17T03:10:25.614645+0000","last_fullsized":"2024-09-17T03:10:25.614645+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.631530+0000","last_change":"2024-09-17T03:10:25.626520+0000","last_active":"2024-09-17T03:10:25.631530+0000","last_peered":"2024-09-17T03:10:25.631530+0000","last_clean":"2024-09-17T03:10:25.631530+0000","last_became_active":"2024-09-17T03:10:25.626229+0000","last_became_peered":"2024-09-17T03:10:25.626229+0000","last_unstale":"2024-09-17T03:10:25.631530+0000","last_undegraded":"2024-09-17T03:10:25.631530+0000","last_fullsized":"2024-09-17T03:10:25.631530+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:18.573372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616315+0000","last_change":"2024-09-17T03:10:25.616315+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616315+0000","last_undegraded":"2024-09-17T03:10:25.616315+0000","last_fullsized":"2024-09-17T03:10:25.616315+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.628587+0000","last_change":"2024-09-17T03:10:25.626034+0000","last_active":"2024-09-17T03:10:25.628587+0000","last_peered":"2024-09-17T03:10:25.628587+0000","last_clean":"2024-09-17T03:10:25.628587+0000","last_became_active":"2024-09-17T03:10:25.625671+0000","last_became_peered":"2024-09-17T03:10:25.625671+0000","last_unstale":"2024-09-17T03:10:25.628587+0000","last_undegraded":"2024-09-17T03:10:25.628587+0000","last_fullsized":"2024-09-17T03:10:25.628587+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:51.028351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.609800+0000","last_change":"2024-09-17T03:10:25.609800+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.609800+0000","last_undegraded":"2024-09-17T03:10:25.609800+0000","last_fullsized":"2024-09-17T03:10:25.609800+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.630431+0000","last_change":"2024-09-17T03:10:25.627030+0000","last_active":"2024-09-17T03:10:26.630431+0000","last_peered":"2024-09-17T03:10:26.630431+0000","last_clean":"2024-09-17T03:10:26.630431+0000","last_became_active":"2024-09-17T03:10:25.626746+0000","last_became_peered":"2024-09-17T03:10:25.626746+0000","last_unstale":"2024-09-17T03:10:26.630431+0000","last_undegraded":"2024-09-17T03:10:26.630431+0000","last_fullsized":"2024-09-17T03:10:26.630431+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:20.215142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614407+0000","last_change":"2024-09-17T03:10:25.614407+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614407+0000","last_undegraded":"2024-09-17T03:10:25.614407+0000","last_fullsized":"2024-09-17T03:10:25.614407+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.626927+0000","last_change":"2024-09-17T03:10:25.624581+0000","last_active":"2024-09-17T03:10:25.626927+0000","last_peered":"2024-09-17T03:10:25.626927+0000","last_clean":"2024-09-17T03:10:25.626927+0000","last_became_active":"2024-09-17T03:10:25.623625+0000","last_became_peered":"2024-09-17T03:10:25.623625+0000","last_unstale":"2024-09-17T03:10:25.626927+0000","last_undegraded":"2024-09-17T03:10:25.626927+0000","last_fullsized":"2024-09-17T03:10:25.626927+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:32.576616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613970+0000","last_change":"2024-09-17T03:10:25.613970+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613970+0000","last_undegraded":"2024-09-17T03:10:25.613970+0000","last_fullsized":"2024-09-17T03:10:25.613970+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.630138+0000","last_change":"2024-09-17T03:10:25.625253+0000","last_active":"2024-09-17T03:10:25.630138+0000","last_peered":"2024-09-17T03:10:25.630138+0000","last_clean":"2024-09-17T03:10:25.630138+0000","last_became_active":"2024-09-17T03:10:25.624870+0000","last_became_peered":"2024-09-17T03:10:25.624870+0000","last_unstale":"2024-09-17T03:10:25.630138+0000","last_undegraded":"2024-09-17T03:10:25.630138+0000","last_fullsized":"2024-09-17T03:10:25.630138+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:16.507885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613828+0000","last_change":"2024-09-17T03:10:25.613828+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613828+0000","last_undegraded":"2024-09-17T03:10:25.613828+0000","last_fullsized":"2024-09-17T03:10:25.613828+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.634039+0000","last_change":"2024-09-17T03:10:25.628027+0000","last_active":"2024-09-17T03:10:25.634039+0000","last_peered":"2024-09-17T03:10:25.634039+0000","last_clean":"2024-09-17T03:10:25.634039+0000","last_became_active":"2024-09-17T03:10:25.624938+0000","last_became_peered":"2024-09-17T03:10:25.624938+0000","last_unstale":"2024-09-17T03:10:25.634039+0000","last_undegraded":"2024-09-17T03:10:25.634039+0000","last_fullsized":"2024-09-17T03:10:25.634039+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:24.615797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.609938+0000","last_change":"2024-09-17T03:10:25.609938+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.609938+0000","last_undegraded":"2024-09-17T03:10:25.609938+0000","last_fullsized":"2024-09-17T03:10:25.609938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.621285+0000","last_change":"2024-09-17T03:10:25.619136+0000","last_active":"2024-09-17T03:10:25.621285+0000","last_peered":"2024-09-17T03:10:25.621285+0000","last_clean":"2024-09-17T03:10:25.621285+0000","last_became_active":"2024-09-17T03:10:25.618816+0000","last_became_peered":"2024-09-17T03:10:25.618816+0000","last_unstale":"2024-09-17T03:10:25.621285+0000","last_undegraded":"2024-09-17T03:10:25.621285+0000","last_fullsized":"2024-09-17T03:10:25.621285+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:47.735636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613992+0000","last_change":"2024-09-17T03:10:25.613992+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613992+0000","last_undegraded":"2024-09-17T03:10:25.613992+0000","last_fullsized":"2024-09-17T03:10:25.613992+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.627651+0000","last_change":"2024-09-17T03:10:25.623416+0000","last_active":"2024-09-17T03:10:25.627651+0000","last_peered":"2024-09-17T03:10:25.627651+0000","last_clean":"2024-09-17T03:10:25.627651+0000","last_became_active":"2024-09-17T03:10:25.623090+0000","last_became_peered":"2024-09-17T03:10:25.623090+0000","last_unstale":"2024-09-17T03:10:25.627651+0000","last_undegraded":"2024-09-17T03:10:25.627651+0000","last_fullsized":"2024-09-17T03:10:25.627651+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:20.799970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.632253+0000","last_change":"2024-09-17T03:10:26.626795+0000","last_active":"2024-09-17T03:10:26.632253+0000","last_peered":"2024-09-17T03:10:26.632253+0000","last_clean":"2024-09-17T03:10:26.632253+0000","last_became_active":"2024-09-17T03:10:26.625634+0000","last_became_peered":"2024-09-17T03:10:26.625634+0000","last_unstale":"2024-09-17T03:10:26.632253+0000","last_undegraded":"2024-09-17T03:10:26.632253+0000","last_fullsized":"2024-09-17T03:10:26.632253+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:40.332682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.628554+0000","last_change":"2024-09-17T03:10:25.625282+0000","last_active":"2024-09-17T03:10:25.628554+0000","last_peered":"2024-09-17T03:10:25.628554+0000","last_clean":"2024-09-17T03:10:25.628554+0000","last_became_active":"2024-09-17T03:10:25.624893+0000","last_became_peered":"2024-09-17T03:10:25.624893+0000","last_unstale":"2024-09-17T03:10:25.628554+0000","last_undegraded":"2024-09-17T03:10:25.628554+0000","last_fullsized":"2024-09-17T03:10:25.628554+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:16.507885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614580+0000","last_change":"2024-09-17T03:10:25.614580+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614580+0000","last_undegraded":"2024-09-17T03:10:25.614580+0000","last_fullsized":"2024-09-17T03:10:25.614580+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.621247+0000","last_change":"2024-09-17T03:10:25.614140+0000","last_active":"2024-09-17T03:10:25.621247+0000","last_peered":"2024-09-17T03:10:25.621247+0000","last_clean":"2024-09-17T03:10:25.621247+0000","last_became_active":"2024-09-17T03:10:25.613844+0000","last_became_peered":"2024-09-17T03:10:25.613844+0000","last_unstale":"2024-09-17T03:10:25.621247+0000","last_undegraded":"2024-09-17T03:10:25.621247+0000","last_fullsized":"2024-09-17T03:10:25.621247+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:49.842511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.609410+0000","last_change":"2024-09-17T03:10:25.609410+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.609410+0000","last_undegraded":"2024-09-17T03:10:25.609410+0000","last_fullsized":"2024-09-17T03:10:25.609410+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.632428+0000","last_change":"2024-09-17T03:10:25.630508+0000","last_active":"2024-09-17T03:10:26.632428+0000","last_peered":"2024-09-17T03:10:26.632428+0000","last_clean":"2024-09-17T03:10:26.632428+0000","last_became_active":"2024-09-17T03:10:25.630209+0000","last_became_peered":"2024-09-17T03:10:25.630209+0000","last_unstale":"2024-09-17T03:10:26.632428+0000","last_undegraded":"2024-09-17T03:10:26.632428+0000","last_fullsized":"2024-09-17T03:10:26.632428+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:15.757991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613962+0000","last_change":"2024-09-17T03:10:25.613962+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613962+0000","last_undegraded":"2024-09-17T03:10:25.613962+0000","last_fullsized":"2024-09-17T03:10:25.613962+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.632215+0000","last_change":"2024-09-17T03:10:25.628330+0000","last_active":"2024-09-17T03:10:25.632215+0000","last_peered":"2024-09-17T03:10:25.632215+0000","last_clean":"2024-09-17T03:10:25.632215+0000","last_became_active":"2024-09-17T03:10:25.627919+0000","last_became_peered":"2024-09-17T03:10:25.627919+0000","last_unstale":"2024-09-17T03:10:25.632215+0000","last_undegraded":"2024-09-17T03:10:25.632215+0000","last_fullsized":"2024-09-17T03:10:25.632215+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:14.190956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.637269+0000","last_change":"2024-09-17T03:10:26.630787+0000","last_active":"2024-09-17T03:10:26.637269+0000","last_peered":"2024-09-17T03:10:26.637269+0000","last_clean":"2024-09-17T03:10:26.637269+0000","last_became_active":"2024-09-17T03:10:26.629999+0000","last_became_peered":"2024-09-17T03:10:26.629999+0000","last_unstale":"2024-09-17T03:10:26.637269+0000","last_undegraded":"2024-09-17T03:10:26.637269+0000","last_fullsized":"2024-09-17T03:10:26.637269+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:54.370486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.614340+0000","last_change":"2024-09-17T03:10:25.625455+0000","last_active":"2024-09-17T03:10:26.614340+0000","last_peered":"2024-09-17T03:10:26.614340+0000","last_clean":"2024-09-17T03:10:26.614340+0000","last_became_active":"2024-09-17T03:10:25.625151+0000","last_became_peered":"2024-09-17T03:10:25.625151+0000","last_unstale":"2024-09-17T03:10:26.614340+0000","last_undegraded":"2024-09-17T03:10:26.614340+0000","last_fullsized":"2024-09-17T03:10:26.614340+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:24.800733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613788+0000","last_change":"2024-09-17T03:10:25.613788+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613788+0000","last_undegraded":"2024-09-17T03:10:25.613788+0000","last_fullsized":"2024-09-17T03:10:25.613788+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.627892+0000","last_change":"2024-09-17T03:10:25.623870+0000","last_active":"2024-09-17T03:10:25.627892+0000","last_peered":"2024-09-17T03:10:25.627892+0000","last_clean":"2024-09-17T03:10:25.627892+0000","last_became_active":"2024-09-17T03:10:25.622936+0000","last_became_peered":"2024-09-17T03:10:25.622936+0000","last_unstale":"2024-09-17T03:10:25.627892+0000","last_undegraded":"2024-09-17T03:10:25.627892+0000","last_fullsized":"2024-09-17T03:10:25.627892+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:36.802376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614663+0000","last_change":"2024-09-17T03:10:25.614663+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614663+0000","last_undegraded":"2024-09-17T03:10:25.614663+0000","last_fullsized":"2024-09-17T03:10:25.614663+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.636862+0000","last_change":"2024-09-17T03:10:25.627052+0000","last_active":"2024-09-17T03:10:25.636862+0000","last_peered":"2024-09-17T03:10:25.636862+0000","last_clean":"2024-09-17T03:10:25.636862+0000","last_became_active":"2024-09-17T03:10:25.626732+0000","last_became_peered":"2024-09-17T03:10:25.626732+0000","last_unstale":"2024-09-17T03:10:25.636862+0000","last_undegraded":"2024-09-17T03:10:25.636862+0000","last_fullsized":"2024-09-17T03:10:25.636862+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:45.402110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614027+0000","last_change":"2024-09-17T03:10:25.614027+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614027+0000","last_undegraded":"2024-09-17T03:10:25.614027+0000","last_fullsized":"2024-09-17T03:10:25.614027+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.626596+0000","last_change":"2024-09-17T03:10:25.622889+0000","last_active":"2024-09-17T03:10:25.626596+0000","last_peered":"2024-09-17T03:10:25.626596+0000","last_clean":"2024-09-17T03:10:25.626596+0000","last_became_active":"2024-09-17T03:10:25.622552+0000","last_became_peered":"2024-09-17T03:10:25.622552+0000","last_unstale":"2024-09-17T03:10:25.626596+0000","last_undegraded":"2024-09-17T03:10:25.626596+0000","last_fullsized":"2024-09-17T03:10:25.626596+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:57.309006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.610556+0000","last_change":"2024-09-17T03:10:25.610556+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.610556+0000","last_undegraded":"2024-09-17T03:10:25.610556+0000","last_fullsized":"2024-09-17T03:10:25.610556+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.630021+0000","last_change":"2024-09-17T03:10:25.625213+0000","last_active":"2024-09-17T03:10:25.630021+0000","last_peered":"2024-09-17T03:10:25.630021+0000","last_clean":"2024-09-17T03:10:25.630021+0000","last_became_active":"2024-09-17T03:10:25.624885+0000","last_became_peered":"2024-09-17T03:10:25.624885+0000","last_unstale":"2024-09-17T03:10:25.630021+0000","last_undegraded":"2024-09-17T03:10:25.630021+0000","last_fullsized":"2024-09-17T03:10:25.630021+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:40.794606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.612590+0000","last_change":"2024-09-17T03:10:25.612590+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.612590+0000","last_undegraded":"2024-09-17T03:10:25.612590+0000","last_fullsized":"2024-09-17T03:10:25.612590+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.616186+0000","last_change":"2024-09-17T03:10:25.626305+0000","last_active":"2024-09-17T03:10:26.616186+0000","last_peered":"2024-09-17T03:10:26.616186+0000","last_clean":"2024-09-17T03:10:26.616186+0000","last_became_active":"2024-09-17T03:10:25.626021+0000","last_became_peered":"2024-09-17T03:10:25.626021+0000","last_unstale":"2024-09-17T03:10:26.616186+0000","last_undegraded":"2024-09-17T03:10:26.616186+0000","last_fullsized":"2024-09-17T03:10:26.616186+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:20.547659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.637228+0000","last_change":"2024-09-17T03:10:26.628582+0000","last_active":"2024-09-17T03:10:26.637228+0000","last_peered":"2024-09-17T03:10:26.637228+0000","last_clean":"2024-09-17T03:10:26.637228+0000","last_became_active":"2024-09-17T03:10:26.628003+0000","last_became_peered":"2024-09-17T03:10:26.628003+0000","last_unstale":"2024-09-17T03:10:26.637228+0000","last_undegraded":"2024-09-17T03:10:26.637228+0000","last_fullsized":"2024-09-17T03:10:26.637228+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:48.501354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.630505+0000","last_change":"2024-09-17T03:10:25.628379+0000","last_active":"2024-09-17T03:10:26.630505+0000","last_peered":"2024-09-17T03:10:26.630505+0000","last_clean":"2024-09-17T03:10:26.630505+0000","last_became_active":"2024-09-17T03:10:25.628078+0000","last_became_peered":"2024-09-17T03:10:25.628078+0000","last_unstale":"2024-09-17T03:10:26.630505+0000","last_undegraded":"2024-09-17T03:10:26.630505+0000","last_fullsized":"2024-09-17T03:10:26.630505+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:23.877248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614989+0000","last_change":"2024-09-17T03:10:25.614989+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614989+0000","last_undegraded":"2024-09-17T03:10:25.614989+0000","last_fullsized":"2024-09-17T03:10:25.614989+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.630033+0000","last_change":"2024-09-17T03:10:25.626068+0000","last_active":"2024-09-17T03:10:25.630033+0000","last_peered":"2024-09-17T03:10:25.630033+0000","last_clean":"2024-09-17T03:10:25.630033+0000","last_became_active":"2024-09-17T03:10:25.625744+0000","last_became_peered":"2024-09-17T03:10:25.625744+0000","last_unstale":"2024-09-17T03:10:25.630033+0000","last_undegraded":"2024-09-17T03:10:25.630033+0000","last_fullsized":"2024-09-17T03:10:25.630033+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:51.028351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614118+0000","last_change":"2024-09-17T03:10:25.614118+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614118+0000","last_undegraded":"2024-09-17T03:10:25.614118+0000","last_fullsized":"2024-09-17T03:10:25.614118+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.627537+0000","last_change":"2024-09-17T03:10:25.622607+0000","last_active":"2024-09-17T03:10:25.627537+0000","last_peered":"2024-09-17T03:10:25.627537+0000","last_clean":"2024-09-17T03:10:25.627537+0000","last_became_active":"2024-09-17T03:10:25.622323+0000","last_became_peered":"2024-09-17T03:10:25.622323+0000","last_unstale":"2024-09-17T03:10:25.627537+0000","last_undegraded":"2024-09-17T03:10:25.627537+0000","last_fullsized":"2024-09-17T03:10:25.627537+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:40.437500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613466+0000","last_change":"2024-09-17T03:10:25.613466+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613466+0000","last_undegraded":"2024-09-17T03:10:25.613466+0000","last_fullsized":"2024-09-17T03:10:25.613466+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.632220+0000","last_change":"2024-09-17T03:10:25.628191+0000","last_active":"2024-09-17T03:10:25.632220+0000","last_peered":"2024-09-17T03:10:25.632220+0000","last_clean":"2024-09-17T03:10:25.632220+0000","last_became_active":"2024-09-17T03:10:25.627726+0000","last_became_peered":"2024-09-17T03:10:25.627726+0000","last_unstale":"2024-09-17T03:10:25.632220+0000","last_undegraded":"2024-09-17T03:10:25.632220+0000","last_fullsized":"2024-09-17T03:10:25.632220+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:21.661328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.612910+0000","last_change":"2024-09-17T03:10:25.612910+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.612910+0000","last_undegraded":"2024-09-17T03:10:25.612910+0000","last_fullsized":"2024-09-17T03:10:25.612910+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.613158+0000","last_change":"2024-09-17T03:10:25.629315+0000","last_active":"2024-09-17T03:10:27.613158+0000","last_peered":"2024-09-17T03:10:27.613158+0000","last_clean":"2024-09-17T03:10:27.613158+0000","last_became_active":"2024-09-17T03:10:25.629015+0000","last_became_peered":"2024-09-17T03:10:25.629015+0000","last_unstale":"2024-09-17T03:10:27.613158+0000","last_undegraded":"2024-09-17T03:10:27.613158+0000","last_fullsized":"2024-09-17T03:10:27.613158+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:30.992821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613385+0000","last_change":"2024-09-17T03:10:25.613385+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613385+0000","last_undegraded":"2024-09-17T03:10:25.613385+0000","last_fullsized":"2024-09-17T03:10:25.613385+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.630605+0000","last_change":"2024-09-17T03:10:25.627561+0000","last_active":"2024-09-17T03:10:25.630605+0000","last_peered":"2024-09-17T03:10:25.630605+0000","last_clean":"2024-09-17T03:10:25.630605+0000","last_became_active":"2024-09-17T03:10:25.627173+0000","last_became_peered":"2024-09-17T03:10:25.627173+0000","last_unstale":"2024-09-17T03:10:25.630605+0000","last_undegraded":"2024-09-17T03:10:25.630605+0000","last_fullsized":"2024-09-17T03:10:25.630605+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:28.504300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613721+0000","last_change":"2024-09-17T03:10:25.613721+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613721+0000","last_undegraded":"2024-09-17T03:10:25.613721+0000","last_fullsized":"2024-09-17T03:10:25.613721+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.626996+0000","last_change":"2024-09-17T03:10:25.622690+0000","last_active":"2024-09-17T03:10:25.626996+0000","last_peered":"2024-09-17T03:10:25.626996+0000","last_clean":"2024-09-17T03:10:25.626996+0000","last_became_active":"2024-09-17T03:10:25.622386+0000","last_became_peered":"2024-09-17T03:10:25.622386+0000","last_unstale":"2024-09-17T03:10:25.626996+0000","last_undegraded":"2024-09-17T03:10:25.626996+0000","last_fullsized":"2024-09-17T03:10:25.626996+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:32.576616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.637199+0000","last_change":"2024-09-17T03:10:26.628270+0000","last_active":"2024-09-17T03:10:26.637199+0000","last_peered":"2024-09-17T03:10:26.637199+0000","last_clean":"2024-09-17T03:10:26.637199+0000","last_became_active":"2024-09-17T03:10:26.627647+0000","last_became_peered":"2024-09-17T03:10:26.627647+0000","last_unstale":"2024-09-17T03:10:26.637199+0000","last_undegraded":"2024-09-17T03:10:26.637199+0000","last_fullsized":"2024-09-17T03:10:26.637199+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:38.953959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.626902+0000","last_change":"2024-09-17T03:10:25.623065+0000","last_active":"2024-09-17T03:10:25.626902+0000","last_peered":"2024-09-17T03:10:25.626902+0000","last_clean":"2024-09-17T03:10:25.626902+0000","last_became_active":"2024-09-17T03:10:25.621840+0000","last_became_peered":"2024-09-17T03:10:25.621840+0000","last_unstale":"2024-09-17T03:10:25.626902+0000","last_undegraded":"2024-09-17T03:10:25.626902+0000","last_fullsized":"2024-09-17T03:10:25.626902+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:40.794606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.632322+0000","last_change":"2024-09-17T03:10:26.625644+0000","last_active":"2024-09-17T03:10:26.632322+0000","last_peered":"2024-09-17T03:10:26.632322+0000","last_clean":"2024-09-17T03:10:26.632322+0000","last_became_active":"2024-09-17T03:10:26.625302+0000","last_became_peered":"2024-09-17T03:10:26.625302+0000","last_unstale":"2024-09-17T03:10:26.632322+0000","last_undegraded":"2024-09-17T03:10:26.632322+0000","last_fullsized":"2024-09-17T03:10:26.632322+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:41.524955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.630548+0000","last_change":"2024-09-17T03:10:25.629526+0000","last_active":"2024-09-17T03:10:25.630548+0000","last_peered":"2024-09-17T03:10:25.630548+0000","last_clean":"2024-09-17T03:10:25.630548+0000","last_became_active":"2024-09-17T03:10:25.629138+0000","last_became_peered":"2024-09-17T03:10:25.629138+0000","last_unstale":"2024-09-17T03:10:25.630548+0000","last_undegraded":"2024-09-17T03:10:25.630548+0000","last_fullsized":"2024-09-17T03:10:25.630548+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:31.396010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613526+0000","last_change":"2024-09-17T03:10:25.613526+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613526+0000","last_undegraded":"2024-09-17T03:10:25.613526+0000","last_fullsized":"2024-09-17T03:10:25.613526+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.631522+0000","last_change":"2024-09-17T03:10:25.625114+0000","last_active":"2024-09-17T03:10:25.631522+0000","last_peered":"2024-09-17T03:10:25.631522+0000","last_clean":"2024-09-17T03:10:25.631522+0000","last_became_active":"2024-09-17T03:10:25.624791+0000","last_became_peered":"2024-09-17T03:10:25.624791+0000","last_unstale":"2024-09-17T03:10:25.631522+0000","last_undegraded":"2024-09-17T03:10:25.631522+0000","last_fullsized":"2024-09-17T03:10:25.631522+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:31.396010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.611619+0000","last_change":"2024-09-17T03:10:25.611619+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.611619+0000","last_undegraded":"2024-09-17T03:10:25.611619+0000","last_fullsized":"2024-09-17T03:10:25.611619+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.634008+0000","last_change":"2024-09-17T03:10:25.625645+0000","last_active":"2024-09-17T03:10:25.634008+0000","last_peered":"2024-09-17T03:10:25.634008+0000","last_clean":"2024-09-17T03:10:25.634008+0000","last_became_active":"2024-09-17T03:10:25.625291+0000","last_became_peered":"2024-09-17T03:10:25.625291+0000","last_unstale":"2024-09-17T03:10:25.634008+0000","last_undegraded":"2024-09-17T03:10:25.634008+0000","last_fullsized":"2024-09-17T03:10:25.634008+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:30.515112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613500+0000","last_change":"2024-09-17T03:10:25.613500+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613500+0000","last_undegraded":"2024-09-17T03:10:25.613500+0000","last_fullsized":"2024-09-17T03:10:25.613500+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.631751+0000","last_change":"2024-09-17T03:10:25.627675+0000","last_active":"2024-09-17T03:10:25.631751+0000","last_peered":"2024-09-17T03:10:25.631751+0000","last_clean":"2024-09-17T03:10:25.631751+0000","last_became_active":"2024-09-17T03:10:25.627236+0000","last_became_peered":"2024-09-17T03:10:25.627236+0000","last_unstale":"2024-09-17T03:10:25.631751+0000","last_undegraded":"2024-09-17T03:10:25.631751+0000","last_fullsized":"2024-09-17T03:10:25.631751+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:28.504300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":146,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.616638+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:10:25.616638+0000","last_peered":"2024-09-17T03:10:25.616638+0000","last_clean":"2024-09-17T03:10:25.616638+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:10:25.616638+0000","last_undegraded":"2024-09-17T03:10:25.616638+0000","last_fullsized":"2024-09-17T03:10:25.616638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1077248,"data_stored":780517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":495616,"data_stored":196416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":196416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":196416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":190149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":190149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1089536,"data_stored":786784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":520192,"data_stored":203829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:10:31.022 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:10:31.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.171+0000 7fdde7c69640 1 -- 172.21.15.78:0/3658584312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdde00d1490 msgr2=0x7fdde01674d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:31.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.171+0000 7fdde7c69640 1 --2- 172.21.15.78:0/3658584312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdde00d1490 0x7fdde01674d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fddd8005fd0 tx=0x7fddd802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.171+0000 7fdde7c69640 1 -- 172.21.15.78:0/3658584312 shutdown_connections 2024-09-17T03:10:31.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.171+0000 7fdde7c69640 1 --2- 172.21.15.78:0/3658584312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdde00d1490 0x7fdde01674d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.171+0000 7fdde7c69640 1 -- 172.21.15.78:0/3658584312 >> 172.21.15.78:0/3658584312 conn(0x7fdde0072ae0 msgr2=0x7fdde0072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:31.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.171+0000 7fdde7c69640 1 -- 172.21.15.78:0/3658584312 shutdown_connections 2024-09-17T03:10:31.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.171+0000 7fdde7c69640 1 -- 172.21.15.78:0/3658584312 wait complete. 2024-09-17T03:10:31.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.172+0000 7fdde7c69640 1 Processor -- start 2024-09-17T03:10:31.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.172+0000 7fdde7c69640 1 -- start start 2024-09-17T03:10:31.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.174+0000 7fdde7c69640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdde00b51c0 0x7fdde015cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:31.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.174+0000 7fdde7c69640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdde00ccbd0 0x7fdde014f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:31.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.174+0000 7fdde7c69640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdde00d1490 0x7fdde0153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:31.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.174+0000 7fdde7c69640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdde0167da0 con 0x7fdde00d1490 2024-09-17T03:10:31.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.174+0000 7fdde7c69640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdde0167c20 con 0x7fdde00ccbd0 2024-09-17T03:10:31.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.174+0000 7fdde7c69640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fdde0167f20 con 0x7fdde00b51c0 2024-09-17T03:10:31.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.174+0000 7fdde6206640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdde00d1490 0x7fdde0153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:31.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.174+0000 7fdde6206640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdde00d1490 0x7fdde0153000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46888/0 (socket says 172.21.15.78:46888) 2024-09-17T03:10:31.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.174+0000 7fdde6206640 1 -- 172.21.15.78:0/1625148662 learned_addr learned my addr 172.21.15.78:0/1625148662 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:31.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.174+0000 7fdde5204640 1 --2- 172.21.15.78:0/1625148662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdde00ccbd0 0x7fdde014f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:31.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.174+0000 7fdde5a05640 1 --2- 172.21.15.78:0/1625148662 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdde00b51c0 0x7fdde015cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:31.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.174+0000 7fdde6206640 1 -- 172.21.15.78:0/1625148662 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdde00b51c0 msgr2=0x7fdde015cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:31.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.174+0000 7fdde6206640 1 --2- 172.21.15.78:0/1625148662 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdde00b51c0 0x7fdde015cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.174+0000 7fdde6206640 1 -- 172.21.15.78:0/1625148662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdde00ccbd0 msgr2=0x7fdde014f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:31.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.174+0000 7fdde6206640 1 --2- 172.21.15.78:0/1625148662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdde00ccbd0 0x7fdde014f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.174+0000 7fdde6206640 1 -- 172.21.15.78:0/1625148662 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde014fe50 con 0x7fdde00d1490 2024-09-17T03:10:31.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.174+0000 7fdde5a05640 1 --2- 172.21.15.78:0/1625148662 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdde00b51c0 0x7fdde015cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:31.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.174+0000 7fdde5204640 1 --2- 172.21.15.78:0/1625148662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdde00ccbd0 0x7fdde014f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:31.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.174+0000 7fdde6206640 1 --2- 172.21.15.78:0/1625148662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdde00d1490 0x7fdde0153000 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fddd8006010 tx=0x7fddd8003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:31.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.174+0000 7fddd67fc640 1 -- 172.21.15.78:0/1625148662 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd803e030 con 0x7fdde00d1490 2024-09-17T03:10:31.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.175+0000 7fddd67fc640 1 -- 172.21.15.78:0/1625148662 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fddd8003c20 con 0x7fdde00d1490 2024-09-17T03:10:31.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.175+0000 7fdde7c69640 1 -- 172.21.15.78:0/1625148662 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde015d590 con 0x7fdde00d1490 2024-09-17T03:10:31.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.175+0000 7fddd67fc640 1 -- 172.21.15.78:0/1625148662 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd8035040 con 0x7fdde00d1490 2024-09-17T03:10:31.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.175+0000 7fdde7c69640 1 -- 172.21.15.78:0/1625148662 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde015db50 con 0x7fdde00d1490 2024-09-17T03:10:31.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.176+0000 7fdde7c69640 1 -- 172.21.15.78:0/1625148662 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde015d300 con 0x7fdde00d1490 2024-09-17T03:10:31.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.176+0000 7fddd67fc640 1 -- 172.21.15.78:0/1625148662 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fddd8041030 con 0x7fdde00d1490 2024-09-17T03:10:31.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.177+0000 7fddd67fc640 1 --2- 172.21.15.78:0/1625148662 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fddc4078bc0 0x7fddc407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:31.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.177+0000 7fddd67fc640 1 -- 172.21.15.78:0/1625148662 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fddd80bb610 con 0x7fdde00d1490 2024-09-17T03:10:31.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.177+0000 7fdde5a05640 1 --2- 172.21.15.78:0/1625148662 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fddc4078bc0 0x7fddc407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:31.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.178+0000 7fdde5a05640 1 --2- 172.21.15.78:0/1625148662 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fddc4078bc0 0x7fddc407b0d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009fc0 tx=0x7fdddc009550 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:31.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.181+0000 7fddd67fc640 1 -- 172.21.15.78:0/1625148662 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fddd8083b70 con 0x7fdde00d1490 2024-09-17T03:10:31.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.353+0000 7fdde7c69640 1 -- 172.21.15.78:0/1625148662 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdde015c6e0 con 0x7fddc4078bc0 2024-09-17T03:10:31.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.358+0000 7fddd67fc640 1 -- 172.21.15.78:0/1625148662 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247415 (secure 0 0 0) 0x7fdde015c6e0 con 0x7fddc4078bc0 2024-09-17T03:10:31.359 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:31.361 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:10:31.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.361+0000 7fdde7c69640 1 -- 172.21.15.78:0/1625148662 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fddc4078bc0 msgr2=0x7fddc407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:31.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.361+0000 7fdde7c69640 1 --2- 172.21.15.78:0/1625148662 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fddc4078bc0 0x7fddc407b0d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdddc009fc0 tx=0x7fdddc009550 comp rx=0 tx=0).stop 2024-09-17T03:10:31.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.361+0000 7fdde7c69640 1 -- 172.21.15.78:0/1625148662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdde00d1490 msgr2=0x7fdde0153000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:31.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.361+0000 7fdde7c69640 1 --2- 172.21.15.78:0/1625148662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdde00d1490 0x7fdde0153000 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fddd8006010 tx=0x7fddd8003820 comp rx=0 tx=0).stop 2024-09-17T03:10:31.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.362+0000 7fdde7c69640 1 -- 172.21.15.78:0/1625148662 shutdown_connections 2024-09-17T03:10:31.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.362+0000 7fdde7c69640 1 --2- 172.21.15.78:0/1625148662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdde00d1490 0x7fdde0153000 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.362+0000 7fdde7c69640 1 --2- 172.21.15.78:0/1625148662 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fddc4078bc0 0x7fddc407b0d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.362+0000 7fdde7c69640 1 --2- 172.21.15.78:0/1625148662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdde00ccbd0 0x7fdde014f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.362+0000 7fdde7c69640 1 --2- 172.21.15.78:0/1625148662 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdde00b51c0 0x7fdde015cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.362+0000 7fdde7c69640 1 -- 172.21.15.78:0/1625148662 >> 172.21.15.78:0/1625148662 conn(0x7fdde0072ae0 msgr2=0x7fdde00cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:31.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.362+0000 7fdde7c69640 1 -- 172.21.15.78:0/1625148662 shutdown_connections 2024-09-17T03:10:31.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.362+0000 7fdde7c69640 1 -- 172.21.15.78:0/1625148662 wait complete. 2024-09-17T03:10:31.371 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2024-09-17T03:10:31.150932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":110,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229584,"kb_used_data":5020,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745136,"statfs":{"total":773094113280,"available":772859019264,"internally_reserved":0,"allocated":5140480,"data_stored":2740676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001742"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615402+0000","last_change":"2024-09-17T03:10:25.615402+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615402+0000","last_undegraded":"2024-09-17T03:10:25.615402+0000","last_fullsized":"2024-09-17T03:10:25.615402+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616162+0000","last_change":"2024-09-17T03:10:25.616162+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616162+0000","last_undegraded":"2024-09-17T03:10:25.616162+0000","last_fullsized":"2024-09-17T03:10:25.616162+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.609754+0000","last_change":"2024-09-17T03:10:25.609754+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.609754+0000","last_undegraded":"2024-09-17T03:10:25.609754+0000","last_fullsized":"2024-09-17T03:10:25.609754+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.618870+0000","last_change":"2024-09-17T03:10:25.618870+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.618870+0000","last_undegraded":"2024-09-17T03:10:25.618870+0000","last_fullsized":"2024-09-17T03:10:25.618870+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614129+0000","last_change":"2024-09-17T03:10:25.614129+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614129+0000","last_undegraded":"2024-09-17T03:10:25.614129+0000","last_fullsized":"2024-09-17T03:10:25.614129+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.633121+0000","last_change":"2024-09-17T03:10:26.627225+0000","last_active":"2024-09-17T03:10:26.633121+0000","last_peered":"2024-09-17T03:10:26.633121+0000","last_clean":"2024-09-17T03:10:26.633121+0000","last_became_active":"2024-09-17T03:10:26.626923+0000","last_became_peered":"2024-09-17T03:10:26.626923+0000","last_unstale":"2024-09-17T03:10:26.633121+0000","last_undegraded":"2024-09-17T03:10:26.633121+0000","last_fullsized":"2024-09-17T03:10:26.633121+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:56.586793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615319+0000","last_change":"2024-09-17T03:10:25.615319+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615319+0000","last_undegraded":"2024-09-17T03:10:25.615319+0000","last_fullsized":"2024-09-17T03:10:25.615319+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616535+0000","last_change":"2024-09-17T03:10:25.616535+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616535+0000","last_undegraded":"2024-09-17T03:10:25.616535+0000","last_fullsized":"2024-09-17T03:10:25.616535+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616079+0000","last_change":"2024-09-17T03:10:25.616079+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616079+0000","last_undegraded":"2024-09-17T03:10:25.616079+0000","last_fullsized":"2024-09-17T03:10:25.616079+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615559+0000","last_change":"2024-09-17T03:10:25.615559+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615559+0000","last_undegraded":"2024-09-17T03:10:25.615559+0000","last_fullsized":"2024-09-17T03:10:25.615559+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615839+0000","last_change":"2024-09-17T03:10:25.615839+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615839+0000","last_undegraded":"2024-09-17T03:10:25.615839+0000","last_fullsized":"2024-09-17T03:10:25.615839+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615631+0000","last_change":"2024-09-17T03:10:25.615631+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615631+0000","last_undegraded":"2024-09-17T03:10:25.615631+0000","last_fullsized":"2024-09-17T03:10:25.615631+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616737+0000","last_change":"2024-09-17T03:10:25.616737+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616737+0000","last_undegraded":"2024-09-17T03:10:25.616737+0000","last_fullsized":"2024-09-17T03:10:25.616737+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615070+0000","last_change":"2024-09-17T03:10:25.615070+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615070+0000","last_undegraded":"2024-09-17T03:10:25.615070+0000","last_fullsized":"2024-09-17T03:10:25.615070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.632804+0000","last_change":"2024-09-17T03:10:26.626832+0000","last_active":"2024-09-17T03:10:26.632804+0000","last_peered":"2024-09-17T03:10:26.632804+0000","last_clean":"2024-09-17T03:10:26.632804+0000","last_became_active":"2024-09-17T03:10:26.625618+0000","last_became_peered":"2024-09-17T03:10:26.625618+0000","last_unstale":"2024-09-17T03:10:26.632804+0000","last_undegraded":"2024-09-17T03:10:26.632804+0000","last_fullsized":"2024-09-17T03:10:26.632804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:11.569131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614248+0000","last_change":"2024-09-17T03:10:25.614248+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614248+0000","last_undegraded":"2024-09-17T03:10:25.614248+0000","last_fullsized":"2024-09-17T03:10:25.614248+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.608846+0000","last_change":"2024-09-17T03:10:25.608846+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.608846+0000","last_undegraded":"2024-09-17T03:10:25.608846+0000","last_fullsized":"2024-09-17T03:10:25.608846+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.610584+0000","last_change":"2024-09-17T03:10:25.610584+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.610584+0000","last_undegraded":"2024-09-17T03:10:25.610584+0000","last_fullsized":"2024-09-17T03:10:25.610584+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.611206+0000","last_change":"2024-09-17T03:10:25.611206+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.611206+0000","last_undegraded":"2024-09-17T03:10:25.611206+0000","last_fullsized":"2024-09-17T03:10:25.611206+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616259+0000","last_change":"2024-09-17T03:10:25.616259+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616259+0000","last_undegraded":"2024-09-17T03:10:25.616259+0000","last_fullsized":"2024-09-17T03:10:25.616259+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.640384+0000","last_change":"2024-09-17T03:10:26.636653+0000","last_active":"2024-09-17T03:10:26.640384+0000","last_peered":"2024-09-17T03:10:26.640384+0000","last_clean":"2024-09-17T03:10:26.640384+0000","last_became_active":"2024-09-17T03:10:26.636103+0000","last_became_peered":"2024-09-17T03:10:26.636103+0000","last_unstale":"2024-09-17T03:10:26.640384+0000","last_undegraded":"2024-09-17T03:10:26.640384+0000","last_fullsized":"2024-09-17T03:10:26.640384+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:07.048273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614516+0000","last_change":"2024-09-17T03:10:25.614516+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614516+0000","last_undegraded":"2024-09-17T03:10:25.614516+0000","last_fullsized":"2024-09-17T03:10:25.614516+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.612876+0000","last_change":"2024-09-17T03:10:25.612876+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.612876+0000","last_undegraded":"2024-09-17T03:10:25.612876+0000","last_fullsized":"2024-09-17T03:10:25.612876+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.612070+0000","last_change":"2024-09-17T03:10:25.612070+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.612070+0000","last_undegraded":"2024-09-17T03:10:25.612070+0000","last_fullsized":"2024-09-17T03:10:25.612070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614092+0000","last_change":"2024-09-17T03:10:25.614092+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614092+0000","last_undegraded":"2024-09-17T03:10:25.614092+0000","last_fullsized":"2024-09-17T03:10:25.614092+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615695+0000","last_change":"2024-09-17T03:10:25.615695+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615695+0000","last_undegraded":"2024-09-17T03:10:25.615695+0000","last_fullsized":"2024-09-17T03:10:25.615695+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.609226+0000","last_change":"2024-09-17T03:10:25.609226+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.609226+0000","last_undegraded":"2024-09-17T03:10:25.609226+0000","last_fullsized":"2024-09-17T03:10:25.609226+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615144+0000","last_change":"2024-09-17T03:10:25.615144+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615144+0000","last_undegraded":"2024-09-17T03:10:25.615144+0000","last_fullsized":"2024-09-17T03:10:25.615144+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.610015+0000","last_change":"2024-09-17T03:10:25.610015+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.610015+0000","last_undegraded":"2024-09-17T03:10:25.610015+0000","last_fullsized":"2024-09-17T03:10:25.610015+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.610387+0000","last_change":"2024-09-17T03:10:25.610387+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.610387+0000","last_undegraded":"2024-09-17T03:10:25.610387+0000","last_fullsized":"2024-09-17T03:10:25.610387+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.640234+0000","last_change":"2024-09-17T03:10:26.632798+0000","last_active":"2024-09-17T03:10:26.640234+0000","last_peered":"2024-09-17T03:10:26.640234+0000","last_clean":"2024-09-17T03:10:26.640234+0000","last_became_active":"2024-09-17T03:10:26.632513+0000","last_became_peered":"2024-09-17T03:10:26.632513+0000","last_unstale":"2024-09-17T03:10:26.640234+0000","last_undegraded":"2024-09-17T03:10:26.640234+0000","last_fullsized":"2024-09-17T03:10:26.640234+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:16.049381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615186+0000","last_change":"2024-09-17T03:10:25.615186+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615186+0000","last_undegraded":"2024-09-17T03:10:25.615186+0000","last_fullsized":"2024-09-17T03:10:25.615186+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615543+0000","last_change":"2024-09-17T03:10:25.615543+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615543+0000","last_undegraded":"2024-09-17T03:10:25.615543+0000","last_fullsized":"2024-09-17T03:10:25.615543+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.639313+0000","last_change":"2024-09-17T03:10:25.630050+0000","last_active":"2024-09-17T03:10:26.639313+0000","last_peered":"2024-09-17T03:10:26.639313+0000","last_clean":"2024-09-17T03:10:26.639313+0000","last_became_active":"2024-09-17T03:10:25.629738+0000","last_became_peered":"2024-09-17T03:10:25.629738+0000","last_unstale":"2024-09-17T03:10:26.639313+0000","last_undegraded":"2024-09-17T03:10:26.639313+0000","last_fullsized":"2024-09-17T03:10:26.639313+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:34.296787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613567+0000","last_change":"2024-09-17T03:10:25.613567+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613567+0000","last_undegraded":"2024-09-17T03:10:25.613567+0000","last_fullsized":"2024-09-17T03:10:25.613567+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.621731+0000","last_change":"2024-09-17T03:10:25.616451+0000","last_active":"2024-09-17T03:10:25.621731+0000","last_peered":"2024-09-17T03:10:25.621731+0000","last_clean":"2024-09-17T03:10:25.621731+0000","last_became_active":"2024-09-17T03:10:25.616110+0000","last_became_peered":"2024-09-17T03:10:25.616110+0000","last_unstale":"2024-09-17T03:10:25.621731+0000","last_undegraded":"2024-09-17T03:10:25.621731+0000","last_fullsized":"2024-09-17T03:10:25.621731+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:23.827138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614645+0000","last_change":"2024-09-17T03:10:25.614645+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614645+0000","last_undegraded":"2024-09-17T03:10:25.614645+0000","last_fullsized":"2024-09-17T03:10:25.614645+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.631530+0000","last_change":"2024-09-17T03:10:25.626520+0000","last_active":"2024-09-17T03:10:25.631530+0000","last_peered":"2024-09-17T03:10:25.631530+0000","last_clean":"2024-09-17T03:10:25.631530+0000","last_became_active":"2024-09-17T03:10:25.626229+0000","last_became_peered":"2024-09-17T03:10:25.626229+0000","last_unstale":"2024-09-17T03:10:25.631530+0000","last_undegraded":"2024-09-17T03:10:25.631530+0000","last_fullsized":"2024-09-17T03:10:25.631530+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:18.573372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616315+0000","last_change":"2024-09-17T03:10:25.616315+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616315+0000","last_undegraded":"2024-09-17T03:10:25.616315+0000","last_fullsized":"2024-09-17T03:10:25.616315+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.628587+0000","last_change":"2024-09-17T03:10:25.626034+0000","last_active":"2024-09-17T03:10:25.628587+0000","last_peered":"2024-09-17T03:10:25.628587+0000","last_clean":"2024-09-17T03:10:25.628587+0000","last_became_active":"2024-09-17T03:10:25.625671+0000","last_became_peered":"2024-09-17T03:10:25.625671+0000","last_unstale":"2024-09-17T03:10:25.628587+0000","last_undegraded":"2024-09-17T03:10:25.628587+0000","last_fullsized":"2024-09-17T03:10:25.628587+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:51.028351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.609800+0000","last_change":"2024-09-17T03:10:25.609800+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.609800+0000","last_undegraded":"2024-09-17T03:10:25.609800+0000","last_fullsized":"2024-09-17T03:10:25.609800+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.630431+0000","last_change":"2024-09-17T03:10:25.627030+0000","last_active":"2024-09-17T03:10:26.630431+0000","last_peered":"2024-09-17T03:10:26.630431+0000","last_clean":"2024-09-17T03:10:26.630431+0000","last_became_active":"2024-09-17T03:10:25.626746+0000","last_became_peered":"2024-09-17T03:10:25.626746+0000","last_unstale":"2024-09-17T03:10:26.630431+0000","last_undegraded":"2024-09-17T03:10:26.630431+0000","last_fullsized":"2024-09-17T03:10:26.630431+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:20.215142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614407+0000","last_change":"2024-09-17T03:10:25.614407+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614407+0000","last_undegraded":"2024-09-17T03:10:25.614407+0000","last_fullsized":"2024-09-17T03:10:25.614407+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.626927+0000","last_change":"2024-09-17T03:10:25.624581+0000","last_active":"2024-09-17T03:10:25.626927+0000","last_peered":"2024-09-17T03:10:25.626927+0000","last_clean":"2024-09-17T03:10:25.626927+0000","last_became_active":"2024-09-17T03:10:25.623625+0000","last_became_peered":"2024-09-17T03:10:25.623625+0000","last_unstale":"2024-09-17T03:10:25.626927+0000","last_undegraded":"2024-09-17T03:10:25.626927+0000","last_fullsized":"2024-09-17T03:10:25.626927+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:32.576616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613970+0000","last_change":"2024-09-17T03:10:25.613970+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613970+0000","last_undegraded":"2024-09-17T03:10:25.613970+0000","last_fullsized":"2024-09-17T03:10:25.613970+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.630138+0000","last_change":"2024-09-17T03:10:25.625253+0000","last_active":"2024-09-17T03:10:25.630138+0000","last_peered":"2024-09-17T03:10:25.630138+0000","last_clean":"2024-09-17T03:10:25.630138+0000","last_became_active":"2024-09-17T03:10:25.624870+0000","last_became_peered":"2024-09-17T03:10:25.624870+0000","last_unstale":"2024-09-17T03:10:25.630138+0000","last_undegraded":"2024-09-17T03:10:25.630138+0000","last_fullsized":"2024-09-17T03:10:25.630138+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:16.507885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613828+0000","last_change":"2024-09-17T03:10:25.613828+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613828+0000","last_undegraded":"2024-09-17T03:10:25.613828+0000","last_fullsized":"2024-09-17T03:10:25.613828+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.634039+0000","last_change":"2024-09-17T03:10:25.628027+0000","last_active":"2024-09-17T03:10:25.634039+0000","last_peered":"2024-09-17T03:10:25.634039+0000","last_clean":"2024-09-17T03:10:25.634039+0000","last_became_active":"2024-09-17T03:10:25.624938+0000","last_became_peered":"2024-09-17T03:10:25.624938+0000","last_unstale":"2024-09-17T03:10:25.634039+0000","last_undegraded":"2024-09-17T03:10:25.634039+0000","last_fullsized":"2024-09-17T03:10:25.634039+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:24.615797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.609938+0000","last_change":"2024-09-17T03:10:25.609938+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.609938+0000","last_undegraded":"2024-09-17T03:10:25.609938+0000","last_fullsized":"2024-09-17T03:10:25.609938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.621285+0000","last_change":"2024-09-17T03:10:25.619136+0000","last_active":"2024-09-17T03:10:25.621285+0000","last_peered":"2024-09-17T03:10:25.621285+0000","last_clean":"2024-09-17T03:10:25.621285+0000","last_became_active":"2024-09-17T03:10:25.618816+0000","last_became_peered":"2024-09-17T03:10:25.618816+0000","last_unstale":"2024-09-17T03:10:25.621285+0000","last_undegraded":"2024-09-17T03:10:25.621285+0000","last_fullsized":"2024-09-17T03:10:25.621285+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:47.735636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613992+0000","last_change":"2024-09-17T03:10:25.613992+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613992+0000","last_undegraded":"2024-09-17T03:10:25.613992+0000","last_fullsized":"2024-09-17T03:10:25.613992+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.627651+0000","last_change":"2024-09-17T03:10:25.623416+0000","last_active":"2024-09-17T03:10:25.627651+0000","last_peered":"2024-09-17T03:10:25.627651+0000","last_clean":"2024-09-17T03:10:25.627651+0000","last_became_active":"2024-09-17T03:10:25.623090+0000","last_became_peered":"2024-09-17T03:10:25.623090+0000","last_unstale":"2024-09-17T03:10:25.627651+0000","last_undegraded":"2024-09-17T03:10:25.627651+0000","last_fullsized":"2024-09-17T03:10:25.627651+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:20.799970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.632253+0000","last_change":"2024-09-17T03:10:26.626795+0000","last_active":"2024-09-17T03:10:26.632253+0000","last_peered":"2024-09-17T03:10:26.632253+0000","last_clean":"2024-09-17T03:10:26.632253+0000","last_became_active":"2024-09-17T03:10:26.625634+0000","last_became_peered":"2024-09-17T03:10:26.625634+0000","last_unstale":"2024-09-17T03:10:26.632253+0000","last_undegraded":"2024-09-17T03:10:26.632253+0000","last_fullsized":"2024-09-17T03:10:26.632253+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:40.332682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.628554+0000","last_change":"2024-09-17T03:10:25.625282+0000","last_active":"2024-09-17T03:10:25.628554+0000","last_peered":"2024-09-17T03:10:25.628554+0000","last_clean":"2024-09-17T03:10:25.628554+0000","last_became_active":"2024-09-17T03:10:25.624893+0000","last_became_peered":"2024-09-17T03:10:25.624893+0000","last_unstale":"2024-09-17T03:10:25.628554+0000","last_undegraded":"2024-09-17T03:10:25.628554+0000","last_fullsized":"2024-09-17T03:10:25.628554+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:16.507885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614580+0000","last_change":"2024-09-17T03:10:25.614580+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614580+0000","last_undegraded":"2024-09-17T03:10:25.614580+0000","last_fullsized":"2024-09-17T03:10:25.614580+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.621247+0000","last_change":"2024-09-17T03:10:25.614140+0000","last_active":"2024-09-17T03:10:25.621247+0000","last_peered":"2024-09-17T03:10:25.621247+0000","last_clean":"2024-09-17T03:10:25.621247+0000","last_became_active":"2024-09-17T03:10:25.613844+0000","last_became_peered":"2024-09-17T03:10:25.613844+0000","last_unstale":"2024-09-17T03:10:25.621247+0000","last_undegraded":"2024-09-17T03:10:25.621247+0000","last_fullsized":"2024-09-17T03:10:25.621247+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:49.842511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.609410+0000","last_change":"2024-09-17T03:10:25.609410+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.609410+0000","last_undegraded":"2024-09-17T03:10:25.609410+0000","last_fullsized":"2024-09-17T03:10:25.609410+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.632428+0000","last_change":"2024-09-17T03:10:25.630508+0000","last_active":"2024-09-17T03:10:26.632428+0000","last_peered":"2024-09-17T03:10:26.632428+0000","last_clean":"2024-09-17T03:10:26.632428+0000","last_became_active":"2024-09-17T03:10:25.630209+0000","last_became_peered":"2024-09-17T03:10:25.630209+0000","last_unstale":"2024-09-17T03:10:26.632428+0000","last_undegraded":"2024-09-17T03:10:26.632428+0000","last_fullsized":"2024-09-17T03:10:26.632428+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:15.757991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613962+0000","last_change":"2024-09-17T03:10:25.613962+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613962+0000","last_undegraded":"2024-09-17T03:10:25.613962+0000","last_fullsized":"2024-09-17T03:10:25.613962+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.632215+0000","last_change":"2024-09-17T03:10:25.628330+0000","last_active":"2024-09-17T03:10:25.632215+0000","last_peered":"2024-09-17T03:10:25.632215+0000","last_clean":"2024-09-17T03:10:25.632215+0000","last_became_active":"2024-09-17T03:10:25.627919+0000","last_became_peered":"2024-09-17T03:10:25.627919+0000","last_unstale":"2024-09-17T03:10:25.632215+0000","last_undegraded":"2024-09-17T03:10:25.632215+0000","last_fullsized":"2024-09-17T03:10:25.632215+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:14.190956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.637269+0000","last_change":"2024-09-17T03:10:26.630787+0000","last_active":"2024-09-17T03:10:26.637269+0000","last_peered":"2024-09-17T03:10:26.637269+0000","last_clean":"2024-09-17T03:10:26.637269+0000","last_became_active":"2024-09-17T03:10:26.629999+0000","last_became_peered":"2024-09-17T03:10:26.629999+0000","last_unstale":"2024-09-17T03:10:26.637269+0000","last_undegraded":"2024-09-17T03:10:26.637269+0000","last_fullsized":"2024-09-17T03:10:26.637269+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:54.370486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.614340+0000","last_change":"2024-09-17T03:10:25.625455+0000","last_active":"2024-09-17T03:10:26.614340+0000","last_peered":"2024-09-17T03:10:26.614340+0000","last_clean":"2024-09-17T03:10:26.614340+0000","last_became_active":"2024-09-17T03:10:25.625151+0000","last_became_peered":"2024-09-17T03:10:25.625151+0000","last_unstale":"2024-09-17T03:10:26.614340+0000","last_undegraded":"2024-09-17T03:10:26.614340+0000","last_fullsized":"2024-09-17T03:10:26.614340+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:24.800733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613788+0000","last_change":"2024-09-17T03:10:25.613788+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613788+0000","last_undegraded":"2024-09-17T03:10:25.613788+0000","last_fullsized":"2024-09-17T03:10:25.613788+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.627892+0000","last_change":"2024-09-17T03:10:25.623870+0000","last_active":"2024-09-17T03:10:25.627892+0000","last_peered":"2024-09-17T03:10:25.627892+0000","last_clean":"2024-09-17T03:10:25.627892+0000","last_became_active":"2024-09-17T03:10:25.622936+0000","last_became_peered":"2024-09-17T03:10:25.622936+0000","last_unstale":"2024-09-17T03:10:25.627892+0000","last_undegraded":"2024-09-17T03:10:25.627892+0000","last_fullsized":"2024-09-17T03:10:25.627892+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:36.802376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614663+0000","last_change":"2024-09-17T03:10:25.614663+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614663+0000","last_undegraded":"2024-09-17T03:10:25.614663+0000","last_fullsized":"2024-09-17T03:10:25.614663+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.636862+0000","last_change":"2024-09-17T03:10:25.627052+0000","last_active":"2024-09-17T03:10:25.636862+0000","last_peered":"2024-09-17T03:10:25.636862+0000","last_clean":"2024-09-17T03:10:25.636862+0000","last_became_active":"2024-09-17T03:10:25.626732+0000","last_became_peered":"2024-09-17T03:10:25.626732+0000","last_unstale":"2024-09-17T03:10:25.636862+0000","last_undegraded":"2024-09-17T03:10:25.636862+0000","last_fullsized":"2024-09-17T03:10:25.636862+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:45.402110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614027+0000","last_change":"2024-09-17T03:10:25.614027+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614027+0000","last_undegraded":"2024-09-17T03:10:25.614027+0000","last_fullsized":"2024-09-17T03:10:25.614027+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.626596+0000","last_change":"2024-09-17T03:10:25.622889+0000","last_active":"2024-09-17T03:10:25.626596+0000","last_peered":"2024-09-17T03:10:25.626596+0000","last_clean":"2024-09-17T03:10:25.626596+0000","last_became_active":"2024-09-17T03:10:25.622552+0000","last_became_peered":"2024-09-17T03:10:25.622552+0000","last_unstale":"2024-09-17T03:10:25.626596+0000","last_undegraded":"2024-09-17T03:10:25.626596+0000","last_fullsized":"2024-09-17T03:10:25.626596+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:57.309006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.610556+0000","last_change":"2024-09-17T03:10:25.610556+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.610556+0000","last_undegraded":"2024-09-17T03:10:25.610556+0000","last_fullsized":"2024-09-17T03:10:25.610556+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.630021+0000","last_change":"2024-09-17T03:10:25.625213+0000","last_active":"2024-09-17T03:10:25.630021+0000","last_peered":"2024-09-17T03:10:25.630021+0000","last_clean":"2024-09-17T03:10:25.630021+0000","last_became_active":"2024-09-17T03:10:25.624885+0000","last_became_peered":"2024-09-17T03:10:25.624885+0000","last_unstale":"2024-09-17T03:10:25.630021+0000","last_undegraded":"2024-09-17T03:10:25.630021+0000","last_fullsized":"2024-09-17T03:10:25.630021+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:40.794606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.612590+0000","last_change":"2024-09-17T03:10:25.612590+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.612590+0000","last_undegraded":"2024-09-17T03:10:25.612590+0000","last_fullsized":"2024-09-17T03:10:25.612590+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.616186+0000","last_change":"2024-09-17T03:10:25.626305+0000","last_active":"2024-09-17T03:10:26.616186+0000","last_peered":"2024-09-17T03:10:26.616186+0000","last_clean":"2024-09-17T03:10:26.616186+0000","last_became_active":"2024-09-17T03:10:25.626021+0000","last_became_peered":"2024-09-17T03:10:25.626021+0000","last_unstale":"2024-09-17T03:10:26.616186+0000","last_undegraded":"2024-09-17T03:10:26.616186+0000","last_fullsized":"2024-09-17T03:10:26.616186+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:20.547659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.637228+0000","last_change":"2024-09-17T03:10:26.628582+0000","last_active":"2024-09-17T03:10:26.637228+0000","last_peered":"2024-09-17T03:10:26.637228+0000","last_clean":"2024-09-17T03:10:26.637228+0000","last_became_active":"2024-09-17T03:10:26.628003+0000","last_became_peered":"2024-09-17T03:10:26.628003+0000","last_unstale":"2024-09-17T03:10:26.637228+0000","last_undegraded":"2024-09-17T03:10:26.637228+0000","last_fullsized":"2024-09-17T03:10:26.637228+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:48.501354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.630505+0000","last_change":"2024-09-17T03:10:25.628379+0000","last_active":"2024-09-17T03:10:26.630505+0000","last_peered":"2024-09-17T03:10:26.630505+0000","last_clean":"2024-09-17T03:10:26.630505+0000","last_became_active":"2024-09-17T03:10:25.628078+0000","last_became_peered":"2024-09-17T03:10:25.628078+0000","last_unstale":"2024-09-17T03:10:26.630505+0000","last_undegraded":"2024-09-17T03:10:26.630505+0000","last_fullsized":"2024-09-17T03:10:26.630505+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:23.877248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614989+0000","last_change":"2024-09-17T03:10:25.614989+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614989+0000","last_undegraded":"2024-09-17T03:10:25.614989+0000","last_fullsized":"2024-09-17T03:10:25.614989+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.630033+0000","last_change":"2024-09-17T03:10:25.626068+0000","last_active":"2024-09-17T03:10:25.630033+0000","last_peered":"2024-09-17T03:10:25.630033+0000","last_clean":"2024-09-17T03:10:25.630033+0000","last_became_active":"2024-09-17T03:10:25.625744+0000","last_became_peered":"2024-09-17T03:10:25.625744+0000","last_unstale":"2024-09-17T03:10:25.630033+0000","last_undegraded":"2024-09-17T03:10:25.630033+0000","last_fullsized":"2024-09-17T03:10:25.630033+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:51.028351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614118+0000","last_change":"2024-09-17T03:10:25.614118+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614118+0000","last_undegraded":"2024-09-17T03:10:25.614118+0000","last_fullsized":"2024-09-17T03:10:25.614118+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.627537+0000","last_change":"2024-09-17T03:10:25.622607+0000","last_active":"2024-09-17T03:10:25.627537+0000","last_peered":"2024-09-17T03:10:25.627537+0000","last_clean":"2024-09-17T03:10:25.627537+0000","last_became_active":"2024-09-17T03:10:25.622323+0000","last_became_peered":"2024-09-17T03:10:25.622323+0000","last_unstale":"2024-09-17T03:10:25.627537+0000","last_undegraded":"2024-09-17T03:10:25.627537+0000","last_fullsized":"2024-09-17T03:10:25.627537+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:40.437500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613466+0000","last_change":"2024-09-17T03:10:25.613466+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613466+0000","last_undegraded":"2024-09-17T03:10:25.613466+0000","last_fullsized":"2024-09-17T03:10:25.613466+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.632220+0000","last_change":"2024-09-17T03:10:25.628191+0000","last_active":"2024-09-17T03:10:25.632220+0000","last_peered":"2024-09-17T03:10:25.632220+0000","last_clean":"2024-09-17T03:10:25.632220+0000","last_became_active":"2024-09-17T03:10:25.627726+0000","last_became_peered":"2024-09-17T03:10:25.627726+0000","last_unstale":"2024-09-17T03:10:25.632220+0000","last_undegraded":"2024-09-17T03:10:25.632220+0000","last_fullsized":"2024-09-17T03:10:25.632220+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:21.661328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.612910+0000","last_change":"2024-09-17T03:10:25.612910+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.612910+0000","last_undegraded":"2024-09-17T03:10:25.612910+0000","last_fullsized":"2024-09-17T03:10:25.612910+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.613158+0000","last_change":"2024-09-17T03:10:25.629315+0000","last_active":"2024-09-17T03:10:27.613158+0000","last_peered":"2024-09-17T03:10:27.613158+0000","last_clean":"2024-09-17T03:10:27.613158+0000","last_became_active":"2024-09-17T03:10:25.629015+0000","last_became_peered":"2024-09-17T03:10:25.629015+0000","last_unstale":"2024-09-17T03:10:27.613158+0000","last_undegraded":"2024-09-17T03:10:27.613158+0000","last_fullsized":"2024-09-17T03:10:27.613158+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:30.992821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613385+0000","last_change":"2024-09-17T03:10:25.613385+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613385+0000","last_undegraded":"2024-09-17T03:10:25.613385+0000","last_fullsized":"2024-09-17T03:10:25.613385+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.630605+0000","last_change":"2024-09-17T03:10:25.627561+0000","last_active":"2024-09-17T03:10:25.630605+0000","last_peered":"2024-09-17T03:10:25.630605+0000","last_clean":"2024-09-17T03:10:25.630605+0000","last_became_active":"2024-09-17T03:10:25.627173+0000","last_became_peered":"2024-09-17T03:10:25.627173+0000","last_unstale":"2024-09-17T03:10:25.630605+0000","last_undegraded":"2024-09-17T03:10:25.630605+0000","last_fullsized":"2024-09-17T03:10:25.630605+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:28.504300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613721+0000","last_change":"2024-09-17T03:10:25.613721+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613721+0000","last_undegraded":"2024-09-17T03:10:25.613721+0000","last_fullsized":"2024-09-17T03:10:25.613721+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.626996+0000","last_change":"2024-09-17T03:10:25.622690+0000","last_active":"2024-09-17T03:10:25.626996+0000","last_peered":"2024-09-17T03:10:25.626996+0000","last_clean":"2024-09-17T03:10:25.626996+0000","last_became_active":"2024-09-17T03:10:25.622386+0000","last_became_peered":"2024-09-17T03:10:25.622386+0000","last_unstale":"2024-09-17T03:10:25.626996+0000","last_undegraded":"2024-09-17T03:10:25.626996+0000","last_fullsized":"2024-09-17T03:10:25.626996+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:32.576616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.637199+0000","last_change":"2024-09-17T03:10:26.628270+0000","last_active":"2024-09-17T03:10:26.637199+0000","last_peered":"2024-09-17T03:10:26.637199+0000","last_clean":"2024-09-17T03:10:26.637199+0000","last_became_active":"2024-09-17T03:10:26.627647+0000","last_became_peered":"2024-09-17T03:10:26.627647+0000","last_unstale":"2024-09-17T03:10:26.637199+0000","last_undegraded":"2024-09-17T03:10:26.637199+0000","last_fullsized":"2024-09-17T03:10:26.637199+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:38.953959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.626902+0000","last_change":"2024-09-17T03:10:25.623065+0000","last_active":"2024-09-17T03:10:25.626902+0000","last_peered":"2024-09-17T03:10:25.626902+0000","last_clean":"2024-09-17T03:10:25.626902+0000","last_became_active":"2024-09-17T03:10:25.621840+0000","last_became_peered":"2024-09-17T03:10:25.621840+0000","last_unstale":"2024-09-17T03:10:25.626902+0000","last_undegraded":"2024-09-17T03:10:25.626902+0000","last_fullsized":"2024-09-17T03:10:25.626902+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:40.794606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.632322+0000","last_change":"2024-09-17T03:10:26.625644+0000","last_active":"2024-09-17T03:10:26.632322+0000","last_peered":"2024-09-17T03:10:26.632322+0000","last_clean":"2024-09-17T03:10:26.632322+0000","last_became_active":"2024-09-17T03:10:26.625302+0000","last_became_peered":"2024-09-17T03:10:26.625302+0000","last_unstale":"2024-09-17T03:10:26.632322+0000","last_undegraded":"2024-09-17T03:10:26.632322+0000","last_fullsized":"2024-09-17T03:10:26.632322+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:41.524955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.630548+0000","last_change":"2024-09-17T03:10:25.629526+0000","last_active":"2024-09-17T03:10:25.630548+0000","last_peered":"2024-09-17T03:10:25.630548+0000","last_clean":"2024-09-17T03:10:25.630548+0000","last_became_active":"2024-09-17T03:10:25.629138+0000","last_became_peered":"2024-09-17T03:10:25.629138+0000","last_unstale":"2024-09-17T03:10:25.630548+0000","last_undegraded":"2024-09-17T03:10:25.630548+0000","last_fullsized":"2024-09-17T03:10:25.630548+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:31.396010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613526+0000","last_change":"2024-09-17T03:10:25.613526+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613526+0000","last_undegraded":"2024-09-17T03:10:25.613526+0000","last_fullsized":"2024-09-17T03:10:25.613526+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.631522+0000","last_change":"2024-09-17T03:10:25.625114+0000","last_active":"2024-09-17T03:10:25.631522+0000","last_peered":"2024-09-17T03:10:25.631522+0000","last_clean":"2024-09-17T03:10:25.631522+0000","last_became_active":"2024-09-17T03:10:25.624791+0000","last_became_peered":"2024-09-17T03:10:25.624791+0000","last_unstale":"2024-09-17T03:10:25.631522+0000","last_undegraded":"2024-09-17T03:10:25.631522+0000","last_fullsized":"2024-09-17T03:10:25.631522+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:31.396010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.611619+0000","last_change":"2024-09-17T03:10:25.611619+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.611619+0000","last_undegraded":"2024-09-17T03:10:25.611619+0000","last_fullsized":"2024-09-17T03:10:25.611619+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.634008+0000","last_change":"2024-09-17T03:10:25.625645+0000","last_active":"2024-09-17T03:10:25.634008+0000","last_peered":"2024-09-17T03:10:25.634008+0000","last_clean":"2024-09-17T03:10:25.634008+0000","last_became_active":"2024-09-17T03:10:25.625291+0000","last_became_peered":"2024-09-17T03:10:25.625291+0000","last_unstale":"2024-09-17T03:10:25.634008+0000","last_undegraded":"2024-09-17T03:10:25.634008+0000","last_fullsized":"2024-09-17T03:10:25.634008+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:30.515112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613500+0000","last_change":"2024-09-17T03:10:25.613500+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613500+0000","last_undegraded":"2024-09-17T03:10:25.613500+0000","last_fullsized":"2024-09-17T03:10:25.613500+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.631751+0000","last_change":"2024-09-17T03:10:25.627675+0000","last_active":"2024-09-17T03:10:25.631751+0000","last_peered":"2024-09-17T03:10:25.631751+0000","last_clean":"2024-09-17T03:10:25.631751+0000","last_became_active":"2024-09-17T03:10:25.627236+0000","last_became_peered":"2024-09-17T03:10:25.627236+0000","last_unstale":"2024-09-17T03:10:25.631751+0000","last_undegraded":"2024-09-17T03:10:25.631751+0000","last_fullsized":"2024-09-17T03:10:25.631751+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:28.504300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":146,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.616638+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:10:25.616638+0000","last_peered":"2024-09-17T03:10:25.616638+0000","last_clean":"2024-09-17T03:10:25.616638+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:10:25.616638+0000","last_undegraded":"2024-09-17T03:10:25.616638+0000","last_fullsized":"2024-09-17T03:10:25.616638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1077248,"data_stored":780517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":495616,"data_stored":196416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":196416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":196416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":190149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":190149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1089536,"data_stored":786784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":520192,"data_stored":203829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:10:31.376 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3f is not active+clean 2024-09-17T03:10:31.376 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.615402+0000', 'last_change': '2024-09-17T03:10:25.615402+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.615402+0000', 'last_undegraded': '2024-09-17T03:10:25.615402+0000', 'last_fullsized': '2024-09-17T03:10:25.615402+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:10:31.376 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3e is not active+clean 2024-09-17T03:10:31.376 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.616162+0000', 'last_change': '2024-09-17T03:10:25.616162+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.616162+0000', 'last_undegraded': '2024-09-17T03:10:25.616162+0000', 'last_fullsized': '2024-09-17T03:10:25.616162+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:10:31.376 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3d is not active+clean 2024-09-17T03:10:31.376 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.609754+0000', 'last_change': '2024-09-17T03:10:25.609754+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.609754+0000', 'last_undegraded': '2024-09-17T03:10:25.609754+0000', 'last_fullsized': '2024-09-17T03:10:25.609754+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:10:31.376 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3c is not active+clean 2024-09-17T03:10:31.377 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.618870+0000', 'last_change': '2024-09-17T03:10:25.618870+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.618870+0000', 'last_undegraded': '2024-09-17T03:10:25.618870+0000', 'last_fullsized': '2024-09-17T03:10:25.618870+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:10:31.377 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3b is not active+clean 2024-09-17T03:10:31.377 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.614129+0000', 'last_change': '2024-09-17T03:10:25.614129+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.614129+0000', 'last_undegraded': '2024-09-17T03:10:25.614129+0000', 'last_fullsized': '2024-09-17T03:10:25.614129+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:10:31.377 INFO:tasks.ceph.ceph_manager.ceph:PG 7.39 is not active+clean 2024-09-17T03:10:31.377 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.615319+0000', 'last_change': '2024-09-17T03:10:25.615319+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.615319+0000', 'last_undegraded': '2024-09-17T03:10:25.615319+0000', 'last_fullsized': '2024-09-17T03:10:25.615319+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:10:31.377 INFO:tasks.ceph.ceph_manager.ceph:PG 7.38 is not active+clean 2024-09-17T03:10:31.377 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.616535+0000', 'last_change': '2024-09-17T03:10:25.616535+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.616535+0000', 'last_undegraded': '2024-09-17T03:10:25.616535+0000', 'last_fullsized': '2024-09-17T03:10:25.616535+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:10:31.377 INFO:tasks.ceph.ceph_manager.ceph:PG 7.37 is not active+clean 2024-09-17T03:10:31.377 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.616079+0000', 'last_change': '2024-09-17T03:10:25.616079+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.616079+0000', 'last_undegraded': '2024-09-17T03:10:25.616079+0000', 'last_fullsized': '2024-09-17T03:10:25.616079+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:10:31.377 INFO:tasks.ceph.ceph_manager.ceph:PG 7.36 is not active+clean 2024-09-17T03:10:31.377 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.615559+0000', 'last_change': '2024-09-17T03:10:25.615559+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.615559+0000', 'last_undegraded': '2024-09-17T03:10:25.615559+0000', 'last_fullsized': '2024-09-17T03:10:25.615559+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:10:31.378 INFO:tasks.ceph.ceph_manager.ceph:PG 7.35 is not active+clean 2024-09-17T03:10:31.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.615839+0000', 'last_change': '2024-09-17T03:10:25.615839+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.615839+0000', 'last_undegraded': '2024-09-17T03:10:25.615839+0000', 'last_fullsized': '2024-09-17T03:10:25.615839+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:10:31.378 INFO:tasks.ceph.ceph_manager.ceph:PG 7.34 is not active+clean 2024-09-17T03:10:31.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.615631+0000', 'last_change': '2024-09-17T03:10:25.615631+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.615631+0000', 'last_undegraded': '2024-09-17T03:10:25.615631+0000', 'last_fullsized': '2024-09-17T03:10:25.615631+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:10:31.378 INFO:tasks.ceph.ceph_manager.ceph:PG 7.33 is not active+clean 2024-09-17T03:10:31.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.616737+0000', 'last_change': '2024-09-17T03:10:25.616737+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.616737+0000', 'last_undegraded': '2024-09-17T03:10:25.616737+0000', 'last_fullsized': '2024-09-17T03:10:25.616737+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:10:31.378 INFO:tasks.ceph.ceph_manager.ceph:PG 7.32 is not active+clean 2024-09-17T03:10:31.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.615070+0000', 'last_change': '2024-09-17T03:10:25.615070+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.615070+0000', 'last_undegraded': '2024-09-17T03:10:25.615070+0000', 'last_fullsized': '2024-09-17T03:10:25.615070+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:10:31.378 INFO:tasks.ceph.ceph_manager.ceph:PG 7.30 is not active+clean 2024-09-17T03:10:31.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.614248+0000', 'last_change': '2024-09-17T03:10:25.614248+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.614248+0000', 'last_undegraded': '2024-09-17T03:10:25.614248+0000', 'last_fullsized': '2024-09-17T03:10:25.614248+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:10:31.378 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2f is not active+clean 2024-09-17T03:10:31.378 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.608846+0000', 'last_change': '2024-09-17T03:10:25.608846+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.608846+0000', 'last_undegraded': '2024-09-17T03:10:25.608846+0000', 'last_fullsized': '2024-09-17T03:10:25.608846+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:10:31.379 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2e is not active+clean 2024-09-17T03:10:31.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.610584+0000', 'last_change': '2024-09-17T03:10:25.610584+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.610584+0000', 'last_undegraded': '2024-09-17T03:10:25.610584+0000', 'last_fullsized': '2024-09-17T03:10:25.610584+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:10:31.379 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2d is not active+clean 2024-09-17T03:10:31.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.611206+0000', 'last_change': '2024-09-17T03:10:25.611206+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.611206+0000', 'last_undegraded': '2024-09-17T03:10:25.611206+0000', 'last_fullsized': '2024-09-17T03:10:25.611206+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:10:31.379 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2c is not active+clean 2024-09-17T03:10:31.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.616259+0000', 'last_change': '2024-09-17T03:10:25.616259+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.616259+0000', 'last_undegraded': '2024-09-17T03:10:25.616259+0000', 'last_fullsized': '2024-09-17T03:10:25.616259+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:10:31.379 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2a is not active+clean 2024-09-17T03:10:31.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.614516+0000', 'last_change': '2024-09-17T03:10:25.614516+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.614516+0000', 'last_undegraded': '2024-09-17T03:10:25.614516+0000', 'last_fullsized': '2024-09-17T03:10:25.614516+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:10:31.379 INFO:tasks.ceph.ceph_manager.ceph:PG 7.29 is not active+clean 2024-09-17T03:10:31.379 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.612876+0000', 'last_change': '2024-09-17T03:10:25.612876+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.612876+0000', 'last_undegraded': '2024-09-17T03:10:25.612876+0000', 'last_fullsized': '2024-09-17T03:10:25.612876+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:10:31.379 INFO:tasks.ceph.ceph_manager.ceph:PG 7.28 is not active+clean 2024-09-17T03:10:31.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.612070+0000', 'last_change': '2024-09-17T03:10:25.612070+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.612070+0000', 'last_undegraded': '2024-09-17T03:10:25.612070+0000', 'last_fullsized': '2024-09-17T03:10:25.612070+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:10:31.380 INFO:tasks.ceph.ceph_manager.ceph:PG 7.27 is not active+clean 2024-09-17T03:10:31.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.614092+0000', 'last_change': '2024-09-17T03:10:25.614092+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.614092+0000', 'last_undegraded': '2024-09-17T03:10:25.614092+0000', 'last_fullsized': '2024-09-17T03:10:25.614092+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:10:31.380 INFO:tasks.ceph.ceph_manager.ceph:PG 7.26 is not active+clean 2024-09-17T03:10:31.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.615695+0000', 'last_change': '2024-09-17T03:10:25.615695+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.615695+0000', 'last_undegraded': '2024-09-17T03:10:25.615695+0000', 'last_fullsized': '2024-09-17T03:10:25.615695+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:10:31.380 INFO:tasks.ceph.ceph_manager.ceph:PG 7.25 is not active+clean 2024-09-17T03:10:31.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.609226+0000', 'last_change': '2024-09-17T03:10:25.609226+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.609226+0000', 'last_undegraded': '2024-09-17T03:10:25.609226+0000', 'last_fullsized': '2024-09-17T03:10:25.609226+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:10:31.380 INFO:tasks.ceph.ceph_manager.ceph:PG 7.24 is not active+clean 2024-09-17T03:10:31.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.615144+0000', 'last_change': '2024-09-17T03:10:25.615144+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.615144+0000', 'last_undegraded': '2024-09-17T03:10:25.615144+0000', 'last_fullsized': '2024-09-17T03:10:25.615144+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:10:31.380 INFO:tasks.ceph.ceph_manager.ceph:PG 7.23 is not active+clean 2024-09-17T03:10:31.380 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.610015+0000', 'last_change': '2024-09-17T03:10:25.610015+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.610015+0000', 'last_undegraded': '2024-09-17T03:10:25.610015+0000', 'last_fullsized': '2024-09-17T03:10:25.610015+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:10:31.381 INFO:tasks.ceph.ceph_manager.ceph:PG 7.22 is not active+clean 2024-09-17T03:10:31.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.610387+0000', 'last_change': '2024-09-17T03:10:25.610387+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.610387+0000', 'last_undegraded': '2024-09-17T03:10:25.610387+0000', 'last_fullsized': '2024-09-17T03:10:25.610387+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:10:31.381 INFO:tasks.ceph.ceph_manager.ceph:PG 7.20 is not active+clean 2024-09-17T03:10:31.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.615186+0000', 'last_change': '2024-09-17T03:10:25.615186+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.615186+0000', 'last_undegraded': '2024-09-17T03:10:25.615186+0000', 'last_fullsized': '2024-09-17T03:10:25.615186+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:10:31.381 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1e is not active+clean 2024-09-17T03:10:31.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.615543+0000', 'last_change': '2024-09-17T03:10:25.615543+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.615543+0000', 'last_undegraded': '2024-09-17T03:10:25.615543+0000', 'last_fullsized': '2024-09-17T03:10:25.615543+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:10:31.381 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1f is not active+clean 2024-09-17T03:10:31.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.613567+0000', 'last_change': '2024-09-17T03:10:25.613567+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.613567+0000', 'last_undegraded': '2024-09-17T03:10:25.613567+0000', 'last_fullsized': '2024-09-17T03:10:25.613567+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:10:31.381 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1c is not active+clean 2024-09-17T03:10:31.381 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.614645+0000', 'last_change': '2024-09-17T03:10:25.614645+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.614645+0000', 'last_undegraded': '2024-09-17T03:10:25.614645+0000', 'last_fullsized': '2024-09-17T03:10:25.614645+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:10:31.381 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1d is not active+clean 2024-09-17T03:10:31.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.616315+0000', 'last_change': '2024-09-17T03:10:25.616315+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.616315+0000', 'last_undegraded': '2024-09-17T03:10:25.616315+0000', 'last_fullsized': '2024-09-17T03:10:25.616315+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:10:31.382 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1a is not active+clean 2024-09-17T03:10:31.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.609800+0000', 'last_change': '2024-09-17T03:10:25.609800+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.609800+0000', 'last_undegraded': '2024-09-17T03:10:25.609800+0000', 'last_fullsized': '2024-09-17T03:10:25.609800+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:10:31.382 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1b is not active+clean 2024-09-17T03:10:31.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.614407+0000', 'last_change': '2024-09-17T03:10:25.614407+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.614407+0000', 'last_undegraded': '2024-09-17T03:10:25.614407+0000', 'last_fullsized': '2024-09-17T03:10:25.614407+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:10:31.382 INFO:tasks.ceph.ceph_manager.ceph:PG 7.18 is not active+clean 2024-09-17T03:10:31.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.613970+0000', 'last_change': '2024-09-17T03:10:25.613970+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.613970+0000', 'last_undegraded': '2024-09-17T03:10:25.613970+0000', 'last_fullsized': '2024-09-17T03:10:25.613970+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:10:31.382 INFO:tasks.ceph.ceph_manager.ceph:PG 7.19 is not active+clean 2024-09-17T03:10:31.382 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.613828+0000', 'last_change': '2024-09-17T03:10:25.613828+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.613828+0000', 'last_undegraded': '2024-09-17T03:10:25.613828+0000', 'last_fullsized': '2024-09-17T03:10:25.613828+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:10:31.383 INFO:tasks.ceph.ceph_manager.ceph:PG 7.16 is not active+clean 2024-09-17T03:10:31.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.609938+0000', 'last_change': '2024-09-17T03:10:25.609938+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.609938+0000', 'last_undegraded': '2024-09-17T03:10:25.609938+0000', 'last_fullsized': '2024-09-17T03:10:25.609938+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:10:31.383 INFO:tasks.ceph.ceph_manager.ceph:PG 7.17 is not active+clean 2024-09-17T03:10:31.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.613992+0000', 'last_change': '2024-09-17T03:10:25.613992+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.613992+0000', 'last_undegraded': '2024-09-17T03:10:25.613992+0000', 'last_fullsized': '2024-09-17T03:10:25.613992+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:10:31.383 INFO:tasks.ceph.ceph_manager.ceph:PG 7.15 is not active+clean 2024-09-17T03:10:31.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.614580+0000', 'last_change': '2024-09-17T03:10:25.614580+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.614580+0000', 'last_undegraded': '2024-09-17T03:10:25.614580+0000', 'last_fullsized': '2024-09-17T03:10:25.614580+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:10:31.383 INFO:tasks.ceph.ceph_manager.ceph:PG 7.12 is not active+clean 2024-09-17T03:10:31.383 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.609410+0000', 'last_change': '2024-09-17T03:10:25.609410+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.609410+0000', 'last_undegraded': '2024-09-17T03:10:25.609410+0000', 'last_fullsized': '2024-09-17T03:10:25.609410+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:10:31.384 INFO:tasks.ceph.ceph_manager.ceph:PG 7.13 is not active+clean 2024-09-17T03:10:31.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.613962+0000', 'last_change': '2024-09-17T03:10:25.613962+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.613962+0000', 'last_undegraded': '2024-09-17T03:10:25.613962+0000', 'last_fullsized': '2024-09-17T03:10:25.613962+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:10:31.384 INFO:tasks.ceph.ceph_manager.ceph:PG 7.11 is not active+clean 2024-09-17T03:10:31.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.613788+0000', 'last_change': '2024-09-17T03:10:25.613788+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.613788+0000', 'last_undegraded': '2024-09-17T03:10:25.613788+0000', 'last_fullsized': '2024-09-17T03:10:25.613788+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:10:31.384 INFO:tasks.ceph.ceph_manager.ceph:PG 7.e is not active+clean 2024-09-17T03:10:31.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.614663+0000', 'last_change': '2024-09-17T03:10:25.614663+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.614663+0000', 'last_undegraded': '2024-09-17T03:10:25.614663+0000', 'last_fullsized': '2024-09-17T03:10:25.614663+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:10:31.384 INFO:tasks.ceph.ceph_manager.ceph:PG 7.f is not active+clean 2024-09-17T03:10:31.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.614027+0000', 'last_change': '2024-09-17T03:10:25.614027+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.614027+0000', 'last_undegraded': '2024-09-17T03:10:25.614027+0000', 'last_fullsized': '2024-09-17T03:10:25.614027+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:10:31.384 INFO:tasks.ceph.ceph_manager.ceph:PG 7.c is not active+clean 2024-09-17T03:10:31.384 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.610556+0000', 'last_change': '2024-09-17T03:10:25.610556+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.610556+0000', 'last_undegraded': '2024-09-17T03:10:25.610556+0000', 'last_fullsized': '2024-09-17T03:10:25.610556+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:10:31.385 INFO:tasks.ceph.ceph_manager.ceph:PG 7.d is not active+clean 2024-09-17T03:10:31.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.612590+0000', 'last_change': '2024-09-17T03:10:25.612590+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.612590+0000', 'last_undegraded': '2024-09-17T03:10:25.612590+0000', 'last_fullsized': '2024-09-17T03:10:25.612590+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:10:31.385 INFO:tasks.ceph.ceph_manager.ceph:PG 7.b is not active+clean 2024-09-17T03:10:31.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.614989+0000', 'last_change': '2024-09-17T03:10:25.614989+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.614989+0000', 'last_undegraded': '2024-09-17T03:10:25.614989+0000', 'last_fullsized': '2024-09-17T03:10:25.614989+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:10:31.385 INFO:tasks.ceph.ceph_manager.ceph:PG 7.8 is not active+clean 2024-09-17T03:10:31.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.614118+0000', 'last_change': '2024-09-17T03:10:25.614118+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.614118+0000', 'last_undegraded': '2024-09-17T03:10:25.614118+0000', 'last_fullsized': '2024-09-17T03:10:25.614118+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:10:31.385 INFO:tasks.ceph.ceph_manager.ceph:PG 7.9 is not active+clean 2024-09-17T03:10:31.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.613466+0000', 'last_change': '2024-09-17T03:10:25.613466+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.613466+0000', 'last_undegraded': '2024-09-17T03:10:25.613466+0000', 'last_fullsized': '2024-09-17T03:10:25.613466+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:10:31.385 INFO:tasks.ceph.ceph_manager.ceph:PG 7.7 is not active+clean 2024-09-17T03:10:31.385 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.612910+0000', 'last_change': '2024-09-17T03:10:25.612910+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.612910+0000', 'last_undegraded': '2024-09-17T03:10:25.612910+0000', 'last_fullsized': '2024-09-17T03:10:25.612910+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:10:31.385 INFO:tasks.ceph.ceph_manager.ceph:PG 7.4 is not active+clean 2024-09-17T03:10:31.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.613385+0000', 'last_change': '2024-09-17T03:10:25.613385+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.613385+0000', 'last_undegraded': '2024-09-17T03:10:25.613385+0000', 'last_fullsized': '2024-09-17T03:10:25.613385+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:10:31.386 INFO:tasks.ceph.ceph_manager.ceph:PG 7.5 is not active+clean 2024-09-17T03:10:31.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.613721+0000', 'last_change': '2024-09-17T03:10:25.613721+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.613721+0000', 'last_undegraded': '2024-09-17T03:10:25.613721+0000', 'last_fullsized': '2024-09-17T03:10:25.613721+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:10:31.386 INFO:tasks.ceph.ceph_manager.ceph:PG 7.0 is not active+clean 2024-09-17T03:10:31.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.613526+0000', 'last_change': '2024-09-17T03:10:25.613526+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.613526+0000', 'last_undegraded': '2024-09-17T03:10:25.613526+0000', 'last_fullsized': '2024-09-17T03:10:25.613526+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:10:31.386 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1 is not active+clean 2024-09-17T03:10:31.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.611619+0000', 'last_change': '2024-09-17T03:10:25.611619+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.611619+0000', 'last_undegraded': '2024-09-17T03:10:25.611619+0000', 'last_fullsized': '2024-09-17T03:10:25.611619+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:10:31.386 INFO:tasks.ceph.ceph_manager.ceph:PG 7.6 is not active+clean 2024-09-17T03:10:31.386 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:10:25.613500+0000', 'last_change': '2024-09-17T03:10:25.613500+0000', 'last_active': '2024-09-17T03:10:25.596554+0000', 'last_peered': '2024-09-17T03:10:25.596554+0000', 'last_clean': '2024-09-17T03:10:25.596554+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:10:25.613500+0000', 'last_undegraded': '2024-09-17T03:10:25.613500+0000', 'last_fullsized': '2024-09-17T03:10:25.613500+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'last_clean_scrub_stamp': '2024-09-17T03:10:25.596554+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:10:31.387 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:10:31.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.524+0000 7f0b733c3640 1 -- 172.21.15.78:0/397141721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c0701c0 msgr2=0x7f0b6c0705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:31.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.524+0000 7f0b733c3640 1 --2- 172.21.15.78:0/397141721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c0701c0 0x7f0b6c0705d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c070fe0 tx=0x7f0b6402aa30 comp rx=0 tx=0).stop 2024-09-17T03:10:31.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.524+0000 7f0b733c3640 1 -- 172.21.15.78:0/397141721 shutdown_connections 2024-09-17T03:10:31.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.524+0000 7f0b733c3640 1 --2- 172.21.15.78:0/397141721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c0701c0 0x7f0b6c0705d0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.524+0000 7f0b733c3640 1 --2- 172.21.15.78:0/397141721 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0b6c0cf940 0x7f0b6c06fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.524+0000 7f0b733c3640 1 --2- 172.21.15.78:0/397141721 >> v2:172.21.15.193:3300/0 conn(0x7f0b6c0b4d90 0x7f0b6c072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.524+0000 7f0b733c3640 1 -- 172.21.15.78:0/397141721 >> 172.21.15.78:0/397141721 conn(0x7f0b6c06d7d0 msgr2=0x7f0b6c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:31.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.524+0000 7f0b733c3640 1 -- 172.21.15.78:0/397141721 shutdown_connections 2024-09-17T03:10:31.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.524+0000 7f0b733c3640 1 -- 172.21.15.78:0/397141721 wait complete. 2024-09-17T03:10:31.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.526+0000 7f0b733c3640 1 Processor -- start 2024-09-17T03:10:31.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.526+0000 7f0b733c3640 1 -- start start 2024-09-17T03:10:31.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.527+0000 7f0b733c3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b6c0701c0 0x7f0b6c0af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:31.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.527+0000 7f0b733c3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0b6c0cf940 0x7f0b6c14bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:31.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.527+0000 7f0b733c3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c158e10 0x7f0b6c0b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:31.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.527+0000 7f0b733c3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c0cd000 con 0x7f0b6c158e10 2024-09-17T03:10:31.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.527+0000 7f0b733c3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0b6c0cce80 con 0x7f0b6c0701c0 2024-09-17T03:10:31.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.527+0000 7f0b733c3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0b6c0cd180 con 0x7f0b6c0cf940 2024-09-17T03:10:31.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.527+0000 7f0b71960640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c158e10 0x7f0b6c0b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:31.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.527+0000 7f0b71960640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c158e10 0x7f0b6c0b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46920/0 (socket says 172.21.15.78:46920) 2024-09-17T03:10:31.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.527+0000 7f0b71960640 1 -- 172.21.15.78:0/3461705945 learned_addr learned my addr 172.21.15.78:0/3461705945 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:31.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.527+0000 7f0b7115f640 1 --2- 172.21.15.78:0/3461705945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b6c0701c0 0x7f0b6c0af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:31.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.527+0000 7f0b7095e640 1 --2- 172.21.15.78:0/3461705945 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0b6c0cf940 0x7f0b6c14bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:31.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.527+0000 7f0b71960640 1 -- 172.21.15.78:0/3461705945 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0b6c0cf940 msgr2=0x7f0b6c14bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:31.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.527+0000 7f0b71960640 1 --2- 172.21.15.78:0/3461705945 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0b6c0cf940 0x7f0b6c14bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.527+0000 7f0b71960640 1 -- 172.21.15.78:0/3461705945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b6c0701c0 msgr2=0x7f0b6c0af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:31.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.527+0000 7f0b71960640 1 --2- 172.21.15.78:0/3461705945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b6c0701c0 0x7f0b6c0af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.527+0000 7f0b71960640 1 -- 172.21.15.78:0/3461705945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b6c163270 con 0x7f0b6c158e10 2024-09-17T03:10:31.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.527+0000 7f0b7115f640 1 --2- 172.21.15.78:0/3461705945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b6c0701c0 0x7f0b6c0af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:10:31.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.528+0000 7f0b71960640 1 --2- 172.21.15.78:0/3461705945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c158e10 0x7f0b6c0b0c70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0b64009d60 tx=0x7f0b64003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:31.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.528+0000 7f0b61ffb640 1 -- 172.21.15.78:0/3461705945 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b64033050 con 0x7f0b6c158e10 2024-09-17T03:10:31.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.528+0000 7f0b61ffb640 1 -- 172.21.15.78:0/3461705945 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b64004550 con 0x7f0b6c158e10 2024-09-17T03:10:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.528+0000 7f0b733c3640 1 -- 172.21.15.78:0/3461705945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b6c09da70 con 0x7f0b6c158e10 2024-09-17T03:10:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.528+0000 7f0b61ffb640 1 -- 172.21.15.78:0/3461705945 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b64038450 con 0x7f0b6c158e10 2024-09-17T03:10:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.528+0000 7f0b733c3640 1 -- 172.21.15.78:0/3461705945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b6c163550 con 0x7f0b6c158e10 2024-09-17T03:10:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.529+0000 7f0b733c3640 1 -- 172.21.15.78:0/3461705945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b6c0b4d90 con 0x7f0b6c158e10 2024-09-17T03:10:31.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.530+0000 7f0b61ffb640 1 -- 172.21.15.78:0/3461705945 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0b64036070 con 0x7f0b6c158e10 2024-09-17T03:10:31.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.530+0000 7f0b61ffb640 1 --2- 172.21.15.78:0/3461705945 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0b50078b90 0x7f0b5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:31.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.530+0000 7f0b61ffb640 1 -- 172.21.15.78:0/3461705945 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f0b640bc330 con 0x7f0b6c158e10 2024-09-17T03:10:31.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.530+0000 7f0b7115f640 1 --2- 172.21.15.78:0/3461705945 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0b50078b90 0x7f0b5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:31.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.531+0000 7f0b7115f640 1 --2- 172.21.15.78:0/3461705945 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0b50078b90 0x7f0b5007b0a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0b680058c0 tx=0x7f0b68005c90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:31.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.535+0000 7f0b61ffb640 1 -- 172.21.15.78:0/3461705945 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0b64084800 con 0x7f0b6c158e10 2024-09-17T03:10:31.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.779+0000 7f0b733c3640 1 -- 172.21.15.78:0/3461705945 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f0b6c0d0e80 con 0x7f0b6c158e10 2024-09-17T03:10:31.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.779+0000 7f0b61ffb640 1 -- 172.21.15.78:0/3461705945 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1141 (secure 0 0 0) 0x7f0b64084100 con 0x7f0b6c158e10 2024-09-17T03:10:31.778 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:31.778 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":148,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":45,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":55},{"state_name":"active+clean","count":42}],"num_pgs":97,"num_pools":3,"num_objects":8,"data_bytes":590984,"bytes_used":235094016,"bytes_avail":772859019264,"bytes_total":773094113280,"inactive_pgs_ratio":0.56701028347015381,"write_bytes_sec":1364,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":29,"btime":"2024-09-17T03:10:29:624541+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"b","status":"up:active","gid":5565}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2024-09-17T03:10:15.146966+0000","services":{}},"progress_events":{}} 2024-09-17T03:10:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.782+0000 7f0b733c3640 1 -- 172.21.15.78:0/3461705945 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0b50078b90 msgr2=0x7f0b5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.782+0000 7f0b733c3640 1 --2- 172.21.15.78:0/3461705945 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0b50078b90 0x7f0b5007b0a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0b680058c0 tx=0x7f0b68005c90 comp rx=0 tx=0).stop 2024-09-17T03:10:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.782+0000 7f0b733c3640 1 -- 172.21.15.78:0/3461705945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c158e10 msgr2=0x7f0b6c0b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.782+0000 7f0b733c3640 1 --2- 172.21.15.78:0/3461705945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c158e10 0x7f0b6c0b0c70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0b64009d60 tx=0x7f0b64003f10 comp rx=0 tx=0).stop 2024-09-17T03:10:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.782+0000 7f0b733c3640 1 -- 172.21.15.78:0/3461705945 shutdown_connections 2024-09-17T03:10:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.782+0000 7f0b733c3640 1 --2- 172.21.15.78:0/3461705945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0b6c158e10 0x7f0b6c0b0c70 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.782+0000 7f0b733c3640 1 --2- 172.21.15.78:0/3461705945 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0b6c0cf940 0x7f0b6c14bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.782+0000 7f0b733c3640 1 --2- 172.21.15.78:0/3461705945 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0b50078b90 0x7f0b5007b0a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.782+0000 7f0b733c3640 1 --2- 172.21.15.78:0/3461705945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b6c0701c0 0x7f0b6c0af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.782+0000 7f0b733c3640 1 -- 172.21.15.78:0/3461705945 >> 172.21.15.78:0/3461705945 conn(0x7f0b6c06d7d0 msgr2=0x7f0b6c0acf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.782+0000 7f0b733c3640 1 -- 172.21.15.78:0/3461705945 shutdown_connections 2024-09-17T03:10:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.782+0000 7f0b733c3640 1 -- 172.21.15.78:0/3461705945 wait complete. 2024-09-17T03:10:31.792 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:10:31.792 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:10:31.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.906+0000 7fb1bda77640 1 -- 172.21.15.78:0/1803765294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1b80d2ed0 msgr2=0x7fb1b80d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:31.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.906+0000 7fb1bda77640 1 --2- 172.21.15.78:0/1803765294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1b80d2ed0 0x7fb1b80d1a80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80c8020 tx=0x7fb1a802a560 comp rx=0 tx=0).stop 2024-09-17T03:10:31.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.906+0000 7fb1bda77640 1 -- 172.21.15.78:0/1803765294 shutdown_connections 2024-09-17T03:10:31.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.906+0000 7fb1bda77640 1 --2- 172.21.15.78:0/1803765294 >> v2:172.21.15.193:3300/0 conn(0x7fb1b80cf5d0 0x7fb1b80cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.906+0000 7fb1bda77640 1 --2- 172.21.15.78:0/1803765294 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb1b80b9b70 0x7fb1b80cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.906+0000 7fb1bda77640 1 --2- 172.21.15.78:0/1803765294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1b80d2ed0 0x7fb1b80d1a80 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.906+0000 7fb1bda77640 1 -- 172.21.15.78:0/1803765294 >> 172.21.15.78:0/1803765294 conn(0x7fb1b808bfc0 msgr2=0x7fb1b809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:31.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.906+0000 7fb1bda77640 1 -- 172.21.15.78:0/1803765294 shutdown_connections 2024-09-17T03:10:31.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.906+0000 7fb1bda77640 1 -- 172.21.15.78:0/1803765294 wait complete. 2024-09-17T03:10:31.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.908+0000 7fb1bda77640 1 Processor -- start 2024-09-17T03:10:31.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.908+0000 7fb1bda77640 1 -- start start 2024-09-17T03:10:31.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.909+0000 7fb1bda77640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1b80b9b70 0x7fb1b8150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:31.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb1bda77640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb1b80cf5d0 0x7fb1b815fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:31.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb1bda77640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb1b80d2ed0 0x7fb1b80c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:31.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb1bda77640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b80d4640 con 0x7fb1b80b9b70 2024-09-17T03:10:31.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb1bda77640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb1b80d44c0 con 0x7fb1b80d2ed0 2024-09-17T03:10:31.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb1bda77640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb1b80d47c0 con 0x7fb1b80cf5d0 2024-09-17T03:10:31.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb1b77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1b80b9b70 0x7fb1b8150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:31.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb1b77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1b80b9b70 0x7fb1b8150d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46948/0 (socket says 172.21.15.78:46948) 2024-09-17T03:10:31.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb1b77fe640 1 -- 172.21.15.78:0/1358972016 learned_addr learned my addr 172.21.15.78:0/1358972016 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:31.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb1b7fff640 1 --2- 172.21.15.78:0/1358972016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb1b80d2ed0 0x7fb1b80c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:31.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb1b6ffd640 1 --2- 172.21.15.78:0/1358972016 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb1b80cf5d0 0x7fb1b815fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:31.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb1b77fe640 1 -- 172.21.15.78:0/1358972016 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb1b80cf5d0 msgr2=0x7fb1b815fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:31.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb1b77fe640 1 --2- 172.21.15.78:0/1358972016 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb1b80cf5d0 0x7fb1b815fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb1b77fe640 1 -- 172.21.15.78:0/1358972016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb1b80d2ed0 msgr2=0x7fb1b80c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:31.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb1b77fe640 1 --2- 172.21.15.78:0/1358972016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb1b80d2ed0 0x7fb1b80c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:31.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb1b77fe640 1 -- 172.21.15.78:0/1358972016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b815f420 con 0x7fb1b80b9b70 2024-09-17T03:10:31.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb1b77fe640 1 --2- 172.21.15.78:0/1358972016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1b80b9b70 0x7fb1b8150d10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80099d0 tx=0x7fb1a80052f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:31.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb19ffff640 1 -- 172.21.15.78:0/1358972016 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8031b50 con 0x7fb1b80b9b70 2024-09-17T03:10:31.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb19ffff640 1 -- 172.21.15.78:0/1358972016 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1a8031de0 con 0x7fb1b80b9b70 2024-09-17T03:10:31.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb19ffff640 1 -- 172.21.15.78:0/1358972016 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8004a00 con 0x7fb1b80b9b70 2024-09-17T03:10:31.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb1bda77640 1 -- 172.21.15.78:0/1358972016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1b8151250 con 0x7fb1b80b9b70 2024-09-17T03:10:31.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.910+0000 7fb1bda77640 1 -- 172.21.15.78:0/1358972016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1b815d2b0 con 0x7fb1b80b9b70 2024-09-17T03:10:31.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.911+0000 7fb1bda77640 1 -- 172.21.15.78:0/1358972016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1b80d4db0 con 0x7fb1b80b9b70 2024-09-17T03:10:31.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.912+0000 7fb19ffff640 1 -- 172.21.15.78:0/1358972016 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb1a8004ba0 con 0x7fb1b80b9b70 2024-09-17T03:10:31.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.912+0000 7fb19ffff640 1 --2- 172.21.15.78:0/1358972016 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb1a4078b90 0x7fb1a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:31.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.913+0000 7fb19ffff640 1 -- 172.21.15.78:0/1358972016 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fb1a80bc0f0 con 0x7fb1b80b9b70 2024-09-17T03:10:31.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.913+0000 7fb1b6ffd640 1 --2- 172.21.15.78:0/1358972016 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb1a4078b90 0x7fb1a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:31.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.913+0000 7fb1b6ffd640 1 --2- 172.21.15.78:0/1358972016 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb1a4078b90 0x7fb1a407b0a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8159450 tx=0x7fb1ac0090e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:31.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:31.917+0000 7fb19ffff640 1 -- 172.21.15.78:0/1358972016 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb1b815f420 con 0x7fb1b80b9b70 2024-09-17T03:10:32.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:32.089+0000 7fb1bda77640 1 -- 172.21.15.78:0/1358972016 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb1b80d5050 con 0x7fb1a4078b90 2024-09-17T03:10:32.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:32.094+0000 7fb19ffff640 1 -- 172.21.15.78:0/1358972016 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247415 (secure 0 0 0) 0x7fb1b80d5050 con 0x7fb1a4078b90 2024-09-17T03:10:32.095 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:32.096 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:10:32.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:32.097+0000 7fb1bda77640 1 -- 172.21.15.78:0/1358972016 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb1a4078b90 msgr2=0x7fb1a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:32.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:32.097+0000 7fb1bda77640 1 --2- 172.21.15.78:0/1358972016 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb1a4078b90 0x7fb1a407b0a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8159450 tx=0x7fb1ac0090e0 comp rx=0 tx=0).stop 2024-09-17T03:10:32.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:32.097+0000 7fb1bda77640 1 -- 172.21.15.78:0/1358972016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1b80b9b70 msgr2=0x7fb1b8150d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:32.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:32.097+0000 7fb1bda77640 1 --2- 172.21.15.78:0/1358972016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1b80b9b70 0x7fb1b8150d10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb1a80099d0 tx=0x7fb1a80052f0 comp rx=0 tx=0).stop 2024-09-17T03:10:32.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:32.097+0000 7fb1bda77640 1 -- 172.21.15.78:0/1358972016 shutdown_connections 2024-09-17T03:10:32.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:32.097+0000 7fb1bda77640 1 --2- 172.21.15.78:0/1358972016 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb1a4078b90 0x7fb1a407b0a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:32.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:32.097+0000 7fb1bda77640 1 --2- 172.21.15.78:0/1358972016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb1b80d2ed0 0x7fb1b80c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:32.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:32.097+0000 7fb1bda77640 1 --2- 172.21.15.78:0/1358972016 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb1b80cf5d0 0x7fb1b815fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:32.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:32.097+0000 7fb1bda77640 1 --2- 172.21.15.78:0/1358972016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1b80b9b70 0x7fb1b8150d10 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:32.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:32.097+0000 7fb1bda77640 1 -- 172.21.15.78:0/1358972016 >> 172.21.15.78:0/1358972016 conn(0x7fb1b808bfc0 msgr2=0x7fb1b806f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:32.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:32.097+0000 7fb1bda77640 1 -- 172.21.15.78:0/1358972016 shutdown_connections 2024-09-17T03:10:32.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:32.097+0000 7fb1bda77640 1 -- 172.21.15.78:0/1358972016 wait complete. 2024-09-17T03:10:32.107 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2024-09-17T03:10:31.150932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":110,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229584,"kb_used_data":5020,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745136,"statfs":{"total":773094113280,"available":772859019264,"internally_reserved":0,"allocated":5140480,"data_stored":2740676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001742"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615402+0000","last_change":"2024-09-17T03:10:25.615402+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615402+0000","last_undegraded":"2024-09-17T03:10:25.615402+0000","last_fullsized":"2024-09-17T03:10:25.615402+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616162+0000","last_change":"2024-09-17T03:10:25.616162+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616162+0000","last_undegraded":"2024-09-17T03:10:25.616162+0000","last_fullsized":"2024-09-17T03:10:25.616162+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.609754+0000","last_change":"2024-09-17T03:10:25.609754+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.609754+0000","last_undegraded":"2024-09-17T03:10:25.609754+0000","last_fullsized":"2024-09-17T03:10:25.609754+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.618870+0000","last_change":"2024-09-17T03:10:25.618870+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.618870+0000","last_undegraded":"2024-09-17T03:10:25.618870+0000","last_fullsized":"2024-09-17T03:10:25.618870+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614129+0000","last_change":"2024-09-17T03:10:25.614129+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614129+0000","last_undegraded":"2024-09-17T03:10:25.614129+0000","last_fullsized":"2024-09-17T03:10:25.614129+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.633121+0000","last_change":"2024-09-17T03:10:26.627225+0000","last_active":"2024-09-17T03:10:26.633121+0000","last_peered":"2024-09-17T03:10:26.633121+0000","last_clean":"2024-09-17T03:10:26.633121+0000","last_became_active":"2024-09-17T03:10:26.626923+0000","last_became_peered":"2024-09-17T03:10:26.626923+0000","last_unstale":"2024-09-17T03:10:26.633121+0000","last_undegraded":"2024-09-17T03:10:26.633121+0000","last_fullsized":"2024-09-17T03:10:26.633121+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:54:56.586793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615319+0000","last_change":"2024-09-17T03:10:25.615319+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615319+0000","last_undegraded":"2024-09-17T03:10:25.615319+0000","last_fullsized":"2024-09-17T03:10:25.615319+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616535+0000","last_change":"2024-09-17T03:10:25.616535+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616535+0000","last_undegraded":"2024-09-17T03:10:25.616535+0000","last_fullsized":"2024-09-17T03:10:25.616535+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616079+0000","last_change":"2024-09-17T03:10:25.616079+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616079+0000","last_undegraded":"2024-09-17T03:10:25.616079+0000","last_fullsized":"2024-09-17T03:10:25.616079+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615559+0000","last_change":"2024-09-17T03:10:25.615559+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615559+0000","last_undegraded":"2024-09-17T03:10:25.615559+0000","last_fullsized":"2024-09-17T03:10:25.615559+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615839+0000","last_change":"2024-09-17T03:10:25.615839+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615839+0000","last_undegraded":"2024-09-17T03:10:25.615839+0000","last_fullsized":"2024-09-17T03:10:25.615839+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615631+0000","last_change":"2024-09-17T03:10:25.615631+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615631+0000","last_undegraded":"2024-09-17T03:10:25.615631+0000","last_fullsized":"2024-09-17T03:10:25.615631+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616737+0000","last_change":"2024-09-17T03:10:25.616737+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616737+0000","last_undegraded":"2024-09-17T03:10:25.616737+0000","last_fullsized":"2024-09-17T03:10:25.616737+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615070+0000","last_change":"2024-09-17T03:10:25.615070+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615070+0000","last_undegraded":"2024-09-17T03:10:25.615070+0000","last_fullsized":"2024-09-17T03:10:25.615070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.632804+0000","last_change":"2024-09-17T03:10:26.626832+0000","last_active":"2024-09-17T03:10:26.632804+0000","last_peered":"2024-09-17T03:10:26.632804+0000","last_clean":"2024-09-17T03:10:26.632804+0000","last_became_active":"2024-09-17T03:10:26.625618+0000","last_became_peered":"2024-09-17T03:10:26.625618+0000","last_unstale":"2024-09-17T03:10:26.632804+0000","last_undegraded":"2024-09-17T03:10:26.632804+0000","last_fullsized":"2024-09-17T03:10:26.632804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:01:11.569131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614248+0000","last_change":"2024-09-17T03:10:25.614248+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614248+0000","last_undegraded":"2024-09-17T03:10:25.614248+0000","last_fullsized":"2024-09-17T03:10:25.614248+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.608846+0000","last_change":"2024-09-17T03:10:25.608846+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.608846+0000","last_undegraded":"2024-09-17T03:10:25.608846+0000","last_fullsized":"2024-09-17T03:10:25.608846+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.610584+0000","last_change":"2024-09-17T03:10:25.610584+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.610584+0000","last_undegraded":"2024-09-17T03:10:25.610584+0000","last_fullsized":"2024-09-17T03:10:25.610584+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.611206+0000","last_change":"2024-09-17T03:10:25.611206+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.611206+0000","last_undegraded":"2024-09-17T03:10:25.611206+0000","last_fullsized":"2024-09-17T03:10:25.611206+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616259+0000","last_change":"2024-09-17T03:10:25.616259+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616259+0000","last_undegraded":"2024-09-17T03:10:25.616259+0000","last_fullsized":"2024-09-17T03:10:25.616259+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.640384+0000","last_change":"2024-09-17T03:10:26.636653+0000","last_active":"2024-09-17T03:10:26.640384+0000","last_peered":"2024-09-17T03:10:26.640384+0000","last_clean":"2024-09-17T03:10:26.640384+0000","last_became_active":"2024-09-17T03:10:26.636103+0000","last_became_peered":"2024-09-17T03:10:26.636103+0000","last_unstale":"2024-09-17T03:10:26.640384+0000","last_undegraded":"2024-09-17T03:10:26.640384+0000","last_fullsized":"2024-09-17T03:10:26.640384+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:07.048273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614516+0000","last_change":"2024-09-17T03:10:25.614516+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614516+0000","last_undegraded":"2024-09-17T03:10:25.614516+0000","last_fullsized":"2024-09-17T03:10:25.614516+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.612876+0000","last_change":"2024-09-17T03:10:25.612876+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.612876+0000","last_undegraded":"2024-09-17T03:10:25.612876+0000","last_fullsized":"2024-09-17T03:10:25.612876+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.612070+0000","last_change":"2024-09-17T03:10:25.612070+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.612070+0000","last_undegraded":"2024-09-17T03:10:25.612070+0000","last_fullsized":"2024-09-17T03:10:25.612070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614092+0000","last_change":"2024-09-17T03:10:25.614092+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614092+0000","last_undegraded":"2024-09-17T03:10:25.614092+0000","last_fullsized":"2024-09-17T03:10:25.614092+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615695+0000","last_change":"2024-09-17T03:10:25.615695+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615695+0000","last_undegraded":"2024-09-17T03:10:25.615695+0000","last_fullsized":"2024-09-17T03:10:25.615695+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.609226+0000","last_change":"2024-09-17T03:10:25.609226+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.609226+0000","last_undegraded":"2024-09-17T03:10:25.609226+0000","last_fullsized":"2024-09-17T03:10:25.609226+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615144+0000","last_change":"2024-09-17T03:10:25.615144+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615144+0000","last_undegraded":"2024-09-17T03:10:25.615144+0000","last_fullsized":"2024-09-17T03:10:25.615144+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.610015+0000","last_change":"2024-09-17T03:10:25.610015+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.610015+0000","last_undegraded":"2024-09-17T03:10:25.610015+0000","last_fullsized":"2024-09-17T03:10:25.610015+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.610387+0000","last_change":"2024-09-17T03:10:25.610387+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.610387+0000","last_undegraded":"2024-09-17T03:10:25.610387+0000","last_fullsized":"2024-09-17T03:10:25.610387+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.640234+0000","last_change":"2024-09-17T03:10:26.632798+0000","last_active":"2024-09-17T03:10:26.640234+0000","last_peered":"2024-09-17T03:10:26.640234+0000","last_clean":"2024-09-17T03:10:26.640234+0000","last_became_active":"2024-09-17T03:10:26.632513+0000","last_became_peered":"2024-09-17T03:10:26.632513+0000","last_unstale":"2024-09-17T03:10:26.640234+0000","last_undegraded":"2024-09-17T03:10:26.640234+0000","last_fullsized":"2024-09-17T03:10:26.640234+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:16.049381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615186+0000","last_change":"2024-09-17T03:10:25.615186+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615186+0000","last_undegraded":"2024-09-17T03:10:25.615186+0000","last_fullsized":"2024-09-17T03:10:25.615186+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.615543+0000","last_change":"2024-09-17T03:10:25.615543+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.615543+0000","last_undegraded":"2024-09-17T03:10:25.615543+0000","last_fullsized":"2024-09-17T03:10:25.615543+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.639313+0000","last_change":"2024-09-17T03:10:25.630050+0000","last_active":"2024-09-17T03:10:26.639313+0000","last_peered":"2024-09-17T03:10:26.639313+0000","last_clean":"2024-09-17T03:10:26.639313+0000","last_became_active":"2024-09-17T03:10:25.629738+0000","last_became_peered":"2024-09-17T03:10:25.629738+0000","last_unstale":"2024-09-17T03:10:26.639313+0000","last_undegraded":"2024-09-17T03:10:26.639313+0000","last_fullsized":"2024-09-17T03:10:26.639313+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:34.296787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613567+0000","last_change":"2024-09-17T03:10:25.613567+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613567+0000","last_undegraded":"2024-09-17T03:10:25.613567+0000","last_fullsized":"2024-09-17T03:10:25.613567+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.621731+0000","last_change":"2024-09-17T03:10:25.616451+0000","last_active":"2024-09-17T03:10:25.621731+0000","last_peered":"2024-09-17T03:10:25.621731+0000","last_clean":"2024-09-17T03:10:25.621731+0000","last_became_active":"2024-09-17T03:10:25.616110+0000","last_became_peered":"2024-09-17T03:10:25.616110+0000","last_unstale":"2024-09-17T03:10:25.621731+0000","last_undegraded":"2024-09-17T03:10:25.621731+0000","last_fullsized":"2024-09-17T03:10:25.621731+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:44:23.827138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614645+0000","last_change":"2024-09-17T03:10:25.614645+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614645+0000","last_undegraded":"2024-09-17T03:10:25.614645+0000","last_fullsized":"2024-09-17T03:10:25.614645+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.631530+0000","last_change":"2024-09-17T03:10:25.626520+0000","last_active":"2024-09-17T03:10:25.631530+0000","last_peered":"2024-09-17T03:10:25.631530+0000","last_clean":"2024-09-17T03:10:25.631530+0000","last_became_active":"2024-09-17T03:10:25.626229+0000","last_became_peered":"2024-09-17T03:10:25.626229+0000","last_unstale":"2024-09-17T03:10:25.631530+0000","last_undegraded":"2024-09-17T03:10:25.631530+0000","last_fullsized":"2024-09-17T03:10:25.631530+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:18.573372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.616315+0000","last_change":"2024-09-17T03:10:25.616315+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.616315+0000","last_undegraded":"2024-09-17T03:10:25.616315+0000","last_fullsized":"2024-09-17T03:10:25.616315+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.628587+0000","last_change":"2024-09-17T03:10:25.626034+0000","last_active":"2024-09-17T03:10:25.628587+0000","last_peered":"2024-09-17T03:10:25.628587+0000","last_clean":"2024-09-17T03:10:25.628587+0000","last_became_active":"2024-09-17T03:10:25.625671+0000","last_became_peered":"2024-09-17T03:10:25.625671+0000","last_unstale":"2024-09-17T03:10:25.628587+0000","last_undegraded":"2024-09-17T03:10:25.628587+0000","last_fullsized":"2024-09-17T03:10:25.628587+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:51.028351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.609800+0000","last_change":"2024-09-17T03:10:25.609800+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.609800+0000","last_undegraded":"2024-09-17T03:10:25.609800+0000","last_fullsized":"2024-09-17T03:10:25.609800+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.630431+0000","last_change":"2024-09-17T03:10:25.627030+0000","last_active":"2024-09-17T03:10:26.630431+0000","last_peered":"2024-09-17T03:10:26.630431+0000","last_clean":"2024-09-17T03:10:26.630431+0000","last_became_active":"2024-09-17T03:10:25.626746+0000","last_became_peered":"2024-09-17T03:10:25.626746+0000","last_unstale":"2024-09-17T03:10:26.630431+0000","last_undegraded":"2024-09-17T03:10:26.630431+0000","last_fullsized":"2024-09-17T03:10:26.630431+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:20.215142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614407+0000","last_change":"2024-09-17T03:10:25.614407+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614407+0000","last_undegraded":"2024-09-17T03:10:25.614407+0000","last_fullsized":"2024-09-17T03:10:25.614407+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.626927+0000","last_change":"2024-09-17T03:10:25.624581+0000","last_active":"2024-09-17T03:10:25.626927+0000","last_peered":"2024-09-17T03:10:25.626927+0000","last_clean":"2024-09-17T03:10:25.626927+0000","last_became_active":"2024-09-17T03:10:25.623625+0000","last_became_peered":"2024-09-17T03:10:25.623625+0000","last_unstale":"2024-09-17T03:10:25.626927+0000","last_undegraded":"2024-09-17T03:10:25.626927+0000","last_fullsized":"2024-09-17T03:10:25.626927+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:32.576616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613970+0000","last_change":"2024-09-17T03:10:25.613970+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613970+0000","last_undegraded":"2024-09-17T03:10:25.613970+0000","last_fullsized":"2024-09-17T03:10:25.613970+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.630138+0000","last_change":"2024-09-17T03:10:25.625253+0000","last_active":"2024-09-17T03:10:25.630138+0000","last_peered":"2024-09-17T03:10:25.630138+0000","last_clean":"2024-09-17T03:10:25.630138+0000","last_became_active":"2024-09-17T03:10:25.624870+0000","last_became_peered":"2024-09-17T03:10:25.624870+0000","last_unstale":"2024-09-17T03:10:25.630138+0000","last_undegraded":"2024-09-17T03:10:25.630138+0000","last_fullsized":"2024-09-17T03:10:25.630138+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:16.507885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613828+0000","last_change":"2024-09-17T03:10:25.613828+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613828+0000","last_undegraded":"2024-09-17T03:10:25.613828+0000","last_fullsized":"2024-09-17T03:10:25.613828+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.634039+0000","last_change":"2024-09-17T03:10:25.628027+0000","last_active":"2024-09-17T03:10:25.634039+0000","last_peered":"2024-09-17T03:10:25.634039+0000","last_clean":"2024-09-17T03:10:25.634039+0000","last_became_active":"2024-09-17T03:10:25.624938+0000","last_became_peered":"2024-09-17T03:10:25.624938+0000","last_unstale":"2024-09-17T03:10:25.634039+0000","last_undegraded":"2024-09-17T03:10:25.634039+0000","last_fullsized":"2024-09-17T03:10:25.634039+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:24.615797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.609938+0000","last_change":"2024-09-17T03:10:25.609938+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.609938+0000","last_undegraded":"2024-09-17T03:10:25.609938+0000","last_fullsized":"2024-09-17T03:10:25.609938+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.621285+0000","last_change":"2024-09-17T03:10:25.619136+0000","last_active":"2024-09-17T03:10:25.621285+0000","last_peered":"2024-09-17T03:10:25.621285+0000","last_clean":"2024-09-17T03:10:25.621285+0000","last_became_active":"2024-09-17T03:10:25.618816+0000","last_became_peered":"2024-09-17T03:10:25.618816+0000","last_unstale":"2024-09-17T03:10:25.621285+0000","last_undegraded":"2024-09-17T03:10:25.621285+0000","last_fullsized":"2024-09-17T03:10:25.621285+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:47.735636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613992+0000","last_change":"2024-09-17T03:10:25.613992+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613992+0000","last_undegraded":"2024-09-17T03:10:25.613992+0000","last_fullsized":"2024-09-17T03:10:25.613992+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.627651+0000","last_change":"2024-09-17T03:10:25.623416+0000","last_active":"2024-09-17T03:10:25.627651+0000","last_peered":"2024-09-17T03:10:25.627651+0000","last_clean":"2024-09-17T03:10:25.627651+0000","last_became_active":"2024-09-17T03:10:25.623090+0000","last_became_peered":"2024-09-17T03:10:25.623090+0000","last_unstale":"2024-09-17T03:10:25.627651+0000","last_undegraded":"2024-09-17T03:10:25.627651+0000","last_fullsized":"2024-09-17T03:10:25.627651+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:20.799970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.632253+0000","last_change":"2024-09-17T03:10:26.626795+0000","last_active":"2024-09-17T03:10:26.632253+0000","last_peered":"2024-09-17T03:10:26.632253+0000","last_clean":"2024-09-17T03:10:26.632253+0000","last_became_active":"2024-09-17T03:10:26.625634+0000","last_became_peered":"2024-09-17T03:10:26.625634+0000","last_unstale":"2024-09-17T03:10:26.632253+0000","last_undegraded":"2024-09-17T03:10:26.632253+0000","last_fullsized":"2024-09-17T03:10:26.632253+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:12:40.332682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.628554+0000","last_change":"2024-09-17T03:10:25.625282+0000","last_active":"2024-09-17T03:10:25.628554+0000","last_peered":"2024-09-17T03:10:25.628554+0000","last_clean":"2024-09-17T03:10:25.628554+0000","last_became_active":"2024-09-17T03:10:25.624893+0000","last_became_peered":"2024-09-17T03:10:25.624893+0000","last_unstale":"2024-09-17T03:10:25.628554+0000","last_undegraded":"2024-09-17T03:10:25.628554+0000","last_fullsized":"2024-09-17T03:10:25.628554+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:16.507885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614580+0000","last_change":"2024-09-17T03:10:25.614580+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614580+0000","last_undegraded":"2024-09-17T03:10:25.614580+0000","last_fullsized":"2024-09-17T03:10:25.614580+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.621247+0000","last_change":"2024-09-17T03:10:25.614140+0000","last_active":"2024-09-17T03:10:25.621247+0000","last_peered":"2024-09-17T03:10:25.621247+0000","last_clean":"2024-09-17T03:10:25.621247+0000","last_became_active":"2024-09-17T03:10:25.613844+0000","last_became_peered":"2024-09-17T03:10:25.613844+0000","last_unstale":"2024-09-17T03:10:25.621247+0000","last_undegraded":"2024-09-17T03:10:25.621247+0000","last_fullsized":"2024-09-17T03:10:25.621247+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:49.842511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.609410+0000","last_change":"2024-09-17T03:10:25.609410+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.609410+0000","last_undegraded":"2024-09-17T03:10:25.609410+0000","last_fullsized":"2024-09-17T03:10:25.609410+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.632428+0000","last_change":"2024-09-17T03:10:25.630508+0000","last_active":"2024-09-17T03:10:26.632428+0000","last_peered":"2024-09-17T03:10:26.632428+0000","last_clean":"2024-09-17T03:10:26.632428+0000","last_became_active":"2024-09-17T03:10:25.630209+0000","last_became_peered":"2024-09-17T03:10:25.630209+0000","last_unstale":"2024-09-17T03:10:26.632428+0000","last_undegraded":"2024-09-17T03:10:26.632428+0000","last_fullsized":"2024-09-17T03:10:26.632428+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:15.757991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613962+0000","last_change":"2024-09-17T03:10:25.613962+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613962+0000","last_undegraded":"2024-09-17T03:10:25.613962+0000","last_fullsized":"2024-09-17T03:10:25.613962+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.632215+0000","last_change":"2024-09-17T03:10:25.628330+0000","last_active":"2024-09-17T03:10:25.632215+0000","last_peered":"2024-09-17T03:10:25.632215+0000","last_clean":"2024-09-17T03:10:25.632215+0000","last_became_active":"2024-09-17T03:10:25.627919+0000","last_became_peered":"2024-09-17T03:10:25.627919+0000","last_unstale":"2024-09-17T03:10:25.632215+0000","last_undegraded":"2024-09-17T03:10:25.632215+0000","last_fullsized":"2024-09-17T03:10:25.632215+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:14.190956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.637269+0000","last_change":"2024-09-17T03:10:26.630787+0000","last_active":"2024-09-17T03:10:26.637269+0000","last_peered":"2024-09-17T03:10:26.637269+0000","last_clean":"2024-09-17T03:10:26.637269+0000","last_became_active":"2024-09-17T03:10:26.629999+0000","last_became_peered":"2024-09-17T03:10:26.629999+0000","last_unstale":"2024-09-17T03:10:26.637269+0000","last_undegraded":"2024-09-17T03:10:26.637269+0000","last_fullsized":"2024-09-17T03:10:26.637269+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:54.370486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.614340+0000","last_change":"2024-09-17T03:10:25.625455+0000","last_active":"2024-09-17T03:10:26.614340+0000","last_peered":"2024-09-17T03:10:26.614340+0000","last_clean":"2024-09-17T03:10:26.614340+0000","last_became_active":"2024-09-17T03:10:25.625151+0000","last_became_peered":"2024-09-17T03:10:25.625151+0000","last_unstale":"2024-09-17T03:10:26.614340+0000","last_undegraded":"2024-09-17T03:10:26.614340+0000","last_fullsized":"2024-09-17T03:10:26.614340+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:24.800733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613788+0000","last_change":"2024-09-17T03:10:25.613788+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613788+0000","last_undegraded":"2024-09-17T03:10:25.613788+0000","last_fullsized":"2024-09-17T03:10:25.613788+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.627892+0000","last_change":"2024-09-17T03:10:25.623870+0000","last_active":"2024-09-17T03:10:25.627892+0000","last_peered":"2024-09-17T03:10:25.627892+0000","last_clean":"2024-09-17T03:10:25.627892+0000","last_became_active":"2024-09-17T03:10:25.622936+0000","last_became_peered":"2024-09-17T03:10:25.622936+0000","last_unstale":"2024-09-17T03:10:25.627892+0000","last_undegraded":"2024-09-17T03:10:25.627892+0000","last_fullsized":"2024-09-17T03:10:25.627892+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:36.802376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614663+0000","last_change":"2024-09-17T03:10:25.614663+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614663+0000","last_undegraded":"2024-09-17T03:10:25.614663+0000","last_fullsized":"2024-09-17T03:10:25.614663+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.636862+0000","last_change":"2024-09-17T03:10:25.627052+0000","last_active":"2024-09-17T03:10:25.636862+0000","last_peered":"2024-09-17T03:10:25.636862+0000","last_clean":"2024-09-17T03:10:25.636862+0000","last_became_active":"2024-09-17T03:10:25.626732+0000","last_became_peered":"2024-09-17T03:10:25.626732+0000","last_unstale":"2024-09-17T03:10:25.636862+0000","last_undegraded":"2024-09-17T03:10:25.636862+0000","last_fullsized":"2024-09-17T03:10:25.636862+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:45.402110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614027+0000","last_change":"2024-09-17T03:10:25.614027+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614027+0000","last_undegraded":"2024-09-17T03:10:25.614027+0000","last_fullsized":"2024-09-17T03:10:25.614027+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.626596+0000","last_change":"2024-09-17T03:10:25.622889+0000","last_active":"2024-09-17T03:10:25.626596+0000","last_peered":"2024-09-17T03:10:25.626596+0000","last_clean":"2024-09-17T03:10:25.626596+0000","last_became_active":"2024-09-17T03:10:25.622552+0000","last_became_peered":"2024-09-17T03:10:25.622552+0000","last_unstale":"2024-09-17T03:10:25.626596+0000","last_undegraded":"2024-09-17T03:10:25.626596+0000","last_fullsized":"2024-09-17T03:10:25.626596+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:57.309006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.610556+0000","last_change":"2024-09-17T03:10:25.610556+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.610556+0000","last_undegraded":"2024-09-17T03:10:25.610556+0000","last_fullsized":"2024-09-17T03:10:25.610556+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.630021+0000","last_change":"2024-09-17T03:10:25.625213+0000","last_active":"2024-09-17T03:10:25.630021+0000","last_peered":"2024-09-17T03:10:25.630021+0000","last_clean":"2024-09-17T03:10:25.630021+0000","last_became_active":"2024-09-17T03:10:25.624885+0000","last_became_peered":"2024-09-17T03:10:25.624885+0000","last_unstale":"2024-09-17T03:10:25.630021+0000","last_undegraded":"2024-09-17T03:10:25.630021+0000","last_fullsized":"2024-09-17T03:10:25.630021+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:40.794606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.612590+0000","last_change":"2024-09-17T03:10:25.612590+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.612590+0000","last_undegraded":"2024-09-17T03:10:25.612590+0000","last_fullsized":"2024-09-17T03:10:25.612590+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.616186+0000","last_change":"2024-09-17T03:10:25.626305+0000","last_active":"2024-09-17T03:10:26.616186+0000","last_peered":"2024-09-17T03:10:26.616186+0000","last_clean":"2024-09-17T03:10:26.616186+0000","last_became_active":"2024-09-17T03:10:25.626021+0000","last_became_peered":"2024-09-17T03:10:25.626021+0000","last_unstale":"2024-09-17T03:10:26.616186+0000","last_undegraded":"2024-09-17T03:10:26.616186+0000","last_fullsized":"2024-09-17T03:10:26.616186+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:20.547659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.637228+0000","last_change":"2024-09-17T03:10:26.628582+0000","last_active":"2024-09-17T03:10:26.637228+0000","last_peered":"2024-09-17T03:10:26.637228+0000","last_clean":"2024-09-17T03:10:26.637228+0000","last_became_active":"2024-09-17T03:10:26.628003+0000","last_became_peered":"2024-09-17T03:10:26.628003+0000","last_unstale":"2024-09-17T03:10:26.637228+0000","last_undegraded":"2024-09-17T03:10:26.637228+0000","last_fullsized":"2024-09-17T03:10:26.637228+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:48.501354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.630505+0000","last_change":"2024-09-17T03:10:25.628379+0000","last_active":"2024-09-17T03:10:26.630505+0000","last_peered":"2024-09-17T03:10:26.630505+0000","last_clean":"2024-09-17T03:10:26.630505+0000","last_became_active":"2024-09-17T03:10:25.628078+0000","last_became_peered":"2024-09-17T03:10:25.628078+0000","last_unstale":"2024-09-17T03:10:26.630505+0000","last_undegraded":"2024-09-17T03:10:26.630505+0000","last_fullsized":"2024-09-17T03:10:26.630505+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:23.877248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614989+0000","last_change":"2024-09-17T03:10:25.614989+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614989+0000","last_undegraded":"2024-09-17T03:10:25.614989+0000","last_fullsized":"2024-09-17T03:10:25.614989+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.630033+0000","last_change":"2024-09-17T03:10:25.626068+0000","last_active":"2024-09-17T03:10:25.630033+0000","last_peered":"2024-09-17T03:10:25.630033+0000","last_clean":"2024-09-17T03:10:25.630033+0000","last_became_active":"2024-09-17T03:10:25.625744+0000","last_became_peered":"2024-09-17T03:10:25.625744+0000","last_unstale":"2024-09-17T03:10:25.630033+0000","last_undegraded":"2024-09-17T03:10:25.630033+0000","last_fullsized":"2024-09-17T03:10:25.630033+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:51.028351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.614118+0000","last_change":"2024-09-17T03:10:25.614118+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.614118+0000","last_undegraded":"2024-09-17T03:10:25.614118+0000","last_fullsized":"2024-09-17T03:10:25.614118+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.627537+0000","last_change":"2024-09-17T03:10:25.622607+0000","last_active":"2024-09-17T03:10:25.627537+0000","last_peered":"2024-09-17T03:10:25.627537+0000","last_clean":"2024-09-17T03:10:25.627537+0000","last_became_active":"2024-09-17T03:10:25.622323+0000","last_became_peered":"2024-09-17T03:10:25.622323+0000","last_unstale":"2024-09-17T03:10:25.627537+0000","last_undegraded":"2024-09-17T03:10:25.627537+0000","last_fullsized":"2024-09-17T03:10:25.627537+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:40.437500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613466+0000","last_change":"2024-09-17T03:10:25.613466+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613466+0000","last_undegraded":"2024-09-17T03:10:25.613466+0000","last_fullsized":"2024-09-17T03:10:25.613466+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.632220+0000","last_change":"2024-09-17T03:10:25.628191+0000","last_active":"2024-09-17T03:10:25.632220+0000","last_peered":"2024-09-17T03:10:25.632220+0000","last_clean":"2024-09-17T03:10:25.632220+0000","last_became_active":"2024-09-17T03:10:25.627726+0000","last_became_peered":"2024-09-17T03:10:25.627726+0000","last_unstale":"2024-09-17T03:10:25.632220+0000","last_undegraded":"2024-09-17T03:10:25.632220+0000","last_fullsized":"2024-09-17T03:10:25.632220+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:21.661328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.612910+0000","last_change":"2024-09-17T03:10:25.612910+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.612910+0000","last_undegraded":"2024-09-17T03:10:25.612910+0000","last_fullsized":"2024-09-17T03:10:25.612910+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.613158+0000","last_change":"2024-09-17T03:10:25.629315+0000","last_active":"2024-09-17T03:10:27.613158+0000","last_peered":"2024-09-17T03:10:27.613158+0000","last_clean":"2024-09-17T03:10:27.613158+0000","last_became_active":"2024-09-17T03:10:25.629015+0000","last_became_peered":"2024-09-17T03:10:25.629015+0000","last_unstale":"2024-09-17T03:10:27.613158+0000","last_undegraded":"2024-09-17T03:10:27.613158+0000","last_fullsized":"2024-09-17T03:10:27.613158+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:30.992821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613385+0000","last_change":"2024-09-17T03:10:25.613385+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613385+0000","last_undegraded":"2024-09-17T03:10:25.613385+0000","last_fullsized":"2024-09-17T03:10:25.613385+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.630605+0000","last_change":"2024-09-17T03:10:25.627561+0000","last_active":"2024-09-17T03:10:25.630605+0000","last_peered":"2024-09-17T03:10:25.630605+0000","last_clean":"2024-09-17T03:10:25.630605+0000","last_became_active":"2024-09-17T03:10:25.627173+0000","last_became_peered":"2024-09-17T03:10:25.627173+0000","last_unstale":"2024-09-17T03:10:25.630605+0000","last_undegraded":"2024-09-17T03:10:25.630605+0000","last_fullsized":"2024-09-17T03:10:25.630605+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:28.504300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613721+0000","last_change":"2024-09-17T03:10:25.613721+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613721+0000","last_undegraded":"2024-09-17T03:10:25.613721+0000","last_fullsized":"2024-09-17T03:10:25.613721+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.626996+0000","last_change":"2024-09-17T03:10:25.622690+0000","last_active":"2024-09-17T03:10:25.626996+0000","last_peered":"2024-09-17T03:10:25.626996+0000","last_clean":"2024-09-17T03:10:25.626996+0000","last_became_active":"2024-09-17T03:10:25.622386+0000","last_became_peered":"2024-09-17T03:10:25.622386+0000","last_unstale":"2024-09-17T03:10:25.626996+0000","last_undegraded":"2024-09-17T03:10:25.626996+0000","last_fullsized":"2024-09-17T03:10:25.626996+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:32.576616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.637199+0000","last_change":"2024-09-17T03:10:26.628270+0000","last_active":"2024-09-17T03:10:26.637199+0000","last_peered":"2024-09-17T03:10:26.637199+0000","last_clean":"2024-09-17T03:10:26.637199+0000","last_became_active":"2024-09-17T03:10:26.627647+0000","last_became_peered":"2024-09-17T03:10:26.627647+0000","last_unstale":"2024-09-17T03:10:26.637199+0000","last_undegraded":"2024-09-17T03:10:26.637199+0000","last_fullsized":"2024-09-17T03:10:26.637199+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:17:38.953959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.626902+0000","last_change":"2024-09-17T03:10:25.623065+0000","last_active":"2024-09-17T03:10:25.626902+0000","last_peered":"2024-09-17T03:10:25.626902+0000","last_clean":"2024-09-17T03:10:25.626902+0000","last_became_active":"2024-09-17T03:10:25.621840+0000","last_became_peered":"2024-09-17T03:10:25.621840+0000","last_unstale":"2024-09-17T03:10:25.626902+0000","last_undegraded":"2024-09-17T03:10:25.626902+0000","last_fullsized":"2024-09-17T03:10:25.626902+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:40.794606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T03:10:26.632322+0000","last_change":"2024-09-17T03:10:26.625644+0000","last_active":"2024-09-17T03:10:26.632322+0000","last_peered":"2024-09-17T03:10:26.632322+0000","last_clean":"2024-09-17T03:10:26.632322+0000","last_became_active":"2024-09-17T03:10:26.625302+0000","last_became_peered":"2024-09-17T03:10:26.625302+0000","last_unstale":"2024-09-17T03:10:26.632322+0000","last_undegraded":"2024-09-17T03:10:26.632322+0000","last_fullsized":"2024-09-17T03:10:26.632322+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:41.524955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.630548+0000","last_change":"2024-09-17T03:10:25.629526+0000","last_active":"2024-09-17T03:10:25.630548+0000","last_peered":"2024-09-17T03:10:25.630548+0000","last_clean":"2024-09-17T03:10:25.630548+0000","last_became_active":"2024-09-17T03:10:25.629138+0000","last_became_peered":"2024-09-17T03:10:25.629138+0000","last_unstale":"2024-09-17T03:10:25.630548+0000","last_undegraded":"2024-09-17T03:10:25.630548+0000","last_fullsized":"2024-09-17T03:10:25.630548+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:31.396010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613526+0000","last_change":"2024-09-17T03:10:25.613526+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613526+0000","last_undegraded":"2024-09-17T03:10:25.613526+0000","last_fullsized":"2024-09-17T03:10:25.613526+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.631522+0000","last_change":"2024-09-17T03:10:25.625114+0000","last_active":"2024-09-17T03:10:25.631522+0000","last_peered":"2024-09-17T03:10:25.631522+0000","last_clean":"2024-09-17T03:10:25.631522+0000","last_became_active":"2024-09-17T03:10:25.624791+0000","last_became_peered":"2024-09-17T03:10:25.624791+0000","last_unstale":"2024-09-17T03:10:25.631522+0000","last_undegraded":"2024-09-17T03:10:25.631522+0000","last_fullsized":"2024-09-17T03:10:25.631522+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:31.396010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.611619+0000","last_change":"2024-09-17T03:10:25.611619+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.611619+0000","last_undegraded":"2024-09-17T03:10:25.611619+0000","last_fullsized":"2024-09-17T03:10:25.611619+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.634008+0000","last_change":"2024-09-17T03:10:25.625645+0000","last_active":"2024-09-17T03:10:25.634008+0000","last_peered":"2024-09-17T03:10:25.634008+0000","last_clean":"2024-09-17T03:10:25.634008+0000","last_became_active":"2024-09-17T03:10:25.625291+0000","last_became_peered":"2024-09-17T03:10:25.625291+0000","last_unstale":"2024-09-17T03:10:25.634008+0000","last_undegraded":"2024-09-17T03:10:25.634008+0000","last_fullsized":"2024-09-17T03:10:25.634008+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:30.515112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-09-17T03:10:25.613500+0000","last_change":"2024-09-17T03:10:25.613500+0000","last_active":"2024-09-17T03:10:25.596554+0000","last_peered":"2024-09-17T03:10:25.596554+0000","last_clean":"2024-09-17T03:10:25.596554+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:10:25.613500+0000","last_undegraded":"2024-09-17T03:10:25.613500+0000","last_fullsized":"2024-09-17T03:10:25.613500+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.631751+0000","last_change":"2024-09-17T03:10:25.627675+0000","last_active":"2024-09-17T03:10:25.631751+0000","last_peered":"2024-09-17T03:10:25.631751+0000","last_clean":"2024-09-17T03:10:25.631751+0000","last_became_active":"2024-09-17T03:10:25.627236+0000","last_became_peered":"2024-09-17T03:10:25.627236+0000","last_unstale":"2024-09-17T03:10:25.631751+0000","last_undegraded":"2024-09-17T03:10:25.631751+0000","last_fullsized":"2024-09-17T03:10:25.631751+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:28.504300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":146,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-09-17T03:10:25.616638+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:10:25.616638+0000","last_peered":"2024-09-17T03:10:25.616638+0000","last_clean":"2024-09-17T03:10:25.616638+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:10:25.616638+0000","last_undegraded":"2024-09-17T03:10:25.616638+0000","last_fullsized":"2024-09-17T03:10:25.616638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1077248,"data_stored":780517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":495616,"data_stored":196416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":196416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27516,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":495616,"data_stored":196416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509471,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":190149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509470,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":483328,"data_stored":190149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509470,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28096,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343744,"statfs":{"total":96636764160,"available":96607993856,"internally_reserved":0,"allocated":1089536,"data_stored":786784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31700,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340140,"statfs":{"total":96636764160,"available":96604303360,"internally_reserved":0,"allocated":520192,"data_stored":203829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:10:35.112 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:10:35.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.238+0000 7f64c5407640 1 -- 172.21.15.78:0/587494132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64c00ca800 msgr2=0x7f64c00cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:35.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.238+0000 7f64c5407640 1 --2- 172.21.15.78:0/587494132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64c00ca800 0x7f64c00cba00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f64c0070dc0 tx=0x7f64b002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:10:35.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.238+0000 7f64c5407640 1 -- 172.21.15.78:0/587494132 shutdown_connections 2024-09-17T03:10:35.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.238+0000 7f64c5407640 1 --2- 172.21.15.78:0/587494132 >> v2:172.21.15.193:3300/0 conn(0x7f64c00706b0 0x7f64c00735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:35.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.238+0000 7f64c5407640 1 --2- 172.21.15.78:0/587494132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64c00ca800 0x7f64c00cba00 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:35.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.238+0000 7f64c5407640 1 -- 172.21.15.78:0/587494132 >> 172.21.15.78:0/587494132 conn(0x7f64c00b1cb0 msgr2=0x7f64c00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:35.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.238+0000 7f64c5407640 1 -- 172.21.15.78:0/587494132 shutdown_connections 2024-09-17T03:10:35.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.238+0000 7f64c5407640 1 -- 172.21.15.78:0/587494132 wait complete. 2024-09-17T03:10:35.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.239+0000 7f64c5407640 1 Processor -- start 2024-09-17T03:10:35.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.240+0000 7f64c5407640 1 -- start start 2024-09-17T03:10:35.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.241+0000 7f64c5407640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64c00ca800 0x7f64c009c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:35.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.241+0000 7f64c5407640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64c00cad30 0x7f64c00c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:35.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.241+0000 7f64c5407640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f64c01f6e90 0x7f64c01f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:35.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.241+0000 7f64c5407640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f64c0073e80 con 0x7f64c00cad30 2024-09-17T03:10:35.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.241+0000 7f64c5407640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f64c0073d00 con 0x7f64c00ca800 2024-09-17T03:10:35.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.241+0000 7f64c5407640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f64c0074000 con 0x7f64c01f6e90 2024-09-17T03:10:35.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.241+0000 7f64b67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64c00cad30 0x7f64c00c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:35.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.241+0000 7f64b67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64c00cad30 0x7f64c00c9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46968/0 (socket says 172.21.15.78:46968) 2024-09-17T03:10:35.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.241+0000 7f64b67fc640 1 -- 172.21.15.78:0/2977144068 learned_addr learned my addr 172.21.15.78:0/2977144068 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:35.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.241+0000 7f64beffd640 1 --2- 172.21.15.78:0/2977144068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64c00ca800 0x7f64c009c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:35.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.241+0000 7f64bf7fe640 1 --2- 172.21.15.78:0/2977144068 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f64c01f6e90 0x7f64c01f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:35.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.241+0000 7f64b67fc640 1 -- 172.21.15.78:0/2977144068 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f64c01f6e90 msgr2=0x7f64c01f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:35.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.241+0000 7f64b67fc640 1 --2- 172.21.15.78:0/2977144068 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f64c01f6e90 0x7f64c01f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:35.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.241+0000 7f64b67fc640 1 -- 172.21.15.78:0/2977144068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64c00ca800 msgr2=0x7f64c009c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:35.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.241+0000 7f64b67fc640 1 --2- 172.21.15.78:0/2977144068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64c00ca800 0x7f64c009c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:35.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.241+0000 7f64b67fc640 1 -- 172.21.15.78:0/2977144068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64c00ca020 con 0x7f64c00cad30 2024-09-17T03:10:35.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.242+0000 7f64b67fc640 1 --2- 172.21.15.78:0/2977144068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64c00cad30 0x7f64c00c9ae0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f64a800c3a0 tx=0x7f64a800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:35.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.242+0000 7f64b7fff640 1 -- 172.21.15.78:0/2977144068 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a8017070 con 0x7f64c00cad30 2024-09-17T03:10:35.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.242+0000 7f64b7fff640 1 -- 172.21.15.78:0/2977144068 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64a80053c0 con 0x7f64c00cad30 2024-09-17T03:10:35.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.242+0000 7f64c5407640 1 -- 172.21.15.78:0/2977144068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64c009ce00 con 0x7f64c00cad30 2024-09-17T03:10:35.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.242+0000 7f64b7fff640 1 -- 172.21.15.78:0/2977144068 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a8003850 con 0x7f64c00cad30 2024-09-17T03:10:35.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.242+0000 7f64c5407640 1 -- 172.21.15.78:0/2977144068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64c01f3fd0 con 0x7f64c00cad30 2024-09-17T03:10:35.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.243+0000 7f64c5407640 1 -- 172.21.15.78:0/2977144068 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64c009cb70 con 0x7f64c00cad30 2024-09-17T03:10:35.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.243+0000 7f64b7fff640 1 -- 172.21.15.78:0/2977144068 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f64a801a070 con 0x7f64c00cad30 2024-09-17T03:10:35.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.244+0000 7f64b7fff640 1 --2- 172.21.15.78:0/2977144068 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f64a0078bc0 0x7f64a007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:35.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.244+0000 7f64b7fff640 1 -- 172.21.15.78:0/2977144068 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f64a8099ee0 con 0x7f64c00cad30 2024-09-17T03:10:35.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.244+0000 7f64beffd640 1 --2- 172.21.15.78:0/2977144068 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f64a0078bc0 0x7f64a007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:35.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.245+0000 7f64beffd640 1 --2- 172.21.15.78:0/2977144068 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f64a0078bc0 0x7f64a007b0d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f64b0033000 tx=0x7f64b0004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:35.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.249+0000 7f64b7fff640 1 -- 172.21.15.78:0/2977144068 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f64a8061df0 con 0x7f64c00cad30 2024-09-17T03:10:35.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.418+0000 7f64c5407640 1 -- 172.21.15.78:0/2977144068 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f64c0074590 con 0x7f64a0078bc0 2024-09-17T03:10:35.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.422+0000 7f64b7fff640 1 -- 172.21.15.78:0/2977144068 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251937 (secure 0 0 0) 0x7f64c0074590 con 0x7f64a0078bc0 2024-09-17T03:10:35.424 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:35.425 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:10:35.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.425+0000 7f64c5407640 1 -- 172.21.15.78:0/2977144068 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f64a0078bc0 msgr2=0x7f64a007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:35.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.425+0000 7f64c5407640 1 --2- 172.21.15.78:0/2977144068 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f64a0078bc0 0x7f64a007b0d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f64b0033000 tx=0x7f64b0004730 comp rx=0 tx=0).stop 2024-09-17T03:10:35.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.425+0000 7f64c5407640 1 -- 172.21.15.78:0/2977144068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64c00cad30 msgr2=0x7f64c00c9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:35.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.425+0000 7f64c5407640 1 --2- 172.21.15.78:0/2977144068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64c00cad30 0x7f64c00c9ae0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f64a800c3a0 tx=0x7f64a800c860 comp rx=0 tx=0).stop 2024-09-17T03:10:35.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.425+0000 7f64c5407640 1 -- 172.21.15.78:0/2977144068 shutdown_connections 2024-09-17T03:10:35.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.425+0000 7f64c5407640 1 --2- 172.21.15.78:0/2977144068 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f64c01f6e90 0x7f64c01f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:35.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.425+0000 7f64c5407640 1 --2- 172.21.15.78:0/2977144068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64c00cad30 0x7f64c00c9ae0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:35.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.425+0000 7f64c5407640 1 --2- 172.21.15.78:0/2977144068 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f64a0078bc0 0x7f64a007b0d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:35.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.425+0000 7f64c5407640 1 --2- 172.21.15.78:0/2977144068 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f64c00ca800 0x7f64c009c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:35.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.426+0000 7f64c5407640 1 -- 172.21.15.78:0/2977144068 >> 172.21.15.78:0/2977144068 conn(0x7f64c00b1cb0 msgr2=0x7f64c015e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:35.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.426+0000 7f64c5407640 1 -- 172.21.15.78:0/2977144068 shutdown_connections 2024-09-17T03:10:35.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.426+0000 7f64c5407640 1 -- 172.21.15.78:0/2977144068 wait complete. 2024-09-17T03:10:35.436 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2024-09-17T03:10:35.151974+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229852,"kb_used_data":5288,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754744868,"statfs":{"total":773094113280,"available":772858744832,"internally_reserved":0,"allocated":5414912,"data_stored":2861484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.543476"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.719245+0000","last_change":"2024-09-17T03:10:26.623720+0000","last_active":"2024-09-17T03:10:27.719245+0000","last_peered":"2024-09-17T03:10:27.719245+0000","last_clean":"2024-09-17T03:10:27.719245+0000","last_became_active":"2024-09-17T03:10:26.622881+0000","last_became_peered":"2024-09-17T03:10:26.622881+0000","last_unstale":"2024-09-17T03:10:27.719245+0000","last_undegraded":"2024-09-17T03:10:27.719245+0000","last_fullsized":"2024-09-17T03:10:27.719245+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:13.420046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.491551+0000","last_change":"2024-09-17T03:10:26.630841+0000","last_active":"2024-09-17T03:10:28.491551+0000","last_peered":"2024-09-17T03:10:28.491551+0000","last_clean":"2024-09-17T03:10:28.491551+0000","last_became_active":"2024-09-17T03:10:26.630319+0000","last_became_peered":"2024-09-17T03:10:26.630319+0000","last_unstale":"2024-09-17T03:10:28.491551+0000","last_undegraded":"2024-09-17T03:10:28.491551+0000","last_fullsized":"2024-09-17T03:10:28.491551+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:59.177046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.625643+0000","last_change":"2024-09-17T03:10:26.624978+0000","last_active":"2024-09-17T03:10:27.625643+0000","last_peered":"2024-09-17T03:10:27.625643+0000","last_clean":"2024-09-17T03:10:27.625643+0000","last_became_active":"2024-09-17T03:10:26.624663+0000","last_became_peered":"2024-09-17T03:10:26.624663+0000","last_unstale":"2024-09-17T03:10:27.625643+0000","last_undegraded":"2024-09-17T03:10:27.625643+0000","last_fullsized":"2024-09-17T03:10:27.625643+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:07:17.699613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.658936+0000","last_change":"2024-09-17T03:10:26.639280+0000","last_active":"2024-09-17T03:10:29.658936+0000","last_peered":"2024-09-17T03:10:29.658936+0000","last_clean":"2024-09-17T03:10:29.658936+0000","last_became_active":"2024-09-17T03:10:26.638942+0000","last_became_peered":"2024-09-17T03:10:26.638942+0000","last_unstale":"2024-09-17T03:10:29.658936+0000","last_undegraded":"2024-09-17T03:10:29.658936+0000","last_fullsized":"2024-09-17T03:10:29.658936+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:26.858995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.491246+0000","last_change":"2024-09-17T03:10:26.634117+0000","last_active":"2024-09-17T03:10:28.491246+0000","last_peered":"2024-09-17T03:10:28.491246+0000","last_clean":"2024-09-17T03:10:28.491246+0000","last_became_active":"2024-09-17T03:10:26.633547+0000","last_became_peered":"2024-09-17T03:10:26.633547+0000","last_unstale":"2024-09-17T03:10:28.491246+0000","last_undegraded":"2024-09-17T03:10:28.491246+0000","last_fullsized":"2024-09-17T03:10:28.491246+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:26.858995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.310875+0000","last_change":"2024-09-17T03:10:26.627225+0000","last_active":"2024-09-17T03:10:28.310875+0000","last_peered":"2024-09-17T03:10:28.310875+0000","last_clean":"2024-09-17T03:10:28.310875+0000","last_became_active":"2024-09-17T03:10:26.626923+0000","last_became_peered":"2024-09-17T03:10:26.626923+0000","last_unstale":"2024-09-17T03:10:28.310875+0000","last_undegraded":"2024-09-17T03:10:28.310875+0000","last_fullsized":"2024-09-17T03:10:28.310875+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:57.284308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.718709+0000","last_change":"2024-09-17T03:10:26.626842+0000","last_active":"2024-09-17T03:10:27.718709+0000","last_peered":"2024-09-17T03:10:27.718709+0000","last_clean":"2024-09-17T03:10:27.718709+0000","last_became_active":"2024-09-17T03:10:26.626540+0000","last_became_peered":"2024-09-17T03:10:26.626540+0000","last_unstale":"2024-09-17T03:10:27.718709+0000","last_undegraded":"2024-09-17T03:10:27.718709+0000","last_fullsized":"2024-09-17T03:10:27.718709+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:34.250640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.657882+0000","last_change":"2024-09-17T03:10:26.639173+0000","last_active":"2024-09-17T03:10:29.657882+0000","last_peered":"2024-09-17T03:10:29.657882+0000","last_clean":"2024-09-17T03:10:29.657882+0000","last_became_active":"2024-09-17T03:10:26.638875+0000","last_became_peered":"2024-09-17T03:10:26.638875+0000","last_unstale":"2024-09-17T03:10:29.657882+0000","last_undegraded":"2024-09-17T03:10:29.657882+0000","last_fullsized":"2024-09-17T03:10:29.657882+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:07:17.699613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.659464+0000","last_change":"2024-09-17T03:10:26.633044+0000","last_active":"2024-09-17T03:10:29.659464+0000","last_peered":"2024-09-17T03:10:29.659464+0000","last_clean":"2024-09-17T03:10:29.659464+0000","last_became_active":"2024-09-17T03:10:26.632743+0000","last_became_peered":"2024-09-17T03:10:26.632743+0000","last_unstale":"2024-09-17T03:10:29.659464+0000","last_undegraded":"2024-09-17T03:10:29.659464+0000","last_fullsized":"2024-09-17T03:10:29.659464+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:04.868757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.659195+0000","last_change":"2024-09-17T03:10:26.636007+0000","last_active":"2024-09-17T03:10:29.659195+0000","last_peered":"2024-09-17T03:10:29.659195+0000","last_clean":"2024-09-17T03:10:29.659195+0000","last_became_active":"2024-09-17T03:10:26.635576+0000","last_became_peered":"2024-09-17T03:10:26.635576+0000","last_unstale":"2024-09-17T03:10:29.659195+0000","last_undegraded":"2024-09-17T03:10:29.659195+0000","last_fullsized":"2024-09-17T03:10:29.659195+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:50.930519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.658850+0000","last_change":"2024-09-17T03:10:26.625908+0000","last_active":"2024-09-17T03:10:29.658850+0000","last_peered":"2024-09-17T03:10:29.658850+0000","last_clean":"2024-09-17T03:10:29.658850+0000","last_became_active":"2024-09-17T03:10:26.625611+0000","last_became_peered":"2024-09-17T03:10:26.625611+0000","last_unstale":"2024-09-17T03:10:29.658850+0000","last_undegraded":"2024-09-17T03:10:29.658850+0000","last_fullsized":"2024-09-17T03:10:29.658850+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:32.835911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.491424+0000","last_change":"2024-09-17T03:10:26.638535+0000","last_active":"2024-09-17T03:10:28.491424+0000","last_peered":"2024-09-17T03:10:28.491424+0000","last_clean":"2024-09-17T03:10:28.491424+0000","last_became_active":"2024-09-17T03:10:26.638212+0000","last_became_peered":"2024-09-17T03:10:26.638212+0000","last_unstale":"2024-09-17T03:10:28.491424+0000","last_undegraded":"2024-09-17T03:10:28.491424+0000","last_fullsized":"2024-09-17T03:10:28.491424+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:16:39.349546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.624843+0000","last_change":"2024-09-17T03:10:26.629534+0000","last_active":"2024-09-17T03:10:27.624843+0000","last_peered":"2024-09-17T03:10:27.624843+0000","last_clean":"2024-09-17T03:10:27.624843+0000","last_became_active":"2024-09-17T03:10:26.629123+0000","last_became_peered":"2024-09-17T03:10:26.629123+0000","last_unstale":"2024-09-17T03:10:27.624843+0000","last_undegraded":"2024-09-17T03:10:27.624843+0000","last_fullsized":"2024-09-17T03:10:27.624843+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:41.439651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.658505+0000","last_change":"2024-09-17T03:10:26.631566+0000","last_active":"2024-09-17T03:10:29.658505+0000","last_peered":"2024-09-17T03:10:29.658505+0000","last_clean":"2024-09-17T03:10:29.658505+0000","last_became_active":"2024-09-17T03:10:26.631278+0000","last_became_peered":"2024-09-17T03:10:26.631278+0000","last_unstale":"2024-09-17T03:10:29.658505+0000","last_undegraded":"2024-09-17T03:10:29.658505+0000","last_fullsized":"2024-09-17T03:10:29.658505+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:13.223258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.310804+0000","last_change":"2024-09-17T03:10:26.626832+0000","last_active":"2024-09-17T03:10:28.310804+0000","last_peered":"2024-09-17T03:10:28.310804+0000","last_clean":"2024-09-17T03:10:28.310804+0000","last_became_active":"2024-09-17T03:10:26.625618+0000","last_became_peered":"2024-09-17T03:10:26.625618+0000","last_unstale":"2024-09-17T03:10:28.310804+0000","last_undegraded":"2024-09-17T03:10:28.310804+0000","last_fullsized":"2024-09-17T03:10:28.310804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:13.195133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.626122+0000","last_change":"2024-09-17T03:10:26.624902+0000","last_active":"2024-09-17T03:10:27.626122+0000","last_peered":"2024-09-17T03:10:27.626122+0000","last_clean":"2024-09-17T03:10:27.626122+0000","last_became_active":"2024-09-17T03:10:26.624599+0000","last_became_peered":"2024-09-17T03:10:26.624599+0000","last_unstale":"2024-09-17T03:10:27.626122+0000","last_undegraded":"2024-09-17T03:10:27.626122+0000","last_fullsized":"2024-09-17T03:10:27.626122+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:45.694553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.625831+0000","last_change":"2024-09-17T03:10:26.635371+0000","last_active":"2024-09-17T03:10:27.625831+0000","last_peered":"2024-09-17T03:10:27.625831+0000","last_clean":"2024-09-17T03:10:27.625831+0000","last_became_active":"2024-09-17T03:10:26.635063+0000","last_became_peered":"2024-09-17T03:10:26.635063+0000","last_unstale":"2024-09-17T03:10:27.625831+0000","last_undegraded":"2024-09-17T03:10:27.625831+0000","last_fullsized":"2024-09-17T03:10:27.625831+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:21.155964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.626206+0000","last_change":"2024-09-17T03:10:26.626651+0000","last_active":"2024-09-17T03:10:27.626206+0000","last_peered":"2024-09-17T03:10:27.626206+0000","last_clean":"2024-09-17T03:10:27.626206+0000","last_became_active":"2024-09-17T03:10:26.626152+0000","last_became_peered":"2024-09-17T03:10:26.626152+0000","last_unstale":"2024-09-17T03:10:27.626206+0000","last_undegraded":"2024-09-17T03:10:27.626206+0000","last_fullsized":"2024-09-17T03:10:27.626206+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:02.597368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.627340+0000","last_change":"2024-09-17T03:10:26.636781+0000","last_active":"2024-09-17T03:10:27.627340+0000","last_peered":"2024-09-17T03:10:27.627340+0000","last_clean":"2024-09-17T03:10:27.627340+0000","last_became_active":"2024-09-17T03:10:26.636480+0000","last_became_peered":"2024-09-17T03:10:26.636480+0000","last_unstale":"2024-09-17T03:10:27.627340+0000","last_undegraded":"2024-09-17T03:10:27.627340+0000","last_fullsized":"2024-09-17T03:10:27.627340+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:22.241197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.625065+0000","last_change":"2024-09-17T03:10:26.623479+0000","last_active":"2024-09-17T03:10:27.625065+0000","last_peered":"2024-09-17T03:10:27.625065+0000","last_clean":"2024-09-17T03:10:27.625065+0000","last_became_active":"2024-09-17T03:10:26.623212+0000","last_became_peered":"2024-09-17T03:10:26.623212+0000","last_unstale":"2024-09-17T03:10:27.625065+0000","last_undegraded":"2024-09-17T03:10:27.625065+0000","last_fullsized":"2024-09-17T03:10:27.625065+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:31.517263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.310932+0000","last_change":"2024-09-17T03:10:26.636653+0000","last_active":"2024-09-17T03:10:28.310932+0000","last_peered":"2024-09-17T03:10:28.310932+0000","last_clean":"2024-09-17T03:10:28.310932+0000","last_became_active":"2024-09-17T03:10:26.636103+0000","last_became_peered":"2024-09-17T03:10:26.636103+0000","last_unstale":"2024-09-17T03:10:28.310932+0000","last_undegraded":"2024-09-17T03:10:28.310932+0000","last_fullsized":"2024-09-17T03:10:28.310932+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:14:19.909284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.658564+0000","last_change":"2024-09-17T03:10:26.639242+0000","last_active":"2024-09-17T03:10:29.658564+0000","last_peered":"2024-09-17T03:10:29.658564+0000","last_clean":"2024-09-17T03:10:29.658564+0000","last_became_active":"2024-09-17T03:10:26.638836+0000","last_became_peered":"2024-09-17T03:10:26.638836+0000","last_unstale":"2024-09-17T03:10:29.658564+0000","last_undegraded":"2024-09-17T03:10:29.658564+0000","last_fullsized":"2024-09-17T03:10:29.658564+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:25.683407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.626417+0000","last_change":"2024-09-17T03:10:26.628761+0000","last_active":"2024-09-17T03:10:27.626417+0000","last_peered":"2024-09-17T03:10:27.626417+0000","last_clean":"2024-09-17T03:10:27.626417+0000","last_became_active":"2024-09-17T03:10:26.628442+0000","last_became_peered":"2024-09-17T03:10:26.628442+0000","last_unstale":"2024-09-17T03:10:27.626417+0000","last_undegraded":"2024-09-17T03:10:27.626417+0000","last_fullsized":"2024-09-17T03:10:27.626417+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:10.426541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.626195+0000","last_change":"2024-09-17T03:10:26.634049+0000","last_active":"2024-09-17T03:10:27.626195+0000","last_peered":"2024-09-17T03:10:27.626195+0000","last_clean":"2024-09-17T03:10:27.626195+0000","last_became_active":"2024-09-17T03:10:26.633702+0000","last_became_peered":"2024-09-17T03:10:26.633702+0000","last_unstale":"2024-09-17T03:10:27.626195+0000","last_undegraded":"2024-09-17T03:10:27.626195+0000","last_fullsized":"2024-09-17T03:10:27.626195+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:33.506674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.627396+0000","last_change":"2024-09-17T03:10:26.631833+0000","last_active":"2024-09-17T03:10:27.627396+0000","last_peered":"2024-09-17T03:10:27.627396+0000","last_clean":"2024-09-17T03:10:27.627396+0000","last_became_active":"2024-09-17T03:10:26.630072+0000","last_became_peered":"2024-09-17T03:10:26.630072+0000","last_unstale":"2024-09-17T03:10:27.627396+0000","last_undegraded":"2024-09-17T03:10:27.627396+0000","last_fullsized":"2024-09-17T03:10:27.627396+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:43:49.941475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.624933+0000","last_change":"2024-09-17T03:10:26.629204+0000","last_active":"2024-09-17T03:10:27.624933+0000","last_peered":"2024-09-17T03:10:27.624933+0000","last_clean":"2024-09-17T03:10:27.624933+0000","last_became_active":"2024-09-17T03:10:26.628915+0000","last_became_peered":"2024-09-17T03:10:26.628915+0000","last_unstale":"2024-09-17T03:10:27.624933+0000","last_undegraded":"2024-09-17T03:10:27.624933+0000","last_fullsized":"2024-09-17T03:10:27.624933+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:35:37.804526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.625743+0000","last_change":"2024-09-17T03:10:26.633776+0000","last_active":"2024-09-17T03:10:27.625743+0000","last_peered":"2024-09-17T03:10:27.625743+0000","last_clean":"2024-09-17T03:10:27.625743+0000","last_became_active":"2024-09-17T03:10:26.633456+0000","last_became_peered":"2024-09-17T03:10:26.633456+0000","last_unstale":"2024-09-17T03:10:27.625743+0000","last_undegraded":"2024-09-17T03:10:27.625743+0000","last_fullsized":"2024-09-17T03:10:27.625743+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:25.183445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.491435+0000","last_change":"2024-09-17T03:10:26.638562+0000","last_active":"2024-09-17T03:10:28.491435+0000","last_peered":"2024-09-17T03:10:28.491435+0000","last_clean":"2024-09-17T03:10:28.491435+0000","last_became_active":"2024-09-17T03:10:26.638264+0000","last_became_peered":"2024-09-17T03:10:26.638264+0000","last_unstale":"2024-09-17T03:10:28.491435+0000","last_undegraded":"2024-09-17T03:10:28.491435+0000","last_fullsized":"2024-09-17T03:10:28.491435+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:55.267170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.626882+0000","last_change":"2024-09-17T03:10:26.630538+0000","last_active":"2024-09-17T03:10:27.626882+0000","last_peered":"2024-09-17T03:10:27.626882+0000","last_clean":"2024-09-17T03:10:27.626882+0000","last_became_active":"2024-09-17T03:10:26.629514+0000","last_became_peered":"2024-09-17T03:10:26.629514+0000","last_unstale":"2024-09-17T03:10:27.626882+0000","last_undegraded":"2024-09-17T03:10:27.626882+0000","last_fullsized":"2024-09-17T03:10:27.626882+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:17.044874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.625628+0000","last_change":"2024-09-17T03:10:26.623559+0000","last_active":"2024-09-17T03:10:27.625628+0000","last_peered":"2024-09-17T03:10:27.625628+0000","last_clean":"2024-09-17T03:10:27.625628+0000","last_became_active":"2024-09-17T03:10:26.623225+0000","last_became_peered":"2024-09-17T03:10:26.623225+0000","last_unstale":"2024-09-17T03:10:27.625628+0000","last_undegraded":"2024-09-17T03:10:27.625628+0000","last_fullsized":"2024-09-17T03:10:27.625628+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:06.686344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.310831+0000","last_change":"2024-09-17T03:10:26.632798+0000","last_active":"2024-09-17T03:10:28.310831+0000","last_peered":"2024-09-17T03:10:28.310831+0000","last_clean":"2024-09-17T03:10:28.310831+0000","last_became_active":"2024-09-17T03:10:26.632513+0000","last_became_peered":"2024-09-17T03:10:26.632513+0000","last_unstale":"2024-09-17T03:10:28.310831+0000","last_undegraded":"2024-09-17T03:10:28.310831+0000","last_fullsized":"2024-09-17T03:10:28.310831+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:01.170315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.624793+0000","last_change":"2024-09-17T03:10:26.628167+0000","last_active":"2024-09-17T03:10:27.624793+0000","last_peered":"2024-09-17T03:10:27.624793+0000","last_clean":"2024-09-17T03:10:27.624793+0000","last_became_active":"2024-09-17T03:10:26.627876+0000","last_became_peered":"2024-09-17T03:10:26.627876+0000","last_unstale":"2024-09-17T03:10:27.624793+0000","last_undegraded":"2024-09-17T03:10:27.624793+0000","last_fullsized":"2024-09-17T03:10:27.624793+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:52.216576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.658284+0000","last_change":"2024-09-17T03:10:26.625075+0000","last_active":"2024-09-17T03:10:29.658284+0000","last_peered":"2024-09-17T03:10:29.658284+0000","last_clean":"2024-09-17T03:10:29.658284+0000","last_became_active":"2024-09-17T03:10:26.624411+0000","last_became_peered":"2024-09-17T03:10:26.624411+0000","last_unstale":"2024-09-17T03:10:29.658284+0000","last_undegraded":"2024-09-17T03:10:29.658284+0000","last_fullsized":"2024-09-17T03:10:29.658284+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:52.030501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":19,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.311356+0000","last_change":"2024-09-17T03:10:25.630050+0000","last_active":"2024-09-17T03:10:28.311356+0000","last_peered":"2024-09-17T03:10:28.311356+0000","last_clean":"2024-09-17T03:10:28.311356+0000","last_became_active":"2024-09-17T03:10:25.629738+0000","last_became_peered":"2024-09-17T03:10:25.629738+0000","last_unstale":"2024-09-17T03:10:28.311356+0000","last_undegraded":"2024-09-17T03:10:28.311356+0000","last_fullsized":"2024-09-17T03:10:28.311356+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:34.296787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.627470+0000","last_change":"2024-09-17T03:10:26.627879+0000","last_active":"2024-09-17T03:10:27.627470+0000","last_peered":"2024-09-17T03:10:27.627470+0000","last_clean":"2024-09-17T03:10:27.627470+0000","last_became_active":"2024-09-17T03:10:26.625988+0000","last_became_peered":"2024-09-17T03:10:26.625988+0000","last_unstale":"2024-09-17T03:10:27.627470+0000","last_undegraded":"2024-09-17T03:10:27.627470+0000","last_fullsized":"2024-09-17T03:10:27.627470+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:38.126130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.626394+0000","last_change":"2024-09-17T03:10:25.616451+0000","last_active":"2024-09-17T03:10:27.626394+0000","last_peered":"2024-09-17T03:10:27.626394+0000","last_clean":"2024-09-17T03:10:27.626394+0000","last_became_active":"2024-09-17T03:10:25.616110+0000","last_became_peered":"2024-09-17T03:10:25.616110+0000","last_unstale":"2024-09-17T03:10:27.626394+0000","last_undegraded":"2024-09-17T03:10:27.626394+0000","last_fullsized":"2024-09-17T03:10:27.626394+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:07.567082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.491695+0000","last_change":"2024-09-17T03:10:26.632971+0000","last_active":"2024-09-17T03:10:28.491695+0000","last_peered":"2024-09-17T03:10:28.491695+0000","last_clean":"2024-09-17T03:10:28.491695+0000","last_became_active":"2024-09-17T03:10:26.632643+0000","last_became_peered":"2024-09-17T03:10:26.632643+0000","last_unstale":"2024-09-17T03:10:28.491695+0000","last_undegraded":"2024-09-17T03:10:28.491695+0000","last_fullsized":"2024-09-17T03:10:28.491695+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:34.250640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.658571+0000","last_change":"2024-09-17T03:10:25.626520+0000","last_active":"2024-09-17T03:10:29.658571+0000","last_peered":"2024-09-17T03:10:29.658571+0000","last_clean":"2024-09-17T03:10:29.658571+0000","last_became_active":"2024-09-17T03:10:25.626229+0000","last_became_peered":"2024-09-17T03:10:25.626229+0000","last_unstale":"2024-09-17T03:10:29.658571+0000","last_undegraded":"2024-09-17T03:10:29.658571+0000","last_fullsized":"2024-09-17T03:10:29.658571+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:11:20.566923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.658404+0000","last_change":"2024-09-17T03:10:26.640040+0000","last_active":"2024-09-17T03:10:29.658404+0000","last_peered":"2024-09-17T03:10:29.658404+0000","last_clean":"2024-09-17T03:10:29.658404+0000","last_became_active":"2024-09-17T03:10:26.639694+0000","last_became_peered":"2024-09-17T03:10:26.639694+0000","last_unstale":"2024-09-17T03:10:29.658404+0000","last_undegraded":"2024-09-17T03:10:29.658404+0000","last_fullsized":"2024-09-17T03:10:29.658404+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:29.506450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.718989+0000","last_change":"2024-09-17T03:10:25.626034+0000","last_active":"2024-09-17T03:10:27.718989+0000","last_peered":"2024-09-17T03:10:27.718989+0000","last_clean":"2024-09-17T03:10:27.718989+0000","last_became_active":"2024-09-17T03:10:25.625671+0000","last_became_peered":"2024-09-17T03:10:25.625671+0000","last_unstale":"2024-09-17T03:10:27.718989+0000","last_undegraded":"2024-09-17T03:10:27.718989+0000","last_fullsized":"2024-09-17T03:10:27.718989+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:27.283493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.625825+0000","last_change":"2024-09-17T03:10:26.637815+0000","last_active":"2024-09-17T03:10:27.625825+0000","last_peered":"2024-09-17T03:10:27.625825+0000","last_clean":"2024-09-17T03:10:27.625825+0000","last_became_active":"2024-09-17T03:10:26.637469+0000","last_became_peered":"2024-09-17T03:10:26.637469+0000","last_unstale":"2024-09-17T03:10:27.625825+0000","last_undegraded":"2024-09-17T03:10:27.625825+0000","last_fullsized":"2024-09-17T03:10:27.625825+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:13.223258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.311365+0000","last_change":"2024-09-17T03:10:25.627030+0000","last_active":"2024-09-17T03:10:28.311365+0000","last_peered":"2024-09-17T03:10:28.311365+0000","last_clean":"2024-09-17T03:10:28.311365+0000","last_became_active":"2024-09-17T03:10:25.626746+0000","last_became_peered":"2024-09-17T03:10:25.626746+0000","last_unstale":"2024-09-17T03:10:28.311365+0000","last_undegraded":"2024-09-17T03:10:28.311365+0000","last_fullsized":"2024-09-17T03:10:28.311365+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:16:20.215142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.658807+0000","last_change":"2024-09-17T03:10:26.621818+0000","last_active":"2024-09-17T03:10:29.658807+0000","last_peered":"2024-09-17T03:10:29.658807+0000","last_clean":"2024-09-17T03:10:29.658807+0000","last_became_active":"2024-09-17T03:10:26.621564+0000","last_became_peered":"2024-09-17T03:10:26.621564+0000","last_unstale":"2024-09-17T03:10:29.658807+0000","last_undegraded":"2024-09-17T03:10:29.658807+0000","last_fullsized":"2024-09-17T03:10:29.658807+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:43.894472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.625912+0000","last_change":"2024-09-17T03:10:25.624581+0000","last_active":"2024-09-17T03:10:27.625912+0000","last_peered":"2024-09-17T03:10:27.625912+0000","last_clean":"2024-09-17T03:10:27.625912+0000","last_became_active":"2024-09-17T03:10:25.623625+0000","last_became_peered":"2024-09-17T03:10:25.623625+0000","last_unstale":"2024-09-17T03:10:27.625912+0000","last_undegraded":"2024-09-17T03:10:27.625912+0000","last_fullsized":"2024-09-17T03:10:27.625912+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:13.925616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.657977+0000","last_change":"2024-09-17T03:10:26.629833+0000","last_active":"2024-09-17T03:10:29.657977+0000","last_peered":"2024-09-17T03:10:29.657977+0000","last_clean":"2024-09-17T03:10:29.657977+0000","last_became_active":"2024-09-17T03:10:26.629554+0000","last_became_peered":"2024-09-17T03:10:26.629554+0000","last_unstale":"2024-09-17T03:10:29.657977+0000","last_undegraded":"2024-09-17T03:10:29.657977+0000","last_fullsized":"2024-09-17T03:10:29.657977+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:25.183445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.491166+0000","last_change":"2024-09-17T03:10:25.625253+0000","last_active":"2024-09-17T03:10:28.491166+0000","last_peered":"2024-09-17T03:10:28.491166+0000","last_clean":"2024-09-17T03:10:28.491166+0000","last_became_active":"2024-09-17T03:10:25.624870+0000","last_became_peered":"2024-09-17T03:10:25.624870+0000","last_unstale":"2024-09-17T03:10:28.491166+0000","last_undegraded":"2024-09-17T03:10:28.491166+0000","last_fullsized":"2024-09-17T03:10:28.491166+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:21.661328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.626325+0000","last_change":"2024-09-17T03:10:26.629765+0000","last_active":"2024-09-17T03:10:27.626325+0000","last_peered":"2024-09-17T03:10:27.626325+0000","last_clean":"2024-09-17T03:10:27.626325+0000","last_became_active":"2024-09-17T03:10:26.628972+0000","last_became_peered":"2024-09-17T03:10:26.628972+0000","last_unstale":"2024-09-17T03:10:27.626325+0000","last_undegraded":"2024-09-17T03:10:27.626325+0000","last_fullsized":"2024-09-17T03:10:27.626325+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:37.331681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.658074+0000","last_change":"2024-09-17T03:10:25.628027+0000","last_active":"2024-09-17T03:10:29.658074+0000","last_peered":"2024-09-17T03:10:29.658074+0000","last_clean":"2024-09-17T03:10:29.658074+0000","last_became_active":"2024-09-17T03:10:25.624938+0000","last_became_peered":"2024-09-17T03:10:25.624938+0000","last_unstale":"2024-09-17T03:10:29.658074+0000","last_undegraded":"2024-09-17T03:10:29.658074+0000","last_fullsized":"2024-09-17T03:10:29.658074+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:20.903811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.626212+0000","last_change":"2024-09-17T03:10:26.625803+0000","last_active":"2024-09-17T03:10:27.626212+0000","last_peered":"2024-09-17T03:10:27.626212+0000","last_clean":"2024-09-17T03:10:27.626212+0000","last_became_active":"2024-09-17T03:10:26.625301+0000","last_became_peered":"2024-09-17T03:10:26.625301+0000","last_unstale":"2024-09-17T03:10:27.626212+0000","last_undegraded":"2024-09-17T03:10:27.626212+0000","last_fullsized":"2024-09-17T03:10:27.626212+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:20:37.380836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.626003+0000","last_change":"2024-09-17T03:10:25.619136+0000","last_active":"2024-09-17T03:10:27.626003+0000","last_peered":"2024-09-17T03:10:27.626003+0000","last_clean":"2024-09-17T03:10:27.626003+0000","last_became_active":"2024-09-17T03:10:25.618816+0000","last_became_peered":"2024-09-17T03:10:25.618816+0000","last_unstale":"2024-09-17T03:10:27.626003+0000","last_undegraded":"2024-09-17T03:10:27.626003+0000","last_fullsized":"2024-09-17T03:10:27.626003+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:18.573372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.719239+0000","last_change":"2024-09-17T03:10:26.636473+0000","last_active":"2024-09-17T03:10:27.719239+0000","last_peered":"2024-09-17T03:10:27.719239+0000","last_clean":"2024-09-17T03:10:27.719239+0000","last_became_active":"2024-09-17T03:10:26.633945+0000","last_became_peered":"2024-09-17T03:10:26.633945+0000","last_unstale":"2024-09-17T03:10:27.719239+0000","last_undegraded":"2024-09-17T03:10:27.719239+0000","last_fullsized":"2024-09-17T03:10:27.719239+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:23:43.469108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.659390+0000","last_change":"2024-09-17T03:10:25.623416+0000","last_active":"2024-09-17T03:10:29.659390+0000","last_peered":"2024-09-17T03:10:29.659390+0000","last_clean":"2024-09-17T03:10:29.659390+0000","last_became_active":"2024-09-17T03:10:25.623090+0000","last_became_peered":"2024-09-17T03:10:25.623090+0000","last_unstale":"2024-09-17T03:10:29.659390+0000","last_undegraded":"2024-09-17T03:10:29.659390+0000","last_fullsized":"2024-09-17T03:10:29.659390+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:38.097133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.311175+0000","last_change":"2024-09-17T03:10:26.626795+0000","last_active":"2024-09-17T03:10:28.311175+0000","last_peered":"2024-09-17T03:10:28.311175+0000","last_clean":"2024-09-17T03:10:28.311175+0000","last_became_active":"2024-09-17T03:10:26.625634+0000","last_became_peered":"2024-09-17T03:10:26.625634+0000","last_unstale":"2024-09-17T03:10:28.311175+0000","last_undegraded":"2024-09-17T03:10:28.311175+0000","last_fullsized":"2024-09-17T03:10:28.311175+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:29.565526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.719265+0000","last_change":"2024-09-17T03:10:25.625282+0000","last_active":"2024-09-17T03:10:27.719265+0000","last_peered":"2024-09-17T03:10:27.719265+0000","last_clean":"2024-09-17T03:10:27.719265+0000","last_became_active":"2024-09-17T03:10:25.624893+0000","last_became_peered":"2024-09-17T03:10:25.624893+0000","last_unstale":"2024-09-17T03:10:27.719265+0000","last_undegraded":"2024-09-17T03:10:27.719265+0000","last_fullsized":"2024-09-17T03:10:27.719265+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:59.663142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.719082+0000","last_change":"2024-09-17T03:10:26.627112+0000","last_active":"2024-09-17T03:10:27.719082+0000","last_peered":"2024-09-17T03:10:27.719082+0000","last_clean":"2024-09-17T03:10:27.719082+0000","last_became_active":"2024-09-17T03:10:26.626797+0000","last_became_peered":"2024-09-17T03:10:26.626797+0000","last_unstale":"2024-09-17T03:10:27.719082+0000","last_undegraded":"2024-09-17T03:10:27.719082+0000","last_fullsized":"2024-09-17T03:10:27.719082+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:06.982391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.625072+0000","last_change":"2024-09-17T03:10:25.614140+0000","last_active":"2024-09-17T03:10:27.625072+0000","last_peered":"2024-09-17T03:10:27.625072+0000","last_clean":"2024-09-17T03:10:27.625072+0000","last_became_active":"2024-09-17T03:10:25.613844+0000","last_became_peered":"2024-09-17T03:10:25.613844+0000","last_unstale":"2024-09-17T03:10:27.625072+0000","last_undegraded":"2024-09-17T03:10:27.625072+0000","last_fullsized":"2024-09-17T03:10:27.625072+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:59.025382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.626709+0000","last_change":"2024-09-17T03:10:26.638325+0000","last_active":"2024-09-17T03:10:27.626709+0000","last_peered":"2024-09-17T03:10:27.626709+0000","last_clean":"2024-09-17T03:10:27.626709+0000","last_became_active":"2024-09-17T03:10:26.636489+0000","last_became_peered":"2024-09-17T03:10:26.636489+0000","last_unstale":"2024-09-17T03:10:27.626709+0000","last_undegraded":"2024-09-17T03:10:27.626709+0000","last_fullsized":"2024-09-17T03:10:27.626709+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:30:46.753138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.311357+0000","last_change":"2024-09-17T03:10:25.630508+0000","last_active":"2024-09-17T03:10:28.311357+0000","last_peered":"2024-09-17T03:10:28.311357+0000","last_clean":"2024-09-17T03:10:28.311357+0000","last_became_active":"2024-09-17T03:10:25.630209+0000","last_became_peered":"2024-09-17T03:10:25.630209+0000","last_unstale":"2024-09-17T03:10:28.311357+0000","last_undegraded":"2024-09-17T03:10:28.311357+0000","last_fullsized":"2024-09-17T03:10:28.311357+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:15.757991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.658760+0000","last_change":"2024-09-17T03:10:26.628319+0000","last_active":"2024-09-17T03:10:29.658760+0000","last_peered":"2024-09-17T03:10:29.658760+0000","last_clean":"2024-09-17T03:10:29.658760+0000","last_became_active":"2024-09-17T03:10:26.626608+0000","last_became_peered":"2024-09-17T03:10:26.626608+0000","last_unstale":"2024-09-17T03:10:29.658760+0000","last_undegraded":"2024-09-17T03:10:29.658760+0000","last_fullsized":"2024-09-17T03:10:29.658760+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:02:02.597368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.718640+0000","last_change":"2024-09-17T03:10:25.628330+0000","last_active":"2024-09-17T03:10:27.718640+0000","last_peered":"2024-09-17T03:10:27.718640+0000","last_clean":"2024-09-17T03:10:27.718640+0000","last_became_active":"2024-09-17T03:10:25.627919+0000","last_became_peered":"2024-09-17T03:10:25.627919+0000","last_unstale":"2024-09-17T03:10:27.718640+0000","last_undegraded":"2024-09-17T03:10:27.718640+0000","last_fullsized":"2024-09-17T03:10:27.718640+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:57.528310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.310788+0000","last_change":"2024-09-17T03:10:26.630787+0000","last_active":"2024-09-17T03:10:28.310788+0000","last_peered":"2024-09-17T03:10:28.310788+0000","last_clean":"2024-09-17T03:10:28.310788+0000","last_became_active":"2024-09-17T03:10:26.629999+0000","last_became_peered":"2024-09-17T03:10:26.629999+0000","last_unstale":"2024-09-17T03:10:28.310788+0000","last_undegraded":"2024-09-17T03:10:28.310788+0000","last_fullsized":"2024-09-17T03:10:28.310788+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:09.830683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.311044+0000","last_change":"2024-09-17T03:10:25.625455+0000","last_active":"2024-09-17T03:10:28.311044+0000","last_peered":"2024-09-17T03:10:28.311044+0000","last_clean":"2024-09-17T03:10:28.311044+0000","last_became_active":"2024-09-17T03:10:25.625151+0000","last_became_peered":"2024-09-17T03:10:25.625151+0000","last_unstale":"2024-09-17T03:10:28.311044+0000","last_undegraded":"2024-09-17T03:10:28.311044+0000","last_fullsized":"2024-09-17T03:10:28.311044+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:24.800733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.718736+0000","last_change":"2024-09-17T03:10:26.634616+0000","last_active":"2024-09-17T03:10:27.718736+0000","last_peered":"2024-09-17T03:10:27.718736+0000","last_clean":"2024-09-17T03:10:27.718736+0000","last_became_active":"2024-09-17T03:10:26.633900+0000","last_became_peered":"2024-09-17T03:10:26.633900+0000","last_unstale":"2024-09-17T03:10:27.718736+0000","last_undegraded":"2024-09-17T03:10:27.718736+0000","last_fullsized":"2024-09-17T03:10:27.718736+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:59.177046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.658341+0000","last_change":"2024-09-17T03:10:25.623870+0000","last_active":"2024-09-17T03:10:29.658341+0000","last_peered":"2024-09-17T03:10:29.658341+0000","last_clean":"2024-09-17T03:10:29.658341+0000","last_became_active":"2024-09-17T03:10:25.622936+0000","last_became_peered":"2024-09-17T03:10:25.622936+0000","last_unstale":"2024-09-17T03:10:29.658341+0000","last_undegraded":"2024-09-17T03:10:29.658341+0000","last_fullsized":"2024-09-17T03:10:29.658341+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:58.145638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.625127+0000","last_change":"2024-09-17T03:10:26.632580+0000","last_active":"2024-09-17T03:10:27.625127+0000","last_peered":"2024-09-17T03:10:27.625127+0000","last_clean":"2024-09-17T03:10:27.625127+0000","last_became_active":"2024-09-17T03:10:26.631503+0000","last_became_peered":"2024-09-17T03:10:26.631503+0000","last_unstale":"2024-09-17T03:10:27.625127+0000","last_undegraded":"2024-09-17T03:10:27.625127+0000","last_fullsized":"2024-09-17T03:10:27.625127+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:25.617947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.625006+0000","last_change":"2024-09-17T03:10:25.627052+0000","last_active":"2024-09-17T03:10:27.625006+0000","last_peered":"2024-09-17T03:10:27.625006+0000","last_clean":"2024-09-17T03:10:27.625006+0000","last_became_active":"2024-09-17T03:10:25.626732+0000","last_became_peered":"2024-09-17T03:10:25.626732+0000","last_unstale":"2024-09-17T03:10:27.625006+0000","last_undegraded":"2024-09-17T03:10:27.625006+0000","last_fullsized":"2024-09-17T03:10:27.625006+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:00.999578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.659474+0000","last_change":"2024-09-17T03:10:26.627994+0000","last_active":"2024-09-17T03:10:29.659474+0000","last_peered":"2024-09-17T03:10:29.659474+0000","last_clean":"2024-09-17T03:10:29.659474+0000","last_became_active":"2024-09-17T03:10:26.627677+0000","last_became_peered":"2024-09-17T03:10:26.627677+0000","last_unstale":"2024-09-17T03:10:29.659474+0000","last_undegraded":"2024-09-17T03:10:29.659474+0000","last_fullsized":"2024-09-17T03:10:29.659474+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:06.982391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.626419+0000","last_change":"2024-09-17T03:10:25.622889+0000","last_active":"2024-09-17T03:10:27.626419+0000","last_peered":"2024-09-17T03:10:27.626419+0000","last_clean":"2024-09-17T03:10:27.626419+0000","last_became_active":"2024-09-17T03:10:25.622552+0000","last_became_peered":"2024-09-17T03:10:25.622552+0000","last_unstale":"2024-09-17T03:10:27.626419+0000","last_undegraded":"2024-09-17T03:10:27.626419+0000","last_fullsized":"2024-09-17T03:10:27.626419+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:36.291853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.627030+0000","last_change":"2024-09-17T03:10:26.629050+0000","last_active":"2024-09-17T03:10:27.627030+0000","last_peered":"2024-09-17T03:10:27.627030+0000","last_clean":"2024-09-17T03:10:27.627030+0000","last_became_active":"2024-09-17T03:10:26.628692+0000","last_became_peered":"2024-09-17T03:10:26.628692+0000","last_unstale":"2024-09-17T03:10:27.627030+0000","last_undegraded":"2024-09-17T03:10:27.627030+0000","last_fullsized":"2024-09-17T03:10:27.627030+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:03.422880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.491415+0000","last_change":"2024-09-17T03:10:25.625213+0000","last_active":"2024-09-17T03:10:28.491415+0000","last_peered":"2024-09-17T03:10:28.491415+0000","last_clean":"2024-09-17T03:10:28.491415+0000","last_became_active":"2024-09-17T03:10:25.624885+0000","last_became_peered":"2024-09-17T03:10:25.624885+0000","last_unstale":"2024-09-17T03:10:28.491415+0000","last_undegraded":"2024-09-17T03:10:28.491415+0000","last_fullsized":"2024-09-17T03:10:28.491415+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:57.528310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.627231+0000","last_change":"2024-09-17T03:10:26.633293+0000","last_active":"2024-09-17T03:10:27.627231+0000","last_peered":"2024-09-17T03:10:27.627231+0000","last_clean":"2024-09-17T03:10:27.627231+0000","last_became_active":"2024-09-17T03:10:26.632986+0000","last_became_peered":"2024-09-17T03:10:26.632986+0000","last_unstale":"2024-09-17T03:10:27.627231+0000","last_undegraded":"2024-09-17T03:10:27.627231+0000","last_fullsized":"2024-09-17T03:10:27.627231+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:20.565573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.311124+0000","last_change":"2024-09-17T03:10:25.626305+0000","last_active":"2024-09-17T03:10:28.311124+0000","last_peered":"2024-09-17T03:10:28.311124+0000","last_clean":"2024-09-17T03:10:28.311124+0000","last_became_active":"2024-09-17T03:10:25.626021+0000","last_became_peered":"2024-09-17T03:10:25.626021+0000","last_unstale":"2024-09-17T03:10:28.311124+0000","last_undegraded":"2024-09-17T03:10:28.311124+0000","last_fullsized":"2024-09-17T03:10:28.311124+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:22:20.547659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.310894+0000","last_change":"2024-09-17T03:10:26.628582+0000","last_active":"2024-09-17T03:10:28.310894+0000","last_peered":"2024-09-17T03:10:28.310894+0000","last_clean":"2024-09-17T03:10:28.310894+0000","last_became_active":"2024-09-17T03:10:26.628003+0000","last_became_peered":"2024-09-17T03:10:26.628003+0000","last_unstale":"2024-09-17T03:10:28.310894+0000","last_undegraded":"2024-09-17T03:10:28.310894+0000","last_fullsized":"2024-09-17T03:10:28.310894+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:47.077084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.311445+0000","last_change":"2024-09-17T03:10:25.628379+0000","last_active":"2024-09-17T03:10:28.311445+0000","last_peered":"2024-09-17T03:10:28.311445+0000","last_clean":"2024-09-17T03:10:28.311445+0000","last_became_active":"2024-09-17T03:10:25.628078+0000","last_became_peered":"2024-09-17T03:10:25.628078+0000","last_unstale":"2024-09-17T03:10:28.311445+0000","last_undegraded":"2024-09-17T03:10:28.311445+0000","last_fullsized":"2024-09-17T03:10:28.311445+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:23.877248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.658113+0000","last_change":"2024-09-17T03:10:26.631356+0000","last_active":"2024-09-17T03:10:29.658113+0000","last_peered":"2024-09-17T03:10:29.658113+0000","last_clean":"2024-09-17T03:10:29.658113+0000","last_became_active":"2024-09-17T03:10:26.631086+0000","last_became_peered":"2024-09-17T03:10:26.631086+0000","last_unstale":"2024-09-17T03:10:29.658113+0000","last_undegraded":"2024-09-17T03:10:29.658113+0000","last_fullsized":"2024-09-17T03:10:29.658113+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:17.510035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.491201+0000","last_change":"2024-09-17T03:10:25.626068+0000","last_active":"2024-09-17T03:10:28.491201+0000","last_peered":"2024-09-17T03:10:28.491201+0000","last_clean":"2024-09-17T03:10:28.491201+0000","last_became_active":"2024-09-17T03:10:25.625744+0000","last_became_peered":"2024-09-17T03:10:25.625744+0000","last_unstale":"2024-09-17T03:10:28.491201+0000","last_undegraded":"2024-09-17T03:10:28.491201+0000","last_fullsized":"2024-09-17T03:10:28.491201+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:14.190956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.624804+0000","last_change":"2024-09-17T03:10:26.622489+0000","last_active":"2024-09-17T03:10:27.624804+0000","last_peered":"2024-09-17T03:10:27.624804+0000","last_clean":"2024-09-17T03:10:27.624804+0000","last_became_active":"2024-09-17T03:10:26.622188+0000","last_became_peered":"2024-09-17T03:10:26.622188+0000","last_unstale":"2024-09-17T03:10:27.624804+0000","last_undegraded":"2024-09-17T03:10:27.624804+0000","last_fullsized":"2024-09-17T03:10:27.624804+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:21.802120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.658981+0000","last_change":"2024-09-17T03:10:25.622607+0000","last_active":"2024-09-17T03:10:29.658981+0000","last_peered":"2024-09-17T03:10:29.658981+0000","last_clean":"2024-09-17T03:10:29.658981+0000","last_became_active":"2024-09-17T03:10:25.622323+0000","last_became_peered":"2024-09-17T03:10:25.622323+0000","last_unstale":"2024-09-17T03:10:29.658981+0000","last_undegraded":"2024-09-17T03:10:29.658981+0000","last_fullsized":"2024-09-17T03:10:29.658981+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:10:32.576616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.659020+0000","last_change":"2024-09-17T03:10:26.630987+0000","last_active":"2024-09-17T03:10:29.659020+0000","last_peered":"2024-09-17T03:10:29.659020+0000","last_clean":"2024-09-17T03:10:29.659020+0000","last_became_active":"2024-09-17T03:10:26.630703+0000","last_became_peered":"2024-09-17T03:10:26.630703+0000","last_unstale":"2024-09-17T03:10:29.659020+0000","last_undegraded":"2024-09-17T03:10:29.659020+0000","last_fullsized":"2024-09-17T03:10:29.659020+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:16:39.349546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.718521+0000","last_change":"2024-09-17T03:10:25.628191+0000","last_active":"2024-09-17T03:10:27.718521+0000","last_peered":"2024-09-17T03:10:27.718521+0000","last_clean":"2024-09-17T03:10:27.718521+0000","last_became_active":"2024-09-17T03:10:25.627726+0000","last_became_peered":"2024-09-17T03:10:25.627726+0000","last_unstale":"2024-09-17T03:10:27.718521+0000","last_undegraded":"2024-09-17T03:10:27.718521+0000","last_fullsized":"2024-09-17T03:10:27.718521+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:20.153814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.627689+0000","last_change":"2024-09-17T03:10:26.637158+0000","last_active":"2024-09-17T03:10:27.627689+0000","last_peered":"2024-09-17T03:10:27.627689+0000","last_clean":"2024-09-17T03:10:27.627689+0000","last_became_active":"2024-09-17T03:10:26.636866+0000","last_became_peered":"2024-09-17T03:10:26.636866+0000","last_unstale":"2024-09-17T03:10:27.627689+0000","last_undegraded":"2024-09-17T03:10:27.627689+0000","last_fullsized":"2024-09-17T03:10:27.627689+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:45.261920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.311245+0000","last_change":"2024-09-17T03:10:25.629315+0000","last_active":"2024-09-17T03:10:28.311245+0000","last_peered":"2024-09-17T03:10:28.311245+0000","last_clean":"2024-09-17T03:10:28.311245+0000","last_became_active":"2024-09-17T03:10:25.629015+0000","last_became_peered":"2024-09-17T03:10:25.629015+0000","last_unstale":"2024-09-17T03:10:28.311245+0000","last_undegraded":"2024-09-17T03:10:28.311245+0000","last_fullsized":"2024-09-17T03:10:28.311245+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:30.992821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.659197+0000","last_change":"2024-09-17T03:10:26.634495+0000","last_active":"2024-09-17T03:10:29.659197+0000","last_peered":"2024-09-17T03:10:29.659197+0000","last_clean":"2024-09-17T03:10:29.659197+0000","last_became_active":"2024-09-17T03:10:26.633346+0000","last_became_peered":"2024-09-17T03:10:26.633346+0000","last_unstale":"2024-09-17T03:10:29.659197+0000","last_undegraded":"2024-09-17T03:10:29.659197+0000","last_fullsized":"2024-09-17T03:10:29.659197+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:37.183736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.719271+0000","last_change":"2024-09-17T03:10:25.627561+0000","last_active":"2024-09-17T03:10:27.719271+0000","last_peered":"2024-09-17T03:10:27.719271+0000","last_clean":"2024-09-17T03:10:27.719271+0000","last_became_active":"2024-09-17T03:10:25.627173+0000","last_became_peered":"2024-09-17T03:10:25.627173+0000","last_unstale":"2024-09-17T03:10:27.719271+0000","last_undegraded":"2024-09-17T03:10:27.719271+0000","last_fullsized":"2024-09-17T03:10:27.719271+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:06.028675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.719120+0000","last_change":"2024-09-17T03:10:26.622206+0000","last_active":"2024-09-17T03:10:27.719120+0000","last_peered":"2024-09-17T03:10:27.719120+0000","last_clean":"2024-09-17T03:10:27.719120+0000","last_became_active":"2024-09-17T03:10:26.621890+0000","last_became_peered":"2024-09-17T03:10:26.621890+0000","last_unstale":"2024-09-17T03:10:27.719120+0000","last_undegraded":"2024-09-17T03:10:27.719120+0000","last_fullsized":"2024-09-17T03:10:27.719120+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:32.330255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.658010+0000","last_change":"2024-09-17T03:10:25.622690+0000","last_active":"2024-09-17T03:10:29.658010+0000","last_peered":"2024-09-17T03:10:29.658010+0000","last_clean":"2024-09-17T03:10:29.658010+0000","last_became_active":"2024-09-17T03:10:25.622386+0000","last_became_peered":"2024-09-17T03:10:25.622386+0000","last_unstale":"2024-09-17T03:10:29.658010+0000","last_undegraded":"2024-09-17T03:10:29.658010+0000","last_fullsized":"2024-09-17T03:10:29.658010+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:13.925616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.311260+0000","last_change":"2024-09-17T03:10:26.628270+0000","last_active":"2024-09-17T03:10:28.311260+0000","last_peered":"2024-09-17T03:10:28.311260+0000","last_clean":"2024-09-17T03:10:28.311260+0000","last_became_active":"2024-09-17T03:10:26.627647+0000","last_became_peered":"2024-09-17T03:10:26.627647+0000","last_unstale":"2024-09-17T03:10:28.311260+0000","last_undegraded":"2024-09-17T03:10:28.311260+0000","last_fullsized":"2024-09-17T03:10:28.311260+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:19:32.678017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.719022+0000","last_change":"2024-09-17T03:10:25.623065+0000","last_active":"2024-09-17T03:10:27.719022+0000","last_peered":"2024-09-17T03:10:27.719022+0000","last_clean":"2024-09-17T03:10:27.719022+0000","last_became_active":"2024-09-17T03:10:25.621840+0000","last_became_peered":"2024-09-17T03:10:25.621840+0000","last_unstale":"2024-09-17T03:10:27.719022+0000","last_undegraded":"2024-09-17T03:10:27.719022+0000","last_fullsized":"2024-09-17T03:10:27.719022+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:03.194754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.310990+0000","last_change":"2024-09-17T03:10:26.625644+0000","last_active":"2024-09-17T03:10:28.310990+0000","last_peered":"2024-09-17T03:10:28.310990+0000","last_clean":"2024-09-17T03:10:28.310990+0000","last_became_active":"2024-09-17T03:10:26.625302+0000","last_became_peered":"2024-09-17T03:10:26.625302+0000","last_unstale":"2024-09-17T03:10:28.310990+0000","last_undegraded":"2024-09-17T03:10:28.310990+0000","last_fullsized":"2024-09-17T03:10:28.310990+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:28.964975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.626003+0000","last_change":"2024-09-17T03:10:25.629526+0000","last_active":"2024-09-17T03:10:27.626003+0000","last_peered":"2024-09-17T03:10:27.626003+0000","last_clean":"2024-09-17T03:10:27.626003+0000","last_became_active":"2024-09-17T03:10:25.629138+0000","last_became_peered":"2024-09-17T03:10:25.629138+0000","last_unstale":"2024-09-17T03:10:27.626003+0000","last_undegraded":"2024-09-17T03:10:27.626003+0000","last_fullsized":"2024-09-17T03:10:27.626003+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:11:20.566923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.491184+0000","last_change":"2024-09-17T03:10:26.629937+0000","last_active":"2024-09-17T03:10:28.491184+0000","last_peered":"2024-09-17T03:10:28.491184+0000","last_clean":"2024-09-17T03:10:28.491184+0000","last_became_active":"2024-09-17T03:10:26.629637+0000","last_became_peered":"2024-09-17T03:10:26.629637+0000","last_unstale":"2024-09-17T03:10:28.491184+0000","last_undegraded":"2024-09-17T03:10:28.491184+0000","last_fullsized":"2024-09-17T03:10:28.491184+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:32.835911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.657992+0000","last_change":"2024-09-17T03:10:25.625114+0000","last_active":"2024-09-17T03:10:29.657992+0000","last_peered":"2024-09-17T03:10:29.657992+0000","last_clean":"2024-09-17T03:10:29.657992+0000","last_became_active":"2024-09-17T03:10:25.624791+0000","last_became_peered":"2024-09-17T03:10:25.624791+0000","last_unstale":"2024-09-17T03:10:29.657992+0000","last_undegraded":"2024-09-17T03:10:29.657992+0000","last_fullsized":"2024-09-17T03:10:29.657992+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:07.567082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.625532+0000","last_change":"2024-09-17T03:10:26.619428+0000","last_active":"2024-09-17T03:10:27.625532+0000","last_peered":"2024-09-17T03:10:27.625532+0000","last_clean":"2024-09-17T03:10:27.625532+0000","last_became_active":"2024-09-17T03:10:26.619121+0000","last_became_peered":"2024-09-17T03:10:26.619121+0000","last_unstale":"2024-09-17T03:10:27.625532+0000","last_undegraded":"2024-09-17T03:10:27.625532+0000","last_fullsized":"2024-09-17T03:10:27.625532+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:51:21.484037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.659179+0000","last_change":"2024-09-17T03:10:25.625645+0000","last_active":"2024-09-17T03:10:29.659179+0000","last_peered":"2024-09-17T03:10:29.659179+0000","last_clean":"2024-09-17T03:10:29.659179+0000","last_became_active":"2024-09-17T03:10:25.625291+0000","last_became_peered":"2024-09-17T03:10:25.625291+0000","last_unstale":"2024-09-17T03:10:29.659179+0000","last_undegraded":"2024-09-17T03:10:29.659179+0000","last_fullsized":"2024-09-17T03:10:29.659179+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:13:30.885335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:29.659214+0000","last_change":"2024-09-17T03:10:26.623510+0000","last_active":"2024-09-17T03:10:29.659214+0000","last_peered":"2024-09-17T03:10:29.659214+0000","last_clean":"2024-09-17T03:10:29.659214+0000","last_became_active":"2024-09-17T03:10:26.623216+0000","last_became_peered":"2024-09-17T03:10:26.623216+0000","last_unstale":"2024-09-17T03:10:29.659214+0000","last_undegraded":"2024-09-17T03:10:29.659214+0000","last_fullsized":"2024-09-17T03:10:29.659214+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:25.596554+0000","last_clean_scrub_stamp":"2024-09-17T03:10:25.596554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:59.177046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:28.491602+0000","last_change":"2024-09-17T03:10:25.627675+0000","last_active":"2024-09-17T03:10:28.491602+0000","last_peered":"2024-09-17T03:10:28.491602+0000","last_clean":"2024-09-17T03:10:28.491602+0000","last_became_active":"2024-09-17T03:10:25.627236+0000","last_became_peered":"2024-09-17T03:10:25.627236+0000","last_unstale":"2024-09-17T03:10:28.491602+0000","last_undegraded":"2024-09-17T03:10:28.491602+0000","last_fullsized":"2024-09-17T03:10:28.491602+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:10:24.594404+0000","last_clean_scrub_stamp":"2024-09-17T03:10:24.594404+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:27.283493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":150,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T03:10:27.718561+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:10:27.718561+0000","last_peered":"2024-09-17T03:10:27.718561+0000","last_clean":"2024-09-17T03:10:27.718561+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:10:27.718561+0000","last_undegraded":"2024-09-17T03:10:27.718561+0000","last_fullsized":"2024-09-17T03:10:27.718561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509471,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1118208,"data_stored":799949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509471,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31704,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340136,"statfs":{"total":96636764160,"available":96604299264,"internally_reserved":0,"allocated":528384,"data_stored":210163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509470,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27544,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344296,"statfs":{"total":96636764160,"available":96608559104,"internally_reserved":0,"allocated":524288,"data_stored":209561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509471,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":532480,"data_stored":211103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509472,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":536576,"data_stored":211125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509471,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":524288,"data_stored":209561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509471,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28120,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343720,"statfs":{"total":96636764160,"available":96607969280,"internally_reserved":0,"allocated":1118208,"data_stored":799893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31716,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340124,"statfs":{"total":96636764160,"available":96604286976,"internally_reserved":0,"allocated":532480,"data_stored":210129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:10:35.440 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:10:35.440 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:10:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.598+0000 7f655c9ad640 1 -- 172.21.15.78:0/1059427370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6540004080 msgr2=0x7f6540004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.598+0000 7f655c9ad640 1 --2- 172.21.15.78:0/1059427370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6540004080 0x7f6540004800 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f654c00c260 tx=0x7f6540005830 comp rx=0 tx=0).stop 2024-09-17T03:10:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.598+0000 7f6556d9d640 1 -- 172.21.15.78:0/1059427370 reap_dead start 2024-09-17T03:10:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.598+0000 7f655c9ad640 1 -- 172.21.15.78:0/1059427370 shutdown_connections 2024-09-17T03:10:35.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.598+0000 7f655c9ad640 1 -- 172.21.15.78:0/1059427370 >> 172.21.15.78:0/1059427370 conn(0x7f655808bfc0 msgr2=0x7f655809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:35.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.598+0000 7f655c9ad640 1 -- 172.21.15.78:0/1059427370 shutdown_connections 2024-09-17T03:10:35.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.598+0000 7f655c9ad640 1 -- 172.21.15.78:0/1059427370 wait complete. 2024-09-17T03:10:35.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.600+0000 7f655c9ad640 1 Processor -- start 2024-09-17T03:10:35.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.600+0000 7f655c9ad640 1 -- start start 2024-09-17T03:10:35.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.601+0000 7f655c9ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6540004080 0x7f65580c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:35.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.601+0000 7f655c9ad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f655815d650 0x7f6558156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:35.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.601+0000 7f655c9ad640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f655815fa40 0x7f65580cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:35.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.601+0000 7f655c9ad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f65581626e0 con 0x7f6540004080 2024-09-17T03:10:35.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.601+0000 7f655c9ad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6558162860 con 0x7f655815d650 2024-09-17T03:10:35.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.601+0000 7f655c9ad640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f65581629e0 con 0x7f655815fa40 2024-09-17T03:10:35.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.601+0000 7f655659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6540004080 0x7f65580c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:35.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.601+0000 7f655659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6540004080 0x7f65580c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46982/0 (socket says 172.21.15.78:46982) 2024-09-17T03:10:35.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.601+0000 7f655659c640 1 -- 172.21.15.78:0/3688205996 learned_addr learned my addr 172.21.15.78:0/3688205996 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:35.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.602+0000 7f6555d9b640 1 --2- 172.21.15.78:0/3688205996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f655815d650 0x7f6558156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:35.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.602+0000 7f6556d9d640 1 --2- 172.21.15.78:0/3688205996 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f655815fa40 0x7f65580cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:35.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.602+0000 7f655659c640 1 -- 172.21.15.78:0/3688205996 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f655815fa40 msgr2=0x7f65580cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:35.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.602+0000 7f655659c640 1 --2- 172.21.15.78:0/3688205996 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f655815fa40 0x7f65580cd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:35.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.602+0000 7f655659c640 1 -- 172.21.15.78:0/3688205996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f655815d650 msgr2=0x7f6558156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:35.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.602+0000 7f655659c640 1 --2- 172.21.15.78:0/3688205996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f655815d650 0x7f6558156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:35.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.602+0000 7f655659c640 1 -- 172.21.15.78:0/3688205996 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65580c93c0 con 0x7f6540004080 2024-09-17T03:10:35.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.602+0000 7f6555d9b640 1 --2- 172.21.15.78:0/3688205996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f655815d650 0x7f6558156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:10:35.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.602+0000 7f655659c640 1 --2- 172.21.15.78:0/3688205996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6540004080 0x7f65580c8e80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f654800fa30 tx=0x7f654800fef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:35.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.602+0000 7f6546ffd640 1 -- 172.21.15.78:0/3688205996 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654800bcf0 con 0x7f6540004080 2024-09-17T03:10:35.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.602+0000 7f6546ffd640 1 -- 172.21.15.78:0/3688205996 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6548011440 con 0x7f6540004080 2024-09-17T03:10:35.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.602+0000 7f655c9ad640 1 -- 172.21.15.78:0/3688205996 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f655815f280 con 0x7f6540004080 2024-09-17T03:10:35.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.602+0000 7f6546ffd640 1 -- 172.21.15.78:0/3688205996 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6548011870 con 0x7f6540004080 2024-09-17T03:10:35.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.602+0000 7f655c9ad640 1 -- 172.21.15.78:0/3688205996 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65580cc0e0 con 0x7f6540004080 2024-09-17T03:10:35.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.603+0000 7f655c9ad640 1 -- 172.21.15.78:0/3688205996 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65580d1a80 con 0x7f6540004080 2024-09-17T03:10:35.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.604+0000 7f6546ffd640 1 -- 172.21.15.78:0/3688205996 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6548019020 con 0x7f6540004080 2024-09-17T03:10:35.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.604+0000 7f6546ffd640 1 --2- 172.21.15.78:0/3688205996 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6538078b90 0x7f653807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:35.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.604+0000 7f6546ffd640 1 -- 172.21.15.78:0/3688205996 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f654809b7f0 con 0x7f6540004080 2024-09-17T03:10:35.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.604+0000 7f6555d9b640 1 --2- 172.21.15.78:0/3688205996 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6538078b90 0x7f653807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:35.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.605+0000 7f6555d9b640 1 --2- 172.21.15.78:0/3688205996 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6538078b90 0x7f653807b0a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f654c033000 tx=0x7f654c02d000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:35.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.609+0000 7f6546ffd640 1 -- 172.21.15.78:0/3688205996 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6548063c30 con 0x7f6540004080 2024-09-17T03:10:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.852+0000 7f655c9ad640 1 -- 172.21.15.78:0/3688205996 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f65580b9430 con 0x7f6540004080 2024-09-17T03:10:35.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.857+0000 7f6546ffd640 1 -- 172.21.15.78:0/3688205996 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f6548063530 con 0x7f6540004080 2024-09-17T03:10:35.855 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2024-09-17T03:10:35.856 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBv8uhmn+c/IxAALXG+Qkwye7zc6PjcLBsk1g== 2024-09-17T03:10:35.856 INFO:teuthology.orchestra.run.smithi078.stdout: caps mds = "allow" 2024-09-17T03:10:35.856 INFO:teuthology.orchestra.run.smithi078.stdout: caps mon = "allow r" 2024-09-17T03:10:35.856 INFO:teuthology.orchestra.run.smithi078.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:10:35.856 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2024-09-17T03:10:35.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.859+0000 7f655c9ad640 1 -- 172.21.15.78:0/3688205996 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6538078b90 msgr2=0x7f653807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:35.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.859+0000 7f655c9ad640 1 --2- 172.21.15.78:0/3688205996 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6538078b90 0x7f653807b0a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f654c033000 tx=0x7f654c02d000 comp rx=0 tx=0).stop 2024-09-17T03:10:35.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.859+0000 7f655c9ad640 1 -- 172.21.15.78:0/3688205996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6540004080 msgr2=0x7f65580c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:35.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.859+0000 7f655c9ad640 1 --2- 172.21.15.78:0/3688205996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6540004080 0x7f65580c8e80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f654800fa30 tx=0x7f654800fef0 comp rx=0 tx=0).stop 2024-09-17T03:10:35.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.859+0000 7f655c9ad640 1 -- 172.21.15.78:0/3688205996 shutdown_connections 2024-09-17T03:10:35.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.859+0000 7f655c9ad640 1 --2- 172.21.15.78:0/3688205996 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f655815fa40 0x7f65580cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:35.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.859+0000 7f655c9ad640 1 --2- 172.21.15.78:0/3688205996 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6538078b90 0x7f653807b0a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:35.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.859+0000 7f655c9ad640 1 --2- 172.21.15.78:0/3688205996 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f655815d650 0x7f6558156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:35.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.859+0000 7f655c9ad640 1 --2- 172.21.15.78:0/3688205996 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6540004080 0x7f65580c8e80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:35.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.859+0000 7f655c9ad640 1 -- 172.21.15.78:0/3688205996 >> 172.21.15.78:0/3688205996 conn(0x7f655808bfc0 msgr2=0x7f65580d24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:35.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.859+0000 7f655c9ad640 1 -- 172.21.15.78:0/3688205996 shutdown_connections 2024-09-17T03:10:35.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.859+0000 7f655c9ad640 1 -- 172.21.15.78:0/3688205996 wait complete. 2024-09-17T03:10:35.869 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:10:35.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.984+0000 7ff8b3063640 1 -- 172.21.15.78:0/1692876594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff89c004800 msgr2=0x7ff89c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:35.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.984+0000 7ff8b3063640 1 --2- 172.21.15.78:0/1692876594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff89c004800 0x7ff89c004c10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff89800c4a0 tx=0x7ff89c005830 comp rx=0 tx=0).stop 2024-09-17T03:10:35.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.984+0000 7ff8b1600640 1 -- 172.21.15.78:0/1692876594 reap_dead start 2024-09-17T03:10:35.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.984+0000 7ff8b3063640 1 -- 172.21.15.78:0/1692876594 shutdown_connections 2024-09-17T03:10:35.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.984+0000 7ff8b3063640 1 -- 172.21.15.78:0/1692876594 >> 172.21.15.78:0/1692876594 conn(0x7ff8ac06d550 msgr2=0x7ff8ac071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:35.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.984+0000 7ff8b3063640 1 -- 172.21.15.78:0/1692876594 shutdown_connections 2024-09-17T03:10:35.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.984+0000 7ff8b3063640 1 -- 172.21.15.78:0/1692876594 wait complete. 2024-09-17T03:10:35.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.986+0000 7ff8b3063640 1 Processor -- start 2024-09-17T03:10:35.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.986+0000 7ff8b3063640 1 -- start start 2024-09-17T03:10:35.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.987+0000 7ff8b3063640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff89c004800 0x7ff8ac0c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:35.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.987+0000 7ff8b3063640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8ac0c7840 0x7ff8ac15bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:35.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.987+0000 7ff8b3063640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff8ac15c140 0x7ff8ac154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:35.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.987+0000 7ff8b3063640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ac0b7820 con 0x7ff8ac0c7840 2024-09-17T03:10:35.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.987+0000 7ff8b3063640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ac0b76a0 con 0x7ff89c004800 2024-09-17T03:10:35.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.987+0000 7ff8b3063640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff8ac0b79a0 con 0x7ff8ac15c140 2024-09-17T03:10:35.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.987+0000 7ff8abfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8ac0c7840 0x7ff8ac15bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:35.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.987+0000 7ff8abfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8ac0c7840 0x7ff8ac15bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46992/0 (socket says 172.21.15.78:46992) 2024-09-17T03:10:35.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.987+0000 7ff8abfff640 1 -- 172.21.15.78:0/1052686031 learned_addr learned my addr 172.21.15.78:0/1052686031 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:35.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.987+0000 7ff8b0dff640 1 --2- 172.21.15.78:0/1052686031 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff89c004800 0x7ff8ac0c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:35.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.987+0000 7ff8b1600640 1 --2- 172.21.15.78:0/1052686031 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff8ac15c140 0x7ff8ac154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:35.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.988+0000 7ff8abfff640 1 -- 172.21.15.78:0/1052686031 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff8ac15c140 msgr2=0x7ff8ac154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:35.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.988+0000 7ff8abfff640 1 --2- 172.21.15.78:0/1052686031 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff8ac15c140 0x7ff8ac154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:35.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.988+0000 7ff8abfff640 1 -- 172.21.15.78:0/1052686031 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff89c004800 msgr2=0x7ff8ac0c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:35.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.988+0000 7ff8abfff640 1 --2- 172.21.15.78:0/1052686031 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff89c004800 0x7ff8ac0c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:35.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.988+0000 7ff8abfff640 1 -- 172.21.15.78:0/1052686031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8ac0ca620 con 0x7ff8ac0c7840 2024-09-17T03:10:35.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.988+0000 7ff8b1600640 1 --2- 172.21.15.78:0/1052686031 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff8ac15c140 0x7ff8ac154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:10:35.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.988+0000 7ff8b0dff640 1 --2- 172.21.15.78:0/1052686031 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff89c004800 0x7ff8ac0c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:10:35.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.988+0000 7ff8abfff640 1 --2- 172.21.15.78:0/1052686031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8ac0c7840 0x7ff8ac15bc00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff89802b310 tx=0x7ff898006060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:35.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.988+0000 7ff8a97fa640 1 -- 172.21.15.78:0/1052686031 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89802b660 con 0x7ff8ac0c7840 2024-09-17T03:10:35.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.988+0000 7ff8a97fa640 1 -- 172.21.15.78:0/1052686031 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff89802b800 con 0x7ff8ac0c7840 2024-09-17T03:10:35.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.988+0000 7ff8b3063640 1 -- 172.21.15.78:0/1052686031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8ac0cbfb0 con 0x7ff8ac0c7840 2024-09-17T03:10:35.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.988+0000 7ff8a97fa640 1 -- 172.21.15.78:0/1052686031 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89802bc50 con 0x7ff8ac0c7840 2024-09-17T03:10:35.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.988+0000 7ff8b3063640 1 -- 172.21.15.78:0/1052686031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8ac0cbb80 con 0x7ff8ac0c7840 2024-09-17T03:10:35.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.989+0000 7ff8b3063640 1 -- 172.21.15.78:0/1052686031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8ac0d1f20 con 0x7ff8ac0c7840 2024-09-17T03:10:35.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.990+0000 7ff8a97fa640 1 -- 172.21.15.78:0/1052686031 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff8980035f0 con 0x7ff8ac0c7840 2024-09-17T03:10:35.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.991+0000 7ff8a97fa640 1 --2- 172.21.15.78:0/1052686031 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff890078b90 0x7ff89007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:35.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.991+0000 7ff8a97fa640 1 -- 172.21.15.78:0/1052686031 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7ff8980bae60 con 0x7ff8ac0c7840 2024-09-17T03:10:35.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.991+0000 7ff8b0dff640 1 --2- 172.21.15.78:0/1052686031 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff890078b90 0x7ff89007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:35.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.992+0000 7ff8b0dff640 1 --2- 172.21.15.78:0/1052686031 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff890078b90 0x7ff89007b0a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0003640 tx=0x7ff8a000b260 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:35.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:35.996+0000 7ff8a97fa640 1 -- 172.21.15.78:0/1052686031 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff8ac0d2870 con 0x7ff8ac0c7840 2024-09-17T03:10:36.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.208+0000 7ff8b3063640 1 -- 172.21.15.78:0/1052686031 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8ac0cc4d0 con 0x7ff8ac0c7840 2024-09-17T03:10:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.209+0000 7ff8a97fa640 1 -- 172.21.15.78:0/1052686031 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5229 (secure 0 0 0) 0x7ff898083220 con 0x7ff8ac0c7840 2024-09-17T03:10:36.208 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:36.208 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":29,"btime":"2024-09-17T03:10:29:624541+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/2973955781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2973955781},{"type":"v1","addr":"172.21.15.78:6834","nonce":2973955781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3629327943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3629327943},{"type":"v1","addr":"172.21.15.78:6835","nonce":3629327943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5039,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/3209848332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":3209848332},{"type":"v1","addr":"172.21.15.193:6837","nonce":3209848332}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:10:25.982190+0000","modified":"2024-09-17T03:10:28.971132+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5565},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5565":{"gid":5565,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6836/1788096053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1788096053},{"type":"v1","addr":"172.21.15.193:6836","nonce":1788096053}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5565,"qdb_cluster":[5565]},"id":3}]} 2024-09-17T03:10:36.209 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 29 2024-09-17T03:10:36.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.211+0000 7ff8b3063640 1 -- 172.21.15.78:0/1052686031 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff890078b90 msgr2=0x7ff89007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:36.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.211+0000 7ff8b3063640 1 --2- 172.21.15.78:0/1052686031 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff890078b90 0x7ff89007b0a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0003640 tx=0x7ff8a000b260 comp rx=0 tx=0).stop 2024-09-17T03:10:36.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.211+0000 7ff8b3063640 1 -- 172.21.15.78:0/1052686031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8ac0c7840 msgr2=0x7ff8ac15bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:36.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.211+0000 7ff8b3063640 1 --2- 172.21.15.78:0/1052686031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8ac0c7840 0x7ff8ac15bc00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff89802b310 tx=0x7ff898006060 comp rx=0 tx=0).stop 2024-09-17T03:10:36.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.211+0000 7ff8b3063640 1 -- 172.21.15.78:0/1052686031 shutdown_connections 2024-09-17T03:10:36.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.211+0000 7ff8b3063640 1 --2- 172.21.15.78:0/1052686031 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff8ac15c140 0x7ff8ac154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.211+0000 7ff8b3063640 1 --2- 172.21.15.78:0/1052686031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8ac0c7840 0x7ff8ac15bc00 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.211+0000 7ff8b3063640 1 --2- 172.21.15.78:0/1052686031 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff890078b90 0x7ff89007b0a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.211+0000 7ff8b3063640 1 --2- 172.21.15.78:0/1052686031 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff89c004800 0x7ff8ac0c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.211+0000 7ff8b3063640 1 -- 172.21.15.78:0/1052686031 >> 172.21.15.78:0/1052686031 conn(0x7ff8ac06d550 msgr2=0x7ff8ac15e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:36.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.211+0000 7ff8b3063640 1 -- 172.21.15.78:0/1052686031 shutdown_connections 2024-09-17T03:10:36.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.211+0000 7ff8b3063640 1 -- 172.21.15.78:0/1052686031 wait complete. 2024-09-17T03:10:36.624 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:10:25.982190+0000', 'modified': '2024-09-17T03:10:28.971132+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5565}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5565': {'gid': 5565, 'name': 'b', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.193:6836/1788096053', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6834', 'nonce': 1788096053}, {'type': 'v1', 'addr': '172.21.15.193:6836', 'nonce': 1788096053}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5565, 'qdb_cluster': [5565]} 2024-09-17T03:10:36.624 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:10:36.625 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T03:10:36.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.740+0000 7f4b4d41d640 1 -- 172.21.15.78:0/1677000409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4b480ceb40 msgr2=0x7f4b480cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:36.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.740+0000 7f4b4d41d640 1 --2- 172.21.15.78:0/1677000409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4b480ceb40 0x7f4b480cef50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009830 tx=0x7f4b4002a480 comp rx=0 tx=0).stop 2024-09-17T03:10:36.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.740+0000 7f4b4d41d640 1 -- 172.21.15.78:0/1677000409 shutdown_connections 2024-09-17T03:10:36.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.740+0000 7f4b4d41d640 1 --2- 172.21.15.78:0/1677000409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4b480ceb40 0x7f4b480cef50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.740+0000 7f4b4d41d640 1 --2- 172.21.15.78:0/1677000409 >> v2:172.21.15.193:3300/0 conn(0x7f4b4806e170 0x7f4b480b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.740+0000 7f4b4d41d640 1 -- 172.21.15.78:0/1677000409 >> 172.21.15.78:0/1677000409 conn(0x7f4b4808bfc0 msgr2=0x7f4b4809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:36.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.740+0000 7f4b4d41d640 1 -- 172.21.15.78:0/1677000409 shutdown_connections 2024-09-17T03:10:36.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.740+0000 7f4b4d41d640 1 -- 172.21.15.78:0/1677000409 wait complete. 2024-09-17T03:10:36.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.742+0000 7f4b4d41d640 1 Processor -- start 2024-09-17T03:10:36.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.742+0000 7f4b4d41d640 1 -- start start 2024-09-17T03:10:36.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.743+0000 7f4b4d41d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4b4806f4b0 0x7f4b480ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.743+0000 7f4b4d41d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b480ceb40 0x7f4b4815eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.743+0000 7f4b4d41d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b481f8b40 0x7f4b481f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.743+0000 7f4b4d41d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4b480d0e60 con 0x7f4b481f8b40 2024-09-17T03:10:36.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.743+0000 7f4b4d41d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4b480d0ce0 con 0x7f4b480ceb40 2024-09-17T03:10:36.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.743+0000 7f4b4d41d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4b480d0fe0 con 0x7f4b4806f4b0 2024-09-17T03:10:36.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.743+0000 7f4b477fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b481f8b40 0x7f4b481f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.744+0000 7f4b477fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b481f8b40 0x7f4b481f8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40982/0 (socket says 172.21.15.78:40982) 2024-09-17T03:10:36.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.744+0000 7f4b477fe640 1 -- 172.21.15.78:0/1830594221 learned_addr learned my addr 172.21.15.78:0/1830594221 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:36.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.744+0000 7f4b46ffd640 1 --2- 172.21.15.78:0/1830594221 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4b4806f4b0 0x7f4b480ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.744+0000 7f4b467fc640 1 --2- 172.21.15.78:0/1830594221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b480ceb40 0x7f4b4815eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.744+0000 7f4b477fe640 1 -- 172.21.15.78:0/1830594221 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4b4806f4b0 msgr2=0x7f4b480ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:36.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.744+0000 7f4b477fe640 1 --2- 172.21.15.78:0/1830594221 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4b4806f4b0 0x7f4b480ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.744+0000 7f4b477fe640 1 -- 172.21.15.78:0/1830594221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b480ceb40 msgr2=0x7f4b4815eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:36.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.744+0000 7f4b477fe640 1 --2- 172.21.15.78:0/1830594221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b480ceb40 0x7f4b4815eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.744+0000 7f4b477fe640 1 -- 172.21.15.78:0/1830594221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b481f9490 con 0x7f4b481f8b40 2024-09-17T03:10:36.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.744+0000 7f4b477fe640 1 --2- 172.21.15.78:0/1830594221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b481f8b40 0x7f4b481f8f50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009950 tx=0x7f4b40033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:36.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.744+0000 7f4b2f7fe640 1 -- 172.21.15.78:0/1830594221 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b40031b50 con 0x7f4b481f8b40 2024-09-17T03:10:36.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.744+0000 7f4b2f7fe640 1 -- 172.21.15.78:0/1830594221 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b40031e00 con 0x7f4b481f8b40 2024-09-17T03:10:36.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.744+0000 7f4b4d41d640 1 -- 172.21.15.78:0/1830594221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b4815f840 con 0x7f4b481f8b40 2024-09-17T03:10:36.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.744+0000 7f4b2f7fe640 1 -- 172.21.15.78:0/1830594221 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b40005280 con 0x7f4b481f8b40 2024-09-17T03:10:36.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.744+0000 7f4b4d41d640 1 -- 172.21.15.78:0/1830594221 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b4815fe00 con 0x7f4b481f8b40 2024-09-17T03:10:36.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.746+0000 7f4b2f7fe640 1 -- 172.21.15.78:0/1830594221 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4b40005420 con 0x7f4b481f8b40 2024-09-17T03:10:36.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.746+0000 7f4b2f7fe640 1 --2- 172.21.15.78:0/1830594221 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4b34078b90 0x7f4b3407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.747+0000 7f4b2f7fe640 1 -- 172.21.15.78:0/1830594221 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f4b400bbf90 con 0x7f4b481f8b40 2024-09-17T03:10:36.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.747+0000 7f4b46ffd640 1 --2- 172.21.15.78:0/1830594221 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4b34078b90 0x7f4b3407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.747+0000 7f4b46ffd640 1 --2- 172.21.15.78:0/1830594221 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4b34078b90 0x7f4b3407b0a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4b38005fd0 tx=0x7f4b38009500 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:36.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.748+0000 7f4b54464740 1 Processor -- start 2024-09-17T03:10:36.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.748+0000 7f4b54464740 1 -- start start 2024-09-17T03:10:36.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.749+0000 7f4b54464740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e0818270 0x55a0e0be9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.749+0000 7f4b54464740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 0x55a0e0bea500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.749+0000 7f4b54464740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a0e07f7590 0x55a0e0c07400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.749+0000 7f4b54464740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a0e0b32820 con 0x55a0e07ef3b0 2024-09-17T03:10:36.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.749+0000 7f4b54464740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a0e0b21c50 con 0x55a0e07f7590 2024-09-17T03:10:36.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.749+0000 7f4b54464740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a0e0b25a60 con 0x55a0e0818270 2024-09-17T03:10:36.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.749+0000 7f4b467fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 0x55a0e0bea500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.749+0000 7f4b467fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 0x55a0e0bea500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40990/0 (socket says 172.21.15.78:40990) 2024-09-17T03:10:36.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.749+0000 7f4b467fc640 1 -- 172.21.15.78:0/2205863057 learned_addr learned my addr 172.21.15.78:0/2205863057 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:36.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.749+0000 7f4b46ffd640 1 --2- 172.21.15.78:0/2205863057 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e0818270 0x55a0e0be9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.749+0000 7f4b477fe640 1 --2- 172.21.15.78:0/2205863057 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a0e07f7590 0x55a0e0c07400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.749+0000 7f4b467fc640 1 -- 172.21.15.78:0/2205863057 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e0818270 msgr2=0x55a0e0be9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:36.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.750+0000 7f4b467fc640 1 --2- 172.21.15.78:0/2205863057 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e0818270 0x55a0e0be9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.750+0000 7f4b467fc640 1 -- 172.21.15.78:0/2205863057 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a0e07f7590 msgr2=0x55a0e0c07400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:36.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.750+0000 7f4b467fc640 1 --2- 172.21.15.78:0/2205863057 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a0e07f7590 0x55a0e0c07400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.750+0000 7f4b467fc640 1 -- 172.21.15.78:0/2205863057 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0e0883850 con 0x55a0e07ef3b0 2024-09-17T03:10:36.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.750+0000 7f4b46ffd640 1 --2- 172.21.15.78:0/2205863057 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e0818270 0x55a0e0be9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:36.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.750+0000 7f4b467fc640 1 --2- 172.21.15.78:0/2205863057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 0x55a0e0bea500 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c001480 tx=0x7f4b3c001880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8815213828bbad server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:36.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.750+0000 7f4b2cff9640 1 -- 172.21.15.78:0/2205863057 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c006890 con 0x55a0e07ef3b0 2024-09-17T03:10:36.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.750+0000 7f4b2cff9640 1 -- 172.21.15.78:0/2205863057 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b3c006b40 con 0x55a0e07ef3b0 2024-09-17T03:10:36.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.750+0000 7f4b2cff9640 1 -- 172.21.15.78:0/2205863057 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c006d90 con 0x55a0e07ef3b0 2024-09-17T03:10:36.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.751+0000 7f4b54464740 1 -- 172.21.15.78:0/2205863057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 msgr2=0x55a0e0bea500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:36.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.751+0000 7f4b54464740 1 --2- 172.21.15.78:0/2205863057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 0x55a0e0bea500 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c001480 tx=0x7f4b3c001880 comp rx=0 tx=0).stop 2024-09-17T03:10:36.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.751+0000 7f4b54464740 1 -- 172.21.15.78:0/2205863057 shutdown_connections 2024-09-17T03:10:36.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.751+0000 7f4b54464740 1 --2- 172.21.15.78:0/2205863057 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a0e07f7590 0x55a0e0c07400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.751+0000 7f4b54464740 1 --2- 172.21.15.78:0/2205863057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 0x55a0e0bea500 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.751+0000 7f4b54464740 1 --2- 172.21.15.78:0/2205863057 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e0818270 0x55a0e0be9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.751+0000 7f4b54464740 1 -- 172.21.15.78:0/2205863057 >> 172.21.15.78:0/2205863057 conn(0x55a0e080c3c0 msgr2=0x55a0e0bc0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:36.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.751+0000 7f4b54464740 1 -- 172.21.15.78:0/2205863057 shutdown_connections 2024-09-17T03:10:36.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.751+0000 7f4b54464740 1 -- 172.21.15.78:0/2205863057 wait complete. 2024-09-17T03:10:36.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.752+0000 7f4b54464740 1 -- start start 2024-09-17T03:10:36.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.752+0000 7f4b54464740 1 Processor -- start 2024-09-17T03:10:36.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.753+0000 7f4b54464740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a0e07ef3b0 0x55a0e0bc8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.753+0000 7f4b54464740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e07f7590 0x55a0e0bd7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.753+0000 7f4b54464740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e0818270 0x55a0e0bd82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.753+0000 7f4b54464740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a0e0892620 con 0x55a0e0818270 2024-09-17T03:10:36.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.753+0000 7f4b54464740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a0e0ac75f0 con 0x55a0e07ef3b0 2024-09-17T03:10:36.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.753+0000 7f4b54464740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a0e0beaa40 con 0x55a0e07f7590 2024-09-17T03:10:36.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.753+0000 7f4b54464740 10 client.0 _ll_register_callbacks cb 0x55a0e0acb0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:10:36.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.753+0000 7f4b477fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e0818270 0x55a0e0bd82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.753+0000 7f4b477fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e0818270 0x55a0e0bd82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41000/0 (socket says 172.21.15.78:41000) 2024-09-17T03:10:36.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.753+0000 7f4b477fe640 1 -- 172.21.15.78:0/1365348588 learned_addr learned my addr 172.21.15.78:0/1365348588 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:36.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.753+0000 7f4b46ffd640 1 --2- 172.21.15.78:0/1365348588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a0e07ef3b0 0x55a0e0bc8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.753+0000 7f4b467fc640 1 --2- 172.21.15.78:0/1365348588 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e07f7590 0x55a0e0bd7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.753+0000 7f4b477fe640 1 -- 172.21.15.78:0/1365348588 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e07f7590 msgr2=0x55a0e0bd7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:36.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.753+0000 7f4b477fe640 1 --2- 172.21.15.78:0/1365348588 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e07f7590 0x55a0e0bd7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.753+0000 7f4b477fe640 1 -- 172.21.15.78:0/1365348588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a0e07ef3b0 msgr2=0x55a0e0bc8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:36.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.753+0000 7f4b477fe640 1 --2- 172.21.15.78:0/1365348588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a0e07ef3b0 0x55a0e0bc8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.754+0000 7f4b477fe640 1 -- 172.21.15.78:0/1365348588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0e08fa6b0 con 0x55a0e0818270 2024-09-17T03:10:36.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.754+0000 7f4b477fe640 1 --2- 172.21.15.78:0/1365348588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e0818270 0x55a0e0bd82c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4b400839e0 tx=0x7f4b400842b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04b82a859b3645b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:36.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.754+0000 7f4b25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:10:36.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.754+0000 7f4b25ffb640 1 -- 172.21.15.78:0/1365348588 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b400aa070 con 0x55a0e0818270 2024-09-17T03:10:36.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.754+0000 7f4b25ffb640 1 -- 172.21.15.78:0/1365348588 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f4b4006f170 con 0x55a0e0818270 2024-09-17T03:10:36.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.754+0000 7f4b54464740 1 -- 172.21.15.78:0/1365348588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b3c006b40 con 0x55a0e0818270 2024-09-17T03:10:36.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.754+0000 7f4b25ffb640 1 -- 172.21.15.78:0/1365348588 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4b40048040 con 0x55a0e0818270 2024-09-17T03:10:36.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.754+0000 7f4b54464740 10 client.5700 fetch_fsmap learned FSMap version 29 2024-09-17T03:10:36.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.754+0000 7f4b54464740 1 -- 172.21.15.78:0/1365348588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55a0e0bfe670 con 0x55a0e0818270 2024-09-17T03:10:36.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.754+0000 7f4b25ffb640 1 -- 172.21.15.78:0/1365348588 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b3c006b40 con 0x55a0e0818270 2024-09-17T03:10:36.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.754+0000 7f4b25ffb640 1 -- 172.21.15.78:0/1365348588 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f4b4008d1e0 con 0x55a0e0818270 2024-09-17T03:10:36.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.754+0000 7f4b54464740 10 client.5700 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T03:10:36.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.754+0000 7f4b54464740 10 client.5700 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T03:10:36.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.754+0000 7f4b54464740 20 client.5700 populate_metadata read hostname 'smithi078' 2024-09-17T03:10:36.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.754+0000 7f4b54464740 1 --2- 172.21.15.78:0/1365348588 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55a0e07d6e40 0x55a0e0bbde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.754+0000 7f4b54464740 4 client.5700 mds_command: new command op to 5565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:10:36.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.754+0000 7f4b54464740 1 -- 172.21.15.78:0/1365348588 --> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0e0b34770 con 0x55a0e07d6e40 2024-09-17T03:10:36.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.755+0000 7f4b46ffd640 1 --2- 172.21.15.78:0/1365348588 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55a0e07d6e40 0x55a0e0bbde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.755+0000 7f4b25ffb640 10 client.5700 ms_handle_connect on v2:172.21.15.193:6834/1788096053 2024-09-17T03:10:36.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.755+0000 7f4b46ffd640 1 --2- 172.21.15.78:0/1365348588 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55a0e07d6e40 0x55a0e0bbde00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e935ecf281da56f3 server_cookie=38a5da3d3ea010b in_seq=0 out_seq=0 2024-09-17T03:10:36.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.756+0000 7f4b25ffb640 1 -- 172.21.15.78:0/1365348588 <== mds.0 v2:172.21.15.193:6834/1788096053 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a0e0b34770 con 0x55a0e07d6e40 2024-09-17T03:10:36.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.756+0000 7f4b25ffb640 10 client.5700 handle_command_reply: tid=0 2024-09-17T03:10:36.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.756+0000 7f4b54464740 1 client.5700 shutdown 2024-09-17T03:10:36.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.756+0000 7f4b54464740 1 -- 172.21.15.78:0/1365348588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e0818270 msgr2=0x55a0e0bd82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:36.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.756+0000 7f4b54464740 1 --2- 172.21.15.78:0/1365348588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e0818270 0x55a0e0bd82c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4b400839e0 tx=0x7f4b400842b0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.756+0000 7f4b54464740 1 -- 172.21.15.78:0/1365348588 shutdown_connections 2024-09-17T03:10:36.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.756+0000 7f4b54464740 1 --2- 172.21.15.78:0/1365348588 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55a0e07d6e40 0x55a0e0bbde00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.756+0000 7f4b54464740 1 --2- 172.21.15.78:0/1365348588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e0818270 0x55a0e0bd82c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.756+0000 7f4b25ffb640 0 client.5700 ms_handle_reset on v2:172.21.15.193:6834/1788096053 2024-09-17T03:10:36.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.756+0000 7f4b54464740 1 --2- 172.21.15.78:0/1365348588 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e07f7590 0x55a0e0bd7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.756+0000 7f4b54464740 1 --2- 172.21.15.78:0/1365348588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a0e07ef3b0 0x55a0e0bc8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.756+0000 7f4b54464740 1 -- 172.21.15.78:0/1365348588 >> 172.21.15.78:0/1365348588 conn(0x55a0e080c3c0 msgr2=0x55a0e0bc0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:36.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.756+0000 7f4b54464740 1 -- 172.21.15.78:0/1365348588 shutdown_connections 2024-09-17T03:10:36.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.756+0000 7f4b54464740 1 -- 172.21.15.78:0/1365348588 wait complete. 2024-09-17T03:10:36.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.756+0000 7f4b54464740 20 client.5700 trim_cache size 0 max 16384 2024-09-17T03:10:36.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.774+0000 7f4b54464740 1 Processor -- start 2024-09-17T03:10:36.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.774+0000 7f4b54464740 1 -- start start 2024-09-17T03:10:36.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.775+0000 7f4b54464740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 0x55a0e0be8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.775+0000 7f4b54464740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a0e07f7590 0x55a0e0bbf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.775+0000 7f4b54464740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e0818270 0x55a0e0bd7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.775+0000 7f4b54464740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4b48201270 con 0x55a0e07ef3b0 2024-09-17T03:10:36.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.775+0000 7f4b54464740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4b480c9fe0 con 0x55a0e07f7590 2024-09-17T03:10:36.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.775+0000 7f4b54464740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4b480ca630 con 0x55a0e0818270 2024-09-17T03:10:36.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.776+0000 7f4b46ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 0x55a0e0be8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.776+0000 7f4b46ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 0x55a0e0be8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41008/0 (socket says 172.21.15.78:41008) 2024-09-17T03:10:36.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.776+0000 7f4b46ffd640 1 -- 172.21.15.78:0/3124666925 learned_addr learned my addr 172.21.15.78:0/3124666925 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:36.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.776+0000 7f4b467fc640 1 --2- 172.21.15.78:0/3124666925 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a0e07f7590 0x55a0e0bbf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.776+0000 7f4b477fe640 1 --2- 172.21.15.78:0/3124666925 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e0818270 0x55a0e0bd7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.776+0000 7f4b46ffd640 1 -- 172.21.15.78:0/3124666925 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e0818270 msgr2=0x55a0e0bd7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:36.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.776+0000 7f4b46ffd640 1 --2- 172.21.15.78:0/3124666925 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e0818270 0x55a0e0bd7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.776+0000 7f4b46ffd640 1 -- 172.21.15.78:0/3124666925 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a0e07f7590 msgr2=0x55a0e0bbf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:36.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.776+0000 7f4b46ffd640 1 --2- 172.21.15.78:0/3124666925 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a0e07f7590 0x55a0e0bbf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.776+0000 7f4b46ffd640 1 -- 172.21.15.78:0/3124666925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0e0bc0110 con 0x55a0e07ef3b0 2024-09-17T03:10:36.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.776+0000 7f4b477fe640 1 --2- 172.21.15.78:0/3124666925 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e0818270 0x55a0e0bd7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:10:36.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.776+0000 7f4b46ffd640 1 --2- 172.21.15.78:0/3124666925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 0x55a0e0be8030 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x55a0e0bfd280 tx=0x7f4b38013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ff5deed6e63d6d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:36.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.776+0000 7f4b27fff640 1 -- 172.21.15.78:0/3124666925 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b380210d0 con 0x55a0e07ef3b0 2024-09-17T03:10:36.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.776+0000 7f4b27fff640 1 -- 172.21.15.78:0/3124666925 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b38021270 con 0x55a0e07ef3b0 2024-09-17T03:10:36.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.776+0000 7f4b27fff640 1 -- 172.21.15.78:0/3124666925 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b38021b80 con 0x55a0e07ef3b0 2024-09-17T03:10:36.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.777+0000 7f4b54464740 1 -- 172.21.15.78:0/3124666925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 msgr2=0x55a0e0be8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:36.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.777+0000 7f4b54464740 1 --2- 172.21.15.78:0/3124666925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 0x55a0e0be8030 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x55a0e0bfd280 tx=0x7f4b38013000 comp rx=0 tx=0).stop 2024-09-17T03:10:36.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.777+0000 7f4b54464740 1 -- 172.21.15.78:0/3124666925 shutdown_connections 2024-09-17T03:10:36.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.777+0000 7f4b54464740 1 --2- 172.21.15.78:0/3124666925 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e0818270 0x55a0e0bd7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.777+0000 7f4b54464740 1 --2- 172.21.15.78:0/3124666925 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a0e07f7590 0x55a0e0bbf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.777+0000 7f4b54464740 1 --2- 172.21.15.78:0/3124666925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 0x55a0e0be8030 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.777+0000 7f4b54464740 1 -- 172.21.15.78:0/3124666925 >> 172.21.15.78:0/3124666925 conn(0x55a0e080c3c0 msgr2=0x55a0e0bc11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:36.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.777+0000 7f4b54464740 1 -- 172.21.15.78:0/3124666925 shutdown_connections 2024-09-17T03:10:36.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.777+0000 7f4b54464740 1 -- 172.21.15.78:0/3124666925 wait complete. 2024-09-17T03:10:36.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.778+0000 7f4b54464740 1 -- start start 2024-09-17T03:10:36.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.778+0000 7f4b54464740 1 Processor -- start 2024-09-17T03:10:36.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.779+0000 7f4b54464740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 0x55a0e0bd5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.779+0000 7f4b54464740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e07f7590 0x55a0e0bd7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.779+0000 7f4b54464740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a0e0818270 0x55a0e0bd54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.779+0000 7f4b54464740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a0e0bd5160 con 0x55a0e07ef3b0 2024-09-17T03:10:36.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.779+0000 7f4b54464740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a0e0bfe940 con 0x55a0e0818270 2024-09-17T03:10:36.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.779+0000 7f4b54464740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a0e0bd3e00 con 0x55a0e07f7590 2024-09-17T03:10:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.779+0000 7f4b54464740 10 client.0 _ll_register_callbacks cb 0x7f4b40080330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:10:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.779+0000 7f4b46ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 0x55a0e0bd5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.779+0000 7f4b46ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 0x55a0e0bd5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41010/0 (socket says 172.21.15.78:41010) 2024-09-17T03:10:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.779+0000 7f4b46ffd640 1 -- 172.21.15.78:0/751560787 learned_addr learned my addr 172.21.15.78:0/751560787 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.779+0000 7f4b477fe640 1 --2- 172.21.15.78:0/751560787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a0e0818270 0x55a0e0bd54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.779+0000 7f4b467fc640 1 --2- 172.21.15.78:0/751560787 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e07f7590 0x55a0e0bd7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b46ffd640 1 -- 172.21.15.78:0/751560787 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e07f7590 msgr2=0x55a0e0bd7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b46ffd640 1 --2- 172.21.15.78:0/751560787 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e07f7590 0x55a0e0bd7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b46ffd640 1 -- 172.21.15.78:0/751560787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a0e0818270 msgr2=0x55a0e0bd54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b46ffd640 1 --2- 172.21.15.78:0/751560787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a0e0818270 0x55a0e0bd54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b46ffd640 1 -- 172.21.15.78:0/751560787 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0e0bbc8d0 con 0x55a0e07ef3b0 2024-09-17T03:10:36.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b46ffd640 1 --2- 172.21.15.78:0/751560787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 0x55a0e0bd5c90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009fd0 tx=0x7f4b380115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4036070a3562772 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:36.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:10:36.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b25ffb640 1 -- 172.21.15.78:0/751560787 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b38021b30 con 0x55a0e07ef3b0 2024-09-17T03:10:36.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b25ffb640 1 -- 172.21.15.78:0/751560787 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f4b3802d070 con 0x55a0e07ef3b0 2024-09-17T03:10:36.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b54464740 1 -- 172.21.15.78:0/751560787 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b38021270 con 0x55a0e07ef3b0 2024-09-17T03:10:36.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b25ffb640 1 -- 172.21.15.78:0/751560787 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4b38021cd0 con 0x55a0e07ef3b0 2024-09-17T03:10:36.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b54464740 10 client.5706 fetch_fsmap learned FSMap version 29 2024-09-17T03:10:36.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b54464740 1 -- 172.21.15.78:0/751560787 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) -- 0x55a0e0be83d0 con 0x55a0e07ef3b0 2024-09-17T03:10:36.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b25ffb640 1 -- 172.21.15.78:0/751560787 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b38021270 con 0x55a0e07ef3b0 2024-09-17T03:10:36.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b25ffb640 1 -- 172.21.15.78:0/751560787 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 29) ==== 3502+0+0 (secure 0 0 0) 0x7f4b3803b460 con 0x55a0e07ef3b0 2024-09-17T03:10:36.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b54464740 10 client.5706 fetch_fsmap finished waiting for FSMap version 29 2024-09-17T03:10:36.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b54464740 10 client.5706 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T03:10:36.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b54464740 20 client.5706 populate_metadata read hostname 'smithi078' 2024-09-17T03:10:36.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b54464740 1 --2- 172.21.15.78:0/751560787 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55a0e0c88520 0x55a0e0c88930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b54464740 4 client.5706 mds_command: new command op to 5565 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:10:36.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.780+0000 7f4b54464740 1 -- 172.21.15.78:0/751560787 --> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] -- command(tid 0: {"prefix": "status"}) -- 0x55a0e0c06580 con 0x55a0e0c88520 2024-09-17T03:10:36.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.781+0000 7f4b467fc640 1 --2- 172.21.15.78:0/751560787 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55a0e0c88520 0x55a0e0c88930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.781+0000 7f4b25ffb640 10 client.5706 ms_handle_connect on v2:172.21.15.193:6834/1788096053 2024-09-17T03:10:36.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.781+0000 7f4b467fc640 1 --2- 172.21.15.78:0/751560787 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55a0e0c88520 0x55a0e0c88930 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1523a591da07e98a server_cookie=f37aab0b26ffde10 in_seq=0 out_seq=0 2024-09-17T03:10:36.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.781+0000 7f4b25ffb640 1 -- 172.21.15.78:0/751560787 <== mds.0 v2:172.21.15.193:6834/1788096053 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55a0e0c06580 con 0x55a0e0c88520 2024-09-17T03:10:36.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.781+0000 7f4b25ffb640 10 client.5706 handle_command_reply: tid=0 2024-09-17T03:10:36.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.781+0000 7f4b54464740 1 client.5706 shutdown 2024-09-17T03:10:36.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.781+0000 7f4b54464740 1 -- 172.21.15.78:0/751560787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 msgr2=0x55a0e0bd5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:36.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.781+0000 7f4b54464740 1 --2- 172.21.15.78:0/751560787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 0x55a0e0bd5c90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4b38009fd0 tx=0x7f4b380115a0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.781+0000 7f4b54464740 1 -- 172.21.15.78:0/751560787 shutdown_connections 2024-09-17T03:10:36.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.781+0000 7f4b54464740 1 --2- 172.21.15.78:0/751560787 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55a0e0c88520 0x55a0e0c88930 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.781+0000 7f4b54464740 1 --2- 172.21.15.78:0/751560787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a0e0818270 0x55a0e0bd54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.781+0000 7f4b25ffb640 0 client.5706 ms_handle_reset on v2:172.21.15.193:6834/1788096053 2024-09-17T03:10:36.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.781+0000 7f4b54464740 1 --2- 172.21.15.78:0/751560787 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a0e07f7590 0x55a0e0bd7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.781+0000 7f4b54464740 1 --2- 172.21.15.78:0/751560787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a0e07ef3b0 0x55a0e0bd5c90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.781+0000 7f4b54464740 1 -- 172.21.15.78:0/751560787 >> 172.21.15.78:0/751560787 conn(0x55a0e080c3c0 msgr2=0x55a0e0bd8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:36.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.782+0000 7f4b54464740 1 -- 172.21.15.78:0/751560787 shutdown_connections 2024-09-17T03:10:36.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.782+0000 7f4b54464740 1 -- 172.21.15.78:0/751560787 wait complete. 2024-09-17T03:10:36.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.782+0000 7f4b54464740 20 client.5706 trim_cache size 0 max 16384 2024-09-17T03:10:36.787 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:10:36.787 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:10:36.787 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-09-17T03:10:36.787 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 5565, 2024-09-17T03:10:36.788 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:10:36.788 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:10:36.788 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:10:36.788 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 10.175093371999999, 2024-09-17T03:10:36.788 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 29, 2024-09-17T03:10:36.788 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 45, 2024-09-17T03:10:36.788 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 45, 2024-09-17T03:10:36.788 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 14.862592943999999 2024-09-17T03:10:36.788 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:10:36.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.782+0000 7f4b4d41d640 1 -- 172.21.15.78:0/1830594221 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4b34078b90 msgr2=0x7f4b3407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:36.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.782+0000 7f4b4d41d640 1 --2- 172.21.15.78:0/1830594221 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4b34078b90 0x7f4b3407b0a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4b38005fd0 tx=0x7f4b38009500 comp rx=0 tx=0).stop 2024-09-17T03:10:36.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.782+0000 7f4b4d41d640 1 -- 172.21.15.78:0/1830594221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b481f8b40 msgr2=0x7f4b481f8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:36.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.782+0000 7f4b4d41d640 1 --2- 172.21.15.78:0/1830594221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b481f8b40 0x7f4b481f8f50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009950 tx=0x7f4b40033ba0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.782+0000 7f4b4d41d640 1 -- 172.21.15.78:0/1830594221 shutdown_connections 2024-09-17T03:10:36.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.782+0000 7f4b4d41d640 1 --2- 172.21.15.78:0/1830594221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b481f8b40 0x7f4b481f8f50 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.782+0000 7f4b4d41d640 1 --2- 172.21.15.78:0/1830594221 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4b34078b90 0x7f4b3407b0a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.782+0000 7f4b4d41d640 1 --2- 172.21.15.78:0/1830594221 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b480ceb40 0x7f4b4815eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.782+0000 7f4b4d41d640 1 --2- 172.21.15.78:0/1830594221 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4b4806f4b0 0x7f4b480ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.782+0000 7f4b4d41d640 1 -- 172.21.15.78:0/1830594221 >> 172.21.15.78:0/1830594221 conn(0x7f4b4808bfc0 msgr2=0x7f4b480b7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:36.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.782+0000 7f4b4d41d640 1 -- 172.21.15.78:0/1830594221 shutdown_connections 2024-09-17T03:10:36.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.782+0000 7f4b4d41d640 1 -- 172.21.15.78:0/1830594221 wait complete. 2024-09-17T03:10:36.792 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:10:36.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.910+0000 7ffaa7fc6640 1 -- 172.21.15.78:0/31940406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa015c6f0 msgr2=0x7ffaa00ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:36.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.910+0000 7ffaa7fc6640 1 --2- 172.21.15.78:0/31940406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa015c6f0 0x7ffaa00ceb50 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ffa90005fd0 tx=0x7ffa9002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.910+0000 7ffaa7fc6640 1 -- 172.21.15.78:0/31940406 shutdown_connections 2024-09-17T03:10:36.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.910+0000 7ffaa7fc6640 1 --2- 172.21.15.78:0/31940406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa015c6f0 0x7ffaa00ceb50 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.910+0000 7ffaa7fc6640 1 --2- 172.21.15.78:0/31940406 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffaa00d1d40 0x7ffaa00b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.910+0000 7ffaa7fc6640 1 -- 172.21.15.78:0/31940406 >> 172.21.15.78:0/31940406 conn(0x7ffaa00b3f10 msgr2=0x7ffaa00b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:36.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.910+0000 7ffaa7fc6640 1 -- 172.21.15.78:0/31940406 shutdown_connections 2024-09-17T03:10:36.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.910+0000 7ffaa7fc6640 1 -- 172.21.15.78:0/31940406 wait complete. 2024-09-17T03:10:36.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.912+0000 7ffaa7fc6640 1 Processor -- start 2024-09-17T03:10:36.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.912+0000 7ffaa7fc6640 1 -- start start 2024-09-17T03:10:36.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.913+0000 7ffaa7fc6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaa00ccba0 0x7ffaa014a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.913+0000 7ffaa7fc6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa00d1d40 0x7ffaa00a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.913+0000 7ffaa7fc6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffaa015c6f0 0x7ffaa01e9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.913+0000 7ffaa7fc6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa00d12d0 con 0x7ffaa00d1d40 2024-09-17T03:10:36.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.913+0000 7ffaa7fc6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa00d1150 con 0x7ffaa00ccba0 2024-09-17T03:10:36.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.913+0000 7ffaa7fc6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa00d1450 con 0x7ffaa015c6f0 2024-09-17T03:10:36.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.913+0000 7ffaa5561640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa00d1d40 0x7ffaa00a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.913+0000 7ffaa5561640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa00d1d40 0x7ffaa00a94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41024/0 (socket says 172.21.15.78:41024) 2024-09-17T03:10:36.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.913+0000 7ffaa5561640 1 -- 172.21.15.78:0/2647929458 learned_addr learned my addr 172.21.15.78:0/2647929458 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:36.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.913+0000 7ffaa5d62640 1 --2- 172.21.15.78:0/2647929458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaa00ccba0 0x7ffaa014a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.913+0000 7ffaa6563640 1 --2- 172.21.15.78:0/2647929458 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffaa015c6f0 0x7ffaa01e9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.913+0000 7ffaa5561640 1 -- 172.21.15.78:0/2647929458 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffaa015c6f0 msgr2=0x7ffaa01e9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:36.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.913+0000 7ffaa5561640 1 --2- 172.21.15.78:0/2647929458 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffaa015c6f0 0x7ffaa01e9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.913+0000 7ffaa5561640 1 -- 172.21.15.78:0/2647929458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaa00ccba0 msgr2=0x7ffaa014a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:36.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.913+0000 7ffaa5561640 1 --2- 172.21.15.78:0/2647929458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaa00ccba0 0x7ffaa014a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:36.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.913+0000 7ffaa5561640 1 -- 172.21.15.78:0/2647929458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa00a99e0 con 0x7ffaa00d1d40 2024-09-17T03:10:36.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.913+0000 7ffaa6563640 1 --2- 172.21.15.78:0/2647929458 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffaa015c6f0 0x7ffaa01e9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:36.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.914+0000 7ffaa5561640 1 --2- 172.21.15.78:0/2647929458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa00d1d40 0x7ffaa00a94a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ffa90034040 tx=0x7ffa900038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:36.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.914+0000 7ffa967fc640 1 -- 172.21.15.78:0/2647929458 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9003e030 con 0x7ffaa00d1d40 2024-09-17T03:10:36.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.914+0000 7ffa967fc640 1 -- 172.21.15.78:0/2647929458 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa90003ca0 con 0x7ffaa00d1d40 2024-09-17T03:10:36.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.914+0000 7ffaa7fc6640 1 -- 172.21.15.78:0/2647929458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa014ad40 con 0x7ffaa00d1d40 2024-09-17T03:10:36.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.914+0000 7ffa967fc640 1 -- 172.21.15.78:0/2647929458 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa90035040 con 0x7ffaa00d1d40 2024-09-17T03:10:36.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.914+0000 7ffaa7fc6640 1 -- 172.21.15.78:0/2647929458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa014b300 con 0x7ffaa00d1d40 2024-09-17T03:10:36.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.915+0000 7ffaa7fc6640 1 -- 172.21.15.78:0/2647929458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa00cde90 con 0x7ffaa00d1d40 2024-09-17T03:10:36.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.915+0000 7ffa967fc640 1 -- 172.21.15.78:0/2647929458 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffa90041030 con 0x7ffaa00d1d40 2024-09-17T03:10:36.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.916+0000 7ffa967fc640 1 --2- 172.21.15.78:0/2647929458 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ffa84078b90 0x7ffa8407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:36.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.916+0000 7ffa967fc640 1 -- 172.21.15.78:0/2647929458 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7ffa900bb390 con 0x7ffaa00d1d40 2024-09-17T03:10:36.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.916+0000 7ffaa5d62640 1 --2- 172.21.15.78:0/2647929458 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ffa84078b90 0x7ffa8407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:36.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.917+0000 7ffaa5d62640 1 --2- 172.21.15.78:0/2647929458 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ffa84078b90 0x7ffa8407b0a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0098e0 tx=0x7ffa9c009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:36.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:36.920+0000 7ffa967fc640 1 -- 172.21.15.78:0/2647929458 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffaa00cde90 con 0x7ffaa00d1d40 2024-09-17T03:10:37.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:37.129+0000 7ffaa7fc6640 1 -- 172.21.15.78:0/2647929458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ffaa015c0e0 con 0x7ffaa00d1d40 2024-09-17T03:10:37.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:37.129+0000 7ffa967fc640 1 -- 172.21.15.78:0/2647929458 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) ==== 53+0+73 (secure 0 0 0) 0x7ffaa015c0e0 con 0x7ffaa00d1d40 2024-09-17T03:10:37.128 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:10:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:37.131+0000 7ffaa7fc6640 1 -- 172.21.15.78:0/2647929458 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ffa84078b90 msgr2=0x7ffa8407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:37.131+0000 7ffaa7fc6640 1 --2- 172.21.15.78:0/2647929458 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ffa84078b90 0x7ffa8407b0a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c0098e0 tx=0x7ffa9c009060 comp rx=0 tx=0).stop 2024-09-17T03:10:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:37.131+0000 7ffaa7fc6640 1 -- 172.21.15.78:0/2647929458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa00d1d40 msgr2=0x7ffaa00a94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:37.131+0000 7ffaa7fc6640 1 --2- 172.21.15.78:0/2647929458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa00d1d40 0x7ffaa00a94a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ffa90034040 tx=0x7ffa900038a0 comp rx=0 tx=0).stop 2024-09-17T03:10:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:37.131+0000 7ffaa7fc6640 1 -- 172.21.15.78:0/2647929458 shutdown_connections 2024-09-17T03:10:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:37.131+0000 7ffaa7fc6640 1 --2- 172.21.15.78:0/2647929458 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffaa015c6f0 0x7ffaa01e9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:37.131+0000 7ffaa7fc6640 1 --2- 172.21.15.78:0/2647929458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa00d1d40 0x7ffaa00a94a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:37.131+0000 7ffaa7fc6640 1 --2- 172.21.15.78:0/2647929458 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ffa84078b90 0x7ffa8407b0a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:37.131+0000 7ffaa7fc6640 1 --2- 172.21.15.78:0/2647929458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaa00ccba0 0x7ffaa014a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:37.131+0000 7ffaa7fc6640 1 -- 172.21.15.78:0/2647929458 >> 172.21.15.78:0/2647929458 conn(0x7ffaa00b3f10 msgr2=0x7ffaa0068e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:37.131+0000 7ffaa7fc6640 1 -- 172.21.15.78:0/2647929458 shutdown_connections 2024-09-17T03:10:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:37.131+0000 7ffaa7fc6640 1 -- 172.21.15.78:0/2647929458 wait complete. 2024-09-17T03:10:37.141 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:10:37.141 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:10:37.141 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2024-09-17T03:10:37.141 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:10:37.141 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:10:37.141 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:10:37.141 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:10:37.142 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:10:37.142 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:10:37.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:10:37.142 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2024-09-17T03:10:37.159 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:10:37.159 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:10:37.160 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:10:37.160 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:10:37.160 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2024-09-17T03:10:37.160 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:10:37.160 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:10:37.160 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:10:37.160 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2024-09-17T03:10:37.160 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:10:37.160 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:10:37.161 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2024-09-17T03:10:37.161 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:10:37.161 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:10:37.161 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:10:37.162 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:10:37.162 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:10:37.162 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42628sec preferred_lft 42628sec 2024-09-17T03:10:37.162 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link noprefixroute 2024-09-17T03:10:37.162 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:10:37.162 INFO:teuthology.orchestra.run.smithi078.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:10:37.162 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0e:9b:80:f7:8b:c2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:10:37.162 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:10:37.162 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:10:37.162 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::58a0:47ff:fe97:6de8/64 scope link 2024-09-17T03:10:37.162 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:10:37.162 INFO:teuthology.orchestra.run.smithi078.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:10:37.163 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether e6:fb:78:d9:ba:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:10:37.163 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::e4fb:78ff:fed9:ba75/64 scope link 2024-09-17T03:10:37.163 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:10:37.163 INFO:teuthology.orchestra.run.smithi078.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:10:37.163 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0e:9b:80:f7:8b:c2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:10:37.163 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::c9b:80ff:fef7:8bc2/64 scope link 2024-09-17T03:10:37.163 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:10:37.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:10:37.163 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:10:37.222 INFO:teuthology.orchestra.run.smithi078.stdout:1 2024-09-17T03:10:37.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:10:37.224 DEBUG:teuthology.orchestra.run.smithi078:> route 2024-09-17T03:10:37.280 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2024-09-17T03:10:37.280 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:10:37.280 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:10:37.280 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:10:37.280 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:10:37.281 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:10:37.281 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-17T03:10:37.281 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:10:37.281 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:10:37.281 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:10:37.281 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-17T03:10:37.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:10:37.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:10:37.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:10:37.410 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-17T03:10:37.425 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:10:37.425 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:10:37.425 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:10:37.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:10:37.426 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2024-09-17T03:10:37.491 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:10:37.491 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:10:37.546 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:10:37.546 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:10:37.546 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:10:37.601 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:10:37.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:10:37.601 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:10:37.696 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:10:37.696 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:10:37.696 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:10:37.707 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:10:37.707 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:10:37.707 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:10:37.707 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-09-17T03:10:37.707 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:10:37.714 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:10:37.714 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:10:37.714 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:10:37.714 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-09-17T03:10:37.714 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:10:37.714 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:6789,172.21.15.193:6789,172.21.15.193:6790" 2024-09-17T03:10:37.714 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.78:6789,172.21.15.193:6789,172.21.15.193:6790:/ 2024-09-17T03:10:37.714 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f3c59ba9-dab4-4ee6-8989-d80d11d430b6" will pass to kernel 2024-09-17T03:10:37.715 INFO:teuthology.orchestra.run.smithi078.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:10:37.715 INFO:teuthology.orchestra.run.smithi078.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:10:37.715 INFO:teuthology.orchestra.run.smithi078.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:10:37.715 INFO:teuthology.orchestra.run.smithi078.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:10:37.715 INFO:teuthology.orchestra.run.smithi078.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:10:37.716 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:10:37.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:10:37.717 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:10:37.742 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:10:37.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:10:37.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:10:37.847 INFO:teuthology.orchestra.run.smithi078.stdout:client5141 2024-09-17T03:10:37.848 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:10:37.848 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:10:37.864 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-17T03:10:38.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.021+0000 7fa6294d5640 1 -- 172.21.15.78:0/2307266571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa610003a50 msgr2=0x7fa610003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:38.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.021+0000 7fa6294d5640 1 --2- 172.21.15.78:0/2307266571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa610003a50 0x7fa610003ec0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa6140016c0 tx=0x7fa610005830 comp rx=0 tx=0).stop 2024-09-17T03:10:38.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.021+0000 7fa6294d5640 1 -- 172.21.15.78:0/2307266571 shutdown_connections 2024-09-17T03:10:38.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.021+0000 7fa6294d5640 1 --2- 172.21.15.78:0/2307266571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa610003a50 0x7fa610003ec0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:38.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.021+0000 7fa6294d5640 1 -- 172.21.15.78:0/2307266571 >> 172.21.15.78:0/2307266571 conn(0x7fa62408bfc0 msgr2=0x7fa62409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:38.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.021+0000 7fa6294d5640 1 -- 172.21.15.78:0/2307266571 shutdown_connections 2024-09-17T03:10:38.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.021+0000 7fa6294d5640 1 -- 172.21.15.78:0/2307266571 wait complete. 2024-09-17T03:10:38.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.023+0000 7fa6294d5640 1 Processor -- start 2024-09-17T03:10:38.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.023+0000 7fa6294d5640 1 -- start start 2024-09-17T03:10:38.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.024+0000 7fa6294d5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa610003a50 0x7fa6241f5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:38.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.024+0000 7fa6294d5640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6241e9dc0 0x7fa62415f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:38.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.024+0000 7fa6294d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6241f8a30 0x7fa6241f8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:38.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.024+0000 7fa6294d5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa6240cef50 con 0x7fa6241f8a30 2024-09-17T03:10:38.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.024+0000 7fa6294d5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa62406e3d0 con 0x7fa610003a50 2024-09-17T03:10:38.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.024+0000 7fa6294d5640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa6240cf0d0 con 0x7fa6241e9dc0 2024-09-17T03:10:38.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.024+0000 7fa6237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6241f8a30 0x7fa6241f8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:38.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.024+0000 7fa6237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6241f8a30 0x7fa6241f8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41032/0 (socket says 172.21.15.78:41032) 2024-09-17T03:10:38.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.024+0000 7fa6237fe640 1 -- 172.21.15.78:0/2458179392 learned_addr learned my addr 172.21.15.78:0/2458179392 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:38.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.024+0000 7fa622ffd640 1 --2- 172.21.15.78:0/2458179392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa610003a50 0x7fa6241f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:38.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.024+0000 7fa61a7fc640 1 --2- 172.21.15.78:0/2458179392 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6241e9dc0 0x7fa62415f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:38.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.025+0000 7fa6237fe640 1 -- 172.21.15.78:0/2458179392 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6241e9dc0 msgr2=0x7fa62415f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:38.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.025+0000 7fa6237fe640 1 --2- 172.21.15.78:0/2458179392 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6241e9dc0 0x7fa62415f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:38.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.025+0000 7fa6237fe640 1 -- 172.21.15.78:0/2458179392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa610003a50 msgr2=0x7fa6241f5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:38.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.025+0000 7fa6237fe640 1 --2- 172.21.15.78:0/2458179392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa610003a50 0x7fa6241f5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:38.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.025+0000 7fa6237fe640 1 -- 172.21.15.78:0/2458179392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6241f9380 con 0x7fa6241f8a30 2024-09-17T03:10:38.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.025+0000 7fa6237fe640 1 --2- 172.21.15.78:0/2458179392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6241f8a30 0x7fa6241f8e40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa61c005fd0 tx=0x7fa61c010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:38.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.025+0000 7fa61bfff640 1 -- 172.21.15.78:0/2458179392 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c003970 con 0x7fa6241f8a30 2024-09-17T03:10:38.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.025+0000 7fa61bfff640 1 -- 172.21.15.78:0/2458179392 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa61c015070 con 0x7fa6241f8a30 2024-09-17T03:10:38.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.025+0000 7fa61bfff640 1 -- 172.21.15.78:0/2458179392 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c004050 con 0x7fa6241f8a30 2024-09-17T03:10:38.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.025+0000 7fa6294d5640 1 -- 172.21.15.78:0/2458179392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6241e7210 con 0x7fa6241f8a30 2024-09-17T03:10:38.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.025+0000 7fa6294d5640 1 -- 172.21.15.78:0/2458179392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6241f5fe0 con 0x7fa6241f8a30 2024-09-17T03:10:38.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.026+0000 7fa6294d5640 1 -- 172.21.15.78:0/2458179392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6241f5a70 con 0x7fa6241f8a30 2024-09-17T03:10:38.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.027+0000 7fa61bfff640 1 -- 172.21.15.78:0/2458179392 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa61c0041f0 con 0x7fa6241f8a30 2024-09-17T03:10:38.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.027+0000 7fa61bfff640 1 --2- 172.21.15.78:0/2458179392 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa604078b90 0x7fa60407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:38.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.027+0000 7fa61bfff640 1 -- 172.21.15.78:0/2458179392 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fa61c09b780 con 0x7fa6241f8a30 2024-09-17T03:10:38.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.027+0000 7fa622ffd640 1 --2- 172.21.15.78:0/2458179392 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa604078b90 0x7fa60407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:38.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.028+0000 7fa622ffd640 1 --2- 172.21.15.78:0/2458179392 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa604078b90 0x7fa60407b0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa614032000 tx=0x7fa61402c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:38.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.032+0000 7fa61bfff640 1 -- 172.21.15.78:0/2458179392 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa6241f9380 con 0x7fa6241f8a30 2024-09-17T03:10:38.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.242+0000 7fa6294d5640 1 -- 172.21.15.78:0/2458179392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fa62406f670 con 0x7fa6241f8a30 2024-09-17T03:10:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.661+0000 7fa61bfff640 1 -- 172.21.15.78:0/2458179392 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v30) ==== 105+0+0 (secure 0 0 0) 0x7fa61c063570 con 0x7fa6241f8a30 2024-09-17T03:10:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.664+0000 7fa6294d5640 1 -- 172.21.15.78:0/2458179392 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa604078b90 msgr2=0x7fa60407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.664+0000 7fa6294d5640 1 --2- 172.21.15.78:0/2458179392 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa604078b90 0x7fa60407b0a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa614032000 tx=0x7fa61402c040 comp rx=0 tx=0).stop 2024-09-17T03:10:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.664+0000 7fa6294d5640 1 -- 172.21.15.78:0/2458179392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6241f8a30 msgr2=0x7fa6241f8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.664+0000 7fa6294d5640 1 --2- 172.21.15.78:0/2458179392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6241f8a30 0x7fa6241f8e40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa61c005fd0 tx=0x7fa61c010f40 comp rx=0 tx=0).stop 2024-09-17T03:10:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.664+0000 7fa6294d5640 1 -- 172.21.15.78:0/2458179392 shutdown_connections 2024-09-17T03:10:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.664+0000 7fa6294d5640 1 --2- 172.21.15.78:0/2458179392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6241f8a30 0x7fa6241f8e40 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.664+0000 7fa6294d5640 1 --2- 172.21.15.78:0/2458179392 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6241e9dc0 0x7fa62415f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.664+0000 7fa6294d5640 1 --2- 172.21.15.78:0/2458179392 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa604078b90 0x7fa60407b0a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.664+0000 7fa6294d5640 1 --2- 172.21.15.78:0/2458179392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa610003a50 0x7fa6241f5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.664+0000 7fa6294d5640 1 -- 172.21.15.78:0/2458179392 >> 172.21.15.78:0/2458179392 conn(0x7fa62408bfc0 msgr2=0x7fa624068e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.664+0000 7fa6294d5640 1 -- 172.21.15.78:0/2458179392 shutdown_connections 2024-09-17T03:10:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.664+0000 7fa6294d5640 1 -- 172.21.15.78:0/2458179392 wait complete. 2024-09-17T03:10:38.677 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:10:38.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.790+0000 7fae64094640 1 -- 172.21.15.78:0/67760552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae5c0af780 msgr2=0x7fae5c0b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:38.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.790+0000 7fae64094640 1 --2- 172.21.15.78:0/67760552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae5c0af780 0x7fae5c0b39c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fae58005fd0 tx=0x7fae5802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:10:38.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.790+0000 7fae64094640 1 -- 172.21.15.78:0/67760552 shutdown_connections 2024-09-17T03:10:38.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.790+0000 7fae64094640 1 --2- 172.21.15.78:0/67760552 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fae5c072ff0 0x7fae5c073400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:38.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.790+0000 7fae64094640 1 --2- 172.21.15.78:0/67760552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae5c0af780 0x7fae5c0b39c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:38.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.790+0000 7fae64094640 1 -- 172.21.15.78:0/67760552 >> 172.21.15.78:0/67760552 conn(0x7fae5c06d7d0 msgr2=0x7fae5c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:38.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.790+0000 7fae64094640 1 -- 172.21.15.78:0/67760552 shutdown_connections 2024-09-17T03:10:38.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.790+0000 7fae64094640 1 -- 172.21.15.78:0/67760552 wait complete. 2024-09-17T03:10:38.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.792+0000 7fae64094640 1 Processor -- start 2024-09-17T03:10:38.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.792+0000 7fae64094640 1 -- start start 2024-09-17T03:10:38.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.793+0000 7fae64094640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae5c072ff0 0x7fae5c154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:38.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.793+0000 7fae64094640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae5c0af780 0x7fae5c152bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:38.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.793+0000 7fae64094640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fae5c0cd3e0 0x7fae5c09c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:38.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.793+0000 7fae64094640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fae5c073d10 con 0x7fae5c072ff0 2024-09-17T03:10:38.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.793+0000 7fae64094640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fae5c073b90 con 0x7fae5c0af780 2024-09-17T03:10:38.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.793+0000 7fae64094640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fae5c15f930 con 0x7fae5c0cd3e0 2024-09-17T03:10:38.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.793+0000 7fae61e30640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae5c072ff0 0x7fae5c154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:38.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.793+0000 7fae61e30640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae5c072ff0 0x7fae5c154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41056/0 (socket says 172.21.15.78:41056) 2024-09-17T03:10:38.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.793+0000 7fae61e30640 1 -- 172.21.15.78:0/365115357 learned_addr learned my addr 172.21.15.78:0/365115357 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:38.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.793+0000 7fae62631640 1 --2- 172.21.15.78:0/365115357 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fae5c0cd3e0 0x7fae5c09c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:38.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.793+0000 7fae61e30640 1 -- 172.21.15.78:0/365115357 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fae5c0cd3e0 msgr2=0x7fae5c09c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:38.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.793+0000 7fae61e30640 1 --2- 172.21.15.78:0/365115357 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fae5c0cd3e0 0x7fae5c09c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:38.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.793+0000 7fae61e30640 1 -- 172.21.15.78:0/365115357 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae5c0af780 msgr2=0x7fae5c152bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:38.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.793+0000 7fae6162f640 1 --2- 172.21.15.78:0/365115357 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae5c0af780 0x7fae5c152bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:38.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.793+0000 7fae61e30640 1 --2- 172.21.15.78:0/365115357 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae5c0af780 0x7fae5c152bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:38.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.793+0000 7fae61e30640 1 -- 172.21.15.78:0/365115357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5c1f7810 con 0x7fae5c072ff0 2024-09-17T03:10:38.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.793+0000 7fae6162f640 1 --2- 172.21.15.78:0/365115357 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae5c0af780 0x7fae5c152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:10:38.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.794+0000 7fae61e30640 1 --2- 172.21.15.78:0/365115357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae5c072ff0 0x7fae5c154650 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fae58034040 tx=0x7fae580038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:38.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.794+0000 7fae527fc640 1 -- 172.21.15.78:0/365115357 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5803e030 con 0x7fae5c072ff0 2024-09-17T03:10:38.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.794+0000 7fae527fc640 1 -- 172.21.15.78:0/365115357 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae58003ca0 con 0x7fae5c072ff0 2024-09-17T03:10:38.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.794+0000 7fae527fc640 1 -- 172.21.15.78:0/365115357 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae58035040 con 0x7fae5c072ff0 2024-09-17T03:10:38.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.794+0000 7fae64094640 1 -- 172.21.15.78:0/365115357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae5c1f6a50 con 0x7fae5c072ff0 2024-09-17T03:10:38.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.794+0000 7fae64094640 1 -- 172.21.15.78:0/365115357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae5c1f7010 con 0x7fae5c072ff0 2024-09-17T03:10:38.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.795+0000 7fae64094640 1 -- 172.21.15.78:0/365115357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae5c073400 con 0x7fae5c072ff0 2024-09-17T03:10:38.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.795+0000 7fae527fc640 1 -- 172.21.15.78:0/365115357 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fae58041030 con 0x7fae5c072ff0 2024-09-17T03:10:38.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.796+0000 7fae527fc640 1 --2- 172.21.15.78:0/365115357 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fae40078b90 0x7fae4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:38.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.796+0000 7fae527fc640 1 -- 172.21.15.78:0/365115357 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fae580bb270 con 0x7fae5c072ff0 2024-09-17T03:10:38.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.796+0000 7fae6162f640 1 --2- 172.21.15.78:0/365115357 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fae40078b90 0x7fae4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:38.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.797+0000 7fae6162f640 1 --2- 172.21.15.78:0/365115357 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fae40078b90 0x7fae4007b0a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fae5c159270 tx=0x7fae4c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:38.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:38.800+0000 7fae527fc640 1 -- 172.21.15.78:0/365115357 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fae58083740 con 0x7fae5c072ff0 2024-09-17T03:10:39.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:39.011+0000 7fae64094640 1 -- 172.21.15.78:0/365115357 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae5c15afc0 con 0x7fae5c072ff0 2024-09-17T03:10:39.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:39.012+0000 7fae527fc640 1 -- 172.21.15.78:0/365115357 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5245 (secure 0 0 0) 0x7fae58083040 con 0x7fae5c072ff0 2024-09-17T03:10:39.011 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:39.011 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":31,"btime":"2024-09-17T03:10:38:664709+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/2973955781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2973955781},{"type":"v1","addr":"172.21.15.78:6834","nonce":2973955781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5036,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3629327943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3629327943},{"type":"v1","addr":"172.21.15.78:6835","nonce":3629327943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:10:25.982190+0000","modified":"2024-09-17T03:10:38.664695+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":5565,"mds_1":5039},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5039":{"gid":5039,"name":"d","rank":1,"incarnation":31,"state":"up:creating","state_seq":1,"addr":"172.21.15.193:6837/3209848332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":3209848332},{"type":"v1","addr":"172.21.15.193:6837","nonce":3209848332}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5565":{"gid":5565,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6836/1788096053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1788096053},{"type":"v1","addr":"172.21.15.193:6836","nonce":1788096053}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5565,"qdb_cluster":[5565]},"id":3}]} 2024-09-17T03:10:39.011 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 31 2024-09-17T03:10:39.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:39.014+0000 7fae64094640 1 -- 172.21.15.78:0/365115357 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fae40078b90 msgr2=0x7fae4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:39.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:39.014+0000 7fae64094640 1 --2- 172.21.15.78:0/365115357 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fae40078b90 0x7fae4007b0a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fae5c159270 tx=0x7fae4c009040 comp rx=0 tx=0).stop 2024-09-17T03:10:39.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:39.014+0000 7fae64094640 1 -- 172.21.15.78:0/365115357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae5c072ff0 msgr2=0x7fae5c154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:39.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:39.014+0000 7fae64094640 1 --2- 172.21.15.78:0/365115357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae5c072ff0 0x7fae5c154650 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fae58034040 tx=0x7fae580038a0 comp rx=0 tx=0).stop 2024-09-17T03:10:39.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:39.014+0000 7fae64094640 1 -- 172.21.15.78:0/365115357 shutdown_connections 2024-09-17T03:10:39.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:39.014+0000 7fae64094640 1 --2- 172.21.15.78:0/365115357 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fae5c0cd3e0 0x7fae5c09c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:39.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:39.014+0000 7fae64094640 1 --2- 172.21.15.78:0/365115357 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fae40078b90 0x7fae4007b0a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:39.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:39.014+0000 7fae64094640 1 --2- 172.21.15.78:0/365115357 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fae5c0af780 0x7fae5c152bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:39.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:39.014+0000 7fae64094640 1 --2- 172.21.15.78:0/365115357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae5c072ff0 0x7fae5c154650 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:39.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:39.014+0000 7fae64094640 1 -- 172.21.15.78:0/365115357 >> 172.21.15.78:0/365115357 conn(0x7fae5c06d7d0 msgr2=0x7fae5c0ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:39.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:39.014+0000 7fae64094640 1 -- 172.21.15.78:0/365115357 shutdown_connections 2024-09-17T03:10:39.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:39.014+0000 7fae64094640 1 -- 172.21.15.78:0/365115357 wait complete. 2024-09-17T03:10:39.427 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:10:25.982190+0000', 'modified': '2024-09-17T03:10:38.664695+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 5565, 'mds_1': 5039}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5039': {'gid': 5039, 'name': 'd', 'rank': 1, 'incarnation': 31, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.193:6837/3209848332', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6835', 'nonce': 3209848332}, {'type': 'v1', 'addr': '172.21.15.193:6837', 'nonce': 3209848332}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_5565': {'gid': 5565, 'name': 'b', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.193:6836/1788096053', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6834', 'nonce': 1788096053}, {'type': 'v1', 'addr': '172.21.15.193:6836', 'nonce': 1788096053}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5565, 'qdb_cluster': [5565]} 2024-09-17T03:10:39.427 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5039:up:creating 2024-09-17T03:10:40.428 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:10:40.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.554+0000 7fca33358640 1 -- 172.21.15.78:0/2200765904 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca2c0cff70 msgr2=0x7fca2c15c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:40.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.554+0000 7fca33358640 1 --2- 172.21.15.78:0/2200765904 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca2c0cff70 0x7fca2c15c830 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fca28009830 tx=0x7fca2802a480 comp rx=0 tx=0).stop 2024-09-17T03:10:40.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.554+0000 7fca33358640 1 -- 172.21.15.78:0/2200765904 shutdown_connections 2024-09-17T03:10:40.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.554+0000 7fca33358640 1 --2- 172.21.15.78:0/2200765904 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fca2c0b4530 0x7fca2c0d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:40.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.554+0000 7fca33358640 1 --2- 172.21.15.78:0/2200765904 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca2c0cff70 0x7fca2c15c830 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:40.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.554+0000 7fca33358640 1 -- 172.21.15.78:0/2200765904 >> 172.21.15.78:0/2200765904 conn(0x7fca2c0cee20 msgr2=0x7fca2c0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:40.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.554+0000 7fca33358640 1 -- 172.21.15.78:0/2200765904 shutdown_connections 2024-09-17T03:10:40.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.554+0000 7fca33358640 1 -- 172.21.15.78:0/2200765904 wait complete. 2024-09-17T03:10:40.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.556+0000 7fca33358640 1 Processor -- start 2024-09-17T03:10:40.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.556+0000 7fca33358640 1 -- start start 2024-09-17T03:10:40.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.557+0000 7fca33358640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca2c0cff70 0x7fca2c15efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:40.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.557+0000 7fca33358640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fca2c160c90 0x7fca2c0c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:40.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.557+0000 7fca33358640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca2c1528d0 0x7fca2c0c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:40.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.557+0000 7fca33358640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c0d17c0 con 0x7fca2c1528d0 2024-09-17T03:10:40.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.557+0000 7fca33358640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c0d1640 con 0x7fca2c0cff70 2024-09-17T03:10:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.557+0000 7fca33358640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fca2c0d1940 con 0x7fca2c160c90 2024-09-17T03:10:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.557+0000 7fca318f5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca2c1528d0 0x7fca2c0c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.557+0000 7fca318f5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca2c1528d0 0x7fca2c0c84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41068/0 (socket says 172.21.15.78:41068) 2024-09-17T03:10:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.557+0000 7fca318f5640 1 -- 172.21.15.78:0/1408974803 learned_addr learned my addr 172.21.15.78:0/1408974803 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.557+0000 7fca310f4640 1 --2- 172.21.15.78:0/1408974803 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca2c0cff70 0x7fca2c15efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.558+0000 7fca308f3640 1 --2- 172.21.15.78:0/1408974803 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fca2c160c90 0x7fca2c0c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.558+0000 7fca318f5640 1 -- 172.21.15.78:0/1408974803 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fca2c160c90 msgr2=0x7fca2c0c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.558+0000 7fca318f5640 1 --2- 172.21.15.78:0/1408974803 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fca2c160c90 0x7fca2c0c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.558+0000 7fca318f5640 1 -- 172.21.15.78:0/1408974803 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca2c0cff70 msgr2=0x7fca2c15efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.558+0000 7fca318f5640 1 --2- 172.21.15.78:0/1408974803 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca2c0cff70 0x7fca2c15efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.558+0000 7fca318f5640 1 -- 172.21.15.78:0/1408974803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2c0b3380 con 0x7fca2c1528d0 2024-09-17T03:10:40.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.558+0000 7fca318f5640 1 --2- 172.21.15.78:0/1408974803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca2c1528d0 0x7fca2c0c84b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fca2400ebf0 tx=0x7fca2400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:40.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.558+0000 7fca1dffb640 1 -- 172.21.15.78:0/1408974803 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca24010630 con 0x7fca2c1528d0 2024-09-17T03:10:40.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.558+0000 7fca1dffb640 1 -- 172.21.15.78:0/1408974803 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca240107d0 con 0x7fca2c1528d0 2024-09-17T03:10:40.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.558+0000 7fca33358640 1 -- 172.21.15.78:0/1408974803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca2c0b3660 con 0x7fca2c1528d0 2024-09-17T03:10:40.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.558+0000 7fca1dffb640 1 -- 172.21.15.78:0/1408974803 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca24010c20 con 0x7fca2c1528d0 2024-09-17T03:10:40.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.558+0000 7fca33358640 1 -- 172.21.15.78:0/1408974803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca2c153050 con 0x7fca2c1528d0 2024-09-17T03:10:40.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.559+0000 7fca33358640 1 -- 172.21.15.78:0/1408974803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca2c0cc750 con 0x7fca2c1528d0 2024-09-17T03:10:40.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.560+0000 7fca1dffb640 1 -- 172.21.15.78:0/1408974803 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fca24021440 con 0x7fca2c1528d0 2024-09-17T03:10:40.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.560+0000 7fca1dffb640 1 --2- 172.21.15.78:0/1408974803 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fca10078b90 0x7fca1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:40.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.561+0000 7fca1dffb640 1 -- 172.21.15.78:0/1408974803 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fca2409ba00 con 0x7fca2c1528d0 2024-09-17T03:10:40.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.561+0000 7fca310f4640 1 --2- 172.21.15.78:0/1408974803 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fca10078b90 0x7fca1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:40.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.561+0000 7fca310f4640 1 --2- 172.21.15.78:0/1408974803 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fca10078b90 0x7fca1007b0a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fca28034000 tx=0x7fca28004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:40.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.565+0000 7fca1dffb640 1 -- 172.21.15.78:0/1408974803 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fca24063910 con 0x7fca2c1528d0 2024-09-17T03:10:40.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.775+0000 7fca33358640 1 -- 172.21.15.78:0/1408974803 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca2c160560 con 0x7fca2c1528d0 2024-09-17T03:10:40.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.776+0000 7fca1dffb640 1 -- 172.21.15.78:0/1408974803 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5267 (secure 0 0 0) 0x7fca2c160560 con 0x7fca2c1528d0 2024-09-17T03:10:40.775 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:40.775 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":34,"btime":"2024-09-17T03:10:40:681344+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/2973955781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2973955781},{"type":"v1","addr":"172.21.15.78:6834","nonce":2973955781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:10:25.982190+0000","modified":"2024-09-17T03:10:40.681338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5565,"mds_1":5039,"mds_2":5036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5036":{"gid":5036,"name":"a","rank":2,"incarnation":33,"state":"up:active","state_seq":6,"addr":"172.21.15.78:6835/3629327943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3629327943},{"type":"v1","addr":"172.21.15.78:6835","nonce":3629327943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5039":{"gid":5039,"name":"d","rank":1,"incarnation":31,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6837/3209848332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":3209848332},{"type":"v1","addr":"172.21.15.193:6837","nonce":3209848332}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5565":{"gid":5565,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6836/1788096053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1788096053},{"type":"v1","addr":"172.21.15.193:6836","nonce":1788096053}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5565,"qdb_cluster":[5036,5039,5565]},"id":3}]} 2024-09-17T03:10:40.775 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 34 2024-09-17T03:10:40.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.778+0000 7fca33358640 1 -- 172.21.15.78:0/1408974803 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fca10078b90 msgr2=0x7fca1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:40.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.778+0000 7fca33358640 1 --2- 172.21.15.78:0/1408974803 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fca10078b90 0x7fca1007b0a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fca28034000 tx=0x7fca28004730 comp rx=0 tx=0).stop 2024-09-17T03:10:40.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.778+0000 7fca33358640 1 -- 172.21.15.78:0/1408974803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca2c1528d0 msgr2=0x7fca2c0c84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:40.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.778+0000 7fca33358640 1 --2- 172.21.15.78:0/1408974803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca2c1528d0 0x7fca2c0c84b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fca2400ebf0 tx=0x7fca2400c6a0 comp rx=0 tx=0).stop 2024-09-17T03:10:40.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.778+0000 7fca33358640 1 -- 172.21.15.78:0/1408974803 shutdown_connections 2024-09-17T03:10:40.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.778+0000 7fca33358640 1 --2- 172.21.15.78:0/1408974803 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca2c1528d0 0x7fca2c0c84b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:40.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.778+0000 7fca33358640 1 --2- 172.21.15.78:0/1408974803 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fca2c160c90 0x7fca2c0c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:40.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.778+0000 7fca33358640 1 --2- 172.21.15.78:0/1408974803 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fca10078b90 0x7fca1007b0a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:40.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.778+0000 7fca33358640 1 --2- 172.21.15.78:0/1408974803 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca2c0cff70 0x7fca2c15efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:40.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.778+0000 7fca33358640 1 -- 172.21.15.78:0/1408974803 >> 172.21.15.78:0/1408974803 conn(0x7fca2c0cee20 msgr2=0x7fca2c1e8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:40.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.778+0000 7fca33358640 1 -- 172.21.15.78:0/1408974803 shutdown_connections 2024-09-17T03:10:40.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:40.778+0000 7fca33358640 1 -- 172.21.15.78:0/1408974803 wait complete. 2024-09-17T03:10:41.190 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:10:25.982190+0000', 'modified': '2024-09-17T03:10:40.681338+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 5565, 'mds_1': 5039, 'mds_2': 5036}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5036': {'gid': 5036, 'name': 'a', 'rank': 2, 'incarnation': 33, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.78:6835/3629327943', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6832', 'nonce': 3629327943}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 3629327943}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_5039': {'gid': 5039, 'name': 'd', 'rank': 1, 'incarnation': 31, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.193:6837/3209848332', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6835', 'nonce': 3209848332}, {'type': 'v1', 'addr': '172.21.15.193:6837', 'nonce': 3209848332}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_5565': {'gid': 5565, 'name': 'b', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.193:6836/1788096053', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6834', 'nonce': 1788096053}, {'type': 'v1', 'addr': '172.21.15.193:6836', 'nonce': 1788096053}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5565, 'qdb_cluster': [5036, 5039, 5565]} 2024-09-17T03:10:41.190 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-17T03:10:41.190 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:10:41.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.308+0000 7fd9d9c64640 1 -- 172.21.15.78:0/3246910496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9bc003c60 msgr2=0x7fd9bc0040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:41.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.308+0000 7fd9d9c64640 1 --2- 172.21.15.78:0/3246910496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9bc003c60 0x7fd9bc0040b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4006ed0 tx=0x7fd9bc005830 comp rx=0 tx=0).stop 2024-09-17T03:10:41.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.308+0000 7fd9d3fff640 1 -- 172.21.15.78:0/3246910496 reap_dead start 2024-09-17T03:10:41.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.308+0000 7fd9d9c64640 1 -- 172.21.15.78:0/3246910496 shutdown_connections 2024-09-17T03:10:41.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.308+0000 7fd9d9c64640 1 -- 172.21.15.78:0/3246910496 >> 172.21.15.78:0/3246910496 conn(0x7fd9d406d4f0 msgr2=0x7fd9d4071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:41.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.308+0000 7fd9d9c64640 1 -- 172.21.15.78:0/3246910496 shutdown_connections 2024-09-17T03:10:41.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.308+0000 7fd9d9c64640 1 -- 172.21.15.78:0/3246910496 wait complete. 2024-09-17T03:10:41.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.310+0000 7fd9d9c64640 1 Processor -- start 2024-09-17T03:10:41.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.310+0000 7fd9d9c64640 1 -- start start 2024-09-17T03:10:41.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.312+0000 7fd9d9c64640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9bc003c60 0x7fd9d40b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.312+0000 7fd9d9c64640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9d40ca080 0x7fd9d41f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.312+0000 7fd9d9c64640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd9d40cbf50 0x7fd9d40cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.312+0000 7fd9d9c64640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d40d1090 con 0x7fd9bc003c60 2024-09-17T03:10:41.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.312+0000 7fd9d9c64640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d40cd080 con 0x7fd9d40ca080 2024-09-17T03:10:41.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.312+0000 7fd9d9c64640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd9d40d1210 con 0x7fd9d40cbf50 2024-09-17T03:10:41.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.312+0000 7fd9d37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9bc003c60 0x7fd9d40b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.312+0000 7fd9d37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9bc003c60 0x7fd9d40b10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41088/0 (socket says 172.21.15.78:41088) 2024-09-17T03:10:41.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.312+0000 7fd9d37fe640 1 -- 172.21.15.78:0/336846989 learned_addr learned my addr 172.21.15.78:0/336846989 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:41.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.312+0000 7fd9d2ffd640 1 --2- 172.21.15.78:0/336846989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9d40ca080 0x7fd9d41f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.312+0000 7fd9d3fff640 1 --2- 172.21.15.78:0/336846989 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd9d40cbf50 0x7fd9d40cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.312+0000 7fd9d37fe640 1 -- 172.21.15.78:0/336846989 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd9d40cbf50 msgr2=0x7fd9d40cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:41.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.312+0000 7fd9d37fe640 1 --2- 172.21.15.78:0/336846989 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd9d40cbf50 0x7fd9d40cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.312+0000 7fd9d37fe640 1 -- 172.21.15.78:0/336846989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9d40ca080 msgr2=0x7fd9d41f6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:41.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.312+0000 7fd9d37fe640 1 --2- 172.21.15.78:0/336846989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9d40ca080 0x7fd9d41f6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.312+0000 7fd9d37fe640 1 -- 172.21.15.78:0/336846989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d40cc8a0 con 0x7fd9bc003c60 2024-09-17T03:10:41.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.312+0000 7fd9d3fff640 1 --2- 172.21.15.78:0/336846989 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd9d40cbf50 0x7fd9d40cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:41.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.312+0000 7fd9d37fe640 1 --2- 172.21.15.78:0/336846989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9bc003c60 0x7fd9d40b10a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd9c402a660 tx=0x7fd9c40017c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:41.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.313+0000 7fd9bbfff640 1 -- 172.21.15.78:0/336846989 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4006b20 con 0x7fd9bc003c60 2024-09-17T03:10:41.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.313+0000 7fd9bbfff640 1 -- 172.21.15.78:0/336846989 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9c403f030 con 0x7fd9bc003c60 2024-09-17T03:10:41.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.313+0000 7fd9d9c64640 1 -- 172.21.15.78:0/336846989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d40ca820 con 0x7fd9bc003c60 2024-09-17T03:10:41.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.313+0000 7fd9bbfff640 1 -- 172.21.15.78:0/336846989 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4003d70 con 0x7fd9bc003c60 2024-09-17T03:10:41.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.313+0000 7fd9d9c64640 1 -- 172.21.15.78:0/336846989 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d415d930 con 0x7fd9bc003c60 2024-09-17T03:10:41.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.314+0000 7fd9bbfff640 1 -- 172.21.15.78:0/336846989 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd9c402f440 con 0x7fd9bc003c60 2024-09-17T03:10:41.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.315+0000 7fd9bbfff640 1 --2- 172.21.15.78:0/336846989 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd9c0078b90 0x7fd9c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.315+0000 7fd9bbfff640 1 -- 172.21.15.78:0/336846989 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fd9c40bb8b0 con 0x7fd9bc003c60 2024-09-17T03:10:41.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.315+0000 7fd9d2ffd640 1 --2- 172.21.15.78:0/336846989 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd9c0078b90 0x7fd9c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.316+0000 7fd9e0bce740 1 Processor -- start 2024-09-17T03:10:41.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.316+0000 7fd9e0bce740 1 -- start start 2024-09-17T03:10:41.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.316+0000 7fd9d2ffd640 1 --2- 172.21.15.78:0/336846989 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd9c0078b90 0x7fd9c007b0a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd9d41fa910 tx=0x7fd9c8006c60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:41.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.317+0000 7fd9e0bce740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1a1360270 0x55f1a1731fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.317+0000 7fd9e0bce740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1a13373b0 0x55f1a17324e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.317+0000 7fd9e0bce740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a133f590 0x55f1a174f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.317+0000 7fd9e0bce740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f1a167a820 con 0x55f1a133f590 2024-09-17T03:10:41.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.317+0000 7fd9e0bce740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f1a1669c50 con 0x55f1a13373b0 2024-09-17T03:10:41.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.317+0000 7fd9e0bce740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f1a166da60 con 0x55f1a1360270 2024-09-17T03:10:41.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.317+0000 7fd9d3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a133f590 0x55f1a174f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.317+0000 7fd9d3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a133f590 0x55f1a174f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41104/0 (socket says 172.21.15.78:41104) 2024-09-17T03:10:41.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.317+0000 7fd9d3fff640 1 -- 172.21.15.78:0/318502240 learned_addr learned my addr 172.21.15.78:0/318502240 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:41.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.317+0000 7fd9d37fe640 1 --2- 172.21.15.78:0/318502240 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1a1360270 0x55f1a1731fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.317+0000 7fd9d2ffd640 1 --2- 172.21.15.78:0/318502240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1a13373b0 0x55f1a17324e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.318+0000 7fd9d3fff640 1 -- 172.21.15.78:0/318502240 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1a1360270 msgr2=0x55f1a1731fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:41.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.318+0000 7fd9d3fff640 1 --2- 172.21.15.78:0/318502240 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1a1360270 0x55f1a1731fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.318+0000 7fd9d3fff640 1 -- 172.21.15.78:0/318502240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1a13373b0 msgr2=0x55f1a17324e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:41.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.318+0000 7fd9d3fff640 1 --2- 172.21.15.78:0/318502240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1a13373b0 0x55f1a17324e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.318+0000 7fd9d3fff640 1 -- 172.21.15.78:0/318502240 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1a13cb850 con 0x55f1a133f590 2024-09-17T03:10:41.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.318+0000 7fd9d3fff640 1 --2- 172.21.15.78:0/318502240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a133f590 0x55f1a174f3e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40b7c70 tx=0x7fd9cc003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a3e2cb7271817a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:41.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.318+0000 7fd9b97fa640 1 -- 172.21.15.78:0/318502240 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0047f0 con 0x55f1a133f590 2024-09-17T03:10:41.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.318+0000 7fd9b97fa640 1 -- 172.21.15.78:0/318502240 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9cc004b20 con 0x55f1a133f590 2024-09-17T03:10:41.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.318+0000 7fd9b97fa640 1 -- 172.21.15.78:0/318502240 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc005020 con 0x55f1a133f590 2024-09-17T03:10:41.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.319+0000 7fd9e0bce740 1 -- 172.21.15.78:0/318502240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a133f590 msgr2=0x55f1a174f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:41.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.319+0000 7fd9e0bce740 1 --2- 172.21.15.78:0/318502240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a133f590 0x55f1a174f3e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40b7c70 tx=0x7fd9cc003d40 comp rx=0 tx=0).stop 2024-09-17T03:10:41.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.319+0000 7fd9e0bce740 1 -- 172.21.15.78:0/318502240 shutdown_connections 2024-09-17T03:10:41.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.319+0000 7fd9e0bce740 1 --2- 172.21.15.78:0/318502240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a133f590 0x55f1a174f3e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.319+0000 7fd9e0bce740 1 --2- 172.21.15.78:0/318502240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1a13373b0 0x55f1a17324e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.319+0000 7fd9e0bce740 1 --2- 172.21.15.78:0/318502240 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1a1360270 0x55f1a1731fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.319+0000 7fd9e0bce740 1 -- 172.21.15.78:0/318502240 >> 172.21.15.78:0/318502240 conn(0x55f1a13543c0 msgr2=0x55f1a1708260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:41.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.319+0000 7fd9e0bce740 1 -- 172.21.15.78:0/318502240 shutdown_connections 2024-09-17T03:10:41.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.319+0000 7fd9e0bce740 1 -- 172.21.15.78:0/318502240 wait complete. 2024-09-17T03:10:41.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.320+0000 7fd9e0bce740 1 -- start start 2024-09-17T03:10:41.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.320+0000 7fd9e0bce740 1 Processor -- start 2024-09-17T03:10:41.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.321+0000 7fd9e0bce740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1a13373b0 0x55f1a17594c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.321+0000 7fd9e0bce740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1a133f590 0x55f1a175c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.321+0000 7fd9e0bce740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a1360270 0x55f1a175c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.321+0000 7fd9e0bce740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f1a13da620 con 0x55f1a1360270 2024-09-17T03:10:41.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.321+0000 7fd9e0bce740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f1a160f5f0 con 0x55f1a13373b0 2024-09-17T03:10:41.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.321+0000 7fd9e0bce740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f1a1732a20 con 0x55f1a133f590 2024-09-17T03:10:41.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.321+0000 7fd9e0bce740 10 client.0 _ll_register_callbacks cb 0x55f1a16130a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:10:41.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.321+0000 7fd9d3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a1360270 0x55f1a175c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.321+0000 7fd9d3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a1360270 0x55f1a175c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41118/0 (socket says 172.21.15.78:41118) 2024-09-17T03:10:41.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.321+0000 7fd9d3fff640 1 -- 172.21.15.78:0/4073804812 learned_addr learned my addr 172.21.15.78:0/4073804812 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:41.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.321+0000 7fd9d37fe640 1 --2- 172.21.15.78:0/4073804812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1a13373b0 0x55f1a17594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.321+0000 7fd9d2ffd640 1 --2- 172.21.15.78:0/4073804812 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1a133f590 0x55f1a175c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9d3fff640 1 -- 172.21.15.78:0/4073804812 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1a133f590 msgr2=0x55f1a175c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:41.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9d3fff640 1 --2- 172.21.15.78:0/4073804812 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1a133f590 0x55f1a175c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9d3fff640 1 -- 172.21.15.78:0/4073804812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1a13373b0 msgr2=0x55f1a17594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:41.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9d3fff640 1 --2- 172.21.15.78:0/4073804812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1a13373b0 0x55f1a17594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9d3fff640 1 -- 172.21.15.78:0/4073804812 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1a14426b0 con 0x55f1a1360270 2024-09-17T03:10:41.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9d3fff640 1 --2- 172.21.15.78:0/4073804812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a1360270 0x55f1a175c9a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc017000 tx=0x7fd9cc011670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4e49d5ca6c5418 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:41.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9b27fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:10:41.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9b27fc640 1 -- 172.21.15.78:0/4073804812 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc011bf0 con 0x55f1a1360270 2024-09-17T03:10:41.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9b27fc640 1 -- 172.21.15.78:0/4073804812 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fd9cc011d90 con 0x55f1a1360270 2024-09-17T03:10:41.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9e0bce740 1 -- 172.21.15.78:0/4073804812 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9cc004b20 con 0x55f1a1360270 2024-09-17T03:10:41.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9b27fc640 1 -- 172.21.15.78:0/4073804812 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd9cc031050 con 0x55f1a1360270 2024-09-17T03:10:41.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9e0bce740 10 client.5745 fetch_fsmap learned FSMap version 34 2024-09-17T03:10:41.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9e0bce740 1 -- 172.21.15.78:0/4073804812 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x55f1a175d630 con 0x55f1a1360270 2024-09-17T03:10:41.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9b27fc640 1 -- 172.21.15.78:0/4073804812 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9cc004b20 con 0x55f1a1360270 2024-09-17T03:10:41.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9b27fc640 1 -- 172.21.15.78:0/4073804812 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 34) ==== 3542+0+0 (secure 0 0 0) 0x7fd9cc034020 con 0x55f1a1360270 2024-09-17T03:10:41.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9e0bce740 10 client.5745 fetch_fsmap finished waiting for FSMap version 34 2024-09-17T03:10:41.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9e0bce740 10 client.5745 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:10:41.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9e0bce740 20 client.5745 populate_metadata read hostname 'smithi078' 2024-09-17T03:10:41.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9e0bce740 1 --2- 172.21.15.78:0/4073804812 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x55f1a131ee40 0x55f1a1745810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9e0bce740 4 client.5745 mds_command: new command op to 5036 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:10:41.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.322+0000 7fd9e0bce740 1 -- 172.21.15.78:0/4073804812 --> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1a167c770 con 0x55f1a131ee40 2024-09-17T03:10:41.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.323+0000 7fd9d37fe640 1 --2- 172.21.15.78:0/4073804812 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x55f1a131ee40 0x55f1a1745810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.323+0000 7fd9b27fc640 10 client.5745 ms_handle_connect on v2:172.21.15.78:6832/3629327943 2024-09-17T03:10:41.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.323+0000 7fd9d37fe640 1 --2- 172.21.15.78:0/4073804812 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x55f1a131ee40 0x55f1a1745810 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fe6a2fd3e12f2662 server_cookie=36b0f8f05e8bc26b in_seq=0 out_seq=0 2024-09-17T03:10:41.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.323+0000 7fd9b27fc640 1 -- 172.21.15.78:0/4073804812 <== mds.2 v2:172.21.15.78:6832/3629327943 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f1a167c770 con 0x55f1a131ee40 2024-09-17T03:10:41.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.323+0000 7fd9b27fc640 10 client.5745 handle_command_reply: tid=0 2024-09-17T03:10:41.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.323+0000 7fd9e0bce740 1 client.5745 shutdown 2024-09-17T03:10:41.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.324+0000 7fd9e0bce740 1 -- 172.21.15.78:0/4073804812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a1360270 msgr2=0x55f1a175c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:41.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.324+0000 7fd9e0bce740 1 --2- 172.21.15.78:0/4073804812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a1360270 0x55f1a175c9a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc017000 tx=0x7fd9cc011670 comp rx=0 tx=0).stop 2024-09-17T03:10:41.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.324+0000 7fd9e0bce740 1 -- 172.21.15.78:0/4073804812 shutdown_connections 2024-09-17T03:10:41.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.324+0000 7fd9e0bce740 1 --2- 172.21.15.78:0/4073804812 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x55f1a131ee40 0x55f1a1745810 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.324+0000 7fd9e0bce740 1 --2- 172.21.15.78:0/4073804812 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a1360270 0x55f1a175c9a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.324+0000 7fd9b27fc640 0 client.5745 ms_handle_reset on v2:172.21.15.78:6832/3629327943 2024-09-17T03:10:41.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.324+0000 7fd9e0bce740 1 --2- 172.21.15.78:0/4073804812 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1a133f590 0x55f1a175c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.324+0000 7fd9e0bce740 1 --2- 172.21.15.78:0/4073804812 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1a13373b0 0x55f1a17594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.324+0000 7fd9e0bce740 1 -- 172.21.15.78:0/4073804812 >> 172.21.15.78:0/4073804812 conn(0x55f1a13543c0 msgr2=0x55f1a174f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:41.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.324+0000 7fd9e0bce740 1 -- 172.21.15.78:0/4073804812 shutdown_connections 2024-09-17T03:10:41.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.324+0000 7fd9e0bce740 1 -- 172.21.15.78:0/4073804812 wait complete. 2024-09-17T03:10:41.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.324+0000 7fd9e0bce740 20 client.5745 trim_cache size 0 max 16384 2024-09-17T03:10:41.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.342+0000 7fd9e0bce740 1 Processor -- start 2024-09-17T03:10:41.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.342+0000 7fd9e0bce740 1 -- start start 2024-09-17T03:10:41.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.343+0000 7fd9e0bce740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1a13373b0 0x55f1a1749380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.343+0000 7fd9e0bce740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1a133f590 0x55f1a175c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.343+0000 7fd9e0bce740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a1360270 0x55f1a175da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.343+0000 7fd9e0bce740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d41fa5c0 con 0x55f1a1360270 2024-09-17T03:10:41.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.343+0000 7fd9e0bce740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d4202010 con 0x55f1a133f590 2024-09-17T03:10:41.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.343+0000 7fd9e0bce740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd9d415ef80 con 0x55f1a13373b0 2024-09-17T03:10:41.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.343+0000 7fd9d3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a1360270 0x55f1a175da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.343+0000 7fd9d3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a1360270 0x55f1a175da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41130/0 (socket says 172.21.15.78:41130) 2024-09-17T03:10:41.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.343+0000 7fd9d3fff640 1 -- 172.21.15.78:0/470896393 learned_addr learned my addr 172.21.15.78:0/470896393 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:41.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.344+0000 7fd9d3fff640 1 -- 172.21.15.78:0/470896393 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1a13373b0 msgr2=0x55f1a1749380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:41.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.344+0000 7fd9d3fff640 1 --2- 172.21.15.78:0/470896393 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1a13373b0 0x55f1a1749380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.344+0000 7fd9d3fff640 1 -- 172.21.15.78:0/470896393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1a133f590 msgr2=0x55f1a175c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:41.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.344+0000 7fd9d3fff640 1 --2- 172.21.15.78:0/470896393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1a133f590 0x55f1a175c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.344+0000 7fd9d3fff640 1 -- 172.21.15.78:0/470896393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1a1628aa0 con 0x55f1a1360270 2024-09-17T03:10:41.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.344+0000 7fd9d3fff640 1 --2- 172.21.15.78:0/470896393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a1360270 0x55f1a175da80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc011be0 tx=0x7fd9cc011c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce72c240e696ce0b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:41.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.344+0000 7fd9b8ff9640 1 -- 172.21.15.78:0/470896393 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc03b070 con 0x55f1a1360270 2024-09-17T03:10:41.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.344+0000 7fd9b8ff9640 1 -- 172.21.15.78:0/470896393 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9cc01e030 con 0x55f1a1360270 2024-09-17T03:10:41.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.344+0000 7fd9b8ff9640 1 -- 172.21.15.78:0/470896393 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc010b30 con 0x55f1a1360270 2024-09-17T03:10:41.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.345+0000 7fd9e0bce740 1 -- 172.21.15.78:0/470896393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a1360270 msgr2=0x55f1a175da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:41.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.345+0000 7fd9e0bce740 1 --2- 172.21.15.78:0/470896393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a1360270 0x55f1a175da80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc011be0 tx=0x7fd9cc011c10 comp rx=0 tx=0).stop 2024-09-17T03:10:41.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.345+0000 7fd9e0bce740 1 -- 172.21.15.78:0/470896393 shutdown_connections 2024-09-17T03:10:41.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.345+0000 7fd9e0bce740 1 --2- 172.21.15.78:0/470896393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a1360270 0x55f1a175da80 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.345+0000 7fd9e0bce740 1 --2- 172.21.15.78:0/470896393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1a133f590 0x55f1a175c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.345+0000 7fd9e0bce740 1 --2- 172.21.15.78:0/470896393 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1a13373b0 0x55f1a1749380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.345+0000 7fd9e0bce740 1 -- 172.21.15.78:0/470896393 >> 172.21.15.78:0/470896393 conn(0x55f1a13543c0 msgr2=0x55f1a1709180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:41.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.345+0000 7fd9e0bce740 1 -- 172.21.15.78:0/470896393 shutdown_connections 2024-09-17T03:10:41.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.345+0000 7fd9e0bce740 1 -- 172.21.15.78:0/470896393 wait complete. 2024-09-17T03:10:41.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.346+0000 7fd9e0bce740 1 -- start start 2024-09-17T03:10:41.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.346+0000 7fd9e0bce740 1 Processor -- start 2024-09-17T03:10:41.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.347+0000 7fd9e0bce740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a13373b0 0x55f1a17c6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.347+0000 7fd9e0bce740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1a133f590 0x55f1a17668f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.347+0000 7fd9e0bce740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1a1360270 0x55f1a1766e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.347+0000 7fd9e0bce740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f1a175fdb0 con 0x55f1a13373b0 2024-09-17T03:10:41.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.347+0000 7fd9e0bce740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f1a175f8c0 con 0x55f1a133f590 2024-09-17T03:10:41.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.347+0000 7fd9e0bce740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f1a175ea90 con 0x55f1a1360270 2024-09-17T03:10:41.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.347+0000 7fd9e0bce740 10 client.0 _ll_register_callbacks cb 0x7fd9c80065d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:10:41.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.347+0000 7fd9d37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a13373b0 0x55f1a17c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.347+0000 7fd9d37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a13373b0 0x55f1a17c6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41146/0 (socket says 172.21.15.78:41146) 2024-09-17T03:10:41.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.347+0000 7fd9d37fe640 1 -- 172.21.15.78:0/3192079887 learned_addr learned my addr 172.21.15.78:0/3192079887 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:41.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.347+0000 7fd9d37fe640 1 -- 172.21.15.78:0/3192079887 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1a1360270 msgr2=0x55f1a1766e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:41.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.347+0000 7fd9d37fe640 1 --2- 172.21.15.78:0/3192079887 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1a1360270 0x55f1a1766e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.347+0000 7fd9d37fe640 1 -- 172.21.15.78:0/3192079887 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1a133f590 msgr2=0x55f1a17668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:41.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.347+0000 7fd9d2ffd640 1 --2- 172.21.15.78:0/3192079887 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1a133f590 0x55f1a17668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.347+0000 7fd9d37fe640 1 --2- 172.21.15.78:0/3192079887 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1a133f590 0x55f1a17668f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.348+0000 7fd9d37fe640 1 -- 172.21.15.78:0/3192079887 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1a1771a90 con 0x55f1a13373b0 2024-09-17T03:10:41.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.348+0000 7fd9d37fe640 1 --2- 172.21.15.78:0/3192079887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a13373b0 0x55f1a17c6930 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4000f60 tx=0x7fd9c4001c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5082733606ab48ca server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:41.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.348+0000 7fd9b27fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:10:41.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.348+0000 7fd9b27fc640 1 -- 172.21.15.78:0/3192079887 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c40a1030 con 0x55f1a13373b0 2024-09-17T03:10:41.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.348+0000 7fd9b27fc640 1 -- 172.21.15.78:0/3192079887 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fd9c407fa60 con 0x55f1a13373b0 2024-09-17T03:10:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.348+0000 7fd9e0bce740 1 -- 172.21.15.78:0/3192079887 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9cc01e030 con 0x55f1a13373b0 2024-09-17T03:10:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.348+0000 7fd9b27fc640 1 -- 172.21.15.78:0/3192079887 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd9c4083ef0 con 0x55f1a13373b0 2024-09-17T03:10:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.348+0000 7fd9e0bce740 10 client.5751 fetch_fsmap learned FSMap version 34 2024-09-17T03:10:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.348+0000 7fd9e0bce740 1 -- 172.21.15.78:0/3192079887 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x55f1a1746440 con 0x55f1a13373b0 2024-09-17T03:10:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.348+0000 7fd9b27fc640 1 -- 172.21.15.78:0/3192079887 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9cc01e030 con 0x55f1a13373b0 2024-09-17T03:10:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.348+0000 7fd9b27fc640 1 -- 172.21.15.78:0/3192079887 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 34) ==== 3542+0+0 (secure 0 0 0) 0x7fd9c4083a50 con 0x55f1a13373b0 2024-09-17T03:10:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.348+0000 7fd9e0bce740 10 client.5751 fetch_fsmap finished waiting for FSMap version 34 2024-09-17T03:10:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.348+0000 7fd9e0bce740 10 client.5751 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:10:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.348+0000 7fd9e0bce740 20 client.5751 populate_metadata read hostname 'smithi078' 2024-09-17T03:10:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.348+0000 7fd9e0bce740 1 --2- 172.21.15.78:0/3192079887 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x55f1a1770640 0x55f1a1749cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.348+0000 7fd9e0bce740 4 client.5751 mds_command: new command op to 5036 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:10:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.348+0000 7fd9e0bce740 1 -- 172.21.15.78:0/3192079887 --> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] -- command(tid 0: {"prefix": "status"}) -- 0x55f1a1678220 con 0x55f1a1770640 2024-09-17T03:10:41.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.348+0000 7fd9d2ffd640 1 --2- 172.21.15.78:0/3192079887 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x55f1a1770640 0x55f1a1749cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.349+0000 7fd9b27fc640 10 client.5751 ms_handle_connect on v2:172.21.15.78:6832/3629327943 2024-09-17T03:10:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.349+0000 7fd9d2ffd640 1 --2- 172.21.15.78:0/3192079887 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x55f1a1770640 0x55f1a1749cf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=386f77405a3f3755 server_cookie=713afc45ea267aa0 in_seq=0 out_seq=0 2024-09-17T03:10:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.349+0000 7fd9b27fc640 1 -- 172.21.15.78:0/3192079887 <== mds.2 v2:172.21.15.78:6832/3629327943 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55f1a1678220 con 0x55f1a1770640 2024-09-17T03:10:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.349+0000 7fd9b27fc640 10 client.5751 handle_command_reply: tid=0 2024-09-17T03:10:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.349+0000 7fd9e0bce740 1 client.5751 shutdown 2024-09-17T03:10:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.349+0000 7fd9e0bce740 1 -- 172.21.15.78:0/3192079887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a13373b0 msgr2=0x55f1a17c6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.349+0000 7fd9e0bce740 1 --2- 172.21.15.78:0/3192079887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a13373b0 0x55f1a17c6930 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4000f60 tx=0x7fd9c4001c00 comp rx=0 tx=0).stop 2024-09-17T03:10:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.349+0000 7fd9e0bce740 1 -- 172.21.15.78:0/3192079887 shutdown_connections 2024-09-17T03:10:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.349+0000 7fd9e0bce740 1 --2- 172.21.15.78:0/3192079887 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x55f1a1770640 0x55f1a1749cf0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.349+0000 7fd9e0bce740 1 --2- 172.21.15.78:0/3192079887 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1a1360270 0x55f1a1766e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.349+0000 7fd9e0bce740 1 --2- 172.21.15.78:0/3192079887 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1a133f590 0x55f1a17668f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.349+0000 7fd9b27fc640 0 client.5751 ms_handle_reset on v2:172.21.15.78:6832/3629327943 2024-09-17T03:10:41.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.349+0000 7fd9e0bce740 1 --2- 172.21.15.78:0/3192079887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1a13373b0 0x55f1a17c6930 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.349+0000 7fd9e0bce740 1 -- 172.21.15.78:0/3192079887 >> 172.21.15.78:0/3192079887 conn(0x55f1a13543c0 msgr2=0x55f1a175c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:41.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.349+0000 7fd9e0bce740 1 -- 172.21.15.78:0/3192079887 shutdown_connections 2024-09-17T03:10:41.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.349+0000 7fd9e0bce740 1 -- 172.21.15.78:0/3192079887 wait complete. 2024-09-17T03:10:41.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.349+0000 7fd9e0bce740 20 client.5751 trim_cache size 0 max 16384 2024-09-17T03:10:41.354 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:10:41.354 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:10:41.354 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 2, 2024-09-17T03:10:41.354 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 5036, 2024-09-17T03:10:41.354 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:10:41.354 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:10:41.355 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:10:41.355 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 1.6676404359999999, 2024-09-17T03:10:41.355 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 34, 2024-09-17T03:10:41.355 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 45, 2024-09-17T03:10:41.355 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 45, 2024-09-17T03:10:41.355 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 19.438146562 2024-09-17T03:10:41.355 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:10:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.350+0000 7fd9d9c64640 1 -- 172.21.15.78:0/336846989 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd9c0078b90 msgr2=0x7fd9c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.350+0000 7fd9d9c64640 1 --2- 172.21.15.78:0/336846989 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd9c0078b90 0x7fd9c007b0a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd9d41fa910 tx=0x7fd9c8006c60 comp rx=0 tx=0).stop 2024-09-17T03:10:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.350+0000 7fd9d9c64640 1 -- 172.21.15.78:0/336846989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9bc003c60 msgr2=0x7fd9d40b10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.350+0000 7fd9d9c64640 1 --2- 172.21.15.78:0/336846989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9bc003c60 0x7fd9d40b10a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd9c402a660 tx=0x7fd9c40017c0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.350+0000 7fd9d9c64640 1 -- 172.21.15.78:0/336846989 shutdown_connections 2024-09-17T03:10:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.350+0000 7fd9d9c64640 1 --2- 172.21.15.78:0/336846989 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd9d40cbf50 0x7fd9d40cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.350+0000 7fd9d9c64640 1 --2- 172.21.15.78:0/336846989 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd9c0078b90 0x7fd9c007b0a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.350+0000 7fd9d9c64640 1 --2- 172.21.15.78:0/336846989 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9d40ca080 0x7fd9d41f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.350+0000 7fd9d9c64640 1 --2- 172.21.15.78:0/336846989 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9bc003c60 0x7fd9d40b10a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.350+0000 7fd9d9c64640 1 -- 172.21.15.78:0/336846989 >> 172.21.15.78:0/336846989 conn(0x7fd9d406d4f0 msgr2=0x7fd9d4159890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:41.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.350+0000 7fd9d9c64640 1 -- 172.21.15.78:0/336846989 shutdown_connections 2024-09-17T03:10:41.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.350+0000 7fd9d9c64640 1 -- 172.21.15.78:0/336846989 wait complete. 2024-09-17T03:10:41.360 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T03:10:41.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.473+0000 7f0f5625c640 1 -- 172.21.15.78:0/2578394504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f500d1d40 msgr2=0x7f0f500b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:41.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.473+0000 7f0f5625c640 1 --2- 172.21.15.78:0/2578394504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f500d1d40 0x7f0f500b5210 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0f40009830 tx=0x7f0f4002a510 comp rx=0 tx=0).stop 2024-09-17T03:10:41.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.473+0000 7f0f5625c640 1 -- 172.21.15.78:0/2578394504 shutdown_connections 2024-09-17T03:10:41.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.473+0000 7f0f5625c640 1 --2- 172.21.15.78:0/2578394504 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f5015c6f0 0x7f0f500ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.473+0000 7f0f5625c640 1 --2- 172.21.15.78:0/2578394504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f500d1d40 0x7f0f500b5210 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.473+0000 7f0f5625c640 1 -- 172.21.15.78:0/2578394504 >> 172.21.15.78:0/2578394504 conn(0x7f0f500b3f10 msgr2=0x7f0f500b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:41.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.473+0000 7f0f5625c640 1 -- 172.21.15.78:0/2578394504 shutdown_connections 2024-09-17T03:10:41.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.473+0000 7f0f5625c640 1 -- 172.21.15.78:0/2578394504 wait complete. 2024-09-17T03:10:41.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.475+0000 7f0f5625c640 1 Processor -- start 2024-09-17T03:10:41.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.475+0000 7f0f5625c640 1 -- start start 2024-09-17T03:10:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.477+0000 7f0f5625c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f500ccba0 0x7f0f501f3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.477+0000 7f0f5625c640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f500d1d40 0x7f0f501f04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.477+0000 7f0f5625c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f5015c6f0 0x7f0f5015efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.477+0000 7f0f5625c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0f500d12d0 con 0x7f0f5015c6f0 2024-09-17T03:10:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.477+0000 7f0f5625c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0f500d1150 con 0x7f0f500ccba0 2024-09-17T03:10:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.477+0000 7f0f5625c640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0f500d1450 con 0x7f0f500d1d40 2024-09-17T03:10:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.477+0000 7f0f4ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f5015c6f0 0x7f0f5015efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.477+0000 7f0f4ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f5015c6f0 0x7f0f5015efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41160/0 (socket says 172.21.15.78:41160) 2024-09-17T03:10:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.477+0000 7f0f4ffff640 1 -- 172.21.15.78:0/1399269495 learned_addr learned my addr 172.21.15.78:0/1399269495 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.477+0000 7f0f4f7fe640 1 --2- 172.21.15.78:0/1399269495 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f500ccba0 0x7f0f501f3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.477+0000 7f0f4effd640 1 --2- 172.21.15.78:0/1399269495 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f500d1d40 0x7f0f501f04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.477+0000 7f0f4ffff640 1 -- 172.21.15.78:0/1399269495 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f500d1d40 msgr2=0x7f0f501f04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:41.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.477+0000 7f0f4ffff640 1 --2- 172.21.15.78:0/1399269495 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f500d1d40 0x7f0f501f04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.477+0000 7f0f4ffff640 1 -- 172.21.15.78:0/1399269495 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f500ccba0 msgr2=0x7f0f501f3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:41.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.477+0000 7f0f4ffff640 1 --2- 172.21.15.78:0/1399269495 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f500ccba0 0x7f0f501f3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.477+0000 7f0f4ffff640 1 -- 172.21.15.78:0/1399269495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f501f4030 con 0x7f0f5015c6f0 2024-09-17T03:10:41.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.477+0000 7f0f4ffff640 1 --2- 172.21.15.78:0/1399269495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f5015c6f0 0x7f0f5015efd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0f4800cb10 tx=0x7f0f4800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:41.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.477+0000 7f0f37fff640 1 -- 172.21.15.78:0/1399269495 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f48016020 con 0x7f0f5015c6f0 2024-09-17T03:10:41.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.477+0000 7f0f37fff640 1 -- 172.21.15.78:0/1399269495 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f4800ad60 con 0x7f0f5015c6f0 2024-09-17T03:10:41.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.478+0000 7f0f5625c640 1 -- 172.21.15.78:0/1399269495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f500a97d0 con 0x7f0f5015c6f0 2024-09-17T03:10:41.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.478+0000 7f0f37fff640 1 -- 172.21.15.78:0/1399269495 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f48012680 con 0x7f0f5015c6f0 2024-09-17T03:10:41.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.478+0000 7f0f5625c640 1 -- 172.21.15.78:0/1399269495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f500a9d90 con 0x7f0f5015c6f0 2024-09-17T03:10:41.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.479+0000 7f0f37fff640 1 -- 172.21.15.78:0/1399269495 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0f48019020 con 0x7f0f5015c6f0 2024-09-17T03:10:41.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.480+0000 7f0f37fff640 1 --2- 172.21.15.78:0/1399269495 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0f3c078b90 0x7f0f3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.480+0000 7f0f37fff640 1 -- 172.21.15.78:0/1399269495 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f0f4809b240 con 0x7f0f5015c6f0 2024-09-17T03:10:41.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.480+0000 7f0f4f7fe640 1 --2- 172.21.15.78:0/1399269495 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0f3c078b90 0x7f0f3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.481+0000 7f0f5d1ca740 1 Processor -- start 2024-09-17T03:10:41.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.481+0000 7f0f4f7fe640 1 --2- 172.21.15.78:0/1399269495 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0f3c078b90 0x7f0f3c07b0a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0f40034000 tx=0x7f0f40004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:41.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.481+0000 7f0f5d1ca740 1 -- start start 2024-09-17T03:10:41.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.482+0000 7f0f5d1ca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af399f270 0x558af3d70fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.482+0000 7f0f5d1ca740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af39763b0 0x558af3d71500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.482+0000 7f0f5d1ca740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558af397e590 0x558af3d8e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.482+0000 7f0f5d1ca740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x558af3cb9820 con 0x558af39763b0 2024-09-17T03:10:41.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.482+0000 7f0f5d1ca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558af3ca8c50 con 0x558af399f270 2024-09-17T03:10:41.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.482+0000 7f0f5d1ca740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x558af3caca60 con 0x558af397e590 2024-09-17T03:10:41.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.482+0000 7f0f4effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af39763b0 0x558af3d71500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.482+0000 7f0f4effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af39763b0 0x558af3d71500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41168/0 (socket says 172.21.15.78:41168) 2024-09-17T03:10:41.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.482+0000 7f0f4effd640 1 -- 172.21.15.78:0/1639657678 learned_addr learned my addr 172.21.15.78:0/1639657678 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:41.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.482+0000 7f0f4f7fe640 1 --2- 172.21.15.78:0/1639657678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af399f270 0x558af3d70fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.482+0000 7f0f4ffff640 1 --2- 172.21.15.78:0/1639657678 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558af397e590 0x558af3d8e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.483+0000 7f0f4effd640 1 -- 172.21.15.78:0/1639657678 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558af397e590 msgr2=0x558af3d8e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:41.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.483+0000 7f0f4effd640 1 --2- 172.21.15.78:0/1639657678 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558af397e590 0x558af3d8e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.483+0000 7f0f4effd640 1 -- 172.21.15.78:0/1639657678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af399f270 msgr2=0x558af3d70fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:41.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.483+0000 7f0f4effd640 1 --2- 172.21.15.78:0/1639657678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af399f270 0x558af3d70fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.483+0000 7f0f4effd640 1 -- 172.21.15.78:0/1639657678 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af3a0a850 con 0x558af39763b0 2024-09-17T03:10:41.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.483+0000 7f0f4f7fe640 1 --2- 172.21.15.78:0/1639657678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af399f270 0x558af3d70fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:10:41.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.483+0000 7f0f4effd640 1 --2- 172.21.15.78:0/1639657678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af39763b0 0x558af3d71500 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009bc0 tx=0x7f0f44011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a603b5d3e4f89c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:41.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.483+0000 7f0f357fa640 1 -- 172.21.15.78:0/1639657678 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44004230 con 0x558af39763b0 2024-09-17T03:10:41.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.483+0000 7f0f357fa640 1 -- 172.21.15.78:0/1639657678 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f440043d0 con 0x558af39763b0 2024-09-17T03:10:41.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.483+0000 7f0f357fa640 1 -- 172.21.15.78:0/1639657678 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44005280 con 0x558af39763b0 2024-09-17T03:10:41.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.484+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/1639657678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af39763b0 msgr2=0x558af3d71500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:41.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.484+0000 7f0f5d1ca740 1 --2- 172.21.15.78:0/1639657678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af39763b0 0x558af3d71500 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0f44009bc0 tx=0x7f0f44011810 comp rx=0 tx=0).stop 2024-09-17T03:10:41.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.484+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/1639657678 shutdown_connections 2024-09-17T03:10:41.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.484+0000 7f0f5d1ca740 1 --2- 172.21.15.78:0/1639657678 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558af397e590 0x558af3d8e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.484+0000 7f0f5d1ca740 1 --2- 172.21.15.78:0/1639657678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af39763b0 0x558af3d71500 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.484+0000 7f0f5d1ca740 1 --2- 172.21.15.78:0/1639657678 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af399f270 0x558af3d70fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.484+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/1639657678 >> 172.21.15.78:0/1639657678 conn(0x558af39933c0 msgr2=0x558af3d47280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:41.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.484+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/1639657678 shutdown_connections 2024-09-17T03:10:41.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.484+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/1639657678 wait complete. 2024-09-17T03:10:41.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.485+0000 7f0f5d1ca740 1 -- start start 2024-09-17T03:10:41.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.485+0000 7f0f5d1ca740 1 Processor -- start 2024-09-17T03:10:41.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.486+0000 7f0f5d1ca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af39763b0 0x558af3d84920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.486+0000 7f0f5d1ca740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558af397e590 0x558af3d5ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.486+0000 7f0f5d1ca740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af399f270 0x558af3d9d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.486+0000 7f0f5d1ca740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x558af3a19620 con 0x558af399f270 2024-09-17T03:10:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.486+0000 7f0f5d1ca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558af3c4e5f0 con 0x558af39763b0 2024-09-17T03:10:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.486+0000 7f0f5d1ca740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x558af3d71a40 con 0x558af397e590 2024-09-17T03:10:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.486+0000 7f0f5d1ca740 10 client.0 _ll_register_callbacks cb 0x558af3c520a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:10:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.486+0000 7f0f4ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af399f270 0x558af3d9d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.486+0000 7f0f4ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af399f270 0x558af3d9d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41178/0 (socket says 172.21.15.78:41178) 2024-09-17T03:10:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.486+0000 7f0f4ffff640 1 -- 172.21.15.78:0/1162042305 learned_addr learned my addr 172.21.15.78:0/1162042305 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.486+0000 7f0f4f7fe640 1 --2- 172.21.15.78:0/1162042305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af39763b0 0x558af3d84920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.486+0000 7f0f4effd640 1 --2- 172.21.15.78:0/1162042305 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558af397e590 0x558af3d5ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.486+0000 7f0f4ffff640 1 -- 172.21.15.78:0/1162042305 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558af397e590 msgr2=0x558af3d5ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.486+0000 7f0f4ffff640 1 --2- 172.21.15.78:0/1162042305 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558af397e590 0x558af3d5ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.486+0000 7f0f4ffff640 1 -- 172.21.15.78:0/1162042305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af39763b0 msgr2=0x558af3d84920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:41.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.486+0000 7f0f4ffff640 1 --2- 172.21.15.78:0/1162042305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af39763b0 0x558af3d84920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.487+0000 7f0f4ffff640 1 -- 172.21.15.78:0/1162042305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558af3a816b0 con 0x558af399f270 2024-09-17T03:10:41.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.487+0000 7f0f4effd640 1 --2- 172.21.15.78:0/1162042305 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558af397e590 0x558af3d5ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:41.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.487+0000 7f0f4ffff640 1 --2- 172.21.15.78:0/1162042305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af399f270 0x558af3d9d950 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0f48001cd0 tx=0x7f0f48062850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5bfafb900583447 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:41.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.487+0000 7f0f2e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:10:41.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.487+0000 7f0f2e7fc640 1 -- 172.21.15.78:0/1162042305 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f480679e0 con 0x558af399f270 2024-09-17T03:10:41.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.487+0000 7f0f2e7fc640 1 -- 172.21.15.78:0/1162042305 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f0f48089120 con 0x558af399f270 2024-09-17T03:10:41.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.487+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/1162042305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f440043d0 con 0x558af399f270 2024-09-17T03:10:41.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.487+0000 7f0f2e7fc640 1 -- 172.21.15.78:0/1162042305 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0f4806c920 con 0x558af399f270 2024-09-17T03:10:41.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.487+0000 7f0f5d1ca740 10 client.5760 fetch_fsmap learned FSMap version 34 2024-09-17T03:10:41.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.487+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/1162042305 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x558af3d9c230 con 0x558af399f270 2024-09-17T03:10:41.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.487+0000 7f0f2e7fc640 1 -- 172.21.15.78:0/1162042305 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f440043d0 con 0x558af399f270 2024-09-17T03:10:41.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.487+0000 7f0f2e7fc640 1 -- 172.21.15.78:0/1162042305 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 34) ==== 3542+0+0 (secure 0 0 0) 0x7f0f48062210 con 0x558af399f270 2024-09-17T03:10:41.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.487+0000 7f0f5d1ca740 10 client.5760 fetch_fsmap finished waiting for FSMap version 34 2024-09-17T03:10:41.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.487+0000 7f0f5d1ca740 10 client.5760 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:10:41.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.487+0000 7f0f5d1ca740 20 client.5760 populate_metadata read hostname 'smithi078' 2024-09-17T03:10:41.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.487+0000 7f0f5d1ca740 1 --2- 172.21.15.78:0/1162042305 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x558af395de40 0x558af3d9e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.487+0000 7f0f5d1ca740 4 client.5760 mds_command: new command op to 5039 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:10:41.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.487+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/1162042305 --> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558af3cbb770 con 0x558af395de40 2024-09-17T03:10:41.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.488+0000 7f0f4f7fe640 1 --2- 172.21.15.78:0/1162042305 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x558af395de40 0x558af3d9e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.488+0000 7f0f2e7fc640 10 client.5760 ms_handle_connect on v2:172.21.15.193:6835/3209848332 2024-09-17T03:10:41.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.488+0000 7f0f4f7fe640 1 --2- 172.21.15.78:0/1162042305 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x558af395de40 0x558af3d9e550 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6680675fd605717d server_cookie=331bbf1ff8d356f9 in_seq=0 out_seq=0 2024-09-17T03:10:41.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.489+0000 7f0f2e7fc640 1 -- 172.21.15.78:0/1162042305 <== mds.1 v2:172.21.15.193:6835/3209848332 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558af3cbb770 con 0x558af395de40 2024-09-17T03:10:41.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.489+0000 7f0f2e7fc640 10 client.5760 handle_command_reply: tid=0 2024-09-17T03:10:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.489+0000 7f0f5d1ca740 1 client.5760 shutdown 2024-09-17T03:10:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.489+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/1162042305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af399f270 msgr2=0x558af3d9d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.489+0000 7f0f5d1ca740 1 --2- 172.21.15.78:0/1162042305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af399f270 0x558af3d9d950 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0f48001cd0 tx=0x7f0f48062850 comp rx=0 tx=0).stop 2024-09-17T03:10:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.489+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/1162042305 shutdown_connections 2024-09-17T03:10:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.489+0000 7f0f5d1ca740 1 --2- 172.21.15.78:0/1162042305 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x558af395de40 0x558af3d9e550 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.489+0000 7f0f5d1ca740 1 --2- 172.21.15.78:0/1162042305 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af399f270 0x558af3d9d950 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.489+0000 7f0f2e7fc640 0 client.5760 ms_handle_reset on v2:172.21.15.193:6835/3209848332 2024-09-17T03:10:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.489+0000 7f0f5d1ca740 1 --2- 172.21.15.78:0/1162042305 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558af397e590 0x558af3d5ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.489+0000 7f0f5d1ca740 1 --2- 172.21.15.78:0/1162042305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af39763b0 0x558af3d84920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.489+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/1162042305 >> 172.21.15.78:0/1162042305 conn(0x558af39933c0 msgr2=0x558af3d47130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.489+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/1162042305 shutdown_connections 2024-09-17T03:10:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.489+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/1162042305 wait complete. 2024-09-17T03:10:41.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.489+0000 7f0f5d1ca740 20 client.5760 trim_cache size 0 max 16384 2024-09-17T03:10:41.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.507+0000 7f0f5d1ca740 1 Processor -- start 2024-09-17T03:10:41.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.507+0000 7f0f5d1ca740 1 -- start start 2024-09-17T03:10:41.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.509+0000 7f0f5d1ca740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af39763b0 0x558af3d47300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.509+0000 7f0f5d1ca740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558af397e590 0x558af3daed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.509+0000 7f0f5d1ca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af399f270 0x558af3daf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.509+0000 7f0f5d1ca740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0f501ff0e0 con 0x558af39763b0 2024-09-17T03:10:41.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.509+0000 7f0f5d1ca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0f501ff7b0 con 0x558af399f270 2024-09-17T03:10:41.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.509+0000 7f0f5d1ca740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0f500afe90 con 0x558af397e590 2024-09-17T03:10:41.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.509+0000 7f0f4f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af39763b0 0x558af3d47300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.509+0000 7f0f4f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af39763b0 0x558af3d47300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41182/0 (socket says 172.21.15.78:41182) 2024-09-17T03:10:41.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.509+0000 7f0f4f7fe640 1 -- 172.21.15.78:0/1541315263 learned_addr learned my addr 172.21.15.78:0/1541315263 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:41.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.509+0000 7f0f4f7fe640 1 -- 172.21.15.78:0/1541315263 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558af397e590 msgr2=0x558af3daed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:41.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.509+0000 7f0f4f7fe640 1 --2- 172.21.15.78:0/1541315263 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558af397e590 0x558af3daed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.509+0000 7f0f4f7fe640 1 -- 172.21.15.78:0/1541315263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af399f270 msgr2=0x558af3daf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:41.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.509+0000 7f0f4f7fe640 1 --2- 172.21.15.78:0/1541315263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af399f270 0x558af3daf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.509+0000 7f0f4f7fe640 1 -- 172.21.15.78:0/1541315263 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558af3d88820 con 0x558af39763b0 2024-09-17T03:10:41.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.509+0000 7f0f4f7fe640 1 --2- 172.21.15.78:0/1541315263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af39763b0 0x558af3d47300 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0f400044c0 tx=0x7f0f4003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a717cc5ffa78ec56 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:41.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.509+0000 7f0f34ff9640 1 -- 172.21.15.78:0/1541315263 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40003b30 con 0x558af39763b0 2024-09-17T03:10:41.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.509+0000 7f0f34ff9640 1 -- 172.21.15.78:0/1541315263 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f40003cd0 con 0x558af39763b0 2024-09-17T03:10:41.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.509+0000 7f0f34ff9640 1 -- 172.21.15.78:0/1541315263 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f400466b0 con 0x558af39763b0 2024-09-17T03:10:41.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.510+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/1541315263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af39763b0 msgr2=0x558af3d47300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:41.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.510+0000 7f0f5d1ca740 1 --2- 172.21.15.78:0/1541315263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af39763b0 0x558af3d47300 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0f400044c0 tx=0x7f0f4003f000 comp rx=0 tx=0).stop 2024-09-17T03:10:41.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.510+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/1541315263 shutdown_connections 2024-09-17T03:10:41.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.510+0000 7f0f5d1ca740 1 --2- 172.21.15.78:0/1541315263 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af399f270 0x558af3daf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.510+0000 7f0f5d1ca740 1 --2- 172.21.15.78:0/1541315263 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558af397e590 0x558af3daed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.510+0000 7f0f5d1ca740 1 --2- 172.21.15.78:0/1541315263 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af39763b0 0x558af3d47300 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.510+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/1541315263 >> 172.21.15.78:0/1541315263 conn(0x558af39933c0 msgr2=0x558af3d425c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:41.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.510+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/1541315263 shutdown_connections 2024-09-17T03:10:41.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.510+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/1541315263 wait complete. 2024-09-17T03:10:41.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.511+0000 7f0f5d1ca740 1 -- start start 2024-09-17T03:10:41.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.511+0000 7f0f5d1ca740 1 Processor -- start 2024-09-17T03:10:41.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.512+0000 7f0f5d1ca740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558af39763b0 0x558af3d9d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.512+0000 7f0f5d1ca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af397e590 0x558af3d9b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.512+0000 7f0f5d1ca740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af399f270 0x558af3e0b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.512+0000 7f0f5d1ca740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x558af3d83bc0 con 0x558af399f270 2024-09-17T03:10:41.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.512+0000 7f0f5d1ca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558af3d5f1d0 con 0x558af397e590 2024-09-17T03:10:41.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.512+0000 7f0f5d1ca740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x558af3d871e0 con 0x558af39763b0 2024-09-17T03:10:41.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.513+0000 7f0f5d1ca740 10 client.0 _ll_register_callbacks cb 0x7f0f48001b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:10:41.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.513+0000 7f0f4ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af399f270 0x558af3e0b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.513+0000 7f0f4ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af399f270 0x558af3e0b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41190/0 (socket says 172.21.15.78:41190) 2024-09-17T03:10:41.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.513+0000 7f0f4ffff640 1 -- 172.21.15.78:0/841871002 learned_addr learned my addr 172.21.15.78:0/841871002 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:41.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.513+0000 7f0f4f7fe640 1 --2- 172.21.15.78:0/841871002 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558af39763b0 0x558af3d9d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.513+0000 7f0f4effd640 1 --2- 172.21.15.78:0/841871002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af397e590 0x558af3d9b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.513+0000 7f0f4ffff640 1 -- 172.21.15.78:0/841871002 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558af39763b0 msgr2=0x558af3d9d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:41.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.513+0000 7f0f4ffff640 1 --2- 172.21.15.78:0/841871002 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558af39763b0 0x558af3d9d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.513+0000 7f0f4ffff640 1 -- 172.21.15.78:0/841871002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af397e590 msgr2=0x558af3d9b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:41.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.513+0000 7f0f4ffff640 1 --2- 172.21.15.78:0/841871002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af397e590 0x558af3d9b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.513+0000 7f0f4ffff640 1 -- 172.21.15.78:0/841871002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558af3d42050 con 0x558af399f270 2024-09-17T03:10:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.513+0000 7f0f4effd640 1 --2- 172.21.15.78:0/841871002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af397e590 0x558af3d9b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:10:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.513+0000 7f0f4ffff640 1 --2- 172.21.15.78:0/841871002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af399f270 0x558af3e0b3a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0f4806cae0 tx=0x7f0f48062670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02ec1ecbac3cbf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.513+0000 7f0f2e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:10:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.513+0000 7f0f2e7fc640 1 -- 172.21.15.78:0/841871002 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f480679e0 con 0x558af399f270 2024-09-17T03:10:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.513+0000 7f0f2e7fc640 1 -- 172.21.15.78:0/841871002 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f0f48089330 con 0x558af399f270 2024-09-17T03:10:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.513+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/841871002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f40003cd0 con 0x558af399f270 2024-09-17T03:10:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.513+0000 7f0f2e7fc640 1 -- 172.21.15.78:0/841871002 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0f4805ee50 con 0x558af399f270 2024-09-17T03:10:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.513+0000 7f0f5d1ca740 10 client.5766 fetch_fsmap learned FSMap version 34 2024-09-17T03:10:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.514+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/841871002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x558af3daf4d0 con 0x558af399f270 2024-09-17T03:10:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.514+0000 7f0f2e7fc640 1 -- 172.21.15.78:0/841871002 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f40003cd0 con 0x558af399f270 2024-09-17T03:10:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.514+0000 7f0f2e7fc640 1 -- 172.21.15.78:0/841871002 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 34) ==== 3542+0+0 (secure 0 0 0) 0x7f0f4806cb70 con 0x558af399f270 2024-09-17T03:10:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.514+0000 7f0f5d1ca740 10 client.5766 fetch_fsmap finished waiting for FSMap version 34 2024-09-17T03:10:41.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.514+0000 7f0f5d1ca740 10 client.5766 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:10:41.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.514+0000 7f0f5d1ca740 20 client.5766 populate_metadata read hostname 'smithi078' 2024-09-17T03:10:41.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.514+0000 7f0f5d1ca740 1 --2- 172.21.15.78:0/841871002 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x558af3d97c70 0x558af3d60760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:41.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.514+0000 7f0f5d1ca740 4 client.5766 mds_command: new command op to 5039 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:10:41.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.514+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/841871002 --> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] -- command(tid 0: {"prefix": "status"}) -- 0x558af3cb7220 con 0x558af3d97c70 2024-09-17T03:10:41.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.514+0000 7f0f4f7fe640 1 --2- 172.21.15.78:0/841871002 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x558af3d97c70 0x558af3d60760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:41.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.514+0000 7f0f2e7fc640 10 client.5766 ms_handle_connect on v2:172.21.15.193:6835/3209848332 2024-09-17T03:10:41.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.514+0000 7f0f4f7fe640 1 --2- 172.21.15.78:0/841871002 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x558af3d97c70 0x558af3d60760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ad92fd87e43ca08c server_cookie=1e2455004e003437 in_seq=0 out_seq=0 2024-09-17T03:10:41.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.515+0000 7f0f2e7fc640 1 -- 172.21.15.78:0/841871002 <== mds.1 v2:172.21.15.193:6835/3209848332 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x558af3cb7220 con 0x558af3d97c70 2024-09-17T03:10:41.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.515+0000 7f0f2e7fc640 10 client.5766 handle_command_reply: tid=0 2024-09-17T03:10:41.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.515+0000 7f0f5d1ca740 1 client.5766 shutdown 2024-09-17T03:10:41.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.515+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/841871002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af399f270 msgr2=0x558af3e0b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:41.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.515+0000 7f0f5d1ca740 1 --2- 172.21.15.78:0/841871002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af399f270 0x558af3e0b3a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0f4806cae0 tx=0x7f0f48062670 comp rx=0 tx=0).stop 2024-09-17T03:10:41.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.515+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/841871002 shutdown_connections 2024-09-17T03:10:41.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.515+0000 7f0f5d1ca740 1 --2- 172.21.15.78:0/841871002 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x558af3d97c70 0x558af3d60760 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.515+0000 7f0f5d1ca740 1 --2- 172.21.15.78:0/841871002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558af399f270 0x558af3e0b3a0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.515+0000 7f0f5d1ca740 1 --2- 172.21.15.78:0/841871002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558af397e590 0x558af3d9b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.515+0000 7f0f5d1ca740 1 --2- 172.21.15.78:0/841871002 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558af39763b0 0x558af3d9d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.515+0000 7f0f2e7fc640 0 client.5766 ms_handle_reset on v2:172.21.15.193:6835/3209848332 2024-09-17T03:10:41.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.515+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/841871002 >> 172.21.15.78:0/841871002 conn(0x558af39933c0 msgr2=0x558af3d47300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:41.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.515+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/841871002 shutdown_connections 2024-09-17T03:10:41.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.515+0000 7f0f5d1ca740 1 -- 172.21.15.78:0/841871002 wait complete. 2024-09-17T03:10:41.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.515+0000 7f0f5d1ca740 20 client.5766 trim_cache size 0 max 16384 2024-09-17T03:10:41.521 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:10:41.522 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:10:41.522 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 1, 2024-09-17T03:10:41.522 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 5039, 2024-09-17T03:10:41.522 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:10:41.522 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:10:41.522 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:10:41.522 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 2.8492076810000002, 2024-09-17T03:10:41.522 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 34, 2024-09-17T03:10:41.522 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 45, 2024-09-17T03:10:41.522 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 45, 2024-09-17T03:10:41.522 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 19.596866290000001 2024-09-17T03:10:41.522 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:10:41.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.515+0000 7f0f5625c640 1 -- 172.21.15.78:0/1399269495 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0f3c078b90 msgr2=0x7f0f3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:41.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.515+0000 7f0f5625c640 1 --2- 172.21.15.78:0/1399269495 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0f3c078b90 0x7f0f3c07b0a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0f40034000 tx=0x7f0f40004730 comp rx=0 tx=0).stop 2024-09-17T03:10:41.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.515+0000 7f0f5625c640 1 -- 172.21.15.78:0/1399269495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f5015c6f0 msgr2=0x7f0f5015efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:41.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.515+0000 7f0f5625c640 1 --2- 172.21.15.78:0/1399269495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f5015c6f0 0x7f0f5015efd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0f4800cb10 tx=0x7f0f4800a060 comp rx=0 tx=0).stop 2024-09-17T03:10:41.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.516+0000 7f0f5625c640 1 -- 172.21.15.78:0/1399269495 shutdown_connections 2024-09-17T03:10:41.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.516+0000 7f0f5625c640 1 --2- 172.21.15.78:0/1399269495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f5015c6f0 0x7f0f5015efd0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.516+0000 7f0f5625c640 1 --2- 172.21.15.78:0/1399269495 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f500d1d40 0x7f0f501f04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.516+0000 7f0f5625c640 1 --2- 172.21.15.78:0/1399269495 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0f3c078b90 0x7f0f3c07b0a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.516+0000 7f0f5625c640 1 --2- 172.21.15.78:0/1399269495 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f500ccba0 0x7f0f501f3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:41.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.516+0000 7f0f5625c640 1 -- 172.21.15.78:0/1399269495 >> 172.21.15.78:0/1399269495 conn(0x7f0f500b3f10 msgr2=0x7f0f500b7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:41.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.516+0000 7f0f5625c640 1 -- 172.21.15.78:0/1399269495 shutdown_connections 2024-09-17T03:10:41.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.516+0000 7f0f5625c640 1 -- 172.21.15.78:0/1399269495 wait complete. 2024-09-17T03:10:41.526 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T03:10:41.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.641+0000 7f998cfa8640 1 -- 172.21.15.78:0/4221827836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99880b9b60 msgr2=0x7f99880d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:42.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.641+0000 7f998cfa8640 1 --2- 172.21.15.78:0/4221827836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99880b9b60 0x7f99880d4d80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9978009bb0 tx=0x7f997802a780 comp rx=0 tx=0).stop 2024-09-17T03:10:42.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.641+0000 7f998cfa8640 1 -- 172.21.15.78:0/4221827836 shutdown_connections 2024-09-17T03:10:42.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.641+0000 7f998cfa8640 1 --2- 172.21.15.78:0/4221827836 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99880cf540 0x7f99880b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.641+0000 7f998cfa8640 1 --2- 172.21.15.78:0/4221827836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99880b9b60 0x7f99880d4d80 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.641+0000 7f998cfa8640 1 -- 172.21.15.78:0/4221827836 >> 172.21.15.78:0/4221827836 conn(0x7f998809d7f0 msgr2=0x7f99880d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:42.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.641+0000 7f998cfa8640 1 -- 172.21.15.78:0/4221827836 shutdown_connections 2024-09-17T03:10:42.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.641+0000 7f998cfa8640 1 -- 172.21.15.78:0/4221827836 wait complete. 2024-09-17T03:10:42.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.643+0000 7f998cfa8640 1 Processor -- start 2024-09-17T03:10:42.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.643+0000 7f998cfa8640 1 -- start start 2024-09-17T03:10:42.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.644+0000 7f998cfa8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99880b64e0 0x7f99881f9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.644+0000 7f998cfa8640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99880b9b60 0x7f99880a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.644+0000 7f998cfa8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99880cf540 0x7f9988160630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.644+0000 7f998cfa8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f99880d2e40 con 0x7f99880cf540 2024-09-17T03:10:42.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.644+0000 7f998cfa8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f99880d2cc0 con 0x7f99880b64e0 2024-09-17T03:10:42.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.644+0000 7f998cfa8640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f99880d2fc0 con 0x7f99880b9b60 2024-09-17T03:10:42.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.644+0000 7f9986d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99880cf540 0x7f9988160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.644+0000 7f9986d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99880cf540 0x7f9988160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41212/0 (socket says 172.21.15.78:41212) 2024-09-17T03:10:42.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.644+0000 7f9986d9d640 1 -- 172.21.15.78:0/2636889427 learned_addr learned my addr 172.21.15.78:0/2636889427 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:42.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.645+0000 7f998659c640 1 --2- 172.21.15.78:0/2636889427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99880b64e0 0x7f99881f9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.645+0000 7f9985d9b640 1 --2- 172.21.15.78:0/2636889427 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99880b9b60 0x7f99880a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.645+0000 7f9986d9d640 1 -- 172.21.15.78:0/2636889427 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99880b9b60 msgr2=0x7f99880a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:42.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.645+0000 7f9986d9d640 1 --2- 172.21.15.78:0/2636889427 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99880b9b60 0x7f99880a0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.645+0000 7f9986d9d640 1 -- 172.21.15.78:0/2636889427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99880b64e0 msgr2=0x7f99881f9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:42.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.645+0000 7f9986d9d640 1 --2- 172.21.15.78:0/2636889427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99880b64e0 0x7f99881f9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.645+0000 7f9986d9d640 1 -- 172.21.15.78:0/2636889427 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f998809e4b0 con 0x7f99880cf540 2024-09-17T03:10:42.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.645+0000 7f9985d9b640 1 --2- 172.21.15.78:0/2636889427 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99880b9b60 0x7f99880a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:42.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.645+0000 7f9986d9d640 1 --2- 172.21.15.78:0/2636889427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99880cf540 0x7f9988160630 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f998000c3c0 tx=0x7f998000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:42.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.645+0000 7f9976ffd640 1 -- 172.21.15.78:0/2636889427 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9980017070 con 0x7f99880cf540 2024-09-17T03:10:42.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.645+0000 7f9976ffd640 1 -- 172.21.15.78:0/2636889427 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99800035f0 con 0x7f99880cf540 2024-09-17T03:10:42.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.645+0000 7f998cfa8640 1 -- 172.21.15.78:0/2636889427 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f998809e790 con 0x7f99880cf540 2024-09-17T03:10:42.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.645+0000 7f9976ffd640 1 -- 172.21.15.78:0/2636889427 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9980003a80 con 0x7f99880cf540 2024-09-17T03:10:42.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.645+0000 7f998cfa8640 1 -- 172.21.15.78:0/2636889427 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99881f5960 con 0x7f99880cf540 2024-09-17T03:10:42.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.647+0000 7f9976ffd640 1 -- 172.21.15.78:0/2636889427 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f998001a070 con 0x7f99880cf540 2024-09-17T03:10:42.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.648+0000 7f9976ffd640 1 --2- 172.21.15.78:0/2636889427 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9968078bc0 0x7f996807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.648+0000 7f9976ffd640 1 -- 172.21.15.78:0/2636889427 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f9980099e30 con 0x7f99880cf540 2024-09-17T03:10:42.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.648+0000 7f998659c640 1 --2- 172.21.15.78:0/2636889427 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9968078bc0 0x7f996807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.649+0000 7f9993ff2740 1 Processor -- start 2024-09-17T03:10:42.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.649+0000 7f998659c640 1 --2- 172.21.15.78:0/2636889427 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9968078bc0 0x7f996807b0d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f99880b6e20 tx=0x7f9978004ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:42.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.649+0000 7f9993ff2740 1 -- start start 2024-09-17T03:10:42.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.650+0000 7f9993ff2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc367270 0x55cfbc738fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.650+0000 7f9993ff2740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cfbc33e3b0 0x55cfbc7394e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.650+0000 7f9993ff2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc346590 0x55cfbc7563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.650+0000 7f9993ff2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55cfbc681820 con 0x55cfbc367270 2024-09-17T03:10:42.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.650+0000 7f9993ff2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55cfbc670c50 con 0x55cfbc346590 2024-09-17T03:10:42.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.650+0000 7f9993ff2740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55cfbc674a60 con 0x55cfbc33e3b0 2024-09-17T03:10:42.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.650+0000 7f998659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc367270 0x55cfbc738fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.650+0000 7f998659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc367270 0x55cfbc738fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41216/0 (socket says 172.21.15.78:41216) 2024-09-17T03:10:42.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.650+0000 7f998659c640 1 -- 172.21.15.78:0/2951134314 learned_addr learned my addr 172.21.15.78:0/2951134314 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:42.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.650+0000 7f9986d9d640 1 --2- 172.21.15.78:0/2951134314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc346590 0x55cfbc7563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.650+0000 7f9985d9b640 1 --2- 172.21.15.78:0/2951134314 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cfbc33e3b0 0x55cfbc7394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.651+0000 7f998659c640 1 -- 172.21.15.78:0/2951134314 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cfbc33e3b0 msgr2=0x55cfbc7394e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:42.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.651+0000 7f998659c640 1 --2- 172.21.15.78:0/2951134314 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cfbc33e3b0 0x55cfbc7394e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.651+0000 7f998659c640 1 -- 172.21.15.78:0/2951134314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc346590 msgr2=0x55cfbc7563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:42.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.651+0000 7f998659c640 1 --2- 172.21.15.78:0/2951134314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc346590 0x55cfbc7563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.651+0000 7f998659c640 1 -- 172.21.15.78:0/2951134314 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfbc3d2850 con 0x55cfbc367270 2024-09-17T03:10:42.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.651+0000 7f9986d9d640 1 --2- 172.21.15.78:0/2951134314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc346590 0x55cfbc7563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:10:42.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.651+0000 7f998659c640 1 --2- 172.21.15.78:0/2951134314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc367270 0x55cfbc738fa0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f997802ad70 tx=0x7f997803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bcf23b2c925ab64 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:42.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.651+0000 7f9967fff640 1 -- 172.21.15.78:0/2951134314 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978043070 con 0x55cfbc367270 2024-09-17T03:10:42.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.651+0000 7f9967fff640 1 -- 172.21.15.78:0/2951134314 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f997804f070 con 0x55cfbc367270 2024-09-17T03:10:42.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.651+0000 7f9967fff640 1 -- 172.21.15.78:0/2951134314 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997804a670 con 0x55cfbc367270 2024-09-17T03:10:42.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.652+0000 7f9993ff2740 1 -- 172.21.15.78:0/2951134314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc367270 msgr2=0x55cfbc738fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:42.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.652+0000 7f9993ff2740 1 --2- 172.21.15.78:0/2951134314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc367270 0x55cfbc738fa0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f997802ad70 tx=0x7f997803d000 comp rx=0 tx=0).stop 2024-09-17T03:10:42.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.652+0000 7f9993ff2740 1 -- 172.21.15.78:0/2951134314 shutdown_connections 2024-09-17T03:10:42.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.652+0000 7f9993ff2740 1 --2- 172.21.15.78:0/2951134314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc346590 0x55cfbc7563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.652+0000 7f9993ff2740 1 --2- 172.21.15.78:0/2951134314 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cfbc33e3b0 0x55cfbc7394e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.652+0000 7f9993ff2740 1 --2- 172.21.15.78:0/2951134314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc367270 0x55cfbc738fa0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.652+0000 7f9993ff2740 1 -- 172.21.15.78:0/2951134314 >> 172.21.15.78:0/2951134314 conn(0x55cfbc35b3c0 msgr2=0x55cfbc70f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:42.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.652+0000 7f9993ff2740 1 -- 172.21.15.78:0/2951134314 shutdown_connections 2024-09-17T03:10:42.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.652+0000 7f9993ff2740 1 -- 172.21.15.78:0/2951134314 wait complete. 2024-09-17T03:10:42.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.653+0000 7f9993ff2740 1 -- start start 2024-09-17T03:10:42.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.653+0000 7f9993ff2740 1 Processor -- start 2024-09-17T03:10:42.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.654+0000 7f9993ff2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 0x55cfbc74ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.654+0000 7f9993ff2740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cfbc346590 0x55cfbc7277c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.654+0000 7f9993ff2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc367270 0x55cfbc756140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.654+0000 7f9993ff2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55cfbc3e1620 con 0x55cfbc33e3b0 2024-09-17T03:10:42.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.654+0000 7f9993ff2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55cfbc6165f0 con 0x55cfbc367270 2024-09-17T03:10:42.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.654+0000 7f9993ff2740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55cfbc739a20 con 0x55cfbc346590 2024-09-17T03:10:42.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.654+0000 7f9993ff2740 10 client.0 _ll_register_callbacks cb 0x55cfbc61a0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:10:42.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.654+0000 7f998659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 0x55cfbc74ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.654+0000 7f998659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 0x55cfbc74ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41228/0 (socket says 172.21.15.78:41228) 2024-09-17T03:10:42.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.654+0000 7f998659c640 1 -- 172.21.15.78:0/2321651462 learned_addr learned my addr 172.21.15.78:0/2321651462 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:42.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.655+0000 7f9985d9b640 1 --2- 172.21.15.78:0/2321651462 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cfbc346590 0x55cfbc7277c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.655+0000 7f9986d9d640 1 --2- 172.21.15.78:0/2321651462 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc367270 0x55cfbc756140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.655+0000 7f998659c640 1 -- 172.21.15.78:0/2321651462 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cfbc346590 msgr2=0x55cfbc7277c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:42.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.655+0000 7f998659c640 1 --2- 172.21.15.78:0/2321651462 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cfbc346590 0x55cfbc7277c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.655+0000 7f998659c640 1 -- 172.21.15.78:0/2321651462 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc367270 msgr2=0x55cfbc756140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:42.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.655+0000 7f998659c640 1 --2- 172.21.15.78:0/2321651462 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc367270 0x55cfbc756140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.655+0000 7f998659c640 1 -- 172.21.15.78:0/2321651462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfbc4496b0 con 0x55cfbc33e3b0 2024-09-17T03:10:42.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.655+0000 7f9986d9d640 1 --2- 172.21.15.78:0/2321651462 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc367270 0x55cfbc756140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:10:42.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.655+0000 7f998659c640 1 --2- 172.21.15.78:0/2321651462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 0x55cfbc74ab90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f997804c040 tx=0x7f997804ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3064f1d524ee9b82 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:42.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.655+0000 7f99657fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:10:42.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.655+0000 7f99657fa640 1 -- 172.21.15.78:0/2321651462 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978043040 con 0x55cfbc33e3b0 2024-09-17T03:10:42.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.655+0000 7f99657fa640 1 -- 172.21.15.78:0/2321651462 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f997803d650 con 0x55cfbc33e3b0 2024-09-17T03:10:42.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.655+0000 7f9993ff2740 1 -- 172.21.15.78:0/2321651462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f997804f070 con 0x55cfbc33e3b0 2024-09-17T03:10:42.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.655+0000 7f99657fa640 1 -- 172.21.15.78:0/2321651462 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9978064050 con 0x55cfbc33e3b0 2024-09-17T03:10:42.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.655+0000 7f9993ff2740 10 client.5781 fetch_fsmap learned FSMap version 34 2024-09-17T03:10:42.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.655+0000 7f9993ff2740 1 -- 172.21.15.78:0/2321651462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x55cfbc74ba00 con 0x55cfbc33e3b0 2024-09-17T03:10:42.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.655+0000 7f99657fa640 1 -- 172.21.15.78:0/2321651462 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f997804f070 con 0x55cfbc33e3b0 2024-09-17T03:10:42.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.656+0000 7f99657fa640 1 -- 172.21.15.78:0/2321651462 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 34) ==== 3542+0+0 (secure 0 0 0) 0x7f9978067020 con 0x55cfbc33e3b0 2024-09-17T03:10:42.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.656+0000 7f9993ff2740 10 client.5781 fetch_fsmap finished waiting for FSMap version 34 2024-09-17T03:10:42.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.656+0000 7f9993ff2740 10 client.5781 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T03:10:42.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.656+0000 7f9993ff2740 20 client.5781 populate_metadata read hostname 'smithi078' 2024-09-17T03:10:42.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.656+0000 7f9993ff2740 1 --2- 172.21.15.78:0/2321651462 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55cfbc325e40 0x55cfbc74cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.656+0000 7f9993ff2740 4 client.5781 mds_command: new command op to 5565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:10:42.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.656+0000 7f9993ff2740 1 -- 172.21.15.78:0/2321651462 --> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfbc683770 con 0x55cfbc325e40 2024-09-17T03:10:42.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.656+0000 7f9985d9b640 1 --2- 172.21.15.78:0/2321651462 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55cfbc325e40 0x55cfbc74cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.656+0000 7f99657fa640 10 client.5781 ms_handle_connect on v2:172.21.15.193:6834/1788096053 2024-09-17T03:10:42.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.656+0000 7f9985d9b640 1 --2- 172.21.15.78:0/2321651462 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55cfbc325e40 0x55cfbc74cb80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdf26128efcae0e1 server_cookie=feaef96ca83ab7e3 in_seq=0 out_seq=0 2024-09-17T03:10:42.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.657+0000 7f99657fa640 1 -- 172.21.15.78:0/2321651462 <== mds.0 v2:172.21.15.193:6834/1788096053 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cfbc683770 con 0x55cfbc325e40 2024-09-17T03:10:42.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.657+0000 7f99657fa640 10 client.5781 handle_command_reply: tid=0 2024-09-17T03:10:42.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.657+0000 7f9993ff2740 1 client.5781 shutdown 2024-09-17T03:10:42.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.657+0000 7f9993ff2740 1 -- 172.21.15.78:0/2321651462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 msgr2=0x55cfbc74ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:42.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.657+0000 7f9993ff2740 1 --2- 172.21.15.78:0/2321651462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 0x55cfbc74ab90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f997804c040 tx=0x7f997804ac80 comp rx=0 tx=0).stop 2024-09-17T03:10:42.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.657+0000 7f9993ff2740 1 -- 172.21.15.78:0/2321651462 shutdown_connections 2024-09-17T03:10:42.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.657+0000 7f9993ff2740 1 --2- 172.21.15.78:0/2321651462 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55cfbc325e40 0x55cfbc74cb80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.657+0000 7f9993ff2740 1 --2- 172.21.15.78:0/2321651462 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc367270 0x55cfbc756140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.657+0000 7f9993ff2740 1 --2- 172.21.15.78:0/2321651462 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cfbc346590 0x55cfbc7277c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.657+0000 7f9993ff2740 1 --2- 172.21.15.78:0/2321651462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 0x55cfbc74ab90 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.657+0000 7f99657fa640 0 client.5781 ms_handle_reset on v2:172.21.15.193:6834/1788096053 2024-09-17T03:10:42.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.657+0000 7f9993ff2740 1 -- 172.21.15.78:0/2321651462 >> 172.21.15.78:0/2321651462 conn(0x55cfbc35b3c0 msgr2=0x55cfbc7559b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.657+0000 7f9993ff2740 1 -- 172.21.15.78:0/2321651462 shutdown_connections 2024-09-17T03:10:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.657+0000 7f9993ff2740 1 -- 172.21.15.78:0/2321651462 wait complete. 2024-09-17T03:10:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.658+0000 7f9993ff2740 20 client.5781 trim_cache size 0 max 16384 2024-09-17T03:10:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.676+0000 7f9993ff2740 1 Processor -- start 2024-09-17T03:10:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.676+0000 7f9993ff2740 1 -- start start 2024-09-17T03:10:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.677+0000 7f9993ff2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 0x55cfbc732220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.677+0000 7f9993ff2740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cfbc346590 0x55cfbc726f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.677+0000 7f9993ff2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc367270 0x55cfbc738fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.677+0000 7f9993ff2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9988201310 con 0x55cfbc33e3b0 2024-09-17T03:10:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.677+0000 7f9993ff2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f99882019c0 con 0x55cfbc367270 2024-09-17T03:10:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.677+0000 7f9993ff2740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f99880cb760 con 0x55cfbc346590 2024-09-17T03:10:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.677+0000 7f998659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 0x55cfbc732220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.677+0000 7f998659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 0x55cfbc732220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41244/0 (socket says 172.21.15.78:41244) 2024-09-17T03:10:42.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.677+0000 7f998659c640 1 -- 172.21.15.78:0/3511136005 learned_addr learned my addr 172.21.15.78:0/3511136005 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:42.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.677+0000 7f998659c640 1 -- 172.21.15.78:0/3511136005 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cfbc346590 msgr2=0x55cfbc726f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:42.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.677+0000 7f9986d9d640 1 --2- 172.21.15.78:0/3511136005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc367270 0x55cfbc738fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.677+0000 7f9985d9b640 1 --2- 172.21.15.78:0/3511136005 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cfbc346590 0x55cfbc726f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.677+0000 7f998659c640 1 --2- 172.21.15.78:0/3511136005 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cfbc346590 0x55cfbc726f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.677+0000 7f998659c640 1 -- 172.21.15.78:0/3511136005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc367270 msgr2=0x55cfbc738fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:42.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.677+0000 7f998659c640 1 --2- 172.21.15.78:0/3511136005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc367270 0x55cfbc738fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.677+0000 7f998659c640 1 -- 172.21.15.78:0/3511136005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfbc74e040 con 0x55cfbc33e3b0 2024-09-17T03:10:42.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.677+0000 7f9986d9d640 1 --2- 172.21.15.78:0/3511136005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc367270 0x55cfbc738fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:10:42.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.678+0000 7f998659c640 1 --2- 172.21.15.78:0/3511136005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 0x55cfbc732220 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9978003f00 tx=0x7f9978005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3677f1281f13e8bb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:42.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.678+0000 7f99677fe640 1 -- 172.21.15.78:0/3511136005 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997806d070 con 0x55cfbc33e3b0 2024-09-17T03:10:42.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.678+0000 7f99677fe640 1 -- 172.21.15.78:0/3511136005 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f997804f040 con 0x55cfbc33e3b0 2024-09-17T03:10:42.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.678+0000 7f99677fe640 1 -- 172.21.15.78:0/3511136005 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978043070 con 0x55cfbc33e3b0 2024-09-17T03:10:42.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.678+0000 7f9993ff2740 1 -- 172.21.15.78:0/3511136005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 msgr2=0x55cfbc732220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:42.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.678+0000 7f9993ff2740 1 --2- 172.21.15.78:0/3511136005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 0x55cfbc732220 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9978003f00 tx=0x7f9978005fd0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.678+0000 7f9993ff2740 1 -- 172.21.15.78:0/3511136005 shutdown_connections 2024-09-17T03:10:42.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.678+0000 7f9993ff2740 1 --2- 172.21.15.78:0/3511136005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc367270 0x55cfbc738fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.678+0000 7f9993ff2740 1 --2- 172.21.15.78:0/3511136005 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cfbc346590 0x55cfbc726f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.678+0000 7f9993ff2740 1 --2- 172.21.15.78:0/3511136005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 0x55cfbc732220 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.679+0000 7f9993ff2740 1 -- 172.21.15.78:0/3511136005 >> 172.21.15.78:0/3511136005 conn(0x55cfbc35b3c0 msgr2=0x55cfbc70b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:42.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.679+0000 7f9993ff2740 1 -- 172.21.15.78:0/3511136005 shutdown_connections 2024-09-17T03:10:42.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.679+0000 7f9993ff2740 1 -- 172.21.15.78:0/3511136005 wait complete. 2024-09-17T03:10:42.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.679+0000 7f9993ff2740 1 -- start start 2024-09-17T03:10:42.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.679+0000 7f9993ff2740 1 Processor -- start 2024-09-17T03:10:42.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.681+0000 7f9993ff2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 0x55cfbc7d2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.681+0000 7f9993ff2740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cfbc346590 0x55cfbc738fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.681+0000 7f9993ff2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc367270 0x55cfbc7394e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.681+0000 7f9993ff2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55cfbc7566d0 con 0x55cfbc33e3b0 2024-09-17T03:10:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.681+0000 7f9993ff2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55cfbc727d00 con 0x55cfbc367270 2024-09-17T03:10:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.681+0000 7f9993ff2740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55cfbc7661c0 con 0x55cfbc346590 2024-09-17T03:10:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.681+0000 7f9993ff2740 10 client.0 _ll_register_callbacks cb 0x7f9978004c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:10:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.681+0000 7f998659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 0x55cfbc7d2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.681+0000 7f998659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 0x55cfbc7d2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41250/0 (socket says 172.21.15.78:41250) 2024-09-17T03:10:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.681+0000 7f998659c640 1 -- 172.21.15.78:0/3806529816 learned_addr learned my addr 172.21.15.78:0/3806529816 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.681+0000 7f9985d9b640 1 --2- 172.21.15.78:0/3806529816 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cfbc346590 0x55cfbc738fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.681+0000 7f9986d9d640 1 --2- 172.21.15.78:0/3806529816 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc367270 0x55cfbc7394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.681+0000 7f998659c640 1 -- 172.21.15.78:0/3806529816 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cfbc346590 msgr2=0x55cfbc738fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.681+0000 7f998659c640 1 --2- 172.21.15.78:0/3806529816 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cfbc346590 0x55cfbc738fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.681+0000 7f998659c640 1 -- 172.21.15.78:0/3806529816 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc367270 msgr2=0x55cfbc7394e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:42.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.681+0000 7f998659c640 1 --2- 172.21.15.78:0/3806529816 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc367270 0x55cfbc7394e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.681+0000 7f998659c640 1 -- 172.21.15.78:0/3806529816 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfbc7d2c80 con 0x55cfbc33e3b0 2024-09-17T03:10:42.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.682+0000 7f998659c640 1 --2- 172.21.15.78:0/3806529816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 0x55cfbc7d2740 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f997802ad70 tx=0x7f9978009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff4797ed6d884bc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:42.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.682+0000 7f99657fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:10:42.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.684+0000 7f99657fa640 1 -- 172.21.15.78:0/3806529816 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9978075060 con 0x55cfbc33e3b0 2024-09-17T03:10:42.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.684+0000 7f99657fa640 1 -- 172.21.15.78:0/3806529816 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f997803ddb0 con 0x55cfbc33e3b0 2024-09-17T03:10:42.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.684+0000 7f9993ff2740 1 -- 172.21.15.78:0/3806529816 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f997804f040 con 0x55cfbc33e3b0 2024-09-17T03:10:42.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.684+0000 7f99657fa640 1 -- 172.21.15.78:0/3806529816 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f997806d070 con 0x55cfbc33e3b0 2024-09-17T03:10:42.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.684+0000 7f9993ff2740 10 client.5787 fetch_fsmap learned FSMap version 34 2024-09-17T03:10:42.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.684+0000 7f9993ff2740 1 -- 172.21.15.78:0/3806529816 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) -- 0x55cfbc7d68c0 con 0x55cfbc33e3b0 2024-09-17T03:10:42.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.684+0000 7f99657fa640 1 -- 172.21.15.78:0/3806529816 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f997804f040 con 0x55cfbc33e3b0 2024-09-17T03:10:42.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.684+0000 7f99657fa640 1 -- 172.21.15.78:0/3806529816 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 34) ==== 3542+0+0 (secure 0 0 0) 0x7f9978067070 con 0x55cfbc33e3b0 2024-09-17T03:10:42.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.684+0000 7f9993ff2740 10 client.5787 fetch_fsmap finished waiting for FSMap version 34 2024-09-17T03:10:42.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.684+0000 7f9993ff2740 10 client.5787 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T03:10:42.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.684+0000 7f9993ff2740 20 client.5787 populate_metadata read hostname 'smithi078' 2024-09-17T03:10:42.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.684+0000 7f9993ff2740 1 --2- 172.21.15.78:0/3806529816 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55cfbc754460 0x55cfbc754870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.684+0000 7f9993ff2740 4 client.5787 mds_command: new command op to 5565 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:10:42.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.684+0000 7f9993ff2740 1 -- 172.21.15.78:0/3806529816 --> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] -- command(tid 0: {"prefix": "status"}) -- 0x55cfbc67f220 con 0x55cfbc754460 2024-09-17T03:10:42.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.684+0000 7f9985d9b640 1 --2- 172.21.15.78:0/3806529816 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55cfbc754460 0x55cfbc754870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.685+0000 7f99657fa640 10 client.5787 ms_handle_connect on v2:172.21.15.193:6834/1788096053 2024-09-17T03:10:42.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.685+0000 7f9985d9b640 1 --2- 172.21.15.78:0/3806529816 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55cfbc754460 0x55cfbc754870 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8c16e69436d663c server_cookie=19c5e646380afff8 in_seq=0 out_seq=0 2024-09-17T03:10:42.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.685+0000 7f99657fa640 1 -- 172.21.15.78:0/3806529816 <== mds.0 v2:172.21.15.193:6834/1788096053 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55cfbc67f220 con 0x55cfbc754460 2024-09-17T03:10:42.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.685+0000 7f99657fa640 10 client.5787 handle_command_reply: tid=0 2024-09-17T03:10:42.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.685+0000 7f9993ff2740 1 client.5787 shutdown 2024-09-17T03:10:42.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.685+0000 7f9993ff2740 1 -- 172.21.15.78:0/3806529816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 msgr2=0x55cfbc7d2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:42.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.685+0000 7f9993ff2740 1 --2- 172.21.15.78:0/3806529816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 0x55cfbc7d2740 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f997802ad70 tx=0x7f9978009610 comp rx=0 tx=0).stop 2024-09-17T03:10:42.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.685+0000 7f9993ff2740 1 -- 172.21.15.78:0/3806529816 shutdown_connections 2024-09-17T03:10:42.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.685+0000 7f9993ff2740 1 --2- 172.21.15.78:0/3806529816 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55cfbc754460 0x55cfbc754870 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.685+0000 7f9993ff2740 1 --2- 172.21.15.78:0/3806529816 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cfbc367270 0x55cfbc7394e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.685+0000 7f9993ff2740 1 --2- 172.21.15.78:0/3806529816 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cfbc346590 0x55cfbc738fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.685+0000 7f99657fa640 0 client.5787 ms_handle_reset on v2:172.21.15.193:6834/1788096053 2024-09-17T03:10:42.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.685+0000 7f9993ff2740 1 --2- 172.21.15.78:0/3806529816 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cfbc33e3b0 0x55cfbc7d2740 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.685+0000 7f9993ff2740 1 -- 172.21.15.78:0/3806529816 >> 172.21.15.78:0/3806529816 conn(0x55cfbc35b3c0 msgr2=0x55cfbc732fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:42.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.685+0000 7f9993ff2740 1 -- 172.21.15.78:0/3806529816 shutdown_connections 2024-09-17T03:10:42.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.685+0000 7f9993ff2740 1 -- 172.21.15.78:0/3806529816 wait complete. 2024-09-17T03:10:42.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.686+0000 7f9993ff2740 20 client.5787 trim_cache size 0 max 16384 2024-09-17T03:10:42.740 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:10:42.740 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:10:42.740 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-09-17T03:10:42.740 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 5565, 2024-09-17T03:10:42.740 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:10:42.741 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:10:42.741 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:10:42.741 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 15.079852277000001, 2024-09-17T03:10:42.741 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 34, 2024-09-17T03:10:42.742 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 45, 2024-09-17T03:10:42.742 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 45, 2024-09-17T03:10:42.742 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 19.767352382999999 2024-09-17T03:10:42.742 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:10:42.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.686+0000 7f998cfa8640 1 -- 172.21.15.78:0/2636889427 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9968078bc0 msgr2=0x7f996807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:42.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.686+0000 7f998cfa8640 1 --2- 172.21.15.78:0/2636889427 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9968078bc0 0x7f996807b0d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f99880b6e20 tx=0x7f9978004ab0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.686+0000 7f998cfa8640 1 -- 172.21.15.78:0/2636889427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99880cf540 msgr2=0x7f9988160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:42.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.686+0000 7f998cfa8640 1 --2- 172.21.15.78:0/2636889427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99880cf540 0x7f9988160630 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f998000c3c0 tx=0x7f998000c880 comp rx=0 tx=0).stop 2024-09-17T03:10:42.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.686+0000 7f998cfa8640 1 -- 172.21.15.78:0/2636889427 shutdown_connections 2024-09-17T03:10:42.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.686+0000 7f998cfa8640 1 --2- 172.21.15.78:0/2636889427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99880cf540 0x7f9988160630 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.686+0000 7f998cfa8640 1 --2- 172.21.15.78:0/2636889427 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99880b9b60 0x7f99880a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.686+0000 7f998cfa8640 1 --2- 172.21.15.78:0/2636889427 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9968078bc0 0x7f996807b0d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.686+0000 7f998cfa8640 1 --2- 172.21.15.78:0/2636889427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99880b64e0 0x7f99881f9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.686+0000 7f998cfa8640 1 -- 172.21.15.78:0/2636889427 >> 172.21.15.78:0/2636889427 conn(0x7f998809d7f0 msgr2=0x7f99880d41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:42.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.686+0000 7f998cfa8640 1 -- 172.21.15.78:0/2636889427 shutdown_connections 2024-09-17T03:10:42.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:41.686+0000 7f998cfa8640 1 -- 172.21.15.78:0/2636889427 wait complete. 2024-09-17T03:10:42.748 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:10:42.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.879+0000 7fbdc1cde640 1 -- 172.21.15.78:0/2689280283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbda4004d40 msgr2=0x7fbda4005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:42.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.879+0000 7fbdc1cde640 1 --2- 172.21.15.78:0/2689280283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbda4004d40 0x7fbda4005150 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4002230 tx=0x7fbda4005830 comp rx=0 tx=0).stop 2024-09-17T03:10:42.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.879+0000 7fbdbbfff640 1 -- 172.21.15.78:0/2689280283 reap_dead start 2024-09-17T03:10:42.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.879+0000 7fbdc1cde640 1 -- 172.21.15.78:0/2689280283 shutdown_connections 2024-09-17T03:10:42.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.879+0000 7fbdc1cde640 1 -- 172.21.15.78:0/2689280283 >> 172.21.15.78:0/2689280283 conn(0x7fbdbc0cd530 msgr2=0x7fbdbc0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:42.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.879+0000 7fbdc1cde640 1 -- 172.21.15.78:0/2689280283 shutdown_connections 2024-09-17T03:10:42.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.879+0000 7fbdc1cde640 1 -- 172.21.15.78:0/2689280283 wait complete. 2024-09-17T03:10:42.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.881+0000 7fbdc1cde640 1 Processor -- start 2024-09-17T03:10:42.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.881+0000 7fbdc1cde640 1 -- start start 2024-09-17T03:10:42.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.883+0000 7fbdc1cde640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbda4004d40 0x7fbdbc1464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.883+0000 7fbdc1cde640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbdbc1f90e0 0x7fbdbc1f94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.883+0000 7fbdc1cde640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdbc06cde0 0x7fbdbc06d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.883+0000 7fbdc1cde640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc15f2a0 con 0x7fbdbc06cde0 2024-09-17T03:10:42.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.883+0000 7fbdc1cde640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbdbc0cf8a0 con 0x7fbda4004d40 2024-09-17T03:10:42.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.883+0000 7fbdc1cde640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fbdbc15f420 con 0x7fbdbc1f90e0 2024-09-17T03:10:42.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.883+0000 7fbdbbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdbc06cde0 0x7fbdbc06d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.883+0000 7fbdbbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdbc06cde0 0x7fbdbc06d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41264/0 (socket says 172.21.15.78:41264) 2024-09-17T03:10:42.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.883+0000 7fbdbbfff640 1 -- 172.21.15.78:0/3573676001 learned_addr learned my addr 172.21.15.78:0/3573676001 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:42.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.883+0000 7fbdbaffd640 1 --2- 172.21.15.78:0/3573676001 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbdbc1f90e0 0x7fbdbc1f94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.883+0000 7fbdbb7fe640 1 --2- 172.21.15.78:0/3573676001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbda4004d40 0x7fbdbc1464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.883+0000 7fbdbbfff640 1 -- 172.21.15.78:0/3573676001 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbdbc1f90e0 msgr2=0x7fbdbc1f94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:42.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.883+0000 7fbdbbfff640 1 --2- 172.21.15.78:0/3573676001 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbdbc1f90e0 0x7fbdbc1f94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.883+0000 7fbdbbfff640 1 -- 172.21.15.78:0/3573676001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbda4004d40 msgr2=0x7fbdbc1464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:42.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.883+0000 7fbdbbfff640 1 --2- 172.21.15.78:0/3573676001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbda4004d40 0x7fbdbc1464a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:42.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.883+0000 7fbdbbfff640 1 -- 172.21.15.78:0/3573676001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdbc06d730 con 0x7fbdbc06cde0 2024-09-17T03:10:42.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.883+0000 7fbdbbfff640 1 --2- 172.21.15.78:0/3573676001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdbc06cde0 0x7fbdbc06d1f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fbdb402b450 tx=0x7fbdb4004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:42.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.883+0000 7fbda3fff640 1 -- 172.21.15.78:0/3573676001 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb402b9a0 con 0x7fbdbc06cde0 2024-09-17T03:10:42.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.884+0000 7fbda3fff640 1 -- 172.21.15.78:0/3573676001 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdb402bc30 con 0x7fbdbc06cde0 2024-09-17T03:10:42.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.884+0000 7fbda3fff640 1 -- 172.21.15.78:0/3573676001 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40060a0 con 0x7fbdbc06cde0 2024-09-17T03:10:42.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.884+0000 7fbdc1cde640 1 -- 172.21.15.78:0/3573676001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdbc0c7330 con 0x7fbdbc06cde0 2024-09-17T03:10:42.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.884+0000 7fbdc1cde640 1 -- 172.21.15.78:0/3573676001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdbc0c78f0 con 0x7fbdbc06cde0 2024-09-17T03:10:42.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.885+0000 7fbdc1cde640 1 -- 172.21.15.78:0/3573676001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdbc070e40 con 0x7fbdbc06cde0 2024-09-17T03:10:42.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.885+0000 7fbda3fff640 1 -- 172.21.15.78:0/3573676001 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbdb4006240 con 0x7fbdbc06cde0 2024-09-17T03:10:42.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.886+0000 7fbda3fff640 1 --2- 172.21.15.78:0/3573676001 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbda8078b90 0x7fbda807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:42.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.886+0000 7fbda3fff640 1 -- 172.21.15.78:0/3573676001 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fbdb40bb0e0 con 0x7fbdbc06cde0 2024-09-17T03:10:42.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.886+0000 7fbdbb7fe640 1 --2- 172.21.15.78:0/3573676001 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbda8078b90 0x7fbda807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:42.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.887+0000 7fbdbb7fe640 1 --2- 172.21.15.78:0/3573676001 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbda8078b90 0x7fbda807b0a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbdac009cd0 tx=0x7fbdac005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:42.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:42.890+0000 7fbda3fff640 1 -- 172.21.15.78:0/3573676001 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbdbc06d730 con 0x7fbdbc06cde0 2024-09-17T03:10:43.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:43.099+0000 7fbdc1cde640 1 -- 172.21.15.78:0/3573676001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbdbc1f9c40 con 0x7fbdbc06cde0 2024-09-17T03:10:43.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:43.100+0000 7fbda3fff640 1 -- 172.21.15.78:0/3573676001 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+5267 (secure 0 0 0) 0x7fbdbc15fbf0 con 0x7fbdbc06cde0 2024-09-17T03:10:43.100 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:10:43.100 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":34,"btime":"2024-09-17T03:10:40:681344+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/2973955781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2973955781},{"type":"v1","addr":"172.21.15.78:6834","nonce":2973955781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:10:25.982190+0000","modified":"2024-09-17T03:10:40.681338+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5565,"mds_1":5039,"mds_2":5036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5036":{"gid":5036,"name":"a","rank":2,"incarnation":33,"state":"up:active","state_seq":6,"addr":"172.21.15.78:6835/3629327943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3629327943},{"type":"v1","addr":"172.21.15.78:6835","nonce":3629327943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5039":{"gid":5039,"name":"d","rank":1,"incarnation":31,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6837/3209848332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":3209848332},{"type":"v1","addr":"172.21.15.193:6837","nonce":3209848332}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5565":{"gid":5565,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6836/1788096053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1788096053},{"type":"v1","addr":"172.21.15.193:6836","nonce":1788096053}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5565,"qdb_cluster":[5036,5039,5565]},"id":3}]} 2024-09-17T03:10:43.100 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 34 2024-09-17T03:10:43.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:43.102+0000 7fbdc1cde640 1 -- 172.21.15.78:0/3573676001 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbda8078b90 msgr2=0x7fbda807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:43.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:43.102+0000 7fbdc1cde640 1 --2- 172.21.15.78:0/3573676001 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbda8078b90 0x7fbda807b0a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbdac009cd0 tx=0x7fbdac005f90 comp rx=0 tx=0).stop 2024-09-17T03:10:43.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:43.102+0000 7fbdc1cde640 1 -- 172.21.15.78:0/3573676001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdbc06cde0 msgr2=0x7fbdbc06d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:43.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:43.102+0000 7fbdc1cde640 1 --2- 172.21.15.78:0/3573676001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdbc06cde0 0x7fbdbc06d1f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fbdb402b450 tx=0x7fbdb4004bb0 comp rx=0 tx=0).stop 2024-09-17T03:10:43.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:43.102+0000 7fbdc1cde640 1 -- 172.21.15.78:0/3573676001 shutdown_connections 2024-09-17T03:10:43.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:43.102+0000 7fbdc1cde640 1 --2- 172.21.15.78:0/3573676001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdbc06cde0 0x7fbdbc06d1f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:43.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:43.102+0000 7fbdc1cde640 1 --2- 172.21.15.78:0/3573676001 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbdbc1f90e0 0x7fbdbc1f94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:43.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:43.102+0000 7fbdc1cde640 1 --2- 172.21.15.78:0/3573676001 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbda8078b90 0x7fbda807b0a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:43.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:43.102+0000 7fbdc1cde640 1 --2- 172.21.15.78:0/3573676001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbda4004d40 0x7fbdbc1464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:43.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:43.102+0000 7fbdc1cde640 1 -- 172.21.15.78:0/3573676001 >> 172.21.15.78:0/3573676001 conn(0x7fbdbc0cd530 msgr2=0x7fbdbc0b53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:43.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:43.102+0000 7fbdc1cde640 1 -- 172.21.15.78:0/3573676001 shutdown_connections 2024-09-17T03:10:43.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:43.102+0000 7fbdc1cde640 1 -- 172.21.15.78:0/3573676001 wait complete. 2024-09-17T03:10:43.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:10:43.114 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-17T03:10:43.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:10:43.142 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-17T03:10:43.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:10:43.204 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2024-09-17T03:10:43.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:10:43.261 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2024-09-17T03:10:43.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:10:43.318 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2024-09-17T03:10:43.375 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-09-17T03:10:43.511 INFO:teuthology.orchestra.run.smithi193.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:10:43.512 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:10:43.512 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:10:45.514 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-09-17T03:10:45.649 INFO:teuthology.orchestra.run.smithi193.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:10:45.650 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:10:45.650 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:10:47.651 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-09-17T03:10:47.787 INFO:teuthology.orchestra.run.smithi193.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:10:47.787 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:10:47.787 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:10:49.789 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-09-17T03:10:49.925 INFO:teuthology.orchestra.run.smithi193.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:10:49.925 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:10:49.925 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:10:51.926 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-09-17T03:10:52.061 INFO:teuthology.orchestra.run.smithi193.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}}] 2024-09-17T03:10:52.062 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:10:52.062 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:10:54.063 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-09-17T03:10:54.199 INFO:teuthology.orchestra.run.smithi193.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2024-09-17T03:10:54.200 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-17T03:10:54.200 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:10:54.200 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-17T03:10:54.320 INFO:teuthology.orchestra.run.smithi193.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-17T03:10:54.321 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:10:54.321 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:10:55.269 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:10:55.272 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:10:56.321 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-17T03:10:56.456 INFO:teuthology.orchestra.run.smithi193.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-17T03:10:56.457 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:10:56.457 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:10:58.458 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-17T03:10:58.594 INFO:teuthology.orchestra.run.smithi193.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2024-09-17T03:10:58.595 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-17T03:10:58.595 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:10:58.596 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:10:58.733 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-17T03:10:58.733 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:10:58.734 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:10:58.734 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 flush journal 2024-09-17T03:10:58.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.849+0000 7f53c889b640 1 -- 172.21.15.78:0/4229658407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53c41600a0 msgr2=0x7f53c4071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:58.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.849+0000 7f53c889b640 1 --2- 172.21.15.78:0/4229658407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53c41600a0 0x7f53c4071250 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f53b4005fd0 tx=0x7f53b402a710 comp rx=0 tx=0).stop 2024-09-17T03:10:58.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.849+0000 7f53c889b640 1 -- 172.21.15.78:0/4229658407 shutdown_connections 2024-09-17T03:10:58.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.849+0000 7f53c889b640 1 --2- 172.21.15.78:0/4229658407 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53c41600a0 0x7f53c4071250 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.849+0000 7f53c889b640 1 -- 172.21.15.78:0/4229658407 >> 172.21.15.78:0/4229658407 conn(0x7f53c40cdcb0 msgr2=0x7f53c40ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:58.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.849+0000 7f53c889b640 1 -- 172.21.15.78:0/4229658407 shutdown_connections 2024-09-17T03:10:58.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.849+0000 7f53c889b640 1 -- 172.21.15.78:0/4229658407 wait complete. 2024-09-17T03:10:58.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.851+0000 7f53c889b640 1 Processor -- start 2024-09-17T03:10:58.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.851+0000 7f53c889b640 1 -- start start 2024-09-17T03:10:58.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53c889b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f53c40ce7d0 0x7f53c40b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53c889b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53c41600a0 0x7f53c4143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53c889b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53c415bc30 0x7f53c415c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53c889b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f53c40d0540 con 0x7f53c415bc30 2024-09-17T03:10:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53c889b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f53c40d03c0 con 0x7f53c41600a0 2024-09-17T03:10:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53c889b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f53c40d06c0 con 0x7f53c40ce7d0 2024-09-17T03:10:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53c2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53c415bc30 0x7f53c415c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53c2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53c415bc30 0x7f53c415c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57628/0 (socket says 172.21.15.78:57628) 2024-09-17T03:10:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53c2d9d640 1 -- 172.21.15.78:0/2853795571 learned_addr learned my addr 172.21.15.78:0/2853795571 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53bbfff640 1 --2- 172.21.15.78:0/2853795571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53c41600a0 0x7f53c4143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53c259c640 1 --2- 172.21.15.78:0/2853795571 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f53c40ce7d0 0x7f53c40b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:58.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53c2d9d640 1 -- 172.21.15.78:0/2853795571 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f53c40ce7d0 msgr2=0x7f53c40b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:58.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53c2d9d640 1 --2- 172.21.15.78:0/2853795571 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f53c40ce7d0 0x7f53c40b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53c2d9d640 1 -- 172.21.15.78:0/2853795571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53c41600a0 msgr2=0x7f53c4143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:58.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53c2d9d640 1 --2- 172.21.15.78:0/2853795571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53c41600a0 0x7f53c4143be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53c2d9d640 1 -- 172.21.15.78:0/2853795571 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c415c580 con 0x7f53c415bc30 2024-09-17T03:10:58.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53c2d9d640 1 --2- 172.21.15.78:0/2853795571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53c415bc30 0x7f53c415c040 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00c730 tx=0x7f53bc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:58.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53baffd640 1 -- 172.21.15.78:0/2853795571 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc003b70 con 0x7f53c415bc30 2024-09-17T03:10:58.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53baffd640 1 -- 172.21.15.78:0/2853795571 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53bc003d30 con 0x7f53c415bc30 2024-09-17T03:10:58.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53baffd640 1 -- 172.21.15.78:0/2853795571 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc0052d0 con 0x7f53c415bc30 2024-09-17T03:10:58.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53c889b640 1 -- 172.21.15.78:0/2853795571 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c415aa10 con 0x7f53c415bc30 2024-09-17T03:10:58.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.853+0000 7f53c889b640 1 -- 172.21.15.78:0/2853795571 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c4157a70 con 0x7f53c415bc30 2024-09-17T03:10:58.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.856+0000 7f53baffd640 1 -- 172.21.15.78:0/2853795571 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f53bc005680 con 0x7f53c415bc30 2024-09-17T03:10:58.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.856+0000 7f53baffd640 1 --2- 172.21.15.78:0/2853795571 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f53a4078bc0 0x7f53a407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:58.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.856+0000 7f53baffd640 1 -- 172.21.15.78:0/2853795571 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f53bc09ab70 con 0x7f53c415bc30 2024-09-17T03:10:58.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.857+0000 7f53c259c640 1 --2- 172.21.15.78:0/2853795571 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f53a4078bc0 0x7f53a407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:58.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.857+0000 7f53cf80a740 1 Processor -- start 2024-09-17T03:10:58.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.857+0000 7f53cf80a740 1 -- start start 2024-09-17T03:10:58.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.857+0000 7f53c259c640 1 --2- 172.21.15.78:0/2853795571 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f53a4078bc0 0x7f53a407b0d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f53b4033000 tx=0x7f53b4004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:58.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.858+0000 7f53cf80a740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f78390 0x55ea72364a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:58.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.858+0000 7f53cf80a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea71f4f4d0 0x55ea72339860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:58.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.858+0000 7f53cf80a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f576b0 0x55ea72339da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:58.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.858+0000 7f53cf80a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ea72292a60 con 0x55ea71f576b0 2024-09-17T03:10:58.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.858+0000 7f53cf80a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ea72281e90 con 0x55ea71f4f4d0 2024-09-17T03:10:58.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.858+0000 7f53cf80a740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ea72285ca0 con 0x55ea71f78390 2024-09-17T03:10:58.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.859+0000 7f53c2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f576b0 0x55ea72339da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:58.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.859+0000 7f53c2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f576b0 0x55ea72339da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57640/0 (socket says 172.21.15.78:57640) 2024-09-17T03:10:58.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.859+0000 7f53c2d9d640 1 -- 172.21.15.78:0/3283611041 learned_addr learned my addr 172.21.15.78:0/3283611041 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:58.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.859+0000 7f53bbfff640 1 --2- 172.21.15.78:0/3283611041 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea71f4f4d0 0x55ea72339860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:58.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.859+0000 7f53c259c640 1 --2- 172.21.15.78:0/3283611041 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f78390 0x55ea72364a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:58.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.859+0000 7f53c2d9d640 1 -- 172.21.15.78:0/3283611041 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f78390 msgr2=0x55ea72364a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:58.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.859+0000 7f53c2d9d640 1 --2- 172.21.15.78:0/3283611041 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f78390 0x55ea72364a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.859+0000 7f53c2d9d640 1 -- 172.21.15.78:0/3283611041 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea71f4f4d0 msgr2=0x55ea72339860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:58.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.859+0000 7f53c2d9d640 1 --2- 172.21.15.78:0/3283611041 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea71f4f4d0 0x55ea72339860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.859+0000 7f53c2d9d640 1 -- 172.21.15.78:0/3283611041 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea7205a7d0 con 0x55ea71f576b0 2024-09-17T03:10:58.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.859+0000 7f53c2d9d640 1 --2- 172.21.15.78:0/3283611041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f576b0 0x55ea72339da0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f53bc099010 tx=0x7f53bc05ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9fc32a890d64e4b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.859+0000 7f53a3fff640 1 -- 172.21.15.78:0/3283611041 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc067420 con 0x55ea71f576b0 2024-09-17T03:10:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.859+0000 7f53a3fff640 1 -- 172.21.15.78:0/3283611041 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53bc06c2d0 con 0x55ea71f576b0 2024-09-17T03:10:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.859+0000 7f53a3fff640 1 -- 172.21.15.78:0/3283611041 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc06c0a0 con 0x55ea71f576b0 2024-09-17T03:10:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.860+0000 7f53cf80a740 1 -- 172.21.15.78:0/3283611041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f576b0 msgr2=0x55ea72339da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.860+0000 7f53cf80a740 1 --2- 172.21.15.78:0/3283611041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f576b0 0x55ea72339da0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f53bc099010 tx=0x7f53bc05ea40 comp rx=0 tx=0).stop 2024-09-17T03:10:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.860+0000 7f53cf80a740 1 -- 172.21.15.78:0/3283611041 shutdown_connections 2024-09-17T03:10:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.860+0000 7f53cf80a740 1 --2- 172.21.15.78:0/3283611041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f576b0 0x55ea72339da0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.860+0000 7f53cf80a740 1 --2- 172.21.15.78:0/3283611041 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea71f4f4d0 0x55ea72339860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.860+0000 7f53cf80a740 1 --2- 172.21.15.78:0/3283611041 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f78390 0x55ea72364a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.860+0000 7f53cf80a740 1 -- 172.21.15.78:0/3283611041 >> 172.21.15.78:0/3283611041 conn(0x55ea71f6c4e0 msgr2=0x55ea7231fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:58.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.860+0000 7f53cf80a740 1 -- 172.21.15.78:0/3283611041 shutdown_connections 2024-09-17T03:10:58.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.860+0000 7f53cf80a740 1 -- 172.21.15.78:0/3283611041 wait complete. 2024-09-17T03:10:58.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.861+0000 7f53cf80a740 1 -- start start 2024-09-17T03:10:58.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.861+0000 7f53cf80a740 1 Processor -- start 2024-09-17T03:10:58.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53cf80a740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f4f4d0 0x55ea72361730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:58.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53cf80a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea71f576b0 0x55ea7236d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:58.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53cf80a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f78390 0x55ea72373cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:58.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53cf80a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ea71ff2740 con 0x55ea71f78390 2024-09-17T03:10:58.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53cf80a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ea72227970 con 0x55ea71f576b0 2024-09-17T03:10:58.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53cf80a740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ea72292a60 con 0x55ea71f4f4d0 2024-09-17T03:10:58.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53cf80a740 10 client.0 _ll_register_callbacks cb 0x55ea72236780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:10:58.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53c2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f78390 0x55ea72373cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:58.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53c2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f78390 0x55ea72373cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57648/0 (socket says 172.21.15.78:57648) 2024-09-17T03:10:58.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53c259c640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f4f4d0 0x55ea72361730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:58.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53bbfff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea71f576b0 0x55ea7236d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:58.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53c2d9d640 1 -- 172.21.15.78:0/566707259 learned_addr learned my addr 172.21.15.78:0/566707259 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:58.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53c2d9d640 1 -- 172.21.15.78:0/566707259 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f4f4d0 msgr2=0x55ea72361730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:58.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53c2d9d640 1 --2- 172.21.15.78:0/566707259 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f4f4d0 0x55ea72361730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53c2d9d640 1 -- 172.21.15.78:0/566707259 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea71f576b0 msgr2=0x55ea7236d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:58.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53c2d9d640 1 --2- 172.21.15.78:0/566707259 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea71f576b0 0x55ea7236d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53c2d9d640 1 -- 172.21.15.78:0/566707259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea71fe3970 con 0x55ea71f78390 2024-09-17T03:10:58.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53c259c640 1 --2- 172.21.15.78:0/566707259 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f4f4d0 0x55ea72361730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:10:58.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53c2d9d640 1 --2- 172.21.15.78:0/566707259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f78390 0x55ea72373cc0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f53bc065010 tx=0x7f53bc05ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83161e2c360e2de server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:58.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:10:58.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53a17fa640 1 -- 172.21.15.78:0/566707259 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc067420 con 0x55ea71f78390 2024-09-17T03:10:58.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53a17fa640 1 -- 172.21.15.78:0/566707259 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f53bc06c050 con 0x55ea71f78390 2024-09-17T03:10:58.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53cf80a740 1 -- 172.21.15.78:0/566707259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53bc06c2d0 con 0x55ea71f78390 2024-09-17T03:10:58.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.863+0000 7f53a17fa640 1 -- 172.21.15.78:0/566707259 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f53bc006b30 con 0x55ea71f78390 2024-09-17T03:10:58.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.864+0000 7f53cf80a740 10 client.5808 fetch_fsmap learned FSMap version 36 2024-09-17T03:10:58.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.864+0000 7f53cf80a740 1 -- 172.21.15.78:0/566707259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55ea71fc16a0 con 0x55ea71f78390 2024-09-17T03:10:58.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.864+0000 7f53a17fa640 1 -- 172.21.15.78:0/566707259 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53bc06c2d0 con 0x55ea71f78390 2024-09-17T03:10:58.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.864+0000 7f53a17fa640 1 -- 172.21.15.78:0/566707259 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 36) ==== 3554+0+0 (secure 0 0 0) 0x7f53bc006cd0 con 0x55ea71f78390 2024-09-17T03:10:58.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.864+0000 7f53cf80a740 10 client.5808 fetch_fsmap finished waiting for FSMap version 36 2024-09-17T03:10:58.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.864+0000 7f53cf80a740 10 client.5808 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-09-17T03:10:58.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.864+0000 7f53cf80a740 20 client.5808 populate_metadata read hostname 'smithi078' 2024-09-17T03:10:58.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.864+0000 7f53cf80a740 1 --2- 172.21.15.78:0/566707259 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55ea71f36f60 0x55ea72335b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:58.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.864+0000 7f53cf80a740 4 client.5808 mds_command: new command op to 5565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:10:58.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.864+0000 7f53cf80a740 1 -- 172.21.15.78:0/566707259 --> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea722949b0 con 0x55ea71f36f60 2024-09-17T03:10:58.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.864+0000 7f53c259c640 1 --2- 172.21.15.78:0/566707259 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55ea71f36f60 0x55ea72335b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:58.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.864+0000 7f53a17fa640 10 client.5808 ms_handle_connect on v2:172.21.15.193:6834/1788096053 2024-09-17T03:10:58.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.864+0000 7f53c259c640 1 --2- 172.21.15.78:0/566707259 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55ea71f36f60 0x55ea72335b80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffc51c66cc86c344 server_cookie=1fb24ea067c73e0f in_seq=0 out_seq=0 2024-09-17T03:10:58.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.865+0000 7f53a17fa640 1 -- 172.21.15.78:0/566707259 <== mds.0 v2:172.21.15.193:6834/1788096053 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ea722949b0 con 0x55ea71f36f60 2024-09-17T03:10:58.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.865+0000 7f53a17fa640 10 client.5808 handle_command_reply: tid=0 2024-09-17T03:10:58.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.865+0000 7f53cf80a740 1 client.5808 shutdown 2024-09-17T03:10:58.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.865+0000 7f53cf80a740 1 -- 172.21.15.78:0/566707259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f78390 msgr2=0x55ea72373cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:58.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.865+0000 7f53cf80a740 1 --2- 172.21.15.78:0/566707259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f78390 0x55ea72373cc0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f53bc065010 tx=0x7f53bc05ef90 comp rx=0 tx=0).stop 2024-09-17T03:10:58.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.865+0000 7f53cf80a740 1 -- 172.21.15.78:0/566707259 shutdown_connections 2024-09-17T03:10:58.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.865+0000 7f53cf80a740 1 --2- 172.21.15.78:0/566707259 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55ea71f36f60 0x55ea72335b80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.865+0000 7f53cf80a740 1 --2- 172.21.15.78:0/566707259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f78390 0x55ea72373cc0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.865+0000 7f53cf80a740 1 --2- 172.21.15.78:0/566707259 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea71f576b0 0x55ea7236d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.865+0000 7f53cf80a740 1 --2- 172.21.15.78:0/566707259 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f4f4d0 0x55ea72361730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.865+0000 7f53a17fa640 0 client.5808 ms_handle_reset on v2:172.21.15.193:6834/1788096053 2024-09-17T03:10:58.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.865+0000 7f53cf80a740 1 -- 172.21.15.78:0/566707259 >> 172.21.15.78:0/566707259 conn(0x55ea71f6c4e0 msgr2=0x55ea72318e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:58.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.865+0000 7f53cf80a740 1 -- 172.21.15.78:0/566707259 shutdown_connections 2024-09-17T03:10:58.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.865+0000 7f53cf80a740 1 -- 172.21.15.78:0/566707259 wait complete. 2024-09-17T03:10:58.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.866+0000 7f53cf80a740 20 client.5808 trim_cache size 0 max 16384 2024-09-17T03:10:58.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.880+0000 7f53cf80a740 1 Processor -- start 2024-09-17T03:10:58.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.880+0000 7f53cf80a740 1 -- start start 2024-09-17T03:10:58.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.881+0000 7f53cf80a740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f4f4d0 0x55ea72349f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:58.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.881+0000 7f53cf80a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f576b0 0x55ea7234a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:58.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.881+0000 7f53cf80a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea71f78390 0x55ea7231a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:58.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.881+0000 7f53cf80a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f53c42001b0 con 0x55ea71f576b0 2024-09-17T03:10:58.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.881+0000 7f53cf80a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f53c41ff380 con 0x55ea71f78390 2024-09-17T03:10:58.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.881+0000 7f53cf80a740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f53c41ffa80 con 0x55ea71f4f4d0 2024-09-17T03:10:58.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.882+0000 7f53bbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f576b0 0x55ea7234a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:58.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.882+0000 7f53bbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f576b0 0x55ea7234a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57658/0 (socket says 172.21.15.78:57658) 2024-09-17T03:10:58.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.882+0000 7f53bbfff640 1 -- 172.21.15.78:0/1011262767 learned_addr learned my addr 172.21.15.78:0/1011262767 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:58.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.882+0000 7f53c2d9d640 1 --2- 172.21.15.78:0/1011262767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea71f78390 0x55ea7231a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:58.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.882+0000 7f53c259c640 1 --2- 172.21.15.78:0/1011262767 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f4f4d0 0x55ea72349f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:58.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.882+0000 7f53bbfff640 1 -- 172.21.15.78:0/1011262767 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f4f4d0 msgr2=0x55ea72349f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:58.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.882+0000 7f53bbfff640 1 --2- 172.21.15.78:0/1011262767 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f4f4d0 0x55ea72349f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.882+0000 7f53bbfff640 1 -- 172.21.15.78:0/1011262767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea71f78390 msgr2=0x55ea7231a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:58.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.882+0000 7f53bbfff640 1 --2- 172.21.15.78:0/1011262767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea71f78390 0x55ea7231a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.882+0000 7f53bbfff640 1 -- 172.21.15.78:0/1011262767 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea723398b0 con 0x55ea71f576b0 2024-09-17T03:10:58.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.882+0000 7f53bbfff640 1 --2- 172.21.15.78:0/1011262767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f576b0 0x55ea7234a4b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f53ac0018a0 tx=0x7f53ac007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fafe94ff53d9a3f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:58.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.882+0000 7f53a37fe640 1 -- 172.21.15.78:0/1011262767 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac0053e0 con 0x55ea71f576b0 2024-09-17T03:10:58.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.882+0000 7f53a37fe640 1 -- 172.21.15.78:0/1011262767 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53ac015ac0 con 0x55ea71f576b0 2024-09-17T03:10:58.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.882+0000 7f53a37fe640 1 -- 172.21.15.78:0/1011262767 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53ac015e90 con 0x55ea71f576b0 2024-09-17T03:10:58.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.883+0000 7f53cf80a740 1 -- 172.21.15.78:0/1011262767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f576b0 msgr2=0x55ea7234a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:58.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.883+0000 7f53cf80a740 1 --2- 172.21.15.78:0/1011262767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f576b0 0x55ea7234a4b0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f53ac0018a0 tx=0x7f53ac007df0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.883+0000 7f53cf80a740 1 -- 172.21.15.78:0/1011262767 shutdown_connections 2024-09-17T03:10:58.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.883+0000 7f53cf80a740 1 --2- 172.21.15.78:0/1011262767 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea71f78390 0x55ea7231a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.883+0000 7f53cf80a740 1 --2- 172.21.15.78:0/1011262767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f576b0 0x55ea7234a4b0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.883+0000 7f53cf80a740 1 --2- 172.21.15.78:0/1011262767 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f4f4d0 0x55ea72349f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.883+0000 7f53cf80a740 1 -- 172.21.15.78:0/1011262767 >> 172.21.15.78:0/1011262767 conn(0x55ea71f6c4e0 msgr2=0x55ea72361560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:58.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.883+0000 7f53cf80a740 1 -- 172.21.15.78:0/1011262767 shutdown_connections 2024-09-17T03:10:58.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.883+0000 7f53cf80a740 1 -- 172.21.15.78:0/1011262767 wait complete. 2024-09-17T03:10:58.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.884+0000 7f53cf80a740 1 -- start start 2024-09-17T03:10:58.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.884+0000 7f53cf80a740 1 Processor -- start 2024-09-17T03:10:58.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.885+0000 7f53cf80a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f4f4d0 0x55ea7236d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:58.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.885+0000 7f53cf80a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea71f576b0 0x55ea72349f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:58.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.885+0000 7f53cf80a740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f78390 0x55ea7234a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:58.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.885+0000 7f53cf80a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f53c4142de0 con 0x55ea71f4f4d0 2024-09-17T03:10:58.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.885+0000 7f53cf80a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ea72376780 con 0x55ea71f576b0 2024-09-17T03:10:58.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.885+0000 7f53cf80a740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ea723e32b0 con 0x55ea71f78390 2024-09-17T03:10:58.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.885+0000 7f53cf80a740 10 client.0 _ll_register_callbacks cb 0x7f53ac001240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:10:58.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.885+0000 7f53c259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f4f4d0 0x55ea7236d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:58.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.885+0000 7f53c259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f4f4d0 0x55ea7236d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57666/0 (socket says 172.21.15.78:57666) 2024-09-17T03:10:58.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.885+0000 7f53c259c640 1 -- 172.21.15.78:0/273311316 learned_addr learned my addr 172.21.15.78:0/273311316 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:58.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.886+0000 7f53bbfff640 1 --2- 172.21.15.78:0/273311316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea71f576b0 0x55ea72349f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:58.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.886+0000 7f53c2d9d640 1 --2- 172.21.15.78:0/273311316 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f78390 0x55ea7234a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:58.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.886+0000 7f53c259c640 1 -- 172.21.15.78:0/273311316 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f78390 msgr2=0x55ea7234a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:58.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.886+0000 7f53c259c640 1 --2- 172.21.15.78:0/273311316 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f78390 0x55ea7234a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.886+0000 7f53c259c640 1 -- 172.21.15.78:0/273311316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea71f576b0 msgr2=0x55ea72349f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:58.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.886+0000 7f53c259c640 1 --2- 172.21.15.78:0/273311316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea71f576b0 0x55ea72349f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.886+0000 7f53c259c640 1 -- 172.21.15.78:0/273311316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea7236de20 con 0x55ea71f4f4d0 2024-09-17T03:10:58.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.886+0000 7f53c2d9d640 1 --2- 172.21.15.78:0/273311316 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f78390 0x55ea7234a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:58.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.886+0000 7f53c259c640 1 --2- 172.21.15.78:0/273311316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f4f4d0 0x55ea7236d8e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f53b4000c00 tx=0x7f53b402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8a39a23b7391df server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:58.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.886+0000 7f53a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:10:58.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.886+0000 7f53a17fa640 1 -- 172.21.15.78:0/273311316 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b405a060 con 0x55ea71f4f4d0 2024-09-17T03:10:58.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.886+0000 7f53a17fa640 1 -- 172.21.15.78:0/273311316 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f53b40049a0 con 0x55ea71f4f4d0 2024-09-17T03:10:58.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.886+0000 7f53cf80a740 1 -- 172.21.15.78:0/273311316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53ac015ac0 con 0x55ea71f4f4d0 2024-09-17T03:10:58.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.886+0000 7f53a17fa640 1 -- 172.21.15.78:0/273311316 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f53b4060050 con 0x55ea71f4f4d0 2024-09-17T03:10:58.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.886+0000 7f53cf80a740 10 client.5814 fetch_fsmap learned FSMap version 36 2024-09-17T03:10:58.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.886+0000 7f53cf80a740 1 -- 172.21.15.78:0/273311316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55ea723e2af0 con 0x55ea71f4f4d0 2024-09-17T03:10:58.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.886+0000 7f53a17fa640 1 -- 172.21.15.78:0/273311316 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53ac015ac0 con 0x55ea71f4f4d0 2024-09-17T03:10:58.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.886+0000 7f53a17fa640 1 -- 172.21.15.78:0/273311316 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 36) ==== 3554+0+0 (secure 0 0 0) 0x7f53b4063020 con 0x55ea71f4f4d0 2024-09-17T03:10:58.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.887+0000 7f53cf80a740 10 client.5814 fetch_fsmap finished waiting for FSMap version 36 2024-09-17T03:10:58.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.887+0000 7f53cf80a740 10 client.5814 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-09-17T03:10:58.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.887+0000 7f53cf80a740 20 client.5814 populate_metadata read hostname 'smithi078' 2024-09-17T03:10:58.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.887+0000 7f53cf80a740 1 --2- 172.21.15.78:0/273311316 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55ea72386ad0 0x55ea723e6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:58.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.887+0000 7f53cf80a740 4 client.5814 mds_command: new command op to 5565 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T03:10:58.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.887+0000 7f53cf80a740 1 -- 172.21.15.78:0/273311316 --> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ea72290460 con 0x55ea72386ad0 2024-09-17T03:10:58.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.887+0000 7f53bbfff640 1 --2- 172.21.15.78:0/273311316 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55ea72386ad0 0x55ea723e6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:58.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.887+0000 7f53a17fa640 10 client.5814 ms_handle_connect on v2:172.21.15.193:6834/1788096053 2024-09-17T03:10:58.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.887+0000 7f53bbfff640 1 --2- 172.21.15.78:0/273311316 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55ea72386ad0 0x55ea723e6610 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61b233226daeda48 server_cookie=1803092afe9201b6 in_seq=0 out_seq=0 2024-09-17T03:10:58.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.901+0000 7f53a17fa640 1 -- 172.21.15.78:0/273311316 <== mds.0 v2:172.21.15.193:6834/1788096053 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ea72290460 con 0x55ea72386ad0 2024-09-17T03:10:58.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.901+0000 7f53a17fa640 10 client.5814 handle_command_reply: tid=0 2024-09-17T03:10:58.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.901+0000 7f53cf80a740 1 client.5814 shutdown 2024-09-17T03:10:58.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.902+0000 7f53cf80a740 1 -- 172.21.15.78:0/273311316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f4f4d0 msgr2=0x55ea7236d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:58.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.902+0000 7f53cf80a740 1 --2- 172.21.15.78:0/273311316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f4f4d0 0x55ea7236d8e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f53b4000c00 tx=0x7f53b402a710 comp rx=0 tx=0).stop 2024-09-17T03:10:58.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.902+0000 7f53cf80a740 1 -- 172.21.15.78:0/273311316 shutdown_connections 2024-09-17T03:10:58.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.902+0000 7f53cf80a740 1 --2- 172.21.15.78:0/273311316 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55ea72386ad0 0x55ea723e6610 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.902+0000 7f53cf80a740 1 --2- 172.21.15.78:0/273311316 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea71f78390 0x55ea7234a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.902+0000 7f53cf80a740 1 --2- 172.21.15.78:0/273311316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea71f576b0 0x55ea72349f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.902+0000 7f53cf80a740 1 --2- 172.21.15.78:0/273311316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea71f4f4d0 0x55ea7236d8e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.902+0000 7f53a17fa640 0 client.5814 ms_handle_reset on v2:172.21.15.193:6834/1788096053 2024-09-17T03:10:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.902+0000 7f53cf80a740 1 -- 172.21.15.78:0/273311316 >> 172.21.15.78:0/273311316 conn(0x55ea71f6c4e0 msgr2=0x55ea7231f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.902+0000 7f53cf80a740 1 -- 172.21.15.78:0/273311316 shutdown_connections 2024-09-17T03:10:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.902+0000 7f53cf80a740 1 -- 172.21.15.78:0/273311316 wait complete. 2024-09-17T03:10:58.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.902+0000 7f53cf80a740 20 client.5814 trim_cache size 0 max 16384 2024-09-17T03:10:58.902 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:10:58.902 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:10:58.903 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:10:58.903 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:10:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.902+0000 7f53c889b640 1 -- 172.21.15.78:0/2853795571 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f53a4078bc0 msgr2=0x7f53a407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.902+0000 7f53c889b640 1 --2- 172.21.15.78:0/2853795571 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f53a4078bc0 0x7f53a407b0d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f53b4033000 tx=0x7f53b4004730 comp rx=0 tx=0).stop 2024-09-17T03:10:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.902+0000 7f53c889b640 1 -- 172.21.15.78:0/2853795571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53c415bc30 msgr2=0x7f53c415c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.902+0000 7f53c889b640 1 --2- 172.21.15.78:0/2853795571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53c415bc30 0x7f53c415c040 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00c730 tx=0x7f53bc00cbf0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.903+0000 7f53c889b640 1 -- 172.21.15.78:0/2853795571 shutdown_connections 2024-09-17T03:10:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.903+0000 7f53c889b640 1 --2- 172.21.15.78:0/2853795571 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53c415bc30 0x7f53c415c040 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.903+0000 7f53c889b640 1 --2- 172.21.15.78:0/2853795571 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f53a4078bc0 0x7f53a407b0d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.903+0000 7f53c889b640 1 --2- 172.21.15.78:0/2853795571 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53c41600a0 0x7f53c4143be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.903+0000 7f53c889b640 1 --2- 172.21.15.78:0/2853795571 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f53c40ce7d0 0x7f53c40b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.903+0000 7f53c889b640 1 -- 172.21.15.78:0/2853795571 >> 172.21.15.78:0/2853795571 conn(0x7f53c40cdcb0 msgr2=0x7f53c40ae640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.903+0000 7f53c889b640 1 -- 172.21.15.78:0/2853795571 shutdown_connections 2024-09-17T03:10:58.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:58.903+0000 7f53c889b640 1 -- 172.21.15.78:0/2853795571 wait complete. 2024-09-17T03:10:58.913 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:1 flush journal 2024-09-17T03:10:59.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.028+0000 7f42db120640 1 -- 172.21.15.78:0/2858139747 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42d41600a0 msgr2=0x7f42d4071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:59.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.028+0000 7f42db120640 1 --2- 172.21.15.78:0/2858139747 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42d41600a0 0x7f42d4071250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f42c4009830 tx=0x7f42c402a5a0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.028+0000 7f42db120640 1 -- 172.21.15.78:0/2858139747 shutdown_connections 2024-09-17T03:10:59.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.028+0000 7f42db120640 1 --2- 172.21.15.78:0/2858139747 >> v2:172.21.15.193:3300/0 conn(0x7f42d406d4f0 0x7f42d40cfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.028+0000 7f42db120640 1 --2- 172.21.15.78:0/2858139747 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42d41600a0 0x7f42d4071250 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.028+0000 7f42db120640 1 -- 172.21.15.78:0/2858139747 >> 172.21.15.78:0/2858139747 conn(0x7f42d40cdcb0 msgr2=0x7f42d40ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:59.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.028+0000 7f42db120640 1 -- 172.21.15.78:0/2858139747 shutdown_connections 2024-09-17T03:10:59.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.028+0000 7f42db120640 1 -- 172.21.15.78:0/2858139747 wait complete. 2024-09-17T03:10:59.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.030+0000 7f42db120640 1 Processor -- start 2024-09-17T03:10:59.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.030+0000 7f42db120640 1 -- start start 2024-09-17T03:10:59.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42db120640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d40ce7d0 0x7f42d41f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42db120640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d41600a0 0x7f42d41f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42db120640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42d41f7290 0x7f42d415e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42db120640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f42d40d0370 con 0x7f42d41600a0 2024-09-17T03:10:59.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42db120640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f42d40d01f0 con 0x7f42d40ce7d0 2024-09-17T03:10:59.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42db120640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f42d40d04f0 con 0x7f42d41f7290 2024-09-17T03:10:59.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42d3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d41600a0 0x7f42d41f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42d3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d41600a0 0x7f42d41f2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57668/0 (socket says 172.21.15.78:57668) 2024-09-17T03:10:59.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42d3fff640 1 -- 172.21.15.78:0/2884289339 learned_addr learned my addr 172.21.15.78:0/2884289339 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:59.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42d8ebc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d40ce7d0 0x7f42d41f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42d96bd640 1 --2- 172.21.15.78:0/2884289339 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42d41f7290 0x7f42d415e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42d3fff640 1 -- 172.21.15.78:0/2884289339 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42d41f7290 msgr2=0x7f42d415e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:59.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42d3fff640 1 --2- 172.21.15.78:0/2884289339 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42d41f7290 0x7f42d415e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42d3fff640 1 -- 172.21.15.78:0/2884289339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d40ce7d0 msgr2=0x7f42d41f3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:59.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42d3fff640 1 --2- 172.21.15.78:0/2884289339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d40ce7d0 0x7f42d41f3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42d3fff640 1 -- 172.21.15.78:0/2884289339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d41f2eb0 con 0x7f42d41600a0 2024-09-17T03:10:59.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42d8ebc640 1 --2- 172.21.15.78:0/2884289339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d40ce7d0 0x7f42d41f3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:10:59.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42d3fff640 1 --2- 172.21.15.78:0/2884289339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d41600a0 0x7f42d41f2970 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f42c8007fd0 tx=0x7f42c800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:59.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42d17fa640 1 -- 172.21.15.78:0/2884289339 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8011790 con 0x7f42d41600a0 2024-09-17T03:10:59.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42d17fa640 1 -- 172.21.15.78:0/2884289339 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42c8017070 con 0x7f42d41600a0 2024-09-17T03:10:59.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42db120640 1 -- 172.21.15.78:0/2884289339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d40b2270 con 0x7f42d41600a0 2024-09-17T03:10:59.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42d17fa640 1 -- 172.21.15.78:0/2884289339 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8011d40 con 0x7f42d41600a0 2024-09-17T03:10:59.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.032+0000 7f42db120640 1 -- 172.21.15.78:0/2884289339 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d41f6a90 con 0x7f42d41600a0 2024-09-17T03:10:59.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.034+0000 7f42d17fa640 1 -- 172.21.15.78:0/2884289339 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f42c801c460 con 0x7f42d41600a0 2024-09-17T03:10:59.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.035+0000 7f42d17fa640 1 --2- 172.21.15.78:0/2884289339 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42c0078b90 0x7f42c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.035+0000 7f42d17fa640 1 -- 172.21.15.78:0/2884289339 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f42c809a980 con 0x7f42d41600a0 2024-09-17T03:10:59.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.035+0000 7f42d8ebc640 1 --2- 172.21.15.78:0/2884289339 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42c0078b90 0x7f42c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.035+0000 7f42d8ebc640 1 --2- 172.21.15.78:0/2884289339 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42c0078b90 0x7f42c007b0a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f42c4034000 tx=0x7f42c4004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:59.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.036+0000 7f42e208a740 1 Processor -- start 2024-09-17T03:10:59.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.036+0000 7f42e208a740 1 -- start start 2024-09-17T03:10:59.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.037+0000 7f42e208a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c90990390 0x563c90d7da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.037+0000 7f42e208a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c909674d0 0x563c90d33530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.037+0000 7f42e208a740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c9096f6b0 0x563c90d5e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.037+0000 7f42e208a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x563c90caaa60 con 0x563c90990390 2024-09-17T03:10:59.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.037+0000 7f42e208a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563c90c99e90 con 0x563c909674d0 2024-09-17T03:10:59.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.037+0000 7f42e208a740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x563c90c9dca0 con 0x563c9096f6b0 2024-09-17T03:10:59.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.037+0000 7f42d8ebc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c90990390 0x563c90d7da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.037+0000 7f42d8ebc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c90990390 0x563c90d7da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57670/0 (socket says 172.21.15.78:57670) 2024-09-17T03:10:59.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.037+0000 7f42d8ebc640 1 -- 172.21.15.78:0/3456530539 learned_addr learned my addr 172.21.15.78:0/3456530539 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:59.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.037+0000 7f42d3fff640 1 --2- 172.21.15.78:0/3456530539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c909674d0 0x563c90d33530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.037+0000 7f42d96bd640 1 --2- 172.21.15.78:0/3456530539 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c9096f6b0 0x563c90d5e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.037+0000 7f42d8ebc640 1 -- 172.21.15.78:0/3456530539 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c9096f6b0 msgr2=0x563c90d5e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:59.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.037+0000 7f42d8ebc640 1 --2- 172.21.15.78:0/3456530539 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c9096f6b0 0x563c90d5e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.037+0000 7f42d8ebc640 1 -- 172.21.15.78:0/3456530539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c909674d0 msgr2=0x563c90d33530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:59.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.037+0000 7f42d8ebc640 1 --2- 172.21.15.78:0/3456530539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c909674d0 0x563c90d33530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.037+0000 7f42d8ebc640 1 -- 172.21.15.78:0/3456530539 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c90a727d0 con 0x563c90990390 2024-09-17T03:10:59.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.038+0000 7f42d8ebc640 1 --2- 172.21.15.78:0/3456530539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c90990390 0x563c90d7da50 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f42c4005eb0 tx=0x7f42c403e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6727b61f27613c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:59.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.038+0000 7f42ba7fc640 1 -- 172.21.15.78:0/3456530539 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c4003af0 con 0x563c90990390 2024-09-17T03:10:59.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.038+0000 7f42ba7fc640 1 -- 172.21.15.78:0/3456530539 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42c4003c90 con 0x563c90990390 2024-09-17T03:10:59.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.038+0000 7f42ba7fc640 1 -- 172.21.15.78:0/3456530539 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c40456c0 con 0x563c90990390 2024-09-17T03:10:59.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.038+0000 7f42e208a740 1 -- 172.21.15.78:0/3456530539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c90990390 msgr2=0x563c90d7da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:59.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.038+0000 7f42e208a740 1 --2- 172.21.15.78:0/3456530539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c90990390 0x563c90d7da50 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f42c4005eb0 tx=0x7f42c403e040 comp rx=0 tx=0).stop 2024-09-17T03:10:59.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.039+0000 7f42e208a740 1 -- 172.21.15.78:0/3456530539 shutdown_connections 2024-09-17T03:10:59.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.039+0000 7f42e208a740 1 --2- 172.21.15.78:0/3456530539 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c9096f6b0 0x563c90d5e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.039+0000 7f42e208a740 1 --2- 172.21.15.78:0/3456530539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c909674d0 0x563c90d33530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.039+0000 7f42e208a740 1 --2- 172.21.15.78:0/3456530539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c90990390 0x563c90d7da50 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.039+0000 7f42e208a740 1 -- 172.21.15.78:0/3456530539 >> 172.21.15.78:0/3456530539 conn(0x563c909844e0 msgr2=0x563c90d37d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:59.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.039+0000 7f42e208a740 1 -- 172.21.15.78:0/3456530539 shutdown_connections 2024-09-17T03:10:59.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.039+0000 7f42e208a740 1 -- 172.21.15.78:0/3456530539 wait complete. 2024-09-17T03:10:59.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.039+0000 7f42e208a740 1 -- start start 2024-09-17T03:10:59.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.040+0000 7f42e208a740 1 Processor -- start 2024-09-17T03:10:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.041+0000 7f42e208a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c909674d0 0x563c90d5f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.041+0000 7f42e208a740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c9096f6b0 0x563c90d94440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.041+0000 7f42e208a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c90990390 0x563c90d90550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.041+0000 7f42e208a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x563c90a0a740 con 0x563c90990390 2024-09-17T03:10:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.041+0000 7f42e208a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563c90c3f970 con 0x563c909674d0 2024-09-17T03:10:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.041+0000 7f42e208a740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x563c90d93e90 con 0x563c9096f6b0 2024-09-17T03:10:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.041+0000 7f42e208a740 10 client.0 _ll_register_callbacks cb 0x563c90c4e780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:10:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.041+0000 7f42d96bd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c90990390 0x563c90d90550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.041+0000 7f42d96bd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c90990390 0x563c90d90550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57678/0 (socket says 172.21.15.78:57678) 2024-09-17T03:10:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.041+0000 7f42d96bd640 1 -- 172.21.15.78:0/2810690188 learned_addr learned my addr 172.21.15.78:0/2810690188 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:59.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.041+0000 7f42d8ebc640 1 --2- 172.21.15.78:0/2810690188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c909674d0 0x563c90d5f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.041+0000 7f42d3fff640 1 --2- 172.21.15.78:0/2810690188 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c9096f6b0 0x563c90d94440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.041+0000 7f42d96bd640 1 -- 172.21.15.78:0/2810690188 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c9096f6b0 msgr2=0x563c90d94440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:59.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.041+0000 7f42d96bd640 1 --2- 172.21.15.78:0/2810690188 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c9096f6b0 0x563c90d94440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.041+0000 7f42d96bd640 1 -- 172.21.15.78:0/2810690188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c909674d0 msgr2=0x563c90d5f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:59.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.041+0000 7f42d96bd640 1 --2- 172.21.15.78:0/2810690188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c909674d0 0x563c90d5f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.041+0000 7f42d96bd640 1 -- 172.21.15.78:0/2810690188 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c909fb970 con 0x563c90990390 2024-09-17T03:10:59.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.042+0000 7f42d96bd640 1 --2- 172.21.15.78:0/2810690188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c90990390 0x563c90d90550 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f42d40cf1e0 tx=0x7f42cc012d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee43d31994c62ec server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:59.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.042+0000 7f42b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:10:59.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.042+0000 7f42b37fe640 1 -- 172.21.15.78:0/2810690188 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc004b20 con 0x563c90990390 2024-09-17T03:10:59.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.042+0000 7f42b37fe640 1 -- 172.21.15.78:0/2810690188 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f42cc004cc0 con 0x563c90990390 2024-09-17T03:10:59.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.042+0000 7f42e208a740 1 -- 172.21.15.78:0/2810690188 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42c4003c90 con 0x563c90990390 2024-09-17T03:10:59.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.042+0000 7f42b37fe640 1 -- 172.21.15.78:0/2810690188 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f42cc024050 con 0x563c90990390 2024-09-17T03:10:59.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.042+0000 7f42e208a740 10 client.5823 fetch_fsmap learned FSMap version 36 2024-09-17T03:10:59.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.042+0000 7f42e208a740 1 -- 172.21.15.78:0/2810690188 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x563c909d96a0 con 0x563c90990390 2024-09-17T03:10:59.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.042+0000 7f42b37fe640 1 -- 172.21.15.78:0/2810690188 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42c4003c90 con 0x563c90990390 2024-09-17T03:10:59.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.042+0000 7f42b37fe640 1 -- 172.21.15.78:0/2810690188 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 36) ==== 3554+0+0 (secure 0 0 0) 0x7f42cc027020 con 0x563c90990390 2024-09-17T03:10:59.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.042+0000 7f42e208a740 10 client.5823 fetch_fsmap finished waiting for FSMap version 36 2024-09-17T03:10:59.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.042+0000 7f42e208a740 10 client.5823 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.d 2024-09-17T03:10:59.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.042+0000 7f42e208a740 20 client.5823 populate_metadata read hostname 'smithi078' 2024-09-17T03:10:59.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.042+0000 7f42e208a740 1 --2- 172.21.15.78:0/2810690188 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x563c9094ef60 0x563c90d75b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.042+0000 7f42e208a740 4 client.5823 mds_command: new command op to 5039 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:10:59.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.042+0000 7f42e208a740 1 -- 172.21.15.78:0/2810690188 --> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c90cac9b0 con 0x563c9094ef60 2024-09-17T03:10:59.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.042+0000 7f42d8ebc640 1 --2- 172.21.15.78:0/2810690188 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x563c9094ef60 0x563c90d75b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.043+0000 7f42d8ebc640 1 --2- 172.21.15.78:0/2810690188 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x563c9094ef60 0x563c90d75b00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=96f4d538ebe433dd server_cookie=2076e3c8b8ee160e in_seq=0 out_seq=0 2024-09-17T03:10:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.043+0000 7f42b37fe640 10 client.5823 ms_handle_connect on v2:172.21.15.193:6835/3209848332 2024-09-17T03:10:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.043+0000 7f42b37fe640 1 -- 172.21.15.78:0/2810690188 <== mds.1 v2:172.21.15.193:6835/3209848332 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563c90cac9b0 con 0x563c9094ef60 2024-09-17T03:10:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.043+0000 7f42b37fe640 10 client.5823 handle_command_reply: tid=0 2024-09-17T03:10:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.043+0000 7f42e208a740 1 client.5823 shutdown 2024-09-17T03:10:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.044+0000 7f42e208a740 1 -- 172.21.15.78:0/2810690188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c90990390 msgr2=0x563c90d90550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.044+0000 7f42e208a740 1 --2- 172.21.15.78:0/2810690188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c90990390 0x563c90d90550 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f42d40cf1e0 tx=0x7f42cc012d70 comp rx=0 tx=0).stop 2024-09-17T03:10:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.044+0000 7f42e208a740 1 -- 172.21.15.78:0/2810690188 shutdown_connections 2024-09-17T03:10:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.044+0000 7f42e208a740 1 --2- 172.21.15.78:0/2810690188 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x563c9094ef60 0x563c90d75b00 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.044+0000 7f42e208a740 1 --2- 172.21.15.78:0/2810690188 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c90990390 0x563c90d90550 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.044+0000 7f42e208a740 1 --2- 172.21.15.78:0/2810690188 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c9096f6b0 0x563c90d94440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.044+0000 7f42b37fe640 0 client.5823 ms_handle_reset on v2:172.21.15.193:6835/3209848332 2024-09-17T03:10:59.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.044+0000 7f42e208a740 1 --2- 172.21.15.78:0/2810690188 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c909674d0 0x563c90d5f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.044+0000 7f42e208a740 1 -- 172.21.15.78:0/2810690188 >> 172.21.15.78:0/2810690188 conn(0x563c909844e0 msgr2=0x563c90d38c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:59.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.044+0000 7f42e208a740 1 -- 172.21.15.78:0/2810690188 shutdown_connections 2024-09-17T03:10:59.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.044+0000 7f42e208a740 1 -- 172.21.15.78:0/2810690188 wait complete. 2024-09-17T03:10:59.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.044+0000 7f42e208a740 20 client.5823 trim_cache size 0 max 16384 2024-09-17T03:10:59.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.059+0000 7f42e208a740 1 Processor -- start 2024-09-17T03:10:59.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.059+0000 7f42e208a740 1 -- start start 2024-09-17T03:10:59.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.060+0000 7f42e208a740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c9094ef60 0x563c90d4f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.060+0000 7f42e208a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c909674d0 0x563c90da4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.060+0000 7f42e208a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c9096f6b0 0x563c90d334c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.060+0000 7f42e208a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f42d41fda80 con 0x563c909674d0 2024-09-17T03:10:59.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.060+0000 7f42e208a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f42d40cd020 con 0x563c9096f6b0 2024-09-17T03:10:59.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.060+0000 7f42e208a740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f42d40cd720 con 0x563c9094ef60 2024-09-17T03:10:59.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.060+0000 7f42d3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c909674d0 0x563c90da4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.060+0000 7f42d3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c909674d0 0x563c90da4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57688/0 (socket says 172.21.15.78:57688) 2024-09-17T03:10:59.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.060+0000 7f42d3fff640 1 -- 172.21.15.78:0/3876038898 learned_addr learned my addr 172.21.15.78:0/3876038898 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:59.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.060+0000 7f42d3fff640 1 -- 172.21.15.78:0/3876038898 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c9094ef60 msgr2=0x563c90d4f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:59.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.060+0000 7f42d3fff640 1 --2- 172.21.15.78:0/3876038898 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c9094ef60 0x563c90d4f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.060+0000 7f42d3fff640 1 -- 172.21.15.78:0/3876038898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c9096f6b0 msgr2=0x563c90d334c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:59.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.060+0000 7f42d96bd640 1 --2- 172.21.15.78:0/3876038898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c9096f6b0 0x563c90d334c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.060+0000 7f42d3fff640 1 --2- 172.21.15.78:0/3876038898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c9096f6b0 0x563c90d334c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.060+0000 7f42d3fff640 1 -- 172.21.15.78:0/3876038898 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c90d397c0 con 0x563c909674d0 2024-09-17T03:10:59.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.060+0000 7f42d3fff640 1 --2- 172.21.15.78:0/3876038898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c909674d0 0x563c90da4800 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f42c8001220 tx=0x7f42c8062650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f1cefe34d3803c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:59.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.061+0000 7f42b9ffb640 1 -- 172.21.15.78:0/3876038898 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8062e60 con 0x563c909674d0 2024-09-17T03:10:59.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.061+0000 7f42b9ffb640 1 -- 172.21.15.78:0/3876038898 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42c8062760 con 0x563c909674d0 2024-09-17T03:10:59.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.061+0000 7f42b9ffb640 1 -- 172.21.15.78:0/3876038898 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8061c00 con 0x563c909674d0 2024-09-17T03:10:59.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.061+0000 7f42e208a740 1 -- 172.21.15.78:0/3876038898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c909674d0 msgr2=0x563c90da4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:59.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.061+0000 7f42e208a740 1 --2- 172.21.15.78:0/3876038898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c909674d0 0x563c90da4800 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f42c8001220 tx=0x7f42c8062650 comp rx=0 tx=0).stop 2024-09-17T03:10:59.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.061+0000 7f42e208a740 1 -- 172.21.15.78:0/3876038898 shutdown_connections 2024-09-17T03:10:59.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.061+0000 7f42e208a740 1 --2- 172.21.15.78:0/3876038898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c9096f6b0 0x563c90d334c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.061+0000 7f42e208a740 1 --2- 172.21.15.78:0/3876038898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c909674d0 0x563c90da4800 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.061+0000 7f42e208a740 1 --2- 172.21.15.78:0/3876038898 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c9094ef60 0x563c90d4f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.061+0000 7f42e208a740 1 -- 172.21.15.78:0/3876038898 >> 172.21.15.78:0/3876038898 conn(0x563c909844e0 msgr2=0x563c90d38e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:59.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.061+0000 7f42e208a740 1 -- 172.21.15.78:0/3876038898 shutdown_connections 2024-09-17T03:10:59.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.061+0000 7f42e208a740 1 -- 172.21.15.78:0/3876038898 wait complete. 2024-09-17T03:10:59.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.062+0000 7f42e208a740 1 -- start start 2024-09-17T03:10:59.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.062+0000 7f42e208a740 1 Processor -- start 2024-09-17T03:10:59.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42e208a740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c9094ef60 0x563c90d59340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42e208a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c909674d0 0x563c90e04340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42e208a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c9096f6b0 0x563c90dfa310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42e208a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f42d41e5fa0 con 0x563c9096f6b0 2024-09-17T03:10:59.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42e208a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563c90e01030 con 0x563c909674d0 2024-09-17T03:10:59.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42e208a740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x563c90da45b0 con 0x563c9094ef60 2024-09-17T03:10:59.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42e208a740 10 client.0 _ll_register_callbacks cb 0x7f42cc0099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:10:59.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42d96bd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c9096f6b0 0x563c90dfa310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42d96bd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c9096f6b0 0x563c90dfa310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57692/0 (socket says 172.21.15.78:57692) 2024-09-17T03:10:59.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42d96bd640 1 -- 172.21.15.78:0/2259395441 learned_addr learned my addr 172.21.15.78:0/2259395441 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:59.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42d8ebc640 1 --2- 172.21.15.78:0/2259395441 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c9094ef60 0x563c90d59340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42d3fff640 1 --2- 172.21.15.78:0/2259395441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c909674d0 0x563c90e04340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42d96bd640 1 -- 172.21.15.78:0/2259395441 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c9094ef60 msgr2=0x563c90d59340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:59.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42d96bd640 1 --2- 172.21.15.78:0/2259395441 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c9094ef60 0x563c90d59340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42d96bd640 1 -- 172.21.15.78:0/2259395441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c909674d0 msgr2=0x563c90e04340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:59.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42d96bd640 1 --2- 172.21.15.78:0/2259395441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c909674d0 0x563c90e04340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42d96bd640 1 -- 172.21.15.78:0/2259395441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c90e04880 con 0x563c9096f6b0 2024-09-17T03:10:59.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42d96bd640 1 --2- 172.21.15.78:0/2259395441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c9096f6b0 0x563c90dfa310 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f42cc009600 tx=0x7f42cc004a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f687b7deb7c50a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:59.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:10:59.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42b37fe640 1 -- 172.21.15.78:0/2259395441 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc02e060 con 0x563c9096f6b0 2024-09-17T03:10:59.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42b37fe640 1 -- 172.21.15.78:0/2259395441 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f42cc002030 con 0x563c9096f6b0 2024-09-17T03:10:59.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.064+0000 7f42e208a740 1 -- 172.21.15.78:0/2259395441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42c8062760 con 0x563c9096f6b0 2024-09-17T03:10:59.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.065+0000 7f42b37fe640 1 -- 172.21.15.78:0/2259395441 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f42cc00fbc0 con 0x563c9096f6b0 2024-09-17T03:10:59.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.065+0000 7f42e208a740 10 client.5829 fetch_fsmap learned FSMap version 36 2024-09-17T03:10:59.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.065+0000 7f42e208a740 1 -- 172.21.15.78:0/2259395441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x563c90e03e80 con 0x563c9096f6b0 2024-09-17T03:10:59.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.065+0000 7f42b37fe640 1 -- 172.21.15.78:0/2259395441 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42c8062760 con 0x563c9096f6b0 2024-09-17T03:10:59.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.065+0000 7f42b37fe640 1 -- 172.21.15.78:0/2259395441 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 36) ==== 3554+0+0 (secure 0 0 0) 0x7f42cc027040 con 0x563c9096f6b0 2024-09-17T03:10:59.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.065+0000 7f42e208a740 10 client.5829 fetch_fsmap finished waiting for FSMap version 36 2024-09-17T03:10:59.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.065+0000 7f42e208a740 10 client.5829 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.d 2024-09-17T03:10:59.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.065+0000 7f42e208a740 20 client.5829 populate_metadata read hostname 'smithi078' 2024-09-17T03:10:59.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.065+0000 7f42e208a740 1 --2- 172.21.15.78:0/2259395441 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x563c909243a0 0x563c90e00430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.065+0000 7f42e208a740 4 client.5829 mds_command: new command op to 5039 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T03:10:59.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.065+0000 7f42e208a740 1 -- 172.21.15.78:0/2259395441 --> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563c90ca8460 con 0x563c909243a0 2024-09-17T03:10:59.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.065+0000 7f42d8ebc640 1 --2- 172.21.15.78:0/2259395441 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x563c909243a0 0x563c90e00430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.065+0000 7f42b37fe640 10 client.5829 ms_handle_connect on v2:172.21.15.193:6835/3209848332 2024-09-17T03:10:59.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.065+0000 7f42d8ebc640 1 --2- 172.21.15.78:0/2259395441 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x563c909243a0 0x563c90e00430 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ab54c062e4f5028d server_cookie=2364b87445815522 in_seq=0 out_seq=0 2024-09-17T03:10:59.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.080+0000 7f42b37fe640 1 -- 172.21.15.78:0/2259395441 <== mds.1 v2:172.21.15.193:6835/3209848332 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563c90ca8460 con 0x563c909243a0 2024-09-17T03:10:59.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.080+0000 7f42b37fe640 10 client.5829 handle_command_reply: tid=0 2024-09-17T03:10:59.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.080+0000 7f42e208a740 1 client.5829 shutdown 2024-09-17T03:10:59.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.080+0000 7f42e208a740 1 -- 172.21.15.78:0/2259395441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c9096f6b0 msgr2=0x563c90dfa310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:59.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.080+0000 7f42e208a740 1 --2- 172.21.15.78:0/2259395441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c9096f6b0 0x563c90dfa310 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f42cc009600 tx=0x7f42cc004a10 comp rx=0 tx=0).stop 2024-09-17T03:10:59.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.080+0000 7f42e208a740 1 -- 172.21.15.78:0/2259395441 shutdown_connections 2024-09-17T03:10:59.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.080+0000 7f42e208a740 1 --2- 172.21.15.78:0/2259395441 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x563c909243a0 0x563c90e00430 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.080+0000 7f42e208a740 1 --2- 172.21.15.78:0/2259395441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c9096f6b0 0x563c90dfa310 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.080+0000 7f42e208a740 1 --2- 172.21.15.78:0/2259395441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c909674d0 0x563c90e04340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.080+0000 7f42b37fe640 0 client.5829 ms_handle_reset on v2:172.21.15.193:6835/3209848332 2024-09-17T03:10:59.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.080+0000 7f42e208a740 1 --2- 172.21.15.78:0/2259395441 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c9094ef60 0x563c90d59340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.080+0000 7f42e208a740 1 -- 172.21.15.78:0/2259395441 >> 172.21.15.78:0/2259395441 conn(0x563c909844e0 msgr2=0x563c90d7db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:59.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.080+0000 7f42e208a740 1 -- 172.21.15.78:0/2259395441 shutdown_connections 2024-09-17T03:10:59.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.080+0000 7f42e208a740 1 -- 172.21.15.78:0/2259395441 wait complete. 2024-09-17T03:10:59.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.080+0000 7f42e208a740 20 client.5829 trim_cache size 0 max 16384 2024-09-17T03:10:59.081 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:10:59.081 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:10:59.081 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:10:59.081 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:10:59.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.081+0000 7f42db120640 1 -- 172.21.15.78:0/2884289339 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42c0078b90 msgr2=0x7f42c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:59.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.081+0000 7f42db120640 1 --2- 172.21.15.78:0/2884289339 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42c0078b90 0x7f42c007b0a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f42c4034000 tx=0x7f42c4004730 comp rx=0 tx=0).stop 2024-09-17T03:10:59.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.081+0000 7f42db120640 1 -- 172.21.15.78:0/2884289339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d41600a0 msgr2=0x7f42d41f2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:59.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.081+0000 7f42db120640 1 --2- 172.21.15.78:0/2884289339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d41600a0 0x7f42d41f2970 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f42c8007fd0 tx=0x7f42c800c760 comp rx=0 tx=0).stop 2024-09-17T03:10:59.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.081+0000 7f42db120640 1 -- 172.21.15.78:0/2884289339 shutdown_connections 2024-09-17T03:10:59.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.081+0000 7f42db120640 1 --2- 172.21.15.78:0/2884289339 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42d41f7290 0x7f42d415e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.081+0000 7f42db120640 1 --2- 172.21.15.78:0/2884289339 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d41600a0 0x7f42d41f2970 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.081+0000 7f42db120640 1 --2- 172.21.15.78:0/2884289339 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42c0078b90 0x7f42c007b0a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.081+0000 7f42db120640 1 --2- 172.21.15.78:0/2884289339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d40ce7d0 0x7f42d41f3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.081+0000 7f42db120640 1 -- 172.21.15.78:0/2884289339 >> 172.21.15.78:0/2884289339 conn(0x7f42d40cdcb0 msgr2=0x7f42d40adfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:59.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.081+0000 7f42db120640 1 -- 172.21.15.78:0/2884289339 shutdown_connections 2024-09-17T03:10:59.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.081+0000 7f42db120640 1 -- 172.21.15.78:0/2884289339 wait complete. 2024-09-17T03:10:59.091 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:2 flush journal 2024-09-17T03:10:59.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.207+0000 7fcf78507640 1 -- 172.21.15.78:0/3235007051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf700ca800 msgr2=0x7fcf700cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:59.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.207+0000 7fcf78507640 1 --2- 172.21.15.78:0/3235007051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf700ca800 0x7fcf700cba00 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fcf7009e2e0 tx=0x7fcf6002aac0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.207+0000 7fcf78507640 1 -- 172.21.15.78:0/3235007051 shutdown_connections 2024-09-17T03:10:59.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.207+0000 7fcf78507640 1 --2- 172.21.15.78:0/3235007051 >> v2:172.21.15.193:3300/0 conn(0x7fcf700cad30 0x7fcf7006ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.207+0000 7fcf78507640 1 --2- 172.21.15.78:0/3235007051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf700ca800 0x7fcf700cba00 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.207+0000 7fcf78507640 1 -- 172.21.15.78:0/3235007051 >> 172.21.15.78:0/3235007051 conn(0x7fcf700b1cb0 msgr2=0x7fcf700b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:59.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.207+0000 7fcf78507640 1 -- 172.21.15.78:0/3235007051 shutdown_connections 2024-09-17T03:10:59.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.207+0000 7fcf78507640 1 -- 172.21.15.78:0/3235007051 wait complete. 2024-09-17T03:10:59.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.209+0000 7fcf78507640 1 Processor -- start 2024-09-17T03:10:59.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.209+0000 7fcf78507640 1 -- start start 2024-09-17T03:10:59.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.210+0000 7fcf78507640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf700704e0 0x7fcf7009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.210+0000 7fcf78507640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf700ca800 0x7fcf70152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.210+0000 7fcf78507640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcf700cad30 0x7fcf700b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.210+0000 7fcf78507640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcf700cec00 con 0x7fcf700704e0 2024-09-17T03:10:59.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.210+0000 7fcf78507640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcf70074810 con 0x7fcf700ca800 2024-09-17T03:10:59.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.210+0000 7fcf78507640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fcf700ccf40 con 0x7fcf700cad30 2024-09-17T03:10:59.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.210+0000 7fcf762a3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf700704e0 0x7fcf7009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.210+0000 7fcf762a3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf700704e0 0x7fcf7009aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57716/0 (socket says 172.21.15.78:57716) 2024-09-17T03:10:59.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.210+0000 7fcf762a3640 1 -- 172.21.15.78:0/1685392493 learned_addr learned my addr 172.21.15.78:0/1685392493 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:59.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.210+0000 7fcf75aa2640 1 --2- 172.21.15.78:0/1685392493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf700ca800 0x7fcf70152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.210+0000 7fcf76aa4640 1 --2- 172.21.15.78:0/1685392493 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcf700cad30 0x7fcf700b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.210+0000 7fcf762a3640 1 -- 172.21.15.78:0/1685392493 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcf700cad30 msgr2=0x7fcf700b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.210+0000 7fcf762a3640 1 --2- 172.21.15.78:0/1685392493 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcf700cad30 0x7fcf700b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.210+0000 7fcf762a3640 1 -- 172.21.15.78:0/1685392493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf700ca800 msgr2=0x7fcf70152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.210+0000 7fcf762a3640 1 --2- 172.21.15.78:0/1685392493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf700ca800 0x7fcf70152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.210+0000 7fcf762a3640 1 -- 172.21.15.78:0/1685392493 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf701f8f10 con 0x7fcf700704e0 2024-09-17T03:10:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.210+0000 7fcf76aa4640 1 --2- 172.21.15.78:0/1685392493 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcf700cad30 0x7fcf700b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:10:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.211+0000 7fcf762a3640 1 --2- 172.21.15.78:0/1685392493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf700704e0 0x7fcf7009aa30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009d60 tx=0x7fcf60003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.211+0000 7fcf6effd640 1 -- 172.21.15.78:0/1685392493 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60004310 con 0x7fcf700704e0 2024-09-17T03:10:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.211+0000 7fcf6effd640 1 -- 172.21.15.78:0/1685392493 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf600044d0 con 0x7fcf700704e0 2024-09-17T03:10:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.211+0000 7fcf78507640 1 -- 172.21.15.78:0/1685392493 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf701f91f0 con 0x7fcf700704e0 2024-09-17T03:10:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.211+0000 7fcf6effd640 1 -- 172.21.15.78:0/1685392493 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60040420 con 0x7fcf700704e0 2024-09-17T03:10:59.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.211+0000 7fcf78507640 1 -- 172.21.15.78:0/1685392493 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf701f97b0 con 0x7fcf700704e0 2024-09-17T03:10:59.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.213+0000 7fcf6effd640 1 -- 172.21.15.78:0/1685392493 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcf60036400 con 0x7fcf700704e0 2024-09-17T03:10:59.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.213+0000 7fcf6effd640 1 --2- 172.21.15.78:0/1685392493 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcf5c078b90 0x7fcf5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.214+0000 7fcf6effd640 1 -- 172.21.15.78:0/1685392493 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fcf600bbcd0 con 0x7fcf700704e0 2024-09-17T03:10:59.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.214+0000 7fcf75aa2640 1 --2- 172.21.15.78:0/1685392493 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcf5c078b90 0x7fcf5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.214+0000 7fcf75aa2640 1 --2- 172.21.15.78:0/1685392493 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcf5c078b90 0x7fcf5c07b0a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400a490 tx=0x7fcf6400a420 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:59.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.214+0000 7fcf7f473740 1 Processor -- start 2024-09-17T03:10:59.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.214+0000 7fcf7f473740 1 -- start start 2024-09-17T03:10:59.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.216+0000 7fcf7f473740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55c435dd0390 0x55c4361bca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.216+0000 7fcf7f473740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435da74d0 0x55c436191860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.216+0000 7fcf7f473740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c435daf6b0 0x55c436191da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.216+0000 7fcf7f473740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55c4360eaa60 con 0x55c435da74d0 2024-09-17T03:10:59.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.216+0000 7fcf7f473740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c4360d9e90 con 0x55c435daf6b0 2024-09-17T03:10:59.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.216+0000 7fcf7f473740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55c4360ddca0 con 0x55c435dd0390 2024-09-17T03:10:59.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.216+0000 7fcf75aa2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435da74d0 0x55c436191860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.216+0000 7fcf75aa2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435da74d0 0x55c436191860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57728/0 (socket says 172.21.15.78:57728) 2024-09-17T03:10:59.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.216+0000 7fcf75aa2640 1 -- 172.21.15.78:0/854063600 learned_addr learned my addr 172.21.15.78:0/854063600 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:59.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.216+0000 7fcf762a3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55c435dd0390 0x55c4361bca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.216+0000 7fcf76aa4640 1 --2- 172.21.15.78:0/854063600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c435daf6b0 0x55c436191da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.216+0000 7fcf75aa2640 1 -- 172.21.15.78:0/854063600 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55c435dd0390 msgr2=0x55c4361bca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:59.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.216+0000 7fcf75aa2640 1 --2- 172.21.15.78:0/854063600 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55c435dd0390 0x55c4361bca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.216+0000 7fcf75aa2640 1 -- 172.21.15.78:0/854063600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c435daf6b0 msgr2=0x55c436191da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:59.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.216+0000 7fcf75aa2640 1 --2- 172.21.15.78:0/854063600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c435daf6b0 0x55c436191da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.216+0000 7fcf75aa2640 1 -- 172.21.15.78:0/854063600 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c435eb27d0 con 0x55c435da74d0 2024-09-17T03:10:59.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.216+0000 7fcf75aa2640 1 --2- 172.21.15.78:0/854063600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435da74d0 0x55c436191860 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400fe80 tx=0x7fcf64012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b9ea49daa19d440 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:59.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.216+0000 7fcf57fff640 1 -- 172.21.15.78:0/854063600 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64016070 con 0x55c435da74d0 2024-09-17T03:10:59.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.216+0000 7fcf57fff640 1 -- 172.21.15.78:0/854063600 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf64025630 con 0x55c435da74d0 2024-09-17T03:10:59.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.216+0000 7fcf57fff640 1 -- 172.21.15.78:0/854063600 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64025a20 con 0x55c435da74d0 2024-09-17T03:10:59.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.217+0000 7fcf7f473740 1 -- 172.21.15.78:0/854063600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435da74d0 msgr2=0x55c436191860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:59.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.217+0000 7fcf7f473740 1 --2- 172.21.15.78:0/854063600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435da74d0 0x55c436191860 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400fe80 tx=0x7fcf64012000 comp rx=0 tx=0).stop 2024-09-17T03:10:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.217+0000 7fcf7f473740 1 -- 172.21.15.78:0/854063600 shutdown_connections 2024-09-17T03:10:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.217+0000 7fcf7f473740 1 --2- 172.21.15.78:0/854063600 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c435daf6b0 0x55c436191da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.217+0000 7fcf7f473740 1 --2- 172.21.15.78:0/854063600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435da74d0 0x55c436191860 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.217+0000 7fcf7f473740 1 --2- 172.21.15.78:0/854063600 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55c435dd0390 0x55c4361bca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.217+0000 7fcf7f473740 1 -- 172.21.15.78:0/854063600 >> 172.21.15.78:0/854063600 conn(0x55c435dc44e0 msgr2=0x55c436177d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.217+0000 7fcf7f473740 1 -- 172.21.15.78:0/854063600 shutdown_connections 2024-09-17T03:10:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.217+0000 7fcf7f473740 1 -- 172.21.15.78:0/854063600 wait complete. 2024-09-17T03:10:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.218+0000 7fcf7f473740 1 -- start start 2024-09-17T03:10:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.218+0000 7fcf7f473740 1 Processor -- start 2024-09-17T03:10:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.220+0000 7fcf7f473740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55c435da74d0 0x55c4361cca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.220+0000 7fcf7f473740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 0x55c436190460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.220+0000 7fcf7f473740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c435dd0390 0x55c4361cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.220+0000 7fcf7f473740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55c435e4a740 con 0x55c435daf6b0 2024-09-17T03:10:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.220+0000 7fcf7f473740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55c43607f970 con 0x55c435dd0390 2024-09-17T03:10:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.220+0000 7fcf7f473740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55c4361b6a70 con 0x55c435da74d0 2024-09-17T03:10:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.220+0000 7fcf7f473740 10 client.0 _ll_register_callbacks cb 0x55c43608e780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:10:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.220+0000 7fcf75aa2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 0x55c436190460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.220+0000 7fcf75aa2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 0x55c436190460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57744/0 (socket says 172.21.15.78:57744) 2024-09-17T03:10:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.220+0000 7fcf75aa2640 1 -- 172.21.15.78:0/1782799676 learned_addr learned my addr 172.21.15.78:0/1782799676 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:59.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.220+0000 7fcf76aa4640 1 --2- 172.21.15.78:0/1782799676 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c435dd0390 0x55c4361cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.220+0000 7fcf762a3640 1 --2- 172.21.15.78:0/1782799676 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55c435da74d0 0x55c4361cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.220+0000 7fcf75aa2640 1 -- 172.21.15.78:0/1782799676 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55c435da74d0 msgr2=0x55c4361cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:59.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.220+0000 7fcf75aa2640 1 --2- 172.21.15.78:0/1782799676 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55c435da74d0 0x55c4361cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.220+0000 7fcf75aa2640 1 -- 172.21.15.78:0/1782799676 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c435dd0390 msgr2=0x55c4361cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:59.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.220+0000 7fcf75aa2640 1 --2- 172.21.15.78:0/1782799676 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c435dd0390 0x55c4361cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.220+0000 7fcf75aa2640 1 -- 172.21.15.78:0/1782799676 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c435e3b970 con 0x55c435daf6b0 2024-09-17T03:10:59.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.220+0000 7fcf75aa2640 1 --2- 172.21.15.78:0/1782799676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 0x55c436190460 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400a950 tx=0x7fcf64025430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf0790721743e2b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:59.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.220+0000 7fcf557fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:10:59.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.221+0000 7fcf557fa640 1 -- 172.21.15.78:0/1782799676 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf640273e0 con 0x55c435daf6b0 2024-09-17T03:10:59.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.221+0000 7fcf557fa640 1 -- 172.21.15.78:0/1782799676 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fcf64027580 con 0x55c435daf6b0 2024-09-17T03:10:59.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.221+0000 7fcf7f473740 1 -- 172.21.15.78:0/1782799676 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf64025630 con 0x55c435daf6b0 2024-09-17T03:10:59.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.221+0000 7fcf557fa640 1 -- 172.21.15.78:0/1782799676 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fcf64027880 con 0x55c435daf6b0 2024-09-17T03:10:59.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.221+0000 7fcf7f473740 10 client.5844 fetch_fsmap learned FSMap version 36 2024-09-17T03:10:59.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.221+0000 7fcf7f473740 1 -- 172.21.15.78:0/1782799676 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55c435e196a0 con 0x55c435daf6b0 2024-09-17T03:10:59.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.221+0000 7fcf557fa640 1 -- 172.21.15.78:0/1782799676 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf64025630 con 0x55c435daf6b0 2024-09-17T03:10:59.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.221+0000 7fcf557fa640 1 -- 172.21.15.78:0/1782799676 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 36) ==== 3554+0+0 (secure 0 0 0) 0x7fcf64027b10 con 0x55c435daf6b0 2024-09-17T03:10:59.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.221+0000 7fcf7f473740 10 client.5844 fetch_fsmap finished waiting for FSMap version 36 2024-09-17T03:10:59.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.221+0000 7fcf7f473740 10 client.5844 resolve_mds: resolved 3:2 to role '3:2' aka daemon mds.a 2024-09-17T03:10:59.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.221+0000 7fcf7f473740 20 client.5844 populate_metadata read hostname 'smithi078' 2024-09-17T03:10:59.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.221+0000 7fcf7f473740 1 --2- 172.21.15.78:0/1782799676 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x55c435d8ef60 0x55c436183600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.221+0000 7fcf7f473740 4 client.5844 mds_command: new command op to 5036 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:10:59.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.221+0000 7fcf7f473740 1 -- 172.21.15.78:0/1782799676 --> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4360ec9b0 con 0x55c435d8ef60 2024-09-17T03:10:59.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.221+0000 7fcf762a3640 1 --2- 172.21.15.78:0/1782799676 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x55c435d8ef60 0x55c436183600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.222+0000 7fcf557fa640 10 client.5844 ms_handle_connect on v2:172.21.15.78:6832/3629327943 2024-09-17T03:10:59.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.222+0000 7fcf762a3640 1 --2- 172.21.15.78:0/1782799676 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x55c435d8ef60 0x55c436183600 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b7df7dbb03f3d2da server_cookie=d862ec232b71db36 in_seq=0 out_seq=0 2024-09-17T03:10:59.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.222+0000 7fcf557fa640 1 -- 172.21.15.78:0/1782799676 <== mds.2 v2:172.21.15.78:6832/3629327943 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c4360ec9b0 con 0x55c435d8ef60 2024-09-17T03:10:59.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.222+0000 7fcf557fa640 10 client.5844 handle_command_reply: tid=0 2024-09-17T03:10:59.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.222+0000 7fcf7f473740 1 client.5844 shutdown 2024-09-17T03:10:59.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.222+0000 7fcf7f473740 1 -- 172.21.15.78:0/1782799676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 msgr2=0x55c436190460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:59.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.222+0000 7fcf7f473740 1 --2- 172.21.15.78:0/1782799676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 0x55c436190460 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400a950 tx=0x7fcf64025430 comp rx=0 tx=0).stop 2024-09-17T03:10:59.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.223+0000 7fcf7f473740 1 -- 172.21.15.78:0/1782799676 shutdown_connections 2024-09-17T03:10:59.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.223+0000 7fcf7f473740 1 --2- 172.21.15.78:0/1782799676 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x55c435d8ef60 0x55c436183600 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.223+0000 7fcf7f473740 1 --2- 172.21.15.78:0/1782799676 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c435dd0390 0x55c4361cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.223+0000 7fcf7f473740 1 --2- 172.21.15.78:0/1782799676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 0x55c436190460 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.223+0000 7fcf557fa640 0 client.5844 ms_handle_reset on v2:172.21.15.78:6832/3629327943 2024-09-17T03:10:59.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.223+0000 7fcf7f473740 1 --2- 172.21.15.78:0/1782799676 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55c435da74d0 0x55c4361cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.223+0000 7fcf7f473740 1 -- 172.21.15.78:0/1782799676 >> 172.21.15.78:0/1782799676 conn(0x55c435dc44e0 msgr2=0x55c436172a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:59.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.223+0000 7fcf7f473740 1 -- 172.21.15.78:0/1782799676 shutdown_connections 2024-09-17T03:10:59.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.223+0000 7fcf7f473740 1 -- 172.21.15.78:0/1782799676 wait complete. 2024-09-17T03:10:59.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.223+0000 7fcf7f473740 20 client.5844 trim_cache size 0 max 16384 2024-09-17T03:10:59.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.238+0000 7fcf7f473740 1 Processor -- start 2024-09-17T03:10:59.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.238+0000 7fcf7f473740 1 -- start start 2024-09-17T03:10:59.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.239+0000 7fcf7f473740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c435da74d0 0x55c4361b4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.239+0000 7fcf7f473740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 0x55c436232740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.239+0000 7fcf7f473740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55c435dd0390 0x55c436177980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.239+0000 7fcf7f473740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55c4361754e0 con 0x55c435daf6b0 2024-09-17T03:10:59.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.239+0000 7fcf7f473740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcf702022c0 con 0x55c435da74d0 2024-09-17T03:10:59.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.239+0000 7fcf7f473740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fcf702014d0 con 0x55c435dd0390 2024-09-17T03:10:59.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.239+0000 7fcf75aa2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 0x55c436232740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.239+0000 7fcf75aa2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 0x55c436232740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57748/0 (socket says 172.21.15.78:57748) 2024-09-17T03:10:59.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.239+0000 7fcf75aa2640 1 -- 172.21.15.78:0/176029674 learned_addr learned my addr 172.21.15.78:0/176029674 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:59.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.239+0000 7fcf762a3640 1 --2- 172.21.15.78:0/176029674 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c435da74d0 0x55c4361b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.239+0000 7fcf75aa2640 1 -- 172.21.15.78:0/176029674 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55c435dd0390 msgr2=0x55c436177980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:59.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.239+0000 7fcf75aa2640 1 --2- 172.21.15.78:0/176029674 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55c435dd0390 0x55c436177980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.239+0000 7fcf75aa2640 1 -- 172.21.15.78:0/176029674 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c435da74d0 msgr2=0x55c4361b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:59.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.239+0000 7fcf75aa2640 1 --2- 172.21.15.78:0/176029674 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c435da74d0 0x55c4361b4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.239+0000 7fcf75aa2640 1 -- 172.21.15.78:0/176029674 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4361cf690 con 0x55c435daf6b0 2024-09-17T03:10:59.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.240+0000 7fcf75aa2640 1 --2- 172.21.15.78:0/176029674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 0x55c436232740 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fcf64010fd0 tx=0x7fcf64025520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8a1d81c3088914 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:59.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.240+0000 7fcf577fe640 1 -- 172.21.15.78:0/176029674 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64016070 con 0x55c435daf6b0 2024-09-17T03:10:59.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.240+0000 7fcf577fe640 1 -- 172.21.15.78:0/176029674 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf64010c90 con 0x55c435daf6b0 2024-09-17T03:10:59.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.240+0000 7fcf577fe640 1 -- 172.21.15.78:0/176029674 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf64027c80 con 0x55c435daf6b0 2024-09-17T03:10:59.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.240+0000 7fcf7f473740 1 -- 172.21.15.78:0/176029674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 msgr2=0x55c436232740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:59.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.240+0000 7fcf7f473740 1 --2- 172.21.15.78:0/176029674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 0x55c436232740 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fcf64010fd0 tx=0x7fcf64025520 comp rx=0 tx=0).stop 2024-09-17T03:10:59.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.240+0000 7fcf7f473740 1 -- 172.21.15.78:0/176029674 shutdown_connections 2024-09-17T03:10:59.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.240+0000 7fcf7f473740 1 --2- 172.21.15.78:0/176029674 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55c435dd0390 0x55c436177980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.240+0000 7fcf7f473740 1 --2- 172.21.15.78:0/176029674 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 0x55c436232740 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.240+0000 7fcf7f473740 1 --2- 172.21.15.78:0/176029674 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c435da74d0 0x55c4361b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.240+0000 7fcf7f473740 1 -- 172.21.15.78:0/176029674 >> 172.21.15.78:0/176029674 conn(0x55c435dc44e0 msgr2=0x55c4361b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:59.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.241+0000 7fcf7f473740 1 -- 172.21.15.78:0/176029674 shutdown_connections 2024-09-17T03:10:59.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.241+0000 7fcf7f473740 1 -- 172.21.15.78:0/176029674 wait complete. 2024-09-17T03:10:59.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.241+0000 7fcf7f473740 1 -- start start 2024-09-17T03:10:59.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.241+0000 7fcf7f473740 1 Processor -- start 2024-09-17T03:10:59.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.243+0000 7fcf7f473740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55c435da74d0 0x55c43621e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.243+0000 7fcf7f473740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 0x55c436170dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.243+0000 7fcf7f473740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c435dd0390 0x55c43623fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.243+0000 7fcf7f473740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7006faf0 con 0x55c435daf6b0 2024-09-17T03:10:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.243+0000 7fcf7f473740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcf70201b90 con 0x55c435dd0390 2024-09-17T03:10:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.243+0000 7fcf7f473740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55c436171810 con 0x55c435da74d0 2024-09-17T03:10:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.243+0000 7fcf7f473740 10 client.0 _ll_register_callbacks cb 0x7fcf68007e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:10:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.243+0000 7fcf75aa2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 0x55c436170dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.243+0000 7fcf75aa2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 0x55c436170dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57760/0 (socket says 172.21.15.78:57760) 2024-09-17T03:10:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.243+0000 7fcf75aa2640 1 -- 172.21.15.78:0/10790540 learned_addr learned my addr 172.21.15.78:0/10790540 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:10:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.243+0000 7fcf762a3640 1 --2- 172.21.15.78:0/10790540 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55c435da74d0 0x55c43621e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.243+0000 7fcf76aa4640 1 --2- 172.21.15.78:0/10790540 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c435dd0390 0x55c43623fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.243+0000 7fcf75aa2640 1 -- 172.21.15.78:0/10790540 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55c435da74d0 msgr2=0x55c43621e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.243+0000 7fcf75aa2640 1 --2- 172.21.15.78:0/10790540 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55c435da74d0 0x55c43621e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.243+0000 7fcf75aa2640 1 -- 172.21.15.78:0/10790540 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c435dd0390 msgr2=0x55c43623fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:10:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.243+0000 7fcf75aa2640 1 --2- 172.21.15.78:0/10790540 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c435dd0390 0x55c43623fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.243+0000 7fcf75aa2640 1 -- 172.21.15.78:0/10790540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c436171310 con 0x55c435daf6b0 2024-09-17T03:10:59.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.243+0000 7fcf75aa2640 1 --2- 172.21.15.78:0/10790540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 0x55c436170dd0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fcf6403e040 tx=0x7fcf64027c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51bb256b64402e02 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:10:59.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.243+0000 7fcf557fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:10:59.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.244+0000 7fcf557fa640 1 -- 172.21.15.78:0/10790540 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6404b060 con 0x55c435daf6b0 2024-09-17T03:10:59.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.244+0000 7fcf557fa640 1 -- 172.21.15.78:0/10790540 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fcf640275f0 con 0x55c435daf6b0 2024-09-17T03:10:59.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.244+0000 7fcf7f473740 1 -- 172.21.15.78:0/10790540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf64010c90 con 0x55c435daf6b0 2024-09-17T03:10:59.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.244+0000 7fcf557fa640 1 -- 172.21.15.78:0/10790540 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fcf64051050 con 0x55c435daf6b0 2024-09-17T03:10:59.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.244+0000 7fcf7f473740 10 client.5850 fetch_fsmap learned FSMap version 36 2024-09-17T03:10:59.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.244+0000 7fcf7f473740 1 -- 172.21.15.78:0/10790540 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55c43621e8e0 con 0x55c435daf6b0 2024-09-17T03:10:59.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.244+0000 7fcf557fa640 1 -- 172.21.15.78:0/10790540 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf64010c90 con 0x55c435daf6b0 2024-09-17T03:10:59.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.244+0000 7fcf557fa640 1 -- 172.21.15.78:0/10790540 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 36) ==== 3554+0+0 (secure 0 0 0) 0x7fcf64054020 con 0x55c435daf6b0 2024-09-17T03:10:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.244+0000 7fcf7f473740 10 client.5850 fetch_fsmap finished waiting for FSMap version 36 2024-09-17T03:10:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.244+0000 7fcf7f473740 10 client.5850 resolve_mds: resolved 3:2 to role '3:2' aka daemon mds.a 2024-09-17T03:10:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.244+0000 7fcf7f473740 20 client.5850 populate_metadata read hostname 'smithi078' 2024-09-17T03:10:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.244+0000 7fcf7f473740 1 --2- 172.21.15.78:0/10790540 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x55c43619f000 0x55c436231270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:10:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.244+0000 7fcf7f473740 4 client.5850 mds_command: new command op to 5036 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T03:10:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.244+0000 7fcf7f473740 1 -- 172.21.15.78:0/10790540 --> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c4360e8460 con 0x55c43619f000 2024-09-17T03:10:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.244+0000 7fcf762a3640 1 --2- 172.21.15.78:0/10790540 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x55c43619f000 0x55c436231270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:10:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.245+0000 7fcf557fa640 10 client.5850 ms_handle_connect on v2:172.21.15.78:6832/3629327943 2024-09-17T03:10:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.245+0000 7fcf762a3640 1 --2- 172.21.15.78:0/10790540 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x55c43619f000 0x55c436231270 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=766b9f784db8840c server_cookie=c6f9970f3c75b3ec in_seq=0 out_seq=0 2024-09-17T03:10:59.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.257+0000 7fcf557fa640 1 -- 172.21.15.78:0/10790540 <== mds.2 v2:172.21.15.78:6832/3629327943 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c4360e8460 con 0x55c43619f000 2024-09-17T03:10:59.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.257+0000 7fcf557fa640 10 client.5850 handle_command_reply: tid=0 2024-09-17T03:10:59.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.257+0000 7fcf7f473740 1 client.5850 shutdown 2024-09-17T03:10:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.257+0000 7fcf7f473740 1 -- 172.21.15.78:0/10790540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 msgr2=0x55c436170dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.257+0000 7fcf7f473740 1 --2- 172.21.15.78:0/10790540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 0x55c436170dd0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fcf6403e040 tx=0x7fcf64027c30 comp rx=0 tx=0).stop 2024-09-17T03:10:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.257+0000 7fcf7f473740 1 -- 172.21.15.78:0/10790540 shutdown_connections 2024-09-17T03:10:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.257+0000 7fcf7f473740 1 --2- 172.21.15.78:0/10790540 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x55c43619f000 0x55c436231270 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.257+0000 7fcf7f473740 1 --2- 172.21.15.78:0/10790540 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55c435dd0390 0x55c43623fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.257+0000 7fcf7f473740 1 --2- 172.21.15.78:0/10790540 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55c435daf6b0 0x55c436170dd0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.257+0000 7fcf557fa640 0 client.5850 ms_handle_reset on v2:172.21.15.78:6832/3629327943 2024-09-17T03:10:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.257+0000 7fcf7f473740 1 --2- 172.21.15.78:0/10790540 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55c435da74d0 0x55c43621e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.257+0000 7fcf7f473740 1 -- 172.21.15.78:0/10790540 >> 172.21.15.78:0/10790540 conn(0x55c435dc44e0 msgr2=0x55c436177890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.257+0000 7fcf7f473740 1 -- 172.21.15.78:0/10790540 shutdown_connections 2024-09-17T03:10:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.257+0000 7fcf7f473740 1 -- 172.21.15.78:0/10790540 wait complete. 2024-09-17T03:10:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.257+0000 7fcf7f473740 20 client.5850 trim_cache size 0 max 16384 2024-09-17T03:10:59.258 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:10:59.258 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:10:59.258 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:10:59.259 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:10:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.258+0000 7fcf78507640 1 -- 172.21.15.78:0/1685392493 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcf5c078b90 msgr2=0x7fcf5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.258+0000 7fcf78507640 1 --2- 172.21.15.78:0/1685392493 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcf5c078b90 0x7fcf5c07b0a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcf6400a490 tx=0x7fcf6400a420 comp rx=0 tx=0).stop 2024-09-17T03:10:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.258+0000 7fcf78507640 1 -- 172.21.15.78:0/1685392493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf700704e0 msgr2=0x7fcf7009aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:10:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.258+0000 7fcf78507640 1 --2- 172.21.15.78:0/1685392493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf700704e0 0x7fcf7009aa30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fcf60009d60 tx=0x7fcf60003f10 comp rx=0 tx=0).stop 2024-09-17T03:10:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.258+0000 7fcf78507640 1 -- 172.21.15.78:0/1685392493 shutdown_connections 2024-09-17T03:10:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.258+0000 7fcf78507640 1 --2- 172.21.15.78:0/1685392493 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcf700cad30 0x7fcf700b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.258+0000 7fcf78507640 1 --2- 172.21.15.78:0/1685392493 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcf5c078b90 0x7fcf5c07b0a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.258+0000 7fcf78507640 1 --2- 172.21.15.78:0/1685392493 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf700ca800 0x7fcf70152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.258+0000 7fcf78507640 1 --2- 172.21.15.78:0/1685392493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf700704e0 0x7fcf7009aa30 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:10:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.258+0000 7fcf78507640 1 -- 172.21.15.78:0/1685392493 >> 172.21.15.78:0/1685392493 conn(0x7fcf700b1cb0 msgr2=0x7fcf700af220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:10:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.258+0000 7fcf78507640 1 -- 172.21.15.78:0/1685392493 shutdown_connections 2024-09-17T03:10:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59.258+0000 7fcf78507640 1 -- 172.21.15.78:0/1685392493 wait complete. 2024-09-17T03:10:59.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:10:59.268 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2024-09-17T03:10:59.290 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/ 2024-09-17T03:10:59.290 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4 2024-09-17T03:10:59.290 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4/d5 2024-09-17T03:10:59.290 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4/d5/d6 2024-09-17T03:10:59.290 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4/d5/d6/d7 2024-09-17T03:10:59.290 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2024-09-17T03:10:59.291 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:10:59.291 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:10:59.291 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:10:59.291 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:10:59.291 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2024-09-17T03:10:59.291 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:10:59.395 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627778 2024-09-17T03:10:59.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:10:59.404 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:10:59.404 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:10:59.404 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:10:59.404 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:10:59.404 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2024-09-17T03:10:59.404 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:10:59.507 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627779 2024-09-17T03:10:59.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:10:59.516 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:10:59.516 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:10:59.516 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:10:59.516 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:10:59.516 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2024-09-17T03:10:59.516 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:10:59.620 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627780 2024-09-17T03:10:59.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:10:59.629 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:10:59.629 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:10:59.630 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:10:59.630 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:10:59.630 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2024-09-17T03:10:59.630 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:10:59.735 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627781 2024-09-17T03:10:59.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:10:59.745 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:10:59.745 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:10:59.745 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:10:59.745 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:10:59.745 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2024-09-17T03:10:59.745 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:10:59.848 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627782 2024-09-17T03:10:59.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:10:59.857 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:10:59.857 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:10:59.857 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:10:59.857 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:10:59.858 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2024-09-17T03:10:59.858 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:10:59.962 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627783 2024-09-17T03:10:59.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:10:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:10:59.972 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000002.00000000 parent 2024-09-17T03:11:00.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.069+0000 7f0f7ed21f40 1 Processor -- start 2024-09-17T03:11:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.069+0000 7f0f7ed21f40 1 -- start start 2024-09-17T03:11:00.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.070+0000 7f0f7ed21f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f600030f0 0x55f27ce116b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.070+0000 7f0f7ed21f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f27cd7e850 0x55f27cce4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.070+0000 7f0f7ed21f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f27cce4840 0x55f27ce1bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.070+0000 7f0f7ed21f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f27cc63430 con 0x55f27cd7e850 2024-09-17T03:11:00.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.070+0000 7f0f7ed21f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f27cc701f0 con 0x55f27cce4840 2024-09-17T03:11:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.070+0000 7f0f7ed21f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f27cc04d60 con 0x7f0f600030f0 2024-09-17T03:11:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.070+0000 7f0f77592640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f27cd7e850 0x55f27cce4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.070+0000 7f0f77592640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f27cd7e850 0x55f27cce4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57792/0 (socket says 172.21.15.78:57792) 2024-09-17T03:11:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.070+0000 7f0f77592640 1 -- 172.21.15.78:0/1826968219 learned_addr learned my addr 172.21.15.78:0/1826968219 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.070+0000 7f0f78594640 1 --2- 172.21.15.78:0/1826968219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f27cce4840 0x55f27ce1bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.070+0000 7f0f77d93640 1 --2- 172.21.15.78:0/1826968219 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f600030f0 0x55f27ce116b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.070+0000 7f0f77592640 1 -- 172.21.15.78:0/1826968219 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f600030f0 msgr2=0x55f27ce116b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.070+0000 7f0f77592640 1 --2- 172.21.15.78:0/1826968219 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f600030f0 0x55f27ce116b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.070+0000 7f0f77592640 1 -- 172.21.15.78:0/1826968219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f27cce4840 msgr2=0x55f27ce1bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.070+0000 7f0f77592640 1 --2- 172.21.15.78:0/1826968219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f27cce4840 0x55f27ce1bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.070+0000 7f0f77592640 1 -- 172.21.15.78:0/1826968219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f27cce4c50 con 0x55f27cd7e850 2024-09-17T03:11:00.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.070+0000 7f0f77592640 1 --2- 172.21.15.78:0/1826968219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f27cd7e850 0x55f27cce4300 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c046970 tx=0x7f0f6c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d427b406249c85d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.071+0000 7f0f76590640 1 -- 172.21.15.78:0/1826968219 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c064030 con 0x55f27cd7e850 2024-09-17T03:11:00.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.071+0000 7f0f76590640 1 -- 172.21.15.78:0/1826968219 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f6c05b040 con 0x55f27cd7e850 2024-09-17T03:11:00.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.071+0000 7f0f76590640 1 -- 172.21.15.78:0/1826968219 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c057600 con 0x55f27cd7e850 2024-09-17T03:11:00.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.071+0000 7f0f7ed21f40 1 -- 172.21.15.78:0/1826968219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f27cd7e850 msgr2=0x55f27cce4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.071+0000 7f0f7ed21f40 1 --2- 172.21.15.78:0/1826968219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f27cd7e850 0x55f27cce4300 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c046970 tx=0x7f0f6c003020 comp rx=0 tx=0).stop 2024-09-17T03:11:00.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.071+0000 7f0f7ed21f40 1 -- 172.21.15.78:0/1826968219 shutdown_connections 2024-09-17T03:11:00.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.071+0000 7f0f7ed21f40 1 --2- 172.21.15.78:0/1826968219 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f27cce4840 0x55f27ce1bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.071+0000 7f0f7ed21f40 1 --2- 172.21.15.78:0/1826968219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f27cd7e850 0x55f27cce4300 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.071+0000 7f0f7ed21f40 1 --2- 172.21.15.78:0/1826968219 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f600030f0 0x55f27ce116b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.071+0000 7f0f7ed21f40 1 -- 172.21.15.78:0/1826968219 >> 172.21.15.78:0/1826968219 conn(0x55f27cbd5ac0 msgr2=0x55f27cce3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.071+0000 7f0f7ed21f40 1 -- 172.21.15.78:0/1826968219 shutdown_connections 2024-09-17T03:11:00.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.071+0000 7f0f7ed21f40 1 -- 172.21.15.78:0/1826968219 wait complete. 2024-09-17T03:11:00.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.072+0000 7f0f7ed21f40 1 Processor -- start 2024-09-17T03:11:00.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.072+0000 7f0f7ed21f40 1 -- start start 2024-09-17T03:11:00.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.073+0000 7f0f7ed21f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f27cce4840 0x55f27cd72990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.073+0000 7f0f7ed21f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f27cd7e850 0x55f27ce22df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.074+0000 7f0f7ed21f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f600030f0 0x55f27ce23330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.074+0000 7f0f7ed21f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f27ce12fc0 con 0x55f27cce4840 2024-09-17T03:11:00.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.074+0000 7f0f7ed21f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f27ccf59a0 con 0x55f27cd7e850 2024-09-17T03:11:00.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.074+0000 7f0f7ed21f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f27ccfa3e0 con 0x7f0f600030f0 2024-09-17T03:11:00.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.074+0000 7f0f77d93640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f27cce4840 0x55f27cd72990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.074+0000 7f0f77d93640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f27cce4840 0x55f27cd72990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57796/0 (socket says 172.21.15.78:57796) 2024-09-17T03:11:00.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.074+0000 7f0f77d93640 1 -- 172.21.15.78:0/432777665 learned_addr learned my addr 172.21.15.78:0/432777665 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.074+0000 7f0f77d93640 1 -- 172.21.15.78:0/432777665 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f600030f0 msgr2=0x55f27ce23330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.074+0000 7f0f77d93640 1 --2- 172.21.15.78:0/432777665 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f600030f0 0x55f27ce23330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.074+0000 7f0f77592640 1 --2- 172.21.15.78:0/432777665 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f27cd7e850 0x55f27ce22df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.074+0000 7f0f77d93640 1 -- 172.21.15.78:0/432777665 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f27cd7e850 msgr2=0x55f27ce22df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.074+0000 7f0f77d93640 1 --2- 172.21.15.78:0/432777665 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f27cd7e850 0x55f27ce22df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.074+0000 7f0f77d93640 1 -- 172.21.15.78:0/432777665 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f27ccb4690 con 0x55f27cce4840 2024-09-17T03:11:00.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.074+0000 7f0f77d93640 1 --2- 172.21.15.78:0/432777665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f27cce4840 0x55f27cd72990 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0f68001750 tx=0x7f0f6800f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.074+0000 7f0f7558e640 1 -- 172.21.15.78:0/432777665 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6801a430 con 0x55f27cce4840 2024-09-17T03:11:00.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.074+0000 7f0f7558e640 1 -- 172.21.15.78:0/432777665 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f68014030 con 0x55f27cce4840 2024-09-17T03:11:00.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.074+0000 7f0f7558e640 1 -- 172.21.15.78:0/432777665 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6801a850 con 0x55f27cce4840 2024-09-17T03:11:00.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.074+0000 7f0f7ed21f40 1 -- 172.21.15.78:0/432777665 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f27cd72ed0 con 0x55f27cce4840 2024-09-17T03:11:00.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.074+0000 7f0f7ed21f40 1 -- 172.21.15.78:0/432777665 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f27ccfa100 con 0x55f27cce4840 2024-09-17T03:11:00.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.076+0000 7f0f7558e640 1 -- 172.21.15.78:0/432777665 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0f68010410 con 0x55f27cce4840 2024-09-17T03:11:00.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.076+0000 7f0f7558e640 1 --2- 172.21.15.78:0/432777665 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0f640775a0 0x7f0f64079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.076+0000 7f0f7558e640 1 -- 172.21.15.78:0/432777665 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f0f68099cb0 con 0x55f27cce4840 2024-09-17T03:11:00.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.077+0000 7f0f77592640 1 --2- 172.21.15.78:0/432777665 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0f640775a0 0x7f0f64079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.077+0000 7f0f7ed21f40 1 --2- 172.21.15.78:0/432777665 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x55f27cd7dea0 0x55f27ccf4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.077+0000 7f0f7ed21f40 1 -- 172.21.15.78:0/432777665 --> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] -- osd_op(unknown.0.0:1 6.12 6:4bec3886:::10000000002.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45) -- 0x55f27ccf50b0 con 0x55f27cd7dea0 2024-09-17T03:11:00.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.077+0000 7f0f78594640 1 --2- 172.21.15.78:0/432777665 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x55f27cd7dea0 0x55f27ccf4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.077+0000 7f0f77592640 1 --2- 172.21.15.78:0/432777665 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0f640775a0 0x7f0f64079ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c064000 tx=0x7f0f6c004880 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.077+0000 7f0f78594640 1 --2- 172.21.15.78:0/432777665 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x55f27cd7dea0 0x55f27ccf4b70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.079+0000 7f0f78594640 1 -- 172.21.15.78:0/432777665 <== osd.7 v2:172.21.15.193:6802/216613644 1 ==== osd_op_reply(1 10000000002.00000000 [rmxattr] v45'8 uv8 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0f70009040 con 0x55f27cd7dea0 2024-09-17T03:11:00.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.079+0000 7f0f7ed21f40 1 -- 172.21.15.78:0/432777665 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x55f27cd7dea0 msgr2=0x55f27ccf4b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.079+0000 7f0f7ed21f40 1 --2- 172.21.15.78:0/432777665 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x55f27cd7dea0 0x55f27ccf4b70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.079+0000 7f0f7ed21f40 1 -- 172.21.15.78:0/432777665 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0f640775a0 msgr2=0x7f0f64079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.079+0000 7f0f7ed21f40 1 --2- 172.21.15.78:0/432777665 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0f640775a0 0x7f0f64079ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c064000 tx=0x7f0f6c004880 comp rx=0 tx=0).stop 2024-09-17T03:11:00.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.079+0000 7f0f7ed21f40 1 -- 172.21.15.78:0/432777665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f27cce4840 msgr2=0x55f27cd72990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.079+0000 7f0f7ed21f40 1 --2- 172.21.15.78:0/432777665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f27cce4840 0x55f27cd72990 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0f68001750 tx=0x7f0f6800f460 comp rx=0 tx=0).stop 2024-09-17T03:11:00.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.079+0000 7f0f78594640 1 -- 172.21.15.78:0/432777665 reap_dead start 2024-09-17T03:11:00.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.079+0000 7f0f7ed21f40 1 -- 172.21.15.78:0/432777665 shutdown_connections 2024-09-17T03:11:00.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.079+0000 7f0f7ed21f40 1 -- 172.21.15.78:0/432777665 >> 172.21.15.78:0/432777665 conn(0x55f27cbd5ac0 msgr2=0x55f27cce4120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.079+0000 7f0f7ed21f40 1 -- 172.21.15.78:0/432777665 shutdown_connections 2024-09-17T03:11:00.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.079+0000 7f0f7ed21f40 1 -- 172.21.15.78:0/432777665 wait complete. 2024-09-17T03:11:00.081 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000003.00000000 parent 2024-09-17T03:11:00.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.137+0000 7f3bc6218f40 1 Processor -- start 2024-09-17T03:11:00.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.137+0000 7f3bc6218f40 1 -- start start 2024-09-17T03:11:00.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.138+0000 7f3bc6218f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e88b95d90 0x558e88c64d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.138+0000 7f3bc6218f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e88c6c1d0 0x558e88bde930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.138+0000 7f3bc6218f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558e88bdf480 0x558e88c4e110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.138+0000 7f3bc6218f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x558e88ae6d60 con 0x558e88c6c1d0 2024-09-17T03:11:00.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.138+0000 7f3bc6218f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558e88b45430 con 0x558e88b95d90 2024-09-17T03:11:00.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.138+0000 7f3bc6218f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x558e88c6dd60 con 0x558e88bdf480 2024-09-17T03:11:00.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.138+0000 7f3bbf4d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e88c6c1d0 0x558e88bde930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.138+0000 7f3bbf4d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e88c6c1d0 0x558e88bde930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57816/0 (socket says 172.21.15.78:57816) 2024-09-17T03:11:00.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.138+0000 7f3bbf4d1640 1 -- 172.21.15.78:0/2538422738 learned_addr learned my addr 172.21.15.78:0/2538422738 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.138+0000 7f3bc04d3640 1 --2- 172.21.15.78:0/2538422738 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558e88bdf480 0x558e88c4e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.138+0000 7f3bbfcd2640 1 --2- 172.21.15.78:0/2538422738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e88b95d90 0x558e88c64d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.138+0000 7f3bbf4d1640 1 -- 172.21.15.78:0/2538422738 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558e88bdf480 msgr2=0x558e88c4e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.138+0000 7f3bbf4d1640 1 --2- 172.21.15.78:0/2538422738 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558e88bdf480 0x558e88c4e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.138+0000 7f3bbf4d1640 1 -- 172.21.15.78:0/2538422738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e88b95d90 msgr2=0x558e88c64d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.138+0000 7f3bbf4d1640 1 --2- 172.21.15.78:0/2538422738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e88b95d90 0x558e88c64d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.138+0000 7f3bbf4d1640 1 -- 172.21.15.78:0/2538422738 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e88b99840 con 0x558e88c6c1d0 2024-09-17T03:11:00.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.138+0000 7f3bbf4d1640 1 --2- 172.21.15.78:0/2538422738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e88c6c1d0 0x558e88bde930 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4025de0 tx=0x7f3bb4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd415509a37b340 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.139+0000 7f3bbe4cf640 1 -- 172.21.15.78:0/2538422738 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb404dcd0 con 0x558e88c6c1d0 2024-09-17T03:11:00.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.139+0000 7f3bbe4cf640 1 -- 172.21.15.78:0/2538422738 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bb4056470 con 0x558e88c6c1d0 2024-09-17T03:11:00.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.139+0000 7f3bbe4cf640 1 -- 172.21.15.78:0/2538422738 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb40568c0 con 0x558e88c6c1d0 2024-09-17T03:11:00.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.139+0000 7f3bc6218f40 1 -- 172.21.15.78:0/2538422738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e88c6c1d0 msgr2=0x558e88bde930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.139+0000 7f3bc6218f40 1 --2- 172.21.15.78:0/2538422738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e88c6c1d0 0x558e88bde930 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4025de0 tx=0x7f3bb4002fb0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.139+0000 7f3bc6218f40 1 -- 172.21.15.78:0/2538422738 shutdown_connections 2024-09-17T03:11:00.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.139+0000 7f3bc6218f40 1 --2- 172.21.15.78:0/2538422738 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558e88bdf480 0x558e88c4e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.139+0000 7f3bc6218f40 1 --2- 172.21.15.78:0/2538422738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e88c6c1d0 0x558e88bde930 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.139+0000 7f3bc6218f40 1 --2- 172.21.15.78:0/2538422738 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e88b95d90 0x558e88c64d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.139+0000 7f3bc6218f40 1 -- 172.21.15.78:0/2538422738 >> 172.21.15.78:0/2538422738 conn(0x558e88ab7ac0 msgr2=0x558e88bdfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.139+0000 7f3bc6218f40 1 -- 172.21.15.78:0/2538422738 shutdown_connections 2024-09-17T03:11:00.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.139+0000 7f3bc6218f40 1 -- 172.21.15.78:0/2538422738 wait complete. 2024-09-17T03:11:00.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.140+0000 7f3bc6218f40 1 Processor -- start 2024-09-17T03:11:00.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.140+0000 7f3bc6218f40 1 -- start start 2024-09-17T03:11:00.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.141+0000 7f3bc6218f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558e88b95d90 0x558e88c49960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.141+0000 7f3bc6218f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e88bdf480 0x558e88c49150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.141+0000 7f3bc6218f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e88c6c1d0 0x558e88c6b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.141+0000 7f3bc6218f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x558e88c4eb50 con 0x558e88bdf480 2024-09-17T03:11:00.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.141+0000 7f3bc6218f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x558e88bc3eb0 con 0x558e88c6c1d0 2024-09-17T03:11:00.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.141+0000 7f3bc6218f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x558e88c4a1f0 con 0x558e88b95d90 2024-09-17T03:11:00.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.142+0000 7f3bbf4d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e88bdf480 0x558e88c49150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.142+0000 7f3bbf4d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e88bdf480 0x558e88c49150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57830/0 (socket says 172.21.15.78:57830) 2024-09-17T03:11:00.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.142+0000 7f3bbf4d1640 1 -- 172.21.15.78:0/2700751024 learned_addr learned my addr 172.21.15.78:0/2700751024 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.142+0000 7f3bbfcd2640 1 --2- 172.21.15.78:0/2700751024 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558e88b95d90 0x558e88c49960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.142+0000 7f3bc04d3640 1 --2- 172.21.15.78:0/2700751024 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e88c6c1d0 0x558e88c6b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.142+0000 7f3bbf4d1640 1 -- 172.21.15.78:0/2700751024 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558e88b95d90 msgr2=0x558e88c49960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.142+0000 7f3bbf4d1640 1 --2- 172.21.15.78:0/2700751024 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x558e88b95d90 0x558e88c49960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.142+0000 7f3bbf4d1640 1 -- 172.21.15.78:0/2700751024 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e88c6c1d0 msgr2=0x558e88c6b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.142+0000 7f3bbf4d1640 1 --2- 172.21.15.78:0/2700751024 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e88c6c1d0 0x558e88c6b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.142+0000 7f3bbf4d1640 1 -- 172.21.15.78:0/2700751024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e88bc30e0 con 0x558e88bdf480 2024-09-17T03:11:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.142+0000 7f3bc04d3640 1 --2- 172.21.15.78:0/2700751024 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x558e88c6c1d0 0x558e88c6b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.142+0000 7f3bbf4d1640 1 --2- 172.21.15.78:0/2700751024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e88bdf480 0x558e88c49150 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4025db0 tx=0x7f3bb40041c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.142+0000 7f3bbd4cd640 1 -- 172.21.15.78:0/2700751024 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb406f030 con 0x558e88bdf480 2024-09-17T03:11:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.142+0000 7f3bbd4cd640 1 -- 172.21.15.78:0/2700751024 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bb40576b0 con 0x558e88bdf480 2024-09-17T03:11:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.142+0000 7f3bbd4cd640 1 -- 172.21.15.78:0/2700751024 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4067040 con 0x558e88bdf480 2024-09-17T03:11:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.142+0000 7f3bc6218f40 1 -- 172.21.15.78:0/2700751024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558e88bc2e40 con 0x558e88bdf480 2024-09-17T03:11:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.142+0000 7f3bc6218f40 1 -- 172.21.15.78:0/2700751024 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e88c6add0 con 0x558e88bdf480 2024-09-17T03:11:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.144+0000 7f3bbd4cd640 1 -- 172.21.15.78:0/2700751024 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3bb4072070 con 0x558e88bdf480 2024-09-17T03:11:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.144+0000 7f3bbd4cd640 1 --2- 172.21.15.78:0/2700751024 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3bac077570 0x7f3bac079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.144+0000 7f3bbd4cd640 1 -- 172.21.15.78:0/2700751024 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f3bb40dea70 con 0x558e88bdf480 2024-09-17T03:11:00.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.145+0000 7f3bc6218f40 1 --2- 172.21.15.78:0/2700751024 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x558e88bdfa30 0x558e88bdfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.145+0000 7f3bbfcd2640 1 --2- 172.21.15.78:0/2700751024 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3bac077570 0x7f3bac079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.145+0000 7f3bc6218f40 1 -- 172.21.15.78:0/2700751024 --> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] -- osd_op(unknown.0.0:1 6.12 6:4def72d4:::10000000003.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45) -- 0x558e88c4cec0 con 0x558e88bdfa30 2024-09-17T03:11:00.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.145+0000 7f3bc04d3640 1 --2- 172.21.15.78:0/2700751024 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x558e88bdfa30 0x558e88bdfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.145+0000 7f3bbfcd2640 1 --2- 172.21.15.78:0/2700751024 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3bac077570 0x7f3bac079a80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000f4c0 tx=0x7f3bb0007810 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.145+0000 7f3bc04d3640 1 --2- 172.21.15.78:0/2700751024 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x558e88bdfa30 0x558e88bdfe40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.147+0000 7f3bc04d3640 1 -- 172.21.15.78:0/2700751024 <== osd.7 v2:172.21.15.193:6802/216613644 1 ==== osd_op_reply(1 10000000003.00000000 [rmxattr] v45'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f3bb8003040 con 0x558e88bdfa30 2024-09-17T03:11:00.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.147+0000 7f3bc6218f40 1 -- 172.21.15.78:0/2700751024 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x558e88bdfa30 msgr2=0x558e88bdfe40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.147+0000 7f3bc6218f40 1 --2- 172.21.15.78:0/2700751024 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x558e88bdfa30 0x558e88bdfe40 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.147+0000 7f3bc6218f40 1 -- 172.21.15.78:0/2700751024 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3bac077570 msgr2=0x7f3bac079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.147+0000 7f3bc6218f40 1 --2- 172.21.15.78:0/2700751024 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3bac077570 0x7f3bac079a80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3bb000f4c0 tx=0x7f3bb0007810 comp rx=0 tx=0).stop 2024-09-17T03:11:00.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.147+0000 7f3bc6218f40 1 -- 172.21.15.78:0/2700751024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e88bdf480 msgr2=0x558e88c49150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.147+0000 7f3bc6218f40 1 --2- 172.21.15.78:0/2700751024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x558e88bdf480 0x558e88c49150 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4025db0 tx=0x7f3bb40041c0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.147+0000 7f3bc04d3640 1 -- 172.21.15.78:0/2700751024 reap_dead start 2024-09-17T03:11:00.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.147+0000 7f3bc6218f40 1 -- 172.21.15.78:0/2700751024 shutdown_connections 2024-09-17T03:11:00.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.147+0000 7f3bc6218f40 1 -- 172.21.15.78:0/2700751024 >> 172.21.15.78:0/2700751024 conn(0x558e88ab7ac0 msgr2=0x558e88cfe280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.147+0000 7f3bc6218f40 1 -- 172.21.15.78:0/2700751024 shutdown_connections 2024-09-17T03:11:00.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.147+0000 7f3bc6218f40 1 -- 172.21.15.78:0/2700751024 wait complete. 2024-09-17T03:11:00.149 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000004.00000000 parent 2024-09-17T03:11:00.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.205+0000 7f3b90f1df40 1 Processor -- start 2024-09-17T03:11:00.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.205+0000 7f3b90f1df40 1 -- start start 2024-09-17T03:11:00.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.206+0000 7f3b90f1df40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556490f9cd90 0x556490fe5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.206+0000 7f3b90f1df40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556490f9df80 0x556491072880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.207+0000 7f3b90f1df40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564910731d0 0x556490fc85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.207+0000 7f3b90f1df40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x556490eedd60 con 0x556490f9cd90 2024-09-17T03:11:00.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.207+0000 7f3b90f1df40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556490f4c430 con 0x5564910731d0 2024-09-17T03:11:00.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.207+0000 7f3b90f1df40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x556491075830 con 0x556490f9df80 2024-09-17T03:11:00.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.207+0000 7f3b89f62640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556490f9cd90 0x556490fe5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.207+0000 7f3b89f62640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556490f9cd90 0x556490fe5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57848/0 (socket says 172.21.15.78:57848) 2024-09-17T03:11:00.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.207+0000 7f3b89f62640 1 -- 172.21.15.78:0/1180941593 learned_addr learned my addr 172.21.15.78:0/1180941593 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.207+0000 7f3b8a763640 1 --2- 172.21.15.78:0/1180941593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564910731d0 0x556490fc85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.207+0000 7f3b89761640 1 --2- 172.21.15.78:0/1180941593 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556490f9df80 0x556491072880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.207+0000 7f3b89f62640 1 -- 172.21.15.78:0/1180941593 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556490f9df80 msgr2=0x556491072880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.207+0000 7f3b89f62640 1 --2- 172.21.15.78:0/1180941593 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556490f9df80 0x556491072880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.207+0000 7f3b89f62640 1 -- 172.21.15.78:0/1180941593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564910731d0 msgr2=0x556490fc85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.207+0000 7f3b89f62640 1 --2- 172.21.15.78:0/1180941593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564910731d0 0x556490fc85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.207+0000 7f3b89f62640 1 -- 172.21.15.78:0/1180941593 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55649106c800 con 0x556490f9cd90 2024-09-17T03:11:00.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.207+0000 7f3b89f62640 1 --2- 172.21.15.78:0/1180941593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556490f9cd90 0x556490fe5930 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c000c00 tx=0x7f3b7c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a493df0bbde411d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.207+0000 7f3b7bfff640 1 -- 172.21.15.78:0/1180941593 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c04d9e0 con 0x556490f9cd90 2024-09-17T03:11:00.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.207+0000 7f3b7bfff640 1 -- 172.21.15.78:0/1180941593 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b7c056470 con 0x556490f9cd90 2024-09-17T03:11:00.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.207+0000 7f3b7bfff640 1 -- 172.21.15.78:0/1180941593 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0568a0 con 0x556490f9cd90 2024-09-17T03:11:00.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.208+0000 7f3b90f1df40 1 -- 172.21.15.78:0/1180941593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556490f9cd90 msgr2=0x556490fe5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.208+0000 7f3b90f1df40 1 --2- 172.21.15.78:0/1180941593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556490f9cd90 0x556490fe5930 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c000c00 tx=0x7f3b7c002fb0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.208+0000 7f3b90f1df40 1 -- 172.21.15.78:0/1180941593 shutdown_connections 2024-09-17T03:11:00.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.208+0000 7f3b90f1df40 1 --2- 172.21.15.78:0/1180941593 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564910731d0 0x556490fc85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.208+0000 7f3b90f1df40 1 --2- 172.21.15.78:0/1180941593 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556490f9df80 0x556491072880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.208+0000 7f3b90f1df40 1 --2- 172.21.15.78:0/1180941593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556490f9cd90 0x556490fe5930 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.208+0000 7f3b90f1df40 1 -- 172.21.15.78:0/1180941593 >> 172.21.15.78:0/1180941593 conn(0x556490ebeac0 msgr2=0x556490fc9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.208+0000 7f3b90f1df40 1 -- 172.21.15.78:0/1180941593 shutdown_connections 2024-09-17T03:11:00.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.208+0000 7f3b90f1df40 1 -- 172.21.15.78:0/1180941593 wait complete. 2024-09-17T03:11:00.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.209+0000 7f3b90f1df40 1 Processor -- start 2024-09-17T03:11:00.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.209+0000 7f3b90f1df40 1 -- start start 2024-09-17T03:11:00.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.210+0000 7f3b90f1df40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556490f9cd90 0x556491072450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.210+0000 7f3b90f1df40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556490f9df80 0x5564910531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.210+0000 7f3b90f1df40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564910731d0 0x556490fe6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.210+0000 7f3b90f1df40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55649106dc50 con 0x556490f9cd90 2024-09-17T03:11:00.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.210+0000 7f3b90f1df40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556490fc9ae0 con 0x556490f9df80 2024-09-17T03:11:00.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.210+0000 7f3b90f1df40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55649106d8e0 con 0x5564910731d0 2024-09-17T03:11:00.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.210+0000 7f3b89f62640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556490f9cd90 0x556491072450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.210+0000 7f3b89f62640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556490f9cd90 0x556491072450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57860/0 (socket says 172.21.15.78:57860) 2024-09-17T03:11:00.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.210+0000 7f3b89f62640 1 -- 172.21.15.78:0/2408966052 learned_addr learned my addr 172.21.15.78:0/2408966052 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.210+0000 7f3b89761640 1 --2- 172.21.15.78:0/2408966052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556490f9df80 0x5564910531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.210+0000 7f3b8a763640 1 --2- 172.21.15.78:0/2408966052 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564910731d0 0x556490fe6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.210+0000 7f3b89f62640 1 -- 172.21.15.78:0/2408966052 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564910731d0 msgr2=0x556490fe6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.210+0000 7f3b89f62640 1 --2- 172.21.15.78:0/2408966052 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564910731d0 0x556490fe6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.210+0000 7f3b89f62640 1 -- 172.21.15.78:0/2408966052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556490f9df80 msgr2=0x5564910531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.210+0000 7f3b89f62640 1 --2- 172.21.15.78:0/2408966052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556490f9df80 0x5564910531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.210+0000 7f3b89f62640 1 -- 172.21.15.78:0/2408966052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556491053730 con 0x556490f9cd90 2024-09-17T03:11:00.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.210+0000 7f3b89761640 1 --2- 172.21.15.78:0/2408966052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556490f9df80 0x5564910531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:00.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.211+0000 7f3b89f62640 1 --2- 172.21.15.78:0/2408966052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556490f9cd90 0x556491072450 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c046680 tx=0x7f3b7c056c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.211+0000 7f3b7affd640 1 -- 172.21.15.78:0/2408966052 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c071070 con 0x556490f9cd90 2024-09-17T03:11:00.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.211+0000 7f3b7affd640 1 -- 172.21.15.78:0/2408966052 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b7c04d7e0 con 0x556490f9cd90 2024-09-17T03:11:00.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.211+0000 7f3b90f1df40 1 -- 172.21.15.78:0/2408966052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556491068120 con 0x556490f9cd90 2024-09-17T03:11:00.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.211+0000 7f3b7affd640 1 -- 172.21.15.78:0/2408966052 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c06c690 con 0x556490f9cd90 2024-09-17T03:11:00.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.211+0000 7f3b90f1df40 1 -- 172.21.15.78:0/2408966052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55649106e4c0 con 0x556490f9cd90 2024-09-17T03:11:00.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.212+0000 7f3b7affd640 1 -- 172.21.15.78:0/2408966052 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3b7c06a040 con 0x556490f9cd90 2024-09-17T03:11:00.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.213+0000 7f3b7affd640 1 --2- 172.21.15.78:0/2408966052 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3b6c0775a0 0x7f3b6c079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.213+0000 7f3b7affd640 1 -- 172.21.15.78:0/2408966052 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f3b7c0deb10 con 0x556490f9cd90 2024-09-17T03:11:00.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.213+0000 7f3b90f1df40 1 --2- 172.21.15.78:0/2408966052 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x556491063710 0x556491063b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.213+0000 7f3b89761640 1 --2- 172.21.15.78:0/2408966052 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3b6c0775a0 0x7f3b6c079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.213+0000 7f3b90f1df40 1 -- 172.21.15.78:0/2408966052 --> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] -- osd_op(unknown.0.0:1 6.5 6:a367a3e8:::10000000004.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45) -- 0x556491116910 con 0x556491063710 2024-09-17T03:11:00.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.213+0000 7f3b8a763640 1 --2- 172.21.15.78:0/2408966052 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x556491063710 0x556491063b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.214+0000 7f3b89761640 1 --2- 172.21.15.78:0/2408966052 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3b6c0775a0 0x7f3b6c079ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3b80006fd0 tx=0x7f3b80006760 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.214+0000 7f3b8a763640 1 --2- 172.21.15.78:0/2408966052 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x556491063710 0x556491063b20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.215+0000 7f3b8a763640 1 -- 172.21.15.78:0/2408966052 <== osd.7 v2:172.21.15.193:6802/216613644 1 ==== osd_op_reply(1 10000000004.00000000 [rmxattr] v45'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f3b84001560 con 0x556491063710 2024-09-17T03:11:00.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.215+0000 7f3b90f1df40 1 -- 172.21.15.78:0/2408966052 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x556491063710 msgr2=0x556491063b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.215+0000 7f3b90f1df40 1 --2- 172.21.15.78:0/2408966052 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x556491063710 0x556491063b20 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.215+0000 7f3b90f1df40 1 -- 172.21.15.78:0/2408966052 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3b6c0775a0 msgr2=0x7f3b6c079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.215+0000 7f3b90f1df40 1 --2- 172.21.15.78:0/2408966052 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3b6c0775a0 0x7f3b6c079ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3b80006fd0 tx=0x7f3b80006760 comp rx=0 tx=0).stop 2024-09-17T03:11:00.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.215+0000 7f3b90f1df40 1 -- 172.21.15.78:0/2408966052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556490f9cd90 msgr2=0x556491072450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.215+0000 7f3b90f1df40 1 --2- 172.21.15.78:0/2408966052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556490f9cd90 0x556491072450 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c046680 tx=0x7f3b7c056c50 comp rx=0 tx=0).stop 2024-09-17T03:11:00.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.215+0000 7f3b8a763640 1 -- 172.21.15.78:0/2408966052 reap_dead start 2024-09-17T03:11:00.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.215+0000 7f3b90f1df40 1 -- 172.21.15.78:0/2408966052 shutdown_connections 2024-09-17T03:11:00.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.215+0000 7f3b90f1df40 1 -- 172.21.15.78:0/2408966052 >> 172.21.15.78:0/2408966052 conn(0x556490ebeac0 msgr2=0x5564910668a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.216+0000 7f3b90f1df40 1 -- 172.21.15.78:0/2408966052 shutdown_connections 2024-09-17T03:11:00.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.216+0000 7f3b90f1df40 1 -- 172.21.15.78:0/2408966052 wait complete. 2024-09-17T03:11:00.218 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000005.00000000 parent 2024-09-17T03:11:00.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.274+0000 7f4c1d51bf40 1 Processor -- start 2024-09-17T03:11:00.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.274+0000 7f4c1d51bf40 1 -- start start 2024-09-17T03:11:00.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c1d51bf40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b0a784b2c0 0x55b0a781b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c1d51bf40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b0a78f0300 0x55b0a78e7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c1d51bf40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0a78f86c0 0x55b0a78ee620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c1d51bf40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55b0a77ca430 con 0x55b0a78f86c0 2024-09-17T03:11:00.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c1d51bf40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b0a77d71f0 con 0x55b0a784b2c0 2024-09-17T03:11:00.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c1d51bf40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55b0a776bd60 con 0x55b0a78f0300 2024-09-17T03:11:00.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c16d53640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0a78f86c0 0x55b0a78ee620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c16d53640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0a78f86c0 0x55b0a78ee620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57876/0 (socket says 172.21.15.78:57876) 2024-09-17T03:11:00.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c16d53640 1 -- 172.21.15.78:0/840012780 learned_addr learned my addr 172.21.15.78:0/840012780 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c16552640 1 --2- 172.21.15.78:0/840012780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b0a784b2c0 0x55b0a781b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c0ffff640 1 --2- 172.21.15.78:0/840012780 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b0a78f0300 0x55b0a78e7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c16d53640 1 -- 172.21.15.78:0/840012780 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b0a78f0300 msgr2=0x55b0a78e7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c16d53640 1 --2- 172.21.15.78:0/840012780 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b0a78f0300 0x55b0a78e7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c16d53640 1 -- 172.21.15.78:0/840012780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b0a784b2c0 msgr2=0x55b0a781b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c16d53640 1 --2- 172.21.15.78:0/840012780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b0a784b2c0 0x55b0a781b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c16d53640 1 -- 172.21.15.78:0/840012780 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0a781baa0 con 0x55b0a78f86c0 2024-09-17T03:11:00.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c16552640 1 --2- 172.21.15.78:0/840012780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b0a784b2c0 0x55b0a781b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:00.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c16d53640 1 --2- 172.21.15.78:0/840012780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0a78f86c0 0x55b0a78ee620 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4c10025eb0 tx=0x7f4c10003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed36e933ab6f69a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c15550640 1 -- 172.21.15.78:0/840012780 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c10064070 con 0x55b0a78f86c0 2024-09-17T03:11:00.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c15550640 1 -- 172.21.15.78:0/840012780 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c1004dba0 con 0x55b0a78f86c0 2024-09-17T03:11:00.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.276+0000 7f4c15550640 1 -- 172.21.15.78:0/840012780 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c10060430 con 0x55b0a78f86c0 2024-09-17T03:11:00.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.277+0000 7f4c1d51bf40 1 -- 172.21.15.78:0/840012780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0a78f86c0 msgr2=0x55b0a78ee620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.277+0000 7f4c1d51bf40 1 --2- 172.21.15.78:0/840012780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0a78f86c0 0x55b0a78ee620 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4c10025eb0 tx=0x7f4c10003330 comp rx=0 tx=0).stop 2024-09-17T03:11:00.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.277+0000 7f4c1d51bf40 1 -- 172.21.15.78:0/840012780 shutdown_connections 2024-09-17T03:11:00.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.277+0000 7f4c1d51bf40 1 --2- 172.21.15.78:0/840012780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0a78f86c0 0x55b0a78ee620 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.277+0000 7f4c1d51bf40 1 --2- 172.21.15.78:0/840012780 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b0a78f0300 0x55b0a78e7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.277+0000 7f4c1d51bf40 1 --2- 172.21.15.78:0/840012780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b0a784b2c0 0x55b0a781b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.277+0000 7f4c1d51bf40 1 -- 172.21.15.78:0/840012780 >> 172.21.15.78:0/840012780 conn(0x55b0a773cac0 msgr2=0x55b0a78e9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.277+0000 7f4c1d51bf40 1 -- 172.21.15.78:0/840012780 shutdown_connections 2024-09-17T03:11:00.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.277+0000 7f4c1d51bf40 1 -- 172.21.15.78:0/840012780 wait complete. 2024-09-17T03:11:00.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.278+0000 7f4c1d51bf40 1 Processor -- start 2024-09-17T03:11:00.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.278+0000 7f4c1d51bf40 1 -- start start 2024-09-17T03:11:00.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.279+0000 7f4c1d51bf40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b0a784b2c0 0x55b0a781a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.279+0000 7f4c1d51bf40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b0a78f0300 0x55b0a781aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.279+0000 7f4c1d51bf40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0a78f86c0 0x55b0a78e9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.279+0000 7f4c1d51bf40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55b0a78ed0e0 con 0x55b0a78f86c0 2024-09-17T03:11:00.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.279+0000 7f4c1d51bf40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b0a7848fa0 con 0x55b0a784b2c0 2024-09-17T03:11:00.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.279+0000 7f4c1d51bf40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55b0a78f8310 con 0x55b0a78f0300 2024-09-17T03:11:00.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.279+0000 7f4c16d53640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0a78f86c0 0x55b0a78e9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.279+0000 7f4c16d53640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0a78f86c0 0x55b0a78e9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57886/0 (socket says 172.21.15.78:57886) 2024-09-17T03:11:00.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.279+0000 7f4c16d53640 1 -- 172.21.15.78:0/3176982297 learned_addr learned my addr 172.21.15.78:0/3176982297 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.279+0000 7f4c0ffff640 1 --2- 172.21.15.78:0/3176982297 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b0a78f0300 0x55b0a781aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.280+0000 7f4c16552640 1 --2- 172.21.15.78:0/3176982297 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b0a784b2c0 0x55b0a781a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.280+0000 7f4c16d53640 1 -- 172.21.15.78:0/3176982297 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b0a78f0300 msgr2=0x55b0a781aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.280+0000 7f4c16d53640 1 --2- 172.21.15.78:0/3176982297 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b0a78f0300 0x55b0a781aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.280+0000 7f4c16d53640 1 -- 172.21.15.78:0/3176982297 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b0a784b2c0 msgr2=0x55b0a781a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.280+0000 7f4c16d53640 1 --2- 172.21.15.78:0/3176982297 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b0a784b2c0 0x55b0a781a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.280+0000 7f4c16d53640 1 -- 172.21.15.78:0/3176982297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0a7849cd0 con 0x55b0a78f86c0 2024-09-17T03:11:00.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.280+0000 7f4c16d53640 1 --2- 172.21.15.78:0/3176982297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0a78f86c0 0x55b0a78e9090 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4c10025eb0 tx=0x7f4c10060620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.280+0000 7f4c0f7fe640 1 -- 172.21.15.78:0/3176982297 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c10064070 con 0x55b0a78f86c0 2024-09-17T03:11:00.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.280+0000 7f4c0f7fe640 1 -- 172.21.15.78:0/3176982297 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c100609c0 con 0x55b0a78f86c0 2024-09-17T03:11:00.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.280+0000 7f4c1d51bf40 1 -- 172.21.15.78:0/3176982297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b0a78f31f0 con 0x55b0a78f86c0 2024-09-17T03:11:00.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.280+0000 7f4c0f7fe640 1 -- 172.21.15.78:0/3176982297 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c10060df0 con 0x55b0a78f86c0 2024-09-17T03:11:00.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.280+0000 7f4c1d51bf40 1 -- 172.21.15.78:0/3176982297 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b0a78e65c0 con 0x55b0a78f86c0 2024-09-17T03:11:00.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.282+0000 7f4c0f7fe640 1 -- 172.21.15.78:0/3176982297 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4c10072020 con 0x55b0a78f86c0 2024-09-17T03:11:00.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.282+0000 7f4c0f7fe640 1 --2- 172.21.15.78:0/3176982297 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4bf8077570 0x7f4bf8079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.282+0000 7f4c0f7fe640 1 -- 172.21.15.78:0/3176982297 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f4c100dedd0 con 0x55b0a78f86c0 2024-09-17T03:11:00.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.282+0000 7f4c1d51bf40 1 --2- 172.21.15.78:0/3176982297 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x55b0a78e9ae0 0x55b0a78e4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.282+0000 7f4c16552640 1 --2- 172.21.15.78:0/3176982297 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4bf8077570 0x7f4bf8079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.282+0000 7f4c1d51bf40 1 -- 172.21.15.78:0/3176982297 --> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] -- osd_op(unknown.0.0:1 6.9 6:9258b67d:::10000000005.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45) -- 0x55b0a78e5350 con 0x55b0a78e9ae0 2024-09-17T03:11:00.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.282+0000 7f4c0ffff640 1 --2- 172.21.15.78:0/3176982297 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x55b0a78e9ae0 0x55b0a78e4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.283+0000 7f4c0ffff640 1 --2- 172.21.15.78:0/3176982297 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x55b0a78e9ae0 0x55b0a78e4e10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.283+0000 7f4c16552640 1 --2- 172.21.15.78:0/3176982297 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4bf8077570 0x7f4bf8079a80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c5f0 tx=0x7f4c08005760 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.284+0000 7f4c0ffff640 1 -- 172.21.15.78:0/3176982297 <== osd.0 v2:172.21.15.78:6816/3825297687 1 ==== osd_op_reply(1 10000000005.00000000 [rmxattr] v45'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4c00003c60 con 0x55b0a78e9ae0 2024-09-17T03:11:00.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.284+0000 7f4c1d51bf40 1 -- 172.21.15.78:0/3176982297 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x55b0a78e9ae0 msgr2=0x55b0a78e4e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.284+0000 7f4c1d51bf40 1 --2- 172.21.15.78:0/3176982297 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x55b0a78e9ae0 0x55b0a78e4e10 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.284+0000 7f4c1d51bf40 1 -- 172.21.15.78:0/3176982297 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4bf8077570 msgr2=0x7f4bf8079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.284+0000 7f4c1d51bf40 1 --2- 172.21.15.78:0/3176982297 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4bf8077570 0x7f4bf8079a80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c5f0 tx=0x7f4c08005760 comp rx=0 tx=0).stop 2024-09-17T03:11:00.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.284+0000 7f4c1d51bf40 1 -- 172.21.15.78:0/3176982297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0a78f86c0 msgr2=0x55b0a78e9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.284+0000 7f4c1d51bf40 1 --2- 172.21.15.78:0/3176982297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b0a78f86c0 0x55b0a78e9090 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4c10025eb0 tx=0x7f4c10060620 comp rx=0 tx=0).stop 2024-09-17T03:11:00.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.284+0000 7f4c16d53640 1 -- 172.21.15.78:0/3176982297 reap_dead start 2024-09-17T03:11:00.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.284+0000 7f4c1d51bf40 1 -- 172.21.15.78:0/3176982297 shutdown_connections 2024-09-17T03:11:00.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.284+0000 7f4c1d51bf40 1 -- 172.21.15.78:0/3176982297 >> 172.21.15.78:0/3176982297 conn(0x55b0a773cac0 msgr2=0x55b0a7862970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.284+0000 7f4c1d51bf40 1 -- 172.21.15.78:0/3176982297 shutdown_connections 2024-09-17T03:11:00.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.285+0000 7f4c1d51bf40 1 -- 172.21.15.78:0/3176982297 wait complete. 2024-09-17T03:11:00.288 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000006.00000000 parent 2024-09-17T03:11:00.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.345+0000 7fa7caf85f40 1 Processor -- start 2024-09-17T03:11:00.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.345+0000 7fa7caf85f40 1 -- start start 2024-09-17T03:11:00.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.346+0000 7fa7caf85f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5621f2293e90 0x5621f224fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.346+0000 7fa7caf85f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621f2290af0 0x5621f2294db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.346+0000 7fa7caf85f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621f2290f00 0x5621f22952f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.346+0000 7fa7caf85f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5621f21fd430 con 0x5621f2290f00 2024-09-17T03:11:00.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.347+0000 7fa7caf85f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5621f220a1f0 con 0x5621f2290af0 2024-09-17T03:11:00.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.347+0000 7fa7caf85f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5621f219ed60 con 0x5621f2293e90 2024-09-17T03:11:00.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.347+0000 7fa7c5240640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621f2290f00 0x5621f22952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.347+0000 7fa7c5240640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621f2290f00 0x5621f22952f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57900/0 (socket says 172.21.15.78:57900) 2024-09-17T03:11:00.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.347+0000 7fa7c5240640 1 -- 172.21.15.78:0/3310642368 learned_addr learned my addr 172.21.15.78:0/3310642368 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.347+0000 7fa7c4a3f640 1 --2- 172.21.15.78:0/3310642368 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5621f2293e90 0x5621f224fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.347+0000 7fa7c423e640 1 --2- 172.21.15.78:0/3310642368 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621f2290af0 0x5621f2294db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.347+0000 7fa7c5240640 1 -- 172.21.15.78:0/3310642368 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5621f2293e90 msgr2=0x5621f224fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.347+0000 7fa7c5240640 1 --2- 172.21.15.78:0/3310642368 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5621f2293e90 0x5621f224fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.347+0000 7fa7c5240640 1 -- 172.21.15.78:0/3310642368 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621f2290af0 msgr2=0x5621f2294db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.347+0000 7fa7c5240640 1 --2- 172.21.15.78:0/3310642368 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621f2290af0 0x5621f2294db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.347+0000 7fa7c5240640 1 -- 172.21.15.78:0/3310642368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621f2250240 con 0x5621f2290f00 2024-09-17T03:11:00.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.347+0000 7fa7c4a3f640 1 --2- 172.21.15.78:0/3310642368 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5621f2293e90 0x5621f224fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:00.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.347+0000 7fa7c5240640 1 --2- 172.21.15.78:0/3310642368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621f2290f00 0x5621f22952f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc057040 tx=0x5621f2290080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c0c8800e57464b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.347+0000 7fa7c323c640 1 -- 172.21.15.78:0/3310642368 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc0016f0 con 0x5621f2290f00 2024-09-17T03:11:00.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.347+0000 7fa7c323c640 1 -- 172.21.15.78:0/3310642368 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7bc065070 con 0x5621f2290f00 2024-09-17T03:11:00.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.347+0000 7fa7c323c640 1 -- 172.21.15.78:0/3310642368 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7bc04db60 con 0x5621f2290f00 2024-09-17T03:11:00.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.348+0000 7fa7caf85f40 1 -- 172.21.15.78:0/3310642368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621f2290f00 msgr2=0x5621f22952f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.348+0000 7fa7caf85f40 1 --2- 172.21.15.78:0/3310642368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621f2290f00 0x5621f22952f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc057040 tx=0x5621f2290080 comp rx=0 tx=0).stop 2024-09-17T03:11:00.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.348+0000 7fa7caf85f40 1 -- 172.21.15.78:0/3310642368 shutdown_connections 2024-09-17T03:11:00.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.348+0000 7fa7caf85f40 1 --2- 172.21.15.78:0/3310642368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621f2290f00 0x5621f22952f0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.348+0000 7fa7caf85f40 1 --2- 172.21.15.78:0/3310642368 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621f2290af0 0x5621f2294db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.348+0000 7fa7caf85f40 1 --2- 172.21.15.78:0/3310642368 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5621f2293e90 0x5621f224fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.348+0000 7fa7caf85f40 1 -- 172.21.15.78:0/3310642368 >> 172.21.15.78:0/3310642368 conn(0x5621f216fac0 msgr2=0x5621f2323490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.348+0000 7fa7caf85f40 1 -- 172.21.15.78:0/3310642368 shutdown_connections 2024-09-17T03:11:00.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.348+0000 7fa7caf85f40 1 -- 172.21.15.78:0/3310642368 wait complete. 2024-09-17T03:11:00.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.349+0000 7fa7caf85f40 1 Processor -- start 2024-09-17T03:11:00.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.349+0000 7fa7caf85f40 1 -- start start 2024-09-17T03:11:00.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.350+0000 7fa7caf85f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5621f2290af0 0x5621f2305810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.350+0000 7fa7caf85f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621f2290f00 0x5621f2305d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.350+0000 7fa7caf85f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621f2293e90 0x5621f2321e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.350+0000 7fa7caf85f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5621f2323d40 con 0x5621f2290f00 2024-09-17T03:11:00.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.350+0000 7fa7caf85f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5621f2320d60 con 0x5621f2293e90 2024-09-17T03:11:00.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.350+0000 7fa7caf85f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5621f23230e0 con 0x5621f2290af0 2024-09-17T03:11:00.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.350+0000 7fa7c423e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621f2290f00 0x5621f2305d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.350+0000 7fa7c423e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621f2290f00 0x5621f2305d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57904/0 (socket says 172.21.15.78:57904) 2024-09-17T03:11:00.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.350+0000 7fa7c423e640 1 -- 172.21.15.78:0/3985580419 learned_addr learned my addr 172.21.15.78:0/3985580419 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.350+0000 7fa7c4a3f640 1 --2- 172.21.15.78:0/3985580419 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5621f2290af0 0x5621f2305810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.350+0000 7fa7c5240640 1 --2- 172.21.15.78:0/3985580419 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621f2293e90 0x5621f2321e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.350+0000 7fa7c423e640 1 -- 172.21.15.78:0/3985580419 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5621f2290af0 msgr2=0x5621f2305810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.350+0000 7fa7c423e640 1 --2- 172.21.15.78:0/3985580419 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5621f2290af0 0x5621f2305810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.350+0000 7fa7c423e640 1 -- 172.21.15.78:0/3985580419 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621f2293e90 msgr2=0x5621f2321e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.350+0000 7fa7c423e640 1 --2- 172.21.15.78:0/3985580419 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621f2293e90 0x5621f2321e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.350+0000 7fa7c423e640 1 -- 172.21.15.78:0/3985580419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621f22959c0 con 0x5621f2290f00 2024-09-17T03:11:00.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.350+0000 7fa7c5240640 1 --2- 172.21.15.78:0/3985580419 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5621f2293e90 0x5621f2321e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:00.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.351+0000 7fa7c423e640 1 --2- 172.21.15.78:0/3985580419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621f2290f00 0x5621f2305d50 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800a710 tx=0x7fa7b800abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.351+0000 7fa7c223a640 1 -- 172.21.15.78:0/3985580419 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b801b070 con 0x5621f2290f00 2024-09-17T03:11:00.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.351+0000 7fa7c223a640 1 -- 172.21.15.78:0/3985580419 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7b8009b20 con 0x5621f2290f00 2024-09-17T03:11:00.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.351+0000 7fa7c223a640 1 -- 172.21.15.78:0/3985580419 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8016460 con 0x5621f2290f00 2024-09-17T03:11:00.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.351+0000 7fa7caf85f40 1 -- 172.21.15.78:0/3985580419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5621f2302970 con 0x5621f2290f00 2024-09-17T03:11:00.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.351+0000 7fa7caf85f40 1 -- 172.21.15.78:0/3985580419 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621f2306470 con 0x5621f2290f00 2024-09-17T03:11:00.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.352+0000 7fa7c223a640 1 -- 172.21.15.78:0/3985580419 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa7b801e070 con 0x5621f2290f00 2024-09-17T03:11:00.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.353+0000 7fa7c223a640 1 --2- 172.21.15.78:0/3985580419 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa7b00775a0 0x7fa7b0079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.353+0000 7fa7c223a640 1 -- 172.21.15.78:0/3985580419 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fa7b809a160 con 0x5621f2290f00 2024-09-17T03:11:00.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.353+0000 7fa7c4a3f640 1 --2- 172.21.15.78:0/3985580419 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa7b00775a0 0x7fa7b0079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.353+0000 7fa7caf85f40 1 --2- 172.21.15.78:0/3985580419 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x5621f224fe00 0x5621f23ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.353+0000 7fa7caf85f40 1 -- 172.21.15.78:0/3985580419 --> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] -- osd_op(unknown.0.0:1 6.5 6:a5feb6f3:::10000000006.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45) -- 0x5621f2322870 con 0x5621f224fe00 2024-09-17T03:11:00.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.353+0000 7fa7c5240640 1 --2- 172.21.15.78:0/3985580419 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x5621f224fe00 0x5621f23ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.354+0000 7fa7c4a3f640 1 --2- 172.21.15.78:0/3985580419 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa7b00775a0 0x7fa7b0079ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5621f224faf0 tx=0x7fa7b400b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.354+0000 7fa7c5240640 1 --2- 172.21.15.78:0/3985580419 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x5621f224fe00 0x5621f23ca140 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.355+0000 7fa7c5240640 1 -- 172.21.15.78:0/3985580419 <== osd.7 v2:172.21.15.193:6802/216613644 1 ==== osd_op_reply(1 10000000006.00000000 [rmxattr] v45'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa7bc04d900 con 0x5621f224fe00 2024-09-17T03:11:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.355+0000 7fa7caf85f40 1 -- 172.21.15.78:0/3985580419 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x5621f224fe00 msgr2=0x5621f23ca140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.355+0000 7fa7caf85f40 1 --2- 172.21.15.78:0/3985580419 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x5621f224fe00 0x5621f23ca140 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.355+0000 7fa7caf85f40 1 -- 172.21.15.78:0/3985580419 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa7b00775a0 msgr2=0x7fa7b0079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.355+0000 7fa7caf85f40 1 --2- 172.21.15.78:0/3985580419 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa7b00775a0 0x7fa7b0079ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x5621f224faf0 tx=0x7fa7b400b040 comp rx=0 tx=0).stop 2024-09-17T03:11:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.355+0000 7fa7caf85f40 1 -- 172.21.15.78:0/3985580419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621f2290f00 msgr2=0x5621f2305d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.355+0000 7fa7caf85f40 1 --2- 172.21.15.78:0/3985580419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5621f2290f00 0x5621f2305d50 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa7b800a710 tx=0x7fa7b800abd0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.355+0000 7fa7c5240640 1 -- 172.21.15.78:0/3985580419 reap_dead start 2024-09-17T03:11:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.355+0000 7fa7caf85f40 1 -- 172.21.15.78:0/3985580419 shutdown_connections 2024-09-17T03:11:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.355+0000 7fa7caf85f40 1 -- 172.21.15.78:0/3985580419 >> 172.21.15.78:0/3985580419 conn(0x5621f216fac0 msgr2=0x5621f2323450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.355+0000 7fa7caf85f40 1 -- 172.21.15.78:0/3985580419 shutdown_connections 2024-09-17T03:11:00.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.355+0000 7fa7caf85f40 1 -- 172.21.15.78:0/3985580419 wait complete. 2024-09-17T03:11:00.357 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000007.00000000 parent 2024-09-17T03:11:00.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.414+0000 7f76475e1f40 1 Processor -- start 2024-09-17T03:11:00.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.414+0000 7f76475e1f40 1 -- start start 2024-09-17T03:11:00.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.415+0000 7f76475e1f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56036b503820 0x56036b477ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.415+0000 7f76475e1f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56036b5043c0 0x56036b470150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.415+0000 7f76475e1f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56036b476770 0x56036b4786d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.415+0000 7f76475e1f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56036b37dd60 con 0x56036b476770 2024-09-17T03:11:00.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.415+0000 7f76475e1f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56036b3dc430 con 0x56036b503820 2024-09-17T03:11:00.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.415+0000 7f76475e1f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x56036b503c30 con 0x56036b5043c0 2024-09-17T03:11:00.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.415+0000 7f764189c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56036b476770 0x56036b4786d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.415+0000 7f764189c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56036b476770 0x56036b4786d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57906/0 (socket says 172.21.15.78:57906) 2024-09-17T03:11:00.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.415+0000 7f764189c640 1 -- 172.21.15.78:0/3840792433 learned_addr learned my addr 172.21.15.78:0/3840792433 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.415+0000 7f764109b640 1 --2- 172.21.15.78:0/3840792433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56036b503820 0x56036b477ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.415+0000 7f763889a640 1 --2- 172.21.15.78:0/3840792433 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56036b5043c0 0x56036b470150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.415+0000 7f764189c640 1 -- 172.21.15.78:0/3840792433 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56036b5043c0 msgr2=0x56036b470150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.415+0000 7f764189c640 1 --2- 172.21.15.78:0/3840792433 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56036b5043c0 0x56036b470150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.415+0000 7f764189c640 1 -- 172.21.15.78:0/3840792433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56036b503820 msgr2=0x56036b477ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.415+0000 7f764189c640 1 --2- 172.21.15.78:0/3840792433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56036b503820 0x56036b477ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.415+0000 7f764189c640 1 -- 172.21.15.78:0/3840792433 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56036b4fcd40 con 0x56036b476770 2024-09-17T03:11:00.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.416+0000 7f764189c640 1 --2- 172.21.15.78:0/3840792433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56036b476770 0x56036b4786d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f763c00d790 tx=0x7f763c00dc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1d6505093165a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.416+0000 7f763bfff640 1 -- 172.21.15.78:0/3840792433 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c00dea0 con 0x56036b476770 2024-09-17T03:11:00.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.416+0000 7f763bfff640 1 -- 172.21.15.78:0/3840792433 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f763c00bbe0 con 0x56036b476770 2024-09-17T03:11:00.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.416+0000 7f763bfff640 1 -- 172.21.15.78:0/3840792433 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c00f430 con 0x56036b476770 2024-09-17T03:11:00.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.416+0000 7f76475e1f40 1 -- 172.21.15.78:0/3840792433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56036b476770 msgr2=0x56036b4786d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.416+0000 7f76475e1f40 1 --2- 172.21.15.78:0/3840792433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56036b476770 0x56036b4786d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f763c00d790 tx=0x7f763c00dc50 comp rx=0 tx=0).stop 2024-09-17T03:11:00.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.416+0000 7f76475e1f40 1 -- 172.21.15.78:0/3840792433 shutdown_connections 2024-09-17T03:11:00.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.416+0000 7f76475e1f40 1 --2- 172.21.15.78:0/3840792433 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56036b476770 0x56036b4786d0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.416+0000 7f76475e1f40 1 --2- 172.21.15.78:0/3840792433 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56036b5043c0 0x56036b470150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.416+0000 7f76475e1f40 1 --2- 172.21.15.78:0/3840792433 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56036b503820 0x56036b477ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.416+0000 7f76475e1f40 1 -- 172.21.15.78:0/3840792433 >> 172.21.15.78:0/3840792433 conn(0x56036b34eac0 msgr2=0x56036b476e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.416+0000 7f76475e1f40 1 -- 172.21.15.78:0/3840792433 shutdown_connections 2024-09-17T03:11:00.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.416+0000 7f76475e1f40 1 -- 172.21.15.78:0/3840792433 wait complete. 2024-09-17T03:11:00.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.417+0000 7f76475e1f40 1 Processor -- start 2024-09-17T03:11:00.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.417+0000 7f76475e1f40 1 -- start start 2024-09-17T03:11:00.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f76475e1f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56036b476770 0x56036b4e1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f76475e1f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56036b503820 0x56036b4dd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f76475e1f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56036b5043c0 0x56036b4e7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f76475e1f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56036b477a30 con 0x56036b5043c0 2024-09-17T03:11:00.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f76475e1f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56036b4fd020 con 0x56036b503820 2024-09-17T03:11:00.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f76475e1f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x56036b5028d0 con 0x56036b476770 2024-09-17T03:11:00.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f764189c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56036b5043c0 0x56036b4e7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f764189c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56036b5043c0 0x56036b4e7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57918/0 (socket says 172.21.15.78:57918) 2024-09-17T03:11:00.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f764189c640 1 -- 172.21.15.78:0/1046105304 learned_addr learned my addr 172.21.15.78:0/1046105304 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f764109b640 1 --2- 172.21.15.78:0/1046105304 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56036b476770 0x56036b4e1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f763889a640 1 --2- 172.21.15.78:0/1046105304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56036b503820 0x56036b4dd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f764189c640 1 -- 172.21.15.78:0/1046105304 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56036b476770 msgr2=0x56036b4e1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f764189c640 1 --2- 172.21.15.78:0/1046105304 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56036b476770 0x56036b4e1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f764189c640 1 -- 172.21.15.78:0/1046105304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56036b503820 msgr2=0x56036b4dd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f764189c640 1 --2- 172.21.15.78:0/1046105304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56036b503820 0x56036b4dd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f764189c640 1 -- 172.21.15.78:0/1046105304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56036b474cc0 con 0x56036b5043c0 2024-09-17T03:11:00.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f763889a640 1 --2- 172.21.15.78:0/1046105304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56036b503820 0x56036b4dd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:00.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f764189c640 1 --2- 172.21.15.78:0/1046105304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56036b5043c0 0x56036b4e7e80 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x56036b4fd290 tx=0x7f763c00f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f763affd640 1 -- 172.21.15.78:0/1046105304 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c00fa60 con 0x56036b5043c0 2024-09-17T03:11:00.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f763affd640 1 -- 172.21.15.78:0/1046105304 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f763c00fc00 con 0x56036b5043c0 2024-09-17T03:11:00.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f76475e1f40 1 -- 172.21.15.78:0/1046105304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56036b474f60 con 0x56036b5043c0 2024-09-17T03:11:00.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f763affd640 1 -- 172.21.15.78:0/1046105304 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763c022420 con 0x56036b5043c0 2024-09-17T03:11:00.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.419+0000 7f76475e1f40 1 -- 172.21.15.78:0/1046105304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56036b4e2540 con 0x56036b5043c0 2024-09-17T03:11:00.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.421+0000 7f763affd640 1 -- 172.21.15.78:0/1046105304 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f763c02b440 con 0x56036b5043c0 2024-09-17T03:11:00.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.421+0000 7f763affd640 1 --2- 172.21.15.78:0/1046105304 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7624077570 0x7f7624079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.422+0000 7f763affd640 1 -- 172.21.15.78:0/1046105304 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f763c09bf10 con 0x56036b5043c0 2024-09-17T03:11:00.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.422+0000 7f764109b640 1 --2- 172.21.15.78:0/1046105304 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7624077570 0x7f7624079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.422+0000 7f76475e1f40 1 --2- 172.21.15.78:0/1046105304 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x56036b4e13d0 0x56036b477360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.422+0000 7f76475e1f40 1 -- 172.21.15.78:0/1046105304 --> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] -- osd_op(unknown.0.0:1 6.1d 6:bbf5850a:::10000000007.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45) -- 0x56036b5a8f00 con 0x56036b4e13d0 2024-09-17T03:11:00.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.422+0000 7f763889a640 1 --2- 172.21.15.78:0/1046105304 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x56036b4e13d0 0x56036b477360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.422+0000 7f764109b640 1 --2- 172.21.15.78:0/1046105304 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7624077570 0x7f7624079a80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7634001200 tx=0x7f7634001190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.422+0000 7f763889a640 1 --2- 172.21.15.78:0/1046105304 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x56036b4e13d0 0x56036b477360 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.424+0000 7f763889a640 1 -- 172.21.15.78:0/1046105304 <== osd.1 v2:172.21.15.78:6808/607587433 1 ==== osd_op_reply(1 10000000007.00000000 [rmxattr] v45'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f762c04eb40 con 0x56036b4e13d0 2024-09-17T03:11:00.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.424+0000 7f76475e1f40 1 -- 172.21.15.78:0/1046105304 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x56036b4e13d0 msgr2=0x56036b477360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.424+0000 7f76475e1f40 1 --2- 172.21.15.78:0/1046105304 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x56036b4e13d0 0x56036b477360 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.424+0000 7f76475e1f40 1 -- 172.21.15.78:0/1046105304 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7624077570 msgr2=0x7f7624079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.424+0000 7f76475e1f40 1 --2- 172.21.15.78:0/1046105304 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7624077570 0x7f7624079a80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7634001200 tx=0x7f7634001190 comp rx=0 tx=0).stop 2024-09-17T03:11:00.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.424+0000 7f76475e1f40 1 -- 172.21.15.78:0/1046105304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56036b5043c0 msgr2=0x56036b4e7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.424+0000 7f76475e1f40 1 --2- 172.21.15.78:0/1046105304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56036b5043c0 0x56036b4e7e80 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x56036b4fd290 tx=0x7f763c00f660 comp rx=0 tx=0).stop 2024-09-17T03:11:00.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.424+0000 7f764189c640 1 -- 172.21.15.78:0/1046105304 reap_dead start 2024-09-17T03:11:00.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.424+0000 7f76475e1f40 1 -- 172.21.15.78:0/1046105304 shutdown_connections 2024-09-17T03:11:00.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.424+0000 7f76475e1f40 1 -- 172.21.15.78:0/1046105304 >> 172.21.15.78:0/1046105304 conn(0x56036b34eac0 msgr2=0x56036b42f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.424+0000 7f76475e1f40 1 -- 172.21.15.78:0/1046105304 shutdown_connections 2024-09-17T03:11:00.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.424+0000 7f76475e1f40 1 -- 172.21.15.78:0/1046105304 wait complete. 2024-09-17T03:11:00.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:11:00.426 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub start /d1/d2/d3 recursive,force 2024-09-17T03:11:00.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.544+0000 7f652181d640 1 -- 172.21.15.78:0/1876426716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f651c0b20a0 msgr2=0x7f651c0b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.544+0000 7f652181d640 1 --2- 172.21.15.78:0/1876426716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f651c0b20a0 0x7f651c0b24b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f651c09bbc0 tx=0x7f651402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.544+0000 7f652181d640 1 -- 172.21.15.78:0/1876426716 shutdown_connections 2024-09-17T03:11:00.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.544+0000 7f652181d640 1 --2- 172.21.15.78:0/1876426716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f651c0b20a0 0x7f651c0b24b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.544+0000 7f652181d640 1 --2- 172.21.15.78:0/1876426716 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f651c0d1060 0x7f651c0b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.544+0000 7f652181d640 1 -- 172.21.15.78:0/1876426716 >> 172.21.15.78:0/1876426716 conn(0x7f651c0ced80 msgr2=0x7f651c0cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.544+0000 7f652181d640 1 -- 172.21.15.78:0/1876426716 shutdown_connections 2024-09-17T03:11:00.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.544+0000 7f652181d640 1 -- 172.21.15.78:0/1876426716 wait complete. 2024-09-17T03:11:00.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.546+0000 7f652181d640 1 Processor -- start 2024-09-17T03:11:00.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.546+0000 7f652181d640 1 -- start start 2024-09-17T03:11:00.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f652181d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f651c0b20a0 0x7f651c157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f652181d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f651c0b7a00 0x7f651c1597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f652181d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f651c0d1060 0x7f651c1530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f652181d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f651c0ccf10 con 0x7f651c0d1060 2024-09-17T03:11:00.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f652181d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f651c0b1940 con 0x7f651c0b20a0 2024-09-17T03:11:00.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f652181d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f651c0cd090 con 0x7f651c0b7a00 2024-09-17T03:11:00.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f651b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f651c0d1060 0x7f651c1530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f651b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f651c0d1060 0x7f651c1530d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57928/0 (socket says 172.21.15.78:57928) 2024-09-17T03:11:00.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f651b7fe640 1 -- 172.21.15.78:0/4261613177 learned_addr learned my addr 172.21.15.78:0/4261613177 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f651affd640 1 --2- 172.21.15.78:0/4261613177 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f651c0b20a0 0x7f651c157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f651a7fc640 1 --2- 172.21.15.78:0/4261613177 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f651c0b7a00 0x7f651c1597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f651b7fe640 1 -- 172.21.15.78:0/4261613177 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f651c0b7a00 msgr2=0x7f651c1597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f651b7fe640 1 --2- 172.21.15.78:0/4261613177 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f651c0b7a00 0x7f651c1597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f651b7fe640 1 -- 172.21.15.78:0/4261613177 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f651c0b20a0 msgr2=0x7f651c157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f651b7fe640 1 --2- 172.21.15.78:0/4261613177 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f651c0b20a0 0x7f651c157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f651b7fe640 1 -- 172.21.15.78:0/4261613177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f651c157da0 con 0x7f651c0d1060 2024-09-17T03:11:00.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f651b7fe640 1 --2- 172.21.15.78:0/4261613177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f651c0d1060 0x7f651c1530d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6514034040 tx=0x7f6514003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f6513fff640 1 -- 172.21.15.78:0/4261613177 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651403e030 con 0x7f651c0d1060 2024-09-17T03:11:00.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f652181d640 1 -- 172.21.15.78:0/4261613177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f651c158080 con 0x7f651c0d1060 2024-09-17T03:11:00.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f6513fff640 1 -- 172.21.15.78:0/4261613177 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6514003c20 con 0x7f651c0d1060 2024-09-17T03:11:00.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.548+0000 7f6513fff640 1 -- 172.21.15.78:0/4261613177 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6514035040 con 0x7f651c0d1060 2024-09-17T03:11:00.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.549+0000 7f652181d640 1 -- 172.21.15.78:0/4261613177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f651c158640 con 0x7f651c0d1060 2024-09-17T03:11:00.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.550+0000 7f6513fff640 1 -- 172.21.15.78:0/4261613177 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6514041030 con 0x7f651c0d1060 2024-09-17T03:11:00.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.551+0000 7f6513fff640 1 --2- 172.21.15.78:0/4261613177 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f64fc078b90 0x7f64fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.551+0000 7f6513fff640 1 -- 172.21.15.78:0/4261613177 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f65140bb270 con 0x7f651c0d1060 2024-09-17T03:11:00.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.551+0000 7f651affd640 1 --2- 172.21.15.78:0/4261613177 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f64fc078b90 0x7f64fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.551+0000 7f651affd640 1 --2- 172.21.15.78:0/4261613177 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f64fc078b90 0x7f64fc07b0a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f650c007fd0 tx=0x7f650c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.552+0000 7f6528863740 1 Processor -- start 2024-09-17T03:11:00.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.552+0000 7f6528863740 1 -- start start 2024-09-17T03:11:00.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.553+0000 7f6528863740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 0x55fddc6f6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.553+0000 7f6528863740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc2de7c0 0x55fddc6d9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.553+0000 7f6528863740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 0x55fddc6d9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.553+0000 7f6528863740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55fddc6220b0 con 0x55fddc307680 2024-09-17T03:11:00.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.553+0000 7f6528863740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55fddc6114e0 con 0x55fddc2e69a0 2024-09-17T03:11:00.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.553+0000 7f6528863740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55fddc6152f0 con 0x55fddc2de7c0 2024-09-17T03:11:00.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.553+0000 7f651affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 0x55fddc6f6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.553+0000 7f651affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 0x55fddc6f6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57942/0 (socket says 172.21.15.78:57942) 2024-09-17T03:11:00.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.553+0000 7f651affd640 1 -- 172.21.15.78:0/3673115704 learned_addr learned my addr 172.21.15.78:0/3673115704 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.553+0000 7f651a7fc640 1 --2- 172.21.15.78:0/3673115704 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc2de7c0 0x55fddc6d9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.553+0000 7f651b7fe640 1 --2- 172.21.15.78:0/3673115704 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 0x55fddc6d9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.554+0000 7f651affd640 1 -- 172.21.15.78:0/3673115704 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc2de7c0 msgr2=0x55fddc6d9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.554+0000 7f651affd640 1 --2- 172.21.15.78:0/3673115704 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc2de7c0 0x55fddc6d9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.554+0000 7f651affd640 1 -- 172.21.15.78:0/3673115704 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 msgr2=0x55fddc6d9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.554+0000 7f651affd640 1 --2- 172.21.15.78:0/3673115704 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 0x55fddc6d9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.554+0000 7f651affd640 1 -- 172.21.15.78:0/3673115704 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fddc3e7a50 con 0x55fddc307680 2024-09-17T03:11:00.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.554+0000 7f651a7fc640 1 --2- 172.21.15.78:0/3673115704 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc2de7c0 0x55fddc6d9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:00.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.554+0000 7f651b7fe640 1 --2- 172.21.15.78:0/3673115704 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 0x55fddc6d9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:00.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.554+0000 7f651affd640 1 --2- 172.21.15.78:0/3673115704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 0x55fddc6f6540 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f650c00fd10 tx=0x7f650c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c986997e2190593 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.554+0000 7f65117fa640 1 -- 172.21.15.78:0/3673115704 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650c025070 con 0x55fddc307680 2024-09-17T03:11:00.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.554+0000 7f65117fa640 1 -- 172.21.15.78:0/3673115704 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f650c01b050 con 0x55fddc307680 2024-09-17T03:11:00.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.554+0000 7f65117fa640 1 -- 172.21.15.78:0/3673115704 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650c020610 con 0x55fddc307680 2024-09-17T03:11:00.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.555+0000 7f6528863740 1 -- 172.21.15.78:0/3673115704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 msgr2=0x55fddc6f6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.555+0000 7f6528863740 1 --2- 172.21.15.78:0/3673115704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 0x55fddc6f6540 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f650c00fd10 tx=0x7f650c012000 comp rx=0 tx=0).stop 2024-09-17T03:11:00.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.555+0000 7f6528863740 1 -- 172.21.15.78:0/3673115704 shutdown_connections 2024-09-17T03:11:00.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.555+0000 7f6528863740 1 --2- 172.21.15.78:0/3673115704 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 0x55fddc6d9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.555+0000 7f6528863740 1 --2- 172.21.15.78:0/3673115704 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc2de7c0 0x55fddc6d9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.555+0000 7f6528863740 1 --2- 172.21.15.78:0/3673115704 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 0x55fddc6f6540 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.555+0000 7f6528863740 1 -- 172.21.15.78:0/3673115704 >> 172.21.15.78:0/3673115704 conn(0x55fddc2fb7d0 msgr2=0x55fddc6af430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.555+0000 7f6528863740 1 -- 172.21.15.78:0/3673115704 shutdown_connections 2024-09-17T03:11:00.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.555+0000 7f6528863740 1 -- 172.21.15.78:0/3673115704 wait complete. 2024-09-17T03:11:00.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.556+0000 7f6528863740 1 -- start start 2024-09-17T03:11:00.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.556+0000 7f6528863740 1 Processor -- start 2024-09-17T03:11:00.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.557+0000 7f6528863740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc2de7c0 0x55fddc6f4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.557+0000 7f6528863740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 0x55fddc6d3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.557+0000 7f6528863740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 0x55fddc6d4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.557+0000 7f6528863740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55fddc381a30 con 0x55fddc307680 2024-09-17T03:11:00.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.557+0000 7f6528863740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55fddc5979d0 con 0x55fddc2e69a0 2024-09-17T03:11:00.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.557+0000 7f6528863740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55fddc6d4e50 con 0x55fddc2de7c0 2024-09-17T03:11:00.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.557+0000 7f6528863740 10 client.0 _ll_register_callbacks cb 0x55fddc60bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:00.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.557+0000 7f651b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 0x55fddc6d4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.557+0000 7f651b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 0x55fddc6d4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57944/0 (socket says 172.21.15.78:57944) 2024-09-17T03:11:00.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.557+0000 7f651b7fe640 1 -- 172.21.15.78:0/3107246425 learned_addr learned my addr 172.21.15.78:0/3107246425 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.557+0000 7f651affd640 1 --2- 172.21.15.78:0/3107246425 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc2de7c0 0x55fddc6f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.557+0000 7f651b7fe640 1 -- 172.21.15.78:0/3107246425 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc2de7c0 msgr2=0x55fddc6f4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.557+0000 7f651a7fc640 1 --2- 172.21.15.78:0/3107246425 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 0x55fddc6d3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.557+0000 7f651b7fe640 1 --2- 172.21.15.78:0/3107246425 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc2de7c0 0x55fddc6f4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.558+0000 7f651b7fe640 1 -- 172.21.15.78:0/3107246425 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 msgr2=0x55fddc6d3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.558+0000 7f651b7fe640 1 --2- 172.21.15.78:0/3107246425 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 0x55fddc6d3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.558+0000 7f651b7fe640 1 -- 172.21.15.78:0/3107246425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fddc350990 con 0x55fddc307680 2024-09-17T03:11:00.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.558+0000 7f651b7fe640 1 --2- 172.21.15.78:0/3107246425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 0x55fddc6d4360 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f65140b9710 tx=0x7f651407efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad555ae348312d9a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.558+0000 7f64fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:00.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.558+0000 7f64fa7fc640 1 -- 172.21.15.78:0/3107246425 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6514048070 con 0x55fddc307680 2024-09-17T03:11:00.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.558+0000 7f64fa7fc640 1 -- 172.21.15.78:0/3107246425 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f651408c6d0 con 0x55fddc307680 2024-09-17T03:11:00.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.558+0000 7f6528863740 1 -- 172.21.15.78:0/3107246425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f650c01b050 con 0x55fddc307680 2024-09-17T03:11:00.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.558+0000 7f64fa7fc640 1 -- 172.21.15.78:0/3107246425 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6514082af0 con 0x55fddc307680 2024-09-17T03:11:00.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.558+0000 7f6528863740 10 client.5919 fetch_fsmap learned FSMap version 36 2024-09-17T03:11:00.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.558+0000 7f6528863740 1 -- 172.21.15.78:0/3107246425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55fddc4481e0 con 0x55fddc307680 2024-09-17T03:11:00.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.558+0000 7f64fa7fc640 1 -- 172.21.15.78:0/3107246425 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f650c01b050 con 0x55fddc307680 2024-09-17T03:11:00.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.558+0000 7f64fa7fc640 1 -- 172.21.15.78:0/3107246425 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 36) ==== 3554+0+0 (secure 0 0 0) 0x7f65140a9170 con 0x55fddc307680 2024-09-17T03:11:00.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.558+0000 7f6528863740 10 client.5919 fetch_fsmap finished waiting for FSMap version 36 2024-09-17T03:11:00.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.558+0000 7f6528863740 10 client.5919 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-09-17T03:11:00.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.558+0000 7f6528863740 20 client.5919 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:00.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.558+0000 7f6528863740 1 --2- 172.21.15.78:0/3107246425 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55fddc2c6250 0x55fddc702bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.558+0000 7f6528863740 4 client.5919 mds_command: new command op to 5565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:11:00.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.558+0000 7f6528863740 1 -- 172.21.15.78:0/3107246425 --> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fddc624000 con 0x55fddc2c6250 2024-09-17T03:11:00.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.559+0000 7f651affd640 1 --2- 172.21.15.78:0/3107246425 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55fddc2c6250 0x55fddc702bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.559+0000 7f651affd640 1 --2- 172.21.15.78:0/3107246425 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55fddc2c6250 0x55fddc702bb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33a4f5b5576b9f3d server_cookie=d4f93b7d997fd5b9 in_seq=0 out_seq=0 2024-09-17T03:11:00.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.559+0000 7f64fa7fc640 10 client.5919 ms_handle_connect on v2:172.21.15.193:6834/1788096053 2024-09-17T03:11:00.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.560+0000 7f64fa7fc640 1 -- 172.21.15.78:0/3107246425 <== mds.0 v2:172.21.15.193:6834/1788096053 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fddc624000 con 0x55fddc2c6250 2024-09-17T03:11:00.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.560+0000 7f64fa7fc640 10 client.5919 handle_command_reply: tid=0 2024-09-17T03:11:00.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.560+0000 7f6528863740 1 client.5919 shutdown 2024-09-17T03:11:00.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.560+0000 7f6528863740 1 -- 172.21.15.78:0/3107246425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 msgr2=0x55fddc6d4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.560+0000 7f6528863740 1 --2- 172.21.15.78:0/3107246425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 0x55fddc6d4360 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f65140b9710 tx=0x7f651407efb0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.560+0000 7f6528863740 1 -- 172.21.15.78:0/3107246425 shutdown_connections 2024-09-17T03:11:00.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.560+0000 7f6528863740 1 --2- 172.21.15.78:0/3107246425 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55fddc2c6250 0x55fddc702bb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.560+0000 7f6528863740 1 --2- 172.21.15.78:0/3107246425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 0x55fddc6d4360 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.560+0000 7f6528863740 1 --2- 172.21.15.78:0/3107246425 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 0x55fddc6d3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.560+0000 7f64fa7fc640 0 client.5919 ms_handle_reset on v2:172.21.15.193:6834/1788096053 2024-09-17T03:11:00.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.560+0000 7f6528863740 1 --2- 172.21.15.78:0/3107246425 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc2de7c0 0x55fddc6f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.560+0000 7f6528863740 1 -- 172.21.15.78:0/3107246425 >> 172.21.15.78:0/3107246425 conn(0x55fddc2fb7d0 msgr2=0x55fddc6a8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.560+0000 7f6528863740 1 -- 172.21.15.78:0/3107246425 shutdown_connections 2024-09-17T03:11:00.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.560+0000 7f6528863740 1 -- 172.21.15.78:0/3107246425 wait complete. 2024-09-17T03:11:00.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.560+0000 7f6528863740 20 client.5919 trim_cache size 0 max 16384 2024-09-17T03:11:00.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.578+0000 7f6528863740 1 Processor -- start 2024-09-17T03:11:00.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.578+0000 7f6528863740 1 -- start start 2024-09-17T03:11:00.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.579+0000 7f6528863740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc2de7c0 0x55fddc6d33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.579+0000 7f6528863740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 0x55fddc6c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.579+0000 7f6528863740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 0x55fddc6c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.579+0000 7f6528863740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f651c200060 con 0x55fddc307680 2024-09-17T03:11:00.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.579+0000 7f6528863740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f651c1ff260 con 0x55fddc2e69a0 2024-09-17T03:11:00.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.579+0000 7f6528863740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f651c1ff930 con 0x55fddc2de7c0 2024-09-17T03:11:00.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.579+0000 7f651b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 0x55fddc6c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.580+0000 7f651b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 0x55fddc6c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57960/0 (socket says 172.21.15.78:57960) 2024-09-17T03:11:00.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.580+0000 7f651b7fe640 1 -- 172.21.15.78:0/1123167535 learned_addr learned my addr 172.21.15.78:0/1123167535 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.580+0000 7f651affd640 1 --2- 172.21.15.78:0/1123167535 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc2de7c0 0x55fddc6d33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.580+0000 7f651a7fc640 1 --2- 172.21.15.78:0/1123167535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 0x55fddc6c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.580+0000 7f651b7fe640 1 -- 172.21.15.78:0/1123167535 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc2de7c0 msgr2=0x55fddc6d33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.580+0000 7f651b7fe640 1 --2- 172.21.15.78:0/1123167535 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc2de7c0 0x55fddc6d33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.580+0000 7f651b7fe640 1 -- 172.21.15.78:0/1123167535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 msgr2=0x55fddc6c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.580+0000 7f651b7fe640 1 --2- 172.21.15.78:0/1123167535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 0x55fddc6c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.580+0000 7f651b7fe640 1 -- 172.21.15.78:0/1123167535 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fddc3e5d50 con 0x55fddc307680 2024-09-17T03:11:00.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.580+0000 7f651b7fe640 1 --2- 172.21.15.78:0/1123167535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 0x55fddc6c8f10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6514080250 tx=0x7f6514005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e575ae980c5ffd71 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.580+0000 7f6510ff9640 1 -- 172.21.15.78:0/1123167535 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65140a3070 con 0x55fddc307680 2024-09-17T03:11:00.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.580+0000 7f6510ff9640 1 -- 172.21.15.78:0/1123167535 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f651409b020 con 0x55fddc307680 2024-09-17T03:11:00.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.580+0000 7f6510ff9640 1 -- 172.21.15.78:0/1123167535 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6514048030 con 0x55fddc307680 2024-09-17T03:11:00.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.581+0000 7f6528863740 1 -- 172.21.15.78:0/1123167535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 msgr2=0x55fddc6c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.581+0000 7f6528863740 1 --2- 172.21.15.78:0/1123167535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 0x55fddc6c8f10 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6514080250 tx=0x7f6514005e30 comp rx=0 tx=0).stop 2024-09-17T03:11:00.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.581+0000 7f6528863740 1 -- 172.21.15.78:0/1123167535 shutdown_connections 2024-09-17T03:11:00.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.581+0000 7f6528863740 1 --2- 172.21.15.78:0/1123167535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc307680 0x55fddc6c8f10 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.581+0000 7f6528863740 1 --2- 172.21.15.78:0/1123167535 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 0x55fddc6c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.581+0000 7f6528863740 1 --2- 172.21.15.78:0/1123167535 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc2de7c0 0x55fddc6d33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.581+0000 7f6528863740 1 -- 172.21.15.78:0/1123167535 >> 172.21.15.78:0/1123167535 conn(0x55fddc2fb7d0 msgr2=0x55fddc6a9650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.581+0000 7f6528863740 1 -- 172.21.15.78:0/1123167535 shutdown_connections 2024-09-17T03:11:00.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.581+0000 7f6528863740 1 -- 172.21.15.78:0/1123167535 wait complete. 2024-09-17T03:11:00.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.582+0000 7f6528863740 1 -- start start 2024-09-17T03:11:00.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.582+0000 7f6528863740 1 Processor -- start 2024-09-17T03:11:00.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.583+0000 7f6528863740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc2de7c0 0x55fddc6d8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.583+0000 7f6528863740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 0x55fddc6d9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.583+0000 7f6528863740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc307680 0x55fddc716fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.583+0000 7f6528863740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f651c1f3cd0 con 0x55fddc2de7c0 2024-09-17T03:11:00.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.583+0000 7f6528863740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55fddc6d3540 con 0x55fddc2e69a0 2024-09-17T03:11:00.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.583+0000 7f6528863740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55fddc6d3a70 con 0x55fddc307680 2024-09-17T03:11:00.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.583+0000 7f6528863740 10 client.0 _ll_register_callbacks cb 0x7f651407f6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:00.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.583+0000 7f651affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc2de7c0 0x55fddc6d8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.583+0000 7f651affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc2de7c0 0x55fddc6d8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57974/0 (socket says 172.21.15.78:57974) 2024-09-17T03:11:00.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.583+0000 7f651affd640 1 -- 172.21.15.78:0/1875695992 learned_addr learned my addr 172.21.15.78:0/1875695992 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.583+0000 7f651a7fc640 1 --2- 172.21.15.78:0/1875695992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 0x55fddc6d9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.583+0000 7f651b7fe640 1 --2- 172.21.15.78:0/1875695992 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc307680 0x55fddc716fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f651affd640 1 -- 172.21.15.78:0/1875695992 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc307680 msgr2=0x55fddc716fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f651affd640 1 --2- 172.21.15.78:0/1875695992 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc307680 0x55fddc716fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f651affd640 1 -- 172.21.15.78:0/1875695992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 msgr2=0x55fddc6d9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f651affd640 1 --2- 172.21.15.78:0/1875695992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 0x55fddc6d9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f651affd640 1 -- 172.21.15.78:0/1875695992 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fddc704cf0 con 0x55fddc2de7c0 2024-09-17T03:11:00.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f651affd640 1 --2- 172.21.15.78:0/1875695992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc2de7c0 0x55fddc6d8fd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f650c00fce0 tx=0x7f650c00fa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b339547c2527d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f64fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:00.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f64fa7fc640 1 -- 172.21.15.78:0/1875695992 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f650c038060 con 0x55fddc2de7c0 2024-09-17T03:11:00.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f64fa7fc640 1 -- 172.21.15.78:0/1875695992 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f650c0208a0 con 0x55fddc2de7c0 2024-09-17T03:11:00.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f6528863740 1 -- 172.21.15.78:0/1875695992 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fddc6ab390 con 0x55fddc2de7c0 2024-09-17T03:11:00.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f64fa7fc640 1 -- 172.21.15.78:0/1875695992 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f650c03e050 con 0x55fddc2de7c0 2024-09-17T03:11:00.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f6528863740 10 client.5925 fetch_fsmap learned FSMap version 36 2024-09-17T03:11:00.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f6528863740 1 -- 172.21.15.78:0/1875695992 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x55fddc6aa8d0 con 0x55fddc2de7c0 2024-09-17T03:11:00.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f64fa7fc640 1 -- 172.21.15.78:0/1875695992 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55fddc6ab390 con 0x55fddc2de7c0 2024-09-17T03:11:00.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f64fa7fc640 1 -- 172.21.15.78:0/1875695992 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 36) ==== 3554+0+0 (secure 0 0 0) 0x7f650c041020 con 0x55fddc2de7c0 2024-09-17T03:11:00.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f6528863740 10 client.5925 fetch_fsmap finished waiting for FSMap version 36 2024-09-17T03:11:00.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f6528863740 10 client.5925 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-09-17T03:11:00.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f6528863740 20 client.5925 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:00.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f6528863740 1 --2- 172.21.15.78:0/1875695992 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55fddc7174e0 0x55fddc7178f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f6528863740 4 client.5925 mds_command: new command op to 5565 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}] 2024-09-17T03:11:00.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.584+0000 7f6528863740 1 -- 172.21.15.78:0/1875695992 --> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}) -- 0x55fddc6eff80 con 0x55fddc7174e0 2024-09-17T03:11:00.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.585+0000 7f651a7fc640 1 --2- 172.21.15.78:0/1875695992 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55fddc7174e0 0x55fddc7178f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.585+0000 7f651a7fc640 1 --2- 172.21.15.78:0/1875695992 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55fddc7174e0 0x55fddc7178f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f850fd8ab92b3c07 server_cookie=8f8c221c33f88ee1 in_seq=0 out_seq=0 2024-09-17T03:11:00.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.585+0000 7f64fa7fc640 10 client.5925 ms_handle_connect on v2:172.21.15.193:6834/1788096053 2024-09-17T03:11:00.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.586+0000 7f64fa7fc640 1 -- 172.21.15.78:0/1875695992 <== mds.0 v2:172.21.15.193:6834/1788096053 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fddc6eff80 con 0x55fddc7174e0 2024-09-17T03:11:00.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.586+0000 7f64fa7fc640 10 client.5925 handle_command_reply: tid=0 2024-09-17T03:11:00.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.586+0000 7f6528863740 1 client.5925 shutdown 2024-09-17T03:11:00.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.586+0000 7f6528863740 1 -- 172.21.15.78:0/1875695992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc2de7c0 msgr2=0x55fddc6d8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.586+0000 7f6528863740 1 --2- 172.21.15.78:0/1875695992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc2de7c0 0x55fddc6d8fd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f650c00fce0 tx=0x7f650c00fa10 comp rx=0 tx=0).stop 2024-09-17T03:11:00.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.586+0000 7f6528863740 1 -- 172.21.15.78:0/1875695992 shutdown_connections 2024-09-17T03:11:00.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.586+0000 7f6528863740 1 --2- 172.21.15.78:0/1875695992 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55fddc7174e0 0x55fddc7178f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.586+0000 7f6528863740 1 --2- 172.21.15.78:0/1875695992 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fddc307680 0x55fddc716fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.586+0000 7f6528863740 1 --2- 172.21.15.78:0/1875695992 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fddc2e69a0 0x55fddc6d9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.586+0000 7f64fa7fc640 0 client.5925 ms_handle_reset on v2:172.21.15.193:6834/1788096053 2024-09-17T03:11:00.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.586+0000 7f6528863740 1 --2- 172.21.15.78:0/1875695992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fddc2de7c0 0x55fddc6d8fd0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.586+0000 7f6528863740 1 -- 172.21.15.78:0/1875695992 >> 172.21.15.78:0/1875695992 conn(0x55fddc2fb7d0 msgr2=0x55fddc6a9650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.586+0000 7f6528863740 1 -- 172.21.15.78:0/1875695992 shutdown_connections 2024-09-17T03:11:00.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.586+0000 7f6528863740 1 -- 172.21.15.78:0/1875695992 wait complete. 2024-09-17T03:11:00.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.586+0000 7f6528863740 20 client.5925 trim_cache size 0 max 16384 2024-09-17T03:11:00.597 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:11:00.597 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-17T03:11:00.597 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "8ebf2041-e471-4ebc-8443-f9f2c10aae14", 2024-09-17T03:11:00.597 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-17T03:11:00.597 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:11:00.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.587+0000 7f652181d640 1 -- 172.21.15.78:0/4261613177 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f64fc078b90 msgr2=0x7f64fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.587+0000 7f652181d640 1 --2- 172.21.15.78:0/4261613177 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f64fc078b90 0x7f64fc07b0a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f650c007fd0 tx=0x7f650c009040 comp rx=0 tx=0).stop 2024-09-17T03:11:00.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.587+0000 7f652181d640 1 -- 172.21.15.78:0/4261613177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f651c0d1060 msgr2=0x7f651c1530d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.587+0000 7f652181d640 1 --2- 172.21.15.78:0/4261613177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f651c0d1060 0x7f651c1530d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f6514034040 tx=0x7f6514003820 comp rx=0 tx=0).stop 2024-09-17T03:11:00.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.587+0000 7f652181d640 1 -- 172.21.15.78:0/4261613177 shutdown_connections 2024-09-17T03:11:00.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.587+0000 7f652181d640 1 --2- 172.21.15.78:0/4261613177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f651c0d1060 0x7f651c1530d0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.587+0000 7f652181d640 1 --2- 172.21.15.78:0/4261613177 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f651c0b7a00 0x7f651c1597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.587+0000 7f652181d640 1 --2- 172.21.15.78:0/4261613177 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f64fc078b90 0x7f64fc07b0a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.587+0000 7f652181d640 1 --2- 172.21.15.78:0/4261613177 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f651c0b20a0 0x7f651c157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.587+0000 7f652181d640 1 -- 172.21.15.78:0/4261613177 >> 172.21.15.78:0/4261613177 conn(0x7f651c0ced80 msgr2=0x7f651c0cc140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.587+0000 7f652181d640 1 -- 172.21.15.78:0/4261613177 shutdown_connections 2024-09-17T03:11:00.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.587+0000 7f652181d640 1 -- 172.21.15.78:0/4261613177 wait complete. 2024-09-17T03:11:00.599 INFO:tasks.ceph.mds.a.smithi078.stderr:2024-09-17T03:11:00.587+0000 7f2245999640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-17T03:10:43.140971+0000 1=0+1) n(v0 rc2024-09-17T03:10:43.140971+0000 2=0+2) (inest lock) (ifile excl) caps={5141=pAsLsXsFsx/pAsLsXsFsxcral@4},l=5141 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5594bf759080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(6)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:10:43.140971+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:10:43.140971+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-17T03:10:43.140971+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-17T03:10:43.140971+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-17T03:11:00.599 INFO:tasks.ceph.mds.a.smithi078.stderr:2024-09-17T03:11:00.587+0000 7f2245999640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) caps={5141=pAsLsXsFsx/AsLsXsFsx@2},l=5141 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5594bf759600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(6)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-17T03:11:00.599 INFO:tasks.ceph.mds.b.smithi193.stderr:2024-09-17T03:11:00.585+0000 7fe71e77c640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-17T03:10:43.137971+0000 1=0+1) n(v3 rc2024-09-17T03:10:43.374967+0000 6=0+6) (inest mix dirty) (ifile excl) caps={5141=pAsLsXsFsx/pAsLsXsFsxcral@4},l=5141 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55f21cd17080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(6)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:10:43.137971+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:10:43.374967+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-17T03:10:43.137971+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-17T03:10:43.374967+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-17T03:11:00.600 INFO:tasks.ceph.mds.d.smithi193.stderr:2024-09-17T03:11:00.586+0000 7fe6e4976640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-17T03:10:43.138971+0000 1=0+1) n(v2 rc2024-09-17T03:10:43.374967+0000 4=0+4) (inest lock) (ifile excl) caps={5141=pAsLsXsFsx/pAsLsXsFsxcral@4},l=5141 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x561a060fa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(6)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:10:43.138971+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:10:43.374967+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-17T03:10:43.138971+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-17T03:10:43.374967+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-17T03:11:00.601 INFO:tasks.ceph.mds.b.smithi193.stderr:2024-09-17T03:11:00.587+0000 7fe724f89640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-17T03:10:43.138971+0000 1=0+1) n(v4 rc2024-09-17T03:10:43.374967+0000 5=0+5) (inest sync->mix g=1,2) caps={5141=pAsLsXsFs/pAsLsXsFsxcral@8} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55f21cd16b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(6)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:10:43.138971+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:10:43.374967+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-17T03:10:43.138971+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-17T03:10:43.374967+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-17T03:11:00.601 INFO:tasks.ceph.mds.d.smithi193.stderr:2024-09-17T03:11:00.587+0000 7fe6eb183640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-17T03:10:43.139971+0000 1=0+1) n(v1 rc2024-09-17T03:10:43.374967+0000 3=0+3) (inest sync->mix g=0,2 scatter_wanted) caps={5141=pAsLsXsFs/pAsLsXsFsxcral@7} | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x561a060fb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(6)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:10:43.139971+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:10:43.140971+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-17T03:10:43.139971+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-17T03:10:43.374967+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-17T03:11:00.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:11:00.601 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub abort 2024-09-17T03:11:00.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.716+0000 7f3b51007640 1 -- 172.21.15.78:0/3885646512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b4c0b4360 msgr2=0x7f3b4c0727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.716+0000 7f3b51007640 1 --2- 172.21.15.78:0/3885646512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b4c0b4360 0x7f3b4c0727e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c074c90 tx=0x7f3b3c02a4d0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.716+0000 7f3b51007640 1 -- 172.21.15.78:0/3885646512 shutdown_connections 2024-09-17T03:11:00.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.716+0000 7f3b51007640 1 --2- 172.21.15.78:0/3885646512 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b4c0b4360 0x7f3b4c0727e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.716+0000 7f3b51007640 1 --2- 172.21.15.78:0/3885646512 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b4c160c90 0x7f3b4c0b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.716+0000 7f3b51007640 1 --2- 172.21.15.78:0/3885646512 >> v2:172.21.15.193:3300/0 conn(0x7f3b4c0cff70 0x7f3b4c15c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.716+0000 7f3b51007640 1 -- 172.21.15.78:0/3885646512 >> 172.21.15.78:0/3885646512 conn(0x7f3b4c0cee20 msgr2=0x7f3b4c0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.716+0000 7f3b51007640 1 -- 172.21.15.78:0/3885646512 shutdown_connections 2024-09-17T03:11:00.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.716+0000 7f3b51007640 1 -- 172.21.15.78:0/3885646512 wait complete. 2024-09-17T03:11:00.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.718+0000 7f3b51007640 1 Processor -- start 2024-09-17T03:11:00.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.718+0000 7f3b51007640 1 -- start start 2024-09-17T03:11:00.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.719+0000 7f3b51007640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b4c0b4360 0x7f3b4c154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.719+0000 7f3b51007640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b4c0cff70 0x7f3b4c0c70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.719+0000 7f3b51007640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b4c160c90 0x7f3b4c0c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.719+0000 7f3b51007640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c073160 con 0x7f3b4c160c90 2024-09-17T03:11:00.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.719+0000 7f3b51007640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c072fe0 con 0x7f3b4c0cff70 2024-09-17T03:11:00.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.719+0000 7f3b51007640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3b4c0732e0 con 0x7f3b4c0b4360 2024-09-17T03:11:00.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.720+0000 7f3b4b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b4c160c90 0x7f3b4c0c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.720+0000 7f3b4b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b4c160c90 0x7f3b4c0c75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57992/0 (socket says 172.21.15.78:57992) 2024-09-17T03:11:00.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.720+0000 7f3b4b59e640 1 -- 172.21.15.78:0/696017715 learned_addr learned my addr 172.21.15.78:0/696017715 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.720+0000 7f3b4a59c640 1 --2- 172.21.15.78:0/696017715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b4c0cff70 0x7f3b4c0c70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.720+0000 7f3b4ad9d640 1 --2- 172.21.15.78:0/696017715 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b4c0b4360 0x7f3b4c154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.720+0000 7f3b4b59e640 1 -- 172.21.15.78:0/696017715 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b4c0b4360 msgr2=0x7f3b4c154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.720+0000 7f3b4b59e640 1 --2- 172.21.15.78:0/696017715 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b4c0b4360 0x7f3b4c154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.720+0000 7f3b4b59e640 1 -- 172.21.15.78:0/696017715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b4c0cff70 msgr2=0x7f3b4c0c70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.720+0000 7f3b4b59e640 1 --2- 172.21.15.78:0/696017715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b4c0cff70 0x7f3b4c0c70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.720+0000 7f3b4b59e640 1 -- 172.21.15.78:0/696017715 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4c0c6030 con 0x7f3b4c160c90 2024-09-17T03:11:00.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.720+0000 7f3b4b59e640 1 --2- 172.21.15.78:0/696017715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b4c160c90 0x7f3b4c0c75f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c034040 tx=0x7f3b3c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.720+0000 7f3b437fe640 1 -- 172.21.15.78:0/696017715 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c03e030 con 0x7f3b4c160c90 2024-09-17T03:11:00.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.720+0000 7f3b437fe640 1 -- 172.21.15.78:0/696017715 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b3c0047a0 con 0x7f3b4c160c90 2024-09-17T03:11:00.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.720+0000 7f3b51007640 1 -- 172.21.15.78:0/696017715 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b4c0c6310 con 0x7f3b4c160c90 2024-09-17T03:11:00.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.720+0000 7f3b437fe640 1 -- 172.21.15.78:0/696017715 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c035040 con 0x7f3b4c160c90 2024-09-17T03:11:00.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.720+0000 7f3b51007640 1 -- 172.21.15.78:0/696017715 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b4c0c68d0 con 0x7f3b4c160c90 2024-09-17T03:11:00.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.722+0000 7f3b437fe640 1 -- 172.21.15.78:0/696017715 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3b3c041030 con 0x7f3b4c160c90 2024-09-17T03:11:00.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.722+0000 7f3b437fe640 1 --2- 172.21.15.78:0/696017715 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3b2c078b90 0x7f3b2c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.723+0000 7f3b437fe640 1 -- 172.21.15.78:0/696017715 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f3b3c0bb550 con 0x7f3b4c160c90 2024-09-17T03:11:00.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.723+0000 7f3b4ad9d640 1 --2- 172.21.15.78:0/696017715 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3b2c078b90 0x7f3b2c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.723+0000 7f3b4ad9d640 1 --2- 172.21.15.78:0/696017715 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3b2c078b90 0x7f3b2c07b0a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3b44005cc0 tx=0x7f3b4400a570 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.723+0000 7f3b5804b740 1 Processor -- start 2024-09-17T03:11:00.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.724+0000 7f3b5804b740 1 -- start start 2024-09-17T03:11:00.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.725+0000 7f3b5804b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56357ab0d390 0x56357aefc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.725+0000 7f3b5804b740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56357aae44d0 0x56357aedefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.725+0000 7f3b5804b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 0x56357aedf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.725+0000 7f3b5804b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56357ae27bd0 con 0x56357aaec6b0 2024-09-17T03:11:00.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.725+0000 7f3b5804b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56357ae17000 con 0x56357ab0d390 2024-09-17T03:11:00.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.725+0000 7f3b5804b740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x56357ae1ae10 con 0x56357aae44d0 2024-09-17T03:11:00.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.725+0000 7f3b4b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 0x56357aedf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.725+0000 7f3b4b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 0x56357aedf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57994/0 (socket says 172.21.15.78:57994) 2024-09-17T03:11:00.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.725+0000 7f3b4b59e640 1 -- 172.21.15.78:0/422565099 learned_addr learned my addr 172.21.15.78:0/422565099 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.725+0000 7f3b4ad9d640 1 --2- 172.21.15.78:0/422565099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56357ab0d390 0x56357aefc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.725+0000 7f3b4a59c640 1 --2- 172.21.15.78:0/422565099 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56357aae44d0 0x56357aedefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.725+0000 7f3b4b59e640 1 -- 172.21.15.78:0/422565099 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56357aae44d0 msgr2=0x56357aedefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.725+0000 7f3b4b59e640 1 --2- 172.21.15.78:0/422565099 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56357aae44d0 0x56357aedefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.725+0000 7f3b4b59e640 1 -- 172.21.15.78:0/422565099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56357ab0d390 msgr2=0x56357aefc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.725+0000 7f3b4b59e640 1 --2- 172.21.15.78:0/422565099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56357ab0d390 0x56357aefc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.725+0000 7f3b4b59e640 1 -- 172.21.15.78:0/422565099 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56357abef7d0 con 0x56357aaec6b0 2024-09-17T03:11:00.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.725+0000 7f3b4b59e640 1 --2- 172.21.15.78:0/422565099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 0x56357aedf520 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c083360 tx=0x7f3b3c083260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96dda1a005c7fe8b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.726+0000 7f3b40ff9640 1 -- 172.21.15.78:0/422565099 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c048030 con 0x56357aaec6b0 2024-09-17T03:11:00.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.726+0000 7f3b40ff9640 1 -- 172.21.15.78:0/422565099 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b3c08c040 con 0x56357aaec6b0 2024-09-17T03:11:00.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.726+0000 7f3b40ff9640 1 -- 172.21.15.78:0/422565099 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c08cad0 con 0x56357aaec6b0 2024-09-17T03:11:00.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.726+0000 7f3b5804b740 1 -- 172.21.15.78:0/422565099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 msgr2=0x56357aedf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.726+0000 7f3b5804b740 1 --2- 172.21.15.78:0/422565099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 0x56357aedf520 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c083360 tx=0x7f3b3c083260 comp rx=0 tx=0).stop 2024-09-17T03:11:00.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.727+0000 7f3b5804b740 1 -- 172.21.15.78:0/422565099 shutdown_connections 2024-09-17T03:11:00.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.727+0000 7f3b5804b740 1 --2- 172.21.15.78:0/422565099 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 0x56357aedf520 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.727+0000 7f3b5804b740 1 --2- 172.21.15.78:0/422565099 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56357aae44d0 0x56357aedefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.727+0000 7f3b5804b740 1 --2- 172.21.15.78:0/422565099 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56357ab0d390 0x56357aefc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.727+0000 7f3b5804b740 1 -- 172.21.15.78:0/422565099 >> 172.21.15.78:0/422565099 conn(0x56357ab014e0 msgr2=0x56357aeb5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.727+0000 7f3b5804b740 1 -- 172.21.15.78:0/422565099 shutdown_connections 2024-09-17T03:11:00.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.727+0000 7f3b5804b740 1 -- 172.21.15.78:0/422565099 wait complete. 2024-09-17T03:11:00.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.727+0000 7f3b5804b740 1 -- start start 2024-09-17T03:11:00.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.728+0000 7f3b5804b740 1 Processor -- start 2024-09-17T03:11:00.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.729+0000 7f3b5804b740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56357aae44d0 0x56357aef1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.729+0000 7f3b5804b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56357aaec6b0 0x56357aecd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.729+0000 7f3b5804b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357ab0d390 0x56357aef7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.729+0000 7f3b5804b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56357ab87740 con 0x56357ab0d390 2024-09-17T03:11:00.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.729+0000 7f3b5804b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56357adbc540 con 0x56357aaec6b0 2024-09-17T03:11:00.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.729+0000 7f3b5804b740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x56357ae17000 con 0x56357aae44d0 2024-09-17T03:11:00.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.729+0000 7f3b5804b740 10 client.0 _ll_register_callbacks cb 0x56357adbb0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:00.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.729+0000 7f3b4b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357ab0d390 0x56357aef7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.729+0000 7f3b4b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357ab0d390 0x56357aef7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58004/0 (socket says 172.21.15.78:58004) 2024-09-17T03:11:00.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.729+0000 7f3b4b59e640 1 -- 172.21.15.78:0/2196158064 learned_addr learned my addr 172.21.15.78:0/2196158064 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.729+0000 7f3b4ad9d640 1 --2- 172.21.15.78:0/2196158064 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56357aae44d0 0x56357aef1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.729+0000 7f3b4a59c640 1 --2- 172.21.15.78:0/2196158064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56357aaec6b0 0x56357aecd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.729+0000 7f3b4b59e640 1 -- 172.21.15.78:0/2196158064 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56357aae44d0 msgr2=0x56357aef1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.729+0000 7f3b4b59e640 1 --2- 172.21.15.78:0/2196158064 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56357aae44d0 0x56357aef1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.729+0000 7f3b4b59e640 1 -- 172.21.15.78:0/2196158064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56357aaec6b0 msgr2=0x56357aecd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.729+0000 7f3b4b59e640 1 --2- 172.21.15.78:0/2196158064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56357aaec6b0 0x56357aecd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.729+0000 7f3b4b59e640 1 -- 172.21.15.78:0/2196158064 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56357ab566a0 con 0x56357ab0d390 2024-09-17T03:11:00.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.729+0000 7f3b4ad9d640 1 --2- 172.21.15.78:0/2196158064 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56357aae44d0 0x56357aef1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:00.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.729+0000 7f3b4b59e640 1 --2- 172.21.15.78:0/2196158064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357ab0d390 0x56357aef7930 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0096c0 tx=0x7f3b3c08cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1718975e42ce7e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.729+0000 7f3b29ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:00.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.730+0000 7f3b29ffb640 1 -- 172.21.15.78:0/2196158064 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0833d0 con 0x56357ab0d390 2024-09-17T03:11:00.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.730+0000 7f3b29ffb640 1 -- 172.21.15.78:0/2196158064 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f3b3c0bb2e0 con 0x56357ab0d390 2024-09-17T03:11:00.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.730+0000 7f3b5804b740 1 -- 172.21.15.78:0/2196158064 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b3c08c040 con 0x56357ab0d390 2024-09-17T03:11:00.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.730+0000 7f3b29ffb640 1 -- 172.21.15.78:0/2196158064 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f3b3c087e00 con 0x56357ab0d390 2024-09-17T03:11:00.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.730+0000 7f3b5804b740 10 client.5937 fetch_fsmap learned FSMap version 36 2024-09-17T03:11:00.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.730+0000 7f3b5804b740 1 -- 172.21.15.78:0/2196158064 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x56357ac4ff60 con 0x56357ab0d390 2024-09-17T03:11:00.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.730+0000 7f3b29ffb640 1 -- 172.21.15.78:0/2196158064 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b3c08c040 con 0x56357ab0d390 2024-09-17T03:11:00.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.730+0000 7f3b29ffb640 1 -- 172.21.15.78:0/2196158064 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 36) ==== 3554+0+0 (secure 0 0 0) 0x7f3b3c082630 con 0x56357ab0d390 2024-09-17T03:11:00.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.730+0000 7f3b5804b740 10 client.5937 fetch_fsmap finished waiting for FSMap version 36 2024-09-17T03:11:00.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.730+0000 7f3b5804b740 10 client.5937 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-09-17T03:11:00.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.730+0000 7f3b5804b740 20 client.5937 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:00.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.730+0000 7f3b5804b740 1 --2- 172.21.15.78:0/2196158064 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x56357aacbf60 0x56357aef1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.730+0000 7f3b5804b740 4 client.5937 mds_command: new command op to 5565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:11:00.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.730+0000 7f3b5804b740 1 -- 172.21.15.78:0/2196158064 --> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56357ae29b20 con 0x56357aacbf60 2024-09-17T03:11:00.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.730+0000 7f3b4ad9d640 1 --2- 172.21.15.78:0/2196158064 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x56357aacbf60 0x56357aef1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.731+0000 7f3b29ffb640 10 client.5937 ms_handle_connect on v2:172.21.15.193:6834/1788096053 2024-09-17T03:11:00.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.731+0000 7f3b4ad9d640 1 --2- 172.21.15.78:0/2196158064 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x56357aacbf60 0x56357aef1df0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96c6622a999685fc server_cookie=840f8c0d212b75c3 in_seq=0 out_seq=0 2024-09-17T03:11:00.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.731+0000 7f3b29ffb640 1 -- 172.21.15.78:0/2196158064 <== mds.0 v2:172.21.15.193:6834/1788096053 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56357ae29b20 con 0x56357aacbf60 2024-09-17T03:11:00.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.731+0000 7f3b29ffb640 10 client.5937 handle_command_reply: tid=0 2024-09-17T03:11:00.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.731+0000 7f3b5804b740 1 client.5937 shutdown 2024-09-17T03:11:00.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.732+0000 7f3b5804b740 1 -- 172.21.15.78:0/2196158064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357ab0d390 msgr2=0x56357aef7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.732+0000 7f3b5804b740 1 --2- 172.21.15.78:0/2196158064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357ab0d390 0x56357aef7930 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0096c0 tx=0x7f3b3c08cae0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.732+0000 7f3b5804b740 1 -- 172.21.15.78:0/2196158064 shutdown_connections 2024-09-17T03:11:00.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.732+0000 7f3b5804b740 1 --2- 172.21.15.78:0/2196158064 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x56357aacbf60 0x56357aef1df0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.732+0000 7f3b5804b740 1 --2- 172.21.15.78:0/2196158064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357ab0d390 0x56357aef7930 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.732+0000 7f3b29ffb640 0 client.5937 ms_handle_reset on v2:172.21.15.193:6834/1788096053 2024-09-17T03:11:00.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.732+0000 7f3b5804b740 1 --2- 172.21.15.78:0/2196158064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56357aaec6b0 0x56357aecd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.732+0000 7f3b5804b740 1 --2- 172.21.15.78:0/2196158064 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56357aae44d0 0x56357aef1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.732+0000 7f3b5804b740 1 -- 172.21.15.78:0/2196158064 >> 172.21.15.78:0/2196158064 conn(0x56357ab014e0 msgr2=0x56357aedbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.732+0000 7f3b5804b740 1 -- 172.21.15.78:0/2196158064 shutdown_connections 2024-09-17T03:11:00.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.732+0000 7f3b5804b740 1 -- 172.21.15.78:0/2196158064 wait complete. 2024-09-17T03:11:00.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.732+0000 7f3b5804b740 20 client.5937 trim_cache size 0 max 16384 2024-09-17T03:11:00.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.749+0000 7f3b5804b740 1 Processor -- start 2024-09-17T03:11:00.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.749+0000 7f3b5804b740 1 -- start start 2024-09-17T03:11:00.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.750+0000 7f3b5804b740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56357aacbf60 0x56357aeb6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.750+0000 7f3b5804b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56357aae44d0 0x56357aeb66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.750+0000 7f3b5804b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 0x56357aef55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.750+0000 7f3b5804b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c202060 con 0x56357aaec6b0 2024-09-17T03:11:00.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.750+0000 7f3b5804b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c201230 con 0x56357aae44d0 2024-09-17T03:11:00.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.750+0000 7f3b5804b740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3b4c201930 con 0x56357aacbf60 2024-09-17T03:11:00.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.751+0000 7f3b4b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 0x56357aef55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.751+0000 7f3b4b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 0x56357aef55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58008/0 (socket says 172.21.15.78:58008) 2024-09-17T03:11:00.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.751+0000 7f3b4b59e640 1 -- 172.21.15.78:0/3462180557 learned_addr learned my addr 172.21.15.78:0/3462180557 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.751+0000 7f3b4b59e640 1 -- 172.21.15.78:0/3462180557 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56357aacbf60 msgr2=0x56357aeb6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.751+0000 7f3b4b59e640 1 --2- 172.21.15.78:0/3462180557 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56357aacbf60 0x56357aeb6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.751+0000 7f3b4b59e640 1 -- 172.21.15.78:0/3462180557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56357aae44d0 msgr2=0x56357aeb66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.751+0000 7f3b4b59e640 1 --2- 172.21.15.78:0/3462180557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56357aae44d0 0x56357aeb66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.751+0000 7f3b4b59e640 1 -- 172.21.15.78:0/3462180557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56357aecd980 con 0x56357aaec6b0 2024-09-17T03:11:00.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.751+0000 7f3b4b59e640 1 --2- 172.21.15.78:0/3462180557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 0x56357aef55d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c08cfb0 tx=0x7f3b3c083260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf89578aa58240d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.751+0000 7f3b2bfff640 1 -- 172.21.15.78:0/3462180557 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c048050 con 0x56357aaec6b0 2024-09-17T03:11:00.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.751+0000 7f3b2bfff640 1 -- 172.21.15.78:0/3462180557 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b3c08c040 con 0x56357aaec6b0 2024-09-17T03:11:00.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.751+0000 7f3b2bfff640 1 -- 172.21.15.78:0/3462180557 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c07f270 con 0x56357aaec6b0 2024-09-17T03:11:00.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.752+0000 7f3b5804b740 1 -- 172.21.15.78:0/3462180557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 msgr2=0x56357aef55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.752+0000 7f3b5804b740 1 --2- 172.21.15.78:0/3462180557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 0x56357aef55d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c08cfb0 tx=0x7f3b3c083260 comp rx=0 tx=0).stop 2024-09-17T03:11:00.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.752+0000 7f3b5804b740 1 -- 172.21.15.78:0/3462180557 shutdown_connections 2024-09-17T03:11:00.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.752+0000 7f3b5804b740 1 --2- 172.21.15.78:0/3462180557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 0x56357aef55d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.752+0000 7f3b5804b740 1 --2- 172.21.15.78:0/3462180557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56357aae44d0 0x56357aeb66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.752+0000 7f3b5804b740 1 --2- 172.21.15.78:0/3462180557 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56357aacbf60 0x56357aeb6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.752+0000 7f3b5804b740 1 -- 172.21.15.78:0/3462180557 >> 172.21.15.78:0/3462180557 conn(0x56357ab014e0 msgr2=0x56357aefcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.752+0000 7f3b5804b740 1 -- 172.21.15.78:0/3462180557 shutdown_connections 2024-09-17T03:11:00.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.752+0000 7f3b5804b740 1 -- 172.21.15.78:0/3462180557 wait complete. 2024-09-17T03:11:00.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.753+0000 7f3b5804b740 1 -- start start 2024-09-17T03:11:00.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.753+0000 7f3b5804b740 1 Processor -- start 2024-09-17T03:11:00.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.754+0000 7f3b5804b740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56357aacbf60 0x56357af6f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.754+0000 7f3b5804b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56357aae44d0 0x56357aeaf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.754+0000 7f3b5804b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 0x56357aeafb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.754+0000 7f3b5804b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56357ae27bd0 con 0x56357aaec6b0 2024-09-17T03:11:00.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.754+0000 7f3b5804b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4c2002a0 con 0x56357aae44d0 2024-09-17T03:11:00.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.754+0000 7f3b5804b740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x56357aedc260 con 0x56357aacbf60 2024-09-17T03:11:00.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.754+0000 7f3b5804b740 10 client.0 _ll_register_callbacks cb 0x7f3b4400ae80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:00.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.754+0000 7f3b4b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 0x56357aeafb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.754+0000 7f3b4b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 0x56357aeafb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58018/0 (socket says 172.21.15.78:58018) 2024-09-17T03:11:00.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.754+0000 7f3b4b59e640 1 -- 172.21.15.78:0/2056658103 learned_addr learned my addr 172.21.15.78:0/2056658103 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.754+0000 7f3b4a59c640 1 --2- 172.21.15.78:0/2056658103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56357aae44d0 0x56357aeaf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b4ad9d640 1 --2- 172.21.15.78:0/2056658103 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56357aacbf60 0x56357af6f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b4b59e640 1 -- 172.21.15.78:0/2056658103 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56357aacbf60 msgr2=0x56357af6f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b4b59e640 1 --2- 172.21.15.78:0/2056658103 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56357aacbf60 0x56357af6f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b4b59e640 1 -- 172.21.15.78:0/2056658103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56357aae44d0 msgr2=0x56357aeaf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b4b59e640 1 --2- 172.21.15.78:0/2056658103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56357aae44d0 0x56357aeaf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b4b59e640 1 -- 172.21.15.78:0/2056658103 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56357abedad0 con 0x56357aaec6b0 2024-09-17T03:11:00.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b4b59e640 1 --2- 172.21.15.78:0/2056658103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 0x56357aeafb60 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0096c0 tx=0x7f3b3c0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73267aad79e7fd03 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b29ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:00.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b29ffb640 1 -- 172.21.15.78:0/2056658103 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c048070 con 0x56357aaec6b0 2024-09-17T03:11:00.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b29ffb640 1 -- 172.21.15.78:0/2056658103 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f3b3c07ed20 con 0x56357aaec6b0 2024-09-17T03:11:00.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b5804b740 1 -- 172.21.15.78:0/2056658103 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b3c08c040 con 0x56357aaec6b0 2024-09-17T03:11:00.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b29ffb640 1 -- 172.21.15.78:0/2056658103 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f3b3c0b99f0 con 0x56357aaec6b0 2024-09-17T03:11:00.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b5804b740 10 client.5943 fetch_fsmap learned FSMap version 36 2024-09-17T03:11:00.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b5804b740 1 -- 172.21.15.78:0/2056658103 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x56357abedad0 con 0x56357aaec6b0 2024-09-17T03:11:00.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b29ffb640 1 -- 172.21.15.78:0/2056658103 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b3c08c040 con 0x56357aaec6b0 2024-09-17T03:11:00.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b29ffb640 1 -- 172.21.15.78:0/2056658103 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 36) ==== 3554+0+0 (secure 0 0 0) 0x7f3b3c07ef20 con 0x56357aaec6b0 2024-09-17T03:11:00.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b5804b740 10 client.5943 fetch_fsmap finished waiting for FSMap version 36 2024-09-17T03:11:00.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b5804b740 10 client.5943 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-09-17T03:11:00.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b5804b740 20 client.5943 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:00.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b5804b740 1 --2- 172.21.15.78:0/2056658103 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x56357aaa13a0 0x56357aef52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b5804b740 4 client.5943 mds_command: new command op to 5565 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-17T03:11:00.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.755+0000 7f3b5804b740 1 -- 172.21.15.78:0/2056658103 --> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x56357aef1890 con 0x56357aaa13a0 2024-09-17T03:11:00.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.756+0000 7f3b4ad9d640 1 --2- 172.21.15.78:0/2056658103 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x56357aaa13a0 0x56357aef52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.756+0000 7f3b29ffb640 10 client.5943 ms_handle_connect on v2:172.21.15.193:6834/1788096053 2024-09-17T03:11:00.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.756+0000 7f3b4ad9d640 1 --2- 172.21.15.78:0/2056658103 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x56357aaa13a0 0x56357aef52a0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fca1c4adce75369 server_cookie=16dd7997f13e470b in_seq=0 out_seq=0 2024-09-17T03:11:00.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.756+0000 7f3b29ffb640 1 -- 172.21.15.78:0/2056658103 <== mds.0 v2:172.21.15.193:6834/1788096053 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56357aef1890 con 0x56357aaa13a0 2024-09-17T03:11:00.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.756+0000 7f3b29ffb640 10 client.5943 handle_command_reply: tid=0 2024-09-17T03:11:00.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.756+0000 7f3b5804b740 1 client.5943 shutdown 2024-09-17T03:11:00.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b5804b740 1 -- 172.21.15.78:0/2056658103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 msgr2=0x56357aeafb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b5804b740 1 --2- 172.21.15.78:0/2056658103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 0x56357aeafb60 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0096c0 tx=0x7f3b3c0057c0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b5804b740 1 -- 172.21.15.78:0/2056658103 shutdown_connections 2024-09-17T03:11:00.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b5804b740 1 --2- 172.21.15.78:0/2056658103 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x56357aaa13a0 0x56357aef52a0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b5804b740 1 --2- 172.21.15.78:0/2056658103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56357aaec6b0 0x56357aeafb60 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b5804b740 1 --2- 172.21.15.78:0/2056658103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56357aae44d0 0x56357aeaf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b29ffb640 0 client.5943 ms_handle_reset on v2:172.21.15.193:6834/1788096053 2024-09-17T03:11:00.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b5804b740 1 --2- 172.21.15.78:0/2056658103 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56357aacbf60 0x56357af6f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b5804b740 1 -- 172.21.15.78:0/2056658103 >> 172.21.15.78:0/2056658103 conn(0x56357ab014e0 msgr2=0x56357aeb4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b5804b740 1 -- 172.21.15.78:0/2056658103 shutdown_connections 2024-09-17T03:11:00.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b5804b740 1 -- 172.21.15.78:0/2056658103 wait complete. 2024-09-17T03:11:00.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b5804b740 20 client.5943 trim_cache size 0 max 16384 2024-09-17T03:11:00.763 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:11:00.763 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:11:00.763 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:11:00.763 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:11:00.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b51007640 1 -- 172.21.15.78:0/696017715 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3b2c078b90 msgr2=0x7f3b2c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b51007640 1 --2- 172.21.15.78:0/696017715 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3b2c078b90 0x7f3b2c07b0a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3b44005cc0 tx=0x7f3b4400a570 comp rx=0 tx=0).stop 2024-09-17T03:11:00.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b51007640 1 -- 172.21.15.78:0/696017715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b4c160c90 msgr2=0x7f3b4c0c75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b51007640 1 --2- 172.21.15.78:0/696017715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b4c160c90 0x7f3b4c0c75f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c034040 tx=0x7f3b3c0039e0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b51007640 1 -- 172.21.15.78:0/696017715 shutdown_connections 2024-09-17T03:11:00.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b51007640 1 --2- 172.21.15.78:0/696017715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b4c160c90 0x7f3b4c0c75f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b51007640 1 --2- 172.21.15.78:0/696017715 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3b2c078b90 0x7f3b2c07b0a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b51007640 1 --2- 172.21.15.78:0/696017715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b4c0cff70 0x7f3b4c0c70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b51007640 1 --2- 172.21.15.78:0/696017715 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b4c0b4360 0x7f3b4c154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b51007640 1 -- 172.21.15.78:0/696017715 >> 172.21.15.78:0/696017715 conn(0x7f3b4c0cee20 msgr2=0x7f3b4c0b7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b51007640 1 -- 172.21.15.78:0/696017715 shutdown_connections 2024-09-17T03:11:00.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.757+0000 7f3b51007640 1 -- 172.21.15.78:0/696017715 wait complete. 2024-09-17T03:11:00.767 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:11:00.768 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:1 scrub status 2024-09-17T03:11:00.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.883+0000 7f3db4c4d640 1 -- 172.21.15.78:0/4076890514 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3db0074560 msgr2=0x7f3db00cfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.883+0000 7f3db4c4d640 1 --2- 172.21.15.78:0/4076890514 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3db0074560 0x7f3db00cfe60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3da8005fd0 tx=0x7f3da802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.883+0000 7f3db4c4d640 1 -- 172.21.15.78:0/4076890514 shutdown_connections 2024-09-17T03:11:00.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.883+0000 7f3db4c4d640 1 --2- 172.21.15.78:0/4076890514 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3db0074560 0x7f3db00cfe60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.883+0000 7f3db4c4d640 1 --2- 172.21.15.78:0/4076890514 >> v2:172.21.15.193:3300/0 conn(0x7f3db0144270 0x7f3db00b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.883+0000 7f3db4c4d640 1 -- 172.21.15.78:0/4076890514 >> 172.21.15.78:0/4076890514 conn(0x7f3db00d15f0 msgr2=0x7f3db0073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.883+0000 7f3db4c4d640 1 -- 172.21.15.78:0/4076890514 shutdown_connections 2024-09-17T03:11:00.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.883+0000 7f3db4c4d640 1 -- 172.21.15.78:0/4076890514 wait complete. 2024-09-17T03:11:00.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.885+0000 7f3db4c4d640 1 Processor -- start 2024-09-17T03:11:00.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.885+0000 7f3db4c4d640 1 -- start start 2024-09-17T03:11:00.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.886+0000 7f3db4c4d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3db0142270 0x7f3db01f8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.886+0000 7f3db4c4d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3db0144270 0x7f3db00cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.886+0000 7f3db4c4d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3db00715d0 0x7f3db013ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.886+0000 7f3db4c4d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3db0142800 con 0x7f3db0142270 2024-09-17T03:11:00.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.886+0000 7f3db4c4d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3db0142680 con 0x7f3db0144270 2024-09-17T03:11:00.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.886+0000 7f3db4c4d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3db0142980 con 0x7f3db00715d0 2024-09-17T03:11:00.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.887+0000 7f3dae59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3db0142270 0x7f3db01f8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.887+0000 7f3dae59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3db0142270 0x7f3db01f8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58028/0 (socket says 172.21.15.78:58028) 2024-09-17T03:11:00.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.887+0000 7f3dae59c640 1 -- 172.21.15.78:0/4257282728 learned_addr learned my addr 172.21.15.78:0/4257282728 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.887+0000 7f3dadd9b640 1 --2- 172.21.15.78:0/4257282728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3db0144270 0x7f3db00cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.887+0000 7f3daed9d640 1 --2- 172.21.15.78:0/4257282728 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3db00715d0 0x7f3db013ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.887+0000 7f3dae59c640 1 -- 172.21.15.78:0/4257282728 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3db00715d0 msgr2=0x7f3db013ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.887+0000 7f3dae59c640 1 --2- 172.21.15.78:0/4257282728 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3db00715d0 0x7f3db013ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.887+0000 7f3dae59c640 1 -- 172.21.15.78:0/4257282728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3db0144270 msgr2=0x7f3db00cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.887+0000 7f3dae59c640 1 --2- 172.21.15.78:0/4257282728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3db0144270 0x7f3db00cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.887+0000 7f3dae59c640 1 -- 172.21.15.78:0/4257282728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3db01f9020 con 0x7f3db0142270 2024-09-17T03:11:00.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.887+0000 7f3dae59c640 1 --2- 172.21.15.78:0/4257282728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3db0142270 0x7f3db01f8720 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3da000e790 tx=0x7f3da000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.887+0000 7f3d9effd640 1 -- 172.21.15.78:0/4257282728 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da000eea0 con 0x7f3db0142270 2024-09-17T03:11:00.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.887+0000 7f3d9effd640 1 -- 172.21.15.78:0/4257282728 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3da000cdb0 con 0x7f3db0142270 2024-09-17T03:11:00.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.887+0000 7f3db4c4d640 1 -- 172.21.15.78:0/4257282728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3db01f9300 con 0x7f3db0142270 2024-09-17T03:11:00.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.887+0000 7f3d9effd640 1 -- 172.21.15.78:0/4257282728 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da0010690 con 0x7f3db0142270 2024-09-17T03:11:00.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.887+0000 7f3db4c4d640 1 -- 172.21.15.78:0/4257282728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3db01f5520 con 0x7f3db0142270 2024-09-17T03:11:00.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.889+0000 7f3d9effd640 1 -- 172.21.15.78:0/4257282728 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3da0010830 con 0x7f3db0142270 2024-09-17T03:11:00.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.890+0000 7f3d9effd640 1 --2- 172.21.15.78:0/4257282728 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3d90078bc0 0x7f3d9007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.890+0000 7f3d9effd640 1 -- 172.21.15.78:0/4257282728 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f3da009b750 con 0x7f3db0142270 2024-09-17T03:11:00.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.890+0000 7f3dadd9b640 1 --2- 172.21.15.78:0/4257282728 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3d90078bc0 0x7f3d9007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.891+0000 7f3dadd9b640 1 --2- 172.21.15.78:0/4257282728 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3d90078bc0 0x7f3d9007b0d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3da4007fd0 tx=0x7f3da4001370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.891+0000 7f3dbbbc4740 1 Processor -- start 2024-09-17T03:11:00.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.891+0000 7f3dbbbc4740 1 -- start start 2024-09-17T03:11:00.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.892+0000 7f3dbbbc4740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5639af9e8390 0x5639afdb9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.892+0000 7f3dbbbc4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9bf4d0 0x5639afdb9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.892+0000 7f3dbbbc4740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9c76b0 0x5639afdd6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.892+0000 7f3dbbbc4740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5639afd02a60 con 0x5639af9c76b0 2024-09-17T03:11:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.892+0000 7f3dbbbc4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5639afcf1e90 con 0x5639af9bf4d0 2024-09-17T03:11:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.892+0000 7f3dbbbc4740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5639afcf5ca0 con 0x5639af9e8390 2024-09-17T03:11:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.892+0000 7f3daed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9c76b0 0x5639afdd6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.892+0000 7f3daed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9c76b0 0x5639afdd6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58034/0 (socket says 172.21.15.78:58034) 2024-09-17T03:11:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.892+0000 7f3daed9d640 1 -- 172.21.15.78:0/386125342 learned_addr learned my addr 172.21.15.78:0/386125342 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.892+0000 7f3dadd9b640 1 --2- 172.21.15.78:0/386125342 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9bf4d0 0x5639afdb9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.892+0000 7f3dae59c640 1 --2- 172.21.15.78:0/386125342 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5639af9e8390 0x5639afdb9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.893+0000 7f3daed9d640 1 -- 172.21.15.78:0/386125342 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5639af9e8390 msgr2=0x5639afdb9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.893+0000 7f3daed9d640 1 --2- 172.21.15.78:0/386125342 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5639af9e8390 0x5639afdb9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.893+0000 7f3daed9d640 1 -- 172.21.15.78:0/386125342 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9bf4d0 msgr2=0x5639afdb9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.893+0000 7f3daed9d640 1 --2- 172.21.15.78:0/386125342 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9bf4d0 0x5639afdb9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.893+0000 7f3daed9d640 1 -- 172.21.15.78:0/386125342 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639afaca7d0 con 0x5639af9c76b0 2024-09-17T03:11:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.893+0000 7f3dadd9b640 1 --2- 172.21.15.78:0/386125342 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9bf4d0 0x5639afdb9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.893+0000 7f3daed9d640 1 --2- 172.21.15.78:0/386125342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9c76b0 0x5639afdd6b80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3da8005fd0 tx=0x7f3da8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e934f34384ac92 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.893+0000 7f3d8ffff640 1 -- 172.21.15.78:0/386125342 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da8003d70 con 0x5639af9c76b0 2024-09-17T03:11:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.893+0000 7f3d8ffff640 1 -- 172.21.15.78:0/386125342 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3da8004040 con 0x5639af9c76b0 2024-09-17T03:11:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.893+0000 7f3d8ffff640 1 -- 172.21.15.78:0/386125342 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da8004410 con 0x5639af9c76b0 2024-09-17T03:11:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.894+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/386125342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9c76b0 msgr2=0x5639afdd6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.894+0000 7f3dbbbc4740 1 --2- 172.21.15.78:0/386125342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9c76b0 0x5639afdd6b80 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3da8005fd0 tx=0x7f3da8004a40 comp rx=0 tx=0).stop 2024-09-17T03:11:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.894+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/386125342 shutdown_connections 2024-09-17T03:11:00.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.894+0000 7f3dbbbc4740 1 --2- 172.21.15.78:0/386125342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9c76b0 0x5639afdd6b80 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.894+0000 7f3dbbbc4740 1 --2- 172.21.15.78:0/386125342 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9bf4d0 0x5639afdb9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.894+0000 7f3dbbbc4740 1 --2- 172.21.15.78:0/386125342 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5639af9e8390 0x5639afdb9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.894+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/386125342 >> 172.21.15.78:0/386125342 conn(0x5639af9dc4e0 msgr2=0x5639afd8fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.894+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/386125342 shutdown_connections 2024-09-17T03:11:00.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.894+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/386125342 wait complete. 2024-09-17T03:11:00.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.895+0000 7f3dbbbc4740 1 -- start start 2024-09-17T03:11:00.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.895+0000 7f3dbbbc4740 1 Processor -- start 2024-09-17T03:11:00.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.896+0000 7f3dbbbc4740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9bf4d0 0x5639afdcced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.896+0000 7f3dbbbc4740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5639af9c76b0 0x5639afde44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.896+0000 7f3dbbbc4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9e8390 0x5639afdd0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.896+0000 7f3dbbbc4740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5639afa62740 con 0x5639af9bf4d0 2024-09-17T03:11:00.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.896+0000 7f3dbbbc4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5639afc97970 con 0x5639af9e8390 2024-09-17T03:11:00.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.896+0000 7f3dbbbc4740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5639afdba1c0 con 0x5639af9c76b0 2024-09-17T03:11:00.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.896+0000 7f3dbbbc4740 10 client.0 _ll_register_callbacks cb 0x5639afc9abe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:00.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.896+0000 7f3dae59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9bf4d0 0x5639afdcced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.896+0000 7f3dae59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9bf4d0 0x5639afdcced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58050/0 (socket says 172.21.15.78:58050) 2024-09-17T03:11:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.896+0000 7f3dae59c640 1 -- 172.21.15.78:0/3637777341 learned_addr learned my addr 172.21.15.78:0/3637777341 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3daed9d640 1 --2- 172.21.15.78:0/3637777341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9e8390 0x5639afdd0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3dadd9b640 1 --2- 172.21.15.78:0/3637777341 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5639af9c76b0 0x5639afde44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3dae59c640 1 -- 172.21.15.78:0/3637777341 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5639af9c76b0 msgr2=0x5639afde44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3dae59c640 1 --2- 172.21.15.78:0/3637777341 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5639af9c76b0 0x5639afde44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3dae59c640 1 -- 172.21.15.78:0/3637777341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9e8390 msgr2=0x5639afdd0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3dae59c640 1 --2- 172.21.15.78:0/3637777341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9e8390 0x5639afdd0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3dae59c640 1 -- 172.21.15.78:0/3637777341 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639afa53970 con 0x5639af9bf4d0 2024-09-17T03:11:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3daed9d640 1 --2- 172.21.15.78:0/3637777341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9e8390 0x5639afdd0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3dae59c640 1 --2- 172.21.15.78:0/3637777341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9bf4d0 0x5639afdcced0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009fd0 tx=0x7f3da0063ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85a80d4da19aafc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3d8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3d8d7fa640 1 -- 172.21.15.78:0/3637777341 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da0089070 con 0x5639af9bf4d0 2024-09-17T03:11:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3d8d7fa640 1 -- 172.21.15.78:0/3637777341 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f3da005ee90 con 0x5639af9bf4d0 2024-09-17T03:11:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/3637777341 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3da8004040 con 0x5639af9bf4d0 2024-09-17T03:11:00.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3d8d7fa640 1 -- 172.21.15.78:0/3637777341 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f3da0084050 con 0x5639af9bf4d0 2024-09-17T03:11:00.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3dbbbc4740 10 client.5952 fetch_fsmap learned FSMap version 36 2024-09-17T03:11:00.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/3637777341 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x5639afa316a0 con 0x5639af9bf4d0 2024-09-17T03:11:00.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3d8d7fa640 1 -- 172.21.15.78:0/3637777341 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3da8004040 con 0x5639af9bf4d0 2024-09-17T03:11:00.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3d8d7fa640 1 -- 172.21.15.78:0/3637777341 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 36) ==== 3554+0+0 (secure 0 0 0) 0x7f3da006c040 con 0x5639af9bf4d0 2024-09-17T03:11:00.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3dbbbc4740 10 client.5952 fetch_fsmap finished waiting for FSMap version 36 2024-09-17T03:11:00.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3dbbbc4740 10 client.5952 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.d 2024-09-17T03:11:00.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3dbbbc4740 20 client.5952 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:00.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3dbbbc4740 1 --2- 172.21.15.78:0/3637777341 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x5639af9a6f60 0x5639afdcb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3dbbbc4740 4 client.5952 mds_command: new command op to 5039 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:11:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.897+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/3637777341 --> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5639afd049b0 con 0x5639af9a6f60 2024-09-17T03:11:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.898+0000 7f3dadd9b640 1 --2- 172.21.15.78:0/3637777341 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x5639af9a6f60 0x5639afdcb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.898+0000 7f3dadd9b640 1 --2- 172.21.15.78:0/3637777341 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x5639af9a6f60 0x5639afdcb930 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5f86453b523ede48 server_cookie=c2b04b497d7fb7f0 in_seq=0 out_seq=0 2024-09-17T03:11:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.898+0000 7f3d8d7fa640 10 client.5952 ms_handle_connect on v2:172.21.15.193:6835/3209848332 2024-09-17T03:11:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.899+0000 7f3d8d7fa640 1 -- 172.21.15.78:0/3637777341 <== mds.1 v2:172.21.15.193:6835/3209848332 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5639afd049b0 con 0x5639af9a6f60 2024-09-17T03:11:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.899+0000 7f3d8d7fa640 10 client.5952 handle_command_reply: tid=0 2024-09-17T03:11:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.899+0000 7f3dbbbc4740 1 client.5952 shutdown 2024-09-17T03:11:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.899+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/3637777341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9bf4d0 msgr2=0x5639afdcced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.899+0000 7f3dbbbc4740 1 --2- 172.21.15.78:0/3637777341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9bf4d0 0x5639afdcced0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009fd0 tx=0x7f3da0063ac0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.899+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/3637777341 shutdown_connections 2024-09-17T03:11:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.899+0000 7f3dbbbc4740 1 --2- 172.21.15.78:0/3637777341 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x5639af9a6f60 0x5639afdcb930 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.899+0000 7f3dbbbc4740 1 --2- 172.21.15.78:0/3637777341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9e8390 0x5639afdd0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.899+0000 7f3dbbbc4740 1 --2- 172.21.15.78:0/3637777341 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5639af9c76b0 0x5639afde44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.899+0000 7f3dbbbc4740 1 --2- 172.21.15.78:0/3637777341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9bf4d0 0x5639afdcced0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.899+0000 7f3d8d7fa640 0 client.5952 ms_handle_reset on v2:172.21.15.193:6835/3209848332 2024-09-17T03:11:00.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.899+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/3637777341 >> 172.21.15.78:0/3637777341 conn(0x5639af9dc4e0 msgr2=0x5639afd8fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.899+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/3637777341 shutdown_connections 2024-09-17T03:11:00.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.899+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/3637777341 wait complete. 2024-09-17T03:11:00.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.899+0000 7f3dbbbc4740 20 client.5952 trim_cache size 0 max 16384 2024-09-17T03:11:00.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.917+0000 7f3dbbbc4740 1 Processor -- start 2024-09-17T03:11:00.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.917+0000 7f3dbbbc4740 1 -- start start 2024-09-17T03:11:00.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.918+0000 7f3dbbbc4740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5639af9bf4d0 0x5639afdd1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.918+0000 7f3dbbbc4740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9c76b0 0x5639afdd6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.918+0000 7f3dbbbc4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9e8390 0x5639afdd6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.918+0000 7f3dbbbc4740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3db0202120 con 0x5639af9c76b0 2024-09-17T03:11:00.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.918+0000 7f3dbbbc4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3db02012f0 con 0x5639af9e8390 2024-09-17T03:11:00.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.918+0000 7f3dbbbc4740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3db02019f0 con 0x5639af9bf4d0 2024-09-17T03:11:00.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.918+0000 7f3dadd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9c76b0 0x5639afdd6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.918+0000 7f3dadd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9c76b0 0x5639afdd6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58066/0 (socket says 172.21.15.78:58066) 2024-09-17T03:11:00.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.918+0000 7f3dadd9b640 1 -- 172.21.15.78:0/3191195976 learned_addr learned my addr 172.21.15.78:0/3191195976 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.918+0000 7f3dadd9b640 1 -- 172.21.15.78:0/3191195976 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5639af9bf4d0 msgr2=0x5639afdd1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.918+0000 7f3dadd9b640 1 --2- 172.21.15.78:0/3191195976 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5639af9bf4d0 0x5639afdd1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.918+0000 7f3dadd9b640 1 -- 172.21.15.78:0/3191195976 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9e8390 msgr2=0x5639afdd6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.918+0000 7f3dadd9b640 1 --2- 172.21.15.78:0/3191195976 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9e8390 0x5639afdd6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.918+0000 7f3dadd9b640 1 -- 172.21.15.78:0/3191195976 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5639afdf6d60 con 0x5639af9c76b0 2024-09-17T03:11:00.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.918+0000 7f3dadd9b640 1 --2- 172.21.15.78:0/3191195976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9c76b0 0x5639afdd6030 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3da400fd90 tx=0x7f3da4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2637f3c1ade924ef server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.919+0000 7f3d8f7fe640 1 -- 172.21.15.78:0/3191195976 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da401b040 con 0x5639af9c76b0 2024-09-17T03:11:00.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.919+0000 7f3d8f7fe640 1 -- 172.21.15.78:0/3191195976 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3da401c040 con 0x5639af9c76b0 2024-09-17T03:11:00.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.919+0000 7f3d8f7fe640 1 -- 172.21.15.78:0/3191195976 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da4005260 con 0x5639af9c76b0 2024-09-17T03:11:00.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.919+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/3191195976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9c76b0 msgr2=0x5639afdd6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.919+0000 7f3dbbbc4740 1 --2- 172.21.15.78:0/3191195976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9c76b0 0x5639afdd6030 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3da400fd90 tx=0x7f3da4015000 comp rx=0 tx=0).stop 2024-09-17T03:11:00.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.919+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/3191195976 shutdown_connections 2024-09-17T03:11:00.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.919+0000 7f3dbbbc4740 1 --2- 172.21.15.78:0/3191195976 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9e8390 0x5639afdd6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.919+0000 7f3dbbbc4740 1 --2- 172.21.15.78:0/3191195976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9c76b0 0x5639afdd6030 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.919+0000 7f3dbbbc4740 1 --2- 172.21.15.78:0/3191195976 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5639af9bf4d0 0x5639afdd1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.919+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/3191195976 >> 172.21.15.78:0/3191195976 conn(0x5639af9dc4e0 msgr2=0x5639afd89ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.919+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/3191195976 shutdown_connections 2024-09-17T03:11:00.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.919+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/3191195976 wait complete. 2024-09-17T03:11:00.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.920+0000 7f3dbbbc4740 1 -- start start 2024-09-17T03:11:00.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.920+0000 7f3dbbbc4740 1 Processor -- start 2024-09-17T03:11:00.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.922+0000 7f3dbbbc4740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9bf4d0 0x5639afda76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.922+0000 7f3dbbbc4740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5639af9c76b0 0x5639afda7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.922+0000 7f3dbbbc4740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9e8390 0x5639afdd6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.922+0000 7f3dbbbc4740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5639afdd1850 con 0x5639af9bf4d0 2024-09-17T03:11:00.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.922+0000 7f3dbbbc4740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3db01e7960 con 0x5639af9e8390 2024-09-17T03:11:00.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.922+0000 7f3dbbbc4740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5639afcf8140 con 0x5639af9c76b0 2024-09-17T03:11:00.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.922+0000 7f3dbbbc4740 10 client.0 _ll_register_callbacks cb 0x7f3da005f490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:00.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.922+0000 7f3dae59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9bf4d0 0x5639afda76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.922+0000 7f3dae59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9bf4d0 0x5639afda76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58072/0 (socket says 172.21.15.78:58072) 2024-09-17T03:11:00.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.922+0000 7f3dae59c640 1 -- 172.21.15.78:0/738168020 learned_addr learned my addr 172.21.15.78:0/738168020 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:00.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.922+0000 7f3dadd9b640 1 --2- 172.21.15.78:0/738168020 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5639af9c76b0 0x5639afda7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.922+0000 7f3daed9d640 1 --2- 172.21.15.78:0/738168020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9e8390 0x5639afdd6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.922+0000 7f3dae59c640 1 -- 172.21.15.78:0/738168020 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5639af9c76b0 msgr2=0x5639afda7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.922+0000 7f3dae59c640 1 --2- 172.21.15.78:0/738168020 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5639af9c76b0 0x5639afda7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.922+0000 7f3dae59c640 1 -- 172.21.15.78:0/738168020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9e8390 msgr2=0x5639afdd6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.922+0000 7f3dae59c640 1 --2- 172.21.15.78:0/738168020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9e8390 0x5639afdd6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.922+0000 7f3dae59c640 1 -- 172.21.15.78:0/738168020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5639afd90a50 con 0x5639af9bf4d0 2024-09-17T03:11:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.922+0000 7f3dae59c640 1 --2- 172.21.15.78:0/738168020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9bf4d0 0x5639afda76b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3da0000c00 tx=0x7f3da0062440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e9b08740e3cbc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.922+0000 7f3d8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.922+0000 7f3d8d7fa640 1 -- 172.21.15.78:0/738168020 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da0089050 con 0x5639af9bf4d0 2024-09-17T03:11:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.923+0000 7f3d8d7fa640 1 -- 172.21.15.78:0/738168020 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f3da0069100 con 0x5639af9bf4d0 2024-09-17T03:11:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.923+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/738168020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3da401c040 con 0x5639af9bf4d0 2024-09-17T03:11:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.923+0000 7f3d8d7fa640 1 -- 172.21.15.78:0/738168020 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f3da0062e90 con 0x5639af9bf4d0 2024-09-17T03:11:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.923+0000 7f3dbbbc4740 10 client.5958 fetch_fsmap learned FSMap version 36 2024-09-17T03:11:00.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.923+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/738168020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x5639afe54e30 con 0x5639af9bf4d0 2024-09-17T03:11:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.923+0000 7f3d8d7fa640 1 -- 172.21.15.78:0/738168020 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3da401c040 con 0x5639af9bf4d0 2024-09-17T03:11:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.923+0000 7f3d8d7fa640 1 -- 172.21.15.78:0/738168020 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 36) ==== 3554+0+0 (secure 0 0 0) 0x7f3da006c040 con 0x5639af9bf4d0 2024-09-17T03:11:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.923+0000 7f3dbbbc4740 10 client.5958 fetch_fsmap finished waiting for FSMap version 36 2024-09-17T03:11:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.923+0000 7f3dbbbc4740 10 client.5958 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.d 2024-09-17T03:11:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.923+0000 7f3dbbbc4740 20 client.5958 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.923+0000 7f3dbbbc4740 1 --2- 172.21.15.78:0/738168020 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x5639afdd1fc0 0x5639afdd6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.923+0000 7f3dbbbc4740 4 client.5958 mds_command: new command op to 5039 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:11:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.923+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/738168020 --> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5639afd00460 con 0x5639afdd1fc0 2024-09-17T03:11:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.923+0000 7f3dadd9b640 1 --2- 172.21.15.78:0/738168020 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x5639afdd1fc0 0x5639afdd6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.924+0000 7f3dadd9b640 1 --2- 172.21.15.78:0/738168020 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x5639afdd1fc0 0x5639afdd6570 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4a1e9c4896d39915 server_cookie=d241aaf26178e9c2 in_seq=0 out_seq=0 2024-09-17T03:11:00.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.924+0000 7f3d8d7fa640 10 client.5958 ms_handle_connect on v2:172.21.15.193:6835/3209848332 2024-09-17T03:11:00.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.924+0000 7f3d8d7fa640 1 -- 172.21.15.78:0/738168020 <== mds.1 v2:172.21.15.193:6835/3209848332 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x5639afd00460 con 0x5639afdd1fc0 2024-09-17T03:11:00.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.924+0000 7f3d8d7fa640 10 client.5958 handle_command_reply: tid=0 2024-09-17T03:11:00.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.924+0000 7f3dbbbc4740 1 client.5958 shutdown 2024-09-17T03:11:00.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.924+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/738168020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9bf4d0 msgr2=0x5639afda76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.924+0000 7f3dbbbc4740 1 --2- 172.21.15.78:0/738168020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9bf4d0 0x5639afda76b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3da0000c00 tx=0x7f3da0062440 comp rx=0 tx=0).stop 2024-09-17T03:11:00.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.924+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/738168020 shutdown_connections 2024-09-17T03:11:00.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.924+0000 7f3dbbbc4740 1 --2- 172.21.15.78:0/738168020 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x5639afdd1fc0 0x5639afdd6570 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.924+0000 7f3dbbbc4740 1 --2- 172.21.15.78:0/738168020 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5639af9e8390 0x5639afdd6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.924+0000 7f3dbbbc4740 1 --2- 172.21.15.78:0/738168020 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5639af9c76b0 0x5639afda7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.924+0000 7f3d8d7fa640 0 client.5958 ms_handle_reset on v2:172.21.15.193:6835/3209848332 2024-09-17T03:11:00.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.924+0000 7f3dbbbc4740 1 --2- 172.21.15.78:0/738168020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5639af9bf4d0 0x5639afda76b0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.924+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/738168020 >> 172.21.15.78:0/738168020 conn(0x5639af9dc4e0 msgr2=0x5639afd89ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.924+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/738168020 shutdown_connections 2024-09-17T03:11:00.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.924+0000 7f3dbbbc4740 1 -- 172.21.15.78:0/738168020 wait complete. 2024-09-17T03:11:00.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.924+0000 7f3dbbbc4740 20 client.5958 trim_cache size 0 max 16384 2024-09-17T03:11:00.929 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:11:00.929 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T03:11:00.929 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:11:00.930 INFO:teuthology.orchestra.run.smithi078.stdout: "8ebf2041-e471-4ebc-8443-f9f2c10aae14": { 2024-09-17T03:11:00.930 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:11:00.930 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "8ebf2041-e471-4ebc-8443-f9f2c10aae14", 2024-09-17T03:11:00.930 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:11:00.930 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:00.930 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:00.930 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:11:00.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.925+0000 7f3db4c4d640 1 -- 172.21.15.78:0/4257282728 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3d90078bc0 msgr2=0x7f3d9007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.925+0000 7f3db4c4d640 1 --2- 172.21.15.78:0/4257282728 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3d90078bc0 0x7f3d9007b0d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3da4007fd0 tx=0x7f3da4001370 comp rx=0 tx=0).stop 2024-09-17T03:11:00.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.925+0000 7f3db4c4d640 1 -- 172.21.15.78:0/4257282728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3db0142270 msgr2=0x7f3db01f8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:00.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.925+0000 7f3db4c4d640 1 --2- 172.21.15.78:0/4257282728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3db0142270 0x7f3db01f8720 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3da000e790 tx=0x7f3da000ec50 comp rx=0 tx=0).stop 2024-09-17T03:11:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.925+0000 7f3db4c4d640 1 -- 172.21.15.78:0/4257282728 shutdown_connections 2024-09-17T03:11:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.925+0000 7f3db4c4d640 1 --2- 172.21.15.78:0/4257282728 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3db00715d0 0x7f3db013ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.925+0000 7f3db4c4d640 1 --2- 172.21.15.78:0/4257282728 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3d90078bc0 0x7f3d9007b0d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.925+0000 7f3db4c4d640 1 --2- 172.21.15.78:0/4257282728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3db0144270 0x7f3db00cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.925+0000 7f3db4c4d640 1 --2- 172.21.15.78:0/4257282728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3db0142270 0x7f3db01f8720 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.925+0000 7f3db4c4d640 1 -- 172.21.15.78:0/4257282728 >> 172.21.15.78:0/4257282728 conn(0x7f3db00d15f0 msgr2=0x7f3db015bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:00.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.925+0000 7f3db4c4d640 1 -- 172.21.15.78:0/4257282728 shutdown_connections 2024-09-17T03:11:00.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:00.925+0000 7f3db4c4d640 1 -- 172.21.15.78:0/4257282728 wait complete. 2024-09-17T03:11:02.737 INFO:tasks.ceph.mon.a.smithi078.stderr:2024-09-17T03:11:02.738+0000 7f192d77d640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-17T03:11:05.935 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:11:05.935 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:1 scrub status 2024-09-17T03:11:06.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.064+0000 7f8c4ff13640 1 -- 172.21.15.78:0/1991084024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c34004d90 msgr2=0x7f8c34005260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:06.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.064+0000 7f8c4ff13640 1 --2- 172.21.15.78:0/1991084024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c34004d90 0x7f8c34005260 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8c48070de0 tx=0x7f8c34005830 comp rx=0 tx=0).stop 2024-09-17T03:11:06.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.064+0000 7f8c4e4b0640 1 -- 172.21.15.78:0/1991084024 reap_dead start 2024-09-17T03:11:06.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.064+0000 7f8c4ff13640 1 -- 172.21.15.78:0/1991084024 shutdown_connections 2024-09-17T03:11:06.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.064+0000 7f8c4ff13640 1 -- 172.21.15.78:0/1991084024 >> 172.21.15.78:0/1991084024 conn(0x7f8c480b1cb0 msgr2=0x7f8c480b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:06.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.064+0000 7f8c4ff13640 1 -- 172.21.15.78:0/1991084024 shutdown_connections 2024-09-17T03:11:06.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.064+0000 7f8c4ff13640 1 -- 172.21.15.78:0/1991084024 wait complete. 2024-09-17T03:11:06.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.066+0000 7f8c4ff13640 1 Processor -- start 2024-09-17T03:11:06.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.066+0000 7f8c4ff13640 1 -- start start 2024-09-17T03:11:06.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.067+0000 7f8c4ff13640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c34004d90 0x7f8c480af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:06.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.067+0000 7f8c4ff13640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c481f3a50 0x7f8c481524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:06.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.067+0000 7f8c4ff13640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c48157af0 0x7f8c48157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:06.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.067+0000 7f8c4ff13640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8c48073cc0 con 0x7f8c481f3a50 2024-09-17T03:11:06.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.067+0000 7f8c4ff13640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8c480cbe00 con 0x7f8c48157af0 2024-09-17T03:11:06.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.067+0000 7f8c4ff13640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8c48073e40 con 0x7f8c34004d90 2024-09-17T03:11:06.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.067+0000 7f8c4d4ae640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c481f3a50 0x7f8c481524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:06.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.067+0000 7f8c4d4ae640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c481f3a50 0x7f8c481524c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58090/0 (socket says 172.21.15.78:58090) 2024-09-17T03:11:06.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.067+0000 7f8c4d4ae640 1 -- 172.21.15.78:0/344122940 learned_addr learned my addr 172.21.15.78:0/344122940 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:06.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.067+0000 7f8c4dcaf640 1 --2- 172.21.15.78:0/344122940 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c34004d90 0x7f8c480af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:06.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.067+0000 7f8c4e4b0640 1 --2- 172.21.15.78:0/344122940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c48157af0 0x7f8c48157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:06.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.067+0000 7f8c4d4ae640 1 -- 172.21.15.78:0/344122940 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c34004d90 msgr2=0x7f8c480af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:06.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.067+0000 7f8c4d4ae640 1 --2- 172.21.15.78:0/344122940 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c34004d90 0x7f8c480af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.067+0000 7f8c4d4ae640 1 -- 172.21.15.78:0/344122940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c48157af0 msgr2=0x7f8c48157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:06.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.067+0000 7f8c4d4ae640 1 --2- 172.21.15.78:0/344122940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c48157af0 0x7f8c48157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.067+0000 7f8c4d4ae640 1 -- 172.21.15.78:0/344122940 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c48158440 con 0x7f8c481f3a50 2024-09-17T03:11:06.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.067+0000 7f8c4dcaf640 1 --2- 172.21.15.78:0/344122940 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c34004d90 0x7f8c480af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:06.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.067+0000 7f8c4e4b0640 1 --2- 172.21.15.78:0/344122940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c48157af0 0x7f8c48157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:06.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.067+0000 7f8c4d4ae640 1 --2- 172.21.15.78:0/344122940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c481f3a50 0x7f8c481524c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8c38004ed0 tx=0x7f8c380015d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:06.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.068+0000 7f8c3e7fc640 1 -- 172.21.15.78:0/344122940 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c38015020 con 0x7f8c481f3a50 2024-09-17T03:11:06.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.068+0000 7f8c3e7fc640 1 -- 172.21.15.78:0/344122940 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c38011960 con 0x7f8c481f3a50 2024-09-17T03:11:06.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.068+0000 7f8c4ff13640 1 -- 172.21.15.78:0/344122940 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c4815a090 con 0x7f8c481f3a50 2024-09-17T03:11:06.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.068+0000 7f8c3e7fc640 1 -- 172.21.15.78:0/344122940 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c38011d90 con 0x7f8c481f3a50 2024-09-17T03:11:06.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.068+0000 7f8c4ff13640 1 -- 172.21.15.78:0/344122940 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c481f4300 con 0x7f8c481f3a50 2024-09-17T03:11:06.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.069+0000 7f8c3e7fc640 1 -- 172.21.15.78:0/344122940 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8c38018020 con 0x7f8c481f3a50 2024-09-17T03:11:06.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.070+0000 7f8c3e7fc640 1 --2- 172.21.15.78:0/344122940 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c2c078bc0 0x7f8c2c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:06.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.070+0000 7f8c3e7fc640 1 -- 172.21.15.78:0/344122940 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f8c3809b7e0 con 0x7f8c481f3a50 2024-09-17T03:11:06.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.070+0000 7f8c4dcaf640 1 --2- 172.21.15.78:0/344122940 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c2c078bc0 0x7f8c2c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:06.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.071+0000 7f8c4dcaf640 1 --2- 172.21.15.78:0/344122940 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c2c078bc0 0x7f8c2c07b0d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8c480cb250 tx=0x7f8c44009610 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:06.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.071+0000 7f8c56e7f740 1 Processor -- start 2024-09-17T03:11:06.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.071+0000 7f8c56e7f740 1 -- start start 2024-09-17T03:11:06.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.072+0000 7f8c56e7f740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd4598390 0x561bd4984a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:06.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.072+0000 7f8c56e7f740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bd456f4d0 0x561bd4959860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:06.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.072+0000 7f8c56e7f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd45776b0 0x561bd4959da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:06.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.072+0000 7f8c56e7f740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x561bd48b2a60 con 0x561bd4598390 2024-09-17T03:11:06.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.072+0000 7f8c56e7f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561bd48a1e90 con 0x561bd45776b0 2024-09-17T03:11:06.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.072+0000 7f8c56e7f740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x561bd48a5ca0 con 0x561bd456f4d0 2024-09-17T03:11:06.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.073+0000 7f8c4dcaf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd4598390 0x561bd4984a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:06.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.073+0000 7f8c4dcaf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd4598390 0x561bd4984a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58098/0 (socket says 172.21.15.78:58098) 2024-09-17T03:11:06.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.073+0000 7f8c4dcaf640 1 -- 172.21.15.78:0/3134245134 learned_addr learned my addr 172.21.15.78:0/3134245134 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:06.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.073+0000 7f8c4d4ae640 1 --2- 172.21.15.78:0/3134245134 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bd456f4d0 0x561bd4959860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:06.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.073+0000 7f8c4e4b0640 1 --2- 172.21.15.78:0/3134245134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd45776b0 0x561bd4959da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:06.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.073+0000 7f8c4dcaf640 1 -- 172.21.15.78:0/3134245134 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bd456f4d0 msgr2=0x561bd4959860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:06.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.073+0000 7f8c4dcaf640 1 --2- 172.21.15.78:0/3134245134 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bd456f4d0 0x561bd4959860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.073+0000 7f8c4dcaf640 1 -- 172.21.15.78:0/3134245134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd45776b0 msgr2=0x561bd4959da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:06.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.073+0000 7f8c4dcaf640 1 --2- 172.21.15.78:0/3134245134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd45776b0 0x561bd4959da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.073+0000 7f8c4dcaf640 1 -- 172.21.15.78:0/3134245134 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bd467a7d0 con 0x561bd4598390 2024-09-17T03:11:06.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.073+0000 7f8c4e4b0640 1 --2- 172.21.15.78:0/3134245134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd45776b0 0x561bd4959da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:06.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.073+0000 7f8c4dcaf640 1 --2- 172.21.15.78:0/3134245134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd4598390 0x561bd4984a10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8c44012770 tx=0x7f8c44014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2a8ffb95fdad8b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:06.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.073+0000 7f8c2b7fe640 1 -- 172.21.15.78:0/3134245134 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4401d730 con 0x561bd4598390 2024-09-17T03:11:06.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.073+0000 7f8c2b7fe640 1 -- 172.21.15.78:0/3134245134 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c4401d8d0 con 0x561bd4598390 2024-09-17T03:11:06.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.073+0000 7f8c2b7fe640 1 -- 172.21.15.78:0/3134245134 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c4401dd00 con 0x561bd4598390 2024-09-17T03:11:06.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.074+0000 7f8c56e7f740 1 -- 172.21.15.78:0/3134245134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd4598390 msgr2=0x561bd4984a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:06.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.074+0000 7f8c56e7f740 1 --2- 172.21.15.78:0/3134245134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd4598390 0x561bd4984a10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8c44012770 tx=0x7f8c44014000 comp rx=0 tx=0).stop 2024-09-17T03:11:06.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.074+0000 7f8c56e7f740 1 -- 172.21.15.78:0/3134245134 shutdown_connections 2024-09-17T03:11:06.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.074+0000 7f8c56e7f740 1 --2- 172.21.15.78:0/3134245134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd45776b0 0x561bd4959da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.074+0000 7f8c56e7f740 1 --2- 172.21.15.78:0/3134245134 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bd456f4d0 0x561bd4959860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.074+0000 7f8c56e7f740 1 --2- 172.21.15.78:0/3134245134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd4598390 0x561bd4984a10 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.074+0000 7f8c56e7f740 1 -- 172.21.15.78:0/3134245134 >> 172.21.15.78:0/3134245134 conn(0x561bd458c4e0 msgr2=0x561bd493fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:06.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.074+0000 7f8c56e7f740 1 -- 172.21.15.78:0/3134245134 shutdown_connections 2024-09-17T03:11:06.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.074+0000 7f8c56e7f740 1 -- 172.21.15.78:0/3134245134 wait complete. 2024-09-17T03:11:06.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.075+0000 7f8c56e7f740 1 -- start start 2024-09-17T03:11:06.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.075+0000 7f8c56e7f740 1 Processor -- start 2024-09-17T03:11:06.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c56e7f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd456f4d0 0x561bd497ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:06.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c56e7f740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd45776b0 0x561bd497f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:06.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c56e7f740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bd4598390 0x561bd4997260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:06.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c56e7f740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x561bd4612740 con 0x561bd45776b0 2024-09-17T03:11:06.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c56e7f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561bd4847970 con 0x561bd456f4d0 2024-09-17T03:11:06.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c56e7f740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x561bd497fff0 con 0x561bd4598390 2024-09-17T03:11:06.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c56e7f740 10 client.0 _ll_register_callbacks cb 0x561bd4856780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:06.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c4d4ae640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd45776b0 0x561bd497f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:06.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c4d4ae640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd45776b0 0x561bd497f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58104/0 (socket says 172.21.15.78:58104) 2024-09-17T03:11:06.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c4d4ae640 1 -- 172.21.15.78:0/530474046 learned_addr learned my addr 172.21.15.78:0/530474046 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:06.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c4dcaf640 1 --2- 172.21.15.78:0/530474046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd456f4d0 0x561bd497ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:06.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c4e4b0640 1 --2- 172.21.15.78:0/530474046 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bd4598390 0x561bd4997260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:06.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c4d4ae640 1 -- 172.21.15.78:0/530474046 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bd4598390 msgr2=0x561bd4997260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:06.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c4d4ae640 1 --2- 172.21.15.78:0/530474046 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bd4598390 0x561bd4997260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c4d4ae640 1 -- 172.21.15.78:0/530474046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd456f4d0 msgr2=0x561bd497ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:06.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c4d4ae640 1 --2- 172.21.15.78:0/530474046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd456f4d0 0x561bd497ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c4d4ae640 1 -- 172.21.15.78:0/530474046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bd4603970 con 0x561bd45776b0 2024-09-17T03:11:06.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c4dcaf640 1 --2- 172.21.15.78:0/530474046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd456f4d0 0x561bd497ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:06.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c4d4ae640 1 --2- 172.21.15.78:0/530474046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd45776b0 0x561bd497f490 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8c38004ea0 tx=0x7f8c38062d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e43de495a791b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:06.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:06.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c28ff9640 1 -- 172.21.15.78:0/530474046 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3804ae60 con 0x561bd45776b0 2024-09-17T03:11:06.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c28ff9640 1 -- 172.21.15.78:0/530474046 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f8c3805ee70 con 0x561bd45776b0 2024-09-17T03:11:06.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c56e7f740 1 -- 172.21.15.78:0/530474046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c4401d8d0 con 0x561bd45776b0 2024-09-17T03:11:06.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c28ff9640 1 -- 172.21.15.78:0/530474046 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f8c38084050 con 0x561bd45776b0 2024-09-17T03:11:06.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c56e7f740 10 client.5970 fetch_fsmap learned FSMap version 38 2024-09-17T03:11:06.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.077+0000 7f8c56e7f740 1 -- 172.21.15.78:0/530474046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x561bd45e16a0 con 0x561bd45776b0 2024-09-17T03:11:06.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.078+0000 7f8c28ff9640 1 -- 172.21.15.78:0/530474046 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c4401d8d0 con 0x561bd45776b0 2024-09-17T03:11:06.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.078+0000 7f8c28ff9640 1 -- 172.21.15.78:0/530474046 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 38) ==== 3558+0+0 (secure 0 0 0) 0x7f8c3805f070 con 0x561bd45776b0 2024-09-17T03:11:06.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.078+0000 7f8c56e7f740 10 client.5970 fetch_fsmap finished waiting for FSMap version 38 2024-09-17T03:11:06.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.078+0000 7f8c56e7f740 10 client.5970 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.d 2024-09-17T03:11:06.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.078+0000 7f8c56e7f740 20 client.5970 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:06.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.078+0000 7f8c56e7f740 1 --2- 172.21.15.78:0/530474046 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x561bd4556f60 0x561bd4997c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:06.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.078+0000 7f8c56e7f740 4 client.5970 mds_command: new command op to 5039 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:11:06.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.078+0000 7f8c56e7f740 1 -- 172.21.15.78:0/530474046 --> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561bd48b49b0 con 0x561bd4556f60 2024-09-17T03:11:06.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.078+0000 7f8c4dcaf640 1 --2- 172.21.15.78:0/530474046 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x561bd4556f60 0x561bd4997c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:06.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.078+0000 7f8c28ff9640 10 client.5970 ms_handle_connect on v2:172.21.15.193:6835/3209848332 2024-09-17T03:11:06.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.078+0000 7f8c4dcaf640 1 --2- 172.21.15.78:0/530474046 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x561bd4556f60 0x561bd4997c70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fbc6e09a0c6f8ee9 server_cookie=7e53abd1d51dea87 in_seq=0 out_seq=0 2024-09-17T03:11:06.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.079+0000 7f8c28ff9640 1 -- 172.21.15.78:0/530474046 <== mds.1 v2:172.21.15.193:6835/3209848332 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561bd48b49b0 con 0x561bd4556f60 2024-09-17T03:11:06.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.079+0000 7f8c28ff9640 10 client.5970 handle_command_reply: tid=0 2024-09-17T03:11:06.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.079+0000 7f8c56e7f740 1 client.5970 shutdown 2024-09-17T03:11:06.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.079+0000 7f8c56e7f740 1 -- 172.21.15.78:0/530474046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd45776b0 msgr2=0x561bd497f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:06.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.079+0000 7f8c56e7f740 1 --2- 172.21.15.78:0/530474046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd45776b0 0x561bd497f490 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8c38004ea0 tx=0x7f8c38062d00 comp rx=0 tx=0).stop 2024-09-17T03:11:06.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.079+0000 7f8c56e7f740 1 -- 172.21.15.78:0/530474046 shutdown_connections 2024-09-17T03:11:06.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.079+0000 7f8c56e7f740 1 --2- 172.21.15.78:0/530474046 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x561bd4556f60 0x561bd4997c70 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.079+0000 7f8c56e7f740 1 --2- 172.21.15.78:0/530474046 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bd4598390 0x561bd4997260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.079+0000 7f8c56e7f740 1 --2- 172.21.15.78:0/530474046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd45776b0 0x561bd497f490 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.079+0000 7f8c28ff9640 0 client.5970 ms_handle_reset on v2:172.21.15.193:6835/3209848332 2024-09-17T03:11:06.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.079+0000 7f8c56e7f740 1 --2- 172.21.15.78:0/530474046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd456f4d0 0x561bd497ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.079+0000 7f8c56e7f740 1 -- 172.21.15.78:0/530474046 >> 172.21.15.78:0/530474046 conn(0x561bd458c4e0 msgr2=0x561bd493aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:06.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.080+0000 7f8c56e7f740 1 -- 172.21.15.78:0/530474046 shutdown_connections 2024-09-17T03:11:06.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.080+0000 7f8c56e7f740 1 -- 172.21.15.78:0/530474046 wait complete. 2024-09-17T03:11:06.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.080+0000 7f8c56e7f740 20 client.5970 trim_cache size 0 max 16384 2024-09-17T03:11:06.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.097+0000 7f8c56e7f740 1 Processor -- start 2024-09-17T03:11:06.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.097+0000 7f8c56e7f740 1 -- start start 2024-09-17T03:11:06.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.098+0000 7f8c56e7f740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bd456f4d0 0x561bd497df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:06.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.098+0000 7f8c56e7f740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd45776b0 0x561bd49925c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:06.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.098+0000 7f8c56e7f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd4598390 0x561bd4992b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:06.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.098+0000 7f8c56e7f740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8c48200320 con 0x561bd45776b0 2024-09-17T03:11:06.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.098+0000 7f8c56e7f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8c481ff4c0 con 0x561bd4598390 2024-09-17T03:11:06.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.098+0000 7f8c56e7f740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8c481ffbf0 con 0x561bd456f4d0 2024-09-17T03:11:06.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.099+0000 7f8c4d4ae640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd45776b0 0x561bd49925c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:06.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.099+0000 7f8c4d4ae640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd45776b0 0x561bd49925c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58108/0 (socket says 172.21.15.78:58108) 2024-09-17T03:11:06.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.099+0000 7f8c4d4ae640 1 -- 172.21.15.78:0/1430022824 learned_addr learned my addr 172.21.15.78:0/1430022824 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:06.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.099+0000 7f8c4d4ae640 1 -- 172.21.15.78:0/1430022824 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bd456f4d0 msgr2=0x561bd497df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:06.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.099+0000 7f8c4d4ae640 1 --2- 172.21.15.78:0/1430022824 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bd456f4d0 0x561bd497df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.099+0000 7f8c4d4ae640 1 -- 172.21.15.78:0/1430022824 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd4598390 msgr2=0x561bd4992b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:06.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.099+0000 7f8c4d4ae640 1 --2- 172.21.15.78:0/1430022824 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd4598390 0x561bd4992b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.099+0000 7f8c4d4ae640 1 -- 172.21.15.78:0/1430022824 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bd493ae90 con 0x561bd45776b0 2024-09-17T03:11:06.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.099+0000 7f8c4d4ae640 1 --2- 172.21.15.78:0/1430022824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd45776b0 0x561bd49925c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8c380634b0 tx=0x7f8c380680a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a00d3c2f0be00e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:06.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.099+0000 7f8c2affd640 1 -- 172.21.15.78:0/1430022824 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3804ae60 con 0x561bd45776b0 2024-09-17T03:11:06.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.099+0000 7f8c2affd640 1 -- 172.21.15.78:0/1430022824 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c3805ee70 con 0x561bd45776b0 2024-09-17T03:11:06.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.099+0000 7f8c2affd640 1 -- 172.21.15.78:0/1430022824 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3806cf90 con 0x561bd45776b0 2024-09-17T03:11:06.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.100+0000 7f8c56e7f740 1 -- 172.21.15.78:0/1430022824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd45776b0 msgr2=0x561bd49925c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:06.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.100+0000 7f8c56e7f740 1 --2- 172.21.15.78:0/1430022824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd45776b0 0x561bd49925c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8c380634b0 tx=0x7f8c380680a0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.100+0000 7f8c56e7f740 1 -- 172.21.15.78:0/1430022824 shutdown_connections 2024-09-17T03:11:06.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.100+0000 7f8c56e7f740 1 --2- 172.21.15.78:0/1430022824 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd4598390 0x561bd4992b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.100+0000 7f8c56e7f740 1 --2- 172.21.15.78:0/1430022824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd45776b0 0x561bd49925c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.100+0000 7f8c56e7f740 1 --2- 172.21.15.78:0/1430022824 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bd456f4d0 0x561bd497df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.100+0000 7f8c56e7f740 1 -- 172.21.15.78:0/1430022824 >> 172.21.15.78:0/1430022824 conn(0x561bd458c4e0 msgr2=0x561bd4980260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:06.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.100+0000 7f8c56e7f740 1 -- 172.21.15.78:0/1430022824 shutdown_connections 2024-09-17T03:11:06.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.100+0000 7f8c56e7f740 1 -- 172.21.15.78:0/1430022824 wait complete. 2024-09-17T03:11:06.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.101+0000 7f8c56e7f740 1 -- start start 2024-09-17T03:11:06.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.101+0000 7f8c56e7f740 1 Processor -- start 2024-09-17T03:11:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.102+0000 7f8c56e7f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd456f4d0 0x561bd4981770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.102+0000 7f8c56e7f740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bd45776b0 0x561bd49fe730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.102+0000 7f8c56e7f740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd4598390 0x561bd49a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.102+0000 7f8c56e7f740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8c481f56f0 con 0x561bd4598390 2024-09-17T03:11:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.102+0000 7f8c56e7f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561bd497c570 con 0x561bd456f4d0 2024-09-17T03:11:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.102+0000 7f8c56e7f740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x561bd4a08380 con 0x561bd45776b0 2024-09-17T03:11:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.102+0000 7f8c56e7f740 10 client.0 _ll_register_callbacks cb 0x7f8c38062ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.102+0000 7f8c4e4b0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd4598390 0x561bd49a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.102+0000 7f8c4e4b0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd4598390 0x561bd49a6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58124/0 (socket says 172.21.15.78:58124) 2024-09-17T03:11:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.102+0000 7f8c4e4b0640 1 -- 172.21.15.78:0/2975411701 learned_addr learned my addr 172.21.15.78:0/2975411701 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c4dcaf640 1 --2- 172.21.15.78:0/2975411701 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd456f4d0 0x561bd4981770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c4d4ae640 1 --2- 172.21.15.78:0/2975411701 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bd45776b0 0x561bd49fe730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c4e4b0640 1 -- 172.21.15.78:0/2975411701 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bd45776b0 msgr2=0x561bd49fe730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c4e4b0640 1 --2- 172.21.15.78:0/2975411701 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bd45776b0 0x561bd49fe730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c4e4b0640 1 -- 172.21.15.78:0/2975411701 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd456f4d0 msgr2=0x561bd4981770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c4e4b0640 1 --2- 172.21.15.78:0/2975411701 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd456f4d0 0x561bd4981770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c4e4b0640 1 -- 172.21.15.78:0/2975411701 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bd4986180 con 0x561bd4598390 2024-09-17T03:11:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c4e4b0640 1 --2- 172.21.15.78:0/2975411701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd4598390 0x561bd49a6b70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8c4002b130 tx=0x7f8c400011c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453421a82e4c0025 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c28ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c28ff9640 1 -- 172.21.15.78:0/2975411701 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c40031070 con 0x561bd4598390 2024-09-17T03:11:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c28ff9640 1 -- 172.21.15.78:0/2975411701 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f8c40006450 con 0x561bd4598390 2024-09-17T03:11:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c56e7f740 1 -- 172.21.15.78:0/2975411701 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c3805ee70 con 0x561bd4598390 2024-09-17T03:11:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c28ff9640 1 -- 172.21.15.78:0/2975411701 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f8c40047050 con 0x561bd4598390 2024-09-17T03:11:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c56e7f740 10 client.5976 fetch_fsmap learned FSMap version 38 2024-09-17T03:11:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c56e7f740 1 -- 172.21.15.78:0/2975411701 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x561bd4a07e40 con 0x561bd4598390 2024-09-17T03:11:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c28ff9640 1 -- 172.21.15.78:0/2975411701 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c3805ee70 con 0x561bd4598390 2024-09-17T03:11:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c28ff9640 1 -- 172.21.15.78:0/2975411701 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 38) ==== 3558+0+0 (secure 0 0 0) 0x7f8c4004a020 con 0x561bd4598390 2024-09-17T03:11:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c56e7f740 10 client.5976 fetch_fsmap finished waiting for FSMap version 38 2024-09-17T03:11:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c56e7f740 10 client.5976 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.d 2024-09-17T03:11:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c56e7f740 20 client.5976 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c56e7f740 1 --2- 172.21.15.78:0/2975411701 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x561bd49925c0 0x561bd49929d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c56e7f740 4 client.5976 mds_command: new command op to 5039 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:11:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.103+0000 7f8c56e7f740 1 -- 172.21.15.78:0/2975411701 --> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561bd48b0460 con 0x561bd49925c0 2024-09-17T03:11:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.104+0000 7f8c4dcaf640 1 --2- 172.21.15.78:0/2975411701 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x561bd49925c0 0x561bd49929d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.104+0000 7f8c28ff9640 10 client.5976 ms_handle_connect on v2:172.21.15.193:6835/3209848332 2024-09-17T03:11:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.104+0000 7f8c4dcaf640 1 --2- 172.21.15.78:0/2975411701 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x561bd49925c0 0x561bd49929d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=283b07ebd61e7923 server_cookie=b0baf4314102ad48 in_seq=0 out_seq=0 2024-09-17T03:11:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.104+0000 7f8c28ff9640 1 -- 172.21.15.78:0/2975411701 <== mds.1 v2:172.21.15.193:6835/3209848332 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x561bd48b0460 con 0x561bd49925c0 2024-09-17T03:11:06.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.104+0000 7f8c28ff9640 10 client.5976 handle_command_reply: tid=0 2024-09-17T03:11:06.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.104+0000 7f8c56e7f740 1 client.5976 shutdown 2024-09-17T03:11:06.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.104+0000 7f8c56e7f740 1 -- 172.21.15.78:0/2975411701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd4598390 msgr2=0x561bd49a6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:06.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.104+0000 7f8c56e7f740 1 --2- 172.21.15.78:0/2975411701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd4598390 0x561bd49a6b70 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8c4002b130 tx=0x7f8c400011c0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.104+0000 7f8c56e7f740 1 -- 172.21.15.78:0/2975411701 shutdown_connections 2024-09-17T03:11:06.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.104+0000 7f8c56e7f740 1 --2- 172.21.15.78:0/2975411701 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x561bd49925c0 0x561bd49929d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.104+0000 7f8c56e7f740 1 --2- 172.21.15.78:0/2975411701 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bd4598390 0x561bd49a6b70 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.104+0000 7f8c28ff9640 0 client.5976 ms_handle_reset on v2:172.21.15.193:6835/3209848332 2024-09-17T03:11:06.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.104+0000 7f8c56e7f740 1 --2- 172.21.15.78:0/2975411701 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bd45776b0 0x561bd49fe730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.104+0000 7f8c56e7f740 1 --2- 172.21.15.78:0/2975411701 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bd456f4d0 0x561bd4981770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.104+0000 7f8c56e7f740 1 -- 172.21.15.78:0/2975411701 >> 172.21.15.78:0/2975411701 conn(0x561bd458c4e0 msgr2=0x561bd493a730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:06.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.105+0000 7f8c56e7f740 1 -- 172.21.15.78:0/2975411701 shutdown_connections 2024-09-17T03:11:06.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.105+0000 7f8c56e7f740 1 -- 172.21.15.78:0/2975411701 wait complete. 2024-09-17T03:11:06.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.105+0000 7f8c56e7f740 20 client.5976 trim_cache size 0 max 16384 2024-09-17T03:11:06.109 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:11:06.109 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T03:11:06.109 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:11:06.109 INFO:teuthology.orchestra.run.smithi078.stdout: "8ebf2041-e471-4ebc-8443-f9f2c10aae14": { 2024-09-17T03:11:06.110 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:11:06.110 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "8ebf2041-e471-4ebc-8443-f9f2c10aae14", 2024-09-17T03:11:06.110 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:11:06.110 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:06.110 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:06.110 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:11:06.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.105+0000 7f8c4ff13640 1 -- 172.21.15.78:0/344122940 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c2c078bc0 msgr2=0x7f8c2c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:06.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.105+0000 7f8c4ff13640 1 --2- 172.21.15.78:0/344122940 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c2c078bc0 0x7f8c2c07b0d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8c480cb250 tx=0x7f8c44009610 comp rx=0 tx=0).stop 2024-09-17T03:11:06.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.105+0000 7f8c4ff13640 1 -- 172.21.15.78:0/344122940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c481f3a50 msgr2=0x7f8c481524c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.105+0000 7f8c4ff13640 1 --2- 172.21.15.78:0/344122940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c481f3a50 0x7f8c481524c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8c38004ed0 tx=0x7f8c380015d0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.105+0000 7f8c4ff13640 1 -- 172.21.15.78:0/344122940 shutdown_connections 2024-09-17T03:11:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.105+0000 7f8c4ff13640 1 --2- 172.21.15.78:0/344122940 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c2c078bc0 0x7f8c2c07b0d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.105+0000 7f8c4ff13640 1 --2- 172.21.15.78:0/344122940 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c48157af0 0x7f8c48157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.105+0000 7f8c4ff13640 1 --2- 172.21.15.78:0/344122940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c481f3a50 0x7f8c481524c0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.105+0000 7f8c4ff13640 1 --2- 172.21.15.78:0/344122940 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c34004d90 0x7f8c480af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.105+0000 7f8c4ff13640 1 -- 172.21.15.78:0/344122940 >> 172.21.15.78:0/344122940 conn(0x7f8c480b1cb0 msgr2=0x7f8c48156860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.105+0000 7f8c4ff13640 1 -- 172.21.15.78:0/344122940 shutdown_connections 2024-09-17T03:11:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:06.105+0000 7f8c4ff13640 1 -- 172.21.15.78:0/344122940 wait complete. 2024-09-17T03:11:11.116 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:11:11.117 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:1 scrub status 2024-09-17T03:11:11.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.245+0000 7fcd149c3640 1 -- 172.21.15.78:0/3000060187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd100d1d40 msgr2=0x7fcd100b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:11.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.245+0000 7fcd149c3640 1 --2- 172.21.15.78:0/3000060187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd100d1d40 0x7fcd100b5210 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcd10072650 tx=0x7fcd0002aac0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.245+0000 7fcd149c3640 1 -- 172.21.15.78:0/3000060187 shutdown_connections 2024-09-17T03:11:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.245+0000 7fcd149c3640 1 --2- 172.21.15.78:0/3000060187 >> v2:172.21.15.193:3300/0 conn(0x7fcd100ccba0 0x7fcd100ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.245+0000 7fcd149c3640 1 --2- 172.21.15.78:0/3000060187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd100d1d40 0x7fcd100b5210 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.245+0000 7fcd149c3640 1 -- 172.21.15.78:0/3000060187 >> 172.21.15.78:0/3000060187 conn(0x7fcd100b3f10 msgr2=0x7fcd100b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.245+0000 7fcd149c3640 1 -- 172.21.15.78:0/3000060187 shutdown_connections 2024-09-17T03:11:11.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.245+0000 7fcd149c3640 1 -- 172.21.15.78:0/3000060187 wait complete. 2024-09-17T03:11:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.247+0000 7fcd149c3640 1 Processor -- start 2024-09-17T03:11:11.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.247+0000 7fcd149c3640 1 -- start start 2024-09-17T03:11:11.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.248+0000 7fcd149c3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcd100ccba0 0x7fcd1015f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:11.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.248+0000 7fcd149c3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd100d1d40 0x7fcd100c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:11.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.248+0000 7fcd149c3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd1015c6f0 0x7fcd1014a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:11.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.248+0000 7fcd149c3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcd100d11f0 con 0x7fcd1015c6f0 2024-09-17T03:11:11.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.248+0000 7fcd149c3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcd100d1070 con 0x7fcd100d1d40 2024-09-17T03:11:11.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.248+0000 7fcd149c3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fcd100d1370 con 0x7fcd100ccba0 2024-09-17T03:11:11.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.249+0000 7fcd0ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd1015c6f0 0x7fcd1014a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:11.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.249+0000 7fcd0ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd1015c6f0 0x7fcd1014a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36484/0 (socket says 172.21.15.78:36484) 2024-09-17T03:11:11.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.249+0000 7fcd0ed9d640 1 -- 172.21.15.78:0/2009638112 learned_addr learned my addr 172.21.15.78:0/2009638112 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:11.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.249+0000 7fcd0dd9b640 1 --2- 172.21.15.78:0/2009638112 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd100d1d40 0x7fcd100c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:11.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.249+0000 7fcd0e59c640 1 --2- 172.21.15.78:0/2009638112 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcd100ccba0 0x7fcd1015f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:11.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.249+0000 7fcd0ed9d640 1 -- 172.21.15.78:0/2009638112 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcd100ccba0 msgr2=0x7fcd1015f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:11.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.249+0000 7fcd0ed9d640 1 --2- 172.21.15.78:0/2009638112 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcd100ccba0 0x7fcd1015f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.249+0000 7fcd0ed9d640 1 -- 172.21.15.78:0/2009638112 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd100d1d40 msgr2=0x7fcd100c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:11.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.249+0000 7fcd0ed9d640 1 --2- 172.21.15.78:0/2009638112 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd100d1d40 0x7fcd100c93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.249+0000 7fcd0ed9d640 1 -- 172.21.15.78:0/2009638112 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd100c9900 con 0x7fcd1015c6f0 2024-09-17T03:11:11.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.249+0000 7fcd0e59c640 1 --2- 172.21.15.78:0/2009638112 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcd100ccba0 0x7fcd1015f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:11.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.249+0000 7fcd0ed9d640 1 --2- 172.21.15.78:0/2009638112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd1015c6f0 0x7fcd1014a740 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcd0800b410 tx=0x7fcd0800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:11.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.249+0000 7fccfeffd640 1 -- 172.21.15.78:0/2009638112 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08015020 con 0x7fcd1015c6f0 2024-09-17T03:11:11.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.249+0000 7fccfeffd640 1 -- 172.21.15.78:0/2009638112 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd08011940 con 0x7fcd1015c6f0 2024-09-17T03:11:11.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.249+0000 7fcd149c3640 1 -- 172.21.15.78:0/2009638112 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd1014ac80 con 0x7fcd1015c6f0 2024-09-17T03:11:11.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.249+0000 7fccfeffd640 1 -- 172.21.15.78:0/2009638112 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08011d90 con 0x7fcd1015c6f0 2024-09-17T03:11:11.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.249+0000 7fcd149c3640 1 -- 172.21.15.78:0/2009638112 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd1015d240 con 0x7fcd1015c6f0 2024-09-17T03:11:11.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.251+0000 7fccfeffd640 1 -- 172.21.15.78:0/2009638112 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcd08018020 con 0x7fcd1015c6f0 2024-09-17T03:11:11.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.252+0000 7fccfeffd640 1 --2- 172.21.15.78:0/2009638112 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fccf0078b90 0x7fccf007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:11.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.252+0000 7fccfeffd640 1 -- 172.21.15.78:0/2009638112 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fcd0809ade0 con 0x7fcd1015c6f0 2024-09-17T03:11:11.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.252+0000 7fcd0e59c640 1 --2- 172.21.15.78:0/2009638112 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fccf0078b90 0x7fccf007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:11.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.253+0000 7fcd1ba0a740 1 Processor -- start 2024-09-17T03:11:11.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.253+0000 7fcd1ba0a740 1 -- start start 2024-09-17T03:11:11.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.253+0000 7fcd0e59c640 1 --2- 172.21.15.78:0/2009638112 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fccf0078b90 0x7fccf007b0a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcd00035000 tx=0x7fcd00004ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.254+0000 7fcd1ba0a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301d8390 0x5605305a9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.254+0000 7fcd1ba0a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301af4d0 0x5605305a9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.254+0000 7fcd1ba0a740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5605301b76b0 0x5605305c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.254+0000 7fcd1ba0a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5605304f2a60 con 0x5605301d8390 2024-09-17T03:11:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.254+0000 7fcd1ba0a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5605304e1e90 con 0x5605301af4d0 2024-09-17T03:11:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.254+0000 7fcd1ba0a740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5605304e5ca0 con 0x5605301b76b0 2024-09-17T03:11:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.254+0000 7fcd0e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301d8390 0x5605305a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.254+0000 7fcd0e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301d8390 0x5605305a9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36486/0 (socket says 172.21.15.78:36486) 2024-09-17T03:11:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.254+0000 7fcd0e59c640 1 -- 172.21.15.78:0/2915239041 learned_addr learned my addr 172.21.15.78:0/2915239041 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.254+0000 7fcd0ed9d640 1 --2- 172.21.15.78:0/2915239041 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5605301b76b0 0x5605305c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.254+0000 7fcd0dd9b640 1 --2- 172.21.15.78:0/2915239041 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301af4d0 0x5605305a9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.254+0000 7fcd0e59c640 1 -- 172.21.15.78:0/2915239041 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5605301b76b0 msgr2=0x5605305c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:11.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.254+0000 7fcd0e59c640 1 --2- 172.21.15.78:0/2915239041 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5605301b76b0 0x5605305c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.254+0000 7fcd0e59c640 1 -- 172.21.15.78:0/2915239041 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301af4d0 msgr2=0x5605305a9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.254+0000 7fcd0e59c640 1 --2- 172.21.15.78:0/2915239041 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301af4d0 0x5605305a9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.254+0000 7fcd0e59c640 1 -- 172.21.15.78:0/2915239041 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605302ba7d0 con 0x5605301d8390 2024-09-17T03:11:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.255+0000 7fcd0e59c640 1 --2- 172.21.15.78:0/2915239041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301d8390 0x5605305a9740 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fcd00005fd0 tx=0x7fcd00038050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f47d8316e7ac8e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.255+0000 7fcceffff640 1 -- 172.21.15.78:0/2915239041 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd000045c0 con 0x5605301d8390 2024-09-17T03:11:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.255+0000 7fcceffff640 1 -- 172.21.15.78:0/2915239041 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd00004850 con 0x5605301d8390 2024-09-17T03:11:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.255+0000 7fcceffff640 1 -- 172.21.15.78:0/2915239041 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0004e680 con 0x5605301d8390 2024-09-17T03:11:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.256+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/2915239041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301d8390 msgr2=0x5605305a9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.256+0000 7fcd1ba0a740 1 --2- 172.21.15.78:0/2915239041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301d8390 0x5605305a9740 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fcd00005fd0 tx=0x7fcd00038050 comp rx=0 tx=0).stop 2024-09-17T03:11:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.256+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/2915239041 shutdown_connections 2024-09-17T03:11:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.256+0000 7fcd1ba0a740 1 --2- 172.21.15.78:0/2915239041 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5605301b76b0 0x5605305c6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.256+0000 7fcd1ba0a740 1 --2- 172.21.15.78:0/2915239041 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301af4d0 0x5605305a9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.256+0000 7fcd1ba0a740 1 --2- 172.21.15.78:0/2915239041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301d8390 0x5605305a9740 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.256+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/2915239041 >> 172.21.15.78:0/2915239041 conn(0x5605301cc4e0 msgr2=0x56053057fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:11.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.256+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/2915239041 shutdown_connections 2024-09-17T03:11:11.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.256+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/2915239041 wait complete. 2024-09-17T03:11:11.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.257+0000 7fcd1ba0a740 1 -- start start 2024-09-17T03:11:11.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.257+0000 7fcd1ba0a740 1 Processor -- start 2024-09-17T03:11:11.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.258+0000 7fcd1ba0a740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5605301af4d0 0x5605305c6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:11.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.258+0000 7fcd1ba0a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301b76b0 0x5605305c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:11.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.258+0000 7fcd1ba0a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301d8390 0x5605305d3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:11.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.258+0000 7fcd1ba0a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x560530252740 con 0x5605301b76b0 2024-09-17T03:11:11.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.258+0000 7fcd1ba0a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560530487970 con 0x5605301d8390 2024-09-17T03:11:11.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.258+0000 7fcd1ba0a740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5605305aa1c0 con 0x5605301af4d0 2024-09-17T03:11:11.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.258+0000 7fcd1ba0a740 10 client.0 _ll_register_callbacks cb 0x56053048abe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:11.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.258+0000 7fcd0dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301b76b0 0x5605305c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:11.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.258+0000 7fcd0dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301b76b0 0x5605305c6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36500/0 (socket says 172.21.15.78:36500) 2024-09-17T03:11:11.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.258+0000 7fcd0dd9b640 1 -- 172.21.15.78:0/3780987546 learned_addr learned my addr 172.21.15.78:0/3780987546 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:11.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.259+0000 7fcd0ed9d640 1 --2- 172.21.15.78:0/3780987546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301d8390 0x5605305d3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:11.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.259+0000 7fcd0e59c640 1 --2- 172.21.15.78:0/3780987546 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5605301af4d0 0x5605305c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:11.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.259+0000 7fcd0dd9b640 1 -- 172.21.15.78:0/3780987546 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5605301af4d0 msgr2=0x5605305c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:11.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.259+0000 7fcd0dd9b640 1 --2- 172.21.15.78:0/3780987546 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5605301af4d0 0x5605305c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.259+0000 7fcd0dd9b640 1 -- 172.21.15.78:0/3780987546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301d8390 msgr2=0x5605305d3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:11.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.259+0000 7fcd0dd9b640 1 --2- 172.21.15.78:0/3780987546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301d8390 0x5605305d3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.259+0000 7fcd0dd9b640 1 -- 172.21.15.78:0/3780987546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560530243970 con 0x5605301b76b0 2024-09-17T03:11:11.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.259+0000 7fcd0ed9d640 1 --2- 172.21.15.78:0/3780987546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301d8390 0x5605305d3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:11.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.259+0000 7fcd0dd9b640 1 --2- 172.21.15.78:0/3780987546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301b76b0 0x5605305c6e40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fcd04003cf0 tx=0x7fcd04001590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36aa6f8a8458d8e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:11.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.259+0000 7fcced7fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:11.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.259+0000 7fcced7fa640 1 -- 172.21.15.78:0/3780987546 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04007030 con 0x5605301b76b0 2024-09-17T03:11:11.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.259+0000 7fcced7fa640 1 -- 172.21.15.78:0/3780987546 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fcd04010040 con 0x5605301b76b0 2024-09-17T03:11:11.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.259+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/3780987546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd00004850 con 0x5605301b76b0 2024-09-17T03:11:11.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.259+0000 7fcced7fa640 1 -- 172.21.15.78:0/3780987546 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fcd040071d0 con 0x5605301b76b0 2024-09-17T03:11:11.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.259+0000 7fcd1ba0a740 10 client.5991 fetch_fsmap learned FSMap version 38 2024-09-17T03:11:11.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.259+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/3780987546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x5605302216a0 con 0x5605301b76b0 2024-09-17T03:11:11.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.259+0000 7fcced7fa640 1 -- 172.21.15.78:0/3780987546 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd00004850 con 0x5605301b76b0 2024-09-17T03:11:11.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.259+0000 7fcced7fa640 1 -- 172.21.15.78:0/3780987546 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 38) ==== 3558+0+0 (secure 0 0 0) 0x7fcd04007370 con 0x5605301b76b0 2024-09-17T03:11:11.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.260+0000 7fcd1ba0a740 10 client.5991 fetch_fsmap finished waiting for FSMap version 38 2024-09-17T03:11:11.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.260+0000 7fcd1ba0a740 10 client.5991 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.d 2024-09-17T03:11:11.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.260+0000 7fcd1ba0a740 20 client.5991 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:11.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.260+0000 7fcd1ba0a740 1 --2- 172.21.15.78:0/3780987546 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x560530196f60 0x5605305bb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:11.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.260+0000 7fcd1ba0a740 4 client.5991 mds_command: new command op to 5039 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:11:11.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.260+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/3780987546 --> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605304f49b0 con 0x560530196f60 2024-09-17T03:11:11.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.260+0000 7fcd0e59c640 1 --2- 172.21.15.78:0/3780987546 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x560530196f60 0x5605305bb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:11.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.260+0000 7fcced7fa640 10 client.5991 ms_handle_connect on v2:172.21.15.193:6835/3209848332 2024-09-17T03:11:11.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.260+0000 7fcd0e59c640 1 --2- 172.21.15.78:0/3780987546 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x560530196f60 0x5605305bb750 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2e55297078d33ed8 server_cookie=5255446feeac736d in_seq=0 out_seq=0 2024-09-17T03:11:11.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.261+0000 7fcced7fa640 1 -- 172.21.15.78:0/3780987546 <== mds.1 v2:172.21.15.193:6835/3209848332 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5605304f49b0 con 0x560530196f60 2024-09-17T03:11:11.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.261+0000 7fcced7fa640 10 client.5991 handle_command_reply: tid=0 2024-09-17T03:11:11.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.261+0000 7fcd1ba0a740 1 client.5991 shutdown 2024-09-17T03:11:11.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.261+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/3780987546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301b76b0 msgr2=0x5605305c6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:11.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.261+0000 7fcd1ba0a740 1 --2- 172.21.15.78:0/3780987546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301b76b0 0x5605305c6e40 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fcd04003cf0 tx=0x7fcd04001590 comp rx=0 tx=0).stop 2024-09-17T03:11:11.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.261+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/3780987546 shutdown_connections 2024-09-17T03:11:11.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.261+0000 7fcd1ba0a740 1 --2- 172.21.15.78:0/3780987546 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x560530196f60 0x5605305bb750 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.261+0000 7fcd1ba0a740 1 --2- 172.21.15.78:0/3780987546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301d8390 0x5605305d3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.261+0000 7fcd1ba0a740 1 --2- 172.21.15.78:0/3780987546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301b76b0 0x5605305c6e40 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.261+0000 7fcd1ba0a740 1 --2- 172.21.15.78:0/3780987546 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5605301af4d0 0x5605305c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.261+0000 7fcced7fa640 0 client.5991 ms_handle_reset on v2:172.21.15.193:6835/3209848332 2024-09-17T03:11:11.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.261+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/3780987546 >> 172.21.15.78:0/3780987546 conn(0x5605301cc4e0 msgr2=0x5605305c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:11.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.262+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/3780987546 shutdown_connections 2024-09-17T03:11:11.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.262+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/3780987546 wait complete. 2024-09-17T03:11:11.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.262+0000 7fcd1ba0a740 20 client.5991 trim_cache size 0 max 16384 2024-09-17T03:11:11.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.279+0000 7fcd1ba0a740 1 Processor -- start 2024-09-17T03:11:11.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.279+0000 7fcd1ba0a740 1 -- start start 2024-09-17T03:11:11.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.280+0000 7fcd1ba0a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301af4d0 0x5605305c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:11.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.280+0000 7fcd1ba0a740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5605301b76b0 0x5605305a9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:11.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.280+0000 7fcd1ba0a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301d8390 0x5605305a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:11.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.280+0000 7fcd1ba0a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcd10202490 con 0x5605301af4d0 2024-09-17T03:11:11.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.280+0000 7fcd1ba0a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcd10201630 con 0x5605301d8390 2024-09-17T03:11:11.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.280+0000 7fcd1ba0a740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fcd10201d60 con 0x5605301b76b0 2024-09-17T03:11:11.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.281+0000 7fcd0e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301af4d0 0x5605305c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:11.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.281+0000 7fcd0e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301af4d0 0x5605305c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36504/0 (socket says 172.21.15.78:36504) 2024-09-17T03:11:11.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.281+0000 7fcd0e59c640 1 -- 172.21.15.78:0/2813416599 learned_addr learned my addr 172.21.15.78:0/2813416599 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:11.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.281+0000 7fcd0e59c640 1 -- 172.21.15.78:0/2813416599 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5605301b76b0 msgr2=0x5605305a9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:11.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.281+0000 7fcd0ed9d640 1 --2- 172.21.15.78:0/2813416599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301d8390 0x5605305a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:11.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.281+0000 7fcd0e59c640 1 --2- 172.21.15.78:0/2813416599 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5605301b76b0 0x5605305a9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.281+0000 7fcd0e59c640 1 -- 172.21.15.78:0/2813416599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301d8390 msgr2=0x5605305a98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:11.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.281+0000 7fcd0e59c640 1 --2- 172.21.15.78:0/2813416599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301d8390 0x5605305a98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.281+0000 7fcd0e59c640 1 -- 172.21.15.78:0/2813416599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605305ba8a0 con 0x5605301af4d0 2024-09-17T03:11:11.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.281+0000 7fcd0ed9d640 1 --2- 172.21.15.78:0/2813416599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301d8390 0x5605305a98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:11.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.281+0000 7fcd0e59c640 1 --2- 172.21.15.78:0/2813416599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301af4d0 0x5605305c6ad0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fcd00005fd0 tx=0x7fcd000095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a123e90bf64bd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:11.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.281+0000 7fccef7fe640 1 -- 172.21.15.78:0/2813416599 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0002ccd0 con 0x5605301af4d0 2024-09-17T03:11:11.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.281+0000 7fccef7fe640 1 -- 172.21.15.78:0/2813416599 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd0005b020 con 0x5605301af4d0 2024-09-17T03:11:11.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.281+0000 7fccef7fe640 1 -- 172.21.15.78:0/2813416599 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd000586a0 con 0x5605301af4d0 2024-09-17T03:11:11.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.282+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/2813416599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301af4d0 msgr2=0x5605305c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:11.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.282+0000 7fcd1ba0a740 1 --2- 172.21.15.78:0/2813416599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301af4d0 0x5605305c6ad0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fcd00005fd0 tx=0x7fcd000095c0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.282+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/2813416599 shutdown_connections 2024-09-17T03:11:11.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.282+0000 7fcd1ba0a740 1 --2- 172.21.15.78:0/2813416599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301d8390 0x5605305a98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.282+0000 7fcd1ba0a740 1 --2- 172.21.15.78:0/2813416599 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5605301b76b0 0x5605305a9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.282+0000 7fcd1ba0a740 1 --2- 172.21.15.78:0/2813416599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301af4d0 0x5605305c6ad0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.282+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/2813416599 >> 172.21.15.78:0/2813416599 conn(0x5605301cc4e0 msgr2=0x560530599350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:11.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.282+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/2813416599 shutdown_connections 2024-09-17T03:11:11.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.282+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/2813416599 wait complete. 2024-09-17T03:11:11.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.283+0000 7fcd1ba0a740 1 -- start start 2024-09-17T03:11:11.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.283+0000 7fcd1ba0a740 1 Processor -- start 2024-09-17T03:11:11.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.284+0000 7fcd1ba0a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301af4d0 0x5605305a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:11.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.284+0000 7fcd1ba0a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301b76b0 0x560530629d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:11.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.284+0000 7fcd1ba0a740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5605301d8390 0x5605305c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:11.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.284+0000 7fcd1ba0a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5605305976b0 con 0x5605301af4d0 2024-09-17T03:11:11.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.284+0000 7fcd1ba0a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcd101f6650 con 0x5605301b76b0 2024-09-17T03:11:11.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.284+0000 7fcd1ba0a740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5605305800a0 con 0x5605301d8390 2024-09-17T03:11:11.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.284+0000 7fcd1ba0a740 10 client.0 _ll_register_callbacks cb 0x7fcd04005050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:11.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.284+0000 7fcd0e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301af4d0 0x5605305a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:11.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.284+0000 7fcd0e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301af4d0 0x5605305a0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36518/0 (socket says 172.21.15.78:36518) 2024-09-17T03:11:11.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.284+0000 7fcd0e59c640 1 -- 172.21.15.78:0/1002901376 learned_addr learned my addr 172.21.15.78:0/1002901376 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:11.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.285+0000 7fcd0dd9b640 1 --2- 172.21.15.78:0/1002901376 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301b76b0 0x560530629d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:11.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.285+0000 7fcd0ed9d640 1 --2- 172.21.15.78:0/1002901376 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5605301d8390 0x5605305c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:11.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.285+0000 7fcd0e59c640 1 -- 172.21.15.78:0/1002901376 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5605301d8390 msgr2=0x5605305c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:11.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.285+0000 7fcd0e59c640 1 --2- 172.21.15.78:0/1002901376 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5605301d8390 0x5605305c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.285+0000 7fcd0e59c640 1 -- 172.21.15.78:0/1002901376 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301b76b0 msgr2=0x560530629d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:11.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.285+0000 7fcd0e59c640 1 --2- 172.21.15.78:0/1002901376 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301b76b0 0x560530629d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.285+0000 7fcd0e59c640 1 -- 172.21.15.78:0/1002901376 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605306486b0 con 0x5605301af4d0 2024-09-17T03:11:11.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.285+0000 7fcd0e59c640 1 --2- 172.21.15.78:0/1002901376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301af4d0 0x5605305a0e80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x5605305815d0 tx=0x7fcd00004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6083e5e764fbe70 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.285+0000 7fcced7fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.285+0000 7fcced7fa640 1 -- 172.21.15.78:0/1002901376 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0002ccd0 con 0x5605301af4d0 2024-09-17T03:11:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.285+0000 7fcced7fa640 1 -- 172.21.15.78:0/1002901376 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fcd00004d50 con 0x5605301af4d0 2024-09-17T03:11:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.285+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/1002901376 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd0005b020 con 0x5605301af4d0 2024-09-17T03:11:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.285+0000 7fcced7fa640 1 -- 172.21.15.78:0/1002901376 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fcd00004850 con 0x5605301af4d0 2024-09-17T03:11:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.285+0000 7fcd1ba0a740 10 client.5997 fetch_fsmap learned FSMap version 38 2024-09-17T03:11:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.285+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/1002901376 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x56053062a290 con 0x5605301af4d0 2024-09-17T03:11:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.285+0000 7fcced7fa640 1 -- 172.21.15.78:0/1002901376 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd0005b020 con 0x5605301af4d0 2024-09-17T03:11:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.285+0000 7fcced7fa640 1 -- 172.21.15.78:0/1002901376 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 38) ==== 3558+0+0 (secure 0 0 0) 0x7fcd00058440 con 0x5605301af4d0 2024-09-17T03:11:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.285+0000 7fcd1ba0a740 10 client.5997 fetch_fsmap finished waiting for FSMap version 38 2024-09-17T03:11:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.285+0000 7fcd1ba0a740 10 client.5997 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.d 2024-09-17T03:11:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.285+0000 7fcd1ba0a740 20 client.5997 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.286+0000 7fcd1ba0a740 1 --2- 172.21.15.78:0/1002901376 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x5605305d7c60 0x5605305c7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:11.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.286+0000 7fcd1ba0a740 4 client.5997 mds_command: new command op to 5039 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:11:11.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.286+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/1002901376 --> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5605304f0460 con 0x5605305d7c60 2024-09-17T03:11:11.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.286+0000 7fcd0dd9b640 1 --2- 172.21.15.78:0/1002901376 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x5605305d7c60 0x5605305c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:11.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.286+0000 7fcced7fa640 10 client.5997 ms_handle_connect on v2:172.21.15.193:6835/3209848332 2024-09-17T03:11:11.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.286+0000 7fcd0dd9b640 1 --2- 172.21.15.78:0/1002901376 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x5605305d7c60 0x5605305c7010 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4f710c62d00595b4 server_cookie=90e986e9e38d1dd4 in_seq=0 out_seq=0 2024-09-17T03:11:11.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcced7fa640 1 -- 172.21.15.78:0/1002901376 <== mds.1 v2:172.21.15.193:6835/3209848332 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x5605304f0460 con 0x5605305d7c60 2024-09-17T03:11:11.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcced7fa640 10 client.5997 handle_command_reply: tid=0 2024-09-17T03:11:11.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd1ba0a740 1 client.5997 shutdown 2024-09-17T03:11:11.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/1002901376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301af4d0 msgr2=0x5605305a0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:11.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd1ba0a740 1 --2- 172.21.15.78:0/1002901376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301af4d0 0x5605305a0e80 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x5605305815d0 tx=0x7fcd00004640 comp rx=0 tx=0).stop 2024-09-17T03:11:11.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/1002901376 shutdown_connections 2024-09-17T03:11:11.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd1ba0a740 1 --2- 172.21.15.78:0/1002901376 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x5605305d7c60 0x5605305c7010 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd1ba0a740 1 --2- 172.21.15.78:0/1002901376 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5605301d8390 0x5605305c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd1ba0a740 1 --2- 172.21.15.78:0/1002901376 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5605301b76b0 0x560530629d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd1ba0a740 1 --2- 172.21.15.78:0/1002901376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5605301af4d0 0x5605305a0e80 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcced7fa640 0 client.5997 ms_handle_reset on v2:172.21.15.193:6835/3209848332 2024-09-17T03:11:11.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/1002901376 >> 172.21.15.78:0/1002901376 conn(0x5605301cc4e0 msgr2=0x560530597fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:11.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/1002901376 shutdown_connections 2024-09-17T03:11:11.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd1ba0a740 1 -- 172.21.15.78:0/1002901376 wait complete. 2024-09-17T03:11:11.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd1ba0a740 20 client.5997 trim_cache size 0 max 16384 2024-09-17T03:11:11.291 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:11:11.291 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T03:11:11.291 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:11:11.291 INFO:teuthology.orchestra.run.smithi078.stdout: "8ebf2041-e471-4ebc-8443-f9f2c10aae14": { 2024-09-17T03:11:11.292 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:11:11.292 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "8ebf2041-e471-4ebc-8443-f9f2c10aae14", 2024-09-17T03:11:11.292 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:11:11.292 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:11.292 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:11.292 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:11:11.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd149c3640 1 -- 172.21.15.78:0/2009638112 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fccf0078b90 msgr2=0x7fccf007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:11.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd149c3640 1 --2- 172.21.15.78:0/2009638112 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fccf0078b90 0x7fccf007b0a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcd00035000 tx=0x7fcd00004ab0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd149c3640 1 -- 172.21.15.78:0/2009638112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd1015c6f0 msgr2=0x7fcd1014a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:11.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd149c3640 1 --2- 172.21.15.78:0/2009638112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd1015c6f0 0x7fcd1014a740 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fcd0800b410 tx=0x7fcd0800b8d0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd149c3640 1 -- 172.21.15.78:0/2009638112 shutdown_connections 2024-09-17T03:11:11.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd149c3640 1 --2- 172.21.15.78:0/2009638112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd1015c6f0 0x7fcd1014a740 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd149c3640 1 --2- 172.21.15.78:0/2009638112 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fccf0078b90 0x7fccf007b0a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd149c3640 1 --2- 172.21.15.78:0/2009638112 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd100d1d40 0x7fcd100c93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd149c3640 1 --2- 172.21.15.78:0/2009638112 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcd100ccba0 0x7fcd1015f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:11.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.287+0000 7fcd149c3640 1 -- 172.21.15.78:0/2009638112 >> 172.21.15.78:0/2009638112 conn(0x7fcd100b3f10 msgr2=0x7fcd1006f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:11.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.288+0000 7fcd149c3640 1 -- 172.21.15.78:0/2009638112 shutdown_connections 2024-09-17T03:11:11.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:11.288+0000 7fcd149c3640 1 -- 172.21.15.78:0/2009638112 wait complete. 2024-09-17T03:11:12.611 INFO:tasks.ceph.mon.a.smithi078.stderr:2024-09-17T03:11:12.612+0000 7f192d77d640 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-17T03:11:16.298 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:11:16.298 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:1 scrub status 2024-09-17T03:11:16.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.426+0000 7f7721c8b640 1 -- 172.21.15.78:0/2262984567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7704003a50 msgr2=0x7f7704003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.426+0000 7f7721c8b640 1 --2- 172.21.15.78:0/2262984567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7704003a50 0x7f7704003ec0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f770c009b50 tx=0x7f7704005830 comp rx=0 tx=0).stop 2024-09-17T03:11:16.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.426+0000 7f7721c8b640 1 -- 172.21.15.78:0/2262984567 shutdown_connections 2024-09-17T03:11:16.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.426+0000 7f7721c8b640 1 --2- 172.21.15.78:0/2262984567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7704003a50 0x7f7704003ec0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.426+0000 7f7721c8b640 1 -- 172.21.15.78:0/2262984567 >> 172.21.15.78:0/2262984567 conn(0x7f771c0cdcc0 msgr2=0x7f771c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:16.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.427+0000 7f7721c8b640 1 -- 172.21.15.78:0/2262984567 shutdown_connections 2024-09-17T03:11:16.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.427+0000 7f7721c8b640 1 -- 172.21.15.78:0/2262984567 wait complete. 2024-09-17T03:11:16.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.428+0000 7f7721c8b640 1 Processor -- start 2024-09-17T03:11:16.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.429+0000 7f7721c8b640 1 -- start start 2024-09-17T03:11:16.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.430+0000 7f7721c8b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7704003a50 0x7f771c159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.430+0000 7f7721c8b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f771c151000 0x7f771c06cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.430+0000 7f7721c8b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c151410 0x7f771c06d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.430+0000 7f7721c8b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f771c0702d0 con 0x7f771c151410 2024-09-17T03:11:16.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.430+0000 7f7721c8b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f771c0b3a30 con 0x7f771c151000 2024-09-17T03:11:16.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.430+0000 7f7721c8b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f771c070450 con 0x7f7704003a50 2024-09-17T03:11:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.430+0000 7f771bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c151410 0x7f771c06d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.430+0000 7f771bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c151410 0x7f771c06d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54402/0 (socket says 172.21.15.78:54402) 2024-09-17T03:11:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.430+0000 7f771bfff640 1 -- 172.21.15.78:0/675103445 learned_addr learned my addr 172.21.15.78:0/675103445 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.430+0000 7f771b7fe640 1 --2- 172.21.15.78:0/675103445 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7704003a50 0x7f771c159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.430+0000 7f771affd640 1 --2- 172.21.15.78:0/675103445 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f771c151000 0x7f771c06cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.430+0000 7f771bfff640 1 -- 172.21.15.78:0/675103445 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7704003a50 msgr2=0x7f771c159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.430+0000 7f771bfff640 1 --2- 172.21.15.78:0/675103445 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7704003a50 0x7f771c159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.430+0000 7f771bfff640 1 -- 172.21.15.78:0/675103445 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f771c151000 msgr2=0x7f771c06cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.430+0000 7f771bfff640 1 --2- 172.21.15.78:0/675103445 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f771c151000 0x7f771c06cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.430+0000 7f771bfff640 1 -- 172.21.15.78:0/675103445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771c159080 con 0x7f771c151410 2024-09-17T03:11:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.430+0000 7f771bfff640 1 --2- 172.21.15.78:0/675103445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c151410 0x7f771c06d320 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f771c15f2e0 tx=0x7f77140019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.431+0000 7f7703fff640 1 -- 172.21.15.78:0/675103445 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714011870 con 0x7f771c151410 2024-09-17T03:11:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.431+0000 7f7703fff640 1 -- 172.21.15.78:0/675103445 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7714017070 con 0x7f771c151410 2024-09-17T03:11:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.431+0000 7f7721c8b640 1 -- 172.21.15.78:0/675103445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f771c1582c0 con 0x7f771c151410 2024-09-17T03:11:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.431+0000 7f7703fff640 1 -- 172.21.15.78:0/675103445 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714011d60 con 0x7f771c151410 2024-09-17T03:11:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.431+0000 7f7721c8b640 1 -- 172.21.15.78:0/675103445 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f771c158880 con 0x7f771c151410 2024-09-17T03:11:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.433+0000 7f7703fff640 1 -- 172.21.15.78:0/675103445 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f771401c460 con 0x7f771c151410 2024-09-17T03:11:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.434+0000 7f7703fff640 1 --2- 172.21.15.78:0/675103445 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7708078b90 0x7f770807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.434+0000 7f7703fff640 1 -- 172.21.15.78:0/675103445 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f771409b3d0 con 0x7f771c151410 2024-09-17T03:11:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.434+0000 7f771b7fe640 1 --2- 172.21.15.78:0/675103445 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7708078b90 0x7f770807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.434+0000 7f7728bf9740 1 Processor -- start 2024-09-17T03:11:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.434+0000 7f7728bf9740 1 -- start start 2024-09-17T03:11:16.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.434+0000 7f771b7fe640 1 --2- 172.21.15.78:0/675103445 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7708078b90 0x7f770807b0a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f770c035000 tx=0x7f770c0046c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:16.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f7728bf9740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981fa3390 0x55998238fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f7728bf9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f7a4d0 0x559982364860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f7728bf9740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f826b0 0x559982364da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f7728bf9740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5599822bda60 con 0x559981fa3390 2024-09-17T03:11:16.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f7728bf9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5599822ace90 con 0x559981f7a4d0 2024-09-17T03:11:16.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f7728bf9740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5599822b0ca0 con 0x559981f826b0 2024-09-17T03:11:16.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f771b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981fa3390 0x55998238fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f771b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981fa3390 0x55998238fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54414/0 (socket says 172.21.15.78:54414) 2024-09-17T03:11:16.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f771b7fe640 1 -- 172.21.15.78:0/958906480 learned_addr learned my addr 172.21.15.78:0/958906480 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:16.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f771affd640 1 --2- 172.21.15.78:0/958906480 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f7a4d0 0x559982364860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f771bfff640 1 --2- 172.21.15.78:0/958906480 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f826b0 0x559982364da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f771b7fe640 1 -- 172.21.15.78:0/958906480 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f826b0 msgr2=0x559982364da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f771b7fe640 1 --2- 172.21.15.78:0/958906480 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f826b0 0x559982364da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f771b7fe640 1 -- 172.21.15.78:0/958906480 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f7a4d0 msgr2=0x559982364860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f771b7fe640 1 --2- 172.21.15.78:0/958906480 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f7a4d0 0x559982364860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f771b7fe640 1 -- 172.21.15.78:0/958906480 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599820857d0 con 0x559981fa3390 2024-09-17T03:11:16.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f771bfff640 1 --2- 172.21.15.78:0/958906480 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f826b0 0x559982364da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:16.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f771b7fe640 1 --2- 172.21.15.78:0/958906480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981fa3390 0x55998238fa10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f770c009c40 tx=0x7f770c03b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36f4641af208844 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:16.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f77017fa640 1 -- 172.21.15.78:0/958906480 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c038040 con 0x559981fa3390 2024-09-17T03:11:16.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f77017fa640 1 -- 172.21.15.78:0/958906480 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f770c04d070 con 0x559981fa3390 2024-09-17T03:11:16.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.436+0000 7f77017fa640 1 -- 172.21.15.78:0/958906480 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c03dc90 con 0x559981fa3390 2024-09-17T03:11:16.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.437+0000 7f7728bf9740 1 -- 172.21.15.78:0/958906480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981fa3390 msgr2=0x55998238fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.437+0000 7f7728bf9740 1 --2- 172.21.15.78:0/958906480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981fa3390 0x55998238fa10 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f770c009c40 tx=0x7f770c03b000 comp rx=0 tx=0).stop 2024-09-17T03:11:16.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.437+0000 7f7728bf9740 1 -- 172.21.15.78:0/958906480 shutdown_connections 2024-09-17T03:11:16.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.437+0000 7f7728bf9740 1 --2- 172.21.15.78:0/958906480 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f826b0 0x559982364da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.437+0000 7f7728bf9740 1 --2- 172.21.15.78:0/958906480 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f7a4d0 0x559982364860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.437+0000 7f7728bf9740 1 --2- 172.21.15.78:0/958906480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981fa3390 0x55998238fa10 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.437+0000 7f7728bf9740 1 -- 172.21.15.78:0/958906480 >> 172.21.15.78:0/958906480 conn(0x559981f974e0 msgr2=0x55998234ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:16.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.437+0000 7f7728bf9740 1 -- 172.21.15.78:0/958906480 shutdown_connections 2024-09-17T03:11:16.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.437+0000 7f7728bf9740 1 -- 172.21.15.78:0/958906480 wait complete. 2024-09-17T03:11:16.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.438+0000 7f7728bf9740 1 -- start start 2024-09-17T03:11:16.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.438+0000 7f7728bf9740 1 Processor -- start 2024-09-17T03:11:16.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f7728bf9740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f7a4d0 0x55998238b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f7728bf9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f826b0 0x559982352dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f7728bf9740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981fa3390 0x559982353310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f7728bf9740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55998201d740 con 0x559981fa3390 2024-09-17T03:11:16.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f7728bf9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559982252970 con 0x559981f826b0 2024-09-17T03:11:16.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f7728bf9740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5599823899c0 con 0x559981f7a4d0 2024-09-17T03:11:16.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f7728bf9740 10 client.0 _ll_register_callbacks cb 0x559982261780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:16.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f771bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981fa3390 0x559982353310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f771bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981fa3390 0x559982353310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54424/0 (socket says 172.21.15.78:54424) 2024-09-17T03:11:16.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f771bfff640 1 -- 172.21.15.78:0/3624793027 learned_addr learned my addr 172.21.15.78:0/3624793027 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:16.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f771affd640 1 --2- 172.21.15.78:0/3624793027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f826b0 0x559982352dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f771b7fe640 1 --2- 172.21.15.78:0/3624793027 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f7a4d0 0x55998238b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f771bfff640 1 -- 172.21.15.78:0/3624793027 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f7a4d0 msgr2=0x55998238b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f771bfff640 1 --2- 172.21.15.78:0/3624793027 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f7a4d0 0x55998238b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f771bfff640 1 -- 172.21.15.78:0/3624793027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f826b0 msgr2=0x559982352dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f771bfff640 1 --2- 172.21.15.78:0/3624793027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f826b0 0x559982352dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f771bfff640 1 -- 172.21.15.78:0/3624793027 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55998200e970 con 0x559981fa3390 2024-09-17T03:11:16.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f771bfff640 1 --2- 172.21.15.78:0/3624793027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981fa3390 0x559982353310 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7714062f10 tx=0x7f7714062c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f21df56952020c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:16.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f76fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:16.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f76fa7fc640 1 -- 172.21.15.78:0/3624793027 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7714067c40 con 0x559981fa3390 2024-09-17T03:11:16.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f76fa7fc640 1 -- 172.21.15.78:0/3624793027 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f7714062470 con 0x559981fa3390 2024-09-17T03:11:16.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.440+0000 7f7728bf9740 1 -- 172.21.15.78:0/3624793027 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f770c04d070 con 0x559981fa3390 2024-09-17T03:11:16.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.441+0000 7f76fa7fc640 1 -- 172.21.15.78:0/3624793027 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f771406caf0 con 0x559981fa3390 2024-09-17T03:11:16.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.441+0000 7f7728bf9740 10 client.6009 fetch_fsmap learned FSMap version 38 2024-09-17T03:11:16.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.441+0000 7f7728bf9740 1 -- 172.21.15.78:0/3624793027 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x559981fec6a0 con 0x559981fa3390 2024-09-17T03:11:16.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.441+0000 7f76fa7fc640 1 -- 172.21.15.78:0/3624793027 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f770c04d070 con 0x559981fa3390 2024-09-17T03:11:16.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.441+0000 7f76fa7fc640 1 -- 172.21.15.78:0/3624793027 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 38) ==== 3558+0+0 (secure 0 0 0) 0x7f7714099ce0 con 0x559981fa3390 2024-09-17T03:11:16.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.441+0000 7f7728bf9740 10 client.6009 fetch_fsmap finished waiting for FSMap version 38 2024-09-17T03:11:16.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.441+0000 7f7728bf9740 10 client.6009 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.d 2024-09-17T03:11:16.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.441+0000 7f7728bf9740 20 client.6009 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:16.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.441+0000 7f7728bf9740 1 --2- 172.21.15.78:0/3624793027 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x559981f61f60 0x5599823587d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.441+0000 7f7728bf9740 4 client.6009 mds_command: new command op to 5039 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:11:16.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.441+0000 7f7728bf9740 1 -- 172.21.15.78:0/3624793027 --> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599822bf9b0 con 0x559981f61f60 2024-09-17T03:11:16.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.441+0000 7f771b7fe640 1 --2- 172.21.15.78:0/3624793027 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x559981f61f60 0x5599823587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.442+0000 7f771b7fe640 1 --2- 172.21.15.78:0/3624793027 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x559981f61f60 0x5599823587d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f5fedf7b080c5905 server_cookie=2de08811a888fbea in_seq=0 out_seq=0 2024-09-17T03:11:16.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.442+0000 7f76fa7fc640 10 client.6009 ms_handle_connect on v2:172.21.15.193:6835/3209848332 2024-09-17T03:11:16.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.442+0000 7f76fa7fc640 1 -- 172.21.15.78:0/3624793027 <== mds.1 v2:172.21.15.193:6835/3209848332 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5599822bf9b0 con 0x559981f61f60 2024-09-17T03:11:16.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.442+0000 7f76fa7fc640 10 client.6009 handle_command_reply: tid=0 2024-09-17T03:11:16.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.442+0000 7f7728bf9740 1 client.6009 shutdown 2024-09-17T03:11:16.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.442+0000 7f7728bf9740 1 -- 172.21.15.78:0/3624793027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981fa3390 msgr2=0x559982353310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.442+0000 7f7728bf9740 1 --2- 172.21.15.78:0/3624793027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981fa3390 0x559982353310 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7714062f10 tx=0x7f7714062c20 comp rx=0 tx=0).stop 2024-09-17T03:11:16.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.442+0000 7f7728bf9740 1 -- 172.21.15.78:0/3624793027 shutdown_connections 2024-09-17T03:11:16.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.442+0000 7f7728bf9740 1 --2- 172.21.15.78:0/3624793027 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x559981f61f60 0x5599823587d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.442+0000 7f7728bf9740 1 --2- 172.21.15.78:0/3624793027 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981fa3390 0x559982353310 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.442+0000 7f76fa7fc640 0 client.6009 ms_handle_reset on v2:172.21.15.193:6835/3209848332 2024-09-17T03:11:16.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.442+0000 7f7728bf9740 1 --2- 172.21.15.78:0/3624793027 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f826b0 0x559982352dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.442+0000 7f7728bf9740 1 --2- 172.21.15.78:0/3624793027 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f7a4d0 0x55998238b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.443+0000 7f7728bf9740 1 -- 172.21.15.78:0/3624793027 >> 172.21.15.78:0/3624793027 conn(0x559981f974e0 msgr2=0x559982345a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:16.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.443+0000 7f7728bf9740 1 -- 172.21.15.78:0/3624793027 shutdown_connections 2024-09-17T03:11:16.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.443+0000 7f7728bf9740 1 -- 172.21.15.78:0/3624793027 wait complete. 2024-09-17T03:11:16.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.443+0000 7f7728bf9740 20 client.6009 trim_cache size 0 max 16384 2024-09-17T03:11:16.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.460+0000 7f7728bf9740 1 Processor -- start 2024-09-17T03:11:16.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.460+0000 7f7728bf9740 1 -- start start 2024-09-17T03:11:16.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f7728bf9740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981f61f60 0x559982345c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f7728bf9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f7a4d0 0x5599823b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f7728bf9740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f826b0 0x5599823b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f7728bf9740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f771c202980 con 0x559981f61f60 2024-09-17T03:11:16.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f7728bf9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f771c201b20 con 0x559981f7a4d0 2024-09-17T03:11:16.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f7728bf9740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f771c202250 con 0x559981f826b0 2024-09-17T03:11:16.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f771b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981f61f60 0x559982345c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f771b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981f61f60 0x559982345c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54426/0 (socket says 172.21.15.78:54426) 2024-09-17T03:11:16.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f771b7fe640 1 -- 172.21.15.78:0/2172828685 learned_addr learned my addr 172.21.15.78:0/2172828685 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:16.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f771affd640 1 --2- 172.21.15.78:0/2172828685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f7a4d0 0x5599823b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f771bfff640 1 --2- 172.21.15.78:0/2172828685 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f826b0 0x5599823b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f771b7fe640 1 -- 172.21.15.78:0/2172828685 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f826b0 msgr2=0x5599823b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f771b7fe640 1 --2- 172.21.15.78:0/2172828685 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f826b0 0x5599823b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f771b7fe640 1 -- 172.21.15.78:0/2172828685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f7a4d0 msgr2=0x5599823b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f771b7fe640 1 --2- 172.21.15.78:0/2172828685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f7a4d0 0x5599823b38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f771b7fe640 1 -- 172.21.15.78:0/2172828685 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559982347860 con 0x559981f61f60 2024-09-17T03:11:16.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f771affd640 1 --2- 172.21.15.78:0/2172828685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f7a4d0 0x5599823b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:16.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f771bfff640 1 --2- 172.21.15.78:0/2172828685 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f826b0 0x5599823b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:16.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f771b7fe640 1 --2- 172.21.15.78:0/2172828685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981f61f60 0x559982345c10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f770c009c70 tx=0x7f770c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a51f6afccee1dff server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:16.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f7700ff9640 1 -- 172.21.15.78:0/2172828685 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c05a070 con 0x559981f61f60 2024-09-17T03:11:16.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f7700ff9640 1 -- 172.21.15.78:0/2172828685 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f770c04d040 con 0x559981f61f60 2024-09-17T03:11:16.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.462+0000 7f7700ff9640 1 -- 172.21.15.78:0/2172828685 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f770c038040 con 0x559981f61f60 2024-09-17T03:11:16.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.463+0000 7f7728bf9740 1 -- 172.21.15.78:0/2172828685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981f61f60 msgr2=0x559982345c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.463+0000 7f7728bf9740 1 --2- 172.21.15.78:0/2172828685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981f61f60 0x559982345c10 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f770c009c70 tx=0x7f770c005f90 comp rx=0 tx=0).stop 2024-09-17T03:11:16.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.463+0000 7f7728bf9740 1 -- 172.21.15.78:0/2172828685 shutdown_connections 2024-09-17T03:11:16.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.463+0000 7f7728bf9740 1 --2- 172.21.15.78:0/2172828685 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f826b0 0x5599823b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.463+0000 7f7728bf9740 1 --2- 172.21.15.78:0/2172828685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f7a4d0 0x5599823b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.463+0000 7f7728bf9740 1 --2- 172.21.15.78:0/2172828685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981f61f60 0x559982345c10 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.463+0000 7f7728bf9740 1 -- 172.21.15.78:0/2172828685 >> 172.21.15.78:0/2172828685 conn(0x559981f974e0 msgr2=0x55998234aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:16.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.463+0000 7f7728bf9740 1 -- 172.21.15.78:0/2172828685 shutdown_connections 2024-09-17T03:11:16.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.463+0000 7f7728bf9740 1 -- 172.21.15.78:0/2172828685 wait complete. 2024-09-17T03:11:16.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.464+0000 7f7728bf9740 1 -- start start 2024-09-17T03:11:16.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.464+0000 7f7728bf9740 1 Processor -- start 2024-09-17T03:11:16.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.465+0000 7f7728bf9740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f61f60 0x55998240da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.465+0000 7f7728bf9740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f7a4d0 0x5599823a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.465+0000 7f7728bf9740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981f826b0 0x5599823a1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.465+0000 7f7728bf9740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f771c0b82e0 con 0x559981f826b0 2024-09-17T03:11:16.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.465+0000 7f7728bf9740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559982388a80 con 0x559981f7a4d0 2024-09-17T03:11:16.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.465+0000 7f7728bf9740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x559982340780 con 0x559981f61f60 2024-09-17T03:11:16.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.465+0000 7f7728bf9740 10 client.0 _ll_register_callbacks cb 0x7f7714062fe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:16.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.465+0000 7f771bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981f826b0 0x5599823a1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.465+0000 7f771bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981f826b0 0x5599823a1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54434/0 (socket says 172.21.15.78:54434) 2024-09-17T03:11:16.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.465+0000 7f771bfff640 1 -- 172.21.15.78:0/2250524516 learned_addr learned my addr 172.21.15.78:0/2250524516 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:16.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.465+0000 7f771b7fe640 1 --2- 172.21.15.78:0/2250524516 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f61f60 0x55998240da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.465+0000 7f771affd640 1 --2- 172.21.15.78:0/2250524516 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f7a4d0 0x5599823a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f771bfff640 1 -- 172.21.15.78:0/2250524516 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f61f60 msgr2=0x55998240da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f771bfff640 1 --2- 172.21.15.78:0/2250524516 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f61f60 0x55998240da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f771bfff640 1 -- 172.21.15.78:0/2250524516 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f7a4d0 msgr2=0x5599823a0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f771bfff640 1 --2- 172.21.15.78:0/2250524516 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f7a4d0 0x5599823a0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f771bfff640 1 -- 172.21.15.78:0/2250524516 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55998238c350 con 0x559981f826b0 2024-09-17T03:11:16.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f771bfff640 1 --2- 172.21.15.78:0/2250524516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981f826b0 0x5599823a1190 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f771405f9d0 tx=0x7f7714011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9cafb4d73490eda server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:16.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f76fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:16.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f76fa7fc640 1 -- 172.21.15.78:0/2250524516 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771407d3f0 con 0x559981f826b0 2024-09-17T03:11:16.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f76fa7fc640 1 -- 172.21.15.78:0/2250524516 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f771409b070 con 0x559981f826b0 2024-09-17T03:11:16.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f7728bf9740 1 -- 172.21.15.78:0/2250524516 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f770c04d040 con 0x559981f826b0 2024-09-17T03:11:16.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f76fa7fc640 1 -- 172.21.15.78:0/2250524516 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f7714067c40 con 0x559981f826b0 2024-09-17T03:11:16.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f7728bf9740 10 client.6015 fetch_fsmap learned FSMap version 38 2024-09-17T03:11:16.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f7728bf9740 1 -- 172.21.15.78:0/2250524516 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x559982351440 con 0x559981f826b0 2024-09-17T03:11:16.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f76fa7fc640 1 -- 172.21.15.78:0/2250524516 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f770c04d040 con 0x559981f826b0 2024-09-17T03:11:16.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f76fa7fc640 1 -- 172.21.15.78:0/2250524516 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 38) ==== 3558+0+0 (secure 0 0 0) 0x7f7714099ce0 con 0x559981f826b0 2024-09-17T03:11:16.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f7728bf9740 10 client.6015 fetch_fsmap finished waiting for FSMap version 38 2024-09-17T03:11:16.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f7728bf9740 10 client.6015 resolve_mds: resolved 3:1 to role '3:1' aka daemon mds.d 2024-09-17T03:11:16.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f7728bf9740 20 client.6015 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:16.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f7728bf9740 1 --2- 172.21.15.78:0/2250524516 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x559981f373a0 0x55998234eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f7728bf9740 4 client.6015 mds_command: new command op to 5039 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:11:16.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.466+0000 7f7728bf9740 1 -- 172.21.15.78:0/2250524516 --> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5599822bb460 con 0x559981f373a0 2024-09-17T03:11:16.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.467+0000 7f771b7fe640 1 --2- 172.21.15.78:0/2250524516 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x559981f373a0 0x55998234eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.467+0000 7f771b7fe640 1 --2- 172.21.15.78:0/2250524516 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x559981f373a0 0x55998234eeb0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4d0681c298495f54 server_cookie=1b45ece7aa7190b1 in_seq=0 out_seq=0 2024-09-17T03:11:16.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.467+0000 7f76fa7fc640 10 client.6015 ms_handle_connect on v2:172.21.15.193:6835/3209848332 2024-09-17T03:11:16.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.467+0000 7f76fa7fc640 1 -- 172.21.15.78:0/2250524516 <== mds.1 v2:172.21.15.193:6835/3209848332 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5599822bb460 con 0x559981f373a0 2024-09-17T03:11:16.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.467+0000 7f76fa7fc640 10 client.6015 handle_command_reply: tid=0 2024-09-17T03:11:16.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.467+0000 7f7728bf9740 1 client.6015 shutdown 2024-09-17T03:11:16.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.467+0000 7f7728bf9740 1 -- 172.21.15.78:0/2250524516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981f826b0 msgr2=0x5599823a1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.467+0000 7f7728bf9740 1 --2- 172.21.15.78:0/2250524516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981f826b0 0x5599823a1190 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f771405f9d0 tx=0x7f7714011f00 comp rx=0 tx=0).stop 2024-09-17T03:11:16.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.467+0000 7f7728bf9740 1 -- 172.21.15.78:0/2250524516 shutdown_connections 2024-09-17T03:11:16.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.467+0000 7f7728bf9740 1 --2- 172.21.15.78:0/2250524516 >> [v2:172.21.15.193:6835/3209848332,v1:172.21.15.193:6837/3209848332] conn(0x559981f373a0 0x55998234eeb0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.467+0000 7f7728bf9740 1 --2- 172.21.15.78:0/2250524516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559981f826b0 0x5599823a1190 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.467+0000 7f76fa7fc640 0 client.6015 ms_handle_reset on v2:172.21.15.193:6835/3209848332 2024-09-17T03:11:16.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.467+0000 7f7728bf9740 1 --2- 172.21.15.78:0/2250524516 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559981f7a4d0 0x5599823a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.467+0000 7f7728bf9740 1 --2- 172.21.15.78:0/2250524516 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559981f61f60 0x55998240da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.467+0000 7f7728bf9740 1 -- 172.21.15.78:0/2250524516 >> 172.21.15.78:0/2250524516 conn(0x559981f974e0 msgr2=0x55998234aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:16.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.467+0000 7f7728bf9740 1 -- 172.21.15.78:0/2250524516 shutdown_connections 2024-09-17T03:11:16.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.467+0000 7f7728bf9740 1 -- 172.21.15.78:0/2250524516 wait complete. 2024-09-17T03:11:16.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.468+0000 7f7728bf9740 20 client.6015 trim_cache size 0 max 16384 2024-09-17T03:11:16.474 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:11:16.474 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-17T03:11:16.474 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {} 2024-09-17T03:11:16.474 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:11:16.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.468+0000 7f7721c8b640 1 -- 172.21.15.78:0/675103445 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7708078b90 msgr2=0x7f770807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.468+0000 7f7721c8b640 1 --2- 172.21.15.78:0/675103445 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7708078b90 0x7f770807b0a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f770c035000 tx=0x7f770c0046c0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.468+0000 7f7721c8b640 1 -- 172.21.15.78:0/675103445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c151410 msgr2=0x7f771c06d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.468+0000 7f7721c8b640 1 --2- 172.21.15.78:0/675103445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c151410 0x7f771c06d320 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f771c15f2e0 tx=0x7f77140019b0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.468+0000 7f7721c8b640 1 -- 172.21.15.78:0/675103445 shutdown_connections 2024-09-17T03:11:16.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.468+0000 7f7721c8b640 1 --2- 172.21.15.78:0/675103445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f771c151410 0x7f771c06d320 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.468+0000 7f7721c8b640 1 --2- 172.21.15.78:0/675103445 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7708078b90 0x7f770807b0a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.468+0000 7f7721c8b640 1 --2- 172.21.15.78:0/675103445 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f771c151000 0x7f771c06cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.468+0000 7f7721c8b640 1 --2- 172.21.15.78:0/675103445 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7704003a50 0x7f771c159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.468+0000 7f7721c8b640 1 -- 172.21.15.78:0/675103445 >> 172.21.15.78:0/675103445 conn(0x7f771c0cdcc0 msgr2=0x7f771c0b0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:16.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.468+0000 7f7721c8b640 1 -- 172.21.15.78:0/675103445 shutdown_connections 2024-09-17T03:11:16.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.468+0000 7f7721c8b640 1 -- 172.21.15.78:0/675103445 wait complete. 2024-09-17T03:11:16.478 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:11:16.478 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:11:16.478 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:2 scrub status 2024-09-17T03:11:16.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.595+0000 7f577cd9d640 1 -- 172.21.15.78:0/3127285105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57780ccc30 msgr2=0x7f57780cec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.595+0000 7f577cd9d640 1 --2- 172.21.15.78:0/3127285105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57780ccc30 0x7f57780cec70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5768005fd0 tx=0x7f576802aa10 comp rx=0 tx=0).stop 2024-09-17T03:11:16.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.595+0000 7f577cd9d640 1 -- 172.21.15.78:0/3127285105 shutdown_connections 2024-09-17T03:11:16.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.595+0000 7f577cd9d640 1 --2- 172.21.15.78:0/3127285105 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f57780ce640 0x7f57780cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.595+0000 7f577cd9d640 1 --2- 172.21.15.78:0/3127285105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57780ccc30 0x7f57780cec70 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.595+0000 7f577cd9d640 1 -- 172.21.15.78:0/3127285105 >> 172.21.15.78:0/3127285105 conn(0x7f57780cdb20 msgr2=0x7f57780cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:16.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.595+0000 7f577cd9d640 1 -- 172.21.15.78:0/3127285105 shutdown_connections 2024-09-17T03:11:16.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.595+0000 7f577cd9d640 1 -- 172.21.15.78:0/3127285105 wait complete. 2024-09-17T03:11:16.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.596+0000 7f577cd9d640 1 Processor -- start 2024-09-17T03:11:16.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.597+0000 7f577cd9d640 1 -- start start 2024-09-17T03:11:16.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.598+0000 7f577cd9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57780cbc30 0x7f57780c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.598+0000 7f577cd9d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f57780ccc30 0x7f5778153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.598+0000 7f577cd9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57780ce640 0x7f577806cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.598+0000 7f577cd9d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f57780cd6e0 con 0x7f57780ce640 2024-09-17T03:11:16.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.598+0000 7f577cd9d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5778159380 con 0x7f57780cbc30 2024-09-17T03:11:16.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.598+0000 7f577cd9d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5778071f70 con 0x7f57780ccc30 2024-09-17T03:11:16.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.598+0000 7f5777fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57780ce640 0x7f577806cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.598+0000 7f5777fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57780ce640 0x7f577806cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54458/0 (socket says 172.21.15.78:54458) 2024-09-17T03:11:16.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.598+0000 7f5777fff640 1 -- 172.21.15.78:0/3149928482 learned_addr learned my addr 172.21.15.78:0/3149928482 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:16.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.598+0000 7f5776ffd640 1 --2- 172.21.15.78:0/3149928482 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f57780ccc30 0x7f5778153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.598+0000 7f57777fe640 1 --2- 172.21.15.78:0/3149928482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57780cbc30 0x7f57780c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.598+0000 7f5777fff640 1 -- 172.21.15.78:0/3149928482 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f57780ccc30 msgr2=0x7f5778153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.598+0000 7f5777fff640 1 --2- 172.21.15.78:0/3149928482 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f57780ccc30 0x7f5778153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.598+0000 7f5777fff640 1 -- 172.21.15.78:0/3149928482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57780cbc30 msgr2=0x7f57780c7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.598+0000 7f5777fff640 1 --2- 172.21.15.78:0/3149928482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57780cbc30 0x7f57780c7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.598+0000 7f5777fff640 1 -- 172.21.15.78:0/3149928482 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5778156920 con 0x7f57780ce640 2024-09-17T03:11:16.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.598+0000 7f57777fe640 1 --2- 172.21.15.78:0/3149928482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57780cbc30 0x7f57780c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:16.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.598+0000 7f5776ffd640 1 --2- 172.21.15.78:0/3149928482 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f57780ccc30 0x7f5778153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:16.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.599+0000 7f5777fff640 1 --2- 172.21.15.78:0/3149928482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57780ce640 0x7f577806cde0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f577000c3c0 tx=0x7f577000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:16.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.599+0000 7f575ffff640 1 -- 172.21.15.78:0/3149928482 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770017070 con 0x7f57780ce640 2024-09-17T03:11:16.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.599+0000 7f575ffff640 1 -- 172.21.15.78:0/3149928482 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57700053c0 con 0x7f57780ce640 2024-09-17T03:11:16.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.599+0000 7f577cd9d640 1 -- 172.21.15.78:0/3149928482 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5778156c00 con 0x7f57780ce640 2024-09-17T03:11:16.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.599+0000 7f575ffff640 1 -- 172.21.15.78:0/3149928482 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770003850 con 0x7f57780ce640 2024-09-17T03:11:16.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.599+0000 7f577cd9d640 1 -- 172.21.15.78:0/3149928482 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57780c78d0 con 0x7f57780ce640 2024-09-17T03:11:16.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.601+0000 7f575ffff640 1 -- 172.21.15.78:0/3149928482 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f577001a070 con 0x7f57780ce640 2024-09-17T03:11:16.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.601+0000 7f575ffff640 1 --2- 172.21.15.78:0/3149928482 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5764078b90 0x7f576407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.601+0000 7f575ffff640 1 -- 172.21.15.78:0/3149928482 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f577009a130 con 0x7f57780ce640 2024-09-17T03:11:16.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.601+0000 7f57777fe640 1 --2- 172.21.15.78:0/3149928482 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5764078b90 0x7f576407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.602+0000 7f5785043740 1 Processor -- start 2024-09-17T03:11:16.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.602+0000 7f57777fe640 1 --2- 172.21.15.78:0/3149928482 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5764078b90 0x7f576407b0a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5768035000 tx=0x7f5768004ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:16.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.602+0000 7f5785043740 1 -- start start 2024-09-17T03:11:16.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.603+0000 7f5785043740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c137390 0x56039c523c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.603+0000 7f5785043740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c10e4d0 0x56039c4f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.603+0000 7f5785043740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c1166b0 0x56039c4f8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.603+0000 7f5785043740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56039c451a60 con 0x56039c1166b0 2024-09-17T03:11:16.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.603+0000 7f5785043740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56039c440e90 con 0x56039c10e4d0 2024-09-17T03:11:16.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.603+0000 7f5785043740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x56039c444ca0 con 0x56039c137390 2024-09-17T03:11:16.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.603+0000 7f5777fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c1166b0 0x56039c4f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.604+0000 7f5777fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c1166b0 0x56039c4f8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54460/0 (socket says 172.21.15.78:54460) 2024-09-17T03:11:16.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.604+0000 7f5777fff640 1 -- 172.21.15.78:0/4093196017 learned_addr learned my addr 172.21.15.78:0/4093196017 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:16.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.604+0000 7f57777fe640 1 --2- 172.21.15.78:0/4093196017 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c137390 0x56039c523c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.604+0000 7f5776ffd640 1 --2- 172.21.15.78:0/4093196017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c10e4d0 0x56039c4f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.604+0000 7f5777fff640 1 -- 172.21.15.78:0/4093196017 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c137390 msgr2=0x56039c523c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.604+0000 7f5777fff640 1 --2- 172.21.15.78:0/4093196017 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c137390 0x56039c523c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.604+0000 7f5777fff640 1 -- 172.21.15.78:0/4093196017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c10e4d0 msgr2=0x56039c4f8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.604+0000 7f5777fff640 1 --2- 172.21.15.78:0/4093196017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c10e4d0 0x56039c4f8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.604+0000 7f5777fff640 1 -- 172.21.15.78:0/4093196017 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56039c2197d0 con 0x56039c1166b0 2024-09-17T03:11:16.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.604+0000 7f5776ffd640 1 --2- 172.21.15.78:0/4093196017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c10e4d0 0x56039c4f8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:16.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.604+0000 7f5777fff640 1 --2- 172.21.15.78:0/4093196017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c1166b0 0x56039c4f8fa0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5770061f20 tx=0x7f5770061700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad79dfb502b70874 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:16.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.604+0000 7f575d7fa640 1 -- 172.21.15.78:0/4093196017 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770061f90 con 0x56039c1166b0 2024-09-17T03:11:16.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.604+0000 7f575d7fa640 1 -- 172.21.15.78:0/4093196017 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5770066a70 con 0x56039c1166b0 2024-09-17T03:11:16.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.604+0000 7f575d7fa640 1 -- 172.21.15.78:0/4093196017 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770084310 con 0x56039c1166b0 2024-09-17T03:11:16.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.605+0000 7f5785043740 1 -- 172.21.15.78:0/4093196017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c1166b0 msgr2=0x56039c4f8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.605+0000 7f5785043740 1 --2- 172.21.15.78:0/4093196017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c1166b0 0x56039c4f8fa0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5770061f20 tx=0x7f5770061700 comp rx=0 tx=0).stop 2024-09-17T03:11:16.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.605+0000 7f5785043740 1 -- 172.21.15.78:0/4093196017 shutdown_connections 2024-09-17T03:11:16.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.605+0000 7f5785043740 1 --2- 172.21.15.78:0/4093196017 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c1166b0 0x56039c4f8fa0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.605+0000 7f5785043740 1 --2- 172.21.15.78:0/4093196017 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c10e4d0 0x56039c4f8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.605+0000 7f5785043740 1 --2- 172.21.15.78:0/4093196017 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c137390 0x56039c523c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.605+0000 7f5785043740 1 -- 172.21.15.78:0/4093196017 >> 172.21.15.78:0/4093196017 conn(0x56039c12b4e0 msgr2=0x56039c4def00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:16.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.605+0000 7f5785043740 1 -- 172.21.15.78:0/4093196017 shutdown_connections 2024-09-17T03:11:16.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.605+0000 7f5785043740 1 -- 172.21.15.78:0/4093196017 wait complete. 2024-09-17T03:11:16.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.606+0000 7f5785043740 1 -- start start 2024-09-17T03:11:16.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.606+0000 7f5785043740 1 Processor -- start 2024-09-17T03:11:16.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.607+0000 7f5785043740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c10e4d0 0x56039c51a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.607+0000 7f5785043740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c1166b0 0x56039c536790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.607+0000 7f5785043740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c137390 0x56039c536cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.607+0000 7f5785043740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56039c1b1740 con 0x56039c1166b0 2024-09-17T03:11:16.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.607+0000 7f5785043740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56039c3e6970 con 0x56039c137390 2024-09-17T03:11:16.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.607+0000 7f5785043740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x56039c51fd40 con 0x56039c10e4d0 2024-09-17T03:11:16.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.607+0000 7f5785043740 10 client.0 _ll_register_callbacks cb 0x56039c3f5780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:16.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.607+0000 7f5776ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c1166b0 0x56039c536790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.607+0000 7f5776ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c1166b0 0x56039c536790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54466/0 (socket says 172.21.15.78:54466) 2024-09-17T03:11:16.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.607+0000 7f5776ffd640 1 -- 172.21.15.78:0/2454630826 learned_addr learned my addr 172.21.15.78:0/2454630826 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:16.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.607+0000 7f57777fe640 1 --2- 172.21.15.78:0/2454630826 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c10e4d0 0x56039c51a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.607+0000 7f5777fff640 1 --2- 172.21.15.78:0/2454630826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c137390 0x56039c536cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f5776ffd640 1 -- 172.21.15.78:0/2454630826 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c10e4d0 msgr2=0x56039c51a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f5776ffd640 1 --2- 172.21.15.78:0/2454630826 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c10e4d0 0x56039c51a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f5776ffd640 1 -- 172.21.15.78:0/2454630826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c137390 msgr2=0x56039c536cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f5776ffd640 1 --2- 172.21.15.78:0/2454630826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c137390 0x56039c536cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f5776ffd640 1 -- 172.21.15.78:0/2454630826 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56039c1a2970 con 0x56039c1166b0 2024-09-17T03:11:16.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f5776ffd640 1 --2- 172.21.15.78:0/2454630826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c1166b0 0x56039c536790 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f576c00df00 tx=0x7f576c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade1e71edc946b83 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:16.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f57567fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:16.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f57567fc640 1 -- 172.21.15.78:0/2454630826 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f576c012650 con 0x56039c1166b0 2024-09-17T03:11:16.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f57567fc640 1 -- 172.21.15.78:0/2454630826 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f576c01cb20 con 0x56039c1166b0 2024-09-17T03:11:16.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f5785043740 1 -- 172.21.15.78:0/2454630826 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5770066a70 con 0x56039c1166b0 2024-09-17T03:11:16.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f57567fc640 1 -- 172.21.15.78:0/2454630826 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f576c01cd20 con 0x56039c1166b0 2024-09-17T03:11:16.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f5785043740 10 client.6027 fetch_fsmap learned FSMap version 38 2024-09-17T03:11:16.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f5785043740 1 -- 172.21.15.78:0/2454630826 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x56039c1806a0 con 0x56039c1166b0 2024-09-17T03:11:16.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f57567fc640 1 -- 172.21.15.78:0/2454630826 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5770066a70 con 0x56039c1166b0 2024-09-17T03:11:16.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f57567fc640 1 -- 172.21.15.78:0/2454630826 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 38) ==== 3558+0+0 (secure 0 0 0) 0x7f576c023050 con 0x56039c1166b0 2024-09-17T03:11:16.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f5785043740 10 client.6027 fetch_fsmap finished waiting for FSMap version 38 2024-09-17T03:11:16.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f5785043740 10 client.6027 resolve_mds: resolved 3:2 to role '3:2' aka daemon mds.a 2024-09-17T03:11:16.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f5785043740 20 client.6027 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:16.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f5785043740 1 --2- 172.21.15.78:0/2454630826 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x56039c0f5f60 0x56039c51ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f5785043740 4 client.6027 mds_command: new command op to 5036 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:11:16.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.608+0000 7f5785043740 1 -- 172.21.15.78:0/2454630826 --> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56039c4539b0 con 0x56039c0f5f60 2024-09-17T03:11:16.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.609+0000 7f57777fe640 1 --2- 172.21.15.78:0/2454630826 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x56039c0f5f60 0x56039c51ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.609+0000 7f57567fc640 10 client.6027 ms_handle_connect on v2:172.21.15.78:6832/3629327943 2024-09-17T03:11:16.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.609+0000 7f57777fe640 1 --2- 172.21.15.78:0/2454630826 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x56039c0f5f60 0x56039c51ea00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d9807160992896fc server_cookie=30b736c955ffa804 in_seq=0 out_seq=0 2024-09-17T03:11:16.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.610+0000 7f57567fc640 1 -- 172.21.15.78:0/2454630826 <== mds.2 v2:172.21.15.78:6832/3629327943 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56039c4539b0 con 0x56039c0f5f60 2024-09-17T03:11:16.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.610+0000 7f57567fc640 10 client.6027 handle_command_reply: tid=0 2024-09-17T03:11:16.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.610+0000 7f5785043740 1 client.6027 shutdown 2024-09-17T03:11:16.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.610+0000 7f5785043740 1 -- 172.21.15.78:0/2454630826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c1166b0 msgr2=0x56039c536790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.610+0000 7f5785043740 1 --2- 172.21.15.78:0/2454630826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c1166b0 0x56039c536790 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f576c00df00 tx=0x7f576c0117b0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.610+0000 7f5785043740 1 -- 172.21.15.78:0/2454630826 shutdown_connections 2024-09-17T03:11:16.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.610+0000 7f5785043740 1 --2- 172.21.15.78:0/2454630826 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x56039c0f5f60 0x56039c51ea00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.610+0000 7f5785043740 1 --2- 172.21.15.78:0/2454630826 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c137390 0x56039c536cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.610+0000 7f5785043740 1 --2- 172.21.15.78:0/2454630826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c1166b0 0x56039c536790 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.610+0000 7f57567fc640 0 client.6027 ms_handle_reset on v2:172.21.15.78:6832/3629327943 2024-09-17T03:11:16.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.610+0000 7f5785043740 1 --2- 172.21.15.78:0/2454630826 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c10e4d0 0x56039c51a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.610+0000 7f5785043740 1 -- 172.21.15.78:0/2454630826 >> 172.21.15.78:0/2454630826 conn(0x56039c12b4e0 msgr2=0x56039c4d8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:16.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.610+0000 7f5785043740 1 -- 172.21.15.78:0/2454630826 shutdown_connections 2024-09-17T03:11:16.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.610+0000 7f5785043740 1 -- 172.21.15.78:0/2454630826 wait complete. 2024-09-17T03:11:16.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.610+0000 7f5785043740 20 client.6027 trim_cache size 0 max 16384 2024-09-17T03:11:16.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.627+0000 7f5785043740 1 Processor -- start 2024-09-17T03:11:16.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.627+0000 7f5785043740 1 -- start start 2024-09-17T03:11:16.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.629+0000 7f5785043740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c10e4d0 0x56039c5471c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.629+0000 7f5785043740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c1166b0 0x56039c4e00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.629+0000 7f5785043740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c137390 0x56039c4deb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.629+0000 7f5785043740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f57781fffd0 con 0x56039c137390 2024-09-17T03:11:16.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.629+0000 7f5785043740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f57781ff1b0 con 0x56039c1166b0 2024-09-17T03:11:16.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.629+0000 7f5785043740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f57781ff8a0 con 0x56039c10e4d0 2024-09-17T03:11:16.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.629+0000 7f5777fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c137390 0x56039c4deb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.629+0000 7f5777fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c137390 0x56039c4deb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54482/0 (socket says 172.21.15.78:54482) 2024-09-17T03:11:16.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.629+0000 7f5777fff640 1 -- 172.21.15.78:0/1847594627 learned_addr learned my addr 172.21.15.78:0/1847594627 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:16.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.629+0000 7f57777fe640 1 --2- 172.21.15.78:0/1847594627 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c10e4d0 0x56039c5471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.629+0000 7f5776ffd640 1 --2- 172.21.15.78:0/1847594627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c1166b0 0x56039c4e00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.629+0000 7f5777fff640 1 -- 172.21.15.78:0/1847594627 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c10e4d0 msgr2=0x56039c5471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.629+0000 7f5777fff640 1 --2- 172.21.15.78:0/1847594627 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c10e4d0 0x56039c5471c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.629+0000 7f5777fff640 1 -- 172.21.15.78:0/1847594627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c1166b0 msgr2=0x56039c4e00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.629+0000 7f5777fff640 1 --2- 172.21.15.78:0/1847594627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c1166b0 0x56039c4e00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.629+0000 7f5777fff640 1 -- 172.21.15.78:0/1847594627 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56039c532890 con 0x56039c137390 2024-09-17T03:11:16.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.629+0000 7f57777fe640 1 --2- 172.21.15.78:0/1847594627 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c10e4d0 0x56039c5471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:16.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.629+0000 7f5776ffd640 1 --2- 172.21.15.78:0/1847594627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c1166b0 0x56039c4e00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:16.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.629+0000 7f5777fff640 1 --2- 172.21.15.78:0/1847594627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c137390 0x56039c4deb60 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5770000f60 tx=0x7f5770001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300c45b0ab362b1a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:16.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.630+0000 7f575cff9640 1 -- 172.21.15.78:0/1847594627 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577006b920 con 0x56039c137390 2024-09-17T03:11:16.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.630+0000 7f575cff9640 1 -- 172.21.15.78:0/1847594627 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5770061f90 con 0x56039c137390 2024-09-17T03:11:16.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.630+0000 7f575cff9640 1 -- 172.21.15.78:0/1847594627 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57700840e0 con 0x56039c137390 2024-09-17T03:11:16.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.630+0000 7f5785043740 1 -- 172.21.15.78:0/1847594627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c137390 msgr2=0x56039c4deb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.630+0000 7f5785043740 1 --2- 172.21.15.78:0/1847594627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c137390 0x56039c4deb60 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5770000f60 tx=0x7f5770001080 comp rx=0 tx=0).stop 2024-09-17T03:11:16.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.630+0000 7f5785043740 1 -- 172.21.15.78:0/1847594627 shutdown_connections 2024-09-17T03:11:16.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.630+0000 7f5785043740 1 --2- 172.21.15.78:0/1847594627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c137390 0x56039c4deb60 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.630+0000 7f5785043740 1 --2- 172.21.15.78:0/1847594627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c1166b0 0x56039c4e00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.630+0000 7f5785043740 1 --2- 172.21.15.78:0/1847594627 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c10e4d0 0x56039c5471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.630+0000 7f5785043740 1 -- 172.21.15.78:0/1847594627 >> 172.21.15.78:0/1847594627 conn(0x56039c12b4e0 msgr2=0x56039c4d8b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:16.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.630+0000 7f5785043740 1 -- 172.21.15.78:0/1847594627 shutdown_connections 2024-09-17T03:11:16.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.630+0000 7f5785043740 1 -- 172.21.15.78:0/1847594627 wait complete. 2024-09-17T03:11:16.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.631+0000 7f5785043740 1 -- start start 2024-09-17T03:11:16.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.631+0000 7f5785043740 1 Processor -- start 2024-09-17T03:11:16.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f5785043740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c10e4d0 0x56039c5a6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f5785043740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c1166b0 0x56039c58c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f5785043740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c137390 0x56039c526390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f5785043740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f57781f6f50 con 0x56039c137390 2024-09-17T03:11:16.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f5785043740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56039c532d60 con 0x56039c1166b0 2024-09-17T03:11:16.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f5785043740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x56039c5a7670 con 0x56039c10e4d0 2024-09-17T03:11:16.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f5785043740 10 client.0 _ll_register_callbacks cb 0x7f576c00d420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:16.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f5777fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c137390 0x56039c526390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f5777fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c137390 0x56039c526390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54498/0 (socket says 172.21.15.78:54498) 2024-09-17T03:11:16.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f5777fff640 1 -- 172.21.15.78:0/2054465111 learned_addr learned my addr 172.21.15.78:0/2054465111 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:16.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f5776ffd640 1 --2- 172.21.15.78:0/2054465111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c1166b0 0x56039c58c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f57777fe640 1 --2- 172.21.15.78:0/2054465111 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c10e4d0 0x56039c5a6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f5777fff640 1 -- 172.21.15.78:0/2054465111 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c10e4d0 msgr2=0x56039c5a6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f5777fff640 1 --2- 172.21.15.78:0/2054465111 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c10e4d0 0x56039c5a6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f5777fff640 1 -- 172.21.15.78:0/2054465111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c1166b0 msgr2=0x56039c58c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f5777fff640 1 --2- 172.21.15.78:0/2054465111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c1166b0 0x56039c58c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f5777fff640 1 -- 172.21.15.78:0/2054465111 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56039c51a400 con 0x56039c137390 2024-09-17T03:11:16.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f5777fff640 1 --2- 172.21.15.78:0/2054465111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c137390 0x56039c526390 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f577005f200 tx=0x7f577005e430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139ddb9d730369cd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:16.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f57567fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:16.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f57567fc640 1 -- 172.21.15.78:0/2054465111 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5770066a70 con 0x56039c137390 2024-09-17T03:11:16.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f57567fc640 1 -- 172.21.15.78:0/2054465111 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f57700842d0 con 0x56039c137390 2024-09-17T03:11:16.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f5785043740 1 -- 172.21.15.78:0/2054465111 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5770061f90 con 0x56039c137390 2024-09-17T03:11:16.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f57567fc640 1 -- 172.21.15.78:0/2054465111 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f57700611f0 con 0x56039c137390 2024-09-17T03:11:16.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.633+0000 7f5785043740 10 client.6033 fetch_fsmap learned FSMap version 38 2024-09-17T03:11:16.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.634+0000 7f5785043740 1 -- 172.21.15.78:0/2054465111 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x56039c58cd00 con 0x56039c137390 2024-09-17T03:11:16.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.634+0000 7f57567fc640 1 -- 172.21.15.78:0/2054465111 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5770061f90 con 0x56039c137390 2024-09-17T03:11:16.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.634+0000 7f57567fc640 1 -- 172.21.15.78:0/2054465111 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 38) ==== 3558+0+0 (secure 0 0 0) 0x7f5770061390 con 0x56039c137390 2024-09-17T03:11:16.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.634+0000 7f5785043740 10 client.6033 fetch_fsmap finished waiting for FSMap version 38 2024-09-17T03:11:16.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.634+0000 7f5785043740 10 client.6033 resolve_mds: resolved 3:2 to role '3:2' aka daemon mds.a 2024-09-17T03:11:16.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.634+0000 7f5785043740 20 client.6033 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:16.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.634+0000 7f5785043740 1 --2- 172.21.15.78:0/2054465111 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x56039c5194d0 0x56039c536360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.634+0000 7f5785043740 4 client.6033 mds_command: new command op to 5036 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:11:16.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.634+0000 7f5785043740 1 -- 172.21.15.78:0/2054465111 --> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56039c44f460 con 0x56039c5194d0 2024-09-17T03:11:16.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.634+0000 7f57777fe640 1 --2- 172.21.15.78:0/2054465111 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x56039c5194d0 0x56039c536360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.634+0000 7f57567fc640 10 client.6033 ms_handle_connect on v2:172.21.15.78:6832/3629327943 2024-09-17T03:11:16.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.634+0000 7f57777fe640 1 --2- 172.21.15.78:0/2054465111 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x56039c5194d0 0x56039c536360 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bee9c4dccf52cfe7 server_cookie=a3ae507283908daf in_seq=0 out_seq=0 2024-09-17T03:11:16.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.634+0000 7f57567fc640 1 -- 172.21.15.78:0/2054465111 <== mds.2 v2:172.21.15.78:6832/3629327943 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56039c44f460 con 0x56039c5194d0 2024-09-17T03:11:16.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.634+0000 7f57567fc640 10 client.6033 handle_command_reply: tid=0 2024-09-17T03:11:16.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.634+0000 7f5785043740 1 client.6033 shutdown 2024-09-17T03:11:16.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f5785043740 1 -- 172.21.15.78:0/2054465111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c137390 msgr2=0x56039c526390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f5785043740 1 --2- 172.21.15.78:0/2054465111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c137390 0x56039c526390 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f577005f200 tx=0x7f577005e430 comp rx=0 tx=0).stop 2024-09-17T03:11:16.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f5785043740 1 -- 172.21.15.78:0/2054465111 shutdown_connections 2024-09-17T03:11:16.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f5785043740 1 --2- 172.21.15.78:0/2054465111 >> [v2:172.21.15.78:6832/3629327943,v1:172.21.15.78:6835/3629327943] conn(0x56039c5194d0 0x56039c536360 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f5785043740 1 --2- 172.21.15.78:0/2054465111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56039c137390 0x56039c526390 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f57567fc640 0 client.6033 ms_handle_reset on v2:172.21.15.78:6832/3629327943 2024-09-17T03:11:16.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f5785043740 1 --2- 172.21.15.78:0/2054465111 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56039c1166b0 0x56039c58c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f5785043740 1 --2- 172.21.15.78:0/2054465111 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56039c10e4d0 0x56039c5a6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f5785043740 1 -- 172.21.15.78:0/2054465111 >> 172.21.15.78:0/2054465111 conn(0x56039c12b4e0 msgr2=0x56039c51cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:16.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f5785043740 1 -- 172.21.15.78:0/2054465111 shutdown_connections 2024-09-17T03:11:16.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f5785043740 1 -- 172.21.15.78:0/2054465111 wait complete. 2024-09-17T03:11:16.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f5785043740 20 client.6033 trim_cache size 0 max 16384 2024-09-17T03:11:16.645 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:11:16.645 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-17T03:11:16.645 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {} 2024-09-17T03:11:16.645 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:11:16.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f577cd9d640 1 -- 172.21.15.78:0/3149928482 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5764078b90 msgr2=0x7f576407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f577cd9d640 1 --2- 172.21.15.78:0/3149928482 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5764078b90 0x7f576407b0a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5768035000 tx=0x7f5768004ab0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f577cd9d640 1 -- 172.21.15.78:0/3149928482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57780ce640 msgr2=0x7f577806cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f577cd9d640 1 --2- 172.21.15.78:0/3149928482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57780ce640 0x7f577806cde0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f577000c3c0 tx=0x7f577000c880 comp rx=0 tx=0).stop 2024-09-17T03:11:16.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f577cd9d640 1 -- 172.21.15.78:0/3149928482 shutdown_connections 2024-09-17T03:11:16.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f577cd9d640 1 --2- 172.21.15.78:0/3149928482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57780ce640 0x7f577806cde0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f577cd9d640 1 --2- 172.21.15.78:0/3149928482 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f57780ccc30 0x7f5778153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f577cd9d640 1 --2- 172.21.15.78:0/3149928482 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5764078b90 0x7f576407b0a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f577cd9d640 1 --2- 172.21.15.78:0/3149928482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57780cbc30 0x7f57780c7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f577cd9d640 1 -- 172.21.15.78:0/3149928482 >> 172.21.15.78:0/3149928482 conn(0x7f57780cdb20 msgr2=0x7f57780b2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:16.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f577cd9d640 1 -- 172.21.15.78:0/3149928482 shutdown_connections 2024-09-17T03:11:16.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.635+0000 7f577cd9d640 1 -- 172.21.15.78:0/3149928482 wait complete. 2024-09-17T03:11:16.648 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:11:16.648 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:11:16.648 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.3:0 scrub status 2024-09-17T03:11:16.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.764+0000 7f5a82700640 1 -- 172.21.15.78:0/1140026874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a7c0cf5d0 msgr2=0x7f5a7c0cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.764+0000 7f5a82700640 1 --2- 172.21.15.78:0/1140026874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a7c0cf5d0 0x7f5a7c0cf9e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5a74005fd0 tx=0x7f5a7402aa90 comp rx=0 tx=0).stop 2024-09-17T03:11:16.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.764+0000 7f5a82700640 1 -- 172.21.15.78:0/1140026874 shutdown_connections 2024-09-17T03:11:16.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.764+0000 7f5a82700640 1 --2- 172.21.15.78:0/1140026874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a7c0cf5d0 0x7f5a7c0cf9e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.764+0000 7f5a82700640 1 --2- 172.21.15.78:0/1140026874 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5a7c0d1a80 0x7f5a7c0cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.764+0000 7f5a82700640 1 -- 172.21.15.78:0/1140026874 >> 172.21.15.78:0/1140026874 conn(0x7f5a7c08bfc0 msgr2=0x7f5a7c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:16.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.764+0000 7f5a82700640 1 -- 172.21.15.78:0/1140026874 shutdown_connections 2024-09-17T03:11:16.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.764+0000 7f5a82700640 1 -- 172.21.15.78:0/1140026874 wait complete. 2024-09-17T03:11:16.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.766+0000 7f5a82700640 1 Processor -- start 2024-09-17T03:11:16.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.766+0000 7f5a82700640 1 -- start start 2024-09-17T03:11:16.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.767+0000 7f5a82700640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a7c0cf5d0 0x7f5a7c1f6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.767+0000 7f5a82700640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5a7c0d1a80 0x7f5a7c0cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.767+0000 7f5a82700640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a7c0d2ed0 0x7f5a7c0c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.767+0000 7f5a82700640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c162c60 con 0x7f5a7c0d2ed0 2024-09-17T03:11:16.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.767+0000 7f5a82700640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c162ae0 con 0x7f5a7c0cf5d0 2024-09-17T03:11:16.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.767+0000 7f5a82700640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7c162de0 con 0x7f5a7c0d1a80 2024-09-17T03:11:16.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.767+0000 7f5a80c9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a7c0d2ed0 0x7f5a7c0c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.767+0000 7f5a80c9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a7c0d2ed0 0x7f5a7c0c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54522/0 (socket says 172.21.15.78:54522) 2024-09-17T03:11:16.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.767+0000 7f5a80c9d640 1 -- 172.21.15.78:0/4099414765 learned_addr learned my addr 172.21.15.78:0/4099414765 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:16.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.767+0000 7f5a7b7fe640 1 --2- 172.21.15.78:0/4099414765 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5a7c0d1a80 0x7f5a7c0cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.767+0000 7f5a7bfff640 1 --2- 172.21.15.78:0/4099414765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a7c0cf5d0 0x7f5a7c1f6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.767+0000 7f5a80c9d640 1 -- 172.21.15.78:0/4099414765 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5a7c0d1a80 msgr2=0x7f5a7c0cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.767+0000 7f5a80c9d640 1 --2- 172.21.15.78:0/4099414765 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5a7c0d1a80 0x7f5a7c0cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.767+0000 7f5a80c9d640 1 -- 172.21.15.78:0/4099414765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a7c0cf5d0 msgr2=0x7f5a7c1f6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.767+0000 7f5a80c9d640 1 --2- 172.21.15.78:0/4099414765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a7c0cf5d0 0x7f5a7c1f6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.767+0000 7f5a80c9d640 1 -- 172.21.15.78:0/4099414765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a7c0ce500 con 0x7f5a7c0d2ed0 2024-09-17T03:11:16.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.768+0000 7f5a80c9d640 1 --2- 172.21.15.78:0/4099414765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a7c0d2ed0 0x7f5a7c0c80f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009d90 tx=0x7f5a74003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:16.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.768+0000 7f5a78ff9640 1 -- 172.21.15.78:0/4099414765 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a74044070 con 0x7f5a7c0d2ed0 2024-09-17T03:11:16.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.768+0000 7f5a78ff9640 1 -- 172.21.15.78:0/4099414765 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a74004250 con 0x7f5a7c0d2ed0 2024-09-17T03:11:16.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.768+0000 7f5a82700640 1 -- 172.21.15.78:0/4099414765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a7c0ce7e0 con 0x7f5a7c0d2ed0 2024-09-17T03:11:16.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.768+0000 7f5a78ff9640 1 -- 172.21.15.78:0/4099414765 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a74004660 con 0x7f5a7c0d2ed0 2024-09-17T03:11:16.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.768+0000 7f5a82700640 1 -- 172.21.15.78:0/4099414765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7c0cba90 con 0x7f5a7c0d2ed0 2024-09-17T03:11:16.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.770+0000 7f5a78ff9640 1 -- 172.21.15.78:0/4099414765 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5a74047070 con 0x7f5a7c0d2ed0 2024-09-17T03:11:16.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.771+0000 7f5a78ff9640 1 --2- 172.21.15.78:0/4099414765 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5a68078b90 0x7f5a6807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.771+0000 7f5a78ff9640 1 -- 172.21.15.78:0/4099414765 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f5a740bbd80 con 0x7f5a7c0d2ed0 2024-09-17T03:11:16.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.771+0000 7f5a7bfff640 1 --2- 172.21.15.78:0/4099414765 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5a68078b90 0x7f5a6807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.771+0000 7f5a89670740 1 Processor -- start 2024-09-17T03:11:16.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.771+0000 7f5a89670740 1 -- start start 2024-09-17T03:11:16.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.771+0000 7f5a7bfff640 1 --2- 172.21.15.78:0/4099414765 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5a68078b90 0x7f5a6807b0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c001530 tx=0x7f5a6c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:16.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a89670740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bfa390 0x55ae94fe6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a89670740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bd14d0 0x55ae94fbb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a89670740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd96b0 0x55ae94fbbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a89670740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ae94f14a60 con 0x55ae94bd96b0 2024-09-17T03:11:16.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a89670740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ae94f03e90 con 0x55ae94bfa390 2024-09-17T03:11:16.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a89670740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ae94f07ca0 con 0x55ae94bd14d0 2024-09-17T03:11:16.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a80c9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd96b0 0x55ae94fbbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a80c9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd96b0 0x55ae94fbbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54528/0 (socket says 172.21.15.78:54528) 2024-09-17T03:11:16.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a80c9d640 1 -- 172.21.15.78:0/3645916486 learned_addr learned my addr 172.21.15.78:0/3645916486 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:16.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a7b7fe640 1 --2- 172.21.15.78:0/3645916486 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bd14d0 0x55ae94fbb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a7bfff640 1 --2- 172.21.15.78:0/3645916486 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bfa390 0x55ae94fe6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a80c9d640 1 -- 172.21.15.78:0/3645916486 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bd14d0 msgr2=0x55ae94fbb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a80c9d640 1 --2- 172.21.15.78:0/3645916486 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bd14d0 0x55ae94fbb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a80c9d640 1 -- 172.21.15.78:0/3645916486 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bfa390 msgr2=0x55ae94fe6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a80c9d640 1 --2- 172.21.15.78:0/3645916486 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bfa390 0x55ae94fe6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a80c9d640 1 -- 172.21.15.78:0/3645916486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae94cdc7d0 con 0x55ae94bd96b0 2024-09-17T03:11:16.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a7b7fe640 1 --2- 172.21.15.78:0/3645916486 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bd14d0 0x55ae94fbb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:16.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a7bfff640 1 --2- 172.21.15.78:0/3645916486 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bfa390 0x55ae94fe6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:16.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a80c9d640 1 --2- 172.21.15.78:0/3645916486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd96b0 0x55ae94fbbda0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5a740ba210 tx=0x7f5a740838d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e5d59ce4c066bb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:16.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a61ffb640 1 -- 172.21.15.78:0/3645916486 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a740884e0 con 0x55ae94bd96b0 2024-09-17T03:11:16.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a61ffb640 1 -- 172.21.15.78:0/3645916486 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a7408d420 con 0x55ae94bd96b0 2024-09-17T03:11:16.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.773+0000 7f5a61ffb640 1 -- 172.21.15.78:0/3645916486 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a74083390 con 0x55ae94bd96b0 2024-09-17T03:11:16.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.774+0000 7f5a89670740 1 -- 172.21.15.78:0/3645916486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd96b0 msgr2=0x55ae94fbbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.774+0000 7f5a89670740 1 --2- 172.21.15.78:0/3645916486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd96b0 0x55ae94fbbda0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5a740ba210 tx=0x7f5a740838d0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.774+0000 7f5a89670740 1 -- 172.21.15.78:0/3645916486 shutdown_connections 2024-09-17T03:11:16.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.774+0000 7f5a89670740 1 --2- 172.21.15.78:0/3645916486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd96b0 0x55ae94fbbda0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.774+0000 7f5a89670740 1 --2- 172.21.15.78:0/3645916486 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bd14d0 0x55ae94fbb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.774+0000 7f5a89670740 1 --2- 172.21.15.78:0/3645916486 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bfa390 0x55ae94fe6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.774+0000 7f5a89670740 1 -- 172.21.15.78:0/3645916486 >> 172.21.15.78:0/3645916486 conn(0x55ae94bee4e0 msgr2=0x55ae94fa1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:16.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.774+0000 7f5a89670740 1 -- 172.21.15.78:0/3645916486 shutdown_connections 2024-09-17T03:11:16.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.774+0000 7f5a89670740 1 -- 172.21.15.78:0/3645916486 wait complete. 2024-09-17T03:11:16.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.775+0000 7f5a89670740 1 -- start start 2024-09-17T03:11:16.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.775+0000 7f5a89670740 1 Processor -- start 2024-09-17T03:11:16.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.776+0000 7f5a89670740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bd14d0 0x55ae94fb87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.776+0000 7f5a89670740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd96b0 0x55ae94fb9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.776+0000 7f5a89670740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bfa390 0x55ae94fb9560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a89670740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ae94c74740 con 0x55ae94bd96b0 2024-09-17T03:11:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a89670740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ae94ea9970 con 0x55ae94bd14d0 2024-09-17T03:11:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a89670740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ae94f14a60 con 0x55ae94bfa390 2024-09-17T03:11:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a89670740 10 client.0 _ll_register_callbacks cb 0x55ae94eb8780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a7b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd96b0 0x55ae94fb9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a7b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd96b0 0x55ae94fb9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54542/0 (socket says 172.21.15.78:54542) 2024-09-17T03:11:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a7b7fe640 1 -- 172.21.15.78:0/3937190907 learned_addr learned my addr 172.21.15.78:0/3937190907 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a7bfff640 1 --2- 172.21.15.78:0/3937190907 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bd14d0 0x55ae94fb87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a80c9d640 1 --2- 172.21.15.78:0/3937190907 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bfa390 0x55ae94fb9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a7b7fe640 1 -- 172.21.15.78:0/3937190907 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bfa390 msgr2=0x55ae94fb9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a7b7fe640 1 --2- 172.21.15.78:0/3937190907 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bfa390 0x55ae94fb9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a7b7fe640 1 -- 172.21.15.78:0/3937190907 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bd14d0 msgr2=0x55ae94fb87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a7b7fe640 1 --2- 172.21.15.78:0/3937190907 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bd14d0 0x55ae94fb87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a7b7fe640 1 -- 172.21.15.78:0/3937190907 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae94c65970 con 0x55ae94bd96b0 2024-09-17T03:11:16.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a7bfff640 1 --2- 172.21.15.78:0/3937190907 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bd14d0 0x55ae94fb87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:16.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a7b7fe640 1 --2- 172.21.15.78:0/3937190907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd96b0 0x55ae94fb9020 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0b3fa0 tx=0x7f5a70010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6186b7ba24f148 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:16.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a5affd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:16.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a5affd640 1 -- 172.21.15.78:0/3937190907 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70005220 con 0x55ae94bd96b0 2024-09-17T03:11:16.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a5affd640 1 -- 172.21.15.78:0/3937190907 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f5a700053c0 con 0x55ae94bd96b0 2024-09-17T03:11:16.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a89670740 1 -- 172.21.15.78:0/3937190907 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a7408d420 con 0x55ae94bd96b0 2024-09-17T03:11:16.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.777+0000 7f5a5affd640 1 -- 172.21.15.78:0/3937190907 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5a70023050 con 0x55ae94bd96b0 2024-09-17T03:11:16.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.778+0000 7f5a89670740 10 client.6048 fetch_fsmap learned FSMap version 38 2024-09-17T03:11:16.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.778+0000 7f5a89670740 1 -- 172.21.15.78:0/3937190907 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x55ae94c436a0 con 0x55ae94bd96b0 2024-09-17T03:11:16.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.778+0000 7f5a5affd640 1 -- 172.21.15.78:0/3937190907 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a7408d420 con 0x55ae94bd96b0 2024-09-17T03:11:16.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.778+0000 7f5a5affd640 1 -- 172.21.15.78:0/3937190907 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 38) ==== 3558+0+0 (secure 0 0 0) 0x7f5a70026020 con 0x55ae94bd96b0 2024-09-17T03:11:16.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.778+0000 7f5a89670740 10 client.6048 fetch_fsmap finished waiting for FSMap version 38 2024-09-17T03:11:16.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.778+0000 7f5a89670740 10 client.6048 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-09-17T03:11:16.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.778+0000 7f5a89670740 20 client.6048 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:16.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.778+0000 7f5a89670740 1 --2- 172.21.15.78:0/3937190907 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55ae94bb8f60 0x55ae94fdf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.778+0000 7f5a89670740 4 client.6048 mds_command: new command op to 5565 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:11:16.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.778+0000 7f5a89670740 1 -- 172.21.15.78:0/3937190907 --> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae94f169b0 con 0x55ae94bb8f60 2024-09-17T03:11:16.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.778+0000 7f5a7bfff640 1 --2- 172.21.15.78:0/3937190907 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55ae94bb8f60 0x55ae94fdf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.779+0000 7f5a5affd640 10 client.6048 ms_handle_connect on v2:172.21.15.193:6834/1788096053 2024-09-17T03:11:16.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.779+0000 7f5a7bfff640 1 --2- 172.21.15.78:0/3937190907 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55ae94bb8f60 0x55ae94fdf040 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b55dcf256e20d891 server_cookie=9cb8f2f671cccb0e in_seq=0 out_seq=0 2024-09-17T03:11:16.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.779+0000 7f5a5affd640 1 -- 172.21.15.78:0/3937190907 <== mds.0 v2:172.21.15.193:6834/1788096053 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ae94f169b0 con 0x55ae94bb8f60 2024-09-17T03:11:16.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.779+0000 7f5a5affd640 10 client.6048 handle_command_reply: tid=0 2024-09-17T03:11:16.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.779+0000 7f5a89670740 1 client.6048 shutdown 2024-09-17T03:11:16.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.780+0000 7f5a89670740 1 -- 172.21.15.78:0/3937190907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd96b0 msgr2=0x55ae94fb9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.780+0000 7f5a89670740 1 --2- 172.21.15.78:0/3937190907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd96b0 0x55ae94fb9020 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0b3fa0 tx=0x7f5a70010800 comp rx=0 tx=0).stop 2024-09-17T03:11:16.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.780+0000 7f5a89670740 1 -- 172.21.15.78:0/3937190907 shutdown_connections 2024-09-17T03:11:16.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.780+0000 7f5a89670740 1 --2- 172.21.15.78:0/3937190907 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55ae94bb8f60 0x55ae94fdf040 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.780+0000 7f5a89670740 1 --2- 172.21.15.78:0/3937190907 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bfa390 0x55ae94fb9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.780+0000 7f5a89670740 1 --2- 172.21.15.78:0/3937190907 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd96b0 0x55ae94fb9020 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.780+0000 7f5a89670740 1 --2- 172.21.15.78:0/3937190907 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bd14d0 0x55ae94fb87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.780+0000 7f5a5affd640 0 client.6048 ms_handle_reset on v2:172.21.15.193:6834/1788096053 2024-09-17T03:11:16.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.780+0000 7f5a89670740 1 -- 172.21.15.78:0/3937190907 >> 172.21.15.78:0/3937190907 conn(0x55ae94bee4e0 msgr2=0x55ae94f9ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:16.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.780+0000 7f5a89670740 1 -- 172.21.15.78:0/3937190907 shutdown_connections 2024-09-17T03:11:16.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.780+0000 7f5a89670740 1 -- 172.21.15.78:0/3937190907 wait complete. 2024-09-17T03:11:16.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.780+0000 7f5a89670740 20 client.6048 trim_cache size 0 max 16384 2024-09-17T03:11:16.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.797+0000 7f5a89670740 1 Processor -- start 2024-09-17T03:11:16.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.797+0000 7f5a89670740 1 -- start start 2024-09-17T03:11:16.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.799+0000 7f5a89670740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bd14d0 0x55ae95009fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.799+0000 7f5a89670740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bd96b0 0x55ae94fb7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.799+0000 7f5a89670740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bfa390 0x55ae94fb7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.799+0000 7f5a89670740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c202440 con 0x55ae94bfa390 2024-09-17T03:11:16.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.799+0000 7f5a89670740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c201640 con 0x55ae94bd96b0 2024-09-17T03:11:16.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.799+0000 7f5a89670740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5a7c201d10 con 0x55ae94bd14d0 2024-09-17T03:11:16.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.799+0000 7f5a80c9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bfa390 0x55ae94fb7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.799+0000 7f5a80c9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bfa390 0x55ae94fb7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54554/0 (socket says 172.21.15.78:54554) 2024-09-17T03:11:16.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.799+0000 7f5a80c9d640 1 -- 172.21.15.78:0/2055855260 learned_addr learned my addr 172.21.15.78:0/2055855260 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:16.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.799+0000 7f5a7b7fe640 1 --2- 172.21.15.78:0/2055855260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bd96b0 0x55ae94fb7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.799+0000 7f5a7bfff640 1 --2- 172.21.15.78:0/2055855260 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bd14d0 0x55ae95009fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.799+0000 7f5a80c9d640 1 -- 172.21.15.78:0/2055855260 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bd14d0 msgr2=0x55ae95009fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.799+0000 7f5a80c9d640 1 --2- 172.21.15.78:0/2055855260 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bd14d0 0x55ae95009fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.799+0000 7f5a80c9d640 1 -- 172.21.15.78:0/2055855260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bd96b0 msgr2=0x55ae94fb7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.799+0000 7f5a80c9d640 1 --2- 172.21.15.78:0/2055855260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bd96b0 0x55ae94fb7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.799+0000 7f5a80c9d640 1 -- 172.21.15.78:0/2055855260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae94fbb0c0 con 0x55ae94bfa390 2024-09-17T03:11:16.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.799+0000 7f5a7bfff640 1 --2- 172.21.15.78:0/2055855260 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bd14d0 0x55ae95009fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:16.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.799+0000 7f5a80c9d640 1 --2- 172.21.15.78:0/2055855260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bfa390 0x55ae94fb7c80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5a74083940 tx=0x7f5a740ba140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f06a99bc0d0058 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:16.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.799+0000 7f5a617fa640 1 -- 172.21.15.78:0/2055855260 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a740884e0 con 0x55ae94bfa390 2024-09-17T03:11:16.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.800+0000 7f5a617fa640 1 -- 172.21.15.78:0/2055855260 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a7407fdf0 con 0x55ae94bfa390 2024-09-17T03:11:16.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.800+0000 7f5a617fa640 1 -- 172.21.15.78:0/2055855260 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a74088070 con 0x55ae94bfa390 2024-09-17T03:11:16.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.800+0000 7f5a89670740 1 -- 172.21.15.78:0/2055855260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bfa390 msgr2=0x55ae94fb7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.800+0000 7f5a89670740 1 --2- 172.21.15.78:0/2055855260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bfa390 0x55ae94fb7c80 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f5a74083940 tx=0x7f5a740ba140 comp rx=0 tx=0).stop 2024-09-17T03:11:16.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.800+0000 7f5a89670740 1 -- 172.21.15.78:0/2055855260 shutdown_connections 2024-09-17T03:11:16.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.800+0000 7f5a89670740 1 --2- 172.21.15.78:0/2055855260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bfa390 0x55ae94fb7c80 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.800+0000 7f5a89670740 1 --2- 172.21.15.78:0/2055855260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bd96b0 0x55ae94fb7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.800+0000 7f5a89670740 1 --2- 172.21.15.78:0/2055855260 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bd14d0 0x55ae95009fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.800+0000 7f5a89670740 1 -- 172.21.15.78:0/2055855260 >> 172.21.15.78:0/2055855260 conn(0x55ae94bee4e0 msgr2=0x55ae94fddfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:16.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.800+0000 7f5a89670740 1 -- 172.21.15.78:0/2055855260 shutdown_connections 2024-09-17T03:11:16.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.800+0000 7f5a89670740 1 -- 172.21.15.78:0/2055855260 wait complete. 2024-09-17T03:11:16.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.801+0000 7f5a89670740 1 -- start start 2024-09-17T03:11:16.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.802+0000 7f5a89670740 1 Processor -- start 2024-09-17T03:11:16.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.803+0000 7f5a89670740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd14d0 0x55ae94fbb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.803+0000 7f5a89670740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bd96b0 0x55ae9505c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.803+0000 7f5a89670740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bfa390 0x55ae94fb7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.803+0000 7f5a89670740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ae94f9f9d0 con 0x55ae94bd14d0 2024-09-17T03:11:16.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.803+0000 7f5a89670740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7c1f93a0 con 0x55ae94bfa390 2024-09-17T03:11:16.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.803+0000 7f5a89670740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ae95069530 con 0x55ae94bd96b0 2024-09-17T03:11:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.803+0000 7f5a89670740 10 client.0 _ll_register_callbacks cb 0x7f5a70005eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.803+0000 7f5a7bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd14d0 0x55ae94fbb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.803+0000 7f5a7bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd14d0 0x55ae94fbb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54562/0 (socket says 172.21.15.78:54562) 2024-09-17T03:11:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.803+0000 7f5a7bfff640 1 -- 172.21.15.78:0/414192606 learned_addr learned my addr 172.21.15.78:0/414192606 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.803+0000 7f5a7b7fe640 1 --2- 172.21.15.78:0/414192606 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bd96b0 0x55ae9505c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.803+0000 7f5a80c9d640 1 --2- 172.21.15.78:0/414192606 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bfa390 0x55ae94fb7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.803+0000 7f5a7bfff640 1 -- 172.21.15.78:0/414192606 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bd96b0 msgr2=0x55ae9505c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.803+0000 7f5a7bfff640 1 --2- 172.21.15.78:0/414192606 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bd96b0 0x55ae9505c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.803+0000 7f5a7bfff640 1 -- 172.21.15.78:0/414192606 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bfa390 msgr2=0x55ae94fb7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.803+0000 7f5a7bfff640 1 --2- 172.21.15.78:0/414192606 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bfa390 0x55ae94fb7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.803+0000 7f5a7bfff640 1 -- 172.21.15.78:0/414192606 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae94f9dcd0 con 0x55ae94bd14d0 2024-09-17T03:11:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.803+0000 7f5a7bfff640 1 --2- 172.21.15.78:0/414192606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd14d0 0x55ae94fbb490 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x55ae94fbabd0 tx=0x7f5a6c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb9b0fd513efa1d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:16.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.803+0000 7f5a5affd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.804+0000 7f5a5affd640 1 -- 172.21.15.78:0/414192606 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c025720 con 0x55ae94bd14d0 2024-09-17T03:11:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.804+0000 7f5a5affd640 1 -- 172.21.15.78:0/414192606 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f5a6c0258c0 con 0x55ae94bd14d0 2024-09-17T03:11:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.804+0000 7f5a89670740 1 -- 172.21.15.78:0/414192606 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a7407fdf0 con 0x55ae94bd14d0 2024-09-17T03:11:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.804+0000 7f5a5affd640 1 -- 172.21.15.78:0/414192606 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5a6c036050 con 0x55ae94bd14d0 2024-09-17T03:11:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.804+0000 7f5a89670740 10 client.6054 fetch_fsmap learned FSMap version 38 2024-09-17T03:11:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.804+0000 7f5a89670740 1 -- 172.21.15.78:0/414192606 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) -- 0x55ae9505c920 con 0x55ae94bd14d0 2024-09-17T03:11:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.804+0000 7f5a5affd640 1 -- 172.21.15.78:0/414192606 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a7407fdf0 con 0x55ae94bd14d0 2024-09-17T03:11:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.804+0000 7f5a5affd640 1 -- 172.21.15.78:0/414192606 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 38) ==== 3558+0+0 (secure 0 0 0) 0x7f5a6c039020 con 0x55ae94bd14d0 2024-09-17T03:11:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.804+0000 7f5a89670740 10 client.6054 fetch_fsmap finished waiting for FSMap version 38 2024-09-17T03:11:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.804+0000 7f5a89670740 10 client.6054 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-09-17T03:11:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.804+0000 7f5a89670740 20 client.6054 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:16.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.804+0000 7f5a89670740 1 --2- 172.21.15.78:0/414192606 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55ae94fb7c80 0x55ae94fe8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.804+0000 7f5a89670740 4 client.6054 mds_command: new command op to 5565 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:11:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.804+0000 7f5a89670740 1 -- 172.21.15.78:0/414192606 --> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ae94f12460 con 0x55ae94fb7c80 2024-09-17T03:11:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.804+0000 7f5a7b7fe640 1 --2- 172.21.15.78:0/414192606 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55ae94fb7c80 0x55ae94fe8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.805+0000 7f5a5affd640 10 client.6054 ms_handle_connect on v2:172.21.15.193:6834/1788096053 2024-09-17T03:11:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.805+0000 7f5a7b7fe640 1 --2- 172.21.15.78:0/414192606 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55ae94fb7c80 0x55ae94fe8cd0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b4aa596365155a8 server_cookie=3278833a41ffe46 in_seq=0 out_seq=0 2024-09-17T03:11:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.805+0000 7f5a5affd640 1 -- 172.21.15.78:0/414192606 <== mds.0 v2:172.21.15.193:6834/1788096053 1 ==== command_reply(tid 0: 0 ) ==== 8+0+382 (crc 0 0 0) 0x55ae94f12460 con 0x55ae94fb7c80 2024-09-17T03:11:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.805+0000 7f5a5affd640 10 client.6054 handle_command_reply: tid=0 2024-09-17T03:11:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.805+0000 7f5a89670740 1 client.6054 shutdown 2024-09-17T03:11:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.805+0000 7f5a89670740 1 -- 172.21.15.78:0/414192606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd14d0 msgr2=0x55ae94fbb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.805+0000 7f5a89670740 1 --2- 172.21.15.78:0/414192606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd14d0 0x55ae94fbb490 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x55ae94fbabd0 tx=0x7f5a6c000bc0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.805+0000 7f5a89670740 1 -- 172.21.15.78:0/414192606 shutdown_connections 2024-09-17T03:11:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.805+0000 7f5a89670740 1 --2- 172.21.15.78:0/414192606 >> [v2:172.21.15.193:6834/1788096053,v1:172.21.15.193:6836/1788096053] conn(0x55ae94fb7c80 0x55ae94fe8cd0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.805+0000 7f5a89670740 1 --2- 172.21.15.78:0/414192606 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ae94bfa390 0x55ae94fb7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.805+0000 7f5a89670740 1 --2- 172.21.15.78:0/414192606 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ae94bd96b0 0x55ae9505c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.805+0000 7f5a5affd640 0 client.6054 ms_handle_reset on v2:172.21.15.193:6834/1788096053 2024-09-17T03:11:16.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.805+0000 7f5a89670740 1 --2- 172.21.15.78:0/414192606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ae94bd14d0 0x55ae94fbb490 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.805+0000 7f5a89670740 1 -- 172.21.15.78:0/414192606 >> 172.21.15.78:0/414192606 conn(0x55ae94bee4e0 msgr2=0x55ae95009fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:16.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.805+0000 7f5a89670740 1 -- 172.21.15.78:0/414192606 shutdown_connections 2024-09-17T03:11:16.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.805+0000 7f5a89670740 1 -- 172.21.15.78:0/414192606 wait complete. 2024-09-17T03:11:16.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.805+0000 7f5a89670740 20 client.6054 trim_cache size 0 max 16384 2024-09-17T03:11:16.811 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:11:16.811 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-17T03:11:16.811 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-17T03:11:16.811 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-17T03:11:16.811 INFO:teuthology.orchestra.run.smithi078.stdout: "8ebf2041-e471-4ebc-8443-f9f2c10aae14": { 2024-09-17T03:11:16.811 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-17T03:11:00.584960+0000", 2024-09-17T03:11:16.811 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:11:16.811 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-17T03:11:16.812 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-17T03:11:16.812 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-17T03:11:16.812 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-17T03:11:16.812 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:16.812 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:16.812 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:11:16.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.806+0000 7f5a82700640 1 -- 172.21.15.78:0/4099414765 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5a68078b90 msgr2=0x7f5a6807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.806+0000 7f5a82700640 1 --2- 172.21.15.78:0/4099414765 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5a68078b90 0x7f5a6807b0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c001530 tx=0x7f5a6c009040 comp rx=0 tx=0).stop 2024-09-17T03:11:16.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.806+0000 7f5a82700640 1 -- 172.21.15.78:0/4099414765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a7c0d2ed0 msgr2=0x7f5a7c0c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.806+0000 7f5a82700640 1 --2- 172.21.15.78:0/4099414765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a7c0d2ed0 0x7f5a7c0c80f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009d90 tx=0x7f5a74003ce0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.806+0000 7f5a82700640 1 -- 172.21.15.78:0/4099414765 shutdown_connections 2024-09-17T03:11:16.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.806+0000 7f5a82700640 1 --2- 172.21.15.78:0/4099414765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5a7c0d2ed0 0x7f5a7c0c80f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.806+0000 7f5a82700640 1 --2- 172.21.15.78:0/4099414765 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5a7c0d1a80 0x7f5a7c0cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.806+0000 7f5a82700640 1 --2- 172.21.15.78:0/4099414765 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5a68078b90 0x7f5a6807b0a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.806+0000 7f5a82700640 1 --2- 172.21.15.78:0/4099414765 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5a7c0cf5d0 0x7f5a7c1f6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.806+0000 7f5a82700640 1 -- 172.21.15.78:0/4099414765 >> 172.21.15.78:0/4099414765 conn(0x7f5a7c08bfc0 msgr2=0x7f5a7c15eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:16.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.806+0000 7f5a82700640 1 -- 172.21.15.78:0/4099414765 shutdown_connections 2024-09-17T03:11:16.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.806+0000 7f5a82700640 1 -- 172.21.15.78:0/4099414765 wait complete. 2024-09-17T03:11:16.816 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:11:16.816 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:11:16.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.931+0000 7fb955120640 1 -- 172.21.15.78:0/3685754800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9501601c0 msgr2=0x7fb9501605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.931+0000 7fb955120640 1 --2- 172.21.15.78:0/3685754800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9501601c0 0x7fb9501605d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb938009830 tx=0x7fb93802a510 comp rx=0 tx=0).stop 2024-09-17T03:11:16.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.931+0000 7fb955120640 1 -- 172.21.15.78:0/3685754800 shutdown_connections 2024-09-17T03:11:16.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.931+0000 7fb955120640 1 --2- 172.21.15.78:0/3685754800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9501601c0 0x7fb9501605d0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.931+0000 7fb955120640 1 --2- 172.21.15.78:0/3685754800 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9500ce490 0x7fb9500ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.931+0000 7fb955120640 1 -- 172.21.15.78:0/3685754800 >> 172.21.15.78:0/3685754800 conn(0x7fb950073fa0 msgr2=0x7fb9500743e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:16.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.931+0000 7fb955120640 1 -- 172.21.15.78:0/3685754800 shutdown_connections 2024-09-17T03:11:16.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.931+0000 7fb955120640 1 -- 172.21.15.78:0/3685754800 wait complete. 2024-09-17T03:11:16.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.933+0000 7fb955120640 1 Processor -- start 2024-09-17T03:11:16.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.933+0000 7fb955120640 1 -- start start 2024-09-17T03:11:16.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.934+0000 7fb955120640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9500b5a40 0x7fb9501f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.934+0000 7fb955120640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9500ce490 0x7fb950141c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.934+0000 7fb955120640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9501601c0 0x7fb9501421a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.934+0000 7fb955120640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb9500cef60 con 0x7fb9501601c0 2024-09-17T03:11:16.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.934+0000 7fb955120640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb9500cede0 con 0x7fb9500ce490 2024-09-17T03:11:16.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.934+0000 7fb955120640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb9500cf0e0 con 0x7fb9500b5a40 2024-09-17T03:11:16.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.935+0000 7fb94f59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9501601c0 0x7fb9501421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.935+0000 7fb94f59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9501601c0 0x7fb9501421a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54578/0 (socket says 172.21.15.78:54578) 2024-09-17T03:11:16.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.935+0000 7fb94f59e640 1 -- 172.21.15.78:0/1973697015 learned_addr learned my addr 172.21.15.78:0/1973697015 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:16.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.935+0000 7fb947fff640 1 --2- 172.21.15.78:0/1973697015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9500ce490 0x7fb950141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.935+0000 7fb94ed9d640 1 --2- 172.21.15.78:0/1973697015 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9500b5a40 0x7fb9501f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.935+0000 7fb94f59e640 1 -- 172.21.15.78:0/1973697015 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9500b5a40 msgr2=0x7fb9501f6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.935+0000 7fb94f59e640 1 --2- 172.21.15.78:0/1973697015 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9500b5a40 0x7fb9501f6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.935+0000 7fb94f59e640 1 -- 172.21.15.78:0/1973697015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9500ce490 msgr2=0x7fb950141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:16.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.935+0000 7fb94f59e640 1 --2- 172.21.15.78:0/1973697015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9500ce490 0x7fb950141c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:16.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.935+0000 7fb94f59e640 1 -- 172.21.15.78:0/1973697015 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9501f77d0 con 0x7fb9501601c0 2024-09-17T03:11:16.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.935+0000 7fb94f59e640 1 --2- 172.21.15.78:0/1973697015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9501601c0 0x7fb9501421a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb94800da90 tx=0x7fb94800df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:16.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.935+0000 7fb9477fe640 1 -- 172.21.15.78:0/1973697015 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948017070 con 0x7fb9501601c0 2024-09-17T03:11:16.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.935+0000 7fb9477fe640 1 -- 172.21.15.78:0/1973697015 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb948003970 con 0x7fb9501601c0 2024-09-17T03:11:16.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.935+0000 7fb955120640 1 -- 172.21.15.78:0/1973697015 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9501f7ab0 con 0x7fb9501601c0 2024-09-17T03:11:16.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.935+0000 7fb9477fe640 1 -- 172.21.15.78:0/1973697015 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948003dc0 con 0x7fb9501601c0 2024-09-17T03:11:16.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.935+0000 7fb955120640 1 -- 172.21.15.78:0/1973697015 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb950154560 con 0x7fb9501601c0 2024-09-17T03:11:16.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.937+0000 7fb955120640 1 -- 172.21.15.78:0/1973697015 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9501f7cf0 con 0x7fb9501601c0 2024-09-17T03:11:16.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.937+0000 7fb9477fe640 1 -- 172.21.15.78:0/1973697015 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb948003f60 con 0x7fb9501601c0 2024-09-17T03:11:16.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.938+0000 7fb9477fe640 1 --2- 172.21.15.78:0/1973697015 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb930078bc0 0x7fb93007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:16.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.938+0000 7fb9477fe640 1 -- 172.21.15.78:0/1973697015 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fb94809b170 con 0x7fb9501601c0 2024-09-17T03:11:16.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.938+0000 7fb94ed9d640 1 --2- 172.21.15.78:0/1973697015 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb930078bc0 0x7fb93007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:16.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.938+0000 7fb94ed9d640 1 --2- 172.21.15.78:0/1973697015 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb930078bc0 0x7fb93007b0d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb9400013f0 tx=0x7fb940009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:16.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:16.942+0000 7fb9477fe640 1 -- 172.21.15.78:0/1973697015 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb948063570 con 0x7fb9501601c0 2024-09-17T03:11:17.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.151+0000 7fb955120640 1 -- 172.21.15.78:0/1973697015 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9500cf590 con 0x7fb9501601c0 2024-09-17T03:11:17.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.152+0000 7fb9477fe640 1 -- 172.21.15.78:0/1973697015 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5276 (secure 0 0 0) 0x7fb948062e70 con 0x7fb9501601c0 2024-09-17T03:11:17.151 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:17.151 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":38,"btime":"2024-09-17T03:11:03:747649+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/2973955781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2973955781},{"type":"v1","addr":"172.21.15.78:6834","nonce":2973955781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:10:25.982190+0000","modified":"2024-09-17T03:11:03.696960+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5565,"mds_1":5039,"mds_2":5036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5036":{"gid":5036,"name":"a","rank":2,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.78:6835/3629327943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3629327943},{"type":"v1","addr":"172.21.15.78:6835","nonce":3629327943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5039":{"gid":5039,"name":"d","rank":1,"incarnation":31,"state":"up:active","state_seq":12,"addr":"172.21.15.193:6837/3209848332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":3209848332},{"type":"v1","addr":"172.21.15.193:6837","nonce":3209848332}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5565":{"gid":5565,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":12,"addr":"172.21.15.193:6836/1788096053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1788096053},{"type":"v1","addr":"172.21.15.193:6836","nonce":1788096053}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5565,"qdb_cluster":[5036,5039,5565]},"id":3}]} 2024-09-17T03:11:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 38 2024-09-17T03:11:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.154+0000 7fb955120640 1 -- 172.21.15.78:0/1973697015 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb930078bc0 msgr2=0x7fb93007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.154+0000 7fb955120640 1 --2- 172.21.15.78:0/1973697015 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb930078bc0 0x7fb93007b0d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb9400013f0 tx=0x7fb940009040 comp rx=0 tx=0).stop 2024-09-17T03:11:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.154+0000 7fb955120640 1 -- 172.21.15.78:0/1973697015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9501601c0 msgr2=0x7fb9501421a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.154+0000 7fb955120640 1 --2- 172.21.15.78:0/1973697015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9501601c0 0x7fb9501421a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb94800da90 tx=0x7fb94800df50 comp rx=0 tx=0).stop 2024-09-17T03:11:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.154+0000 7fb955120640 1 -- 172.21.15.78:0/1973697015 shutdown_connections 2024-09-17T03:11:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.154+0000 7fb955120640 1 --2- 172.21.15.78:0/1973697015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9501601c0 0x7fb9501421a0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.154+0000 7fb955120640 1 --2- 172.21.15.78:0/1973697015 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb930078bc0 0x7fb93007b0d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.154+0000 7fb955120640 1 --2- 172.21.15.78:0/1973697015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9500ce490 0x7fb950141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.154+0000 7fb955120640 1 --2- 172.21.15.78:0/1973697015 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9500b5a40 0x7fb9501f6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.154+0000 7fb955120640 1 -- 172.21.15.78:0/1973697015 >> 172.21.15.78:0/1973697015 conn(0x7fb950073fa0 msgr2=0x7fb9500b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.154+0000 7fb955120640 1 -- 172.21.15.78:0/1973697015 shutdown_connections 2024-09-17T03:11:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.154+0000 7fb955120640 1 -- 172.21.15.78:0/1973697015 wait complete. 2024-09-17T03:11:17.164 DEBUG:tasks.cephfs.test_multimds_misc:current active=['b', 'd', 'a'] 2024-09-17T03:11:17.164 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:11:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.276+0000 7f99e3ed5640 1 -- 172.21.15.78:0/1998878841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99dc15f7e0 msgr2=0x7f99dc0ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.276+0000 7f99e3ed5640 1 --2- 172.21.15.78:0/1998878841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99dc15f7e0 0x7f99dc0ce680 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f99dc0cbe10 tx=0x7f99d402aac0 comp rx=0 tx=0).stop 2024-09-17T03:11:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.276+0000 7f99e3ed5640 1 -- 172.21.15.78:0/1998878841 shutdown_connections 2024-09-17T03:11:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.276+0000 7f99e3ed5640 1 --2- 172.21.15.78:0/1998878841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99dc15f7e0 0x7f99dc0ce680 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.276+0000 7f99e3ed5640 1 --2- 172.21.15.78:0/1998878841 >> v2:172.21.15.193:3300/0 conn(0x7f99dc070e40 0x7f99dc15f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.276+0000 7f99e3ed5640 1 -- 172.21.15.78:0/1998878841 >> 172.21.15.78:0/1998878841 conn(0x7f99dc0cd530 msgr2=0x7f99dc0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.276+0000 7f99e3ed5640 1 -- 172.21.15.78:0/1998878841 shutdown_connections 2024-09-17T03:11:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.276+0000 7f99e3ed5640 1 -- 172.21.15.78:0/1998878841 wait complete. 2024-09-17T03:11:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.278+0000 7f99e3ed5640 1 Processor -- start 2024-09-17T03:11:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.278+0000 7f99e3ed5640 1 -- start start 2024-09-17T03:11:17.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.279+0000 7f99e3ed5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99dc070e40 0x7f99dc140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:17.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.279+0000 7f99e3ed5640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99dc075fa0 0x7f99dc1f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99e3ed5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99dc15f7e0 0x7f99dc0b1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99e3ed5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc0cef50 con 0x7f99dc15f7e0 2024-09-17T03:11:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99e3ed5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc0cedd0 con 0x7f99dc070e40 2024-09-17T03:11:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99e3ed5640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f99dc0cf0d0 con 0x7f99dc075fa0 2024-09-17T03:11:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99e2472640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99dc15f7e0 0x7f99dc0b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99e2472640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99dc15f7e0 0x7f99dc0b1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54584/0 (socket says 172.21.15.78:54584) 2024-09-17T03:11:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99e2472640 1 -- 172.21.15.78:0/796675742 learned_addr learned my addr 172.21.15.78:0/796675742 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99e1c71640 1 --2- 172.21.15.78:0/796675742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99dc070e40 0x7f99dc140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99e1470640 1 --2- 172.21.15.78:0/796675742 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99dc075fa0 0x7f99dc1f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99e2472640 1 -- 172.21.15.78:0/796675742 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99dc075fa0 msgr2=0x7f99dc1f2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99e2472640 1 --2- 172.21.15.78:0/796675742 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99dc075fa0 0x7f99dc1f2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99e2472640 1 -- 172.21.15.78:0/796675742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99dc070e40 msgr2=0x7f99dc140dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99e2472640 1 --2- 172.21.15.78:0/796675742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99dc070e40 0x7f99dc140dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99e2472640 1 -- 172.21.15.78:0/796675742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99dc1f35a0 con 0x7f99dc15f7e0 2024-09-17T03:11:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99e1c71640 1 --2- 172.21.15.78:0/796675742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99dc070e40 0x7f99dc140dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99e2472640 1 --2- 172.21.15.78:0/796675742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99dc15f7e0 0x7f99dc0b1850 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f99d402b0b0 tx=0x7f99d4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99d27fc640 1 -- 172.21.15.78:0/796675742 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d4004250 con 0x7f99dc15f7e0 2024-09-17T03:11:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99d27fc640 1 -- 172.21.15.78:0/796675742 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99d40043f0 con 0x7f99dc15f7e0 2024-09-17T03:11:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99d27fc640 1 -- 172.21.15.78:0/796675742 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d4004820 con 0x7f99dc15f7e0 2024-09-17T03:11:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99e3ed5640 1 -- 172.21.15.78:0/796675742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99dc1437c0 con 0x7f99dc15f7e0 2024-09-17T03:11:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.280+0000 7f99e3ed5640 1 -- 172.21.15.78:0/796675742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99dc1442a0 con 0x7f99dc15f7e0 2024-09-17T03:11:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.281+0000 7f99e3ed5640 1 -- 172.21.15.78:0/796675742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99dc144560 con 0x7f99dc15f7e0 2024-09-17T03:11:17.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.282+0000 7f99d27fc640 1 -- 172.21.15.78:0/796675742 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f99d404b440 con 0x7f99dc15f7e0 2024-09-17T03:11:17.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.282+0000 7f99d27fc640 1 --2- 172.21.15.78:0/796675742 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f99c0078b90 0x7f99c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:17.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.283+0000 7f99d27fc640 1 -- 172.21.15.78:0/796675742 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f99d40bde50 con 0x7f99dc15f7e0 2024-09-17T03:11:17.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.283+0000 7f99e1c71640 1 --2- 172.21.15.78:0/796675742 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f99c0078b90 0x7f99c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:17.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.283+0000 7f99e1c71640 1 --2- 172.21.15.78:0/796675742 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f99c0078b90 0x7f99c007b0a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f99d80016a0 tx=0x7f99d8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:17.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.287+0000 7f99d27fc640 1 -- 172.21.15.78:0/796675742 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f99dc15fbf0 con 0x7f99dc15f7e0 2024-09-17T03:11:17.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.529+0000 7f99e3ed5640 1 -- 172.21.15.78:0/796675742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f99dc1f3330 con 0x7f99dc15f7e0 2024-09-17T03:11:17.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.529+0000 7f99d27fc640 1 -- 172.21.15.78:0/796675742 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1913 (secure 0 0 0) 0x7f99d4032030 con 0x7f99dc15f7e0 2024-09-17T03:11:17.528 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:17.529 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":194,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":47,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":706268,"bytes_used":235868160,"bytes_avail":772858245120,"bytes_total":773094113280,"write_bytes_sec":1023,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":38,"btime":"2024-09-17T03:11:03:747649+0000","id":3,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":3,"rank":2,"name":"a","status":"up:active","gid":5036},{"filesystem_id":3,"rank":1,"name":"d","status":"up:active","gid":5039},{"filesystem_id":3,"rank":0,"name":"b","status":"up:active","gid":5565}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2024-09-17T03:11:15.163967+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:11:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.532+0000 7f99e3ed5640 1 -- 172.21.15.78:0/796675742 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f99c0078b90 msgr2=0x7f99c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.532+0000 7f99e3ed5640 1 --2- 172.21.15.78:0/796675742 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f99c0078b90 0x7f99c007b0a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f99d80016a0 tx=0x7f99d8009040 comp rx=0 tx=0).stop 2024-09-17T03:11:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.532+0000 7f99e3ed5640 1 -- 172.21.15.78:0/796675742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99dc15f7e0 msgr2=0x7f99dc0b1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.532+0000 7f99e3ed5640 1 --2- 172.21.15.78:0/796675742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99dc15f7e0 0x7f99dc0b1850 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f99d402b0b0 tx=0x7f99d4003f10 comp rx=0 tx=0).stop 2024-09-17T03:11:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.532+0000 7f99e3ed5640 1 -- 172.21.15.78:0/796675742 shutdown_connections 2024-09-17T03:11:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.532+0000 7f99e3ed5640 1 --2- 172.21.15.78:0/796675742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99dc15f7e0 0x7f99dc0b1850 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.532+0000 7f99e3ed5640 1 --2- 172.21.15.78:0/796675742 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99dc075fa0 0x7f99dc1f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.532+0000 7f99e3ed5640 1 --2- 172.21.15.78:0/796675742 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f99c0078b90 0x7f99c007b0a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:17.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.532+0000 7f99e3ed5640 1 --2- 172.21.15.78:0/796675742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f99dc070e40 0x7f99dc140dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.532+0000 7f99e3ed5640 1 -- 172.21.15.78:0/796675742 >> 172.21.15.78:0/796675742 conn(0x7f99dc0cd530 msgr2=0x7f99dc15dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.532+0000 7f99e3ed5640 1 -- 172.21.15.78:0/796675742 shutdown_connections 2024-09-17T03:11:17.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.532+0000 7f99e3ed5640 1 -- 172.21.15.78:0/796675742 wait complete. 2024-09-17T03:11:17.542 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'idle+waiting paths [/d1/d2/d3]'} 2024-09-17T03:11:17.542 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:11:17.542 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:11:17.580 DEBUG:teuthology.orchestra.run.smithi193:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:11:17.625 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:11:17.625 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:11:17.625 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:11:17.625 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:11:17.642 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:11:17.642 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:11:17.701 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:11:17.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.856+0000 7fb96b430640 1 -- 172.21.15.78:0/1973081086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9640d08e0 msgr2=0x7fb96415f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:17.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.856+0000 7fb96b430640 1 --2- 172.21.15.78:0/1973081086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9640d08e0 0x7fb96415f0a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fb95c005fd0 tx=0x7fb95c02a820 comp rx=0 tx=0).stop 2024-09-17T03:11:17.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.856+0000 7fb96b430640 1 -- 172.21.15.78:0/1973081086 shutdown_connections 2024-09-17T03:11:17.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.856+0000 7fb96b430640 1 --2- 172.21.15.78:0/1973081086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9640d08e0 0x7fb96415f0a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:17.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.856+0000 7fb96b430640 1 -- 172.21.15.78:0/1973081086 >> 172.21.15.78:0/1973081086 conn(0x7fb96406d4f0 msgr2=0x7fb964071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:17.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.856+0000 7fb96b430640 1 -- 172.21.15.78:0/1973081086 shutdown_connections 2024-09-17T03:11:17.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.856+0000 7fb96b430640 1 -- 172.21.15.78:0/1973081086 wait complete. 2024-09-17T03:11:17.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.858+0000 7fb96b430640 1 Processor -- start 2024-09-17T03:11:17.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.858+0000 7fb96b430640 1 -- start start 2024-09-17T03:11:17.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.859+0000 7fb96b430640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9640cf050 0x7fb96415a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:17.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.859+0000 7fb96b430640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb964148880 0x7fb9640cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:17.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.859+0000 7fb96b430640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb964161dc0 0x7fb9641621d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:17.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.859+0000 7fb96b430640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb964160440 con 0x7fb964148880 2024-09-17T03:11:17.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.859+0000 7fb96b430640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb9641602c0 con 0x7fb964161dc0 2024-09-17T03:11:17.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.859+0000 7fb96b430640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb9641605c0 con 0x7fb9640cf050 2024-09-17T03:11:17.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.860+0000 7fb9689cb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb964148880 0x7fb9640cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:17.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.860+0000 7fb9689cb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb964148880 0x7fb9640cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54614/0 (socket says 172.21.15.78:54614) 2024-09-17T03:11:17.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.860+0000 7fb9689cb640 1 -- 172.21.15.78:0/269469589 learned_addr learned my addr 172.21.15.78:0/269469589 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:17.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.860+0000 7fb9691cc640 1 --2- 172.21.15.78:0/269469589 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9640cf050 0x7fb96415a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:17.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.860+0000 7fb9699cd640 1 --2- 172.21.15.78:0/269469589 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb964161dc0 0x7fb9641621d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:17.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.860+0000 7fb9689cb640 1 -- 172.21.15.78:0/269469589 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9640cf050 msgr2=0x7fb96415a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:17.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.860+0000 7fb9689cb640 1 --2- 172.21.15.78:0/269469589 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9640cf050 0x7fb96415a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:17.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.860+0000 7fb9689cb640 1 -- 172.21.15.78:0/269469589 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb964161dc0 msgr2=0x7fb9641621d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:17.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.860+0000 7fb9689cb640 1 --2- 172.21.15.78:0/269469589 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb964161dc0 0x7fb9641621d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:17.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.860+0000 7fb9689cb640 1 -- 172.21.15.78:0/269469589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb964162710 con 0x7fb964148880 2024-09-17T03:11:17.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.860+0000 7fb9689cb640 1 --2- 172.21.15.78:0/269469589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb964148880 0x7fb9640cb920 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb95400c3a0 tx=0x7fb95400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:17.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.860+0000 7fb959ffb640 1 -- 172.21.15.78:0/269469589 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb954011790 con 0x7fb964148880 2024-09-17T03:11:17.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.860+0000 7fb959ffb640 1 -- 172.21.15.78:0/269469589 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb954017070 con 0x7fb964148880 2024-09-17T03:11:17.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.860+0000 7fb96b430640 1 -- 172.21.15.78:0/269469589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb964145770 con 0x7fb964148880 2024-09-17T03:11:17.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.860+0000 7fb959ffb640 1 -- 172.21.15.78:0/269469589 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb954011ce0 con 0x7fb964148880 2024-09-17T03:11:17.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.860+0000 7fb96b430640 1 -- 172.21.15.78:0/269469589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb964145d30 con 0x7fb964148880 2024-09-17T03:11:17.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.861+0000 7fb96b430640 1 -- 172.21.15.78:0/269469589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb964160b60 con 0x7fb964148880 2024-09-17T03:11:17.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.862+0000 7fb959ffb640 1 -- 172.21.15.78:0/269469589 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb95401c460 con 0x7fb964148880 2024-09-17T03:11:17.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.862+0000 7fb959ffb640 1 --2- 172.21.15.78:0/269469589 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb948078b90 0x7fb94807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:17.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.862+0000 7fb959ffb640 1 -- 172.21.15.78:0/269469589 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fb95409ab90 con 0x7fb964148880 2024-09-17T03:11:17.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.863+0000 7fb9691cc640 1 --2- 172.21.15.78:0/269469589 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb948078b90 0x7fb94807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:17.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.863+0000 7fb9691cc640 1 --2- 172.21.15.78:0/269469589 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb948078b90 0x7fb94807b0a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb960006fd0 tx=0x7fb960008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:17.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:17.867+0000 7fb959ffb640 1 -- 172.21.15.78:0/269469589 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb964162710 con 0x7fb964148880 2024-09-17T03:11:18.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.051+0000 7fb96b430640 1 -- 172.21.15.78:0/269469589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb964145500 con 0x7fb964148880 2024-09-17T03:11:18.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.052+0000 7fb959ffb640 1 -- 172.21.15.78:0/269469589 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) ==== 80+0+0 (secure 0 0 0) 0x7fb954062f90 con 0x7fb964148880 2024-09-17T03:11:18.050 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-09-17T03:11:18.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.054+0000 7fb96b430640 1 -- 172.21.15.78:0/269469589 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb948078b90 msgr2=0x7fb94807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:18.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.054+0000 7fb96b430640 1 --2- 172.21.15.78:0/269469589 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb948078b90 0x7fb94807b0a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb960006fd0 tx=0x7fb960008040 comp rx=0 tx=0).stop 2024-09-17T03:11:18.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.054+0000 7fb96b430640 1 -- 172.21.15.78:0/269469589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb964148880 msgr2=0x7fb9640cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:18.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.054+0000 7fb96b430640 1 --2- 172.21.15.78:0/269469589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb964148880 0x7fb9640cb920 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fb95400c3a0 tx=0x7fb95400c860 comp rx=0 tx=0).stop 2024-09-17T03:11:18.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.054+0000 7fb96b430640 1 -- 172.21.15.78:0/269469589 shutdown_connections 2024-09-17T03:11:18.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.054+0000 7fb96b430640 1 --2- 172.21.15.78:0/269469589 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb948078b90 0x7fb94807b0a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:18.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.054+0000 7fb96b430640 1 --2- 172.21.15.78:0/269469589 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb964161dc0 0x7fb9641621d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:18.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.054+0000 7fb96b430640 1 --2- 172.21.15.78:0/269469589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb964148880 0x7fb9640cb920 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:18.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.054+0000 7fb96b430640 1 --2- 172.21.15.78:0/269469589 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9640cf050 0x7fb96415a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:18.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.054+0000 7fb96b430640 1 -- 172.21.15.78:0/269469589 >> 172.21.15.78:0/269469589 conn(0x7fb96406d4f0 msgr2=0x7fb9640d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:18.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.054+0000 7fb96b430640 1 -- 172.21.15.78:0/269469589 shutdown_connections 2024-09-17T03:11:18.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.054+0000 7fb96b430640 1 -- 172.21.15.78:0/269469589 wait complete. 2024-09-17T03:11:18.064 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:11:18.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:11:18.064 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:11:18.094 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T03:11:18.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:11:18.094 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:11:18.150 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:11:18.151 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:11:18.151 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:11:18.170 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:11:18.170 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:11:18.170 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:11:18.170 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:11:18.207 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056010,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1013 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:11:18.207 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:11:18.207 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:11:18.207 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:11:18.229 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:11:18.229 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:11:18.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.362+0000 7ff7e6030640 1 -- 172.21.15.78:0/345076833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7c8004d40 msgr2=0x7ff7c8005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:18.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.362+0000 7ff7e6030640 1 --2- 172.21.15.78:0/345076833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7c8004d40 0x7ff7c8005150 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8009b20 tx=0x7ff7c8005830 comp rx=0 tx=0).stop 2024-09-17T03:11:18.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.362+0000 7ff7dffff640 1 -- 172.21.15.78:0/345076833 reap_dead start 2024-09-17T03:11:18.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.362+0000 7ff7e6030640 1 -- 172.21.15.78:0/345076833 shutdown_connections 2024-09-17T03:11:18.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.362+0000 7ff7e6030640 1 -- 172.21.15.78:0/345076833 >> 172.21.15.78:0/345076833 conn(0x7ff7e00b1cb0 msgr2=0x7ff7e00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:18.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.363+0000 7ff7e6030640 1 -- 172.21.15.78:0/345076833 shutdown_connections 2024-09-17T03:11:18.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.363+0000 7ff7e6030640 1 -- 172.21.15.78:0/345076833 wait complete. 2024-09-17T03:11:18.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.364+0000 7ff7e6030640 1 Processor -- start 2024-09-17T03:11:18.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.365+0000 7ff7e6030640 1 -- start start 2024-09-17T03:11:18.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.366+0000 7ff7e6030640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7c8004d40 0x7ff7e00c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:18.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.366+0000 7ff7e6030640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7e01504c0 0x7ff7e009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:18.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.366+0000 7ff7e6030640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff7e01508d0 0x7ff7e00c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:18.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.366+0000 7ff7e6030640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e00b3420 con 0x7ff7c8004d40 2024-09-17T03:11:18.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.366+0000 7ff7e6030640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e00b32a0 con 0x7ff7e01504c0 2024-09-17T03:11:18.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.366+0000 7ff7e6030640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff7e00b35a0 con 0x7ff7e01508d0 2024-09-17T03:11:18.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.366+0000 7ff7df7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7c8004d40 0x7ff7e00c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:18.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.366+0000 7ff7df7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7c8004d40 0x7ff7e00c4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54632/0 (socket says 172.21.15.78:54632) 2024-09-17T03:11:18.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.366+0000 7ff7df7fe640 1 -- 172.21.15.78:0/326226098 learned_addr learned my addr 172.21.15.78:0/326226098 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:18.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.366+0000 7ff7deffd640 1 --2- 172.21.15.78:0/326226098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7e01504c0 0x7ff7e009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:18.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.366+0000 7ff7dffff640 1 --2- 172.21.15.78:0/326226098 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff7e01508d0 0x7ff7e00c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:18.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.366+0000 7ff7df7fe640 1 -- 172.21.15.78:0/326226098 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff7e01508d0 msgr2=0x7ff7e00c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:18.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.366+0000 7ff7df7fe640 1 --2- 172.21.15.78:0/326226098 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff7e01508d0 0x7ff7e00c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:18.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.366+0000 7ff7df7fe640 1 -- 172.21.15.78:0/326226098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7e01504c0 msgr2=0x7ff7e009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:18.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.366+0000 7ff7df7fe640 1 --2- 172.21.15.78:0/326226098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7e01504c0 0x7ff7e009aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:18.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.366+0000 7ff7df7fe640 1 -- 172.21.15.78:0/326226098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e00c53f0 con 0x7ff7c8004d40 2024-09-17T03:11:18.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.366+0000 7ff7df7fe640 1 --2- 172.21.15.78:0/326226098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7c8004d40 0x7ff7e00c4eb0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0001330 tx=0x7ff7d000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:18.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.367+0000 7ff7c7fff640 1 -- 172.21.15.78:0/326226098 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0015070 con 0x7ff7c8004d40 2024-09-17T03:11:18.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.367+0000 7ff7c7fff640 1 -- 172.21.15.78:0/326226098 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7d000ce20 con 0x7ff7c8004d40 2024-09-17T03:11:18.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.367+0000 7ff7e6030640 1 -- 172.21.15.78:0/326226098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7e00c3e10 con 0x7ff7c8004d40 2024-09-17T03:11:18.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.367+0000 7ff7c7fff640 1 -- 172.21.15.78:0/326226098 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d00116a0 con 0x7ff7c8004d40 2024-09-17T03:11:18.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.367+0000 7ff7e6030640 1 -- 172.21.15.78:0/326226098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7e00c43d0 con 0x7ff7c8004d40 2024-09-17T03:11:18.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.368+0000 7ff7e6030640 1 -- 172.21.15.78:0/326226098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7e00c3860 con 0x7ff7c8004d40 2024-09-17T03:11:18.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.368+0000 7ff7c7fff640 1 -- 172.21.15.78:0/326226098 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff7d0018070 con 0x7ff7c8004d40 2024-09-17T03:11:18.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.369+0000 7ff7c7fff640 1 --2- 172.21.15.78:0/326226098 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff7cc078b90 0x7ff7cc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:18.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.369+0000 7ff7c7fff640 1 -- 172.21.15.78:0/326226098 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7ff7d009b620 con 0x7ff7c8004d40 2024-09-17T03:11:18.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.369+0000 7ff7deffd640 1 --2- 172.21.15.78:0/326226098 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff7cc078b90 0x7ff7cc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:18.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.370+0000 7ff7deffd640 1 --2- 172.21.15.78:0/326226098 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff7cc078b90 0x7ff7cc07b0a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff7e015bb80 tx=0x7ff7d4005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:18.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.373+0000 7ff7c7fff640 1 -- 172.21.15.78:0/326226098 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff7d0063a30 con 0x7ff7c8004d40 2024-09-17T03:11:18.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.580+0000 7ff7e6030640 1 -- 172.21.15.78:0/326226098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7e00b2310 con 0x7ff7c8004d40 2024-09-17T03:11:18.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.581+0000 7ff7c7fff640 1 -- 172.21.15.78:0/326226098 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5276 (secure 0 0 0) 0x7ff7d0063330 con 0x7ff7c8004d40 2024-09-17T03:11:18.580 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:18.580 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":38,"btime":"2024-09-17T03:11:03:747649+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/2973955781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2973955781},{"type":"v1","addr":"172.21.15.78:6834","nonce":2973955781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:10:25.982190+0000","modified":"2024-09-17T03:11:03.696960+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5565,"mds_1":5039,"mds_2":5036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5036":{"gid":5036,"name":"a","rank":2,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.78:6835/3629327943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3629327943},{"type":"v1","addr":"172.21.15.78:6835","nonce":3629327943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5039":{"gid":5039,"name":"d","rank":1,"incarnation":31,"state":"up:active","state_seq":12,"addr":"172.21.15.193:6837/3209848332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":3209848332},{"type":"v1","addr":"172.21.15.193:6837","nonce":3209848332}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5565":{"gid":5565,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":12,"addr":"172.21.15.193:6836/1788096053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1788096053},{"type":"v1","addr":"172.21.15.193:6836","nonce":1788096053}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5565,"qdb_cluster":[5036,5039,5565]},"id":3}]} 2024-09-17T03:11:18.580 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 38 2024-09-17T03:11:18.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.583+0000 7ff7e6030640 1 -- 172.21.15.78:0/326226098 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff7cc078b90 msgr2=0x7ff7cc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:18.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.583+0000 7ff7e6030640 1 --2- 172.21.15.78:0/326226098 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff7cc078b90 0x7ff7cc07b0a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff7e015bb80 tx=0x7ff7d4005f90 comp rx=0 tx=0).stop 2024-09-17T03:11:18.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.583+0000 7ff7e6030640 1 -- 172.21.15.78:0/326226098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7c8004d40 msgr2=0x7ff7e00c4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:18.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.583+0000 7ff7e6030640 1 --2- 172.21.15.78:0/326226098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7c8004d40 0x7ff7e00c4eb0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0001330 tx=0x7ff7d000ee20 comp rx=0 tx=0).stop 2024-09-17T03:11:18.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.583+0000 7ff7e6030640 1 -- 172.21.15.78:0/326226098 shutdown_connections 2024-09-17T03:11:18.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.583+0000 7ff7e6030640 1 --2- 172.21.15.78:0/326226098 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff7e01508d0 0x7ff7e00c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:18.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.583+0000 7ff7e6030640 1 --2- 172.21.15.78:0/326226098 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff7cc078b90 0x7ff7cc07b0a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:18.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.583+0000 7ff7e6030640 1 --2- 172.21.15.78:0/326226098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7e01504c0 0x7ff7e009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:18.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.583+0000 7ff7e6030640 1 --2- 172.21.15.78:0/326226098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7c8004d40 0x7ff7e00c4eb0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:18.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.583+0000 7ff7e6030640 1 -- 172.21.15.78:0/326226098 >> 172.21.15.78:0/326226098 conn(0x7ff7e00b1cb0 msgr2=0x7ff7e015ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:18.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.584+0000 7ff7e6030640 1 -- 172.21.15.78:0/326226098 shutdown_connections 2024-09-17T03:11:18.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.584+0000 7ff7e6030640 1 -- 172.21.15.78:0/326226098 wait complete. 2024-09-17T03:11:18.594 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:11:18.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.709+0000 7f0752939640 1 -- 172.21.15.78:0/1917594965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f074c15d840 msgr2=0x7f074c0b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:18.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.709+0000 7f0752939640 1 --2- 172.21.15.78:0/1917594965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f074c15d840 0x7f074c0b7490 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0744005fd0 tx=0x7f074402aa00 comp rx=0 tx=0).stop 2024-09-17T03:11:18.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.709+0000 7f0752939640 1 -- 172.21.15.78:0/1917594965 shutdown_connections 2024-09-17T03:11:18.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.709+0000 7f0752939640 1 --2- 172.21.15.78:0/1917594965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f074c15d840 0x7f074c0b7490 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:18.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.709+0000 7f0752939640 1 --2- 172.21.15.78:0/1917594965 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f074c1570e0 0x7f074c0d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:18.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.709+0000 7f0752939640 1 -- 172.21.15.78:0/1917594965 >> 172.21.15.78:0/1917594965 conn(0x7f074c06d550 msgr2=0x7f074c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:18.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.709+0000 7f0752939640 1 -- 172.21.15.78:0/1917594965 shutdown_connections 2024-09-17T03:11:18.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.709+0000 7f0752939640 1 -- 172.21.15.78:0/1917594965 wait complete. 2024-09-17T03:11:18.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.711+0000 7f0752939640 1 Processor -- start 2024-09-17T03:11:18.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.711+0000 7f0752939640 1 -- start start 2024-09-17T03:11:18.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.712+0000 7f0752939640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f074c0d2460 0x7f074c1f36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:18.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.712+0000 7f0752939640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f074c1570e0 0x7f074c0b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:18.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.712+0000 7f0752939640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f074c15d840 0x7f074c0b4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:18.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.712+0000 7f0752939640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f074c0b7d60 con 0x7f074c1570e0 2024-09-17T03:11:18.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.712+0000 7f0752939640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f074c0b7be0 con 0x7f074c15d840 2024-09-17T03:11:18.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.712+0000 7f0752939640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f074c0b7ee0 con 0x7f074c0d2460 2024-09-17T03:11:18.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.712+0000 7f074b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f074c1570e0 0x7f074c0b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:18.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.712+0000 7f074b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f074c1570e0 0x7f074c0b3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54652/0 (socket says 172.21.15.78:54652) 2024-09-17T03:11:18.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.712+0000 7f074b7fe640 1 -- 172.21.15.78:0/3940131136 learned_addr learned my addr 172.21.15.78:0/3940131136 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:18.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.712+0000 7f074bfff640 1 --2- 172.21.15.78:0/3940131136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f074c0d2460 0x7f074c1f36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:18.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.712+0000 7f0750ed6640 1 --2- 172.21.15.78:0/3940131136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f074c15d840 0x7f074c0b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:18.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.712+0000 7f074b7fe640 1 -- 172.21.15.78:0/3940131136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f074c0d2460 msgr2=0x7f074c1f36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:18.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.712+0000 7f074b7fe640 1 --2- 172.21.15.78:0/3940131136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f074c0d2460 0x7f074c1f36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:18.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.712+0000 7f074b7fe640 1 -- 172.21.15.78:0/3940131136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f074c15d840 msgr2=0x7f074c0b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:18.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.712+0000 7f074b7fe640 1 --2- 172.21.15.78:0/3940131136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f074c15d840 0x7f074c0b4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:18.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.712+0000 7f074b7fe640 1 -- 172.21.15.78:0/3940131136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f074c1f3be0 con 0x7f074c1570e0 2024-09-17T03:11:18.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.712+0000 7f074bfff640 1 --2- 172.21.15.78:0/3940131136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f074c0d2460 0x7f074c1f36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:18.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.713+0000 7f074b7fe640 1 --2- 172.21.15.78:0/3940131136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f074c1570e0 0x7f074c0b3e00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f074000b3e0 tx=0x7f074000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:18.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.713+0000 7f0748ff9640 1 -- 172.21.15.78:0/3940131136 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0740015020 con 0x7f074c1570e0 2024-09-17T03:11:18.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.713+0000 7f0748ff9640 1 -- 172.21.15.78:0/3940131136 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0740011940 con 0x7f074c1570e0 2024-09-17T03:11:18.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.713+0000 7f0752939640 1 -- 172.21.15.78:0/3940131136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f074c0b3040 con 0x7f074c1570e0 2024-09-17T03:11:18.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.713+0000 7f0748ff9640 1 -- 172.21.15.78:0/3940131136 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0740011d90 con 0x7f074c1570e0 2024-09-17T03:11:18.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.713+0000 7f0752939640 1 -- 172.21.15.78:0/3940131136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f074c0b3600 con 0x7f074c1570e0 2024-09-17T03:11:18.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.714+0000 7f0752939640 1 -- 172.21.15.78:0/3940131136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f074c0d1f20 con 0x7f074c1570e0 2024-09-17T03:11:18.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.715+0000 7f0748ff9640 1 -- 172.21.15.78:0/3940131136 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0740018020 con 0x7f074c1570e0 2024-09-17T03:11:18.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.715+0000 7f0748ff9640 1 --2- 172.21.15.78:0/3940131136 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0738078bc0 0x7f073807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:18.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.715+0000 7f0748ff9640 1 -- 172.21.15.78:0/3940131136 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f074009ac40 con 0x7f074c1570e0 2024-09-17T03:11:18.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.715+0000 7f074bfff640 1 --2- 172.21.15.78:0/3940131136 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0738078bc0 0x7f073807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:18.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.716+0000 7f074bfff640 1 --2- 172.21.15.78:0/3940131136 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0738078bc0 0x7f073807b0d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f073c005fd0 tx=0x7f073c005e00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:18.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.720+0000 7f0748ff9640 1 -- 172.21.15.78:0/3940131136 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f074001f020 con 0x7f074c1570e0 2024-09-17T03:11:18.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.930+0000 7f0752939640 1 -- 172.21.15.78:0/3940131136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f074c0cdb70 con 0x7f074c1570e0 2024-09-17T03:11:18.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.930+0000 7f0748ff9640 1 -- 172.21.15.78:0/3940131136 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5276 (secure 0 0 0) 0x7f07400630d0 con 0x7f074c1570e0 2024-09-17T03:11:18.930 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:18.930 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":38,"btime":"2024-09-17T03:11:03:747649+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/2973955781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2973955781},{"type":"v1","addr":"172.21.15.78:6834","nonce":2973955781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:10:25.982190+0000","modified":"2024-09-17T03:11:03.696960+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5565,"mds_1":5039,"mds_2":5036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5036":{"gid":5036,"name":"a","rank":2,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.78:6835/3629327943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3629327943},{"type":"v1","addr":"172.21.15.78:6835","nonce":3629327943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5039":{"gid":5039,"name":"d","rank":1,"incarnation":31,"state":"up:active","state_seq":12,"addr":"172.21.15.193:6837/3209848332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":3209848332},{"type":"v1","addr":"172.21.15.193:6837","nonce":3209848332}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5565":{"gid":5565,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":12,"addr":"172.21.15.193:6836/1788096053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1788096053},{"type":"v1","addr":"172.21.15.193:6836","nonce":1788096053}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5565,"qdb_cluster":[5036,5039,5565]},"id":3}]} 2024-09-17T03:11:18.930 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 38 2024-09-17T03:11:18.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.932+0000 7f0752939640 1 -- 172.21.15.78:0/3940131136 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0738078bc0 msgr2=0x7f073807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:18.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.932+0000 7f0752939640 1 --2- 172.21.15.78:0/3940131136 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0738078bc0 0x7f073807b0d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f073c005fd0 tx=0x7f073c005e00 comp rx=0 tx=0).stop 2024-09-17T03:11:18.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.932+0000 7f0752939640 1 -- 172.21.15.78:0/3940131136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f074c1570e0 msgr2=0x7f074c0b3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:18.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.932+0000 7f0752939640 1 --2- 172.21.15.78:0/3940131136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f074c1570e0 0x7f074c0b3e00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f074000b3e0 tx=0x7f074000b8a0 comp rx=0 tx=0).stop 2024-09-17T03:11:18.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.932+0000 7f0752939640 1 -- 172.21.15.78:0/3940131136 shutdown_connections 2024-09-17T03:11:18.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.932+0000 7f0752939640 1 --2- 172.21.15.78:0/3940131136 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0738078bc0 0x7f073807b0d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:18.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.932+0000 7f0752939640 1 --2- 172.21.15.78:0/3940131136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f074c15d840 0x7f074c0b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:18.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.932+0000 7f0752939640 1 --2- 172.21.15.78:0/3940131136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f074c1570e0 0x7f074c0b3e00 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:18.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.932+0000 7f0752939640 1 --2- 172.21.15.78:0/3940131136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f074c0d2460 0x7f074c1f36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:18.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.932+0000 7f0752939640 1 -- 172.21.15.78:0/3940131136 >> 172.21.15.78:0/3940131136 conn(0x7f074c06d550 msgr2=0x7f074c0d0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:18.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.932+0000 7f0752939640 1 -- 172.21.15.78:0/3940131136 shutdown_connections 2024-09-17T03:11:18.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:18.932+0000 7f0752939640 1 -- 172.21.15.78:0/3940131136 wait complete. 2024-09-17T03:11:18.943 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:11:19.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.056+0000 7f469092b640 1 -- 172.21.15.78:0/3185837653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f468c075fa0 msgr2=0x7f468c070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:19.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.056+0000 7f469092b640 1 --2- 172.21.15.78:0/3185837653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f468c075fa0 0x7f468c070e40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f468c0cbe10 tx=0x7f467c02aa50 comp rx=0 tx=0).stop 2024-09-17T03:11:19.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.056+0000 7f469092b640 1 -- 172.21.15.78:0/3185837653 shutdown_connections 2024-09-17T03:11:19.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.056+0000 7f469092b640 1 --2- 172.21.15.78:0/3185837653 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f468c15f7e0 0x7f468c15bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.056+0000 7f469092b640 1 --2- 172.21.15.78:0/3185837653 >> v2:172.21.15.193:3300/0 conn(0x7f468c06e100 0x7f468c15f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.056+0000 7f469092b640 1 --2- 172.21.15.78:0/3185837653 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f468c075fa0 0x7f468c070e40 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.056+0000 7f469092b640 1 -- 172.21.15.78:0/3185837653 >> 172.21.15.78:0/3185837653 conn(0x7f468c0cd530 msgr2=0x7f468c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:19.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.056+0000 7f469092b640 1 -- 172.21.15.78:0/3185837653 shutdown_connections 2024-09-17T03:11:19.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.056+0000 7f469092b640 1 -- 172.21.15.78:0/3185837653 wait complete. 2024-09-17T03:11:19.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.058+0000 7f469092b640 1 Processor -- start 2024-09-17T03:11:19.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.058+0000 7f469092b640 1 -- start start 2024-09-17T03:11:19.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.059+0000 7f469092b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f468c06e100 0x7f468c0b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:19.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.059+0000 7f469092b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f468c075fa0 0x7f468c0b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:19.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.059+0000 7f469092b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f468c15f7e0 0x7f468c0ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:19.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.059+0000 7f469092b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f468c15c400 con 0x7f468c075fa0 2024-09-17T03:11:19.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.059+0000 7f469092b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f468c0cc520 con 0x7f468c06e100 2024-09-17T03:11:19.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.059+0000 7f469092b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f468c15c580 con 0x7f468c15f7e0 2024-09-17T03:11:19.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.060+0000 7f4689d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f468c075fa0 0x7f468c0b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:19.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.060+0000 7f4689d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f468c075fa0 0x7f468c0b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54662/0 (socket says 172.21.15.78:54662) 2024-09-17T03:11:19.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.060+0000 7f4689d9b640 1 -- 172.21.15.78:0/453743727 learned_addr learned my addr 172.21.15.78:0/453743727 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:19.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.060+0000 7f468ad9d640 1 --2- 172.21.15.78:0/453743727 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f468c15f7e0 0x7f468c0ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:19.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.060+0000 7f468a59c640 1 --2- 172.21.15.78:0/453743727 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f468c06e100 0x7f468c0b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:19.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.060+0000 7f4689d9b640 1 -- 172.21.15.78:0/453743727 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f468c15f7e0 msgr2=0x7f468c0ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:19.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.060+0000 7f4689d9b640 1 --2- 172.21.15.78:0/453743727 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f468c15f7e0 0x7f468c0ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.060+0000 7f4689d9b640 1 -- 172.21.15.78:0/453743727 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f468c06e100 msgr2=0x7f468c0b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:19.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.060+0000 7f4689d9b640 1 --2- 172.21.15.78:0/453743727 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f468c06e100 0x7f468c0b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.060+0000 7f4689d9b640 1 -- 172.21.15.78:0/453743727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f468c153b50 con 0x7f468c075fa0 2024-09-17T03:11:19.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.060+0000 7f468a59c640 1 --2- 172.21.15.78:0/453743727 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f468c06e100 0x7f468c0b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:19.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.060+0000 7f4689d9b640 1 --2- 172.21.15.78:0/453743727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f468c075fa0 0x7f468c0b5450 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f468000b440 tx=0x7f468000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:19.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.060+0000 7f467affd640 1 -- 172.21.15.78:0/453743727 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4680015020 con 0x7f468c075fa0 2024-09-17T03:11:19.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.060+0000 7f467affd640 1 -- 172.21.15.78:0/453743727 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4680011980 con 0x7f468c075fa0 2024-09-17T03:11:19.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.060+0000 7f469092b640 1 -- 172.21.15.78:0/453743727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f468c158550 con 0x7f468c075fa0 2024-09-17T03:11:19.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.060+0000 7f467affd640 1 -- 172.21.15.78:0/453743727 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4680011dd0 con 0x7f468c075fa0 2024-09-17T03:11:19.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.060+0000 7f469092b640 1 -- 172.21.15.78:0/453743727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f468c158b10 con 0x7f468c075fa0 2024-09-17T03:11:19.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.061+0000 7f469092b640 1 -- 172.21.15.78:0/453743727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f468c15cb20 con 0x7f468c075fa0 2024-09-17T03:11:19.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.062+0000 7f467affd640 1 -- 172.21.15.78:0/453743727 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4680018020 con 0x7f468c075fa0 2024-09-17T03:11:19.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.062+0000 7f467affd640 1 --2- 172.21.15.78:0/453743727 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f466c078b90 0x7f466c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:19.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.063+0000 7f467affd640 1 -- 172.21.15.78:0/453743727 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f468009af50 con 0x7f468c075fa0 2024-09-17T03:11:19.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.063+0000 7f468a59c640 1 --2- 172.21.15.78:0/453743727 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f466c078b90 0x7f466c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:19.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.063+0000 7f468a59c640 1 --2- 172.21.15.78:0/453743727 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f466c078b90 0x7f466c07b0a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f467c035000 tx=0x7f467c004ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:19.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.067+0000 7f467affd640 1 -- 172.21.15.78:0/453743727 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f468001f020 con 0x7f468c075fa0 2024-09-17T03:11:19.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.242+0000 7f469092b640 1 -- 172.21.15.78:0/453743727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f468c15b3d0 con 0x7f468c075fa0 2024-09-17T03:11:19.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.243+0000 7f467affd640 1 -- 172.21.15.78:0/453743727 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16740 (secure 0 0 0) 0x7f468c15b3d0 con 0x7f468c075fa0 2024-09-17T03:11:19.242 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:19.242 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":47,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:11:08.763100+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:10:23.600479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T03:10:24.925537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":4}]},{"pgid":"7.37","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:11:19.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.245+0000 7f469092b640 1 -- 172.21.15.78:0/453743727 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f466c078b90 msgr2=0x7f466c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:19.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.245+0000 7f469092b640 1 --2- 172.21.15.78:0/453743727 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f466c078b90 0x7f466c07b0a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f467c035000 tx=0x7f467c004ab0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.245+0000 7f469092b640 1 -- 172.21.15.78:0/453743727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f468c075fa0 msgr2=0x7f468c0b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:19.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.245+0000 7f469092b640 1 --2- 172.21.15.78:0/453743727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f468c075fa0 0x7f468c0b5450 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f468000b440 tx=0x7f468000b900 comp rx=0 tx=0).stop 2024-09-17T03:11:19.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.245+0000 7f469092b640 1 -- 172.21.15.78:0/453743727 shutdown_connections 2024-09-17T03:11:19.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.245+0000 7f469092b640 1 --2- 172.21.15.78:0/453743727 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f468c15f7e0 0x7f468c0ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.245+0000 7f469092b640 1 --2- 172.21.15.78:0/453743727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f468c075fa0 0x7f468c0b5450 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.245+0000 7f469092b640 1 --2- 172.21.15.78:0/453743727 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f466c078b90 0x7f466c07b0a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.245+0000 7f469092b640 1 --2- 172.21.15.78:0/453743727 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f468c06e100 0x7f468c0b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.245+0000 7f469092b640 1 -- 172.21.15.78:0/453743727 >> 172.21.15.78:0/453743727 conn(0x7f468c0cd530 msgr2=0x7f468c15dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:19.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.245+0000 7f469092b640 1 -- 172.21.15.78:0/453743727 shutdown_connections 2024-09-17T03:11:19.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.245+0000 7f469092b640 1 -- 172.21.15.78:0/453743727 wait complete. 2024-09-17T03:11:19.256 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:11:19.257 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:11:19.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.371+0000 7fd99fc7e640 1 -- 172.21.15.78:0/947200354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd99815d840 msgr2=0x7fd9980b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:19.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.371+0000 7fd99fc7e640 1 --2- 172.21.15.78:0/947200354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd99815d840 0x7fd9980b7490 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd990005fd0 tx=0x7fd99002aa90 comp rx=0 tx=0).stop 2024-09-17T03:11:19.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.371+0000 7fd99fc7e640 1 -- 172.21.15.78:0/947200354 shutdown_connections 2024-09-17T03:11:19.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.371+0000 7fd99fc7e640 1 --2- 172.21.15.78:0/947200354 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd99815d840 0x7fd9980b7490 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.371+0000 7fd99fc7e640 1 --2- 172.21.15.78:0/947200354 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd9981570e0 0x7fd9980d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.371+0000 7fd99fc7e640 1 -- 172.21.15.78:0/947200354 >> 172.21.15.78:0/947200354 conn(0x7fd99806d550 msgr2=0x7fd998071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:19.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.371+0000 7fd99fc7e640 1 -- 172.21.15.78:0/947200354 shutdown_connections 2024-09-17T03:11:19.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.371+0000 7fd99fc7e640 1 -- 172.21.15.78:0/947200354 wait complete. 2024-09-17T03:11:19.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.373+0000 7fd99fc7e640 1 Processor -- start 2024-09-17T03:11:19.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.373+0000 7fd99fc7e640 1 -- start start 2024-09-17T03:11:19.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.374+0000 7fd99fc7e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9980d2460 0x7fd9980ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:19.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.374+0000 7fd99fc7e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9981570e0 0x7fd9980c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:19.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.374+0000 7fd99fc7e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd99815d840 0x7fd9980c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:19.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.374+0000 7fd99fc7e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd9980b7de0 con 0x7fd9980d2460 2024-09-17T03:11:19.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.374+0000 7fd99fc7e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd9980b7c60 con 0x7fd9981570e0 2024-09-17T03:11:19.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.374+0000 7fd99fc7e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd9980b7f60 con 0x7fd99815d840 2024-09-17T03:11:19.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.374+0000 7fd99da1a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9980d2460 0x7fd9980ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:19.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.374+0000 7fd99da1a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9980d2460 0x7fd9980ca6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54688/0 (socket says 172.21.15.78:54688) 2024-09-17T03:11:19.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.374+0000 7fd99da1a640 1 -- 172.21.15.78:0/715841553 learned_addr learned my addr 172.21.15.78:0/715841553 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:19.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.374+0000 7fd99e21b640 1 --2- 172.21.15.78:0/715841553 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd99815d840 0x7fd9980c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:19.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.374+0000 7fd99d219640 1 --2- 172.21.15.78:0/715841553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9981570e0 0x7fd9980c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:19.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.374+0000 7fd99da1a640 1 -- 172.21.15.78:0/715841553 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd99815d840 msgr2=0x7fd9980c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:19.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.374+0000 7fd99da1a640 1 --2- 172.21.15.78:0/715841553 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd99815d840 0x7fd9980c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.374+0000 7fd99da1a640 1 -- 172.21.15.78:0/715841553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9981570e0 msgr2=0x7fd9980c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:19.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.374+0000 7fd99da1a640 1 --2- 172.21.15.78:0/715841553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9981570e0 0x7fd9980c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.374+0000 7fd99da1a640 1 -- 172.21.15.78:0/715841553 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9980b22f0 con 0x7fd9980d2460 2024-09-17T03:11:19.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.374+0000 7fd99e21b640 1 --2- 172.21.15.78:0/715841553 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd99815d840 0x7fd9980c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:19.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.374+0000 7fd99da1a640 1 --2- 172.21.15.78:0/715841553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9980d2460 0x7fd9980ca6e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd99400d750 tx=0x7fd99400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:19.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.375+0000 7fd98e7fc640 1 -- 172.21.15.78:0/715841553 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd994017070 con 0x7fd9980d2460 2024-09-17T03:11:19.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.375+0000 7fd98e7fc640 1 -- 172.21.15.78:0/715841553 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd994004310 con 0x7fd9980d2460 2024-09-17T03:11:19.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.375+0000 7fd98e7fc640 1 -- 172.21.15.78:0/715841553 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd99400de60 con 0x7fd9980d2460 2024-09-17T03:11:19.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.375+0000 7fd99fc7e640 1 -- 172.21.15.78:0/715841553 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9980b25d0 con 0x7fd9980d2460 2024-09-17T03:11:19.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.375+0000 7fd99fc7e640 1 -- 172.21.15.78:0/715841553 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9980b2b90 con 0x7fd9980d2460 2024-09-17T03:11:19.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.376+0000 7fd99fc7e640 1 -- 172.21.15.78:0/715841553 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9980d1f20 con 0x7fd9980d2460 2024-09-17T03:11:19.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.377+0000 7fd98e7fc640 1 -- 172.21.15.78:0/715841553 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd994009c30 con 0x7fd9980d2460 2024-09-17T03:11:19.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.377+0000 7fd98e7fc640 1 --2- 172.21.15.78:0/715841553 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd97c078b90 0x7fd97c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:19.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.377+0000 7fd98e7fc640 1 -- 172.21.15.78:0/715841553 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fd99409b100 con 0x7fd9980d2460 2024-09-17T03:11:19.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.377+0000 7fd99d219640 1 --2- 172.21.15.78:0/715841553 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd97c078b90 0x7fd97c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:19.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.378+0000 7fd99d219640 1 --2- 172.21.15.78:0/715841553 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd97c078b90 0x7fd97c07b0a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd9980b55a0 tx=0x7fd988009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:19.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.381+0000 7fd98e7fc640 1 -- 172.21.15.78:0/715841553 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd994020020 con 0x7fd9980d2460 2024-09-17T03:11:19.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.590+0000 7fd99fc7e640 1 -- 172.21.15.78:0/715841553 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd9980d1500 con 0x7fd9980d2460 2024-09-17T03:11:19.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.590+0000 7fd98e7fc640 1 -- 172.21.15.78:0/715841553 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5276 (secure 0 0 0) 0x7fd994063590 con 0x7fd9980d2460 2024-09-17T03:11:19.589 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:19.589 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":38,"btime":"2024-09-17T03:11:03:747649+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/2973955781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2973955781},{"type":"v1","addr":"172.21.15.78:6834","nonce":2973955781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:10:25.982190+0000","modified":"2024-09-17T03:11:03.696960+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5565,"mds_1":5039,"mds_2":5036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5036":{"gid":5036,"name":"a","rank":2,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.78:6835/3629327943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3629327943},{"type":"v1","addr":"172.21.15.78:6835","nonce":3629327943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5039":{"gid":5039,"name":"d","rank":1,"incarnation":31,"state":"up:active","state_seq":12,"addr":"172.21.15.193:6837/3209848332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":3209848332},{"type":"v1","addr":"172.21.15.193:6837","nonce":3209848332}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5565":{"gid":5565,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":12,"addr":"172.21.15.193:6836/1788096053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1788096053},{"type":"v1","addr":"172.21.15.193:6836","nonce":1788096053}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5565,"qdb_cluster":[5036,5039,5565]},"id":3}]} 2024-09-17T03:11:19.590 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 38 2024-09-17T03:11:19.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.592+0000 7fd99fc7e640 1 -- 172.21.15.78:0/715841553 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd97c078b90 msgr2=0x7fd97c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:19.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.592+0000 7fd99fc7e640 1 --2- 172.21.15.78:0/715841553 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd97c078b90 0x7fd97c07b0a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd9980b55a0 tx=0x7fd988009040 comp rx=0 tx=0).stop 2024-09-17T03:11:19.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.592+0000 7fd99fc7e640 1 -- 172.21.15.78:0/715841553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9980d2460 msgr2=0x7fd9980ca6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:19.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.592+0000 7fd99fc7e640 1 --2- 172.21.15.78:0/715841553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9980d2460 0x7fd9980ca6e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd99400d750 tx=0x7fd99400dc10 comp rx=0 tx=0).stop 2024-09-17T03:11:19.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.592+0000 7fd99fc7e640 1 -- 172.21.15.78:0/715841553 shutdown_connections 2024-09-17T03:11:19.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.592+0000 7fd99fc7e640 1 --2- 172.21.15.78:0/715841553 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd99815d840 0x7fd9980c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.592+0000 7fd99fc7e640 1 --2- 172.21.15.78:0/715841553 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd97c078b90 0x7fd97c07b0a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.592+0000 7fd99fc7e640 1 --2- 172.21.15.78:0/715841553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9981570e0 0x7fd9980c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.592+0000 7fd99fc7e640 1 --2- 172.21.15.78:0/715841553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9980d2460 0x7fd9980ca6e0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.592+0000 7fd99fc7e640 1 -- 172.21.15.78:0/715841553 >> 172.21.15.78:0/715841553 conn(0x7fd99806d550 msgr2=0x7fd9980c7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:19.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.592+0000 7fd99fc7e640 1 -- 172.21.15.78:0/715841553 shutdown_connections 2024-09-17T03:11:19.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.592+0000 7fd99fc7e640 1 -- 172.21.15.78:0/715841553 wait complete. 2024-09-17T03:11:19.604 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:11:19.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.718+0000 7f1e13a07640 1 -- 172.21.15.78:0/924552109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e0c075fa0 msgr2=0x7f1e0c070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:19.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.718+0000 7f1e13a07640 1 --2- 172.21.15.78:0/924552109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e0c075fa0 0x7f1e0c070e40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1e08009830 tx=0x7f1e0802a510 comp rx=0 tx=0).stop 2024-09-17T03:11:19.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.718+0000 7f1e13a07640 1 -- 172.21.15.78:0/924552109 shutdown_connections 2024-09-17T03:11:19.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.718+0000 7f1e13a07640 1 --2- 172.21.15.78:0/924552109 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1e0c15f9b0 0x7f1e0c0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.718+0000 7f1e13a07640 1 --2- 172.21.15.78:0/924552109 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e0c075fa0 0x7f1e0c070e40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.718+0000 7f1e13a07640 1 -- 172.21.15.78:0/924552109 >> 172.21.15.78:0/924552109 conn(0x7f1e0c0cd530 msgr2=0x7f1e0c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:19.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.718+0000 7f1e13a07640 1 -- 172.21.15.78:0/924552109 shutdown_connections 2024-09-17T03:11:19.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.718+0000 7f1e13a07640 1 -- 172.21.15.78:0/924552109 wait complete. 2024-09-17T03:11:19.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.720+0000 7f1e13a07640 1 Processor -- start 2024-09-17T03:11:19.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.720+0000 7f1e13a07640 1 -- start start 2024-09-17T03:11:19.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.721+0000 7f1e13a07640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1e0c06e100 0x7f1e0c0b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:19.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.721+0000 7f1e13a07640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e0c075fa0 0x7f1e0c146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:19.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.721+0000 7f1e13a07640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e0c147110 0x7f1e0c147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:19.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.721+0000 7f1e13a07640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c0cf060 con 0x7f1e0c147110 2024-09-17T03:11:19.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.721+0000 7f1e13a07640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c0ceee0 con 0x7f1e0c075fa0 2024-09-17T03:11:19.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.721+0000 7f1e13a07640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f1e0c0cf1e0 con 0x7f1e0c06e100 2024-09-17T03:11:19.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.722+0000 7f1e11fa4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e0c147110 0x7f1e0c147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:19.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.722+0000 7f1e11fa4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e0c147110 0x7f1e0c147520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54694/0 (socket says 172.21.15.78:54694) 2024-09-17T03:11:19.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.722+0000 7f1e11fa4640 1 -- 172.21.15.78:0/1349839436 learned_addr learned my addr 172.21.15.78:0/1349839436 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:19.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.722+0000 7f1e117a3640 1 --2- 172.21.15.78:0/1349839436 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1e0c06e100 0x7f1e0c0b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:19.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.722+0000 7f1e10fa2640 1 --2- 172.21.15.78:0/1349839436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e0c075fa0 0x7f1e0c146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:19.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.722+0000 7f1e11fa4640 1 -- 172.21.15.78:0/1349839436 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1e0c06e100 msgr2=0x7f1e0c0b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:19.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.722+0000 7f1e11fa4640 1 --2- 172.21.15.78:0/1349839436 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1e0c06e100 0x7f1e0c0b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.722+0000 7f1e11fa4640 1 -- 172.21.15.78:0/1349839436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e0c075fa0 msgr2=0x7f1e0c146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:19.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.722+0000 7f1e11fa4640 1 --2- 172.21.15.78:0/1349839436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e0c075fa0 0x7f1e0c146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.722+0000 7f1e11fa4640 1 -- 172.21.15.78:0/1349839436 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0c1f4540 con 0x7f1e0c147110 2024-09-17T03:11:19.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.722+0000 7f1e11fa4640 1 --2- 172.21.15.78:0/1349839436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e0c147110 0x7f1e0c147520 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400ec20 tx=0x7f1e0400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:19.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.722+0000 7f1e01ffb640 1 -- 172.21.15.78:0/1349839436 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e04003b70 con 0x7f1e0c147110 2024-09-17T03:11:19.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.722+0000 7f1e01ffb640 1 -- 172.21.15.78:0/1349839436 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e04003e00 con 0x7f1e0c147110 2024-09-17T03:11:19.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.722+0000 7f1e01ffb640 1 -- 172.21.15.78:0/1349839436 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e04004280 con 0x7f1e0c147110 2024-09-17T03:11:19.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.722+0000 7f1e13a07640 1 -- 172.21.15.78:0/1349839436 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e0c0b3c00 con 0x7f1e0c147110 2024-09-17T03:11:19.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.723+0000 7f1e13a07640 1 -- 172.21.15.78:0/1349839436 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e0c0b41c0 con 0x7f1e0c147110 2024-09-17T03:11:19.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.724+0000 7f1e13a07640 1 -- 172.21.15.78:0/1349839436 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e0c147ac0 con 0x7f1e0c147110 2024-09-17T03:11:19.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.724+0000 7f1e01ffb640 1 -- 172.21.15.78:0/1349839436 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1e04004420 con 0x7f1e0c147110 2024-09-17T03:11:19.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.724+0000 7f1e01ffb640 1 --2- 172.21.15.78:0/1349839436 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1df0078b90 0x7f1df007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:19.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.725+0000 7f1e01ffb640 1 -- 172.21.15.78:0/1349839436 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f1e0409bab0 con 0x7f1e0c147110 2024-09-17T03:11:19.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.725+0000 7f1e117a3640 1 --2- 172.21.15.78:0/1349839436 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1df0078b90 0x7f1df007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:19.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.725+0000 7f1e117a3640 1 --2- 172.21.15.78:0/1349839436 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1df0078b90 0x7f1df007b0a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1e08034000 tx=0x7f1e08004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:19.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.729+0000 7f1e01ffb640 1 -- 172.21.15.78:0/1349839436 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1e040638f0 con 0x7f1e0c147110 2024-09-17T03:11:19.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.944+0000 7f1e13a07640 1 -- 172.21.15.78:0/1349839436 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e0c1f42b0 con 0x7f1e0c147110 2024-09-17T03:11:19.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.945+0000 7f1e01ffb640 1 -- 172.21.15.78:0/1349839436 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+5276 (secure 0 0 0) 0x7f1e04068320 con 0x7f1e0c147110 2024-09-17T03:11:19.944 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:19.944 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":38,"btime":"2024-09-17T03:11:03:747649+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/2973955781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2973955781},{"type":"v1","addr":"172.21.15.78:6834","nonce":2973955781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:10:25.982190+0000","modified":"2024-09-17T03:11:03.696960+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":5565,"mds_1":5039,"mds_2":5036},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5036":{"gid":5036,"name":"a","rank":2,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.78:6835/3629327943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3629327943},{"type":"v1","addr":"172.21.15.78:6835","nonce":3629327943}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5039":{"gid":5039,"name":"d","rank":1,"incarnation":31,"state":"up:active","state_seq":12,"addr":"172.21.15.193:6837/3209848332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":3209848332},{"type":"v1","addr":"172.21.15.193:6837","nonce":3209848332}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5565":{"gid":5565,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":12,"addr":"172.21.15.193:6836/1788096053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1788096053},{"type":"v1","addr":"172.21.15.193:6836","nonce":1788096053}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5565,"qdb_cluster":[5036,5039,5565]},"id":3}]} 2024-09-17T03:11:19.944 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 38 2024-09-17T03:11:19.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.947+0000 7f1e13a07640 1 -- 172.21.15.78:0/1349839436 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1df0078b90 msgr2=0x7f1df007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:19.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.947+0000 7f1e13a07640 1 --2- 172.21.15.78:0/1349839436 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1df0078b90 0x7f1df007b0a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1e08034000 tx=0x7f1e08004730 comp rx=0 tx=0).stop 2024-09-17T03:11:19.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.947+0000 7f1e13a07640 1 -- 172.21.15.78:0/1349839436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e0c147110 msgr2=0x7f1e0c147520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:19.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.947+0000 7f1e13a07640 1 --2- 172.21.15.78:0/1349839436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e0c147110 0x7f1e0c147520 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1e0400ec20 tx=0x7f1e0400c6a0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.947+0000 7f1e13a07640 1 -- 172.21.15.78:0/1349839436 shutdown_connections 2024-09-17T03:11:19.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.947+0000 7f1e13a07640 1 --2- 172.21.15.78:0/1349839436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1e0c147110 0x7f1e0c147520 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.947+0000 7f1e13a07640 1 --2- 172.21.15.78:0/1349839436 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1df0078b90 0x7f1df007b0a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.947+0000 7f1e13a07640 1 --2- 172.21.15.78:0/1349839436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e0c075fa0 0x7f1e0c146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.947+0000 7f1e13a07640 1 --2- 172.21.15.78:0/1349839436 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1e0c06e100 0x7f1e0c0b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:19.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.947+0000 7f1e13a07640 1 -- 172.21.15.78:0/1349839436 >> 172.21.15.78:0/1349839436 conn(0x7f1e0c0cd530 msgr2=0x7f1e0c14cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:19.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.947+0000 7f1e13a07640 1 -- 172.21.15.78:0/1349839436 shutdown_connections 2024-09-17T03:11:19.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:19.947+0000 7f1e13a07640 1 -- 172.21.15.78:0/1349839436 wait complete. 2024-09-17T03:11:19.957 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:11:20.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.071+0000 7f93574bd640 1 -- 172.21.15.78:0/4174676026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93500b5210 msgr2=0x7f93500ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:20.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.071+0000 7f93574bd640 1 --2- 172.21.15.78:0/4174676026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93500b5210 0x7f93500ceb50 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9350072650 tx=0x7f934002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.071+0000 7f93574bd640 1 -- 172.21.15.78:0/4174676026 shutdown_connections 2024-09-17T03:11:20.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.071+0000 7f93574bd640 1 --2- 172.21.15.78:0/4174676026 >> v2:172.21.15.193:3300/0 conn(0x7f93500ccba0 0x7f93500ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.071+0000 7f93574bd640 1 --2- 172.21.15.78:0/4174676026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93500b5210 0x7f93500ceb50 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.071+0000 7f93574bd640 1 -- 172.21.15.78:0/4174676026 >> 172.21.15.78:0/4174676026 conn(0x7f93500b3f10 msgr2=0x7f93500b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:20.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.071+0000 7f93574bd640 1 -- 172.21.15.78:0/4174676026 shutdown_connections 2024-09-17T03:11:20.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.071+0000 7f93574bd640 1 -- 172.21.15.78:0/4174676026 wait complete. 2024-09-17T03:11:20.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.073+0000 7f93574bd640 1 Processor -- start 2024-09-17T03:11:20.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.073+0000 7f93574bd640 1 -- start start 2024-09-17T03:11:20.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.074+0000 7f93574bd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93500b5210 0x7f93500cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:20.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.074+0000 7f93574bd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f93500ccba0 0x7f9350154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:20.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.074+0000 7f93574bd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93500d1d40 0x7f935014a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:20.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.074+0000 7f93574bd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f93500d11f0 con 0x7f93500d1d40 2024-09-17T03:11:20.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.074+0000 7f93574bd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f93500d1070 con 0x7f93500b5210 2024-09-17T03:11:20.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.074+0000 7f93574bd640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f93500d1370 con 0x7f93500ccba0 2024-09-17T03:11:20.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.074+0000 7f9355a5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93500d1d40 0x7f935014a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:20.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.074+0000 7f9355a5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93500d1d40 0x7f935014a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54708/0 (socket says 172.21.15.78:54708) 2024-09-17T03:11:20.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.074+0000 7f9355a5a640 1 -- 172.21.15.78:0/3523523178 learned_addr learned my addr 172.21.15.78:0/3523523178 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:20.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.074+0000 7f9354a58640 1 --2- 172.21.15.78:0/3523523178 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f93500ccba0 0x7f9350154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:20.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.074+0000 7f9355259640 1 --2- 172.21.15.78:0/3523523178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93500b5210 0x7f93500cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:20.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.074+0000 7f9355a5a640 1 -- 172.21.15.78:0/3523523178 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f93500ccba0 msgr2=0x7f9350154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:20.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.074+0000 7f9355a5a640 1 --2- 172.21.15.78:0/3523523178 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f93500ccba0 0x7f9350154840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.074+0000 7f9355a5a640 1 -- 172.21.15.78:0/3523523178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93500b5210 msgr2=0x7f93500cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:20.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.074+0000 7f9355a5a640 1 --2- 172.21.15.78:0/3523523178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93500b5210 0x7f93500cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.074+0000 7f9355a5a640 1 -- 172.21.15.78:0/3523523178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9350154d80 con 0x7f93500d1d40 2024-09-17T03:11:20.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.074+0000 7f9355259640 1 --2- 172.21.15.78:0/3523523178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93500b5210 0x7f93500cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:20.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.075+0000 7f9355a5a640 1 --2- 172.21.15.78:0/3523523178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93500d1d40 0x7f935014a530 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f934800d660 tx=0x7f934800db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:20.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.075+0000 7f9345ffb640 1 -- 172.21.15.78:0/3523523178 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9348017070 con 0x7f93500d1d40 2024-09-17T03:11:20.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.075+0000 7f9345ffb640 1 -- 172.21.15.78:0/3523523178 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9348005310 con 0x7f93500d1d40 2024-09-17T03:11:20.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.075+0000 7f93574bd640 1 -- 172.21.15.78:0/3523523178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93501537a0 con 0x7f93500d1d40 2024-09-17T03:11:20.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.075+0000 7f9345ffb640 1 -- 172.21.15.78:0/3523523178 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9348009820 con 0x7f93500d1d40 2024-09-17T03:11:20.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.075+0000 7f93574bd640 1 -- 172.21.15.78:0/3523523178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9350153d60 con 0x7f93500d1d40 2024-09-17T03:11:20.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.076+0000 7f93574bd640 1 -- 172.21.15.78:0/3523523178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93500cc590 con 0x7f93500d1d40 2024-09-17T03:11:20.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.077+0000 7f9345ffb640 1 -- 172.21.15.78:0/3523523178 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f93480099c0 con 0x7f93500d1d40 2024-09-17T03:11:20.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.077+0000 7f9345ffb640 1 --2- 172.21.15.78:0/3523523178 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9334078b90 0x7f933407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:20.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.077+0000 7f9345ffb640 1 -- 172.21.15.78:0/3523523178 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f934809ad50 con 0x7f93500d1d40 2024-09-17T03:11:20.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.077+0000 7f9355259640 1 --2- 172.21.15.78:0/3523523178 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9334078b90 0x7f933407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:20.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.078+0000 7f9355259640 1 --2- 172.21.15.78:0/3523523178 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9334078b90 0x7f933407b0a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f934c001d10 tx=0x7f934c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:20.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.081+0000 7f9345ffb640 1 -- 172.21.15.78:0/3523523178 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f934809e030 con 0x7f93500d1d40 2024-09-17T03:11:20.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.260+0000 7f93574bd640 1 -- 172.21.15.78:0/3523523178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93500d1840 con 0x7f93500d1d40 2024-09-17T03:11:20.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.261+0000 7f9345ffb640 1 -- 172.21.15.78:0/3523523178 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16740 (secure 0 0 0) 0x7f93480631e0 con 0x7f93500d1d40 2024-09-17T03:11:20.260 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:20.260 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":47,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:11:08.763100+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:10:23.600479+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T03:10:24.925537+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.f","mappings":[{"from":0,"to":4}]},{"pgid":"7.37","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:11:20.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.263+0000 7f93574bd640 1 -- 172.21.15.78:0/3523523178 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9334078b90 msgr2=0x7f933407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:20.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.263+0000 7f93574bd640 1 --2- 172.21.15.78:0/3523523178 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9334078b90 0x7f933407b0a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f934c001d10 tx=0x7f934c009040 comp rx=0 tx=0).stop 2024-09-17T03:11:20.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.264+0000 7f93574bd640 1 -- 172.21.15.78:0/3523523178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93500d1d40 msgr2=0x7f935014a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:20.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.264+0000 7f93574bd640 1 --2- 172.21.15.78:0/3523523178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93500d1d40 0x7f935014a530 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f934800d660 tx=0x7f934800db20 comp rx=0 tx=0).stop 2024-09-17T03:11:20.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.264+0000 7f93574bd640 1 -- 172.21.15.78:0/3523523178 shutdown_connections 2024-09-17T03:11:20.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.264+0000 7f93574bd640 1 --2- 172.21.15.78:0/3523523178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93500d1d40 0x7f935014a530 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.264+0000 7f93574bd640 1 --2- 172.21.15.78:0/3523523178 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f93500ccba0 0x7f9350154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.264+0000 7f93574bd640 1 --2- 172.21.15.78:0/3523523178 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9334078b90 0x7f933407b0a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.264+0000 7f93574bd640 1 --2- 172.21.15.78:0/3523523178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f93500b5210 0x7f93500cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.264+0000 7f93574bd640 1 -- 172.21.15.78:0/3523523178 >> 172.21.15.78:0/3523523178 conn(0x7f93500b3f10 msgr2=0x7f93500b7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:20.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.264+0000 7f93574bd640 1 -- 172.21.15.78:0/3523523178 shutdown_connections 2024-09-17T03:11:20.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.264+0000 7f93574bd640 1 -- 172.21.15.78:0/3523523178 wait complete. 2024-09-17T03:11:20.274 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:11:20.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.389+0000 7fd395b90640 1 -- 172.21.15.78:0/2186789720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd39006e170 msgr2=0x7fd3900b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:20.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.389+0000 7fd395b90640 1 --2- 172.21.15.78:0/2186789720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd39006e170 0x7fd3900b3540 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fd380005fd0 tx=0x7fd38002a540 comp rx=0 tx=0).stop 2024-09-17T03:11:20.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.389+0000 7fd395b90640 1 -- 172.21.15.78:0/2186789720 shutdown_connections 2024-09-17T03:11:20.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.389+0000 7fd395b90640 1 --2- 172.21.15.78:0/2186789720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd39006e170 0x7fd3900b3540 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.389+0000 7fd395b90640 1 -- 172.21.15.78:0/2186789720 >> 172.21.15.78:0/2186789720 conn(0x7fd39008bfc0 msgr2=0x7fd39009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:20.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.389+0000 7fd395b90640 1 -- 172.21.15.78:0/2186789720 shutdown_connections 2024-09-17T03:11:20.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.389+0000 7fd395b90640 1 -- 172.21.15.78:0/2186789720 wait complete. 2024-09-17T03:11:20.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.391+0000 7fd395b90640 1 Processor -- start 2024-09-17T03:11:20.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.391+0000 7fd395b90640 1 -- start start 2024-09-17T03:11:20.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.392+0000 7fd395b90640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd39006f4b0 0x7fd3900cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:20.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.392+0000 7fd395b90640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3900ceb40 0x7fd390150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:20.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.392+0000 7fd395b90640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd39015fa10 0x7fd390150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:20.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.392+0000 7fd395b90640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd3900d10b0 con 0x7fd3900ceb40 2024-09-17T03:11:20.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.392+0000 7fd395b90640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd3900d0f30 con 0x7fd39015fa10 2024-09-17T03:11:20.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.392+0000 7fd395b90640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd3900d1230 con 0x7fd39006f4b0 2024-09-17T03:11:20.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.393+0000 7fd38effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3900ceb40 0x7fd390150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:20.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.393+0000 7fd38effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3900ceb40 0x7fd390150400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54724/0 (socket says 172.21.15.78:54724) 2024-09-17T03:11:20.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.393+0000 7fd38effd640 1 -- 172.21.15.78:0/805117372 learned_addr learned my addr 172.21.15.78:0/805117372 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:20.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.393+0000 7fd38ffff640 1 --2- 172.21.15.78:0/805117372 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd39015fa10 0x7fd390150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:20.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.393+0000 7fd38f7fe640 1 --2- 172.21.15.78:0/805117372 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd39006f4b0 0x7fd3900cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:20.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.393+0000 7fd38effd640 1 -- 172.21.15.78:0/805117372 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd39006f4b0 msgr2=0x7fd3900cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:20.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.393+0000 7fd38effd640 1 --2- 172.21.15.78:0/805117372 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd39006f4b0 0x7fd3900cae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.393+0000 7fd38effd640 1 -- 172.21.15.78:0/805117372 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd39015fa10 msgr2=0x7fd390150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:20.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.393+0000 7fd38effd640 1 --2- 172.21.15.78:0/805117372 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd39015fa10 0x7fd390150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.393+0000 7fd38effd640 1 -- 172.21.15.78:0/805117372 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3901512a0 con 0x7fd3900ceb40 2024-09-17T03:11:20.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.393+0000 7fd38f7fe640 1 --2- 172.21.15.78:0/805117372 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd39006f4b0 0x7fd3900cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:20.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.393+0000 7fd38effd640 1 --2- 172.21.15.78:0/805117372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3900ceb40 0x7fd390150400 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd384009fd0 tx=0x7fd38400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:20.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.393+0000 7fd377fff640 1 -- 172.21.15.78:0/805117372 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd384015020 con 0x7fd3900ceb40 2024-09-17T03:11:20.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.393+0000 7fd377fff640 1 -- 172.21.15.78:0/805117372 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd384011920 con 0x7fd3900ceb40 2024-09-17T03:11:20.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.393+0000 7fd395b90640 1 -- 172.21.15.78:0/805117372 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3900cce30 con 0x7fd3900ceb40 2024-09-17T03:11:20.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.393+0000 7fd377fff640 1 -- 172.21.15.78:0/805117372 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd384011d50 con 0x7fd3900ceb40 2024-09-17T03:11:20.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.393+0000 7fd395b90640 1 -- 172.21.15.78:0/805117372 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3900cd3f0 con 0x7fd3900ceb40 2024-09-17T03:11:20.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.394+0000 7fd395b90640 1 -- 172.21.15.78:0/805117372 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd39006e170 con 0x7fd3900ceb40 2024-09-17T03:11:20.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.395+0000 7fd377fff640 1 -- 172.21.15.78:0/805117372 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd384018020 con 0x7fd3900ceb40 2024-09-17T03:11:20.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.396+0000 7fd377fff640 1 --2- 172.21.15.78:0/805117372 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd37c078b90 0x7fd37c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:20.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.396+0000 7fd377fff640 1 -- 172.21.15.78:0/805117372 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fd38409ac70 con 0x7fd3900ceb40 2024-09-17T03:11:20.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.396+0000 7fd38f7fe640 1 --2- 172.21.15.78:0/805117372 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd37c078b90 0x7fd37c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:20.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.397+0000 7fd38f7fe640 1 --2- 172.21.15.78:0/805117372 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd37c078b90 0x7fd37c07b0a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd380033000 tx=0x7fd380004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:20.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.400+0000 7fd377fff640 1 -- 172.21.15.78:0/805117372 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd38401f020 con 0x7fd3900ceb40 2024-09-17T03:11:20.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.610+0000 7fd395b90640 1 -- 172.21.15.78:0/805117372 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fd390151030 con 0x7fd3900ceb40 2024-09-17T03:11:20.610 INFO:tasks.ceph.mon.a.smithi078.stderr:2024-09-17T03:11:20.611+0000 7f192af78640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:11:20.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.612+0000 7fd377fff640 1 -- 172.21.15.78:0/805117372 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) ==== 161+0+0 (secure 0 0 0) 0x7fd384063100 con 0x7fd3900ceb40 2024-09-17T03:11:20.611 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:11:20.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.615+0000 7fd395b90640 1 -- 172.21.15.78:0/805117372 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd37c078b90 msgr2=0x7fd37c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:20.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.615+0000 7fd395b90640 1 --2- 172.21.15.78:0/805117372 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd37c078b90 0x7fd37c07b0a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd380033000 tx=0x7fd380004730 comp rx=0 tx=0).stop 2024-09-17T03:11:20.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.615+0000 7fd395b90640 1 -- 172.21.15.78:0/805117372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3900ceb40 msgr2=0x7fd390150400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:20.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.615+0000 7fd395b90640 1 --2- 172.21.15.78:0/805117372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3900ceb40 0x7fd390150400 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd384009fd0 tx=0x7fd38400b870 comp rx=0 tx=0).stop 2024-09-17T03:11:20.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.615+0000 7fd395b90640 1 -- 172.21.15.78:0/805117372 shutdown_connections 2024-09-17T03:11:20.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.615+0000 7fd395b90640 1 --2- 172.21.15.78:0/805117372 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd37c078b90 0x7fd37c07b0a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.615+0000 7fd395b90640 1 --2- 172.21.15.78:0/805117372 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd39015fa10 0x7fd390150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.615+0000 7fd395b90640 1 --2- 172.21.15.78:0/805117372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3900ceb40 0x7fd390150400 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.615+0000 7fd395b90640 1 --2- 172.21.15.78:0/805117372 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd39006f4b0 0x7fd3900cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.615+0000 7fd395b90640 1 -- 172.21.15.78:0/805117372 >> 172.21.15.78:0/805117372 conn(0x7fd39008bfc0 msgr2=0x7fd3900d3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:20.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.616+0000 7fd395b90640 1 -- 172.21.15.78:0/805117372 shutdown_connections 2024-09-17T03:11:20.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.616+0000 7fd395b90640 1 -- 172.21.15.78:0/805117372 wait complete. 2024-09-17T03:11:20.618 INFO:tasks.ceph.mds.a.smithi078.stderr: -1072> 2024-09-17T03:11:00.587+0000 7f2245999640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-17T03:10:43.140971+0000 1=0+1) n(v0 rc2024-09-17T03:10:43.140971+0000 2=0+2) (inest lock) (ifile excl) caps={5141=pAsLsXsFsx/pAsLsXsFsxcral@4},l=5141 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5594bf759080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(6)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:10:43.140971+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:10:43.140971+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-17T03:10:43.140971+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-17T03:10:43.140971+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-17T03:11:20.619 INFO:tasks.ceph.mds.a.smithi078.stderr: -1058> 2024-09-17T03:11:00.587+0000 7f2245999640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) caps={5141=pAsLsXsFsx/AsLsXsFsx@2},l=5141 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5594bf759600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(6)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-17T03:11:20.625 INFO:tasks.ceph.mds.d.smithi193.stderr: -1322> 2024-09-17T03:11:00.586+0000 7fe6e4976640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-17T03:10:43.138971+0000 1=0+1) n(v2 rc2024-09-17T03:10:43.374967+0000 4=0+4) (inest lock) (ifile excl) caps={5141=pAsLsXsFsx/pAsLsXsFsxcral@4},l=5141 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x561a060fa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(6)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:10:43.138971+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:10:43.374967+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-17T03:10:43.138971+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-17T03:10:43.374967+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-17T03:11:20.625 INFO:tasks.ceph.mds.d.smithi193.stderr: -1172> 2024-09-17T03:11:00.587+0000 7fe6eb183640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-17T03:10:43.139971+0000 1=0+1) n(v1 rc2024-09-17T03:10:43.374967+0000 3=0+3) (inest sync->mix g=0,2 scatter_wanted) caps={5141=pAsLsXsFs/pAsLsXsFsxcral@7} | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x561a060fb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(6)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:10:43.139971+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:10:43.140971+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-17T03:10:43.139971+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-17T03:10:43.374967+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-17T03:11:20.626 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:11:20.628 INFO:tasks.ceph.mds.b.smithi193.stderr: -2512> 2024-09-17T03:11:00.585+0000 7fe71e77c640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-17T03:10:43.137971+0000 1=0+1) n(v3 rc2024-09-17T03:10:43.374967+0000 6=0+6) (inest mix dirty) (ifile excl) caps={5141=pAsLsXsFsx/pAsLsXsFsxcral@4},l=5141 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55f21cd17080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(6)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:10:43.137971+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:10:43.374967+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-17T03:10:43.137971+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-17T03:10:43.374967+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-17T03:11:20.628 INFO:tasks.ceph.mds.b.smithi193.stderr: -2384> 2024-09-17T03:11:00.587+0000 7fe724f89640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-17T03:10:43.138971+0000 1=0+1) n(v4 rc2024-09-17T03:10:43.374967+0000 5=0+5) (inest sync->mix g=1,2) caps={5141=pAsLsXsFs/pAsLsXsFsxcral@8} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55f21cd16b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(6)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:10:43.138971+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:10:43.374967+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-17T03:10:43.138971+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-17T03:10:43.374967+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-17T03:11:20.672 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-09-17T03:11:20.679 INFO:tasks.ceph.mds.d.smithi193.stdout:starting mds.d at 2024-09-17T03:11:20.684 INFO:tasks.ceph.mds.b.smithi193.stdout:starting mds.b at 2024-09-17T03:11:20.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.746+0000 7f59deb9d640 1 -- 172.21.15.78:0/2132653999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d806e330 msgr2=0x7f59d815b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:20.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.746+0000 7f59deb9d640 1 --2- 172.21.15.78:0/2132653999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d806e330 0x7f59d815b920 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f59d8064b50 tx=0x7f59d002aa30 comp rx=0 tx=0).stop 2024-09-17T03:11:20.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.746+0000 7f59deb9d640 1 -- 172.21.15.78:0/2132653999 shutdown_connections 2024-09-17T03:11:20.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.746+0000 7f59deb9d640 1 --2- 172.21.15.78:0/2132653999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d806e330 0x7f59d815b920 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.746+0000 7f59deb9d640 1 --2- 172.21.15.78:0/2132653999 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59d815f450 0x7f59d806ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.746+0000 7f59deb9d640 1 --2- 172.21.15.78:0/2132653999 >> v2:172.21.15.193:3300/0 conn(0x7f59d80cee10 0x7f59d815ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.746+0000 7f59deb9d640 1 -- 172.21.15.78:0/2132653999 >> 172.21.15.78:0/2132653999 conn(0x7f59d80733c0 msgr2=0x7f59d80737d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:20.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.747+0000 7f59deb9d640 1 -- 172.21.15.78:0/2132653999 shutdown_connections 2024-09-17T03:11:20.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.747+0000 7f59deb9d640 1 -- 172.21.15.78:0/2132653999 wait complete. 2024-09-17T03:11:20.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.748+0000 7f59deb9d640 1 Processor -- start 2024-09-17T03:11:20.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.748+0000 7f59deb9d640 1 -- start start 2024-09-17T03:11:20.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.749+0000 7f59deb9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d806e330 0x7f59d814ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:20.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59deb9d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59d80cee10 0x7f59d80c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:20.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59deb9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59d815f450 0x7f59d8157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:20.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59deb9d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f59d80cf330 con 0x7f59d806e330 2024-09-17T03:11:20.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59deb9d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f59d80d01b0 con 0x7f59d815f450 2024-09-17T03:11:20.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59deb9d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f59d815be60 con 0x7f59d80cee10 2024-09-17T03:11:20.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59ddb9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d806e330 0x7f59d814ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:20.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59ddb9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d806e330 0x7f59d814ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54756/0 (socket says 172.21.15.78:54756) 2024-09-17T03:11:20.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59ddb9b640 1 -- 172.21.15.78:0/3818451648 learned_addr learned my addr 172.21.15.78:0/3818451648 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:20.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59dd39a640 1 --2- 172.21.15.78:0/3818451648 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59d80cee10 0x7f59d80c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:20.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59de39c640 1 --2- 172.21.15.78:0/3818451648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59d815f450 0x7f59d8157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:20.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59ddb9b640 1 -- 172.21.15.78:0/3818451648 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59d80cee10 msgr2=0x7f59d80c89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:20.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59ddb9b640 1 --2- 172.21.15.78:0/3818451648 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59d80cee10 0x7f59d80c89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59ddb9b640 1 -- 172.21.15.78:0/3818451648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59d815f450 msgr2=0x7f59d8157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:20.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59ddb9b640 1 --2- 172.21.15.78:0/3818451648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59d815f450 0x7f59d8157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:20.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59ddb9b640 1 -- 172.21.15.78:0/3818451648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d8157420 con 0x7f59d806e330 2024-09-17T03:11:20.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59de39c640 1 --2- 172.21.15.78:0/3818451648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59d815f450 0x7f59d8157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:20.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59dd39a640 1 --2- 172.21.15.78:0/3818451648 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59d80cee10 0x7f59d80c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:20.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59ddb9b640 1 --2- 172.21.15.78:0/3818451648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d806e330 0x7f59d814ec90 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f59d400c940 tx=0x7f59d400ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:20.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59ce7fc640 1 -- 172.21.15.78:0/3818451648 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4007bb0 con 0x7f59d806e330 2024-09-17T03:11:20.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59ce7fc640 1 -- 172.21.15.78:0/3818451648 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59d4007e40 con 0x7f59d806e330 2024-09-17T03:11:20.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59deb9d640 1 -- 172.21.15.78:0/3818451648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d80c7170 con 0x7f59d806e330 2024-09-17T03:11:20.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59ce7fc640 1 -- 172.21.15.78:0/3818451648 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d400f690 con 0x7f59d806e330 2024-09-17T03:11:20.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.750+0000 7f59deb9d640 1 -- 172.21.15.78:0/3818451648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d80c4ce0 con 0x7f59d806e330 2024-09-17T03:11:20.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.751+0000 7f59deb9d640 1 -- 172.21.15.78:0/3818451648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d81f67f0 con 0x7f59d806e330 2024-09-17T03:11:20.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.752+0000 7f59ce7fc640 1 -- 172.21.15.78:0/3818451648 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f59d400f830 con 0x7f59d806e330 2024-09-17T03:11:20.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.753+0000 7f59ce7fc640 1 --2- 172.21.15.78:0/3818451648 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f59bc078b90 0x7f59bc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:20.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.753+0000 7f59ce7fc640 1 -- 172.21.15.78:0/3818451648 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6025+0+0 (secure 0 0 0) 0x7f59d409b600 con 0x7f59d806e330 2024-09-17T03:11:20.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.753+0000 7f59dd39a640 1 --2- 172.21.15.78:0/3818451648 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f59bc078b90 0x7f59bc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:20.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.754+0000 7f59dd39a640 1 --2- 172.21.15.78:0/3818451648 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f59bc078b90 0x7f59bc07b0a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f59d8070220 tx=0x7f59c8005f10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:20.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.757+0000 7f59ce7fc640 1 -- 172.21.15.78:0/3818451648 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f59d81f67f0 con 0x7f59d806e330 2024-09-17T03:11:20.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:20.968+0000 7f59deb9d640 1 -- 172.21.15.78:0/3818451648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f59d815c380 con 0x7f59d806e330 2024-09-17T03:11:21.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.614+0000 7f59ce7fc640 1 -- 172.21.15.78:0/3818451648 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) ==== 104+0+0 (secure 0 0 0) 0x7f59d4014030 con 0x7f59d806e330 2024-09-17T03:11:21.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.616+0000 7f59deb9d640 1 -- 172.21.15.78:0/3818451648 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f59bc078b90 msgr2=0x7f59bc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:21.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.616+0000 7f59deb9d640 1 --2- 172.21.15.78:0/3818451648 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f59bc078b90 0x7f59bc07b0a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f59d8070220 tx=0x7f59c8005f10 comp rx=0 tx=0).stop 2024-09-17T03:11:21.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.617+0000 7f59deb9d640 1 -- 172.21.15.78:0/3818451648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d806e330 msgr2=0x7f59d814ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:21.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.617+0000 7f59deb9d640 1 --2- 172.21.15.78:0/3818451648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d806e330 0x7f59d814ec90 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f59d400c940 tx=0x7f59d400ce00 comp rx=0 tx=0).stop 2024-09-17T03:11:21.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.617+0000 7f59deb9d640 1 -- 172.21.15.78:0/3818451648 shutdown_connections 2024-09-17T03:11:21.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.617+0000 7f59deb9d640 1 --2- 172.21.15.78:0/3818451648 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f59bc078b90 0x7f59bc07b0a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:21.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.617+0000 7f59deb9d640 1 --2- 172.21.15.78:0/3818451648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f59d815f450 0x7f59d8157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:21.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.617+0000 7f59deb9d640 1 --2- 172.21.15.78:0/3818451648 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f59d80cee10 0x7f59d80c89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:21.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.617+0000 7f59deb9d640 1 --2- 172.21.15.78:0/3818451648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59d806e330 0x7f59d814ec90 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:21.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.617+0000 7f59deb9d640 1 -- 172.21.15.78:0/3818451648 >> 172.21.15.78:0/3818451648 conn(0x7f59d80733c0 msgr2=0x7f59d815b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:21.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.617+0000 7f59deb9d640 1 -- 172.21.15.78:0/3818451648 shutdown_connections 2024-09-17T03:11:21.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.617+0000 7f59deb9d640 1 -- 172.21.15.78:0/3818451648 wait complete. 2024-09-17T03:11:21.629 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:11:21.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.749+0000 7fe7b1b20640 1 -- 172.21.15.78:0/1035784295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7ac0cd1a0 msgr2=0x7fe7ac0728a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:21.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.749+0000 7fe7b1b20640 1 --2- 172.21.15.78:0/1035784295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7ac0cd1a0 0x7fe7ac0728a0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac073f70 tx=0x7fe7a402aa30 comp rx=0 tx=0).stop 2024-09-17T03:11:21.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.749+0000 7fe7b1b20640 1 -- 172.21.15.78:0/1035784295 shutdown_connections 2024-09-17T03:11:21.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.749+0000 7fe7b1b20640 1 --2- 172.21.15.78:0/1035784295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7ac0cd1a0 0x7fe7ac0728a0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:21.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.749+0000 7fe7b1b20640 1 --2- 172.21.15.78:0/1035784295 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe7ac0cf4a0 0x7fe7ac0ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:21.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.749+0000 7fe7b1b20640 1 --2- 172.21.15.78:0/1035784295 >> v2:172.21.15.193:3300/0 conn(0x7fe7ac15c6f0 0x7fe7ac0cef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:21.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.749+0000 7fe7b1b20640 1 -- 172.21.15.78:0/1035784295 >> 172.21.15.78:0/1035784295 conn(0x7fe7ac0710b0 msgr2=0x7fe7ac0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:21.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.749+0000 7fe7b1b20640 1 -- 172.21.15.78:0/1035784295 shutdown_connections 2024-09-17T03:11:21.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.749+0000 7fe7b1b20640 1 -- 172.21.15.78:0/1035784295 wait complete. 2024-09-17T03:11:21.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.751+0000 7fe7b1b20640 1 Processor -- start 2024-09-17T03:11:21.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.751+0000 7fe7b1b20640 1 -- start start 2024-09-17T03:11:21.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.752+0000 7fe7b1b20640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe7ac0cd1a0 0x7fe7ac0b1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:21.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.752+0000 7fe7b1b20640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7ac0cf4a0 0x7fe7ac1e9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:21.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.752+0000 7fe7b1b20640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7ac15c6f0 0x7fe7ac1e98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:21.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.752+0000 7fe7b1b20640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac073170 con 0x7fe7ac0cf4a0 2024-09-17T03:11:21.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.752+0000 7fe7b1b20640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ac072ff0 con 0x7fe7ac15c6f0 2024-09-17T03:11:21.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.752+0000 7fe7b1b20640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe7ac0732f0 con 0x7fe7ac0cd1a0 2024-09-17T03:11:21.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.752+0000 7fe7aaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7ac0cf4a0 0x7fe7ac1e9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:21.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.752+0000 7fe7aaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7ac0cf4a0 0x7fe7ac1e9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54766/0 (socket says 172.21.15.78:54766) 2024-09-17T03:11:21.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.752+0000 7fe7aaffd640 1 -- 172.21.15.78:0/1163123768 learned_addr learned my addr 172.21.15.78:0/1163123768 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:21.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.752+0000 7fe7ab7fe640 1 --2- 172.21.15.78:0/1163123768 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe7ac0cd1a0 0x7fe7ac0b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:21.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.752+0000 7fe7abfff640 1 --2- 172.21.15.78:0/1163123768 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7ac15c6f0 0x7fe7ac1e98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:21.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.753+0000 7fe7aaffd640 1 -- 172.21.15.78:0/1163123768 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe7ac0cd1a0 msgr2=0x7fe7ac0b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:21.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.753+0000 7fe7aaffd640 1 --2- 172.21.15.78:0/1163123768 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe7ac0cd1a0 0x7fe7ac0b1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:21.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.753+0000 7fe7aaffd640 1 -- 172.21.15.78:0/1163123768 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7ac15c6f0 msgr2=0x7fe7ac1e98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:21.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.753+0000 7fe7aaffd640 1 --2- 172.21.15.78:0/1163123768 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7ac15c6f0 0x7fe7ac1e98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:21.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.753+0000 7fe7aaffd640 1 -- 172.21.15.78:0/1163123768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ac1f8b00 con 0x7fe7ac0cf4a0 2024-09-17T03:11:21.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.753+0000 7fe7aaffd640 1 --2- 172.21.15.78:0/1163123768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7ac0cf4a0 0x7fe7ac1e9370 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fe7a000d680 tx=0x7fe7a000db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:21.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.753+0000 7fe793fff640 1 -- 172.21.15.78:0/1163123768 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0017070 con 0x7fe7ac0cf4a0 2024-09-17T03:11:21.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.753+0000 7fe793fff640 1 -- 172.21.15.78:0/1163123768 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7a0005310 con 0x7fe7ac0cf4a0 2024-09-17T03:11:21.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.753+0000 7fe7b1b20640 1 -- 172.21.15.78:0/1163123768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ac1f8de0 con 0x7fe7ac0cf4a0 2024-09-17T03:11:21.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.753+0000 7fe793fff640 1 -- 172.21.15.78:0/1163123768 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0009820 con 0x7fe7ac0cf4a0 2024-09-17T03:11:21.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.753+0000 7fe7b1b20640 1 -- 172.21.15.78:0/1163123768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ac1f93a0 con 0x7fe7ac0cf4a0 2024-09-17T03:11:21.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.754+0000 7fe7b1b20640 1 -- 172.21.15.78:0/1163123768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7ac0ccc60 con 0x7fe7ac0cf4a0 2024-09-17T03:11:21.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.755+0000 7fe793fff640 1 -- 172.21.15.78:0/1163123768 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe7a00099c0 con 0x7fe7ac0cf4a0 2024-09-17T03:11:21.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.755+0000 7fe793fff640 1 --2- 172.21.15.78:0/1163123768 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe798078bc0 0x7fe79807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:21.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.756+0000 7fe793fff640 1 -- 172.21.15.78:0/1163123768 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6025+0+0 (secure 0 0 0) 0x7fe7a009ae00 con 0x7fe7ac0cf4a0 2024-09-17T03:11:21.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.756+0000 7fe7ab7fe640 1 --2- 172.21.15.78:0/1163123768 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe798078bc0 0x7fe79807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:21.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.756+0000 7fe7ab7fe640 1 --2- 172.21.15.78:0/1163123768 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe798078bc0 0x7fe79807b0d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00bad0 tx=0x7fe79c00b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:21.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.760+0000 7fe793fff640 1 -- 172.21.15.78:0/1163123768 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe7a0062ac0 con 0x7fe7ac0cf4a0 2024-09-17T03:11:21.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:21.939+0000 7fe7b1b20640 1 -- 172.21.15.78:0/1163123768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe7ac070100 con 0x7fe7ac0cf4a0 2024-09-17T03:11:22.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.818+0000 7fe793fff640 1 -- 172.21.15.78:0/1163123768 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v49) ==== 181+0+0 (secure 0 0 0) 0x7fe7a00674f0 con 0x7fe7ac0cf4a0 2024-09-17T03:11:22.817 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:11:22.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.822+0000 7fe7b1b20640 1 -- 172.21.15.78:0/1163123768 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe798078bc0 msgr2=0x7fe79807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:22.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.822+0000 7fe7b1b20640 1 --2- 172.21.15.78:0/1163123768 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe798078bc0 0x7fe79807b0d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe79c00bad0 tx=0x7fe79c00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:11:22.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.822+0000 7fe7b1b20640 1 -- 172.21.15.78:0/1163123768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7ac0cf4a0 msgr2=0x7fe7ac1e9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:22.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.822+0000 7fe7b1b20640 1 --2- 172.21.15.78:0/1163123768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7ac0cf4a0 0x7fe7ac1e9370 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fe7a000d680 tx=0x7fe7a000db40 comp rx=0 tx=0).stop 2024-09-17T03:11:22.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.822+0000 7fe7b1b20640 1 -- 172.21.15.78:0/1163123768 shutdown_connections 2024-09-17T03:11:22.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.822+0000 7fe7b1b20640 1 --2- 172.21.15.78:0/1163123768 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe798078bc0 0x7fe79807b0d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:22.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.822+0000 7fe7b1b20640 1 --2- 172.21.15.78:0/1163123768 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe7ac15c6f0 0x7fe7ac1e98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:22.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.822+0000 7fe7b1b20640 1 --2- 172.21.15.78:0/1163123768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7ac0cf4a0 0x7fe7ac1e9370 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:22.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.822+0000 7fe7b1b20640 1 --2- 172.21.15.78:0/1163123768 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe7ac0cd1a0 0x7fe7ac0b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:22.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.822+0000 7fe7b1b20640 1 -- 172.21.15.78:0/1163123768 >> 172.21.15.78:0/1163123768 conn(0x7fe7ac0710b0 msgr2=0x7fe7ac15ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:22.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.822+0000 7fe7b1b20640 1 -- 172.21.15.78:0/1163123768 shutdown_connections 2024-09-17T03:11:22.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.822+0000 7fe7b1b20640 1 -- 172.21.15.78:0/1163123768 wait complete. 2024-09-17T03:11:22.835 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:11:22.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.957+0000 7f10cdbe4640 1 -- 172.21.15.78:0/2027971924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10c80ce8d0 msgr2=0x7f10c80b6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:22.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.957+0000 7f10cdbe4640 1 --2- 172.21.15.78:0/2027971924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10c80ce8d0 0x7f10c80b6120 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f10c80cd9e0 tx=0x7f10b802a530 comp rx=0 tx=0).stop 2024-09-17T03:11:22.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.957+0000 7f10cdbe4640 1 -- 172.21.15.78:0/2027971924 shutdown_connections 2024-09-17T03:11:22.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.957+0000 7f10cdbe4640 1 --2- 172.21.15.78:0/2027971924 >> v2:172.21.15.193:3300/0 conn(0x7f10c80b4150 0x7f10c80b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:22.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.957+0000 7f10cdbe4640 1 --2- 172.21.15.78:0/2027971924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10c80ce8d0 0x7f10c80b6120 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:22.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.957+0000 7f10cdbe4640 1 -- 172.21.15.78:0/2027971924 >> 172.21.15.78:0/2027971924 conn(0x7f10c809aa30 msgr2=0x7f10c80b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:22.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.957+0000 7f10cdbe4640 1 -- 172.21.15.78:0/2027971924 shutdown_connections 2024-09-17T03:11:22.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.957+0000 7f10cdbe4640 1 -- 172.21.15.78:0/2027971924 wait complete. 2024-09-17T03:11:22.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.959+0000 7f10cdbe4640 1 Processor -- start 2024-09-17T03:11:22.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.959+0000 7f10cdbe4640 1 -- start start 2024-09-17T03:11:22.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.960+0000 7f10cdbe4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10c80b4150 0x7f10c815d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:22.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.960+0000 7f10cdbe4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10c80ce8d0 0x7f10c81550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:22.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.960+0000 7f10cdbe4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f10c80cf7e0 0x7f10c81555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:22.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.960+0000 7f10cdbe4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f10c80b4c20 con 0x7f10c80b4150 2024-09-17T03:11:22.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.960+0000 7f10cdbe4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f10c80b4aa0 con 0x7f10c80ce8d0 2024-09-17T03:11:22.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.960+0000 7f10cdbe4640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f10c80b4da0 con 0x7f10c80cf7e0 2024-09-17T03:11:22.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.960+0000 7f10c77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10c80b4150 0x7f10c815d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:22.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.960+0000 7f10c77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10c80b4150 0x7f10c815d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54784/0 (socket says 172.21.15.78:54784) 2024-09-17T03:11:22.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.960+0000 7f10c77fe640 1 -- 172.21.15.78:0/2515238555 learned_addr learned my addr 172.21.15.78:0/2515238555 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:22.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.961+0000 7f10c6ffd640 1 --2- 172.21.15.78:0/2515238555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10c80ce8d0 0x7f10c81550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:22.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.961+0000 7f10c7fff640 1 --2- 172.21.15.78:0/2515238555 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f10c80cf7e0 0x7f10c81555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:22.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.961+0000 7f10c77fe640 1 -- 172.21.15.78:0/2515238555 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f10c80cf7e0 msgr2=0x7f10c81555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:22.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.961+0000 7f10c77fe640 1 --2- 172.21.15.78:0/2515238555 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f10c80cf7e0 0x7f10c81555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:22.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.961+0000 7f10c77fe640 1 -- 172.21.15.78:0/2515238555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10c80ce8d0 msgr2=0x7f10c81550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:22.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.961+0000 7f10c77fe640 1 --2- 172.21.15.78:0/2515238555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10c80ce8d0 0x7f10c81550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:22.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.961+0000 7f10c77fe640 1 -- 172.21.15.78:0/2515238555 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c815c6f0 con 0x7f10c80b4150 2024-09-17T03:11:22.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.961+0000 7f10c6ffd640 1 --2- 172.21.15.78:0/2515238555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10c80ce8d0 0x7f10c81550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:22.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.961+0000 7f10c77fe640 1 --2- 172.21.15.78:0/2515238555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10c80b4150 0x7f10c815d180 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f10b8009780 tx=0x7f10b8033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:22.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.961+0000 7f10affff640 1 -- 172.21.15.78:0/2515238555 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b8031d60 con 0x7f10c80b4150 2024-09-17T03:11:22.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.961+0000 7f10affff640 1 -- 172.21.15.78:0/2515238555 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f10b8005020 con 0x7f10c80b4150 2024-09-17T03:11:22.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.961+0000 7f10cdbe4640 1 -- 172.21.15.78:0/2515238555 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c8155b30 con 0x7f10c80b4150 2024-09-17T03:11:22.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.961+0000 7f10affff640 1 -- 172.21.15.78:0/2515238555 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b8005470 con 0x7f10c80b4150 2024-09-17T03:11:22.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.961+0000 7f10cdbe4640 1 -- 172.21.15.78:0/2515238555 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c8157010 con 0x7f10c80b4150 2024-09-17T03:11:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.962+0000 7f10cdbe4640 1 -- 172.21.15.78:0/2515238555 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10c80b5340 con 0x7f10c80b4150 2024-09-17T03:11:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.963+0000 7f10affff640 1 -- 172.21.15.78:0/2515238555 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f10b80047a0 con 0x7f10c80b4150 2024-09-17T03:11:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.963+0000 7f10affff640 1 --2- 172.21.15.78:0/2515238555 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f10b4078b90 0x7f10b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.963+0000 7f10affff640 1 -- 172.21.15.78:0/2515238555 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5587+0+0 (secure 0 0 0) 0x7f10b80bc090 con 0x7f10c80b4150 2024-09-17T03:11:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.964+0000 7f10c6ffd640 1 --2- 172.21.15.78:0/2515238555 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f10b4078b90 0x7f10b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.964+0000 7f10c6ffd640 1 --2- 172.21.15.78:0/2515238555 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f10b4078b90 0x7f10b407b0a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f10c815dfa0 tx=0x7f10bc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:22.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:22.968+0000 7f10affff640 1 -- 172.21.15.78:0/2515238555 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f10b803f030 con 0x7f10c80b4150 2024-09-17T03:11:23.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.141+0000 7f10cdbe4640 1 -- 172.21.15.78:0/2515238555 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f10c81f38d0 con 0x7f10c80b4150 2024-09-17T03:11:23.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.832+0000 7f10affff640 1 -- 172.21.15.78:0/2515238555 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v50) ==== 169+0+0 (secure 0 0 0) 0x7f10b8084540 con 0x7f10c80b4150 2024-09-17T03:11:23.832 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2024-09-17T03:11:23.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.835+0000 7f10cdbe4640 1 -- 172.21.15.78:0/2515238555 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f10b4078b90 msgr2=0x7f10b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:23.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.835+0000 7f10cdbe4640 1 --2- 172.21.15.78:0/2515238555 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f10b4078b90 0x7f10b407b0a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f10c815dfa0 tx=0x7f10bc009040 comp rx=0 tx=0).stop 2024-09-17T03:11:23.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.836+0000 7f10cdbe4640 1 -- 172.21.15.78:0/2515238555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10c80b4150 msgr2=0x7f10c815d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:23.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.836+0000 7f10cdbe4640 1 --2- 172.21.15.78:0/2515238555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10c80b4150 0x7f10c815d180 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f10b8009780 tx=0x7f10b8033d60 comp rx=0 tx=0).stop 2024-09-17T03:11:23.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.836+0000 7f10cdbe4640 1 -- 172.21.15.78:0/2515238555 shutdown_connections 2024-09-17T03:11:23.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.836+0000 7f10cdbe4640 1 --2- 172.21.15.78:0/2515238555 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f10c80cf7e0 0x7f10c81555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:23.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.836+0000 7f10cdbe4640 1 --2- 172.21.15.78:0/2515238555 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f10b4078b90 0x7f10b407b0a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:23.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.836+0000 7f10cdbe4640 1 --2- 172.21.15.78:0/2515238555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10c80ce8d0 0x7f10c81550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:23.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.836+0000 7f10cdbe4640 1 --2- 172.21.15.78:0/2515238555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10c80b4150 0x7f10c815d180 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:23.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.836+0000 7f10cdbe4640 1 -- 172.21.15.78:0/2515238555 >> 172.21.15.78:0/2515238555 conn(0x7f10c809aa30 msgr2=0x7f10c8071790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:23.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.837+0000 7f10cdbe4640 1 -- 172.21.15.78:0/2515238555 shutdown_connections 2024-09-17T03:11:23.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.837+0000 7f10cdbe4640 1 -- 172.21.15.78:0/2515238555 wait complete. 2024-09-17T03:11:23.850 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:11:23.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.970+0000 7fa3ed957640 1 -- 172.21.15.78:0/3425174645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e806e170 msgr2=0x7fa3e80b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:23.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.970+0000 7fa3ed957640 1 --2- 172.21.15.78:0/3425174645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e806e170 0x7fa3e80b3540 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80ba090 tx=0x7fa3e002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:11:23.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.970+0000 7fa3ed957640 1 -- 172.21.15.78:0/3425174645 shutdown_connections 2024-09-17T03:11:23.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.970+0000 7fa3ed957640 1 --2- 172.21.15.78:0/3425174645 >> v2:172.21.15.193:3300/0 conn(0x7fa3e80ceb40 0x7fa3e80cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:23.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.970+0000 7fa3ed957640 1 --2- 172.21.15.78:0/3425174645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e806e170 0x7fa3e80b3540 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:23.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.970+0000 7fa3ed957640 1 -- 172.21.15.78:0/3425174645 >> 172.21.15.78:0/3425174645 conn(0x7fa3e808bfc0 msgr2=0x7fa3e809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:23.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.970+0000 7fa3ed957640 1 -- 172.21.15.78:0/3425174645 shutdown_connections 2024-09-17T03:11:23.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.970+0000 7fa3ed957640 1 -- 172.21.15.78:0/3425174645 wait complete. 2024-09-17T03:11:23.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.972+0000 7fa3ed957640 1 Processor -- start 2024-09-17T03:11:23.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.972+0000 7fa3ed957640 1 -- start start 2024-09-17T03:11:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.974+0000 7fa3ed957640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3e806f4b0 0x7fa3e80a19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.974+0000 7fa3ed957640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa3e80ceb40 0x7fa3e81f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.974+0000 7fa3ed957640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e81f5b30 0x7fa3e81f8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.974+0000 7fa3ed957640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e80d0e60 con 0x7fa3e81f5b30 2024-09-17T03:11:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.974+0000 7fa3ed957640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e80d0ce0 con 0x7fa3e806f4b0 2024-09-17T03:11:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.974+0000 7fa3ed957640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e80d0fe0 con 0x7fa3e80ceb40 2024-09-17T03:11:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.974+0000 7fa3e77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e81f5b30 0x7fa3e81f8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.974+0000 7fa3e77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e81f5b30 0x7fa3e81f8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54806/0 (socket says 172.21.15.78:54806) 2024-09-17T03:11:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.974+0000 7fa3e77fe640 1 -- 172.21.15.78:0/1976213881 learned_addr learned my addr 172.21.15.78:0/1976213881 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.974+0000 7fa3e67fc640 1 --2- 172.21.15.78:0/1976213881 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa3e80ceb40 0x7fa3e81f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.974+0000 7fa3e6ffd640 1 --2- 172.21.15.78:0/1976213881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3e806f4b0 0x7fa3e80a19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.974+0000 7fa3e77fe640 1 -- 172.21.15.78:0/1976213881 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa3e80ceb40 msgr2=0x7fa3e81f55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.974+0000 7fa3e77fe640 1 --2- 172.21.15.78:0/1976213881 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa3e80ceb40 0x7fa3e81f55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.974+0000 7fa3e77fe640 1 -- 172.21.15.78:0/1976213881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3e806f4b0 msgr2=0x7fa3e80a19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.974+0000 7fa3e77fe640 1 --2- 172.21.15.78:0/1976213881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3e806f4b0 0x7fa3e80a19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.974+0000 7fa3e77fe640 1 -- 172.21.15.78:0/1976213881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e80c91e0 con 0x7fa3e81f5b30 2024-09-17T03:11:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.974+0000 7fa3e77fe640 1 --2- 172.21.15.78:0/1976213881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e81f5b30 0x7fa3e81f8940 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8005d00 tx=0x7fa3d800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.974+0000 7fa3dffff640 1 -- 172.21.15.78:0/1976213881 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8017070 con 0x7fa3e81f5b30 2024-09-17T03:11:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.975+0000 7fa3dffff640 1 -- 172.21.15.78:0/1976213881 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3d8005330 con 0x7fa3e81f5b30 2024-09-17T03:11:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.975+0000 7fa3ed957640 1 -- 172.21.15.78:0/1976213881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e80c94c0 con 0x7fa3e81f5b30 2024-09-17T03:11:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.975+0000 7fa3dffff640 1 -- 172.21.15.78:0/1976213881 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80047a0 con 0x7fa3e81f5b30 2024-09-17T03:11:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.975+0000 7fa3ed957640 1 -- 172.21.15.78:0/1976213881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e80c9a80 con 0x7fa3e81f5b30 2024-09-17T03:11:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.975+0000 7fa3ed957640 1 -- 172.21.15.78:0/1976213881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e80d1570 con 0x7fa3e81f5b30 2024-09-17T03:11:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.976+0000 7fa3dffff640 1 -- 172.21.15.78:0/1976213881 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa3d8004940 con 0x7fa3e81f5b30 2024-09-17T03:11:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.977+0000 7fa3dffff640 1 --2- 172.21.15.78:0/1976213881 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa3c8078b90 0x7fa3c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.977+0000 7fa3dffff640 1 -- 172.21.15.78:0/1976213881 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5115+0+0 (secure 0 0 0) 0x7fa3d809aa10 con 0x7fa3e81f5b30 2024-09-17T03:11:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.977+0000 7fa3e6ffd640 1 --2- 172.21.15.78:0/1976213881 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa3c8078b90 0x7fa3c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:23.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.978+0000 7fa3e6ffd640 1 --2- 172.21.15.78:0/1976213881 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa3c8078b90 0x7fa3c807b0a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0034000 tx=0x7fa3e0004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:23.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:23.982+0000 7fa3dffff640 1 -- 172.21.15.78:0/1976213881 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa3d8062b70 con 0x7fa3e81f5b30 2024-09-17T03:11:24.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.155+0000 7fa3ed957640 1 -- 172.21.15.78:0/1976213881 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fa3e81f60f0 con 0x7fa3e81f5b30 2024-09-17T03:11:24.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.159+0000 7fa3dffff640 1 -- 172.21.15.78:0/1976213881 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v35) ==== 71+0+0 (secure 0 0 0) 0x7fa3d80675a0 con 0x7fa3e81f5b30 2024-09-17T03:11:24.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.161+0000 7fa3ed957640 1 -- 172.21.15.78:0/1976213881 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa3c8078b90 msgr2=0x7fa3c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:24.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.161+0000 7fa3ed957640 1 --2- 172.21.15.78:0/1976213881 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa3c8078b90 0x7fa3c807b0a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0034000 tx=0x7fa3e0004730 comp rx=0 tx=0).stop 2024-09-17T03:11:24.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.161+0000 7fa3ed957640 1 -- 172.21.15.78:0/1976213881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e81f5b30 msgr2=0x7fa3e81f8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:24.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.161+0000 7fa3ed957640 1 --2- 172.21.15.78:0/1976213881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e81f5b30 0x7fa3e81f8940 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8005d00 tx=0x7fa3d800dae0 comp rx=0 tx=0).stop 2024-09-17T03:11:24.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.161+0000 7fa3ed957640 1 -- 172.21.15.78:0/1976213881 shutdown_connections 2024-09-17T03:11:24.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.161+0000 7fa3ed957640 1 --2- 172.21.15.78:0/1976213881 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e81f5b30 0x7fa3e81f8940 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:24.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.161+0000 7fa3ed957640 1 --2- 172.21.15.78:0/1976213881 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa3e80ceb40 0x7fa3e81f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:24.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.161+0000 7fa3ed957640 1 --2- 172.21.15.78:0/1976213881 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa3c8078b90 0x7fa3c807b0a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:24.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.161+0000 7fa3ed957640 1 --2- 172.21.15.78:0/1976213881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3e806f4b0 0x7fa3e80a19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:24.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.161+0000 7fa3ed957640 1 -- 172.21.15.78:0/1976213881 >> 172.21.15.78:0/1976213881 conn(0x7fa3e808bfc0 msgr2=0x7fa3e80b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:24.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.162+0000 7fa3ed957640 1 -- 172.21.15.78:0/1976213881 shutdown_connections 2024-09-17T03:11:24.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.162+0000 7fa3ed957640 1 -- 172.21.15.78:0/1976213881 wait complete. 2024-09-17T03:11:24.172 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0' 2024-09-17T03:11:24.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.285+0000 7fc8cfc39640 1 -- 172.21.15.78:0/190865418 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8c8155ce0 msgr2=0x7fc8c80b45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.285+0000 7fc8cfc39640 1 --2- 172.21.15.78:0/190865418 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8c8155ce0 0x7fc8c80b45a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc8c0009830 tx=0x7fc8c002a510 comp rx=0 tx=0).stop 2024-09-17T03:11:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.285+0000 7fc8cfc39640 1 -- 172.21.15.78:0/190865418 shutdown_connections 2024-09-17T03:11:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.285+0000 7fc8cfc39640 1 --2- 172.21.15.78:0/190865418 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8c8155ce0 0x7fc8c80b45a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.285+0000 7fc8cfc39640 1 --2- 172.21.15.78:0/190865418 >> v2:172.21.15.193:3300/0 conn(0x7fc8c815c580 0x7fc8c8070540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.285+0000 7fc8cfc39640 1 -- 172.21.15.78:0/190865418 >> 172.21.15.78:0/190865418 conn(0x7fc8c806def0 msgr2=0x7fc8c806e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.286+0000 7fc8cfc39640 1 -- 172.21.15.78:0/190865418 shutdown_connections 2024-09-17T03:11:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.286+0000 7fc8cfc39640 1 -- 172.21.15.78:0/190865418 wait complete. 2024-09-17T03:11:24.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.287+0000 7fc8cfc39640 1 Processor -- start 2024-09-17T03:11:24.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.287+0000 7fc8cfc39640 1 -- start start 2024-09-17T03:11:24.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.289+0000 7fc8cfc39640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8c8074420 0x7fc8c8149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:24.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.289+0000 7fc8cfc39640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8c8155ce0 0x7fc8c8153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:24.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.289+0000 7fc8cfc39640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8c814a6b0 0x7fc8c8153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.289+0000 7fc8cfc39640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c80b5090 con 0x7fc8c8074420 2024-09-17T03:11:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.289+0000 7fc8cfc39640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c80b4f10 con 0x7fc8c8155ce0 2024-09-17T03:11:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.289+0000 7fc8cfc39640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc8c80b5210 con 0x7fc8c814a6b0 2024-09-17T03:11:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.289+0000 7fc8cd9d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8c8074420 0x7fc8c8149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.289+0000 7fc8cd1d4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8c8155ce0 0x7fc8c8153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.289+0000 7fc8cd9d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8c8074420 0x7fc8c8149f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54816/0 (socket says 172.21.15.78:54816) 2024-09-17T03:11:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.289+0000 7fc8ce1d6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8c814a6b0 0x7fc8c8153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.289+0000 7fc8cd9d5640 1 -- 172.21.15.78:0/295722553 learned_addr learned my addr 172.21.15.78:0/295722553 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.289+0000 7fc8cd9d5640 1 -- 172.21.15.78:0/295722553 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8c814a6b0 msgr2=0x7fc8c8153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.289+0000 7fc8cd9d5640 1 --2- 172.21.15.78:0/295722553 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8c814a6b0 0x7fc8c8153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.289+0000 7fc8cd9d5640 1 -- 172.21.15.78:0/295722553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8c8155ce0 msgr2=0x7fc8c8153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.289+0000 7fc8cd9d5640 1 --2- 172.21.15.78:0/295722553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8c8155ce0 0x7fc8c8153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.289+0000 7fc8cd9d5640 1 -- 172.21.15.78:0/295722553 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c814f270 con 0x7fc8c8074420 2024-09-17T03:11:24.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.289+0000 7fc8cd1d4640 1 --2- 172.21.15.78:0/295722553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8c8155ce0 0x7fc8c8153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:11:24.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.289+0000 7fc8cd9d5640 1 --2- 172.21.15.78:0/295722553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8c8074420 0x7fc8c8149f20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800cbc0 tx=0x7fc8b800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:24.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.290+0000 7fc8c67fc640 1 -- 172.21.15.78:0/295722553 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8016020 con 0x7fc8c8074420 2024-09-17T03:11:24.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.290+0000 7fc8cfc39640 1 -- 172.21.15.78:0/295722553 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c814a460 con 0x7fc8c8074420 2024-09-17T03:11:24.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.290+0000 7fc8c67fc640 1 -- 172.21.15.78:0/295722553 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8b800ad90 con 0x7fc8c8074420 2024-09-17T03:11:24.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.290+0000 7fc8c67fc640 1 -- 172.21.15.78:0/295722553 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b8012680 con 0x7fc8c8074420 2024-09-17T03:11:24.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.290+0000 7fc8cfc39640 1 -- 172.21.15.78:0/295722553 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c814fa50 con 0x7fc8c8074420 2024-09-17T03:11:24.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.290+0000 7fc8cfc39640 1 -- 172.21.15.78:0/295722553 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8c8154c80 con 0x7fc8c8074420 2024-09-17T03:11:24.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.292+0000 7fc8c67fc640 1 -- 172.21.15.78:0/295722553 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc8b8019020 con 0x7fc8c8074420 2024-09-17T03:11:24.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.292+0000 7fc8c67fc640 1 --2- 172.21.15.78:0/295722553 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc8b4078bc0 0x7fc8b407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:24.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.293+0000 7fc8c67fc640 1 -- 172.21.15.78:0/295722553 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5115+0+0 (secure 0 0 0) 0x7fc8b809b480 con 0x7fc8c8074420 2024-09-17T03:11:24.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.293+0000 7fc8cd1d4640 1 --2- 172.21.15.78:0/295722553 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc8b4078bc0 0x7fc8b407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:24.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.293+0000 7fc8cd1d4640 1 --2- 172.21.15.78:0/295722553 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc8b4078bc0 0x7fc8b407b0d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc8c814abb0 tx=0x7fc8bc005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:24.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.296+0000 7fc8c67fc640 1 -- 172.21.15.78:0/295722553 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc8c8154c80 con 0x7fc8c8074420 2024-09-17T03:11:24.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.537+0000 7fc8cfc39640 1 -- 172.21.15.78:0/295722553 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0"]} v 0) -- 0x7fc8c814cc70 con 0x7fc8c8074420 2024-09-17T03:11:24.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.834+0000 7fc8c67fc640 1 -- 172.21.15.78:0/295722553 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_abort_mds0"]}]=0 v163) ==== 143+0+0 (secure 0 0 0) 0x7fc8b8020020 con 0x7fc8c8074420 2024-09-17T03:11:24.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.836+0000 7fc8cfc39640 1 -- 172.21.15.78:0/295722553 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc8b4078bc0 msgr2=0x7fc8b407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:24.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.836+0000 7fc8cfc39640 1 --2- 172.21.15.78:0/295722553 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc8b4078bc0 0x7fc8b407b0d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc8c814abb0 tx=0x7fc8bc005f90 comp rx=0 tx=0).stop 2024-09-17T03:11:24.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.836+0000 7fc8cfc39640 1 -- 172.21.15.78:0/295722553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8c8074420 msgr2=0x7fc8c8149f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:24.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.836+0000 7fc8cfc39640 1 --2- 172.21.15.78:0/295722553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8c8074420 0x7fc8c8149f20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800cbc0 tx=0x7fc8b800a060 comp rx=0 tx=0).stop 2024-09-17T03:11:24.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.836+0000 7fc8cfc39640 1 -- 172.21.15.78:0/295722553 shutdown_connections 2024-09-17T03:11:24.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.836+0000 7fc8cfc39640 1 --2- 172.21.15.78:0/295722553 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8c814a6b0 0x7fc8c8153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:24.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.836+0000 7fc8cfc39640 1 --2- 172.21.15.78:0/295722553 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc8b4078bc0 0x7fc8b407b0d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:24.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.836+0000 7fc8cfc39640 1 --2- 172.21.15.78:0/295722553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8c8155ce0 0x7fc8c8153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:24.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.836+0000 7fc8cfc39640 1 --2- 172.21.15.78:0/295722553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8c8074420 0x7fc8c8149f20 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:24.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.836+0000 7fc8cfc39640 1 -- 172.21.15.78:0/295722553 >> 172.21.15.78:0/295722553 conn(0x7fc8c806def0 msgr2=0x7fc8c8154570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:24.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.837+0000 7fc8cfc39640 1 -- 172.21.15.78:0/295722553 shutdown_connections 2024-09-17T03:11:24.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.837+0000 7fc8cfc39640 1 -- 172.21.15.78:0/295722553 wait complete. 2024-09-17T03:11:24.848 INFO:tasks.cephfs_test_runner:test_scrub_abort_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2024-09-17T03:11:24.849 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace (tasks.cephfs.test_multimds_misc.TestScrub2) 2024-09-17T03:11:24.849 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:11:24.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.966+0000 7f15e3c0e640 1 -- 172.21.15.78:0/4015416113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15dc0cf5d0 msgr2=0x7f15dc0cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:24.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.966+0000 7f15e3c0e640 1 --2- 172.21.15.78:0/4015416113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15dc0cf5d0 0x7f15dc0cf9e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f15dc08d4e0 tx=0x7f15d402aa30 comp rx=0 tx=0).stop 2024-09-17T03:11:24.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.966+0000 7f15e3c0e640 1 -- 172.21.15.78:0/4015416113 shutdown_connections 2024-09-17T03:11:24.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.966+0000 7f15e3c0e640 1 --2- 172.21.15.78:0/4015416113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15dc0cf5d0 0x7f15dc0cf9e0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:24.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.966+0000 7f15e3c0e640 1 --2- 172.21.15.78:0/4015416113 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15dc0b9b70 0x7f15dc0cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:24.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.966+0000 7f15e3c0e640 1 --2- 172.21.15.78:0/4015416113 >> v2:172.21.15.193:3300/0 conn(0x7f15dc0d2ed0 0x7f15dc0d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.966+0000 7f15e3c0e640 1 -- 172.21.15.78:0/4015416113 >> 172.21.15.78:0/4015416113 conn(0x7f15dc08bfc0 msgr2=0x7f15dc09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.966+0000 7f15e3c0e640 1 -- 172.21.15.78:0/4015416113 shutdown_connections 2024-09-17T03:11:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.966+0000 7f15e3c0e640 1 -- 172.21.15.78:0/4015416113 wait complete. 2024-09-17T03:11:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.968+0000 7f15e3c0e640 1 Processor -- start 2024-09-17T03:11:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.968+0000 7f15e3c0e640 1 -- start start 2024-09-17T03:11:24.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.969+0000 7f15e3c0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15dc0b9b70 0x7f15dc151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:24.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.969+0000 7f15e3c0e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15dc0cf5d0 0x7f15dc153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:24.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.969+0000 7f15e3c0e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15dc0d2ed0 0x7f15dc154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:24.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.969+0000 7f15e3c0e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc0d4640 con 0x7f15dc0b9b70 2024-09-17T03:11:24.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.969+0000 7f15e3c0e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc0d44c0 con 0x7f15dc0d2ed0 2024-09-17T03:11:24.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.969+0000 7f15e3c0e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f15dc0d47c0 con 0x7f15dc0cf5d0 2024-09-17T03:11:24.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.969+0000 7f15e19aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15dc0b9b70 0x7f15dc151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:24.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.969+0000 7f15e19aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15dc0b9b70 0x7f15dc151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54828/0 (socket says 172.21.15.78:54828) 2024-09-17T03:11:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.969+0000 7f15e19aa640 1 -- 172.21.15.78:0/3170573038 learned_addr learned my addr 172.21.15.78:0/3170573038 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.969+0000 7f15e11a9640 1 --2- 172.21.15.78:0/3170573038 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15dc0cf5d0 0x7f15dc153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.969+0000 7f15e21ab640 1 --2- 172.21.15.78:0/3170573038 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15dc0d2ed0 0x7f15dc154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.969+0000 7f15e19aa640 1 -- 172.21.15.78:0/3170573038 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15dc0cf5d0 msgr2=0x7f15dc153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.969+0000 7f15e19aa640 1 --2- 172.21.15.78:0/3170573038 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15dc0cf5d0 0x7f15dc153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.969+0000 7f15e19aa640 1 -- 172.21.15.78:0/3170573038 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15dc0d2ed0 msgr2=0x7f15dc154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.969+0000 7f15e19aa640 1 --2- 172.21.15.78:0/3170573038 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15dc0d2ed0 0x7f15dc154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.969+0000 7f15e19aa640 1 -- 172.21.15.78:0/3170573038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15dc0ca080 con 0x7f15dc0b9b70 2024-09-17T03:11:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.969+0000 7f15e21ab640 1 --2- 172.21.15.78:0/3170573038 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15dc0d2ed0 0x7f15dc154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.970+0000 7f15e19aa640 1 --2- 172.21.15.78:0/3170573038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15dc0b9b70 0x7f15dc151350 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00c970 tx=0x7f15cc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.970+0000 7f15da7fc640 1 -- 172.21.15.78:0/3170573038 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc004220 con 0x7f15dc0b9b70 2024-09-17T03:11:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.970+0000 7f15da7fc640 1 -- 172.21.15.78:0/3170573038 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15cc007950 con 0x7f15dc0b9b70 2024-09-17T03:11:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.970+0000 7f15e3c0e640 1 -- 172.21.15.78:0/3170573038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15dc0ca360 con 0x7f15dc0b9b70 2024-09-17T03:11:24.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.970+0000 7f15da7fc640 1 -- 172.21.15.78:0/3170573038 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15cc007da0 con 0x7f15dc0b9b70 2024-09-17T03:11:24.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.970+0000 7f15e3c0e640 1 -- 172.21.15.78:0/3170573038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15dc0ca920 con 0x7f15dc0b9b70 2024-09-17T03:11:24.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.971+0000 7f15e3c0e640 1 -- 172.21.15.78:0/3170573038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15dc0cf9e0 con 0x7f15dc0b9b70 2024-09-17T03:11:24.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.971+0000 7f15da7fc640 1 -- 172.21.15.78:0/3170573038 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f15cc005030 con 0x7f15dc0b9b70 2024-09-17T03:11:24.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.972+0000 7f15da7fc640 1 --2- 172.21.15.78:0/3170573038 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f15c8078b90 0x7f15c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:24.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.972+0000 7f15da7fc640 1 -- 172.21.15.78:0/3170573038 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5115+0+0 (secure 0 0 0) 0x7f15cc09ae10 con 0x7f15dc0b9b70 2024-09-17T03:11:24.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.972+0000 7f15e11a9640 1 --2- 172.21.15.78:0/3170573038 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f15c8078b90 0x7f15c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:24.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.973+0000 7f15e11a9640 1 --2- 172.21.15.78:0/3170573038 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f15c8078b90 0x7f15c807b0a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f15dc1f8d90 tx=0x7f15d00090e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:24.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:24.976+0000 7f15da7fc640 1 -- 172.21.15.78:0/3170573038 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f15cc014070 con 0x7f15dc0b9b70 2024-09-17T03:11:25.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.151+0000 7f15e3c0e640 1 -- 172.21.15.78:0/3170573038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15dc0b47e0 con 0x7f15dc0b9b70 2024-09-17T03:11:25.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.152+0000 7f15da7fc640 1 -- 172.21.15.78:0/3170573038 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+13272 (secure 0 0 0) 0x7f15cc062ee0 con 0x7f15dc0b9b70 2024-09-17T03:11:25.151 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:25.151 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":50,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:11:23.827625+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6835/3629327943":"2024-09-18T03:11:20.611963+0000","172.21.15.78:6832/3629327943":"2024-09-18T03:11:20.611963+0000","172.21.15.193:6836/1788096053":"2024-09-18T03:11:20.611986+0000","172.21.15.193:6834/1788096053":"2024-09-18T03:11:20.611986+0000","172.21.15.193:6837/3209848332":"2024-09-18T03:11:20.611980+0000","172.21.15.193:6835/3209848332":"2024-09-18T03:11:20.611980+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:11:25.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.154+0000 7f15e3c0e640 1 -- 172.21.15.78:0/3170573038 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f15c8078b90 msgr2=0x7f15c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:25.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.154+0000 7f15e3c0e640 1 --2- 172.21.15.78:0/3170573038 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f15c8078b90 0x7f15c807b0a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f15dc1f8d90 tx=0x7f15d00090e0 comp rx=0 tx=0).stop 2024-09-17T03:11:25.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.154+0000 7f15e3c0e640 1 -- 172.21.15.78:0/3170573038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15dc0b9b70 msgr2=0x7f15dc151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:25.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.154+0000 7f15e3c0e640 1 --2- 172.21.15.78:0/3170573038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15dc0b9b70 0x7f15dc151350 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00c970 tx=0x7f15cc00ce30 comp rx=0 tx=0).stop 2024-09-17T03:11:25.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.154+0000 7f15e3c0e640 1 -- 172.21.15.78:0/3170573038 shutdown_connections 2024-09-17T03:11:25.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.154+0000 7f15e3c0e640 1 --2- 172.21.15.78:0/3170573038 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f15c8078b90 0x7f15c807b0a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:25.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.154+0000 7f15e3c0e640 1 --2- 172.21.15.78:0/3170573038 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15dc0d2ed0 0x7f15dc154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:25.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.154+0000 7f15e3c0e640 1 --2- 172.21.15.78:0/3170573038 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15dc0cf5d0 0x7f15dc153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:25.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.154+0000 7f15e3c0e640 1 --2- 172.21.15.78:0/3170573038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15dc0b9b70 0x7f15dc151350 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:25.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.154+0000 7f15e3c0e640 1 -- 172.21.15.78:0/3170573038 >> 172.21.15.78:0/3170573038 conn(0x7f15dc08bfc0 msgr2=0x7f15dc06ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:25.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.154+0000 7f15e3c0e640 1 -- 172.21.15.78:0/3170573038 shutdown_connections 2024-09-17T03:11:25.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.154+0000 7f15e3c0e640 1 -- 172.21.15.78:0/3170573038 wait complete. 2024-09-17T03:11:25.165 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:08:17.135915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:11:25.165 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:11:25.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.283+0000 7fba9fd69640 1 -- 172.21.15.78:0/2938409579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba80004800 msgr2=0x7fba80004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:25.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.283+0000 7fba9fd69640 1 --2- 172.21.15.78:0/2938409579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba80004800 0x7fba80004c10 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009b20 tx=0x7fba80005830 comp rx=0 tx=0).stop 2024-09-17T03:11:25.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.283+0000 7fba9fd69640 1 -- 172.21.15.78:0/2938409579 shutdown_connections 2024-09-17T03:11:25.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.283+0000 7fba9fd69640 1 --2- 172.21.15.78:0/2938409579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba80004800 0x7fba80004c10 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:25.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.283+0000 7fba9fd69640 1 -- 172.21.15.78:0/2938409579 >> 172.21.15.78:0/2938409579 conn(0x7fba9806def0 msgr2=0x7fba9806e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:25.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.283+0000 7fba9fd69640 1 -- 172.21.15.78:0/2938409579 shutdown_connections 2024-09-17T03:11:25.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.283+0000 7fba9fd69640 1 -- 172.21.15.78:0/2938409579 wait complete. 2024-09-17T03:11:25.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.285+0000 7fba9fd69640 1 Processor -- start 2024-09-17T03:11:25.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.285+0000 7fba9fd69640 1 -- start start 2024-09-17T03:11:25.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.286+0000 7fba9fd69640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba80004800 0x7fba981583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:25.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.286+0000 7fba9fd69640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba98153870 0x7fba981f3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:25.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.286+0000 7fba9fd69640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba980c6080 0x7fba980c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:25.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.286+0000 7fba9fd69640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fba98070320 con 0x7fba80004800 2024-09-17T03:11:25.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.286+0000 7fba9fd69640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fba980701a0 con 0x7fba980c6080 2024-09-17T03:11:25.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.286+0000 7fba9fd69640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fba980704a0 con 0x7fba98153870 2024-09-17T03:11:25.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.286+0000 7fba9db05640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba80004800 0x7fba981583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.286+0000 7fba9db05640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba80004800 0x7fba981583b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54842/0 (socket says 172.21.15.78:54842) 2024-09-17T03:11:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.286+0000 7fba9db05640 1 -- 172.21.15.78:0/2464527426 learned_addr learned my addr 172.21.15.78:0/2464527426 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.286+0000 7fba9d304640 1 --2- 172.21.15.78:0/2464527426 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba98153870 0x7fba981f3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.286+0000 7fba9e306640 1 --2- 172.21.15.78:0/2464527426 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba980c6080 0x7fba980c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.286+0000 7fba9db05640 1 -- 172.21.15.78:0/2464527426 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba98153870 msgr2=0x7fba981f3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.286+0000 7fba9db05640 1 --2- 172.21.15.78:0/2464527426 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba98153870 0x7fba981f3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.286+0000 7fba9db05640 1 -- 172.21.15.78:0/2464527426 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba980c6080 msgr2=0x7fba980c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.286+0000 7fba9db05640 1 --2- 172.21.15.78:0/2464527426 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba980c6080 0x7fba980c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.286+0000 7fba9db05640 1 -- 172.21.15.78:0/2464527426 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba980c69d0 con 0x7fba80004800 2024-09-17T03:11:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.286+0000 7fba9db05640 1 --2- 172.21.15.78:0/2464527426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba80004800 0x7fba981583b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fba8800e970 tx=0x7fba8800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.287+0000 7fba967fc640 1 -- 172.21.15.78:0/2464527426 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba88015020 con 0x7fba80004800 2024-09-17T03:11:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.287+0000 7fba967fc640 1 -- 172.21.15.78:0/2464527426 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba8800ce00 con 0x7fba80004800 2024-09-17T03:11:25.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.287+0000 7fba9fd69640 1 -- 172.21.15.78:0/2464527426 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba981f3cd0 con 0x7fba80004800 2024-09-17T03:11:25.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.287+0000 7fba967fc640 1 -- 172.21.15.78:0/2464527426 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba880116c0 con 0x7fba80004800 2024-09-17T03:11:25.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.287+0000 7fba9fd69640 1 -- 172.21.15.78:0/2464527426 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba980c73d0 con 0x7fba80004800 2024-09-17T03:11:25.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.288+0000 7fba9fd69640 1 -- 172.21.15.78:0/2464527426 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba98070a00 con 0x7fba80004800 2024-09-17T03:11:25.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.288+0000 7fba967fc640 1 -- 172.21.15.78:0/2464527426 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fba88018020 con 0x7fba80004800 2024-09-17T03:11:25.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.289+0000 7fba967fc640 1 --2- 172.21.15.78:0/2464527426 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fba84078b90 0x7fba8407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:25.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.289+0000 7fba967fc640 1 -- 172.21.15.78:0/2464527426 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5115+0+0 (secure 0 0 0) 0x7fba8809b490 con 0x7fba80004800 2024-09-17T03:11:25.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.289+0000 7fba9d304640 1 --2- 172.21.15.78:0/2464527426 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fba84078b90 0x7fba8407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:25.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.289+0000 7fba9d304640 1 --2- 172.21.15.78:0/2464527426 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fba84078b90 0x7fba8407b0a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fba8c035000 tx=0x7fba8c02d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:25.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.293+0000 7fba967fc640 1 -- 172.21.15.78:0/2464527426 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fba8801f020 con 0x7fba80004800 2024-09-17T03:11:25.412 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:11:25.415 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:11:25.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.469+0000 7fba9fd69640 1 -- 172.21.15.78:0/2464527426 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fba980cd420 con 0x7fba80004800 2024-09-17T03:11:25.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.470+0000 7fba967fc640 1 -- 172.21.15.78:0/2464527426 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) ==== 93+0+10 (secure 0 0 0) 0x7fba980c69d0 con 0x7fba80004800 2024-09-17T03:11:25.468 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-09-17T03:11:25.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.472+0000 7fba9fd69640 1 -- 172.21.15.78:0/2464527426 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fba84078b90 msgr2=0x7fba8407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:25.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.472+0000 7fba9fd69640 1 --2- 172.21.15.78:0/2464527426 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fba84078b90 0x7fba8407b0a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fba8c035000 tx=0x7fba8c02d040 comp rx=0 tx=0).stop 2024-09-17T03:11:25.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.472+0000 7fba9fd69640 1 -- 172.21.15.78:0/2464527426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba80004800 msgr2=0x7fba981583b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:25.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.472+0000 7fba9fd69640 1 --2- 172.21.15.78:0/2464527426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba80004800 0x7fba981583b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fba8800e970 tx=0x7fba8800ee30 comp rx=0 tx=0).stop 2024-09-17T03:11:25.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.472+0000 7fba9fd69640 1 -- 172.21.15.78:0/2464527426 shutdown_connections 2024-09-17T03:11:25.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.472+0000 7fba9fd69640 1 --2- 172.21.15.78:0/2464527426 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fba84078b90 0x7fba8407b0a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:25.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.472+0000 7fba9fd69640 1 --2- 172.21.15.78:0/2464527426 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba980c6080 0x7fba980c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:25.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.472+0000 7fba9fd69640 1 --2- 172.21.15.78:0/2464527426 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba98153870 0x7fba981f3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:25.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.472+0000 7fba9fd69640 1 --2- 172.21.15.78:0/2464527426 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba80004800 0x7fba981583b0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:25.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.472+0000 7fba9fd69640 1 -- 172.21.15.78:0/2464527426 >> 172.21.15.78:0/2464527426 conn(0x7fba9806def0 msgr2=0x7fba9806e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:25.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.472+0000 7fba9fd69640 1 -- 172.21.15.78:0/2464527426 shutdown_connections 2024-09-17T03:11:25.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.472+0000 7fba9fd69640 1 -- 172.21.15.78:0/2464527426 wait complete. 2024-09-17T03:11:25.482 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace' 2024-09-17T03:11:25.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.640+0000 7fa148641640 1 -- 172.21.15.78:0/2358767911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14006e170 msgr2=0x7fa1400b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:25.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.640+0000 7fa148641640 1 --2- 172.21.15.78:0/2358767911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14006e170 0x7fa1400b3540 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa1400ba570 tx=0x7fa13c02a4f0 comp rx=0 tx=0).stop 2024-09-17T03:11:25.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.640+0000 7fa148641640 1 -- 172.21.15.78:0/2358767911 shutdown_connections 2024-09-17T03:11:25.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.640+0000 7fa148641640 1 --2- 172.21.15.78:0/2358767911 >> v2:172.21.15.193:3300/0 conn(0x7fa1400ceb40 0x7fa1400cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:25.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.640+0000 7fa148641640 1 --2- 172.21.15.78:0/2358767911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14006e170 0x7fa1400b3540 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:25.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.640+0000 7fa148641640 1 -- 172.21.15.78:0/2358767911 >> 172.21.15.78:0/2358767911 conn(0x7fa14008bfc0 msgr2=0x7fa14009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:25.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.640+0000 7fa148641640 1 -- 172.21.15.78:0/2358767911 shutdown_connections 2024-09-17T03:11:25.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.640+0000 7fa148641640 1 -- 172.21.15.78:0/2358767911 wait complete. 2024-09-17T03:11:25.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.642+0000 7fa148641640 1 Processor -- start 2024-09-17T03:11:25.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.642+0000 7fa148641640 1 -- start start 2024-09-17T03:11:25.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.643+0000 7fa148641640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14006f4b0 0x7fa1401f9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:25.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.643+0000 7fa148641640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1400ceb40 0x7fa14014a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:25.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.643+0000 7fa148641640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa14014ab40 0x7fa140160fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:25.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.643+0000 7fa148641640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa1400d0e60 con 0x7fa14006f4b0 2024-09-17T03:11:25.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.643+0000 7fa148641640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa1400d0ce0 con 0x7fa1400ceb40 2024-09-17T03:11:25.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.643+0000 7fa148641640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa1400d0fe0 con 0x7fa14014ab40 2024-09-17T03:11:25.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.644+0000 7fa1463dd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14006f4b0 0x7fa1401f9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:25.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.644+0000 7fa1463dd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14006f4b0 0x7fa1401f9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54860/0 (socket says 172.21.15.78:54860) 2024-09-17T03:11:25.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.644+0000 7fa1463dd640 1 -- 172.21.15.78:0/2378648446 learned_addr learned my addr 172.21.15.78:0/2378648446 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:25.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.644+0000 7fa145bdc640 1 --2- 172.21.15.78:0/2378648446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1400ceb40 0x7fa14014a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:25.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.644+0000 7fa146bde640 1 --2- 172.21.15.78:0/2378648446 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa14014ab40 0x7fa140160fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:25.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.644+0000 7fa1463dd640 1 -- 172.21.15.78:0/2378648446 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa14014ab40 msgr2=0x7fa140160fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:25.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.644+0000 7fa1463dd640 1 --2- 172.21.15.78:0/2378648446 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa14014ab40 0x7fa140160fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:25.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.644+0000 7fa1463dd640 1 -- 172.21.15.78:0/2378648446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1400ceb40 msgr2=0x7fa14014a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:25.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.644+0000 7fa1463dd640 1 --2- 172.21.15.78:0/2378648446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1400ceb40 0x7fa14014a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:25.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.644+0000 7fa1463dd640 1 -- 172.21.15.78:0/2378648446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1400b6740 con 0x7fa14006f4b0 2024-09-17T03:11:25.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.644+0000 7fa1463dd640 1 --2- 172.21.15.78:0/2378648446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14006f4b0 0x7fa1401f9a70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa13c006010 tx=0x7fa13c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:25.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.644+0000 7fa136ffd640 1 -- 172.21.15.78:0/2378648446 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c03e030 con 0x7fa14006f4b0 2024-09-17T03:11:25.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.644+0000 7fa136ffd640 1 -- 172.21.15.78:0/2378648446 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa13c003d90 con 0x7fa14006f4b0 2024-09-17T03:11:25.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.644+0000 7fa136ffd640 1 -- 172.21.15.78:0/2378648446 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c035040 con 0x7fa14006f4b0 2024-09-17T03:11:25.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.644+0000 7fa148641640 1 -- 172.21.15.78:0/2378648446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa14014af50 con 0x7fa14006f4b0 2024-09-17T03:11:25.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.644+0000 7fa148641640 1 -- 172.21.15.78:0/2378648446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1401f8f90 con 0x7fa14006f4b0 2024-09-17T03:11:25.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.646+0000 7fa148641640 1 -- 172.21.15.78:0/2378648446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1400d1590 con 0x7fa14006f4b0 2024-09-17T03:11:25.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.646+0000 7fa136ffd640 1 -- 172.21.15.78:0/2378648446 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa13c041030 con 0x7fa14006f4b0 2024-09-17T03:11:25.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.647+0000 7fa136ffd640 1 --2- 172.21.15.78:0/2378648446 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa124078bc0 0x7fa12407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:25.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.647+0000 7fa136ffd640 1 -- 172.21.15.78:0/2378648446 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5115+0+0 (secure 0 0 0) 0x7fa13c0bb1e0 con 0x7fa14006f4b0 2024-09-17T03:11:25.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.647+0000 7fa145bdc640 1 --2- 172.21.15.78:0/2378648446 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa124078bc0 0x7fa12407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:25.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.648+0000 7fa145bdc640 1 --2- 172.21.15.78:0/2378648446 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa124078bc0 0x7fa12407b0d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa130007850 tx=0x7fa1300077e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:25.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.651+0000 7fa136ffd640 1 -- 172.21.15.78:0/2378648446 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa13c0832b0 con 0x7fa14006f4b0 2024-09-17T03:11:25.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:25.895+0000 7fa148641640 1 -- 172.21.15.78:0/2378648446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace"]} v 0) -- 0x7fa1400d3d90 con 0x7fa14006f4b0 2024-09-17T03:11:26.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.841+0000 7fa136ffd640 1 -- 172.21.15.78:0/2378648446 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace"]}]=0 v165) ==== 145+0+0 (secure 0 0 0) 0x7fa13c087ce0 con 0x7fa14006f4b0 2024-09-17T03:11:26.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.844+0000 7fa148641640 1 -- 172.21.15.78:0/2378648446 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa124078bc0 msgr2=0x7fa12407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:26.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.844+0000 7fa148641640 1 --2- 172.21.15.78:0/2378648446 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa124078bc0 0x7fa12407b0d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa130007850 tx=0x7fa1300077e0 comp rx=0 tx=0).stop 2024-09-17T03:11:26.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.844+0000 7fa148641640 1 -- 172.21.15.78:0/2378648446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14006f4b0 msgr2=0x7fa1401f9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:26.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.844+0000 7fa148641640 1 --2- 172.21.15.78:0/2378648446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14006f4b0 0x7fa1401f9a70 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa13c006010 tx=0x7fa13c0038a0 comp rx=0 tx=0).stop 2024-09-17T03:11:26.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.844+0000 7fa148641640 1 -- 172.21.15.78:0/2378648446 shutdown_connections 2024-09-17T03:11:26.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.844+0000 7fa148641640 1 --2- 172.21.15.78:0/2378648446 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa14014ab40 0x7fa140160fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:26.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.844+0000 7fa148641640 1 --2- 172.21.15.78:0/2378648446 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa124078bc0 0x7fa12407b0d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:26.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.844+0000 7fa148641640 1 --2- 172.21.15.78:0/2378648446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1400ceb40 0x7fa14014a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:26.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.844+0000 7fa148641640 1 --2- 172.21.15.78:0/2378648446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa14006f4b0 0x7fa1401f9a70 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:26.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.844+0000 7fa148641640 1 -- 172.21.15.78:0/2378648446 >> 172.21.15.78:0/2378648446 conn(0x7fa14008bfc0 msgr2=0x7fa14006eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:26.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.844+0000 7fa148641640 1 -- 172.21.15.78:0/2378648446 shutdown_connections 2024-09-17T03:11:26.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.844+0000 7fa148641640 1 -- 172.21.15.78:0/2378648446 wait complete. 2024-09-17T03:11:26.857 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:11:26.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.978+0000 7f16cc13a640 1 -- 172.21.15.78:0/737731596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c40b2cb0 msgr2=0x7f16c40b30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:26.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.978+0000 7f16cc13a640 1 --2- 172.21.15.78:0/737731596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c40b2cb0 0x7f16c40b30c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f16bc005fd0 tx=0x7f16bc02aa90 comp rx=0 tx=0).stop 2024-09-17T03:11:26.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.978+0000 7f16cc13a640 1 -- 172.21.15.78:0/737731596 shutdown_connections 2024-09-17T03:11:26.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.978+0000 7f16cc13a640 1 --2- 172.21.15.78:0/737731596 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c40b2cb0 0x7f16c40b30c0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:26.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.978+0000 7f16cc13a640 1 -- 172.21.15.78:0/737731596 >> 172.21.15.78:0/737731596 conn(0x7f16c40cdcb0 msgr2=0x7f16c40ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:26.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.978+0000 7f16cc13a640 1 -- 172.21.15.78:0/737731596 shutdown_connections 2024-09-17T03:11:26.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.978+0000 7f16cc13a640 1 -- 172.21.15.78:0/737731596 wait complete. 2024-09-17T03:11:26.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.979+0000 7f16cc13a640 1 Processor -- start 2024-09-17T03:11:26.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.980+0000 7f16cc13a640 1 -- start start 2024-09-17T03:11:26.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.981+0000 7f16cc13a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16c40b2cb0 0x7f16c41e4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:26.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.981+0000 7f16cc13a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f16c40cf130 0x7f16c41f3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:26.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.981+0000 7f16cc13a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c415b8f0 0x7f16c40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:26.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.981+0000 7f16cc13a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f16c40ae330 con 0x7f16c415b8f0 2024-09-17T03:11:26.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.981+0000 7f16cc13a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f16c40ae1b0 con 0x7f16c40b2cb0 2024-09-17T03:11:26.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.981+0000 7f16cc13a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f16c40ae4b0 con 0x7f16c40cf130 2024-09-17T03:11:26.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.981+0000 7f16ca6d7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c415b8f0 0x7f16c40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:26.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.981+0000 7f16ca6d7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c415b8f0 0x7f16c40b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60520/0 (socket says 172.21.15.78:60520) 2024-09-17T03:11:26.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.981+0000 7f16ca6d7640 1 -- 172.21.15.78:0/3769701724 learned_addr learned my addr 172.21.15.78:0/3769701724 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:26.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.981+0000 7f16ca6d7640 1 -- 172.21.15.78:0/3769701724 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f16c40cf130 msgr2=0x7f16c41f3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:26.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.981+0000 7f16ca6d7640 1 --2- 172.21.15.78:0/3769701724 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f16c40cf130 0x7f16c41f3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:26.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.981+0000 7f16ca6d7640 1 -- 172.21.15.78:0/3769701724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16c40b2cb0 msgr2=0x7f16c41e4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:26.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.981+0000 7f16c9ed6640 1 --2- 172.21.15.78:0/3769701724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16c40b2cb0 0x7f16c41e4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:26.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.981+0000 7f16ca6d7640 1 --2- 172.21.15.78:0/3769701724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16c40b2cb0 0x7f16c41e4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:26.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.981+0000 7f16ca6d7640 1 -- 172.21.15.78:0/3769701724 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c41f3840 con 0x7f16c415b8f0 2024-09-17T03:11:26.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.981+0000 7f16c9ed6640 1 --2- 172.21.15.78:0/3769701724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16c40b2cb0 0x7f16c41e4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:26.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.981+0000 7f16ca6d7640 1 --2- 172.21.15.78:0/3769701724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c415b8f0 0x7f16c40b4d90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009bf0 tx=0x7f16bc003d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:26.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.981+0000 7f16ba7fc640 1 -- 172.21.15.78:0/3769701724 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc044070 con 0x7f16c415b8f0 2024-09-17T03:11:26.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.982+0000 7f16ba7fc640 1 -- 172.21.15.78:0/3769701724 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16bc004250 con 0x7f16c415b8f0 2024-09-17T03:11:26.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.982+0000 7f16cc13a640 1 -- 172.21.15.78:0/3769701724 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c41e0f80 con 0x7f16c415b8f0 2024-09-17T03:11:26.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.982+0000 7f16ba7fc640 1 -- 172.21.15.78:0/3769701724 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc004660 con 0x7f16c415b8f0 2024-09-17T03:11:26.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.982+0000 7f16cc13a640 1 -- 172.21.15.78:0/3769701724 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c409af60 con 0x7f16c415b8f0 2024-09-17T03:11:26.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.983+0000 7f16cc13a640 1 -- 172.21.15.78:0/3769701724 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16c41e0cf0 con 0x7f16c415b8f0 2024-09-17T03:11:26.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.983+0000 7f16ba7fc640 1 -- 172.21.15.78:0/3769701724 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f16bc047070 con 0x7f16c415b8f0 2024-09-17T03:11:26.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.984+0000 7f16ba7fc640 1 --2- 172.21.15.78:0/3769701724 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f16a8078b90 0x7f16a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:26.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.984+0000 7f16ba7fc640 1 -- 172.21.15.78:0/3769701724 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5115+0+0 (secure 0 0 0) 0x7f16bc0bbaf0 con 0x7f16c415b8f0 2024-09-17T03:11:26.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.984+0000 7f16c9ed6640 1 --2- 172.21.15.78:0/3769701724 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f16a8078b90 0x7f16a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:26.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.985+0000 7f16c9ed6640 1 --2- 172.21.15.78:0/3769701724 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f16a8078b90 0x7f16a807b0a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f16c000a810 tx=0x7f16c0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:26.989+0000 7f16ba7fc640 1 -- 172.21.15.78:0/3769701724 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f16c41f3840 con 0x7f16c415b8f0 2024-09-17T03:11:27.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.162+0000 7f16cc13a640 1 -- 172.21.15.78:0/3769701724 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f16c40b30c0 con 0x7f16c415b8f0 2024-09-17T03:11:27.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.163+0000 7f16ba7fc640 1 -- 172.21.15.78:0/3769701724 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v35) ==== 59+0+2294 (secure 0 0 0) 0x7f16bc032030 con 0x7f16c415b8f0 2024-09-17T03:11:27.161 INFO:teuthology.orchestra.run.smithi078.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:11:27.162 INFO:teuthology.orchestra.run.smithi078.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:11:27.162 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:11:27.162 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_client 20/20 2024-09-17T03:11:27.162 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:11:27.162 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:11:27.162 INFO:teuthology.orchestra.run.smithi078.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:11:27.162 INFO:teuthology.orchestra.run.smithi078.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:11:27.162 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4994.035848 2024-09-17T03:11:27.162 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5277.317911 2024-09-17T03:11:27.162 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4833.009828 2024-09-17T03:11:27.162 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7208.562209 2024-09-17T03:11:27.162 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4511.051809 2024-09-17T03:11:27.162 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4237.642218 2024-09-17T03:11:27.162 INFO:teuthology.orchestra.run.smithi078.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 6005.051341 2024-09-17T03:11:27.163 INFO:teuthology.orchestra.run.smithi078.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4677.613119 2024-09-17T03:11:27.163 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_mds 20/20 2024-09-17T03:11:27.163 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:11:27.163 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_ms 2/2 2024-09-17T03:11:27.163 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_debug_frag true 2024-09-17T03:11:27.163 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:11:27.163 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:11:27.163 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_verify_scatter true 2024-09-17T03:11:27.163 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:11:27.163 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:11:27.163 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:11:27.163 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced client_mount_timeout 600 2024-09-17T03:11:27.163 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced debug_client 20/20 2024-09-17T03:11:27.163 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced debug_ms 1/1 2024-09-17T03:11:27.164 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:11:27.164 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:11:27.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.165+0000 7f16cc13a640 1 -- 172.21.15.78:0/3769701724 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f16a8078b90 msgr2=0x7f16a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:27.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.165+0000 7f16cc13a640 1 --2- 172.21.15.78:0/3769701724 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f16a8078b90 0x7f16a807b0a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f16c000a810 tx=0x7f16c0008040 comp rx=0 tx=0).stop 2024-09-17T03:11:27.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.165+0000 7f16cc13a640 1 -- 172.21.15.78:0/3769701724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c415b8f0 msgr2=0x7f16c40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:27.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.165+0000 7f16cc13a640 1 --2- 172.21.15.78:0/3769701724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c415b8f0 0x7f16c40b4d90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009bf0 tx=0x7f16bc003d00 comp rx=0 tx=0).stop 2024-09-17T03:11:27.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.165+0000 7f16cc13a640 1 -- 172.21.15.78:0/3769701724 shutdown_connections 2024-09-17T03:11:27.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.165+0000 7f16cc13a640 1 --2- 172.21.15.78:0/3769701724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c415b8f0 0x7f16c40b4d90 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:27.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.165+0000 7f16cc13a640 1 --2- 172.21.15.78:0/3769701724 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f16c40cf130 0x7f16c41f3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:27.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.165+0000 7f16cc13a640 1 --2- 172.21.15.78:0/3769701724 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f16a8078b90 0x7f16a807b0a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:27.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.165+0000 7f16cc13a640 1 --2- 172.21.15.78:0/3769701724 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16c40b2cb0 0x7f16c41e4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:27.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.165+0000 7f16cc13a640 1 -- 172.21.15.78:0/3769701724 >> 172.21.15.78:0/3769701724 conn(0x7f16c40cdcb0 msgr2=0x7f16c4159200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:27.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.165+0000 7f16cc13a640 1 -- 172.21.15.78:0/3769701724 shutdown_connections 2024-09-17T03:11:27.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.165+0000 7f16cc13a640 1 -- 172.21.15.78:0/3769701724 wait complete. 2024-09-17T03:11:27.175 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:11:27.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.292+0000 7f086a28b640 1 -- 172.21.15.78:0/2860401450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f08640caee0 msgr2=0x7f086406ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:27.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.292+0000 7f086a28b640 1 --2- 172.21.15.78:0/2860401450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f08640caee0 0x7f086406ee90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f085c005fd0 tx=0x7f085c02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:11:27.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.292+0000 7f086a28b640 1 -- 172.21.15.78:0/2860401450 shutdown_connections 2024-09-17T03:11:27.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.292+0000 7f086a28b640 1 --2- 172.21.15.78:0/2860401450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f08640caee0 0x7f086406ee90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:27.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.292+0000 7f086a28b640 1 --2- 172.21.15.78:0/2860401450 >> v2:172.21.15.193:3300/0 conn(0x7f086415bf20 0x7f08640ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:27.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.292+0000 7f086a28b640 1 -- 172.21.15.78:0/2860401450 >> 172.21.15.78:0/2860401450 conn(0x7f08640b1cb0 msgr2=0x7f08640b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:27.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.292+0000 7f086a28b640 1 -- 172.21.15.78:0/2860401450 shutdown_connections 2024-09-17T03:11:27.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.292+0000 7f086a28b640 1 -- 172.21.15.78:0/2860401450 wait complete. 2024-09-17T03:11:27.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.294+0000 7f086a28b640 1 Processor -- start 2024-09-17T03:11:27.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.294+0000 7f086a28b640 1 -- start start 2024-09-17T03:11:27.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.295+0000 7f086a28b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f08640caee0 0x7f0864151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:27.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.295+0000 7f086a28b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f08640cfb00 0x7f08640c5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.295+0000 7f086a28b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f086415bf20 0x7f08640c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.295+0000 7f086a28b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f08640ccba0 con 0x7f086415bf20 2024-09-17T03:11:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.295+0000 7f086a28b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f08640ccd20 con 0x7f08640cfb00 2024-09-17T03:11:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.295+0000 7f086a28b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f08640ccea0 con 0x7f08640caee0 2024-09-17T03:11:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.295+0000 7f0868828640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f086415bf20 0x7f08640c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.295+0000 7f0868828640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f086415bf20 0x7f08640c5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60526/0 (socket says 172.21.15.78:60526) 2024-09-17T03:11:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.295+0000 7f0868828640 1 -- 172.21.15.78:0/3652350624 learned_addr learned my addr 172.21.15.78:0/3652350624 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.296+0000 7f0863fff640 1 --2- 172.21.15.78:0/3652350624 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f08640caee0 0x7f0864151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.296+0000 7f08637fe640 1 --2- 172.21.15.78:0/3652350624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f08640cfb00 0x7f08640c5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.296+0000 7f0868828640 1 -- 172.21.15.78:0/3652350624 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f08640caee0 msgr2=0x7f0864151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.296+0000 7f0868828640 1 --2- 172.21.15.78:0/3652350624 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f08640caee0 0x7f0864151860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.296+0000 7f0868828640 1 -- 172.21.15.78:0/3652350624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f08640cfb00 msgr2=0x7f08640c5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:27.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.296+0000 7f0868828640 1 --2- 172.21.15.78:0/3652350624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f08640cfb00 0x7f08640c5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:27.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.296+0000 7f0868828640 1 -- 172.21.15.78:0/3652350624 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086415ed70 con 0x7f086415bf20 2024-09-17T03:11:27.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.296+0000 7f0868828640 1 --2- 172.21.15.78:0/3652350624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f086415bf20 0x7f08640c5e60 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f085c009ca0 tx=0x7f085c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:27.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.296+0000 7f0860ff9640 1 -- 172.21.15.78:0/3652350624 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085c031990 con 0x7f086415bf20 2024-09-17T03:11:27.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.296+0000 7f0860ff9640 1 -- 172.21.15.78:0/3652350624 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f085c031c40 con 0x7f086415bf20 2024-09-17T03:11:27.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.296+0000 7f086a28b640 1 -- 172.21.15.78:0/3652350624 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08640c4e40 con 0x7f086415bf20 2024-09-17T03:11:27.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.296+0000 7f0860ff9640 1 -- 172.21.15.78:0/3652350624 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f085c033330 con 0x7f086415bf20 2024-09-17T03:11:27.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.296+0000 7f086a28b640 1 -- 172.21.15.78:0/3652350624 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08640c5400 con 0x7f086415bf20 2024-09-17T03:11:27.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.297+0000 7f086a28b640 1 -- 172.21.15.78:0/3652350624 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f086415ead0 con 0x7f086415bf20 2024-09-17T03:11:27.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.298+0000 7f0860ff9640 1 -- 172.21.15.78:0/3652350624 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f085c0334d0 con 0x7f086415bf20 2024-09-17T03:11:27.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.298+0000 7f0860ff9640 1 --2- 172.21.15.78:0/3652350624 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0850078bc0 0x7f085007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:27.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.298+0000 7f0860ff9640 1 -- 172.21.15.78:0/3652350624 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5115+0+0 (secure 0 0 0) 0x7f085c0bbd10 con 0x7f086415bf20 2024-09-17T03:11:27.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.299+0000 7f0863fff640 1 --2- 172.21.15.78:0/3652350624 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0850078bc0 0x7f085007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:27.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.299+0000 7f0863fff640 1 --2- 172.21.15.78:0/3652350624 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0850078bc0 0x7f085007b0d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f08540015e0 tx=0x7f0854009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:27.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.303+0000 7f0860ff9640 1 -- 172.21.15.78:0/3652350624 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f086415ead0 con 0x7f086415bf20 2024-09-17T03:11:27.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.481+0000 7f086a28b640 1 -- 172.21.15.78:0/3652350624 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f08640ca9a0 con 0x7f086415bf20 2024-09-17T03:11:27.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.485+0000 7f0860ff9640 1 -- 172.21.15.78:0/3652350624 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f085c04a030 con 0x7f086415bf20 2024-09-17T03:11:27.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.487+0000 7f086a28b640 1 -- 172.21.15.78:0/3652350624 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0850078bc0 msgr2=0x7f085007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:27.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.487+0000 7f086a28b640 1 --2- 172.21.15.78:0/3652350624 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0850078bc0 0x7f085007b0d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f08540015e0 tx=0x7f0854009040 comp rx=0 tx=0).stop 2024-09-17T03:11:27.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.487+0000 7f086a28b640 1 -- 172.21.15.78:0/3652350624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f086415bf20 msgr2=0x7f08640c5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:27.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.487+0000 7f086a28b640 1 --2- 172.21.15.78:0/3652350624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f086415bf20 0x7f08640c5e60 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f085c009ca0 tx=0x7f085c003970 comp rx=0 tx=0).stop 2024-09-17T03:11:27.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.487+0000 7f086a28b640 1 -- 172.21.15.78:0/3652350624 shutdown_connections 2024-09-17T03:11:27.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.487+0000 7f086a28b640 1 --2- 172.21.15.78:0/3652350624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f086415bf20 0x7f08640c5e60 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:27.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.487+0000 7f086a28b640 1 --2- 172.21.15.78:0/3652350624 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0850078bc0 0x7f085007b0d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:27.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.487+0000 7f086a28b640 1 --2- 172.21.15.78:0/3652350624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f08640cfb00 0x7f08640c5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:27.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.487+0000 7f086a28b640 1 --2- 172.21.15.78:0/3652350624 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f08640caee0 0x7f0864151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:27.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.487+0000 7f086a28b640 1 -- 172.21.15.78:0/3652350624 >> 172.21.15.78:0/3652350624 conn(0x7f08640b1cb0 msgr2=0x7f08640adba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:27.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.488+0000 7f086a28b640 1 -- 172.21.15.78:0/3652350624 shutdown_connections 2024-09-17T03:11:27.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.488+0000 7f086a28b640 1 -- 172.21.15.78:0/3652350624 wait complete. 2024-09-17T03:11:27.497 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:11:27.498 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:11:27.542 DEBUG:teuthology.orchestra.run.smithi193:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:11:27.593 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:11:27.594 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:11:27.594 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:11:27.609 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056010,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1013 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:11:27.609 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:11:27.610 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:11:27.627 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:11:27.628 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:11:27.628 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:11:27.665 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056010,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1013 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:11:27.666 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:11:27.666 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:11:27.684 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:11:27.684 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:11:27.685 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:11:27.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.818+0000 7f4180707640 1 -- 172.21.15.78:0/2947678891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41780cff70 msgr2=0x7f417815c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:27.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.818+0000 7f4180707640 1 --2- 172.21.15.78:0/2947678891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41780cff70 0x7f417815c830 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4174005fd0 tx=0x7f417402aaa0 comp rx=0 tx=0).stop 2024-09-17T03:11:27.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.819+0000 7f4180707640 1 -- 172.21.15.78:0/2947678891 shutdown_connections 2024-09-17T03:11:27.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.819+0000 7f4180707640 1 --2- 172.21.15.78:0/2947678891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41780cff70 0x7f417815c830 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:27.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.819+0000 7f4180707640 1 -- 172.21.15.78:0/2947678891 >> 172.21.15.78:0/2947678891 conn(0x7f41780cee20 msgr2=0x7f41780cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:27.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.819+0000 7f4180707640 1 -- 172.21.15.78:0/2947678891 shutdown_connections 2024-09-17T03:11:27.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.819+0000 7f4180707640 1 -- 172.21.15.78:0/2947678891 wait complete. 2024-09-17T03:11:27.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.820+0000 7f4180707640 1 Processor -- start 2024-09-17T03:11:27.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.820+0000 7f4180707640 1 -- start start 2024-09-17T03:11:27.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f4180707640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41780cff70 0x7f417814ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:27.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f4180707640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4178160c90 0x7f417806f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:27.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f4180707640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41781577c0 0x7f4178157bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:27.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f4180707640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f41780d18b0 con 0x7f41780cff70 2024-09-17T03:11:27.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f4180707640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f41780d1730 con 0x7f41781577c0 2024-09-17T03:11:27.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f4180707640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f41780d1a30 con 0x7f4178160c90 2024-09-17T03:11:27.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f417e4a3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41780cff70 0x7f417814ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:27.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f417e4a3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41780cff70 0x7f417814ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60536/0 (socket says 172.21.15.78:60536) 2024-09-17T03:11:27.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f417e4a3640 1 -- 172.21.15.78:0/3972618592 learned_addr learned my addr 172.21.15.78:0/3972618592 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:27.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f417eca4640 1 --2- 172.21.15.78:0/3972618592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41781577c0 0x7f4178157bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:27.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f417dca2640 1 --2- 172.21.15.78:0/3972618592 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4178160c90 0x7f417806f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:27.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f417e4a3640 1 -- 172.21.15.78:0/3972618592 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4178160c90 msgr2=0x7f417806f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:27.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f417e4a3640 1 --2- 172.21.15.78:0/3972618592 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4178160c90 0x7f417806f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:27.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f417e4a3640 1 -- 172.21.15.78:0/3972618592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41781577c0 msgr2=0x7f4178157bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:27.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f417e4a3640 1 --2- 172.21.15.78:0/3972618592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41781577c0 0x7f4178157bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:27.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f417e4a3640 1 -- 172.21.15.78:0/3972618592 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4178158110 con 0x7f41780cff70 2024-09-17T03:11:27.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f417e4a3640 1 --2- 172.21.15.78:0/3972618592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41780cff70 0x7f417814ee50 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4174006010 tx=0x7f4174003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:27.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f416effd640 1 -- 172.21.15.78:0/3972618592 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4174044070 con 0x7f41780cff70 2024-09-17T03:11:27.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f416effd640 1 -- 172.21.15.78:0/3972618592 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4174004250 con 0x7f41780cff70 2024-09-17T03:11:27.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f4180707640 1 -- 172.21.15.78:0/3972618592 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417814f390 con 0x7f41780cff70 2024-09-17T03:11:27.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f416effd640 1 -- 172.21.15.78:0/3972618592 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4174004640 con 0x7f41780cff70 2024-09-17T03:11:27.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.822+0000 7f4180707640 1 -- 172.21.15.78:0/3972618592 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41780c8b60 con 0x7f41780cff70 2024-09-17T03:11:27.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.823+0000 7f4180707640 1 -- 172.21.15.78:0/3972618592 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f417815c830 con 0x7f41780cff70 2024-09-17T03:11:27.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.824+0000 7f416effd640 1 -- 172.21.15.78:0/3972618592 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4174047070 con 0x7f41780cff70 2024-09-17T03:11:27.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.824+0000 7f416effd640 1 --2- 172.21.15.78:0/3972618592 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f415c078b90 0x7f415c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:27.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.825+0000 7f416effd640 1 -- 172.21.15.78:0/3972618592 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5115+0+0 (secure 0 0 0) 0x7f41740bbc00 con 0x7f41780cff70 2024-09-17T03:11:27.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.825+0000 7f417dca2640 1 --2- 172.21.15.78:0/3972618592 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f415c078b90 0x7f415c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:27.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.825+0000 7f417dca2640 1 --2- 172.21.15.78:0/3972618592 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f415c078b90 0x7f415c07b0a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4168000f60 tx=0x7f4168009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:27.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:27.829+0000 7f416effd640 1 -- 172.21.15.78:0/3972618592 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f41740c2080 con 0x7f41780cff70 2024-09-17T03:11:28.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.040+0000 7f4180707640 1 -- 172.21.15.78:0/3972618592 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41780b6e40 con 0x7f41780cff70 2024-09-17T03:11:28.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.041+0000 7f416effd640 1 -- 172.21.15.78:0/3972618592 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+3917 (secure 0 0 0) 0x7f4178158110 con 0x7f41780cff70 2024-09-17T03:11:28.041 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:28.041 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":40,"btime":"2024-09-17T03:11:21:613721+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/2973955781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2973955781},{"type":"v1","addr":"172.21.15.78:6834","nonce":2973955781}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5417,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/1705452328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1705452328},{"type":"v1","addr":"172.21.15.193:6835","nonce":1705452328}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":5420,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/2102665826","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":2102665826},{"type":"v1","addr":"172.21.15.193:6837","nonce":2102665826}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40},{"gid":6129,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2171614026","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2171614026},{"type":"v1","addr":"172.21.15.78:6835","nonce":2171614026}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[]} 2024-09-17T03:11:28.041 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 40 2024-09-17T03:11:28.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.043+0000 7f4180707640 1 -- 172.21.15.78:0/3972618592 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f415c078b90 msgr2=0x7f415c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:28.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.043+0000 7f4180707640 1 --2- 172.21.15.78:0/3972618592 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f415c078b90 0x7f415c07b0a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4168000f60 tx=0x7f4168009040 comp rx=0 tx=0).stop 2024-09-17T03:11:28.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.043+0000 7f4180707640 1 -- 172.21.15.78:0/3972618592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41780cff70 msgr2=0x7f417814ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:28.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.043+0000 7f4180707640 1 --2- 172.21.15.78:0/3972618592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41780cff70 0x7f417814ee50 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f4174006010 tx=0x7f4174003f10 comp rx=0 tx=0).stop 2024-09-17T03:11:28.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.043+0000 7f4180707640 1 -- 172.21.15.78:0/3972618592 shutdown_connections 2024-09-17T03:11:28.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.043+0000 7f4180707640 1 --2- 172.21.15.78:0/3972618592 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f415c078b90 0x7f415c07b0a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:28.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.043+0000 7f4180707640 1 --2- 172.21.15.78:0/3972618592 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f41781577c0 0x7f4178157bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:28.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.043+0000 7f4180707640 1 --2- 172.21.15.78:0/3972618592 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4178160c90 0x7f417806f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:28.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.043+0000 7f4180707640 1 --2- 172.21.15.78:0/3972618592 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f41780cff70 0x7f417814ee50 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:28.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.043+0000 7f4180707640 1 -- 172.21.15.78:0/3972618592 >> 172.21.15.78:0/3972618592 conn(0x7f41780cee20 msgr2=0x7f41781520c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:28.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.043+0000 7f4180707640 1 -- 172.21.15.78:0/3972618592 shutdown_connections 2024-09-17T03:11:28.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.043+0000 7f4180707640 1 -- 172.21.15.78:0/3972618592 wait complete. 2024-09-17T03:11:28.053 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:11:28.053 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:11:28.054 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:11:28.054 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:11:28.054 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:11:28.054 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:11:28.054 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:11:28.054 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:11:28.054 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:11:28.055 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:11:28.055 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:11:28.055 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:11:28.055 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:11:28.055 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:11:28.055 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:11:28.055 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:11:28.065 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:11:28.065 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:11:28.066 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:11:28.066 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:11:28.069 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:11:28.069 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:11:28.070 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:11:28.070 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:11:28.108 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:11:28.109 DEBUG:teuthology.parallel:result is None 2024-09-17T03:11:28.110 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:11:28.110 DEBUG:teuthology.parallel:result is None 2024-09-17T03:11:28.112 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:11:28.112 DEBUG:teuthology.parallel:result is None 2024-09-17T03:11:28.113 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:11:28.113 DEBUG:teuthology.parallel:result is None 2024-09-17T03:11:28.113 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:11:28.194 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-09-17T03:11:28.194 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2024-09-17T03:11:28.204 INFO:tasks.ceph.mds.d.smithi193.stdout:starting mds.d at 2024-09-17T03:11:28.205 INFO:tasks.ceph.mds.b.smithi193.stdout:starting mds.b at 2024-09-17T03:11:28.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.234+0000 7f23f1c84640 1 -- 172.21.15.78:0/3178618995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23ec0b7fe0 msgr2=0x7f23ec0ced30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:28.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.234+0000 7f23f1c84640 1 --2- 172.21.15.78:0/3178618995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23ec0b7fe0 0x7f23ec0ced30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f23e0009830 tx=0x7f23e002a480 comp rx=0 tx=0).stop 2024-09-17T03:11:28.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.234+0000 7f23f1c84640 1 -- 172.21.15.78:0/3178618995 shutdown_connections 2024-09-17T03:11:28.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.234+0000 7f23f1c84640 1 --2- 172.21.15.78:0/3178618995 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23ec0b7fe0 0x7f23ec0ced30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:28.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.234+0000 7f23f1c84640 1 --2- 172.21.15.78:0/3178618995 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f23ec0cd360 0x7f23ec15c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:28.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.234+0000 7f23f1c84640 1 -- 172.21.15.78:0/3178618995 >> 172.21.15.78:0/3178618995 conn(0x7f23ec0710b0 msgr2=0x7f23ec0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:28.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.234+0000 7f23f1c84640 1 -- 172.21.15.78:0/3178618995 shutdown_connections 2024-09-17T03:11:28.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.234+0000 7f23f1c84640 1 -- 172.21.15.78:0/3178618995 wait complete. 2024-09-17T03:11:28.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.236+0000 7f23f1c84640 1 Processor -- start 2024-09-17T03:11:28.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.236+0000 7f23f1c84640 1 -- start start 2024-09-17T03:11:28.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.237+0000 7f23f1c84640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23ec0b7fe0 0x7f23ec0caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:28.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.237+0000 7f23f1c84640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f23ec0cd360 0x7f23ec1f3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:28.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.237+0000 7f23f1c84640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23ec0cf270 0x7f23ec1f4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:28.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.237+0000 7f23f1c84640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec072f60 con 0x7f23ec0cf270 2024-09-17T03:11:28.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.237+0000 7f23f1c84640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f23ec0d13b0 con 0x7f23ec0b7fe0 2024-09-17T03:11:28.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.237+0000 7f23f1c84640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f23ec0730e0 con 0x7f23ec0cd360 2024-09-17T03:11:28.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.238+0000 7f23ebfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23ec0cf270 0x7f23ec1f4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:28.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.238+0000 7f23ebfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23ec0cf270 0x7f23ec1f4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60566/0 (socket says 172.21.15.78:60566) 2024-09-17T03:11:28.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.238+0000 7f23ebfff640 1 -- 172.21.15.78:0/2160758007 learned_addr learned my addr 172.21.15.78:0/2160758007 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:28.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.238+0000 7f23eb7fe640 1 --2- 172.21.15.78:0/2160758007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23ec0b7fe0 0x7f23ec0caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:28.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.238+0000 7f23eaffd640 1 --2- 172.21.15.78:0/2160758007 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f23ec0cd360 0x7f23ec1f3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:28.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.238+0000 7f23ebfff640 1 -- 172.21.15.78:0/2160758007 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f23ec0cd360 msgr2=0x7f23ec1f3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:28.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.238+0000 7f23ebfff640 1 --2- 172.21.15.78:0/2160758007 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f23ec0cd360 0x7f23ec1f3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:28.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.238+0000 7f23ebfff640 1 -- 172.21.15.78:0/2160758007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23ec0b7fe0 msgr2=0x7f23ec0caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:28.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.238+0000 7f23ebfff640 1 --2- 172.21.15.78:0/2160758007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23ec0b7fe0 0x7f23ec0caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:28.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.238+0000 7f23ebfff640 1 -- 172.21.15.78:0/2160758007 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ec15cef0 con 0x7f23ec0cf270 2024-09-17T03:11:28.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.238+0000 7f23eb7fe640 1 --2- 172.21.15.78:0/2160758007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23ec0b7fe0 0x7f23ec0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:11:28.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.238+0000 7f23ebfff640 1 --2- 172.21.15.78:0/2160758007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23ec0cf270 0x7f23ec1f4250 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f23e400cb10 tx=0x7f23e400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:28.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.238+0000 7f23d3fff640 1 -- 172.21.15.78:0/2160758007 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e4016020 con 0x7f23ec0cf270 2024-09-17T03:11:28.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.238+0000 7f23d3fff640 1 -- 172.21.15.78:0/2160758007 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23e400ad60 con 0x7f23ec0cf270 2024-09-17T03:11:28.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.238+0000 7f23d3fff640 1 -- 172.21.15.78:0/2160758007 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e4012680 con 0x7f23ec0cf270 2024-09-17T03:11:28.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.238+0000 7f23f1c84640 1 -- 172.21.15.78:0/2160758007 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23ec15d1d0 con 0x7f23ec0cf270 2024-09-17T03:11:28.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.238+0000 7f23f1c84640 1 -- 172.21.15.78:0/2160758007 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23ec1f4830 con 0x7f23ec0cf270 2024-09-17T03:11:28.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.239+0000 7f23f1c84640 1 -- 172.21.15.78:0/2160758007 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23ec073590 con 0x7f23ec0cf270 2024-09-17T03:11:28.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.240+0000 7f23d3fff640 1 -- 172.21.15.78:0/2160758007 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f23e4019020 con 0x7f23ec0cf270 2024-09-17T03:11:28.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.241+0000 7f23d3fff640 1 --2- 172.21.15.78:0/2160758007 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f23d8078bc0 0x7f23d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:28.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.241+0000 7f23d3fff640 1 -- 172.21.15.78:0/2160758007 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5115+0+0 (secure 0 0 0) 0x7f23e409af90 con 0x7f23ec0cf270 2024-09-17T03:11:28.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.241+0000 7f23eb7fe640 1 --2- 172.21.15.78:0/2160758007 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f23d8078bc0 0x7f23d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:28.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.241+0000 7f23eb7fe640 1 --2- 172.21.15.78:0/2160758007 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f23d8078bc0 0x7f23d807b0d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f23dc012150 tx=0x7f23dc014040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:28.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.245+0000 7f23d3fff640 1 -- 172.21.15.78:0/2160758007 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f23e4020020 con 0x7f23ec0cf270 2024-09-17T03:11:28.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.429+0000 7f23f1c84640 1 -- 172.21.15.78:0/2160758007 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f23ec0b6200 con 0x7f23ec0cf270 2024-09-17T03:11:28.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.864+0000 7f23d3fff640 1 -- 172.21.15.78:0/2160758007 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v52) ==== 97+0+0 (secure 0 0 0) 0x7f23ec0cf680 con 0x7f23ec0cf270 2024-09-17T03:11:28.863 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2024-09-17T03:11:28.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.868+0000 7f23f1c84640 1 -- 172.21.15.78:0/2160758007 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f23d8078bc0 msgr2=0x7f23d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:28.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.868+0000 7f23f1c84640 1 --2- 172.21.15.78:0/2160758007 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f23d8078bc0 0x7f23d807b0d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f23dc012150 tx=0x7f23dc014040 comp rx=0 tx=0).stop 2024-09-17T03:11:28.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.868+0000 7f23f1c84640 1 -- 172.21.15.78:0/2160758007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23ec0cf270 msgr2=0x7f23ec1f4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:28.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.868+0000 7f23f1c84640 1 --2- 172.21.15.78:0/2160758007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23ec0cf270 0x7f23ec1f4250 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f23e400cb10 tx=0x7f23e400a060 comp rx=0 tx=0).stop 2024-09-17T03:11:28.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.868+0000 7f23f1c84640 1 -- 172.21.15.78:0/2160758007 shutdown_connections 2024-09-17T03:11:28.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.868+0000 7f23f1c84640 1 --2- 172.21.15.78:0/2160758007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23ec0cf270 0x7f23ec1f4250 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:28.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.868+0000 7f23f1c84640 1 --2- 172.21.15.78:0/2160758007 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f23ec0cd360 0x7f23ec1f3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:28.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.868+0000 7f23f1c84640 1 --2- 172.21.15.78:0/2160758007 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f23d8078bc0 0x7f23d807b0d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:28.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.868+0000 7f23f1c84640 1 --2- 172.21.15.78:0/2160758007 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23ec0b7fe0 0x7f23ec0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:28.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.868+0000 7f23f1c84640 1 -- 172.21.15.78:0/2160758007 >> 172.21.15.78:0/2160758007 conn(0x7f23ec0710b0 msgr2=0x7f23ec0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:28.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.868+0000 7f23f1c84640 1 -- 172.21.15.78:0/2160758007 shutdown_connections 2024-09-17T03:11:28.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.868+0000 7f23f1c84640 1 -- 172.21.15.78:0/2160758007 wait complete. 2024-09-17T03:11:28.880 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:11:28.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.995+0000 7fcc4272b640 1 -- 172.21.15.78:0/2661415583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc3c070e40 msgr2=0x7fcc3c15f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:28.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.995+0000 7fcc4272b640 1 --2- 172.21.15.78:0/2661415583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc3c070e40 0x7fcc3c15f2a0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fcc3c06e8c0 tx=0x7fcc2402a560 comp rx=0 tx=0).stop 2024-09-17T03:11:28.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.995+0000 7fcc4272b640 1 -- 172.21.15.78:0/2661415583 shutdown_connections 2024-09-17T03:11:28.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.995+0000 7fcc4272b640 1 --2- 172.21.15.78:0/2661415583 >> v2:172.21.15.193:3300/0 conn(0x7fcc3c15f7e0 0x7fcc3c0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:28.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.995+0000 7fcc4272b640 1 --2- 172.21.15.78:0/2661415583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc3c070e40 0x7fcc3c15f2a0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:28.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.995+0000 7fcc4272b640 1 -- 172.21.15.78:0/2661415583 >> 172.21.15.78:0/2661415583 conn(0x7fcc3c0cd530 msgr2=0x7fcc3c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:28.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.995+0000 7fcc4272b640 1 -- 172.21.15.78:0/2661415583 shutdown_connections 2024-09-17T03:11:28.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.995+0000 7fcc4272b640 1 -- 172.21.15.78:0/2661415583 wait complete. 2024-09-17T03:11:28.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.997+0000 7fcc4272b640 1 Processor -- start 2024-09-17T03:11:28.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.997+0000 7fcc4272b640 1 -- start start 2024-09-17T03:11:28.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.998+0000 7fcc4272b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcc3c070e40 0x7fcc3c1f5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:28.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.998+0000 7fcc4272b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcc3c075fa0 0x7fcc3c152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:28.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.998+0000 7fcc4272b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc3c15f7e0 0x7fcc3c1e60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:28.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.998+0000 7fcc4272b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c0cef50 con 0x7fcc3c15f7e0 2024-09-17T03:11:28.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.998+0000 7fcc4272b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3c0cedd0 con 0x7fcc3c070e40 2024-09-17T03:11:28.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.998+0000 7fcc4272b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fcc3c0cf0d0 con 0x7fcc3c075fa0 2024-09-17T03:11:29.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.998+0000 7fcc40cc8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc3c15f7e0 0x7fcc3c1e60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:29.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.998+0000 7fcc40cc8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc3c15f7e0 0x7fcc3c1e60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60590/0 (socket says 172.21.15.78:60590) 2024-09-17T03:11:29.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.998+0000 7fcc40cc8640 1 -- 172.21.15.78:0/929721659 learned_addr learned my addr 172.21.15.78:0/929721659 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:29.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.998+0000 7fcc3bfff640 1 --2- 172.21.15.78:0/929721659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcc3c070e40 0x7fcc3c1f5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:29.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.998+0000 7fcc33fff640 1 --2- 172.21.15.78:0/929721659 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcc3c075fa0 0x7fcc3c152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:29.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.998+0000 7fcc40cc8640 1 -- 172.21.15.78:0/929721659 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcc3c075fa0 msgr2=0x7fcc3c152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:29.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.998+0000 7fcc40cc8640 1 --2- 172.21.15.78:0/929721659 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcc3c075fa0 0x7fcc3c152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:29.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.998+0000 7fcc40cc8640 1 -- 172.21.15.78:0/929721659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcc3c070e40 msgr2=0x7fcc3c1f5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:29.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.998+0000 7fcc40cc8640 1 --2- 172.21.15.78:0/929721659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcc3c070e40 0x7fcc3c1f5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:29.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.998+0000 7fcc40cc8640 1 -- 172.21.15.78:0/929721659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3c152c60 con 0x7fcc3c15f7e0 2024-09-17T03:11:29.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.998+0000 7fcc40cc8640 1 --2- 172.21.15.78:0/929721659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc3c15f7e0 0x7fcc3c1e60e0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400ba10 tx=0x7fcc3400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:29.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.999+0000 7fcc397fa640 1 -- 172.21.15.78:0/929721659 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc34019070 con 0x7fcc3c15f7e0 2024-09-17T03:11:29.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.999+0000 7fcc397fa640 1 -- 172.21.15.78:0/929721659 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc3400cbf0 con 0x7fcc3c15f7e0 2024-09-17T03:11:29.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.999+0000 7fcc4272b640 1 -- 172.21.15.78:0/929721659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc3c1e5900 con 0x7fcc3c15f7e0 2024-09-17T03:11:29.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.999+0000 7fcc397fa640 1 -- 172.21.15.78:0/929721659 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc34014440 con 0x7fcc3c15f7e0 2024-09-17T03:11:29.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:28.999+0000 7fcc4272b640 1 -- 172.21.15.78:0/929721659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc3c1f6a30 con 0x7fcc3c15f7e0 2024-09-17T03:11:29.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.000+0000 7fcc4272b640 1 -- 172.21.15.78:0/929721659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc3c15ee30 con 0x7fcc3c15f7e0 2024-09-17T03:11:29.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.000+0000 7fcc397fa640 1 -- 172.21.15.78:0/929721659 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc3401c070 con 0x7fcc3c15f7e0 2024-09-17T03:11:29.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.001+0000 7fcc397fa640 1 --2- 172.21.15.78:0/929721659 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcc1c078bc0 0x7fcc1c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:29.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.001+0000 7fcc397fa640 1 -- 172.21.15.78:0/929721659 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4857+0+0 (secure 0 0 0) 0x7fcc3409a650 con 0x7fcc3c15f7e0 2024-09-17T03:11:29.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.001+0000 7fcc3bfff640 1 --2- 172.21.15.78:0/929721659 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcc1c078bc0 0x7fcc1c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:29.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.002+0000 7fcc3bfff640 1 --2- 172.21.15.78:0/929721659 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcc1c078bc0 0x7fcc1c07b0d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c006fd0 tx=0x7fcc2c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:29.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.006+0000 7fcc397fa640 1 -- 172.21.15.78:0/929721659 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcc3c15ee30 con 0x7fcc3c15f7e0 2024-09-17T03:11:29.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.249+0000 7fcc4272b640 1 -- 172.21.15.78:0/929721659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fcc3c0cf6e0 con 0x7fcc3c15f7e0 2024-09-17T03:11:29.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.250+0000 7fcc397fa640 1 -- 172.21.15.78:0/929721659 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7fcc34062e70 con 0x7fcc3c15f7e0 2024-09-17T03:11:29.249 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:29.249 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:11:29.249 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2024-09-17T03:11:29.249 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:11:29.249 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2024-09-17T03:11:29.249 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmF3icCRAAZEAXi3RiY/e4JSSr1nd2sQ==", 2024-09-17T03:11:29.249 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:11:29.249 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:11:29.249 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:11:29.249 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:11:29.249 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:11:29.250 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.250 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:11:29.250 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:11:29.250 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2024-09-17T03:11:29.250 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmzFPWFhAAptFKHxH9Xy3l9q0gxLARBQ==", 2024-09-17T03:11:29.250 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:11:29.250 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:11:29.250 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:11:29.250 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:11:29.250 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:11:29.250 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.250 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:11:29.250 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:11:29.250 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2024-09-17T03:11:29.251 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmFoc7ERAAlPpal3pKHjPKFotpPiJ9dA==", 2024-09-17T03:11:29.251 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:11:29.251 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:11:29.251 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:11:29.251 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:11:29.251 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:11:29.251 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.251 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:11:29.251 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:11:29.251 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2024-09-17T03:11:29.251 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmYJ2aHhAAhG6Sw6iZDy6s0qpiSLc//A==", 2024-09-17T03:11:29.251 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:11:29.251 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:11:29.251 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:11:29.252 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:11:29.252 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:11:29.252 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.252 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:11:29.252 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:11:29.252 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2024-09-17T03:11:29.252 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBy8uhmiaXeOhAAbhD0AqPz5JYg9CvycMk6cQ==", 2024-09-17T03:11:29.252 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:11:29.252 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:11:29.252 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:11:29.252 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:11:29.252 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.252 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:11:29.252 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:11:29.253 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2024-09-17T03:11:29.253 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB28uhmWT32HxAAATHdxAa6QOLYGnpPCx72iA==", 2024-09-17T03:11:29.253 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:11:29.253 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:11:29.253 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:11:29.253 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:11:29.253 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.253 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:11:29.253 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:11:29.253 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2024-09-17T03:11:29.253 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB58uhmTOOMMBAA4YSlpqeuxlIXypxCpxDJ+Q==", 2024-09-17T03:11:29.253 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:11:29.253 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:11:29.253 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:11:29.254 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:11:29.254 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.254 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:11:29.254 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:11:29.254 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2024-09-17T03:11:29.254 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB88uhmSgx6MxAAKHGCbjfVZTyeb0nX2xKkSQ==", 2024-09-17T03:11:29.254 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:11:29.254 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:11:29.254 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:11:29.254 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:11:29.254 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.254 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:11:29.254 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:11:29.254 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2024-09-17T03:11:29.255 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCD8uhmNKZkBBAAZwn1Xf+fd3GNeP4etvNePg==", 2024-09-17T03:11:29.255 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:11:29.255 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:11:29.255 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:11:29.255 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:11:29.255 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.255 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:11:29.255 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:11:29.255 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2024-09-17T03:11:29.255 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCG8uhmDTyzBhAAzeipRWM5M2fjCQt7xDGBwA==", 2024-09-17T03:11:29.255 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:11:29.255 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:11:29.255 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:11:29.255 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:11:29.256 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.256 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:11:29.256 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:11:29.256 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2024-09-17T03:11:29.256 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCJ8uhmDsZLGBAAB3VNeHQoty+fQwvYpRkltw==", 2024-09-17T03:11:29.256 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:11:29.256 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:11:29.256 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:11:29.256 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:11:29.256 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.256 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:11:29.256 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:11:29.256 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2024-09-17T03:11:29.256 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCM8uhm3PkQKRAAjJV2xFyyoACLkA3f/lFhWw==", 2024-09-17T03:11:29.257 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:11:29.257 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:11:29.257 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:11:29.257 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:11:29.257 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.257 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:11:29.257 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:11:29.257 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2024-09-17T03:11:29.257 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmn+c/IxAALXG+Qkwye7zc6PjcLBsk1g==", 2024-09-17T03:11:29.257 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:11:29.257 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:11:29.257 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow r", 2024-09-17T03:11:29.257 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:11:29.257 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.257 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:11:29.258 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:11:29.258 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2024-09-17T03:11:29.258 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmbzjQKhAAr/DB8TDsiWPsLHnsvUaTiw==", 2024-09-17T03:11:29.258 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:11:29.258 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:11:29.258 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2024-09-17T03:11:29.258 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2024-09-17T03:11:29.258 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2024-09-17T03:11:29.258 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.258 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:11:29.258 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:11:29.258 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.2", 2024-09-17T03:11:29.258 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmB9ABJxAATgS37nY3a3bX8wK1H3S/8A==", 2024-09-17T03:11:29.258 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:11:29.259 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:11:29.259 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2024-09-17T03:11:29.259 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2024-09-17T03:11:29.259 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2024-09-17T03:11:29.259 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.259 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:11:29.259 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:11:29.259 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.3", 2024-09-17T03:11:29.259 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmyhGmLhAAIfkcz3KW+qZ1qDOqQdPS5g==", 2024-09-17T03:11:29.259 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:11:29.259 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:11:29.259 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2024-09-17T03:11:29.259 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2024-09-17T03:11:29.259 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2024-09-17T03:11:29.260 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.260 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:11:29.260 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:11:29.260 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2024-09-17T03:11:29.260 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBu8uhmBgTvJxAAP2vhORVoAAnDSVpnLukIaA==", 2024-09-17T03:11:29.260 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:11:29.260 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2024-09-17T03:11:29.260 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:11:29.260 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:11:29.260 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:11:29.260 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.260 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:11:29.260 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:11:29.260 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2024-09-17T03:11:29.261 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmcpvVBRAA2JTbv0LrIc7seMyOmOIBmA==", 2024-09-17T03:11:29.261 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:11:29.261 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2024-09-17T03:11:29.261 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2024-09-17T03:11:29.261 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:11:29.261 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.261 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:11:29.261 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:11:29.261 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2024-09-17T03:11:29.261 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhm1SeKARAA2hyytqNjqToQ0K+RgQ8Tbg==", 2024-09-17T03:11:29.261 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:11:29.261 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2024-09-17T03:11:29.261 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2024-09-17T03:11:29.261 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:11:29.262 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.262 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.262 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-17T03:11:29.262 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:11:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.252+0000 7fcc4272b640 1 -- 172.21.15.78:0/929721659 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcc1c078bc0 msgr2=0x7fcc1c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.252+0000 7fcc4272b640 1 --2- 172.21.15.78:0/929721659 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcc1c078bc0 0x7fcc1c07b0d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c006fd0 tx=0x7fcc2c008040 comp rx=0 tx=0).stop 2024-09-17T03:11:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.252+0000 7fcc4272b640 1 -- 172.21.15.78:0/929721659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc3c15f7e0 msgr2=0x7fcc3c1e60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.252+0000 7fcc4272b640 1 --2- 172.21.15.78:0/929721659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc3c15f7e0 0x7fcc3c1e60e0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400ba10 tx=0x7fcc3400bed0 comp rx=0 tx=0).stop 2024-09-17T03:11:29.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.252+0000 7fcc4272b640 1 -- 172.21.15.78:0/929721659 shutdown_connections 2024-09-17T03:11:29.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.252+0000 7fcc4272b640 1 --2- 172.21.15.78:0/929721659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc3c15f7e0 0x7fcc3c1e60e0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:29.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.252+0000 7fcc4272b640 1 --2- 172.21.15.78:0/929721659 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcc3c075fa0 0x7fcc3c152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:29.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.252+0000 7fcc4272b640 1 --2- 172.21.15.78:0/929721659 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcc1c078bc0 0x7fcc1c07b0d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:29.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.252+0000 7fcc4272b640 1 --2- 172.21.15.78:0/929721659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcc3c070e40 0x7fcc3c1f5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:29.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.252+0000 7fcc4272b640 1 -- 172.21.15.78:0/929721659 >> 172.21.15.78:0/929721659 conn(0x7fcc3c0cd530 msgr2=0x7fcc3c073660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:29.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.252+0000 7fcc4272b640 1 -- 172.21.15.78:0/929721659 shutdown_connections 2024-09-17T03:11:29.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.252+0000 7fcc4272b640 1 -- 172.21.15.78:0/929721659 wait complete. 2024-09-17T03:11:29.265 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:11:29.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.379+0000 7f955d1df640 1 -- 172.21.15.78:0/279009085 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9544004d40 msgr2=0x7f9544005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:29.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.379+0000 7f955d1df640 1 --2- 172.21.15.78:0/279009085 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9544004d40 0x7f9544005150 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f95580b3c10 tx=0x7f9544005830 comp rx=0 tx=0).stop 2024-09-17T03:11:29.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.379+0000 7f955759e640 1 -- 172.21.15.78:0/279009085 reap_dead start 2024-09-17T03:11:29.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.379+0000 7f955d1df640 1 -- 172.21.15.78:0/279009085 shutdown_connections 2024-09-17T03:11:29.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.379+0000 7f955d1df640 1 -- 172.21.15.78:0/279009085 >> 172.21.15.78:0/279009085 conn(0x7f955808bfc0 msgr2=0x7f955809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:29.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.379+0000 7f955d1df640 1 -- 172.21.15.78:0/279009085 shutdown_connections 2024-09-17T03:11:29.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.379+0000 7f955d1df640 1 -- 172.21.15.78:0/279009085 wait complete. 2024-09-17T03:11:29.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.381+0000 7f955d1df640 1 Processor -- start 2024-09-17T03:11:29.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.381+0000 7f955d1df640 1 -- start start 2024-09-17T03:11:29.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.382+0000 7f955d1df640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9558160dd0 0x7f955809e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:29.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.382+0000 7f955d1df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f955809ea70 0x7f95580c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:29.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.382+0000 7f955d1df640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95580c9dd0 0x7f95581f8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:29.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.382+0000 7f955d1df640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f95581626e0 con 0x7f955809ea70 2024-09-17T03:11:29.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.382+0000 7f955d1df640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9558162860 con 0x7f95580c9dd0 2024-09-17T03:11:29.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.382+0000 7f955d1df640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f95581629e0 con 0x7f9558160dd0 2024-09-17T03:11:29.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.382+0000 7f954ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f955809ea70 0x7f95580c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:29.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.382+0000 7f954ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f955809ea70 0x7f95580c9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60606/0 (socket says 172.21.15.78:60606) 2024-09-17T03:11:29.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.382+0000 7f954ffff640 1 -- 172.21.15.78:0/71155761 learned_addr learned my addr 172.21.15.78:0/71155761 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:29.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.383+0000 7f955759e640 1 --2- 172.21.15.78:0/71155761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95580c9dd0 0x7f95581f8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:29.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.383+0000 7f9556d9d640 1 --2- 172.21.15.78:0/71155761 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9558160dd0 0x7f955809e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:29.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.383+0000 7f954ffff640 1 -- 172.21.15.78:0/71155761 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9558160dd0 msgr2=0x7f955809e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:29.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.383+0000 7f954ffff640 1 --2- 172.21.15.78:0/71155761 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9558160dd0 0x7f955809e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:29.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.383+0000 7f954ffff640 1 -- 172.21.15.78:0/71155761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95580c9dd0 msgr2=0x7f95581f8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:29.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.383+0000 7f954ffff640 1 --2- 172.21.15.78:0/71155761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95580c9dd0 0x7f95581f8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:29.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.383+0000 7f954ffff640 1 -- 172.21.15.78:0/71155761 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95580ca1e0 con 0x7f955809ea70 2024-09-17T03:11:29.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.383+0000 7f954ffff640 1 --2- 172.21.15.78:0/71155761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f955809ea70 0x7f95580c9890 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f954000e600 tx=0x7f954000eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:29.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.383+0000 7f954f7fe640 1 -- 172.21.15.78:0/71155761 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540015070 con 0x7f955809ea70 2024-09-17T03:11:29.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.383+0000 7f954f7fe640 1 -- 172.21.15.78:0/71155761 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f954000ca90 con 0x7f955809ea70 2024-09-17T03:11:29.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.383+0000 7f955d1df640 1 -- 172.21.15.78:0/71155761 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95581611e0 con 0x7f955809ea70 2024-09-17T03:11:29.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.383+0000 7f954f7fe640 1 -- 172.21.15.78:0/71155761 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540011460 con 0x7f955809ea70 2024-09-17T03:11:29.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.383+0000 7f955d1df640 1 -- 172.21.15.78:0/71155761 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95580cb7d0 con 0x7f955809ea70 2024-09-17T03:11:29.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.384+0000 7f955d1df640 1 -- 172.21.15.78:0/71155761 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95580d1a80 con 0x7f955809ea70 2024-09-17T03:11:29.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.385+0000 7f954f7fe640 1 -- 172.21.15.78:0/71155761 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9540018070 con 0x7f955809ea70 2024-09-17T03:11:29.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.386+0000 7f954f7fe640 1 --2- 172.21.15.78:0/71155761 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9538078bc0 0x7f953807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:29.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.386+0000 7f954f7fe640 1 -- 172.21.15.78:0/71155761 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4857+0+0 (secure 0 0 0) 0x7f954009afd0 con 0x7f955809ea70 2024-09-17T03:11:29.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.386+0000 7f9556d9d640 1 --2- 172.21.15.78:0/71155761 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9538078bc0 0x7f953807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:29.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.386+0000 7f9556d9d640 1 --2- 172.21.15.78:0/71155761 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9538078bc0 0x7f953807b0d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f955809da70 tx=0x7f9548005f30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:29.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.390+0000 7f954f7fe640 1 -- 172.21.15.78:0/71155761 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f95580ca1e0 con 0x7f955809ea70 2024-09-17T03:11:29.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.567+0000 7f955d1df640 1 -- 172.21.15.78:0/71155761 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f955806e400 con 0x7f955809ea70 2024-09-17T03:11:29.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.567+0000 7f954f7fe640 1 -- 172.21.15.78:0/71155761 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v54) ==== 84+0+65 (secure 0 0 0) 0x7f95400637f0 con 0x7f955809ea70 2024-09-17T03:11:29.566 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:29.566 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2024-09-17T03:11:29.566 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:11:29.567 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2024-09-17T03:11:29.567 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2024-09-17T03:11:29.567 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:11:29.567 INFO:teuthology.orchestra.run.smithi078.stdout:] 2024-09-17T03:11:29.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.570+0000 7f955d1df640 1 -- 172.21.15.78:0/71155761 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9538078bc0 msgr2=0x7f953807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:29.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.570+0000 7f955d1df640 1 --2- 172.21.15.78:0/71155761 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9538078bc0 0x7f953807b0d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f955809da70 tx=0x7f9548005f30 comp rx=0 tx=0).stop 2024-09-17T03:11:29.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.570+0000 7f955d1df640 1 -- 172.21.15.78:0/71155761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f955809ea70 msgr2=0x7f95580c9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:29.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.570+0000 7f955d1df640 1 --2- 172.21.15.78:0/71155761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f955809ea70 0x7f95580c9890 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f954000e600 tx=0x7f954000eac0 comp rx=0 tx=0).stop 2024-09-17T03:11:29.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.570+0000 7f955d1df640 1 -- 172.21.15.78:0/71155761 shutdown_connections 2024-09-17T03:11:29.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.570+0000 7f955d1df640 1 --2- 172.21.15.78:0/71155761 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9538078bc0 0x7f953807b0d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:29.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.570+0000 7f955d1df640 1 --2- 172.21.15.78:0/71155761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95580c9dd0 0x7f95581f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:29.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.570+0000 7f955d1df640 1 --2- 172.21.15.78:0/71155761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f955809ea70 0x7f95580c9890 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:29.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.570+0000 7f955d1df640 1 --2- 172.21.15.78:0/71155761 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9558160dd0 0x7f955809e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:29.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.570+0000 7f955d1df640 1 -- 172.21.15.78:0/71155761 >> 172.21.15.78:0/71155761 conn(0x7f955808bfc0 msgr2=0x7f95580d4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:29.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.570+0000 7f955d1df640 1 -- 172.21.15.78:0/71155761 shutdown_connections 2024-09-17T03:11:29.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.570+0000 7f955d1df640 1 -- 172.21.15.78:0/71155761 wait complete. 2024-09-17T03:11:29.580 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:11:29.580 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:11:29.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.699+0000 7f9185294640 1 -- 172.21.15.78:0/3761075127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f918006fa70 msgr2=0x7f918006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:29.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.699+0000 7f9185294640 1 --2- 172.21.15.78:0/3761075127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f918006fa70 0x7f918006e160 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f9170009830 tx=0x7f917002a530 comp rx=0 tx=0).stop 2024-09-17T03:11:29.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.699+0000 7f9185294640 1 -- 172.21.15.78:0/3761075127 shutdown_connections 2024-09-17T03:11:29.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.699+0000 7f9185294640 1 --2- 172.21.15.78:0/3761075127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f918006fa70 0x7f918006e160 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:29.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.699+0000 7f9185294640 1 -- 172.21.15.78:0/3761075127 >> 172.21.15.78:0/3761075127 conn(0x7f918008dc50 msgr2=0x7f918009d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:29.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.699+0000 7f9185294640 1 -- 172.21.15.78:0/3761075127 shutdown_connections 2024-09-17T03:11:29.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.699+0000 7f9185294640 1 -- 172.21.15.78:0/3761075127 wait complete. 2024-09-17T03:11:29.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.701+0000 7f9185294640 1 Processor -- start 2024-09-17T03:11:29.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.701+0000 7f9185294640 1 -- start start 2024-09-17T03:11:29.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.702+0000 7f9185294640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f918006fa70 0x7f918015db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:29.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.702+0000 7f9185294640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91800cf540 0x7f91801eb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:29.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.702+0000 7f9185294640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f91800d0ef0 0x7f91801eb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:29.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.702+0000 7f9185294640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9180162d10 con 0x7f918006fa70 2024-09-17T03:11:29.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.702+0000 7f9185294640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9180162b90 con 0x7f91800cf540 2024-09-17T03:11:29.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.702+0000 7f9185294640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f9180162e90 con 0x7f91800d0ef0 2024-09-17T03:11:29.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.702+0000 7f917effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f918006fa70 0x7f918015db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:29.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.702+0000 7f917effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f918006fa70 0x7f918015db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60628/0 (socket says 172.21.15.78:60628) 2024-09-17T03:11:29.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.702+0000 7f917effd640 1 -- 172.21.15.78:0/3967096503 learned_addr learned my addr 172.21.15.78:0/3967096503 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:29.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.702+0000 7f917e7fc640 1 --2- 172.21.15.78:0/3967096503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91800cf540 0x7f91801eb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:29.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.702+0000 7f917f7fe640 1 --2- 172.21.15.78:0/3967096503 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f91800d0ef0 0x7f91801eb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:29.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.702+0000 7f917effd640 1 -- 172.21.15.78:0/3967096503 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f91800d0ef0 msgr2=0x7f91801eb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:29.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.702+0000 7f917effd640 1 --2- 172.21.15.78:0/3967096503 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f91800d0ef0 0x7f91801eb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:29.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.702+0000 7f917effd640 1 -- 172.21.15.78:0/3967096503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91800cf540 msgr2=0x7f91801eb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:29.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.702+0000 7f917effd640 1 --2- 172.21.15.78:0/3967096503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91800cf540 0x7f91801eb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:29.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.702+0000 7f917effd640 1 -- 172.21.15.78:0/3967096503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91800c98a0 con 0x7f918006fa70 2024-09-17T03:11:29.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.702+0000 7f917e7fc640 1 --2- 172.21.15.78:0/3967096503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91800cf540 0x7f91801eb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:29.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.702+0000 7f917f7fe640 1 --2- 172.21.15.78:0/3967096503 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f91800d0ef0 0x7f91801eb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:29.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.702+0000 7f917effd640 1 --2- 172.21.15.78:0/3967096503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f918006fa70 0x7f918015db20 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9170000c00 tx=0x7f9170033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:29.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.703+0000 7f91677fe640 1 -- 172.21.15.78:0/3967096503 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170031d60 con 0x7f918006fa70 2024-09-17T03:11:29.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.703+0000 7f91677fe640 1 -- 172.21.15.78:0/3967096503 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91700330d0 con 0x7f918006fa70 2024-09-17T03:11:29.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.703+0000 7f9185294640 1 -- 172.21.15.78:0/3967096503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91800c9b80 con 0x7f918006fa70 2024-09-17T03:11:29.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.703+0000 7f91677fe640 1 -- 172.21.15.78:0/3967096503 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9170033520 con 0x7f918006fa70 2024-09-17T03:11:29.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.703+0000 7f9185294640 1 -- 172.21.15.78:0/3967096503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91800ccc80 con 0x7f918006fa70 2024-09-17T03:11:29.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.704+0000 7f9185294640 1 -- 172.21.15.78:0/3967096503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f918006e160 con 0x7f918006fa70 2024-09-17T03:11:29.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.704+0000 7f91677fe640 1 -- 172.21.15.78:0/3967096503 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f91700035f0 con 0x7f918006fa70 2024-09-17T03:11:29.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.705+0000 7f91677fe640 1 --2- 172.21.15.78:0/3967096503 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f916c078b90 0x7f916c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:29.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.705+0000 7f91677fe640 1 -- 172.21.15.78:0/3967096503 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4857+0+0 (secure 0 0 0) 0x7f91700bbeb0 con 0x7f918006fa70 2024-09-17T03:11:29.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.705+0000 7f917e7fc640 1 --2- 172.21.15.78:0/3967096503 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f916c078b90 0x7f916c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:29.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.706+0000 7f917e7fc640 1 --2- 172.21.15.78:0/3967096503 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f916c078b90 0x7f916c07b0a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f91800695a0 tx=0x7f9174009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:29.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.709+0000 7f91677fe640 1 -- 172.21.15.78:0/3967096503 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f917003f030 con 0x7f918006fa70 2024-09-17T03:11:29.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:29.886+0000 7f9185294640 1 -- 172.21.15.78:0/3967096503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f91800b7560 con 0x7f918006fa70 2024-09-17T03:11:30.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:30.876+0000 7f91677fe640 1 -- 172.21.15.78:0/3967096503 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v55) ==== 138+0+0 (secure 0 0 0) 0x7f9170084760 con 0x7f918006fa70 2024-09-17T03:11:30.875 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2024-09-17T03:11:30.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:30.879+0000 7f9185294640 1 -- 172.21.15.78:0/3967096503 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f916c078b90 msgr2=0x7f916c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:30.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:30.879+0000 7f9185294640 1 --2- 172.21.15.78:0/3967096503 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f916c078b90 0x7f916c07b0a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f91800695a0 tx=0x7f9174009040 comp rx=0 tx=0).stop 2024-09-17T03:11:30.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:30.879+0000 7f9185294640 1 -- 172.21.15.78:0/3967096503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f918006fa70 msgr2=0x7f918015db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:30.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:30.879+0000 7f9185294640 1 --2- 172.21.15.78:0/3967096503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f918006fa70 0x7f918015db20 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f9170000c00 tx=0x7f9170033d60 comp rx=0 tx=0).stop 2024-09-17T03:11:30.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:30.880+0000 7f9185294640 1 -- 172.21.15.78:0/3967096503 shutdown_connections 2024-09-17T03:11:30.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:30.880+0000 7f9185294640 1 --2- 172.21.15.78:0/3967096503 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f91800d0ef0 0x7f91801eb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:30.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:30.880+0000 7f9185294640 1 --2- 172.21.15.78:0/3967096503 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f916c078b90 0x7f916c07b0a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:30.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:30.880+0000 7f9185294640 1 --2- 172.21.15.78:0/3967096503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f91800cf540 0x7f91801eb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:30.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:30.880+0000 7f9185294640 1 --2- 172.21.15.78:0/3967096503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f918006fa70 0x7f918015db20 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:30.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:30.880+0000 7f9185294640 1 -- 172.21.15.78:0/3967096503 >> 172.21.15.78:0/3967096503 conn(0x7f918008dc50 msgr2=0x7f9180160b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:30.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:30.880+0000 7f9185294640 1 -- 172.21.15.78:0/3967096503 shutdown_connections 2024-09-17T03:11:30.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:30.880+0000 7f9185294640 1 -- 172.21.15.78:0/3967096503 wait complete. 2024-09-17T03:11:30.897 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:11:31.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.024+0000 7faceba56640 1 -- 172.21.15.78:0/3695864800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facd0004db0 msgr2=0x7facd0005280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:31.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.024+0000 7faceba56640 1 --2- 172.21.15.78:0/3695864800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7facd0004db0 0x7facd0005280 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7face40d0f70 tx=0x7facd0005830 comp rx=0 tx=0).stop 2024-09-17T03:11:31.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.024+0000 7face9ff3640 1 -- 172.21.15.78:0/3695864800 reap_dead start 2024-09-17T03:11:31.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.025+0000 7faceba56640 1 -- 172.21.15.78:0/3695864800 shutdown_connections 2024-09-17T03:11:31.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.025+0000 7faceba56640 1 -- 172.21.15.78:0/3695864800 >> 172.21.15.78:0/3695864800 conn(0x7face409d830 msgr2=0x7face40d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:31.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.025+0000 7faceba56640 1 -- 172.21.15.78:0/3695864800 shutdown_connections 2024-09-17T03:11:31.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.025+0000 7faceba56640 1 -- 172.21.15.78:0/3695864800 wait complete. 2024-09-17T03:11:31.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.026+0000 7faceba56640 1 Processor -- start 2024-09-17T03:11:31.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.026+0000 7faceba56640 1 -- start start 2024-09-17T03:11:31.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.028+0000 7faceba56640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7facd0004db0 0x7face415fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:31.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.028+0000 7faceba56640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7face4160ec0 0x7face40a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:31.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.028+0000 7faceba56640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face4160970 0x7face40a0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:31.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.028+0000 7faceba56640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7face406dea0 con 0x7face4160970 2024-09-17T03:11:31.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.028+0000 7faceba56640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7face40b6730 con 0x7face4160ec0 2024-09-17T03:11:31.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.028+0000 7faceba56640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7face406e020 con 0x7facd0004db0 2024-09-17T03:11:31.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.028+0000 7face9ff3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face4160970 0x7face40a0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:31.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.028+0000 7face9ff3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face4160970 0x7face40a0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60654/0 (socket says 172.21.15.78:60654) 2024-09-17T03:11:31.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.028+0000 7face9ff3640 1 -- 172.21.15.78:0/3750746842 learned_addr learned my addr 172.21.15.78:0/3750746842 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:31.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.028+0000 7face8ff1640 1 --2- 172.21.15.78:0/3750746842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7face4160ec0 0x7face40a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:31.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.028+0000 7face97f2640 1 --2- 172.21.15.78:0/3750746842 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7facd0004db0 0x7face415fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:31.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.028+0000 7face9ff3640 1 -- 172.21.15.78:0/3750746842 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7facd0004db0 msgr2=0x7face415fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:31.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.028+0000 7face9ff3640 1 --2- 172.21.15.78:0/3750746842 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7facd0004db0 0x7face415fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:31.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.028+0000 7face9ff3640 1 -- 172.21.15.78:0/3750746842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7face4160ec0 msgr2=0x7face40a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:31.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.028+0000 7face9ff3640 1 --2- 172.21.15.78:0/3750746842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7face4160ec0 0x7face40a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:31.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.028+0000 7face9ff3640 1 -- 172.21.15.78:0/3750746842 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face4160670 con 0x7face4160970 2024-09-17T03:11:31.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.028+0000 7face9ff3640 1 --2- 172.21.15.78:0/3750746842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face4160970 0x7face40a0ff0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7facdc002230 tx=0x7facdc034bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:31.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.029+0000 7facd9ffb640 1 -- 172.21.15.78:0/3750746842 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc043070 con 0x7face4160970 2024-09-17T03:11:31.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.029+0000 7facd9ffb640 1 -- 172.21.15.78:0/3750746842 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7facdc034ca0 con 0x7face4160970 2024-09-17T03:11:31.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.029+0000 7facd9ffb640 1 -- 172.21.15.78:0/3750746842 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facdc038040 con 0x7face4160970 2024-09-17T03:11:31.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.029+0000 7faceba56640 1 -- 172.21.15.78:0/3750746842 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face40ce350 con 0x7face4160970 2024-09-17T03:11:31.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.029+0000 7faceba56640 1 -- 172.21.15.78:0/3750746842 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face409ede0 con 0x7face4160970 2024-09-17T03:11:31.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.030+0000 7faceba56640 1 -- 172.21.15.78:0/3750746842 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7face40cb0e0 con 0x7face4160970 2024-09-17T03:11:31.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.031+0000 7facd9ffb640 1 -- 172.21.15.78:0/3750746842 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7facdc046070 con 0x7face4160970 2024-09-17T03:11:31.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.031+0000 7facd9ffb640 1 --2- 172.21.15.78:0/3750746842 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7facc8078b90 0x7facc807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:31.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.031+0000 7facd9ffb640 1 -- 172.21.15.78:0/3750746842 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5227+0+0 (secure 0 0 0) 0x7facdc0bacb0 con 0x7face4160970 2024-09-17T03:11:31.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.031+0000 7face97f2640 1 --2- 172.21.15.78:0/3750746842 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7facc8078b90 0x7facc807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:31.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.032+0000 7face97f2640 1 --2- 172.21.15.78:0/3750746842 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7facc8078b90 0x7facc807b0a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7face0006fd0 tx=0x7face0006b80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:31.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.035+0000 7facd9ffb640 1 -- 172.21.15.78:0/3750746842 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7facdc04d080 con 0x7face4160970 2024-09-17T03:11:31.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.211+0000 7faceba56640 1 -- 172.21.15.78:0/3750746842 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7face406f0c0 con 0x7face4160970 2024-09-17T03:11:31.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.881+0000 7facd9ffb640 1 -- 172.21.15.78:0/3750746842 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v56) ==== 170+0+0 (secure 0 0 0) 0x7facdc082df0 con 0x7face4160970 2024-09-17T03:11:31.880 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2024-09-17T03:11:31.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.884+0000 7faceba56640 1 -- 172.21.15.78:0/3750746842 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7facc8078b90 msgr2=0x7facc807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:31.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.884+0000 7faceba56640 1 --2- 172.21.15.78:0/3750746842 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7facc8078b90 0x7facc807b0a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7face0006fd0 tx=0x7face0006b80 comp rx=0 tx=0).stop 2024-09-17T03:11:31.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.884+0000 7faceba56640 1 -- 172.21.15.78:0/3750746842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face4160970 msgr2=0x7face40a0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:31.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.884+0000 7faceba56640 1 --2- 172.21.15.78:0/3750746842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face4160970 0x7face40a0ff0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7facdc002230 tx=0x7facdc034bb0 comp rx=0 tx=0).stop 2024-09-17T03:11:31.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.884+0000 7faceba56640 1 -- 172.21.15.78:0/3750746842 shutdown_connections 2024-09-17T03:11:31.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.884+0000 7faceba56640 1 --2- 172.21.15.78:0/3750746842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7face4160970 0x7face40a0ff0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:31.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.884+0000 7faceba56640 1 --2- 172.21.15.78:0/3750746842 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7facc8078b90 0x7facc807b0a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:31.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.884+0000 7faceba56640 1 --2- 172.21.15.78:0/3750746842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7face4160ec0 0x7face40a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:31.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.884+0000 7faceba56640 1 --2- 172.21.15.78:0/3750746842 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7facd0004db0 0x7face415fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:31.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.884+0000 7faceba56640 1 -- 172.21.15.78:0/3750746842 >> 172.21.15.78:0/3750746842 conn(0x7face409d830 msgr2=0x7face406f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:31.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.885+0000 7faceba56640 1 -- 172.21.15.78:0/3750746842 shutdown_connections 2024-09-17T03:11:31.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:31.885+0000 7faceba56640 1 -- 172.21.15.78:0/3750746842 wait complete. 2024-09-17T03:11:31.906 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:11:32.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.029+0000 7f26c8225640 1 -- 172.21.15.78:0/56768163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26c00cfb00 msgr2=0x7f26c015bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:32.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.029+0000 7f26c8225640 1 --2- 172.21.15.78:0/56768163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26c00cfb00 0x7f26c015bf20 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f26c00cdc20 tx=0x7f26bc02b860 comp rx=0 tx=0).stop 2024-09-17T03:11:32.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.029+0000 7f26c8225640 1 -- 172.21.15.78:0/56768163 shutdown_connections 2024-09-17T03:11:32.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.029+0000 7f26c8225640 1 --2- 172.21.15.78:0/56768163 >> v2:172.21.15.193:3300/0 conn(0x7f26c00cb0b0 0x7f26c006ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:32.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.029+0000 7f26c8225640 1 --2- 172.21.15.78:0/56768163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26c00cfb00 0x7f26c015bf20 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:32.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.029+0000 7f26c8225640 1 -- 172.21.15.78:0/56768163 >> 172.21.15.78:0/56768163 conn(0x7f26c00b1cb0 msgr2=0x7f26c00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:32.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.029+0000 7f26c8225640 1 -- 172.21.15.78:0/56768163 shutdown_connections 2024-09-17T03:11:32.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.029+0000 7f26c8225640 1 -- 172.21.15.78:0/56768163 wait complete. 2024-09-17T03:11:32.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.031+0000 7f26c8225640 1 Processor -- start 2024-09-17T03:11:32.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.031+0000 7f26c8225640 1 -- start start 2024-09-17T03:11:32.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.032+0000 7f26c8225640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26c00cf160 0x7f26c009d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:32.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.032+0000 7f26c8225640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26c00cfb00 0x7f26c01596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:32.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.032+0000 7f26c8225640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26c009aef0 0x7f26c0159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.032+0000 7f26c8225640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f26c00ccba0 con 0x7f26c00cfb00 2024-09-17T03:11:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.032+0000 7f26c8225640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f26c00cf780 con 0x7f26c00cf160 2024-09-17T03:11:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.032+0000 7f26c8225640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f26c00ccd20 con 0x7f26c009aef0 2024-09-17T03:11:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.032+0000 7f26c57c0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26c00cfb00 0x7f26c01596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.032+0000 7f26c5fc1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26c00cf160 0x7f26c009d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.032+0000 7f26c57c0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26c00cfb00 0x7f26c01596d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60686/0 (socket says 172.21.15.78:60686) 2024-09-17T03:11:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.032+0000 7f26c57c0640 1 -- 172.21.15.78:0/3399089788 learned_addr learned my addr 172.21.15.78:0/3399089788 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.032+0000 7f26c67c2640 1 --2- 172.21.15.78:0/3399089788 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26c009aef0 0x7f26c0159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.033+0000 7f26c57c0640 1 -- 172.21.15.78:0/3399089788 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26c009aef0 msgr2=0x7f26c0159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.033+0000 7f26c57c0640 1 --2- 172.21.15.78:0/3399089788 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26c009aef0 0x7f26c0159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:32.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.033+0000 7f26c57c0640 1 -- 172.21.15.78:0/3399089788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26c00cf160 msgr2=0x7f26c009d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:32.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.033+0000 7f26c57c0640 1 --2- 172.21.15.78:0/3399089788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26c00cf160 0x7f26c009d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:32.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.033+0000 7f26c57c0640 1 -- 172.21.15.78:0/3399089788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26c01f47a0 con 0x7f26c00cfb00 2024-09-17T03:11:32.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.033+0000 7f26c57c0640 1 --2- 172.21.15.78:0/3399089788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26c00cfb00 0x7f26c01596d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f26b000c3c0 tx=0x7f26b000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:32.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.033+0000 7f26b67fc640 1 -- 172.21.15.78:0/3399089788 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b0017070 con 0x7f26c00cfb00 2024-09-17T03:11:32.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.033+0000 7f26b67fc640 1 -- 172.21.15.78:0/3399089788 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26b00035f0 con 0x7f26c00cfb00 2024-09-17T03:11:32.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.033+0000 7f26c8225640 1 -- 172.21.15.78:0/3399089788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26c01f4a80 con 0x7f26c00cfb00 2024-09-17T03:11:32.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.033+0000 7f26b67fc640 1 -- 172.21.15.78:0/3399089788 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b0003a80 con 0x7f26c00cfb00 2024-09-17T03:11:32.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.033+0000 7f26c8225640 1 -- 172.21.15.78:0/3399089788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c01f5040 con 0x7f26c00cfb00 2024-09-17T03:11:32.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.034+0000 7f26c8225640 1 -- 172.21.15.78:0/3399089788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26c009b400 con 0x7f26c00cfb00 2024-09-17T03:11:32.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.035+0000 7f26b67fc640 1 -- 172.21.15.78:0/3399089788 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f26b001a070 con 0x7f26c00cfb00 2024-09-17T03:11:32.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.035+0000 7f26b67fc640 1 --2- 172.21.15.78:0/3399089788 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f26a4078bc0 0x7f26a407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:32.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.035+0000 7f26b67fc640 1 -- 172.21.15.78:0/3399089788 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5609+0+0 (secure 0 0 0) 0x7f26b0099da0 con 0x7f26c00cfb00 2024-09-17T03:11:32.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.035+0000 7f26c5fc1640 1 --2- 172.21.15.78:0/3399089788 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f26a4078bc0 0x7f26a407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:32.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.036+0000 7f26c5fc1640 1 --2- 172.21.15.78:0/3399089788 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f26a4078bc0 0x7f26a407b0d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f26bc036000 tx=0x7f26bc004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:32.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.040+0000 7f26b67fc640 1 -- 172.21.15.78:0/3399089788 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f26b0061dd0 con 0x7f26c00cfb00 2024-09-17T03:11:32.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.249+0000 7f26c8225640 1 -- 172.21.15.78:0/3399089788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f26c0076820 con 0x7f26c00cfb00 2024-09-17T03:11:32.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.883+0000 7f26b67fc640 1 -- 172.21.15.78:0/3399089788 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v43) ==== 172+0+0 (secure 0 0 0) 0x7f26b0066800 con 0x7f26c00cfb00 2024-09-17T03:11:32.882 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 8 and data pool 9 2024-09-17T03:11:32.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.887+0000 7f26c8225640 1 -- 172.21.15.78:0/3399089788 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f26a4078bc0 msgr2=0x7f26a407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:32.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.887+0000 7f26c8225640 1 --2- 172.21.15.78:0/3399089788 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f26a4078bc0 0x7f26a407b0d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f26bc036000 tx=0x7f26bc004730 comp rx=0 tx=0).stop 2024-09-17T03:11:32.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.887+0000 7f26c8225640 1 -- 172.21.15.78:0/3399089788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26c00cfb00 msgr2=0x7f26c01596d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:32.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.887+0000 7f26c8225640 1 --2- 172.21.15.78:0/3399089788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26c00cfb00 0x7f26c01596d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f26b000c3c0 tx=0x7f26b000c880 comp rx=0 tx=0).stop 2024-09-17T03:11:32.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.887+0000 7f26c8225640 1 -- 172.21.15.78:0/3399089788 shutdown_connections 2024-09-17T03:11:32.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.887+0000 7f26c8225640 1 --2- 172.21.15.78:0/3399089788 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26c009aef0 0x7f26c0159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:32.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.887+0000 7f26c8225640 1 --2- 172.21.15.78:0/3399089788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26c00cfb00 0x7f26c01596d0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:32.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.887+0000 7f26c8225640 1 --2- 172.21.15.78:0/3399089788 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f26a4078bc0 0x7f26a407b0d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:32.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.887+0000 7f26c8225640 1 --2- 172.21.15.78:0/3399089788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26c00cf160 0x7f26c009d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:32.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.887+0000 7f26c8225640 1 -- 172.21.15.78:0/3399089788 >> 172.21.15.78:0/3399089788 conn(0x7f26c00b1cb0 msgr2=0x7f26c00d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:32.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.887+0000 7f26c8225640 1 -- 172.21.15.78:0/3399089788 shutdown_connections 2024-09-17T03:11:32.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:32.887+0000 7f26c8225640 1 -- 172.21.15.78:0/3399089788 wait complete. 2024-09-17T03:11:32.919 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:11:33.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.034+0000 7f1f14c56640 1 -- 172.21.15.78:0/2603478710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f100706b0 msgr2=0x7f1f100cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:33.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.034+0000 7f1f14c56640 1 --2- 172.21.15.78:0/2603478710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f100706b0 0x7f1f100cba00 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f1f04009830 tx=0x7f1f0402a510 comp rx=0 tx=0).stop 2024-09-17T03:11:33.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.034+0000 7f1f14c56640 1 -- 172.21.15.78:0/2603478710 shutdown_connections 2024-09-17T03:11:33.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.034+0000 7f1f14c56640 1 --2- 172.21.15.78:0/2603478710 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f100706b0 0x7f1f100cba00 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.034+0000 7f1f14c56640 1 --2- 172.21.15.78:0/2603478710 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1f100cad30 0x7f1f100735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.034+0000 7f1f14c56640 1 -- 172.21.15.78:0/2603478710 >> 172.21.15.78:0/2603478710 conn(0x7f1f100b1cb0 msgr2=0x7f1f100b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:33.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.034+0000 7f1f14c56640 1 -- 172.21.15.78:0/2603478710 shutdown_connections 2024-09-17T03:11:33.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.034+0000 7f1f14c56640 1 -- 172.21.15.78:0/2603478710 wait complete. 2024-09-17T03:11:33.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.036+0000 7f1f14c56640 1 Processor -- start 2024-09-17T03:11:33.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.036+0000 7f1f14c56640 1 -- start start 2024-09-17T03:11:33.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.037+0000 7f1f14c56640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f100ca800 0x7f1f1014f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:33.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.037+0000 7f1f14c56640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1f100cad30 0x7f1f101516a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:33.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.037+0000 7f1f14c56640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f1014ecc0 0x7f1f1009d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:33.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.037+0000 7f1f14c56640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1f10073f00 con 0x7f1f1014ecc0 2024-09-17T03:11:33.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.037+0000 7f1f14c56640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1f10073d80 con 0x7f1f100ca800 2024-09-17T03:11:33.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.037+0000 7f1f14c56640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f1f10074080 con 0x7f1f100cad30 2024-09-17T03:11:33.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.037+0000 7f1f0ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f1014ecc0 0x7f1f1009d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:33.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.037+0000 7f1f0ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f1014ecc0 0x7f1f1009d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60698/0 (socket says 172.21.15.78:60698) 2024-09-17T03:11:33.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.037+0000 7f1f0ed9d640 1 -- 172.21.15.78:0/4120988845 learned_addr learned my addr 172.21.15.78:0/4120988845 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:33.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.037+0000 7f1f0dd9b640 1 --2- 172.21.15.78:0/4120988845 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1f100cad30 0x7f1f101516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:33.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.037+0000 7f1f0e59c640 1 --2- 172.21.15.78:0/4120988845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f100ca800 0x7f1f1014f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:33.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.037+0000 7f1f0ed9d640 1 -- 172.21.15.78:0/4120988845 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1f100cad30 msgr2=0x7f1f101516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:33.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.037+0000 7f1f0ed9d640 1 --2- 172.21.15.78:0/4120988845 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1f100cad30 0x7f1f101516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.037+0000 7f1f0ed9d640 1 -- 172.21.15.78:0/4120988845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f100ca800 msgr2=0x7f1f1014f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:33.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.037+0000 7f1f0ed9d640 1 --2- 172.21.15.78:0/4120988845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f100ca800 0x7f1f1014f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.037+0000 7f1f0ed9d640 1 -- 172.21.15.78:0/4120988845 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f101521f0 con 0x7f1f1014ecc0 2024-09-17T03:11:33.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.038+0000 7f1f0ed9d640 1 --2- 172.21.15.78:0/4120988845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f1014ecc0 0x7f1f1009d410 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800e990 tx=0x7f1f0800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:33.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.038+0000 7f1efeffd640 1 -- 172.21.15.78:0/4120988845 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f08004d20 con 0x7f1f1014ecc0 2024-09-17T03:11:33.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.038+0000 7f1efeffd640 1 -- 172.21.15.78:0/4120988845 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f0800caa0 con 0x7f1f1014ecc0 2024-09-17T03:11:33.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.038+0000 7f1f14c56640 1 -- 172.21.15.78:0/4120988845 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f101524d0 con 0x7f1f1014ecc0 2024-09-17T03:11:33.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.038+0000 7f1efeffd640 1 -- 172.21.15.78:0/4120988845 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f08005020 con 0x7f1f1014ecc0 2024-09-17T03:11:33.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.038+0000 7f1f14c56640 1 -- 172.21.15.78:0/4120988845 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1015a970 con 0x7f1f1014ecc0 2024-09-17T03:11:33.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.039+0000 7f1f14c56640 1 -- 172.21.15.78:0/4120988845 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f10151f60 con 0x7f1f1014ecc0 2024-09-17T03:11:33.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.039+0000 7f1efeffd640 1 -- 172.21.15.78:0/4120988845 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1f080051c0 con 0x7f1f1014ecc0 2024-09-17T03:11:33.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.040+0000 7f1efeffd640 1 --2- 172.21.15.78:0/4120988845 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1ef0078bc0 0x7f1ef007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:33.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.040+0000 7f1efeffd640 1 -- 172.21.15.78:0/4120988845 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f1f0809b6a0 con 0x7f1f1014ecc0 2024-09-17T03:11:33.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.040+0000 7f1f0e59c640 1 --2- 172.21.15.78:0/4120988845 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1ef0078bc0 0x7f1ef007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:33.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.041+0000 7f1f0e59c640 1 --2- 172.21.15.78:0/4120988845 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1ef0078bc0 0x7f1ef007b0d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1f000046b0 tx=0x7f1f00009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:33.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.044+0000 7f1efeffd640 1 -- 172.21.15.78:0/4120988845 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1f08016030 con 0x7f1f1014ecc0 2024-09-17T03:11:33.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.220+0000 7f1f14c56640 1 -- 172.21.15.78:0/4120988845 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1f100745e0 con 0x7f1f1014ecc0 2024-09-17T03:11:33.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.221+0000 7f1efeffd640 1 -- 172.21.15.78:0/4120988845 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16714 (secure 0 0 0) 0x7f1f08063ae0 con 0x7f1f1014ecc0 2024-09-17T03:11:33.220 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:33.221 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":57,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:11:32.250725+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:11:29.890641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T03:11:31.216226+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:11:33.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.224+0000 7f1f14c56640 1 -- 172.21.15.78:0/4120988845 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1ef0078bc0 msgr2=0x7f1ef007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:33.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.224+0000 7f1f14c56640 1 --2- 172.21.15.78:0/4120988845 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1ef0078bc0 0x7f1ef007b0d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1f000046b0 tx=0x7f1f00009040 comp rx=0 tx=0).stop 2024-09-17T03:11:33.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.224+0000 7f1f14c56640 1 -- 172.21.15.78:0/4120988845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f1014ecc0 msgr2=0x7f1f1009d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:33.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.224+0000 7f1f14c56640 1 --2- 172.21.15.78:0/4120988845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f1014ecc0 0x7f1f1009d410 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f1f0800e990 tx=0x7f1f0800ee50 comp rx=0 tx=0).stop 2024-09-17T03:11:33.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.224+0000 7f1f14c56640 1 -- 172.21.15.78:0/4120988845 shutdown_connections 2024-09-17T03:11:33.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.224+0000 7f1f14c56640 1 --2- 172.21.15.78:0/4120988845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1f1014ecc0 0x7f1f1009d410 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.224+0000 7f1f14c56640 1 --2- 172.21.15.78:0/4120988845 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1f100cad30 0x7f1f101516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.224+0000 7f1f14c56640 1 --2- 172.21.15.78:0/4120988845 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1ef0078bc0 0x7f1ef007b0d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.224+0000 7f1f14c56640 1 --2- 172.21.15.78:0/4120988845 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f100ca800 0x7f1f1014f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.224+0000 7f1f14c56640 1 -- 172.21.15.78:0/4120988845 >> 172.21.15.78:0/4120988845 conn(0x7f1f100b1cb0 msgr2=0x7f1f100af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:33.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.224+0000 7f1f14c56640 1 -- 172.21.15.78:0/4120988845 shutdown_connections 2024-09-17T03:11:33.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.224+0000 7f1f14c56640 1 -- 172.21.15.78:0/4120988845 wait complete. 2024-09-17T03:11:33.237 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:11:33.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.351+0000 7f320835e640 1 -- 172.21.15.78:0/1513057255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31e8003a50 msgr2=0x7f31e8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:33.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.351+0000 7f320835e640 1 --2- 172.21.15.78:0/1513057255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31e8003a50 0x7f31e8003ec0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f31f0009e20 tx=0x7f31e8005830 comp rx=0 tx=0).stop 2024-09-17T03:11:33.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.351+0000 7f320835e640 1 -- 172.21.15.78:0/1513057255 shutdown_connections 2024-09-17T03:11:33.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.351+0000 7f320835e640 1 --2- 172.21.15.78:0/1513057255 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31e8003a50 0x7f31e8003ec0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.351+0000 7f320835e640 1 -- 172.21.15.78:0/1513057255 >> 172.21.15.78:0/1513057255 conn(0x7f32000b1cb0 msgr2=0x7f32000b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:33.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.351+0000 7f320835e640 1 -- 172.21.15.78:0/1513057255 shutdown_connections 2024-09-17T03:11:33.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.352+0000 7f320835e640 1 -- 172.21.15.78:0/1513057255 wait complete. 2024-09-17T03:11:33.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.353+0000 7f320835e640 1 Processor -- start 2024-09-17T03:11:33.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.353+0000 7f320835e640 1 -- start start 2024-09-17T03:11:33.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.354+0000 7f320835e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31e8003a50 0x7f320014e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:33.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.355+0000 7f320835e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32000cfc40 0x7f32001e94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:33.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.355+0000 7f320835e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32001e9a00 0x7f32001f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:33.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.355+0000 7f320835e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3200074a20 con 0x7f32001e9a00 2024-09-17T03:11:33.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.355+0000 7f320835e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f32000748a0 con 0x7f31e8003a50 2024-09-17T03:11:33.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.355+0000 7f320835e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3200074ba0 con 0x7f32000cfc40 2024-09-17T03:11:33.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.355+0000 7f32068fb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32001e9a00 0x7f32001f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:33.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.355+0000 7f32068fb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32001e9a00 0x7f32001f8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60716/0 (socket says 172.21.15.78:60716) 2024-09-17T03:11:33.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.355+0000 7f32068fb640 1 -- 172.21.15.78:0/4001534392 learned_addr learned my addr 172.21.15.78:0/4001534392 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:33.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.355+0000 7f32060fa640 1 --2- 172.21.15.78:0/4001534392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31e8003a50 0x7f320014e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:33.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.355+0000 7f32058f9640 1 --2- 172.21.15.78:0/4001534392 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32000cfc40 0x7f32001e94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:33.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.355+0000 7f32068fb640 1 -- 172.21.15.78:0/4001534392 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32000cfc40 msgr2=0x7f32001e94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:33.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.355+0000 7f32068fb640 1 --2- 172.21.15.78:0/4001534392 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32000cfc40 0x7f32001e94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.355+0000 7f32068fb640 1 -- 172.21.15.78:0/4001534392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31e8003a50 msgr2=0x7f320014e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:33.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.355+0000 7f32068fb640 1 --2- 172.21.15.78:0/4001534392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31e8003a50 0x7f320014e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.355+0000 7f32068fb640 1 -- 172.21.15.78:0/4001534392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32001e9e10 con 0x7f32001e9a00 2024-09-17T03:11:33.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.355+0000 7f32068fb640 1 --2- 172.21.15.78:0/4001534392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32001e9a00 0x7f32001f8ee0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f32000b58f0 tx=0x7f31f800e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:33.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.356+0000 7f31feffd640 1 -- 172.21.15.78:0/4001534392 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f8010890 con 0x7f32001e9a00 2024-09-17T03:11:33.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.356+0000 7f31feffd640 1 -- 172.21.15.78:0/4001534392 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31f8016070 con 0x7f32001e9a00 2024-09-17T03:11:33.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.356+0000 7f320835e640 1 -- 172.21.15.78:0/4001534392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f320009df30 con 0x7f32001e9a00 2024-09-17T03:11:33.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.356+0000 7f31feffd640 1 -- 172.21.15.78:0/4001534392 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f8010da0 con 0x7f32001e9a00 2024-09-17T03:11:33.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.356+0000 7f320835e640 1 -- 172.21.15.78:0/4001534392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32000d09e0 con 0x7f32001e9a00 2024-09-17T03:11:33.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.357+0000 7f320835e640 1 -- 172.21.15.78:0/4001534392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32000c3860 con 0x7f32001e9a00 2024-09-17T03:11:33.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.357+0000 7f31feffd640 1 -- 172.21.15.78:0/4001534392 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f31f801b460 con 0x7f32001e9a00 2024-09-17T03:11:33.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.358+0000 7f31feffd640 1 --2- 172.21.15.78:0/4001534392 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f31ec078b90 0x7f31ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:33.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.358+0000 7f31feffd640 1 -- 172.21.15.78:0/4001534392 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f31f809b020 con 0x7f32001e9a00 2024-09-17T03:11:33.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.358+0000 7f32060fa640 1 --2- 172.21.15.78:0/4001534392 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f31ec078b90 0x7f31ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:33.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.359+0000 7f32060fa640 1 --2- 172.21.15.78:0/4001534392 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f31ec078b90 0x7f31ec07b0a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f31f0035000 tx=0x7f31f002d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:33.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.362+0000 7f31feffd640 1 -- 172.21.15.78:0/4001534392 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f32001e9e10 con 0x7f32001e9a00 2024-09-17T03:11:33.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.537+0000 7f320835e640 1 -- 172.21.15.78:0/4001534392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32000d0490 con 0x7f32001e9a00 2024-09-17T03:11:33.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.538+0000 7f31feffd640 1 -- 172.21.15.78:0/4001534392 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16714 (secure 0 0 0) 0x7f31f8062ea0 con 0x7f32001e9a00 2024-09-17T03:11:33.537 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:33.537 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":57,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:11:32.250725+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:11:29.890641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T03:11:31.216226+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:11:33.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.541+0000 7f320835e640 1 -- 172.21.15.78:0/4001534392 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f31ec078b90 msgr2=0x7f31ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:33.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.541+0000 7f320835e640 1 --2- 172.21.15.78:0/4001534392 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f31ec078b90 0x7f31ec07b0a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f31f0035000 tx=0x7f31f002d040 comp rx=0 tx=0).stop 2024-09-17T03:11:33.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.541+0000 7f320835e640 1 -- 172.21.15.78:0/4001534392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32001e9a00 msgr2=0x7f32001f8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:33.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.541+0000 7f320835e640 1 --2- 172.21.15.78:0/4001534392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32001e9a00 0x7f32001f8ee0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f32000b58f0 tx=0x7f31f800e980 comp rx=0 tx=0).stop 2024-09-17T03:11:33.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.541+0000 7f320835e640 1 -- 172.21.15.78:0/4001534392 shutdown_connections 2024-09-17T03:11:33.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.541+0000 7f320835e640 1 --2- 172.21.15.78:0/4001534392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32001e9a00 0x7f32001f8ee0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.541+0000 7f320835e640 1 --2- 172.21.15.78:0/4001534392 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32000cfc40 0x7f32001e94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.541+0000 7f320835e640 1 --2- 172.21.15.78:0/4001534392 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f31ec078b90 0x7f31ec07b0a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.541+0000 7f320835e640 1 --2- 172.21.15.78:0/4001534392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31e8003a50 0x7f320014e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.541+0000 7f320835e640 1 -- 172.21.15.78:0/4001534392 >> 172.21.15.78:0/4001534392 conn(0x7f32000b1cb0 msgr2=0x7f320015eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:33.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.541+0000 7f320835e640 1 -- 172.21.15.78:0/4001534392 shutdown_connections 2024-09-17T03:11:33.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.541+0000 7f320835e640 1 -- 172.21.15.78:0/4001534392 wait complete. 2024-09-17T03:11:33.551 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:11:33.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.669+0000 7fa17a425640 1 -- 172.21.15.78:0/3909955552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa15c003a50 msgr2=0x7fa15c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:33.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.669+0000 7fa17a425640 1 --2- 172.21.15.78:0/3909955552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa15c003a50 0x7fa15c003ec0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa1640016c0 tx=0x7fa15c005830 comp rx=0 tx=0).stop 2024-09-17T03:11:33.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.669+0000 7fa17a425640 1 -- 172.21.15.78:0/3909955552 shutdown_connections 2024-09-17T03:11:33.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.669+0000 7fa17a425640 1 --2- 172.21.15.78:0/3909955552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa15c003a50 0x7fa15c003ec0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.669+0000 7fa17a425640 1 -- 172.21.15.78:0/3909955552 >> 172.21.15.78:0/3909955552 conn(0x7fa17408bfc0 msgr2=0x7fa17409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:33.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.669+0000 7fa17a425640 1 -- 172.21.15.78:0/3909955552 shutdown_connections 2024-09-17T03:11:33.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.669+0000 7fa17a425640 1 -- 172.21.15.78:0/3909955552 wait complete. 2024-09-17T03:11:33.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.670+0000 7fa17a425640 1 Processor -- start 2024-09-17T03:11:33.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.671+0000 7fa17a425640 1 -- start start 2024-09-17T03:11:33.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.672+0000 7fa17a425640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa15c003a50 0x7fa1740cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:33.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.672+0000 7fa17a425640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa174160600 0x7fa17415fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:33.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.672+0000 7fa17a425640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa17409e9c0 0x7fa17409edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:33.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.672+0000 7fa17a425640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa1740d34b0 con 0x7fa174160600 2024-09-17T03:11:33.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.672+0000 7fa17a425640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa1740d3330 con 0x7fa17409e9c0 2024-09-17T03:11:33.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.672+0000 7fa17a425640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa1740d3630 con 0x7fa15c003a50 2024-09-17T03:11:33.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.672+0000 7fa1737fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa174160600 0x7fa17415fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:33.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.672+0000 7fa1737fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa174160600 0x7fa17415fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60734/0 (socket says 172.21.15.78:60734) 2024-09-17T03:11:33.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.672+0000 7fa1737fe640 1 -- 172.21.15.78:0/2846619392 learned_addr learned my addr 172.21.15.78:0/2846619392 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:33.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.672+0000 7fa173fff640 1 --2- 172.21.15.78:0/2846619392 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa15c003a50 0x7fa1740cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:33.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.672+0000 7fa1789c2640 1 --2- 172.21.15.78:0/2846619392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa17409e9c0 0x7fa17409edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:33.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.672+0000 7fa1737fe640 1 -- 172.21.15.78:0/2846619392 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa15c003a50 msgr2=0x7fa1740cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:33.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.672+0000 7fa1737fe640 1 --2- 172.21.15.78:0/2846619392 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa15c003a50 0x7fa1740cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.672+0000 7fa1737fe640 1 -- 172.21.15.78:0/2846619392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa17409e9c0 msgr2=0x7fa17409edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:33.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.672+0000 7fa1737fe640 1 --2- 172.21.15.78:0/2846619392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa17409e9c0 0x7fa17409edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.672+0000 7fa1737fe640 1 -- 172.21.15.78:0/2846619392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17409f310 con 0x7fa174160600 2024-09-17T03:11:33.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.673+0000 7fa1737fe640 1 --2- 172.21.15.78:0/2846619392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa174160600 0x7fa17415fdd0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa168011780 tx=0x7fa168011b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:33.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.673+0000 7fa170ff9640 1 -- 172.21.15.78:0/2846619392 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa168004250 con 0x7fa174160600 2024-09-17T03:11:33.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.673+0000 7fa170ff9640 1 -- 172.21.15.78:0/2846619392 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa168016070 con 0x7fa174160600 2024-09-17T03:11:33.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.673+0000 7fa17a425640 1 -- 172.21.15.78:0/2846619392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1740cbe10 con 0x7fa174160600 2024-09-17T03:11:33.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.673+0000 7fa170ff9640 1 -- 172.21.15.78:0/2846619392 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa16800fba0 con 0x7fa174160600 2024-09-17T03:11:33.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.673+0000 7fa17a425640 1 -- 172.21.15.78:0/2846619392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1740cc3d0 con 0x7fa174160600 2024-09-17T03:11:33.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.674+0000 7fa17a425640 1 -- 172.21.15.78:0/2846619392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1740cbb80 con 0x7fa174160600 2024-09-17T03:11:33.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.674+0000 7fa170ff9640 1 -- 172.21.15.78:0/2846619392 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa168018030 con 0x7fa174160600 2024-09-17T03:11:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.675+0000 7fa170ff9640 1 --2- 172.21.15.78:0/2846619392 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa160078b90 0x7fa16007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.675+0000 7fa170ff9640 1 -- 172.21.15.78:0/2846619392 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fa16809b2e0 con 0x7fa174160600 2024-09-17T03:11:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.675+0000 7fa173fff640 1 --2- 172.21.15.78:0/2846619392 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa160078b90 0x7fa16007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.676+0000 7fa173fff640 1 --2- 172.21.15.78:0/2846619392 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa160078b90 0x7fa16007b0a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa164032000 tx=0x7fa16402c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:33.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.679+0000 7fa170ff9640 1 -- 172.21.15.78:0/2846619392 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa17409f310 con 0x7fa174160600 2024-09-17T03:11:33.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.891+0000 7fa17a425640 1 -- 172.21.15.78:0/2846619392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa17406f830 con 0x7fa174160600 2024-09-17T03:11:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.901+0000 7fa170ff9640 1 -- 172.21.15.78:0/2846619392 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v44) ==== 118+0+0 (secure 0 0 0) 0x7fa1680630d0 con 0x7fa174160600 2024-09-17T03:11:33.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.904+0000 7fa17a425640 1 -- 172.21.15.78:0/2846619392 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa160078b90 msgr2=0x7fa16007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:33.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.904+0000 7fa17a425640 1 --2- 172.21.15.78:0/2846619392 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa160078b90 0x7fa16007b0a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa164032000 tx=0x7fa16402c040 comp rx=0 tx=0).stop 2024-09-17T03:11:33.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.904+0000 7fa17a425640 1 -- 172.21.15.78:0/2846619392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa174160600 msgr2=0x7fa17415fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:33.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.904+0000 7fa17a425640 1 --2- 172.21.15.78:0/2846619392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa174160600 0x7fa17415fdd0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa168011780 tx=0x7fa168011b80 comp rx=0 tx=0).stop 2024-09-17T03:11:33.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.904+0000 7fa17a425640 1 -- 172.21.15.78:0/2846619392 shutdown_connections 2024-09-17T03:11:33.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.904+0000 7fa17a425640 1 --2- 172.21.15.78:0/2846619392 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa160078b90 0x7fa16007b0a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.904+0000 7fa17a425640 1 --2- 172.21.15.78:0/2846619392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa17409e9c0 0x7fa17409edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.904+0000 7fa17a425640 1 --2- 172.21.15.78:0/2846619392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa174160600 0x7fa17415fdd0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.904+0000 7fa17a425640 1 --2- 172.21.15.78:0/2846619392 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa15c003a50 0x7fa1740cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:33.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.904+0000 7fa17a425640 1 -- 172.21.15.78:0/2846619392 >> 172.21.15.78:0/2846619392 conn(0x7fa17408bfc0 msgr2=0x7fa1740b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:33.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.904+0000 7fa17a425640 1 -- 172.21.15.78:0/2846619392 shutdown_connections 2024-09-17T03:11:33.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:33.904+0000 7fa17a425640 1 -- 172.21.15.78:0/2846619392 wait complete. 2024-09-17T03:11:33.915 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:11:33.915 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:11:34.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.032+0000 7fd57b162640 1 -- 172.21.15.78:0/833879011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd560005350 msgr2=0x7fd56000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:34.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.032+0000 7fd57b162640 1 --2- 172.21.15.78:0/833879011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd560005350 0x7fd56000b9c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fd56c005fd0 tx=0x7fd560005830 comp rx=0 tx=0).stop 2024-09-17T03:11:34.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.032+0000 7fd57b162640 1 -- 172.21.15.78:0/833879011 shutdown_connections 2024-09-17T03:11:34.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.032+0000 7fd57b162640 1 --2- 172.21.15.78:0/833879011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd560005350 0x7fd56000b9c0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:34.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.032+0000 7fd57b162640 1 -- 172.21.15.78:0/833879011 >> 172.21.15.78:0/833879011 conn(0x7fd57408bfc0 msgr2=0x7fd57409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:34.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.032+0000 7fd57b162640 1 -- 172.21.15.78:0/833879011 shutdown_connections 2024-09-17T03:11:34.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.032+0000 7fd57b162640 1 -- 172.21.15.78:0/833879011 wait complete. 2024-09-17T03:11:34.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.034+0000 7fd57b162640 1 Processor -- start 2024-09-17T03:11:34.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.034+0000 7fd57b162640 1 -- start start 2024-09-17T03:11:34.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.035+0000 7fd57b162640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd560005350 0x7fd5741f5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:34.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.035+0000 7fd57b162640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd57415bb70 0x7fd5740b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:34.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.035+0000 7fd57b162640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5740b28f0 0x7fd5740cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:34.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.035+0000 7fd57b162640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd5740cef50 con 0x7fd5740b28f0 2024-09-17T03:11:34.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.035+0000 7fd57b162640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd57406e380 con 0x7fd57415bb70 2024-09-17T03:11:34.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.035+0000 7fd57b162640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd5740cf0d0 con 0x7fd560005350 2024-09-17T03:11:34.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.035+0000 7fd5796ff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5740b28f0 0x7fd5740cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:34.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.035+0000 7fd5796ff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5740b28f0 0x7fd5740cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60752/0 (socket says 172.21.15.78:60752) 2024-09-17T03:11:34.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.035+0000 7fd5796ff640 1 -- 172.21.15.78:0/429187818 learned_addr learned my addr 172.21.15.78:0/429187818 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:34.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.035+0000 7fd578efe640 1 --2- 172.21.15.78:0/429187818 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd560005350 0x7fd5741f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:34.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.035+0000 7fd5796ff640 1 -- 172.21.15.78:0/429187818 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd560005350 msgr2=0x7fd5741f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:34.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.035+0000 7fd573fff640 1 --2- 172.21.15.78:0/429187818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd57415bb70 0x7fd5740b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:34.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.035+0000 7fd5796ff640 1 --2- 172.21.15.78:0/429187818 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd560005350 0x7fd5741f5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:34.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.035+0000 7fd5796ff640 1 -- 172.21.15.78:0/429187818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd57415bb70 msgr2=0x7fd5740b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:34.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.035+0000 7fd5796ff640 1 --2- 172.21.15.78:0/429187818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd57415bb70 0x7fd5740b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:34.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.035+0000 7fd5796ff640 1 -- 172.21.15.78:0/429187818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5740b2d00 con 0x7fd5740b28f0 2024-09-17T03:11:34.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.035+0000 7fd573fff640 1 --2- 172.21.15.78:0/429187818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd57415bb70 0x7fd5740b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:34.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.036+0000 7fd5796ff640 1 --2- 172.21.15.78:0/429187818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5740b28f0 0x7fd5740cc700 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd56c02aec0 tx=0x7fd56c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:34.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.036+0000 7fd5717fa640 1 -- 172.21.15.78:0/429187818 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c009200 con 0x7fd5740b28f0 2024-09-17T03:11:34.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.036+0000 7fd5717fa640 1 -- 172.21.15.78:0/429187818 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd56c02bc30 con 0x7fd5740b28f0 2024-09-17T03:11:34.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.036+0000 7fd57b162640 1 -- 172.21.15.78:0/429187818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5740cb660 con 0x7fd5740b28f0 2024-09-17T03:11:34.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.036+0000 7fd5717fa640 1 -- 172.21.15.78:0/429187818 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c009ad0 con 0x7fd5740b28f0 2024-09-17T03:11:34.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.036+0000 7fd57b162640 1 -- 172.21.15.78:0/429187818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5740cbc20 con 0x7fd5740b28f0 2024-09-17T03:11:34.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.037+0000 7fd57b162640 1 -- 172.21.15.78:0/429187818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd57415b900 con 0x7fd5740b28f0 2024-09-17T03:11:34.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.038+0000 7fd5717fa640 1 -- 172.21.15.78:0/429187818 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd56c033440 con 0x7fd5740b28f0 2024-09-17T03:11:34.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.038+0000 7fd5717fa640 1 --2- 172.21.15.78:0/429187818 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd554078b90 0x7fd55407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:34.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.038+0000 7fd5717fa640 1 -- 172.21.15.78:0/429187818 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fd56c0bb380 con 0x7fd5740b28f0 2024-09-17T03:11:34.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.038+0000 7fd578efe640 1 --2- 172.21.15.78:0/429187818 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd554078b90 0x7fd55407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:34.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.039+0000 7fd578efe640 1 --2- 172.21.15.78:0/429187818 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd554078b90 0x7fd55407b0a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd55c006540 tx=0x7fd55c006b70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:34.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.042+0000 7fd5717fa640 1 -- 172.21.15.78:0/429187818 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd5740b2d00 con 0x7fd5740b28f0 2024-09-17T03:11:34.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.254+0000 7fd57b162640 1 -- 172.21.15.78:0/429187818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd57406f620 con 0x7fd5740b28f0 2024-09-17T03:11:34.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.907+0000 7fd5717fa640 1 -- 172.21.15.78:0/429187818 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v45) ==== 122+0+0 (secure 0 0 0) 0x7fd56c0837c0 con 0x7fd5740b28f0 2024-09-17T03:11:34.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.909+0000 7fd57b162640 1 -- 172.21.15.78:0/429187818 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd554078b90 msgr2=0x7fd55407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:34.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.909+0000 7fd57b162640 1 --2- 172.21.15.78:0/429187818 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd554078b90 0x7fd55407b0a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd55c006540 tx=0x7fd55c006b70 comp rx=0 tx=0).stop 2024-09-17T03:11:34.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.909+0000 7fd57b162640 1 -- 172.21.15.78:0/429187818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5740b28f0 msgr2=0x7fd5740cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:34.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.909+0000 7fd57b162640 1 --2- 172.21.15.78:0/429187818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5740b28f0 0x7fd5740cc700 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd56c02aec0 tx=0x7fd56c0042f0 comp rx=0 tx=0).stop 2024-09-17T03:11:34.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.910+0000 7fd57b162640 1 -- 172.21.15.78:0/429187818 shutdown_connections 2024-09-17T03:11:34.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.910+0000 7fd57b162640 1 --2- 172.21.15.78:0/429187818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5740b28f0 0x7fd5740cc700 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:34.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.910+0000 7fd57b162640 1 --2- 172.21.15.78:0/429187818 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd554078b90 0x7fd55407b0a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:34.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.910+0000 7fd57b162640 1 --2- 172.21.15.78:0/429187818 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd57415bb70 0x7fd5740b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:34.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.910+0000 7fd57b162640 1 --2- 172.21.15.78:0/429187818 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd560005350 0x7fd5741f5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:34.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.910+0000 7fd57b162640 1 -- 172.21.15.78:0/429187818 >> 172.21.15.78:0/429187818 conn(0x7fd57408bfc0 msgr2=0x7fd5740b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:34.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.910+0000 7fd57b162640 1 -- 172.21.15.78:0/429187818 shutdown_connections 2024-09-17T03:11:34.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:34.910+0000 7fd57b162640 1 -- 172.21.15.78:0/429187818 wait complete. 2024-09-17T03:11:34.920 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:11:34.921 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:11:35.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.036+0000 7f2fbb2b6640 1 -- 172.21.15.78:0/2461785780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f9c004e60 msgr2=0x7f2f9c0052b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:35.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.036+0000 7f2fbb2b6640 1 --2- 172.21.15.78:0/2461785780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f9c004e60 0x7f2f9c0052b0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2fac00c470 tx=0x7f2f9c005830 comp rx=0 tx=0).stop 2024-09-17T03:11:35.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.036+0000 7f2fb9853640 1 -- 172.21.15.78:0/2461785780 reap_dead start 2024-09-17T03:11:35.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.036+0000 7f2fbb2b6640 1 -- 172.21.15.78:0/2461785780 shutdown_connections 2024-09-17T03:11:35.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.036+0000 7f2fbb2b6640 1 -- 172.21.15.78:0/2461785780 >> 172.21.15.78:0/2461785780 conn(0x7f2fb40b1cb0 msgr2=0x7f2fb40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:35.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.036+0000 7f2fbb2b6640 1 -- 172.21.15.78:0/2461785780 shutdown_connections 2024-09-17T03:11:35.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.036+0000 7f2fbb2b6640 1 -- 172.21.15.78:0/2461785780 wait complete. 2024-09-17T03:11:35.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.037+0000 7f2fbb2b6640 1 Processor -- start 2024-09-17T03:11:35.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.038+0000 7f2fbb2b6640 1 -- start start 2024-09-17T03:11:35.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.039+0000 7f2fbb2b6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2f9c004e60 0x7f2fb4150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:35.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.039+0000 7f2fbb2b6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fb4153b60 0x7f2fb4153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:35.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.039+0000 7f2fbb2b6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fb4154a00 0x7f2fb4154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:35.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.039+0000 7f2fbb2b6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb40705b0 con 0x7f2fb4153b60 2024-09-17T03:11:35.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.039+0000 7f2fbb2b6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb415c3b0 con 0x7f2fb4154a00 2024-09-17T03:11:35.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.039+0000 7f2fbb2b6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f2fb4070730 con 0x7f2f9c004e60 2024-09-17T03:11:35.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.039+0000 7f2fb8851640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fb4153b60 0x7f2fb4153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:35.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.039+0000 7f2fb8851640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fb4153b60 0x7f2fb4153f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60770/0 (socket says 172.21.15.78:60770) 2024-09-17T03:11:35.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.039+0000 7f2fb8851640 1 -- 172.21.15.78:0/819891069 learned_addr learned my addr 172.21.15.78:0/819891069 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:35.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.039+0000 7f2fb9853640 1 --2- 172.21.15.78:0/819891069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fb4154a00 0x7f2fb4154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:35.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.039+0000 7f2fb9052640 1 --2- 172.21.15.78:0/819891069 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2f9c004e60 0x7f2fb4150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:35.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.039+0000 7f2fb8851640 1 -- 172.21.15.78:0/819891069 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2f9c004e60 msgr2=0x7f2fb4150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:35.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.039+0000 7f2fb8851640 1 --2- 172.21.15.78:0/819891069 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2f9c004e60 0x7f2fb4150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.039+0000 7f2fb8851640 1 -- 172.21.15.78:0/819891069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fb4154a00 msgr2=0x7f2fb4154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:35.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.039+0000 7f2fb8851640 1 --2- 172.21.15.78:0/819891069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fb4154a00 0x7f2fb4154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.039+0000 7f2fb8851640 1 -- 172.21.15.78:0/819891069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb4155350 con 0x7f2fb4153b60 2024-09-17T03:11:35.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.039+0000 7f2fb9052640 1 --2- 172.21.15.78:0/819891069 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2f9c004e60 0x7f2fb4150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:35.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.039+0000 7f2fb8851640 1 --2- 172.21.15.78:0/819891069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fb4153b60 0x7f2fb4153f70 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8003fa0 tx=0x7f2fa800ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:35.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.040+0000 7f2fb1ffb640 1 -- 172.21.15.78:0/819891069 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa8005220 con 0x7f2fb4153b60 2024-09-17T03:11:35.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.040+0000 7f2fb1ffb640 1 -- 172.21.15.78:0/819891069 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2fa80053c0 con 0x7f2fb4153b60 2024-09-17T03:11:35.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.040+0000 7f2fb1ffb640 1 -- 172.21.15.78:0/819891069 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa80047a0 con 0x7f2fb4153b60 2024-09-17T03:11:35.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.040+0000 7f2fbb2b6640 1 -- 172.21.15.78:0/819891069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb41697a0 con 0x7f2fb4153b60 2024-09-17T03:11:35.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.040+0000 7f2fbb2b6640 1 -- 172.21.15.78:0/819891069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb41694c0 con 0x7f2fb4153b60 2024-09-17T03:11:35.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.041+0000 7f2fbb2b6640 1 -- 172.21.15.78:0/819891069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fb4075130 con 0x7f2fb4153b60 2024-09-17T03:11:35.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.041+0000 7f2fb1ffb640 1 -- 172.21.15.78:0/819891069 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2fa8004940 con 0x7f2fb4153b60 2024-09-17T03:11:35.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.042+0000 7f2fb1ffb640 1 --2- 172.21.15.78:0/819891069 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2fa0078b90 0x7f2fa007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:35.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.042+0000 7f2fb1ffb640 1 -- 172.21.15.78:0/819891069 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f2fa809b800 con 0x7f2fb4153b60 2024-09-17T03:11:35.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.042+0000 7f2fb9052640 1 --2- 172.21.15.78:0/819891069 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2fa0078b90 0x7f2fa007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:35.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.043+0000 7f2fb9052640 1 --2- 172.21.15.78:0/819891069 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2fa0078b90 0x7f2fa007b0a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4000f80 tx=0x7f2fa4004d50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:35.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.047+0000 7f2fb1ffb640 1 -- 172.21.15.78:0/819891069 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2fb4075130 con 0x7f2fb4153b60 2024-09-17T03:11:35.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.259+0000 7f2fbb2b6640 1 -- 172.21.15.78:0/819891069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fb40ca9a0 con 0x7f2fb4153b60 2024-09-17T03:11:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.260+0000 7f2fb1ffb640 1 -- 172.21.15.78:0/819891069 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5220 (secure 0 0 0) 0x7f2fb4155350 con 0x7f2fb4153b60 2024-09-17T03:11:35.259 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:35.259 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":45,"btime":"2024-09-17T03:11:34:902558+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/33195895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":33195895},{"type":"v1","addr":"172.21.15.193:6836","nonce":33195895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5758,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1865992966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1865992966},{"type":"v1","addr":"172.21.15.78:6835","nonce":1865992966}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/2730762656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2730762656},{"type":"v1","addr":"172.21.15.193:6837","nonce":2730762656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:11:32.250686+0000","modified":"2024-09-17T03:11:34.255718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6231":{"gid":6231,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6834/936871583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":936871583},{"type":"v1","addr":"172.21.15.78:6834","nonce":936871583}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6231,"qdb_cluster":[6231]},"id":4}]} 2024-09-17T03:11:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 45 2024-09-17T03:11:35.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.262+0000 7f2fbb2b6640 1 -- 172.21.15.78:0/819891069 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2fa0078b90 msgr2=0x7f2fa007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:35.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.262+0000 7f2fbb2b6640 1 --2- 172.21.15.78:0/819891069 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2fa0078b90 0x7f2fa007b0a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2fa4000f80 tx=0x7f2fa4004d50 comp rx=0 tx=0).stop 2024-09-17T03:11:35.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.262+0000 7f2fbb2b6640 1 -- 172.21.15.78:0/819891069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fb4153b60 msgr2=0x7f2fb4153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:35.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.262+0000 7f2fbb2b6640 1 --2- 172.21.15.78:0/819891069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fb4153b60 0x7f2fb4153f70 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8003fa0 tx=0x7f2fa800ba40 comp rx=0 tx=0).stop 2024-09-17T03:11:35.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.262+0000 7f2fbb2b6640 1 -- 172.21.15.78:0/819891069 shutdown_connections 2024-09-17T03:11:35.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.262+0000 7f2fbb2b6640 1 --2- 172.21.15.78:0/819891069 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2fa0078b90 0x7f2fa007b0a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.262+0000 7f2fbb2b6640 1 --2- 172.21.15.78:0/819891069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fb4154a00 0x7f2fb4154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.262+0000 7f2fbb2b6640 1 --2- 172.21.15.78:0/819891069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fb4153b60 0x7f2fb4153f70 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.262+0000 7f2fbb2b6640 1 --2- 172.21.15.78:0/819891069 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2f9c004e60 0x7f2fb4150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.262+0000 7f2fbb2b6640 1 -- 172.21.15.78:0/819891069 >> 172.21.15.78:0/819891069 conn(0x7f2fb40b1cb0 msgr2=0x7f2fb40b32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:35.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.262+0000 7f2fbb2b6640 1 -- 172.21.15.78:0/819891069 shutdown_connections 2024-09-17T03:11:35.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.262+0000 7f2fbb2b6640 1 -- 172.21.15.78:0/819891069 wait complete. 2024-09-17T03:11:35.273 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:11:35.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.387+0000 7f18d77a1640 1 -- 172.21.15.78:0/547542339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18d00d1d40 msgr2=0x7f18d00b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:35.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.387+0000 7f18d77a1640 1 --2- 172.21.15.78:0/547542339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18d00d1d40 0x7f18d00b5210 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009830 tx=0x7f18cc02a510 comp rx=0 tx=0).stop 2024-09-17T03:11:35.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.387+0000 7f18d77a1640 1 -- 172.21.15.78:0/547542339 shutdown_connections 2024-09-17T03:11:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.387+0000 7f18d77a1640 1 --2- 172.21.15.78:0/547542339 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f18d00ccba0 0x7f18d00ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.387+0000 7f18d77a1640 1 --2- 172.21.15.78:0/547542339 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18d00d1d40 0x7f18d00b5210 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.387+0000 7f18d77a1640 1 -- 172.21.15.78:0/547542339 >> 172.21.15.78:0/547542339 conn(0x7f18d00b3f10 msgr2=0x7f18d00b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.387+0000 7f18d77a1640 1 -- 172.21.15.78:0/547542339 shutdown_connections 2024-09-17T03:11:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.387+0000 7f18d77a1640 1 -- 172.21.15.78:0/547542339 wait complete. 2024-09-17T03:11:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.389+0000 7f18d77a1640 1 Processor -- start 2024-09-17T03:11:35.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.389+0000 7f18d77a1640 1 -- start start 2024-09-17T03:11:35.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.390+0000 7f18d77a1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18d00ccba0 0x7f18d014be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:35.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.390+0000 7f18d77a1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f18d00d1d40 0x7f18d01f6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:35.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.390+0000 7f18d77a1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18d015c6f0 0x7f18d00cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:35.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.390+0000 7f18d77a1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f18d00d11f0 con 0x7f18d015c6f0 2024-09-17T03:11:35.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.390+0000 7f18d77a1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f18d00d1070 con 0x7f18d00ccba0 2024-09-17T03:11:35.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.390+0000 7f18d77a1640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f18d00d1370 con 0x7f18d00d1d40 2024-09-17T03:11:35.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.390+0000 7f18d5d3e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18d015c6f0 0x7f18d00cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:35.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.390+0000 7f18d5d3e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18d015c6f0 0x7f18d00cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60782/0 (socket says 172.21.15.78:60782) 2024-09-17T03:11:35.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.390+0000 7f18d5d3e640 1 -- 172.21.15.78:0/4122017313 learned_addr learned my addr 172.21.15.78:0/4122017313 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:35.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.391+0000 7f18d553d640 1 --2- 172.21.15.78:0/4122017313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18d00ccba0 0x7f18d014be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:35.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.391+0000 7f18d5d3e640 1 -- 172.21.15.78:0/4122017313 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f18d00d1d40 msgr2=0x7f18d01f6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:35.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.391+0000 7f18d5d3e640 1 --2- 172.21.15.78:0/4122017313 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f18d00d1d40 0x7f18d01f6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.391+0000 7f18d5d3e640 1 -- 172.21.15.78:0/4122017313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18d00ccba0 msgr2=0x7f18d014be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:35.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.391+0000 7f18d5d3e640 1 --2- 172.21.15.78:0/4122017313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18d00ccba0 0x7f18d014be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.391+0000 7f18d5d3e640 1 -- 172.21.15.78:0/4122017313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d014f860 con 0x7f18d015c6f0 2024-09-17T03:11:35.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.391+0000 7f18d5d3e640 1 --2- 172.21.15.78:0/4122017313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18d015c6f0 0x7f18d00cb150 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f18c800ea40 tx=0x7f18c800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:35.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.391+0000 7f18c5ffb640 1 -- 172.21.15.78:0/4122017313 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c800ce40 con 0x7f18d015c6f0 2024-09-17T03:11:35.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.391+0000 7f18c5ffb640 1 -- 172.21.15.78:0/4122017313 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18c8004c10 con 0x7f18d015c6f0 2024-09-17T03:11:35.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.391+0000 7f18c5ffb640 1 -- 172.21.15.78:0/4122017313 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8005020 con 0x7f18d015c6f0 2024-09-17T03:11:35.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.391+0000 7f18d77a1640 1 -- 172.21.15.78:0/4122017313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18d00ad850 con 0x7f18d015c6f0 2024-09-17T03:11:35.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.391+0000 7f18d77a1640 1 -- 172.21.15.78:0/4122017313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18d014ed80 con 0x7f18d015c6f0 2024-09-17T03:11:35.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.392+0000 7f18d77a1640 1 -- 172.21.15.78:0/4122017313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18d00d18c0 con 0x7f18d015c6f0 2024-09-17T03:11:35.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.393+0000 7f18c5ffb640 1 -- 172.21.15.78:0/4122017313 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f18c80051c0 con 0x7f18d015c6f0 2024-09-17T03:11:35.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.393+0000 7f18c5ffb640 1 --2- 172.21.15.78:0/4122017313 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f18b4078b90 0x7f18b407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:35.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.394+0000 7f18c5ffb640 1 -- 172.21.15.78:0/4122017313 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f18c809bbb0 con 0x7f18d015c6f0 2024-09-17T03:11:35.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.394+0000 7f18d553d640 1 --2- 172.21.15.78:0/4122017313 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f18b4078b90 0x7f18b407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:35.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.394+0000 7f18d553d640 1 --2- 172.21.15.78:0/4122017313 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f18b4078b90 0x7f18b407b0a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f18cc034000 tx=0x7f18cc004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:35.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.398+0000 7f18c5ffb640 1 -- 172.21.15.78:0/4122017313 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f18c8064080 con 0x7f18d015c6f0 2024-09-17T03:11:35.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.575+0000 7f18d77a1640 1 -- 172.21.15.78:0/4122017313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f18d00b6560 con 0x7f18d015c6f0 2024-09-17T03:11:35.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.576+0000 7f18c5ffb640 1 -- 172.21.15.78:0/4122017313 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+16701 (secure 0 0 0) 0x7f18c8063980 con 0x7f18d015c6f0 2024-09-17T03:11:35.575 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:35.575 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":58,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:11:33.896530+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:11:29.890641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T03:11:31.216226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:11:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.579+0000 7f18d77a1640 1 -- 172.21.15.78:0/4122017313 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f18b4078b90 msgr2=0x7f18b407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.579+0000 7f18d77a1640 1 --2- 172.21.15.78:0/4122017313 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f18b4078b90 0x7f18b407b0a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f18cc034000 tx=0x7f18cc004730 comp rx=0 tx=0).stop 2024-09-17T03:11:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.579+0000 7f18d77a1640 1 -- 172.21.15.78:0/4122017313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18d015c6f0 msgr2=0x7f18d00cb150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.579+0000 7f18d77a1640 1 --2- 172.21.15.78:0/4122017313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18d015c6f0 0x7f18d00cb150 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f18c800ea40 tx=0x7f18c800ef00 comp rx=0 tx=0).stop 2024-09-17T03:11:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.579+0000 7f18d77a1640 1 -- 172.21.15.78:0/4122017313 shutdown_connections 2024-09-17T03:11:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.579+0000 7f18d77a1640 1 --2- 172.21.15.78:0/4122017313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18d015c6f0 0x7f18d00cb150 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.579+0000 7f18d77a1640 1 --2- 172.21.15.78:0/4122017313 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f18d00d1d40 0x7f18d01f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.579+0000 7f18d77a1640 1 --2- 172.21.15.78:0/4122017313 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f18b4078b90 0x7f18b407b0a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.579+0000 7f18d77a1640 1 --2- 172.21.15.78:0/4122017313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18d00ccba0 0x7f18d014be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.579+0000 7f18d77a1640 1 -- 172.21.15.78:0/4122017313 >> 172.21.15.78:0/4122017313 conn(0x7f18d00b3f10 msgr2=0x7f18d00b7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.579+0000 7f18d77a1640 1 -- 172.21.15.78:0/4122017313 shutdown_connections 2024-09-17T03:11:35.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.579+0000 7f18d77a1640 1 -- 172.21.15.78:0/4122017313 wait complete. 2024-09-17T03:11:35.589 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:11:35.590 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:11:35.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.703+0000 7fe58ca27640 1 -- 172.21.15.78:0/24184811 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe58806e170 msgr2=0x7fe5880b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:35.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.703+0000 7fe58ca27640 1 --2- 172.21.15.78:0/24184811 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe58806e170 0x7fe5880b3540 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe578009830 tx=0x7fe57802a410 comp rx=0 tx=0).stop 2024-09-17T03:11:35.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.703+0000 7fe58ca27640 1 -- 172.21.15.78:0/24184811 shutdown_connections 2024-09-17T03:11:35.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.703+0000 7fe58ca27640 1 --2- 172.21.15.78:0/24184811 >> v2:172.21.15.193:3300/0 conn(0x7fe5880ceb40 0x7fe5880cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.703+0000 7fe58ca27640 1 --2- 172.21.15.78:0/24184811 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe58806e170 0x7fe5880b3540 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.703+0000 7fe58ca27640 1 -- 172.21.15.78:0/24184811 >> 172.21.15.78:0/24184811 conn(0x7fe58808bfc0 msgr2=0x7fe58809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:35.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.703+0000 7fe58ca27640 1 -- 172.21.15.78:0/24184811 shutdown_connections 2024-09-17T03:11:35.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.703+0000 7fe58ca27640 1 -- 172.21.15.78:0/24184811 wait complete. 2024-09-17T03:11:35.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.705+0000 7fe58ca27640 1 Processor -- start 2024-09-17T03:11:35.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.705+0000 7fe58ca27640 1 -- start start 2024-09-17T03:11:35.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.706+0000 7fe58ca27640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe58806f4b0 0x7fe5880ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:35.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.706+0000 7fe58ca27640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe5880ceb40 0x7fe5880a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:35.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.706+0000 7fe58ca27640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5881516c0 0x7fe5881f8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:35.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.706+0000 7fe58ca27640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe5880d0e60 con 0x7fe58806f4b0 2024-09-17T03:11:35.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.706+0000 7fe58ca27640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe5880d0ce0 con 0x7fe5881516c0 2024-09-17T03:11:35.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.706+0000 7fe58ca27640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe5880d0fe0 con 0x7fe5880ceb40 2024-09-17T03:11:35.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.706+0000 7fe58659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe58806f4b0 0x7fe5880ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:35.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.706+0000 7fe58659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe58806f4b0 0x7fe5880ca860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60790/0 (socket says 172.21.15.78:60790) 2024-09-17T03:11:35.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.706+0000 7fe58659c640 1 -- 172.21.15.78:0/1867123619 learned_addr learned my addr 172.21.15.78:0/1867123619 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:35.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.706+0000 7fe586d9d640 1 --2- 172.21.15.78:0/1867123619 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5881516c0 0x7fe5881f8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:35.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.706+0000 7fe585d9b640 1 --2- 172.21.15.78:0/1867123619 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe5880ceb40 0x7fe5880a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:35.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.706+0000 7fe58659c640 1 -- 172.21.15.78:0/1867123619 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe5880ceb40 msgr2=0x7fe5880a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:35.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.706+0000 7fe58659c640 1 --2- 172.21.15.78:0/1867123619 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe5880ceb40 0x7fe5880a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.706+0000 7fe58659c640 1 -- 172.21.15.78:0/1867123619 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5881516c0 msgr2=0x7fe5881f8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:35.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.706+0000 7fe58659c640 1 --2- 172.21.15.78:0/1867123619 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5881516c0 0x7fe5881f8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.706+0000 7fe58659c640 1 -- 172.21.15.78:0/1867123619 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5880cc7b0 con 0x7fe58806f4b0 2024-09-17T03:11:35.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.706+0000 7fe585d9b640 1 --2- 172.21.15.78:0/1867123619 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe5880ceb40 0x7fe5880a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:35.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.707+0000 7fe58659c640 1 --2- 172.21.15.78:0/1867123619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe58806f4b0 0x7fe5880ca860 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe578009950 tx=0x7fe578003b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:35.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.707+0000 7fe576ffd640 1 -- 172.21.15.78:0/1867123619 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57803f030 con 0x7fe58806f4b0 2024-09-17T03:11:35.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.707+0000 7fe576ffd640 1 -- 172.21.15.78:0/1867123619 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe578004510 con 0x7fe58806f4b0 2024-09-17T03:11:35.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.707+0000 7fe58ca27640 1 -- 172.21.15.78:0/1867123619 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5880cca90 con 0x7fe58806f4b0 2024-09-17T03:11:35.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.707+0000 7fe576ffd640 1 -- 172.21.15.78:0/1867123619 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe578037040 con 0x7fe58806f4b0 2024-09-17T03:11:35.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.707+0000 7fe58ca27640 1 -- 172.21.15.78:0/1867123619 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5880cd050 con 0x7fe58806f4b0 2024-09-17T03:11:35.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.708+0000 7fe58ca27640 1 -- 172.21.15.78:0/1867123619 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5880d1590 con 0x7fe58806f4b0 2024-09-17T03:11:35.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.709+0000 7fe576ffd640 1 -- 172.21.15.78:0/1867123619 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe578042070 con 0x7fe58806f4b0 2024-09-17T03:11:35.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.709+0000 7fe576ffd640 1 --2- 172.21.15.78:0/1867123619 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe568078bc0 0x7fe56807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:35.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.709+0000 7fe576ffd640 1 -- 172.21.15.78:0/1867123619 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fe5780ba940 con 0x7fe58806f4b0 2024-09-17T03:11:35.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.709+0000 7fe585d9b640 1 --2- 172.21.15.78:0/1867123619 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe568078bc0 0x7fe56807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:35.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.710+0000 7fe585d9b640 1 --2- 172.21.15.78:0/1867123619 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe568078bc0 0x7fe56807b0d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe5880cfa40 tx=0x7fe57c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:35.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.713+0000 7fe576ffd640 1 -- 172.21.15.78:0/1867123619 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe578049070 con 0x7fe58806f4b0 2024-09-17T03:11:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.885+0000 7fe58ca27640 1 -- 172.21.15.78:0/1867123619 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe5880b8630 con 0x7fe568078bc0 2024-09-17T03:11:35.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.890+0000 7fe576ffd640 1 -- 172.21.15.78:0/1867123619 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242080 (secure 0 0 0) 0x7fe5880b8630 con 0x7fe568078bc0 2024-09-17T03:11:35.894 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:35.895 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:11:35.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.893+0000 7fe58ca27640 1 -- 172.21.15.78:0/1867123619 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe568078bc0 msgr2=0x7fe56807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:35.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.893+0000 7fe58ca27640 1 --2- 172.21.15.78:0/1867123619 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe568078bc0 0x7fe56807b0d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe5880cfa40 tx=0x7fe57c009040 comp rx=0 tx=0).stop 2024-09-17T03:11:35.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.893+0000 7fe58ca27640 1 -- 172.21.15.78:0/1867123619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe58806f4b0 msgr2=0x7fe5880ca860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:35.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.893+0000 7fe58ca27640 1 --2- 172.21.15.78:0/1867123619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe58806f4b0 0x7fe5880ca860 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe578009950 tx=0x7fe578003b60 comp rx=0 tx=0).stop 2024-09-17T03:11:35.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.893+0000 7fe58ca27640 1 -- 172.21.15.78:0/1867123619 shutdown_connections 2024-09-17T03:11:35.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.893+0000 7fe58ca27640 1 --2- 172.21.15.78:0/1867123619 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe568078bc0 0x7fe56807b0d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.893+0000 7fe58ca27640 1 --2- 172.21.15.78:0/1867123619 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5881516c0 0x7fe5881f8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.893+0000 7fe58ca27640 1 --2- 172.21.15.78:0/1867123619 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe5880ceb40 0x7fe5880a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.893+0000 7fe58ca27640 1 --2- 172.21.15.78:0/1867123619 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe58806f4b0 0x7fe5880ca860 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:35.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.893+0000 7fe58ca27640 1 -- 172.21.15.78:0/1867123619 >> 172.21.15.78:0/1867123619 conn(0x7fe58808bfc0 msgr2=0x7fe58806eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:35.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.893+0000 7fe58ca27640 1 -- 172.21.15.78:0/1867123619 shutdown_connections 2024-09-17T03:11:35.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:35.893+0000 7fe58ca27640 1 -- 172.21.15.78:0/1867123619 wait complete. 2024-09-17T03:11:35.903 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-17T03:11:35.169260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":106,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":92,"acting":92,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":230800,"kb_used_data":6220,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743920,"statfs":{"total":773094113280,"available":772857774080,"internally_reserved":0,"allocated":6369280,"data_stored":3296741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.290995"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.918389+0000","last_change":"2024-09-17T03:11:32.916748+0000","last_active":"2024-09-17T03:11:32.918389+0000","last_peered":"2024-09-17T03:11:32.918389+0000","last_clean":"2024-09-17T03:11:32.918389+0000","last_became_active":"2024-09-17T03:11:32.916471+0000","last_became_peered":"2024-09-17T03:11:32.916471+0000","last_unstale":"2024-09-17T03:11:32.918389+0000","last_undegraded":"2024-09-17T03:11:32.918389+0000","last_fullsized":"2024-09-17T03:11:32.918389+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:30.828742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.917052+0000","last_change":"2024-09-17T03:11:32.911313+0000","last_active":"2024-09-17T03:11:32.917052+0000","last_peered":"2024-09-17T03:11:32.917052+0000","last_clean":"2024-09-17T03:11:32.917052+0000","last_became_active":"2024-09-17T03:11:32.910712+0000","last_became_peered":"2024-09-17T03:11:32.910712+0000","last_unstale":"2024-09-17T03:11:32.917052+0000","last_undegraded":"2024-09-17T03:11:32.917052+0000","last_fullsized":"2024-09-17T03:11:32.917052+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:15.286661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910352+0000","last_change":"2024-09-17T03:11:32.907186+0000","last_active":"2024-09-17T03:11:32.910352+0000","last_peered":"2024-09-17T03:11:32.910352+0000","last_clean":"2024-09-17T03:11:32.910352+0000","last_became_active":"2024-09-17T03:11:32.904919+0000","last_became_peered":"2024-09-17T03:11:32.904919+0000","last_unstale":"2024-09-17T03:11:32.910352+0000","last_undegraded":"2024-09-17T03:11:32.910352+0000","last_fullsized":"2024-09-17T03:11:32.910352+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:36.666178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910437+0000","last_change":"2024-09-17T03:11:32.906705+0000","last_active":"2024-09-17T03:11:32.910437+0000","last_peered":"2024-09-17T03:11:32.910437+0000","last_clean":"2024-09-17T03:11:32.910437+0000","last_became_active":"2024-09-17T03:11:32.904796+0000","last_became_peered":"2024-09-17T03:11:32.904796+0000","last_unstale":"2024-09-17T03:11:32.910437+0000","last_undegraded":"2024-09-17T03:11:32.910437+0000","last_fullsized":"2024-09-17T03:11:32.910437+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:14.944063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910380+0000","last_change":"2024-09-17T03:11:32.908150+0000","last_active":"2024-09-17T03:11:32.910380+0000","last_peered":"2024-09-17T03:11:32.910380+0000","last_clean":"2024-09-17T03:11:32.910380+0000","last_became_active":"2024-09-17T03:11:32.907642+0000","last_became_peered":"2024-09-17T03:11:32.907642+0000","last_unstale":"2024-09-17T03:11:32.910380+0000","last_undegraded":"2024-09-17T03:11:32.910380+0000","last_fullsized":"2024-09-17T03:11:32.910380+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:29.733804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.917918+0000","last_change":"2024-09-17T03:11:32.914928+0000","last_active":"2024-09-17T03:11:32.917918+0000","last_peered":"2024-09-17T03:11:32.917918+0000","last_clean":"2024-09-17T03:11:32.917918+0000","last_became_active":"2024-09-17T03:11:32.914607+0000","last_became_peered":"2024-09-17T03:11:32.914607+0000","last_unstale":"2024-09-17T03:11:32.917918+0000","last_undegraded":"2024-09-17T03:11:32.917918+0000","last_fullsized":"2024-09-17T03:11:32.917918+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:09.590948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882985+0000","last_change":"2024-09-17T03:11:30.882985+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882985+0000","last_undegraded":"2024-09-17T03:11:30.882985+0000","last_fullsized":"2024-09-17T03:11:30.882985+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910478+0000","last_change":"2024-09-17T03:11:31.902430+0000","last_active":"2024-09-17T03:11:32.910478+0000","last_peered":"2024-09-17T03:11:32.910478+0000","last_clean":"2024-09-17T03:11:32.910478+0000","last_became_active":"2024-09-17T03:11:31.902103+0000","last_became_peered":"2024-09-17T03:11:31.902103+0000","last_unstale":"2024-09-17T03:11:32.910478+0000","last_undegraded":"2024-09-17T03:11:32.910478+0000","last_fullsized":"2024-09-17T03:11:32.910478+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:43.410521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882592+0000","last_change":"2024-09-17T03:11:30.882592+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882592+0000","last_undegraded":"2024-09-17T03:11:30.882592+0000","last_fullsized":"2024-09-17T03:11:30.882592+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.883152+0000","last_change":"2024-09-17T03:11:30.883152+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.883152+0000","last_undegraded":"2024-09-17T03:11:30.883152+0000","last_fullsized":"2024-09-17T03:11:30.883152+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910356+0000","last_change":"2024-09-17T03:11:32.907947+0000","last_active":"2024-09-17T03:11:32.910356+0000","last_peered":"2024-09-17T03:11:32.910356+0000","last_clean":"2024-09-17T03:11:32.910356+0000","last_became_active":"2024-09-17T03:11:32.907490+0000","last_became_peered":"2024-09-17T03:11:32.907490+0000","last_unstale":"2024-09-17T03:11:32.910356+0000","last_undegraded":"2024-09-17T03:11:32.910356+0000","last_fullsized":"2024-09-17T03:11:32.910356+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:10.734398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.884803+0000","last_change":"2024-09-17T03:11:30.884803+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.884803+0000","last_undegraded":"2024-09-17T03:11:30.884803+0000","last_fullsized":"2024-09-17T03:11:30.884803+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.917888+0000","last_change":"2024-09-17T03:11:32.913233+0000","last_active":"2024-09-17T03:11:32.917888+0000","last_peered":"2024-09-17T03:11:32.917888+0000","last_clean":"2024-09-17T03:11:32.917888+0000","last_became_active":"2024-09-17T03:11:32.911876+0000","last_became_peered":"2024-09-17T03:11:32.911876+0000","last_unstale":"2024-09-17T03:11:32.917888+0000","last_undegraded":"2024-09-17T03:11:32.917888+0000","last_fullsized":"2024-09-17T03:11:32.917888+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:27.428278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882569+0000","last_change":"2024-09-17T03:11:30.882569+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882569+0000","last_undegraded":"2024-09-17T03:11:30.882569+0000","last_fullsized":"2024-09-17T03:11:30.882569+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.883039+0000","last_change":"2024-09-17T03:11:30.883039+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.883039+0000","last_undegraded":"2024-09-17T03:11:30.883039+0000","last_fullsized":"2024-09-17T03:11:30.883039+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.915985+0000","last_change":"2024-09-17T03:11:32.911245+0000","last_active":"2024-09-17T03:11:32.915985+0000","last_peered":"2024-09-17T03:11:32.915985+0000","last_clean":"2024-09-17T03:11:32.915985+0000","last_became_active":"2024-09-17T03:11:32.908833+0000","last_became_peered":"2024-09-17T03:11:32.908833+0000","last_unstale":"2024-09-17T03:11:32.915985+0000","last_undegraded":"2024-09-17T03:11:32.915985+0000","last_fullsized":"2024-09-17T03:11:32.915985+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:43.107515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.884726+0000","last_change":"2024-09-17T03:11:30.884726+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.884726+0000","last_undegraded":"2024-09-17T03:11:30.884726+0000","last_fullsized":"2024-09-17T03:11:30.884726+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.879834+0000","last_change":"2024-09-17T03:11:30.879834+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.879834+0000","last_undegraded":"2024-09-17T03:11:30.879834+0000","last_fullsized":"2024-09-17T03:11:30.879834+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.897618+0000","last_change":"2024-09-17T03:11:31.909804+0000","last_active":"2024-09-17T03:11:32.897618+0000","last_peered":"2024-09-17T03:11:32.897618+0000","last_clean":"2024-09-17T03:11:32.897618+0000","last_became_active":"2024-09-17T03:11:31.909381+0000","last_became_peered":"2024-09-17T03:11:31.909381+0000","last_unstale":"2024-09-17T03:11:32.897618+0000","last_undegraded":"2024-09-17T03:11:32.897618+0000","last_fullsized":"2024-09-17T03:11:32.897618+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:40.927693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.879870+0000","last_change":"2024-09-17T03:11:30.879870+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.879870+0000","last_undegraded":"2024-09-17T03:11:30.879870+0000","last_fullsized":"2024-09-17T03:11:30.879870+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.884395+0000","last_change":"2024-09-17T03:11:30.884395+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.884395+0000","last_undegraded":"2024-09-17T03:11:30.884395+0000","last_fullsized":"2024-09-17T03:11:30.884395+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.912022+0000","last_change":"2024-09-17T03:11:31.911919+0000","last_active":"2024-09-17T03:11:32.912022+0000","last_peered":"2024-09-17T03:11:32.912022+0000","last_clean":"2024-09-17T03:11:32.912022+0000","last_became_active":"2024-09-17T03:11:31.911544+0000","last_became_peered":"2024-09-17T03:11:31.911544+0000","last_unstale":"2024-09-17T03:11:32.912022+0000","last_undegraded":"2024-09-17T03:11:32.912022+0000","last_fullsized":"2024-09-17T03:11:32.912022+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:41.728594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.888080+0000","last_change":"2024-09-17T03:11:30.888080+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.888080+0000","last_undegraded":"2024-09-17T03:11:30.888080+0000","last_fullsized":"2024-09-17T03:11:30.888080+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882367+0000","last_change":"2024-09-17T03:11:30.882367+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882367+0000","last_undegraded":"2024-09-17T03:11:30.882367+0000","last_fullsized":"2024-09-17T03:11:30.882367+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.879877+0000","last_change":"2024-09-17T03:11:30.879877+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.879877+0000","last_undegraded":"2024-09-17T03:11:30.879877+0000","last_fullsized":"2024-09-17T03:11:30.879877+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.907321+0000","last_change":"2024-09-17T03:11:31.911865+0000","last_active":"2024-09-17T03:11:32.907321+0000","last_peered":"2024-09-17T03:11:32.907321+0000","last_clean":"2024-09-17T03:11:32.907321+0000","last_became_active":"2024-09-17T03:11:31.911483+0000","last_became_peered":"2024-09-17T03:11:31.911483+0000","last_unstale":"2024-09-17T03:11:32.907321+0000","last_undegraded":"2024-09-17T03:11:32.907321+0000","last_fullsized":"2024-09-17T03:11:32.907321+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:00.238987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.883349+0000","last_change":"2024-09-17T03:11:30.883349+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.883349+0000","last_undegraded":"2024-09-17T03:11:30.883349+0000","last_fullsized":"2024-09-17T03:11:30.883349+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.917447+0000","last_change":"2024-09-17T03:11:32.916040+0000","last_active":"2024-09-17T03:11:32.917447+0000","last_peered":"2024-09-17T03:11:32.917447+0000","last_clean":"2024-09-17T03:11:32.917447+0000","last_became_active":"2024-09-17T03:11:32.915733+0000","last_became_peered":"2024-09-17T03:11:32.915733+0000","last_unstale":"2024-09-17T03:11:32.917447+0000","last_undegraded":"2024-09-17T03:11:32.917447+0000","last_fullsized":"2024-09-17T03:11:32.917447+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:30.159445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882380+0000","last_change":"2024-09-17T03:11:30.882380+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882380+0000","last_undegraded":"2024-09-17T03:11:30.882380+0000","last_fullsized":"2024-09-17T03:11:30.882380+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882640+0000","last_change":"2024-09-17T03:11:30.882640+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882640+0000","last_undegraded":"2024-09-17T03:11:30.882640+0000","last_fullsized":"2024-09-17T03:11:30.882640+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.912090+0000","last_change":"2024-09-17T03:11:31.909356+0000","last_active":"2024-09-17T03:11:32.912090+0000","last_peered":"2024-09-17T03:11:32.912090+0000","last_clean":"2024-09-17T03:11:32.912090+0000","last_became_active":"2024-09-17T03:11:31.908876+0000","last_became_peered":"2024-09-17T03:11:31.908876+0000","last_unstale":"2024-09-17T03:11:32.912090+0000","last_undegraded":"2024-09-17T03:11:32.912090+0000","last_fullsized":"2024-09-17T03:11:32.912090+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:35.023225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882661+0000","last_change":"2024-09-17T03:11:30.882661+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882661+0000","last_undegraded":"2024-09-17T03:11:30.882661+0000","last_fullsized":"2024-09-17T03:11:30.882661+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882327+0000","last_change":"2024-09-17T03:11:30.882327+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882327+0000","last_undegraded":"2024-09-17T03:11:30.882327+0000","last_fullsized":"2024-09-17T03:11:30.882327+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882338+0000","last_change":"2024-09-17T03:11:30.882338+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882338+0000","last_undegraded":"2024-09-17T03:11:30.882338+0000","last_fullsized":"2024-09-17T03:11:30.882338+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882765+0000","last_change":"2024-09-17T03:11:30.882765+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882765+0000","last_undegraded":"2024-09-17T03:11:30.882765+0000","last_fullsized":"2024-09-17T03:11:30.882765+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.888097+0000","last_change":"2024-09-17T03:11:30.888097+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.888097+0000","last_undegraded":"2024-09-17T03:11:30.888097+0000","last_fullsized":"2024-09-17T03:11:30.888097+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882420+0000","last_change":"2024-09-17T03:11:30.882420+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882420+0000","last_undegraded":"2024-09-17T03:11:30.882420+0000","last_fullsized":"2024-09-17T03:11:30.882420+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910328+0000","last_change":"2024-09-17T03:11:32.907821+0000","last_active":"2024-09-17T03:11:32.910328+0000","last_peered":"2024-09-17T03:11:32.910328+0000","last_clean":"2024-09-17T03:11:32.910328+0000","last_became_active":"2024-09-17T03:11:32.907272+0000","last_became_peered":"2024-09-17T03:11:32.907272+0000","last_unstale":"2024-09-17T03:11:32.910328+0000","last_undegraded":"2024-09-17T03:11:32.910328+0000","last_fullsized":"2024-09-17T03:11:32.910328+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:34.186429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.883420+0000","last_change":"2024-09-17T03:11:30.883420+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.883420+0000","last_undegraded":"2024-09-17T03:11:30.883420+0000","last_fullsized":"2024-09-17T03:11:30.883420+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.884474+0000","last_change":"2024-09-17T03:11:30.884474+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.884474+0000","last_undegraded":"2024-09-17T03:11:30.884474+0000","last_fullsized":"2024-09-17T03:11:30.884474+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882324+0000","last_change":"2024-09-17T03:11:30.882324+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882324+0000","last_undegraded":"2024-09-17T03:11:30.882324+0000","last_fullsized":"2024-09-17T03:11:30.882324+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.915954+0000","last_change":"2024-09-17T03:11:32.908829+0000","last_active":"2024-09-17T03:11:32.915954+0000","last_peered":"2024-09-17T03:11:32.915954+0000","last_clean":"2024-09-17T03:11:32.915954+0000","last_became_active":"2024-09-17T03:11:32.908529+0000","last_became_peered":"2024-09-17T03:11:32.908529+0000","last_unstale":"2024-09-17T03:11:32.915954+0000","last_undegraded":"2024-09-17T03:11:32.915954+0000","last_fullsized":"2024-09-17T03:11:32.915954+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:28.383364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.899323+0000","last_change":"2024-09-17T03:11:31.909911+0000","last_active":"2024-09-17T03:11:32.899323+0000","last_peered":"2024-09-17T03:11:32.899323+0000","last_clean":"2024-09-17T03:11:32.899323+0000","last_became_active":"2024-09-17T03:11:31.909497+0000","last_became_peered":"2024-09-17T03:11:31.909497+0000","last_unstale":"2024-09-17T03:11:32.899323+0000","last_undegraded":"2024-09-17T03:11:32.899323+0000","last_fullsized":"2024-09-17T03:11:32.899323+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:32.685040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.917013+0000","last_change":"2024-09-17T03:11:32.909203+0000","last_active":"2024-09-17T03:11:32.917013+0000","last_peered":"2024-09-17T03:11:32.917013+0000","last_clean":"2024-09-17T03:11:32.917013+0000","last_became_active":"2024-09-17T03:11:32.908643+0000","last_became_peered":"2024-09-17T03:11:32.908643+0000","last_unstale":"2024-09-17T03:11:32.917013+0000","last_undegraded":"2024-09-17T03:11:32.917013+0000","last_fullsized":"2024-09-17T03:11:32.917013+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:06.406120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.888080+0000","last_change":"2024-09-17T03:11:30.888080+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.888080+0000","last_undegraded":"2024-09-17T03:11:30.888080+0000","last_fullsized":"2024-09-17T03:11:30.888080+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":168,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-17T03:11:30.880358+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:11:30.880358+0000","last_peered":"2024-09-17T03:11:30.880358+0000","last_clean":"2024-09-17T03:11:30.880358+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:11:30.880358+0000","last_undegraded":"2024-09-17T03:11:30.880358+0000","last_fullsized":"2024-09-17T03:11:30.880358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":1},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1232896,"data_stored":851050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":638976,"data_stored":260682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":260682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":638976,"data_stored":260682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":260682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":266499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1245184,"data_stored":856867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":684032,"data_stored":279597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:11:35.908 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:11:36.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.057+0000 7f8bf83cc640 1 -- 172.21.15.78:0/3662073773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bf00b2cb0 msgr2=0x7f8bf00b30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:36.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.057+0000 7f8bf83cc640 1 --2- 172.21.15.78:0/3662073773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bf00b2cb0 0x7f8bf00b30c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0075570 tx=0x7f8be802aa30 comp rx=0 tx=0).stop 2024-09-17T03:11:36.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.058+0000 7f8bf83cc640 1 -- 172.21.15.78:0/3662073773 shutdown_connections 2024-09-17T03:11:36.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.058+0000 7f8bf83cc640 1 --2- 172.21.15.78:0/3662073773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bf00b2cb0 0x7f8bf00b30c0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:36.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.058+0000 7f8bf83cc640 1 --2- 172.21.15.78:0/3662073773 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8bf00b0520 0x7f8bf0071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:36.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.058+0000 7f8bf83cc640 1 --2- 172.21.15.78:0/3662073773 >> v2:172.21.15.193:3300/0 conn(0x7f8bf015b8f0 0x7f8bf00cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:36.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.058+0000 7f8bf83cc640 1 -- 172.21.15.78:0/3662073773 >> 172.21.15.78:0/3662073773 conn(0x7f8bf00cdcb0 msgr2=0x7f8bf00ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:36.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.058+0000 7f8bf83cc640 1 -- 172.21.15.78:0/3662073773 shutdown_connections 2024-09-17T03:11:36.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.058+0000 7f8bf83cc640 1 -- 172.21.15.78:0/3662073773 wait complete. 2024-09-17T03:11:36.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.059+0000 7f8bf83cc640 1 Processor -- start 2024-09-17T03:11:36.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.059+0000 7f8bf83cc640 1 -- start start 2024-09-17T03:11:36.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.061+0000 7f8bf83cc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bf00b0520 0x7f8bf0155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:36.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.061+0000 7f8bf83cc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8bf00b2cb0 0x7f8bf00cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:36.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.061+0000 7f8bf83cc640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8bf015b8f0 0x7f8bf00cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:36.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.061+0000 7f8bf83cc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf00adfa0 con 0x7f8bf00b0520 2024-09-17T03:11:36.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.061+0000 7f8bf83cc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf0071da0 con 0x7f8bf00b2cb0 2024-09-17T03:11:36.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.061+0000 7f8bf83cc640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8bf00ae120 con 0x7f8bf015b8f0 2024-09-17T03:11:36.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.061+0000 7f8bf6168640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bf00b0520 0x7f8bf0155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:36.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.061+0000 7f8bf6168640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bf00b0520 0x7f8bf0155030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60800/0 (socket says 172.21.15.78:60800) 2024-09-17T03:11:36.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.061+0000 7f8bf6168640 1 -- 172.21.15.78:0/1538658070 learned_addr learned my addr 172.21.15.78:0/1538658070 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:36.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.061+0000 7f8bf5967640 1 --2- 172.21.15.78:0/1538658070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8bf00b2cb0 0x7f8bf00cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:36.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.061+0000 7f8bf6168640 1 -- 172.21.15.78:0/1538658070 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8bf015b8f0 msgr2=0x7f8bf00cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:36.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.061+0000 7f8bf6168640 1 --2- 172.21.15.78:0/1538658070 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8bf015b8f0 0x7f8bf00cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:36.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.061+0000 7f8bf6168640 1 -- 172.21.15.78:0/1538658070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8bf00b2cb0 msgr2=0x7f8bf00cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:36.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.061+0000 7f8bf6168640 1 --2- 172.21.15.78:0/1538658070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8bf00b2cb0 0x7f8bf00cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:36.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.061+0000 7f8bf6168640 1 -- 172.21.15.78:0/1538658070 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf00cb5d0 con 0x7f8bf00b0520 2024-09-17T03:11:36.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.061+0000 7f8bf5967640 1 --2- 172.21.15.78:0/1538658070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8bf00b2cb0 0x7f8bf00cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:36.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.061+0000 7f8bf6168640 1 --2- 172.21.15.78:0/1538658070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bf00b0520 0x7f8bf0155030 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00d740 tx=0x7f8bec00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:36.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.061+0000 7f8be6ffd640 1 -- 172.21.15.78:0/1538658070 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec017070 con 0x7f8bf00b0520 2024-09-17T03:11:36.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.061+0000 7f8be6ffd640 1 -- 172.21.15.78:0/1538658070 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bec009d20 con 0x7f8bf00b0520 2024-09-17T03:11:36.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.061+0000 7f8bf83cc640 1 -- 172.21.15.78:0/1538658070 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf00ccd90 con 0x7f8bf00b0520 2024-09-17T03:11:36.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.062+0000 7f8be6ffd640 1 -- 172.21.15.78:0/1538658070 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bec0106c0 con 0x7f8bf00b0520 2024-09-17T03:11:36.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.062+0000 7f8bf83cc640 1 -- 172.21.15.78:0/1538658070 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf00cb850 con 0x7f8bf00b0520 2024-09-17T03:11:36.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.063+0000 7f8bf83cc640 1 -- 172.21.15.78:0/1538658070 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf00ae650 con 0x7f8bf00b0520 2024-09-17T03:11:36.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.063+0000 7f8be6ffd640 1 -- 172.21.15.78:0/1538658070 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8bec01a070 con 0x7f8bf00b0520 2024-09-17T03:11:36.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.064+0000 7f8be6ffd640 1 --2- 172.21.15.78:0/1538658070 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8bd4078b90 0x7f8bd407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:36.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.064+0000 7f8be6ffd640 1 -- 172.21.15.78:0/1538658070 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f8bec09b220 con 0x7f8bf00b0520 2024-09-17T03:11:36.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.064+0000 7f8bf5967640 1 --2- 172.21.15.78:0/1538658070 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8bd4078b90 0x7f8bd407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:36.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.065+0000 7f8bf5967640 1 --2- 172.21.15.78:0/1538658070 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8bd4078b90 0x7f8bd407b0a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8bf015a610 tx=0x7f8be0005c90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:36.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.068+0000 7f8be6ffd640 1 -- 172.21.15.78:0/1538658070 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8bf00ccd90 con 0x7f8bf00b0520 2024-09-17T03:11:36.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.240+0000 7f8bf83cc640 1 -- 172.21.15.78:0/1538658070 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8bf00b1c70 con 0x7f8bd4078b90 2024-09-17T03:11:36.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.244+0000 7f8be6ffd640 1 -- 172.21.15.78:0/1538658070 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242080 (secure 0 0 0) 0x7f8bf00b1c70 con 0x7f8bd4078b90 2024-09-17T03:11:36.245 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:36.246 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:11:36.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.247+0000 7f8bf83cc640 1 -- 172.21.15.78:0/1538658070 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8bd4078b90 msgr2=0x7f8bd407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:36.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.247+0000 7f8bf83cc640 1 --2- 172.21.15.78:0/1538658070 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8bd4078b90 0x7f8bd407b0a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8bf015a610 tx=0x7f8be0005c90 comp rx=0 tx=0).stop 2024-09-17T03:11:36.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.247+0000 7f8bf83cc640 1 -- 172.21.15.78:0/1538658070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bf00b0520 msgr2=0x7f8bf0155030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:36.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.247+0000 7f8bf83cc640 1 --2- 172.21.15.78:0/1538658070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bf00b0520 0x7f8bf0155030 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00d740 tx=0x7f8bec00dc00 comp rx=0 tx=0).stop 2024-09-17T03:11:36.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.247+0000 7f8bf83cc640 1 -- 172.21.15.78:0/1538658070 shutdown_connections 2024-09-17T03:11:36.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.247+0000 7f8bf83cc640 1 --2- 172.21.15.78:0/1538658070 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8bf015b8f0 0x7f8bf00cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:36.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.247+0000 7f8bf83cc640 1 --2- 172.21.15.78:0/1538658070 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8bd4078b90 0x7f8bd407b0a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:36.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.247+0000 7f8bf83cc640 1 --2- 172.21.15.78:0/1538658070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8bf00b2cb0 0x7f8bf00cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:36.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.247+0000 7f8bf83cc640 1 --2- 172.21.15.78:0/1538658070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bf00b0520 0x7f8bf0155030 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:36.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.247+0000 7f8bf83cc640 1 -- 172.21.15.78:0/1538658070 >> 172.21.15.78:0/1538658070 conn(0x7f8bf00cdcb0 msgr2=0x7f8bf009ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:36.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.247+0000 7f8bf83cc640 1 -- 172.21.15.78:0/1538658070 shutdown_connections 2024-09-17T03:11:36.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.247+0000 7f8bf83cc640 1 -- 172.21.15.78:0/1538658070 wait complete. 2024-09-17T03:11:36.257 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-17T03:11:35.169260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":106,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":92,"acting":92,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":230800,"kb_used_data":6220,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743920,"statfs":{"total":773094113280,"available":772857774080,"internally_reserved":0,"allocated":6369280,"data_stored":3296741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.290995"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.918389+0000","last_change":"2024-09-17T03:11:32.916748+0000","last_active":"2024-09-17T03:11:32.918389+0000","last_peered":"2024-09-17T03:11:32.918389+0000","last_clean":"2024-09-17T03:11:32.918389+0000","last_became_active":"2024-09-17T03:11:32.916471+0000","last_became_peered":"2024-09-17T03:11:32.916471+0000","last_unstale":"2024-09-17T03:11:32.918389+0000","last_undegraded":"2024-09-17T03:11:32.918389+0000","last_fullsized":"2024-09-17T03:11:32.918389+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:30.828742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.917052+0000","last_change":"2024-09-17T03:11:32.911313+0000","last_active":"2024-09-17T03:11:32.917052+0000","last_peered":"2024-09-17T03:11:32.917052+0000","last_clean":"2024-09-17T03:11:32.917052+0000","last_became_active":"2024-09-17T03:11:32.910712+0000","last_became_peered":"2024-09-17T03:11:32.910712+0000","last_unstale":"2024-09-17T03:11:32.917052+0000","last_undegraded":"2024-09-17T03:11:32.917052+0000","last_fullsized":"2024-09-17T03:11:32.917052+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:15.286661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910352+0000","last_change":"2024-09-17T03:11:32.907186+0000","last_active":"2024-09-17T03:11:32.910352+0000","last_peered":"2024-09-17T03:11:32.910352+0000","last_clean":"2024-09-17T03:11:32.910352+0000","last_became_active":"2024-09-17T03:11:32.904919+0000","last_became_peered":"2024-09-17T03:11:32.904919+0000","last_unstale":"2024-09-17T03:11:32.910352+0000","last_undegraded":"2024-09-17T03:11:32.910352+0000","last_fullsized":"2024-09-17T03:11:32.910352+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:36.666178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910437+0000","last_change":"2024-09-17T03:11:32.906705+0000","last_active":"2024-09-17T03:11:32.910437+0000","last_peered":"2024-09-17T03:11:32.910437+0000","last_clean":"2024-09-17T03:11:32.910437+0000","last_became_active":"2024-09-17T03:11:32.904796+0000","last_became_peered":"2024-09-17T03:11:32.904796+0000","last_unstale":"2024-09-17T03:11:32.910437+0000","last_undegraded":"2024-09-17T03:11:32.910437+0000","last_fullsized":"2024-09-17T03:11:32.910437+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:14.944063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910380+0000","last_change":"2024-09-17T03:11:32.908150+0000","last_active":"2024-09-17T03:11:32.910380+0000","last_peered":"2024-09-17T03:11:32.910380+0000","last_clean":"2024-09-17T03:11:32.910380+0000","last_became_active":"2024-09-17T03:11:32.907642+0000","last_became_peered":"2024-09-17T03:11:32.907642+0000","last_unstale":"2024-09-17T03:11:32.910380+0000","last_undegraded":"2024-09-17T03:11:32.910380+0000","last_fullsized":"2024-09-17T03:11:32.910380+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:29.733804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.917918+0000","last_change":"2024-09-17T03:11:32.914928+0000","last_active":"2024-09-17T03:11:32.917918+0000","last_peered":"2024-09-17T03:11:32.917918+0000","last_clean":"2024-09-17T03:11:32.917918+0000","last_became_active":"2024-09-17T03:11:32.914607+0000","last_became_peered":"2024-09-17T03:11:32.914607+0000","last_unstale":"2024-09-17T03:11:32.917918+0000","last_undegraded":"2024-09-17T03:11:32.917918+0000","last_fullsized":"2024-09-17T03:11:32.917918+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:09.590948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882985+0000","last_change":"2024-09-17T03:11:30.882985+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882985+0000","last_undegraded":"2024-09-17T03:11:30.882985+0000","last_fullsized":"2024-09-17T03:11:30.882985+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910478+0000","last_change":"2024-09-17T03:11:31.902430+0000","last_active":"2024-09-17T03:11:32.910478+0000","last_peered":"2024-09-17T03:11:32.910478+0000","last_clean":"2024-09-17T03:11:32.910478+0000","last_became_active":"2024-09-17T03:11:31.902103+0000","last_became_peered":"2024-09-17T03:11:31.902103+0000","last_unstale":"2024-09-17T03:11:32.910478+0000","last_undegraded":"2024-09-17T03:11:32.910478+0000","last_fullsized":"2024-09-17T03:11:32.910478+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:43.410521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882592+0000","last_change":"2024-09-17T03:11:30.882592+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882592+0000","last_undegraded":"2024-09-17T03:11:30.882592+0000","last_fullsized":"2024-09-17T03:11:30.882592+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.883152+0000","last_change":"2024-09-17T03:11:30.883152+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.883152+0000","last_undegraded":"2024-09-17T03:11:30.883152+0000","last_fullsized":"2024-09-17T03:11:30.883152+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910356+0000","last_change":"2024-09-17T03:11:32.907947+0000","last_active":"2024-09-17T03:11:32.910356+0000","last_peered":"2024-09-17T03:11:32.910356+0000","last_clean":"2024-09-17T03:11:32.910356+0000","last_became_active":"2024-09-17T03:11:32.907490+0000","last_became_peered":"2024-09-17T03:11:32.907490+0000","last_unstale":"2024-09-17T03:11:32.910356+0000","last_undegraded":"2024-09-17T03:11:32.910356+0000","last_fullsized":"2024-09-17T03:11:32.910356+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:10.734398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.884803+0000","last_change":"2024-09-17T03:11:30.884803+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.884803+0000","last_undegraded":"2024-09-17T03:11:30.884803+0000","last_fullsized":"2024-09-17T03:11:30.884803+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.917888+0000","last_change":"2024-09-17T03:11:32.913233+0000","last_active":"2024-09-17T03:11:32.917888+0000","last_peered":"2024-09-17T03:11:32.917888+0000","last_clean":"2024-09-17T03:11:32.917888+0000","last_became_active":"2024-09-17T03:11:32.911876+0000","last_became_peered":"2024-09-17T03:11:32.911876+0000","last_unstale":"2024-09-17T03:11:32.917888+0000","last_undegraded":"2024-09-17T03:11:32.917888+0000","last_fullsized":"2024-09-17T03:11:32.917888+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:27.428278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882569+0000","last_change":"2024-09-17T03:11:30.882569+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882569+0000","last_undegraded":"2024-09-17T03:11:30.882569+0000","last_fullsized":"2024-09-17T03:11:30.882569+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.883039+0000","last_change":"2024-09-17T03:11:30.883039+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.883039+0000","last_undegraded":"2024-09-17T03:11:30.883039+0000","last_fullsized":"2024-09-17T03:11:30.883039+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.915985+0000","last_change":"2024-09-17T03:11:32.911245+0000","last_active":"2024-09-17T03:11:32.915985+0000","last_peered":"2024-09-17T03:11:32.915985+0000","last_clean":"2024-09-17T03:11:32.915985+0000","last_became_active":"2024-09-17T03:11:32.908833+0000","last_became_peered":"2024-09-17T03:11:32.908833+0000","last_unstale":"2024-09-17T03:11:32.915985+0000","last_undegraded":"2024-09-17T03:11:32.915985+0000","last_fullsized":"2024-09-17T03:11:32.915985+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:43.107515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.884726+0000","last_change":"2024-09-17T03:11:30.884726+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.884726+0000","last_undegraded":"2024-09-17T03:11:30.884726+0000","last_fullsized":"2024-09-17T03:11:30.884726+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.879834+0000","last_change":"2024-09-17T03:11:30.879834+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.879834+0000","last_undegraded":"2024-09-17T03:11:30.879834+0000","last_fullsized":"2024-09-17T03:11:30.879834+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.897618+0000","last_change":"2024-09-17T03:11:31.909804+0000","last_active":"2024-09-17T03:11:32.897618+0000","last_peered":"2024-09-17T03:11:32.897618+0000","last_clean":"2024-09-17T03:11:32.897618+0000","last_became_active":"2024-09-17T03:11:31.909381+0000","last_became_peered":"2024-09-17T03:11:31.909381+0000","last_unstale":"2024-09-17T03:11:32.897618+0000","last_undegraded":"2024-09-17T03:11:32.897618+0000","last_fullsized":"2024-09-17T03:11:32.897618+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:40.927693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.879870+0000","last_change":"2024-09-17T03:11:30.879870+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.879870+0000","last_undegraded":"2024-09-17T03:11:30.879870+0000","last_fullsized":"2024-09-17T03:11:30.879870+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.884395+0000","last_change":"2024-09-17T03:11:30.884395+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.884395+0000","last_undegraded":"2024-09-17T03:11:30.884395+0000","last_fullsized":"2024-09-17T03:11:30.884395+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.912022+0000","last_change":"2024-09-17T03:11:31.911919+0000","last_active":"2024-09-17T03:11:32.912022+0000","last_peered":"2024-09-17T03:11:32.912022+0000","last_clean":"2024-09-17T03:11:32.912022+0000","last_became_active":"2024-09-17T03:11:31.911544+0000","last_became_peered":"2024-09-17T03:11:31.911544+0000","last_unstale":"2024-09-17T03:11:32.912022+0000","last_undegraded":"2024-09-17T03:11:32.912022+0000","last_fullsized":"2024-09-17T03:11:32.912022+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:41.728594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.888080+0000","last_change":"2024-09-17T03:11:30.888080+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.888080+0000","last_undegraded":"2024-09-17T03:11:30.888080+0000","last_fullsized":"2024-09-17T03:11:30.888080+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882367+0000","last_change":"2024-09-17T03:11:30.882367+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882367+0000","last_undegraded":"2024-09-17T03:11:30.882367+0000","last_fullsized":"2024-09-17T03:11:30.882367+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.879877+0000","last_change":"2024-09-17T03:11:30.879877+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.879877+0000","last_undegraded":"2024-09-17T03:11:30.879877+0000","last_fullsized":"2024-09-17T03:11:30.879877+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.907321+0000","last_change":"2024-09-17T03:11:31.911865+0000","last_active":"2024-09-17T03:11:32.907321+0000","last_peered":"2024-09-17T03:11:32.907321+0000","last_clean":"2024-09-17T03:11:32.907321+0000","last_became_active":"2024-09-17T03:11:31.911483+0000","last_became_peered":"2024-09-17T03:11:31.911483+0000","last_unstale":"2024-09-17T03:11:32.907321+0000","last_undegraded":"2024-09-17T03:11:32.907321+0000","last_fullsized":"2024-09-17T03:11:32.907321+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:00.238987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.883349+0000","last_change":"2024-09-17T03:11:30.883349+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.883349+0000","last_undegraded":"2024-09-17T03:11:30.883349+0000","last_fullsized":"2024-09-17T03:11:30.883349+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.917447+0000","last_change":"2024-09-17T03:11:32.916040+0000","last_active":"2024-09-17T03:11:32.917447+0000","last_peered":"2024-09-17T03:11:32.917447+0000","last_clean":"2024-09-17T03:11:32.917447+0000","last_became_active":"2024-09-17T03:11:32.915733+0000","last_became_peered":"2024-09-17T03:11:32.915733+0000","last_unstale":"2024-09-17T03:11:32.917447+0000","last_undegraded":"2024-09-17T03:11:32.917447+0000","last_fullsized":"2024-09-17T03:11:32.917447+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:30.159445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882380+0000","last_change":"2024-09-17T03:11:30.882380+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882380+0000","last_undegraded":"2024-09-17T03:11:30.882380+0000","last_fullsized":"2024-09-17T03:11:30.882380+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882640+0000","last_change":"2024-09-17T03:11:30.882640+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882640+0000","last_undegraded":"2024-09-17T03:11:30.882640+0000","last_fullsized":"2024-09-17T03:11:30.882640+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.912090+0000","last_change":"2024-09-17T03:11:31.909356+0000","last_active":"2024-09-17T03:11:32.912090+0000","last_peered":"2024-09-17T03:11:32.912090+0000","last_clean":"2024-09-17T03:11:32.912090+0000","last_became_active":"2024-09-17T03:11:31.908876+0000","last_became_peered":"2024-09-17T03:11:31.908876+0000","last_unstale":"2024-09-17T03:11:32.912090+0000","last_undegraded":"2024-09-17T03:11:32.912090+0000","last_fullsized":"2024-09-17T03:11:32.912090+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:35.023225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882661+0000","last_change":"2024-09-17T03:11:30.882661+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882661+0000","last_undegraded":"2024-09-17T03:11:30.882661+0000","last_fullsized":"2024-09-17T03:11:30.882661+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882327+0000","last_change":"2024-09-17T03:11:30.882327+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882327+0000","last_undegraded":"2024-09-17T03:11:30.882327+0000","last_fullsized":"2024-09-17T03:11:30.882327+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882338+0000","last_change":"2024-09-17T03:11:30.882338+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882338+0000","last_undegraded":"2024-09-17T03:11:30.882338+0000","last_fullsized":"2024-09-17T03:11:30.882338+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882765+0000","last_change":"2024-09-17T03:11:30.882765+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882765+0000","last_undegraded":"2024-09-17T03:11:30.882765+0000","last_fullsized":"2024-09-17T03:11:30.882765+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.888097+0000","last_change":"2024-09-17T03:11:30.888097+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.888097+0000","last_undegraded":"2024-09-17T03:11:30.888097+0000","last_fullsized":"2024-09-17T03:11:30.888097+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882420+0000","last_change":"2024-09-17T03:11:30.882420+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882420+0000","last_undegraded":"2024-09-17T03:11:30.882420+0000","last_fullsized":"2024-09-17T03:11:30.882420+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910328+0000","last_change":"2024-09-17T03:11:32.907821+0000","last_active":"2024-09-17T03:11:32.910328+0000","last_peered":"2024-09-17T03:11:32.910328+0000","last_clean":"2024-09-17T03:11:32.910328+0000","last_became_active":"2024-09-17T03:11:32.907272+0000","last_became_peered":"2024-09-17T03:11:32.907272+0000","last_unstale":"2024-09-17T03:11:32.910328+0000","last_undegraded":"2024-09-17T03:11:32.910328+0000","last_fullsized":"2024-09-17T03:11:32.910328+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:34.186429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.883420+0000","last_change":"2024-09-17T03:11:30.883420+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.883420+0000","last_undegraded":"2024-09-17T03:11:30.883420+0000","last_fullsized":"2024-09-17T03:11:30.883420+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.884474+0000","last_change":"2024-09-17T03:11:30.884474+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.884474+0000","last_undegraded":"2024-09-17T03:11:30.884474+0000","last_fullsized":"2024-09-17T03:11:30.884474+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882324+0000","last_change":"2024-09-17T03:11:30.882324+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882324+0000","last_undegraded":"2024-09-17T03:11:30.882324+0000","last_fullsized":"2024-09-17T03:11:30.882324+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.915954+0000","last_change":"2024-09-17T03:11:32.908829+0000","last_active":"2024-09-17T03:11:32.915954+0000","last_peered":"2024-09-17T03:11:32.915954+0000","last_clean":"2024-09-17T03:11:32.915954+0000","last_became_active":"2024-09-17T03:11:32.908529+0000","last_became_peered":"2024-09-17T03:11:32.908529+0000","last_unstale":"2024-09-17T03:11:32.915954+0000","last_undegraded":"2024-09-17T03:11:32.915954+0000","last_fullsized":"2024-09-17T03:11:32.915954+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:28.383364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.899323+0000","last_change":"2024-09-17T03:11:31.909911+0000","last_active":"2024-09-17T03:11:32.899323+0000","last_peered":"2024-09-17T03:11:32.899323+0000","last_clean":"2024-09-17T03:11:32.899323+0000","last_became_active":"2024-09-17T03:11:31.909497+0000","last_became_peered":"2024-09-17T03:11:31.909497+0000","last_unstale":"2024-09-17T03:11:32.899323+0000","last_undegraded":"2024-09-17T03:11:32.899323+0000","last_fullsized":"2024-09-17T03:11:32.899323+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:32.685040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.917013+0000","last_change":"2024-09-17T03:11:32.909203+0000","last_active":"2024-09-17T03:11:32.917013+0000","last_peered":"2024-09-17T03:11:32.917013+0000","last_clean":"2024-09-17T03:11:32.917013+0000","last_became_active":"2024-09-17T03:11:32.908643+0000","last_became_peered":"2024-09-17T03:11:32.908643+0000","last_unstale":"2024-09-17T03:11:32.917013+0000","last_undegraded":"2024-09-17T03:11:32.917013+0000","last_fullsized":"2024-09-17T03:11:32.917013+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:06.406120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.888080+0000","last_change":"2024-09-17T03:11:30.888080+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.888080+0000","last_undegraded":"2024-09-17T03:11:30.888080+0000","last_fullsized":"2024-09-17T03:11:30.888080+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":168,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-17T03:11:30.880358+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:11:30.880358+0000","last_peered":"2024-09-17T03:11:30.880358+0000","last_clean":"2024-09-17T03:11:30.880358+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:11:30.880358+0000","last_undegraded":"2024-09-17T03:11:30.880358+0000","last_fullsized":"2024-09-17T03:11:30.880358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":1},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1232896,"data_stored":851050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":638976,"data_stored":260682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":260682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":638976,"data_stored":260682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":260682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":266499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1245184,"data_stored":856867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":684032,"data_stored":279597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:11:36.261 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:11:36.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.414+0000 7feb9018a640 1 -- 172.21.15.78:0/2078153462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb880cf320 msgr2=0x7feb880ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:36.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.414+0000 7feb9018a640 1 --2- 172.21.15.78:0/2078153462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb880cf320 0x7feb880ccbc0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7feb78005fd0 tx=0x7feb7802a670 comp rx=0 tx=0).stop 2024-09-17T03:11:36.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.414+0000 7feb9018a640 1 -- 172.21.15.78:0/2078153462 shutdown_connections 2024-09-17T03:11:36.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.414+0000 7feb9018a640 1 --2- 172.21.15.78:0/2078153462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb880cf320 0x7feb880ccbc0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:36.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.414+0000 7feb9018a640 1 -- 172.21.15.78:0/2078153462 >> 172.21.15.78:0/2078153462 conn(0x7feb8806d4f0 msgr2=0x7feb88071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:36.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.414+0000 7feb9018a640 1 -- 172.21.15.78:0/2078153462 shutdown_connections 2024-09-17T03:11:36.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.414+0000 7feb9018a640 1 -- 172.21.15.78:0/2078153462 wait complete. 2024-09-17T03:11:36.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.415+0000 7feb9018a640 1 Processor -- start 2024-09-17T03:11:36.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.415+0000 7feb9018a640 1 -- start start 2024-09-17T03:11:36.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.417+0000 7feb9018a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb880b7cc0 0x7feb881f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.417+0000 7feb9018a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb880cf320 0x7feb880c83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.417+0000 7feb9018a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb881600b0 0x7feb880c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.417+0000 7feb9018a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feb880d15b0 con 0x7feb880b7cc0 2024-09-17T03:11:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.417+0000 7feb9018a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7feb880d1430 con 0x7feb881600b0 2024-09-17T03:11:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.417+0000 7feb9018a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7feb880d1730 con 0x7feb880cf320 2024-09-17T03:11:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.417+0000 7feb8df26640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb880b7cc0 0x7feb881f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.417+0000 7feb8df26640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb880b7cc0 0x7feb881f4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50780/0 (socket says 172.21.15.78:50780) 2024-09-17T03:11:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.417+0000 7feb8df26640 1 -- 172.21.15.78:0/1913738454 learned_addr learned my addr 172.21.15.78:0/1913738454 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.417+0000 7feb8e727640 1 --2- 172.21.15.78:0/1913738454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb881600b0 0x7feb880c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.417+0000 7feb8d725640 1 --2- 172.21.15.78:0/1913738454 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb880cf320 0x7feb880c83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.417+0000 7feb8df26640 1 -- 172.21.15.78:0/1913738454 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb880cf320 msgr2=0x7feb880c83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.417+0000 7feb8df26640 1 --2- 172.21.15.78:0/1913738454 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb880cf320 0x7feb880c83f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:36.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.417+0000 7feb8df26640 1 -- 172.21.15.78:0/1913738454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb881600b0 msgr2=0x7feb880c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:36.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.417+0000 7feb8df26640 1 --2- 172.21.15.78:0/1913738454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb881600b0 0x7feb880c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:36.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.417+0000 7feb8df26640 1 -- 172.21.15.78:0/1913738454 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb880c8930 con 0x7feb880b7cc0 2024-09-17T03:11:36.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.417+0000 7feb8df26640 1 --2- 172.21.15.78:0/1913738454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb880b7cc0 0x7feb881f4560 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7feb8400c400 tx=0x7feb8400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:36.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.417+0000 7feb7e7fc640 1 -- 172.21.15.78:0/1913738454 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb84017070 con 0x7feb880b7cc0 2024-09-17T03:11:36.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.417+0000 7feb7e7fc640 1 -- 172.21.15.78:0/1913738454 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb840053c0 con 0x7feb880b7cc0 2024-09-17T03:11:36.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.417+0000 7feb9018a640 1 -- 172.21.15.78:0/1913738454 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb880b5b10 con 0x7feb880b7cc0 2024-09-17T03:11:36.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.418+0000 7feb7e7fc640 1 -- 172.21.15.78:0/1913738454 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb84003850 con 0x7feb880b7cc0 2024-09-17T03:11:36.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.418+0000 7feb9018a640 1 -- 172.21.15.78:0/1913738454 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb881f79a0 con 0x7feb880b7cc0 2024-09-17T03:11:36.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.419+0000 7feb9018a640 1 -- 172.21.15.78:0/1913738454 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb8815ad80 con 0x7feb880b7cc0 2024-09-17T03:11:36.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.419+0000 7feb7e7fc640 1 -- 172.21.15.78:0/1913738454 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feb8401a070 con 0x7feb880b7cc0 2024-09-17T03:11:36.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.420+0000 7feb7e7fc640 1 --2- 172.21.15.78:0/1913738454 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feb6c078bc0 0x7feb6c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:36.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.420+0000 7feb7e7fc640 1 -- 172.21.15.78:0/1913738454 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7feb8409a060 con 0x7feb880b7cc0 2024-09-17T03:11:36.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.420+0000 7feb8d725640 1 --2- 172.21.15.78:0/1913738454 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feb6c078bc0 0x7feb6c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:36.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.421+0000 7feb8d725640 1 --2- 172.21.15.78:0/1913738454 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feb6c078bc0 0x7feb6c07b0d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7feb78033000 tx=0x7feb78004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:36.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.425+0000 7feb7e7fc640 1 -- 172.21.15.78:0/1913738454 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feb8815ad80 con 0x7feb880b7cc0 2024-09-17T03:11:36.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.594+0000 7feb9018a640 1 -- 172.21.15.78:0/1913738454 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feb880ccbc0 con 0x7feb6c078bc0 2024-09-17T03:11:36.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.599+0000 7feb7e7fc640 1 -- 172.21.15.78:0/1913738454 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242080 (secure 0 0 0) 0x7feb880ccbc0 con 0x7feb6c078bc0 2024-09-17T03:11:36.599 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:36.600 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:11:36.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.601+0000 7feb9018a640 1 -- 172.21.15.78:0/1913738454 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feb6c078bc0 msgr2=0x7feb6c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:36.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.602+0000 7feb9018a640 1 --2- 172.21.15.78:0/1913738454 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feb6c078bc0 0x7feb6c07b0d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7feb78033000 tx=0x7feb78004730 comp rx=0 tx=0).stop 2024-09-17T03:11:36.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.602+0000 7feb9018a640 1 -- 172.21.15.78:0/1913738454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb880b7cc0 msgr2=0x7feb881f4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:36.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.602+0000 7feb9018a640 1 --2- 172.21.15.78:0/1913738454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb880b7cc0 0x7feb881f4560 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7feb8400c400 tx=0x7feb8400c8c0 comp rx=0 tx=0).stop 2024-09-17T03:11:36.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.602+0000 7feb9018a640 1 -- 172.21.15.78:0/1913738454 shutdown_connections 2024-09-17T03:11:36.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.602+0000 7feb9018a640 1 --2- 172.21.15.78:0/1913738454 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feb6c078bc0 0x7feb6c07b0d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:36.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.602+0000 7feb9018a640 1 --2- 172.21.15.78:0/1913738454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb881600b0 0x7feb880c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:36.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.602+0000 7feb9018a640 1 --2- 172.21.15.78:0/1913738454 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb880cf320 0x7feb880c83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:36.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.602+0000 7feb9018a640 1 --2- 172.21.15.78:0/1913738454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb880b7cc0 0x7feb881f4560 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:36.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.602+0000 7feb9018a640 1 -- 172.21.15.78:0/1913738454 >> 172.21.15.78:0/1913738454 conn(0x7feb8806d4f0 msgr2=0x7feb8815d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:36.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.602+0000 7feb9018a640 1 -- 172.21.15.78:0/1913738454 shutdown_connections 2024-09-17T03:11:36.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.602+0000 7feb9018a640 1 -- 172.21.15.78:0/1913738454 wait complete. 2024-09-17T03:11:36.612 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-09-17T03:11:35.169260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590424,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":106,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":92,"acting":92,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":25,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":230800,"kb_used_data":6220,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743920,"statfs":{"total":773094113280,"available":772857774080,"internally_reserved":0,"allocated":6369280,"data_stored":3296741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.290995"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.918389+0000","last_change":"2024-09-17T03:11:32.916748+0000","last_active":"2024-09-17T03:11:32.918389+0000","last_peered":"2024-09-17T03:11:32.918389+0000","last_clean":"2024-09-17T03:11:32.918389+0000","last_became_active":"2024-09-17T03:11:32.916471+0000","last_became_peered":"2024-09-17T03:11:32.916471+0000","last_unstale":"2024-09-17T03:11:32.918389+0000","last_undegraded":"2024-09-17T03:11:32.918389+0000","last_fullsized":"2024-09-17T03:11:32.918389+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:30.828742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.917052+0000","last_change":"2024-09-17T03:11:32.911313+0000","last_active":"2024-09-17T03:11:32.917052+0000","last_peered":"2024-09-17T03:11:32.917052+0000","last_clean":"2024-09-17T03:11:32.917052+0000","last_became_active":"2024-09-17T03:11:32.910712+0000","last_became_peered":"2024-09-17T03:11:32.910712+0000","last_unstale":"2024-09-17T03:11:32.917052+0000","last_undegraded":"2024-09-17T03:11:32.917052+0000","last_fullsized":"2024-09-17T03:11:32.917052+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:15.286661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910352+0000","last_change":"2024-09-17T03:11:32.907186+0000","last_active":"2024-09-17T03:11:32.910352+0000","last_peered":"2024-09-17T03:11:32.910352+0000","last_clean":"2024-09-17T03:11:32.910352+0000","last_became_active":"2024-09-17T03:11:32.904919+0000","last_became_peered":"2024-09-17T03:11:32.904919+0000","last_unstale":"2024-09-17T03:11:32.910352+0000","last_undegraded":"2024-09-17T03:11:32.910352+0000","last_fullsized":"2024-09-17T03:11:32.910352+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:36.666178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910437+0000","last_change":"2024-09-17T03:11:32.906705+0000","last_active":"2024-09-17T03:11:32.910437+0000","last_peered":"2024-09-17T03:11:32.910437+0000","last_clean":"2024-09-17T03:11:32.910437+0000","last_became_active":"2024-09-17T03:11:32.904796+0000","last_became_peered":"2024-09-17T03:11:32.904796+0000","last_unstale":"2024-09-17T03:11:32.910437+0000","last_undegraded":"2024-09-17T03:11:32.910437+0000","last_fullsized":"2024-09-17T03:11:32.910437+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:14.944063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910380+0000","last_change":"2024-09-17T03:11:32.908150+0000","last_active":"2024-09-17T03:11:32.910380+0000","last_peered":"2024-09-17T03:11:32.910380+0000","last_clean":"2024-09-17T03:11:32.910380+0000","last_became_active":"2024-09-17T03:11:32.907642+0000","last_became_peered":"2024-09-17T03:11:32.907642+0000","last_unstale":"2024-09-17T03:11:32.910380+0000","last_undegraded":"2024-09-17T03:11:32.910380+0000","last_fullsized":"2024-09-17T03:11:32.910380+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:29.733804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.917918+0000","last_change":"2024-09-17T03:11:32.914928+0000","last_active":"2024-09-17T03:11:32.917918+0000","last_peered":"2024-09-17T03:11:32.917918+0000","last_clean":"2024-09-17T03:11:32.917918+0000","last_became_active":"2024-09-17T03:11:32.914607+0000","last_became_peered":"2024-09-17T03:11:32.914607+0000","last_unstale":"2024-09-17T03:11:32.917918+0000","last_undegraded":"2024-09-17T03:11:32.917918+0000","last_fullsized":"2024-09-17T03:11:32.917918+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:09.590948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882985+0000","last_change":"2024-09-17T03:11:30.882985+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882985+0000","last_undegraded":"2024-09-17T03:11:30.882985+0000","last_fullsized":"2024-09-17T03:11:30.882985+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910478+0000","last_change":"2024-09-17T03:11:31.902430+0000","last_active":"2024-09-17T03:11:32.910478+0000","last_peered":"2024-09-17T03:11:32.910478+0000","last_clean":"2024-09-17T03:11:32.910478+0000","last_became_active":"2024-09-17T03:11:31.902103+0000","last_became_peered":"2024-09-17T03:11:31.902103+0000","last_unstale":"2024-09-17T03:11:32.910478+0000","last_undegraded":"2024-09-17T03:11:32.910478+0000","last_fullsized":"2024-09-17T03:11:32.910478+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:43.410521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882592+0000","last_change":"2024-09-17T03:11:30.882592+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882592+0000","last_undegraded":"2024-09-17T03:11:30.882592+0000","last_fullsized":"2024-09-17T03:11:30.882592+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.883152+0000","last_change":"2024-09-17T03:11:30.883152+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.883152+0000","last_undegraded":"2024-09-17T03:11:30.883152+0000","last_fullsized":"2024-09-17T03:11:30.883152+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910356+0000","last_change":"2024-09-17T03:11:32.907947+0000","last_active":"2024-09-17T03:11:32.910356+0000","last_peered":"2024-09-17T03:11:32.910356+0000","last_clean":"2024-09-17T03:11:32.910356+0000","last_became_active":"2024-09-17T03:11:32.907490+0000","last_became_peered":"2024-09-17T03:11:32.907490+0000","last_unstale":"2024-09-17T03:11:32.910356+0000","last_undegraded":"2024-09-17T03:11:32.910356+0000","last_fullsized":"2024-09-17T03:11:32.910356+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:10.734398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.884803+0000","last_change":"2024-09-17T03:11:30.884803+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.884803+0000","last_undegraded":"2024-09-17T03:11:30.884803+0000","last_fullsized":"2024-09-17T03:11:30.884803+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.917888+0000","last_change":"2024-09-17T03:11:32.913233+0000","last_active":"2024-09-17T03:11:32.917888+0000","last_peered":"2024-09-17T03:11:32.917888+0000","last_clean":"2024-09-17T03:11:32.917888+0000","last_became_active":"2024-09-17T03:11:32.911876+0000","last_became_peered":"2024-09-17T03:11:32.911876+0000","last_unstale":"2024-09-17T03:11:32.917888+0000","last_undegraded":"2024-09-17T03:11:32.917888+0000","last_fullsized":"2024-09-17T03:11:32.917888+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:27.428278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882569+0000","last_change":"2024-09-17T03:11:30.882569+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882569+0000","last_undegraded":"2024-09-17T03:11:30.882569+0000","last_fullsized":"2024-09-17T03:11:30.882569+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.883039+0000","last_change":"2024-09-17T03:11:30.883039+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.883039+0000","last_undegraded":"2024-09-17T03:11:30.883039+0000","last_fullsized":"2024-09-17T03:11:30.883039+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.915985+0000","last_change":"2024-09-17T03:11:32.911245+0000","last_active":"2024-09-17T03:11:32.915985+0000","last_peered":"2024-09-17T03:11:32.915985+0000","last_clean":"2024-09-17T03:11:32.915985+0000","last_became_active":"2024-09-17T03:11:32.908833+0000","last_became_peered":"2024-09-17T03:11:32.908833+0000","last_unstale":"2024-09-17T03:11:32.915985+0000","last_undegraded":"2024-09-17T03:11:32.915985+0000","last_fullsized":"2024-09-17T03:11:32.915985+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:43.107515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.884726+0000","last_change":"2024-09-17T03:11:30.884726+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.884726+0000","last_undegraded":"2024-09-17T03:11:30.884726+0000","last_fullsized":"2024-09-17T03:11:30.884726+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.879834+0000","last_change":"2024-09-17T03:11:30.879834+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.879834+0000","last_undegraded":"2024-09-17T03:11:30.879834+0000","last_fullsized":"2024-09-17T03:11:30.879834+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.897618+0000","last_change":"2024-09-17T03:11:31.909804+0000","last_active":"2024-09-17T03:11:32.897618+0000","last_peered":"2024-09-17T03:11:32.897618+0000","last_clean":"2024-09-17T03:11:32.897618+0000","last_became_active":"2024-09-17T03:11:31.909381+0000","last_became_peered":"2024-09-17T03:11:31.909381+0000","last_unstale":"2024-09-17T03:11:32.897618+0000","last_undegraded":"2024-09-17T03:11:32.897618+0000","last_fullsized":"2024-09-17T03:11:32.897618+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:40.927693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.879870+0000","last_change":"2024-09-17T03:11:30.879870+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.879870+0000","last_undegraded":"2024-09-17T03:11:30.879870+0000","last_fullsized":"2024-09-17T03:11:30.879870+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.884395+0000","last_change":"2024-09-17T03:11:30.884395+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.884395+0000","last_undegraded":"2024-09-17T03:11:30.884395+0000","last_fullsized":"2024-09-17T03:11:30.884395+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.912022+0000","last_change":"2024-09-17T03:11:31.911919+0000","last_active":"2024-09-17T03:11:32.912022+0000","last_peered":"2024-09-17T03:11:32.912022+0000","last_clean":"2024-09-17T03:11:32.912022+0000","last_became_active":"2024-09-17T03:11:31.911544+0000","last_became_peered":"2024-09-17T03:11:31.911544+0000","last_unstale":"2024-09-17T03:11:32.912022+0000","last_undegraded":"2024-09-17T03:11:32.912022+0000","last_fullsized":"2024-09-17T03:11:32.912022+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:41.728594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.888080+0000","last_change":"2024-09-17T03:11:30.888080+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.888080+0000","last_undegraded":"2024-09-17T03:11:30.888080+0000","last_fullsized":"2024-09-17T03:11:30.888080+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882367+0000","last_change":"2024-09-17T03:11:30.882367+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882367+0000","last_undegraded":"2024-09-17T03:11:30.882367+0000","last_fullsized":"2024-09-17T03:11:30.882367+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.879877+0000","last_change":"2024-09-17T03:11:30.879877+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.879877+0000","last_undegraded":"2024-09-17T03:11:30.879877+0000","last_fullsized":"2024-09-17T03:11:30.879877+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.907321+0000","last_change":"2024-09-17T03:11:31.911865+0000","last_active":"2024-09-17T03:11:32.907321+0000","last_peered":"2024-09-17T03:11:32.907321+0000","last_clean":"2024-09-17T03:11:32.907321+0000","last_became_active":"2024-09-17T03:11:31.911483+0000","last_became_peered":"2024-09-17T03:11:31.911483+0000","last_unstale":"2024-09-17T03:11:32.907321+0000","last_undegraded":"2024-09-17T03:11:32.907321+0000","last_fullsized":"2024-09-17T03:11:32.907321+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:00.238987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.883349+0000","last_change":"2024-09-17T03:11:30.883349+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.883349+0000","last_undegraded":"2024-09-17T03:11:30.883349+0000","last_fullsized":"2024-09-17T03:11:30.883349+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.917447+0000","last_change":"2024-09-17T03:11:32.916040+0000","last_active":"2024-09-17T03:11:32.917447+0000","last_peered":"2024-09-17T03:11:32.917447+0000","last_clean":"2024-09-17T03:11:32.917447+0000","last_became_active":"2024-09-17T03:11:32.915733+0000","last_became_peered":"2024-09-17T03:11:32.915733+0000","last_unstale":"2024-09-17T03:11:32.917447+0000","last_undegraded":"2024-09-17T03:11:32.917447+0000","last_fullsized":"2024-09-17T03:11:32.917447+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:30.159445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882380+0000","last_change":"2024-09-17T03:11:30.882380+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882380+0000","last_undegraded":"2024-09-17T03:11:30.882380+0000","last_fullsized":"2024-09-17T03:11:30.882380+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882640+0000","last_change":"2024-09-17T03:11:30.882640+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882640+0000","last_undegraded":"2024-09-17T03:11:30.882640+0000","last_fullsized":"2024-09-17T03:11:30.882640+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.912090+0000","last_change":"2024-09-17T03:11:31.909356+0000","last_active":"2024-09-17T03:11:32.912090+0000","last_peered":"2024-09-17T03:11:32.912090+0000","last_clean":"2024-09-17T03:11:32.912090+0000","last_became_active":"2024-09-17T03:11:31.908876+0000","last_became_peered":"2024-09-17T03:11:31.908876+0000","last_unstale":"2024-09-17T03:11:32.912090+0000","last_undegraded":"2024-09-17T03:11:32.912090+0000","last_fullsized":"2024-09-17T03:11:32.912090+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:35.023225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882661+0000","last_change":"2024-09-17T03:11:30.882661+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882661+0000","last_undegraded":"2024-09-17T03:11:30.882661+0000","last_fullsized":"2024-09-17T03:11:30.882661+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882327+0000","last_change":"2024-09-17T03:11:30.882327+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882327+0000","last_undegraded":"2024-09-17T03:11:30.882327+0000","last_fullsized":"2024-09-17T03:11:30.882327+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882338+0000","last_change":"2024-09-17T03:11:30.882338+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882338+0000","last_undegraded":"2024-09-17T03:11:30.882338+0000","last_fullsized":"2024-09-17T03:11:30.882338+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882765+0000","last_change":"2024-09-17T03:11:30.882765+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882765+0000","last_undegraded":"2024-09-17T03:11:30.882765+0000","last_fullsized":"2024-09-17T03:11:30.882765+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.888097+0000","last_change":"2024-09-17T03:11:30.888097+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.888097+0000","last_undegraded":"2024-09-17T03:11:30.888097+0000","last_fullsized":"2024-09-17T03:11:30.888097+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882420+0000","last_change":"2024-09-17T03:11:30.882420+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882420+0000","last_undegraded":"2024-09-17T03:11:30.882420+0000","last_fullsized":"2024-09-17T03:11:30.882420+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910328+0000","last_change":"2024-09-17T03:11:32.907821+0000","last_active":"2024-09-17T03:11:32.910328+0000","last_peered":"2024-09-17T03:11:32.910328+0000","last_clean":"2024-09-17T03:11:32.910328+0000","last_became_active":"2024-09-17T03:11:32.907272+0000","last_became_peered":"2024-09-17T03:11:32.907272+0000","last_unstale":"2024-09-17T03:11:32.910328+0000","last_undegraded":"2024-09-17T03:11:32.910328+0000","last_fullsized":"2024-09-17T03:11:32.910328+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:34.186429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.883420+0000","last_change":"2024-09-17T03:11:30.883420+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.883420+0000","last_undegraded":"2024-09-17T03:11:30.883420+0000","last_fullsized":"2024-09-17T03:11:30.883420+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.884474+0000","last_change":"2024-09-17T03:11:30.884474+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.884474+0000","last_undegraded":"2024-09-17T03:11:30.884474+0000","last_fullsized":"2024-09-17T03:11:30.884474+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:11:31.877437+0000","last_change":"2024-09-17T03:11:31.877437+0000","last_active":"2024-09-17T03:11:31.877437+0000","last_peered":"2024-09-17T03:11:31.877437+0000","last_clean":"2024-09-17T03:11:31.877437+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:31.877437+0000","last_undegraded":"2024-09-17T03:11:31.877437+0000","last_fullsized":"2024-09-17T03:11:31.877437+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.882324+0000","last_change":"2024-09-17T03:11:30.882324+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.882324+0000","last_undegraded":"2024-09-17T03:11:30.882324+0000","last_fullsized":"2024-09-17T03:11:30.882324+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.915954+0000","last_change":"2024-09-17T03:11:32.908829+0000","last_active":"2024-09-17T03:11:32.915954+0000","last_peered":"2024-09-17T03:11:32.915954+0000","last_clean":"2024-09-17T03:11:32.915954+0000","last_became_active":"2024-09-17T03:11:32.908529+0000","last_became_peered":"2024-09-17T03:11:32.908529+0000","last_unstale":"2024-09-17T03:11:32.915954+0000","last_undegraded":"2024-09-17T03:11:32.915954+0000","last_fullsized":"2024-09-17T03:11:32.915954+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:28.383364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.899323+0000","last_change":"2024-09-17T03:11:31.909911+0000","last_active":"2024-09-17T03:11:32.899323+0000","last_peered":"2024-09-17T03:11:32.899323+0000","last_clean":"2024-09-17T03:11:32.899323+0000","last_became_active":"2024-09-17T03:11:31.909497+0000","last_became_peered":"2024-09-17T03:11:31.909497+0000","last_unstale":"2024-09-17T03:11:32.899323+0000","last_undegraded":"2024-09-17T03:11:32.899323+0000","last_fullsized":"2024-09-17T03:11:32.899323+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:32.685040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.917013+0000","last_change":"2024-09-17T03:11:32.909203+0000","last_active":"2024-09-17T03:11:32.917013+0000","last_peered":"2024-09-17T03:11:32.917013+0000","last_clean":"2024-09-17T03:11:32.917013+0000","last_became_active":"2024-09-17T03:11:32.908643+0000","last_became_peered":"2024-09-17T03:11:32.908643+0000","last_unstale":"2024-09-17T03:11:32.917013+0000","last_undegraded":"2024-09-17T03:11:32.917013+0000","last_fullsized":"2024-09-17T03:11:32.917013+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:06.406120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":55,"state":"creating+peering","last_fresh":"2024-09-17T03:11:30.888080+0000","last_change":"2024-09-17T03:11:30.888080+0000","last_active":"2024-09-17T03:11:30.875300+0000","last_peered":"2024-09-17T03:11:30.875300+0000","last_clean":"2024-09-17T03:11:30.875300+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:11:30.888080+0000","last_undegraded":"2024-09-17T03:11:30.888080+0000","last_fullsized":"2024-09-17T03:11:30.888080+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":168,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-09-17T03:11:30.880358+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:11:30.880358+0000","last_peered":"2024-09-17T03:11:30.880358+0000","last_clean":"2024-09-17T03:11:30.880358+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:11:30.880358+0000","last_undegraded":"2024-09-17T03:11:30.880358+0000","last_fullsized":"2024-09-17T03:11:30.880358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":26,"acting":26,"num_store_stats":1},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":56,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28236,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343604,"statfs":{"total":96636764160,"available":96607850496,"internally_reserved":0,"allocated":1232896,"data_stored":851050,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31824,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340016,"statfs":{"total":96636764160,"available":96604176384,"internally_reserved":0,"allocated":638976,"data_stored":260682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":260682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":638976,"data_stored":260682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509484,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27652,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":638976,"data_stored":260682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509483,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":266499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509483,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28248,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343592,"statfs":{"total":96636764160,"available":96607838208,"internally_reserved":0,"allocated":1245184,"data_stored":856867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":684032,"data_stored":279597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:11:36.616 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3f is not active+clean 2024-09-17T03:11:36.616 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.616 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3d is not active+clean 2024-09-17T03:11:36.616 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.616 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3c is not active+clean 2024-09-17T03:11:36.616 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.616 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3b is not active+clean 2024-09-17T03:11:36.616 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.616 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3a is not active+clean 2024-09-17T03:11:36.617 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.617 INFO:tasks.ceph.ceph_manager.ceph:PG 9.39 is not active+clean 2024-09-17T03:11:36.617 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.617 INFO:tasks.ceph.ceph_manager.ceph:PG 9.37 is not active+clean 2024-09-17T03:11:36.617 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.617 INFO:tasks.ceph.ceph_manager.ceph:PG 9.36 is not active+clean 2024-09-17T03:11:36.617 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.617 INFO:tasks.ceph.ceph_manager.ceph:PG 9.35 is not active+clean 2024-09-17T03:11:36.617 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.617 INFO:tasks.ceph.ceph_manager.ceph:PG 9.34 is not active+clean 2024-09-17T03:11:36.617 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.617 INFO:tasks.ceph.ceph_manager.ceph:PG 9.33 is not active+clean 2024-09-17T03:11:36.618 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.618 INFO:tasks.ceph.ceph_manager.ceph:PG 9.32 is not active+clean 2024-09-17T03:11:36.618 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.618 INFO:tasks.ceph.ceph_manager.ceph:PG 9.31 is not active+clean 2024-09-17T03:11:36.618 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.618 INFO:tasks.ceph.ceph_manager.ceph:PG 9.30 is not active+clean 2024-09-17T03:11:36.618 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.618 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2e is not active+clean 2024-09-17T03:11:36.618 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.618 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2d is not active+clean 2024-09-17T03:11:36.618 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.618 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2b is not active+clean 2024-09-17T03:11:36.619 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.619 INFO:tasks.ceph.ceph_manager.ceph:PG 9.29 is not active+clean 2024-09-17T03:11:36.619 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.619 INFO:tasks.ceph.ceph_manager.ceph:PG 9.28 is not active+clean 2024-09-17T03:11:36.619 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.619 INFO:tasks.ceph.ceph_manager.ceph:PG 9.27 is not active+clean 2024-09-17T03:11:36.619 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.619 INFO:tasks.ceph.ceph_manager.ceph:PG 9.26 is not active+clean 2024-09-17T03:11:36.619 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.619 INFO:tasks.ceph.ceph_manager.ceph:PG 9.25 is not active+clean 2024-09-17T03:11:36.619 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.619 INFO:tasks.ceph.ceph_manager.ceph:PG 9.24 is not active+clean 2024-09-17T03:11:36.620 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.620 INFO:tasks.ceph.ceph_manager.ceph:PG 9.22 is not active+clean 2024-09-17T03:11:36.620 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.620 INFO:tasks.ceph.ceph_manager.ceph:PG 9.21 is not active+clean 2024-09-17T03:11:36.620 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.620 INFO:tasks.ceph.ceph_manager.ceph:PG 9.20 is not active+clean 2024-09-17T03:11:36.620 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.620 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1e is not active+clean 2024-09-17T03:11:36.620 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.620 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1f is not active+clean 2024-09-17T03:11:36.620 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.882985+0000', 'last_change': '2024-09-17T03:11:30.882985+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.882985+0000', 'last_undegraded': '2024-09-17T03:11:30.882985+0000', 'last_fullsized': '2024-09-17T03:11:30.882985+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:11:36.621 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1f is not active+clean 2024-09-17T03:11:36.621 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.621 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1c is not active+clean 2024-09-17T03:11:36.621 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.621 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1d is not active+clean 2024-09-17T03:11:36.621 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.882592+0000', 'last_change': '2024-09-17T03:11:30.882592+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.882592+0000', 'last_undegraded': '2024-09-17T03:11:30.882592+0000', 'last_fullsized': '2024-09-17T03:11:30.882592+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:11:36.621 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1d is not active+clean 2024-09-17T03:11:36.621 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.621 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1c is not active+clean 2024-09-17T03:11:36.621 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.883152+0000', 'last_change': '2024-09-17T03:11:30.883152+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.883152+0000', 'last_undegraded': '2024-09-17T03:11:30.883152+0000', 'last_fullsized': '2024-09-17T03:11:30.883152+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:11:36.621 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1b is not active+clean 2024-09-17T03:11:36.622 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.884803+0000', 'last_change': '2024-09-17T03:11:30.884803+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.884803+0000', 'last_undegraded': '2024-09-17T03:11:30.884803+0000', 'last_fullsized': '2024-09-17T03:11:30.884803+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:11:36.622 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1a is not active+clean 2024-09-17T03:11:36.622 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.882569+0000', 'last_change': '2024-09-17T03:11:30.882569+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.882569+0000', 'last_undegraded': '2024-09-17T03:11:30.882569+0000', 'last_fullsized': '2024-09-17T03:11:30.882569+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:11:36.622 INFO:tasks.ceph.ceph_manager.ceph:PG 9.18 is not active+clean 2024-09-17T03:11:36.622 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.622 INFO:tasks.ceph.ceph_manager.ceph:PG 8.19 is not active+clean 2024-09-17T03:11:36.622 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.883039+0000', 'last_change': '2024-09-17T03:11:30.883039+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.883039+0000', 'last_undegraded': '2024-09-17T03:11:30.883039+0000', 'last_fullsized': '2024-09-17T03:11:30.883039+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:11:36.622 INFO:tasks.ceph.ceph_manager.ceph:PG 8.18 is not active+clean 2024-09-17T03:11:36.622 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.884726+0000', 'last_change': '2024-09-17T03:11:30.884726+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.884726+0000', 'last_undegraded': '2024-09-17T03:11:30.884726+0000', 'last_fullsized': '2024-09-17T03:11:30.884726+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:11:36.622 INFO:tasks.ceph.ceph_manager.ceph:PG 9.16 is not active+clean 2024-09-17T03:11:36.622 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.622 INFO:tasks.ceph.ceph_manager.ceph:PG 8.17 is not active+clean 2024-09-17T03:11:36.623 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.879834+0000', 'last_change': '2024-09-17T03:11:30.879834+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.879834+0000', 'last_undegraded': '2024-09-17T03:11:30.879834+0000', 'last_fullsized': '2024-09-17T03:11:30.879834+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:11:36.623 INFO:tasks.ceph.ceph_manager.ceph:PG 9.17 is not active+clean 2024-09-17T03:11:36.623 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.623 INFO:tasks.ceph.ceph_manager.ceph:PG 9.14 is not active+clean 2024-09-17T03:11:36.623 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.623 INFO:tasks.ceph.ceph_manager.ceph:PG 8.15 is not active+clean 2024-09-17T03:11:36.623 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.879870+0000', 'last_change': '2024-09-17T03:11:30.879870+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.879870+0000', 'last_undegraded': '2024-09-17T03:11:30.879870+0000', 'last_fullsized': '2024-09-17T03:11:30.879870+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:11:36.623 INFO:tasks.ceph.ceph_manager.ceph:PG 9.15 is not active+clean 2024-09-17T03:11:36.623 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.623 INFO:tasks.ceph.ceph_manager.ceph:PG 8.14 is not active+clean 2024-09-17T03:11:36.623 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.884395+0000', 'last_change': '2024-09-17T03:11:30.884395+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.884395+0000', 'last_undegraded': '2024-09-17T03:11:30.884395+0000', 'last_fullsized': '2024-09-17T03:11:30.884395+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:11:36.624 INFO:tasks.ceph.ceph_manager.ceph:PG 9.12 is not active+clean 2024-09-17T03:11:36.624 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.624 INFO:tasks.ceph.ceph_manager.ceph:PG 9.13 is not active+clean 2024-09-17T03:11:36.624 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.624 INFO:tasks.ceph.ceph_manager.ceph:PG 8.12 is not active+clean 2024-09-17T03:11:36.624 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.888080+0000', 'last_change': '2024-09-17T03:11:30.888080+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.888080+0000', 'last_undegraded': '2024-09-17T03:11:30.888080+0000', 'last_fullsized': '2024-09-17T03:11:30.888080+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:11:36.624 INFO:tasks.ceph.ceph_manager.ceph:PG 9.10 is not active+clean 2024-09-17T03:11:36.624 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.624 INFO:tasks.ceph.ceph_manager.ceph:PG 8.11 is not active+clean 2024-09-17T03:11:36.624 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.882367+0000', 'last_change': '2024-09-17T03:11:30.882367+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.882367+0000', 'last_undegraded': '2024-09-17T03:11:30.882367+0000', 'last_fullsized': '2024-09-17T03:11:30.882367+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:11:36.624 INFO:tasks.ceph.ceph_manager.ceph:PG 9.11 is not active+clean 2024-09-17T03:11:36.624 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.625 INFO:tasks.ceph.ceph_manager.ceph:PG 8.10 is not active+clean 2024-09-17T03:11:36.625 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.879877+0000', 'last_change': '2024-09-17T03:11:30.879877+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.879877+0000', 'last_undegraded': '2024-09-17T03:11:30.879877+0000', 'last_fullsized': '2024-09-17T03:11:30.879877+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:11:36.625 INFO:tasks.ceph.ceph_manager.ceph:PG 9.e is not active+clean 2024-09-17T03:11:36.625 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.625 INFO:tasks.ceph.ceph_manager.ceph:PG 9.f is not active+clean 2024-09-17T03:11:36.625 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.625 INFO:tasks.ceph.ceph_manager.ceph:PG 8.e is not active+clean 2024-09-17T03:11:36.625 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.883349+0000', 'last_change': '2024-09-17T03:11:30.883349+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.883349+0000', 'last_undegraded': '2024-09-17T03:11:30.883349+0000', 'last_fullsized': '2024-09-17T03:11:30.883349+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:11:36.625 INFO:tasks.ceph.ceph_manager.ceph:PG 8.d is not active+clean 2024-09-17T03:11:36.625 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.882380+0000', 'last_change': '2024-09-17T03:11:30.882380+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.882380+0000', 'last_undegraded': '2024-09-17T03:11:30.882380+0000', 'last_fullsized': '2024-09-17T03:11:30.882380+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:11:36.625 INFO:tasks.ceph.ceph_manager.ceph:PG 9.d is not active+clean 2024-09-17T03:11:36.626 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.626 INFO:tasks.ceph.ceph_manager.ceph:PG 8.c is not active+clean 2024-09-17T03:11:36.626 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.882640+0000', 'last_change': '2024-09-17T03:11:30.882640+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.882640+0000', 'last_undegraded': '2024-09-17T03:11:30.882640+0000', 'last_fullsized': '2024-09-17T03:11:30.882640+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:11:36.626 INFO:tasks.ceph.ceph_manager.ceph:PG 9.a is not active+clean 2024-09-17T03:11:36.626 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.626 INFO:tasks.ceph.ceph_manager.ceph:PG 9.b is not active+clean 2024-09-17T03:11:36.626 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.626 INFO:tasks.ceph.ceph_manager.ceph:PG 8.a is not active+clean 2024-09-17T03:11:36.626 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.882661+0000', 'last_change': '2024-09-17T03:11:30.882661+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.882661+0000', 'last_undegraded': '2024-09-17T03:11:30.882661+0000', 'last_fullsized': '2024-09-17T03:11:30.882661+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:11:36.626 INFO:tasks.ceph.ceph_manager.ceph:PG 9.9 is not active+clean 2024-09-17T03:11:36.626 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.627 INFO:tasks.ceph.ceph_manager.ceph:PG 8.8 is not active+clean 2024-09-17T03:11:36.627 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.882327+0000', 'last_change': '2024-09-17T03:11:30.882327+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.882327+0000', 'last_undegraded': '2024-09-17T03:11:30.882327+0000', 'last_fullsized': '2024-09-17T03:11:30.882327+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:11:36.627 INFO:tasks.ceph.ceph_manager.ceph:PG 9.6 is not active+clean 2024-09-17T03:11:36.627 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.627 INFO:tasks.ceph.ceph_manager.ceph:PG 8.7 is not active+clean 2024-09-17T03:11:36.627 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.882338+0000', 'last_change': '2024-09-17T03:11:30.882338+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.882338+0000', 'last_undegraded': '2024-09-17T03:11:30.882338+0000', 'last_fullsized': '2024-09-17T03:11:30.882338+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:11:36.627 INFO:tasks.ceph.ceph_manager.ceph:PG 9.7 is not active+clean 2024-09-17T03:11:36.627 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.628 INFO:tasks.ceph.ceph_manager.ceph:PG 8.6 is not active+clean 2024-09-17T03:11:36.628 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.882765+0000', 'last_change': '2024-09-17T03:11:30.882765+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.882765+0000', 'last_undegraded': '2024-09-17T03:11:30.882765+0000', 'last_fullsized': '2024-09-17T03:11:30.882765+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:11:36.628 INFO:tasks.ceph.ceph_manager.ceph:PG 9.4 is not active+clean 2024-09-17T03:11:36.628 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.628 INFO:tasks.ceph.ceph_manager.ceph:PG 8.5 is not active+clean 2024-09-17T03:11:36.628 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.888097+0000', 'last_change': '2024-09-17T03:11:30.888097+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.888097+0000', 'last_undegraded': '2024-09-17T03:11:30.888097+0000', 'last_fullsized': '2024-09-17T03:11:30.888097+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:11:36.628 INFO:tasks.ceph.ceph_manager.ceph:PG 9.5 is not active+clean 2024-09-17T03:11:36.628 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.628 INFO:tasks.ceph.ceph_manager.ceph:PG 8.4 is not active+clean 2024-09-17T03:11:36.628 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.882420+0000', 'last_change': '2024-09-17T03:11:30.882420+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.882420+0000', 'last_undegraded': '2024-09-17T03:11:30.882420+0000', 'last_fullsized': '2024-09-17T03:11:30.882420+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:11:36.628 INFO:tasks.ceph.ceph_manager.ceph:PG 8.3 is not active+clean 2024-09-17T03:11:36.628 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.883420+0000', 'last_change': '2024-09-17T03:11:30.883420+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.883420+0000', 'last_undegraded': '2024-09-17T03:11:30.883420+0000', 'last_fullsized': '2024-09-17T03:11:30.883420+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:11:36.629 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3 is not active+clean 2024-09-17T03:11:36.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.629 INFO:tasks.ceph.ceph_manager.ceph:PG 8.2 is not active+clean 2024-09-17T03:11:36.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.884474+0000', 'last_change': '2024-09-17T03:11:30.884474+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.884474+0000', 'last_undegraded': '2024-09-17T03:11:30.884474+0000', 'last_fullsized': '2024-09-17T03:11:30.884474+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:11:36.629 INFO:tasks.ceph.ceph_manager.ceph:PG 9.0 is not active+clean 2024-09-17T03:11:36.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T03:11:31.877437+0000', 'last_change': '2024-09-17T03:11:31.877437+0000', 'last_active': '2024-09-17T03:11:31.877437+0000', 'last_peered': '2024-09-17T03:11:31.877437+0000', 'last_clean': '2024-09-17T03:11:31.877437+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:31.877437+0000', 'last_undegraded': '2024-09-17T03:11:31.877437+0000', 'last_fullsized': '2024-09-17T03:11:31.877437+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:31.877437+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T03:11:36.629 INFO:tasks.ceph.ceph_manager.ceph:PG 8.1 is not active+clean 2024-09-17T03:11:36.629 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.882324+0000', 'last_change': '2024-09-17T03:11:30.882324+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.882324+0000', 'last_undegraded': '2024-09-17T03:11:30.882324+0000', 'last_fullsized': '2024-09-17T03:11:30.882324+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:11:36.630 INFO:tasks.ceph.ceph_manager.ceph:PG 8.9 is not active+clean 2024-09-17T03:11:36.630 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 55, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:11:30.888080+0000', 'last_change': '2024-09-17T03:11:30.888080+0000', 'last_active': '2024-09-17T03:11:30.875300+0000', 'last_peered': '2024-09-17T03:11:30.875300+0000', 'last_clean': '2024-09-17T03:11:30.875300+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:11:30.888080+0000', 'last_undegraded': '2024-09-17T03:11:30.888080+0000', 'last_fullsized': '2024-09-17T03:11:30.888080+0000', 'mapping_epoch': 55, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 55, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'last_clean_scrub_stamp': '2024-09-17T03:11:30.875300+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:11:36.630 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:11:36.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.765+0000 7f25839a1640 1 -- 172.21.15.78:0/3074854218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2568004d40 msgr2=0x7f2568005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:36.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.765+0000 7f25839a1640 1 --2- 172.21.15.78:0/3074854218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2568004d40 0x7f2568005150 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f2574009ed0 tx=0x7f2568005830 comp rx=0 tx=0).stop 2024-09-17T03:11:36.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.765+0000 7f2581f3e640 1 -- 172.21.15.78:0/3074854218 reap_dead start 2024-09-17T03:11:36.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.766+0000 7f25839a1640 1 -- 172.21.15.78:0/3074854218 shutdown_connections 2024-09-17T03:11:36.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.766+0000 7f25839a1640 1 -- 172.21.15.78:0/3074854218 >> 172.21.15.78:0/3074854218 conn(0x7f257c06d550 msgr2=0x7f257c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:36.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.766+0000 7f25839a1640 1 -- 172.21.15.78:0/3074854218 shutdown_connections 2024-09-17T03:11:36.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.766+0000 7f25839a1640 1 -- 172.21.15.78:0/3074854218 wait complete. 2024-09-17T03:11:36.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.767+0000 7f25839a1640 1 Processor -- start 2024-09-17T03:11:36.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.767+0000 7f25839a1640 1 -- start start 2024-09-17T03:11:36.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f25839a1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2568004d40 0x7f257c1f6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:36.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f25839a1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f257c1f7260 0x7f257c15f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:36.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f25839a1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f257c15f5f0 0x7f257c0ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:36.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f25839a1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f257c0b7820 con 0x7f257c1f7260 2024-09-17T03:11:36.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f25839a1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f257c0b76a0 con 0x7f257c15f5f0 2024-09-17T03:11:36.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f25839a1640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f257c0b79a0 con 0x7f2568004d40 2024-09-17T03:11:36.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f2580f3c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f257c1f7260 0x7f257c15f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:36.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f2580f3c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f257c1f7260 0x7f257c15f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50806/0 (socket says 172.21.15.78:50806) 2024-09-17T03:11:36.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f2580f3c640 1 -- 172.21.15.78:0/3828938432 learned_addr learned my addr 172.21.15.78:0/3828938432 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:36.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f258173d640 1 --2- 172.21.15.78:0/3828938432 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2568004d40 0x7f257c1f6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:36.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f2581f3e640 1 --2- 172.21.15.78:0/3828938432 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f257c15f5f0 0x7f257c0ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:36.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f2580f3c640 1 -- 172.21.15.78:0/3828938432 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2568004d40 msgr2=0x7f257c1f6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:36.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f2580f3c640 1 --2- 172.21.15.78:0/3828938432 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2568004d40 0x7f257c1f6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:36.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f2580f3c640 1 -- 172.21.15.78:0/3828938432 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f257c15f5f0 msgr2=0x7f257c0ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:36.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f2580f3c640 1 --2- 172.21.15.78:0/3828938432 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f257c15f5f0 0x7f257c0ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:36.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f2580f3c640 1 -- 172.21.15.78:0/3828938432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f257c15fa00 con 0x7f257c1f7260 2024-09-17T03:11:36.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f2580f3c640 1 --2- 172.21.15.78:0/3828938432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f257c1f7260 0x7f257c15f0b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f256c011a50 tx=0x7f256c011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:36.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f2571ffb640 1 -- 172.21.15.78:0/3828938432 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c01f070 con 0x7f257c1f7260 2024-09-17T03:11:36.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f2571ffb640 1 -- 172.21.15.78:0/3828938432 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f256c012450 con 0x7f257c1f7260 2024-09-17T03:11:36.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f25839a1640 1 -- 172.21.15.78:0/3828938432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f257c1490d0 con 0x7f257c1f7260 2024-09-17T03:11:36.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.769+0000 7f2571ffb640 1 -- 172.21.15.78:0/3828938432 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f256c012880 con 0x7f257c1f7260 2024-09-17T03:11:36.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.770+0000 7f25839a1640 1 -- 172.21.15.78:0/3828938432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f257c1f39f0 con 0x7f257c1f7260 2024-09-17T03:11:36.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.771+0000 7f25839a1640 1 -- 172.21.15.78:0/3828938432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f257c0b7f30 con 0x7f257c1f7260 2024-09-17T03:11:36.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.771+0000 7f2571ffb640 1 -- 172.21.15.78:0/3828938432 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f256c022070 con 0x7f257c1f7260 2024-09-17T03:11:36.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.772+0000 7f2571ffb640 1 --2- 172.21.15.78:0/3828938432 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2560078b90 0x7f256007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:36.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.772+0000 7f2571ffb640 1 -- 172.21.15.78:0/3828938432 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f256c09b8f0 con 0x7f257c1f7260 2024-09-17T03:11:36.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.772+0000 7f258173d640 1 --2- 172.21.15.78:0/3828938432 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2560078b90 0x7f256007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:36.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.773+0000 7f258173d640 1 --2- 172.21.15.78:0/3828938432 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2560078b90 0x7f256007b0a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2578000ff0 tx=0x7f2578000f80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:36.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:36.777+0000 7f2571ffb640 1 -- 172.21.15.78:0/3828938432 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f257c15fa00 con 0x7f257c1f7260 2024-09-17T03:11:37.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.019+0000 7f25839a1640 1 -- 172.21.15.78:0/3828938432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f257c0b55d0 con 0x7f257c1f7260 2024-09-17T03:11:37.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.019+0000 7f2571ffb640 1 -- 172.21.15.78:0/3828938432 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1635 (secure 0 0 0) 0x7f256c0636e0 con 0x7f257c1f7260 2024-09-17T03:11:37.018 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:37.018 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":214,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":58,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":51},{"state_name":"creating+peering","count":26},{"state_name":"active+clean","count":20}],"num_pgs":97,"num_pools":3,"num_objects":6,"data_bytes":590424,"bytes_used":236339200,"bytes_avail":772857774080,"bytes_total":773094113280,"unknown_pgs_ratio":0.52577316761016846,"inactive_pgs_ratio":0.2680412232875824,"write_bytes_sec":1909,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":45,"btime":"2024-09-17T03:11:34:902558+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":6231}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2024-09-17T03:11:25.166719+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:11:37.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.021+0000 7f25839a1640 1 -- 172.21.15.78:0/3828938432 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2560078b90 msgr2=0x7f256007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:37.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.021+0000 7f25839a1640 1 --2- 172.21.15.78:0/3828938432 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2560078b90 0x7f256007b0a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2578000ff0 tx=0x7f2578000f80 comp rx=0 tx=0).stop 2024-09-17T03:11:37.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.021+0000 7f25839a1640 1 -- 172.21.15.78:0/3828938432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f257c1f7260 msgr2=0x7f257c15f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:37.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.021+0000 7f25839a1640 1 --2- 172.21.15.78:0/3828938432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f257c1f7260 0x7f257c15f0b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f256c011a50 tx=0x7f256c011f10 comp rx=0 tx=0).stop 2024-09-17T03:11:37.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.021+0000 7f25839a1640 1 -- 172.21.15.78:0/3828938432 shutdown_connections 2024-09-17T03:11:37.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.021+0000 7f25839a1640 1 --2- 172.21.15.78:0/3828938432 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2560078b90 0x7f256007b0a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:37.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.021+0000 7f25839a1640 1 --2- 172.21.15.78:0/3828938432 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f257c15f5f0 0x7f257c0ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:37.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.021+0000 7f25839a1640 1 --2- 172.21.15.78:0/3828938432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f257c1f7260 0x7f257c15f0b0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:37.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.021+0000 7f25839a1640 1 --2- 172.21.15.78:0/3828938432 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2568004d40 0x7f257c1f6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:37.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.021+0000 7f25839a1640 1 -- 172.21.15.78:0/3828938432 >> 172.21.15.78:0/3828938432 conn(0x7f257c06d550 msgr2=0x7f257c15e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:37.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.022+0000 7f25839a1640 1 -- 172.21.15.78:0/3828938432 shutdown_connections 2024-09-17T03:11:37.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.022+0000 7f25839a1640 1 -- 172.21.15.78:0/3828938432 wait complete. 2024-09-17T03:11:37.031 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:11:37.032 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:11:37.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.145+0000 7f29d6150640 1 -- 172.21.15.78:0/3365285771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29d006e0e0 msgr2=0x7f29d006e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:37.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.145+0000 7f29d6150640 1 --2- 172.21.15.78:0/3365285771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29d006e0e0 0x7f29d006e4f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f29d008d160 tx=0x7f29c802a5f0 comp rx=0 tx=0).stop 2024-09-17T03:11:37.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.145+0000 7f29d6150640 1 -- 172.21.15.78:0/3365285771 shutdown_connections 2024-09-17T03:11:37.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.145+0000 7f29d6150640 1 --2- 172.21.15.78:0/3365285771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29d006e0e0 0x7f29d006e4f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:37.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.145+0000 7f29d6150640 1 --2- 172.21.15.78:0/3365285771 >> v2:172.21.15.193:3300/0 conn(0x7f29d00b9970 0x7f29d00b3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:37.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.145+0000 7f29d6150640 1 -- 172.21.15.78:0/3365285771 >> 172.21.15.78:0/3365285771 conn(0x7f29d009d7f0 msgr2=0x7f29d00d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:37.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.145+0000 7f29d6150640 1 -- 172.21.15.78:0/3365285771 shutdown_connections 2024-09-17T03:11:37.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.145+0000 7f29d6150640 1 -- 172.21.15.78:0/3365285771 wait complete. 2024-09-17T03:11:37.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.147+0000 7f29d6150640 1 Processor -- start 2024-09-17T03:11:37.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.147+0000 7f29d6150640 1 -- start start 2024-09-17T03:11:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.148+0000 7f29d6150640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29d006e0e0 0x7f29d01f6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.148+0000 7f29d6150640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f29d00b5fa0 0x7f29d01e6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.148+0000 7f29d6150640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29d00b9970 0x7f29d00c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.148+0000 7f29d6150640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f29d006ea30 con 0x7f29d006e0e0 2024-09-17T03:11:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.148+0000 7f29d6150640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f29d00d5010 con 0x7f29d00b9970 2024-09-17T03:11:37.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.148+0000 7f29d6150640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f29d006ebb0 con 0x7f29d00b5fa0 2024-09-17T03:11:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.148+0000 7f29cf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29d006e0e0 0x7f29d01f6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.148+0000 7f29cf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29d006e0e0 0x7f29d01f6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50814/0 (socket says 172.21.15.78:50814) 2024-09-17T03:11:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.148+0000 7f29cf7fe640 1 -- 172.21.15.78:0/2689496749 learned_addr learned my addr 172.21.15.78:0/2689496749 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.149+0000 7f29cffff640 1 --2- 172.21.15.78:0/2689496749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29d00b9970 0x7f29d00c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.149+0000 7f29cf7fe640 1 -- 172.21.15.78:0/2689496749 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f29d00b5fa0 msgr2=0x7f29d01e6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.149+0000 7f29cf7fe640 1 --2- 172.21.15.78:0/2689496749 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f29d00b5fa0 0x7f29d01e6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.149+0000 7f29cf7fe640 1 -- 172.21.15.78:0/2689496749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29d00b9970 msgr2=0x7f29d00c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.149+0000 7f29cf7fe640 1 --2- 172.21.15.78:0/2689496749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29d00b9970 0x7f29d00c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.149+0000 7f29cf7fe640 1 -- 172.21.15.78:0/2689496749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d01f6570 con 0x7f29d006e0e0 2024-09-17T03:11:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.149+0000 7f29cffff640 1 --2- 172.21.15.78:0/2689496749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29d00b9970 0x7f29d00c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.149+0000 7f29cf7fe640 1 --2- 172.21.15.78:0/2689496749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29d006e0e0 0x7f29d01f6030 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f29c000da50 tx=0x7f29c000df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.149+0000 7f29b7fff640 1 -- 172.21.15.78:0/2689496749 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c0017070 con 0x7f29d006e0e0 2024-09-17T03:11:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.149+0000 7f29b7fff640 1 -- 172.21.15.78:0/2689496749 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29c0010460 con 0x7f29d006e0e0 2024-09-17T03:11:37.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.149+0000 7f29d6150640 1 -- 172.21.15.78:0/2689496749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d01e7010 con 0x7f29d006e0e0 2024-09-17T03:11:37.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.149+0000 7f29b7fff640 1 -- 172.21.15.78:0/2689496749 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c00108b0 con 0x7f29d006e0e0 2024-09-17T03:11:37.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.149+0000 7f29d6150640 1 -- 172.21.15.78:0/2689496749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d01e5d10 con 0x7f29d006e0e0 2024-09-17T03:11:37.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.150+0000 7f29d6150640 1 -- 172.21.15.78:0/2689496749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29d006e4f0 con 0x7f29d006e0e0 2024-09-17T03:11:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.151+0000 7f29b7fff640 1 -- 172.21.15.78:0/2689496749 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f29c001a070 con 0x7f29d006e0e0 2024-09-17T03:11:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.151+0000 7f29b7fff640 1 --2- 172.21.15.78:0/2689496749 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f29bc078bc0 0x7f29bc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.151+0000 7f29b7fff640 1 -- 172.21.15.78:0/2689496749 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f29c009b230 con 0x7f29d006e0e0 2024-09-17T03:11:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.152+0000 7f29ceffd640 1 --2- 172.21.15.78:0/2689496749 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f29bc078bc0 0x7f29bc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:37.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.152+0000 7f29ceffd640 1 --2- 172.21.15.78:0/2689496749 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f29bc078bc0 0x7f29bc07b0d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f29d015e440 tx=0x7f29c4007970 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:37.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.156+0000 7f29b7fff640 1 -- 172.21.15.78:0/2689496749 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f29c0063700 con 0x7f29d006e0e0 2024-09-17T03:11:37.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.327+0000 7f29d6150640 1 -- 172.21.15.78:0/2689496749 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29d00c7df0 con 0x7f29bc078bc0 2024-09-17T03:11:37.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.332+0000 7f29b7fff640 1 -- 172.21.15.78:0/2689496749 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251942 (secure 0 0 0) 0x7f29d00c7df0 con 0x7f29bc078bc0 2024-09-17T03:11:37.333 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:37.335 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:11:37.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.335+0000 7f29d6150640 1 -- 172.21.15.78:0/2689496749 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f29bc078bc0 msgr2=0x7f29bc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:37.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.335+0000 7f29d6150640 1 --2- 172.21.15.78:0/2689496749 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f29bc078bc0 0x7f29bc07b0d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f29d015e440 tx=0x7f29c4007970 comp rx=0 tx=0).stop 2024-09-17T03:11:37.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.335+0000 7f29d6150640 1 -- 172.21.15.78:0/2689496749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29d006e0e0 msgr2=0x7f29d01f6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:37.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.335+0000 7f29d6150640 1 --2- 172.21.15.78:0/2689496749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29d006e0e0 0x7f29d01f6030 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f29c000da50 tx=0x7f29c000df10 comp rx=0 tx=0).stop 2024-09-17T03:11:37.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.335+0000 7f29d6150640 1 -- 172.21.15.78:0/2689496749 shutdown_connections 2024-09-17T03:11:37.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.335+0000 7f29d6150640 1 --2- 172.21.15.78:0/2689496749 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f29bc078bc0 0x7f29bc07b0d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:37.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.335+0000 7f29d6150640 1 --2- 172.21.15.78:0/2689496749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f29d00b9970 0x7f29d00c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:37.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.335+0000 7f29d6150640 1 --2- 172.21.15.78:0/2689496749 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f29d00b5fa0 0x7f29d01e6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:37.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.335+0000 7f29d6150640 1 --2- 172.21.15.78:0/2689496749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29d006e0e0 0x7f29d01f6030 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:37.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.335+0000 7f29d6150640 1 -- 172.21.15.78:0/2689496749 >> 172.21.15.78:0/2689496749 conn(0x7f29d009d7f0 msgr2=0x7f29d00cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:37.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.336+0000 7f29d6150640 1 -- 172.21.15.78:0/2689496749 shutdown_connections 2024-09-17T03:11:37.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:37.336+0000 7f29d6150640 1 -- 172.21.15.78:0/2689496749 wait complete. 2024-09-17T03:11:37.345 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-17T03:11:37.169668+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231156,"kb_used_data":6588,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743564,"statfs":{"total":773094113280,"available":772857409536,"internally_reserved":0,"allocated":6746112,"data_stored":3465984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001546"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.904792+0000","last_change":"2024-09-17T03:11:32.915800+0000","last_active":"2024-09-17T03:11:33.904792+0000","last_peered":"2024-09-17T03:11:33.904792+0000","last_clean":"2024-09-17T03:11:33.904792+0000","last_became_active":"2024-09-17T03:11:32.915504+0000","last_became_peered":"2024-09-17T03:11:32.915504+0000","last_unstale":"2024-09-17T03:11:33.904792+0000","last_undegraded":"2024-09-17T03:11:33.904792+0000","last_fullsized":"2024-09-17T03:11:33.904792+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:12.967227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.918389+0000","last_change":"2024-09-17T03:11:32.916748+0000","last_active":"2024-09-17T03:11:32.918389+0000","last_peered":"2024-09-17T03:11:32.918389+0000","last_clean":"2024-09-17T03:11:32.918389+0000","last_became_active":"2024-09-17T03:11:32.916471+0000","last_became_peered":"2024-09-17T03:11:32.916471+0000","last_unstale":"2024-09-17T03:11:32.918389+0000","last_undegraded":"2024-09-17T03:11:32.918389+0000","last_fullsized":"2024-09-17T03:11:32.918389+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:30.828742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267493+0000","last_change":"2024-09-17T03:11:32.911248+0000","last_active":"2024-09-17T03:11:34.267493+0000","last_peered":"2024-09-17T03:11:34.267493+0000","last_clean":"2024-09-17T03:11:34.267493+0000","last_became_active":"2024-09-17T03:11:32.910944+0000","last_became_peered":"2024-09-17T03:11:32.910944+0000","last_unstale":"2024-09-17T03:11:34.267493+0000","last_undegraded":"2024-09-17T03:11:34.267493+0000","last_fullsized":"2024-09-17T03:11:34.267493+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:29.886555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.000310+0000","last_change":"2024-09-17T03:11:32.916492+0000","last_active":"2024-09-17T03:11:34.000310+0000","last_peered":"2024-09-17T03:11:34.000310+0000","last_clean":"2024-09-17T03:11:34.000310+0000","last_became_active":"2024-09-17T03:11:32.914941+0000","last_became_peered":"2024-09-17T03:11:32.914941+0000","last_unstale":"2024-09-17T03:11:34.000310+0000","last_undegraded":"2024-09-17T03:11:34.000310+0000","last_fullsized":"2024-09-17T03:11:34.000310+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:34.805975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.904700+0000","last_change":"2024-09-17T03:11:32.913983+0000","last_active":"2024-09-17T03:11:33.904700+0000","last_peered":"2024-09-17T03:11:33.904700+0000","last_clean":"2024-09-17T03:11:33.904700+0000","last_became_active":"2024-09-17T03:11:32.912539+0000","last_became_peered":"2024-09-17T03:11:32.912539+0000","last_unstale":"2024-09-17T03:11:33.904700+0000","last_undegraded":"2024-09-17T03:11:33.904700+0000","last_fullsized":"2024-09-17T03:11:33.904700+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:02.495575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267795+0000","last_change":"2024-09-17T03:11:32.906283+0000","last_active":"2024-09-17T03:11:34.267795+0000","last_peered":"2024-09-17T03:11:34.267795+0000","last_clean":"2024-09-17T03:11:34.267795+0000","last_became_active":"2024-09-17T03:11:32.905977+0000","last_became_peered":"2024-09-17T03:11:32.905977+0000","last_unstale":"2024-09-17T03:11:34.267795+0000","last_undegraded":"2024-09-17T03:11:34.267795+0000","last_fullsized":"2024-09-17T03:11:34.267795+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:33.339959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.905747+0000","last_change":"2024-09-17T03:11:32.912796+0000","last_active":"2024-09-17T03:11:33.905747+0000","last_peered":"2024-09-17T03:11:33.905747+0000","last_clean":"2024-09-17T03:11:33.905747+0000","last_became_active":"2024-09-17T03:11:32.912411+0000","last_became_peered":"2024-09-17T03:11:32.912411+0000","last_unstale":"2024-09-17T03:11:33.905747+0000","last_undegraded":"2024-09-17T03:11:33.905747+0000","last_fullsized":"2024-09-17T03:11:33.905747+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:57.042506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.917052+0000","last_change":"2024-09-17T03:11:32.911313+0000","last_active":"2024-09-17T03:11:32.917052+0000","last_peered":"2024-09-17T03:11:32.917052+0000","last_clean":"2024-09-17T03:11:32.917052+0000","last_became_active":"2024-09-17T03:11:32.910712+0000","last_became_peered":"2024-09-17T03:11:32.910712+0000","last_unstale":"2024-09-17T03:11:32.917052+0000","last_undegraded":"2024-09-17T03:11:32.917052+0000","last_fullsized":"2024-09-17T03:11:32.917052+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:15.286661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.906342+0000","last_change":"2024-09-17T03:11:32.905612+0000","last_active":"2024-09-17T03:11:33.906342+0000","last_peered":"2024-09-17T03:11:33.906342+0000","last_clean":"2024-09-17T03:11:33.906342+0000","last_became_active":"2024-09-17T03:11:32.904555+0000","last_became_peered":"2024-09-17T03:11:32.904555+0000","last_unstale":"2024-09-17T03:11:33.906342+0000","last_undegraded":"2024-09-17T03:11:33.906342+0000","last_fullsized":"2024-09-17T03:11:33.906342+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:25.657615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267285+0000","last_change":"2024-09-17T03:11:32.895150+0000","last_active":"2024-09-17T03:11:34.267285+0000","last_peered":"2024-09-17T03:11:34.267285+0000","last_clean":"2024-09-17T03:11:34.267285+0000","last_became_active":"2024-09-17T03:11:32.894845+0000","last_became_peered":"2024-09-17T03:11:32.894845+0000","last_unstale":"2024-09-17T03:11:34.267285+0000","last_undegraded":"2024-09-17T03:11:34.267285+0000","last_fullsized":"2024-09-17T03:11:34.267285+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:29.049181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267277+0000","last_change":"2024-09-17T03:11:32.907761+0000","last_active":"2024-09-17T03:11:34.267277+0000","last_peered":"2024-09-17T03:11:34.267277+0000","last_clean":"2024-09-17T03:11:34.267277+0000","last_became_active":"2024-09-17T03:11:32.907411+0000","last_became_peered":"2024-09-17T03:11:32.907411+0000","last_unstale":"2024-09-17T03:11:34.267277+0000","last_undegraded":"2024-09-17T03:11:34.267277+0000","last_fullsized":"2024-09-17T03:11:34.267277+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:31.293651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.999778+0000","last_change":"2024-09-17T03:11:32.905470+0000","last_active":"2024-09-17T03:11:33.999778+0000","last_peered":"2024-09-17T03:11:33.999778+0000","last_clean":"2024-09-17T03:11:33.999778+0000","last_became_active":"2024-09-17T03:11:32.905162+0000","last_became_peered":"2024-09-17T03:11:32.905162+0000","last_unstale":"2024-09-17T03:11:33.999778+0000","last_undegraded":"2024-09-17T03:11:33.999778+0000","last_fullsized":"2024-09-17T03:11:33.999778+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:28.497824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.905749+0000","last_change":"2024-09-17T03:11:32.901622+0000","last_active":"2024-09-17T03:11:33.905749+0000","last_peered":"2024-09-17T03:11:33.905749+0000","last_clean":"2024-09-17T03:11:33.905749+0000","last_became_active":"2024-09-17T03:11:32.901291+0000","last_became_peered":"2024-09-17T03:11:32.901291+0000","last_unstale":"2024-09-17T03:11:33.905749+0000","last_undegraded":"2024-09-17T03:11:33.905749+0000","last_fullsized":"2024-09-17T03:11:33.905749+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:10.921522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.906452+0000","last_change":"2024-09-17T03:11:32.908529+0000","last_active":"2024-09-17T03:11:33.906452+0000","last_peered":"2024-09-17T03:11:33.906452+0000","last_clean":"2024-09-17T03:11:33.906452+0000","last_became_active":"2024-09-17T03:11:32.908194+0000","last_became_peered":"2024-09-17T03:11:32.908194+0000","last_unstale":"2024-09-17T03:11:33.906452+0000","last_undegraded":"2024-09-17T03:11:33.906452+0000","last_fullsized":"2024-09-17T03:11:33.906452+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:16.449177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.906228+0000","last_change":"2024-09-17T03:11:32.900366+0000","last_active":"2024-09-17T03:11:33.906228+0000","last_peered":"2024-09-17T03:11:33.906228+0000","last_clean":"2024-09-17T03:11:33.906228+0000","last_became_active":"2024-09-17T03:11:32.900046+0000","last_became_peered":"2024-09-17T03:11:32.900046+0000","last_unstale":"2024-09-17T03:11:33.906228+0000","last_undegraded":"2024-09-17T03:11:33.906228+0000","last_fullsized":"2024-09-17T03:11:33.906228+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:24.811948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268116+0000","last_change":"2024-09-17T03:11:32.901033+0000","last_active":"2024-09-17T03:11:34.268116+0000","last_peered":"2024-09-17T03:11:34.268116+0000","last_clean":"2024-09-17T03:11:34.268116+0000","last_became_active":"2024-09-17T03:11:32.900714+0000","last_became_peered":"2024-09-17T03:11:32.900714+0000","last_unstale":"2024-09-17T03:11:34.268116+0000","last_undegraded":"2024-09-17T03:11:34.268116+0000","last_fullsized":"2024-09-17T03:11:34.268116+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:25.545131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910352+0000","last_change":"2024-09-17T03:11:32.907186+0000","last_active":"2024-09-17T03:11:32.910352+0000","last_peered":"2024-09-17T03:11:32.910352+0000","last_clean":"2024-09-17T03:11:32.910352+0000","last_became_active":"2024-09-17T03:11:32.904919+0000","last_became_peered":"2024-09-17T03:11:32.904919+0000","last_unstale":"2024-09-17T03:11:32.910352+0000","last_undegraded":"2024-09-17T03:11:32.910352+0000","last_fullsized":"2024-09-17T03:11:32.910352+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:36.666178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267767+0000","last_change":"2024-09-17T03:11:32.909106+0000","last_active":"2024-09-17T03:11:34.267767+0000","last_peered":"2024-09-17T03:11:34.267767+0000","last_clean":"2024-09-17T03:11:34.267767+0000","last_became_active":"2024-09-17T03:11:32.907332+0000","last_became_peered":"2024-09-17T03:11:32.907332+0000","last_unstale":"2024-09-17T03:11:34.267767+0000","last_undegraded":"2024-09-17T03:11:34.267767+0000","last_fullsized":"2024-09-17T03:11:34.267767+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:17.911699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.904807+0000","last_change":"2024-09-17T03:11:32.915816+0000","last_active":"2024-09-17T03:11:33.904807+0000","last_peered":"2024-09-17T03:11:33.904807+0000","last_clean":"2024-09-17T03:11:33.904807+0000","last_became_active":"2024-09-17T03:11:32.915483+0000","last_became_peered":"2024-09-17T03:11:32.915483+0000","last_unstale":"2024-09-17T03:11:33.904807+0000","last_undegraded":"2024-09-17T03:11:33.904807+0000","last_fullsized":"2024-09-17T03:11:33.904807+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:08:23.980496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910437+0000","last_change":"2024-09-17T03:11:32.906705+0000","last_active":"2024-09-17T03:11:32.910437+0000","last_peered":"2024-09-17T03:11:32.910437+0000","last_clean":"2024-09-17T03:11:32.910437+0000","last_became_active":"2024-09-17T03:11:32.904796+0000","last_became_peered":"2024-09-17T03:11:32.904796+0000","last_unstale":"2024-09-17T03:11:32.910437+0000","last_undegraded":"2024-09-17T03:11:32.910437+0000","last_fullsized":"2024-09-17T03:11:32.910437+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:14.944063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267307+0000","last_change":"2024-09-17T03:11:32.912678+0000","last_active":"2024-09-17T03:11:34.267307+0000","last_peered":"2024-09-17T03:11:34.267307+0000","last_clean":"2024-09-17T03:11:34.267307+0000","last_became_active":"2024-09-17T03:11:32.911907+0000","last_became_peered":"2024-09-17T03:11:32.911907+0000","last_unstale":"2024-09-17T03:11:34.267307+0000","last_undegraded":"2024-09-17T03:11:34.267307+0000","last_fullsized":"2024-09-17T03:11:34.267307+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:34.805975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910380+0000","last_change":"2024-09-17T03:11:32.908150+0000","last_active":"2024-09-17T03:11:32.910380+0000","last_peered":"2024-09-17T03:11:32.910380+0000","last_clean":"2024-09-17T03:11:32.910380+0000","last_became_active":"2024-09-17T03:11:32.907642+0000","last_became_peered":"2024-09-17T03:11:32.907642+0000","last_unstale":"2024-09-17T03:11:32.910380+0000","last_undegraded":"2024-09-17T03:11:32.910380+0000","last_fullsized":"2024-09-17T03:11:32.910380+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:29.733804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267348+0000","last_change":"2024-09-17T03:11:32.917872+0000","last_active":"2024-09-17T03:11:34.267348+0000","last_peered":"2024-09-17T03:11:34.267348+0000","last_clean":"2024-09-17T03:11:34.267348+0000","last_became_active":"2024-09-17T03:11:32.917493+0000","last_became_peered":"2024-09-17T03:11:32.917493+0000","last_unstale":"2024-09-17T03:11:34.267348+0000","last_undegraded":"2024-09-17T03:11:34.267348+0000","last_fullsized":"2024-09-17T03:11:34.267348+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:49.603296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.905513+0000","last_change":"2024-09-17T03:11:32.907531+0000","last_active":"2024-09-17T03:11:33.905513+0000","last_peered":"2024-09-17T03:11:33.905513+0000","last_clean":"2024-09-17T03:11:33.905513+0000","last_became_active":"2024-09-17T03:11:32.907228+0000","last_became_peered":"2024-09-17T03:11:32.907228+0000","last_unstale":"2024-09-17T03:11:33.905513+0000","last_undegraded":"2024-09-17T03:11:33.905513+0000","last_fullsized":"2024-09-17T03:11:33.905513+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:27.579154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.905003+0000","last_change":"2024-09-17T03:11:32.919984+0000","last_active":"2024-09-17T03:11:33.905003+0000","last_peered":"2024-09-17T03:11:33.905003+0000","last_clean":"2024-09-17T03:11:33.905003+0000","last_became_active":"2024-09-17T03:11:32.919495+0000","last_became_peered":"2024-09-17T03:11:32.919495+0000","last_unstale":"2024-09-17T03:11:33.905003+0000","last_undegraded":"2024-09-17T03:11:33.905003+0000","last_fullsized":"2024-09-17T03:11:33.905003+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:31.464328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.000439+0000","last_change":"2024-09-17T03:11:32.909585+0000","last_active":"2024-09-17T03:11:34.000439+0000","last_peered":"2024-09-17T03:11:34.000439+0000","last_clean":"2024-09-17T03:11:34.000439+0000","last_became_active":"2024-09-17T03:11:32.909288+0000","last_became_peered":"2024-09-17T03:11:32.909288+0000","last_unstale":"2024-09-17T03:11:34.000439+0000","last_undegraded":"2024-09-17T03:11:34.000439+0000","last_fullsized":"2024-09-17T03:11:34.000439+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:13:36.952044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267793+0000","last_change":"2024-09-17T03:11:32.902027+0000","last_active":"2024-09-17T03:11:34.267793+0000","last_peered":"2024-09-17T03:11:34.267793+0000","last_clean":"2024-09-17T03:11:34.267793+0000","last_became_active":"2024-09-17T03:11:32.901731+0000","last_became_peered":"2024-09-17T03:11:32.901731+0000","last_unstale":"2024-09-17T03:11:34.267793+0000","last_undegraded":"2024-09-17T03:11:34.267793+0000","last_fullsized":"2024-09-17T03:11:34.267793+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:17.042997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.904769+0000","last_change":"2024-09-17T03:11:32.912811+0000","last_active":"2024-09-17T03:11:33.904769+0000","last_peered":"2024-09-17T03:11:33.904769+0000","last_clean":"2024-09-17T03:11:33.904769+0000","last_became_active":"2024-09-17T03:11:32.912530+0000","last_became_peered":"2024-09-17T03:11:32.912530+0000","last_unstale":"2024-09-17T03:11:33.904769+0000","last_undegraded":"2024-09-17T03:11:33.904769+0000","last_fullsized":"2024-09-17T03:11:33.904769+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:27.764920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.917918+0000","last_change":"2024-09-17T03:11:32.914928+0000","last_active":"2024-09-17T03:11:32.917918+0000","last_peered":"2024-09-17T03:11:32.917918+0000","last_clean":"2024-09-17T03:11:32.917918+0000","last_became_active":"2024-09-17T03:11:32.914607+0000","last_became_peered":"2024-09-17T03:11:32.914607+0000","last_unstale":"2024-09-17T03:11:32.917918+0000","last_undegraded":"2024-09-17T03:11:32.917918+0000","last_fullsized":"2024-09-17T03:11:32.917918+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:09.590948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267250+0000","last_change":"2024-09-17T03:11:32.909619+0000","last_active":"2024-09-17T03:11:34.267250+0000","last_peered":"2024-09-17T03:11:34.267250+0000","last_clean":"2024-09-17T03:11:34.267250+0000","last_became_active":"2024-09-17T03:11:32.909307+0000","last_became_peered":"2024-09-17T03:11:32.909307+0000","last_unstale":"2024-09-17T03:11:34.267250+0000","last_undegraded":"2024-09-17T03:11:34.267250+0000","last_fullsized":"2024-09-17T03:11:34.267250+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:53.975656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.904594+0000","last_change":"2024-09-17T03:11:32.912389+0000","last_active":"2024-09-17T03:11:33.904594+0000","last_peered":"2024-09-17T03:11:33.904594+0000","last_clean":"2024-09-17T03:11:33.904594+0000","last_became_active":"2024-09-17T03:11:32.912090+0000","last_became_peered":"2024-09-17T03:11:32.912090+0000","last_unstale":"2024-09-17T03:11:33.904594+0000","last_undegraded":"2024-09-17T03:11:33.904594+0000","last_fullsized":"2024-09-17T03:11:33.904594+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:32.096761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268222+0000","last_change":"2024-09-17T03:11:32.911395+0000","last_active":"2024-09-17T03:11:34.268222+0000","last_peered":"2024-09-17T03:11:34.268222+0000","last_clean":"2024-09-17T03:11:34.268222+0000","last_became_active":"2024-09-17T03:11:32.911051+0000","last_became_peered":"2024-09-17T03:11:32.911051+0000","last_unstale":"2024-09-17T03:11:34.268222+0000","last_undegraded":"2024-09-17T03:11:34.268222+0000","last_fullsized":"2024-09-17T03:11:34.268222+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:07.143292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267676+0000","last_change":"2024-09-17T03:11:32.902385+0000","last_active":"2024-09-17T03:11:34.267676+0000","last_peered":"2024-09-17T03:11:34.267676+0000","last_clean":"2024-09-17T03:11:34.267676+0000","last_became_active":"2024-09-17T03:11:32.902110+0000","last_became_peered":"2024-09-17T03:11:32.902110+0000","last_unstale":"2024-09-17T03:11:34.267676+0000","last_undegraded":"2024-09-17T03:11:34.267676+0000","last_fullsized":"2024-09-17T03:11:34.267676+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:29.886555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267747+0000","last_change":"2024-09-17T03:11:31.906418+0000","last_active":"2024-09-17T03:11:34.267747+0000","last_peered":"2024-09-17T03:11:34.267747+0000","last_clean":"2024-09-17T03:11:34.267747+0000","last_became_active":"2024-09-17T03:11:31.906113+0000","last_became_peered":"2024-09-17T03:11:31.906113+0000","last_unstale":"2024-09-17T03:11:34.267747+0000","last_undegraded":"2024-09-17T03:11:34.267747+0000","last_fullsized":"2024-09-17T03:11:34.267747+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:05.397468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267792+0000","last_change":"2024-09-17T03:11:32.915029+0000","last_active":"2024-09-17T03:11:34.267792+0000","last_peered":"2024-09-17T03:11:34.267792+0000","last_clean":"2024-09-17T03:11:34.267792+0000","last_became_active":"2024-09-17T03:11:32.914035+0000","last_became_peered":"2024-09-17T03:11:32.914035+0000","last_unstale":"2024-09-17T03:11:34.267792+0000","last_undegraded":"2024-09-17T03:11:34.267792+0000","last_fullsized":"2024-09-17T03:11:34.267792+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:06.631734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910478+0000","last_change":"2024-09-17T03:11:31.902430+0000","last_active":"2024-09-17T03:11:32.910478+0000","last_peered":"2024-09-17T03:11:32.910478+0000","last_clean":"2024-09-17T03:11:32.910478+0000","last_became_active":"2024-09-17T03:11:31.902103+0000","last_became_peered":"2024-09-17T03:11:31.902103+0000","last_unstale":"2024-09-17T03:11:32.910478+0000","last_undegraded":"2024-09-17T03:11:32.910478+0000","last_fullsized":"2024-09-17T03:11:32.910478+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:43.410521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267185+0000","last_change":"2024-09-17T03:11:32.905474+0000","last_active":"2024-09-17T03:11:34.267185+0000","last_peered":"2024-09-17T03:11:34.267185+0000","last_clean":"2024-09-17T03:11:34.267185+0000","last_became_active":"2024-09-17T03:11:32.903869+0000","last_became_peered":"2024-09-17T03:11:32.903869+0000","last_unstale":"2024-09-17T03:11:34.267185+0000","last_undegraded":"2024-09-17T03:11:34.267185+0000","last_fullsized":"2024-09-17T03:11:34.267185+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:06.909782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267944+0000","last_change":"2024-09-17T03:11:31.905671+0000","last_active":"2024-09-17T03:11:34.267944+0000","last_peered":"2024-09-17T03:11:34.267944+0000","last_clean":"2024-09-17T03:11:34.267944+0000","last_became_active":"2024-09-17T03:11:31.905141+0000","last_became_peered":"2024-09-17T03:11:31.905141+0000","last_unstale":"2024-09-17T03:11:34.267944+0000","last_undegraded":"2024-09-17T03:11:34.267944+0000","last_fullsized":"2024-09-17T03:11:34.267944+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:33.245594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267873+0000","last_change":"2024-09-17T03:11:32.908602+0000","last_active":"2024-09-17T03:11:34.267873+0000","last_peered":"2024-09-17T03:11:34.267873+0000","last_clean":"2024-09-17T03:11:34.267873+0000","last_became_active":"2024-09-17T03:11:32.908321+0000","last_became_peered":"2024-09-17T03:11:32.908321+0000","last_unstale":"2024-09-17T03:11:34.267873+0000","last_undegraded":"2024-09-17T03:11:34.267873+0000","last_fullsized":"2024-09-17T03:11:34.267873+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:17.911699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.999855+0000","last_change":"2024-09-17T03:11:31.901868+0000","last_active":"2024-09-17T03:11:33.999855+0000","last_peered":"2024-09-17T03:11:33.999855+0000","last_clean":"2024-09-17T03:11:33.999855+0000","last_became_active":"2024-09-17T03:11:31.901286+0000","last_became_peered":"2024-09-17T03:11:31.901286+0000","last_unstale":"2024-09-17T03:11:33.999855+0000","last_undegraded":"2024-09-17T03:11:33.999855+0000","last_fullsized":"2024-09-17T03:11:33.999855+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:33.245594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910356+0000","last_change":"2024-09-17T03:11:32.907947+0000","last_active":"2024-09-17T03:11:32.910356+0000","last_peered":"2024-09-17T03:11:32.910356+0000","last_clean":"2024-09-17T03:11:32.910356+0000","last_became_active":"2024-09-17T03:11:32.907490+0000","last_became_peered":"2024-09-17T03:11:32.907490+0000","last_unstale":"2024-09-17T03:11:32.910356+0000","last_undegraded":"2024-09-17T03:11:32.910356+0000","last_fullsized":"2024-09-17T03:11:32.910356+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:35:10.734398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.906107+0000","last_change":"2024-09-17T03:11:31.902788+0000","last_active":"2024-09-17T03:11:33.906107+0000","last_peered":"2024-09-17T03:11:33.906107+0000","last_clean":"2024-09-17T03:11:33.906107+0000","last_became_active":"2024-09-17T03:11:31.902430+0000","last_became_peered":"2024-09-17T03:11:31.902430+0000","last_unstale":"2024-09-17T03:11:33.906107+0000","last_undegraded":"2024-09-17T03:11:33.906107+0000","last_fullsized":"2024-09-17T03:11:33.906107+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:29.309485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.917888+0000","last_change":"2024-09-17T03:11:32.913233+0000","last_active":"2024-09-17T03:11:32.917888+0000","last_peered":"2024-09-17T03:11:32.917888+0000","last_clean":"2024-09-17T03:11:32.917888+0000","last_became_active":"2024-09-17T03:11:32.911876+0000","last_became_peered":"2024-09-17T03:11:32.911876+0000","last_unstale":"2024-09-17T03:11:32.917888+0000","last_undegraded":"2024-09-17T03:11:32.917888+0000","last_fullsized":"2024-09-17T03:11:32.917888+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:27.428278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267932+0000","last_change":"2024-09-17T03:11:31.893272+0000","last_active":"2024-09-17T03:11:34.267932+0000","last_peered":"2024-09-17T03:11:34.267932+0000","last_clean":"2024-09-17T03:11:34.267932+0000","last_became_active":"2024-09-17T03:11:31.892198+0000","last_became_peered":"2024-09-17T03:11:31.892198+0000","last_unstale":"2024-09-17T03:11:34.267932+0000","last_undegraded":"2024-09-17T03:11:34.267932+0000","last_fullsized":"2024-09-17T03:11:34.267932+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:16.078000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.905697+0000","last_change":"2024-09-17T03:11:32.900601+0000","last_active":"2024-09-17T03:11:33.905697+0000","last_peered":"2024-09-17T03:11:33.905697+0000","last_clean":"2024-09-17T03:11:33.905697+0000","last_became_active":"2024-09-17T03:11:32.900151+0000","last_became_peered":"2024-09-17T03:11:32.900151+0000","last_unstale":"2024-09-17T03:11:33.905697+0000","last_undegraded":"2024-09-17T03:11:33.905697+0000","last_fullsized":"2024-09-17T03:11:33.905697+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:49.063396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.999346+0000","last_change":"2024-09-17T03:11:31.903086+0000","last_active":"2024-09-17T03:11:33.999346+0000","last_peered":"2024-09-17T03:11:33.999346+0000","last_clean":"2024-09-17T03:11:33.999346+0000","last_became_active":"2024-09-17T03:11:31.902762+0000","last_became_peered":"2024-09-17T03:11:31.902762+0000","last_unstale":"2024-09-17T03:11:33.999346+0000","last_undegraded":"2024-09-17T03:11:33.999346+0000","last_fullsized":"2024-09-17T03:11:33.999346+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:06.360388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.915985+0000","last_change":"2024-09-17T03:11:32.911245+0000","last_active":"2024-09-17T03:11:32.915985+0000","last_peered":"2024-09-17T03:11:32.915985+0000","last_clean":"2024-09-17T03:11:32.915985+0000","last_became_active":"2024-09-17T03:11:32.908833+0000","last_became_peered":"2024-09-17T03:11:32.908833+0000","last_unstale":"2024-09-17T03:11:32.915985+0000","last_undegraded":"2024-09-17T03:11:32.915985+0000","last_fullsized":"2024-09-17T03:11:32.915985+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:43.107515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.906650+0000","last_change":"2024-09-17T03:11:31.898616+0000","last_active":"2024-09-17T03:11:33.906650+0000","last_peered":"2024-09-17T03:11:33.906650+0000","last_clean":"2024-09-17T03:11:33.906650+0000","last_became_active":"2024-09-17T03:11:31.898302+0000","last_became_peered":"2024-09-17T03:11:31.898302+0000","last_unstale":"2024-09-17T03:11:33.906650+0000","last_undegraded":"2024-09-17T03:11:33.906650+0000","last_fullsized":"2024-09-17T03:11:33.906650+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:30.291514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.906396+0000","last_change":"2024-09-17T03:11:32.901639+0000","last_active":"2024-09-17T03:11:33.906396+0000","last_peered":"2024-09-17T03:11:33.906396+0000","last_clean":"2024-09-17T03:11:33.906396+0000","last_became_active":"2024-09-17T03:11:32.901291+0000","last_became_peered":"2024-09-17T03:11:32.901291+0000","last_unstale":"2024-09-17T03:11:33.906396+0000","last_undegraded":"2024-09-17T03:11:33.906396+0000","last_fullsized":"2024-09-17T03:11:33.906396+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:11.700438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267690+0000","last_change":"2024-09-17T03:11:31.908308+0000","last_active":"2024-09-17T03:11:34.267690+0000","last_peered":"2024-09-17T03:11:34.267690+0000","last_clean":"2024-09-17T03:11:34.267690+0000","last_became_active":"2024-09-17T03:11:31.908047+0000","last_became_peered":"2024-09-17T03:11:31.908047+0000","last_unstale":"2024-09-17T03:11:34.267690+0000","last_undegraded":"2024-09-17T03:11:34.267690+0000","last_fullsized":"2024-09-17T03:11:34.267690+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:16.078000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267838+0000","last_change":"2024-09-17T03:11:32.919801+0000","last_active":"2024-09-17T03:11:34.267838+0000","last_peered":"2024-09-17T03:11:34.267838+0000","last_clean":"2024-09-17T03:11:34.267838+0000","last_became_active":"2024-09-17T03:11:32.919449+0000","last_became_peered":"2024-09-17T03:11:32.919449+0000","last_unstale":"2024-09-17T03:11:34.267838+0000","last_undegraded":"2024-09-17T03:11:34.267838+0000","last_fullsized":"2024-09-17T03:11:34.267838+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:25.545131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.897618+0000","last_change":"2024-09-17T03:11:31.909804+0000","last_active":"2024-09-17T03:11:32.897618+0000","last_peered":"2024-09-17T03:11:32.897618+0000","last_clean":"2024-09-17T03:11:32.897618+0000","last_became_active":"2024-09-17T03:11:31.909381+0000","last_became_peered":"2024-09-17T03:11:31.909381+0000","last_unstale":"2024-09-17T03:11:32.897618+0000","last_undegraded":"2024-09-17T03:11:32.897618+0000","last_fullsized":"2024-09-17T03:11:32.897618+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:40.927693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267348+0000","last_change":"2024-09-17T03:11:32.896534+0000","last_active":"2024-09-17T03:11:34.267348+0000","last_peered":"2024-09-17T03:11:34.267348+0000","last_clean":"2024-09-17T03:11:34.267348+0000","last_became_active":"2024-09-17T03:11:32.896250+0000","last_became_peered":"2024-09-17T03:11:32.896250+0000","last_unstale":"2024-09-17T03:11:34.267348+0000","last_undegraded":"2024-09-17T03:11:34.267348+0000","last_fullsized":"2024-09-17T03:11:34.267348+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:30.311622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"57'3","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267603+0000","last_change":"2024-09-17T03:11:31.906933+0000","last_active":"2024-09-17T03:11:34.267603+0000","last_peered":"2024-09-17T03:11:34.267603+0000","last_clean":"2024-09-17T03:11:34.267603+0000","last_became_active":"2024-09-17T03:11:31.906633+0000","last_became_peered":"2024-09-17T03:11:31.906633+0000","last_unstale":"2024-09-17T03:11:34.267603+0000","last_undegraded":"2024-09-17T03:11:34.267603+0000","last_fullsized":"2024-09-17T03:11:34.267603+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:05.397468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267526+0000","last_change":"2024-09-17T03:11:32.912135+0000","last_active":"2024-09-17T03:11:34.267526+0000","last_peered":"2024-09-17T03:11:34.267526+0000","last_clean":"2024-09-17T03:11:34.267526+0000","last_became_active":"2024-09-17T03:11:32.911666+0000","last_became_peered":"2024-09-17T03:11:32.911666+0000","last_unstale":"2024-09-17T03:11:34.267526+0000","last_undegraded":"2024-09-17T03:11:34.267526+0000","last_fullsized":"2024-09-17T03:11:34.267526+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:17.042997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"57'6","reported_seq":21,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.905835+0000","last_change":"2024-09-17T03:11:31.904922+0000","last_active":"2024-09-17T03:11:33.905835+0000","last_peered":"2024-09-17T03:11:33.905835+0000","last_clean":"2024-09-17T03:11:33.905835+0000","last_became_active":"2024-09-17T03:11:31.904586+0000","last_became_peered":"2024-09-17T03:11:31.904586+0000","last_unstale":"2024-09-17T03:11:33.905835+0000","last_undegraded":"2024-09-17T03:11:33.905835+0000","last_fullsized":"2024-09-17T03:11:33.905835+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:05.884037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.999615+0000","last_change":"2024-09-17T03:11:32.912026+0000","last_active":"2024-09-17T03:11:33.999615+0000","last_peered":"2024-09-17T03:11:33.999615+0000","last_clean":"2024-09-17T03:11:33.999615+0000","last_became_active":"2024-09-17T03:11:32.911693+0000","last_became_peered":"2024-09-17T03:11:32.911693+0000","last_unstale":"2024-09-17T03:11:33.999615+0000","last_undegraded":"2024-09-17T03:11:33.999615+0000","last_fullsized":"2024-09-17T03:11:33.999615+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:24.691013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.912022+0000","last_change":"2024-09-17T03:11:31.911919+0000","last_active":"2024-09-17T03:11:32.912022+0000","last_peered":"2024-09-17T03:11:32.912022+0000","last_clean":"2024-09-17T03:11:32.912022+0000","last_became_active":"2024-09-17T03:11:31.911544+0000","last_became_peered":"2024-09-17T03:11:31.911544+0000","last_unstale":"2024-09-17T03:11:32.912022+0000","last_undegraded":"2024-09-17T03:11:32.912022+0000","last_fullsized":"2024-09-17T03:11:32.912022+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:41.728594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267300+0000","last_change":"2024-09-17T03:11:32.901746+0000","last_active":"2024-09-17T03:11:34.267300+0000","last_peered":"2024-09-17T03:11:34.267300+0000","last_clean":"2024-09-17T03:11:34.267300+0000","last_became_active":"2024-09-17T03:11:32.901428+0000","last_became_peered":"2024-09-17T03:11:32.901428+0000","last_unstale":"2024-09-17T03:11:34.267300+0000","last_undegraded":"2024-09-17T03:11:34.267300+0000","last_fullsized":"2024-09-17T03:11:34.267300+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:06.909782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.905357+0000","last_change":"2024-09-17T03:11:31.898706+0000","last_active":"2024-09-17T03:11:33.905357+0000","last_peered":"2024-09-17T03:11:33.905357+0000","last_clean":"2024-09-17T03:11:33.905357+0000","last_became_active":"2024-09-17T03:11:31.898343+0000","last_became_peered":"2024-09-17T03:11:31.898343+0000","last_unstale":"2024-09-17T03:11:33.905357+0000","last_undegraded":"2024-09-17T03:11:33.905357+0000","last_fullsized":"2024-09-17T03:11:33.905357+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:45.885574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.906765+0000","last_change":"2024-09-17T03:11:32.906373+0000","last_active":"2024-09-17T03:11:33.906765+0000","last_peered":"2024-09-17T03:11:33.906765+0000","last_clean":"2024-09-17T03:11:33.906765+0000","last_became_active":"2024-09-17T03:11:32.905734+0000","last_became_peered":"2024-09-17T03:11:32.905734+0000","last_unstale":"2024-09-17T03:11:33.906765+0000","last_undegraded":"2024-09-17T03:11:33.906765+0000","last_fullsized":"2024-09-17T03:11:33.906765+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:20.435329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.999386+0000","last_change":"2024-09-17T03:11:31.902280+0000","last_active":"2024-09-17T03:11:33.999386+0000","last_peered":"2024-09-17T03:11:33.999386+0000","last_clean":"2024-09-17T03:11:33.999386+0000","last_became_active":"2024-09-17T03:11:31.901961+0000","last_became_peered":"2024-09-17T03:11:31.901961+0000","last_unstale":"2024-09-17T03:11:33.999386+0000","last_undegraded":"2024-09-17T03:11:33.999386+0000","last_fullsized":"2024-09-17T03:11:33.999386+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:05.397468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267445+0000","last_change":"2024-09-17T03:11:32.918480+0000","last_active":"2024-09-17T03:11:34.267445+0000","last_peered":"2024-09-17T03:11:34.267445+0000","last_clean":"2024-09-17T03:11:34.267445+0000","last_became_active":"2024-09-17T03:11:32.918156+0000","last_became_peered":"2024-09-17T03:11:32.918156+0000","last_unstale":"2024-09-17T03:11:34.267445+0000","last_undegraded":"2024-09-17T03:11:34.267445+0000","last_fullsized":"2024-09-17T03:11:34.267445+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:59.971044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"57'8","reported_seq":23,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.266905+0000","last_change":"2024-09-17T03:11:31.903879+0000","last_active":"2024-09-17T03:11:34.266905+0000","last_peered":"2024-09-17T03:11:34.266905+0000","last_clean":"2024-09-17T03:11:34.266905+0000","last_became_active":"2024-09-17T03:11:31.903394+0000","last_became_peered":"2024-09-17T03:11:31.903394+0000","last_unstale":"2024-09-17T03:11:34.266905+0000","last_undegraded":"2024-09-17T03:11:34.266905+0000","last_fullsized":"2024-09-17T03:11:34.266905+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:06.360388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267852+0000","last_change":"2024-09-17T03:11:32.915631+0000","last_active":"2024-09-17T03:11:34.267852+0000","last_peered":"2024-09-17T03:11:34.267852+0000","last_clean":"2024-09-17T03:11:34.267852+0000","last_became_active":"2024-09-17T03:11:32.915311+0000","last_became_peered":"2024-09-17T03:11:32.915311+0000","last_unstale":"2024-09-17T03:11:34.267852+0000","last_undegraded":"2024-09-17T03:11:34.267852+0000","last_fullsized":"2024-09-17T03:11:34.267852+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:49.955971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.907321+0000","last_change":"2024-09-17T03:11:31.911865+0000","last_active":"2024-09-17T03:11:32.907321+0000","last_peered":"2024-09-17T03:11:32.907321+0000","last_clean":"2024-09-17T03:11:32.907321+0000","last_became_active":"2024-09-17T03:11:31.911483+0000","last_became_peered":"2024-09-17T03:11:31.911483+0000","last_unstale":"2024-09-17T03:11:32.907321+0000","last_undegraded":"2024-09-17T03:11:32.907321+0000","last_fullsized":"2024-09-17T03:11:32.907321+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:00.238987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.000432+0000","last_change":"2024-09-17T03:11:32.917072+0000","last_active":"2024-09-17T03:11:34.000432+0000","last_peered":"2024-09-17T03:11:34.000432+0000","last_clean":"2024-09-17T03:11:34.000432+0000","last_became_active":"2024-09-17T03:11:32.916762+0000","last_became_peered":"2024-09-17T03:11:32.916762+0000","last_unstale":"2024-09-17T03:11:34.000432+0000","last_undegraded":"2024-09-17T03:11:34.000432+0000","last_fullsized":"2024-09-17T03:11:34.000432+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:23.262799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267744+0000","last_change":"2024-09-17T03:11:31.905655+0000","last_active":"2024-09-17T03:11:34.267744+0000","last_peered":"2024-09-17T03:11:34.267744+0000","last_clean":"2024-09-17T03:11:34.267744+0000","last_became_active":"2024-09-17T03:11:31.905349+0000","last_became_peered":"2024-09-17T03:11:31.905349+0000","last_unstale":"2024-09-17T03:11:34.267744+0000","last_undegraded":"2024-09-17T03:11:34.267744+0000","last_fullsized":"2024-09-17T03:11:34.267744+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:34.328725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.917447+0000","last_change":"2024-09-17T03:11:32.916040+0000","last_active":"2024-09-17T03:11:32.917447+0000","last_peered":"2024-09-17T03:11:32.917447+0000","last_clean":"2024-09-17T03:11:32.917447+0000","last_became_active":"2024-09-17T03:11:32.915733+0000","last_became_peered":"2024-09-17T03:11:32.915733+0000","last_unstale":"2024-09-17T03:11:32.917447+0000","last_undegraded":"2024-09-17T03:11:32.917447+0000","last_fullsized":"2024-09-17T03:11:32.917447+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:30.159445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.000238+0000","last_change":"2024-09-17T03:11:31.901733+0000","last_active":"2024-09-17T03:11:34.000238+0000","last_peered":"2024-09-17T03:11:34.000238+0000","last_clean":"2024-09-17T03:11:34.000238+0000","last_became_active":"2024-09-17T03:11:31.901358+0000","last_became_peered":"2024-09-17T03:11:31.901358+0000","last_unstale":"2024-09-17T03:11:34.000238+0000","last_undegraded":"2024-09-17T03:11:34.000238+0000","last_fullsized":"2024-09-17T03:11:34.000238+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:00.917561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267797+0000","last_change":"2024-09-17T03:11:32.912970+0000","last_active":"2024-09-17T03:11:34.267797+0000","last_peered":"2024-09-17T03:11:34.267797+0000","last_clean":"2024-09-17T03:11:34.267797+0000","last_became_active":"2024-09-17T03:11:32.912583+0000","last_became_peered":"2024-09-17T03:11:32.912583+0000","last_unstale":"2024-09-17T03:11:34.267797+0000","last_undegraded":"2024-09-17T03:11:34.267797+0000","last_fullsized":"2024-09-17T03:11:34.267797+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:50.877744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267486+0000","last_change":"2024-09-17T03:11:31.901161+0000","last_active":"2024-09-17T03:11:34.267486+0000","last_peered":"2024-09-17T03:11:34.267486+0000","last_clean":"2024-09-17T03:11:34.267486+0000","last_became_active":"2024-09-17T03:11:31.900514+0000","last_became_peered":"2024-09-17T03:11:31.900514+0000","last_unstale":"2024-09-17T03:11:34.267486+0000","last_undegraded":"2024-09-17T03:11:34.267486+0000","last_fullsized":"2024-09-17T03:11:34.267486+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:00.917561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.999574+0000","last_change":"2024-09-17T03:11:32.904972+0000","last_active":"2024-09-17T03:11:33.999574+0000","last_peered":"2024-09-17T03:11:33.999574+0000","last_clean":"2024-09-17T03:11:33.999574+0000","last_became_active":"2024-09-17T03:11:32.904602+0000","last_became_peered":"2024-09-17T03:11:32.904602+0000","last_unstale":"2024-09-17T03:11:33.999574+0000","last_undegraded":"2024-09-17T03:11:33.999574+0000","last_fullsized":"2024-09-17T03:11:33.999574+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:41.673897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.912090+0000","last_change":"2024-09-17T03:11:31.909356+0000","last_active":"2024-09-17T03:11:32.912090+0000","last_peered":"2024-09-17T03:11:32.912090+0000","last_clean":"2024-09-17T03:11:32.912090+0000","last_became_active":"2024-09-17T03:11:31.908876+0000","last_became_peered":"2024-09-17T03:11:31.908876+0000","last_unstale":"2024-09-17T03:11:32.912090+0000","last_undegraded":"2024-09-17T03:11:32.912090+0000","last_fullsized":"2024-09-17T03:11:32.912090+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:35.023225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267546+0000","last_change":"2024-09-17T03:11:32.896840+0000","last_active":"2024-09-17T03:11:34.267546+0000","last_peered":"2024-09-17T03:11:34.267546+0000","last_clean":"2024-09-17T03:11:34.267546+0000","last_became_active":"2024-09-17T03:11:32.896537+0000","last_became_peered":"2024-09-17T03:11:32.896537+0000","last_unstale":"2024-09-17T03:11:34.267546+0000","last_undegraded":"2024-09-17T03:11:34.267546+0000","last_fullsized":"2024-09-17T03:11:34.267546+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:59.971044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267093+0000","last_change":"2024-09-17T03:11:31.906964+0000","last_active":"2024-09-17T03:11:34.267093+0000","last_peered":"2024-09-17T03:11:34.267093+0000","last_clean":"2024-09-17T03:11:34.267093+0000","last_became_active":"2024-09-17T03:11:31.906668+0000","last_became_peered":"2024-09-17T03:11:31.906668+0000","last_unstale":"2024-09-17T03:11:34.267093+0000","last_undegraded":"2024-09-17T03:11:34.267093+0000","last_fullsized":"2024-09-17T03:11:34.267093+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:39.529386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267255+0000","last_change":"2024-09-17T03:11:32.901548+0000","last_active":"2024-09-17T03:11:34.267255+0000","last_peered":"2024-09-17T03:11:34.267255+0000","last_clean":"2024-09-17T03:11:34.267255+0000","last_became_active":"2024-09-17T03:11:32.901277+0000","last_became_peered":"2024-09-17T03:11:32.901277+0000","last_unstale":"2024-09-17T03:11:34.267255+0000","last_undegraded":"2024-09-17T03:11:34.267255+0000","last_fullsized":"2024-09-17T03:11:34.267255+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:20.892505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.999310+0000","last_change":"2024-09-17T03:11:31.910278+0000","last_active":"2024-09-17T03:11:33.999310+0000","last_peered":"2024-09-17T03:11:33.999310+0000","last_clean":"2024-09-17T03:11:33.999310+0000","last_became_active":"2024-09-17T03:11:31.909963+0000","last_became_peered":"2024-09-17T03:11:31.909963+0000","last_unstale":"2024-09-17T03:11:33.999310+0000","last_undegraded":"2024-09-17T03:11:33.999310+0000","last_fullsized":"2024-09-17T03:11:33.999310+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:16.078000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.000488+0000","last_change":"2024-09-17T03:11:32.908009+0000","last_active":"2024-09-17T03:11:34.000488+0000","last_peered":"2024-09-17T03:11:34.000488+0000","last_clean":"2024-09-17T03:11:34.000488+0000","last_became_active":"2024-09-17T03:11:32.907691+0000","last_became_peered":"2024-09-17T03:11:32.907691+0000","last_unstale":"2024-09-17T03:11:34.000488+0000","last_undegraded":"2024-09-17T03:11:34.000488+0000","last_fullsized":"2024-09-17T03:11:34.000488+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:33.339959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267861+0000","last_change":"2024-09-17T03:11:31.902655+0000","last_active":"2024-09-17T03:11:34.267861+0000","last_peered":"2024-09-17T03:11:34.267861+0000","last_clean":"2024-09-17T03:11:34.267861+0000","last_became_active":"2024-09-17T03:11:31.902302+0000","last_became_peered":"2024-09-17T03:11:31.902302+0000","last_unstale":"2024-09-17T03:11:34.267861+0000","last_undegraded":"2024-09-17T03:11:34.267861+0000","last_fullsized":"2024-09-17T03:11:34.267861+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:56.209265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.000459+0000","last_change":"2024-09-17T03:11:32.906605+0000","last_active":"2024-09-17T03:11:34.000459+0000","last_peered":"2024-09-17T03:11:34.000459+0000","last_clean":"2024-09-17T03:11:34.000459+0000","last_became_active":"2024-09-17T03:11:32.906277+0000","last_became_peered":"2024-09-17T03:11:32.906277+0000","last_unstale":"2024-09-17T03:11:34.000459+0000","last_undegraded":"2024-09-17T03:11:34.000459+0000","last_fullsized":"2024-09-17T03:11:34.000459+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:04.685375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"58'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267909+0000","last_change":"2024-09-17T03:11:31.893101+0000","last_active":"2024-09-17T03:11:34.267909+0000","last_peered":"2024-09-17T03:11:34.267909+0000","last_clean":"2024-09-17T03:11:34.267909+0000","last_became_active":"2024-09-17T03:11:31.892592+0000","last_became_peered":"2024-09-17T03:11:31.892592+0000","last_unstale":"2024-09-17T03:11:34.267909+0000","last_undegraded":"2024-09-17T03:11:34.267909+0000","last_fullsized":"2024-09-17T03:11:34.267909+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:35.589650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267373+0000","last_change":"2024-09-17T03:11:32.897619+0000","last_active":"2024-09-17T03:11:34.267373+0000","last_peered":"2024-09-17T03:11:34.267373+0000","last_clean":"2024-09-17T03:11:34.267373+0000","last_became_active":"2024-09-17T03:11:32.897325+0000","last_became_peered":"2024-09-17T03:11:32.897325+0000","last_unstale":"2024-09-17T03:11:34.267373+0000","last_undegraded":"2024-09-17T03:11:34.267373+0000","last_fullsized":"2024-09-17T03:11:34.267373+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:06.886174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.905943+0000","last_change":"2024-09-17T03:11:31.897667+0000","last_active":"2024-09-17T03:11:33.905943+0000","last_peered":"2024-09-17T03:11:33.905943+0000","last_clean":"2024-09-17T03:11:33.905943+0000","last_became_active":"2024-09-17T03:11:31.897257+0000","last_became_peered":"2024-09-17T03:11:31.897257+0000","last_unstale":"2024-09-17T03:11:33.905943+0000","last_undegraded":"2024-09-17T03:11:33.905943+0000","last_fullsized":"2024-09-17T03:11:33.905943+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:18.212228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267946+0000","last_change":"2024-09-17T03:11:32.906776+0000","last_active":"2024-09-17T03:11:34.267946+0000","last_peered":"2024-09-17T03:11:34.267946+0000","last_clean":"2024-09-17T03:11:34.267946+0000","last_became_active":"2024-09-17T03:11:32.906476+0000","last_became_peered":"2024-09-17T03:11:32.906476+0000","last_unstale":"2024-09-17T03:11:34.267946+0000","last_undegraded":"2024-09-17T03:11:34.267946+0000","last_fullsized":"2024-09-17T03:11:34.267946+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:50.877744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.999986+0000","last_change":"2024-09-17T03:11:31.903176+0000","last_active":"2024-09-17T03:11:33.999986+0000","last_peered":"2024-09-17T03:11:33.999986+0000","last_clean":"2024-09-17T03:11:33.999986+0000","last_became_active":"2024-09-17T03:11:31.902849+0000","last_became_peered":"2024-09-17T03:11:31.902849+0000","last_unstale":"2024-09-17T03:11:33.999986+0000","last_undegraded":"2024-09-17T03:11:33.999986+0000","last_fullsized":"2024-09-17T03:11:33.999986+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:35.589650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.910328+0000","last_change":"2024-09-17T03:11:32.907821+0000","last_active":"2024-09-17T03:11:32.910328+0000","last_peered":"2024-09-17T03:11:32.910328+0000","last_clean":"2024-09-17T03:11:32.910328+0000","last_became_active":"2024-09-17T03:11:32.907272+0000","last_became_peered":"2024-09-17T03:11:32.907272+0000","last_unstale":"2024-09-17T03:11:32.910328+0000","last_undegraded":"2024-09-17T03:11:32.910328+0000","last_fullsized":"2024-09-17T03:11:32.910328+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:34.186429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.266980+0000","last_change":"2024-09-17T03:11:31.902264+0000","last_active":"2024-09-17T03:11:34.266980+0000","last_peered":"2024-09-17T03:11:34.266980+0000","last_clean":"2024-09-17T03:11:34.266980+0000","last_became_active":"2024-09-17T03:11:31.901925+0000","last_became_peered":"2024-09-17T03:11:31.901925+0000","last_unstale":"2024-09-17T03:11:34.266980+0000","last_undegraded":"2024-09-17T03:11:34.266980+0000","last_fullsized":"2024-09-17T03:11:34.266980+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:04.455792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267664+0000","last_change":"2024-09-17T03:11:32.919195+0000","last_active":"2024-09-17T03:11:34.267664+0000","last_peered":"2024-09-17T03:11:34.267664+0000","last_clean":"2024-09-17T03:11:34.267664+0000","last_became_active":"2024-09-17T03:11:32.918810+0000","last_became_peered":"2024-09-17T03:11:32.918810+0000","last_unstale":"2024-09-17T03:11:34.267664+0000","last_undegraded":"2024-09-17T03:11:34.267664+0000","last_fullsized":"2024-09-17T03:11:34.267664+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:44.508396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.906540+0000","last_change":"2024-09-17T03:11:31.904832+0000","last_active":"2024-09-17T03:11:33.906540+0000","last_peered":"2024-09-17T03:11:33.906540+0000","last_clean":"2024-09-17T03:11:33.906540+0000","last_became_active":"2024-09-17T03:11:31.904491+0000","last_became_peered":"2024-09-17T03:11:31.904491+0000","last_unstale":"2024-09-17T03:11:33.906540+0000","last_undegraded":"2024-09-17T03:11:33.906540+0000","last_fullsized":"2024-09-17T03:11:33.906540+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:41.395655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.266901+0000","last_change":"2024-09-17T03:11:32.895042+0000","last_active":"2024-09-17T03:11:34.266901+0000","last_peered":"2024-09-17T03:11:34.266901+0000","last_clean":"2024-09-17T03:11:34.266901+0000","last_became_active":"2024-09-17T03:11:32.894779+0000","last_became_peered":"2024-09-17T03:11:32.894779+0000","last_unstale":"2024-09-17T03:11:34.266901+0000","last_undegraded":"2024-09-17T03:11:34.266901+0000","last_fullsized":"2024-09-17T03:11:34.266901+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:43.986942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.266824+0000","last_change":"2024-09-17T03:11:31.911498+0000","last_active":"2024-09-17T03:11:34.266824+0000","last_peered":"2024-09-17T03:11:34.266824+0000","last_clean":"2024-09-17T03:11:34.266824+0000","last_became_active":"2024-09-17T03:11:31.911117+0000","last_became_peered":"2024-09-17T03:11:31.911117+0000","last_unstale":"2024-09-17T03:11:34.266824+0000","last_undegraded":"2024-09-17T03:11:34.266824+0000","last_fullsized":"2024-09-17T03:11:34.266824+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:12.261137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.915954+0000","last_change":"2024-09-17T03:11:32.908829+0000","last_active":"2024-09-17T03:11:32.915954+0000","last_peered":"2024-09-17T03:11:32.915954+0000","last_clean":"2024-09-17T03:11:32.915954+0000","last_became_active":"2024-09-17T03:11:32.908529+0000","last_became_peered":"2024-09-17T03:11:32.908529+0000","last_unstale":"2024-09-17T03:11:32.915954+0000","last_undegraded":"2024-09-17T03:11:32.915954+0000","last_fullsized":"2024-09-17T03:11:32.915954+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:28.383364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.899323+0000","last_change":"2024-09-17T03:11:31.909911+0000","last_active":"2024-09-17T03:11:32.899323+0000","last_peered":"2024-09-17T03:11:32.899323+0000","last_clean":"2024-09-17T03:11:32.899323+0000","last_became_active":"2024-09-17T03:11:31.909497+0000","last_became_peered":"2024-09-17T03:11:31.909497+0000","last_unstale":"2024-09-17T03:11:32.899323+0000","last_undegraded":"2024-09-17T03:11:32.899323+0000","last_fullsized":"2024-09-17T03:11:32.899323+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:32.685040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T03:11:32.917013+0000","last_change":"2024-09-17T03:11:32.909203+0000","last_active":"2024-09-17T03:11:32.917013+0000","last_peered":"2024-09-17T03:11:32.917013+0000","last_clean":"2024-09-17T03:11:32.917013+0000","last_became_active":"2024-09-17T03:11:32.908643+0000","last_became_peered":"2024-09-17T03:11:32.908643+0000","last_unstale":"2024-09-17T03:11:32.917013+0000","last_undegraded":"2024-09-17T03:11:32.917013+0000","last_fullsized":"2024-09-17T03:11:32.917013+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:06.406120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.905335+0000","last_change":"2024-09-17T03:11:31.901890+0000","last_active":"2024-09-17T03:11:33.905335+0000","last_peered":"2024-09-17T03:11:33.905335+0000","last_clean":"2024-09-17T03:11:33.905335+0000","last_became_active":"2024-09-17T03:11:31.901372+0000","last_became_peered":"2024-09-17T03:11:31.901372+0000","last_unstale":"2024-09-17T03:11:33.905335+0000","last_undegraded":"2024-09-17T03:11:33.905335+0000","last_fullsized":"2024-09-17T03:11:33.905335+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:08.995683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":174,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.266997+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:11:34.266997+0000","last_peered":"2024-09-17T03:11:34.266997+0000","last_clean":"2024-09-17T03:11:34.266997+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:11:34.266997+0000","last_undegraded":"2024-09-17T03:11:34.266997+0000","last_fullsized":"2024-09-17T03:11:34.266997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509484,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28288,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343552,"statfs":{"total":96636764160,"available":96607797248,"internally_reserved":0,"allocated":1290240,"data_stored":876369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509484,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":688128,"data_stored":285841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":696320,"data_stored":286493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509484,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":700416,"data_stored":287453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509485,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":696320,"data_stored":285897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509484,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":692224,"data_stored":285931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509484,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28300,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343540,"statfs":{"total":96636764160,"available":96607784960,"internally_reserved":0,"allocated":1298432,"data_stored":878403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":684032,"data_stored":279597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:11:38.867 INFO:tasks.ceph.mds.c.smithi078.stderr:2024-09-17T03:11:38.869+0000 7f2163f89640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:11:40.350 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:11:40.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.486+0000 7f3a23fad640 1 -- 172.21.15.78:0/1775048353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c0d0ca0 msgr2=0x7f3a1c06f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:40.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.486+0000 7f3a23fad640 1 --2- 172.21.15.78:0/1775048353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c0d0ca0 0x7f3a1c06f100 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c162ed0 tx=0x7f3a0c02a530 comp rx=0 tx=0).stop 2024-09-17T03:11:40.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.486+0000 7f3a23fad640 1 -- 172.21.15.78:0/1775048353 shutdown_connections 2024-09-17T03:11:40.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.486+0000 7f3a23fad640 1 --2- 172.21.15.78:0/1775048353 >> v2:172.21.15.193:3300/0 conn(0x7f3a1c06f640 0x7f3a1c0d2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:40.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.486+0000 7f3a23fad640 1 --2- 172.21.15.78:0/1775048353 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c0d0ca0 0x7f3a1c06f100 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:40.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.486+0000 7f3a23fad640 1 -- 172.21.15.78:0/1775048353 >> 172.21.15.78:0/1775048353 conn(0x7f3a1c06d550 msgr2=0x7f3a1c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:40.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.486+0000 7f3a23fad640 1 -- 172.21.15.78:0/1775048353 shutdown_connections 2024-09-17T03:11:40.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.486+0000 7f3a23fad640 1 -- 172.21.15.78:0/1775048353 wait complete. 2024-09-17T03:11:40.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.488+0000 7f3a23fad640 1 Processor -- start 2024-09-17T03:11:40.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.488+0000 7f3a23fad640 1 -- start start 2024-09-17T03:11:40.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.489+0000 7f3a23fad640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3a1c06f640 0x7f3a1c0c9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:40.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.489+0000 7f3a23fad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c0ce290 0x7f3a1c158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:40.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.489+0000 7f3a23fad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a1c0d0ca0 0x7f3a1c1f95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:40.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.489+0000 7f3a23fad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c0ccd40 con 0x7f3a1c0ce290 2024-09-17T03:11:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.489+0000 7f3a23fad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3a1c0ccbc0 con 0x7f3a1c0d0ca0 2024-09-17T03:11:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.489+0000 7f3a23fad640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3a1c0ccec0 con 0x7f3a1c06f640 2024-09-17T03:11:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.489+0000 7f3a21548640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c0ce290 0x7f3a1c158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.489+0000 7f3a21548640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c0ce290 0x7f3a1c158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50826/0 (socket says 172.21.15.78:50826) 2024-09-17T03:11:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.489+0000 7f3a21548640 1 -- 172.21.15.78:0/2366212513 learned_addr learned my addr 172.21.15.78:0/2366212513 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.490+0000 7f3a2254a640 1 --2- 172.21.15.78:0/2366212513 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a1c0d0ca0 0x7f3a1c1f95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.490+0000 7f3a21d49640 1 --2- 172.21.15.78:0/2366212513 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3a1c06f640 0x7f3a1c0c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.490+0000 7f3a21548640 1 -- 172.21.15.78:0/2366212513 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3a1c06f640 msgr2=0x7f3a1c0c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.490+0000 7f3a21548640 1 --2- 172.21.15.78:0/2366212513 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3a1c06f640 0x7f3a1c0c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.490+0000 7f3a21548640 1 -- 172.21.15.78:0/2366212513 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a1c0d0ca0 msgr2=0x7f3a1c1f95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:40.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.490+0000 7f3a21548640 1 --2- 172.21.15.78:0/2366212513 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a1c0d0ca0 0x7f3a1c1f95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:40.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.490+0000 7f3a21548640 1 -- 172.21.15.78:0/2366212513 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a1c1fa360 con 0x7f3a1c0ce290 2024-09-17T03:11:40.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.490+0000 7f3a2254a640 1 --2- 172.21.15.78:0/2366212513 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a1c0d0ca0 0x7f3a1c1f95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:40.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.490+0000 7f3a21548640 1 --2- 172.21.15.78:0/2366212513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c0ce290 0x7f3a1c158320 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009780 tx=0x7f3a0c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:40.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.490+0000 7f3a127fc640 1 -- 172.21.15.78:0/2366212513 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c031d60 con 0x7f3a1c0ce290 2024-09-17T03:11:40.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.490+0000 7f3a127fc640 1 -- 172.21.15.78:0/2366212513 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a0c033e10 con 0x7f3a1c0ce290 2024-09-17T03:11:40.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.490+0000 7f3a23fad640 1 -- 172.21.15.78:0/2366212513 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a1c15c120 con 0x7f3a1c0ce290 2024-09-17T03:11:40.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.490+0000 7f3a127fc640 1 -- 172.21.15.78:0/2366212513 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c005260 con 0x7f3a1c0ce290 2024-09-17T03:11:40.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.490+0000 7f3a23fad640 1 -- 172.21.15.78:0/2366212513 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a1c0b1690 con 0x7f3a1c0ce290 2024-09-17T03:11:40.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.491+0000 7f3a23fad640 1 -- 172.21.15.78:0/2366212513 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a1c15c340 con 0x7f3a1c0ce290 2024-09-17T03:11:40.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.492+0000 7f3a127fc640 1 -- 172.21.15.78:0/2366212513 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3a0c005400 con 0x7f3a1c0ce290 2024-09-17T03:11:40.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.493+0000 7f3a127fc640 1 --2- 172.21.15.78:0/2366212513 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3a00078b90 0x7f3a0007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:40.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.493+0000 7f3a127fc640 1 -- 172.21.15.78:0/2366212513 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f3a0c0bbf50 con 0x7f3a1c0ce290 2024-09-17T03:11:40.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.493+0000 7f3a21d49640 1 --2- 172.21.15.78:0/2366212513 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3a00078b90 0x7f3a0007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:40.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.494+0000 7f3a21d49640 1 --2- 172.21.15.78:0/2366212513 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3a00078b90 0x7f3a0007b0a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3a180020b0 tx=0x7f3a18009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:40.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.498+0000 7f3a127fc640 1 -- 172.21.15.78:0/2366212513 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3a0c03f030 con 0x7f3a1c0ce290 2024-09-17T03:11:40.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.668+0000 7f3a23fad640 1 -- 172.21.15.78:0/2366212513 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3a1c15bf10 con 0x7f3a00078b90 2024-09-17T03:11:40.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.673+0000 7f3a127fc640 1 -- 172.21.15.78:0/2366212513 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251930 (secure 0 0 0) 0x7f3a1c15bf10 con 0x7f3a00078b90 2024-09-17T03:11:40.674 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:40.676 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:11:40.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.676+0000 7f3a23fad640 1 -- 172.21.15.78:0/2366212513 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3a00078b90 msgr2=0x7f3a0007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:40.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.676+0000 7f3a23fad640 1 --2- 172.21.15.78:0/2366212513 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3a00078b90 0x7f3a0007b0a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3a180020b0 tx=0x7f3a18009040 comp rx=0 tx=0).stop 2024-09-17T03:11:40.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.676+0000 7f3a23fad640 1 -- 172.21.15.78:0/2366212513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c0ce290 msgr2=0x7f3a1c158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:40.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.676+0000 7f3a23fad640 1 --2- 172.21.15.78:0/2366212513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c0ce290 0x7f3a1c158320 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009780 tx=0x7f3a0c033c20 comp rx=0 tx=0).stop 2024-09-17T03:11:40.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.677+0000 7f3a23fad640 1 -- 172.21.15.78:0/2366212513 shutdown_connections 2024-09-17T03:11:40.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.677+0000 7f3a23fad640 1 --2- 172.21.15.78:0/2366212513 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3a00078b90 0x7f3a0007b0a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:40.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.677+0000 7f3a23fad640 1 --2- 172.21.15.78:0/2366212513 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a1c0d0ca0 0x7f3a1c1f95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:40.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.677+0000 7f3a23fad640 1 --2- 172.21.15.78:0/2366212513 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c0ce290 0x7f3a1c158320 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:40.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.677+0000 7f3a23fad640 1 --2- 172.21.15.78:0/2366212513 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3a1c06f640 0x7f3a1c0c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:40.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.677+0000 7f3a23fad640 1 -- 172.21.15.78:0/2366212513 >> 172.21.15.78:0/2366212513 conn(0x7f3a1c06d550 msgr2=0x7f3a1c1613a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:40.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.677+0000 7f3a23fad640 1 -- 172.21.15.78:0/2366212513 shutdown_connections 2024-09-17T03:11:40.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.677+0000 7f3a23fad640 1 -- 172.21.15.78:0/2366212513 wait complete. 2024-09-17T03:11:40.687 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-09-17T03:11:39.170332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231172,"kb_used_data":6600,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754743548,"statfs":{"total":773094113280,"available":772857393152,"internally_reserved":0,"allocated":6758400,"data_stored":3472284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":229756466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.284272"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.904792+0000","last_change":"2024-09-17T03:11:32.915800+0000","last_active":"2024-09-17T03:11:33.904792+0000","last_peered":"2024-09-17T03:11:33.904792+0000","last_clean":"2024-09-17T03:11:33.904792+0000","last_became_active":"2024-09-17T03:11:32.915504+0000","last_became_peered":"2024-09-17T03:11:32.915504+0000","last_unstale":"2024-09-17T03:11:33.904792+0000","last_undegraded":"2024-09-17T03:11:33.904792+0000","last_fullsized":"2024-09-17T03:11:33.904792+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:12.967227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268883+0000","last_change":"2024-09-17T03:11:32.916748+0000","last_active":"2024-09-17T03:11:34.268883+0000","last_peered":"2024-09-17T03:11:34.268883+0000","last_clean":"2024-09-17T03:11:34.268883+0000","last_became_active":"2024-09-17T03:11:32.916471+0000","last_became_peered":"2024-09-17T03:11:32.916471+0000","last_unstale":"2024-09-17T03:11:34.268883+0000","last_undegraded":"2024-09-17T03:11:34.268883+0000","last_fullsized":"2024-09-17T03:11:34.268883+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:22.686542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267493+0000","last_change":"2024-09-17T03:11:32.911248+0000","last_active":"2024-09-17T03:11:34.267493+0000","last_peered":"2024-09-17T03:11:34.267493+0000","last_clean":"2024-09-17T03:11:34.267493+0000","last_became_active":"2024-09-17T03:11:32.910944+0000","last_became_peered":"2024-09-17T03:11:32.910944+0000","last_unstale":"2024-09-17T03:11:34.267493+0000","last_undegraded":"2024-09-17T03:11:34.267493+0000","last_fullsized":"2024-09-17T03:11:34.267493+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:29.886555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.000310+0000","last_change":"2024-09-17T03:11:32.916492+0000","last_active":"2024-09-17T03:11:34.000310+0000","last_peered":"2024-09-17T03:11:34.000310+0000","last_clean":"2024-09-17T03:11:34.000310+0000","last_became_active":"2024-09-17T03:11:32.914941+0000","last_became_peered":"2024-09-17T03:11:32.914941+0000","last_unstale":"2024-09-17T03:11:34.000310+0000","last_undegraded":"2024-09-17T03:11:34.000310+0000","last_fullsized":"2024-09-17T03:11:34.000310+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:34.805975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.904700+0000","last_change":"2024-09-17T03:11:32.913983+0000","last_active":"2024-09-17T03:11:33.904700+0000","last_peered":"2024-09-17T03:11:33.904700+0000","last_clean":"2024-09-17T03:11:33.904700+0000","last_became_active":"2024-09-17T03:11:32.912539+0000","last_became_peered":"2024-09-17T03:11:32.912539+0000","last_unstale":"2024-09-17T03:11:33.904700+0000","last_undegraded":"2024-09-17T03:11:33.904700+0000","last_fullsized":"2024-09-17T03:11:33.904700+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:02.495575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267795+0000","last_change":"2024-09-17T03:11:32.906283+0000","last_active":"2024-09-17T03:11:34.267795+0000","last_peered":"2024-09-17T03:11:34.267795+0000","last_clean":"2024-09-17T03:11:34.267795+0000","last_became_active":"2024-09-17T03:11:32.905977+0000","last_became_peered":"2024-09-17T03:11:32.905977+0000","last_unstale":"2024-09-17T03:11:34.267795+0000","last_undegraded":"2024-09-17T03:11:34.267795+0000","last_fullsized":"2024-09-17T03:11:34.267795+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:33.339959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.905747+0000","last_change":"2024-09-17T03:11:32.912796+0000","last_active":"2024-09-17T03:11:33.905747+0000","last_peered":"2024-09-17T03:11:33.905747+0000","last_clean":"2024-09-17T03:11:33.905747+0000","last_became_active":"2024-09-17T03:11:32.912411+0000","last_became_peered":"2024-09-17T03:11:32.912411+0000","last_unstale":"2024-09-17T03:11:33.905747+0000","last_undegraded":"2024-09-17T03:11:33.905747+0000","last_fullsized":"2024-09-17T03:11:33.905747+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:57.042506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268319+0000","last_change":"2024-09-17T03:11:32.911313+0000","last_active":"2024-09-17T03:11:34.268319+0000","last_peered":"2024-09-17T03:11:34.268319+0000","last_clean":"2024-09-17T03:11:34.268319+0000","last_became_active":"2024-09-17T03:11:32.910712+0000","last_became_peered":"2024-09-17T03:11:32.910712+0000","last_unstale":"2024-09-17T03:11:34.268319+0000","last_undegraded":"2024-09-17T03:11:34.268319+0000","last_fullsized":"2024-09-17T03:11:34.268319+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:15.881742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.906342+0000","last_change":"2024-09-17T03:11:32.905612+0000","last_active":"2024-09-17T03:11:33.906342+0000","last_peered":"2024-09-17T03:11:33.906342+0000","last_clean":"2024-09-17T03:11:33.906342+0000","last_became_active":"2024-09-17T03:11:32.904555+0000","last_became_peered":"2024-09-17T03:11:32.904555+0000","last_unstale":"2024-09-17T03:11:33.906342+0000","last_undegraded":"2024-09-17T03:11:33.906342+0000","last_fullsized":"2024-09-17T03:11:33.906342+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:25.657615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267285+0000","last_change":"2024-09-17T03:11:32.895150+0000","last_active":"2024-09-17T03:11:34.267285+0000","last_peered":"2024-09-17T03:11:34.267285+0000","last_clean":"2024-09-17T03:11:34.267285+0000","last_became_active":"2024-09-17T03:11:32.894845+0000","last_became_peered":"2024-09-17T03:11:32.894845+0000","last_unstale":"2024-09-17T03:11:34.267285+0000","last_undegraded":"2024-09-17T03:11:34.267285+0000","last_fullsized":"2024-09-17T03:11:34.267285+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:29.049181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267277+0000","last_change":"2024-09-17T03:11:32.907761+0000","last_active":"2024-09-17T03:11:34.267277+0000","last_peered":"2024-09-17T03:11:34.267277+0000","last_clean":"2024-09-17T03:11:34.267277+0000","last_became_active":"2024-09-17T03:11:32.907411+0000","last_became_peered":"2024-09-17T03:11:32.907411+0000","last_unstale":"2024-09-17T03:11:34.267277+0000","last_undegraded":"2024-09-17T03:11:34.267277+0000","last_fullsized":"2024-09-17T03:11:34.267277+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:31.293651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.999778+0000","last_change":"2024-09-17T03:11:32.905470+0000","last_active":"2024-09-17T03:11:33.999778+0000","last_peered":"2024-09-17T03:11:33.999778+0000","last_clean":"2024-09-17T03:11:33.999778+0000","last_became_active":"2024-09-17T03:11:32.905162+0000","last_became_peered":"2024-09-17T03:11:32.905162+0000","last_unstale":"2024-09-17T03:11:33.999778+0000","last_undegraded":"2024-09-17T03:11:33.999778+0000","last_fullsized":"2024-09-17T03:11:33.999778+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:44:28.497824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.905749+0000","last_change":"2024-09-17T03:11:32.901622+0000","last_active":"2024-09-17T03:11:33.905749+0000","last_peered":"2024-09-17T03:11:33.905749+0000","last_clean":"2024-09-17T03:11:33.905749+0000","last_became_active":"2024-09-17T03:11:32.901291+0000","last_became_peered":"2024-09-17T03:11:32.901291+0000","last_unstale":"2024-09-17T03:11:33.905749+0000","last_undegraded":"2024-09-17T03:11:33.905749+0000","last_fullsized":"2024-09-17T03:11:33.905749+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:10.921522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.906452+0000","last_change":"2024-09-17T03:11:32.908529+0000","last_active":"2024-09-17T03:11:33.906452+0000","last_peered":"2024-09-17T03:11:33.906452+0000","last_clean":"2024-09-17T03:11:33.906452+0000","last_became_active":"2024-09-17T03:11:32.908194+0000","last_became_peered":"2024-09-17T03:11:32.908194+0000","last_unstale":"2024-09-17T03:11:33.906452+0000","last_undegraded":"2024-09-17T03:11:33.906452+0000","last_fullsized":"2024-09-17T03:11:33.906452+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:16.449177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.906228+0000","last_change":"2024-09-17T03:11:32.900366+0000","last_active":"2024-09-17T03:11:33.906228+0000","last_peered":"2024-09-17T03:11:33.906228+0000","last_clean":"2024-09-17T03:11:33.906228+0000","last_became_active":"2024-09-17T03:11:32.900046+0000","last_became_peered":"2024-09-17T03:11:32.900046+0000","last_unstale":"2024-09-17T03:11:33.906228+0000","last_undegraded":"2024-09-17T03:11:33.906228+0000","last_fullsized":"2024-09-17T03:11:33.906228+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:05:24.811948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268116+0000","last_change":"2024-09-17T03:11:32.901033+0000","last_active":"2024-09-17T03:11:34.268116+0000","last_peered":"2024-09-17T03:11:34.268116+0000","last_clean":"2024-09-17T03:11:34.268116+0000","last_became_active":"2024-09-17T03:11:32.900714+0000","last_became_peered":"2024-09-17T03:11:32.900714+0000","last_unstale":"2024-09-17T03:11:34.268116+0000","last_undegraded":"2024-09-17T03:11:34.268116+0000","last_fullsized":"2024-09-17T03:11:34.268116+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:25.545131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268796+0000","last_change":"2024-09-17T03:11:32.907186+0000","last_active":"2024-09-17T03:11:34.268796+0000","last_peered":"2024-09-17T03:11:34.268796+0000","last_clean":"2024-09-17T03:11:34.268796+0000","last_became_active":"2024-09-17T03:11:32.904919+0000","last_became_peered":"2024-09-17T03:11:32.904919+0000","last_unstale":"2024-09-17T03:11:34.268796+0000","last_undegraded":"2024-09-17T03:11:34.268796+0000","last_fullsized":"2024-09-17T03:11:34.268796+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:06.569072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267767+0000","last_change":"2024-09-17T03:11:32.909106+0000","last_active":"2024-09-17T03:11:34.267767+0000","last_peered":"2024-09-17T03:11:34.267767+0000","last_clean":"2024-09-17T03:11:34.267767+0000","last_became_active":"2024-09-17T03:11:32.907332+0000","last_became_peered":"2024-09-17T03:11:32.907332+0000","last_unstale":"2024-09-17T03:11:34.267767+0000","last_undegraded":"2024-09-17T03:11:34.267767+0000","last_fullsized":"2024-09-17T03:11:34.267767+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:17.911699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.904807+0000","last_change":"2024-09-17T03:11:32.915816+0000","last_active":"2024-09-17T03:11:33.904807+0000","last_peered":"2024-09-17T03:11:33.904807+0000","last_clean":"2024-09-17T03:11:33.904807+0000","last_became_active":"2024-09-17T03:11:32.915483+0000","last_became_peered":"2024-09-17T03:11:32.915483+0000","last_unstale":"2024-09-17T03:11:33.904807+0000","last_undegraded":"2024-09-17T03:11:33.904807+0000","last_fullsized":"2024-09-17T03:11:33.904807+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:08:23.980496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268703+0000","last_change":"2024-09-17T03:11:32.906705+0000","last_active":"2024-09-17T03:11:34.268703+0000","last_peered":"2024-09-17T03:11:34.268703+0000","last_clean":"2024-09-17T03:11:34.268703+0000","last_became_active":"2024-09-17T03:11:32.904796+0000","last_became_peered":"2024-09-17T03:11:32.904796+0000","last_unstale":"2024-09-17T03:11:34.268703+0000","last_undegraded":"2024-09-17T03:11:34.268703+0000","last_fullsized":"2024-09-17T03:11:34.268703+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:08.263915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267307+0000","last_change":"2024-09-17T03:11:32.912678+0000","last_active":"2024-09-17T03:11:34.267307+0000","last_peered":"2024-09-17T03:11:34.267307+0000","last_clean":"2024-09-17T03:11:34.267307+0000","last_became_active":"2024-09-17T03:11:32.911907+0000","last_became_peered":"2024-09-17T03:11:32.911907+0000","last_unstale":"2024-09-17T03:11:34.267307+0000","last_undegraded":"2024-09-17T03:11:34.267307+0000","last_fullsized":"2024-09-17T03:11:34.267307+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:34.805975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268385+0000","last_change":"2024-09-17T03:11:32.908150+0000","last_active":"2024-09-17T03:11:34.268385+0000","last_peered":"2024-09-17T03:11:34.268385+0000","last_clean":"2024-09-17T03:11:34.268385+0000","last_became_active":"2024-09-17T03:11:32.907642+0000","last_became_peered":"2024-09-17T03:11:32.907642+0000","last_unstale":"2024-09-17T03:11:34.268385+0000","last_undegraded":"2024-09-17T03:11:34.268385+0000","last_fullsized":"2024-09-17T03:11:34.268385+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:34.313675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267348+0000","last_change":"2024-09-17T03:11:32.917872+0000","last_active":"2024-09-17T03:11:34.267348+0000","last_peered":"2024-09-17T03:11:34.267348+0000","last_clean":"2024-09-17T03:11:34.267348+0000","last_became_active":"2024-09-17T03:11:32.917493+0000","last_became_peered":"2024-09-17T03:11:32.917493+0000","last_unstale":"2024-09-17T03:11:34.267348+0000","last_undegraded":"2024-09-17T03:11:34.267348+0000","last_fullsized":"2024-09-17T03:11:34.267348+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:48:49.603296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.905513+0000","last_change":"2024-09-17T03:11:32.907531+0000","last_active":"2024-09-17T03:11:33.905513+0000","last_peered":"2024-09-17T03:11:33.905513+0000","last_clean":"2024-09-17T03:11:33.905513+0000","last_became_active":"2024-09-17T03:11:32.907228+0000","last_became_peered":"2024-09-17T03:11:32.907228+0000","last_unstale":"2024-09-17T03:11:33.905513+0000","last_undegraded":"2024-09-17T03:11:33.905513+0000","last_fullsized":"2024-09-17T03:11:33.905513+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:27.579154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.905003+0000","last_change":"2024-09-17T03:11:32.919984+0000","last_active":"2024-09-17T03:11:33.905003+0000","last_peered":"2024-09-17T03:11:33.905003+0000","last_clean":"2024-09-17T03:11:33.905003+0000","last_became_active":"2024-09-17T03:11:32.919495+0000","last_became_peered":"2024-09-17T03:11:32.919495+0000","last_unstale":"2024-09-17T03:11:33.905003+0000","last_undegraded":"2024-09-17T03:11:33.905003+0000","last_fullsized":"2024-09-17T03:11:33.905003+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:31.464328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.000439+0000","last_change":"2024-09-17T03:11:32.909585+0000","last_active":"2024-09-17T03:11:34.000439+0000","last_peered":"2024-09-17T03:11:34.000439+0000","last_clean":"2024-09-17T03:11:34.000439+0000","last_became_active":"2024-09-17T03:11:32.909288+0000","last_became_peered":"2024-09-17T03:11:32.909288+0000","last_unstale":"2024-09-17T03:11:34.000439+0000","last_undegraded":"2024-09-17T03:11:34.000439+0000","last_fullsized":"2024-09-17T03:11:34.000439+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:13:36.952044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267793+0000","last_change":"2024-09-17T03:11:32.902027+0000","last_active":"2024-09-17T03:11:34.267793+0000","last_peered":"2024-09-17T03:11:34.267793+0000","last_clean":"2024-09-17T03:11:34.267793+0000","last_became_active":"2024-09-17T03:11:32.901731+0000","last_became_peered":"2024-09-17T03:11:32.901731+0000","last_unstale":"2024-09-17T03:11:34.267793+0000","last_undegraded":"2024-09-17T03:11:34.267793+0000","last_fullsized":"2024-09-17T03:11:34.267793+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:17.042997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.904769+0000","last_change":"2024-09-17T03:11:32.912811+0000","last_active":"2024-09-17T03:11:33.904769+0000","last_peered":"2024-09-17T03:11:33.904769+0000","last_clean":"2024-09-17T03:11:33.904769+0000","last_became_active":"2024-09-17T03:11:32.912530+0000","last_became_peered":"2024-09-17T03:11:32.912530+0000","last_unstale":"2024-09-17T03:11:33.904769+0000","last_undegraded":"2024-09-17T03:11:33.904769+0000","last_fullsized":"2024-09-17T03:11:33.904769+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:27.764920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.269036+0000","last_change":"2024-09-17T03:11:32.914928+0000","last_active":"2024-09-17T03:11:34.269036+0000","last_peered":"2024-09-17T03:11:34.269036+0000","last_clean":"2024-09-17T03:11:34.269036+0000","last_became_active":"2024-09-17T03:11:32.914607+0000","last_became_peered":"2024-09-17T03:11:32.914607+0000","last_unstale":"2024-09-17T03:11:34.269036+0000","last_undegraded":"2024-09-17T03:11:34.269036+0000","last_fullsized":"2024-09-17T03:11:34.269036+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:02.751186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267250+0000","last_change":"2024-09-17T03:11:32.909619+0000","last_active":"2024-09-17T03:11:34.267250+0000","last_peered":"2024-09-17T03:11:34.267250+0000","last_clean":"2024-09-17T03:11:34.267250+0000","last_became_active":"2024-09-17T03:11:32.909307+0000","last_became_peered":"2024-09-17T03:11:32.909307+0000","last_unstale":"2024-09-17T03:11:34.267250+0000","last_undegraded":"2024-09-17T03:11:34.267250+0000","last_fullsized":"2024-09-17T03:11:34.267250+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:53.975656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.904594+0000","last_change":"2024-09-17T03:11:32.912389+0000","last_active":"2024-09-17T03:11:33.904594+0000","last_peered":"2024-09-17T03:11:33.904594+0000","last_clean":"2024-09-17T03:11:33.904594+0000","last_became_active":"2024-09-17T03:11:32.912090+0000","last_became_peered":"2024-09-17T03:11:32.912090+0000","last_unstale":"2024-09-17T03:11:33.904594+0000","last_undegraded":"2024-09-17T03:11:33.904594+0000","last_fullsized":"2024-09-17T03:11:33.904594+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:32.096761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268222+0000","last_change":"2024-09-17T03:11:32.911395+0000","last_active":"2024-09-17T03:11:34.268222+0000","last_peered":"2024-09-17T03:11:34.268222+0000","last_clean":"2024-09-17T03:11:34.268222+0000","last_became_active":"2024-09-17T03:11:32.911051+0000","last_became_peered":"2024-09-17T03:11:32.911051+0000","last_unstale":"2024-09-17T03:11:34.268222+0000","last_undegraded":"2024-09-17T03:11:34.268222+0000","last_fullsized":"2024-09-17T03:11:34.268222+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:07.143292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267676+0000","last_change":"2024-09-17T03:11:32.902385+0000","last_active":"2024-09-17T03:11:34.267676+0000","last_peered":"2024-09-17T03:11:34.267676+0000","last_clean":"2024-09-17T03:11:34.267676+0000","last_became_active":"2024-09-17T03:11:32.902110+0000","last_became_peered":"2024-09-17T03:11:32.902110+0000","last_unstale":"2024-09-17T03:11:34.267676+0000","last_undegraded":"2024-09-17T03:11:34.267676+0000","last_fullsized":"2024-09-17T03:11:34.267676+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:29.886555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267747+0000","last_change":"2024-09-17T03:11:31.906418+0000","last_active":"2024-09-17T03:11:34.267747+0000","last_peered":"2024-09-17T03:11:34.267747+0000","last_clean":"2024-09-17T03:11:34.267747+0000","last_became_active":"2024-09-17T03:11:31.906113+0000","last_became_peered":"2024-09-17T03:11:31.906113+0000","last_unstale":"2024-09-17T03:11:34.267747+0000","last_undegraded":"2024-09-17T03:11:34.267747+0000","last_fullsized":"2024-09-17T03:11:34.267747+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:05.397468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267792+0000","last_change":"2024-09-17T03:11:32.915029+0000","last_active":"2024-09-17T03:11:34.267792+0000","last_peered":"2024-09-17T03:11:34.267792+0000","last_clean":"2024-09-17T03:11:34.267792+0000","last_became_active":"2024-09-17T03:11:32.914035+0000","last_became_peered":"2024-09-17T03:11:32.914035+0000","last_unstale":"2024-09-17T03:11:34.267792+0000","last_undegraded":"2024-09-17T03:11:34.267792+0000","last_fullsized":"2024-09-17T03:11:34.267792+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:04:06.631734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268860+0000","last_change":"2024-09-17T03:11:31.902430+0000","last_active":"2024-09-17T03:11:34.268860+0000","last_peered":"2024-09-17T03:11:34.268860+0000","last_clean":"2024-09-17T03:11:34.268860+0000","last_became_active":"2024-09-17T03:11:31.902103+0000","last_became_peered":"2024-09-17T03:11:31.902103+0000","last_unstale":"2024-09-17T03:11:34.268860+0000","last_undegraded":"2024-09-17T03:11:34.268860+0000","last_fullsized":"2024-09-17T03:11:34.268860+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:43.410521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267185+0000","last_change":"2024-09-17T03:11:32.905474+0000","last_active":"2024-09-17T03:11:34.267185+0000","last_peered":"2024-09-17T03:11:34.267185+0000","last_clean":"2024-09-17T03:11:34.267185+0000","last_became_active":"2024-09-17T03:11:32.903869+0000","last_became_peered":"2024-09-17T03:11:32.903869+0000","last_unstale":"2024-09-17T03:11:34.267185+0000","last_undegraded":"2024-09-17T03:11:34.267185+0000","last_fullsized":"2024-09-17T03:11:34.267185+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:06.909782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267944+0000","last_change":"2024-09-17T03:11:31.905671+0000","last_active":"2024-09-17T03:11:34.267944+0000","last_peered":"2024-09-17T03:11:34.267944+0000","last_clean":"2024-09-17T03:11:34.267944+0000","last_became_active":"2024-09-17T03:11:31.905141+0000","last_became_peered":"2024-09-17T03:11:31.905141+0000","last_unstale":"2024-09-17T03:11:34.267944+0000","last_undegraded":"2024-09-17T03:11:34.267944+0000","last_fullsized":"2024-09-17T03:11:34.267944+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:33.245594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267873+0000","last_change":"2024-09-17T03:11:32.908602+0000","last_active":"2024-09-17T03:11:34.267873+0000","last_peered":"2024-09-17T03:11:34.267873+0000","last_clean":"2024-09-17T03:11:34.267873+0000","last_became_active":"2024-09-17T03:11:32.908321+0000","last_became_peered":"2024-09-17T03:11:32.908321+0000","last_unstale":"2024-09-17T03:11:34.267873+0000","last_undegraded":"2024-09-17T03:11:34.267873+0000","last_fullsized":"2024-09-17T03:11:34.267873+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:17.911699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.999855+0000","last_change":"2024-09-17T03:11:31.901868+0000","last_active":"2024-09-17T03:11:33.999855+0000","last_peered":"2024-09-17T03:11:33.999855+0000","last_clean":"2024-09-17T03:11:33.999855+0000","last_became_active":"2024-09-17T03:11:31.901286+0000","last_became_peered":"2024-09-17T03:11:31.901286+0000","last_unstale":"2024-09-17T03:11:33.999855+0000","last_undegraded":"2024-09-17T03:11:33.999855+0000","last_fullsized":"2024-09-17T03:11:33.999855+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:33.245594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268605+0000","last_change":"2024-09-17T03:11:32.907947+0000","last_active":"2024-09-17T03:11:34.268605+0000","last_peered":"2024-09-17T03:11:34.268605+0000","last_clean":"2024-09-17T03:11:34.268605+0000","last_became_active":"2024-09-17T03:11:32.907490+0000","last_became_peered":"2024-09-17T03:11:32.907490+0000","last_unstale":"2024-09-17T03:11:34.268605+0000","last_undegraded":"2024-09-17T03:11:34.268605+0000","last_fullsized":"2024-09-17T03:11:34.268605+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:17.528790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.906107+0000","last_change":"2024-09-17T03:11:31.902788+0000","last_active":"2024-09-17T03:11:33.906107+0000","last_peered":"2024-09-17T03:11:33.906107+0000","last_clean":"2024-09-17T03:11:33.906107+0000","last_became_active":"2024-09-17T03:11:31.902430+0000","last_became_peered":"2024-09-17T03:11:31.902430+0000","last_unstale":"2024-09-17T03:11:33.906107+0000","last_undegraded":"2024-09-17T03:11:33.906107+0000","last_fullsized":"2024-09-17T03:11:33.906107+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:29.309485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268985+0000","last_change":"2024-09-17T03:11:32.913233+0000","last_active":"2024-09-17T03:11:34.268985+0000","last_peered":"2024-09-17T03:11:34.268985+0000","last_clean":"2024-09-17T03:11:34.268985+0000","last_became_active":"2024-09-17T03:11:32.911876+0000","last_became_peered":"2024-09-17T03:11:32.911876+0000","last_unstale":"2024-09-17T03:11:34.268985+0000","last_undegraded":"2024-09-17T03:11:34.268985+0000","last_fullsized":"2024-09-17T03:11:34.268985+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:32:12.200903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267932+0000","last_change":"2024-09-17T03:11:31.893272+0000","last_active":"2024-09-17T03:11:34.267932+0000","last_peered":"2024-09-17T03:11:34.267932+0000","last_clean":"2024-09-17T03:11:34.267932+0000","last_became_active":"2024-09-17T03:11:31.892198+0000","last_became_peered":"2024-09-17T03:11:31.892198+0000","last_unstale":"2024-09-17T03:11:34.267932+0000","last_undegraded":"2024-09-17T03:11:34.267932+0000","last_fullsized":"2024-09-17T03:11:34.267932+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:16.078000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.905697+0000","last_change":"2024-09-17T03:11:32.900601+0000","last_active":"2024-09-17T03:11:33.905697+0000","last_peered":"2024-09-17T03:11:33.905697+0000","last_clean":"2024-09-17T03:11:33.905697+0000","last_became_active":"2024-09-17T03:11:32.900151+0000","last_became_peered":"2024-09-17T03:11:32.900151+0000","last_unstale":"2024-09-17T03:11:33.905697+0000","last_undegraded":"2024-09-17T03:11:33.905697+0000","last_fullsized":"2024-09-17T03:11:33.905697+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:49.063396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.999346+0000","last_change":"2024-09-17T03:11:31.903086+0000","last_active":"2024-09-17T03:11:33.999346+0000","last_peered":"2024-09-17T03:11:33.999346+0000","last_clean":"2024-09-17T03:11:33.999346+0000","last_became_active":"2024-09-17T03:11:31.902762+0000","last_became_peered":"2024-09-17T03:11:31.902762+0000","last_unstale":"2024-09-17T03:11:33.999346+0000","last_undegraded":"2024-09-17T03:11:33.999346+0000","last_fullsized":"2024-09-17T03:11:33.999346+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:06.360388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268449+0000","last_change":"2024-09-17T03:11:32.911245+0000","last_active":"2024-09-17T03:11:34.268449+0000","last_peered":"2024-09-17T03:11:34.268449+0000","last_clean":"2024-09-17T03:11:34.268449+0000","last_became_active":"2024-09-17T03:11:32.908833+0000","last_became_peered":"2024-09-17T03:11:32.908833+0000","last_unstale":"2024-09-17T03:11:34.268449+0000","last_undegraded":"2024-09-17T03:11:34.268449+0000","last_fullsized":"2024-09-17T03:11:34.268449+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:15:00.121961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.906650+0000","last_change":"2024-09-17T03:11:31.898616+0000","last_active":"2024-09-17T03:11:33.906650+0000","last_peered":"2024-09-17T03:11:33.906650+0000","last_clean":"2024-09-17T03:11:33.906650+0000","last_became_active":"2024-09-17T03:11:31.898302+0000","last_became_peered":"2024-09-17T03:11:31.898302+0000","last_unstale":"2024-09-17T03:11:33.906650+0000","last_undegraded":"2024-09-17T03:11:33.906650+0000","last_fullsized":"2024-09-17T03:11:33.906650+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:30.291514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.906396+0000","last_change":"2024-09-17T03:11:32.901639+0000","last_active":"2024-09-17T03:11:33.906396+0000","last_peered":"2024-09-17T03:11:33.906396+0000","last_clean":"2024-09-17T03:11:33.906396+0000","last_became_active":"2024-09-17T03:11:32.901291+0000","last_became_peered":"2024-09-17T03:11:32.901291+0000","last_unstale":"2024-09-17T03:11:33.906396+0000","last_undegraded":"2024-09-17T03:11:33.906396+0000","last_fullsized":"2024-09-17T03:11:33.906396+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:42:11.700438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267690+0000","last_change":"2024-09-17T03:11:31.908308+0000","last_active":"2024-09-17T03:11:34.267690+0000","last_peered":"2024-09-17T03:11:34.267690+0000","last_clean":"2024-09-17T03:11:34.267690+0000","last_became_active":"2024-09-17T03:11:31.908047+0000","last_became_peered":"2024-09-17T03:11:31.908047+0000","last_unstale":"2024-09-17T03:11:34.267690+0000","last_undegraded":"2024-09-17T03:11:34.267690+0000","last_fullsized":"2024-09-17T03:11:34.267690+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:16.078000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267838+0000","last_change":"2024-09-17T03:11:32.919801+0000","last_active":"2024-09-17T03:11:34.267838+0000","last_peered":"2024-09-17T03:11:34.267838+0000","last_clean":"2024-09-17T03:11:34.267838+0000","last_became_active":"2024-09-17T03:11:32.919449+0000","last_became_peered":"2024-09-17T03:11:32.919449+0000","last_unstale":"2024-09-17T03:11:34.267838+0000","last_undegraded":"2024-09-17T03:11:34.267838+0000","last_fullsized":"2024-09-17T03:11:34.267838+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:25.545131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268974+0000","last_change":"2024-09-17T03:11:31.909804+0000","last_active":"2024-09-17T03:11:34.268974+0000","last_peered":"2024-09-17T03:11:34.268974+0000","last_clean":"2024-09-17T03:11:34.268974+0000","last_became_active":"2024-09-17T03:11:31.909381+0000","last_became_peered":"2024-09-17T03:11:31.909381+0000","last_unstale":"2024-09-17T03:11:34.268974+0000","last_undegraded":"2024-09-17T03:11:34.268974+0000","last_fullsized":"2024-09-17T03:11:34.268974+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:57:40.927693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267348+0000","last_change":"2024-09-17T03:11:32.896534+0000","last_active":"2024-09-17T03:11:34.267348+0000","last_peered":"2024-09-17T03:11:34.267348+0000","last_clean":"2024-09-17T03:11:34.267348+0000","last_became_active":"2024-09-17T03:11:32.896250+0000","last_became_peered":"2024-09-17T03:11:32.896250+0000","last_unstale":"2024-09-17T03:11:34.267348+0000","last_undegraded":"2024-09-17T03:11:34.267348+0000","last_fullsized":"2024-09-17T03:11:34.267348+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:30.311622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"57'3","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267603+0000","last_change":"2024-09-17T03:11:31.906933+0000","last_active":"2024-09-17T03:11:34.267603+0000","last_peered":"2024-09-17T03:11:34.267603+0000","last_clean":"2024-09-17T03:11:34.267603+0000","last_became_active":"2024-09-17T03:11:31.906633+0000","last_became_peered":"2024-09-17T03:11:31.906633+0000","last_unstale":"2024-09-17T03:11:34.267603+0000","last_undegraded":"2024-09-17T03:11:34.267603+0000","last_fullsized":"2024-09-17T03:11:34.267603+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:05.397468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267526+0000","last_change":"2024-09-17T03:11:32.912135+0000","last_active":"2024-09-17T03:11:34.267526+0000","last_peered":"2024-09-17T03:11:34.267526+0000","last_clean":"2024-09-17T03:11:34.267526+0000","last_became_active":"2024-09-17T03:11:32.911666+0000","last_became_peered":"2024-09-17T03:11:32.911666+0000","last_unstale":"2024-09-17T03:11:34.267526+0000","last_undegraded":"2024-09-17T03:11:34.267526+0000","last_fullsized":"2024-09-17T03:11:34.267526+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:17.042997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"57'6","reported_seq":21,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.905835+0000","last_change":"2024-09-17T03:11:31.904922+0000","last_active":"2024-09-17T03:11:33.905835+0000","last_peered":"2024-09-17T03:11:33.905835+0000","last_clean":"2024-09-17T03:11:33.905835+0000","last_became_active":"2024-09-17T03:11:31.904586+0000","last_became_peered":"2024-09-17T03:11:31.904586+0000","last_unstale":"2024-09-17T03:11:33.905835+0000","last_undegraded":"2024-09-17T03:11:33.905835+0000","last_fullsized":"2024-09-17T03:11:33.905835+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:05.884037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.999615+0000","last_change":"2024-09-17T03:11:32.912026+0000","last_active":"2024-09-17T03:11:33.999615+0000","last_peered":"2024-09-17T03:11:33.999615+0000","last_clean":"2024-09-17T03:11:33.999615+0000","last_became_active":"2024-09-17T03:11:32.911693+0000","last_became_peered":"2024-09-17T03:11:32.911693+0000","last_unstale":"2024-09-17T03:11:33.999615+0000","last_undegraded":"2024-09-17T03:11:33.999615+0000","last_fullsized":"2024-09-17T03:11:33.999615+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:24.691013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268632+0000","last_change":"2024-09-17T03:11:31.911919+0000","last_active":"2024-09-17T03:11:34.268632+0000","last_peered":"2024-09-17T03:11:34.268632+0000","last_clean":"2024-09-17T03:11:34.268632+0000","last_became_active":"2024-09-17T03:11:31.911544+0000","last_became_peered":"2024-09-17T03:11:31.911544+0000","last_unstale":"2024-09-17T03:11:34.268632+0000","last_undegraded":"2024-09-17T03:11:34.268632+0000","last_fullsized":"2024-09-17T03:11:34.268632+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:52:41.728594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267300+0000","last_change":"2024-09-17T03:11:32.901746+0000","last_active":"2024-09-17T03:11:34.267300+0000","last_peered":"2024-09-17T03:11:34.267300+0000","last_clean":"2024-09-17T03:11:34.267300+0000","last_became_active":"2024-09-17T03:11:32.901428+0000","last_became_peered":"2024-09-17T03:11:32.901428+0000","last_unstale":"2024-09-17T03:11:34.267300+0000","last_undegraded":"2024-09-17T03:11:34.267300+0000","last_fullsized":"2024-09-17T03:11:34.267300+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:06.909782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.905357+0000","last_change":"2024-09-17T03:11:31.898706+0000","last_active":"2024-09-17T03:11:33.905357+0000","last_peered":"2024-09-17T03:11:33.905357+0000","last_clean":"2024-09-17T03:11:33.905357+0000","last_became_active":"2024-09-17T03:11:31.898343+0000","last_became_peered":"2024-09-17T03:11:31.898343+0000","last_unstale":"2024-09-17T03:11:33.905357+0000","last_undegraded":"2024-09-17T03:11:33.905357+0000","last_fullsized":"2024-09-17T03:11:33.905357+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:09:45.885574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.906765+0000","last_change":"2024-09-17T03:11:32.906373+0000","last_active":"2024-09-17T03:11:33.906765+0000","last_peered":"2024-09-17T03:11:33.906765+0000","last_clean":"2024-09-17T03:11:33.906765+0000","last_became_active":"2024-09-17T03:11:32.905734+0000","last_became_peered":"2024-09-17T03:11:32.905734+0000","last_unstale":"2024-09-17T03:11:33.906765+0000","last_undegraded":"2024-09-17T03:11:33.906765+0000","last_fullsized":"2024-09-17T03:11:33.906765+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:37:20.435329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.999386+0000","last_change":"2024-09-17T03:11:31.902280+0000","last_active":"2024-09-17T03:11:33.999386+0000","last_peered":"2024-09-17T03:11:33.999386+0000","last_clean":"2024-09-17T03:11:33.999386+0000","last_became_active":"2024-09-17T03:11:31.901961+0000","last_became_peered":"2024-09-17T03:11:31.901961+0000","last_unstale":"2024-09-17T03:11:33.999386+0000","last_undegraded":"2024-09-17T03:11:33.999386+0000","last_fullsized":"2024-09-17T03:11:33.999386+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:05.397468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267445+0000","last_change":"2024-09-17T03:11:32.918480+0000","last_active":"2024-09-17T03:11:34.267445+0000","last_peered":"2024-09-17T03:11:34.267445+0000","last_clean":"2024-09-17T03:11:34.267445+0000","last_became_active":"2024-09-17T03:11:32.918156+0000","last_became_peered":"2024-09-17T03:11:32.918156+0000","last_unstale":"2024-09-17T03:11:34.267445+0000","last_undegraded":"2024-09-17T03:11:34.267445+0000","last_fullsized":"2024-09-17T03:11:34.267445+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:59.971044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"57'8","reported_seq":23,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.266905+0000","last_change":"2024-09-17T03:11:31.903879+0000","last_active":"2024-09-17T03:11:34.266905+0000","last_peered":"2024-09-17T03:11:34.266905+0000","last_clean":"2024-09-17T03:11:34.266905+0000","last_became_active":"2024-09-17T03:11:31.903394+0000","last_became_peered":"2024-09-17T03:11:31.903394+0000","last_unstale":"2024-09-17T03:11:34.266905+0000","last_undegraded":"2024-09-17T03:11:34.266905+0000","last_fullsized":"2024-09-17T03:11:34.266905+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:06.360388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267852+0000","last_change":"2024-09-17T03:11:32.915631+0000","last_active":"2024-09-17T03:11:34.267852+0000","last_peered":"2024-09-17T03:11:34.267852+0000","last_clean":"2024-09-17T03:11:34.267852+0000","last_became_active":"2024-09-17T03:11:32.915311+0000","last_became_peered":"2024-09-17T03:11:32.915311+0000","last_unstale":"2024-09-17T03:11:34.267852+0000","last_undegraded":"2024-09-17T03:11:34.267852+0000","last_fullsized":"2024-09-17T03:11:34.267852+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:49.955971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268966+0000","last_change":"2024-09-17T03:11:31.911865+0000","last_active":"2024-09-17T03:11:34.268966+0000","last_peered":"2024-09-17T03:11:34.268966+0000","last_clean":"2024-09-17T03:11:34.268966+0000","last_became_active":"2024-09-17T03:11:31.911483+0000","last_became_peered":"2024-09-17T03:11:31.911483+0000","last_unstale":"2024-09-17T03:11:34.268966+0000","last_undegraded":"2024-09-17T03:11:34.268966+0000","last_fullsized":"2024-09-17T03:11:34.268966+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:53:00.238987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.000432+0000","last_change":"2024-09-17T03:11:32.917072+0000","last_active":"2024-09-17T03:11:34.000432+0000","last_peered":"2024-09-17T03:11:34.000432+0000","last_clean":"2024-09-17T03:11:34.000432+0000","last_became_active":"2024-09-17T03:11:32.916762+0000","last_became_peered":"2024-09-17T03:11:32.916762+0000","last_unstale":"2024-09-17T03:11:34.000432+0000","last_undegraded":"2024-09-17T03:11:34.000432+0000","last_fullsized":"2024-09-17T03:11:34.000432+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:23.262799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267744+0000","last_change":"2024-09-17T03:11:31.905655+0000","last_active":"2024-09-17T03:11:34.267744+0000","last_peered":"2024-09-17T03:11:34.267744+0000","last_clean":"2024-09-17T03:11:34.267744+0000","last_became_active":"2024-09-17T03:11:31.905349+0000","last_became_peered":"2024-09-17T03:11:31.905349+0000","last_unstale":"2024-09-17T03:11:34.267744+0000","last_undegraded":"2024-09-17T03:11:34.267744+0000","last_fullsized":"2024-09-17T03:11:34.267744+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:34.328725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268752+0000","last_change":"2024-09-17T03:11:32.916040+0000","last_active":"2024-09-17T03:11:34.268752+0000","last_peered":"2024-09-17T03:11:34.268752+0000","last_clean":"2024-09-17T03:11:34.268752+0000","last_became_active":"2024-09-17T03:11:32.915733+0000","last_became_peered":"2024-09-17T03:11:32.915733+0000","last_unstale":"2024-09-17T03:11:34.268752+0000","last_undegraded":"2024-09-17T03:11:34.268752+0000","last_fullsized":"2024-09-17T03:11:34.268752+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:02.448773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.000238+0000","last_change":"2024-09-17T03:11:31.901733+0000","last_active":"2024-09-17T03:11:34.000238+0000","last_peered":"2024-09-17T03:11:34.000238+0000","last_clean":"2024-09-17T03:11:34.000238+0000","last_became_active":"2024-09-17T03:11:31.901358+0000","last_became_peered":"2024-09-17T03:11:31.901358+0000","last_unstale":"2024-09-17T03:11:34.000238+0000","last_undegraded":"2024-09-17T03:11:34.000238+0000","last_fullsized":"2024-09-17T03:11:34.000238+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:00.917561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267797+0000","last_change":"2024-09-17T03:11:32.912970+0000","last_active":"2024-09-17T03:11:34.267797+0000","last_peered":"2024-09-17T03:11:34.267797+0000","last_clean":"2024-09-17T03:11:34.267797+0000","last_became_active":"2024-09-17T03:11:32.912583+0000","last_became_peered":"2024-09-17T03:11:32.912583+0000","last_unstale":"2024-09-17T03:11:34.267797+0000","last_undegraded":"2024-09-17T03:11:34.267797+0000","last_fullsized":"2024-09-17T03:11:34.267797+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:50.877744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267486+0000","last_change":"2024-09-17T03:11:31.901161+0000","last_active":"2024-09-17T03:11:34.267486+0000","last_peered":"2024-09-17T03:11:34.267486+0000","last_clean":"2024-09-17T03:11:34.267486+0000","last_became_active":"2024-09-17T03:11:31.900514+0000","last_became_peered":"2024-09-17T03:11:31.900514+0000","last_unstale":"2024-09-17T03:11:34.267486+0000","last_undegraded":"2024-09-17T03:11:34.267486+0000","last_fullsized":"2024-09-17T03:11:34.267486+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:00.917561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.999574+0000","last_change":"2024-09-17T03:11:32.904972+0000","last_active":"2024-09-17T03:11:33.999574+0000","last_peered":"2024-09-17T03:11:33.999574+0000","last_clean":"2024-09-17T03:11:33.999574+0000","last_became_active":"2024-09-17T03:11:32.904602+0000","last_became_peered":"2024-09-17T03:11:32.904602+0000","last_unstale":"2024-09-17T03:11:33.999574+0000","last_undegraded":"2024-09-17T03:11:33.999574+0000","last_fullsized":"2024-09-17T03:11:33.999574+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:56:41.673897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.269106+0000","last_change":"2024-09-17T03:11:31.909356+0000","last_active":"2024-09-17T03:11:34.269106+0000","last_peered":"2024-09-17T03:11:34.269106+0000","last_clean":"2024-09-17T03:11:34.269106+0000","last_became_active":"2024-09-17T03:11:31.908876+0000","last_became_peered":"2024-09-17T03:11:31.908876+0000","last_unstale":"2024-09-17T03:11:34.269106+0000","last_undegraded":"2024-09-17T03:11:34.269106+0000","last_fullsized":"2024-09-17T03:11:34.269106+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:31:35.023225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267546+0000","last_change":"2024-09-17T03:11:32.896840+0000","last_active":"2024-09-17T03:11:34.267546+0000","last_peered":"2024-09-17T03:11:34.267546+0000","last_clean":"2024-09-17T03:11:34.267546+0000","last_became_active":"2024-09-17T03:11:32.896537+0000","last_became_peered":"2024-09-17T03:11:32.896537+0000","last_unstale":"2024-09-17T03:11:34.267546+0000","last_undegraded":"2024-09-17T03:11:34.267546+0000","last_fullsized":"2024-09-17T03:11:34.267546+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:40:59.971044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267093+0000","last_change":"2024-09-17T03:11:31.906964+0000","last_active":"2024-09-17T03:11:34.267093+0000","last_peered":"2024-09-17T03:11:34.267093+0000","last_clean":"2024-09-17T03:11:34.267093+0000","last_became_active":"2024-09-17T03:11:31.906668+0000","last_became_peered":"2024-09-17T03:11:31.906668+0000","last_unstale":"2024-09-17T03:11:34.267093+0000","last_undegraded":"2024-09-17T03:11:34.267093+0000","last_fullsized":"2024-09-17T03:11:34.267093+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:39.529386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267255+0000","last_change":"2024-09-17T03:11:32.901548+0000","last_active":"2024-09-17T03:11:34.267255+0000","last_peered":"2024-09-17T03:11:34.267255+0000","last_clean":"2024-09-17T03:11:34.267255+0000","last_became_active":"2024-09-17T03:11:32.901277+0000","last_became_peered":"2024-09-17T03:11:32.901277+0000","last_unstale":"2024-09-17T03:11:34.267255+0000","last_undegraded":"2024-09-17T03:11:34.267255+0000","last_fullsized":"2024-09-17T03:11:34.267255+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:20.892505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.999310+0000","last_change":"2024-09-17T03:11:31.910278+0000","last_active":"2024-09-17T03:11:33.999310+0000","last_peered":"2024-09-17T03:11:33.999310+0000","last_clean":"2024-09-17T03:11:33.999310+0000","last_became_active":"2024-09-17T03:11:31.909963+0000","last_became_peered":"2024-09-17T03:11:31.909963+0000","last_unstale":"2024-09-17T03:11:33.999310+0000","last_undegraded":"2024-09-17T03:11:33.999310+0000","last_fullsized":"2024-09-17T03:11:33.999310+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:16.078000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.000488+0000","last_change":"2024-09-17T03:11:32.908009+0000","last_active":"2024-09-17T03:11:34.000488+0000","last_peered":"2024-09-17T03:11:34.000488+0000","last_clean":"2024-09-17T03:11:34.000488+0000","last_became_active":"2024-09-17T03:11:32.907691+0000","last_became_peered":"2024-09-17T03:11:32.907691+0000","last_unstale":"2024-09-17T03:11:34.000488+0000","last_undegraded":"2024-09-17T03:11:34.000488+0000","last_fullsized":"2024-09-17T03:11:34.000488+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:25:33.339959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267861+0000","last_change":"2024-09-17T03:11:31.902655+0000","last_active":"2024-09-17T03:11:34.267861+0000","last_peered":"2024-09-17T03:11:34.267861+0000","last_clean":"2024-09-17T03:11:34.267861+0000","last_became_active":"2024-09-17T03:11:31.902302+0000","last_became_peered":"2024-09-17T03:11:31.902302+0000","last_unstale":"2024-09-17T03:11:34.267861+0000","last_undegraded":"2024-09-17T03:11:34.267861+0000","last_fullsized":"2024-09-17T03:11:34.267861+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:56.209265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.000459+0000","last_change":"2024-09-17T03:11:32.906605+0000","last_active":"2024-09-17T03:11:34.000459+0000","last_peered":"2024-09-17T03:11:34.000459+0000","last_clean":"2024-09-17T03:11:34.000459+0000","last_became_active":"2024-09-17T03:11:32.906277+0000","last_became_peered":"2024-09-17T03:11:32.906277+0000","last_unstale":"2024-09-17T03:11:34.000459+0000","last_undegraded":"2024-09-17T03:11:34.000459+0000","last_fullsized":"2024-09-17T03:11:34.000459+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:04.685375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"58'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267909+0000","last_change":"2024-09-17T03:11:31.893101+0000","last_active":"2024-09-17T03:11:34.267909+0000","last_peered":"2024-09-17T03:11:34.267909+0000","last_clean":"2024-09-17T03:11:34.267909+0000","last_became_active":"2024-09-17T03:11:31.892592+0000","last_became_peered":"2024-09-17T03:11:31.892592+0000","last_unstale":"2024-09-17T03:11:34.267909+0000","last_undegraded":"2024-09-17T03:11:34.267909+0000","last_fullsized":"2024-09-17T03:11:34.267909+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:35.589650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267373+0000","last_change":"2024-09-17T03:11:32.897619+0000","last_active":"2024-09-17T03:11:34.267373+0000","last_peered":"2024-09-17T03:11:34.267373+0000","last_clean":"2024-09-17T03:11:34.267373+0000","last_became_active":"2024-09-17T03:11:32.897325+0000","last_became_peered":"2024-09-17T03:11:32.897325+0000","last_unstale":"2024-09-17T03:11:34.267373+0000","last_undegraded":"2024-09-17T03:11:34.267373+0000","last_fullsized":"2024-09-17T03:11:34.267373+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:06.886174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.905943+0000","last_change":"2024-09-17T03:11:31.897667+0000","last_active":"2024-09-17T03:11:33.905943+0000","last_peered":"2024-09-17T03:11:33.905943+0000","last_clean":"2024-09-17T03:11:33.905943+0000","last_became_active":"2024-09-17T03:11:31.897257+0000","last_became_peered":"2024-09-17T03:11:31.897257+0000","last_unstale":"2024-09-17T03:11:33.905943+0000","last_undegraded":"2024-09-17T03:11:33.905943+0000","last_fullsized":"2024-09-17T03:11:33.905943+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:18.212228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267946+0000","last_change":"2024-09-17T03:11:32.906776+0000","last_active":"2024-09-17T03:11:34.267946+0000","last_peered":"2024-09-17T03:11:34.267946+0000","last_clean":"2024-09-17T03:11:34.267946+0000","last_became_active":"2024-09-17T03:11:32.906476+0000","last_became_peered":"2024-09-17T03:11:32.906476+0000","last_unstale":"2024-09-17T03:11:34.267946+0000","last_undegraded":"2024-09-17T03:11:34.267946+0000","last_fullsized":"2024-09-17T03:11:34.267946+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:50.877744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.999986+0000","last_change":"2024-09-17T03:11:31.903176+0000","last_active":"2024-09-17T03:11:33.999986+0000","last_peered":"2024-09-17T03:11:33.999986+0000","last_clean":"2024-09-17T03:11:33.999986+0000","last_became_active":"2024-09-17T03:11:31.902849+0000","last_became_peered":"2024-09-17T03:11:31.902849+0000","last_unstale":"2024-09-17T03:11:33.999986+0000","last_undegraded":"2024-09-17T03:11:33.999986+0000","last_fullsized":"2024-09-17T03:11:33.999986+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:24:35.589650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268665+0000","last_change":"2024-09-17T03:11:32.907821+0000","last_active":"2024-09-17T03:11:34.268665+0000","last_peered":"2024-09-17T03:11:34.268665+0000","last_clean":"2024-09-17T03:11:34.268665+0000","last_became_active":"2024-09-17T03:11:32.907272+0000","last_became_peered":"2024-09-17T03:11:32.907272+0000","last_unstale":"2024-09-17T03:11:34.268665+0000","last_undegraded":"2024-09-17T03:11:34.268665+0000","last_fullsized":"2024-09-17T03:11:34.268665+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:30.325043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.266980+0000","last_change":"2024-09-17T03:11:31.902264+0000","last_active":"2024-09-17T03:11:34.266980+0000","last_peered":"2024-09-17T03:11:34.266980+0000","last_clean":"2024-09-17T03:11:34.266980+0000","last_became_active":"2024-09-17T03:11:31.901925+0000","last_became_peered":"2024-09-17T03:11:31.901925+0000","last_unstale":"2024-09-17T03:11:34.266980+0000","last_undegraded":"2024-09-17T03:11:34.266980+0000","last_fullsized":"2024-09-17T03:11:34.266980+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:04.455792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.267664+0000","last_change":"2024-09-17T03:11:32.919195+0000","last_active":"2024-09-17T03:11:34.267664+0000","last_peered":"2024-09-17T03:11:34.267664+0000","last_clean":"2024-09-17T03:11:34.267664+0000","last_became_active":"2024-09-17T03:11:32.918810+0000","last_became_peered":"2024-09-17T03:11:32.918810+0000","last_unstale":"2024-09-17T03:11:34.267664+0000","last_undegraded":"2024-09-17T03:11:34.267664+0000","last_fullsized":"2024-09-17T03:11:34.267664+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:44.508396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.906540+0000","last_change":"2024-09-17T03:11:31.904832+0000","last_active":"2024-09-17T03:11:33.906540+0000","last_peered":"2024-09-17T03:11:33.906540+0000","last_clean":"2024-09-17T03:11:33.906540+0000","last_became_active":"2024-09-17T03:11:31.904491+0000","last_became_peered":"2024-09-17T03:11:31.904491+0000","last_unstale":"2024-09-17T03:11:33.906540+0000","last_undegraded":"2024-09-17T03:11:33.906540+0000","last_fullsized":"2024-09-17T03:11:33.906540+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:36:41.395655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.266901+0000","last_change":"2024-09-17T03:11:32.895042+0000","last_active":"2024-09-17T03:11:34.266901+0000","last_peered":"2024-09-17T03:11:34.266901+0000","last_clean":"2024-09-17T03:11:34.266901+0000","last_became_active":"2024-09-17T03:11:32.894779+0000","last_became_peered":"2024-09-17T03:11:32.894779+0000","last_unstale":"2024-09-17T03:11:34.266901+0000","last_undegraded":"2024-09-17T03:11:34.266901+0000","last_fullsized":"2024-09-17T03:11:34.266901+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:43.986942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.266824+0000","last_change":"2024-09-17T03:11:31.911498+0000","last_active":"2024-09-17T03:11:34.266824+0000","last_peered":"2024-09-17T03:11:34.266824+0000","last_clean":"2024-09-17T03:11:34.266824+0000","last_became_active":"2024-09-17T03:11:31.911117+0000","last_became_peered":"2024-09-17T03:11:31.911117+0000","last_unstale":"2024-09-17T03:11:34.266824+0000","last_undegraded":"2024-09-17T03:11:34.266824+0000","last_fullsized":"2024-09-17T03:11:34.266824+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:00:12.261137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268468+0000","last_change":"2024-09-17T03:11:32.908829+0000","last_active":"2024-09-17T03:11:34.268468+0000","last_peered":"2024-09-17T03:11:34.268468+0000","last_clean":"2024-09-17T03:11:34.268468+0000","last_became_active":"2024-09-17T03:11:32.908529+0000","last_became_peered":"2024-09-17T03:11:32.908529+0000","last_unstale":"2024-09-17T03:11:34.268468+0000","last_undegraded":"2024-09-17T03:11:34.268468+0000","last_fullsized":"2024-09-17T03:11:34.268468+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:07.660856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268609+0000","last_change":"2024-09-17T03:11:31.909911+0000","last_active":"2024-09-17T03:11:34.268609+0000","last_peered":"2024-09-17T03:11:34.268609+0000","last_clean":"2024-09-17T03:11:34.268609+0000","last_became_active":"2024-09-17T03:11:31.909497+0000","last_became_peered":"2024-09-17T03:11:31.909497+0000","last_unstale":"2024-09-17T03:11:34.268609+0000","last_undegraded":"2024-09-17T03:11:34.268609+0000","last_fullsized":"2024-09-17T03:11:34.268609+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:32.685040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.268459+0000","last_change":"2024-09-17T03:11:32.909203+0000","last_active":"2024-09-17T03:11:34.268459+0000","last_peered":"2024-09-17T03:11:34.268459+0000","last_clean":"2024-09-17T03:11:34.268459+0000","last_became_active":"2024-09-17T03:11:32.908643+0000","last_became_peered":"2024-09-17T03:11:32.908643+0000","last_unstale":"2024-09-17T03:11:34.268459+0000","last_undegraded":"2024-09-17T03:11:34.268459+0000","last_fullsized":"2024-09-17T03:11:34.268459+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:31.877437+0000","last_clean_scrub_stamp":"2024-09-17T03:11:31.877437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:09:17.380280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:33.905335+0000","last_change":"2024-09-17T03:11:31.901890+0000","last_active":"2024-09-17T03:11:33.905335+0000","last_peered":"2024-09-17T03:11:33.905335+0000","last_clean":"2024-09-17T03:11:33.905335+0000","last_became_active":"2024-09-17T03:11:31.901372+0000","last_became_peered":"2024-09-17T03:11:31.901372+0000","last_unstale":"2024-09-17T03:11:33.905335+0000","last_undegraded":"2024-09-17T03:11:33.905335+0000","last_fullsized":"2024-09-17T03:11:33.905335+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:11:30.875300+0000","last_clean_scrub_stamp":"2024-09-17T03:11:30.875300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:08.995683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":174,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T03:11:34.266997+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:11:34.266997+0000","last_peered":"2024-09-17T03:11:34.266997+0000","last_clean":"2024-09-17T03:11:34.266997+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:11:34.266997+0000","last_undegraded":"2024-09-17T03:11:34.266997+0000","last_fullsized":"2024-09-17T03:11:34.266997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509484,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28288,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343552,"statfs":{"total":96636764160,"available":96607797248,"internally_reserved":0,"allocated":1290240,"data_stored":876369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509484,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31860,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339980,"statfs":{"total":96636764160,"available":96604139520,"internally_reserved":0,"allocated":688128,"data_stored":285841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":696320,"data_stored":286493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509484,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":700416,"data_stored":287453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509485,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27712,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344128,"statfs":{"total":96636764160,"available":96608387072,"internally_reserved":0,"allocated":696320,"data_stored":285897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509484,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":692224,"data_stored":285931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509484,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28300,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343540,"statfs":{"total":96636764160,"available":96607784960,"internally_reserved":0,"allocated":1298432,"data_stored":878403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31876,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339964,"statfs":{"total":96636764160,"available":96604123136,"internally_reserved":0,"allocated":696320,"data_stored":285897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:11:40.691 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:11:40.692 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:11:40.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.849+0000 7fb17ea5c640 1 -- 172.21.15.78:0/3274703983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1780d43c0 msgr2=0x7fb1780d47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:40.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.849+0000 7fb17ea5c640 1 --2- 172.21.15.78:0/3274703983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1780d43c0 0x7fb1780d47d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fb1780b7190 tx=0x7fb16802a5f0 comp rx=0 tx=0).stop 2024-09-17T03:11:40.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.849+0000 7fb17ea5c640 1 -- 172.21.15.78:0/3274703983 shutdown_connections 2024-09-17T03:11:40.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.849+0000 7fb17ea5c640 1 --2- 172.21.15.78:0/3274703983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1780d43c0 0x7fb1780d47d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:40.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.849+0000 7fb17ea5c640 1 --2- 172.21.15.78:0/3274703983 >> v2:172.21.15.193:3300/0 conn(0x7fb1780b39a0 0x7fb1780b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:40.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.849+0000 7fb17ea5c640 1 -- 172.21.15.78:0/3274703983 >> 172.21.15.78:0/3274703983 conn(0x7fb17808bfc0 msgr2=0x7fb17809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:40.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.849+0000 7fb17ea5c640 1 -- 172.21.15.78:0/3274703983 shutdown_connections 2024-09-17T03:11:40.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.849+0000 7fb17ea5c640 1 -- 172.21.15.78:0/3274703983 wait complete. 2024-09-17T03:11:40.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.851+0000 7fb17ea5c640 1 Processor -- start 2024-09-17T03:11:40.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.851+0000 7fb17ea5c640 1 -- start start 2024-09-17T03:11:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb17ea5c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1780b39a0 0x7fb1781f6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb17ea5c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb1780b4850 0x7fb1781d77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb17ea5c640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb1780d43c0 0x7fb1780cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb17ea5c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb1780b96d0 con 0x7fb1780b39a0 2024-09-17T03:11:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb17ea5c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb1780b9550 con 0x7fb1780b4850 2024-09-17T03:11:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb17ea5c640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb1780b9850 con 0x7fb1780d43c0 2024-09-17T03:11:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb177fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1780b39a0 0x7fb1781f6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb177fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1780b39a0 0x7fb1781f6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50844/0 (socket says 172.21.15.78:50844) 2024-09-17T03:11:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb177fff640 1 -- 172.21.15.78:0/312785983 learned_addr learned my addr 172.21.15.78:0/312785983 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:40.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb1777fe640 1 --2- 172.21.15.78:0/312785983 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb1780b4850 0x7fb1781d77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb17cff9640 1 --2- 172.21.15.78:0/312785983 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb1780d43c0 0x7fb1780cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb177fff640 1 -- 172.21.15.78:0/312785983 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb1780d43c0 msgr2=0x7fb1780cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb177fff640 1 --2- 172.21.15.78:0/312785983 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb1780d43c0 0x7fb1780cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb177fff640 1 -- 172.21.15.78:0/312785983 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb1780b4850 msgr2=0x7fb1781d77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb177fff640 1 --2- 172.21.15.78:0/312785983 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb1780b4850 0x7fb1781d77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb177fff640 1 -- 172.21.15.78:0/312785983 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1780c8240 con 0x7fb1780b39a0 2024-09-17T03:11:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb1777fe640 1 --2- 172.21.15.78:0/312785983 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb1780b4850 0x7fb1781d77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb17cff9640 1 --2- 172.21.15.78:0/312785983 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb1780d43c0 0x7fb1780cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb177fff640 1 --2- 172.21.15.78:0/312785983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1780b39a0 0x7fb1781f6830 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fb16000d740 tx=0x7fb16000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb174ff9640 1 -- 172.21.15.78:0/312785983 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160009c30 con 0x7fb1780b39a0 2024-09-17T03:11:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb174ff9640 1 -- 172.21.15.78:0/312785983 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb16000de50 con 0x7fb1780b39a0 2024-09-17T03:11:40.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb17ea5c640 1 -- 172.21.15.78:0/312785983 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1780c8520 con 0x7fb1780b39a0 2024-09-17T03:11:40.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.853+0000 7fb174ff9640 1 -- 172.21.15.78:0/312785983 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb160004280 con 0x7fb1780b39a0 2024-09-17T03:11:40.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.854+0000 7fb17ea5c640 1 -- 172.21.15.78:0/312785983 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1781f6310 con 0x7fb1780b39a0 2024-09-17T03:11:40.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.855+0000 7fb17ea5c640 1 -- 172.21.15.78:0/312785983 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1780cf700 con 0x7fb1780b39a0 2024-09-17T03:11:40.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.855+0000 7fb174ff9640 1 -- 172.21.15.78:0/312785983 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb160005030 con 0x7fb1780b39a0 2024-09-17T03:11:40.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.856+0000 7fb174ff9640 1 --2- 172.21.15.78:0/312785983 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb158078b90 0x7fb15807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:40.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.856+0000 7fb174ff9640 1 -- 172.21.15.78:0/312785983 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fb16009b3f0 con 0x7fb1780b39a0 2024-09-17T03:11:40.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.856+0000 7fb1777fe640 1 --2- 172.21.15.78:0/312785983 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb158078b90 0x7fb15807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:40.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.856+0000 7fb1777fe640 1 --2- 172.21.15.78:0/312785983 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb158078b90 0x7fb15807b0a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb168033000 tx=0x7fb168004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:40.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:40.860+0000 7fb174ff9640 1 -- 172.21.15.78:0/312785983 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb1780cf700 con 0x7fb1780b39a0 2024-09-17T03:11:41.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.107+0000 7fb17ea5c640 1 -- 172.21.15.78:0/312785983 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fb1780b3db0 con 0x7fb1780b39a0 2024-09-17T03:11:41.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.110+0000 7fb174ff9640 1 -- 172.21.15.78:0/312785983 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7fb160020020 con 0x7fb1780b39a0 2024-09-17T03:11:41.109 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2024-09-17T03:11:41.109 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBv8uhmn+c/IxAALXG+Qkwye7zc6PjcLBsk1g== 2024-09-17T03:11:41.109 INFO:teuthology.orchestra.run.smithi078.stdout: caps mds = "allow" 2024-09-17T03:11:41.109 INFO:teuthology.orchestra.run.smithi078.stdout: caps mon = "allow r" 2024-09-17T03:11:41.109 INFO:teuthology.orchestra.run.smithi078.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:11:41.109 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2024-09-17T03:11:41.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.112+0000 7fb17ea5c640 1 -- 172.21.15.78:0/312785983 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb158078b90 msgr2=0x7fb15807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:41.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.112+0000 7fb17ea5c640 1 --2- 172.21.15.78:0/312785983 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb158078b90 0x7fb15807b0a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb168033000 tx=0x7fb168004730 comp rx=0 tx=0).stop 2024-09-17T03:11:41.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.112+0000 7fb17ea5c640 1 -- 172.21.15.78:0/312785983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1780b39a0 msgr2=0x7fb1781f6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:41.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.112+0000 7fb17ea5c640 1 --2- 172.21.15.78:0/312785983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1780b39a0 0x7fb1781f6830 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fb16000d740 tx=0x7fb16000dc00 comp rx=0 tx=0).stop 2024-09-17T03:11:41.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.112+0000 7fb17ea5c640 1 -- 172.21.15.78:0/312785983 shutdown_connections 2024-09-17T03:11:41.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.112+0000 7fb17ea5c640 1 --2- 172.21.15.78:0/312785983 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb1780d43c0 0x7fb1780cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:41.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.112+0000 7fb17ea5c640 1 --2- 172.21.15.78:0/312785983 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb158078b90 0x7fb15807b0a0 secure :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb168033000 tx=0x7fb168004730 comp rx=0 tx=0).stop 2024-09-17T03:11:41.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.112+0000 7fb17ea5c640 1 --2- 172.21.15.78:0/312785983 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb1780b4850 0x7fb1781d77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:41.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.112+0000 7fb17ea5c640 1 --2- 172.21.15.78:0/312785983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb1780b39a0 0x7fb1781f6830 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:41.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.112+0000 7fb17ea5c640 1 -- 172.21.15.78:0/312785983 >> 172.21.15.78:0/312785983 conn(0x7fb17808bfc0 msgr2=0x7fb17806f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:41.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.112+0000 7fb17ea5c640 1 -- 172.21.15.78:0/312785983 shutdown_connections 2024-09-17T03:11:41.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.112+0000 7fb17ea5c640 1 -- 172.21.15.78:0/312785983 wait complete. 2024-09-17T03:11:41.123 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:11:41.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.238+0000 7fb6f8a27640 1 -- 172.21.15.78:0/2863282997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6e0003c10 msgr2=0x7fb6e0004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:41.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.238+0000 7fb6f8a27640 1 --2- 172.21.15.78:0/2863282997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6e0003c10 0x7fb6e0004060 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00c640 tx=0x7fb6e0005830 comp rx=0 tx=0).stop 2024-09-17T03:11:41.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.238+0000 7fb6f2d9d640 1 -- 172.21.15.78:0/2863282997 reap_dead start 2024-09-17T03:11:41.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.238+0000 7fb6f8a27640 1 -- 172.21.15.78:0/2863282997 shutdown_connections 2024-09-17T03:11:41.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.238+0000 7fb6f8a27640 1 -- 172.21.15.78:0/2863282997 >> 172.21.15.78:0/2863282997 conn(0x7fb6f409d7f0 msgr2=0x7fb6f40d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:41.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.238+0000 7fb6f8a27640 1 -- 172.21.15.78:0/2863282997 shutdown_connections 2024-09-17T03:11:41.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.238+0000 7fb6f8a27640 1 -- 172.21.15.78:0/2863282997 wait complete. 2024-09-17T03:11:41.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.240+0000 7fb6f8a27640 1 Processor -- start 2024-09-17T03:11:41.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.240+0000 7fb6f8a27640 1 -- start start 2024-09-17T03:11:41.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.241+0000 7fb6f8a27640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6e0003c10 0x7fb6f40b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:41.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.241+0000 7fb6f8a27640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6f41f9500 0x7fb6f40b2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:41.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.241+0000 7fb6f8a27640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6f40b2560 0x7fb6f41550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:41.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.241+0000 7fb6f8a27640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f40d5040 con 0x7fb6f40b2560 2024-09-17T03:11:41.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.241+0000 7fb6f8a27640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb6f40b68c0 con 0x7fb6e0003c10 2024-09-17T03:11:41.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.241+0000 7fb6f8a27640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb6f40b3710 con 0x7fb6f41f9500 2024-09-17T03:11:41.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.241+0000 7fb6f2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6f40b2560 0x7fb6f41550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:41.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.241+0000 7fb6f2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6f40b2560 0x7fb6f41550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50858/0 (socket says 172.21.15.78:50858) 2024-09-17T03:11:41.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.241+0000 7fb6f2d9d640 1 -- 172.21.15.78:0/1098557618 learned_addr learned my addr 172.21.15.78:0/1098557618 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:41.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.241+0000 7fb6f1d9b640 1 --2- 172.21.15.78:0/1098557618 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6f41f9500 0x7fb6f40b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:41.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.241+0000 7fb6f259c640 1 --2- 172.21.15.78:0/1098557618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6e0003c10 0x7fb6f40b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:41.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.241+0000 7fb6f2d9d640 1 -- 172.21.15.78:0/1098557618 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6f41f9500 msgr2=0x7fb6f40b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:41.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.241+0000 7fb6f2d9d640 1 --2- 172.21.15.78:0/1098557618 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6f41f9500 0x7fb6f40b2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:41.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.241+0000 7fb6f2d9d640 1 -- 172.21.15.78:0/1098557618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6e0003c10 msgr2=0x7fb6f40b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:41.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.241+0000 7fb6f2d9d640 1 --2- 172.21.15.78:0/1098557618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6e0003c10 0x7fb6f40b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:41.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.241+0000 7fb6f2d9d640 1 -- 172.21.15.78:0/1098557618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6f41f5260 con 0x7fb6f40b2560 2024-09-17T03:11:41.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.241+0000 7fb6f1d9b640 1 --2- 172.21.15.78:0/1098557618 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6f41f9500 0x7fb6f40b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:41.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.242+0000 7fb6f2d9d640 1 --2- 172.21.15.78:0/1098557618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6f40b2560 0x7fb6f41550e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40d3e10 tx=0x7fb6e4001800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:41.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.242+0000 7fb6eaffd640 1 -- 172.21.15.78:0/1098557618 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4004e60 con 0x7fb6f40b2560 2024-09-17T03:11:41.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.242+0000 7fb6eaffd640 1 -- 172.21.15.78:0/1098557618 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6e4011650 con 0x7fb6f40b2560 2024-09-17T03:11:41.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.242+0000 7fb6f8a27640 1 -- 172.21.15.78:0/1098557618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6f41f5520 con 0x7fb6f40b2560 2024-09-17T03:11:41.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.242+0000 7fb6eaffd640 1 -- 172.21.15.78:0/1098557618 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e4011aa0 con 0x7fb6f40b2560 2024-09-17T03:11:41.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.242+0000 7fb6f8a27640 1 -- 172.21.15.78:0/1098557618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6f41f5ae0 con 0x7fb6f40b2560 2024-09-17T03:11:41.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.243+0000 7fb6f8a27640 1 -- 172.21.15.78:0/1098557618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6f40c7dd0 con 0x7fb6f40b2560 2024-09-17T03:11:41.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.243+0000 7fb6eaffd640 1 -- 172.21.15.78:0/1098557618 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb6e4011c40 con 0x7fb6f40b2560 2024-09-17T03:11:41.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.244+0000 7fb6eaffd640 1 --2- 172.21.15.78:0/1098557618 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb6d4078b90 0x7fb6d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:41.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.244+0000 7fb6eaffd640 1 -- 172.21.15.78:0/1098557618 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fb6e409b560 con 0x7fb6f40b2560 2024-09-17T03:11:41.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.244+0000 7fb6f259c640 1 --2- 172.21.15.78:0/1098557618 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb6d4078b90 0x7fb6d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:41.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.245+0000 7fb6f259c640 1 --2- 172.21.15.78:0/1098557618 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb6d4078b90 0x7fb6d407b0a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec033000 tx=0x7fb6ec039040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:41.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.248+0000 7fb6eaffd640 1 -- 172.21.15.78:0/1098557618 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb6e40639a0 con 0x7fb6f40b2560 2024-09-17T03:11:41.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.455+0000 7fb6f8a27640 1 -- 172.21.15.78:0/1098557618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6f40b59b0 con 0x7fb6f40b2560 2024-09-17T03:11:41.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.456+0000 7fb6eaffd640 1 -- 172.21.15.78:0/1098557618 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5220 (secure 0 0 0) 0x7fb6e40632a0 con 0x7fb6f40b2560 2024-09-17T03:11:41.455 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:41.455 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":45,"btime":"2024-09-17T03:11:34:902558+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/33195895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":33195895},{"type":"v1","addr":"172.21.15.193:6836","nonce":33195895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5758,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1865992966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1865992966},{"type":"v1","addr":"172.21.15.78:6835","nonce":1865992966}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5773,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/2730762656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2730762656},{"type":"v1","addr":"172.21.15.193:6837","nonce":2730762656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:11:32.250686+0000","modified":"2024-09-17T03:11:34.255718+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6231},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6231":{"gid":6231,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6834/936871583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":936871583},{"type":"v1","addr":"172.21.15.78:6834","nonce":936871583}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6231,"qdb_cluster":[6231]},"id":4}]} 2024-09-17T03:11:41.455 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 45 2024-09-17T03:11:41.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.458+0000 7fb6f8a27640 1 -- 172.21.15.78:0/1098557618 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb6d4078b90 msgr2=0x7fb6d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:41.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.458+0000 7fb6f8a27640 1 --2- 172.21.15.78:0/1098557618 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb6d4078b90 0x7fb6d407b0a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec033000 tx=0x7fb6ec039040 comp rx=0 tx=0).stop 2024-09-17T03:11:41.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.458+0000 7fb6f8a27640 1 -- 172.21.15.78:0/1098557618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6f40b2560 msgr2=0x7fb6f41550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:41.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.458+0000 7fb6f8a27640 1 --2- 172.21.15.78:0/1098557618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6f40b2560 0x7fb6f41550e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40d3e10 tx=0x7fb6e4001800 comp rx=0 tx=0).stop 2024-09-17T03:11:41.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.458+0000 7fb6f8a27640 1 -- 172.21.15.78:0/1098557618 shutdown_connections 2024-09-17T03:11:41.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.458+0000 7fb6f8a27640 1 --2- 172.21.15.78:0/1098557618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6f40b2560 0x7fb6f41550e0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:41.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.458+0000 7fb6f8a27640 1 --2- 172.21.15.78:0/1098557618 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6f41f9500 0x7fb6f40b2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:41.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.458+0000 7fb6f8a27640 1 --2- 172.21.15.78:0/1098557618 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb6d4078b90 0x7fb6d407b0a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:41.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.458+0000 7fb6f8a27640 1 --2- 172.21.15.78:0/1098557618 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6e0003c10 0x7fb6f40b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:41.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.458+0000 7fb6f8a27640 1 -- 172.21.15.78:0/1098557618 >> 172.21.15.78:0/1098557618 conn(0x7fb6f409d7f0 msgr2=0x7fb6f406eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:41.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.458+0000 7fb6f8a27640 1 -- 172.21.15.78:0/1098557618 shutdown_connections 2024-09-17T03:11:41.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.458+0000 7fb6f8a27640 1 -- 172.21.15.78:0/1098557618 wait complete. 2024-09-17T03:11:41.871 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:11:32.250686+0000', 'modified': '2024-09-17T03:11:34.255718+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6231}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6231': {'gid': 6231, 'name': 'c', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6834/936871583', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6832', 'nonce': 936871583}, {'type': 'v1', 'addr': '172.21.15.78:6834', 'nonce': 936871583}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6231, 'qdb_cluster': [6231]} 2024-09-17T03:11:41.871 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:11:41.871 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:11:41.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.987+0000 7f00b687e640 1 -- 172.21.15.78:0/212228169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00b0153970 msgr2=0x7f00b015d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:41.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.987+0000 7f00b687e640 1 --2- 172.21.15.78:0/212228169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00b0153970 0x7f00b015d810 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f00b006e840 tx=0x7f00a002a560 comp rx=0 tx=0).stop 2024-09-17T03:11:41.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.987+0000 7f00b687e640 1 -- 172.21.15.78:0/212228169 shutdown_connections 2024-09-17T03:11:41.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.987+0000 7f00b687e640 1 --2- 172.21.15.78:0/212228169 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f00b0073e50 0x7f00b0074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:41.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.987+0000 7f00b687e640 1 --2- 172.21.15.78:0/212228169 >> v2:172.21.15.193:3300/0 conn(0x7f00b00cfc00 0x7f00b00ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:41.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.987+0000 7f00b687e640 1 --2- 172.21.15.78:0/212228169 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00b0153970 0x7f00b015d810 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:41.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.987+0000 7f00b687e640 1 -- 172.21.15.78:0/212228169 >> 172.21.15.78:0/212228169 conn(0x7f00b00d15f0 msgr2=0x7f00b0073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:41.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.987+0000 7f00b687e640 1 -- 172.21.15.78:0/212228169 shutdown_connections 2024-09-17T03:11:41.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.987+0000 7f00b687e640 1 -- 172.21.15.78:0/212228169 wait complete. 2024-09-17T03:11:41.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.989+0000 7f00b687e640 1 Processor -- start 2024-09-17T03:11:41.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.989+0000 7f00b687e640 1 -- start start 2024-09-17T03:11:41.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.990+0000 7f00b687e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f00b0073e50 0x7f00b0141b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:41.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.990+0000 7f00b687e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00b00cfc00 0x7f00b015a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:41.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.990+0000 7f00b687e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00b0153970 0x7f00b00b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:41.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.990+0000 7f00b687e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f00b015e0d0 con 0x7f00b0153970 2024-09-17T03:11:41.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.990+0000 7f00b687e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f00b015df50 con 0x7f00b00cfc00 2024-09-17T03:11:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.990+0000 7f00b687e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f00b015e250 con 0x7f00b0073e50 2024-09-17T03:11:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.990+0000 7f00b4e1b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00b0153970 0x7f00b00b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.991+0000 7f00b4e1b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00b0153970 0x7f00b00b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50878/0 (socket says 172.21.15.78:50878) 2024-09-17T03:11:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.991+0000 7f00b4e1b640 1 -- 172.21.15.78:0/2610607965 learned_addr learned my addr 172.21.15.78:0/2610607965 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.991+0000 7f00af7fe640 1 --2- 172.21.15.78:0/2610607965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00b00cfc00 0x7f00b015a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.991+0000 7f00affff640 1 --2- 172.21.15.78:0/2610607965 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f00b0073e50 0x7f00b0141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.991+0000 7f00b4e1b640 1 -- 172.21.15.78:0/2610607965 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f00b0073e50 msgr2=0x7f00b0141b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.991+0000 7f00b4e1b640 1 --2- 172.21.15.78:0/2610607965 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f00b0073e50 0x7f00b0141b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.991+0000 7f00b4e1b640 1 -- 172.21.15.78:0/2610607965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00b00cfc00 msgr2=0x7f00b015a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.991+0000 7f00b4e1b640 1 --2- 172.21.15.78:0/2610607965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00b00cfc00 0x7f00b015a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.991+0000 7f00b4e1b640 1 -- 172.21.15.78:0/2610607965 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b0142070 con 0x7f00b0153970 2024-09-17T03:11:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.991+0000 7f00b4e1b640 1 --2- 172.21.15.78:0/2610607965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00b0153970 0x7f00b00b3a60 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f00a800ea80 tx=0x7f00a800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.991+0000 7f00acff9640 1 -- 172.21.15.78:0/2610607965 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004b20 con 0x7f00b0153970 2024-09-17T03:11:41.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.991+0000 7f00acff9640 1 -- 172.21.15.78:0/2610607965 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00a8004ce0 con 0x7f00b0153970 2024-09-17T03:11:41.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.991+0000 7f00b687e640 1 -- 172.21.15.78:0/2610607965 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b015a690 con 0x7f00b0153970 2024-09-17T03:11:41.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.991+0000 7f00acff9640 1 -- 172.21.15.78:0/2610607965 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8005280 con 0x7f00b0153970 2024-09-17T03:11:41.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.991+0000 7f00b687e640 1 -- 172.21.15.78:0/2610607965 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b0159390 con 0x7f00b0153970 2024-09-17T03:11:41.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.993+0000 7f00acff9640 1 -- 172.21.15.78:0/2610607965 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f00a8005420 con 0x7f00b0153970 2024-09-17T03:11:41.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.993+0000 7f00acff9640 1 --2- 172.21.15.78:0/2610607965 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f009c078b90 0x7f009c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:41.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.994+0000 7f00acff9640 1 -- 172.21.15.78:0/2610607965 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f00a809b890 con 0x7f00b0153970 2024-09-17T03:11:41.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.994+0000 7f00affff640 1 --2- 172.21.15.78:0/2610607965 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f009c078b90 0x7f009c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:41.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.994+0000 7f00affff640 1 --2- 172.21.15.78:0/2610607965 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f009c078b90 0x7f009c07b0a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f00a0033000 tx=0x7f00a0004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:41.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.995+0000 7f00bd7e7740 1 Processor -- start 2024-09-17T03:11:41.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.995+0000 7f00bd7e7740 1 -- start start 2024-09-17T03:11:41.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.996+0000 7f00bd7e7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df737b270 0x555df774cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:41.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.996+0000 7f00bd7e7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df73523b0 0x555df774d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:41.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.996+0000 7f00bd7e7740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555df735a590 0x555df776a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:41.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.996+0000 7f00bd7e7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x555df7695820 con 0x555df737b270 2024-09-17T03:11:41.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.996+0000 7f00bd7e7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555df7684c50 con 0x555df73523b0 2024-09-17T03:11:41.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.996+0000 7f00bd7e7740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x555df7688a60 con 0x555df735a590 2024-09-17T03:11:41.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.996+0000 7f00affff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df737b270 0x555df774cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:41.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.996+0000 7f00affff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df737b270 0x555df774cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50888/0 (socket says 172.21.15.78:50888) 2024-09-17T03:11:41.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.996+0000 7f00affff640 1 -- 172.21.15.78:0/4179083054 learned_addr learned my addr 172.21.15.78:0/4179083054 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:41.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.996+0000 7f00b4e1b640 1 --2- 172.21.15.78:0/4179083054 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555df735a590 0x555df776a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:41.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.996+0000 7f00af7fe640 1 --2- 172.21.15.78:0/4179083054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df73523b0 0x555df774d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:41.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.996+0000 7f00affff640 1 -- 172.21.15.78:0/4179083054 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555df735a590 msgr2=0x555df776a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:41.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.996+0000 7f00affff640 1 --2- 172.21.15.78:0/4179083054 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555df735a590 0x555df776a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:41.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.996+0000 7f00affff640 1 -- 172.21.15.78:0/4179083054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df73523b0 msgr2=0x555df774d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:41.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.996+0000 7f00affff640 1 --2- 172.21.15.78:0/4179083054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df73523b0 0x555df774d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:41.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.996+0000 7f00affff640 1 -- 172.21.15.78:0/4179083054 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555df73e6850 con 0x555df737b270 2024-09-17T03:11:41.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.996+0000 7f00af7fe640 1 --2- 172.21.15.78:0/4179083054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df73523b0 0x555df774d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:41.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.997+0000 7f00affff640 1 --2- 172.21.15.78:0/4179083054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df737b270 0x555df774cfa0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f00a0000c00 tx=0x7f00a003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a223b5d524614213 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:41.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.997+0000 7f0095ffb640 1 -- 172.21.15.78:0/4179083054 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a0035040 con 0x555df737b270 2024-09-17T03:11:41.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.997+0000 7f0095ffb640 1 -- 172.21.15.78:0/4179083054 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00a004e070 con 0x555df737b270 2024-09-17T03:11:41.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.997+0000 7f0095ffb640 1 -- 172.21.15.78:0/4179083054 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a0003be0 con 0x555df737b270 2024-09-17T03:11:41.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.998+0000 7f00bd7e7740 1 -- 172.21.15.78:0/4179083054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df737b270 msgr2=0x555df774cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:41.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.998+0000 7f00bd7e7740 1 --2- 172.21.15.78:0/4179083054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df737b270 0x555df774cfa0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f00a0000c00 tx=0x7f00a003d000 comp rx=0 tx=0).stop 2024-09-17T03:11:41.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.998+0000 7f00bd7e7740 1 -- 172.21.15.78:0/4179083054 shutdown_connections 2024-09-17T03:11:41.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.998+0000 7f00bd7e7740 1 --2- 172.21.15.78:0/4179083054 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555df735a590 0x555df776a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:41.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.998+0000 7f00bd7e7740 1 --2- 172.21.15.78:0/4179083054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df73523b0 0x555df774d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:41.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.998+0000 7f00bd7e7740 1 --2- 172.21.15.78:0/4179083054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df737b270 0x555df774cfa0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:41.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.998+0000 7f00bd7e7740 1 -- 172.21.15.78:0/4179083054 >> 172.21.15.78:0/4179083054 conn(0x555df736f3c0 msgr2=0x555df7723260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:41.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.998+0000 7f00bd7e7740 1 -- 172.21.15.78:0/4179083054 shutdown_connections 2024-09-17T03:11:41.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.998+0000 7f00bd7e7740 1 -- 172.21.15.78:0/4179083054 wait complete. 2024-09-17T03:11:42.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.998+0000 7f00bd7e7740 1 -- start start 2024-09-17T03:11:42.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:41.999+0000 7f00bd7e7740 1 Processor -- start 2024-09-17T03:11:42.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.000+0000 7f00bd7e7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df73523b0 0x555df7762d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:42.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.000+0000 7f00bd7e7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df735a590 0x555df775dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:42.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.000+0000 7f00bd7e7740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555df737b270 0x555df776a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:42.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.000+0000 7f00bd7e7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x555df73f5620 con 0x555df73523b0 2024-09-17T03:11:42.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.000+0000 7f00bd7e7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555df762a5f0 con 0x555df735a590 2024-09-17T03:11:42.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.000+0000 7f00bd7e7740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x555df774da20 con 0x555df737b270 2024-09-17T03:11:42.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.000+0000 7f00bd7e7740 10 client.0 _ll_register_callbacks cb 0x555df762e0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:42.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.000+0000 7f00affff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df73523b0 0x555df7762d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:42.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.000+0000 7f00affff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df73523b0 0x555df7762d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50904/0 (socket says 172.21.15.78:50904) 2024-09-17T03:11:42.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.000+0000 7f00affff640 1 -- 172.21.15.78:0/923868036 learned_addr learned my addr 172.21.15.78:0/923868036 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:42.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.000+0000 7f00af7fe640 1 --2- 172.21.15.78:0/923868036 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df735a590 0x555df775dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:42.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.000+0000 7f00b4e1b640 1 --2- 172.21.15.78:0/923868036 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555df737b270 0x555df776a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:42.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.000+0000 7f00affff640 1 -- 172.21.15.78:0/923868036 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555df737b270 msgr2=0x555df776a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:42.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.000+0000 7f00affff640 1 --2- 172.21.15.78:0/923868036 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555df737b270 0x555df776a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.000+0000 7f00affff640 1 -- 172.21.15.78:0/923868036 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df735a590 msgr2=0x555df775dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:42.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.000+0000 7f00affff640 1 --2- 172.21.15.78:0/923868036 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df735a590 0x555df775dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.000+0000 7f00affff640 1 -- 172.21.15.78:0/923868036 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555df745d6b0 con 0x555df73523b0 2024-09-17T03:11:42.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.001+0000 7f00affff640 1 --2- 172.21.15.78:0/923868036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df73523b0 0x555df7762d10 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f00a00099c0 tx=0x7f00a0003740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7575a18b25d9f7b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:42.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.001+0000 7f008effd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:42.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.001+0000 7f008effd640 1 -- 172.21.15.78:0/923868036 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a0035070 con 0x555df73523b0 2024-09-17T03:11:42.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.001+0000 7f008effd640 1 -- 172.21.15.78:0/923868036 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f00a0003ba0 con 0x555df73523b0 2024-09-17T03:11:42.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.001+0000 7f00bd7e7740 1 -- 172.21.15.78:0/923868036 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00a004e070 con 0x555df73523b0 2024-09-17T03:11:42.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.001+0000 7f008effd640 1 -- 172.21.15.78:0/923868036 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f00a0064050 con 0x555df73523b0 2024-09-17T03:11:42.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.001+0000 7f00bd7e7740 10 client.6399 fetch_fsmap learned FSMap version 45 2024-09-17T03:11:42.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.001+0000 7f00bd7e7740 1 -- 172.21.15.78:0/923868036 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) -- 0x555df775e2b0 con 0x555df73523b0 2024-09-17T03:11:42.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.001+0000 7f008effd640 1 -- 172.21.15.78:0/923868036 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00a004e070 con 0x555df73523b0 2024-09-17T03:11:42.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.001+0000 7f008effd640 1 -- 172.21.15.78:0/923868036 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 45) ==== 3502+0+0 (secure 0 0 0) 0x7f00a0067020 con 0x555df73523b0 2024-09-17T03:11:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.001+0000 7f00bd7e7740 10 client.6399 fetch_fsmap finished waiting for FSMap version 45 2024-09-17T03:11:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.001+0000 7f00bd7e7740 10 client.6399 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:11:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.001+0000 7f00bd7e7740 20 client.6399 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.001+0000 7f00bd7e7740 1 --2- 172.21.15.78:0/923868036 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x555df7339e40 0x555df7760c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.001+0000 7f00bd7e7740 4 client.6399 mds_command: new command op to 6231 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:11:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.001+0000 7f00bd7e7740 1 -- 172.21.15.78:0/923868036 --> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555df7697770 con 0x555df7339e40 2024-09-17T03:11:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.001+0000 7f00af7fe640 1 --2- 172.21.15.78:0/923868036 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x555df7339e40 0x555df7760c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.002+0000 7f008effd640 10 client.6399 ms_handle_connect on v2:172.21.15.78:6832/936871583 2024-09-17T03:11:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.002+0000 7f00af7fe640 1 --2- 172.21.15.78:0/923868036 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x555df7339e40 0x555df7760c50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c0bf65b3a876df7 server_cookie=7eb2d9e1a5336b89 in_seq=0 out_seq=0 2024-09-17T03:11:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.002+0000 7f008effd640 1 -- 172.21.15.78:0/923868036 <== mds.0 v2:172.21.15.78:6832/936871583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555df7697770 con 0x555df7339e40 2024-09-17T03:11:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.002+0000 7f008effd640 10 client.6399 handle_command_reply: tid=0 2024-09-17T03:11:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.002+0000 7f00bd7e7740 1 client.6399 shutdown 2024-09-17T03:11:42.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.003+0000 7f00bd7e7740 1 -- 172.21.15.78:0/923868036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df73523b0 msgr2=0x555df7762d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:42.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.003+0000 7f00bd7e7740 1 --2- 172.21.15.78:0/923868036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df73523b0 0x555df7762d10 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f00a00099c0 tx=0x7f00a0003740 comp rx=0 tx=0).stop 2024-09-17T03:11:42.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.003+0000 7f00bd7e7740 1 -- 172.21.15.78:0/923868036 shutdown_connections 2024-09-17T03:11:42.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.003+0000 7f00bd7e7740 1 --2- 172.21.15.78:0/923868036 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x555df7339e40 0x555df7760c50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.003+0000 7f00bd7e7740 1 --2- 172.21.15.78:0/923868036 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555df737b270 0x555df776a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.003+0000 7f00bd7e7740 1 --2- 172.21.15.78:0/923868036 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df735a590 0x555df775dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.003+0000 7f008effd640 0 client.6399 ms_handle_reset on v2:172.21.15.78:6832/936871583 2024-09-17T03:11:42.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.003+0000 7f00bd7e7740 1 --2- 172.21.15.78:0/923868036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df73523b0 0x555df7762d10 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.003+0000 7f00bd7e7740 1 -- 172.21.15.78:0/923868036 >> 172.21.15.78:0/923868036 conn(0x555df736f3c0 msgr2=0x555df77699b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:42.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.003+0000 7f00bd7e7740 1 -- 172.21.15.78:0/923868036 shutdown_connections 2024-09-17T03:11:42.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.003+0000 7f00bd7e7740 1 -- 172.21.15.78:0/923868036 wait complete. 2024-09-17T03:11:42.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.003+0000 7f00bd7e7740 20 client.6399 trim_cache size 0 max 16384 2024-09-17T03:11:42.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.021+0000 7f00bd7e7740 1 Processor -- start 2024-09-17T03:11:42.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.021+0000 7f00bd7e7740 1 -- start start 2024-09-17T03:11:42.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.022+0000 7f00bd7e7740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555df73523b0 0x555df776a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:42.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.022+0000 7f00bd7e7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df735a590 0x555df778a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:42.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.022+0000 7f00bd7e7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df737b270 0x555df7723670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:42.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.022+0000 7f00bd7e7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f00b01fefb0 con 0x555df737b270 2024-09-17T03:11:42.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.022+0000 7f00bd7e7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f00b01f3d40 con 0x555df735a590 2024-09-17T03:11:42.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.022+0000 7f00bd7e7740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f00b01f4390 con 0x555df73523b0 2024-09-17T03:11:42.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.023+0000 7f00b4e1b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df737b270 0x555df7723670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:42.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.023+0000 7f00b4e1b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df737b270 0x555df7723670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50914/0 (socket says 172.21.15.78:50914) 2024-09-17T03:11:42.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.023+0000 7f00b4e1b640 1 -- 172.21.15.78:0/1017564997 learned_addr learned my addr 172.21.15.78:0/1017564997 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:42.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.023+0000 7f00af7fe640 1 --2- 172.21.15.78:0/1017564997 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df735a590 0x555df778a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:42.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.023+0000 7f00affff640 1 --2- 172.21.15.78:0/1017564997 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555df73523b0 0x555df776a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:42.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.023+0000 7f00b4e1b640 1 -- 172.21.15.78:0/1017564997 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555df73523b0 msgr2=0x555df776a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:42.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.023+0000 7f00b4e1b640 1 --2- 172.21.15.78:0/1017564997 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555df73523b0 0x555df776a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.023+0000 7f00b4e1b640 1 -- 172.21.15.78:0/1017564997 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df735a590 msgr2=0x555df778a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:42.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.023+0000 7f00b4e1b640 1 --2- 172.21.15.78:0/1017564997 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df735a590 0x555df778a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.023+0000 7f00b4e1b640 1 -- 172.21.15.78:0/1017564997 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555df7722980 con 0x555df737b270 2024-09-17T03:11:42.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.023+0000 7f00b4e1b640 1 --2- 172.21.15.78:0/1017564997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df737b270 0x555df7723670 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f00a8099dc0 tx=0x7f00a8099d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a1eea0bbec1aee server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:42.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.023+0000 7f00957fa640 1 -- 172.21.15.78:0/1017564997 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8063230 con 0x555df737b270 2024-09-17T03:11:42.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.023+0000 7f00957fa640 1 -- 172.21.15.78:0/1017564997 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00a8068150 con 0x555df737b270 2024-09-17T03:11:42.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.023+0000 7f00957fa640 1 -- 172.21.15.78:0/1017564997 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a806d000 con 0x555df737b270 2024-09-17T03:11:42.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.024+0000 7f00bd7e7740 1 -- 172.21.15.78:0/1017564997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df737b270 msgr2=0x555df7723670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:42.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.024+0000 7f00bd7e7740 1 --2- 172.21.15.78:0/1017564997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df737b270 0x555df7723670 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f00a8099dc0 tx=0x7f00a8099d20 comp rx=0 tx=0).stop 2024-09-17T03:11:42.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.024+0000 7f00bd7e7740 1 -- 172.21.15.78:0/1017564997 shutdown_connections 2024-09-17T03:11:42.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.024+0000 7f00bd7e7740 1 --2- 172.21.15.78:0/1017564997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df737b270 0x555df7723670 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.024+0000 7f00bd7e7740 1 --2- 172.21.15.78:0/1017564997 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df735a590 0x555df778a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.024+0000 7f00bd7e7740 1 --2- 172.21.15.78:0/1017564997 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555df73523b0 0x555df776a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.024+0000 7f00bd7e7740 1 -- 172.21.15.78:0/1017564997 >> 172.21.15.78:0/1017564997 conn(0x555df736f3c0 msgr2=0x555df7749f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.024+0000 7f00bd7e7740 1 -- 172.21.15.78:0/1017564997 shutdown_connections 2024-09-17T03:11:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.024+0000 7f00bd7e7740 1 -- 172.21.15.78:0/1017564997 wait complete. 2024-09-17T03:11:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.025+0000 7f00bd7e7740 1 -- start start 2024-09-17T03:11:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.025+0000 7f00bd7e7740 1 Processor -- start 2024-09-17T03:11:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.026+0000 7f00bd7e7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df73523b0 0x555df77e6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.026+0000 7f00bd7e7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df735a590 0x555df773a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.026+0000 7f00bd7e7740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555df737b270 0x555df7720de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.026+0000 7f00bd7e7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x555df73f5620 con 0x555df73523b0 2024-09-17T03:11:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.026+0000 7f00bd7e7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555df762a5f0 con 0x555df735a590 2024-09-17T03:11:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.026+0000 7f00bd7e7740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x555df777a1c0 con 0x555df737b270 2024-09-17T03:11:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.026+0000 7f00bd7e7740 10 client.0 _ll_register_callbacks cb 0x7f00a8004ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:42.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.026+0000 7f00affff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df73523b0 0x555df77e6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:42.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.026+0000 7f00affff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df73523b0 0x555df77e6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50928/0 (socket says 172.21.15.78:50928) 2024-09-17T03:11:42.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.026+0000 7f00affff640 1 -- 172.21.15.78:0/2412345185 learned_addr learned my addr 172.21.15.78:0/2412345185 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:42.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.026+0000 7f00af7fe640 1 --2- 172.21.15.78:0/2412345185 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df735a590 0x555df773a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:42.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.027+0000 7f00b4e1b640 1 --2- 172.21.15.78:0/2412345185 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555df737b270 0x555df7720de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:42.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.027+0000 7f00affff640 1 -- 172.21.15.78:0/2412345185 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555df737b270 msgr2=0x555df7720de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:42.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.027+0000 7f00affff640 1 --2- 172.21.15.78:0/2412345185 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555df737b270 0x555df7720de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.027+0000 7f00affff640 1 -- 172.21.15.78:0/2412345185 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df735a590 msgr2=0x555df773a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:42.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.027+0000 7f00affff640 1 --2- 172.21.15.78:0/2412345185 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df735a590 0x555df773a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.027+0000 7f00affff640 1 -- 172.21.15.78:0/2412345185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555df7779550 con 0x555df73523b0 2024-09-17T03:11:42.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.027+0000 7f00affff640 1 --2- 172.21.15.78:0/2412345185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df73523b0 0x555df77e6f30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f00a0004650 tx=0x7f00a0009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fce05d17e8a421c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:42.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.027+0000 7f008effd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:42.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.027+0000 7f008effd640 1 -- 172.21.15.78:0/2412345185 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a0040070 con 0x555df73523b0 2024-09-17T03:11:42.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.027+0000 7f008effd640 1 -- 172.21.15.78:0/2412345185 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f00a0004bb0 con 0x555df73523b0 2024-09-17T03:11:42.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.027+0000 7f00bd7e7740 1 -- 172.21.15.78:0/2412345185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00a8068150 con 0x555df73523b0 2024-09-17T03:11:42.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.027+0000 7f008effd640 1 -- 172.21.15.78:0/2412345185 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f00a0075050 con 0x555df73523b0 2024-09-17T03:11:42.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.027+0000 7f00bd7e7740 10 client.6405 fetch_fsmap learned FSMap version 45 2024-09-17T03:11:42.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.027+0000 7f00bd7e7740 1 -- 172.21.15.78:0/2412345185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) -- 0x555df773abd0 con 0x555df73523b0 2024-09-17T03:11:42.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.027+0000 7f008effd640 1 -- 172.21.15.78:0/2412345185 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00a8068150 con 0x555df73523b0 2024-09-17T03:11:42.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.027+0000 7f008effd640 1 -- 172.21.15.78:0/2412345185 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 45) ==== 3502+0+0 (secure 0 0 0) 0x7f00a0078020 con 0x555df73523b0 2024-09-17T03:11:42.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.027+0000 7f00bd7e7740 10 client.6405 fetch_fsmap finished waiting for FSMap version 45 2024-09-17T03:11:42.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.028+0000 7f00bd7e7740 10 client.6405 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:11:42.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.028+0000 7f00bd7e7740 20 client.6405 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:42.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.028+0000 7f00bd7e7740 1 --2- 172.21.15.78:0/2412345185 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x555df7768d30 0x555df7775340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:42.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.028+0000 7f00bd7e7740 4 client.6405 mds_command: new command op to 6231 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:11:42.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.028+0000 7f00bd7e7740 1 -- 172.21.15.78:0/2412345185 --> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] -- command(tid 0: {"prefix": "status"}) -- 0x555df7693220 con 0x555df7768d30 2024-09-17T03:11:42.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.028+0000 7f00af7fe640 1 --2- 172.21.15.78:0/2412345185 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x555df7768d30 0x555df7775340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:42.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.028+0000 7f008effd640 10 client.6405 ms_handle_connect on v2:172.21.15.78:6832/936871583 2024-09-17T03:11:42.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.028+0000 7f00af7fe640 1 --2- 172.21.15.78:0/2412345185 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x555df7768d30 0x555df7775340 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48a7f85ff4a83ce0 server_cookie=2213aae66a23bebc in_seq=0 out_seq=0 2024-09-17T03:11:42.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.028+0000 7f008effd640 1 -- 172.21.15.78:0/2412345185 <== mds.0 v2:172.21.15.78:6832/936871583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x555df7693220 con 0x555df7768d30 2024-09-17T03:11:42.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.028+0000 7f008effd640 10 client.6405 handle_command_reply: tid=0 2024-09-17T03:11:42.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.028+0000 7f00bd7e7740 1 client.6405 shutdown 2024-09-17T03:11:42.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.028+0000 7f00bd7e7740 1 -- 172.21.15.78:0/2412345185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df73523b0 msgr2=0x555df77e6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:42.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.028+0000 7f00bd7e7740 1 --2- 172.21.15.78:0/2412345185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df73523b0 0x555df77e6f30 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f00a0004650 tx=0x7f00a0009810 comp rx=0 tx=0).stop 2024-09-17T03:11:42.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.028+0000 7f00bd7e7740 1 -- 172.21.15.78:0/2412345185 shutdown_connections 2024-09-17T03:11:42.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.028+0000 7f00bd7e7740 1 --2- 172.21.15.78:0/2412345185 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x555df7768d30 0x555df7775340 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.028+0000 7f00bd7e7740 1 --2- 172.21.15.78:0/2412345185 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555df737b270 0x555df7720de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.028+0000 7f00bd7e7740 1 --2- 172.21.15.78:0/2412345185 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555df735a590 0x555df773a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.028+0000 7f008effd640 0 client.6405 ms_handle_reset on v2:172.21.15.78:6832/936871583 2024-09-17T03:11:42.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.028+0000 7f00bd7e7740 1 --2- 172.21.15.78:0/2412345185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555df73523b0 0x555df77e6f30 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.028+0000 7f00bd7e7740 1 -- 172.21.15.78:0/2412345185 >> 172.21.15.78:0/2412345185 conn(0x555df736f3c0 msgr2=0x555df77234c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:42.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.029+0000 7f00bd7e7740 1 -- 172.21.15.78:0/2412345185 shutdown_connections 2024-09-17T03:11:42.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.029+0000 7f00bd7e7740 1 -- 172.21.15.78:0/2412345185 wait complete. 2024-09-17T03:11:42.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.029+0000 7f00bd7e7740 20 client.6405 trim_cache size 0 max 16384 2024-09-17T03:11:42.033 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:11:42.033 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:11:42.033 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-09-17T03:11:42.033 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 6231, 2024-09-17T03:11:42.033 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:11:42.033 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:11:42.033 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:11:42.034 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 9.1449526900000002, 2024-09-17T03:11:42.034 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 45, 2024-09-17T03:11:42.034 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 58, 2024-09-17T03:11:42.034 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 58, 2024-09-17T03:11:42.034 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 13.831739061 2024-09-17T03:11:42.034 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:11:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.029+0000 7f00b687e640 1 -- 172.21.15.78:0/2610607965 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f009c078b90 msgr2=0x7f009c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.029+0000 7f00b687e640 1 --2- 172.21.15.78:0/2610607965 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f009c078b90 0x7f009c07b0a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f00a0033000 tx=0x7f00a0004730 comp rx=0 tx=0).stop 2024-09-17T03:11:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.029+0000 7f00b687e640 1 -- 172.21.15.78:0/2610607965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00b0153970 msgr2=0x7f00b00b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.029+0000 7f00b687e640 1 --2- 172.21.15.78:0/2610607965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00b0153970 0x7f00b00b3a60 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f00a800ea80 tx=0x7f00a800ef40 comp rx=0 tx=0).stop 2024-09-17T03:11:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.029+0000 7f00b687e640 1 -- 172.21.15.78:0/2610607965 shutdown_connections 2024-09-17T03:11:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.029+0000 7f00b687e640 1 --2- 172.21.15.78:0/2610607965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00b0153970 0x7f00b00b3a60 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.029+0000 7f00b687e640 1 --2- 172.21.15.78:0/2610607965 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f009c078b90 0x7f009c07b0a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.029+0000 7f00b687e640 1 --2- 172.21.15.78:0/2610607965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00b00cfc00 0x7f00b015a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.029+0000 7f00b687e640 1 --2- 172.21.15.78:0/2610607965 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f00b0073e50 0x7f00b0141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.029+0000 7f00b687e640 1 -- 172.21.15.78:0/2610607965 >> 172.21.15.78:0/2610607965 conn(0x7f00b00d15f0 msgr2=0x7f00b014fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.029+0000 7f00b687e640 1 -- 172.21.15.78:0/2610607965 shutdown_connections 2024-09-17T03:11:42.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.029+0000 7f00b687e640 1 -- 172.21.15.78:0/2610607965 wait complete. 2024-09-17T03:11:42.039 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:11:42.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.152+0000 7fe8cd8b4640 1 -- 172.21.15.78:0/1956869942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8c806e170 msgr2=0x7fe8c80b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:42.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.152+0000 7fe8cd8b4640 1 --2- 172.21.15.78:0/1956869942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8c806e170 0x7fe8c80b3540 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8009be0 tx=0x7fe8b802a840 comp rx=0 tx=0).stop 2024-09-17T03:11:42.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.152+0000 7fe8cd8b4640 1 -- 172.21.15.78:0/1956869942 shutdown_connections 2024-09-17T03:11:42.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.152+0000 7fe8cd8b4640 1 --2- 172.21.15.78:0/1956869942 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe8c806f4b0 0x7fe8c80d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.152+0000 7fe8cd8b4640 1 --2- 172.21.15.78:0/1956869942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8c806e170 0x7fe8c80b3540 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.152+0000 7fe8cd8b4640 1 -- 172.21.15.78:0/1956869942 >> 172.21.15.78:0/1956869942 conn(0x7fe8c808bfc0 msgr2=0x7fe8c809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:42.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.152+0000 7fe8cd8b4640 1 -- 172.21.15.78:0/1956869942 shutdown_connections 2024-09-17T03:11:42.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.152+0000 7fe8cd8b4640 1 -- 172.21.15.78:0/1956869942 wait complete. 2024-09-17T03:11:42.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.154+0000 7fe8cd8b4640 1 Processor -- start 2024-09-17T03:11:42.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.154+0000 7fe8cd8b4640 1 -- start start 2024-09-17T03:11:42.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.155+0000 7fe8cd8b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8c806f4b0 0x7fe8c81e96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:42.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.155+0000 7fe8cd8b4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8c80d3870 0x7fe8c81f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:42.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.155+0000 7fe8cd8b4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe8c8153c90 0x7fe8c81f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:42.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.155+0000 7fe8cd8b4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c80d0e60 con 0x7fe8c806f4b0 2024-09-17T03:11:42.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.155+0000 7fe8cd8b4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c80d0ce0 con 0x7fe8c80d3870 2024-09-17T03:11:42.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.155+0000 7fe8cd8b4640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c80d0fe0 con 0x7fe8c8153c90 2024-09-17T03:11:42.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.155+0000 7fe8c6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8c806f4b0 0x7fe8c81e96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:42.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.155+0000 7fe8c6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8c806f4b0 0x7fe8c81e96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50950/0 (socket says 172.21.15.78:50950) 2024-09-17T03:11:42.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.155+0000 7fe8c6ffd640 1 -- 172.21.15.78:0/1518329875 learned_addr learned my addr 172.21.15.78:0/1518329875 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:42.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.156+0000 7fe8c77fe640 1 --2- 172.21.15.78:0/1518329875 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe8c8153c90 0x7fe8c81f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:42.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.156+0000 7fe8c67fc640 1 --2- 172.21.15.78:0/1518329875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8c80d3870 0x7fe8c81f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:42.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.156+0000 7fe8c6ffd640 1 -- 172.21.15.78:0/1518329875 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe8c8153c90 msgr2=0x7fe8c81f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:42.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.156+0000 7fe8c6ffd640 1 --2- 172.21.15.78:0/1518329875 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe8c8153c90 0x7fe8c81f4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.156+0000 7fe8c6ffd640 1 -- 172.21.15.78:0/1518329875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8c80d3870 msgr2=0x7fe8c81f47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:42.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.156+0000 7fe8c6ffd640 1 --2- 172.21.15.78:0/1518329875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8c80d3870 0x7fe8c81f47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.156+0000 7fe8c6ffd640 1 -- 172.21.15.78:0/1518329875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c81544e0 con 0x7fe8c806f4b0 2024-09-17T03:11:42.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.156+0000 7fe8c6ffd640 1 --2- 172.21.15.78:0/1518329875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8c806f4b0 0x7fe8c81e96c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8009be0 tx=0x7fe8b8033f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:42.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.156+0000 7fe8bffff640 1 -- 172.21.15.78:0/1518329875 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8042020 con 0x7fe8c806f4b0 2024-09-17T03:11:42.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.156+0000 7fe8bffff640 1 -- 172.21.15.78:0/1518329875 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8b8004130 con 0x7fe8c806f4b0 2024-09-17T03:11:42.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.156+0000 7fe8cd8b4640 1 -- 172.21.15.78:0/1518329875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c80cae60 con 0x7fe8c806f4b0 2024-09-17T03:11:42.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.156+0000 7fe8bffff640 1 -- 172.21.15.78:0/1518329875 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8037040 con 0x7fe8c806f4b0 2024-09-17T03:11:42.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.156+0000 7fe8cd8b4640 1 -- 172.21.15.78:0/1518329875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c81e8ec0 con 0x7fe8c806f4b0 2024-09-17T03:11:42.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.157+0000 7fe8cd8b4640 1 -- 172.21.15.78:0/1518329875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c806e170 con 0x7fe8c806f4b0 2024-09-17T03:11:42.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.158+0000 7fe8bffff640 1 -- 172.21.15.78:0/1518329875 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe8b8045020 con 0x7fe8c806f4b0 2024-09-17T03:11:42.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.158+0000 7fe8bffff640 1 --2- 172.21.15.78:0/1518329875 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe8a8078bc0 0x7fe8a807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:42.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.159+0000 7fe8bffff640 1 -- 172.21.15.78:0/1518329875 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fe8b80bbe90 con 0x7fe8c806f4b0 2024-09-17T03:11:42.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.159+0000 7fe8c67fc640 1 --2- 172.21.15.78:0/1518329875 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe8a8078bc0 0x7fe8a807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:42.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.159+0000 7fe8c67fc640 1 --2- 172.21.15.78:0/1518329875 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe8a8078bc0 0x7fe8a807b0d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0005fd0 tx=0x7fe8b0005850 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:42.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.163+0000 7fe8bffff640 1 -- 172.21.15.78:0/1518329875 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe8b804c030 con 0x7fe8c806f4b0 2024-09-17T03:11:42.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.374+0000 7fe8cd8b4640 1 -- 172.21.15.78:0/1518329875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe8c806efc0 con 0x7fe8c806f4b0 2024-09-17T03:11:42.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.374+0000 7fe8bffff640 1 -- 172.21.15.78:0/1518329875 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v45) ==== 53+0+73 (secure 0 0 0) 0x7fe8b802f070 con 0x7fe8c806f4b0 2024-09-17T03:11:42.373 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:11:42.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.377+0000 7fe8cd8b4640 1 -- 172.21.15.78:0/1518329875 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe8a8078bc0 msgr2=0x7fe8a807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:42.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.377+0000 7fe8cd8b4640 1 --2- 172.21.15.78:0/1518329875 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe8a8078bc0 0x7fe8a807b0d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0005fd0 tx=0x7fe8b0005850 comp rx=0 tx=0).stop 2024-09-17T03:11:42.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.377+0000 7fe8cd8b4640 1 -- 172.21.15.78:0/1518329875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8c806f4b0 msgr2=0x7fe8c81e96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:42.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.377+0000 7fe8cd8b4640 1 --2- 172.21.15.78:0/1518329875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8c806f4b0 0x7fe8c81e96c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8009be0 tx=0x7fe8b8033f00 comp rx=0 tx=0).stop 2024-09-17T03:11:42.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.377+0000 7fe8cd8b4640 1 -- 172.21.15.78:0/1518329875 shutdown_connections 2024-09-17T03:11:42.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.377+0000 7fe8cd8b4640 1 --2- 172.21.15.78:0/1518329875 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe8c8153c90 0x7fe8c81f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.377+0000 7fe8cd8b4640 1 --2- 172.21.15.78:0/1518329875 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe8a8078bc0 0x7fe8a807b0d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.377+0000 7fe8cd8b4640 1 --2- 172.21.15.78:0/1518329875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8c80d3870 0x7fe8c81f47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.377+0000 7fe8cd8b4640 1 --2- 172.21.15.78:0/1518329875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8c806f4b0 0x7fe8c81e96c0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:42.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.377+0000 7fe8cd8b4640 1 -- 172.21.15.78:0/1518329875 >> 172.21.15.78:0/1518329875 conn(0x7fe8c808bfc0 msgr2=0x7fe8c8161870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:42.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.377+0000 7fe8cd8b4640 1 -- 172.21.15.78:0/1518329875 shutdown_connections 2024-09-17T03:11:42.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42.377+0000 7fe8cd8b4640 1 -- 172.21.15.78:0/1518329875 wait complete. 2024-09-17T03:11:42.387 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:11:42.387 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:11:42.387 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2024-09-17T03:11:42.387 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:11:42.387 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:11:42.387 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:11:42.387 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:11:42.387 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:11:42.387 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:11:42.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:11:42.388 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2024-09-17T03:11:42.403 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:11:42.403 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:11:42.403 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:11:42.403 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:11:42.403 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2024-09-17T03:11:42.404 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:11:42.404 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:11:42.404 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:11:42.404 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2024-09-17T03:11:42.404 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:11:42.404 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:11:42.404 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2024-09-17T03:11:42.404 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:11:42.404 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:11:42.404 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:11:42.404 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:11:42.404 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:11:42.404 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42563sec preferred_lft 42563sec 2024-09-17T03:11:42.405 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link noprefixroute 2024-09-17T03:11:42.405 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:11:42.405 INFO:teuthology.orchestra.run.smithi078.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:11:42.405 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0e:9b:80:f7:8b:c2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:11:42.405 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:11:42.405 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:11:42.405 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::58a0:47ff:fe97:6de8/64 scope link 2024-09-17T03:11:42.405 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:11:42.405 INFO:teuthology.orchestra.run.smithi078.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:11:42.405 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether e6:fb:78:d9:ba:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:11:42.405 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::e4fb:78ff:fed9:ba75/64 scope link 2024-09-17T03:11:42.405 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:11:42.405 INFO:teuthology.orchestra.run.smithi078.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:11:42.405 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0e:9b:80:f7:8b:c2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:11:42.406 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::c9b:80ff:fef7:8bc2/64 scope link 2024-09-17T03:11:42.406 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:11:42.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:11:42.406 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:11:42.467 INFO:teuthology.orchestra.run.smithi078.stdout:1 2024-09-17T03:11:42.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:11:42.468 DEBUG:teuthology.orchestra.run.smithi078:> route 2024-09-17T03:11:42.525 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2024-09-17T03:11:42.525 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:11:42.525 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:11:42.525 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:11:42.525 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:11:42.525 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:11:42.525 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-17T03:11:42.526 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:11:42.526 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:11:42.526 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:11:42.526 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-17T03:11:42.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:11:42.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:11:42.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:11:42.651 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-17T03:11:42.666 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:11:42.666 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:11:42.666 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:11:42.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:11:42.667 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2024-09-17T03:11:42.731 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:11:42.731 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:11:42.787 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:11:42.787 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:11:42.787 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:11:42.843 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:11:42.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:11:42.843 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:11:42.938 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:11:42.938 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:11:42.939 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:11:42.949 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:11:42.949 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:11:42.949 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:11:42.949 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-09-17T03:11:42.949 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:11:42.955 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:11:42.955 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:11:42.956 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:11:42.956 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-09-17T03:11:42.956 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:11:42.956 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:6789,172.21.15.193:6789,172.21.15.193:6790" 2024-09-17T03:11:42.956 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.78:6789,172.21.15.193:6789,172.21.15.193:6790:/ 2024-09-17T03:11:42.956 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f3c59ba9-dab4-4ee6-8989-d80d11d430b6" will pass to kernel 2024-09-17T03:11:42.956 INFO:teuthology.orchestra.run.smithi078.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:11:42.956 INFO:teuthology.orchestra.run.smithi078.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:11:42.957 INFO:teuthology.orchestra.run.smithi078.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:11:42.957 INFO:teuthology.orchestra.run.smithi078.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:11:42.957 INFO:teuthology.orchestra.run.smithi078.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:11:42.958 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:11:42.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:11:42.958 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:11:42.983 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:11:43.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:11:43.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:11:43.084 INFO:teuthology.orchestra.run.smithi078.stdout:client5893 2024-09-17T03:11:43.084 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:11:43.084 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:11:43.100 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-17T03:11:43.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.259+0000 7f07146a9640 1 -- 172.21.15.78:0/2962364556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06f8004800 msgr2=0x7f06f8004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:43.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.259+0000 7f07146a9640 1 --2- 172.21.15.78:0/2962364556 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f06f8004800 0x7f06f8004c10 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00c260 tx=0x7f06f8005830 comp rx=0 tx=0).stop 2024-09-17T03:11:43.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.259+0000 7f0712c46640 1 -- 172.21.15.78:0/2962364556 reap_dead start 2024-09-17T03:11:43.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.259+0000 7f07146a9640 1 -- 172.21.15.78:0/2962364556 shutdown_connections 2024-09-17T03:11:43.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.259+0000 7f07146a9640 1 -- 172.21.15.78:0/2962364556 >> 172.21.15.78:0/2962364556 conn(0x7f070c0710b0 msgr2=0x7f070c0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:43.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.259+0000 7f07146a9640 1 -- 172.21.15.78:0/2962364556 shutdown_connections 2024-09-17T03:11:43.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.259+0000 7f07146a9640 1 -- 172.21.15.78:0/2962364556 wait complete. 2024-09-17T03:11:43.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.261+0000 7f07146a9640 1 Processor -- start 2024-09-17T03:11:43.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.261+0000 7f07146a9640 1 -- start start 2024-09-17T03:11:43.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.262+0000 7f07146a9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06f8004800 0x7f070c06f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:43.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.262+0000 7f07146a9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f070c15f5a0 0x7f070c143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:43.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.262+0000 7f07146a9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f070c1439a0 0x7f070c1f4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:43.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.262+0000 7f07146a9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f070c0d06d0 con 0x7f070c1439a0 2024-09-17T03:11:43.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.262+0000 7f07146a9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f070c15c960 con 0x7f06f8004800 2024-09-17T03:11:43.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.262+0000 7f07146a9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f070c0d0850 con 0x7f070c15f5a0 2024-09-17T03:11:43.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.262+0000 7f0712c46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f070c1439a0 0x7f070c1f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:43.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.262+0000 7f0712c46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f070c1439a0 0x7f070c1f4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50958/0 (socket says 172.21.15.78:50958) 2024-09-17T03:11:43.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.262+0000 7f0712c46640 1 -- 172.21.15.78:0/3526839857 learned_addr learned my addr 172.21.15.78:0/3526839857 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:43.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.262+0000 7f0712445640 1 --2- 172.21.15.78:0/3526839857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06f8004800 0x7f070c06f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:43.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.262+0000 7f0711c44640 1 --2- 172.21.15.78:0/3526839857 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f070c15f5a0 0x7f070c143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:43.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.263+0000 7f0712c46640 1 -- 172.21.15.78:0/3526839857 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f070c15f5a0 msgr2=0x7f070c143460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:43.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.263+0000 7f0712c46640 1 --2- 172.21.15.78:0/3526839857 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f070c15f5a0 0x7f070c143460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:43.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.263+0000 7f0712c46640 1 -- 172.21.15.78:0/3526839857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06f8004800 msgr2=0x7f070c06f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:43.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.263+0000 7f0712c46640 1 --2- 172.21.15.78:0/3526839857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06f8004800 0x7f070c06f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:43.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.263+0000 7f0712c46640 1 -- 172.21.15.78:0/3526839857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070c1e6210 con 0x7f070c1439a0 2024-09-17T03:11:43.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.263+0000 7f0712c46640 1 --2- 172.21.15.78:0/3526839857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f070c1439a0 0x7f070c1f4300 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f070c074f60 tx=0x7f070400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:43.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.263+0000 7f0702ffd640 1 -- 172.21.15.78:0/3526839857 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0704003d80 con 0x7f070c1439a0 2024-09-17T03:11:43.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.263+0000 7f0702ffd640 1 -- 172.21.15.78:0/3526839857 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0704004b20 con 0x7f070c1439a0 2024-09-17T03:11:43.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.263+0000 7f0702ffd640 1 -- 172.21.15.78:0/3526839857 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0704004030 con 0x7f070c1439a0 2024-09-17T03:11:43.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.263+0000 7f07146a9640 1 -- 172.21.15.78:0/3526839857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f070c1e64f0 con 0x7f070c1439a0 2024-09-17T03:11:43.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.263+0000 7f07146a9640 1 -- 172.21.15.78:0/3526839857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f070c06ebe0 con 0x7f070c1439a0 2024-09-17T03:11:43.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.264+0000 7f07146a9640 1 -- 172.21.15.78:0/3526839857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f070c15cae0 con 0x7f070c1439a0 2024-09-17T03:11:43.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.265+0000 7f0702ffd640 1 -- 172.21.15.78:0/3526839857 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f07040041d0 con 0x7f070c1439a0 2024-09-17T03:11:43.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.265+0000 7f0702ffd640 1 --2- 172.21.15.78:0/3526839857 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f06f0078bc0 0x7f06f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:43.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.265+0000 7f0702ffd640 1 -- 172.21.15.78:0/3526839857 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f070409ba20 con 0x7f070c1439a0 2024-09-17T03:11:43.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.265+0000 7f0712445640 1 --2- 172.21.15.78:0/3526839857 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f06f0078bc0 0x7f06f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:43.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.266+0000 7f0712445640 1 --2- 172.21.15.78:0/3526839857 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f06f0078bc0 0x7f06f007b0d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0708005e00 tx=0x7f0708005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:43.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.270+0000 7f0702ffd640 1 -- 172.21.15.78:0/3526839857 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0704063810 con 0x7f070c1439a0 2024-09-17T03:11:43.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:43.480+0000 7f07146a9640 1 -- 172.21.15.78:0/3526839857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f070c15b620 con 0x7f070c1439a0 2024-09-17T03:11:44.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.237+0000 7f0702ffd640 1 -- 172.21.15.78:0/3526839857 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v46) ==== 105+0+0 (secure 0 0 0) 0x7f0704068240 con 0x7f070c1439a0 2024-09-17T03:11:44.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.241+0000 7f07146a9640 1 -- 172.21.15.78:0/3526839857 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f06f0078bc0 msgr2=0x7f06f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:44.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.241+0000 7f07146a9640 1 --2- 172.21.15.78:0/3526839857 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f06f0078bc0 0x7f06f007b0d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0708005e00 tx=0x7f0708005f90 comp rx=0 tx=0).stop 2024-09-17T03:11:44.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.241+0000 7f07146a9640 1 -- 172.21.15.78:0/3526839857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f070c1439a0 msgr2=0x7f070c1f4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:44.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.241+0000 7f07146a9640 1 --2- 172.21.15.78:0/3526839857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f070c1439a0 0x7f070c1f4300 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f070c074f60 tx=0x7f070400f790 comp rx=0 tx=0).stop 2024-09-17T03:11:44.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.241+0000 7f07146a9640 1 -- 172.21.15.78:0/3526839857 shutdown_connections 2024-09-17T03:11:44.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.241+0000 7f07146a9640 1 --2- 172.21.15.78:0/3526839857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f070c1439a0 0x7f070c1f4300 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:44.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.241+0000 7f07146a9640 1 --2- 172.21.15.78:0/3526839857 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f070c15f5a0 0x7f070c143460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:44.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.241+0000 7f07146a9640 1 --2- 172.21.15.78:0/3526839857 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f06f0078bc0 0x7f06f007b0d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:44.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.241+0000 7f07146a9640 1 --2- 172.21.15.78:0/3526839857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06f8004800 0x7f070c06f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:44.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.241+0000 7f07146a9640 1 -- 172.21.15.78:0/3526839857 >> 172.21.15.78:0/3526839857 conn(0x7f070c0710b0 msgr2=0x7f070c15bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:44.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.241+0000 7f07146a9640 1 -- 172.21.15.78:0/3526839857 shutdown_connections 2024-09-17T03:11:44.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.241+0000 7f07146a9640 1 -- 172.21.15.78:0/3526839857 wait complete. 2024-09-17T03:11:44.256 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:11:44.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.371+0000 7f6127e8b640 1 -- 172.21.15.78:0/3205051315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61201600b0 msgr2=0x7f61200ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:44.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.371+0000 7f6127e8b640 1 --2- 172.21.15.78:0/3205051315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61201600b0 0x7f61200ccbc0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f6120074af0 tx=0x7f611002a500 comp rx=0 tx=0).stop 2024-09-17T03:11:44.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.371+0000 7f6127e8b640 1 -- 172.21.15.78:0/3205051315 shutdown_connections 2024-09-17T03:11:44.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.371+0000 7f6127e8b640 1 --2- 172.21.15.78:0/3205051315 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f61200cf320 0x7f61200d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:44.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.371+0000 7f6127e8b640 1 --2- 172.21.15.78:0/3205051315 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61201600b0 0x7f61200ccbc0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:44.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.371+0000 7f6127e8b640 1 -- 172.21.15.78:0/3205051315 >> 172.21.15.78:0/3205051315 conn(0x7f612006d4f0 msgr2=0x7f6120071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:44.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.371+0000 7f6127e8b640 1 -- 172.21.15.78:0/3205051315 shutdown_connections 2024-09-17T03:11:44.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.371+0000 7f6127e8b640 1 -- 172.21.15.78:0/3205051315 wait complete. 2024-09-17T03:11:44.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.373+0000 7f6127e8b640 1 Processor -- start 2024-09-17T03:11:44.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.373+0000 7f6127e8b640 1 -- start start 2024-09-17T03:11:44.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.374+0000 7f6127e8b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61200b7cc0 0x7f612014d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:44.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.374+0000 7f6127e8b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f61200cf320 0x7f61201f7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:44.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.374+0000 7f6127e8b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f61201600b0 0x7f61201f77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:44.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.374+0000 7f6127e8b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f61200d1410 con 0x7f61200b7cc0 2024-09-17T03:11:44.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.374+0000 7f6127e8b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f61200d1290 con 0x7f61201600b0 2024-09-17T03:11:44.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.374+0000 7f6127e8b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f61200d1590 con 0x7f61200cf320 2024-09-17T03:11:44.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.374+0000 7f6125c27640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61200b7cc0 0x7f612014d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:44.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.374+0000 7f6125c27640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61200b7cc0 0x7f612014d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50970/0 (socket says 172.21.15.78:50970) 2024-09-17T03:11:44.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.374+0000 7f6125c27640 1 -- 172.21.15.78:0/4174097095 learned_addr learned my addr 172.21.15.78:0/4174097095 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:44.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.374+0000 7f6126428640 1 --2- 172.21.15.78:0/4174097095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f61201600b0 0x7f61201f77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:44.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.375+0000 7f6125426640 1 --2- 172.21.15.78:0/4174097095 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f61200cf320 0x7f61201f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:44.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.375+0000 7f6125c27640 1 -- 172.21.15.78:0/4174097095 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f61200cf320 msgr2=0x7f61201f7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:44.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.375+0000 7f6125c27640 1 --2- 172.21.15.78:0/4174097095 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f61200cf320 0x7f61201f7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:44.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.375+0000 7f6125c27640 1 -- 172.21.15.78:0/4174097095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f61201600b0 msgr2=0x7f61201f77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:44.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.375+0000 7f6125c27640 1 --2- 172.21.15.78:0/4174097095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f61201600b0 0x7f61201f77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:44.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.375+0000 7f6125c27640 1 -- 172.21.15.78:0/4174097095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612014dc40 con 0x7f61200b7cc0 2024-09-17T03:11:44.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.375+0000 7f6126428640 1 --2- 172.21.15.78:0/4174097095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f61201600b0 0x7f61201f77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:44.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.375+0000 7f6125c27640 1 --2- 172.21.15.78:0/4174097095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61200b7cc0 0x7f612014d700 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f6110034040 tx=0x7f61100039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:44.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.375+0000 7f611e7fc640 1 -- 172.21.15.78:0/4174097095 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611003e030 con 0x7f61200b7cc0 2024-09-17T03:11:44.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.375+0000 7f611e7fc640 1 -- 172.21.15.78:0/4174097095 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61100047a0 con 0x7f61200b7cc0 2024-09-17T03:11:44.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.375+0000 7f6127e8b640 1 -- 172.21.15.78:0/4174097095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f612015ae00 con 0x7f61200b7cc0 2024-09-17T03:11:44.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.375+0000 7f611e7fc640 1 -- 172.21.15.78:0/4174097095 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6110035040 con 0x7f61200b7cc0 2024-09-17T03:11:44.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.375+0000 7f6127e8b640 1 -- 172.21.15.78:0/4174097095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61200ca470 con 0x7f61200b7cc0 2024-09-17T03:11:44.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.376+0000 7f6127e8b640 1 -- 172.21.15.78:0/4174097095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61200713f0 con 0x7f61200b7cc0 2024-09-17T03:11:44.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.377+0000 7f611e7fc640 1 -- 172.21.15.78:0/4174097095 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6110041030 con 0x7f61200b7cc0 2024-09-17T03:11:44.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.377+0000 7f611e7fc640 1 --2- 172.21.15.78:0/4174097095 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f610c078b90 0x7f610c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:44.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.377+0000 7f611e7fc640 1 -- 172.21.15.78:0/4174097095 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f61100bb640 con 0x7f61200b7cc0 2024-09-17T03:11:44.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.378+0000 7f6125426640 1 --2- 172.21.15.78:0/4174097095 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f610c078b90 0x7f610c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:44.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.378+0000 7f6125426640 1 --2- 172.21.15.78:0/4174097095 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f610c078b90 0x7f610c07b0a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6114006fd0 tx=0x7f6114008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:44.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.382+0000 7f611e7fc640 1 -- 172.21.15.78:0/4174097095 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f61200713f0 con 0x7f61200b7cc0 2024-09-17T03:11:44.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.590+0000 7f6127e8b640 1 -- 172.21.15.78:0/4174097095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61200d1b40 con 0x7f61200b7cc0 2024-09-17T03:11:44.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.591+0000 7f611e7fc640 1 -- 172.21.15.78:0/4174097095 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) ==== 94+0+5236 (secure 0 0 0) 0x7f6110083a80 con 0x7f61200b7cc0 2024-09-17T03:11:44.591 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:44.591 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":47,"btime":"2024-09-17T03:11:44:242990+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/33195895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":33195895},{"type":"v1","addr":"172.21.15.193:6836","nonce":33195895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5758,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1865992966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1865992966},{"type":"v1","addr":"172.21.15.78:6835","nonce":1865992966}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:11:32.250686+0000","modified":"2024-09-17T03:11:44.242967+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":6231,"mds_1":5773},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5773":{"gid":5773,"name":"b","rank":1,"incarnation":47,"state":"up:creating","state_seq":1,"addr":"172.21.15.193:6837/2730762656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2730762656},{"type":"v1","addr":"172.21.15.193:6837","nonce":2730762656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6231":{"gid":6231,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6834/936871583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":936871583},{"type":"v1","addr":"172.21.15.78:6834","nonce":936871583}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6231,"qdb_cluster":[6231]},"id":4}]} 2024-09-17T03:11:44.591 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 47 2024-09-17T03:11:44.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.593+0000 7f6127e8b640 1 -- 172.21.15.78:0/4174097095 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f610c078b90 msgr2=0x7f610c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:44.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.593+0000 7f6127e8b640 1 --2- 172.21.15.78:0/4174097095 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f610c078b90 0x7f610c07b0a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6114006fd0 tx=0x7f6114008040 comp rx=0 tx=0).stop 2024-09-17T03:11:44.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.593+0000 7f6127e8b640 1 -- 172.21.15.78:0/4174097095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61200b7cc0 msgr2=0x7f612014d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:44.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.593+0000 7f6127e8b640 1 --2- 172.21.15.78:0/4174097095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61200b7cc0 0x7f612014d700 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f6110034040 tx=0x7f61100039e0 comp rx=0 tx=0).stop 2024-09-17T03:11:44.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.593+0000 7f6127e8b640 1 -- 172.21.15.78:0/4174097095 shutdown_connections 2024-09-17T03:11:44.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.593+0000 7f6127e8b640 1 --2- 172.21.15.78:0/4174097095 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f610c078b90 0x7f610c07b0a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:44.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.593+0000 7f6127e8b640 1 --2- 172.21.15.78:0/4174097095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f61201600b0 0x7f61201f77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:44.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.593+0000 7f6127e8b640 1 --2- 172.21.15.78:0/4174097095 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f61200cf320 0x7f61201f7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:44.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.593+0000 7f6127e8b640 1 --2- 172.21.15.78:0/4174097095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61200b7cc0 0x7f612014d700 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:44.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.593+0000 7f6127e8b640 1 -- 172.21.15.78:0/4174097095 >> 172.21.15.78:0/4174097095 conn(0x7f612006d4f0 msgr2=0x7f61200d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:44.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.593+0000 7f6127e8b640 1 -- 172.21.15.78:0/4174097095 shutdown_connections 2024-09-17T03:11:44.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:44.593+0000 7f6127e8b640 1 -- 172.21.15.78:0/4174097095 wait complete. 2024-09-17T03:11:45.007 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:11:32.250686+0000', 'modified': '2024-09-17T03:11:44.242967+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 6231, 'mds_1': 5773}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5773': {'gid': 5773, 'name': 'b', 'rank': 1, 'incarnation': 47, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.193:6837/2730762656', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6835', 'nonce': 2730762656}, {'type': 'v1', 'addr': '172.21.15.193:6837', 'nonce': 2730762656}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_6231': {'gid': 6231, 'name': 'c', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6834/936871583', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6832', 'nonce': 936871583}, {'type': 'v1', 'addr': '172.21.15.78:6834', 'nonce': 936871583}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6231, 'qdb_cluster': [6231]} 2024-09-17T03:11:45.008 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5773:up:creating 2024-09-17T03:11:46.009 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:11:46.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.144+0000 7f862c58b640 1 -- 172.21.15.78:0/952095024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86240ccbd0 msgr2=0x7f86240d0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:46.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.144+0000 7f862c58b640 1 --2- 172.21.15.78:0/952095024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86240ccbd0 0x7f86240d0d80 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f86240ce170 tx=0x7f861802a560 comp rx=0 tx=0).stop 2024-09-17T03:11:46.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.144+0000 7f862c58b640 1 -- 172.21.15.78:0/952095024 shutdown_connections 2024-09-17T03:11:46.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.144+0000 7f862c58b640 1 --2- 172.21.15.78:0/952095024 >> v2:172.21.15.193:3300/0 conn(0x7f86240d12c0 0x7f86240d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:46.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.144+0000 7f862c58b640 1 --2- 172.21.15.78:0/952095024 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86240ccbd0 0x7f86240d0d80 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:46.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.144+0000 7f862c58b640 1 --2- 172.21.15.78:0/952095024 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f86240b51c0 0x7f862415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:46.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.144+0000 7f862c58b640 1 -- 172.21.15.78:0/952095024 >> 172.21.15.78:0/952095024 conn(0x7f8624072ae0 msgr2=0x7f8624072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:46.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.144+0000 7f862c58b640 1 -- 172.21.15.78:0/952095024 shutdown_connections 2024-09-17T03:11:46.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.144+0000 7f862c58b640 1 -- 172.21.15.78:0/952095024 wait complete. 2024-09-17T03:11:46.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.145+0000 7f862c58b640 1 Processor -- start 2024-09-17T03:11:46.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.146+0000 7f862c58b640 1 -- start start 2024-09-17T03:11:46.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.147+0000 7f862c58b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86240b51c0 0x7f86240cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:46.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.147+0000 7f862c58b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86240ccbd0 0x7f8624147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:46.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.147+0000 7f862c58b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f86240d12c0 0x7f862414a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:46.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.147+0000 7f862c58b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f86241607f0 con 0x7f86240ccbd0 2024-09-17T03:11:46.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.147+0000 7f862c58b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8624160670 con 0x7f86240b51c0 2024-09-17T03:11:46.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.147+0000 7f862c58b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8624160970 con 0x7f86240d12c0 2024-09-17T03:11:46.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.147+0000 7f8629b26640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86240ccbd0 0x7f8624147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:46.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.147+0000 7f8629b26640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86240ccbd0 0x7f8624147e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50996/0 (socket says 172.21.15.78:50996) 2024-09-17T03:11:46.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.147+0000 7f8629b26640 1 -- 172.21.15.78:0/3418324288 learned_addr learned my addr 172.21.15.78:0/3418324288 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:46.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.147+0000 7f862a327640 1 --2- 172.21.15.78:0/3418324288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86240b51c0 0x7f86240cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:46.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.147+0000 7f862ab28640 1 --2- 172.21.15.78:0/3418324288 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f86240d12c0 0x7f862414a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:46.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.147+0000 7f8629b26640 1 -- 172.21.15.78:0/3418324288 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f86240d12c0 msgr2=0x7f862414a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:46.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.147+0000 7f8629b26640 1 --2- 172.21.15.78:0/3418324288 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f86240d12c0 0x7f862414a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:46.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.147+0000 7f8629b26640 1 -- 172.21.15.78:0/3418324288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86240b51c0 msgr2=0x7f86240cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:46.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.147+0000 7f8629b26640 1 --2- 172.21.15.78:0/3418324288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86240b51c0 0x7f86240cb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:46.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.147+0000 7f8629b26640 1 -- 172.21.15.78:0/3418324288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86240cbae0 con 0x7f86240ccbd0 2024-09-17T03:11:46.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.147+0000 7f862a327640 1 --2- 172.21.15.78:0/3418324288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86240b51c0 0x7f86240cb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:46.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.148+0000 7f8629b26640 1 --2- 172.21.15.78:0/3418324288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86240ccbd0 0x7f8624147e80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8618034040 tx=0x7f8618003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:46.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.148+0000 7f8622ffd640 1 -- 172.21.15.78:0/3418324288 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f861803e030 con 0x7f86240ccbd0 2024-09-17T03:11:46.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.148+0000 7f8622ffd640 1 -- 172.21.15.78:0/3418324288 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8618003d10 con 0x7f86240ccbd0 2024-09-17T03:11:46.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.148+0000 7f862c58b640 1 -- 172.21.15.78:0/3418324288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86240cbdc0 con 0x7f86240ccbd0 2024-09-17T03:11:46.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.148+0000 7f8622ffd640 1 -- 172.21.15.78:0/3418324288 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8618035040 con 0x7f86240ccbd0 2024-09-17T03:11:46.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.148+0000 7f862c58b640 1 -- 172.21.15.78:0/3418324288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f862415e4e0 con 0x7f86240ccbd0 2024-09-17T03:11:46.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.149+0000 7f862c58b640 1 -- 172.21.15.78:0/3418324288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86240cb850 con 0x7f86240ccbd0 2024-09-17T03:11:46.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.149+0000 7f8622ffd640 1 -- 172.21.15.78:0/3418324288 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8618041030 con 0x7f86240ccbd0 2024-09-17T03:11:46.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.150+0000 7f8622ffd640 1 --2- 172.21.15.78:0/3418324288 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8610078bc0 0x7f861007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:46.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.150+0000 7f8622ffd640 1 -- 172.21.15.78:0/3418324288 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f86180bb3e0 con 0x7f86240ccbd0 2024-09-17T03:11:46.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.151+0000 7f862a327640 1 --2- 172.21.15.78:0/3418324288 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8610078bc0 0x7f861007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:46.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.151+0000 7f862a327640 1 --2- 172.21.15.78:0/3418324288 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8610078bc0 0x7f861007b0d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8614009a20 tx=0x7f8614005d20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:46.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.154+0000 7f8622ffd640 1 -- 172.21.15.78:0/3418324288 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f86180838b0 con 0x7f86240ccbd0 2024-09-17T03:11:46.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.369+0000 7f862c58b640 1 -- 172.21.15.78:0/3418324288 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f86240d16d0 con 0x7f86240ccbd0 2024-09-17T03:11:46.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.369+0000 7f8622ffd640 1 -- 172.21.15.78:0/3418324288 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5258 (secure 0 0 0) 0x7f8618088e20 con 0x7f86240ccbd0 2024-09-17T03:11:46.758 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:46.758 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":50,"btime":"2024-09-17T03:11:46:256604+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/33195895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":33195895},{"type":"v1","addr":"172.21.15.193:6836","nonce":33195895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:11:32.250686+0000","modified":"2024-09-17T03:11:46.256598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6231,"mds_1":5773,"mds_2":5758},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5758":{"gid":5758,"name":"a","rank":2,"incarnation":49,"state":"up:active","state_seq":6,"addr":"172.21.15.78:6835/1865992966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1865992966},{"type":"v1","addr":"172.21.15.78:6835","nonce":1865992966}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5773":{"gid":5773,"name":"b","rank":1,"incarnation":47,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6837/2730762656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2730762656},{"type":"v1","addr":"172.21.15.193:6837","nonce":2730762656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6231":{"gid":6231,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6834/936871583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":936871583},{"type":"v1","addr":"172.21.15.78:6834","nonce":936871583}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6231,"qdb_cluster":[5758,5773,6231]},"id":4}]} 2024-09-17T03:11:46.759 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 50 2024-09-17T03:11:46.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.372+0000 7f862c58b640 1 -- 172.21.15.78:0/3418324288 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8610078bc0 msgr2=0x7f861007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:46.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.372+0000 7f862c58b640 1 --2- 172.21.15.78:0/3418324288 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8610078bc0 0x7f861007b0d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8614009a20 tx=0x7f8614005d20 comp rx=0 tx=0).stop 2024-09-17T03:11:46.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.372+0000 7f862c58b640 1 -- 172.21.15.78:0/3418324288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86240ccbd0 msgr2=0x7f8624147e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:46.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.372+0000 7f862c58b640 1 --2- 172.21.15.78:0/3418324288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86240ccbd0 0x7f8624147e80 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f8618034040 tx=0x7f8618003820 comp rx=0 tx=0).stop 2024-09-17T03:11:46.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.372+0000 7f862c58b640 1 -- 172.21.15.78:0/3418324288 shutdown_connections 2024-09-17T03:11:46.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.372+0000 7f862c58b640 1 --2- 172.21.15.78:0/3418324288 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f86240d12c0 0x7f862414a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:46.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.372+0000 7f862c58b640 1 --2- 172.21.15.78:0/3418324288 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86240ccbd0 0x7f8624147e80 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:46.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.372+0000 7f862c58b640 1 --2- 172.21.15.78:0/3418324288 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8610078bc0 0x7f861007b0d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:46.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.372+0000 7f862c58b640 1 --2- 172.21.15.78:0/3418324288 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f86240b51c0 0x7f86240cb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:46.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.372+0000 7f862c58b640 1 -- 172.21.15.78:0/3418324288 >> 172.21.15.78:0/3418324288 conn(0x7f8624072ae0 msgr2=0x7f86241e5ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:46.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.372+0000 7f862c58b640 1 -- 172.21.15.78:0/3418324288 shutdown_connections 2024-09-17T03:11:46.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:46.372+0000 7f862c58b640 1 -- 172.21.15.78:0/3418324288 wait complete. 2024-09-17T03:11:47.164 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:11:32.250686+0000', 'modified': '2024-09-17T03:11:46.256598+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 6231, 'mds_1': 5773, 'mds_2': 5758}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5758': {'gid': 5758, 'name': 'a', 'rank': 2, 'incarnation': 49, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.78:6835/1865992966', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6833', 'nonce': 1865992966}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 1865992966}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_5773': {'gid': 5773, 'name': 'b', 'rank': 1, 'incarnation': 47, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.193:6837/2730762656', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6835', 'nonce': 2730762656}, {'type': 'v1', 'addr': '172.21.15.193:6837', 'nonce': 2730762656}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_6231': {'gid': 6231, 'name': 'c', 'rank': 0, 'incarnation': 43, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6834/936871583', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6832', 'nonce': 936871583}, {'type': 'v1', 'addr': '172.21.15.78:6834', 'nonce': 936871583}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6231, 'qdb_cluster': [5758, 5773, 6231]} 2024-09-17T03:11:47.164 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-17T03:11:47.164 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:11:47.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.283+0000 7f194d524640 1 -- 172.21.15.78:0/2055155066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19480cf540 msgr2=0x7f194806eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.283+0000 7f194d524640 1 --2- 172.21.15.78:0/2055155066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19480cf540 0x7f194806eab0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f1940009830 tx=0x7f194002a3f0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.283+0000 7f194d524640 1 -- 172.21.15.78:0/2055155066 shutdown_connections 2024-09-17T03:11:47.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.283+0000 7f194d524640 1 --2- 172.21.15.78:0/2055155066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19480cf540 0x7f194806eab0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.283+0000 7f194d524640 1 --2- 172.21.15.78:0/2055155066 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19480b66b0 0x7f19480d4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.283+0000 7f194d524640 1 -- 172.21.15.78:0/2055155066 >> 172.21.15.78:0/2055155066 conn(0x7f194809d7f0 msgr2=0x7f19480d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:47.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.283+0000 7f194d524640 1 -- 172.21.15.78:0/2055155066 shutdown_connections 2024-09-17T03:11:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.283+0000 7f194d524640 1 -- 172.21.15.78:0/2055155066 wait complete. 2024-09-17T03:11:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.285+0000 7f194d524640 1 Processor -- start 2024-09-17T03:11:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.285+0000 7f194d524640 1 -- start start 2024-09-17T03:11:47.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.286+0000 7f194d524640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19480b9b60 0x7f1948151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.286+0000 7f194d524640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19480cf540 0x7f19481f4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.286+0000 7f194d524640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1948153d60 0x7f19481e9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.286+0000 7f194d524640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f194806f5d0 con 0x7f1948153d60 2024-09-17T03:11:47.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.286+0000 7f194d524640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f194806f450 con 0x7f19480b9b60 2024-09-17T03:11:47.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.286+0000 7f194d524640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f194806f750 con 0x7f19480cf540 2024-09-17T03:11:47.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.286+0000 7f19477fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1948153d60 0x7f19481e9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.286+0000 7f19477fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1948153d60 0x7f19481e9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41148/0 (socket says 172.21.15.78:41148) 2024-09-17T03:11:47.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.286+0000 7f19477fe640 1 -- 172.21.15.78:0/1090283857 learned_addr learned my addr 172.21.15.78:0/1090283857 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:47.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.286+0000 7f19467fc640 1 --2- 172.21.15.78:0/1090283857 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19480cf540 0x7f19481f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.286+0000 7f1946ffd640 1 --2- 172.21.15.78:0/1090283857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19480b9b60 0x7f1948151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.286+0000 7f19477fe640 1 -- 172.21.15.78:0/1090283857 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19480cf540 msgr2=0x7f19481f4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.286+0000 7f19477fe640 1 --2- 172.21.15.78:0/1090283857 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19480cf540 0x7f19481f4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.286+0000 7f19477fe640 1 -- 172.21.15.78:0/1090283857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19480b9b60 msgr2=0x7f1948151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.286+0000 7f19477fe640 1 --2- 172.21.15.78:0/1090283857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19480b9b60 0x7f1948151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.286+0000 7f19477fe640 1 -- 172.21.15.78:0/1090283857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19481e83c0 con 0x7f1948153d60 2024-09-17T03:11:47.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.286+0000 7f1946ffd640 1 --2- 172.21.15.78:0/1090283857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19480b9b60 0x7f1948151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:47.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.287+0000 7f19477fe640 1 --2- 172.21.15.78:0/1090283857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1948153d60 0x7f19481e9460 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f194002a9e0 tx=0x7f1940033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:47.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.287+0000 7f193f7fe640 1 -- 172.21.15.78:0/1090283857 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1940031d60 con 0x7f1948153d60 2024-09-17T03:11:47.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.287+0000 7f193f7fe640 1 -- 172.21.15.78:0/1090283857 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1940033e10 con 0x7f1948153d60 2024-09-17T03:11:47.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.287+0000 7f194d524640 1 -- 172.21.15.78:0/1090283857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19481e86a0 con 0x7f1948153d60 2024-09-17T03:11:47.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.287+0000 7f193f7fe640 1 -- 172.21.15.78:0/1090283857 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1940005220 con 0x7f1948153d60 2024-09-17T03:11:47.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.287+0000 7f194d524640 1 -- 172.21.15.78:0/1090283857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19481e8c60 con 0x7f1948153d60 2024-09-17T03:11:47.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.289+0000 7f193f7fe640 1 -- 172.21.15.78:0/1090283857 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f19400053c0 con 0x7f1948153d60 2024-09-17T03:11:47.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.289+0000 7f193f7fe640 1 --2- 172.21.15.78:0/1090283857 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1928078b90 0x7f192807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.289+0000 7f193f7fe640 1 -- 172.21.15.78:0/1090283857 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f19400bbe40 con 0x7f1948153d60 2024-09-17T03:11:47.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.289+0000 7f1946ffd640 1 --2- 172.21.15.78:0/1090283857 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1928078b90 0x7f192807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.290+0000 7f1946ffd640 1 --2- 172.21.15.78:0/1090283857 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1928078b90 0x7f192807b0a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1938007fd0 tx=0x7f1938009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:47.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.290+0000 7f195448e740 1 Processor -- start 2024-09-17T03:11:47.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.290+0000 7f195448e740 1 -- start start 2024-09-17T03:11:47.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.291+0000 7f195448e740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a94161b270 0x55a9419ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.291+0000 7f195448e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415f23b0 0x55a9419ed4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.291+0000 7f195448e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9415fa590 0x55a941a0a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.291+0000 7f195448e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a941935820 con 0x55a9415f23b0 2024-09-17T03:11:47.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.291+0000 7f195448e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a941924c50 con 0x55a9415fa590 2024-09-17T03:11:47.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.291+0000 7f195448e740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a941928a60 con 0x55a94161b270 2024-09-17T03:11:47.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.292+0000 7f19467fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415f23b0 0x55a9419ed4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.292+0000 7f19467fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415f23b0 0x55a9419ed4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41158/0 (socket says 172.21.15.78:41158) 2024-09-17T03:11:47.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.292+0000 7f19467fc640 1 -- 172.21.15.78:0/4085880677 learned_addr learned my addr 172.21.15.78:0/4085880677 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:47.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.292+0000 7f1946ffd640 1 --2- 172.21.15.78:0/4085880677 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a94161b270 0x55a9419ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.292+0000 7f19477fe640 1 --2- 172.21.15.78:0/4085880677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9415fa590 0x55a941a0a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.292+0000 7f19467fc640 1 -- 172.21.15.78:0/4085880677 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a94161b270 msgr2=0x55a9419ecfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.292+0000 7f19467fc640 1 --2- 172.21.15.78:0/4085880677 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a94161b270 0x55a9419ecfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.292+0000 7f19467fc640 1 -- 172.21.15.78:0/4085880677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9415fa590 msgr2=0x55a941a0a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.292+0000 7f19467fc640 1 --2- 172.21.15.78:0/4085880677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9415fa590 0x55a941a0a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.292+0000 7f19467fc640 1 -- 172.21.15.78:0/4085880677 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a941686850 con 0x55a9415f23b0 2024-09-17T03:11:47.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.292+0000 7f19467fc640 1 --2- 172.21.15.78:0/4085880677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415f23b0 0x55a9419ed4e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f193000bbd0 tx=0x7f19300107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd43453b62089b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:47.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.292+0000 7f193cff9640 1 -- 172.21.15.78:0/4085880677 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193001c480 con 0x55a9415f23b0 2024-09-17T03:11:47.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.292+0000 7f193cff9640 1 -- 172.21.15.78:0/4085880677 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f193001c710 con 0x55a9415f23b0 2024-09-17T03:11:47.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.292+0000 7f193cff9640 1 -- 172.21.15.78:0/4085880677 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193001cb40 con 0x55a9415f23b0 2024-09-17T03:11:47.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.293+0000 7f195448e740 1 -- 172.21.15.78:0/4085880677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415f23b0 msgr2=0x55a9419ed4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.293+0000 7f195448e740 1 --2- 172.21.15.78:0/4085880677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415f23b0 0x55a9419ed4e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f193000bbd0 tx=0x7f19300107a0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.293+0000 7f195448e740 1 -- 172.21.15.78:0/4085880677 shutdown_connections 2024-09-17T03:11:47.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.293+0000 7f195448e740 1 --2- 172.21.15.78:0/4085880677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9415fa590 0x55a941a0a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.293+0000 7f195448e740 1 --2- 172.21.15.78:0/4085880677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415f23b0 0x55a9419ed4e0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.293+0000 7f195448e740 1 --2- 172.21.15.78:0/4085880677 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a94161b270 0x55a9419ecfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.293+0000 7f195448e740 1 -- 172.21.15.78:0/4085880677 >> 172.21.15.78:0/4085880677 conn(0x55a94160f3c0 msgr2=0x55a9419c3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:47.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.293+0000 7f195448e740 1 -- 172.21.15.78:0/4085880677 shutdown_connections 2024-09-17T03:11:47.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.293+0000 7f195448e740 1 -- 172.21.15.78:0/4085880677 wait complete. 2024-09-17T03:11:47.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.294+0000 7f195448e740 1 -- start start 2024-09-17T03:11:47.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.294+0000 7f195448e740 1 Processor -- start 2024-09-17T03:11:47.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.295+0000 7f195448e740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9415f23b0 0x55a941a002d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.295+0000 7f195448e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 0x55a9419feb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.295+0000 7f195448e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a94161b270 0x55a941a1a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.295+0000 7f195448e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a941695620 con 0x55a9415fa590 2024-09-17T03:11:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.295+0000 7f195448e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a9418ca5f0 con 0x55a94161b270 2024-09-17T03:11:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.295+0000 7f195448e740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a9419eda20 con 0x55a9415f23b0 2024-09-17T03:11:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.295+0000 7f195448e740 10 client.0 _ll_register_callbacks cb 0x55a9418ce0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.296+0000 7f19467fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 0x55a9419feb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.296+0000 7f19467fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 0x55a9419feb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41164/0 (socket says 172.21.15.78:41164) 2024-09-17T03:11:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.296+0000 7f19467fc640 1 -- 172.21.15.78:0/227221463 learned_addr learned my addr 172.21.15.78:0/227221463 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.296+0000 7f19477fe640 1 --2- 172.21.15.78:0/227221463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a94161b270 0x55a941a1a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.296+0000 7f1946ffd640 1 --2- 172.21.15.78:0/227221463 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9415f23b0 0x55a941a002d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.296+0000 7f19467fc640 1 -- 172.21.15.78:0/227221463 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9415f23b0 msgr2=0x55a941a002d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.296+0000 7f19467fc640 1 --2- 172.21.15.78:0/227221463 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9415f23b0 0x55a941a002d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.296+0000 7f19467fc640 1 -- 172.21.15.78:0/227221463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a94161b270 msgr2=0x55a941a1a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.296+0000 7f19467fc640 1 --2- 172.21.15.78:0/227221463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a94161b270 0x55a941a1a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.296+0000 7f19467fc640 1 -- 172.21.15.78:0/227221463 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9416fd6b0 con 0x55a9415fa590 2024-09-17T03:11:47.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.296+0000 7f19467fc640 1 --2- 172.21.15.78:0/227221463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 0x55a9419feb90 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x55a9419c4e30 tx=0x7f193001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b8a22c1a5bb88c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:47.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.296+0000 7f1925ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:47.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.296+0000 7f1925ffb640 1 -- 172.21.15.78:0/227221463 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1930029020 con 0x55a9415fa590 2024-09-17T03:11:47.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.296+0000 7f195448e740 1 -- 172.21.15.78:0/227221463 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f193001c710 con 0x55a9415fa590 2024-09-17T03:11:47.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.296+0000 7f1925ffb640 1 -- 172.21.15.78:0/227221463 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f1930004020 con 0x55a9415fa590 2024-09-17T03:11:47.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.296+0000 7f1925ffb640 1 -- 172.21.15.78:0/227221463 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f1930030050 con 0x55a9415fa590 2024-09-17T03:11:47.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.296+0000 7f195448e740 10 client.6447 fetch_fsmap learned FSMap version 50 2024-09-17T03:11:47.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.296+0000 7f195448e740 1 -- 172.21.15.78:0/227221463 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x55a9419e52d0 con 0x55a9415fa590 2024-09-17T03:11:47.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.297+0000 7f1925ffb640 1 -- 172.21.15.78:0/227221463 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f193001c710 con 0x55a9415fa590 2024-09-17T03:11:47.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.297+0000 7f1925ffb640 1 -- 172.21.15.78:0/227221463 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 50) ==== 3542+0+0 (secure 0 0 0) 0x7f1930033020 con 0x55a9415fa590 2024-09-17T03:11:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.297+0000 7f195448e740 10 client.6447 fetch_fsmap finished waiting for FSMap version 50 2024-09-17T03:11:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.297+0000 7f195448e740 10 client.6447 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:11:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.297+0000 7f195448e740 20 client.6447 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.297+0000 7f195448e740 1 --2- 172.21.15.78:0/227221463 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x55a9415d9e40 0x55a941a17080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.297+0000 7f195448e740 4 client.6447 mds_command: new command op to 5758 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:11:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.297+0000 7f195448e740 1 -- 172.21.15.78:0/227221463 --> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a941937770 con 0x55a9415d9e40 2024-09-17T03:11:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.297+0000 7f1946ffd640 1 --2- 172.21.15.78:0/227221463 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x55a9415d9e40 0x55a941a17080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.297+0000 7f1925ffb640 10 client.6447 ms_handle_connect on v2:172.21.15.78:6833/1865992966 2024-09-17T03:11:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.297+0000 7f1946ffd640 1 --2- 172.21.15.78:0/227221463 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x55a9415d9e40 0x55a941a17080 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fc6c4afc61b0b78c server_cookie=b28af3fdb70845c1 in_seq=0 out_seq=0 2024-09-17T03:11:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.298+0000 7f1925ffb640 1 -- 172.21.15.78:0/227221463 <== mds.2 v2:172.21.15.78:6833/1865992966 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a941937770 con 0x55a9415d9e40 2024-09-17T03:11:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.298+0000 7f1925ffb640 10 client.6447 handle_command_reply: tid=0 2024-09-17T03:11:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.298+0000 7f195448e740 1 client.6447 shutdown 2024-09-17T03:11:47.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.298+0000 7f195448e740 1 -- 172.21.15.78:0/227221463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 msgr2=0x55a9419feb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.298+0000 7f195448e740 1 --2- 172.21.15.78:0/227221463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 0x55a9419feb90 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x55a9419c4e30 tx=0x7f193001c480 comp rx=0 tx=0).stop 2024-09-17T03:11:47.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.298+0000 7f195448e740 1 -- 172.21.15.78:0/227221463 shutdown_connections 2024-09-17T03:11:47.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.298+0000 7f195448e740 1 --2- 172.21.15.78:0/227221463 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x55a9415d9e40 0x55a941a17080 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.298+0000 7f195448e740 1 --2- 172.21.15.78:0/227221463 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a94161b270 0x55a941a1a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.298+0000 7f195448e740 1 --2- 172.21.15.78:0/227221463 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 0x55a9419feb90 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.298+0000 7f195448e740 1 --2- 172.21.15.78:0/227221463 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9415f23b0 0x55a941a002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.298+0000 7f1925ffb640 0 client.6447 ms_handle_reset on v2:172.21.15.78:6833/1865992966 2024-09-17T03:11:47.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.298+0000 7f195448e740 1 -- 172.21.15.78:0/227221463 >> 172.21.15.78:0/227221463 conn(0x55a94160f3c0 msgr2=0x55a941a0baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:47.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.298+0000 7f195448e740 1 -- 172.21.15.78:0/227221463 shutdown_connections 2024-09-17T03:11:47.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.298+0000 7f195448e740 1 -- 172.21.15.78:0/227221463 wait complete. 2024-09-17T03:11:47.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.298+0000 7f195448e740 20 client.6447 trim_cache size 0 max 16384 2024-09-17T03:11:47.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.316+0000 7f195448e740 1 Processor -- start 2024-09-17T03:11:47.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.316+0000 7f195448e740 1 -- start start 2024-09-17T03:11:47.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f195448e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9415f23b0 0x55a9419db3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f195448e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 0x55a9419dc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f195448e740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a94161b270 0x55a9419dcc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f195448e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f19480cd760 con 0x55a9415fa590 2024-09-17T03:11:47.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f195448e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1948201c10 con 0x55a9415f23b0 2024-09-17T03:11:47.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f195448e740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f19481f91d0 con 0x55a94161b270 2024-09-17T03:11:47.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f19467fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 0x55a9419dc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f19467fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 0x55a9419dc6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41178/0 (socket says 172.21.15.78:41178) 2024-09-17T03:11:47.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f19467fc640 1 -- 172.21.15.78:0/2011918665 learned_addr learned my addr 172.21.15.78:0/2011918665 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:47.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f1946ffd640 1 --2- 172.21.15.78:0/2011918665 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9415f23b0 0x55a9419db3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f19477fe640 1 --2- 172.21.15.78:0/2011918665 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a94161b270 0x55a9419dcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f19467fc640 1 -- 172.21.15.78:0/2011918665 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a94161b270 msgr2=0x55a9419dcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f19467fc640 1 --2- 172.21.15.78:0/2011918665 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a94161b270 0x55a9419dcc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f19467fc640 1 -- 172.21.15.78:0/2011918665 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9415f23b0 msgr2=0x55a9419db3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f19467fc640 1 --2- 172.21.15.78:0/2011918665 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9415f23b0 0x55a9419db3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f19467fc640 1 -- 172.21.15.78:0/2011918665 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a941a00450 con 0x55a9415fa590 2024-09-17T03:11:47.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f1946ffd640 1 --2- 172.21.15.78:0/2011918665 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9415f23b0 0x55a9419db3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:47.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f19467fc640 1 --2- 172.21.15.78:0/2011918665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 0x55a9419dc6f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1930000c00 tx=0x7f1930010dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8144ee2b23cf2992 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:47.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f1927fff640 1 -- 172.21.15.78:0/2011918665 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1930039070 con 0x55a9415fa590 2024-09-17T03:11:47.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f1927fff640 1 -- 172.21.15.78:0/2011918665 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f193001c840 con 0x55a9415fa590 2024-09-17T03:11:47.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.318+0000 7f1927fff640 1 -- 172.21.15.78:0/2011918665 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1930029040 con 0x55a9415fa590 2024-09-17T03:11:47.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.319+0000 7f195448e740 1 -- 172.21.15.78:0/2011918665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 msgr2=0x55a9419dc6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.319+0000 7f195448e740 1 --2- 172.21.15.78:0/2011918665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 0x55a9419dc6f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1930000c00 tx=0x7f1930010dd0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.319+0000 7f195448e740 1 -- 172.21.15.78:0/2011918665 shutdown_connections 2024-09-17T03:11:47.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.319+0000 7f195448e740 1 --2- 172.21.15.78:0/2011918665 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a94161b270 0x55a9419dcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.319+0000 7f195448e740 1 --2- 172.21.15.78:0/2011918665 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 0x55a9419dc6f0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.319+0000 7f195448e740 1 --2- 172.21.15.78:0/2011918665 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9415f23b0 0x55a9419db3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.319+0000 7f195448e740 1 -- 172.21.15.78:0/2011918665 >> 172.21.15.78:0/2011918665 conn(0x55a94160f3c0 msgr2=0x55a9419bddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:47.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.319+0000 7f195448e740 1 -- 172.21.15.78:0/2011918665 shutdown_connections 2024-09-17T03:11:47.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.319+0000 7f195448e740 1 -- 172.21.15.78:0/2011918665 wait complete. 2024-09-17T03:11:47.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.320+0000 7f195448e740 1 -- start start 2024-09-17T03:11:47.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.320+0000 7f195448e740 1 Processor -- start 2024-09-17T03:11:47.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.321+0000 7f195448e740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9415f23b0 0x55a941a85090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.321+0000 7f195448e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 0x55a941a157e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.321+0000 7f195448e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a94161b270 0x55a941a15d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.321+0000 7f195448e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a9419e59e0 con 0x55a9415fa590 2024-09-17T03:11:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.321+0000 7f195448e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a9419e5560 con 0x55a94161b270 2024-09-17T03:11:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.321+0000 7f195448e740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a941a014d0 con 0x55a9415f23b0 2024-09-17T03:11:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.321+0000 7f195448e740 10 client.0 _ll_register_callbacks cb 0x7f1940009490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f19467fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 0x55a941a157e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f19467fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 0x55a941a157e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41182/0 (socket says 172.21.15.78:41182) 2024-09-17T03:11:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f19467fc640 1 -- 172.21.15.78:0/3883270777 learned_addr learned my addr 172.21.15.78:0/3883270777 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f19477fe640 1 --2- 172.21.15.78:0/3883270777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a94161b270 0x55a941a15d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f1946ffd640 1 --2- 172.21.15.78:0/3883270777 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9415f23b0 0x55a941a85090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f19467fc640 1 -- 172.21.15.78:0/3883270777 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9415f23b0 msgr2=0x55a941a85090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f19467fc640 1 --2- 172.21.15.78:0/3883270777 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9415f23b0 0x55a941a85090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f19467fc640 1 -- 172.21.15.78:0/3883270777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a94161b270 msgr2=0x55a941a15d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f19467fc640 1 --2- 172.21.15.78:0/3883270777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a94161b270 0x55a941a15d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f19467fc640 1 -- 172.21.15.78:0/3883270777 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a941a09530 con 0x55a9415fa590 2024-09-17T03:11:47.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f19477fe640 1 --2- 172.21.15.78:0/3883270777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a94161b270 0x55a941a15d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:47.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f1946ffd640 1 --2- 172.21.15.78:0/3883270777 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9415f23b0 0x55a941a85090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:47.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f19467fc640 1 --2- 172.21.15.78:0/3883270777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 0x55a941a157e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f19300059f0 tx=0x7f1930010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b812ad97443d7e4c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:47.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f1925ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:47.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f1925ffb640 1 -- 172.21.15.78:0/3883270777 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1930039070 con 0x55a9415fa590 2024-09-17T03:11:47.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f1925ffb640 1 -- 172.21.15.78:0/3883270777 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f193003eab0 con 0x55a9415fa590 2024-09-17T03:11:47.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f195448e740 1 -- 172.21.15.78:0/3883270777 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f193001c840 con 0x55a9415fa590 2024-09-17T03:11:47.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f1925ffb640 1 -- 172.21.15.78:0/3883270777 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f1930045050 con 0x55a9415fa590 2024-09-17T03:11:47.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f195448e740 10 client.6453 fetch_fsmap learned FSMap version 50 2024-09-17T03:11:47.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f195448e740 1 -- 172.21.15.78:0/3883270777 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x55a941a01950 con 0x55a9415fa590 2024-09-17T03:11:47.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f1925ffb640 1 -- 172.21.15.78:0/3883270777 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f193001c840 con 0x55a9415fa590 2024-09-17T03:11:47.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.322+0000 7f1925ffb640 1 -- 172.21.15.78:0/3883270777 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 50) ==== 3542+0+0 (secure 0 0 0) 0x7f1930048020 con 0x55a9415fa590 2024-09-17T03:11:47.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f195448e740 10 client.6453 fetch_fsmap finished waiting for FSMap version 50 2024-09-17T03:11:47.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f195448e740 10 client.6453 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:11:47.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f195448e740 20 client.6453 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:47.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f195448e740 1 --2- 172.21.15.78:0/3883270777 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x55a941a8bc50 0x55a941a87c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f195448e740 4 client.6453 mds_command: new command op to 5758 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:11:47.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f195448e740 1 -- 172.21.15.78:0/3883270777 --> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] -- command(tid 0: {"prefix": "status"}) -- 0x55a941933220 con 0x55a941a8bc50 2024-09-17T03:11:47.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f1946ffd640 1 --2- 172.21.15.78:0/3883270777 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x55a941a8bc50 0x55a941a87c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f1925ffb640 10 client.6453 ms_handle_connect on v2:172.21.15.78:6833/1865992966 2024-09-17T03:11:47.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f1946ffd640 1 --2- 172.21.15.78:0/3883270777 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x55a941a8bc50 0x55a941a87c40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=975a5ca0fd879055 server_cookie=2810987592d0dedc in_seq=0 out_seq=0 2024-09-17T03:11:47.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f1925ffb640 1 -- 172.21.15.78:0/3883270777 <== mds.2 v2:172.21.15.78:6833/1865992966 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55a941933220 con 0x55a941a8bc50 2024-09-17T03:11:47.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f1925ffb640 10 client.6453 handle_command_reply: tid=0 2024-09-17T03:11:47.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f195448e740 1 client.6453 shutdown 2024-09-17T03:11:47.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f195448e740 1 -- 172.21.15.78:0/3883270777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 msgr2=0x55a941a157e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f195448e740 1 --2- 172.21.15.78:0/3883270777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 0x55a941a157e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f19300059f0 tx=0x7f1930010ca0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f195448e740 1 -- 172.21.15.78:0/3883270777 shutdown_connections 2024-09-17T03:11:47.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f195448e740 1 --2- 172.21.15.78:0/3883270777 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x55a941a8bc50 0x55a941a87c40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f195448e740 1 --2- 172.21.15.78:0/3883270777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a94161b270 0x55a941a15d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f195448e740 1 --2- 172.21.15.78:0/3883270777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9415fa590 0x55a941a157e0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f1925ffb640 0 client.6453 ms_handle_reset on v2:172.21.15.78:6833/1865992966 2024-09-17T03:11:47.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f195448e740 1 --2- 172.21.15.78:0/3883270777 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9415f23b0 0x55a941a85090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f195448e740 1 -- 172.21.15.78:0/3883270777 >> 172.21.15.78:0/3883270777 conn(0x55a94160f3c0 msgr2=0x55a9419db3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:47.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.323+0000 7f195448e740 1 -- 172.21.15.78:0/3883270777 shutdown_connections 2024-09-17T03:11:47.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.324+0000 7f195448e740 1 -- 172.21.15.78:0/3883270777 wait complete. 2024-09-17T03:11:47.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.324+0000 7f195448e740 20 client.6453 trim_cache size 0 max 16384 2024-09-17T03:11:47.329 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:11:47.330 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:11:47.330 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 2, 2024-09-17T03:11:47.330 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 5758, 2024-09-17T03:11:47.330 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:11:47.330 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:11:47.330 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:11:47.330 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 2.0679660860000002, 2024-09-17T03:11:47.330 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 50, 2024-09-17T03:11:47.330 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 58, 2024-09-17T03:11:47.330 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 58, 2024-09-17T03:11:47.330 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 19.127580613999999 2024-09-17T03:11:47.330 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:11:47.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.324+0000 7f194d524640 1 -- 172.21.15.78:0/1090283857 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1928078b90 msgr2=0x7f192807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.324+0000 7f194d524640 1 --2- 172.21.15.78:0/1090283857 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1928078b90 0x7f192807b0a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1938007fd0 tx=0x7f1938009040 comp rx=0 tx=0).stop 2024-09-17T03:11:47.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.324+0000 7f194d524640 1 -- 172.21.15.78:0/1090283857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1948153d60 msgr2=0x7f19481e9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.324+0000 7f194d524640 1 --2- 172.21.15.78:0/1090283857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1948153d60 0x7f19481e9460 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f194002a9e0 tx=0x7f1940033c20 comp rx=0 tx=0).stop 2024-09-17T03:11:47.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.324+0000 7f194d524640 1 -- 172.21.15.78:0/1090283857 shutdown_connections 2024-09-17T03:11:47.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.324+0000 7f194d524640 1 --2- 172.21.15.78:0/1090283857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1948153d60 0x7f19481e9460 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.324+0000 7f194d524640 1 --2- 172.21.15.78:0/1090283857 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19480cf540 0x7f19481f4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.324+0000 7f194d524640 1 --2- 172.21.15.78:0/1090283857 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1928078b90 0x7f192807b0a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.324+0000 7f194d524640 1 --2- 172.21.15.78:0/1090283857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19480b9b60 0x7f1948151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.324+0000 7f194d524640 1 -- 172.21.15.78:0/1090283857 >> 172.21.15.78:0/1090283857 conn(0x7f194809d7f0 msgr2=0x7f1948161a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:47.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.324+0000 7f194d524640 1 -- 172.21.15.78:0/1090283857 shutdown_connections 2024-09-17T03:11:47.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.324+0000 7f194d524640 1 -- 172.21.15.78:0/1090283857 wait complete. 2024-09-17T03:11:47.335 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T03:11:47.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.449+0000 7fafcd9ba640 1 -- 172.21.15.78:0/274350298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafc806f4b0 msgr2=0x7fafc80d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.449+0000 7fafcd9ba640 1 --2- 172.21.15.78:0/274350298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafc806f4b0 0x7fafc80d3330 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fafc80ba570 tx=0x7fafb002a4f0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.449+0000 7fafcd9ba640 1 -- 172.21.15.78:0/274350298 shutdown_connections 2024-09-17T03:11:47.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.449+0000 7fafcd9ba640 1 --2- 172.21.15.78:0/274350298 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fafc80d3870 0x7fafc80ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.449+0000 7fafcd9ba640 1 --2- 172.21.15.78:0/274350298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafc806f4b0 0x7fafc80d3330 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.449+0000 7fafcd9ba640 1 --2- 172.21.15.78:0/274350298 >> v2:172.21.15.193:3300/0 conn(0x7fafc806e170 0x7fafc80b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.449+0000 7fafcd9ba640 1 -- 172.21.15.78:0/274350298 >> 172.21.15.78:0/274350298 conn(0x7fafc808bfc0 msgr2=0x7fafc809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:47.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.449+0000 7fafcd9ba640 1 -- 172.21.15.78:0/274350298 shutdown_connections 2024-09-17T03:11:47.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.449+0000 7fafcd9ba640 1 -- 172.21.15.78:0/274350298 wait complete. 2024-09-17T03:11:47.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.450+0000 7fafcd9ba640 1 Processor -- start 2024-09-17T03:11:47.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.451+0000 7fafcd9ba640 1 -- start start 2024-09-17T03:11:47.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.452+0000 7fafcd9ba640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fafc806f4b0 0x7fafc80c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.452+0000 7fafcd9ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafc80d3870 0x7fafc81f97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.452+0000 7fafcd9ba640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafc80a2070 0x7fafc8161940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.452+0000 7fafcd9ba640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fafc80cf490 con 0x7fafc80d3870 2024-09-17T03:11:47.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.452+0000 7fafcd9ba640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fafc80cf310 con 0x7fafc80a2070 2024-09-17T03:11:47.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.452+0000 7fafcd9ba640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fafc80d0ce0 con 0x7fafc806f4b0 2024-09-17T03:11:47.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.452+0000 7fafbe7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafc80d3870 0x7fafc81f97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.452+0000 7fafbe7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafc80d3870 0x7fafc81f97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41192/0 (socket says 172.21.15.78:41192) 2024-09-17T03:11:47.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.452+0000 7fafbe7fc640 1 -- 172.21.15.78:0/3299752011 learned_addr learned my addr 172.21.15.78:0/3299752011 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:47.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.452+0000 7fafc6ffd640 1 --2- 172.21.15.78:0/3299752011 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fafc806f4b0 0x7fafc80c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.452+0000 7fafc77fe640 1 --2- 172.21.15.78:0/3299752011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafc80a2070 0x7fafc8161940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.452+0000 7fafbe7fc640 1 -- 172.21.15.78:0/3299752011 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fafc806f4b0 msgr2=0x7fafc80c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.452+0000 7fafbe7fc640 1 --2- 172.21.15.78:0/3299752011 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fafc806f4b0 0x7fafc80c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.452+0000 7fafbe7fc640 1 -- 172.21.15.78:0/3299752011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafc80a2070 msgr2=0x7fafc8161940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.452+0000 7fafbe7fc640 1 --2- 172.21.15.78:0/3299752011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafc80a2070 0x7fafc8161940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.452+0000 7fafbe7fc640 1 -- 172.21.15.78:0/3299752011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc80c8650 con 0x7fafc80d3870 2024-09-17T03:11:47.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.452+0000 7fafc77fe640 1 --2- 172.21.15.78:0/3299752011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafc80a2070 0x7fafc8161940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:47.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.453+0000 7fafbe7fc640 1 --2- 172.21.15.78:0/3299752011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafc80d3870 0x7fafc81f97d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fafb0034040 tx=0x7fafb00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:47.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.453+0000 7fafc4ff9640 1 -- 172.21.15.78:0/3299752011 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb003e030 con 0x7fafc80d3870 2024-09-17T03:11:47.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.453+0000 7fafc4ff9640 1 -- 172.21.15.78:0/3299752011 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafb0003d90 con 0x7fafc80d3870 2024-09-17T03:11:47.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.453+0000 7fafcd9ba640 1 -- 172.21.15.78:0/3299752011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafc81f9d10 con 0x7fafc80d3870 2024-09-17T03:11:47.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.453+0000 7fafc4ff9640 1 -- 172.21.15.78:0/3299752011 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0035040 con 0x7fafc80d3870 2024-09-17T03:11:47.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.453+0000 7fafcd9ba640 1 -- 172.21.15.78:0/3299752011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafc80c8370 con 0x7fafc80d3870 2024-09-17T03:11:47.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.455+0000 7fafc4ff9640 1 -- 172.21.15.78:0/3299752011 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fafb0041030 con 0x7fafc80d3870 2024-09-17T03:11:47.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.455+0000 7fafc4ff9640 1 --2- 172.21.15.78:0/3299752011 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fafa8078bc0 0x7fafa807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.455+0000 7fafc4ff9640 1 -- 172.21.15.78:0/3299752011 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fafb00bb7f0 con 0x7fafc80d3870 2024-09-17T03:11:47.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.455+0000 7fafc6ffd640 1 --2- 172.21.15.78:0/3299752011 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fafa8078bc0 0x7fafa807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.456+0000 7fafc6ffd640 1 --2- 172.21.15.78:0/3299752011 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fafa8078bc0 0x7fafa807b0d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fafb800bb50 tx=0x7fafb800b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:47.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.456+0000 7fafd4a06740 1 Processor -- start 2024-09-17T03:11:47.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.456+0000 7fafd4a06740 1 -- start start 2024-09-17T03:11:47.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.458+0000 7fafd4a06740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a46270 0x55ce70e17fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.458+0000 7fafd4a06740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a1d3b0 0x55ce70e18500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.458+0000 7fafd4a06740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a25590 0x55ce70e35400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.458+0000 7fafd4a06740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ce70d60820 con 0x55ce70a1d3b0 2024-09-17T03:11:47.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.458+0000 7fafd4a06740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ce70d4fc50 con 0x55ce70a25590 2024-09-17T03:11:47.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.458+0000 7fafd4a06740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ce70d53a60 con 0x55ce70a46270 2024-09-17T03:11:47.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.458+0000 7fafbe7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a1d3b0 0x55ce70e18500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.458+0000 7fafbe7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a1d3b0 0x55ce70e18500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41206/0 (socket says 172.21.15.78:41206) 2024-09-17T03:11:47.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.458+0000 7fafbe7fc640 1 -- 172.21.15.78:0/2624730846 learned_addr learned my addr 172.21.15.78:0/2624730846 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:47.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.458+0000 7fafc6ffd640 1 --2- 172.21.15.78:0/2624730846 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a46270 0x55ce70e17fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.458+0000 7fafc77fe640 1 --2- 172.21.15.78:0/2624730846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a25590 0x55ce70e35400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.458+0000 7fafbe7fc640 1 -- 172.21.15.78:0/2624730846 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a46270 msgr2=0x55ce70e17fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.458+0000 7fafbe7fc640 1 --2- 172.21.15.78:0/2624730846 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a46270 0x55ce70e17fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.458+0000 7fafbe7fc640 1 -- 172.21.15.78:0/2624730846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a25590 msgr2=0x55ce70e35400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.458+0000 7fafbe7fc640 1 --2- 172.21.15.78:0/2624730846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a25590 0x55ce70e35400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.458+0000 7fafbe7fc640 1 -- 172.21.15.78:0/2624730846 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce70ab1850 con 0x55ce70a1d3b0 2024-09-17T03:11:47.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.458+0000 7fafbe7fc640 1 --2- 172.21.15.78:0/2624730846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a1d3b0 0x55ce70e18500 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fafb00b9d40 tx=0x7fafb0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f571c712abc61265 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:47.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.458+0000 7fafbd7fa640 1 -- 172.21.15.78:0/2624730846 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0048070 con 0x55ce70a1d3b0 2024-09-17T03:11:47.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.458+0000 7fafbd7fa640 1 -- 172.21.15.78:0/2624730846 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafb00835e0 con 0x55ce70a1d3b0 2024-09-17T03:11:47.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.458+0000 7fafbd7fa640 1 -- 172.21.15.78:0/2624730846 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0083aa0 con 0x55ce70a1d3b0 2024-09-17T03:11:47.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.459+0000 7fafd4a06740 1 -- 172.21.15.78:0/2624730846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a1d3b0 msgr2=0x55ce70e18500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.459+0000 7fafd4a06740 1 --2- 172.21.15.78:0/2624730846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a1d3b0 0x55ce70e18500 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fafb00b9d40 tx=0x7fafb0009260 comp rx=0 tx=0).stop 2024-09-17T03:11:47.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.459+0000 7fafd4a06740 1 -- 172.21.15.78:0/2624730846 shutdown_connections 2024-09-17T03:11:47.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.459+0000 7fafd4a06740 1 --2- 172.21.15.78:0/2624730846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a25590 0x55ce70e35400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.459+0000 7fafd4a06740 1 --2- 172.21.15.78:0/2624730846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a1d3b0 0x55ce70e18500 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.459+0000 7fafd4a06740 1 --2- 172.21.15.78:0/2624730846 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a46270 0x55ce70e17fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.459+0000 7fafd4a06740 1 -- 172.21.15.78:0/2624730846 >> 172.21.15.78:0/2624730846 conn(0x55ce70a3a3c0 msgr2=0x55ce70dee280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:47.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.459+0000 7fafd4a06740 1 -- 172.21.15.78:0/2624730846 shutdown_connections 2024-09-17T03:11:47.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.459+0000 7fafd4a06740 1 -- 172.21.15.78:0/2624730846 wait complete. 2024-09-17T03:11:47.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.460+0000 7fafd4a06740 1 -- start start 2024-09-17T03:11:47.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.460+0000 7fafd4a06740 1 Processor -- start 2024-09-17T03:11:47.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafd4a06740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a1d3b0 0x55ce70e156a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafd4a06740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a25590 0x55ce70e2b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafd4a06740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a46270 0x55ce70e44e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafd4a06740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ce70ac0620 con 0x55ce70a25590 2024-09-17T03:11:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafd4a06740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ce70cf55f0 con 0x55ce70a46270 2024-09-17T03:11:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafd4a06740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ce70d60820 con 0x55ce70a1d3b0 2024-09-17T03:11:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafd4a06740 10 client.0 _ll_register_callbacks cb 0x55ce70cf90a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafbe7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a25590 0x55ce70e2b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafbe7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a25590 0x55ce70e2b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41214/0 (socket says 172.21.15.78:41214) 2024-09-17T03:11:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafbe7fc640 1 -- 172.21.15.78:0/1169628802 learned_addr learned my addr 172.21.15.78:0/1169628802 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafc6ffd640 1 --2- 172.21.15.78:0/1169628802 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a1d3b0 0x55ce70e156a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafc77fe640 1 --2- 172.21.15.78:0/1169628802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a46270 0x55ce70e44e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafbe7fc640 1 -- 172.21.15.78:0/1169628802 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a1d3b0 msgr2=0x55ce70e156a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafbe7fc640 1 --2- 172.21.15.78:0/1169628802 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a1d3b0 0x55ce70e156a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafbe7fc640 1 -- 172.21.15.78:0/1169628802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a46270 msgr2=0x55ce70e44e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafbe7fc640 1 --2- 172.21.15.78:0/1169628802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a46270 0x55ce70e44e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafbe7fc640 1 -- 172.21.15.78:0/1169628802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce70b286b0 con 0x55ce70a25590 2024-09-17T03:11:47.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafc77fe640 1 --2- 172.21.15.78:0/1169628802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a46270 0x55ce70e44e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:47.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafbe7fc640 1 --2- 172.21.15.78:0/1169628802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a25590 0x55ce70e2b810 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fafb0083290 tx=0x7fafb0083a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72bf708921ee608c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:47.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafa67fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:47.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafa67fc640 1 -- 172.21.15.78:0/1169628802 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0048070 con 0x55ce70a25590 2024-09-17T03:11:47.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafa67fc640 1 -- 172.21.15.78:0/1169628802 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fafb008ccd0 con 0x55ce70a25590 2024-09-17T03:11:47.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafd4a06740 1 -- 172.21.15.78:0/1169628802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafb00835e0 con 0x55ce70a25590 2024-09-17T03:11:47.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafa67fc640 1 -- 172.21.15.78:0/1169628802 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fafb008cf50 con 0x55ce70a25590 2024-09-17T03:11:47.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafd4a06740 10 client.6465 fetch_fsmap learned FSMap version 50 2024-09-17T03:11:47.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.462+0000 7fafd4a06740 1 -- 172.21.15.78:0/1169628802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x55ce70e15180 con 0x55ce70a25590 2024-09-17T03:11:47.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.463+0000 7fafa67fc640 1 -- 172.21.15.78:0/1169628802 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafb00835e0 con 0x55ce70a25590 2024-09-17T03:11:47.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.463+0000 7fafa67fc640 1 -- 172.21.15.78:0/1169628802 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 50) ==== 3542+0+0 (secure 0 0 0) 0x7fafb0082840 con 0x55ce70a25590 2024-09-17T03:11:47.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.463+0000 7fafd4a06740 10 client.6465 fetch_fsmap finished waiting for FSMap version 50 2024-09-17T03:11:47.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.463+0000 7fafd4a06740 10 client.6465 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T03:11:47.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.463+0000 7fafd4a06740 20 client.6465 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:47.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.463+0000 7fafd4a06740 1 --2- 172.21.15.78:0/1169628802 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x55ce70a04e40 0x55ce70e2aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.463+0000 7fafd4a06740 4 client.6465 mds_command: new command op to 5773 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:11:47.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.463+0000 7fafd4a06740 1 -- 172.21.15.78:0/1169628802 --> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce70d62770 con 0x55ce70a04e40 2024-09-17T03:11:47.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.463+0000 7fafc6ffd640 1 --2- 172.21.15.78:0/1169628802 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x55ce70a04e40 0x55ce70e2aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.463+0000 7fafa67fc640 10 client.6465 ms_handle_connect on v2:172.21.15.193:6835/2730762656 2024-09-17T03:11:47.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.463+0000 7fafc6ffd640 1 --2- 172.21.15.78:0/1169628802 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x55ce70a04e40 0x55ce70e2aa60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5f1eb322b48c1949 server_cookie=646eea4049f025c3 in_seq=0 out_seq=0 2024-09-17T03:11:47.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.464+0000 7fafa67fc640 1 -- 172.21.15.78:0/1169628802 <== mds.1 v2:172.21.15.193:6835/2730762656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ce70d62770 con 0x55ce70a04e40 2024-09-17T03:11:47.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.464+0000 7fafa67fc640 10 client.6465 handle_command_reply: tid=0 2024-09-17T03:11:47.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.464+0000 7fafd4a06740 1 client.6465 shutdown 2024-09-17T03:11:47.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.464+0000 7fafd4a06740 1 -- 172.21.15.78:0/1169628802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a25590 msgr2=0x55ce70e2b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.464+0000 7fafd4a06740 1 --2- 172.21.15.78:0/1169628802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a25590 0x55ce70e2b810 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fafb0083290 tx=0x7fafb0083a70 comp rx=0 tx=0).stop 2024-09-17T03:11:47.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.464+0000 7fafd4a06740 1 -- 172.21.15.78:0/1169628802 shutdown_connections 2024-09-17T03:11:47.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.464+0000 7fafd4a06740 1 --2- 172.21.15.78:0/1169628802 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x55ce70a04e40 0x55ce70e2aa60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.464+0000 7fafd4a06740 1 --2- 172.21.15.78:0/1169628802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a46270 0x55ce70e44e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.464+0000 7fafa67fc640 0 client.6465 ms_handle_reset on v2:172.21.15.193:6835/2730762656 2024-09-17T03:11:47.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.464+0000 7fafd4a06740 1 --2- 172.21.15.78:0/1169628802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a25590 0x55ce70e2b810 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.464+0000 7fafd4a06740 1 --2- 172.21.15.78:0/1169628802 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a1d3b0 0x55ce70e156a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.464+0000 7fafd4a06740 1 -- 172.21.15.78:0/1169628802 >> 172.21.15.78:0/1169628802 conn(0x55ce70a3a3c0 msgr2=0x55ce70dee130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:47.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.464+0000 7fafd4a06740 1 -- 172.21.15.78:0/1169628802 shutdown_connections 2024-09-17T03:11:47.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.464+0000 7fafd4a06740 1 -- 172.21.15.78:0/1169628802 wait complete. 2024-09-17T03:11:47.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.465+0000 7fafd4a06740 20 client.6465 trim_cache size 0 max 16384 2024-09-17T03:11:47.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.483+0000 7fafd4a06740 1 Processor -- start 2024-09-17T03:11:47.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.483+0000 7fafd4a06740 1 -- start start 2024-09-17T03:11:47.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.484+0000 7fafd4a06740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a04e40 0x55ce70de7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.484+0000 7fafd4a06740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a1d3b0 0x55ce70e403a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.484+0000 7fafd4a06740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a25590 0x55ce70e408e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.484+0000 7fafd4a06740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fafc8201400 con 0x55ce70a25590 2024-09-17T03:11:47.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.484+0000 7fafd4a06740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fafc8201ad0 con 0x55ce70a04e40 2024-09-17T03:11:47.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.484+0000 7fafd4a06740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fafc81ebb70 con 0x55ce70a1d3b0 2024-09-17T03:11:47.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.484+0000 7fafc77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a25590 0x55ce70e408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.485+0000 7fafc77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a25590 0x55ce70e408e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41216/0 (socket says 172.21.15.78:41216) 2024-09-17T03:11:47.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.485+0000 7fafc77fe640 1 -- 172.21.15.78:0/1953940410 learned_addr learned my addr 172.21.15.78:0/1953940410 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:47.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.485+0000 7fafbe7fc640 1 --2- 172.21.15.78:0/1953940410 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a1d3b0 0x55ce70e403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.485+0000 7fafc6ffd640 1 --2- 172.21.15.78:0/1953940410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a04e40 0x55ce70de7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.485+0000 7fafc77fe640 1 -- 172.21.15.78:0/1953940410 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a1d3b0 msgr2=0x55ce70e403a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.485+0000 7fafc77fe640 1 --2- 172.21.15.78:0/1953940410 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a1d3b0 0x55ce70e403a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.485+0000 7fafc77fe640 1 -- 172.21.15.78:0/1953940410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a04e40 msgr2=0x55ce70de7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.485+0000 7fafc77fe640 1 --2- 172.21.15.78:0/1953940410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a04e40 0x55ce70de7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.485+0000 7fafc77fe640 1 -- 172.21.15.78:0/1953940410 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce70deab90 con 0x55ce70a25590 2024-09-17T03:11:47.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.485+0000 7fafbe7fc640 1 --2- 172.21.15.78:0/1953940410 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a1d3b0 0x55ce70e403a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:47.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.485+0000 7fafc6ffd640 1 --2- 172.21.15.78:0/1953940410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a04e40 0x55ce70de7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:11:47.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.485+0000 7fafc77fe640 1 --2- 172.21.15.78:0/1953940410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a25590 0x55ce70e408e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009fa0 tx=0x7fafc00138f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127d4876744bea5f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:47.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.485+0000 7fafbcff9640 1 -- 172.21.15.78:0/1953940410 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0021070 con 0x55ce70a25590 2024-09-17T03:11:47.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.485+0000 7fafbcff9640 1 -- 172.21.15.78:0/1953940410 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafc0011560 con 0x55ce70a25590 2024-09-17T03:11:47.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.485+0000 7fafbcff9640 1 -- 172.21.15.78:0/1953940410 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc00119b0 con 0x55ce70a25590 2024-09-17T03:11:47.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.486+0000 7fafd4a06740 1 -- 172.21.15.78:0/1953940410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a25590 msgr2=0x55ce70e408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.486+0000 7fafd4a06740 1 --2- 172.21.15.78:0/1953940410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a25590 0x55ce70e408e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009fa0 tx=0x7fafc00138f0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.486+0000 7fafd4a06740 1 -- 172.21.15.78:0/1953940410 shutdown_connections 2024-09-17T03:11:47.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.486+0000 7fafd4a06740 1 --2- 172.21.15.78:0/1953940410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a25590 0x55ce70e408e0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.486+0000 7fafd4a06740 1 --2- 172.21.15.78:0/1953940410 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a1d3b0 0x55ce70e403a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.486+0000 7fafd4a06740 1 --2- 172.21.15.78:0/1953940410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a04e40 0x55ce70de7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.486+0000 7fafd4a06740 1 -- 172.21.15.78:0/1953940410 >> 172.21.15.78:0/1953940410 conn(0x55ce70a3a3c0 msgr2=0x55ce70e06d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:47.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.486+0000 7fafd4a06740 1 -- 172.21.15.78:0/1953940410 shutdown_connections 2024-09-17T03:11:47.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.486+0000 7fafd4a06740 1 -- 172.21.15.78:0/1953940410 wait complete. 2024-09-17T03:11:47.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.487+0000 7fafd4a06740 1 -- start start 2024-09-17T03:11:47.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.487+0000 7fafd4a06740 1 Processor -- start 2024-09-17T03:11:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.488+0000 7fafd4a06740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a04e40 0x55ce70e90c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.488+0000 7fafd4a06740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a1d3b0 0x55ce70ea89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.488+0000 7fafd4a06740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a25590 0x55ce70ea8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.488+0000 7fafd4a06740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ce70ac0620 con 0x55ce70a1d3b0 2024-09-17T03:11:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.488+0000 7fafd4a06740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ce70cf55f0 con 0x55ce70a04e40 2024-09-17T03:11:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.488+0000 7fafd4a06740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ce70e456e0 con 0x55ce70a25590 2024-09-17T03:11:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafd4a06740 10 client.0 _ll_register_callbacks cb 0x7fafb0088010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafbe7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a1d3b0 0x55ce70ea89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafbe7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a1d3b0 0x55ce70ea89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41226/0 (socket says 172.21.15.78:41226) 2024-09-17T03:11:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafbe7fc640 1 -- 172.21.15.78:0/3776796832 learned_addr learned my addr 172.21.15.78:0/3776796832 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafc6ffd640 1 --2- 172.21.15.78:0/3776796832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a04e40 0x55ce70e90c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafc77fe640 1 --2- 172.21.15.78:0/3776796832 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a25590 0x55ce70ea8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafbe7fc640 1 -- 172.21.15.78:0/3776796832 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a25590 msgr2=0x55ce70ea8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafbe7fc640 1 --2- 172.21.15.78:0/3776796832 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a25590 0x55ce70ea8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafbe7fc640 1 -- 172.21.15.78:0/3776796832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a04e40 msgr2=0x55ce70e90c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafbe7fc640 1 --2- 172.21.15.78:0/3776796832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a04e40 0x55ce70e90c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafbe7fc640 1 -- 172.21.15.78:0/3776796832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce70deba00 con 0x55ce70a1d3b0 2024-09-17T03:11:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafc77fe640 1 --2- 172.21.15.78:0/3776796832 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a25590 0x55ce70ea8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafbe7fc640 1 --2- 172.21.15.78:0/3776796832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a1d3b0 0x55ce70ea89f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fafb008d110 tx=0x7fafb00b9bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de760bb43620345b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafa67fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafa67fc640 1 -- 172.21.15.78:0/3776796832 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0048070 con 0x55ce70a1d3b0 2024-09-17T03:11:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafa67fc640 1 -- 172.21.15.78:0/3776796832 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fafb007f140 con 0x55ce70a1d3b0 2024-09-17T03:11:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafd4a06740 1 -- 172.21.15.78:0/3776796832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafc0011560 con 0x55ce70a1d3b0 2024-09-17T03:11:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafa67fc640 1 -- 172.21.15.78:0/3776796832 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fafb0082d50 con 0x55ce70a1d3b0 2024-09-17T03:11:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafd4a06740 10 client.6471 fetch_fsmap learned FSMap version 50 2024-09-17T03:11:47.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafd4a06740 1 -- 172.21.15.78:0/3776796832 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x55ce70e91260 con 0x55ce70a1d3b0 2024-09-17T03:11:47.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.489+0000 7fafa67fc640 1 -- 172.21.15.78:0/3776796832 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafc0011560 con 0x55ce70a1d3b0 2024-09-17T03:11:47.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.490+0000 7fafa67fc640 1 -- 172.21.15.78:0/3776796832 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 50) ==== 3542+0+0 (secure 0 0 0) 0x7fafb00822b0 con 0x55ce70a1d3b0 2024-09-17T03:11:47.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.490+0000 7fafd4a06740 10 client.6471 fetch_fsmap finished waiting for FSMap version 50 2024-09-17T03:11:47.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.490+0000 7fafd4a06740 10 client.6471 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T03:11:47.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.490+0000 7fafd4a06740 20 client.6471 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:47.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.490+0000 7fafd4a06740 1 --2- 172.21.15.78:0/3776796832 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x55ce709da280 0x55ce70e32af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.490+0000 7fafd4a06740 4 client.6471 mds_command: new command op to 5773 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:11:47.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.490+0000 7fafd4a06740 1 -- 172.21.15.78:0/3776796832 --> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] -- command(tid 0: {"prefix": "status"}) -- 0x55ce70e34580 con 0x55ce709da280 2024-09-17T03:11:47.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.490+0000 7fafc6ffd640 1 --2- 172.21.15.78:0/3776796832 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x55ce709da280 0x55ce70e32af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.490+0000 7fafa67fc640 10 client.6471 ms_handle_connect on v2:172.21.15.193:6835/2730762656 2024-09-17T03:11:47.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.490+0000 7fafc6ffd640 1 --2- 172.21.15.78:0/3776796832 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x55ce709da280 0x55ce70e32af0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=483b461b3603657e server_cookie=4004ee28874cd979 in_seq=0 out_seq=0 2024-09-17T03:11:47.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafa67fc640 1 -- 172.21.15.78:0/3776796832 <== mds.1 v2:172.21.15.193:6835/2730762656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55ce70e34580 con 0x55ce709da280 2024-09-17T03:11:47.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafa67fc640 10 client.6471 handle_command_reply: tid=0 2024-09-17T03:11:47.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafd4a06740 1 client.6471 shutdown 2024-09-17T03:11:47.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafd4a06740 1 -- 172.21.15.78:0/3776796832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a1d3b0 msgr2=0x55ce70ea89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafd4a06740 1 --2- 172.21.15.78:0/3776796832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a1d3b0 0x55ce70ea89f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fafb008d110 tx=0x7fafb00b9bf0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafd4a06740 1 -- 172.21.15.78:0/3776796832 shutdown_connections 2024-09-17T03:11:47.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafd4a06740 1 --2- 172.21.15.78:0/3776796832 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x55ce709da280 0x55ce70e32af0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafd4a06740 1 --2- 172.21.15.78:0/3776796832 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ce70a25590 0x55ce70ea8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafd4a06740 1 --2- 172.21.15.78:0/3776796832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ce70a1d3b0 0x55ce70ea89f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafa67fc640 0 client.6471 ms_handle_reset on v2:172.21.15.193:6835/2730762656 2024-09-17T03:11:47.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafd4a06740 1 --2- 172.21.15.78:0/3776796832 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ce70a04e40 0x55ce70e90c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafd4a06740 1 -- 172.21.15.78:0/3776796832 >> 172.21.15.78:0/3776796832 conn(0x55ce70a3a3c0 msgr2=0x55ce70def1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:47.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafd4a06740 1 -- 172.21.15.78:0/3776796832 shutdown_connections 2024-09-17T03:11:47.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafd4a06740 1 -- 172.21.15.78:0/3776796832 wait complete. 2024-09-17T03:11:47.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafd4a06740 20 client.6471 trim_cache size 0 max 16384 2024-09-17T03:11:47.497 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:11:47.497 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:11:47.497 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 1, 2024-09-17T03:11:47.497 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 5773, 2024-09-17T03:11:47.497 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:11:47.497 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:11:47.497 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:11:47.497 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 3.2467733010000002, 2024-09-17T03:11:47.497 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 50, 2024-09-17T03:11:47.497 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 58, 2024-09-17T03:11:47.498 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 58, 2024-09-17T03:11:47.498 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 19.284271952000001 2024-09-17T03:11:47.498 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:11:47.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafcd9ba640 1 -- 172.21.15.78:0/3299752011 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fafa8078bc0 msgr2=0x7fafa807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafcd9ba640 1 --2- 172.21.15.78:0/3299752011 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fafa8078bc0 0x7fafa807b0d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fafb800bb50 tx=0x7fafb800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafcd9ba640 1 -- 172.21.15.78:0/3299752011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafc80d3870 msgr2=0x7fafc81f97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafcd9ba640 1 --2- 172.21.15.78:0/3299752011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafc80d3870 0x7fafc81f97d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fafb0034040 tx=0x7fafb00038a0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafcd9ba640 1 -- 172.21.15.78:0/3299752011 shutdown_connections 2024-09-17T03:11:47.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafcd9ba640 1 --2- 172.21.15.78:0/3299752011 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fafa8078bc0 0x7fafa807b0d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafcd9ba640 1 --2- 172.21.15.78:0/3299752011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fafc80a2070 0x7fafc8161940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafcd9ba640 1 --2- 172.21.15.78:0/3299752011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafc80d3870 0x7fafc81f97d0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafcd9ba640 1 --2- 172.21.15.78:0/3299752011 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fafc806f4b0 0x7fafc80c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafcd9ba640 1 -- 172.21.15.78:0/3299752011 >> 172.21.15.78:0/3299752011 conn(0x7fafc808bfc0 msgr2=0x7fafc80b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:47.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.491+0000 7fafcd9ba640 1 -- 172.21.15.78:0/3299752011 shutdown_connections 2024-09-17T03:11:47.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.492+0000 7fafcd9ba640 1 -- 172.21.15.78:0/3299752011 wait complete. 2024-09-17T03:11:47.502 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:11:47.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.617+0000 7f72fa456640 1 -- 172.21.15.78:0/3179661998 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f72f40b2cb0 msgr2=0x7f72f40b30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.617+0000 7f72fa456640 1 --2- 172.21.15.78:0/3179661998 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f72f40b2cb0 0x7f72f40b30c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f72ec005fd0 tx=0x7f72ec02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.618+0000 7f72fa456640 1 -- 172.21.15.78:0/3179661998 shutdown_connections 2024-09-17T03:11:47.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.618+0000 7f72fa456640 1 --2- 172.21.15.78:0/3179661998 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f72f40b2cb0 0x7f72f40b30c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.618+0000 7f72fa456640 1 --2- 172.21.15.78:0/3179661998 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f72f40cf130 0x7f72f4071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.618+0000 7f72fa456640 1 -- 172.21.15.78:0/3179661998 >> 172.21.15.78:0/3179661998 conn(0x7f72f40cdcb0 msgr2=0x7f72f40ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:47.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.618+0000 7f72fa456640 1 -- 172.21.15.78:0/3179661998 shutdown_connections 2024-09-17T03:11:47.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.618+0000 7f72fa456640 1 -- 172.21.15.78:0/3179661998 wait complete. 2024-09-17T03:11:47.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.619+0000 7f72fa456640 1 Processor -- start 2024-09-17T03:11:47.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.620+0000 7f72fa456640 1 -- start start 2024-09-17T03:11:47.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.621+0000 7f72fa456640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72f40b2cb0 0x7f72f409dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.621+0000 7f72fa456640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f72f40cf130 0x7f72f41f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.621+0000 7f72fa456640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f72f415b8f0 0x7f72f406cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.621+0000 7f72fa456640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f72f40ae330 con 0x7f72f40b2cb0 2024-09-17T03:11:47.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.621+0000 7f72fa456640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f72f40ae1b0 con 0x7f72f415b8f0 2024-09-17T03:11:47.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.621+0000 7f72fa456640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f72f40ae4b0 con 0x7f72f40cf130 2024-09-17T03:11:47.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.621+0000 7f72f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72f40b2cb0 0x7f72f409dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.621+0000 7f72f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72f40b2cb0 0x7f72f409dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41240/0 (socket says 172.21.15.78:41240) 2024-09-17T03:11:47.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.621+0000 7f72f3fff640 1 -- 172.21.15.78:0/3060702190 learned_addr learned my addr 172.21.15.78:0/3060702190 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:47.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.621+0000 7f72f89f3640 1 --2- 172.21.15.78:0/3060702190 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f72f415b8f0 0x7f72f406cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.621+0000 7f72f37fe640 1 --2- 172.21.15.78:0/3060702190 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f72f40cf130 0x7f72f41f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.621+0000 7f72f3fff640 1 -- 172.21.15.78:0/3060702190 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f72f40cf130 msgr2=0x7f72f41f3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.621+0000 7f72f3fff640 1 --2- 172.21.15.78:0/3060702190 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f72f40cf130 0x7f72f41f3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.621+0000 7f72f3fff640 1 -- 172.21.15.78:0/3060702190 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f72f415b8f0 msgr2=0x7f72f406cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.621+0000 7f72f3fff640 1 --2- 172.21.15.78:0/3060702190 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f72f415b8f0 0x7f72f406cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.621+0000 7f72f3fff640 1 -- 172.21.15.78:0/3060702190 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f41f4500 con 0x7f72f40b2cb0 2024-09-17T03:11:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.621+0000 7f72f89f3640 1 --2- 172.21.15.78:0/3060702190 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f72f415b8f0 0x7f72f406cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.621+0000 7f72f3fff640 1 --2- 172.21.15.78:0/3060702190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72f40b2cb0 0x7f72f409dae0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f72e400c730 tx=0x7f72e400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.622+0000 7f72f0ff9640 1 -- 172.21.15.78:0/3060702190 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4016020 con 0x7f72f40b2cb0 2024-09-17T03:11:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.622+0000 7f72f0ff9640 1 -- 172.21.15.78:0/3060702190 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72e400a950 con 0x7f72f40b2cb0 2024-09-17T03:11:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.622+0000 7f72fa456640 1 -- 172.21.15.78:0/3060702190 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f41f47e0 con 0x7f72f40b2cb0 2024-09-17T03:11:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.622+0000 7f72f0ff9640 1 -- 172.21.15.78:0/3060702190 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e400ada0 con 0x7f72f40b2cb0 2024-09-17T03:11:47.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.622+0000 7f72fa456640 1 -- 172.21.15.78:0/3060702190 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f409d5c0 con 0x7f72f40b2cb0 2024-09-17T03:11:47.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.623+0000 7f72f0ff9640 1 -- 172.21.15.78:0/3060702190 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f72e4019020 con 0x7f72f40b2cb0 2024-09-17T03:11:47.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.624+0000 7f72f0ff9640 1 --2- 172.21.15.78:0/3060702190 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f72e0078bc0 0x7f72e007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.624+0000 7f72f0ff9640 1 -- 172.21.15.78:0/3060702190 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f72e409ac90 con 0x7f72f40b2cb0 2024-09-17T03:11:47.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.624+0000 7f72f37fe640 1 --2- 172.21.15.78:0/3060702190 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f72e0078bc0 0x7f72e007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.625+0000 7f72f37fe640 1 --2- 172.21.15.78:0/3060702190 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f72e0078bc0 0x7f72e007b0d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f72f40c6480 tx=0x7f72e8005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:47.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.625+0000 7f73013c8740 1 Processor -- start 2024-09-17T03:11:47.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.625+0000 7f73013c8740 1 -- start start 2024-09-17T03:11:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.626+0000 7f73013c8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4d22270 0x5622c50f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.626+0000 7f73013c8740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5622c4cf93b0 0x5622c50f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.626+0000 7f73013c8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5622c4d01590 0x5622c51113e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.626+0000 7f73013c8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5622c503c820 con 0x5622c4d22270 2024-09-17T03:11:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.626+0000 7f73013c8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5622c502bc50 con 0x5622c4d01590 2024-09-17T03:11:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.626+0000 7f73013c8740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5622c502fa60 con 0x5622c4cf93b0 2024-09-17T03:11:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.626+0000 7f72f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4d22270 0x5622c50f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.626+0000 7f72f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4d22270 0x5622c50f3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41252/0 (socket says 172.21.15.78:41252) 2024-09-17T03:11:47.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.626+0000 7f72f3fff640 1 -- 172.21.15.78:0/1098974557 learned_addr learned my addr 172.21.15.78:0/1098974557 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.627+0000 7f72f37fe640 1 --2- 172.21.15.78:0/1098974557 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5622c4cf93b0 0x5622c50f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.627+0000 7f72f89f3640 1 --2- 172.21.15.78:0/1098974557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5622c4d01590 0x5622c51113e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.627+0000 7f72f3fff640 1 -- 172.21.15.78:0/1098974557 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5622c4cf93b0 msgr2=0x5622c50f44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.627+0000 7f72f3fff640 1 --2- 172.21.15.78:0/1098974557 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5622c4cf93b0 0x5622c50f44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.627+0000 7f72f3fff640 1 -- 172.21.15.78:0/1098974557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5622c4d01590 msgr2=0x5622c51113e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.627+0000 7f72f3fff640 1 --2- 172.21.15.78:0/1098974557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5622c4d01590 0x5622c51113e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.627+0000 7f72f3fff640 1 -- 172.21.15.78:0/1098974557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622c4d8d850 con 0x5622c4d22270 2024-09-17T03:11:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.627+0000 7f72f3fff640 1 --2- 172.21.15.78:0/1098974557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4d22270 0x5622c50f3fa0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f72e40991e0 tx=0x7f72e4007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d272bbe28b529f54 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.627+0000 7f72d9ffb640 1 -- 172.21.15.78:0/1098974557 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4063150 con 0x5622c4d22270 2024-09-17T03:11:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.627+0000 7f72d9ffb640 1 -- 172.21.15.78:0/1098974557 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72e4067530 con 0x5622c4d22270 2024-09-17T03:11:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.627+0000 7f72d9ffb640 1 -- 172.21.15.78:0/1098974557 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e406c470 con 0x5622c4d22270 2024-09-17T03:11:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.628+0000 7f73013c8740 1 -- 172.21.15.78:0/1098974557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4d22270 msgr2=0x5622c50f3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.628+0000 7f73013c8740 1 --2- 172.21.15.78:0/1098974557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4d22270 0x5622c50f3fa0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f72e40991e0 tx=0x7f72e4007dd0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.628+0000 7f73013c8740 1 -- 172.21.15.78:0/1098974557 shutdown_connections 2024-09-17T03:11:47.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.628+0000 7f73013c8740 1 --2- 172.21.15.78:0/1098974557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5622c4d01590 0x5622c51113e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.628+0000 7f73013c8740 1 --2- 172.21.15.78:0/1098974557 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5622c4cf93b0 0x5622c50f44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.628+0000 7f73013c8740 1 --2- 172.21.15.78:0/1098974557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4d22270 0x5622c50f3fa0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.628+0000 7f73013c8740 1 -- 172.21.15.78:0/1098974557 >> 172.21.15.78:0/1098974557 conn(0x5622c4d163c0 msgr2=0x5622c50ca260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:47.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.628+0000 7f73013c8740 1 -- 172.21.15.78:0/1098974557 shutdown_connections 2024-09-17T03:11:47.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.628+0000 7f73013c8740 1 -- 172.21.15.78:0/1098974557 wait complete. 2024-09-17T03:11:47.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.629+0000 7f73013c8740 1 -- start start 2024-09-17T03:11:47.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.629+0000 7f73013c8740 1 Processor -- start 2024-09-17T03:11:47.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.630+0000 7f73013c8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5622c4cf93b0 0x5622c5112920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.630+0000 7f73013c8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4d01590 0x5622c50df7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.630+0000 7f73013c8740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5622c4d22270 0x5622c50c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.630+0000 7f73013c8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5622c4d9c620 con 0x5622c4d01590 2024-09-17T03:11:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.630+0000 7f73013c8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5622c4fd15f0 con 0x5622c4cf93b0 2024-09-17T03:11:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.630+0000 7f73013c8740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5622c50f4a20 con 0x5622c4d22270 2024-09-17T03:11:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.630+0000 7f73013c8740 10 client.0 _ll_register_callbacks cb 0x5622c4fd50a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.630+0000 7f72f37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4d01590 0x5622c50df7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.630+0000 7f72f37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4d01590 0x5622c50df7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41264/0 (socket says 172.21.15.78:41264) 2024-09-17T03:11:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.630+0000 7f72f37fe640 1 -- 172.21.15.78:0/3061626655 learned_addr learned my addr 172.21.15.78:0/3061626655 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.631+0000 7f72f3fff640 1 --2- 172.21.15.78:0/3061626655 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5622c4cf93b0 0x5622c5112920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.631+0000 7f72f89f3640 1 --2- 172.21.15.78:0/3061626655 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5622c4d22270 0x5622c50c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.631+0000 7f72f37fe640 1 -- 172.21.15.78:0/3061626655 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5622c4d22270 msgr2=0x5622c50c32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.631+0000 7f72f37fe640 1 --2- 172.21.15.78:0/3061626655 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5622c4d22270 0x5622c50c32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.631+0000 7f72f37fe640 1 -- 172.21.15.78:0/3061626655 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5622c4cf93b0 msgr2=0x5622c5112920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.631+0000 7f72f37fe640 1 --2- 172.21.15.78:0/3061626655 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5622c4cf93b0 0x5622c5112920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.631+0000 7f72f37fe640 1 -- 172.21.15.78:0/3061626655 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622c4e046b0 con 0x5622c4d01590 2024-09-17T03:11:47.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.631+0000 7f72f37fe640 1 --2- 172.21.15.78:0/3061626655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4d01590 0x5622c50df7e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f72e8012930 tx=0x7f72e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b42ef50a1d104a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:47.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.631+0000 7f72d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:47.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.631+0000 7f72d2ffd640 1 -- 172.21.15.78:0/3061626655 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e8020d40 con 0x5622c4d01590 2024-09-17T03:11:47.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.631+0000 7f72d2ffd640 1 -- 172.21.15.78:0/3061626655 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f72e802aaf0 con 0x5622c4d01590 2024-09-17T03:11:47.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.631+0000 7f73013c8740 1 -- 172.21.15.78:0/3061626655 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72e4067530 con 0x5622c4d01590 2024-09-17T03:11:47.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.631+0000 7f72d2ffd640 1 -- 172.21.15.78:0/3061626655 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f72e802acf0 con 0x5622c4d01590 2024-09-17T03:11:47.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.631+0000 7f73013c8740 10 client.6483 fetch_fsmap learned FSMap version 50 2024-09-17T03:11:47.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.631+0000 7f73013c8740 1 -- 172.21.15.78:0/3061626655 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x5622c5112e60 con 0x5622c4d01590 2024-09-17T03:11:47.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.631+0000 7f72d2ffd640 1 -- 172.21.15.78:0/3061626655 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72e4067530 con 0x5622c4d01590 2024-09-17T03:11:47.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.632+0000 7f72d2ffd640 1 -- 172.21.15.78:0/3061626655 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 50) ==== 3542+0+0 (secure 0 0 0) 0x7f72e8031050 con 0x5622c4d01590 2024-09-17T03:11:47.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.632+0000 7f73013c8740 10 client.6483 fetch_fsmap finished waiting for FSMap version 50 2024-09-17T03:11:47.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.632+0000 7f73013c8740 10 client.6483 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:11:47.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.632+0000 7f73013c8740 20 client.6483 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:47.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.632+0000 7f73013c8740 1 --2- 172.21.15.78:0/3061626655 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x5622c4ce0e40 0x5622c5121800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.632+0000 7f73013c8740 4 client.6483 mds_command: new command op to 6231 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:11:47.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.632+0000 7f73013c8740 1 -- 172.21.15.78:0/3061626655 --> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622c503e770 con 0x5622c4ce0e40 2024-09-17T03:11:47.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.632+0000 7f72f3fff640 1 --2- 172.21.15.78:0/3061626655 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x5622c4ce0e40 0x5622c5121800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.632+0000 7f72d2ffd640 10 client.6483 ms_handle_connect on v2:172.21.15.78:6832/936871583 2024-09-17T03:11:47.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.632+0000 7f72f3fff640 1 --2- 172.21.15.78:0/3061626655 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x5622c4ce0e40 0x5622c5121800 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5274e0b9a4cb8c3 server_cookie=be5fb81982e31456 in_seq=0 out_seq=0 2024-09-17T03:11:47.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.633+0000 7f72d2ffd640 1 -- 172.21.15.78:0/3061626655 <== mds.0 v2:172.21.15.78:6832/936871583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5622c503e770 con 0x5622c4ce0e40 2024-09-17T03:11:47.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.633+0000 7f72d2ffd640 10 client.6483 handle_command_reply: tid=0 2024-09-17T03:11:47.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.633+0000 7f73013c8740 1 client.6483 shutdown 2024-09-17T03:11:47.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.633+0000 7f73013c8740 1 -- 172.21.15.78:0/3061626655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4d01590 msgr2=0x5622c50df7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.633+0000 7f73013c8740 1 --2- 172.21.15.78:0/3061626655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4d01590 0x5622c50df7e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f72e8012930 tx=0x7f72e8004730 comp rx=0 tx=0).stop 2024-09-17T03:11:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.633+0000 7f73013c8740 1 -- 172.21.15.78:0/3061626655 shutdown_connections 2024-09-17T03:11:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.633+0000 7f73013c8740 1 --2- 172.21.15.78:0/3061626655 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x5622c4ce0e40 0x5622c5121800 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.633+0000 7f73013c8740 1 --2- 172.21.15.78:0/3061626655 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5622c4d22270 0x5622c50c32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.633+0000 7f73013c8740 1 --2- 172.21.15.78:0/3061626655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4d01590 0x5622c50df7e0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.633+0000 7f72d2ffd640 0 client.6483 ms_handle_reset on v2:172.21.15.78:6832/936871583 2024-09-17T03:11:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.633+0000 7f73013c8740 1 --2- 172.21.15.78:0/3061626655 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5622c4cf93b0 0x5622c5112920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.633+0000 7f73013c8740 1 -- 172.21.15.78:0/3061626655 >> 172.21.15.78:0/3061626655 conn(0x5622c4d163c0 msgr2=0x5622c51109b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.633+0000 7f73013c8740 1 -- 172.21.15.78:0/3061626655 shutdown_connections 2024-09-17T03:11:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.633+0000 7f73013c8740 1 -- 172.21.15.78:0/3061626655 wait complete. 2024-09-17T03:11:47.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.633+0000 7f73013c8740 20 client.6483 trim_cache size 0 max 16384 2024-09-17T03:11:47.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.651+0000 7f73013c8740 1 Processor -- start 2024-09-17T03:11:47.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.651+0000 7f73013c8740 1 -- start start 2024-09-17T03:11:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.652+0000 7f73013c8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4cf93b0 0x5622c51123c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.652+0000 7f73013c8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5622c4d01590 0x5622c5105b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.652+0000 7f73013c8740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5622c4d22270 0x5622c51060d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.652+0000 7f73013c8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f72f41f7020 con 0x5622c4cf93b0 2024-09-17T03:11:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.652+0000 7f73013c8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f72f41f76d0 con 0x5622c4d01590 2024-09-17T03:11:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.652+0000 7f73013c8740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f72f41e9c10 con 0x5622c4d22270 2024-09-17T03:11:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.653+0000 7f72f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4cf93b0 0x5622c51123c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.653+0000 7f72f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4cf93b0 0x5622c51123c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41270/0 (socket says 172.21.15.78:41270) 2024-09-17T03:11:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.653+0000 7f72f3fff640 1 -- 172.21.15.78:0/1772448981 learned_addr learned my addr 172.21.15.78:0/1772448981 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.653+0000 7f72f3fff640 1 -- 172.21.15.78:0/1772448981 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5622c4d22270 msgr2=0x5622c51060d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.653+0000 7f72f3fff640 1 --2- 172.21.15.78:0/1772448981 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5622c4d22270 0x5622c51060d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.653+0000 7f72f3fff640 1 -- 172.21.15.78:0/1772448981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5622c4d01590 msgr2=0x5622c5105b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.653+0000 7f72f37fe640 1 --2- 172.21.15.78:0/1772448981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5622c4d01590 0x5622c5105b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.653+0000 7f72f3fff640 1 --2- 172.21.15.78:0/1772448981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5622c4d01590 0x5622c5105b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.653+0000 7f72f3fff640 1 -- 172.21.15.78:0/1772448981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622c50c3610 con 0x5622c4cf93b0 2024-09-17T03:11:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.653+0000 7f72f3fff640 1 --2- 172.21.15.78:0/1772448981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4cf93b0 0x5622c51123c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f72e400c700 tx=0x7f72e4007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4941114578ce1c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.653+0000 7f72d97fa640 1 -- 172.21.15.78:0/1772448981 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e406c470 con 0x5622c4cf93b0 2024-09-17T03:11:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.653+0000 7f72d97fa640 1 -- 172.21.15.78:0/1772448981 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72e40671e0 con 0x5622c4cf93b0 2024-09-17T03:11:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.653+0000 7f72d97fa640 1 -- 172.21.15.78:0/1772448981 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4078b80 con 0x5622c4cf93b0 2024-09-17T03:11:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.654+0000 7f73013c8740 1 -- 172.21.15.78:0/1772448981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4cf93b0 msgr2=0x5622c51123c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.654+0000 7f73013c8740 1 --2- 172.21.15.78:0/1772448981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4cf93b0 0x5622c51123c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f72e400c700 tx=0x7f72e4007dd0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.654+0000 7f73013c8740 1 -- 172.21.15.78:0/1772448981 shutdown_connections 2024-09-17T03:11:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.654+0000 7f73013c8740 1 --2- 172.21.15.78:0/1772448981 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5622c4d22270 0x5622c51060d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.654+0000 7f73013c8740 1 --2- 172.21.15.78:0/1772448981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5622c4d01590 0x5622c5105b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.654+0000 7f73013c8740 1 --2- 172.21.15.78:0/1772448981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4cf93b0 0x5622c51123c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.654+0000 7f73013c8740 1 -- 172.21.15.78:0/1772448981 >> 172.21.15.78:0/1772448981 conn(0x5622c4d163c0 msgr2=0x5622c510f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:47.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.654+0000 7f73013c8740 1 -- 172.21.15.78:0/1772448981 shutdown_connections 2024-09-17T03:11:47.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.654+0000 7f73013c8740 1 -- 172.21.15.78:0/1772448981 wait complete. 2024-09-17T03:11:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.655+0000 7f73013c8740 1 -- start start 2024-09-17T03:11:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.655+0000 7f73013c8740 1 Processor -- start 2024-09-17T03:11:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.656+0000 7f73013c8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4cf93b0 0x5622c511a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.656+0000 7f73013c8740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5622c4d01590 0x5622c5127f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.656+0000 7f73013c8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5622c4d22270 0x5622c518e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.656+0000 7f73013c8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5622c50df410 con 0x5622c4cf93b0 2024-09-17T03:11:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.656+0000 7f73013c8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5622c50dfd70 con 0x5622c4d22270 2024-09-17T03:11:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.656+0000 7f73013c8740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5622c5111540 con 0x5622c4d01590 2024-09-17T03:11:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.656+0000 7f73013c8740 10 client.0 _ll_register_callbacks cb 0x7f72e80125b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:11:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.656+0000 7f72f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4cf93b0 0x5622c511a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.656+0000 7f72f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4cf93b0 0x5622c511a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41276/0 (socket says 172.21.15.78:41276) 2024-09-17T03:11:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.656+0000 7f72f3fff640 1 -- 172.21.15.78:0/1207563194 learned_addr learned my addr 172.21.15.78:0/1207563194 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f72f3fff640 1 -- 172.21.15.78:0/1207563194 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5622c4d01590 msgr2=0x5622c5127f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f72f3fff640 1 --2- 172.21.15.78:0/1207563194 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5622c4d01590 0x5622c5127f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f72f3fff640 1 -- 172.21.15.78:0/1207563194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5622c4d22270 msgr2=0x5622c518e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:11:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f72f3fff640 1 --2- 172.21.15.78:0/1207563194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5622c4d22270 0x5622c518e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f72f3fff640 1 -- 172.21.15.78:0/1207563194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622c50cacb0 con 0x5622c4cf93b0 2024-09-17T03:11:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f72f3fff640 1 --2- 172.21.15.78:0/1207563194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4cf93b0 0x5622c511a780 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f72e400c700 tx=0x7f72e40626a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d4feb503ebaa1f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f72d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:11:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f72d2ffd640 1 -- 172.21.15.78:0/1207563194 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e4067530 con 0x5622c4cf93b0 2024-09-17T03:11:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f72d2ffd640 1 -- 172.21.15.78:0/1207563194 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f72e406dd70 con 0x5622c4cf93b0 2024-09-17T03:11:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f73013c8740 1 -- 172.21.15.78:0/1207563194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72e40671e0 con 0x5622c4cf93b0 2024-09-17T03:11:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f72d2ffd640 1 -- 172.21.15.78:0/1207563194 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f72e406c470 con 0x5622c4cf93b0 2024-09-17T03:11:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f73013c8740 10 client.6489 fetch_fsmap learned FSMap version 50 2024-09-17T03:11:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f73013c8740 1 -- 172.21.15.78:0/1207563194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) -- 0x5622c50c6b70 con 0x5622c4cf93b0 2024-09-17T03:11:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f72d2ffd640 1 -- 172.21.15.78:0/1207563194 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72e40671e0 con 0x5622c4cf93b0 2024-09-17T03:11:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f72d2ffd640 1 -- 172.21.15.78:0/1207563194 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 50) ==== 3542+0+0 (secure 0 0 0) 0x7f72e4078b80 con 0x5622c4cf93b0 2024-09-17T03:11:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f73013c8740 10 client.6489 fetch_fsmap finished waiting for FSMap version 50 2024-09-17T03:11:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f73013c8740 10 client.6489 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:11:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f73013c8740 20 client.6489 populate_metadata read hostname 'smithi078' 2024-09-17T03:11:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f73013c8740 1 --2- 172.21.15.78:0/1207563194 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x5622c5105b90 0x5622c5105fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f73013c8740 4 client.6489 mds_command: new command op to 6231 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:11:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f73013c8740 1 -- 172.21.15.78:0/1207563194 --> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] -- command(tid 0: {"prefix": "status"}) -- 0x5622c503a220 con 0x5622c5105b90 2024-09-17T03:11:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.657+0000 7f72f37fe640 1 --2- 172.21.15.78:0/1207563194 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x5622c5105b90 0x5622c5105fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.658+0000 7f72d2ffd640 10 client.6489 ms_handle_connect on v2:172.21.15.78:6832/936871583 2024-09-17T03:11:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.658+0000 7f72f37fe640 1 --2- 172.21.15.78:0/1207563194 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x5622c5105b90 0x5622c5105fa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8dd2c9c3dc2ffbad server_cookie=2bc65b0427ea0b5b in_seq=0 out_seq=0 2024-09-17T03:11:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.658+0000 7f72d2ffd640 1 -- 172.21.15.78:0/1207563194 <== mds.0 v2:172.21.15.78:6832/936871583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+319 (crc 0 0 0) 0x5622c503a220 con 0x5622c5105b90 2024-09-17T03:11:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.658+0000 7f72d2ffd640 10 client.6489 handle_command_reply: tid=0 2024-09-17T03:11:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.658+0000 7f73013c8740 1 client.6489 shutdown 2024-09-17T03:11:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.658+0000 7f73013c8740 1 -- 172.21.15.78:0/1207563194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4cf93b0 msgr2=0x5622c511a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.658+0000 7f73013c8740 1 --2- 172.21.15.78:0/1207563194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4cf93b0 0x5622c511a780 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f72e400c700 tx=0x7f72e40626a0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.658+0000 7f73013c8740 1 -- 172.21.15.78:0/1207563194 shutdown_connections 2024-09-17T03:11:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.658+0000 7f73013c8740 1 --2- 172.21.15.78:0/1207563194 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x5622c5105b90 0x5622c5105fa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.658+0000 7f73013c8740 1 --2- 172.21.15.78:0/1207563194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5622c4d22270 0x5622c518e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.658+0000 7f72d2ffd640 0 client.6489 ms_handle_reset on v2:172.21.15.78:6832/936871583 2024-09-17T03:11:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.658+0000 7f73013c8740 1 --2- 172.21.15.78:0/1207563194 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5622c4d01590 0x5622c5127f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.658+0000 7f73013c8740 1 --2- 172.21.15.78:0/1207563194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5622c4cf93b0 0x5622c511a780 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.658+0000 7f73013c8740 1 -- 172.21.15.78:0/1207563194 >> 172.21.15.78:0/1207563194 conn(0x5622c4d163c0 msgr2=0x5622c50c5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.658+0000 7f73013c8740 1 -- 172.21.15.78:0/1207563194 shutdown_connections 2024-09-17T03:11:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.658+0000 7f73013c8740 1 -- 172.21.15.78:0/1207563194 wait complete. 2024-09-17T03:11:47.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.659+0000 7f73013c8740 20 client.6489 trim_cache size 0 max 16384 2024-09-17T03:11:47.663 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:11:47.664 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:11:47.664 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-09-17T03:11:47.664 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 6231, 2024-09-17T03:11:47.664 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:11:47.664 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:11:47.664 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:11:47.664 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 14.775767452, 2024-09-17T03:11:47.664 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 50, 2024-09-17T03:11:47.664 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 58, 2024-09-17T03:11:47.664 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 58, 2024-09-17T03:11:47.664 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 19.462554631 2024-09-17T03:11:47.664 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:11:47.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.659+0000 7f72fa456640 1 -- 172.21.15.78:0/3060702190 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f72e0078bc0 msgr2=0x7f72e007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.659+0000 7f72fa456640 1 --2- 172.21.15.78:0/3060702190 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f72e0078bc0 0x7f72e007b0d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f72f40c6480 tx=0x7f72e8005f90 comp rx=0 tx=0).stop 2024-09-17T03:11:47.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.659+0000 7f72fa456640 1 -- 172.21.15.78:0/3060702190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72f40b2cb0 msgr2=0x7f72f409dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.659+0000 7f72fa456640 1 --2- 172.21.15.78:0/3060702190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72f40b2cb0 0x7f72f409dae0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f72e400c730 tx=0x7f72e400cbf0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.659+0000 7f72fa456640 1 -- 172.21.15.78:0/3060702190 shutdown_connections 2024-09-17T03:11:47.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.659+0000 7f72fa456640 1 --2- 172.21.15.78:0/3060702190 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f72e0078bc0 0x7f72e007b0d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.659+0000 7f72fa456640 1 --2- 172.21.15.78:0/3060702190 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f72f415b8f0 0x7f72f406cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.659+0000 7f72fa456640 1 --2- 172.21.15.78:0/3060702190 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f72f40cf130 0x7f72f41f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.659+0000 7f72fa456640 1 --2- 172.21.15.78:0/3060702190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72f40b2cb0 0x7f72f409dae0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.659+0000 7f72fa456640 1 -- 172.21.15.78:0/3060702190 >> 172.21.15.78:0/3060702190 conn(0x7f72f40cdcb0 msgr2=0x7f72f40d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:47.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.659+0000 7f72fa456640 1 -- 172.21.15.78:0/3060702190 shutdown_connections 2024-09-17T03:11:47.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.659+0000 7f72fa456640 1 -- 172.21.15.78:0/3060702190 wait complete. 2024-09-17T03:11:47.670 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:11:47.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.782+0000 7f0afd3ad640 1 -- 172.21.15.78:0/3928303648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0af80d1a80 msgr2=0x7f0af80cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.782+0000 7f0afd3ad640 1 --2- 172.21.15.78:0/3928303648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0af80d1a80 0x7f0af80cf090 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f0af80d32e0 tx=0x7f0ae002a5f0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.782+0000 7f0afd3ad640 1 -- 172.21.15.78:0/3928303648 shutdown_connections 2024-09-17T03:11:47.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.782+0000 7f0afd3ad640 1 --2- 172.21.15.78:0/3928303648 >> v2:172.21.15.193:3300/0 conn(0x7f0af80cf5d0 0x7f0af80cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.782+0000 7f0afd3ad640 1 --2- 172.21.15.78:0/3928303648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0af80d1a80 0x7f0af80cf090 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.782+0000 7f0afd3ad640 1 -- 172.21.15.78:0/3928303648 >> 172.21.15.78:0/3928303648 conn(0x7f0af808bfc0 msgr2=0x7f0af809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:47.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.782+0000 7f0afd3ad640 1 -- 172.21.15.78:0/3928303648 shutdown_connections 2024-09-17T03:11:47.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.782+0000 7f0afd3ad640 1 -- 172.21.15.78:0/3928303648 wait complete. 2024-09-17T03:11:47.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.784+0000 7f0afd3ad640 1 Processor -- start 2024-09-17T03:11:47.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.784+0000 7f0afd3ad640 1 -- start start 2024-09-17T03:11:47.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.785+0000 7f0afd3ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0af80cf5d0 0x7f0af80ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.785+0000 7f0afd3ad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0af80d1a80 0x7f0af815e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.785+0000 7f0afd3ad640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0af80d2ed0 0x7f0af80a18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.785+0000 7f0afd3ad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0af8162bb0 con 0x7f0af80cf5d0 2024-09-17T03:11:47.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.785+0000 7f0afd3ad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0af8162a30 con 0x7f0af80d1a80 2024-09-17T03:11:47.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.785+0000 7f0afd3ad640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0af8162d30 con 0x7f0af80d2ed0 2024-09-17T03:11:47.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.785+0000 7f0af6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0af80cf5d0 0x7f0af80ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.785+0000 7f0af6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0af80cf5d0 0x7f0af80ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41288/0 (socket says 172.21.15.78:41288) 2024-09-17T03:11:47.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.785+0000 7f0af6ffd640 1 -- 172.21.15.78:0/1423362301 learned_addr learned my addr 172.21.15.78:0/1423362301 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:11:47.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.785+0000 7f0af67fc640 1 --2- 172.21.15.78:0/1423362301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0af80d1a80 0x7f0af815e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.785+0000 7f0af77fe640 1 --2- 172.21.15.78:0/1423362301 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0af80d2ed0 0x7f0af80a18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.785+0000 7f0af6ffd640 1 -- 172.21.15.78:0/1423362301 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0af80d2ed0 msgr2=0x7f0af80a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.785+0000 7f0af6ffd640 1 --2- 172.21.15.78:0/1423362301 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0af80d2ed0 0x7f0af80a18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.785+0000 7f0af6ffd640 1 -- 172.21.15.78:0/1423362301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0af80d1a80 msgr2=0x7f0af815e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:47.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.785+0000 7f0af6ffd640 1 --2- 172.21.15.78:0/1423362301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0af80d1a80 0x7f0af815e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:47.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.785+0000 7f0af6ffd640 1 -- 172.21.15.78:0/1423362301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af815f370 con 0x7f0af80cf5d0 2024-09-17T03:11:47.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.785+0000 7f0af67fc640 1 --2- 172.21.15.78:0/1423362301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0af80d1a80 0x7f0af815e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:11:47.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.785+0000 7f0af6ffd640 1 --2- 172.21.15.78:0/1423362301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0af80cf5d0 0x7f0af80ca040 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f0af000c740 tx=0x7f0af000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:47.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.786+0000 7f0aef7fe640 1 -- 172.21.15.78:0/1423362301 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0003bc0 con 0x7f0af80cf5d0 2024-09-17T03:11:47.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.786+0000 7f0aef7fe640 1 -- 172.21.15.78:0/1423362301 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0af000ce50 con 0x7f0af80cf5d0 2024-09-17T03:11:47.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.786+0000 7f0afd3ad640 1 -- 172.21.15.78:0/1423362301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0af81f9e40 con 0x7f0af80cf5d0 2024-09-17T03:11:47.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.786+0000 7f0aef7fe640 1 -- 172.21.15.78:0/1423362301 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af000a850 con 0x7f0af80cf5d0 2024-09-17T03:11:47.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.786+0000 7f0afd3ad640 1 -- 172.21.15.78:0/1423362301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0af81f9510 con 0x7f0af80cf5d0 2024-09-17T03:11:47.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.787+0000 7f0afd3ad640 1 -- 172.21.15.78:0/1423362301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0af81632c0 con 0x7f0af80cf5d0 2024-09-17T03:11:47.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.787+0000 7f0aef7fe640 1 -- 172.21.15.78:0/1423362301 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0af000a9f0 con 0x7f0af80cf5d0 2024-09-17T03:11:47.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.788+0000 7f0aef7fe640 1 --2- 172.21.15.78:0/1423362301 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0ad8078b90 0x7f0ad807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:11:47.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.788+0000 7f0aef7fe640 1 -- 172.21.15.78:0/1423362301 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f0af009abd0 con 0x7f0af80cf5d0 2024-09-17T03:11:47.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.788+0000 7f0af67fc640 1 --2- 172.21.15.78:0/1423362301 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0ad8078b90 0x7f0ad807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:11:47.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.789+0000 7f0af67fc640 1 --2- 172.21.15.78:0/1423362301 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0ad8078b90 0x7f0ad807b0a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0033000 tx=0x7f0ae0004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:11:47.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:47.793+0000 7f0aef7fe640 1 -- 172.21.15.78:0/1423362301 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0af00630a0 con 0x7f0af80cf5d0 2024-09-17T03:11:48.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:48.004+0000 7f0afd3ad640 1 -- 172.21.15.78:0/1423362301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0af80b4020 con 0x7f0af80cf5d0 2024-09-17T03:11:48.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:48.004+0000 7f0aef7fe640 1 -- 172.21.15.78:0/1423362301 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+5258 (secure 0 0 0) 0x7f0af00629a0 con 0x7f0af80cf5d0 2024-09-17T03:11:48.004 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:11:48.005 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":50,"btime":"2024-09-17T03:11:46:256604+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/33195895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":33195895},{"type":"v1","addr":"172.21.15.193:6836","nonce":33195895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:11:32.250686+0000","modified":"2024-09-17T03:11:46.256598+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6231,"mds_1":5773,"mds_2":5758},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5758":{"gid":5758,"name":"a","rank":2,"incarnation":49,"state":"up:active","state_seq":6,"addr":"172.21.15.78:6835/1865992966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1865992966},{"type":"v1","addr":"172.21.15.78:6835","nonce":1865992966}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5773":{"gid":5773,"name":"b","rank":1,"incarnation":47,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6837/2730762656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2730762656},{"type":"v1","addr":"172.21.15.193:6837","nonce":2730762656}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6231":{"gid":6231,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6834/936871583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":936871583},{"type":"v1","addr":"172.21.15.78:6834","nonce":936871583}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6231,"qdb_cluster":[5758,5773,6231]},"id":4}]} 2024-09-17T03:11:48.005 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 50 2024-09-17T03:11:48.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:48.006+0000 7f0afd3ad640 1 -- 172.21.15.78:0/1423362301 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0ad8078b90 msgr2=0x7f0ad807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:48.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:48.006+0000 7f0afd3ad640 1 --2- 172.21.15.78:0/1423362301 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0ad8078b90 0x7f0ad807b0a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0033000 tx=0x7f0ae0004730 comp rx=0 tx=0).stop 2024-09-17T03:11:48.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:48.007+0000 7f0afd3ad640 1 -- 172.21.15.78:0/1423362301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0af80cf5d0 msgr2=0x7f0af80ca040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:11:48.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:48.007+0000 7f0afd3ad640 1 --2- 172.21.15.78:0/1423362301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0af80cf5d0 0x7f0af80ca040 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f0af000c740 tx=0x7f0af000cc00 comp rx=0 tx=0).stop 2024-09-17T03:11:48.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:48.007+0000 7f0afd3ad640 1 -- 172.21.15.78:0/1423362301 shutdown_connections 2024-09-17T03:11:48.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:48.007+0000 7f0afd3ad640 1 --2- 172.21.15.78:0/1423362301 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0af80d2ed0 0x7f0af80a18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:48.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:48.007+0000 7f0afd3ad640 1 --2- 172.21.15.78:0/1423362301 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0ad8078b90 0x7f0ad807b0a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:48.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:48.007+0000 7f0afd3ad640 1 --2- 172.21.15.78:0/1423362301 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0af80d1a80 0x7f0af815e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:48.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:48.007+0000 7f0afd3ad640 1 --2- 172.21.15.78:0/1423362301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0af80cf5d0 0x7f0af80ca040 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:11:48.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:48.007+0000 7f0afd3ad640 1 -- 172.21.15.78:0/1423362301 >> 172.21.15.78:0/1423362301 conn(0x7f0af808bfc0 msgr2=0x7f0af806e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:11:48.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:48.007+0000 7f0afd3ad640 1 -- 172.21.15.78:0/1423362301 shutdown_connections 2024-09-17T03:11:48.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:11:48.007+0000 7f0afd3ad640 1 -- 172.21.15.78:0/1423362301 wait complete. 2024-09-17T03:11:48.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:11:48.019 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-17T03:11:48.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:11:48.044 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-17T03:11:48.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:11:48.106 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2024-09-17T03:11:48.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:11:48.164 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2024-09-17T03:11:48.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:11:48.219 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2024-09-17T03:11:48.274 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:11:48.437 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:11:48.438 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:11:48.438 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:11:48.868 INFO:tasks.ceph.mds.c.smithi078.stderr:2024-09-17T03:11:48.869+0000 7f2163f89640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-17T03:11:48.868 INFO:tasks.ceph.mds.c.smithi078.stderr:2024-09-17T03:11:48.869+0000 7f2163f89640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-17T03:11:50.439 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:11:50.574 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:11:50.574 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:11:50.574 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:11:52.575 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:11:52.711 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:11:52.711 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:11:52.711 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:11:54.713 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:11:54.856 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"15","version":"15","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}}] 2024-09-17T03:11:54.857 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "15", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "15" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:11:54.857 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:11:55.471 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:11:55.474 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:11:56.858 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:11:56.993 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"15","version":"15","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":1,"authpin":0},"nref":3}}] 2024-09-17T03:11:56.994 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 3, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "subtree": 1 }, "projected_version": "15", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "15" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:11:56.994 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:11:58.995 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:11:59.141 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"15","version":"15","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"15","version":"15","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2024-09-17T03:11:59.142 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "15", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "15" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "15", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "15" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-17T03:11:59.142 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:11:59.143 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-09-17T03:11:59.279 INFO:teuthology.orchestra.run.smithi193.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"15","version":"15","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-17T03:11:59.280 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "15", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "15" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:11:59.280 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:12:01.281 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-09-17T03:12:01.417 INFO:teuthology.orchestra.run.smithi193.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"15","version":"15","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-17T03:12:01.418 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "15", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "15" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:12:01.418 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:12:03.420 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json get subtrees 2024-09-17T03:12:03.556 INFO:teuthology.orchestra.run.smithi193.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"15","version":"15","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-17T03:12:03.557 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "15", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "15" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:12:03.557 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:12:03.557 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:12:03.701 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"17","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"15","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-17T03:12:03.701 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "17" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "15" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:12:03.701 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:12:03.702 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 flush journal 2024-09-17T03:12:03.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.820+0000 7fc2c5f33640 1 -- 172.21.15.78:0/820105801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2a8004d40 msgr2=0x7fc2a8005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:03.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.820+0000 7fc2c5f33640 1 --2- 172.21.15.78:0/820105801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2a8004d40 0x7fc2a8005150 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fc2c00c7ff0 tx=0x7fc2a8005830 comp rx=0 tx=0).stop 2024-09-17T03:12:03.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.820+0000 7fc2bffff640 1 -- 172.21.15.78:0/820105801 reap_dead start 2024-09-17T03:12:03.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.820+0000 7fc2c5f33640 1 -- 172.21.15.78:0/820105801 shutdown_connections 2024-09-17T03:12:03.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.820+0000 7fc2c5f33640 1 -- 172.21.15.78:0/820105801 >> 172.21.15.78:0/820105801 conn(0x7fc2c008bfc0 msgr2=0x7fc2c009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:03.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.820+0000 7fc2c5f33640 1 -- 172.21.15.78:0/820105801 shutdown_connections 2024-09-17T03:12:03.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.820+0000 7fc2c5f33640 1 -- 172.21.15.78:0/820105801 wait complete. 2024-09-17T03:12:03.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.822+0000 7fc2c5f33640 1 Processor -- start 2024-09-17T03:12:03.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.822+0000 7fc2c5f33640 1 -- start start 2024-09-17T03:12:03.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.823+0000 7fc2c5f33640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc2c00cde10 0x7fc2c00cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:03.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.823+0000 7fc2c5f33640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2c01f8ad0 0x7fc2c01f8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:03.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.823+0000 7fc2c5f33640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2c0150720 0x7fc2c0150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:03.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.823+0000 7fc2c5f33640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c00cf080 con 0x7fc2c01f8ad0 2024-09-17T03:12:03.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.823+0000 7fc2c5f33640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c00d36d0 con 0x7fc2c0150720 2024-09-17T03:12:03.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.823+0000 7fc2c5f33640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc2c00cf200 con 0x7fc2c00cde10 2024-09-17T03:12:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.823+0000 7fc2beffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2c01f8ad0 0x7fc2c01f8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.823+0000 7fc2beffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2c01f8ad0 0x7fc2c01f8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51772/0 (socket says 172.21.15.78:51772) 2024-09-17T03:12:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.823+0000 7fc2beffd640 1 -- 172.21.15.78:0/1571538933 learned_addr learned my addr 172.21.15.78:0/1571538933 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.823+0000 7fc2bf7fe640 1 --2- 172.21.15.78:0/1571538933 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc2c00cde10 0x7fc2c00cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.823+0000 7fc2bffff640 1 --2- 172.21.15.78:0/1571538933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2c0150720 0x7fc2c0150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.823+0000 7fc2beffd640 1 -- 172.21.15.78:0/1571538933 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc2c00cde10 msgr2=0x7fc2c00cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.823+0000 7fc2beffd640 1 --2- 172.21.15.78:0/1571538933 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc2c00cde10 0x7fc2c00cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.823+0000 7fc2beffd640 1 -- 172.21.15.78:0/1571538933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2c0150720 msgr2=0x7fc2c0150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.823+0000 7fc2beffd640 1 --2- 172.21.15.78:0/1571538933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2c0150720 0x7fc2c0150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.823+0000 7fc2beffd640 1 -- 172.21.15.78:0/1571538933 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2c01f9420 con 0x7fc2c01f8ad0 2024-09-17T03:12:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.824+0000 7fc2beffd640 1 --2- 172.21.15.78:0/1571538933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2c01f8ad0 0x7fc2c01f8ee0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4011ae0 tx=0x7fc2b4009e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.824+0000 7fc2a7fff640 1 -- 172.21.15.78:0/1571538933 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b401e070 con 0x7fc2c01f8ad0 2024-09-17T03:12:03.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.824+0000 7fc2a7fff640 1 -- 172.21.15.78:0/1571538933 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2b4004460 con 0x7fc2c01f8ad0 2024-09-17T03:12:03.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.824+0000 7fc2c5f33640 1 -- 172.21.15.78:0/1571538933 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2c00ccd70 con 0x7fc2c01f8ad0 2024-09-17T03:12:03.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.824+0000 7fc2a7fff640 1 -- 172.21.15.78:0/1571538933 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b400fc60 con 0x7fc2c01f8ad0 2024-09-17T03:12:03.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.824+0000 7fc2c5f33640 1 -- 172.21.15.78:0/1571538933 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2c00cd330 con 0x7fc2c01f8ad0 2024-09-17T03:12:03.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.826+0000 7fc2a7fff640 1 -- 172.21.15.78:0/1571538933 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc2b4021070 con 0x7fc2c01f8ad0 2024-09-17T03:12:03.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.826+0000 7fc2a7fff640 1 --2- 172.21.15.78:0/1571538933 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc2ac078bc0 0x7fc2ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:03.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.827+0000 7fc2a7fff640 1 -- 172.21.15.78:0/1571538933 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fc2b409b630 con 0x7fc2c01f8ad0 2024-09-17T03:12:03.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.827+0000 7fc2bf7fe640 1 --2- 172.21.15.78:0/1571538933 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc2ac078bc0 0x7fc2ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:03.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.827+0000 7fc2bf7fe640 1 --2- 172.21.15.78:0/1571538933 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc2ac078bc0 0x7fc2ac07b0d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0000ff0 tx=0x7fc2b0000f80 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:03.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.827+0000 7fc2cce9d740 1 Processor -- start 2024-09-17T03:12:03.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.827+0000 7fc2cce9d740 1 -- start start 2024-09-17T03:12:03.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.829+0000 7fc2cce9d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f238b390 0x55a9f275c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:03.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.829+0000 7fc2cce9d740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9f23624d0 0x55a9f275cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:03.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.829+0000 7fc2cce9d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9f236a6b0 0x55a9f2779b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:03.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.829+0000 7fc2cce9d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a9f26a5a60 con 0x55a9f238b390 2024-09-17T03:12:03.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.829+0000 7fc2cce9d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a9f2694e90 con 0x55a9f236a6b0 2024-09-17T03:12:03.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.829+0000 7fc2cce9d740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a9f2698ca0 con 0x55a9f23624d0 2024-09-17T03:12:03.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.829+0000 7fc2bf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f238b390 0x55a9f275c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:03.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.829+0000 7fc2bf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f238b390 0x55a9f275c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51776/0 (socket says 172.21.15.78:51776) 2024-09-17T03:12:03.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.829+0000 7fc2bf7fe640 1 -- 172.21.15.78:0/2506005756 learned_addr learned my addr 172.21.15.78:0/2506005756 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:03.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.829+0000 7fc2beffd640 1 --2- 172.21.15.78:0/2506005756 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9f23624d0 0x55a9f275cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:03.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.829+0000 7fc2bffff640 1 --2- 172.21.15.78:0/2506005756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9f236a6b0 0x55a9f2779b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:03.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.829+0000 7fc2bf7fe640 1 -- 172.21.15.78:0/2506005756 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9f23624d0 msgr2=0x55a9f275cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:03.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.829+0000 7fc2bf7fe640 1 --2- 172.21.15.78:0/2506005756 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9f23624d0 0x55a9f275cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.829+0000 7fc2bf7fe640 1 -- 172.21.15.78:0/2506005756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9f236a6b0 msgr2=0x55a9f2779b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:03.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.829+0000 7fc2bf7fe640 1 --2- 172.21.15.78:0/2506005756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9f236a6b0 0x55a9f2779b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.829+0000 7fc2bf7fe640 1 -- 172.21.15.78:0/2506005756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9f246d7d0 con 0x55a9f238b390 2024-09-17T03:12:03.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.829+0000 7fc2bf7fe640 1 --2- 172.21.15.78:0/2506005756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f238b390 0x55a9f275c740 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0003670 tx=0x7fc2b0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49d854af0c142d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:03.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.830+0000 7fc2a57fa640 1 -- 172.21.15.78:0/2506005756 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0012b10 con 0x55a9f238b390 2024-09-17T03:12:03.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.830+0000 7fc2a57fa640 1 -- 172.21.15.78:0/2506005756 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2b0024020 con 0x55a9f238b390 2024-09-17T03:12:03.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.830+0000 7fc2a57fa640 1 -- 172.21.15.78:0/2506005756 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0012d10 con 0x55a9f238b390 2024-09-17T03:12:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.830+0000 7fc2cce9d740 1 -- 172.21.15.78:0/2506005756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f238b390 msgr2=0x55a9f275c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.830+0000 7fc2cce9d740 1 --2- 172.21.15.78:0/2506005756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f238b390 0x55a9f275c740 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0003670 tx=0x7fc2b0015000 comp rx=0 tx=0).stop 2024-09-17T03:12:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.830+0000 7fc2cce9d740 1 -- 172.21.15.78:0/2506005756 shutdown_connections 2024-09-17T03:12:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.830+0000 7fc2cce9d740 1 --2- 172.21.15.78:0/2506005756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9f236a6b0 0x55a9f2779b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.830+0000 7fc2cce9d740 1 --2- 172.21.15.78:0/2506005756 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9f23624d0 0x55a9f275cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.830+0000 7fc2cce9d740 1 --2- 172.21.15.78:0/2506005756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f238b390 0x55a9f275c740 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.830+0000 7fc2cce9d740 1 -- 172.21.15.78:0/2506005756 >> 172.21.15.78:0/2506005756 conn(0x55a9f237f4e0 msgr2=0x55a9f2732a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.831+0000 7fc2cce9d740 1 -- 172.21.15.78:0/2506005756 shutdown_connections 2024-09-17T03:12:03.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.831+0000 7fc2cce9d740 1 -- 172.21.15.78:0/2506005756 wait complete. 2024-09-17T03:12:03.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.831+0000 7fc2cce9d740 1 -- start start 2024-09-17T03:12:03.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.831+0000 7fc2cce9d740 1 Processor -- start 2024-09-17T03:12:03.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc2cce9d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f23624d0 0x55a9f274a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:03.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc2cce9d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9f236a6b0 0x55a9f274a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:03.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc2cce9d740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9f238b390 0x55a9f275a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:03.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc2cce9d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a9f2405740 con 0x55a9f23624d0 2024-09-17T03:12:03.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc2cce9d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a9f263a970 con 0x55a9f236a6b0 2024-09-17T03:12:03.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc2cce9d740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a9f275d1c0 con 0x55a9f238b390 2024-09-17T03:12:03.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc2cce9d740 10 client.0 _ll_register_callbacks cb 0x55a9f263dbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:12:03.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc2bf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f23624d0 0x55a9f274a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:03.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc2bf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f23624d0 0x55a9f274a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51790/0 (socket says 172.21.15.78:51790) 2024-09-17T03:12:03.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc2bf7fe640 1 -- 172.21.15.78:0/276884956 learned_addr learned my addr 172.21.15.78:0/276884956 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:03.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc2bffff640 1 --2- 172.21.15.78:0/276884956 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9f238b390 0x55a9f275a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:03.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc2beffd640 1 --2- 172.21.15.78:0/276884956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9f236a6b0 0x55a9f274a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:03.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc2bf7fe640 1 -- 172.21.15.78:0/276884956 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9f238b390 msgr2=0x55a9f275a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:03.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc2bf7fe640 1 --2- 172.21.15.78:0/276884956 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9f238b390 0x55a9f275a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc2bf7fe640 1 -- 172.21.15.78:0/276884956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9f236a6b0 msgr2=0x55a9f274a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:03.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc2bf7fe640 1 --2- 172.21.15.78:0/276884956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9f236a6b0 0x55a9f274a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc2bf7fe640 1 -- 172.21.15.78:0/276884956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9f23f6970 con 0x55a9f23624d0 2024-09-17T03:12:03.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc2bf7fe640 1 --2- 172.21.15.78:0/276884956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f23624d0 0x55a9f274a140 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0026040 tx=0x7fc2b00206c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89834316eb48823f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:03.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc29e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:12:03.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc29e7fc640 1 -- 172.21.15.78:0/276884956 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0023040 con 0x55a9f23624d0 2024-09-17T03:12:03.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc29e7fc640 1 -- 172.21.15.78:0/276884956 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fc2b0020cc0 con 0x55a9f23624d0 2024-09-17T03:12:03.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.833+0000 7fc2cce9d740 1 -- 172.21.15.78:0/276884956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2b0024020 con 0x55a9f23624d0 2024-09-17T03:12:03.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.834+0000 7fc29e7fc640 1 -- 172.21.15.78:0/276884956 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fc2b0039050 con 0x55a9f23624d0 2024-09-17T03:12:03.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.834+0000 7fc2cce9d740 10 client.6507 fetch_fsmap learned FSMap version 52 2024-09-17T03:12:03.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.834+0000 7fc2cce9d740 1 -- 172.21.15.78:0/276884956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x55a9f23d46a0 con 0x55a9f23624d0 2024-09-17T03:12:03.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.834+0000 7fc29e7fc640 1 -- 172.21.15.78:0/276884956 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2b0024020 con 0x55a9f23624d0 2024-09-17T03:12:03.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.834+0000 7fc29e7fc640 1 -- 172.21.15.78:0/276884956 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 52) ==== 3554+0+0 (secure 0 0 0) 0x7fc2b003c020 con 0x55a9f23624d0 2024-09-17T03:12:03.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.834+0000 7fc2cce9d740 10 client.6507 fetch_fsmap finished waiting for FSMap version 52 2024-09-17T03:12:03.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.834+0000 7fc2cce9d740 10 client.6507 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T03:12:03.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.834+0000 7fc2cce9d740 20 client.6507 populate_metadata read hostname 'smithi078' 2024-09-17T03:12:03.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.834+0000 7fc2cce9d740 1 --2- 172.21.15.78:0/276884956 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x55a9f2349f60 0x55a9f275a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:03.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.834+0000 7fc2cce9d740 4 client.6507 mds_command: new command op to 6231 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:12:03.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.834+0000 7fc2cce9d740 1 -- 172.21.15.78:0/276884956 --> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9f26a79b0 con 0x55a9f2349f60 2024-09-17T03:12:03.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.834+0000 7fc2beffd640 1 --2- 172.21.15.78:0/276884956 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x55a9f2349f60 0x55a9f275a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:03.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.834+0000 7fc29e7fc640 10 client.6507 ms_handle_connect on v2:172.21.15.78:6832/936871583 2024-09-17T03:12:03.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.834+0000 7fc2beffd640 1 --2- 172.21.15.78:0/276884956 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x55a9f2349f60 0x55a9f275a550 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5dde9598091fe4b server_cookie=71f118304f138ca4 in_seq=0 out_seq=0 2024-09-17T03:12:03.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.835+0000 7fc29e7fc640 1 -- 172.21.15.78:0/276884956 <== mds.0 v2:172.21.15.78:6832/936871583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a9f26a79b0 con 0x55a9f2349f60 2024-09-17T03:12:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.835+0000 7fc29e7fc640 10 client.6507 handle_command_reply: tid=0 2024-09-17T03:12:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.835+0000 7fc2cce9d740 1 client.6507 shutdown 2024-09-17T03:12:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.835+0000 7fc2cce9d740 1 -- 172.21.15.78:0/276884956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f23624d0 msgr2=0x55a9f274a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.835+0000 7fc2cce9d740 1 --2- 172.21.15.78:0/276884956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f23624d0 0x55a9f274a140 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0026040 tx=0x7fc2b00206c0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.835+0000 7fc2cce9d740 1 -- 172.21.15.78:0/276884956 shutdown_connections 2024-09-17T03:12:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.835+0000 7fc2cce9d740 1 --2- 172.21.15.78:0/276884956 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x55a9f2349f60 0x55a9f275a550 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.835+0000 7fc2cce9d740 1 --2- 172.21.15.78:0/276884956 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9f238b390 0x55a9f275a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.835+0000 7fc2cce9d740 1 --2- 172.21.15.78:0/276884956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9f236a6b0 0x55a9f274a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.835+0000 7fc2cce9d740 1 --2- 172.21.15.78:0/276884956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f23624d0 0x55a9f274a140 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.835+0000 7fc29e7fc640 0 client.6507 ms_handle_reset on v2:172.21.15.78:6832/936871583 2024-09-17T03:12:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.835+0000 7fc2cce9d740 1 -- 172.21.15.78:0/276884956 >> 172.21.15.78:0/276884956 conn(0x55a9f237f4e0 msgr2=0x55a9f2779150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.835+0000 7fc2cce9d740 1 -- 172.21.15.78:0/276884956 shutdown_connections 2024-09-17T03:12:03.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.835+0000 7fc2cce9d740 1 -- 172.21.15.78:0/276884956 wait complete. 2024-09-17T03:12:03.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.835+0000 7fc2cce9d740 20 client.6507 trim_cache size 0 max 16384 2024-09-17T03:12:03.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.850+0000 7fc2cce9d740 1 Processor -- start 2024-09-17T03:12:03.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.850+0000 7fc2cce9d740 1 -- start start 2024-09-17T03:12:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.851+0000 7fc2cce9d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f23624d0 0x55a9f2732cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.851+0000 7fc2cce9d740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9f236a6b0 0x55a9f275a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.851+0000 7fc2cce9d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9f238b390 0x55a9f275aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.851+0000 7fc2cce9d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c0202980 con 0x55a9f23624d0 2024-09-17T03:12:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.851+0000 7fc2cce9d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c0201b50 con 0x55a9f238b390 2024-09-17T03:12:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.851+0000 7fc2cce9d740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc2c0202250 con 0x55a9f236a6b0 2024-09-17T03:12:03.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.852+0000 7fc2bf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f23624d0 0x55a9f2732cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:03.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.852+0000 7fc2bf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f23624d0 0x55a9f2732cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51800/0 (socket says 172.21.15.78:51800) 2024-09-17T03:12:03.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.852+0000 7fc2bf7fe640 1 -- 172.21.15.78:0/2314298148 learned_addr learned my addr 172.21.15.78:0/2314298148 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:03.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.852+0000 7fc2bffff640 1 --2- 172.21.15.78:0/2314298148 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9f238b390 0x55a9f275aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:03.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.852+0000 7fc2beffd640 1 --2- 172.21.15.78:0/2314298148 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9f236a6b0 0x55a9f275a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:03.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.852+0000 7fc2bf7fe640 1 -- 172.21.15.78:0/2314298148 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9f236a6b0 msgr2=0x55a9f275a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:03.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.852+0000 7fc2bf7fe640 1 --2- 172.21.15.78:0/2314298148 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9f236a6b0 0x55a9f275a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.852+0000 7fc2bf7fe640 1 -- 172.21.15.78:0/2314298148 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9f238b390 msgr2=0x55a9f275aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:03.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.852+0000 7fc2bf7fe640 1 --2- 172.21.15.78:0/2314298148 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9f238b390 0x55a9f275aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.852+0000 7fc2bf7fe640 1 -- 172.21.15.78:0/2314298148 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9f275c570 con 0x55a9f23624d0 2024-09-17T03:12:03.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.852+0000 7fc2bf7fe640 1 --2- 172.21.15.78:0/2314298148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f23624d0 0x55a9f2732cd0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0021d10 tx=0x7fc2b0021d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6c1190e43b9be7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:03.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.852+0000 7fc2a4ff9640 1 -- 172.21.15.78:0/2314298148 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0023030 con 0x55a9f23624d0 2024-09-17T03:12:03.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.852+0000 7fc2a4ff9640 1 -- 172.21.15.78:0/2314298148 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2b002d070 con 0x55a9f23624d0 2024-09-17T03:12:03.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.852+0000 7fc2a4ff9640 1 -- 172.21.15.78:0/2314298148 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b0029710 con 0x55a9f23624d0 2024-09-17T03:12:03.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.853+0000 7fc2cce9d740 1 -- 172.21.15.78:0/2314298148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f23624d0 msgr2=0x55a9f2732cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:03.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.853+0000 7fc2cce9d740 1 --2- 172.21.15.78:0/2314298148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f23624d0 0x55a9f2732cd0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0021d10 tx=0x7fc2b0021d40 comp rx=0 tx=0).stop 2024-09-17T03:12:03.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.853+0000 7fc2cce9d740 1 -- 172.21.15.78:0/2314298148 shutdown_connections 2024-09-17T03:12:03.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.853+0000 7fc2cce9d740 1 --2- 172.21.15.78:0/2314298148 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9f238b390 0x55a9f275aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.853+0000 7fc2cce9d740 1 --2- 172.21.15.78:0/2314298148 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9f236a6b0 0x55a9f275a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.853+0000 7fc2cce9d740 1 --2- 172.21.15.78:0/2314298148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f23624d0 0x55a9f2732cd0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.853+0000 7fc2cce9d740 1 -- 172.21.15.78:0/2314298148 >> 172.21.15.78:0/2314298148 conn(0x55a9f237f4e0 msgr2=0x55a9f2777dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:03.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.853+0000 7fc2cce9d740 1 -- 172.21.15.78:0/2314298148 shutdown_connections 2024-09-17T03:12:03.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.853+0000 7fc2cce9d740 1 -- 172.21.15.78:0/2314298148 wait complete. 2024-09-17T03:12:03.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.854+0000 7fc2cce9d740 1 -- start start 2024-09-17T03:12:03.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.854+0000 7fc2cce9d740 1 Processor -- start 2024-09-17T03:12:03.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.855+0000 7fc2cce9d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9f23624d0 0x55a9f27fa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:03.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.855+0000 7fc2cce9d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f236a6b0 0x55a9f27fa950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:03.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.855+0000 7fc2cce9d740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9f238b390 0x55a9f279a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:03.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.855+0000 7fc2cce9d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc2c01f7450 con 0x55a9f236a6b0 2024-09-17T03:12:03.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.855+0000 7fc2cce9d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a9f272eae0 con 0x55a9f23624d0 2024-09-17T03:12:03.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.855+0000 7fc2cce9d740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a9f2799bd0 con 0x55a9f238b390 2024-09-17T03:12:03.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.855+0000 7fc2cce9d740 10 client.0 _ll_register_callbacks cb 0x7fc2a80036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:12:03.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.855+0000 7fc2beffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f236a6b0 0x55a9f27fa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:03.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.855+0000 7fc2beffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f236a6b0 0x55a9f27fa950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51810/0 (socket says 172.21.15.78:51810) 2024-09-17T03:12:03.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.855+0000 7fc2beffd640 1 -- 172.21.15.78:0/566287253 learned_addr learned my addr 172.21.15.78:0/566287253 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:03.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc2bffff640 1 --2- 172.21.15.78:0/566287253 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9f238b390 0x55a9f279a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:03.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc2bf7fe640 1 --2- 172.21.15.78:0/566287253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9f23624d0 0x55a9f27fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:03.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc2beffd640 1 -- 172.21.15.78:0/566287253 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9f238b390 msgr2=0x55a9f279a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc2beffd640 1 --2- 172.21.15.78:0/566287253 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9f238b390 0x55a9f279a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc2beffd640 1 -- 172.21.15.78:0/566287253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9f23624d0 msgr2=0x55a9f27fa410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc2beffd640 1 --2- 172.21.15.78:0/566287253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9f23624d0 0x55a9f27fa410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc2beffd640 1 -- 172.21.15.78:0/566287253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9f275b290 con 0x55a9f236a6b0 2024-09-17T03:12:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc2beffd640 1 --2- 172.21.15.78:0/566287253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f236a6b0 0x55a9f27fa950 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4063240 tx=0x7fc2b4099ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a47fe6db0290c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc29e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:12:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc29e7fc640 1 -- 172.21.15.78:0/566287253 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b406ce20 con 0x55a9f236a6b0 2024-09-17T03:12:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc29e7fc640 1 -- 172.21.15.78:0/566287253 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fc2b40856f0 con 0x55a9f236a6b0 2024-09-17T03:12:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc2cce9d740 1 -- 172.21.15.78:0/566287253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2b002d070 con 0x55a9f236a6b0 2024-09-17T03:12:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc29e7fc640 1 -- 172.21.15.78:0/566287253 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fc2b4085930 con 0x55a9f236a6b0 2024-09-17T03:12:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc2cce9d740 10 client.6513 fetch_fsmap learned FSMap version 52 2024-09-17T03:12:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc2cce9d740 1 -- 172.21.15.78:0/566287253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x55a9f2777e80 con 0x55a9f236a6b0 2024-09-17T03:12:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc29e7fc640 1 -- 172.21.15.78:0/566287253 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2b002d070 con 0x55a9f236a6b0 2024-09-17T03:12:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc29e7fc640 1 -- 172.21.15.78:0/566287253 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 52) ==== 3554+0+0 (secure 0 0 0) 0x7fc2b40627a0 con 0x55a9f236a6b0 2024-09-17T03:12:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc2cce9d740 10 client.6513 fetch_fsmap finished waiting for FSMap version 52 2024-09-17T03:12:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc2cce9d740 10 client.6513 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T03:12:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc2cce9d740 20 client.6513 populate_metadata read hostname 'smithi078' 2024-09-17T03:12:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.856+0000 7fc2cce9d740 1 --2- 172.21.15.78:0/566287253 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x55a9f27993f0 0x55a9f279ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.857+0000 7fc2cce9d740 4 client.6513 mds_command: new command op to 6231 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T03:12:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.857+0000 7fc2cce9d740 1 -- 172.21.15.78:0/566287253 --> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a9f26a3460 con 0x55a9f27993f0 2024-09-17T03:12:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.857+0000 7fc2bf7fe640 1 --2- 172.21.15.78:0/566287253 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x55a9f27993f0 0x55a9f279ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.857+0000 7fc29e7fc640 10 client.6513 ms_handle_connect on v2:172.21.15.78:6832/936871583 2024-09-17T03:12:03.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.857+0000 7fc2bf7fe640 1 --2- 172.21.15.78:0/566287253 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x55a9f27993f0 0x55a9f279ace0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8992a45c4e80ef40 server_cookie=942d19eae94f2277 in_seq=0 out_seq=0 2024-09-17T03:12:03.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.874+0000 7fc29e7fc640 1 -- 172.21.15.78:0/566287253 <== mds.0 v2:172.21.15.78:6832/936871583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a9f26a3460 con 0x55a9f27993f0 2024-09-17T03:12:03.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.874+0000 7fc29e7fc640 10 client.6513 handle_command_reply: tid=0 2024-09-17T03:12:03.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.874+0000 7fc2cce9d740 1 client.6513 shutdown 2024-09-17T03:12:03.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.874+0000 7fc2cce9d740 1 -- 172.21.15.78:0/566287253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f236a6b0 msgr2=0x55a9f27fa950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:03.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.874+0000 7fc2cce9d740 1 --2- 172.21.15.78:0/566287253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f236a6b0 0x55a9f27fa950 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4063240 tx=0x7fc2b4099ac0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.874+0000 7fc2cce9d740 1 -- 172.21.15.78:0/566287253 shutdown_connections 2024-09-17T03:12:03.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.874+0000 7fc2cce9d740 1 --2- 172.21.15.78:0/566287253 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x55a9f27993f0 0x55a9f279ace0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.874+0000 7fc2cce9d740 1 --2- 172.21.15.78:0/566287253 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a9f238b390 0x55a9f279a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.874+0000 7fc2cce9d740 1 --2- 172.21.15.78:0/566287253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a9f236a6b0 0x55a9f27fa950 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.874+0000 7fc2cce9d740 1 --2- 172.21.15.78:0/566287253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a9f23624d0 0x55a9f27fa410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.874+0000 7fc29e7fc640 0 client.6513 ms_handle_reset on v2:172.21.15.78:6832/936871583 2024-09-17T03:12:03.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.874+0000 7fc2cce9d740 1 -- 172.21.15.78:0/566287253 >> 172.21.15.78:0/566287253 conn(0x55a9f237f4e0 msgr2=0x55a9f275c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:03.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.874+0000 7fc2cce9d740 1 -- 172.21.15.78:0/566287253 shutdown_connections 2024-09-17T03:12:03.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.874+0000 7fc2cce9d740 1 -- 172.21.15.78:0/566287253 wait complete. 2024-09-17T03:12:03.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.874+0000 7fc2cce9d740 20 client.6513 trim_cache size 0 max 16384 2024-09-17T03:12:03.875 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:12:03.875 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:12:03.875 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:12:03.875 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:12:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.875+0000 7fc2c5f33640 1 -- 172.21.15.78:0/1571538933 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc2ac078bc0 msgr2=0x7fc2ac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.875+0000 7fc2c5f33640 1 --2- 172.21.15.78:0/1571538933 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc2ac078bc0 0x7fc2ac07b0d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0000ff0 tx=0x7fc2b0000f80 comp rx=0 tx=0).stop 2024-09-17T03:12:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.875+0000 7fc2c5f33640 1 -- 172.21.15.78:0/1571538933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2c01f8ad0 msgr2=0x7fc2c01f8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.875+0000 7fc2c5f33640 1 --2- 172.21.15.78:0/1571538933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2c01f8ad0 0x7fc2c01f8ee0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4011ae0 tx=0x7fc2b4009e40 comp rx=0 tx=0).stop 2024-09-17T03:12:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.875+0000 7fc2c5f33640 1 -- 172.21.15.78:0/1571538933 shutdown_connections 2024-09-17T03:12:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.875+0000 7fc2c5f33640 1 --2- 172.21.15.78:0/1571538933 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc2ac078bc0 0x7fc2ac07b0d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.875+0000 7fc2c5f33640 1 --2- 172.21.15.78:0/1571538933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2c0150720 0x7fc2c0150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.875+0000 7fc2c5f33640 1 --2- 172.21.15.78:0/1571538933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2c01f8ad0 0x7fc2c01f8ee0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.875+0000 7fc2c5f33640 1 --2- 172.21.15.78:0/1571538933 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc2c00cde10 0x7fc2c00cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:03.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.875+0000 7fc2c5f33640 1 -- 172.21.15.78:0/1571538933 >> 172.21.15.78:0/1571538933 conn(0x7fc2c008bfc0 msgr2=0x7fc2c0068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:03.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.875+0000 7fc2c5f33640 1 -- 172.21.15.78:0/1571538933 shutdown_connections 2024-09-17T03:12:03.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:03.875+0000 7fc2c5f33640 1 -- 172.21.15.78:0/1571538933 wait complete. 2024-09-17T03:12:03.884 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:1 flush journal 2024-09-17T03:12:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.002+0000 7fa3207e6640 1 -- 172.21.15.78:0/2879161617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa304004d40 msgr2=0x7fa304005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.002+0000 7fa3207e6640 1 --2- 172.21.15.78:0/2879161617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa304004d40 0x7fa304005150 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fa3180b5ec0 tx=0x7fa304005830 comp rx=0 tx=0).stop 2024-09-17T03:12:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.002+0000 7fa31ed83640 1 -- 172.21.15.78:0/2879161617 reap_dead start 2024-09-17T03:12:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.002+0000 7fa3207e6640 1 -- 172.21.15.78:0/2879161617 shutdown_connections 2024-09-17T03:12:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.002+0000 7fa3207e6640 1 -- 172.21.15.78:0/2879161617 >> 172.21.15.78:0/2879161617 conn(0x7fa31808bfc0 msgr2=0x7fa31809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.002+0000 7fa3207e6640 1 -- 172.21.15.78:0/2879161617 shutdown_connections 2024-09-17T03:12:04.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.002+0000 7fa3207e6640 1 -- 172.21.15.78:0/2879161617 wait complete. 2024-09-17T03:12:04.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.004+0000 7fa3207e6640 1 Processor -- start 2024-09-17T03:12:04.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.004+0000 7fa3207e6640 1 -- start start 2024-09-17T03:12:04.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.005+0000 7fa3207e6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa304004d40 0x7fa3180cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.005+0000 7fa3207e6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa3181f55c0 0x7fa3180b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.005+0000 7fa3207e6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3180b2710 0x7fa3180c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.005+0000 7fa3207e6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa3180b42b0 con 0x7fa3180b2710 2024-09-17T03:12:04.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.005+0000 7fa3207e6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa3180b4130 con 0x7fa304004d40 2024-09-17T03:12:04.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.005+0000 7fa3207e6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa3180b8e50 con 0x7fa3181f55c0 2024-09-17T03:12:04.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.005+0000 7fa31ed83640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3180b2710 0x7fa3180c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.005+0000 7fa31ed83640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3180b2710 0x7fa3180c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51828/0 (socket says 172.21.15.78:51828) 2024-09-17T03:12:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.005+0000 7fa31ed83640 1 -- 172.21.15.78:0/3781150634 learned_addr learned my addr 172.21.15.78:0/3781150634 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.005+0000 7fa31dd81640 1 --2- 172.21.15.78:0/3781150634 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa3181f55c0 0x7fa3180b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.005+0000 7fa31e582640 1 --2- 172.21.15.78:0/3781150634 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa304004d40 0x7fa3180cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.005+0000 7fa31ed83640 1 -- 172.21.15.78:0/3781150634 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa3181f55c0 msgr2=0x7fa3180b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.005+0000 7fa31ed83640 1 --2- 172.21.15.78:0/3781150634 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa3181f55c0 0x7fa3180b21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.005+0000 7fa31ed83640 1 -- 172.21.15.78:0/3781150634 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa304004d40 msgr2=0x7fa3180cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.005+0000 7fa31ed83640 1 --2- 172.21.15.78:0/3781150634 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa304004d40 0x7fa3180cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.005+0000 7fa31ed83640 1 -- 172.21.15.78:0/3781150634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3180b2b20 con 0x7fa3180b2710 2024-09-17T03:12:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.005+0000 7fa31dd81640 1 --2- 172.21.15.78:0/3781150634 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa3181f55c0 0x7fa3180b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:12:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.005+0000 7fa31e582640 1 --2- 172.21.15.78:0/3781150634 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa304004d40 0x7fa3180cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:12:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.005+0000 7fa31ed83640 1 --2- 172.21.15.78:0/3781150634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3180b2710 0x7fa3180c9630 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa310036040 tx=0x7fa310033de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.006+0000 7fa30effd640 1 -- 172.21.15.78:0/3781150634 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa310038040 con 0x7fa3180b2710 2024-09-17T03:12:04.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.006+0000 7fa30effd640 1 -- 172.21.15.78:0/3781150634 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa310033e50 con 0x7fa3180b2710 2024-09-17T03:12:04.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.006+0000 7fa30effd640 1 -- 172.21.15.78:0/3781150634 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa310004d80 con 0x7fa3180b2710 2024-09-17T03:12:04.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.006+0000 7fa3207e6640 1 -- 172.21.15.78:0/3781150634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3180ce8c0 con 0x7fa3180b2710 2024-09-17T03:12:04.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.006+0000 7fa3207e6640 1 -- 172.21.15.78:0/3781150634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3181f9880 con 0x7fa3180b2710 2024-09-17T03:12:04.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.007+0000 7fa30effd640 1 -- 172.21.15.78:0/3781150634 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa310044030 con 0x7fa3180b2710 2024-09-17T03:12:04.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.008+0000 7fa30effd640 1 --2- 172.21.15.78:0/3781150634 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa2fc078b90 0x7fa2fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.008+0000 7fa30effd640 1 -- 172.21.15.78:0/3781150634 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fa3100bb590 con 0x7fa3180b2710 2024-09-17T03:12:04.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.008+0000 7fa31e582640 1 --2- 172.21.15.78:0/3781150634 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa2fc078b90 0x7fa2fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.008+0000 7fa31e582640 1 --2- 172.21.15.78:0/3781150634 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa2fc078b90 0x7fa2fc07b0a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa3180a24d0 tx=0x7fa314005f30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:04.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.009+0000 7fa32782c740 1 Processor -- start 2024-09-17T03:12:04.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.009+0000 7fa32782c740 1 -- start start 2024-09-17T03:12:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.010+0000 7fa32782c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65cf390 0x5561f69bba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.010+0000 7fa32782c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65a64d0 0x5561f6990860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.010+0000 7fa32782c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5561f65ae6b0 0x5561f6990da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.010+0000 7fa32782c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5561f68e9a60 con 0x5561f65a64d0 2024-09-17T03:12:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.010+0000 7fa32782c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5561f68d8e90 con 0x5561f65cf390 2024-09-17T03:12:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.010+0000 7fa32782c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5561f68dcca0 con 0x5561f65ae6b0 2024-09-17T03:12:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.010+0000 7fa31dd81640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65a64d0 0x5561f6990860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.010+0000 7fa31e582640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65cf390 0x5561f69bba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.010+0000 7fa31dd81640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65a64d0 0x5561f6990860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51834/0 (socket says 172.21.15.78:51834) 2024-09-17T03:12:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.010+0000 7fa31dd81640 1 -- 172.21.15.78:0/1224567536 learned_addr learned my addr 172.21.15.78:0/1224567536 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.010+0000 7fa31e582640 1 --2- 172.21.15.78:0/1224567536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65cf390 0x5561f69bba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.78:51464/0 (socket says 172.21.15.78:51464) 2024-09-17T03:12:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.010+0000 7fa31ed83640 1 --2- 172.21.15.78:0/1224567536 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5561f65ae6b0 0x5561f6990da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.010+0000 7fa31dd81640 1 -- 172.21.15.78:0/1224567536 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5561f65ae6b0 msgr2=0x5561f6990da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:04.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.010+0000 7fa31dd81640 1 --2- 172.21.15.78:0/1224567536 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5561f65ae6b0 0x5561f6990da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.010+0000 7fa31dd81640 1 -- 172.21.15.78:0/1224567536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65cf390 msgr2=0x5561f69bba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:04.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.010+0000 7fa31dd81640 1 --2- 172.21.15.78:0/1224567536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65cf390 0x5561f69bba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.010+0000 7fa31dd81640 1 -- 172.21.15.78:0/1224567536 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561f66b17d0 con 0x5561f65a64d0 2024-09-17T03:12:04.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.010+0000 7fa31e582640 1 --2- 172.21.15.78:0/1224567536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65cf390 0x5561f69bba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:12:04.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.011+0000 7fa31dd81640 1 --2- 172.21.15.78:0/1224567536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65a64d0 0x5561f6990860 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa308006c70 tx=0x7fa308006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6aa5841f89212d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:04.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.011+0000 7fa2fbfff640 1 -- 172.21.15.78:0/1224567536 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa308016070 con 0x5561f65a64d0 2024-09-17T03:12:04.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.011+0000 7fa2fbfff640 1 -- 172.21.15.78:0/1224567536 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa308003dd0 con 0x5561f65a64d0 2024-09-17T03:12:04.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.011+0000 7fa2fbfff640 1 -- 172.21.15.78:0/1224567536 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3080126a0 con 0x5561f65a64d0 2024-09-17T03:12:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.012+0000 7fa32782c740 1 -- 172.21.15.78:0/1224567536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65a64d0 msgr2=0x5561f6990860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.012+0000 7fa32782c740 1 --2- 172.21.15.78:0/1224567536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65a64d0 0x5561f6990860 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa308006c70 tx=0x7fa308006430 comp rx=0 tx=0).stop 2024-09-17T03:12:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.012+0000 7fa32782c740 1 -- 172.21.15.78:0/1224567536 shutdown_connections 2024-09-17T03:12:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.012+0000 7fa32782c740 1 --2- 172.21.15.78:0/1224567536 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5561f65ae6b0 0x5561f6990da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.012+0000 7fa32782c740 1 --2- 172.21.15.78:0/1224567536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65a64d0 0x5561f6990860 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.012+0000 7fa32782c740 1 --2- 172.21.15.78:0/1224567536 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65cf390 0x5561f69bba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.012+0000 7fa32782c740 1 -- 172.21.15.78:0/1224567536 >> 172.21.15.78:0/1224567536 conn(0x5561f65c34e0 msgr2=0x5561f6976d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:04.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.012+0000 7fa32782c740 1 -- 172.21.15.78:0/1224567536 shutdown_connections 2024-09-17T03:12:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.012+0000 7fa32782c740 1 -- 172.21.15.78:0/1224567536 wait complete. 2024-09-17T03:12:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.013+0000 7fa32782c740 1 -- start start 2024-09-17T03:12:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.013+0000 7fa32782c740 1 Processor -- start 2024-09-17T03:12:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.014+0000 7fa32782c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65a64d0 0x5561f699f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.014+0000 7fa32782c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5561f65ae6b0 0x5561f699fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.014+0000 7fa32782c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65cf390 0x5561f69ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.014+0000 7fa32782c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5561f6649740 con 0x5561f65cf390 2024-09-17T03:12:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.014+0000 7fa32782c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5561f687e970 con 0x5561f65a64d0 2024-09-17T03:12:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.014+0000 7fa32782c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5561f69a0590 con 0x5561f65ae6b0 2024-09-17T03:12:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.014+0000 7fa32782c740 10 client.0 _ll_register_callbacks cb 0x5561f688d780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:12:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.014+0000 7fa31ed83640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65cf390 0x5561f69ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.014+0000 7fa31ed83640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65cf390 0x5561f69ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51848/0 (socket says 172.21.15.78:51848) 2024-09-17T03:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.014+0000 7fa31ed83640 1 -- 172.21.15.78:0/4257909577 learned_addr learned my addr 172.21.15.78:0/4257909577 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa31dd81640 1 --2- 172.21.15.78:0/4257909577 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5561f65ae6b0 0x5561f699fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa31ed83640 1 -- 172.21.15.78:0/4257909577 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5561f65ae6b0 msgr2=0x5561f699fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa31ed83640 1 --2- 172.21.15.78:0/4257909577 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5561f65ae6b0 0x5561f699fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa31e582640 1 --2- 172.21.15.78:0/4257909577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65a64d0 0x5561f699f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa31ed83640 1 -- 172.21.15.78:0/4257909577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65a64d0 msgr2=0x5561f699f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa31ed83640 1 --2- 172.21.15.78:0/4257909577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65a64d0 0x5561f699f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa31ed83640 1 -- 172.21.15.78:0/4257909577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561f663a970 con 0x5561f65cf390 2024-09-17T03:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa31ed83640 1 --2- 172.21.15.78:0/4257909577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65cf390 0x5561f69ce3f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa31000e370 tx=0x7fa310083990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1448a00386e061f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa2f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa2f97fa640 1 -- 172.21.15.78:0/4257909577 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa310083af0 con 0x5561f65cf390 2024-09-17T03:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa2f97fa640 1 -- 172.21.15.78:0/4257909577 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fa3100bb0c0 con 0x5561f65cf390 2024-09-17T03:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa32782c740 1 -- 172.21.15.78:0/4257909577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa308003dd0 con 0x5561f65cf390 2024-09-17T03:12:04.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa2f97fa640 1 -- 172.21.15.78:0/4257909577 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fa3100a5050 con 0x5561f65cf390 2024-09-17T03:12:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa32782c740 10 client.6525 fetch_fsmap learned FSMap version 52 2024-09-17T03:12:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa32782c740 1 -- 172.21.15.78:0/4257909577 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x5561f66186a0 con 0x5561f65cf390 2024-09-17T03:12:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa2f97fa640 1 -- 172.21.15.78:0/4257909577 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa308003dd0 con 0x5561f65cf390 2024-09-17T03:12:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa2f97fa640 1 -- 172.21.15.78:0/4257909577 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 52) ==== 3554+0+0 (secure 0 0 0) 0x7fa31003b050 con 0x5561f65cf390 2024-09-17T03:12:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa32782c740 10 client.6525 fetch_fsmap finished waiting for FSMap version 52 2024-09-17T03:12:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa32782c740 10 client.6525 resolve_mds: resolved 4:1 to role '4:1' aka daemon mds.b 2024-09-17T03:12:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa32782c740 20 client.6525 populate_metadata read hostname 'smithi078' 2024-09-17T03:12:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa32782c740 1 --2- 172.21.15.78:0/4257909577 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x5561f658df60 0x5561f69ce930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa32782c740 4 client.6525 mds_command: new command op to 5773 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:12:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.015+0000 7fa32782c740 1 -- 172.21.15.78:0/4257909577 --> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5561f68eb9b0 con 0x5561f658df60 2024-09-17T03:12:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.016+0000 7fa31e582640 1 --2- 172.21.15.78:0/4257909577 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x5561f658df60 0x5561f69ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.016+0000 7fa2f97fa640 10 client.6525 ms_handle_connect on v2:172.21.15.193:6835/2730762656 2024-09-17T03:12:04.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.016+0000 7fa31e582640 1 --2- 172.21.15.78:0/4257909577 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x5561f658df60 0x5561f69ce930 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=617ab979fa64b780 server_cookie=11a59902572ad5fa in_seq=0 out_seq=0 2024-09-17T03:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.017+0000 7fa2f97fa640 1 -- 172.21.15.78:0/4257909577 <== mds.1 v2:172.21.15.193:6835/2730762656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5561f68eb9b0 con 0x5561f658df60 2024-09-17T03:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.017+0000 7fa2f97fa640 10 client.6525 handle_command_reply: tid=0 2024-09-17T03:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.017+0000 7fa32782c740 1 client.6525 shutdown 2024-09-17T03:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.017+0000 7fa32782c740 1 -- 172.21.15.78:0/4257909577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65cf390 msgr2=0x5561f69ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.017+0000 7fa32782c740 1 --2- 172.21.15.78:0/4257909577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65cf390 0x5561f69ce3f0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa31000e370 tx=0x7fa310083990 comp rx=0 tx=0).stop 2024-09-17T03:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.017+0000 7fa32782c740 1 -- 172.21.15.78:0/4257909577 shutdown_connections 2024-09-17T03:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.017+0000 7fa32782c740 1 --2- 172.21.15.78:0/4257909577 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x5561f658df60 0x5561f69ce930 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.017+0000 7fa32782c740 1 --2- 172.21.15.78:0/4257909577 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65cf390 0x5561f69ce3f0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.017+0000 7fa32782c740 1 --2- 172.21.15.78:0/4257909577 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5561f65ae6b0 0x5561f699fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.017+0000 7fa32782c740 1 --2- 172.21.15.78:0/4257909577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65a64d0 0x5561f699f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.017+0000 7fa2f97fa640 0 client.6525 ms_handle_reset on v2:172.21.15.193:6835/2730762656 2024-09-17T03:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.017+0000 7fa32782c740 1 -- 172.21.15.78:0/4257909577 >> 172.21.15.78:0/4257909577 conn(0x5561f65c34e0 msgr2=0x5561f6990860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.017+0000 7fa32782c740 1 -- 172.21.15.78:0/4257909577 shutdown_connections 2024-09-17T03:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.017+0000 7fa32782c740 1 -- 172.21.15.78:0/4257909577 wait complete. 2024-09-17T03:12:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.017+0000 7fa32782c740 20 client.6525 trim_cache size 0 max 16384 2024-09-17T03:12:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.032+0000 7fa32782c740 1 Processor -- start 2024-09-17T03:12:04.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.032+0000 7fa32782c740 1 -- start start 2024-09-17T03:12:04.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.033+0000 7fa32782c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65a64d0 0x5561f69b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.033+0000 7fa32782c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5561f65ae6b0 0x5561f69deb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.033+0000 7fa32782c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65cf390 0x5561f69df0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.033+0000 7fa32782c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa318202a10 con 0x5561f65a64d0 2024-09-17T03:12:04.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.033+0000 7fa32782c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa318201be0 con 0x5561f65cf390 2024-09-17T03:12:04.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.033+0000 7fa32782c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa3182022e0 con 0x5561f65ae6b0 2024-09-17T03:12:04.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.033+0000 7fa31e582640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65a64d0 0x5561f69b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.033+0000 7fa31e582640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65a64d0 0x5561f69b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51862/0 (socket says 172.21.15.78:51862) 2024-09-17T03:12:04.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.033+0000 7fa31e582640 1 -- 172.21.15.78:0/3306237220 learned_addr learned my addr 172.21.15.78:0/3306237220 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:04.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.033+0000 7fa31e582640 1 -- 172.21.15.78:0/3306237220 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5561f65ae6b0 msgr2=0x5561f69deb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:04.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.033+0000 7fa31e582640 1 --2- 172.21.15.78:0/3306237220 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5561f65ae6b0 0x5561f69deb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.033+0000 7fa31e582640 1 -- 172.21.15.78:0/3306237220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65cf390 msgr2=0x5561f69df0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:04.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.033+0000 7fa31ed83640 1 --2- 172.21.15.78:0/3306237220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65cf390 0x5561f69df0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.033+0000 7fa31e582640 1 --2- 172.21.15.78:0/3306237220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65cf390 0x5561f69df0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.033+0000 7fa31e582640 1 -- 172.21.15.78:0/3306237220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561f69b5f50 con 0x5561f65a64d0 2024-09-17T03:12:04.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.034+0000 7fa31e582640 1 --2- 172.21.15.78:0/3306237220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65a64d0 0x5561f69b47d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa314005340 tx=0x7fa314016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d4cbcebbcfee1d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:04.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.034+0000 7fa2fb7fe640 1 -- 172.21.15.78:0/3306237220 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31402b030 con 0x5561f65a64d0 2024-09-17T03:12:04.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.034+0000 7fa2fb7fe640 1 -- 172.21.15.78:0/3306237220 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa314004c20 con 0x5561f65a64d0 2024-09-17T03:12:04.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.034+0000 7fa2fb7fe640 1 -- 172.21.15.78:0/3306237220 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa314004020 con 0x5561f65a64d0 2024-09-17T03:12:04.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.034+0000 7fa32782c740 1 -- 172.21.15.78:0/3306237220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65a64d0 msgr2=0x5561f69b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:04.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.034+0000 7fa32782c740 1 --2- 172.21.15.78:0/3306237220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65a64d0 0x5561f69b47d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fa314005340 tx=0x7fa314016000 comp rx=0 tx=0).stop 2024-09-17T03:12:04.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.034+0000 7fa32782c740 1 -- 172.21.15.78:0/3306237220 shutdown_connections 2024-09-17T03:12:04.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.034+0000 7fa32782c740 1 --2- 172.21.15.78:0/3306237220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65cf390 0x5561f69df0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.034+0000 7fa32782c740 1 --2- 172.21.15.78:0/3306237220 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5561f65ae6b0 0x5561f69deb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.034+0000 7fa32782c740 1 --2- 172.21.15.78:0/3306237220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65a64d0 0x5561f69b47d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.034+0000 7fa32782c740 1 -- 172.21.15.78:0/3306237220 >> 172.21.15.78:0/3306237220 conn(0x5561f65c34e0 msgr2=0x5561f6976a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:04.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.035+0000 7fa32782c740 1 -- 172.21.15.78:0/3306237220 shutdown_connections 2024-09-17T03:12:04.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.035+0000 7fa32782c740 1 -- 172.21.15.78:0/3306237220 wait complete. 2024-09-17T03:12:04.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.035+0000 7fa32782c740 1 -- start start 2024-09-17T03:12:04.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.035+0000 7fa32782c740 1 Processor -- start 2024-09-17T03:12:04.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.037+0000 7fa32782c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5561f65a64d0 0x5561f69cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.037+0000 7fa32782c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65ae6b0 0x5561f699cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.037+0000 7fa32782c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65cf390 0x5561f6a20410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.037+0000 7fa32782c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5561f69b8740 con 0x5561f65ae6b0 2024-09-17T03:12:04.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.037+0000 7fa32782c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa3180c8ed0 con 0x5561f65cf390 2024-09-17T03:12:04.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.037+0000 7fa32782c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5561f6a3ede0 con 0x5561f65a64d0 2024-09-17T03:12:04.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.037+0000 7fa32782c740 10 client.0 _ll_register_callbacks cb 0x7fa310082d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:12:04.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.037+0000 7fa31dd81640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65ae6b0 0x5561f699cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.037+0000 7fa31dd81640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65ae6b0 0x5561f699cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51870/0 (socket says 172.21.15.78:51870) 2024-09-17T03:12:04.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.037+0000 7fa31dd81640 1 -- 172.21.15.78:0/1678528637 learned_addr learned my addr 172.21.15.78:0/1678528637 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:04.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.037+0000 7fa31e582640 1 --2- 172.21.15.78:0/1678528637 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5561f65a64d0 0x5561f69cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.037+0000 7fa31ed83640 1 --2- 172.21.15.78:0/1678528637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65cf390 0x5561f6a20410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.037+0000 7fa31dd81640 1 -- 172.21.15.78:0/1678528637 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5561f65a64d0 msgr2=0x5561f69cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:04.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.037+0000 7fa31dd81640 1 --2- 172.21.15.78:0/1678528637 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5561f65a64d0 0x5561f69cd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.037+0000 7fa31dd81640 1 -- 172.21.15.78:0/1678528637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65cf390 msgr2=0x5561f6a20410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:04.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.037+0000 7fa31dd81640 1 --2- 172.21.15.78:0/1678528637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65cf390 0x5561f6a20410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.037+0000 7fa31dd81640 1 -- 172.21.15.78:0/1678528637 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561f6a3e040 con 0x5561f65ae6b0 2024-09-17T03:12:04.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.037+0000 7fa31ed83640 1 --2- 172.21.15.78:0/1678528637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65cf390 0x5561f6a20410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:04.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.038+0000 7fa31dd81640 1 --2- 172.21.15.78:0/1678528637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65ae6b0 0x5561f699cc20 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa308001330 tx=0x7fa308006850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801e339afd25491e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:04.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.038+0000 7fa2f97fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:12:04.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.038+0000 7fa2f97fa640 1 -- 172.21.15.78:0/1678528637 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa308016070 con 0x5561f65ae6b0 2024-09-17T03:12:04.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.038+0000 7fa2f97fa640 1 -- 172.21.15.78:0/1678528637 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fa3080228a0 con 0x5561f65ae6b0 2024-09-17T03:12:04.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.038+0000 7fa32782c740 1 -- 172.21.15.78:0/1678528637 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa314004c20 con 0x5561f65ae6b0 2024-09-17T03:12:04.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.038+0000 7fa2f97fa640 1 -- 172.21.15.78:0/1678528637 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fa30802d050 con 0x5561f65ae6b0 2024-09-17T03:12:04.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.038+0000 7fa32782c740 10 client.6531 fetch_fsmap learned FSMap version 52 2024-09-17T03:12:04.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.038+0000 7fa32782c740 1 -- 172.21.15.78:0/1678528637 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x5561f6a209b0 con 0x5561f65ae6b0 2024-09-17T03:12:04.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.038+0000 7fa2f97fa640 1 -- 172.21.15.78:0/1678528637 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa314004c20 con 0x5561f65ae6b0 2024-09-17T03:12:04.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.038+0000 7fa2f97fa640 1 -- 172.21.15.78:0/1678528637 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 52) ==== 3554+0+0 (secure 0 0 0) 0x7fa308022aa0 con 0x5561f65ae6b0 2024-09-17T03:12:04.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.038+0000 7fa32782c740 10 client.6531 fetch_fsmap finished waiting for FSMap version 52 2024-09-17T03:12:04.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.038+0000 7fa32782c740 10 client.6531 resolve_mds: resolved 4:1 to role '4:1' aka daemon mds.b 2024-09-17T03:12:04.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.038+0000 7fa32782c740 20 client.6531 populate_metadata read hostname 'smithi078' 2024-09-17T03:12:04.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.038+0000 7fa32782c740 1 --2- 172.21.15.78:0/1678528637 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x5561f69ddcc0 0x5561f6a3a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.038+0000 7fa32782c740 4 client.6531 mds_command: new command op to 5773 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T03:12:04.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.038+0000 7fa32782c740 1 -- 172.21.15.78:0/1678528637 --> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5561f68e7460 con 0x5561f69ddcc0 2024-09-17T03:12:04.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.038+0000 7fa31e582640 1 --2- 172.21.15.78:0/1678528637 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x5561f69ddcc0 0x5561f6a3a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.039+0000 7fa2f97fa640 10 client.6531 ms_handle_connect on v2:172.21.15.193:6835/2730762656 2024-09-17T03:12:04.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.039+0000 7fa31e582640 1 --2- 172.21.15.78:0/1678528637 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x5561f69ddcc0 0x5561f6a3a8d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c0e9fe2f00b8dcf5 server_cookie=7572ac7da16bd57e in_seq=0 out_seq=0 2024-09-17T03:12:04.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.047+0000 7fa2f97fa640 1 -- 172.21.15.78:0/1678528637 <== mds.1 v2:172.21.15.193:6835/2730762656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5561f68e7460 con 0x5561f69ddcc0 2024-09-17T03:12:04.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.047+0000 7fa2f97fa640 10 client.6531 handle_command_reply: tid=0 2024-09-17T03:12:04.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.047+0000 7fa32782c740 1 client.6531 shutdown 2024-09-17T03:12:04.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.047+0000 7fa32782c740 1 -- 172.21.15.78:0/1678528637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65ae6b0 msgr2=0x5561f699cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:04.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa32782c740 1 --2- 172.21.15.78:0/1678528637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65ae6b0 0x5561f699cc20 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa308001330 tx=0x7fa308006850 comp rx=0 tx=0).stop 2024-09-17T03:12:04.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa32782c740 1 -- 172.21.15.78:0/1678528637 shutdown_connections 2024-09-17T03:12:04.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa32782c740 1 --2- 172.21.15.78:0/1678528637 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x5561f69ddcc0 0x5561f6a3a8d0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa32782c740 1 --2- 172.21.15.78:0/1678528637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5561f65cf390 0x5561f6a20410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa32782c740 1 --2- 172.21.15.78:0/1678528637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5561f65ae6b0 0x5561f699cc20 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa2f97fa640 0 client.6531 ms_handle_reset on v2:172.21.15.193:6835/2730762656 2024-09-17T03:12:04.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa32782c740 1 --2- 172.21.15.78:0/1678528637 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5561f65a64d0 0x5561f69cd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa32782c740 1 -- 172.21.15.78:0/1678528637 >> 172.21.15.78:0/1678528637 conn(0x5561f65c34e0 msgr2=0x5561f69b47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:04.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa32782c740 1 -- 172.21.15.78:0/1678528637 shutdown_connections 2024-09-17T03:12:04.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa32782c740 1 -- 172.21.15.78:0/1678528637 wait complete. 2024-09-17T03:12:04.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa32782c740 20 client.6531 trim_cache size 0 max 16384 2024-09-17T03:12:04.048 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:12:04.049 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:12:04.049 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:12:04.049 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:12:04.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa3207e6640 1 -- 172.21.15.78:0/3781150634 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa2fc078b90 msgr2=0x7fa2fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:04.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa3207e6640 1 --2- 172.21.15.78:0/3781150634 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa2fc078b90 0x7fa2fc07b0a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa3180a24d0 tx=0x7fa314005f30 comp rx=0 tx=0).stop 2024-09-17T03:12:04.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa3207e6640 1 -- 172.21.15.78:0/3781150634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3180b2710 msgr2=0x7fa3180c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:04.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa3207e6640 1 --2- 172.21.15.78:0/3781150634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3180b2710 0x7fa3180c9630 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fa310036040 tx=0x7fa310033de0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa3207e6640 1 -- 172.21.15.78:0/3781150634 shutdown_connections 2024-09-17T03:12:04.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa3207e6640 1 --2- 172.21.15.78:0/3781150634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3180b2710 0x7fa3180c9630 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa3207e6640 1 --2- 172.21.15.78:0/3781150634 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa3181f55c0 0x7fa3180b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa3207e6640 1 --2- 172.21.15.78:0/3781150634 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa2fc078b90 0x7fa2fc07b0a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa3207e6640 1 --2- 172.21.15.78:0/3781150634 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa304004d40 0x7fa3180cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.048+0000 7fa3207e6640 1 -- 172.21.15.78:0/3781150634 >> 172.21.15.78:0/3781150634 conn(0x7fa31808bfc0 msgr2=0x7fa3180cf180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:04.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.049+0000 7fa3207e6640 1 -- 172.21.15.78:0/3781150634 shutdown_connections 2024-09-17T03:12:04.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.049+0000 7fa3207e6640 1 -- 172.21.15.78:0/3781150634 wait complete. 2024-09-17T03:12:04.058 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:2 flush journal 2024-09-17T03:12:04.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.174+0000 7efdbd8a9640 1 -- 172.21.15.78:0/2819120312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb80d2ed0 msgr2=0x7efdb80d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:04.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.174+0000 7efdbd8a9640 1 --2- 172.21.15.78:0/2819120312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb80d2ed0 0x7efdb80d1a80 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7efdb80d32e0 tx=0x7efda802aa30 comp rx=0 tx=0).stop 2024-09-17T03:12:04.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.174+0000 7efdbd8a9640 1 -- 172.21.15.78:0/2819120312 shutdown_connections 2024-09-17T03:12:04.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.174+0000 7efdbd8a9640 1 --2- 172.21.15.78:0/2819120312 >> v2:172.21.15.193:3300/0 conn(0x7efdb80cf7a0 0x7efdb81626e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.174+0000 7efdbd8a9640 1 --2- 172.21.15.78:0/2819120312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb80d2ed0 0x7efdb80d1a80 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.174+0000 7efdbd8a9640 1 -- 172.21.15.78:0/2819120312 >> 172.21.15.78:0/2819120312 conn(0x7efdb808bfc0 msgr2=0x7efdb809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:04.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.174+0000 7efdbd8a9640 1 -- 172.21.15.78:0/2819120312 shutdown_connections 2024-09-17T03:12:04.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.174+0000 7efdbd8a9640 1 -- 172.21.15.78:0/2819120312 wait complete. 2024-09-17T03:12:04.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.175+0000 7efdbd8a9640 1 Processor -- start 2024-09-17T03:12:04.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.176+0000 7efdbd8a9640 1 -- start start 2024-09-17T03:12:04.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.177+0000 7efdbd8a9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdb80b9b70 0x7efdb80c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.177+0000 7efdbd8a9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efdb80cf7a0 0x7efdb8155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.177+0000 7efdbd8a9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb80d2ed0 0x7efdb81f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.177+0000 7efdbd8a9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efdb8162c20 con 0x7efdb80d2ed0 2024-09-17T03:12:04.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.177+0000 7efdbd8a9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efdb80cfed0 con 0x7efdb80b9b70 2024-09-17T03:12:04.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.177+0000 7efdbd8a9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7efdb8162da0 con 0x7efdb80cf7a0 2024-09-17T03:12:04.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.177+0000 7efdb77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb80d2ed0 0x7efdb81f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.177+0000 7efdb77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb80d2ed0 0x7efdb81f5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51886/0 (socket says 172.21.15.78:51886) 2024-09-17T03:12:04.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.177+0000 7efdb77fe640 1 -- 172.21.15.78:0/1310995867 learned_addr learned my addr 172.21.15.78:0/1310995867 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:04.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.177+0000 7efdb6ffd640 1 --2- 172.21.15.78:0/1310995867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdb80b9b70 0x7efdb80c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.177+0000 7efdb67fc640 1 --2- 172.21.15.78:0/1310995867 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efdb80cf7a0 0x7efdb8155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.177+0000 7efdb77fe640 1 -- 172.21.15.78:0/1310995867 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efdb80cf7a0 msgr2=0x7efdb8155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:04.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.177+0000 7efdb77fe640 1 --2- 172.21.15.78:0/1310995867 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efdb80cf7a0 0x7efdb8155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.177+0000 7efdb77fe640 1 -- 172.21.15.78:0/1310995867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdb80b9b70 msgr2=0x7efdb80c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:04.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.177+0000 7efdb77fe640 1 --2- 172.21.15.78:0/1310995867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdb80b9b70 0x7efdb80c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.177+0000 7efdb77fe640 1 -- 172.21.15.78:0/1310995867 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb80c8190 con 0x7efdb80d2ed0 2024-09-17T03:12:04.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.177+0000 7efdb6ffd640 1 --2- 172.21.15.78:0/1310995867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdb80b9b70 0x7efdb80c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:12:04.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.177+0000 7efdb67fc640 1 --2- 172.21.15.78:0/1310995867 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efdb80cf7a0 0x7efdb8155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:12:04.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.178+0000 7efdb77fe640 1 --2- 172.21.15.78:0/1310995867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb80d2ed0 0x7efdb81f5aa0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7efdb000e740 tx=0x7efdb000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:04.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.178+0000 7efd9ffff640 1 -- 172.21.15.78:0/1310995867 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb000ccc0 con 0x7efdb80d2ed0 2024-09-17T03:12:04.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.178+0000 7efd9ffff640 1 -- 172.21.15.78:0/1310995867 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdb000ce80 con 0x7efdb80d2ed0 2024-09-17T03:12:04.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.178+0000 7efdbd8a9640 1 -- 172.21.15.78:0/1310995867 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb81f63a0 con 0x7efdb80d2ed0 2024-09-17T03:12:04.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.178+0000 7efd9ffff640 1 -- 172.21.15.78:0/1310995867 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0005280 con 0x7efdb80d2ed0 2024-09-17T03:12:04.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.178+0000 7efdbd8a9640 1 -- 172.21.15.78:0/1310995867 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb80c9bd0 con 0x7efdb80d2ed0 2024-09-17T03:12:04.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.180+0000 7efd9ffff640 1 -- 172.21.15.78:0/1310995867 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efdb0005420 con 0x7efdb80d2ed0 2024-09-17T03:12:04.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.180+0000 7efd9ffff640 1 --2- 172.21.15.78:0/1310995867 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efda4078b90 0x7efda407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.180+0000 7efd9ffff640 1 -- 172.21.15.78:0/1310995867 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7efdb009b520 con 0x7efdb80d2ed0 2024-09-17T03:12:04.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.180+0000 7efdb6ffd640 1 --2- 172.21.15.78:0/1310995867 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efda4078b90 0x7efda407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.181+0000 7efdb6ffd640 1 --2- 172.21.15.78:0/1310995867 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efda4078b90 0x7efda407b0a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efda8035000 tx=0x7efda8004ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:04.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.181+0000 7efdc481c740 1 Processor -- start 2024-09-17T03:12:04.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.181+0000 7efdc481c740 1 -- start start 2024-09-17T03:12:04.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.183+0000 7efdc481c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556267e3b390 0x55626820c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.183+0000 7efdc481c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556267e124d0 0x55626820cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.183+0000 7efdc481c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e1a6b0 0x556268229b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.183+0000 7efdc481c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x556268155a60 con 0x556267e1a6b0 2024-09-17T03:12:04.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.183+0000 7efdc481c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556268144e90 con 0x556267e124d0 2024-09-17T03:12:04.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.183+0000 7efdc481c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x556268148ca0 con 0x556267e3b390 2024-09-17T03:12:04.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.183+0000 7efdb77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e1a6b0 0x556268229b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.183+0000 7efdb6ffd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556267e3b390 0x55626820c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.183+0000 7efdb77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e1a6b0 0x556268229b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51892/0 (socket says 172.21.15.78:51892) 2024-09-17T03:12:04.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.183+0000 7efdb77fe640 1 -- 172.21.15.78:0/1570711910 learned_addr learned my addr 172.21.15.78:0/1570711910 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:04.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.183+0000 7efdb67fc640 1 --2- 172.21.15.78:0/1570711910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556267e124d0 0x55626820cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.183+0000 7efdb77fe640 1 -- 172.21.15.78:0/1570711910 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556267e3b390 msgr2=0x55626820c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:04.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.183+0000 7efdb77fe640 1 --2- 172.21.15.78:0/1570711910 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556267e3b390 0x55626820c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.183+0000 7efdb77fe640 1 -- 172.21.15.78:0/1570711910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556267e124d0 msgr2=0x55626820cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:04.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.183+0000 7efdb77fe640 1 --2- 172.21.15.78:0/1570711910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556267e124d0 0x55626820cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.183+0000 7efdb77fe640 1 -- 172.21.15.78:0/1570711910 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556267f1d7d0 con 0x556267e1a6b0 2024-09-17T03:12:04.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.183+0000 7efdb77fe640 1 --2- 172.21.15.78:0/1570711910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e1a6b0 0x556268229b80 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7efdb0063080 tx=0x7efdb0062fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d4cbf19fdfa4db1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:04.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.183+0000 7efd9d7fa640 1 -- 172.21.15.78:0/1570711910 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0067e60 con 0x556267e1a6b0 2024-09-17T03:12:04.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.183+0000 7efd9d7fa640 1 -- 172.21.15.78:0/1570711910 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdb006cd10 con 0x556267e1a6b0 2024-09-17T03:12:04.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.183+0000 7efd9d7fa640 1 -- 172.21.15.78:0/1570711910 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb006cac0 con 0x556267e1a6b0 2024-09-17T03:12:04.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.184+0000 7efdc481c740 1 -- 172.21.15.78:0/1570711910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e1a6b0 msgr2=0x556268229b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:04.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.184+0000 7efdc481c740 1 --2- 172.21.15.78:0/1570711910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e1a6b0 0x556268229b80 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7efdb0063080 tx=0x7efdb0062fd0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.184+0000 7efdc481c740 1 -- 172.21.15.78:0/1570711910 shutdown_connections 2024-09-17T03:12:04.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.184+0000 7efdc481c740 1 --2- 172.21.15.78:0/1570711910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e1a6b0 0x556268229b80 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.184+0000 7efdc481c740 1 --2- 172.21.15.78:0/1570711910 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556267e124d0 0x55626820cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.184+0000 7efdc481c740 1 --2- 172.21.15.78:0/1570711910 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556267e3b390 0x55626820c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.184+0000 7efdc481c740 1 -- 172.21.15.78:0/1570711910 >> 172.21.15.78:0/1570711910 conn(0x556267e2f4e0 msgr2=0x5562681e2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:04.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.184+0000 7efdc481c740 1 -- 172.21.15.78:0/1570711910 shutdown_connections 2024-09-17T03:12:04.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.184+0000 7efdc481c740 1 -- 172.21.15.78:0/1570711910 wait complete. 2024-09-17T03:12:04.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.185+0000 7efdc481c740 1 -- start start 2024-09-17T03:12:04.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.185+0000 7efdc481c740 1 Processor -- start 2024-09-17T03:12:04.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efdc481c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556267e124d0 0x556268220840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efdc481c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556267e1a6b0 0x556268222f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efdc481c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e3b390 0x556268221b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efdc481c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x556267eb5740 con 0x556267e3b390 2024-09-17T03:12:04.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efdc481c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5562680ea970 con 0x556267e124d0 2024-09-17T03:12:04.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efdc481c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55626820d1c0 con 0x556267e1a6b0 2024-09-17T03:12:04.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efdc481c740 10 client.0 _ll_register_callbacks cb 0x5562680edbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:12:04.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efdb77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e3b390 0x556268221b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efdb77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e3b390 0x556268221b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51908/0 (socket says 172.21.15.78:51908) 2024-09-17T03:12:04.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efdb77fe640 1 -- 172.21.15.78:0/542565014 learned_addr learned my addr 172.21.15.78:0/542565014 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:04.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efdb67fc640 1 --2- 172.21.15.78:0/542565014 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556267e1a6b0 0x556268222f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efdb6ffd640 1 --2- 172.21.15.78:0/542565014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556267e124d0 0x556268220840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efdb77fe640 1 -- 172.21.15.78:0/542565014 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556267e1a6b0 msgr2=0x556268222f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:04.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efdb77fe640 1 --2- 172.21.15.78:0/542565014 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556267e1a6b0 0x556268222f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efdb77fe640 1 -- 172.21.15.78:0/542565014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556267e124d0 msgr2=0x556268220840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:04.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efdb77fe640 1 --2- 172.21.15.78:0/542565014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556267e124d0 0x556268220840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efdb77fe640 1 -- 172.21.15.78:0/542565014 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556267ea6970 con 0x556267e3b390 2024-09-17T03:12:04.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efdb77fe640 1 --2- 172.21.15.78:0/542565014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e3b390 0x556268221b10 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7efdb0099b30 tx=0x7efdb009b300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac05d3feb558140 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:04.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efd967fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:12:04.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efd967fc640 1 -- 172.21.15.78:0/542565014 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb000ee50 con 0x556267e3b390 2024-09-17T03:12:04.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efd967fc640 1 -- 172.21.15.78:0/542565014 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7efdb00627f0 con 0x556267e3b390 2024-09-17T03:12:04.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.187+0000 7efdc481c740 1 -- 172.21.15.78:0/542565014 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdb006cd10 con 0x556267e3b390 2024-09-17T03:12:04.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.188+0000 7efd967fc640 1 -- 172.21.15.78:0/542565014 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7efdb0067e60 con 0x556267e3b390 2024-09-17T03:12:04.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.188+0000 7efdc481c740 10 client.6543 fetch_fsmap learned FSMap version 52 2024-09-17T03:12:04.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.188+0000 7efdc481c740 1 -- 172.21.15.78:0/542565014 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x556267e846a0 con 0x556267e3b390 2024-09-17T03:12:04.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.188+0000 7efd967fc640 1 -- 172.21.15.78:0/542565014 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdb006cd10 con 0x556267e3b390 2024-09-17T03:12:04.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.188+0000 7efd967fc640 1 -- 172.21.15.78:0/542565014 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 52) ==== 3554+0+0 (secure 0 0 0) 0x7efdb006a060 con 0x556267e3b390 2024-09-17T03:12:04.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.188+0000 7efdc481c740 10 client.6543 fetch_fsmap finished waiting for FSMap version 52 2024-09-17T03:12:04.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.188+0000 7efdc481c740 10 client.6543 resolve_mds: resolved 4:2 to role '4:2' aka daemon mds.a 2024-09-17T03:12:04.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.188+0000 7efdc481c740 20 client.6543 populate_metadata read hostname 'smithi078' 2024-09-17T03:12:04.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.188+0000 7efdc481c740 1 --2- 172.21.15.78:0/542565014 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x556267df9f60 0x556268222520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.188+0000 7efdc481c740 4 client.6543 mds_command: new command op to 5758 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:12:04.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.188+0000 7efdc481c740 1 -- 172.21.15.78:0/542565014 --> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562681579b0 con 0x556267df9f60 2024-09-17T03:12:04.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.188+0000 7efdb6ffd640 1 --2- 172.21.15.78:0/542565014 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x556267df9f60 0x556268222520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.188+0000 7efdb6ffd640 1 --2- 172.21.15.78:0/542565014 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x556267df9f60 0x556268222520 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=32af6283e61cbd72 server_cookie=494e3830375e1faa in_seq=0 out_seq=0 2024-09-17T03:12:04.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.188+0000 7efd967fc640 10 client.6543 ms_handle_connect on v2:172.21.15.78:6833/1865992966 2024-09-17T03:12:04.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.189+0000 7efd967fc640 1 -- 172.21.15.78:0/542565014 <== mds.2 v2:172.21.15.78:6833/1865992966 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5562681579b0 con 0x556267df9f60 2024-09-17T03:12:04.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.189+0000 7efd967fc640 10 client.6543 handle_command_reply: tid=0 2024-09-17T03:12:04.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.189+0000 7efdc481c740 1 client.6543 shutdown 2024-09-17T03:12:04.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.189+0000 7efdc481c740 1 -- 172.21.15.78:0/542565014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e3b390 msgr2=0x556268221b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:04.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.189+0000 7efdc481c740 1 --2- 172.21.15.78:0/542565014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e3b390 0x556268221b10 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7efdb0099b30 tx=0x7efdb009b300 comp rx=0 tx=0).stop 2024-09-17T03:12:04.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.189+0000 7efdc481c740 1 -- 172.21.15.78:0/542565014 shutdown_connections 2024-09-17T03:12:04.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.189+0000 7efdc481c740 1 --2- 172.21.15.78:0/542565014 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x556267df9f60 0x556268222520 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.189+0000 7efdc481c740 1 --2- 172.21.15.78:0/542565014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e3b390 0x556268221b10 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.189+0000 7efdc481c740 1 --2- 172.21.15.78:0/542565014 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556267e1a6b0 0x556268222f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.189+0000 7efdc481c740 1 --2- 172.21.15.78:0/542565014 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556267e124d0 0x556268220840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.189+0000 7efd967fc640 0 client.6543 ms_handle_reset on v2:172.21.15.78:6833/1865992966 2024-09-17T03:12:04.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.189+0000 7efdc481c740 1 -- 172.21.15.78:0/542565014 >> 172.21.15.78:0/542565014 conn(0x556267e2f4e0 msgr2=0x5562681e28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:04.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.189+0000 7efdc481c740 1 -- 172.21.15.78:0/542565014 shutdown_connections 2024-09-17T03:12:04.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.189+0000 7efdc481c740 1 -- 172.21.15.78:0/542565014 wait complete. 2024-09-17T03:12:04.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.189+0000 7efdc481c740 20 client.6543 trim_cache size 0 max 16384 2024-09-17T03:12:04.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.204+0000 7efdc481c740 1 Processor -- start 2024-09-17T03:12:04.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.204+0000 7efdc481c740 1 -- start start 2024-09-17T03:12:04.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.205+0000 7efdc481c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556267e124d0 0x556268209800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.205+0000 7efdc481c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e1a6b0 0x5562681dbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.205+0000 7efdc481c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556267e3b390 0x5562681dc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.205+0000 7efdc481c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efdb8202170 con 0x556267e1a6b0 2024-09-17T03:12:04.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.205+0000 7efdc481c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efdb8201480 con 0x556267e124d0 2024-09-17T03:12:04.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.205+0000 7efdc481c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7efdb8201a40 con 0x556267e3b390 2024-09-17T03:12:04.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.206+0000 7efdb67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e1a6b0 0x5562681dbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.206+0000 7efdb67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e1a6b0 0x5562681dbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51912/0 (socket says 172.21.15.78:51912) 2024-09-17T03:12:04.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.206+0000 7efdb67fc640 1 -- 172.21.15.78:0/1202033448 learned_addr learned my addr 172.21.15.78:0/1202033448 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:04.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.206+0000 7efdb67fc640 1 -- 172.21.15.78:0/1202033448 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556267e3b390 msgr2=0x5562681dc230 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-17T03:12:04.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.206+0000 7efdb67fc640 1 --2- 172.21.15.78:0/1202033448 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556267e3b390 0x5562681dc230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.206+0000 7efdb67fc640 1 -- 172.21.15.78:0/1202033448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556267e124d0 msgr2=0x556268209800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-17T03:12:04.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.206+0000 7efdb67fc640 1 --2- 172.21.15.78:0/1202033448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556267e124d0 0x556268209800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.206+0000 7efdb67fc640 1 -- 172.21.15.78:0/1202033448 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55626821e050 con 0x556267e1a6b0 2024-09-17T03:12:04.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.206+0000 7efdb67fc640 1 --2- 172.21.15.78:0/1202033448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e1a6b0 0x5562681dbcf0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7efdac001660 tx=0x7efdac001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cdd52f8d97028b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:04.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.206+0000 7efd9cff9640 1 -- 172.21.15.78:0/1202033448 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac013890 con 0x556267e1a6b0 2024-09-17T03:12:04.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.206+0000 7efd9cff9640 1 -- 172.21.15.78:0/1202033448 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdac013b20 con 0x556267e1a6b0 2024-09-17T03:12:04.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.206+0000 7efd9cff9640 1 -- 172.21.15.78:0/1202033448 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdac007030 con 0x556267e1a6b0 2024-09-17T03:12:04.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.207+0000 7efdc481c740 1 -- 172.21.15.78:0/1202033448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e1a6b0 msgr2=0x5562681dbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:04.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.207+0000 7efdc481c740 1 --2- 172.21.15.78:0/1202033448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e1a6b0 0x5562681dbcf0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7efdac001660 tx=0x7efdac001b20 comp rx=0 tx=0).stop 2024-09-17T03:12:04.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.207+0000 7efdc481c740 1 -- 172.21.15.78:0/1202033448 shutdown_connections 2024-09-17T03:12:04.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.207+0000 7efdc481c740 1 --2- 172.21.15.78:0/1202033448 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556267e3b390 0x5562681dc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.207+0000 7efdc481c740 1 --2- 172.21.15.78:0/1202033448 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e1a6b0 0x5562681dbcf0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.207+0000 7efdc481c740 1 --2- 172.21.15.78:0/1202033448 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556267e124d0 0x556268209800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.207+0000 7efdc481c740 1 -- 172.21.15.78:0/1202033448 >> 172.21.15.78:0/1202033448 conn(0x556267e2f4e0 msgr2=0x556268223de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:04.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.207+0000 7efdc481c740 1 -- 172.21.15.78:0/1202033448 shutdown_connections 2024-09-17T03:12:04.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.207+0000 7efdc481c740 1 -- 172.21.15.78:0/1202033448 wait complete. 2024-09-17T03:12:04.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.208+0000 7efdc481c740 1 -- start start 2024-09-17T03:12:04.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.208+0000 7efdc481c740 1 Processor -- start 2024-09-17T03:12:04.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.209+0000 7efdc481c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e124d0 0x556268209800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.209+0000 7efdc481c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556267e1a6b0 0x556268222ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.209+0000 7efdc481c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556267e3b390 0x55626821e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.209+0000 7efdc481c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81f90f0 con 0x556267e124d0 2024-09-17T03:12:04.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.209+0000 7efdc481c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55626821f520 con 0x556267e3b390 2024-09-17T03:12:04.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.209+0000 7efdc481c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5562682a71f0 con 0x556267e1a6b0 2024-09-17T03:12:04.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.209+0000 7efdc481c740 10 client.0 _ll_register_callbacks cb 0x7efdb007c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:12:04.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.209+0000 7efdb6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e124d0 0x556268209800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.209+0000 7efdb6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e124d0 0x556268209800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51920/0 (socket says 172.21.15.78:51920) 2024-09-17T03:12:04.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.209+0000 7efdb6ffd640 1 -- 172.21.15.78:0/2796989856 learned_addr learned my addr 172.21.15.78:0/2796989856 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:04.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efdb6ffd640 1 -- 172.21.15.78:0/2796989856 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556267e1a6b0 msgr2=0x556268222ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:04.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efdb6ffd640 1 --2- 172.21.15.78:0/2796989856 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556267e1a6b0 0x556268222ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efdb6ffd640 1 -- 172.21.15.78:0/2796989856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556267e3b390 msgr2=0x55626821e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:04.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efdb6ffd640 1 --2- 172.21.15.78:0/2796989856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556267e3b390 0x55626821e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efdb6ffd640 1 -- 172.21.15.78:0/2796989856 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562682a9a50 con 0x556267e124d0 2024-09-17T03:12:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efdb6ffd640 1 --2- 172.21.15.78:0/2796989856 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e124d0 0x556268209800 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7efda8009a00 tx=0x7efda802aa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9214e48ceb36b50 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efd967fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:12:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efd967fc640 1 -- 172.21.15.78:0/2796989856 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda805c060 con 0x556267e124d0 2024-09-17T03:12:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efd967fc640 1 -- 172.21.15.78:0/2796989856 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7efda8004040 con 0x556267e124d0 2024-09-17T03:12:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efdc481c740 1 -- 172.21.15.78:0/2796989856 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdac013b20 con 0x556267e124d0 2024-09-17T03:12:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efd967fc640 1 -- 172.21.15.78:0/2796989856 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7efda8062050 con 0x556267e124d0 2024-09-17T03:12:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efdc481c740 10 client.6549 fetch_fsmap learned FSMap version 52 2024-09-17T03:12:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efdc481c740 1 -- 172.21.15.78:0/2796989856 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x55626821d9f0 con 0x556267e124d0 2024-09-17T03:12:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efd967fc640 1 -- 172.21.15.78:0/2796989856 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdac013b20 con 0x556267e124d0 2024-09-17T03:12:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efd967fc640 1 -- 172.21.15.78:0/2796989856 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 52) ==== 3554+0+0 (secure 0 0 0) 0x7efda8065020 con 0x556267e124d0 2024-09-17T03:12:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efdc481c740 10 client.6549 fetch_fsmap finished waiting for FSMap version 52 2024-09-17T03:12:04.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efdc481c740 10 client.6549 resolve_mds: resolved 4:2 to role '4:2' aka daemon mds.a 2024-09-17T03:12:04.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efdc481c740 20 client.6549 populate_metadata read hostname 'smithi078' 2024-09-17T03:12:04.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efdc481c740 1 --2- 172.21.15.78:0/2796989856 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x55626821e870 0x5562682a61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:04.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efdc481c740 4 client.6549 mds_command: new command op to 5758 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T03:12:04.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.210+0000 7efdc481c740 1 -- 172.21.15.78:0/2796989856 --> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556268153460 con 0x55626821e870 2024-09-17T03:12:04.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.211+0000 7efdb67fc640 1 --2- 172.21.15.78:0/2796989856 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x55626821e870 0x5562682a61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:04.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.211+0000 7efd967fc640 10 client.6549 ms_handle_connect on v2:172.21.15.78:6833/1865992966 2024-09-17T03:12:04.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.211+0000 7efdb67fc640 1 --2- 172.21.15.78:0/2796989856 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x55626821e870 0x5562682a61c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8fc1104959283ab server_cookie=94311554f41d0d1f in_seq=0 out_seq=0 2024-09-17T03:12:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.226+0000 7efd967fc640 1 -- 172.21.15.78:0/2796989856 <== mds.2 v2:172.21.15.78:6833/1865992966 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556268153460 con 0x55626821e870 2024-09-17T03:12:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.226+0000 7efd967fc640 10 client.6549 handle_command_reply: tid=0 2024-09-17T03:12:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.226+0000 7efdc481c740 1 client.6549 shutdown 2024-09-17T03:12:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.226+0000 7efdc481c740 1 -- 172.21.15.78:0/2796989856 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e124d0 msgr2=0x556268209800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.226+0000 7efdc481c740 1 --2- 172.21.15.78:0/2796989856 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e124d0 0x556268209800 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7efda8009a00 tx=0x7efda802aa30 comp rx=0 tx=0).stop 2024-09-17T03:12:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.226+0000 7efdc481c740 1 -- 172.21.15.78:0/2796989856 shutdown_connections 2024-09-17T03:12:04.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.226+0000 7efdc481c740 1 --2- 172.21.15.78:0/2796989856 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x55626821e870 0x5562682a61c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.226+0000 7efdc481c740 1 --2- 172.21.15.78:0/2796989856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556267e3b390 0x55626821e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.226+0000 7efdc481c740 1 --2- 172.21.15.78:0/2796989856 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556267e1a6b0 0x556268222ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.226+0000 7efd967fc640 0 client.6549 ms_handle_reset on v2:172.21.15.78:6833/1865992966 2024-09-17T03:12:04.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.226+0000 7efdc481c740 1 --2- 172.21.15.78:0/2796989856 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556267e124d0 0x556268209800 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.226+0000 7efdc481c740 1 -- 172.21.15.78:0/2796989856 >> 172.21.15.78:0/2796989856 conn(0x556267e2f4e0 msgr2=0x5562681faea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:04.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.226+0000 7efdc481c740 1 -- 172.21.15.78:0/2796989856 shutdown_connections 2024-09-17T03:12:04.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.226+0000 7efdc481c740 1 -- 172.21.15.78:0/2796989856 wait complete. 2024-09-17T03:12:04.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.226+0000 7efdc481c740 20 client.6549 trim_cache size 0 max 16384 2024-09-17T03:12:04.226 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:12:04.226 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:12:04.226 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:12:04.227 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:12:04.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.227+0000 7efdbd8a9640 1 -- 172.21.15.78:0/1310995867 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efda4078b90 msgr2=0x7efda407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:04.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.227+0000 7efdbd8a9640 1 --2- 172.21.15.78:0/1310995867 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efda4078b90 0x7efda407b0a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efda8035000 tx=0x7efda8004ab0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.227+0000 7efdbd8a9640 1 -- 172.21.15.78:0/1310995867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb80d2ed0 msgr2=0x7efdb81f5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.227+0000 7efdbd8a9640 1 --2- 172.21.15.78:0/1310995867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb80d2ed0 0x7efdb81f5aa0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7efdb000e740 tx=0x7efdb000ec00 comp rx=0 tx=0).stop 2024-09-17T03:12:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.227+0000 7efdbd8a9640 1 -- 172.21.15.78:0/1310995867 shutdown_connections 2024-09-17T03:12:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.227+0000 7efdbd8a9640 1 --2- 172.21.15.78:0/1310995867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efdb80d2ed0 0x7efdb81f5aa0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.227+0000 7efdbd8a9640 1 --2- 172.21.15.78:0/1310995867 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efdb80cf7a0 0x7efdb8155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.227+0000 7efdbd8a9640 1 --2- 172.21.15.78:0/1310995867 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efda4078b90 0x7efda407b0a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.227+0000 7efdbd8a9640 1 --2- 172.21.15.78:0/1310995867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdb80b9b70 0x7efdb80c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.227+0000 7efdbd8a9640 1 -- 172.21.15.78:0/1310995867 >> 172.21.15.78:0/1310995867 conn(0x7efdb808bfc0 msgr2=0x7efdb806eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.227+0000 7efdbd8a9640 1 -- 172.21.15.78:0/1310995867 shutdown_connections 2024-09-17T03:12:04.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04.227+0000 7efdbd8a9640 1 -- 172.21.15.78:0/1310995867 wait complete. 2024-09-17T03:12:04.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:12:04.237 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2024-09-17T03:12:04.259 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/ 2024-09-17T03:12:04.259 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4 2024-09-17T03:12:04.259 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4/d5 2024-09-17T03:12:04.259 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4/d5/d6 2024-09-17T03:12:04.259 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4/d5/d6/d7 2024-09-17T03:12:04.259 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2024-09-17T03:12:04.259 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:12:04.260 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:12:04.260 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:12:04.260 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:12:04.260 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2024-09-17T03:12:04.260 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:12:04.364 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627778 2024-09-17T03:12:04.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:12:04.373 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:12:04.373 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:12:04.374 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:12:04.374 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:12:04.374 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2024-09-17T03:12:04.374 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:12:04.478 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627779 2024-09-17T03:12:04.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:12:04.488 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:12:04.488 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:12:04.488 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:12:04.488 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:12:04.488 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2024-09-17T03:12:04.488 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:12:04.593 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627780 2024-09-17T03:12:04.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:12:04.602 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:12:04.602 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:12:04.602 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:12:04.602 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:12:04.602 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2024-09-17T03:12:04.602 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:12:04.706 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627781 2024-09-17T03:12:04.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:12:04.715 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:12:04.715 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:12:04.715 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:12:04.716 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:12:04.716 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2024-09-17T03:12:04.716 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:12:04.819 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627782 2024-09-17T03:12:04.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:12:04.829 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:12:04.829 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:12:04.829 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:12:04.829 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:12:04.829 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2024-09-17T03:12:04.829 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:12:04.936 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627783 2024-09-17T03:12:04.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:12:04.945 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000002.00000000 parent 2024-09-17T03:12:05.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.040+0000 7f3f834d2f40 1 Processor -- start 2024-09-17T03:12:05.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.040+0000 7f3f834d2f40 1 -- start start 2024-09-17T03:12:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.042+0000 7f3f834d2f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56215c0a72c0 0x56215c1467f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.042+0000 7f3f834d2f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56215c14c300 0x56215c1385b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.042+0000 7f3f834d2f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56215c14cc50 0x56215c0792b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.042+0000 7f3f834d2f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56215c0c0840 con 0x56215c14c300 2024-09-17T03:12:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.042+0000 7f3f834d2f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56215bfc7d60 con 0x56215c14cc50 2024-09-17T03:12:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.042+0000 7f3f834d2f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x56215c0c09c0 con 0x56215c0a72c0 2024-09-17T03:12:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.042+0000 7f3f7c78d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56215c14c300 0x56215c1385b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.042+0000 7f3f7c78d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56215c14c300 0x56215c1385b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51936/0 (socket says 172.21.15.78:51936) 2024-09-17T03:12:05.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.042+0000 7f3f7c78d640 1 -- 172.21.15.78:0/1026210615 learned_addr learned my addr 172.21.15.78:0/1026210615 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.042+0000 7f3f7cf8e640 1 --2- 172.21.15.78:0/1026210615 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56215c0a72c0 0x56215c1467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.042+0000 7f3f7d78f640 1 --2- 172.21.15.78:0/1026210615 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56215c14cc50 0x56215c0792b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.042+0000 7f3f7c78d640 1 -- 172.21.15.78:0/1026210615 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56215c0a72c0 msgr2=0x56215c1467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.042+0000 7f3f7c78d640 1 --2- 172.21.15.78:0/1026210615 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56215c0a72c0 0x56215c1467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.042+0000 7f3f7c78d640 1 -- 172.21.15.78:0/1026210615 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56215c14cc50 msgr2=0x56215c0792b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.042+0000 7f3f7c78d640 1 --2- 172.21.15.78:0/1026210615 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56215c14cc50 0x56215c0792b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.042+0000 7f3f7c78d640 1 -- 172.21.15.78:0/1026210615 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56215c146210 con 0x56215c14c300 2024-09-17T03:12:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.042+0000 7f3f7c78d640 1 --2- 172.21.15.78:0/1026210615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56215c14c300 0x56215c1385b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c00c550 tx=0x7f3f6c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ab99db095643a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.042+0000 7f3f7b78b640 1 -- 172.21.15.78:0/1026210615 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c00aa60 con 0x56215c14c300 2024-09-17T03:12:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.042+0000 7f3f7b78b640 1 -- 172.21.15.78:0/1026210615 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f6c00ac00 con 0x56215c14c300 2024-09-17T03:12:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.042+0000 7f3f7b78b640 1 -- 172.21.15.78:0/1026210615 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c015440 con 0x56215c14c300 2024-09-17T03:12:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.043+0000 7f3f834d2f40 1 -- 172.21.15.78:0/1026210615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56215c14c300 msgr2=0x56215c1385b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.043+0000 7f3f834d2f40 1 --2- 172.21.15.78:0/1026210615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56215c14c300 0x56215c1385b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c00c550 tx=0x7f3f6c00ca10 comp rx=0 tx=0).stop 2024-09-17T03:12:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.043+0000 7f3f834d2f40 1 -- 172.21.15.78:0/1026210615 shutdown_connections 2024-09-17T03:12:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.043+0000 7f3f834d2f40 1 --2- 172.21.15.78:0/1026210615 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56215c14cc50 0x56215c0792b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.043+0000 7f3f834d2f40 1 --2- 172.21.15.78:0/1026210615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56215c14c300 0x56215c1385b0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.043+0000 7f3f834d2f40 1 --2- 172.21.15.78:0/1026210615 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56215c0a72c0 0x56215c1467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.043+0000 7f3f834d2f40 1 -- 172.21.15.78:0/1026210615 >> 172.21.15.78:0/1026210615 conn(0x56215bf98ac0 msgr2=0x56215c07a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.043+0000 7f3f834d2f40 1 -- 172.21.15.78:0/1026210615 shutdown_connections 2024-09-17T03:12:05.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.043+0000 7f3f834d2f40 1 -- 172.21.15.78:0/1026210615 wait complete. 2024-09-17T03:12:05.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.044+0000 7f3f834d2f40 1 Processor -- start 2024-09-17T03:12:05.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.044+0000 7f3f834d2f40 1 -- start start 2024-09-17T03:12:05.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.045+0000 7f3f834d2f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56215c0a72c0 0x56215c1366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.045+0000 7f3f834d2f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56215c14c300 0x56215c14b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.045+0000 7f3f834d2f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56215c14cc50 0x56215c14b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.045+0000 7f3f834d2f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56215c1464b0 con 0x56215c14cc50 2024-09-17T03:12:05.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.045+0000 7f3f834d2f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56215c146f50 con 0x56215c0a72c0 2024-09-17T03:12:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.045+0000 7f3f834d2f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x56215c0a4eb0 con 0x56215c14c300 2024-09-17T03:12:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.045+0000 7f3f7d78f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56215c14cc50 0x56215c14b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.045+0000 7f3f7d78f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56215c14cc50 0x56215c14b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51942/0 (socket says 172.21.15.78:51942) 2024-09-17T03:12:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.045+0000 7f3f7d78f640 1 -- 172.21.15.78:0/2261210885 learned_addr learned my addr 172.21.15.78:0/2261210885 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.045+0000 7f3f7c78d640 1 --2- 172.21.15.78:0/2261210885 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56215c14c300 0x56215c14b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.045+0000 7f3f7cf8e640 1 --2- 172.21.15.78:0/2261210885 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56215c0a72c0 0x56215c1366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.045+0000 7f3f7d78f640 1 -- 172.21.15.78:0/2261210885 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56215c14c300 msgr2=0x56215c14b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.045+0000 7f3f7d78f640 1 --2- 172.21.15.78:0/2261210885 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56215c14c300 0x56215c14b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.045+0000 7f3f7d78f640 1 -- 172.21.15.78:0/2261210885 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56215c0a72c0 msgr2=0x56215c1366d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.045+0000 7f3f7d78f640 1 --2- 172.21.15.78:0/2261210885 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56215c0a72c0 0x56215c1366d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.045+0000 7f3f7d78f640 1 -- 172.21.15.78:0/2261210885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56215c0b7890 con 0x56215c14cc50 2024-09-17T03:12:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.046+0000 7f3f7d78f640 1 --2- 172.21.15.78:0/2261210885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56215c14cc50 0x56215c14b610 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f3f74057040 tx=0x7f3f74004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.046+0000 7f3f7a789640 1 -- 172.21.15.78:0/2261210885 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f74066070 con 0x56215c14cc50 2024-09-17T03:12:05.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.046+0000 7f3f7a789640 1 -- 172.21.15.78:0/2261210885 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f74004020 con 0x56215c14cc50 2024-09-17T03:12:05.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.046+0000 7f3f7a789640 1 -- 172.21.15.78:0/2261210885 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f74060440 con 0x56215c14cc50 2024-09-17T03:12:05.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.046+0000 7f3f834d2f40 1 -- 172.21.15.78:0/2261210885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56215c144c00 con 0x56215c14cc50 2024-09-17T03:12:05.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.046+0000 7f3f834d2f40 1 -- 172.21.15.78:0/2261210885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56215c07a680 con 0x56215c14cc50 2024-09-17T03:12:05.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.048+0000 7f3f7a789640 1 -- 172.21.15.78:0/2261210885 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3f7405e040 con 0x56215c14cc50 2024-09-17T03:12:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.048+0000 7f3f7a789640 1 --2- 172.21.15.78:0/2261210885 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f5c077570 0x7f3f5c079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.048+0000 7f3f7a789640 1 -- 172.21.15.78:0/2261210885 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f3f740dda70 con 0x56215c14cc50 2024-09-17T03:12:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.048+0000 7f3f7cf8e640 1 --2- 172.21.15.78:0/2261210885 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f5c077570 0x7f3f5c079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.048+0000 7f3f834d2f40 1 --2- 172.21.15.78:0/2261210885 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x56215c0b7a60 0x56215c0bd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.048+0000 7f3f834d2f40 1 -- 172.21.15.78:0/2261210885 --> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] -- osd_op(unknown.0.0:1 8.12 8:4bec3886:::10000000002.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58) -- 0x56215c0bde30 con 0x56215c0b7a60 2024-09-17T03:12:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.049+0000 7f3f7c78d640 1 --2- 172.21.15.78:0/2261210885 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x56215c0b7a60 0x56215c0bd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.049+0000 7f3f7cf8e640 1 --2- 172.21.15.78:0/2261210885 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f5c077570 0x7f3f5c079a80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400b550 tx=0x7f3f6400e040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.049+0000 7f3f7c78d640 1 --2- 172.21.15.78:0/2261210885 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x56215c0b7a60 0x56215c0bd8f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.050+0000 7f3f7c78d640 1 -- 172.21.15.78:0/2261210885 <== osd.6 v2:172.21.15.193:6818/2885678262 1 ==== osd_op_reply(1 10000000002.00000000 [rmxattr] v58'8 uv8 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f3f6c00a9e0 con 0x56215c0b7a60 2024-09-17T03:12:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.050+0000 7f3f834d2f40 1 -- 172.21.15.78:0/2261210885 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x56215c0b7a60 msgr2=0x56215c0bd8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.050+0000 7f3f834d2f40 1 --2- 172.21.15.78:0/2261210885 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x56215c0b7a60 0x56215c0bd8f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.051+0000 7f3f834d2f40 1 -- 172.21.15.78:0/2261210885 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f5c077570 msgr2=0x7f3f5c079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.051+0000 7f3f834d2f40 1 --2- 172.21.15.78:0/2261210885 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f5c077570 0x7f3f5c079a80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3f6400b550 tx=0x7f3f6400e040 comp rx=0 tx=0).stop 2024-09-17T03:12:05.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.051+0000 7f3f834d2f40 1 -- 172.21.15.78:0/2261210885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56215c14cc50 msgr2=0x56215c14b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.051+0000 7f3f834d2f40 1 --2- 172.21.15.78:0/2261210885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56215c14cc50 0x56215c14b610 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f3f74057040 tx=0x7f3f74004ab0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.051+0000 7f3f7d78f640 1 -- 172.21.15.78:0/2261210885 reap_dead start 2024-09-17T03:12:05.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.051+0000 7f3f834d2f40 1 -- 172.21.15.78:0/2261210885 shutdown_connections 2024-09-17T03:12:05.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.051+0000 7f3f834d2f40 1 -- 172.21.15.78:0/2261210885 >> 172.21.15.78:0/2261210885 conn(0x56215bf98ac0 msgr2=0x56215c0787a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.051+0000 7f3f834d2f40 1 -- 172.21.15.78:0/2261210885 shutdown_connections 2024-09-17T03:12:05.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.051+0000 7f3f834d2f40 1 -- 172.21.15.78:0/2261210885 wait complete. 2024-09-17T03:12:05.052 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000003.00000000 parent 2024-09-17T03:12:05.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.108+0000 7fd6a4b26f40 1 Processor -- start 2024-09-17T03:12:05.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.108+0000 7fd6a4b26f40 1 -- start start 2024-09-17T03:12:05.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.110+0000 7fd6a4b26f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fd50ba9c50 0x55fd50b1be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.110+0000 7fd6a4b26f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fd50b35ab0 0x55fd50b1b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.110+0000 7fd6a4b26f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd50b1d910 0x55fd50b1dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.110+0000 7fd6a4b26f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55fd50a3dd60 con 0x55fd50b1d910 2024-09-17T03:12:05.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.110+0000 7fd6a4b26f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55fd50a9c430 con 0x55fd50ba9c50 2024-09-17T03:12:05.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.110+0000 7fd6a4b26f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55fd50b35630 con 0x55fd50b35ab0 2024-09-17T03:12:05.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.110+0000 7fd69e39b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd50b1d910 0x55fd50b1dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.110+0000 7fd69e39b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd50b1d910 0x55fd50b1dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51956/0 (socket says 172.21.15.78:51956) 2024-09-17T03:12:05.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.110+0000 7fd69e39b640 1 -- 172.21.15.78:0/76190508 learned_addr learned my addr 172.21.15.78:0/76190508 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.110+0000 7fd69db9a640 1 --2- 172.21.15.78:0/76190508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fd50ba9c50 0x55fd50b1be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.110+0000 7fd695399640 1 --2- 172.21.15.78:0/76190508 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fd50b35ab0 0x55fd50b1b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.110+0000 7fd69e39b640 1 -- 172.21.15.78:0/76190508 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fd50b35ab0 msgr2=0x55fd50b1b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.110+0000 7fd69e39b640 1 --2- 172.21.15.78:0/76190508 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fd50b35ab0 0x55fd50b1b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.110+0000 7fd69e39b640 1 -- 172.21.15.78:0/76190508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fd50ba9c50 msgr2=0x55fd50b1be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.110+0000 7fd69e39b640 1 --2- 172.21.15.78:0/76190508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fd50ba9c50 0x55fd50b1be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.110+0000 7fd69e39b640 1 -- 172.21.15.78:0/76190508 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd50c4d360 con 0x55fd50b1d910 2024-09-17T03:12:05.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.110+0000 7fd69e39b640 1 --2- 172.21.15.78:0/76190508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd50b1d910 0x55fd50b1dd20 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fd698057040 tx=0x7fd6980033a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938c37c7e715dab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.110+0000 7fd69cb98640 1 -- 172.21.15.78:0/76190508 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd69800b480 con 0x55fd50b1d910 2024-09-17T03:12:05.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.110+0000 7fd69cb98640 1 -- 172.21.15.78:0/76190508 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd698055430 con 0x55fd50b1d910 2024-09-17T03:12:05.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.110+0000 7fd69cb98640 1 -- 172.21.15.78:0/76190508 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698055a40 con 0x55fd50b1d910 2024-09-17T03:12:05.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.111+0000 7fd6a4b26f40 1 -- 172.21.15.78:0/76190508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd50b1d910 msgr2=0x55fd50b1dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.111+0000 7fd6a4b26f40 1 --2- 172.21.15.78:0/76190508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd50b1d910 0x55fd50b1dd20 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fd698057040 tx=0x7fd6980033a0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.111+0000 7fd6a4b26f40 1 -- 172.21.15.78:0/76190508 shutdown_connections 2024-09-17T03:12:05.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.111+0000 7fd6a4b26f40 1 --2- 172.21.15.78:0/76190508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd50b1d910 0x55fd50b1dd20 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.111+0000 7fd6a4b26f40 1 --2- 172.21.15.78:0/76190508 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fd50b35ab0 0x55fd50b1b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.111+0000 7fd6a4b26f40 1 --2- 172.21.15.78:0/76190508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fd50ba9c50 0x55fd50b1be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.111+0000 7fd6a4b26f40 1 -- 172.21.15.78:0/76190508 >> 172.21.15.78:0/76190508 conn(0x55fd50a0eac0 msgr2=0x55fd50b1c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.111+0000 7fd6a4b26f40 1 -- 172.21.15.78:0/76190508 shutdown_connections 2024-09-17T03:12:05.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.111+0000 7fd6a4b26f40 1 -- 172.21.15.78:0/76190508 wait complete. 2024-09-17T03:12:05.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.112+0000 7fd6a4b26f40 1 Processor -- start 2024-09-17T03:12:05.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.112+0000 7fd6a4b26f40 1 -- start start 2024-09-17T03:12:05.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.113+0000 7fd6a4b26f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fd50b1d910 0x55fd50aed240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.113+0000 7fd6a4b26f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fd50b35ab0 0x55fd50ba13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.113+0000 7fd6a4b26f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd50ba9c50 0x55fd50ba18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.113+0000 7fd6a4b26f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55fd50bc0f90 con 0x55fd50ba9c50 2024-09-17T03:12:05.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.113+0000 7fd6a4b26f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55fd50bc1750 con 0x55fd50b1d910 2024-09-17T03:12:05.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.113+0000 7fd6a4b26f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55fd50b33910 con 0x55fd50b35ab0 2024-09-17T03:12:05.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.113+0000 7fd69e39b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd50ba9c50 0x55fd50ba18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.113+0000 7fd69e39b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd50ba9c50 0x55fd50ba18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51968/0 (socket says 172.21.15.78:51968) 2024-09-17T03:12:05.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.113+0000 7fd69e39b640 1 -- 172.21.15.78:0/1743566292 learned_addr learned my addr 172.21.15.78:0/1743566292 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.113+0000 7fd695399640 1 --2- 172.21.15.78:0/1743566292 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fd50b35ab0 0x55fd50ba13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.113+0000 7fd69db9a640 1 --2- 172.21.15.78:0/1743566292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fd50b1d910 0x55fd50aed240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.113+0000 7fd69e39b640 1 -- 172.21.15.78:0/1743566292 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fd50b35ab0 msgr2=0x55fd50ba13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.113+0000 7fd69e39b640 1 --2- 172.21.15.78:0/1743566292 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fd50b35ab0 0x55fd50ba13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.113+0000 7fd69e39b640 1 -- 172.21.15.78:0/1743566292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fd50b1d910 msgr2=0x55fd50aed240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.113+0000 7fd69e39b640 1 --2- 172.21.15.78:0/1743566292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fd50b1d910 0x55fd50aed240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.113+0000 7fd69e39b640 1 -- 172.21.15.78:0/1743566292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd50ba2130 con 0x55fd50ba9c50 2024-09-17T03:12:05.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.113+0000 7fd695399640 1 --2- 172.21.15.78:0/1743566292 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fd50b35ab0 0x55fd50ba13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:05.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.113+0000 7fd69db9a640 1 --2- 172.21.15.78:0/1743566292 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fd50b1d910 0x55fd50aed240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:05.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.114+0000 7fd69e39b640 1 --2- 172.21.15.78:0/1743566292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd50ba9c50 0x55fd50ba18f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd698046d90 tx=0x7fd698046ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.114+0000 7fd6977fe640 1 -- 172.21.15.78:0/1743566292 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698060040 con 0x55fd50ba9c50 2024-09-17T03:12:05.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.114+0000 7fd6977fe640 1 -- 172.21.15.78:0/1743566292 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6980557e0 con 0x55fd50ba9c50 2024-09-17T03:12:05.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.114+0000 7fd6977fe640 1 -- 172.21.15.78:0/1743566292 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd698055c10 con 0x55fd50ba9c50 2024-09-17T03:12:05.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.114+0000 7fd6a4b26f40 1 -- 172.21.15.78:0/1743566292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fd50bc0180 con 0x55fd50ba9c50 2024-09-17T03:12:05.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.114+0000 7fd6a4b26f40 1 -- 172.21.15.78:0/1743566292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd50ba24e0 con 0x55fd50ba9c50 2024-09-17T03:12:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.115+0000 7fd6977fe640 1 -- 172.21.15.78:0/1743566292 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd69805c440 con 0x55fd50ba9c50 2024-09-17T03:12:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.116+0000 7fd6977fe640 1 --2- 172.21.15.78:0/1743566292 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd680077570 0x7fd680079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.116+0000 7fd6977fe640 1 -- 172.21.15.78:0/1743566292 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fd6980e02d0 con 0x55fd50ba9c50 2024-09-17T03:12:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.116+0000 7fd69db9a640 1 --2- 172.21.15.78:0/1743566292 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd680077570 0x7fd680079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.116+0000 7fd6a4b26f40 1 --2- 172.21.15.78:0/1743566292 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x55fd50aed780 0x55fd50c5c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.116+0000 7fd6a4b26f40 1 -- 172.21.15.78:0/1743566292 --> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] -- osd_op(unknown.0.0:1 8.12 8:4def72d4:::10000000003.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58) -- 0x55fd50c50650 con 0x55fd50aed780 2024-09-17T03:12:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.116+0000 7fd695399640 1 --2- 172.21.15.78:0/1743566292 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x55fd50aed780 0x55fd50c5c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.117+0000 7fd69db9a640 1 --2- 172.21.15.78:0/1743566292 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd680077570 0x7fd680079a80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd690001860 tx=0x7fd690004040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.117+0000 7fd695399640 1 --2- 172.21.15.78:0/1743566292 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x55fd50aed780 0x55fd50c5c360 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.118+0000 7fd695399640 1 -- 172.21.15.78:0/1743566292 <== osd.6 v2:172.21.15.193:6818/2885678262 1 ==== osd_op_reply(1 10000000003.00000000 [rmxattr] v58'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fd68800b930 con 0x55fd50aed780 2024-09-17T03:12:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.118+0000 7fd6a4b26f40 1 -- 172.21.15.78:0/1743566292 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x55fd50aed780 msgr2=0x55fd50c5c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.118+0000 7fd6a4b26f40 1 --2- 172.21.15.78:0/1743566292 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x55fd50aed780 0x55fd50c5c360 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.118+0000 7fd6a4b26f40 1 -- 172.21.15.78:0/1743566292 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd680077570 msgr2=0x7fd680079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.118+0000 7fd6a4b26f40 1 --2- 172.21.15.78:0/1743566292 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd680077570 0x7fd680079a80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd690001860 tx=0x7fd690004040 comp rx=0 tx=0).stop 2024-09-17T03:12:05.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.118+0000 7fd6a4b26f40 1 -- 172.21.15.78:0/1743566292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd50ba9c50 msgr2=0x55fd50ba18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.118+0000 7fd6a4b26f40 1 --2- 172.21.15.78:0/1743566292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fd50ba9c50 0x55fd50ba18f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fd698046d90 tx=0x7fd698046ca0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.118+0000 7fd69e39b640 1 -- 172.21.15.78:0/1743566292 reap_dead start 2024-09-17T03:12:05.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.118+0000 7fd6a4b26f40 1 -- 172.21.15.78:0/1743566292 shutdown_connections 2024-09-17T03:12:05.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.118+0000 7fd6a4b26f40 1 -- 172.21.15.78:0/1743566292 >> 172.21.15.78:0/1743566292 conn(0x55fd50a0eac0 msgr2=0x55fd50b1b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.118+0000 7fd6a4b26f40 1 -- 172.21.15.78:0/1743566292 shutdown_connections 2024-09-17T03:12:05.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.118+0000 7fd6a4b26f40 1 -- 172.21.15.78:0/1743566292 wait complete. 2024-09-17T03:12:05.123 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000004.00000000 parent 2024-09-17T03:12:05.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.179+0000 7f34a6b25f40 1 Processor -- start 2024-09-17T03:12:05.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.179+0000 7f34a6b25f40 1 -- start start 2024-09-17T03:12:05.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.180+0000 7f34a6b25f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bb8d315f0 0x561bb8e02100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.180+0000 7f34a6b25f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bb8e049f0 0x561bb8d70900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.180+0000 7f34a6b25f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bb8e053c0 0x561bb8d78f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.180+0000 7f34a6b25f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x561bb8cdd430 con 0x561bb8e053c0 2024-09-17T03:12:05.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.180+0000 7f34a6b25f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561bb8cea1f0 con 0x561bb8e049f0 2024-09-17T03:12:05.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.180+0000 7f34a6b25f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x561bb8c7ed60 con 0x561bb8d315f0 2024-09-17T03:12:05.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.181+0000 7f34a04c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bb8e053c0 0x561bb8d78f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.181+0000 7f34a04c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bb8e053c0 0x561bb8d78f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51994/0 (socket says 172.21.15.78:51994) 2024-09-17T03:12:05.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.181+0000 7f34a04c8640 1 -- 172.21.15.78:0/1633976475 learned_addr learned my addr 172.21.15.78:0/1633976475 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.181+0000 7f349fcc7640 1 --2- 172.21.15.78:0/1633976475 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bb8d315f0 0x561bb8e02100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.181+0000 7f34974c6640 1 --2- 172.21.15.78:0/1633976475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bb8e049f0 0x561bb8d70900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.181+0000 7f34a04c8640 1 -- 172.21.15.78:0/1633976475 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bb8d315f0 msgr2=0x561bb8e02100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.181+0000 7f34a04c8640 1 --2- 172.21.15.78:0/1633976475 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bb8d315f0 0x561bb8e02100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.181+0000 7f34a04c8640 1 -- 172.21.15.78:0/1633976475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bb8e049f0 msgr2=0x561bb8d70900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.181+0000 7f34a04c8640 1 --2- 172.21.15.78:0/1633976475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bb8e049f0 0x561bb8d70900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.181+0000 7f34a04c8640 1 -- 172.21.15.78:0/1633976475 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bb8de94d0 con 0x561bb8e053c0 2024-09-17T03:12:05.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.181+0000 7f34974c6640 1 --2- 172.21.15.78:0/1633976475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bb8e049f0 0x561bb8d70900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:05.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.181+0000 7f34a04c8640 1 --2- 172.21.15.78:0/1633976475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bb8e053c0 0x561bb8d78f70 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f34980015b0 tx=0x7f3498001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66738ffec0188c66 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.181+0000 7f349ecc5640 1 -- 172.21.15.78:0/1633976475 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3498017070 con 0x561bb8e053c0 2024-09-17T03:12:05.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.181+0000 7f349ecc5640 1 -- 172.21.15.78:0/1633976475 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34980027a0 con 0x561bb8e053c0 2024-09-17T03:12:05.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.181+0000 7f349ecc5640 1 -- 172.21.15.78:0/1633976475 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3498002c30 con 0x561bb8e053c0 2024-09-17T03:12:05.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.182+0000 7f34a6b25f40 1 -- 172.21.15.78:0/1633976475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bb8e053c0 msgr2=0x561bb8d78f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.182+0000 7f34a6b25f40 1 --2- 172.21.15.78:0/1633976475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bb8e053c0 0x561bb8d78f70 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f34980015b0 tx=0x7f3498001a70 comp rx=0 tx=0).stop 2024-09-17T03:12:05.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.182+0000 7f34a6b25f40 1 -- 172.21.15.78:0/1633976475 shutdown_connections 2024-09-17T03:12:05.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.182+0000 7f34a6b25f40 1 --2- 172.21.15.78:0/1633976475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bb8e053c0 0x561bb8d78f70 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.182+0000 7f34a6b25f40 1 --2- 172.21.15.78:0/1633976475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bb8e049f0 0x561bb8d70900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.182+0000 7f34a6b25f40 1 --2- 172.21.15.78:0/1633976475 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bb8d315f0 0x561bb8e02100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.182+0000 7f34a6b25f40 1 -- 172.21.15.78:0/1633976475 >> 172.21.15.78:0/1633976475 conn(0x561bb8c4fac0 msgr2=0x561bb8d79be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.182+0000 7f34a6b25f40 1 -- 172.21.15.78:0/1633976475 shutdown_connections 2024-09-17T03:12:05.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.182+0000 7f34a6b25f40 1 -- 172.21.15.78:0/1633976475 wait complete. 2024-09-17T03:12:05.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.183+0000 7f34a6b25f40 1 Processor -- start 2024-09-17T03:12:05.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.183+0000 7f34a6b25f40 1 -- start start 2024-09-17T03:12:05.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.184+0000 7f34a6b25f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bb8d315f0 0x561bb8de0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.184+0000 7f34a6b25f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bb8e049f0 0x561bb8e058a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.184+0000 7f34a6b25f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bb8e053c0 0x561bb8e05de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.184+0000 7f34a6b25f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x561bb8dfe620 con 0x561bb8d315f0 2024-09-17T03:12:05.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.184+0000 7f34a6b25f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561bb8de98b0 con 0x561bb8e053c0 2024-09-17T03:12:05.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.184+0000 7f34a6b25f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x561bb8d78560 con 0x561bb8e049f0 2024-09-17T03:12:05.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.184+0000 7f349fcc7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bb8d315f0 0x561bb8de0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.184+0000 7f349fcc7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bb8d315f0 0x561bb8de0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52004/0 (socket says 172.21.15.78:52004) 2024-09-17T03:12:05.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.184+0000 7f349fcc7640 1 -- 172.21.15.78:0/1255555721 learned_addr learned my addr 172.21.15.78:0/1255555721 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.184+0000 7f349fcc7640 1 -- 172.21.15.78:0/1255555721 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bb8e049f0 msgr2=0x561bb8e058a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.184+0000 7f349fcc7640 1 --2- 172.21.15.78:0/1255555721 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561bb8e049f0 0x561bb8e058a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.184+0000 7f349fcc7640 1 -- 172.21.15.78:0/1255555721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bb8e053c0 msgr2=0x561bb8e05de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.184+0000 7f349fcc7640 1 --2- 172.21.15.78:0/1255555721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561bb8e053c0 0x561bb8e05de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.184+0000 7f349fcc7640 1 -- 172.21.15.78:0/1255555721 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bb8e014a0 con 0x561bb8d315f0 2024-09-17T03:12:05.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.184+0000 7f349fcc7640 1 --2- 172.21.15.78:0/1255555721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bb8d315f0 0x561bb8de0a20 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f349000a3d0 tx=0x7f349004d600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.185+0000 7f349dcc3640 1 -- 172.21.15.78:0/1255555721 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3490056670 con 0x561bb8d315f0 2024-09-17T03:12:05.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.185+0000 7f349dcc3640 1 -- 172.21.15.78:0/1255555721 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3490066070 con 0x561bb8d315f0 2024-09-17T03:12:05.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.185+0000 7f349dcc3640 1 -- 172.21.15.78:0/1255555721 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3490056bc0 con 0x561bb8d315f0 2024-09-17T03:12:05.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.185+0000 7f34a6b25f40 1 -- 172.21.15.78:0/1255555721 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561bb8de2630 con 0x561bb8d315f0 2024-09-17T03:12:05.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.185+0000 7f34a6b25f40 1 -- 172.21.15.78:0/1255555721 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bb8de1eb0 con 0x561bb8d315f0 2024-09-17T03:12:05.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.186+0000 7f349dcc3640 1 -- 172.21.15.78:0/1255555721 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f349006b460 con 0x561bb8d315f0 2024-09-17T03:12:05.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.187+0000 7f349dcc3640 1 --2- 172.21.15.78:0/1255555721 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f34800775a0 0x7f3480079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.187+0000 7f349dcc3640 1 -- 172.21.15.78:0/1255555721 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f34900ddde0 con 0x561bb8d315f0 2024-09-17T03:12:05.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.187+0000 7f34a6b25f40 1 --2- 172.21.15.78:0/1255555721 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x561bb8de4a20 0x561bb8de4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.187+0000 7f34974c6640 1 --2- 172.21.15.78:0/1255555721 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f34800775a0 0x7f3480079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.187+0000 7f34a6b25f40 1 -- 172.21.15.78:0/1255555721 --> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] -- osd_op(unknown.0.0:1 8.5 8:a367a3e8:::10000000004.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58) -- 0x561bb8ea9fc0 con 0x561bb8de4a20 2024-09-17T03:12:05.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.187+0000 7f34a04c8640 1 --2- 172.21.15.78:0/1255555721 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x561bb8de4a20 0x561bb8de4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.187+0000 7f34974c6640 1 --2- 172.21.15.78:0/1255555721 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f34800775a0 0x7f3480079ab0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x561bb8d70970 tx=0x7f3488005630 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.188+0000 7f34a04c8640 1 --2- 172.21.15.78:0/1255555721 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x561bb8de4a20 0x561bb8de4e30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.189+0000 7f34a04c8640 1 -- 172.21.15.78:0/1255555721 <== osd.6 v2:172.21.15.193:6818/2885678262 1 ==== osd_op_reply(1 10000000004.00000000 [rmxattr] v58'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f349800f070 con 0x561bb8de4a20 2024-09-17T03:12:05.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.189+0000 7f34a6b25f40 1 -- 172.21.15.78:0/1255555721 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x561bb8de4a20 msgr2=0x561bb8de4e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.189+0000 7f34a6b25f40 1 --2- 172.21.15.78:0/1255555721 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x561bb8de4a20 0x561bb8de4e30 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.189+0000 7f34a6b25f40 1 -- 172.21.15.78:0/1255555721 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f34800775a0 msgr2=0x7f3480079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.189+0000 7f34a6b25f40 1 --2- 172.21.15.78:0/1255555721 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f34800775a0 0x7f3480079ab0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x561bb8d70970 tx=0x7f3488005630 comp rx=0 tx=0).stop 2024-09-17T03:12:05.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.189+0000 7f34a6b25f40 1 -- 172.21.15.78:0/1255555721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bb8d315f0 msgr2=0x561bb8de0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.189+0000 7f34a6b25f40 1 --2- 172.21.15.78:0/1255555721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561bb8d315f0 0x561bb8de0a20 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f349000a3d0 tx=0x7f349004d600 comp rx=0 tx=0).stop 2024-09-17T03:12:05.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.189+0000 7f34a04c8640 1 -- 172.21.15.78:0/1255555721 reap_dead start 2024-09-17T03:12:05.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.189+0000 7f34a6b25f40 1 -- 172.21.15.78:0/1255555721 shutdown_connections 2024-09-17T03:12:05.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.189+0000 7f34a6b25f40 1 -- 172.21.15.78:0/1255555721 >> 172.21.15.78:0/1255555721 conn(0x561bb8c4fac0 msgr2=0x561bb8de8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.189+0000 7f34a6b25f40 1 -- 172.21.15.78:0/1255555721 shutdown_connections 2024-09-17T03:12:05.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.189+0000 7f34a6b25f40 1 -- 172.21.15.78:0/1255555721 wait complete. 2024-09-17T03:12:05.193 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000005.00000000 parent 2024-09-17T03:12:05.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.249+0000 7fa991010f40 1 Processor -- start 2024-09-17T03:12:05.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.249+0000 7fa991010f40 1 -- start start 2024-09-17T03:12:05.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.251+0000 7fa991010f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d5ca35d50 0x557d5cb04bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.251+0000 7fa991010f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d5ca7f3f0 0x557d5ca7ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.251+0000 7fa991010f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d5cb07ea0 0x557d5cb01190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.251+0000 7fa991010f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557d5c9e6430 con 0x557d5ca35d50 2024-09-17T03:12:05.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.251+0000 7fa991010f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557d5c9f31f0 con 0x557d5ca7f3f0 2024-09-17T03:12:05.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.251+0000 7fa991010f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x557d5c987d60 con 0x557d5cb07ea0 2024-09-17T03:12:05.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.251+0000 7fa989d5b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d5ca35d50 0x557d5cb04bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.251+0000 7fa989d5b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d5ca35d50 0x557d5cb04bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52006/0 (socket says 172.21.15.78:52006) 2024-09-17T03:12:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.251+0000 7fa989d5b640 1 -- 172.21.15.78:0/2118203033 learned_addr learned my addr 172.21.15.78:0/2118203033 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.251+0000 7fa98a55c640 1 --2- 172.21.15.78:0/2118203033 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d5cb07ea0 0x557d5cb01190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.251+0000 7fa983fff640 1 --2- 172.21.15.78:0/2118203033 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d5ca7f3f0 0x557d5ca7ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.251+0000 7fa989d5b640 1 -- 172.21.15.78:0/2118203033 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d5cb07ea0 msgr2=0x557d5cb01190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.251+0000 7fa989d5b640 1 --2- 172.21.15.78:0/2118203033 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d5cb07ea0 0x557d5cb01190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.251+0000 7fa989d5b640 1 -- 172.21.15.78:0/2118203033 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d5ca7f3f0 msgr2=0x557d5ca7ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.251+0000 7fa989d5b640 1 --2- 172.21.15.78:0/2118203033 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d5ca7f3f0 0x557d5ca7ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.251+0000 7fa989d5b640 1 -- 172.21.15.78:0/2118203033 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d5caf74b0 con 0x557d5ca35d50 2024-09-17T03:12:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.251+0000 7fa989d5b640 1 --2- 172.21.15.78:0/2118203033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d5ca35d50 0x557d5cb04bb0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fa97c001d40 tx=0x7fa97c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d463fd46900c56 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.252+0000 7fa988d59640 1 -- 172.21.15.78:0/2118203033 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c00bd80 con 0x557d5ca35d50 2024-09-17T03:12:05.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.252+0000 7fa988d59640 1 -- 172.21.15.78:0/2118203033 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa97c00f400 con 0x557d5ca35d50 2024-09-17T03:12:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.252+0000 7fa988d59640 1 -- 172.21.15.78:0/2118203033 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c00f850 con 0x557d5ca35d50 2024-09-17T03:12:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.252+0000 7fa991010f40 1 -- 172.21.15.78:0/2118203033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d5ca35d50 msgr2=0x557d5cb04bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.252+0000 7fa991010f40 1 --2- 172.21.15.78:0/2118203033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d5ca35d50 0x557d5cb04bb0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fa97c001d40 tx=0x7fa97c00b5b0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.252+0000 7fa991010f40 1 -- 172.21.15.78:0/2118203033 shutdown_connections 2024-09-17T03:12:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.252+0000 7fa991010f40 1 --2- 172.21.15.78:0/2118203033 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d5cb07ea0 0x557d5cb01190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.252+0000 7fa991010f40 1 --2- 172.21.15.78:0/2118203033 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d5ca7f3f0 0x557d5ca7ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.252+0000 7fa991010f40 1 --2- 172.21.15.78:0/2118203033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d5ca35d50 0x557d5cb04bb0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.252+0000 7fa991010f40 1 -- 172.21.15.78:0/2118203033 >> 172.21.15.78:0/2118203033 conn(0x557d5c958ac0 msgr2=0x557d5ca7dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.252+0000 7fa991010f40 1 -- 172.21.15.78:0/2118203033 shutdown_connections 2024-09-17T03:12:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.252+0000 7fa991010f40 1 -- 172.21.15.78:0/2118203033 wait complete. 2024-09-17T03:12:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.253+0000 7fa991010f40 1 Processor -- start 2024-09-17T03:12:05.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.253+0000 7fa991010f40 1 -- start start 2024-09-17T03:12:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.254+0000 7fa991010f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d5ca35d50 0x557d5cba7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa991010f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d5ca7f3f0 0x557d5cb05890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa991010f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d5cb07ea0 0x557d5ca67620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa991010f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557d5caf76d0 con 0x557d5ca35d50 2024-09-17T03:12:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa991010f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557d5cb050f0 con 0x557d5cb07ea0 2024-09-17T03:12:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa991010f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x557d5cb045b0 con 0x557d5ca7f3f0 2024-09-17T03:12:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa989d5b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d5ca35d50 0x557d5cba7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa989d5b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d5ca35d50 0x557d5cba7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52010/0 (socket says 172.21.15.78:52010) 2024-09-17T03:12:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa989d5b640 1 -- 172.21.15.78:0/1483545413 learned_addr learned my addr 172.21.15.78:0/1483545413 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa983fff640 1 --2- 172.21.15.78:0/1483545413 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d5ca7f3f0 0x557d5cb05890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa98a55c640 1 --2- 172.21.15.78:0/1483545413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d5cb07ea0 0x557d5ca67620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa989d5b640 1 -- 172.21.15.78:0/1483545413 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d5ca7f3f0 msgr2=0x557d5cb05890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa989d5b640 1 --2- 172.21.15.78:0/1483545413 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557d5ca7f3f0 0x557d5cb05890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa989d5b640 1 -- 172.21.15.78:0/1483545413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d5cb07ea0 msgr2=0x557d5ca67620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa989d5b640 1 --2- 172.21.15.78:0/1483545413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557d5cb07ea0 0x557d5ca67620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa989d5b640 1 -- 172.21.15.78:0/1483545413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d5caf6cb0 con 0x557d5ca35d50 2024-09-17T03:12:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa989d5b640 1 --2- 172.21.15.78:0/1483545413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d5ca35d50 0x557d5cba7110 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00bab0 tx=0x7fa97c00fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa982ffd640 1 -- 172.21.15.78:0/1483545413 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c01b430 con 0x557d5ca35d50 2024-09-17T03:12:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa982ffd640 1 -- 172.21.15.78:0/1483545413 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa97c020020 con 0x557d5ca35d50 2024-09-17T03:12:05.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa982ffd640 1 -- 172.21.15.78:0/1483545413 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa97c01b720 con 0x557d5ca35d50 2024-09-17T03:12:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa991010f40 1 -- 172.21.15.78:0/1483545413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557d5cb07ae0 con 0x557d5ca35d50 2024-09-17T03:12:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.255+0000 7fa991010f40 1 -- 172.21.15.78:0/1483545413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d5cba7650 con 0x557d5ca35d50 2024-09-17T03:12:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.257+0000 7fa982ffd640 1 -- 172.21.15.78:0/1483545413 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa97c017070 con 0x557d5ca35d50 2024-09-17T03:12:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.257+0000 7fa982ffd640 1 --2- 172.21.15.78:0/1483545413 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa96c077570 0x7fa96c079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.258+0000 7fa982ffd640 1 -- 172.21.15.78:0/1483545413 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fa97c09adc0 con 0x557d5ca35d50 2024-09-17T03:12:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.258+0000 7fa983fff640 1 --2- 172.21.15.78:0/1483545413 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa96c077570 0x7fa96c079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.258+0000 7fa991010f40 1 --2- 172.21.15.78:0/1483545413 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x557d5cbaab90 0x557d5cbaafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.258+0000 7fa991010f40 1 -- 172.21.15.78:0/1483545413 --> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] -- osd_op(unknown.0.0:1 8.9 8:9258b67d:::10000000005.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58) -- 0x557d5cb05dd0 con 0x557d5cbaab90 2024-09-17T03:12:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.258+0000 7fa98a55c640 1 --2- 172.21.15.78:0/1483545413 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x557d5cbaab90 0x557d5cbaafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.258+0000 7fa983fff640 1 --2- 172.21.15.78:0/1483545413 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa96c077570 0x7fa96c079a80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x557d5cb16940 tx=0x7fa974007040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.258+0000 7fa98a55c640 1 --2- 172.21.15.78:0/1483545413 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x557d5cbaab90 0x557d5cbaafa0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.260+0000 7fa98a55c640 1 -- 172.21.15.78:0/1483545413 <== osd.6 v2:172.21.15.193:6818/2885678262 1 ==== osd_op_reply(1 10000000005.00000000 [rmxattr] v58'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fa98400b040 con 0x557d5cbaab90 2024-09-17T03:12:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.260+0000 7fa991010f40 1 -- 172.21.15.78:0/1483545413 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x557d5cbaab90 msgr2=0x557d5cbaafa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.260+0000 7fa991010f40 1 --2- 172.21.15.78:0/1483545413 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x557d5cbaab90 0x557d5cbaafa0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.260+0000 7fa991010f40 1 -- 172.21.15.78:0/1483545413 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa96c077570 msgr2=0x7fa96c079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.260+0000 7fa991010f40 1 --2- 172.21.15.78:0/1483545413 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa96c077570 0x7fa96c079a80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x557d5cb16940 tx=0x7fa974007040 comp rx=0 tx=0).stop 2024-09-17T03:12:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.260+0000 7fa991010f40 1 -- 172.21.15.78:0/1483545413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d5ca35d50 msgr2=0x557d5cba7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.260+0000 7fa991010f40 1 --2- 172.21.15.78:0/1483545413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557d5ca35d50 0x557d5cba7110 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00bab0 tx=0x7fa97c00fdf0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.260+0000 7fa98a55c640 1 -- 172.21.15.78:0/1483545413 reap_dead start 2024-09-17T03:12:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.260+0000 7fa991010f40 1 -- 172.21.15.78:0/1483545413 shutdown_connections 2024-09-17T03:12:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.260+0000 7fa991010f40 1 -- 172.21.15.78:0/1483545413 >> 172.21.15.78:0/1483545413 conn(0x557d5c958ac0 msgr2=0x557d5ca363d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.260+0000 7fa991010f40 1 -- 172.21.15.78:0/1483545413 shutdown_connections 2024-09-17T03:12:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.260+0000 7fa991010f40 1 -- 172.21.15.78:0/1483545413 wait complete. 2024-09-17T03:12:05.263 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000006.00000000 parent 2024-09-17T03:12:05.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.320+0000 7f9cd854cf40 1 Processor -- start 2024-09-17T03:12:05.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.320+0000 7f9cd854cf40 1 -- start start 2024-09-17T03:12:05.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.321+0000 7f9cd854cf40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ebbaa0a3d0 0x55ebbaa4fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.321+0000 7f9cd854cf40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ebbaa0bea0 0x55ebbaadba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.321+0000 7f9cd854cf40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebbaa0de60 0x55ebbaa39e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.321+0000 7f9cd854cf40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ebba95bd60 con 0x55ebbaa0de60 2024-09-17T03:12:05.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.321+0000 7f9cd854cf40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ebba9ba430 con 0x55ebbaa0a3d0 2024-09-17T03:12:05.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.321+0000 7f9cd854cf40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ebbaa0e9a0 con 0x55ebbaa0bea0 2024-09-17T03:12:05.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.321+0000 7f9cd2807640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebbaa0de60 0x55ebbaa39e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.321+0000 7f9cd2807640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebbaa0de60 0x55ebbaa39e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52036/0 (socket says 172.21.15.78:52036) 2024-09-17T03:12:05.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.321+0000 7f9cd2807640 1 -- 172.21.15.78:0/3482246693 learned_addr learned my addr 172.21.15.78:0/3482246693 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.321+0000 7f9cd2807640 1 -- 172.21.15.78:0/3482246693 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ebbaa0bea0 msgr2=0x55ebbaadba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.321+0000 7f9cd2807640 1 --2- 172.21.15.78:0/3482246693 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ebbaa0bea0 0x55ebbaadba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.321+0000 7f9cd2807640 1 -- 172.21.15.78:0/3482246693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ebbaa0a3d0 msgr2=0x55ebbaa4fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.321+0000 7f9cd2807640 1 --2- 172.21.15.78:0/3482246693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ebbaa0a3d0 0x55ebbaa4fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.321+0000 7f9cd2807640 1 -- 172.21.15.78:0/3482246693 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebbaa39210 con 0x55ebbaa0de60 2024-09-17T03:12:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.321+0000 7f9cd2807640 1 --2- 172.21.15.78:0/3482246693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebbaa0de60 0x55ebbaa39e30 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0015b0 tx=0x7f9ccc001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d3d232cbf311 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.322+0000 7f9cd1004640 1 -- 172.21.15.78:0/3482246693 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc017070 con 0x55ebbaa0de60 2024-09-17T03:12:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.322+0000 7f9cd1004640 1 -- 172.21.15.78:0/3482246693 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ccc0027a0 con 0x55ebbaa0de60 2024-09-17T03:12:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.322+0000 7f9cd1004640 1 -- 172.21.15.78:0/3482246693 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc002c30 con 0x55ebbaa0de60 2024-09-17T03:12:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.322+0000 7f9cd854cf40 1 -- 172.21.15.78:0/3482246693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebbaa0de60 msgr2=0x55ebbaa39e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.322+0000 7f9cd854cf40 1 --2- 172.21.15.78:0/3482246693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebbaa0de60 0x55ebbaa39e30 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0015b0 tx=0x7f9ccc001a70 comp rx=0 tx=0).stop 2024-09-17T03:12:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.322+0000 7f9cd854cf40 1 -- 172.21.15.78:0/3482246693 shutdown_connections 2024-09-17T03:12:05.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.322+0000 7f9cd854cf40 1 --2- 172.21.15.78:0/3482246693 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebbaa0de60 0x55ebbaa39e30 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.322+0000 7f9cd854cf40 1 --2- 172.21.15.78:0/3482246693 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ebbaa0bea0 0x55ebbaadba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.322+0000 7f9cd854cf40 1 --2- 172.21.15.78:0/3482246693 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ebbaa0a3d0 0x55ebbaa4fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.322+0000 7f9cd854cf40 1 -- 172.21.15.78:0/3482246693 >> 172.21.15.78:0/3482246693 conn(0x55ebba92cac0 msgr2=0x55ebbaa0c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.322+0000 7f9cd854cf40 1 -- 172.21.15.78:0/3482246693 shutdown_connections 2024-09-17T03:12:05.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.322+0000 7f9cd854cf40 1 -- 172.21.15.78:0/3482246693 wait complete. 2024-09-17T03:12:05.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.323+0000 7f9cd854cf40 1 Processor -- start 2024-09-17T03:12:05.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.323+0000 7f9cd854cf40 1 -- start start 2024-09-17T03:12:05.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.324+0000 7f9cd854cf40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ebbaa0a3d0 0x55ebbaad98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.324+0000 7f9cd854cf40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ebbaa0bea0 0x55ebbaae3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.324+0000 7f9cd854cf40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebbaa0de60 0x55ebbaae38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.324+0000 7f9cd854cf40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ebbaadd2a0 con 0x55ebbaa0de60 2024-09-17T03:12:05.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.324+0000 7f9cd854cf40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ebbaa52460 con 0x55ebbaa0bea0 2024-09-17T03:12:05.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.324+0000 7f9cd854cf40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ebbaa394b0 con 0x55ebbaa0a3d0 2024-09-17T03:12:05.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.324+0000 7f9cd2807640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebbaa0de60 0x55ebbaae38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.325+0000 7f9cd2807640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebbaa0de60 0x55ebbaae38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52052/0 (socket says 172.21.15.78:52052) 2024-09-17T03:12:05.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.325+0000 7f9cd2807640 1 -- 172.21.15.78:0/3772769147 learned_addr learned my addr 172.21.15.78:0/3772769147 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.325+0000 7f9cd2006640 1 --2- 172.21.15.78:0/3772769147 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ebbaa0a3d0 0x55ebbaad98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.325+0000 7f9cc9805640 1 --2- 172.21.15.78:0/3772769147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ebbaa0bea0 0x55ebbaae3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.325+0000 7f9cd2807640 1 -- 172.21.15.78:0/3772769147 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ebbaa0a3d0 msgr2=0x55ebbaad98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.325+0000 7f9cd2807640 1 --2- 172.21.15.78:0/3772769147 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ebbaa0a3d0 0x55ebbaad98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.325+0000 7f9cd2807640 1 -- 172.21.15.78:0/3772769147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ebbaa0bea0 msgr2=0x55ebbaae3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.325+0000 7f9cd2807640 1 --2- 172.21.15.78:0/3772769147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ebbaa0bea0 0x55ebbaae3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.325+0000 7f9cd2807640 1 -- 172.21.15.78:0/3772769147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebbaad9e00 con 0x55ebbaa0de60 2024-09-17T03:12:05.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.325+0000 7f9cc9805640 1 --2- 172.21.15.78:0/3772769147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ebbaa0bea0 0x55ebbaae3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:05.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.325+0000 7f9cd2807640 1 --2- 172.21.15.78:0/3772769147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebbaa0de60 0x55ebbaae38d0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x55ebbaae45a0 tx=0x7f9ccc003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.325+0000 7f9ccbfff640 1 -- 172.21.15.78:0/3772769147 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc023070 con 0x55ebbaa0de60 2024-09-17T03:12:05.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.325+0000 7f9ccbfff640 1 -- 172.21.15.78:0/3772769147 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ccc018040 con 0x55ebbaa0de60 2024-09-17T03:12:05.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.325+0000 7f9cd854cf40 1 -- 172.21.15.78:0/3772769147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ebbaa3a4e0 con 0x55ebbaa0de60 2024-09-17T03:12:05.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.325+0000 7f9ccbfff640 1 -- 172.21.15.78:0/3772769147 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc017070 con 0x55ebbaa0de60 2024-09-17T03:12:05.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.325+0000 7f9cd854cf40 1 -- 172.21.15.78:0/3772769147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebbab7b7c0 con 0x55ebbaa0de60 2024-09-17T03:12:05.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.327+0000 7f9ccbfff640 1 -- 172.21.15.78:0/3772769147 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9ccc026070 con 0x55ebbaa0de60 2024-09-17T03:12:05.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.327+0000 7f9ccbfff640 1 --2- 172.21.15.78:0/3772769147 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9cb40775a0 0x7f9cb4079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.327+0000 7f9ccbfff640 1 -- 172.21.15.78:0/3772769147 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f9ccc099e90 con 0x55ebbaa0de60 2024-09-17T03:12:05.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.328+0000 7f9cd2006640 1 --2- 172.21.15.78:0/3772769147 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9cb40775a0 0x7f9cb4079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.328+0000 7f9cd854cf40 1 --2- 172.21.15.78:0/3772769147 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x55ebbaa51840 0x55ebbab7afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.328+0000 7f9cd854cf40 1 -- 172.21.15.78:0/3772769147 --> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] -- osd_op(unknown.0.0:1 8.5 8:a5feb6f3:::10000000006.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58) -- 0x55ebbaa387b0 con 0x55ebbaa51840 2024-09-17T03:12:05.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.328+0000 7f9cc9805640 1 --2- 172.21.15.78:0/3772769147 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x55ebbaa51840 0x55ebbab7afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.328+0000 7f9cd2006640 1 --2- 172.21.15.78:0/3772769147 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9cb40775a0 0x7f9cb4079ab0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4055000 tx=0x7f9cc4002fb0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.328+0000 7f9cc9805640 1 --2- 172.21.15.78:0/3772769147 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x55ebbaa51840 0x55ebbab7afc0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.330+0000 7f9cc9805640 1 -- 172.21.15.78:0/3772769147 <== osd.6 v2:172.21.15.193:6818/2885678262 1 ==== osd_op_reply(1 10000000006.00000000 [rmxattr] v58'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f9cbc00c6f0 con 0x55ebbaa51840 2024-09-17T03:12:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.330+0000 7f9cd854cf40 1 -- 172.21.15.78:0/3772769147 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x55ebbaa51840 msgr2=0x55ebbab7afc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.330+0000 7f9cd854cf40 1 --2- 172.21.15.78:0/3772769147 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x55ebbaa51840 0x55ebbab7afc0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.330+0000 7f9cd854cf40 1 -- 172.21.15.78:0/3772769147 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9cb40775a0 msgr2=0x7f9cb4079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.330+0000 7f9cd854cf40 1 --2- 172.21.15.78:0/3772769147 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9cb40775a0 0x7f9cb4079ab0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4055000 tx=0x7f9cc4002fb0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.330+0000 7f9cd854cf40 1 -- 172.21.15.78:0/3772769147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebbaa0de60 msgr2=0x55ebbaae38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.330+0000 7f9cd854cf40 1 --2- 172.21.15.78:0/3772769147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ebbaa0de60 0x55ebbaae38d0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x55ebbaae45a0 tx=0x7f9ccc003000 comp rx=0 tx=0).stop 2024-09-17T03:12:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.330+0000 7f9cd2807640 1 -- 172.21.15.78:0/3772769147 reap_dead start 2024-09-17T03:12:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.330+0000 7f9cd854cf40 1 -- 172.21.15.78:0/3772769147 shutdown_connections 2024-09-17T03:12:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.330+0000 7f9cd854cf40 1 -- 172.21.15.78:0/3772769147 >> 172.21.15.78:0/3772769147 conn(0x55ebba92cac0 msgr2=0x55ebbaa0c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.330+0000 7f9cd854cf40 1 -- 172.21.15.78:0/3772769147 shutdown_connections 2024-09-17T03:12:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.330+0000 7f9cd854cf40 1 -- 172.21.15.78:0/3772769147 wait complete. 2024-09-17T03:12:05.332 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000007.00000000 parent 2024-09-17T03:12:05.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.389+0000 7fe4d0e31f40 1 Processor -- start 2024-09-17T03:12:05.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.389+0000 7fe4d0e31f40 1 -- start start 2024-09-17T03:12:05.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.390+0000 7fe4d0e31f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aceec26d90 0x55aceecf87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.390+0000 7fe4d0e31f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55aceecfde00 0x55aceeceeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.390+0000 7fe4d0e31f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aceecff080 0x55aceecef2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.390+0000 7fe4d0e31f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55aceeb77d60 con 0x55aceec26d90 2024-09-17T03:12:05.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.390+0000 7fe4d0e31f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55aceebd6430 con 0x55aceecff080 2024-09-17T03:12:05.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.390+0000 7fe4d0e31f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55aceecf7710 con 0x55aceecfde00 2024-09-17T03:12:05.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.390+0000 7fe4ca8eb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aceec26d90 0x55aceecf87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.390+0000 7fe4ca8eb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aceec26d90 0x55aceecf87d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52064/0 (socket says 172.21.15.78:52064) 2024-09-17T03:12:05.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.390+0000 7fe4ca8eb640 1 -- 172.21.15.78:0/1228538400 learned_addr learned my addr 172.21.15.78:0/1228538400 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.390+0000 7fe4cb0ec640 1 --2- 172.21.15.78:0/1228538400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aceecff080 0x55aceecef2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.390+0000 7fe4c20ea640 1 --2- 172.21.15.78:0/1228538400 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55aceecfde00 0x55aceeceeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.391+0000 7fe4ca8eb640 1 -- 172.21.15.78:0/1228538400 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55aceecfde00 msgr2=0x55aceeceeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.391+0000 7fe4ca8eb640 1 --2- 172.21.15.78:0/1228538400 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55aceecfde00 0x55aceeceeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.391+0000 7fe4ca8eb640 1 -- 172.21.15.78:0/1228538400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aceecff080 msgr2=0x55aceecef2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.391+0000 7fe4ca8eb640 1 --2- 172.21.15.78:0/1228538400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aceecff080 0x55aceecef2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.391+0000 7fe4ca8eb640 1 -- 172.21.15.78:0/1228538400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aceec55cb0 con 0x55aceec26d90 2024-09-17T03:12:05.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.391+0000 7fe4c20ea640 1 --2- 172.21.15.78:0/1228538400 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55aceecfde00 0x55aceeceeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:05.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.391+0000 7fe4ca8eb640 1 --2- 172.21.15.78:0/1228538400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aceec26d90 0x55aceecf87d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc025e80 tx=0x7fe4bc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b802dbcea774a45 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.391+0000 7fe4c98e9640 1 -- 172.21.15.78:0/1228538400 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc04db70 con 0x55aceec26d90 2024-09-17T03:12:05.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.391+0000 7fe4c98e9640 1 -- 172.21.15.78:0/1228538400 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4bc04dd10 con 0x55aceec26d90 2024-09-17T03:12:05.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.391+0000 7fe4c98e9640 1 -- 172.21.15.78:0/1228538400 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0566d0 con 0x55aceec26d90 2024-09-17T03:12:05.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.391+0000 7fe4d0e31f40 1 -- 172.21.15.78:0/1228538400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aceec26d90 msgr2=0x55aceecf87d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.391+0000 7fe4d0e31f40 1 --2- 172.21.15.78:0/1228538400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aceec26d90 0x55aceecf87d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc025e80 tx=0x7fe4bc002fb0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.392+0000 7fe4d0e31f40 1 -- 172.21.15.78:0/1228538400 shutdown_connections 2024-09-17T03:12:05.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.392+0000 7fe4d0e31f40 1 --2- 172.21.15.78:0/1228538400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aceecff080 0x55aceecef2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.392+0000 7fe4d0e31f40 1 --2- 172.21.15.78:0/1228538400 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55aceecfde00 0x55aceeceeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.392+0000 7fe4d0e31f40 1 --2- 172.21.15.78:0/1228538400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aceec26d90 0x55aceecf87d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.392+0000 7fe4d0e31f40 1 -- 172.21.15.78:0/1228538400 >> 172.21.15.78:0/1228538400 conn(0x55aceeb48ac0 msgr2=0x55aceecf6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.392+0000 7fe4d0e31f40 1 -- 172.21.15.78:0/1228538400 shutdown_connections 2024-09-17T03:12:05.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.392+0000 7fe4d0e31f40 1 -- 172.21.15.78:0/1228538400 wait complete. 2024-09-17T03:12:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.392+0000 7fe4d0e31f40 1 Processor -- start 2024-09-17T03:12:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.393+0000 7fe4d0e31f40 1 -- start start 2024-09-17T03:12:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4d0e31f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aceec26d90 0x55aceecedc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4d0e31f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55aceecfde00 0x55aceec6cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4d0e31f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aceecff080 0x55aceec6d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4d0e31f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55aceec709b0 con 0x55aceec26d90 2024-09-17T03:12:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4d0e31f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55aceec55680 con 0x55aceecff080 2024-09-17T03:12:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4d0e31f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55aceed95410 con 0x55aceecfde00 2024-09-17T03:12:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4ca8eb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aceec26d90 0x55aceecedc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4ca8eb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aceec26d90 0x55aceecedc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52078/0 (socket says 172.21.15.78:52078) 2024-09-17T03:12:05.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4ca8eb640 1 -- 172.21.15.78:0/2779175946 learned_addr learned my addr 172.21.15.78:0/2779175946 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4c20ea640 1 --2- 172.21.15.78:0/2779175946 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55aceecfde00 0x55aceec6cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4cb0ec640 1 --2- 172.21.15.78:0/2779175946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aceecff080 0x55aceec6d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4ca8eb640 1 -- 172.21.15.78:0/2779175946 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55aceecfde00 msgr2=0x55aceec6cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4ca8eb640 1 --2- 172.21.15.78:0/2779175946 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55aceecfde00 0x55aceec6cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4ca8eb640 1 -- 172.21.15.78:0/2779175946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aceecff080 msgr2=0x55aceec6d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4ca8eb640 1 --2- 172.21.15.78:0/2779175946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aceecff080 0x55aceec6d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4ca8eb640 1 -- 172.21.15.78:0/2779175946 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aceecf25e0 con 0x55aceec26d90 2024-09-17T03:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4cb0ec640 1 --2- 172.21.15.78:0/2779175946 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55aceecff080 0x55aceec6d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4ca8eb640 1 --2- 172.21.15.78:0/2779175946 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aceec26d90 0x55aceecedc50 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc025e50 tx=0x7fe4bc04d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4c88e7640 1 -- 172.21.15.78:0/2779175946 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc06f030 con 0x55aceec26d90 2024-09-17T03:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4c88e7640 1 -- 172.21.15.78:0/2779175946 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4bc057730 con 0x55aceec26d90 2024-09-17T03:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4d0e31f40 1 -- 172.21.15.78:0/2779175946 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aceec57160 con 0x55aceec26d90 2024-09-17T03:12:05.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.394+0000 7fe4c88e7640 1 -- 172.21.15.78:0/2779175946 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc067040 con 0x55aceec26d90 2024-09-17T03:12:05.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.395+0000 7fe4d0e31f40 1 -- 172.21.15.78:0/2779175946 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aceec57720 con 0x55aceec26d90 2024-09-17T03:12:05.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.396+0000 7fe4c88e7640 1 -- 172.21.15.78:0/2779175946 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe4bc072070 con 0x55aceec26d90 2024-09-17T03:12:05.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.396+0000 7fe4c88e7640 1 --2- 172.21.15.78:0/2779175946 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe4ac0775a0 0x7fe4ac079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.397+0000 7fe4c88e7640 1 -- 172.21.15.78:0/2779175946 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fe4bc0de530 con 0x55aceec26d90 2024-09-17T03:12:05.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.397+0000 7fe4c20ea640 1 --2- 172.21.15.78:0/2779175946 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe4ac0775a0 0x7fe4ac079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.397+0000 7fe4d0e31f40 1 --2- 172.21.15.78:0/2779175946 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x55aceecf5620 0x55aceeda07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.397+0000 7fe4d0e31f40 1 -- 172.21.15.78:0/2779175946 --> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] -- osd_op(unknown.0.0:1 8.1d 8:bbf5850a:::10000000007.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58) -- 0x55aceecf6550 con 0x55aceecf5620 2024-09-17T03:12:05.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.397+0000 7fe4cb0ec640 1 --2- 172.21.15.78:0/2779175946 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x55aceecf5620 0x55aceeda07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.397+0000 7fe4c20ea640 1 --2- 172.21.15.78:0/2779175946 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe4ac0775a0 0x7fe4ac079ab0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55aceecf6420 tx=0x7fe4b4003830 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.397+0000 7fe4cb0ec640 1 --2- 172.21.15.78:0/2779175946 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x55aceecf5620 0x55aceeda07e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.398+0000 7fe4cb0ec640 1 -- 172.21.15.78:0/2779175946 <== osd.0 v2:172.21.15.78:6816/3825297687 1 ==== osd_op_reply(1 10000000007.00000000 [rmxattr] v58'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fe4c400b040 con 0x55aceecf5620 2024-09-17T03:12:05.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.399+0000 7fe4d0e31f40 1 -- 172.21.15.78:0/2779175946 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x55aceecf5620 msgr2=0x55aceeda07e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.399+0000 7fe4d0e31f40 1 --2- 172.21.15.78:0/2779175946 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x55aceecf5620 0x55aceeda07e0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.399+0000 7fe4d0e31f40 1 -- 172.21.15.78:0/2779175946 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe4ac0775a0 msgr2=0x7fe4ac079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.399+0000 7fe4d0e31f40 1 --2- 172.21.15.78:0/2779175946 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe4ac0775a0 0x7fe4ac079ab0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x55aceecf6420 tx=0x7fe4b4003830 comp rx=0 tx=0).stop 2024-09-17T03:12:05.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.399+0000 7fe4d0e31f40 1 -- 172.21.15.78:0/2779175946 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aceec26d90 msgr2=0x55aceecedc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.399+0000 7fe4d0e31f40 1 --2- 172.21.15.78:0/2779175946 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55aceec26d90 0x55aceecedc50 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc025e50 tx=0x7fe4bc04d9c0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.399+0000 7fe4cb0ec640 1 -- 172.21.15.78:0/2779175946 reap_dead start 2024-09-17T03:12:05.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.399+0000 7fe4d0e31f40 1 -- 172.21.15.78:0/2779175946 shutdown_connections 2024-09-17T03:12:05.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.399+0000 7fe4d0e31f40 1 -- 172.21.15.78:0/2779175946 >> 172.21.15.78:0/2779175946 conn(0x55aceeb48ac0 msgr2=0x55aceecf6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.399+0000 7fe4d0e31f40 1 -- 172.21.15.78:0/2779175946 shutdown_connections 2024-09-17T03:12:05.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.399+0000 7fe4d0e31f40 1 -- 172.21.15.78:0/2779175946 wait complete. 2024-09-17T03:12:05.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:12:05.401 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start /d1/d2/d3 recursive,force 2024-09-17T03:12:05.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.518+0000 7fc482827640 1 -- 172.21.15.78:0/2302770920 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc47c0b96c0 msgr2=0x7fc47c0d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.518+0000 7fc482827640 1 --2- 172.21.15.78:0/2302770920 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc47c0b96c0 0x7fc47c0d23f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc474005fd0 tx=0x7fc47402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.519+0000 7fc482827640 1 -- 172.21.15.78:0/2302770920 shutdown_connections 2024-09-17T03:12:05.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.519+0000 7fc482827640 1 --2- 172.21.15.78:0/2302770920 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc47c0b96c0 0x7fc47c0d23f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.519+0000 7fc482827640 1 --2- 172.21.15.78:0/2302770920 >> v2:172.21.15.193:3300/0 conn(0x7fc47c0cfa70 0x7fc47c06e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.519+0000 7fc482827640 1 -- 172.21.15.78:0/2302770920 >> 172.21.15.78:0/2302770920 conn(0x7fc47c09d8a0 msgr2=0x7fc47c08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.519+0000 7fc482827640 1 -- 172.21.15.78:0/2302770920 shutdown_connections 2024-09-17T03:12:05.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.519+0000 7fc482827640 1 -- 172.21.15.78:0/2302770920 wait complete. 2024-09-17T03:12:05.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.520+0000 7fc482827640 1 Processor -- start 2024-09-17T03:12:05.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.521+0000 7fc482827640 1 -- start start 2024-09-17T03:12:05.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.522+0000 7fc482827640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc47c0b96c0 0x7fc47c1f6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.522+0000 7fc482827640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc47c0d18f0 0x7fc47c0ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.522+0000 7fc482827640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc47c1f2c60 0x7fc47c1f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.522+0000 7fc482827640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c0d2e60 con 0x7fc47c0b96c0 2024-09-17T03:12:05.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.522+0000 7fc482827640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c0d2ce0 con 0x7fc47c0d18f0 2024-09-17T03:12:05.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.522+0000 7fc482827640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc47c0d2fe0 con 0x7fc47c1f2c60 2024-09-17T03:12:05.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.522+0000 7fc47bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc47c0b96c0 0x7fc47c1f6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.522+0000 7fc47bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc47c0b96c0 0x7fc47c1f6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52092/0 (socket says 172.21.15.78:52092) 2024-09-17T03:12:05.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.522+0000 7fc47bfff640 1 -- 172.21.15.78:0/3562065123 learned_addr learned my addr 172.21.15.78:0/3562065123 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.522+0000 7fc47b7fe640 1 --2- 172.21.15.78:0/3562065123 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc47c0d18f0 0x7fc47c0ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.522+0000 7fc480dc4640 1 --2- 172.21.15.78:0/3562065123 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc47c1f2c60 0x7fc47c1f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.522+0000 7fc47bfff640 1 -- 172.21.15.78:0/3562065123 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc47c1f2c60 msgr2=0x7fc47c1f5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.522+0000 7fc47bfff640 1 --2- 172.21.15.78:0/3562065123 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc47c1f2c60 0x7fc47c1f5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.522+0000 7fc47bfff640 1 -- 172.21.15.78:0/3562065123 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc47c0d18f0 msgr2=0x7fc47c0ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.522+0000 7fc47bfff640 1 --2- 172.21.15.78:0/3562065123 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc47c0d18f0 0x7fc47c0ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.522+0000 7fc47bfff640 1 -- 172.21.15.78:0/3562065123 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc47c1f9260 con 0x7fc47c0b96c0 2024-09-17T03:12:05.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.522+0000 7fc47bfff640 1 --2- 172.21.15.78:0/3562065123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc47c0b96c0 0x7fc47c1f6730 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc46c00c410 tx=0x7fc46c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.523+0000 7fc478ff9640 1 -- 172.21.15.78:0/3562065123 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c011790 con 0x7fc47c0b96c0 2024-09-17T03:12:05.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.523+0000 7fc478ff9640 1 -- 172.21.15.78:0/3562065123 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc46c017070 con 0x7fc47c0b96c0 2024-09-17T03:12:05.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.523+0000 7fc482827640 1 -- 172.21.15.78:0/3562065123 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc47c1f9540 con 0x7fc47c0b96c0 2024-09-17T03:12:05.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.523+0000 7fc478ff9640 1 -- 172.21.15.78:0/3562065123 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c011ce0 con 0x7fc47c0b96c0 2024-09-17T03:12:05.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.523+0000 7fc482827640 1 -- 172.21.15.78:0/3562065123 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc47c1f6d70 con 0x7fc47c0b96c0 2024-09-17T03:12:05.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.524+0000 7fc478ff9640 1 -- 172.21.15.78:0/3562065123 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc46c01c460 con 0x7fc47c0b96c0 2024-09-17T03:12:05.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.525+0000 7fc478ff9640 1 --2- 172.21.15.78:0/3562065123 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc45c078bc0 0x7fc45c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.525+0000 7fc478ff9640 1 -- 172.21.15.78:0/3562065123 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fc46c09a8b0 con 0x7fc47c0b96c0 2024-09-17T03:12:05.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.525+0000 7fc47b7fe640 1 --2- 172.21.15.78:0/3562065123 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc45c078bc0 0x7fc45c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.526+0000 7fc47b7fe640 1 --2- 172.21.15.78:0/3562065123 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc45c078bc0 0x7fc45c07b0d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc47c0762a0 tx=0x7fc464005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.526+0000 7fc48986b740 1 Processor -- start 2024-09-17T03:12:05.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.526+0000 7fc48986b740 1 -- start start 2024-09-17T03:12:05.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.527+0000 7fc48986b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e3d14680 0x55a7e4103540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.527+0000 7fc48986b740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e3ceb7c0 0x55a7e40e6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.527+0000 7fc48986b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3cf39a0 0x55a7e40e6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.527+0000 7fc48986b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a7e402f0b0 con 0x55a7e3cf39a0 2024-09-17T03:12:05.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.527+0000 7fc48986b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a7e401e4e0 con 0x55a7e3d14680 2024-09-17T03:12:05.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.527+0000 7fc48986b740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a7e40222f0 con 0x55a7e3ceb7c0 2024-09-17T03:12:05.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.527+0000 7fc480dc4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3cf39a0 0x55a7e40e6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.527+0000 7fc480dc4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3cf39a0 0x55a7e40e6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52100/0 (socket says 172.21.15.78:52100) 2024-09-17T03:12:05.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.527+0000 7fc480dc4640 1 -- 172.21.15.78:0/535723331 learned_addr learned my addr 172.21.15.78:0/535723331 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.527+0000 7fc47b7fe640 1 --2- 172.21.15.78:0/535723331 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e3ceb7c0 0x55a7e40e6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.527+0000 7fc47bfff640 1 --2- 172.21.15.78:0/535723331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e3d14680 0x55a7e4103540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.527+0000 7fc480dc4640 1 -- 172.21.15.78:0/535723331 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e3ceb7c0 msgr2=0x55a7e40e6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.527+0000 7fc480dc4640 1 --2- 172.21.15.78:0/535723331 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e3ceb7c0 0x55a7e40e6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.527+0000 7fc480dc4640 1 -- 172.21.15.78:0/535723331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e3d14680 msgr2=0x55a7e4103540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.527+0000 7fc480dc4640 1 --2- 172.21.15.78:0/535723331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e3d14680 0x55a7e4103540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.527+0000 7fc480dc4640 1 -- 172.21.15.78:0/535723331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7e3df4a50 con 0x55a7e3cf39a0 2024-09-17T03:12:05.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.528+0000 7fc480dc4640 1 --2- 172.21.15.78:0/535723331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3cf39a0 0x55a7e40e6750 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc474009ca0 tx=0x7fc474004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84be6ffdd25d6b7b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.528+0000 7fc471ffb640 1 -- 172.21.15.78:0/535723331 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc474003cf0 con 0x55a7e3cf39a0 2024-09-17T03:12:05.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.528+0000 7fc471ffb640 1 -- 172.21.15.78:0/535723331 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc474004040 con 0x55a7e3cf39a0 2024-09-17T03:12:05.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.528+0000 7fc471ffb640 1 -- 172.21.15.78:0/535723331 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc474004470 con 0x55a7e3cf39a0 2024-09-17T03:12:05.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.529+0000 7fc48986b740 1 -- 172.21.15.78:0/535723331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3cf39a0 msgr2=0x55a7e40e6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.529+0000 7fc48986b740 1 --2- 172.21.15.78:0/535723331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3cf39a0 0x55a7e40e6750 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc474009ca0 tx=0x7fc474004a40 comp rx=0 tx=0).stop 2024-09-17T03:12:05.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.529+0000 7fc48986b740 1 -- 172.21.15.78:0/535723331 shutdown_connections 2024-09-17T03:12:05.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.529+0000 7fc48986b740 1 --2- 172.21.15.78:0/535723331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3cf39a0 0x55a7e40e6750 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.529+0000 7fc48986b740 1 --2- 172.21.15.78:0/535723331 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e3ceb7c0 0x55a7e40e6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.529+0000 7fc48986b740 1 --2- 172.21.15.78:0/535723331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e3d14680 0x55a7e4103540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.529+0000 7fc48986b740 1 -- 172.21.15.78:0/535723331 >> 172.21.15.78:0/535723331 conn(0x55a7e3d087d0 msgr2=0x55a7e40bc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.529+0000 7fc48986b740 1 -- 172.21.15.78:0/535723331 shutdown_connections 2024-09-17T03:12:05.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.529+0000 7fc48986b740 1 -- 172.21.15.78:0/535723331 wait complete. 2024-09-17T03:12:05.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.530+0000 7fc48986b740 1 -- start start 2024-09-17T03:12:05.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.530+0000 7fc48986b740 1 Processor -- start 2024-09-17T03:12:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.531+0000 7fc48986b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e3ceb7c0 0x55a7e40f74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.531+0000 7fc48986b740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e3cf39a0 0x55a7e4113a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.531+0000 7fc48986b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3d14680 0x55a7e40bb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.531+0000 7fc48986b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a7e3d8ea30 con 0x55a7e3d14680 2024-09-17T03:12:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.531+0000 7fc48986b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a7e3fa49d0 con 0x55a7e3ceb7c0 2024-09-17T03:12:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.531+0000 7fc48986b740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a7e40fdf90 con 0x55a7e3cf39a0 2024-09-17T03:12:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.531+0000 7fc48986b740 10 client.0 _ll_register_callbacks cb 0x55a7e4018ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:12:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.531+0000 7fc480dc4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3d14680 0x55a7e40bb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.531+0000 7fc480dc4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3d14680 0x55a7e40bb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52112/0 (socket says 172.21.15.78:52112) 2024-09-17T03:12:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.531+0000 7fc480dc4640 1 -- 172.21.15.78:0/4031925664 learned_addr learned my addr 172.21.15.78:0/4031925664 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.531+0000 7fc47b7fe640 1 --2- 172.21.15.78:0/4031925664 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e3cf39a0 0x55a7e4113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.531+0000 7fc47bfff640 1 --2- 172.21.15.78:0/4031925664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e3ceb7c0 0x55a7e40f74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc480dc4640 1 -- 172.21.15.78:0/4031925664 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e3cf39a0 msgr2=0x55a7e4113a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc480dc4640 1 --2- 172.21.15.78:0/4031925664 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e3cf39a0 0x55a7e4113a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc480dc4640 1 -- 172.21.15.78:0/4031925664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e3ceb7c0 msgr2=0x55a7e40f74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc480dc4640 1 --2- 172.21.15.78:0/4031925664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e3ceb7c0 0x55a7e40f74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc480dc4640 1 -- 172.21.15.78:0/4031925664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7e3d5d990 con 0x55a7e3d14680 2024-09-17T03:12:05.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc480dc4640 1 --2- 172.21.15.78:0/4031925664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3d14680 0x55a7e40bb9c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc474009420 tx=0x7fc474003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393f1f17d92902f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc45affd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:12:05.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc45affd640 1 -- 172.21.15.78:0/4031925664 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc474004680 con 0x55a7e3d14680 2024-09-17T03:12:05.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc45affd640 1 -- 172.21.15.78:0/4031925664 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fc474045440 con 0x55a7e3d14680 2024-09-17T03:12:05.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc48986b740 1 -- 172.21.15.78:0/4031925664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc474004040 con 0x55a7e3d14680 2024-09-17T03:12:05.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc45affd640 1 -- 172.21.15.78:0/4031925664 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fc474004820 con 0x55a7e3d14680 2024-09-17T03:12:05.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc48986b740 10 client.6615 fetch_fsmap learned FSMap version 52 2024-09-17T03:12:05.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc48986b740 1 -- 172.21.15.78:0/4031925664 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x55a7e3e551e0 con 0x55a7e3d14680 2024-09-17T03:12:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc45affd640 1 -- 172.21.15.78:0/4031925664 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc474004040 con 0x55a7e3d14680 2024-09-17T03:12:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc45affd640 1 -- 172.21.15.78:0/4031925664 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 52) ==== 3554+0+0 (secure 0 0 0) 0x7fc474057030 con 0x55a7e3d14680 2024-09-17T03:12:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc48986b740 10 client.6615 fetch_fsmap finished waiting for FSMap version 52 2024-09-17T03:12:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc48986b740 10 client.6615 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T03:12:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc48986b740 20 client.6615 populate_metadata read hostname 'smithi078' 2024-09-17T03:12:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc48986b740 1 --2- 172.21.15.78:0/4031925664 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x55a7e3cd3250 0x55a7e40f7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc48986b740 4 client.6615 mds_command: new command op to 6231 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:12:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.532+0000 7fc48986b740 1 -- 172.21.15.78:0/4031925664 --> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7e4031000 con 0x55a7e3cd3250 2024-09-17T03:12:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.533+0000 7fc47bfff640 1 --2- 172.21.15.78:0/4031925664 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x55a7e3cd3250 0x55a7e40f7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.533+0000 7fc45affd640 10 client.6615 ms_handle_connect on v2:172.21.15.78:6832/936871583 2024-09-17T03:12:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.533+0000 7fc47bfff640 1 --2- 172.21.15.78:0/4031925664 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x55a7e3cd3250 0x55a7e40f7b20 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1227cd301d813426 server_cookie=911b2d2c59fb34c0 in_seq=0 out_seq=0 2024-09-17T03:12:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.534+0000 7fc45affd640 1 -- 172.21.15.78:0/4031925664 <== mds.0 v2:172.21.15.78:6832/936871583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a7e4031000 con 0x55a7e3cd3250 2024-09-17T03:12:05.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.534+0000 7fc45affd640 10 client.6615 handle_command_reply: tid=0 2024-09-17T03:12:05.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.534+0000 7fc48986b740 1 client.6615 shutdown 2024-09-17T03:12:05.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.534+0000 7fc48986b740 1 -- 172.21.15.78:0/4031925664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3d14680 msgr2=0x55a7e40bb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.534+0000 7fc48986b740 1 --2- 172.21.15.78:0/4031925664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3d14680 0x55a7e40bb9c0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc474009420 tx=0x7fc474003e00 comp rx=0 tx=0).stop 2024-09-17T03:12:05.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.534+0000 7fc48986b740 1 -- 172.21.15.78:0/4031925664 shutdown_connections 2024-09-17T03:12:05.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.534+0000 7fc48986b740 1 --2- 172.21.15.78:0/4031925664 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x55a7e3cd3250 0x55a7e40f7b20 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.534+0000 7fc48986b740 1 --2- 172.21.15.78:0/4031925664 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3d14680 0x55a7e40bb9c0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.534+0000 7fc45affd640 0 client.6615 ms_handle_reset on v2:172.21.15.78:6832/936871583 2024-09-17T03:12:05.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.534+0000 7fc48986b740 1 --2- 172.21.15.78:0/4031925664 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e3cf39a0 0x55a7e4113a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.534+0000 7fc48986b740 1 --2- 172.21.15.78:0/4031925664 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e3ceb7c0 0x55a7e40f74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.534+0000 7fc48986b740 1 -- 172.21.15.78:0/4031925664 >> 172.21.15.78:0/4031925664 conn(0x55a7e3d087d0 msgr2=0x55a7e40e2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.534+0000 7fc48986b740 1 -- 172.21.15.78:0/4031925664 shutdown_connections 2024-09-17T03:12:05.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.534+0000 7fc48986b740 1 -- 172.21.15.78:0/4031925664 wait complete. 2024-09-17T03:12:05.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.534+0000 7fc48986b740 20 client.6615 trim_cache size 0 max 16384 2024-09-17T03:12:05.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.552+0000 7fc48986b740 1 Processor -- start 2024-09-17T03:12:05.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.552+0000 7fc48986b740 1 -- start start 2024-09-17T03:12:05.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.553+0000 7fc48986b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3ceb7c0 0x55a7e40f9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.553+0000 7fc48986b740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e3cf39a0 0x55a7e40e5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.553+0000 7fc48986b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e3d14680 0x55a7e40e61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.553+0000 7fc48986b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c201f00 con 0x55a7e3ceb7c0 2024-09-17T03:12:05.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.553+0000 7fc48986b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c201130 con 0x55a7e3d14680 2024-09-17T03:12:05.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.553+0000 7fc48986b740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc47c2017d0 con 0x55a7e3cf39a0 2024-09-17T03:12:05.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.553+0000 7fc47bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3ceb7c0 0x55a7e40f9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.553+0000 7fc47bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3ceb7c0 0x55a7e40f9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52116/0 (socket says 172.21.15.78:52116) 2024-09-17T03:12:05.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.553+0000 7fc47bfff640 1 -- 172.21.15.78:0/2890254051 learned_addr learned my addr 172.21.15.78:0/2890254051 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.553+0000 7fc47bfff640 1 -- 172.21.15.78:0/2890254051 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e3cf39a0 msgr2=0x55a7e40e5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.553+0000 7fc47bfff640 1 --2- 172.21.15.78:0/2890254051 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e3cf39a0 0x55a7e40e5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.553+0000 7fc47bfff640 1 -- 172.21.15.78:0/2890254051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e3d14680 msgr2=0x55a7e40e61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.553+0000 7fc47bfff640 1 --2- 172.21.15.78:0/2890254051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e3d14680 0x55a7e40e61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.553+0000 7fc47bfff640 1 -- 172.21.15.78:0/2890254051 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7e3df2d50 con 0x55a7e3ceb7c0 2024-09-17T03:12:05.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.553+0000 7fc47bfff640 1 --2- 172.21.15.78:0/2890254051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3ceb7c0 0x55a7e40f9ae0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc46c007fd0 tx=0x7fc46c067130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f048a6c2a53c10 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.554+0000 7fc4717fa640 1 -- 172.21.15.78:0/2890254051 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c06c0d0 con 0x55a7e3ceb7c0 2024-09-17T03:12:05.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.554+0000 7fc4717fa640 1 -- 172.21.15.78:0/2890254051 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc46c05ea60 con 0x55a7e3ceb7c0 2024-09-17T03:12:05.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.554+0000 7fc4717fa640 1 -- 172.21.15.78:0/2890254051 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc46c07cd40 con 0x55a7e3ceb7c0 2024-09-17T03:12:05.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.554+0000 7fc48986b740 1 -- 172.21.15.78:0/2890254051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3ceb7c0 msgr2=0x55a7e40f9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.554+0000 7fc48986b740 1 --2- 172.21.15.78:0/2890254051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3ceb7c0 0x55a7e40f9ae0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc46c007fd0 tx=0x7fc46c067130 comp rx=0 tx=0).stop 2024-09-17T03:12:05.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.554+0000 7fc48986b740 1 -- 172.21.15.78:0/2890254051 shutdown_connections 2024-09-17T03:12:05.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.554+0000 7fc48986b740 1 --2- 172.21.15.78:0/2890254051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e3d14680 0x55a7e40e61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.554+0000 7fc48986b740 1 --2- 172.21.15.78:0/2890254051 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e3cf39a0 0x55a7e40e5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.554+0000 7fc48986b740 1 --2- 172.21.15.78:0/2890254051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3ceb7c0 0x55a7e40f9ae0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.554+0000 7fc48986b740 1 -- 172.21.15.78:0/2890254051 >> 172.21.15.78:0/2890254051 conn(0x55a7e3d087d0 msgr2=0x55a7e40f7120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.554+0000 7fc48986b740 1 -- 172.21.15.78:0/2890254051 shutdown_connections 2024-09-17T03:12:05.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.554+0000 7fc48986b740 1 -- 172.21.15.78:0/2890254051 wait complete. 2024-09-17T03:12:05.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.555+0000 7fc48986b740 1 -- start start 2024-09-17T03:12:05.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.555+0000 7fc48986b740 1 Processor -- start 2024-09-17T03:12:05.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.557+0000 7fc48986b740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e3ceb7c0 0x55a7e41236e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.557+0000 7fc48986b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e3cf39a0 0x55a7e40f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.557+0000 7fc48986b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3d14680 0x55a7e41807b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.557+0000 7fc48986b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc47c06cde0 con 0x55a7e3d14680 2024-09-17T03:12:05.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.557+0000 7fc48986b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a7e40d57d0 con 0x55a7e3cf39a0 2024-09-17T03:12:05.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.557+0000 7fc48986b740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a7e40fd790 con 0x55a7e3ceb7c0 2024-09-17T03:12:05.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.557+0000 7fc48986b740 10 client.0 _ll_register_callbacks cb 0x7fc474009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:12:05.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.557+0000 7fc480dc4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3d14680 0x55a7e41807b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.557+0000 7fc480dc4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3d14680 0x55a7e41807b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52128/0 (socket says 172.21.15.78:52128) 2024-09-17T03:12:05.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.557+0000 7fc480dc4640 1 -- 172.21.15.78:0/2356380478 learned_addr learned my addr 172.21.15.78:0/2356380478 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.557+0000 7fc47bfff640 1 --2- 172.21.15.78:0/2356380478 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e3ceb7c0 0x55a7e41236e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.557+0000 7fc47b7fe640 1 --2- 172.21.15.78:0/2356380478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e3cf39a0 0x55a7e40f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.557+0000 7fc480dc4640 1 -- 172.21.15.78:0/2356380478 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e3ceb7c0 msgr2=0x55a7e41236e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.557+0000 7fc480dc4640 1 --2- 172.21.15.78:0/2356380478 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e3ceb7c0 0x55a7e41236e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.557+0000 7fc480dc4640 1 -- 172.21.15.78:0/2356380478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e3cf39a0 msgr2=0x55a7e40f86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.557+0000 7fc480dc4640 1 --2- 172.21.15.78:0/2356380478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e3cf39a0 0x55a7e40f86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.557+0000 7fc480dc4640 1 -- 172.21.15.78:0/2356380478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7e4112140 con 0x55a7e3d14680 2024-09-17T03:12:05.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.557+0000 7fc480dc4640 1 --2- 172.21.15.78:0/2356380478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3d14680 0x55a7e41807b0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc47402ae60 tx=0x7fc474003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcea751c15b7454e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.557+0000 7fc45affd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:12:05.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.557+0000 7fc45affd640 1 -- 172.21.15.78:0/2356380478 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc474045440 con 0x55a7e3d14680 2024-09-17T03:12:05.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.558+0000 7fc45affd640 1 -- 172.21.15.78:0/2356380478 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fc474045690 con 0x55a7e3d14680 2024-09-17T03:12:05.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.558+0000 7fc48986b740 1 -- 172.21.15.78:0/2356380478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc46c05ea60 con 0x55a7e3d14680 2024-09-17T03:12:05.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.558+0000 7fc45affd640 1 -- 172.21.15.78:0/2356380478 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fc474066050 con 0x55a7e3d14680 2024-09-17T03:12:05.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.558+0000 7fc48986b740 10 client.6621 fetch_fsmap learned FSMap version 52 2024-09-17T03:12:05.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.558+0000 7fc48986b740 1 -- 172.21.15.78:0/2356380478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x55a7e40b5bb0 con 0x55a7e3d14680 2024-09-17T03:12:05.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.558+0000 7fc45affd640 1 -- 172.21.15.78:0/2356380478 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc46c05ea60 con 0x55a7e3d14680 2024-09-17T03:12:05.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.558+0000 7fc45affd640 1 -- 172.21.15.78:0/2356380478 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 52) ==== 3554+0+0 (secure 0 0 0) 0x7fc474069020 con 0x55a7e3d14680 2024-09-17T03:12:05.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.558+0000 7fc48986b740 10 client.6621 fetch_fsmap finished waiting for FSMap version 52 2024-09-17T03:12:05.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.558+0000 7fc48986b740 10 client.6621 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T03:12:05.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.558+0000 7fc48986b740 20 client.6621 populate_metadata read hostname 'smithi078' 2024-09-17T03:12:05.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.558+0000 7fc48986b740 1 --2- 172.21.15.78:0/2356380478 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x55a7e40fca00 0x55a7e40fce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.558+0000 7fc48986b740 4 client.6621 mds_command: new command op to 6231 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}] 2024-09-17T03:12:05.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.558+0000 7fc48986b740 1 -- 172.21.15.78:0/2356380478 --> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}) -- 0x55a7e402cab0 con 0x55a7e40fca00 2024-09-17T03:12:05.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.558+0000 7fc47bfff640 1 --2- 172.21.15.78:0/2356380478 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x55a7e40fca00 0x55a7e40fce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.558+0000 7fc45affd640 10 client.6621 ms_handle_connect on v2:172.21.15.78:6832/936871583 2024-09-17T03:12:05.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.559+0000 7fc47bfff640 1 --2- 172.21.15.78:0/2356380478 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x55a7e40fca00 0x55a7e40fce10 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=893aa400ace201f3 server_cookie=bd5a285c5eb9cfa8 in_seq=0 out_seq=0 2024-09-17T03:12:05.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.559+0000 7fc45affd640 1 -- 172.21.15.78:0/2356380478 <== mds.0 v2:172.21.15.78:6832/936871583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a7e402cab0 con 0x55a7e40fca00 2024-09-17T03:12:05.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.559+0000 7fc45affd640 10 client.6621 handle_command_reply: tid=0 2024-09-17T03:12:05.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.559+0000 7fc48986b740 1 client.6621 shutdown 2024-09-17T03:12:05.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.559+0000 7fc48986b740 1 -- 172.21.15.78:0/2356380478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3d14680 msgr2=0x55a7e41807b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.559+0000 7fc48986b740 1 --2- 172.21.15.78:0/2356380478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3d14680 0x55a7e41807b0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc47402ae60 tx=0x7fc474003970 comp rx=0 tx=0).stop 2024-09-17T03:12:05.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.559+0000 7fc48986b740 1 -- 172.21.15.78:0/2356380478 shutdown_connections 2024-09-17T03:12:05.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.559+0000 7fc48986b740 1 --2- 172.21.15.78:0/2356380478 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x55a7e40fca00 0x55a7e40fce10 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.559+0000 7fc48986b740 1 --2- 172.21.15.78:0/2356380478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a7e3d14680 0x55a7e41807b0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.559+0000 7fc48986b740 1 --2- 172.21.15.78:0/2356380478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a7e3cf39a0 0x55a7e40f86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.559+0000 7fc48986b740 1 --2- 172.21.15.78:0/2356380478 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a7e3ceb7c0 0x55a7e41236e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.559+0000 7fc48986b740 1 -- 172.21.15.78:0/2356380478 >> 172.21.15.78:0/2356380478 conn(0x55a7e3d087d0 msgr2=0x55a7e40f7120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.559+0000 7fc45affd640 0 client.6621 ms_handle_reset on v2:172.21.15.78:6832/936871583 2024-09-17T03:12:05.564 INFO:tasks.ceph.mds.c.smithi078.stderr:2024-09-17T03:12:05.559+0000 7f215ff81640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-17T03:11:48.040920+0000 1=0+1) n(v3 rc2024-09-17T03:11:48.273916+0000 6=0+6) (inest mix) (ifile excl) caps={5893=pAsLsXsFsx/pAsLsXsFsxcral@4},l=5893 | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=1 dirtyparent=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x56143e3ef080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v21>,<0x1/d1 v20>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:11:48.040920+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:11:48.273916+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-17T03:11:48.040920+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-17T03:11:48.273916+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-17T03:12:05.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.560+0000 7fc48986b740 1 -- 172.21.15.78:0/2356380478 shutdown_connections 2024-09-17T03:12:05.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.560+0000 7fc48986b740 1 -- 172.21.15.78:0/2356380478 wait complete. 2024-09-17T03:12:05.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.560+0000 7fc48986b740 20 client.6621 trim_cache size 0 max 16384 2024-09-17T03:12:05.565 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:12:05.565 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-17T03:12:05.565 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "5c59e2b2-bb55-4c4c-b8b3-079558dc59a7", 2024-09-17T03:12:05.565 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-17T03:12:05.565 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:12:05.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.560+0000 7fc482827640 1 -- 172.21.15.78:0/3562065123 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc45c078bc0 msgr2=0x7fc45c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.560+0000 7fc482827640 1 --2- 172.21.15.78:0/3562065123 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc45c078bc0 0x7fc45c07b0d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc47c0762a0 tx=0x7fc464005f90 comp rx=0 tx=0).stop 2024-09-17T03:12:05.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.560+0000 7fc482827640 1 -- 172.21.15.78:0/3562065123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc47c0b96c0 msgr2=0x7fc47c1f6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.560+0000 7fc482827640 1 --2- 172.21.15.78:0/3562065123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc47c0b96c0 0x7fc47c1f6730 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc46c00c410 tx=0x7fc46c00c8d0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.560+0000 7fc482827640 1 -- 172.21.15.78:0/3562065123 shutdown_connections 2024-09-17T03:12:05.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.560+0000 7fc482827640 1 --2- 172.21.15.78:0/3562065123 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc47c1f2c60 0x7fc47c1f5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.560+0000 7fc482827640 1 --2- 172.21.15.78:0/3562065123 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc45c078bc0 0x7fc45c07b0d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.560+0000 7fc482827640 1 --2- 172.21.15.78:0/3562065123 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc47c0d18f0 0x7fc47c0ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.560+0000 7fc482827640 1 --2- 172.21.15.78:0/3562065123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc47c0b96c0 0x7fc47c1f6730 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.560+0000 7fc482827640 1 -- 172.21.15.78:0/3562065123 >> 172.21.15.78:0/3562065123 conn(0x7fc47c09d8a0 msgr2=0x7fc47c0cf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.567 INFO:tasks.ceph.mds.a.smithi078.stderr:2024-09-17T03:12:05.561+0000 7f16cdaf6640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-17T03:11:48.043919+0000 1=0+1) n(v0 rc2024-09-17T03:11:48.043919+0000 2=0+2) (inest lock) (ifile excl) caps={5893=pAsLsXsFsx/pAsLsXsFsxcral@4},l=5893 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x557886dea000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v10>,<0x10000000003/d5 v14>,<0x10000000002/d4 v17>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v20>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:11:48.043919+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:11:48.043919+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-17T03:11:48.043919+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-17T03:11:48.043919+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-17T03:12:05.568 INFO:tasks.ceph.mds.b.smithi193.stderr:2024-09-17T03:12:05.559+0000 7efea2c16640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v14 ap=1 f(v0 m2024-09-17T03:11:48.041919+0000 1=0+1) n(v2 rc2024-09-17T03:11:48.273916+0000 4=0+4) (inest lock) (ifile excl) caps={5893=pAsLsXsFsx/pAsLsXsFsxcral@4},l=5893 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x5651c07f6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000004:[<0x10000000003/d5 v14>,<0x10000000002/d4 v17>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v20>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:11:48.041919+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:11:48.273916+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-17T03:11:48.041919+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-17T03:11:48.273916+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-17T03:12:05.568 INFO:tasks.ceph.mds.b.smithi193.stderr:2024-09-17T03:12:05.561+0000 7efea9423640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v10 ap=2 f(v0 m2024-09-17T03:11:48.042919+0000 1=0+1) n(v1 rc2024-09-17T03:11:48.273916+0000 3=0+3) (inest sync->mix g=0,2 scatter_wanted) caps={5893=pAsLsXsFs/pAsLsXsFsxcral@7} | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x5651c07f6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000005:[<0x10000000004/d6 v10>,<0x10000000003/d5 v14>,<0x10000000002/d4 v17>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v20>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:11:48.042919+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:11:48.043919+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-17T03:11:48.042919+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-17T03:11:48.273916+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-17T03:12:05.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.561+0000 7fc482827640 1 -- 172.21.15.78:0/3562065123 shutdown_connections 2024-09-17T03:12:05.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.561+0000 7fc482827640 1 -- 172.21.15.78:0/3562065123 wait complete. 2024-09-17T03:12:05.568 INFO:tasks.ceph.mds.a.smithi078.stderr:2024-09-17T03:12:05.561+0000 7f16cdaf6640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) caps={5893=pAsLsXsFsx/AsLsXsFsx@2},l=5893 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x557886dea580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v10>,<0x10000000003/d5 v14>,<0x10000000002/d4 v17>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v20>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-17T03:12:05.569 INFO:tasks.ceph.mds.c.smithi078.stderr:2024-09-17T03:12:05.561+0000 7f216678e640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v17 ap=2 f(v0 m2024-09-17T03:11:48.041919+0000 1=0+1) n(v3 rc2024-09-17T03:11:48.273916+0000 5=0+5) (inest sync->mix g=1,2) caps={5893=pAsLsXsFs/pAsLsXsFsxcral@8} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x56143e3eeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000003:[<0x10000000002/d4 v17>,<0x10000000001/d3 v19>,<0x10000000000/d2 v21>,<0x1/d1 v20>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:11:48.041919+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:11:48.273916+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-17T03:11:48.041919+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-17T03:11:48.273916+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-17T03:12:05.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:12:05.571 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-09-17T03:12:05.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.686+0000 7f3abb09b640 1 -- 172.21.15.78:0/3386278866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ab40ca800 msgr2=0x7f3ab40cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.686+0000 7f3abb09b640 1 --2- 172.21.15.78:0/3386278866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ab40ca800 0x7f3ab40cba00 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0005fd0 tx=0x7f3ab002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.686+0000 7f3abb09b640 1 -- 172.21.15.78:0/3386278866 shutdown_connections 2024-09-17T03:12:05.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.686+0000 7f3abb09b640 1 --2- 172.21.15.78:0/3386278866 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3ab40706b0 0x7f3ab40735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.686+0000 7f3abb09b640 1 --2- 172.21.15.78:0/3386278866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ab40ca800 0x7f3ab40cba00 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.686+0000 7f3abb09b640 1 -- 172.21.15.78:0/3386278866 >> 172.21.15.78:0/3386278866 conn(0x7f3ab40b1cb0 msgr2=0x7f3ab40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.686+0000 7f3abb09b640 1 -- 172.21.15.78:0/3386278866 shutdown_connections 2024-09-17T03:12:05.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.686+0000 7f3abb09b640 1 -- 172.21.15.78:0/3386278866 wait complete. 2024-09-17T03:12:05.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.687+0000 7f3abb09b640 1 Processor -- start 2024-09-17T03:12:05.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.688+0000 7f3abb09b640 1 -- start start 2024-09-17T03:12:05.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.689+0000 7f3abb09b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ab40ca800 0x7f3ab41f2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.689+0000 7f3abb09b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ab40cad30 0x7f3ab40c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.689+0000 7f3abb09b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3ab40c4540 0x7f3ab41f69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.689+0000 7f3abb09b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab4073f00 con 0x7f3ab40ca800 2024-09-17T03:12:05.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.689+0000 7f3abb09b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab4073d80 con 0x7f3ab40cad30 2024-09-17T03:12:05.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.689+0000 7f3abb09b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3ab4074080 con 0x7f3ab40c4540 2024-09-17T03:12:05.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.689+0000 7f3ab8e37640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ab40ca800 0x7f3ab41f2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.689+0000 7f3ab8e37640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ab40ca800 0x7f3ab41f2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52152/0 (socket says 172.21.15.78:52152) 2024-09-17T03:12:05.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.689+0000 7f3ab8e37640 1 -- 172.21.15.78:0/589491153 learned_addr learned my addr 172.21.15.78:0/589491153 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.689+0000 7f3ab8e37640 1 -- 172.21.15.78:0/589491153 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3ab40c4540 msgr2=0x7f3ab41f69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.689+0000 7f3ab8e37640 1 --2- 172.21.15.78:0/589491153 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3ab40c4540 0x7f3ab41f69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.689+0000 7f3ab8e37640 1 -- 172.21.15.78:0/589491153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ab40cad30 msgr2=0x7f3ab40c6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.689+0000 7f3ab8e37640 1 --2- 172.21.15.78:0/589491153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ab40cad30 0x7f3ab40c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.689+0000 7f3ab8e37640 1 -- 172.21.15.78:0/589491153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab40ca000 con 0x7f3ab40ca800 2024-09-17T03:12:05.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.690+0000 7f3ab8e37640 1 --2- 172.21.15.78:0/589491153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ab40ca800 0x7f3ab41f2c90 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0034040 tx=0x7f3ab00035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.690+0000 7f3aa97fa640 1 -- 172.21.15.78:0/589491153 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab003e030 con 0x7f3ab40ca800 2024-09-17T03:12:05.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.690+0000 7f3aa97fa640 1 -- 172.21.15.78:0/589491153 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ab0003ae0 con 0x7f3ab40ca800 2024-09-17T03:12:05.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.690+0000 7f3abb09b640 1 -- 172.21.15.78:0/589491153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab40ca2e0 con 0x7f3ab40ca800 2024-09-17T03:12:05.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.690+0000 7f3aa97fa640 1 -- 172.21.15.78:0/589491153 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0035040 con 0x7f3ab40ca800 2024-09-17T03:12:05.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.690+0000 7f3abb09b640 1 -- 172.21.15.78:0/589491153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab40c6b90 con 0x7f3ab40ca800 2024-09-17T03:12:05.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.691+0000 7f3aa97fa640 1 -- 172.21.15.78:0/589491153 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ab0041030 con 0x7f3ab40ca800 2024-09-17T03:12:05.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.692+0000 7f3aa97fa640 1 --2- 172.21.15.78:0/589491153 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3aa0078b90 0x7f3aa007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.692+0000 7f3aa97fa640 1 -- 172.21.15.78:0/589491153 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f3ab00bb280 con 0x7f3ab40ca800 2024-09-17T03:12:05.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.692+0000 7f3aabfff640 1 --2- 172.21.15.78:0/589491153 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3aa0078b90 0x7f3aa007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.693+0000 7f3aabfff640 1 --2- 172.21.15.78:0/589491153 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3aa0078b90 0x7f3aa007b0a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4007fd0 tx=0x7f3aa4007940 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.693+0000 7f3ac2010740 1 Processor -- start 2024-09-17T03:12:05.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.693+0000 7f3ac2010740 1 -- start start 2024-09-17T03:12:05.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.694+0000 7f3ac2010740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a06fa4390 0x555a07364110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.694+0000 7f3ac2010740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f7b4d0 0x555a07372610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.694+0000 7f3ac2010740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06f836b0 0x555a07372b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.694+0000 7f3ac2010740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x555a072bea60 con 0x555a06f7b4d0 2024-09-17T03:12:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.694+0000 7f3ac2010740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555a072ade90 con 0x555a06fa4390 2024-09-17T03:12:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.694+0000 7f3ac2010740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x555a072b1ca0 con 0x555a06f836b0 2024-09-17T03:12:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.694+0000 7f3aabfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f7b4d0 0x555a07372610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.694+0000 7f3aabfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f7b4d0 0x555a07372610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52160/0 (socket says 172.21.15.78:52160) 2024-09-17T03:12:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.694+0000 7f3aabfff640 1 -- 172.21.15.78:0/810053531 learned_addr learned my addr 172.21.15.78:0/810053531 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.694+0000 7f3ab8e37640 1 --2- 172.21.15.78:0/810053531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a06fa4390 0x555a07364110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.694+0000 7f3ab9638640 1 --2- 172.21.15.78:0/810053531 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06f836b0 0x555a07372b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.694+0000 7f3aabfff640 1 -- 172.21.15.78:0/810053531 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06f836b0 msgr2=0x555a07372b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.694+0000 7f3aabfff640 1 --2- 172.21.15.78:0/810053531 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06f836b0 0x555a07372b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.694+0000 7f3aabfff640 1 -- 172.21.15.78:0/810053531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a06fa4390 msgr2=0x555a07364110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.694+0000 7f3aabfff640 1 --2- 172.21.15.78:0/810053531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a06fa4390 0x555a07364110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.694+0000 7f3aabfff640 1 -- 172.21.15.78:0/810053531 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a070867d0 con 0x555a06f7b4d0 2024-09-17T03:12:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.694+0000 7f3ab9638640 1 --2- 172.21.15.78:0/810053531 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06f836b0 0x555a07372b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:12:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.695+0000 7f3aabfff640 1 --2- 172.21.15.78:0/810053531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f7b4d0 0x555a07372610 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3aa40168c0 tx=0x7f3aa400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90bb8740cc6dbbcb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.695+0000 7f3a9a7fc640 1 -- 172.21.15.78:0/810053531 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa40162e0 con 0x555a06f7b4d0 2024-09-17T03:12:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.695+0000 7f3a9a7fc640 1 -- 172.21.15.78:0/810053531 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3aa40050d0 con 0x555a06f7b4d0 2024-09-17T03:12:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.695+0000 7f3a9a7fc640 1 -- 172.21.15.78:0/810053531 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa40138b0 con 0x555a06f7b4d0 2024-09-17T03:12:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.695+0000 7f3ac2010740 1 -- 172.21.15.78:0/810053531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f7b4d0 msgr2=0x555a07372610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.695+0000 7f3ac2010740 1 --2- 172.21.15.78:0/810053531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f7b4d0 0x555a07372610 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3aa40168c0 tx=0x7f3aa400f000 comp rx=0 tx=0).stop 2024-09-17T03:12:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.696+0000 7f3ac2010740 1 -- 172.21.15.78:0/810053531 shutdown_connections 2024-09-17T03:12:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.696+0000 7f3ac2010740 1 --2- 172.21.15.78:0/810053531 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06f836b0 0x555a07372b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.696+0000 7f3ac2010740 1 --2- 172.21.15.78:0/810053531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f7b4d0 0x555a07372610 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.696+0000 7f3ac2010740 1 --2- 172.21.15.78:0/810053531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a06fa4390 0x555a07364110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.696+0000 7f3ac2010740 1 -- 172.21.15.78:0/810053531 >> 172.21.15.78:0/810053531 conn(0x555a06f984e0 msgr2=0x555a0734ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.696+0000 7f3ac2010740 1 -- 172.21.15.78:0/810053531 shutdown_connections 2024-09-17T03:12:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.696+0000 7f3ac2010740 1 -- 172.21.15.78:0/810053531 wait complete. 2024-09-17T03:12:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.696+0000 7f3ac2010740 1 -- start start 2024-09-17T03:12:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.697+0000 7f3ac2010740 1 Processor -- start 2024-09-17T03:12:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.698+0000 7f3ac2010740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a06f7b4d0 0x555a073a4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.698+0000 7f3ac2010740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f836b0 0x555a073a8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.698+0000 7f3ac2010740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06fa4390 0x555a07386a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.698+0000 7f3ac2010740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x555a0701e740 con 0x555a06f836b0 2024-09-17T03:12:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.698+0000 7f3ac2010740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555a07253970 con 0x555a06f7b4d0 2024-09-17T03:12:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.698+0000 7f3ac2010740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x555a073895f0 con 0x555a06fa4390 2024-09-17T03:12:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.698+0000 7f3ac2010740 10 client.0 _ll_register_callbacks cb 0x555a07256be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:12:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.698+0000 7f3aabfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f836b0 0x555a073a8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.698+0000 7f3aabfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f836b0 0x555a073a8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52164/0 (socket says 172.21.15.78:52164) 2024-09-17T03:12:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.698+0000 7f3aabfff640 1 -- 172.21.15.78:0/3239377567 learned_addr learned my addr 172.21.15.78:0/3239377567 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.698+0000 7f3ab8e37640 1 --2- 172.21.15.78:0/3239377567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a06f7b4d0 0x555a073a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.698+0000 7f3ab9638640 1 --2- 172.21.15.78:0/3239377567 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06fa4390 0x555a07386a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.698+0000 7f3aabfff640 1 -- 172.21.15.78:0/3239377567 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06fa4390 msgr2=0x555a07386a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.698+0000 7f3aabfff640 1 --2- 172.21.15.78:0/3239377567 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06fa4390 0x555a07386a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.698+0000 7f3aabfff640 1 -- 172.21.15.78:0/3239377567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a06f7b4d0 msgr2=0x555a073a4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.698+0000 7f3aabfff640 1 --2- 172.21.15.78:0/3239377567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a06f7b4d0 0x555a073a4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.698+0000 7f3aabfff640 1 -- 172.21.15.78:0/3239377567 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a0700f970 con 0x555a06f836b0 2024-09-17T03:12:05.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.698+0000 7f3ab9638640 1 --2- 172.21.15.78:0/3239377567 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06fa4390 0x555a07386a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:05.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.699+0000 7f3aabfff640 1 --2- 172.21.15.78:0/3239377567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f836b0 0x555a073a8240 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4004000 tx=0x7f3aa40138b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfdc8409ed846e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.699+0000 7f3a937fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:12:05.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.699+0000 7f3a937fe640 1 -- 172.21.15.78:0/3239377567 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4013c30 con 0x555a06f836b0 2024-09-17T03:12:05.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.699+0000 7f3a937fe640 1 -- 172.21.15.78:0/3239377567 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f3aa4013dd0 con 0x555a06f836b0 2024-09-17T03:12:05.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.699+0000 7f3ac2010740 1 -- 172.21.15.78:0/3239377567 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3aa40050d0 con 0x555a06f836b0 2024-09-17T03:12:05.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.699+0000 7f3a937fe640 1 -- 172.21.15.78:0/3239377567 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f3aa4031050 con 0x555a06f836b0 2024-09-17T03:12:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.699+0000 7f3ac2010740 10 client.6636 fetch_fsmap learned FSMap version 52 2024-09-17T03:12:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.699+0000 7f3ac2010740 1 -- 172.21.15.78:0/3239377567 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x555a06fed6a0 con 0x555a06f836b0 2024-09-17T03:12:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.699+0000 7f3a937fe640 1 -- 172.21.15.78:0/3239377567 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3aa40050d0 con 0x555a06f836b0 2024-09-17T03:12:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.699+0000 7f3a937fe640 1 -- 172.21.15.78:0/3239377567 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 52) ==== 3554+0+0 (secure 0 0 0) 0x7f3aa4007020 con 0x555a06f836b0 2024-09-17T03:12:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.699+0000 7f3ac2010740 10 client.6636 fetch_fsmap finished waiting for FSMap version 52 2024-09-17T03:12:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.699+0000 7f3ac2010740 10 client.6636 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T03:12:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.699+0000 7f3ac2010740 20 client.6636 populate_metadata read hostname 'smithi078' 2024-09-17T03:12:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.699+0000 7f3ac2010740 1 --2- 172.21.15.78:0/3239377567 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x555a06f62f60 0x555a0734b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.699+0000 7f3ac2010740 4 client.6636 mds_command: new command op to 6231 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:12:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.699+0000 7f3ac2010740 1 -- 172.21.15.78:0/3239377567 --> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a072c09b0 con 0x555a06f62f60 2024-09-17T03:12:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.699+0000 7f3ab8e37640 1 --2- 172.21.15.78:0/3239377567 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x555a06f62f60 0x555a0734b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.700+0000 7f3a937fe640 10 client.6636 ms_handle_connect on v2:172.21.15.78:6832/936871583 2024-09-17T03:12:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.700+0000 7f3ab8e37640 1 --2- 172.21.15.78:0/3239377567 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x555a06f62f60 0x555a0734b340 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25a226ccdaba8683 server_cookie=709be4aa5315148a in_seq=0 out_seq=0 2024-09-17T03:12:05.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.700+0000 7f3a937fe640 1 -- 172.21.15.78:0/3239377567 <== mds.0 v2:172.21.15.78:6832/936871583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555a072c09b0 con 0x555a06f62f60 2024-09-17T03:12:05.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.700+0000 7f3a937fe640 10 client.6636 handle_command_reply: tid=0 2024-09-17T03:12:05.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.700+0000 7f3ac2010740 1 client.6636 shutdown 2024-09-17T03:12:05.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.701+0000 7f3ac2010740 1 -- 172.21.15.78:0/3239377567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f836b0 msgr2=0x555a073a8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.701+0000 7f3ac2010740 1 --2- 172.21.15.78:0/3239377567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f836b0 0x555a073a8240 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4004000 tx=0x7f3aa40138b0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.701+0000 7f3ac2010740 1 -- 172.21.15.78:0/3239377567 shutdown_connections 2024-09-17T03:12:05.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.701+0000 7f3ac2010740 1 --2- 172.21.15.78:0/3239377567 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x555a06f62f60 0x555a0734b340 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.701+0000 7f3ac2010740 1 --2- 172.21.15.78:0/3239377567 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06fa4390 0x555a07386a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.701+0000 7f3ac2010740 1 --2- 172.21.15.78:0/3239377567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f836b0 0x555a073a8240 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.701+0000 7f3a937fe640 0 client.6636 ms_handle_reset on v2:172.21.15.78:6832/936871583 2024-09-17T03:12:05.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.701+0000 7f3ac2010740 1 --2- 172.21.15.78:0/3239377567 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a06f7b4d0 0x555a073a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.701+0000 7f3ac2010740 1 -- 172.21.15.78:0/3239377567 >> 172.21.15.78:0/3239377567 conn(0x555a06f984e0 msgr2=0x555a07365950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.701+0000 7f3ac2010740 1 -- 172.21.15.78:0/3239377567 shutdown_connections 2024-09-17T03:12:05.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.701+0000 7f3ac2010740 1 -- 172.21.15.78:0/3239377567 wait complete. 2024-09-17T03:12:05.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.701+0000 7f3ac2010740 20 client.6636 trim_cache size 0 max 16384 2024-09-17T03:12:05.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.719+0000 7f3ac2010740 1 Processor -- start 2024-09-17T03:12:05.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.719+0000 7f3ac2010740 1 -- start start 2024-09-17T03:12:05.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.720+0000 7f3ac2010740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06f7b4d0 0x555a0734ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.720+0000 7f3ac2010740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f836b0 0x555a0734b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.720+0000 7f3ac2010740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a06fa4390 0x555a073b8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.720+0000 7f3ac2010740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab409d340 con 0x555a06f836b0 2024-09-17T03:12:05.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.720+0000 7f3ac2010740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab409c510 con 0x555a06fa4390 2024-09-17T03:12:05.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.720+0000 7f3ac2010740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3ab409cc10 con 0x555a06f7b4d0 2024-09-17T03:12:05.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.720+0000 7f3aabfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f836b0 0x555a0734b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.720+0000 7f3aabfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f836b0 0x555a0734b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52178/0 (socket says 172.21.15.78:52178) 2024-09-17T03:12:05.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.720+0000 7f3aabfff640 1 -- 172.21.15.78:0/2008242062 learned_addr learned my addr 172.21.15.78:0/2008242062 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.720+0000 7f3ab9638640 1 --2- 172.21.15.78:0/2008242062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a06fa4390 0x555a073b8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.720+0000 7f3ab8e37640 1 --2- 172.21.15.78:0/2008242062 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06f7b4d0 0x555a0734ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.720+0000 7f3aabfff640 1 -- 172.21.15.78:0/2008242062 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06f7b4d0 msgr2=0x555a0734ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.720+0000 7f3aabfff640 1 --2- 172.21.15.78:0/2008242062 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06f7b4d0 0x555a0734ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.720+0000 7f3aabfff640 1 -- 172.21.15.78:0/2008242062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a06fa4390 msgr2=0x555a073b8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.720+0000 7f3aabfff640 1 --2- 172.21.15.78:0/2008242062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a06fa4390 0x555a073b8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.720+0000 7f3aabfff640 1 -- 172.21.15.78:0/2008242062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a0734cc60 con 0x555a06f836b0 2024-09-17T03:12:05.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.720+0000 7f3aabfff640 1 --2- 172.21.15.78:0/2008242062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f836b0 0x555a0734b220 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4001ea0 tx=0x7f3aa400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2bf70b10216d45 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.721+0000 7f3a99ffb640 1 -- 172.21.15.78:0/2008242062 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4023040 con 0x555a06f836b0 2024-09-17T03:12:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.721+0000 7f3a99ffb640 1 -- 172.21.15.78:0/2008242062 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3aa4005090 con 0x555a06f836b0 2024-09-17T03:12:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.721+0000 7f3a99ffb640 1 -- 172.21.15.78:0/2008242062 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4007570 con 0x555a06f836b0 2024-09-17T03:12:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.721+0000 7f3ac2010740 1 -- 172.21.15.78:0/2008242062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f836b0 msgr2=0x555a0734b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.721+0000 7f3ac2010740 1 --2- 172.21.15.78:0/2008242062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f836b0 0x555a0734b220 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4001ea0 tx=0x7f3aa400f000 comp rx=0 tx=0).stop 2024-09-17T03:12:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.721+0000 7f3ac2010740 1 -- 172.21.15.78:0/2008242062 shutdown_connections 2024-09-17T03:12:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.721+0000 7f3ac2010740 1 --2- 172.21.15.78:0/2008242062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a06fa4390 0x555a073b8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.721+0000 7f3ac2010740 1 --2- 172.21.15.78:0/2008242062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f836b0 0x555a0734b220 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.721+0000 7f3ac2010740 1 --2- 172.21.15.78:0/2008242062 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06f7b4d0 0x555a0734ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.721+0000 7f3ac2010740 1 -- 172.21.15.78:0/2008242062 >> 172.21.15.78:0/2008242062 conn(0x555a06f984e0 msgr2=0x555a07375680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.721+0000 7f3ac2010740 1 -- 172.21.15.78:0/2008242062 shutdown_connections 2024-09-17T03:12:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.721+0000 7f3ac2010740 1 -- 172.21.15.78:0/2008242062 wait complete. 2024-09-17T03:12:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.722+0000 7f3ac2010740 1 -- start start 2024-09-17T03:12:05.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.722+0000 7f3ac2010740 1 Processor -- start 2024-09-17T03:12:05.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3ac2010740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f7b4d0 0x555a07413860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3ac2010740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06f836b0 0x555a07361c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3ac2010740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a06fa4390 0x555a07344cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3ac2010740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x555a07362a10 con 0x555a06f7b4d0 2024-09-17T03:12:05.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3ac2010740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555a073621a0 con 0x555a06fa4390 2024-09-17T03:12:05.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3ac2010740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x555a07345970 con 0x555a06f836b0 2024-09-17T03:12:05.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3ac2010740 10 client.0 _ll_register_callbacks cb 0x7f3aa4016760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:12:05.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3ab8e37640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f7b4d0 0x555a07413860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3ab8e37640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f7b4d0 0x555a07413860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52182/0 (socket says 172.21.15.78:52182) 2024-09-17T03:12:05.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3ab8e37640 1 -- 172.21.15.78:0/1604330648 learned_addr learned my addr 172.21.15.78:0/1604330648 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:05.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3ab9638640 1 --2- 172.21.15.78:0/1604330648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a06fa4390 0x555a07344cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3ab8e37640 1 -- 172.21.15.78:0/1604330648 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06f836b0 msgr2=0x555a07361c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3ab8e37640 1 --2- 172.21.15.78:0/1604330648 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06f836b0 0x555a07361c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3ab8e37640 1 -- 172.21.15.78:0/1604330648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a06fa4390 msgr2=0x555a07344cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:05.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3ab8e37640 1 --2- 172.21.15.78:0/1604330648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a06fa4390 0x555a07344cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3ab8e37640 1 -- 172.21.15.78:0/1604330648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a0735cd90 con 0x555a06f7b4d0 2024-09-17T03:12:05.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3ab8e37640 1 --2- 172.21.15.78:0/1604330648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f7b4d0 0x555a07413860 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00b9720 tx=0x7f3ab0045040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229f827fa1e39e2b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:05.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3a937fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:12:05.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3a937fe640 1 -- 172.21.15.78:0/1604330648 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab009a030 con 0x555a06f7b4d0 2024-09-17T03:12:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3a937fe640 1 -- 172.21.15.78:0/1604330648 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f3ab007f230 con 0x555a06f7b4d0 2024-09-17T03:12:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.724+0000 7f3ac2010740 1 -- 172.21.15.78:0/1604330648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3aa4005090 con 0x555a06f7b4d0 2024-09-17T03:12:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.725+0000 7f3a937fe640 1 -- 172.21.15.78:0/1604330648 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f3ab00a3050 con 0x555a06f7b4d0 2024-09-17T03:12:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.725+0000 7f3ac2010740 10 client.6642 fetch_fsmap learned FSMap version 52 2024-09-17T03:12:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.725+0000 7f3ac2010740 1 -- 172.21.15.78:0/1604330648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) -- 0x555a07390f20 con 0x555a06f7b4d0 2024-09-17T03:12:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.725+0000 7f3a937fe640 1 -- 172.21.15.78:0/1604330648 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3aa4005090 con 0x555a06f7b4d0 2024-09-17T03:12:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.725+0000 7f3a937fe640 1 -- 172.21.15.78:0/1604330648 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 52) ==== 3554+0+0 (secure 0 0 0) 0x7f3ab0085040 con 0x555a06f7b4d0 2024-09-17T03:12:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.725+0000 7f3ac2010740 10 client.6642 fetch_fsmap finished waiting for FSMap version 52 2024-09-17T03:12:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.725+0000 7f3ac2010740 10 client.6642 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T03:12:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.725+0000 7f3ac2010740 20 client.6642 populate_metadata read hostname 'smithi078' 2024-09-17T03:12:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.725+0000 7f3ac2010740 1 --2- 172.21.15.78:0/1604330648 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x555a07345230 0x555a07349460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.725+0000 7f3ac2010740 4 client.6642 mds_command: new command op to 6231 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:12:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.725+0000 7f3ac2010740 1 -- 172.21.15.78:0/1604330648 --> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555a072bc460 con 0x555a07345230 2024-09-17T03:12:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.725+0000 7f3aabfff640 1 --2- 172.21.15.78:0/1604330648 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x555a07345230 0x555a07349460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.725+0000 7f3a937fe640 10 client.6642 ms_handle_connect on v2:172.21.15.78:6832/936871583 2024-09-17T03:12:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.725+0000 7f3aabfff640 1 --2- 172.21.15.78:0/1604330648 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x555a07345230 0x555a07349460 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a57520ef43b888fe server_cookie=9e8a9513be5ac1f3 in_seq=0 out_seq=0 2024-09-17T03:12:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.726+0000 7f3a937fe640 1 -- 172.21.15.78:0/1604330648 <== mds.0 v2:172.21.15.78:6832/936871583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x555a072bc460 con 0x555a07345230 2024-09-17T03:12:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.726+0000 7f3a937fe640 10 client.6642 handle_command_reply: tid=0 2024-09-17T03:12:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.726+0000 7f3ac2010740 1 client.6642 shutdown 2024-09-17T03:12:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.726+0000 7f3ac2010740 1 -- 172.21.15.78:0/1604330648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f7b4d0 msgr2=0x555a07413860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.726+0000 7f3ac2010740 1 --2- 172.21.15.78:0/1604330648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f7b4d0 0x555a07413860 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00b9720 tx=0x7f3ab0045040 comp rx=0 tx=0).stop 2024-09-17T03:12:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.726+0000 7f3ac2010740 1 -- 172.21.15.78:0/1604330648 shutdown_connections 2024-09-17T03:12:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.726+0000 7f3ac2010740 1 --2- 172.21.15.78:0/1604330648 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x555a07345230 0x555a07349460 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.726+0000 7f3ac2010740 1 --2- 172.21.15.78:0/1604330648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a06fa4390 0x555a07344cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.726+0000 7f3ac2010740 1 --2- 172.21.15.78:0/1604330648 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a06f836b0 0x555a07361c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.726+0000 7f3a937fe640 0 client.6642 ms_handle_reset on v2:172.21.15.78:6832/936871583 2024-09-17T03:12:05.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.726+0000 7f3ac2010740 1 --2- 172.21.15.78:0/1604330648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a06f7b4d0 0x555a07413860 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.726+0000 7f3ac2010740 1 -- 172.21.15.78:0/1604330648 >> 172.21.15.78:0/1604330648 conn(0x555a06f984e0 msgr2=0x555a07375680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.726+0000 7f3ac2010740 1 -- 172.21.15.78:0/1604330648 shutdown_connections 2024-09-17T03:12:05.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.726+0000 7f3ac2010740 1 -- 172.21.15.78:0/1604330648 wait complete. 2024-09-17T03:12:05.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.726+0000 7f3ac2010740 20 client.6642 trim_cache size 0 max 16384 2024-09-17T03:12:05.731 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:12:05.731 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T03:12:05.731 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:12:05.731 INFO:teuthology.orchestra.run.smithi078.stdout: "5c59e2b2-bb55-4c4c-b8b3-079558dc59a7": { 2024-09-17T03:12:05.731 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:12:05.732 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "5c59e2b2-bb55-4c4c-b8b3-079558dc59a7", 2024-09-17T03:12:05.732 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:12:05.732 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:05.732 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:05.732 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-17T03:12:05.732 INFO:teuthology.orchestra.run.smithi078.stdout: "5c59e2b2-bb55-4c4c-b8b3-079558dc59a7": { 2024-09-17T03:12:05.732 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-17T03:12:05.559636+0000", 2024-09-17T03:12:05.732 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:12:05.732 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-17T03:12:05.732 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-17T03:12:05.732 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-17T03:12:05.732 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-17T03:12:05.732 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:05.733 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:05.733 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:12:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.726+0000 7f3abb09b640 1 -- 172.21.15.78:0/589491153 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3aa0078b90 msgr2=0x7f3aa007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.726+0000 7f3abb09b640 1 --2- 172.21.15.78:0/589491153 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3aa0078b90 0x7f3aa007b0a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4007fd0 tx=0x7f3aa4007940 comp rx=0 tx=0).stop 2024-09-17T03:12:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.727+0000 7f3abb09b640 1 -- 172.21.15.78:0/589491153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ab40ca800 msgr2=0x7f3ab41f2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.727+0000 7f3abb09b640 1 --2- 172.21.15.78:0/589491153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ab40ca800 0x7f3ab41f2c90 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0034040 tx=0x7f3ab00035f0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.727+0000 7f3abb09b640 1 -- 172.21.15.78:0/589491153 shutdown_connections 2024-09-17T03:12:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.727+0000 7f3abb09b640 1 --2- 172.21.15.78:0/589491153 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3ab40c4540 0x7f3ab41f69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.727+0000 7f3abb09b640 1 --2- 172.21.15.78:0/589491153 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3aa0078b90 0x7f3aa007b0a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.727+0000 7f3abb09b640 1 --2- 172.21.15.78:0/589491153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ab40cad30 0x7f3ab40c6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.727+0000 7f3abb09b640 1 --2- 172.21.15.78:0/589491153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ab40ca800 0x7f3ab41f2c90 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.727+0000 7f3abb09b640 1 -- 172.21.15.78:0/589491153 >> 172.21.15.78:0/589491153 conn(0x7f3ab40b1cb0 msgr2=0x7f3ab415b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.727+0000 7f3abb09b640 1 -- 172.21.15.78:0/589491153 shutdown_connections 2024-09-17T03:12:05.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:05.727+0000 7f3abb09b640 1 -- 172.21.15.78:0/589491153 wait complete. 2024-09-17T03:12:05.736 INFO:tasks.cephfs.filesystem:scrub status for tag:5c59e2b2-bb55-4c4c-b8b3-079558dc59a7 - {'path': '/d1/d2/d3', 'tag': '5c59e2b2-bb55-4c4c-b8b3-079558dc59a7', 'options': 'recursive,force'} 2024-09-17T03:12:08.308 INFO:tasks.ceph.mon.a.smithi078.stderr:2024-09-17T03:12:08.309+0000 7f192d77d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-17T03:12:17.620 INFO:tasks.ceph.mon.a.smithi078.stderr:2024-09-17T03:12:17.621+0000 7f192d77d640 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-17T03:12:25.651 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:12:25.654 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:12:35.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:12:35.737 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-09-17T03:12:35.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.865+0000 7f8d322b2640 1 -- 172.21.15.78:0/814919516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d18004800 msgr2=0x7f8d18004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:35.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.865+0000 7f8d322b2640 1 --2- 172.21.15.78:0/814919516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d18004800 0x7f8d18004c10 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c0b7120 tx=0x7f8d18005830 comp rx=0 tx=0).stop 2024-09-17T03:12:35.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.865+0000 7f8d3084f640 1 -- 172.21.15.78:0/814919516 reap_dead start 2024-09-17T03:12:35.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.865+0000 7f8d322b2640 1 -- 172.21.15.78:0/814919516 shutdown_connections 2024-09-17T03:12:35.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.865+0000 7f8d322b2640 1 -- 172.21.15.78:0/814919516 >> 172.21.15.78:0/814919516 conn(0x7f8d2c08bfc0 msgr2=0x7f8d2c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:35.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.865+0000 7f8d322b2640 1 -- 172.21.15.78:0/814919516 shutdown_connections 2024-09-17T03:12:35.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.865+0000 7f8d322b2640 1 -- 172.21.15.78:0/814919516 wait complete. 2024-09-17T03:12:35.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.867+0000 7f8d322b2640 1 Processor -- start 2024-09-17T03:12:35.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.867+0000 7f8d322b2640 1 -- start start 2024-09-17T03:12:35.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.868+0000 7f8d322b2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d18004800 0x7f8d2c1f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:35.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.868+0000 7f8d322b2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d2c0cde30 0x7f8d2c1f6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:35.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.868+0000 7f8d322b2640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8d2c1f9170 0x7f8d2c1f9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:35.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.868+0000 7f8d322b2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c162860 con 0x7f8d18004800 2024-09-17T03:12:35.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.868+0000 7f8d322b2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c1626e0 con 0x7f8d2c0cde30 2024-09-17T03:12:35.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.868+0000 7f8d322b2640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8d2c1629e0 con 0x7f8d2c1f9170 2024-09-17T03:12:35.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.868+0000 7f8d2bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d18004800 0x7f8d2c1f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:35.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.868+0000 7f8d2bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d18004800 0x7f8d2c1f6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35498/0 (socket says 172.21.15.78:35498) 2024-09-17T03:12:35.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.868+0000 7f8d2bfff640 1 -- 172.21.15.78:0/249367319 learned_addr learned my addr 172.21.15.78:0/249367319 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:35.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.869+0000 7f8d23fff640 1 --2- 172.21.15.78:0/249367319 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d2c0cde30 0x7f8d2c1f6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:35.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.869+0000 7f8d3084f640 1 --2- 172.21.15.78:0/249367319 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8d2c1f9170 0x7f8d2c1f9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:35.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.869+0000 7f8d2bfff640 1 -- 172.21.15.78:0/249367319 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8d2c1f9170 msgr2=0x7f8d2c1f9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:35.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.869+0000 7f8d2bfff640 1 --2- 172.21.15.78:0/249367319 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8d2c1f9170 0x7f8d2c1f9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.869+0000 7f8d2bfff640 1 -- 172.21.15.78:0/249367319 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d2c0cde30 msgr2=0x7f8d2c1f6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:35.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.869+0000 7f8d2bfff640 1 --2- 172.21.15.78:0/249367319 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d2c0cde30 0x7f8d2c1f6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.869+0000 7f8d2bfff640 1 -- 172.21.15.78:0/249367319 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2c1f9ac0 con 0x7f8d18004800 2024-09-17T03:12:35.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.869+0000 7f8d23fff640 1 --2- 172.21.15.78:0/249367319 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d2c0cde30 0x7f8d2c1f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:12:35.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.869+0000 7f8d2bfff640 1 --2- 172.21.15.78:0/249367319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d18004800 0x7f8d2c1f6d40 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00e5f0 tx=0x7f8d1c001950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:35.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.869+0000 7f8d297fa640 1 -- 172.21.15.78:0/249367319 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c015070 con 0x7f8d18004800 2024-09-17T03:12:35.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.869+0000 7f8d297fa640 1 -- 172.21.15.78:0/249367319 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d1c00c9e0 con 0x7f8d18004800 2024-09-17T03:12:35.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.869+0000 7f8d322b2640 1 -- 172.21.15.78:0/249367319 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d2c0c9310 con 0x7f8d18004800 2024-09-17T03:12:35.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.869+0000 7f8d297fa640 1 -- 172.21.15.78:0/249367319 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c00ce10 con 0x7f8d18004800 2024-09-17T03:12:35.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.869+0000 7f8d322b2640 1 -- 172.21.15.78:0/249367319 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d2c0c98d0 con 0x7f8d18004800 2024-09-17T03:12:35.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.872+0000 7f8d297fa640 1 -- 172.21.15.78:0/249367319 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8d1c018070 con 0x7f8d18004800 2024-09-17T03:12:35.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.872+0000 7f8d297fa640 1 --2- 172.21.15.78:0/249367319 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8d0c078b90 0x7f8d0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:35.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.872+0000 7f8d297fa640 1 -- 172.21.15.78:0/249367319 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f8d1c09b1b0 con 0x7f8d18004800 2024-09-17T03:12:35.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.872+0000 7f8d23fff640 1 --2- 172.21.15.78:0/249367319 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8d0c078b90 0x7f8d0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:35.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.873+0000 7f8d3921d740 1 Processor -- start 2024-09-17T03:12:35.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.873+0000 7f8d3921d740 1 -- start start 2024-09-17T03:12:35.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.873+0000 7f8d23fff640 1 --2- 172.21.15.78:0/249367319 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8d0c078b90 0x7f8d0c07b0a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8d14036000 tx=0x7f8d140046c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:35.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.874+0000 7f8d3921d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ec14390 0x557c5f000a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:35.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.874+0000 7f8d3921d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebeb4d0 0x557c5efd5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:35.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.874+0000 7f8d3921d740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebf36b0 0x557c5efd5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:35.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.874+0000 7f8d3921d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557c5ef2ea60 con 0x557c5ebeb4d0 2024-09-17T03:12:35.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.874+0000 7f8d3921d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557c5ef1de90 con 0x557c5ec14390 2024-09-17T03:12:35.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.874+0000 7f8d3921d740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x557c5ef21ca0 con 0x557c5ebf36b0 2024-09-17T03:12:35.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.874+0000 7f8d23fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebeb4d0 0x557c5efd5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:35.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.874+0000 7f8d23fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebeb4d0 0x557c5efd5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35508/0 (socket says 172.21.15.78:35508) 2024-09-17T03:12:35.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.874+0000 7f8d23fff640 1 -- 172.21.15.78:0/2969467319 learned_addr learned my addr 172.21.15.78:0/2969467319 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:35.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.874+0000 7f8d2bfff640 1 --2- 172.21.15.78:0/2969467319 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ec14390 0x557c5f000a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.874+0000 7f8d3084f640 1 --2- 172.21.15.78:0/2969467319 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebf36b0 0x557c5efd5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.874+0000 7f8d23fff640 1 -- 172.21.15.78:0/2969467319 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebf36b0 msgr2=0x557c5efd5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.874+0000 7f8d23fff640 1 --2- 172.21.15.78:0/2969467319 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebf36b0 0x557c5efd5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.874+0000 7f8d23fff640 1 -- 172.21.15.78:0/2969467319 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ec14390 msgr2=0x557c5f000a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.874+0000 7f8d23fff640 1 --2- 172.21.15.78:0/2969467319 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ec14390 0x557c5f000a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.874+0000 7f8d23fff640 1 -- 172.21.15.78:0/2969467319 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c5ecf67d0 con 0x557c5ebeb4d0 2024-09-17T03:12:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.875+0000 7f8d23fff640 1 --2- 172.21.15.78:0/2969467319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebeb4d0 0x557c5efd5860 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f8d1402af40 tx=0x7f8d1403d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12bdf22c9dd51b3d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.875+0000 7f8d21ffb640 1 -- 172.21.15.78:0/2969467319 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14004220 con 0x557c5ebeb4d0 2024-09-17T03:12:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.875+0000 7f8d21ffb640 1 -- 172.21.15.78:0/2969467319 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d14037040 con 0x557c5ebeb4d0 2024-09-17T03:12:35.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.875+0000 7f8d21ffb640 1 -- 172.21.15.78:0/2969467319 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d14003810 con 0x557c5ebeb4d0 2024-09-17T03:12:35.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.876+0000 7f8d3921d740 1 -- 172.21.15.78:0/2969467319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebeb4d0 msgr2=0x557c5efd5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:35.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.876+0000 7f8d3921d740 1 --2- 172.21.15.78:0/2969467319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebeb4d0 0x557c5efd5860 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f8d1402af40 tx=0x7f8d1403d040 comp rx=0 tx=0).stop 2024-09-17T03:12:35.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.876+0000 7f8d3921d740 1 -- 172.21.15.78:0/2969467319 shutdown_connections 2024-09-17T03:12:35.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.876+0000 7f8d3921d740 1 --2- 172.21.15.78:0/2969467319 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebf36b0 0x557c5efd5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.876+0000 7f8d3921d740 1 --2- 172.21.15.78:0/2969467319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebeb4d0 0x557c5efd5860 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.876+0000 7f8d3921d740 1 --2- 172.21.15.78:0/2969467319 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ec14390 0x557c5f000a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.876+0000 7f8d3921d740 1 -- 172.21.15.78:0/2969467319 >> 172.21.15.78:0/2969467319 conn(0x557c5ec084e0 msgr2=0x557c5efbbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:35.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.876+0000 7f8d3921d740 1 -- 172.21.15.78:0/2969467319 shutdown_connections 2024-09-17T03:12:35.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.876+0000 7f8d3921d740 1 -- 172.21.15.78:0/2969467319 wait complete. 2024-09-17T03:12:35.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.877+0000 7f8d3921d740 1 -- start start 2024-09-17T03:12:35.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.877+0000 7f8d3921d740 1 Processor -- start 2024-09-17T03:12:35.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.878+0000 7f8d3921d740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebeb4d0 0x557c5eff6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:35.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.878+0000 7f8d3921d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebf36b0 0x557c5efbb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:35.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.878+0000 7f8d3921d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ec14390 0x557c5efbbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:35.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.878+0000 7f8d3921d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557c5ec8e740 con 0x557c5ebf36b0 2024-09-17T03:12:35.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.878+0000 7f8d3921d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557c5eec3970 con 0x557c5ec14390 2024-09-17T03:12:35.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.878+0000 7f8d3921d740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x557c5eff87c0 con 0x557c5ebeb4d0 2024-09-17T03:12:35.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.878+0000 7f8d3921d740 10 client.0 _ll_register_callbacks cb 0x557c5eed2780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:12:35.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.878+0000 7f8d23fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebf36b0 0x557c5efbb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:35.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.878+0000 7f8d23fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebf36b0 0x557c5efbb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35520/0 (socket says 172.21.15.78:35520) 2024-09-17T03:12:35.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.878+0000 7f8d23fff640 1 -- 172.21.15.78:0/218069124 learned_addr learned my addr 172.21.15.78:0/218069124 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:35.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.879+0000 7f8d3084f640 1 --2- 172.21.15.78:0/218069124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ec14390 0x557c5efbbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:35.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.879+0000 7f8d2bfff640 1 --2- 172.21.15.78:0/218069124 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebeb4d0 0x557c5eff6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.879+0000 7f8d23fff640 1 -- 172.21.15.78:0/218069124 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebeb4d0 msgr2=0x557c5eff6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.879+0000 7f8d23fff640 1 --2- 172.21.15.78:0/218069124 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebeb4d0 0x557c5eff6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.879+0000 7f8d23fff640 1 -- 172.21.15.78:0/218069124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ec14390 msgr2=0x557c5efbbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.879+0000 7f8d23fff640 1 --2- 172.21.15.78:0/218069124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ec14390 0x557c5efbbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.879+0000 7f8d23fff640 1 -- 172.21.15.78:0/218069124 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c5ec7f970 con 0x557c5ebf36b0 2024-09-17T03:12:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.879+0000 7f8d23fff640 1 --2- 172.21.15.78:0/218069124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebf36b0 0x557c5efbb770 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f8d1404d000 tx=0x7f8d14004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c8130de597bb11 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.879+0000 7f8d0affd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:12:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.879+0000 7f8d0affd640 1 -- 172.21.15.78:0/218069124 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d140516c0 con 0x557c5ebf36b0 2024-09-17T03:12:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.879+0000 7f8d0affd640 1 -- 172.21.15.78:0/218069124 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f8d14051860 con 0x557c5ebf36b0 2024-09-17T03:12:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.879+0000 7f8d3921d740 1 -- 172.21.15.78:0/218069124 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d14037040 con 0x557c5ebf36b0 2024-09-17T03:12:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.879+0000 7f8d0affd640 1 -- 172.21.15.78:0/218069124 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f8d14064050 con 0x557c5ebf36b0 2024-09-17T03:12:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.879+0000 7f8d3921d740 10 client.6654 fetch_fsmap learned FSMap version 54 2024-09-17T03:12:35.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.879+0000 7f8d3921d740 1 -- 172.21.15.78:0/218069124 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x557c5ec5d6a0 con 0x557c5ebf36b0 2024-09-17T03:12:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.879+0000 7f8d0affd640 1 -- 172.21.15.78:0/218069124 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d14037040 con 0x557c5ebf36b0 2024-09-17T03:12:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.880+0000 7f8d0affd640 1 -- 172.21.15.78:0/218069124 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 54) ==== 3558+0+0 (secure 0 0 0) 0x7f8d14067020 con 0x557c5ebf36b0 2024-09-17T03:12:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.880+0000 7f8d3921d740 10 client.6654 fetch_fsmap finished waiting for FSMap version 54 2024-09-17T03:12:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.880+0000 7f8d3921d740 10 client.6654 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T03:12:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.880+0000 7f8d3921d740 20 client.6654 populate_metadata read hostname 'smithi078' 2024-09-17T03:12:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.880+0000 7f8d3921d740 1 --2- 172.21.15.78:0/218069124 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x557c5ebd2f60 0x557c5f013a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.880+0000 7f8d3921d740 4 client.6654 mds_command: new command op to 6231 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:12:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.880+0000 7f8d3921d740 1 -- 172.21.15.78:0/218069124 --> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c5ef309b0 con 0x557c5ebd2f60 2024-09-17T03:12:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.880+0000 7f8d2bfff640 1 --2- 172.21.15.78:0/218069124 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x557c5ebd2f60 0x557c5f013a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.880+0000 7f8d0affd640 10 client.6654 ms_handle_connect on v2:172.21.15.78:6832/936871583 2024-09-17T03:12:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.880+0000 7f8d2bfff640 1 --2- 172.21.15.78:0/218069124 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x557c5ebd2f60 0x557c5f013a10 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2329988e73176a69 server_cookie=5b3c1af3212bc912 in_seq=0 out_seq=0 2024-09-17T03:12:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.881+0000 7f8d0affd640 1 -- 172.21.15.78:0/218069124 <== mds.0 v2:172.21.15.78:6832/936871583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557c5ef309b0 con 0x557c5ebd2f60 2024-09-17T03:12:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.881+0000 7f8d0affd640 10 client.6654 handle_command_reply: tid=0 2024-09-17T03:12:35.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.881+0000 7f8d3921d740 1 client.6654 shutdown 2024-09-17T03:12:35.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.881+0000 7f8d3921d740 1 -- 172.21.15.78:0/218069124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebf36b0 msgr2=0x557c5efbb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:35.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.881+0000 7f8d3921d740 1 --2- 172.21.15.78:0/218069124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebf36b0 0x557c5efbb770 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f8d1404d000 tx=0x7f8d14004530 comp rx=0 tx=0).stop 2024-09-17T03:12:35.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.881+0000 7f8d3921d740 1 -- 172.21.15.78:0/218069124 shutdown_connections 2024-09-17T03:12:35.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.881+0000 7f8d3921d740 1 --2- 172.21.15.78:0/218069124 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x557c5ebd2f60 0x557c5f013a10 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.881+0000 7f8d3921d740 1 --2- 172.21.15.78:0/218069124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ec14390 0x557c5efbbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.881+0000 7f8d3921d740 1 --2- 172.21.15.78:0/218069124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebf36b0 0x557c5efbb770 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.881+0000 7f8d0affd640 0 client.6654 ms_handle_reset on v2:172.21.15.78:6832/936871583 2024-09-17T03:12:35.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.881+0000 7f8d3921d740 1 --2- 172.21.15.78:0/218069124 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebeb4d0 0x557c5eff6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.881+0000 7f8d3921d740 1 -- 172.21.15.78:0/218069124 >> 172.21.15.78:0/218069124 conn(0x557c5ec084e0 msgr2=0x557c5efb6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:35.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.881+0000 7f8d3921d740 1 -- 172.21.15.78:0/218069124 shutdown_connections 2024-09-17T03:12:35.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.881+0000 7f8d3921d740 1 -- 172.21.15.78:0/218069124 wait complete. 2024-09-17T03:12:35.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.881+0000 7f8d3921d740 20 client.6654 trim_cache size 0 max 16384 2024-09-17T03:12:35.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.899+0000 7f8d3921d740 1 Processor -- start 2024-09-17T03:12:35.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.900+0000 7f8d3921d740 1 -- start start 2024-09-17T03:12:35.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.901+0000 7f8d3921d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebd2f60 0x557c5efb4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:35.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.901+0000 7f8d3921d740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebeb4d0 0x557c5efb5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:35.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.901+0000 7f8d3921d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ebf36b0 0x557c5f023e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:35.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.901+0000 7f8d3921d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c2027e0 con 0x557c5ebd2f60 2024-09-17T03:12:35.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.901+0000 7f8d3921d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c153a80 con 0x557c5ebf36b0 2024-09-17T03:12:35.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.901+0000 7f8d3921d740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8d2c1541b0 con 0x557c5ebeb4d0 2024-09-17T03:12:35.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.901+0000 7f8d2bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebd2f60 0x557c5efb4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:35.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.901+0000 7f8d2bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebd2f60 0x557c5efb4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35530/0 (socket says 172.21.15.78:35530) 2024-09-17T03:12:35.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.901+0000 7f8d2bfff640 1 -- 172.21.15.78:0/407158636 learned_addr learned my addr 172.21.15.78:0/407158636 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:35.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.901+0000 7f8d3084f640 1 --2- 172.21.15.78:0/407158636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ebf36b0 0x557c5f023e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:35.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.901+0000 7f8d23fff640 1 --2- 172.21.15.78:0/407158636 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebeb4d0 0x557c5efb5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:35.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.901+0000 7f8d2bfff640 1 -- 172.21.15.78:0/407158636 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebeb4d0 msgr2=0x557c5efb5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:35.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.901+0000 7f8d2bfff640 1 --2- 172.21.15.78:0/407158636 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebeb4d0 0x557c5efb5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.901+0000 7f8d2bfff640 1 -- 172.21.15.78:0/407158636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ebf36b0 msgr2=0x557c5f023e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:35.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.901+0000 7f8d2bfff640 1 --2- 172.21.15.78:0/407158636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ebf36b0 0x557c5f023e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.901+0000 7f8d2bfff640 1 -- 172.21.15.78:0/407158636 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c5efb19f0 con 0x557c5ebd2f60 2024-09-17T03:12:35.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.901+0000 7f8d2bfff640 1 --2- 172.21.15.78:0/407158636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebd2f60 0x557c5efb4dd0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c060340 tx=0x7f8d1c067040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6375f1211a7d44ce server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:35.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.902+0000 7f8d217fa640 1 -- 172.21.15.78:0/407158636 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c01f040 con 0x557c5ebd2f60 2024-09-17T03:12:35.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.902+0000 7f8d217fa640 1 -- 172.21.15.78:0/407158636 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d1c06c9d0 con 0x557c5ebd2f60 2024-09-17T03:12:35.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.902+0000 7f8d217fa640 1 -- 172.21.15.78:0/407158636 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c05f340 con 0x557c5ebd2f60 2024-09-17T03:12:35.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.902+0000 7f8d3921d740 1 -- 172.21.15.78:0/407158636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebd2f60 msgr2=0x557c5efb4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:35.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.902+0000 7f8d3921d740 1 --2- 172.21.15.78:0/407158636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebd2f60 0x557c5efb4dd0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c060340 tx=0x7f8d1c067040 comp rx=0 tx=0).stop 2024-09-17T03:12:35.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.902+0000 7f8d3921d740 1 -- 172.21.15.78:0/407158636 shutdown_connections 2024-09-17T03:12:35.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.902+0000 7f8d3921d740 1 --2- 172.21.15.78:0/407158636 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ebf36b0 0x557c5f023e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.902+0000 7f8d3921d740 1 --2- 172.21.15.78:0/407158636 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebeb4d0 0x557c5efb5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.902+0000 7f8d3921d740 1 --2- 172.21.15.78:0/407158636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebd2f60 0x557c5efb4dd0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.902+0000 7f8d3921d740 1 -- 172.21.15.78:0/407158636 >> 172.21.15.78:0/407158636 conn(0x557c5ec084e0 msgr2=0x557c5eff91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:35.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.902+0000 7f8d3921d740 1 -- 172.21.15.78:0/407158636 shutdown_connections 2024-09-17T03:12:35.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.902+0000 7f8d3921d740 1 -- 172.21.15.78:0/407158636 wait complete. 2024-09-17T03:12:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.903+0000 7f8d3921d740 1 -- start start 2024-09-17T03:12:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.904+0000 7f8d3921d740 1 Processor -- start 2024-09-17T03:12:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.905+0000 7f8d3921d740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebd2f60 0x557c5f024790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:35.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.905+0000 7f8d3921d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ebeb4d0 0x557c5eff9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:35.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.905+0000 7f8d3921d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebf36b0 0x557c5eff9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:35.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.905+0000 7f8d3921d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557c5effd520 con 0x557c5ebf36b0 2024-09-17T03:12:35.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.905+0000 7f8d3921d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c0ca330 con 0x557c5ebeb4d0 2024-09-17T03:12:35.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.905+0000 7f8d3921d740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x557c5f000a70 con 0x557c5ebd2f60 2024-09-17T03:12:35.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.905+0000 7f8d3921d740 10 client.0 _ll_register_callbacks cb 0x7f8d240093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:12:35.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.905+0000 7f8d23fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ebeb4d0 0x557c5eff9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:35.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.905+0000 7f8d2bfff640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebd2f60 0x557c5f024790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:35.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.905+0000 7f8d3084f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebf36b0 0x557c5eff9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:35.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.905+0000 7f8d23fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ebeb4d0 0x557c5eff9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.78:35984/0 (socket says 172.21.15.78:35984) 2024-09-17T03:12:35.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.905+0000 7f8d23fff640 1 -- 172.21.15.78:0/3256446494 learned_addr learned my addr 172.21.15.78:0/3256446494 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:35.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.905+0000 7f8d2bfff640 1 -- 172.21.15.78:0/3256446494 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ebeb4d0 msgr2=0x557c5eff9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:35.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.905+0000 7f8d2bfff640 1 --2- 172.21.15.78:0/3256446494 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ebeb4d0 0x557c5eff9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.906+0000 7f8d2bfff640 1 -- 172.21.15.78:0/3256446494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebf36b0 msgr2=0x557c5eff9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:35.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.906+0000 7f8d2bfff640 1 --2- 172.21.15.78:0/3256446494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebf36b0 0x557c5eff9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.906+0000 7f8d2bfff640 1 -- 172.21.15.78:0/3256446494 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x557c5efb5580 con 0x557c5ebd2f60 2024-09-17T03:12:35.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.906+0000 7f8d23fff640 1 --2- 172.21.15.78:0/3256446494 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ebeb4d0 0x557c5eff9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:12:35.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.906+0000 7f8d2bfff640 1 --2- 172.21.15.78:0/3256446494 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebd2f60 0x557c5f024790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00cfd0 tx=0x7f8d1c067c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9c6377aa1b3cce6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:35.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.906+0000 7f8d0affd640 10 client.0 ms_handle_connect on v2:172.21.15.193:3301/0 2024-09-17T03:12:35.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.906+0000 7f8d0affd640 1 -- 172.21.15.78:0/3256446494 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d1c01f040 con 0x557c5ebd2f60 2024-09-17T03:12:35.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.906+0000 7f8d0affd640 1 -- 172.21.15.78:0/3256446494 <== mon.2 v2:172.21.15.193:3301/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f8d1c062330 con 0x557c5ebd2f60 2024-09-17T03:12:35.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.906+0000 7f8d3921d740 1 -- 172.21.15.78:0/3256446494 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d1c06c9d0 con 0x557c5ebd2f60 2024-09-17T03:12:35.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.906+0000 7f8d0affd640 1 -- 172.21.15.78:0/3256446494 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f8d1c0637d0 con 0x557c5ebd2f60 2024-09-17T03:12:35.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.906+0000 7f8d3921d740 10 client.5735 fetch_fsmap learned FSMap version 54 2024-09-17T03:12:35.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.906+0000 7f8d3921d740 1 -- 172.21.15.78:0/3256446494 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x557c5efd5d30 con 0x557c5ebd2f60 2024-09-17T03:12:35.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.906+0000 7f8d0affd640 1 -- 172.21.15.78:0/3256446494 <== mon.2 v2:172.21.15.193:3301/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d1c06c9d0 con 0x557c5ebd2f60 2024-09-17T03:12:35.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.906+0000 7f8d0affd640 1 -- 172.21.15.78:0/3256446494 <== mon.2 v2:172.21.15.193:3301/0 5 ==== fsmap(e 54) ==== 3558+0+0 (secure 0 0 0) 0x7f8d1c099b00 con 0x557c5ebd2f60 2024-09-17T03:12:35.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.907+0000 7f8d3921d740 10 client.5735 fetch_fsmap finished waiting for FSMap version 54 2024-09-17T03:12:35.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.907+0000 7f8d3921d740 10 client.5735 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T03:12:35.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.907+0000 7f8d3921d740 20 client.5735 populate_metadata read hostname 'smithi078' 2024-09-17T03:12:35.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.907+0000 7f8d3921d740 1 --2- 172.21.15.78:0/3256446494 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x557c5eba83a0 0x557c5efffc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:35.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.907+0000 7f8d3921d740 4 client.5735 mds_command: new command op to 6231 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:12:35.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.907+0000 7f8d3921d740 1 -- 172.21.15.78:0/3256446494 --> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557c5ef2c460 con 0x557c5eba83a0 2024-09-17T03:12:35.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.907+0000 7f8d23fff640 1 --2- 172.21.15.78:0/3256446494 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x557c5eba83a0 0x557c5efffc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:35.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.907+0000 7f8d0affd640 10 client.5735 ms_handle_connect on v2:172.21.15.78:6832/936871583 2024-09-17T03:12:35.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.907+0000 7f8d23fff640 1 --2- 172.21.15.78:0/3256446494 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x557c5eba83a0 0x557c5efffc00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da291afb98b4311d server_cookie=d27e4b6d791e3e8e in_seq=0 out_seq=0 2024-09-17T03:12:35.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.907+0000 7f8d0affd640 1 -- 172.21.15.78:0/3256446494 <== mds.0 v2:172.21.15.78:6832/936871583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+382 (crc 0 0 0) 0x557c5ef2c460 con 0x557c5eba83a0 2024-09-17T03:12:35.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.907+0000 7f8d0affd640 10 client.5735 handle_command_reply: tid=0 2024-09-17T03:12:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.907+0000 7f8d3921d740 1 client.5735 shutdown 2024-09-17T03:12:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d3921d740 1 -- 172.21.15.78:0/3256446494 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebd2f60 msgr2=0x557c5f024790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d3921d740 1 --2- 172.21.15.78:0/3256446494 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebd2f60 0x557c5f024790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00cfd0 tx=0x7f8d1c067c60 comp rx=0 tx=0).stop 2024-09-17T03:12:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d3921d740 1 -- 172.21.15.78:0/3256446494 shutdown_connections 2024-09-17T03:12:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d3921d740 1 --2- 172.21.15.78:0/3256446494 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x557c5eba83a0 0x557c5efffc00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d3921d740 1 --2- 172.21.15.78:0/3256446494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557c5ebf36b0 0x557c5eff9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d3921d740 1 --2- 172.21.15.78:0/3256446494 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557c5ebeb4d0 0x557c5eff9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d3921d740 1 --2- 172.21.15.78:0/3256446494 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557c5ebd2f60 0x557c5f024790 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d0affd640 0 client.5735 ms_handle_reset on v2:172.21.15.78:6832/936871583 2024-09-17T03:12:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d3921d740 1 -- 172.21.15.78:0/3256446494 >> 172.21.15.78:0/3256446494 conn(0x557c5ec084e0 msgr2=0x557c5efb4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d3921d740 1 -- 172.21.15.78:0/3256446494 shutdown_connections 2024-09-17T03:12:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d3921d740 1 -- 172.21.15.78:0/3256446494 wait complete. 2024-09-17T03:12:35.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d3921d740 20 client.5735 trim_cache size 0 max 16384 2024-09-17T03:12:35.912 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:12:35.912 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "no active scrubs running", 2024-09-17T03:12:35.912 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": {}, 2024-09-17T03:12:35.912 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-17T03:12:35.912 INFO:teuthology.orchestra.run.smithi078.stdout: "5c59e2b2-bb55-4c4c-b8b3-079558dc59a7": { 2024-09-17T03:12:35.912 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-17T03:12:05.559636+0000", 2024-09-17T03:12:35.912 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:12:35.912 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-17T03:12:35.912 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-17T03:12:35.913 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-17T03:12:35.913 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-17T03:12:35.913 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:35.913 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:35.913 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:12:35.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d322b2640 1 -- 172.21.15.78:0/249367319 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8d0c078b90 msgr2=0x7f8d0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:35.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d322b2640 1 --2- 172.21.15.78:0/249367319 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8d0c078b90 0x7f8d0c07b0a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8d14036000 tx=0x7f8d140046c0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d322b2640 1 -- 172.21.15.78:0/249367319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d18004800 msgr2=0x7f8d2c1f6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:35.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d322b2640 1 --2- 172.21.15.78:0/249367319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d18004800 0x7f8d2c1f6d40 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c00e5f0 tx=0x7f8d1c001950 comp rx=0 tx=0).stop 2024-09-17T03:12:35.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d322b2640 1 -- 172.21.15.78:0/249367319 shutdown_connections 2024-09-17T03:12:35.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d322b2640 1 --2- 172.21.15.78:0/249367319 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8d2c1f9170 0x7f8d2c1f9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d322b2640 1 --2- 172.21.15.78:0/249367319 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8d0c078b90 0x7f8d0c07b0a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d322b2640 1 --2- 172.21.15.78:0/249367319 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d2c0cde30 0x7f8d2c1f6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d322b2640 1 --2- 172.21.15.78:0/249367319 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d18004800 0x7f8d2c1f6d40 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:35.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d322b2640 1 -- 172.21.15.78:0/249367319 >> 172.21.15.78:0/249367319 conn(0x7f8d2c08bfc0 msgr2=0x7f8d2c161c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:35.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.908+0000 7f8d322b2640 1 -- 172.21.15.78:0/249367319 shutdown_connections 2024-09-17T03:12:35.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:35.909+0000 7f8d322b2640 1 -- 172.21.15.78:0/249367319 wait complete. 2024-09-17T03:12:35.919 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:12:35.919 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 damage ls 2024-09-17T03:12:36.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.036+0000 7f42cbe07640 1 -- 172.21.15.78:0/4057029930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42c40cfb00 msgr2=0x7f42c415bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.036+0000 7f42cbe07640 1 --2- 172.21.15.78:0/4057029930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42c40cfb00 0x7f42c415bf20 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f42c40d11c0 tx=0x7f42c002a560 comp rx=0 tx=0).stop 2024-09-17T03:12:36.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.036+0000 7f42cbe07640 1 -- 172.21.15.78:0/4057029930 shutdown_connections 2024-09-17T03:12:36.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.036+0000 7f42cbe07640 1 --2- 172.21.15.78:0/4057029930 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42c40cf160 0x7f42c40ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.036+0000 7f42cbe07640 1 --2- 172.21.15.78:0/4057029930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42c40cfb00 0x7f42c415bf20 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.036+0000 7f42cbe07640 1 -- 172.21.15.78:0/4057029930 >> 172.21.15.78:0/4057029930 conn(0x7f42c40b1cb0 msgr2=0x7f42c40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.036+0000 7f42cbe07640 1 -- 172.21.15.78:0/4057029930 shutdown_connections 2024-09-17T03:12:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.036+0000 7f42cbe07640 1 -- 172.21.15.78:0/4057029930 wait complete. 2024-09-17T03:12:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.038+0000 7f42cbe07640 1 Processor -- start 2024-09-17T03:12:36.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.038+0000 7f42cbe07640 1 -- start start 2024-09-17T03:12:36.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.039+0000 7f42cbe07640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42c40cf160 0x7f42c40afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.039+0000 7f42cbe07640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42c40cf570 0x7f42c40b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.039+0000 7f42cbe07640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42c40cfb00 0x7f42c4167c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.039+0000 7f42cbe07640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f42c40cb270 con 0x7f42c40cf570 2024-09-17T03:12:36.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.039+0000 7f42cbe07640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f42c40cb0f0 con 0x7f42c40cfb00 2024-09-17T03:12:36.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.039+0000 7f42cbe07640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f42c40ccba0 con 0x7f42c40cf160 2024-09-17T03:12:36.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.039+0000 7f42c93a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42c40cf570 0x7f42c40b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.039+0000 7f42c93a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42c40cf570 0x7f42c40b0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35558/0 (socket says 172.21.15.78:35558) 2024-09-17T03:12:36.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.039+0000 7f42c93a2640 1 -- 172.21.15.78:0/3949984902 learned_addr learned my addr 172.21.15.78:0/3949984902 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:36.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.039+0000 7f42c9ba3640 1 --2- 172.21.15.78:0/3949984902 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42c40cf160 0x7f42c40afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.039+0000 7f42c93a2640 1 -- 172.21.15.78:0/3949984902 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42c40cf160 msgr2=0x7f42c40afed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.039+0000 7f42c93a2640 1 --2- 172.21.15.78:0/3949984902 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42c40cf160 0x7f42c40afed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.039+0000 7f42ca3a4640 1 --2- 172.21.15.78:0/3949984902 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42c40cfb00 0x7f42c4167c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.039+0000 7f42c93a2640 1 -- 172.21.15.78:0/3949984902 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42c40cfb00 msgr2=0x7f42c4167c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.039+0000 7f42c93a2640 1 --2- 172.21.15.78:0/3949984902 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42c40cfb00 0x7f42c4167c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.039+0000 7f42c93a2640 1 -- 172.21.15.78:0/3949984902 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c40b1120 con 0x7f42c40cf570 2024-09-17T03:12:36.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.039+0000 7f42c9ba3640 1 --2- 172.21.15.78:0/3949984902 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42c40cf160 0x7f42c40afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:12:36.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.039+0000 7f42ca3a4640 1 --2- 172.21.15.78:0/3949984902 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42c40cfb00 0x7f42c4167c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:12:36.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.040+0000 7f42c93a2640 1 --2- 172.21.15.78:0/3949984902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42c40cf570 0x7f42c40b0410 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f42b400b3f0 tx=0x7f42b400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:36.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.040+0000 7f42ba7fc640 1 -- 172.21.15.78:0/3949984902 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4015020 con 0x7f42c40cf570 2024-09-17T03:12:36.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.040+0000 7f42ba7fc640 1 -- 172.21.15.78:0/3949984902 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42b4011920 con 0x7f42c40cf570 2024-09-17T03:12:36.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.040+0000 7f42ba7fc640 1 -- 172.21.15.78:0/3949984902 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4011d50 con 0x7f42c40cf570 2024-09-17T03:12:36.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.040+0000 7f42cbe07640 1 -- 172.21.15.78:0/3949984902 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c40af9f0 con 0x7f42c40cf570 2024-09-17T03:12:36.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.040+0000 7f42cbe07640 1 -- 172.21.15.78:0/3949984902 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c40b0e40 con 0x7f42c40cf570 2024-09-17T03:12:36.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.042+0000 7f42ba7fc640 1 -- 172.21.15.78:0/3949984902 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f42b4018020 con 0x7f42c40cf570 2024-09-17T03:12:36.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.043+0000 7f42ba7fc640 1 --2- 172.21.15.78:0/3949984902 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42a8078b90 0x7f42a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.043+0000 7f42ba7fc640 1 -- 172.21.15.78:0/3949984902 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f42b409ac40 con 0x7f42c40cf570 2024-09-17T03:12:36.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.043+0000 7f42c9ba3640 1 --2- 172.21.15.78:0/3949984902 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42a8078b90 0x7f42a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.043+0000 7f42d2e4b740 1 Processor -- start 2024-09-17T03:12:36.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.043+0000 7f42d2e4b740 1 -- start start 2024-09-17T03:12:36.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.043+0000 7f42c9ba3640 1 --2- 172.21.15.78:0/3949984902 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42a8078b90 0x7f42a807b0a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f42c0033000 tx=0x7f42c0004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:36.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.045+0000 7f42d2e4b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed7092390 0x560ed74641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.045+0000 7f42d2e4b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed70694d0 0x560ed7464710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.045+0000 7f42d2e4b740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560ed70716b0 0x560ed7481610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.045+0000 7f42d2e4b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x560ed73ac8e0 con 0x560ed7092390 2024-09-17T03:12:36.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.045+0000 7f42d2e4b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560ed739bd10 con 0x560ed70694d0 2024-09-17T03:12:36.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.045+0000 7f42d2e4b740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x560ed739fb20 con 0x560ed70716b0 2024-09-17T03:12:36.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.045+0000 7f42c9ba3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed7092390 0x560ed74641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.045+0000 7f42c9ba3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed7092390 0x560ed74641d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35560/0 (socket says 172.21.15.78:35560) 2024-09-17T03:12:36.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.045+0000 7f42c9ba3640 1 -- 172.21.15.78:0/1061256290 learned_addr learned my addr 172.21.15.78:0/1061256290 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:36.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.045+0000 7f42ca3a4640 1 --2- 172.21.15.78:0/1061256290 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560ed70716b0 0x560ed7481610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.045+0000 7f42c93a2640 1 --2- 172.21.15.78:0/1061256290 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed70694d0 0x560ed7464710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.045+0000 7f42c9ba3640 1 -- 172.21.15.78:0/1061256290 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560ed70716b0 msgr2=0x560ed7481610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.045+0000 7f42c9ba3640 1 --2- 172.21.15.78:0/1061256290 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560ed70716b0 0x560ed7481610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.045+0000 7f42c9ba3640 1 -- 172.21.15.78:0/1061256290 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed70694d0 msgr2=0x560ed7464710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.045+0000 7f42c9ba3640 1 --2- 172.21.15.78:0/1061256290 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed70694d0 0x560ed7464710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.045+0000 7f42c9ba3640 1 -- 172.21.15.78:0/1061256290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ed70fd970 con 0x560ed7092390 2024-09-17T03:12:36.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.045+0000 7f42c9ba3640 1 --2- 172.21.15.78:0/1061256290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed7092390 0x560ed74641d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f42c002ab50 tx=0x7f42c003b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134fdb3772431a01 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:36.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.045+0000 7f42a77fe640 1 -- 172.21.15.78:0/1061256290 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0035050 con 0x560ed7092390 2024-09-17T03:12:36.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.046+0000 7f42a77fe640 1 -- 172.21.15.78:0/1061256290 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42c004c070 con 0x560ed7092390 2024-09-17T03:12:36.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.046+0000 7f42a77fe640 1 -- 172.21.15.78:0/1061256290 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0003da0 con 0x560ed7092390 2024-09-17T03:12:36.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.046+0000 7f42d2e4b740 1 -- 172.21.15.78:0/1061256290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed7092390 msgr2=0x560ed74641d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.046+0000 7f42d2e4b740 1 --2- 172.21.15.78:0/1061256290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed7092390 0x560ed74641d0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f42c002ab50 tx=0x7f42c003b000 comp rx=0 tx=0).stop 2024-09-17T03:12:36.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.046+0000 7f42d2e4b740 1 -- 172.21.15.78:0/1061256290 shutdown_connections 2024-09-17T03:12:36.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.046+0000 7f42d2e4b740 1 --2- 172.21.15.78:0/1061256290 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560ed70716b0 0x560ed7481610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.046+0000 7f42d2e4b740 1 --2- 172.21.15.78:0/1061256290 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed70694d0 0x560ed7464710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.046+0000 7f42d2e4b740 1 --2- 172.21.15.78:0/1061256290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed7092390 0x560ed74641d0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.046+0000 7f42d2e4b740 1 -- 172.21.15.78:0/1061256290 >> 172.21.15.78:0/1061256290 conn(0x560ed70864e0 msgr2=0x560ed743a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:36.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.046+0000 7f42d2e4b740 1 -- 172.21.15.78:0/1061256290 shutdown_connections 2024-09-17T03:12:36.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.046+0000 7f42d2e4b740 1 -- 172.21.15.78:0/1061256290 wait complete. 2024-09-17T03:12:36.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.047+0000 7f42d2e4b740 1 -- start start 2024-09-17T03:12:36.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.047+0000 7f42d2e4b740 1 Processor -- start 2024-09-17T03:12:36.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42d2e4b740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560ed70694d0 0x560ed7474930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42d2e4b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed70716b0 0x560ed748e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42d2e4b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed7092390 0x560ed7434b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42d2e4b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x560ed710c740 con 0x560ed7092390 2024-09-17T03:12:36.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42d2e4b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560ed73417f0 con 0x560ed70716b0 2024-09-17T03:12:36.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42d2e4b740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x560ed7464c50 con 0x560ed70694d0 2024-09-17T03:12:36.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42d2e4b740 10 client.0 _ll_register_callbacks cb 0x560ed73452a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:12:36.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42ca3a4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed7092390 0x560ed7434b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42ca3a4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed7092390 0x560ed7434b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35562/0 (socket says 172.21.15.78:35562) 2024-09-17T03:12:36.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42ca3a4640 1 -- 172.21.15.78:0/3904295677 learned_addr learned my addr 172.21.15.78:0/3904295677 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:36.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42c93a2640 1 --2- 172.21.15.78:0/3904295677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed70716b0 0x560ed748e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42c9ba3640 1 --2- 172.21.15.78:0/3904295677 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560ed70694d0 0x560ed7474930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42ca3a4640 1 -- 172.21.15.78:0/3904295677 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560ed70694d0 msgr2=0x560ed7474930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42ca3a4640 1 --2- 172.21.15.78:0/3904295677 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560ed70694d0 0x560ed7474930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42ca3a4640 1 -- 172.21.15.78:0/3904295677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed70716b0 msgr2=0x560ed748e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42ca3a4640 1 --2- 172.21.15.78:0/3904295677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed70716b0 0x560ed748e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42ca3a4640 1 -- 172.21.15.78:0/3904295677 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ed71747d0 con 0x560ed7092390 2024-09-17T03:12:36.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42c93a2640 1 --2- 172.21.15.78:0/3904295677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed70716b0 0x560ed748e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:36.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42ca3a4640 1 --2- 172.21.15.78:0/3904295677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed7092390 0x560ed7434b20 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00eb30 tx=0x7f42bc00ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4d53799a11909ac server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:36.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:12:36.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42a4ff9640 1 -- 172.21.15.78:0/3904295677 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc00ce30 con 0x560ed7092390 2024-09-17T03:12:36.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42a4ff9640 1 -- 172.21.15.78:0/3904295677 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f42bc010420 con 0x560ed7092390 2024-09-17T03:12:36.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.049+0000 7f42d2e4b740 1 -- 172.21.15.78:0/3904295677 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42c004c070 con 0x560ed7092390 2024-09-17T03:12:36.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.050+0000 7f42a4ff9640 1 -- 172.21.15.78:0/3904295677 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f42bc003970 con 0x560ed7092390 2024-09-17T03:12:36.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.050+0000 7f42d2e4b740 10 client.6672 fetch_fsmap learned FSMap version 54 2024-09-17T03:12:36.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.050+0000 7f42d2e4b740 1 -- 172.21.15.78:0/3904295677 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x560ed748f700 con 0x560ed7092390 2024-09-17T03:12:36.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.050+0000 7f42a4ff9640 1 -- 172.21.15.78:0/3904295677 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42c004c070 con 0x560ed7092390 2024-09-17T03:12:36.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.050+0000 7f42a4ff9640 1 -- 172.21.15.78:0/3904295677 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 54) ==== 3558+0+0 (secure 0 0 0) 0x7f42bc003b10 con 0x560ed7092390 2024-09-17T03:12:36.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.050+0000 7f42d2e4b740 10 client.6672 fetch_fsmap finished waiting for FSMap version 54 2024-09-17T03:12:36.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.050+0000 7f42d2e4b740 10 client.6672 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T03:12:36.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.050+0000 7f42d2e4b740 20 client.6672 populate_metadata read hostname 'smithi078' 2024-09-17T03:12:36.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.050+0000 7f42d2e4b740 1 --2- 172.21.15.78:0/3904295677 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x560ed7050f60 0x560ed7491640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.050+0000 7f42d2e4b740 4 client.6672 mds_command: new command op to 6231 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:12:36.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.050+0000 7f42d2e4b740 1 -- 172.21.15.78:0/3904295677 --> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ed73ae830 con 0x560ed7050f60 2024-09-17T03:12:36.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.050+0000 7f42c9ba3640 1 --2- 172.21.15.78:0/3904295677 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x560ed7050f60 0x560ed7491640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.050+0000 7f42a4ff9640 10 client.6672 ms_handle_connect on v2:172.21.15.78:6832/936871583 2024-09-17T03:12:36.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.050+0000 7f42c9ba3640 1 --2- 172.21.15.78:0/3904295677 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x560ed7050f60 0x560ed7491640 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99a0d211b3ffa0a server_cookie=85a5276fa4edc95c in_seq=0 out_seq=0 2024-09-17T03:12:36.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.051+0000 7f42a4ff9640 1 -- 172.21.15.78:0/3904295677 <== mds.0 v2:172.21.15.78:6832/936871583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560ed73ae830 con 0x560ed7050f60 2024-09-17T03:12:36.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.051+0000 7f42a4ff9640 10 client.6672 handle_command_reply: tid=0 2024-09-17T03:12:36.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.051+0000 7f42d2e4b740 1 client.6672 shutdown 2024-09-17T03:12:36.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.051+0000 7f42d2e4b740 1 -- 172.21.15.78:0/3904295677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed7092390 msgr2=0x560ed7434b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.051+0000 7f42d2e4b740 1 --2- 172.21.15.78:0/3904295677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed7092390 0x560ed7434b20 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f42bc00eb30 tx=0x7f42bc00ef30 comp rx=0 tx=0).stop 2024-09-17T03:12:36.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.051+0000 7f42d2e4b740 1 -- 172.21.15.78:0/3904295677 shutdown_connections 2024-09-17T03:12:36.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.051+0000 7f42d2e4b740 1 --2- 172.21.15.78:0/3904295677 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x560ed7050f60 0x560ed7491640 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.051+0000 7f42d2e4b740 1 --2- 172.21.15.78:0/3904295677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed7092390 0x560ed7434b20 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.051+0000 7f42a4ff9640 0 client.6672 ms_handle_reset on v2:172.21.15.78:6832/936871583 2024-09-17T03:12:36.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.051+0000 7f42d2e4b740 1 --2- 172.21.15.78:0/3904295677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed70716b0 0x560ed748e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.051+0000 7f42d2e4b740 1 --2- 172.21.15.78:0/3904295677 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560ed70694d0 0x560ed7474930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.051+0000 7f42d2e4b740 1 -- 172.21.15.78:0/3904295677 >> 172.21.15.78:0/3904295677 conn(0x560ed70864e0 msgr2=0x560ed7480be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:36.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.051+0000 7f42d2e4b740 1 -- 172.21.15.78:0/3904295677 shutdown_connections 2024-09-17T03:12:36.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.051+0000 7f42d2e4b740 1 -- 172.21.15.78:0/3904295677 wait complete. 2024-09-17T03:12:36.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.052+0000 7f42d2e4b740 20 client.6672 trim_cache size 0 max 16384 2024-09-17T03:12:36.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.065+0000 7f42d2e4b740 1 Processor -- start 2024-09-17T03:12:36.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.065+0000 7f42d2e4b740 1 -- start start 2024-09-17T03:12:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.066+0000 7f42d2e4b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed70694d0 0x560ed74f4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.066+0000 7f42d2e4b740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560ed70716b0 0x560ed748fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.066+0000 7f42d2e4b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed7092390 0x560ed7490140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.066+0000 7f42d2e4b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f42c42023d0 con 0x560ed70694d0 2024-09-17T03:12:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.066+0000 7f42d2e4b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f42c4201590 con 0x560ed7092390 2024-09-17T03:12:36.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.066+0000 7f42d2e4b740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f42c4201ca0 con 0x560ed70716b0 2024-09-17T03:12:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.066+0000 7f42c9ba3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed70694d0 0x560ed74f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.066+0000 7f42c9ba3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed70694d0 0x560ed74f4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35570/0 (socket says 172.21.15.78:35570) 2024-09-17T03:12:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.066+0000 7f42c9ba3640 1 -- 172.21.15.78:0/1401451779 learned_addr learned my addr 172.21.15.78:0/1401451779 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.067+0000 7f42ca3a4640 1 --2- 172.21.15.78:0/1401451779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed7092390 0x560ed7490140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.067+0000 7f42c9ba3640 1 -- 172.21.15.78:0/1401451779 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560ed70716b0 msgr2=0x560ed748fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.067+0000 7f42c9ba3640 1 --2- 172.21.15.78:0/1401451779 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560ed70716b0 0x560ed748fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.067+0000 7f42c9ba3640 1 -- 172.21.15.78:0/1401451779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed7092390 msgr2=0x560ed7490140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.067+0000 7f42c9ba3640 1 --2- 172.21.15.78:0/1401451779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed7092390 0x560ed7490140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.067+0000 7f42c9ba3640 1 -- 172.21.15.78:0/1401451779 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ed748e6f0 con 0x560ed70694d0 2024-09-17T03:12:36.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.067+0000 7f42ca3a4640 1 --2- 172.21.15.78:0/1401451779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed7092390 0x560ed7490140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:12:36.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.067+0000 7f42c9ba3640 1 --2- 172.21.15.78:0/1401451779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed70694d0 0x560ed74f4690 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f42c002ab50 tx=0x7f42c003e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6bffa6070d9a94 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:36.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.067+0000 7f42a6ffd640 1 -- 172.21.15.78:0/1401451779 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0035040 con 0x560ed70694d0 2024-09-17T03:12:36.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.067+0000 7f42a6ffd640 1 -- 172.21.15.78:0/1401451779 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42c004c070 con 0x560ed70694d0 2024-09-17T03:12:36.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.067+0000 7f42a6ffd640 1 -- 172.21.15.78:0/1401451779 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c00049e0 con 0x560ed70694d0 2024-09-17T03:12:36.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.068+0000 7f42d2e4b740 1 -- 172.21.15.78:0/1401451779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed70694d0 msgr2=0x560ed74f4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.068+0000 7f42d2e4b740 1 --2- 172.21.15.78:0/1401451779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed70694d0 0x560ed74f4690 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f42c002ab50 tx=0x7f42c003e000 comp rx=0 tx=0).stop 2024-09-17T03:12:36.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.068+0000 7f42d2e4b740 1 -- 172.21.15.78:0/1401451779 shutdown_connections 2024-09-17T03:12:36.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.068+0000 7f42d2e4b740 1 --2- 172.21.15.78:0/1401451779 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed7092390 0x560ed7490140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.068+0000 7f42d2e4b740 1 --2- 172.21.15.78:0/1401451779 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560ed70716b0 0x560ed748fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.068+0000 7f42d2e4b740 1 --2- 172.21.15.78:0/1401451779 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed70694d0 0x560ed74f4690 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.068+0000 7f42d2e4b740 1 -- 172.21.15.78:0/1401451779 >> 172.21.15.78:0/1401451779 conn(0x560ed70864e0 msgr2=0x560ed743b500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:36.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.068+0000 7f42d2e4b740 1 -- 172.21.15.78:0/1401451779 shutdown_connections 2024-09-17T03:12:36.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.068+0000 7f42d2e4b740 1 -- 172.21.15.78:0/1401451779 wait complete. 2024-09-17T03:12:36.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.069+0000 7f42d2e4b740 1 -- start start 2024-09-17T03:12:36.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.069+0000 7f42d2e4b740 1 Processor -- start 2024-09-17T03:12:36.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.070+0000 7f42d2e4b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed70694d0 0x560ed74a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.070+0000 7f42d2e4b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed70716b0 0x560ed74a1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.070+0000 7f42d2e4b740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560ed7092390 0x560ed7452140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.070+0000 7f42d2e4b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x560ed74a23e0 con 0x560ed70694d0 2024-09-17T03:12:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.070+0000 7f42d2e4b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f42c41f9140 con 0x560ed70716b0 2024-09-17T03:12:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.070+0000 7f42d2e4b740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x560ed7498120 con 0x560ed7092390 2024-09-17T03:12:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.070+0000 7f42d2e4b740 10 client.0 _ll_register_callbacks cb 0x7f42bc007700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:12:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.070+0000 7f42c9ba3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed70694d0 0x560ed74a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.070+0000 7f42c9ba3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed70694d0 0x560ed74a0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35584/0 (socket says 172.21.15.78:35584) 2024-09-17T03:12:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.070+0000 7f42c9ba3640 1 -- 172.21.15.78:0/2601997720 learned_addr learned my addr 172.21.15.78:0/2601997720 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.070+0000 7f42ca3a4640 1 --2- 172.21.15.78:0/2601997720 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560ed7092390 0x560ed7452140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.070+0000 7f42c9ba3640 1 -- 172.21.15.78:0/2601997720 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560ed7092390 msgr2=0x560ed7452140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.070+0000 7f42c9ba3640 1 --2- 172.21.15.78:0/2601997720 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560ed7092390 0x560ed7452140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.070+0000 7f42c93a2640 1 --2- 172.21.15.78:0/2601997720 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed70716b0 0x560ed74a1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.070+0000 7f42c9ba3640 1 -- 172.21.15.78:0/2601997720 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed70716b0 msgr2=0x560ed74a1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.070+0000 7f42c9ba3640 1 --2- 172.21.15.78:0/2601997720 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed70716b0 0x560ed74a1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.071+0000 7f42c9ba3640 1 -- 172.21.15.78:0/2601997720 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ed748d510 con 0x560ed70694d0 2024-09-17T03:12:36.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.071+0000 7f42ca3a4640 1 --2- 172.21.15.78:0/2601997720 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560ed7092390 0x560ed7452140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:12:36.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.071+0000 7f42c93a2640 1 --2- 172.21.15.78:0/2601997720 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed70716b0 0x560ed74a1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:12:36.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.071+0000 7f42c9ba3640 1 --2- 172.21.15.78:0/2601997720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed70694d0 0x560ed74a0af0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f42c0034040 tx=0x7f42c0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b23af4e5b0bfad server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.071+0000 7f42a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:12:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.071+0000 7f42a4ff9640 1 -- 172.21.15.78:0/2601997720 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0059030 con 0x560ed70694d0 2024-09-17T03:12:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.071+0000 7f42a4ff9640 1 -- 172.21.15.78:0/2601997720 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f42c0003b40 con 0x560ed70694d0 2024-09-17T03:12:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.071+0000 7f42d2e4b740 1 -- 172.21.15.78:0/2601997720 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42c004c070 con 0x560ed70694d0 2024-09-17T03:12:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.071+0000 7f42a4ff9640 1 -- 172.21.15.78:0/2601997720 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7f42c0065050 con 0x560ed70694d0 2024-09-17T03:12:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.071+0000 7f42d2e4b740 10 client.6678 fetch_fsmap learned FSMap version 54 2024-09-17T03:12:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.071+0000 7f42d2e4b740 1 -- 172.21.15.78:0/2601997720 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x560ed7454610 con 0x560ed70694d0 2024-09-17T03:12:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.071+0000 7f42a4ff9640 1 -- 172.21.15.78:0/2601997720 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42c004c070 con 0x560ed70694d0 2024-09-17T03:12:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.071+0000 7f42a4ff9640 1 -- 172.21.15.78:0/2601997720 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 54) ==== 3558+0+0 (secure 0 0 0) 0x7f42c0068020 con 0x560ed70694d0 2024-09-17T03:12:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.071+0000 7f42d2e4b740 10 client.6678 fetch_fsmap finished waiting for FSMap version 54 2024-09-17T03:12:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.071+0000 7f42d2e4b740 10 client.6678 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.c 2024-09-17T03:12:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.071+0000 7f42d2e4b740 20 client.6678 populate_metadata read hostname 'smithi078' 2024-09-17T03:12:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.071+0000 7f42d2e4b740 1 --2- 172.21.15.78:0/2601997720 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x560ed747a2a0 0x560ed7452680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.071+0000 7f42d2e4b740 4 client.6678 mds_command: new command op to 6231 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-17T03:12:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.071+0000 7f42d2e4b740 1 -- 172.21.15.78:0/2601997720 --> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560ed73aa2e0 con 0x560ed747a2a0 2024-09-17T03:12:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.072+0000 7f42c93a2640 1 --2- 172.21.15.78:0/2601997720 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x560ed747a2a0 0x560ed7452680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.072+0000 7f42a4ff9640 10 client.6678 ms_handle_connect on v2:172.21.15.78:6832/936871583 2024-09-17T03:12:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.072+0000 7f42c93a2640 1 --2- 172.21.15.78:0/2601997720 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x560ed747a2a0 0x560ed7452680 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3250ee33f577d36 server_cookie=8d47e32a2008849a in_seq=0 out_seq=0 2024-09-17T03:12:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.072+0000 7f42a4ff9640 1 -- 172.21.15.78:0/2601997720 <== mds.0 v2:172.21.15.78:6832/936871583 1 ==== command_reply(tid 0: 0 ) ==== 8+0+271 (crc 0 0 0) 0x560ed73aa2e0 con 0x560ed747a2a0 2024-09-17T03:12:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.072+0000 7f42a4ff9640 10 client.6678 handle_command_reply: tid=0 2024-09-17T03:12:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.072+0000 7f42d2e4b740 1 client.6678 shutdown 2024-09-17T03:12:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.072+0000 7f42d2e4b740 1 -- 172.21.15.78:0/2601997720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed70694d0 msgr2=0x560ed74a0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.072+0000 7f42d2e4b740 1 --2- 172.21.15.78:0/2601997720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed70694d0 0x560ed74a0af0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f42c0034040 tx=0x7f42c0004040 comp rx=0 tx=0).stop 2024-09-17T03:12:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.072+0000 7f42d2e4b740 1 -- 172.21.15.78:0/2601997720 shutdown_connections 2024-09-17T03:12:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.072+0000 7f42d2e4b740 1 --2- 172.21.15.78:0/2601997720 >> [v2:172.21.15.78:6832/936871583,v1:172.21.15.78:6834/936871583] conn(0x560ed747a2a0 0x560ed7452680 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.072+0000 7f42d2e4b740 1 --2- 172.21.15.78:0/2601997720 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560ed7092390 0x560ed7452140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.072+0000 7f42d2e4b740 1 --2- 172.21.15.78:0/2601997720 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560ed70716b0 0x560ed74a1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.072+0000 7f42d2e4b740 1 --2- 172.21.15.78:0/2601997720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560ed70694d0 0x560ed74a0af0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.072+0000 7f42a4ff9640 0 client.6678 ms_handle_reset on v2:172.21.15.78:6832/936871583 2024-09-17T03:12:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.072+0000 7f42d2e4b740 1 -- 172.21.15.78:0/2601997720 >> 172.21.15.78:0/2601997720 conn(0x560ed70864e0 msgr2=0x560ed74a1940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.073+0000 7f42d2e4b740 1 -- 172.21.15.78:0/2601997720 shutdown_connections 2024-09-17T03:12:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.073+0000 7f42d2e4b740 1 -- 172.21.15.78:0/2601997720 wait complete. 2024-09-17T03:12:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.073+0000 7f42d2e4b740 20 client.6678 trim_cache size 0 max 16384 2024-09-17T03:12:36.078 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2024-09-17T03:12:36.078 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:36.079 INFO:teuthology.orchestra.run.smithi078.stdout: "damage_type": "backtrace", 2024-09-17T03:12:36.079 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 674742569, 2024-09-17T03:12:36.079 INFO:teuthology.orchestra.run.smithi078.stdout: "ino": 1099511627778, 2024-09-17T03:12:36.079 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3" 2024-09-17T03:12:36.079 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:36.079 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:36.079 INFO:teuthology.orchestra.run.smithi078.stdout: "damage_type": "backtrace", 2024-09-17T03:12:36.079 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4118006986, 2024-09-17T03:12:36.079 INFO:teuthology.orchestra.run.smithi078.stdout: "ino": 1099511627779, 2024-09-17T03:12:36.079 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3/d4" 2024-09-17T03:12:36.079 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:36.079 INFO:teuthology.orchestra.run.smithi078.stdout:] 2024-09-17T03:12:36.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.073+0000 7f42cbe07640 1 -- 172.21.15.78:0/3949984902 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42a8078b90 msgr2=0x7f42a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.073+0000 7f42cbe07640 1 --2- 172.21.15.78:0/3949984902 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42a8078b90 0x7f42a807b0a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f42c0033000 tx=0x7f42c0004730 comp rx=0 tx=0).stop 2024-09-17T03:12:36.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.073+0000 7f42cbe07640 1 -- 172.21.15.78:0/3949984902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42c40cf570 msgr2=0x7f42c40b0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.073+0000 7f42cbe07640 1 --2- 172.21.15.78:0/3949984902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42c40cf570 0x7f42c40b0410 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f42b400b3f0 tx=0x7f42b400b8b0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.073+0000 7f42cbe07640 1 -- 172.21.15.78:0/3949984902 shutdown_connections 2024-09-17T03:12:36.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.073+0000 7f42cbe07640 1 --2- 172.21.15.78:0/3949984902 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42a8078b90 0x7f42a807b0a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.073+0000 7f42cbe07640 1 --2- 172.21.15.78:0/3949984902 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42c40cfb00 0x7f42c4167c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.073+0000 7f42cbe07640 1 --2- 172.21.15.78:0/3949984902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42c40cf570 0x7f42c40b0410 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.073+0000 7f42cbe07640 1 --2- 172.21.15.78:0/3949984902 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42c40cf160 0x7f42c40afed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.073+0000 7f42cbe07640 1 -- 172.21.15.78:0/3949984902 >> 172.21.15.78:0/3949984902 conn(0x7f42c40b1cb0 msgr2=0x7f42c40d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:36.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.073+0000 7f42cbe07640 1 -- 172.21.15.78:0/3949984902 shutdown_connections 2024-09-17T03:12:36.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.073+0000 7f42cbe07640 1 -- 172.21.15.78:0/3949984902 wait complete. 2024-09-17T03:12:36.083 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:1 damage ls 2024-09-17T03:12:36.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.198+0000 7fb097f01640 1 -- 172.21.15.78:0/2922549495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0900d12c0 msgr2=0x7fb0900d16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.198+0000 7fb097f01640 1 --2- 172.21.15.78:0/2922549495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0900d12c0 0x7fb0900d16d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fb0900724e0 tx=0x7fb08802aac0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.198+0000 7fb097f01640 1 -- 172.21.15.78:0/2922549495 shutdown_connections 2024-09-17T03:12:36.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.198+0000 7fb097f01640 1 --2- 172.21.15.78:0/2922549495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0900d12c0 0x7fb0900d16d0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.198+0000 7fb097f01640 1 --2- 172.21.15.78:0/2922549495 >> v2:172.21.15.193:3300/0 conn(0x7fb0900ccbd0 0x7fb0900d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.198+0000 7fb097f01640 1 -- 172.21.15.78:0/2922549495 >> 172.21.15.78:0/2922549495 conn(0x7fb090072ae0 msgr2=0x7fb090072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:36.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.198+0000 7fb097f01640 1 -- 172.21.15.78:0/2922549495 shutdown_connections 2024-09-17T03:12:36.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.198+0000 7fb097f01640 1 -- 172.21.15.78:0/2922549495 wait complete. 2024-09-17T03:12:36.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.200+0000 7fb097f01640 1 Processor -- start 2024-09-17T03:12:36.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.200+0000 7fb097f01640 1 -- start start 2024-09-17T03:12:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.201+0000 7fb097f01640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb0900b51c0 0x7fb09014e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.201+0000 7fb097f01640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0900ccbd0 0x7fb09006e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.201+0000 7fb097f01640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0900d12c0 0x7fb090150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.201+0000 7fb097f01640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb0900cf280 con 0x7fb0900ccbd0 2024-09-17T03:12:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.201+0000 7fb097f01640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb0900cf100 con 0x7fb0900d12c0 2024-09-17T03:12:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.201+0000 7fb097f01640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb0900cf400 con 0x7fb0900b51c0 2024-09-17T03:12:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.201+0000 7fb09549c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0900ccbd0 0x7fb09006e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.201+0000 7fb09549c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0900ccbd0 0x7fb09006e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35600/0 (socket says 172.21.15.78:35600) 2024-09-17T03:12:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.201+0000 7fb09549c640 1 -- 172.21.15.78:0/3770045147 learned_addr learned my addr 172.21.15.78:0/3770045147 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.202+0000 7fb095c9d640 1 --2- 172.21.15.78:0/3770045147 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb0900b51c0 0x7fb09014e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.202+0000 7fb09649e640 1 --2- 172.21.15.78:0/3770045147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0900d12c0 0x7fb090150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.202+0000 7fb09549c640 1 -- 172.21.15.78:0/3770045147 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb0900b51c0 msgr2=0x7fb09014e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.202+0000 7fb09549c640 1 --2- 172.21.15.78:0/3770045147 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb0900b51c0 0x7fb09014e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.202+0000 7fb09549c640 1 -- 172.21.15.78:0/3770045147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0900d12c0 msgr2=0x7fb090150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.202+0000 7fb09549c640 1 --2- 172.21.15.78:0/3770045147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0900d12c0 0x7fb090150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.202+0000 7fb09549c640 1 -- 172.21.15.78:0/3770045147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb09006f1a0 con 0x7fb0900ccbd0 2024-09-17T03:12:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.202+0000 7fb09549c640 1 --2- 172.21.15.78:0/3770045147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0900ccbd0 0x7fb09006e8d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb08000e790 tx=0x7fb08000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.202+0000 7fb0867fc640 1 -- 172.21.15.78:0/3770045147 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08000eea0 con 0x7fb0900ccbd0 2024-09-17T03:12:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.202+0000 7fb0867fc640 1 -- 172.21.15.78:0/3770045147 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb08000cdb0 con 0x7fb0900ccbd0 2024-09-17T03:12:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.202+0000 7fb097f01640 1 -- 172.21.15.78:0/3770045147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb09006f480 con 0x7fb0900ccbd0 2024-09-17T03:12:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.202+0000 7fb0867fc640 1 -- 172.21.15.78:0/3770045147 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb080010690 con 0x7fb0900ccbd0 2024-09-17T03:12:36.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.202+0000 7fb097f01640 1 -- 172.21.15.78:0/3770045147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb09014e9a0 con 0x7fb0900ccbd0 2024-09-17T03:12:36.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.204+0000 7fb0867fc640 1 -- 172.21.15.78:0/3770045147 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb080010830 con 0x7fb0900ccbd0 2024-09-17T03:12:36.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.205+0000 7fb0867fc640 1 --2- 172.21.15.78:0/3770045147 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb074078b90 0x7fb07407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.205+0000 7fb0867fc640 1 -- 172.21.15.78:0/3770045147 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fb08009b750 con 0x7fb0900ccbd0 2024-09-17T03:12:36.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.205+0000 7fb095c9d640 1 --2- 172.21.15.78:0/3770045147 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb074078b90 0x7fb07407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.206+0000 7fb095c9d640 1 --2- 172.21.15.78:0/3770045147 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb074078b90 0x7fb07407b0a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb08c0015e0 tx=0x7fb08c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:36.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.206+0000 7fb09ee6f740 1 Processor -- start 2024-09-17T03:12:36.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.206+0000 7fb09ee6f740 1 -- start start 2024-09-17T03:12:36.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.207+0000 7fb09ee6f740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae88b390 0x5603aec5d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.207+0000 7fb09ee6f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae8624d0 0x5603aec5d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.207+0000 7fb09ee6f740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ae86a6b0 0x5603aec7a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.207+0000 7fb09ee6f740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5603aeba58e0 con 0x5603ae88b390 2024-09-17T03:12:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.207+0000 7fb09ee6f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5603aeb94d10 con 0x5603ae8624d0 2024-09-17T03:12:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.207+0000 7fb09ee6f740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5603aeb98b20 con 0x5603ae86a6b0 2024-09-17T03:12:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.207+0000 7fb095c9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae88b390 0x5603aec5d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.207+0000 7fb095c9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae88b390 0x5603aec5d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35604/0 (socket says 172.21.15.78:35604) 2024-09-17T03:12:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.207+0000 7fb095c9d640 1 -- 172.21.15.78:0/3402410635 learned_addr learned my addr 172.21.15.78:0/3402410635 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.207+0000 7fb09649e640 1 --2- 172.21.15.78:0/3402410635 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ae86a6b0 0x5603aec7a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.207+0000 7fb09549c640 1 --2- 172.21.15.78:0/3402410635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae8624d0 0x5603aec5d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.207+0000 7fb095c9d640 1 -- 172.21.15.78:0/3402410635 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ae86a6b0 msgr2=0x5603aec7a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.207+0000 7fb095c9d640 1 --2- 172.21.15.78:0/3402410635 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ae86a6b0 0x5603aec7a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.207+0000 7fb095c9d640 1 -- 172.21.15.78:0/3402410635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae8624d0 msgr2=0x5603aec5d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.207+0000 7fb095c9d640 1 --2- 172.21.15.78:0/3402410635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae8624d0 0x5603aec5d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.207+0000 7fb095c9d640 1 -- 172.21.15.78:0/3402410635 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603ae8f6970 con 0x5603ae88b390 2024-09-17T03:12:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.207+0000 7fb09549c640 1 --2- 172.21.15.78:0/3402410635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae8624d0 0x5603aec5d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:36.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.208+0000 7fb095c9d640 1 --2- 172.21.15.78:0/3402410635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae88b390 0x5603aec5d1d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb08c005280 tx=0x7fb08c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc47ec95baddf3ae server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:36.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.208+0000 7fb0737fe640 1 -- 172.21.15.78:0/3402410635 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08c00e4b0 con 0x5603ae88b390 2024-09-17T03:12:36.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.208+0000 7fb0737fe640 1 -- 172.21.15.78:0/3402410635 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb08c00e740 con 0x5603ae88b390 2024-09-17T03:12:36.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.208+0000 7fb0737fe640 1 -- 172.21.15.78:0/3402410635 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08c00eb30 con 0x5603ae88b390 2024-09-17T03:12:36.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.208+0000 7fb09ee6f740 1 -- 172.21.15.78:0/3402410635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae88b390 msgr2=0x5603aec5d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.208+0000 7fb09ee6f740 1 --2- 172.21.15.78:0/3402410635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae88b390 0x5603aec5d1d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fb08c005280 tx=0x7fb08c011000 comp rx=0 tx=0).stop 2024-09-17T03:12:36.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.209+0000 7fb09ee6f740 1 -- 172.21.15.78:0/3402410635 shutdown_connections 2024-09-17T03:12:36.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.209+0000 7fb09ee6f740 1 --2- 172.21.15.78:0/3402410635 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ae86a6b0 0x5603aec7a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.209+0000 7fb09ee6f740 1 --2- 172.21.15.78:0/3402410635 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae8624d0 0x5603aec5d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.209+0000 7fb09ee6f740 1 --2- 172.21.15.78:0/3402410635 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae88b390 0x5603aec5d1d0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.209+0000 7fb09ee6f740 1 -- 172.21.15.78:0/3402410635 >> 172.21.15.78:0/3402410635 conn(0x5603ae87f4e0 msgr2=0x5603aec33490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:36.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.209+0000 7fb09ee6f740 1 -- 172.21.15.78:0/3402410635 shutdown_connections 2024-09-17T03:12:36.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.209+0000 7fb09ee6f740 1 -- 172.21.15.78:0/3402410635 wait complete. 2024-09-17T03:12:36.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.209+0000 7fb09ee6f740 1 -- start start 2024-09-17T03:12:36.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.210+0000 7fb09ee6f740 1 Processor -- start 2024-09-17T03:12:36.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.211+0000 7fb09ee6f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae8624d0 0x5603aec78960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.211+0000 7fb09ee6f740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae86a6b0 0x5603aec4b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.211+0000 7fb09ee6f740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ae88b390 0x5603aec7a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.211+0000 7fb09ee6f740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5603ae905740 con 0x5603ae86a6b0 2024-09-17T03:12:36.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.211+0000 7fb09ee6f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5603aeb3a7f0 con 0x5603ae8624d0 2024-09-17T03:12:36.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.211+0000 7fb09ee6f740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5603aec5dc50 con 0x5603ae88b390 2024-09-17T03:12:36.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.211+0000 7fb09ee6f740 10 client.0 _ll_register_callbacks cb 0x5603aeb3e2a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:12:36.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.211+0000 7fb09549c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae86a6b0 0x5603aec4b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.211+0000 7fb09549c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae86a6b0 0x5603aec4b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35610/0 (socket says 172.21.15.78:35610) 2024-09-17T03:12:36.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.211+0000 7fb09549c640 1 -- 172.21.15.78:0/2674461843 learned_addr learned my addr 172.21.15.78:0/2674461843 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:36.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.211+0000 7fb09549c640 1 -- 172.21.15.78:0/2674461843 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ae88b390 msgr2=0x5603aec7a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.211+0000 7fb09549c640 1 --2- 172.21.15.78:0/2674461843 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ae88b390 0x5603aec7a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.211+0000 7fb095c9d640 1 --2- 172.21.15.78:0/2674461843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae8624d0 0x5603aec78960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.211+0000 7fb09549c640 1 -- 172.21.15.78:0/2674461843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae8624d0 msgr2=0x5603aec78960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.211+0000 7fb09549c640 1 --2- 172.21.15.78:0/2674461843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae8624d0 0x5603aec78960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.211+0000 7fb09549c640 1 -- 172.21.15.78:0/2674461843 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603ae96d7d0 con 0x5603ae86a6b0 2024-09-17T03:12:36.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.211+0000 7fb09549c640 1 --2- 172.21.15.78:0/2674461843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae86a6b0 0x5603aec4b8c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb0800606f0 tx=0x7fb080063a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49b99f634c71fbd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:36.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.211+0000 7fb070ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:12:36.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.212+0000 7fb070ff9640 1 -- 172.21.15.78:0/2674461843 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb080063b80 con 0x5603ae86a6b0 2024-09-17T03:12:36.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.212+0000 7fb070ff9640 1 -- 172.21.15.78:0/2674461843 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fb08006a170 con 0x5603ae86a6b0 2024-09-17T03:12:36.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.212+0000 7fb09ee6f740 1 -- 172.21.15.78:0/2674461843 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb08c00e740 con 0x5603ae86a6b0 2024-09-17T03:12:36.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.212+0000 7fb070ff9640 1 -- 172.21.15.78:0/2674461843 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fb080063480 con 0x5603ae86a6b0 2024-09-17T03:12:36.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.212+0000 7fb09ee6f740 10 client.6690 fetch_fsmap learned FSMap version 54 2024-09-17T03:12:36.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.212+0000 7fb09ee6f740 1 -- 172.21.15.78:0/2674461843 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x5603aec8b300 con 0x5603ae86a6b0 2024-09-17T03:12:36.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.212+0000 7fb070ff9640 1 -- 172.21.15.78:0/2674461843 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb08c00e740 con 0x5603ae86a6b0 2024-09-17T03:12:36.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.212+0000 7fb070ff9640 1 -- 172.21.15.78:0/2674461843 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 54) ==== 3558+0+0 (secure 0 0 0) 0x7fb08005edd0 con 0x5603ae86a6b0 2024-09-17T03:12:36.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.212+0000 7fb09ee6f740 10 client.6690 fetch_fsmap finished waiting for FSMap version 54 2024-09-17T03:12:36.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.212+0000 7fb09ee6f740 10 client.6690 resolve_mds: resolved 4:1 to role '4:1' aka daemon mds.b 2024-09-17T03:12:36.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.212+0000 7fb09ee6f740 20 client.6690 populate_metadata read hostname 'smithi078' 2024-09-17T03:12:36.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.212+0000 7fb09ee6f740 1 --2- 172.21.15.78:0/2674461843 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x5603ae849f60 0x5603aec877a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.212+0000 7fb09ee6f740 4 client.6690 mds_command: new command op to 5773 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:12:36.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.212+0000 7fb09ee6f740 1 -- 172.21.15.78:0/2674461843 --> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603aeba7830 con 0x5603ae849f60 2024-09-17T03:12:36.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.212+0000 7fb095c9d640 1 --2- 172.21.15.78:0/2674461843 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x5603ae849f60 0x5603aec877a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.213+0000 7fb095c9d640 1 --2- 172.21.15.78:0/2674461843 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x5603ae849f60 0x5603aec877a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5c49250f9b1d4be3 server_cookie=4258c26a1925bb4b in_seq=0 out_seq=0 2024-09-17T03:12:36.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.213+0000 7fb070ff9640 10 client.6690 ms_handle_connect on v2:172.21.15.193:6835/2730762656 2024-09-17T03:12:36.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.214+0000 7fb070ff9640 1 -- 172.21.15.78:0/2674461843 <== mds.1 v2:172.21.15.193:6835/2730762656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5603aeba7830 con 0x5603ae849f60 2024-09-17T03:12:36.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.214+0000 7fb070ff9640 10 client.6690 handle_command_reply: tid=0 2024-09-17T03:12:36.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.214+0000 7fb09ee6f740 1 client.6690 shutdown 2024-09-17T03:12:36.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.214+0000 7fb09ee6f740 1 -- 172.21.15.78:0/2674461843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae86a6b0 msgr2=0x5603aec4b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.214+0000 7fb09ee6f740 1 --2- 172.21.15.78:0/2674461843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae86a6b0 0x5603aec4b8c0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb0800606f0 tx=0x7fb080063a20 comp rx=0 tx=0).stop 2024-09-17T03:12:36.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.214+0000 7fb09ee6f740 1 -- 172.21.15.78:0/2674461843 shutdown_connections 2024-09-17T03:12:36.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.214+0000 7fb09ee6f740 1 --2- 172.21.15.78:0/2674461843 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x5603ae849f60 0x5603aec877a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.214+0000 7fb09ee6f740 1 --2- 172.21.15.78:0/2674461843 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ae88b390 0x5603aec7a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.214+0000 7fb09ee6f740 1 --2- 172.21.15.78:0/2674461843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae86a6b0 0x5603aec4b8c0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.214+0000 7fb070ff9640 0 client.6690 ms_handle_reset on v2:172.21.15.193:6835/2730762656 2024-09-17T03:12:36.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.214+0000 7fb09ee6f740 1 --2- 172.21.15.78:0/2674461843 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae8624d0 0x5603aec78960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.214+0000 7fb09ee6f740 1 -- 172.21.15.78:0/2674461843 >> 172.21.15.78:0/2674461843 conn(0x5603ae87f4e0 msgr2=0x5603aec79be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:36.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.214+0000 7fb09ee6f740 1 -- 172.21.15.78:0/2674461843 shutdown_connections 2024-09-17T03:12:36.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.214+0000 7fb09ee6f740 1 -- 172.21.15.78:0/2674461843 wait complete. 2024-09-17T03:12:36.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.214+0000 7fb09ee6f740 20 client.6690 trim_cache size 0 max 16384 2024-09-17T03:12:36.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.227+0000 7fb09ee6f740 1 Processor -- start 2024-09-17T03:12:36.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.227+0000 7fb09ee6f740 1 -- start start 2024-09-17T03:12:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.229+0000 7fb09ee6f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae8624d0 0x5603aec73b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.229+0000 7fb09ee6f740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ae86a6b0 0x5603aec74060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.229+0000 7fb09ee6f740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae88b390 0x5603aec9ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.229+0000 7fb09ee6f740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb090202360 con 0x5603ae88b390 2024-09-17T03:12:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.229+0000 7fb09ee6f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb090201500 con 0x5603ae8624d0 2024-09-17T03:12:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.229+0000 7fb09ee6f740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb090201c30 con 0x5603ae86a6b0 2024-09-17T03:12:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.229+0000 7fb09649e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae88b390 0x5603aec9ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.229+0000 7fb09649e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae88b390 0x5603aec9ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35618/0 (socket says 172.21.15.78:35618) 2024-09-17T03:12:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.229+0000 7fb09649e640 1 -- 172.21.15.78:0/430843895 learned_addr learned my addr 172.21.15.78:0/430843895 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.229+0000 7fb09549c640 1 --2- 172.21.15.78:0/430843895 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ae86a6b0 0x5603aec74060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.229+0000 7fb095c9d640 1 --2- 172.21.15.78:0/430843895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae8624d0 0x5603aec73b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.229+0000 7fb09649e640 1 -- 172.21.15.78:0/430843895 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ae86a6b0 msgr2=0x5603aec74060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.229+0000 7fb09649e640 1 --2- 172.21.15.78:0/430843895 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ae86a6b0 0x5603aec74060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.229+0000 7fb09649e640 1 -- 172.21.15.78:0/430843895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae8624d0 msgr2=0x5603aec73b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.229+0000 7fb09649e640 1 --2- 172.21.15.78:0/430843895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae8624d0 0x5603aec73b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.229+0000 7fb09649e640 1 -- 172.21.15.78:0/430843895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603aec6e330 con 0x5603ae88b390 2024-09-17T03:12:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.229+0000 7fb09649e640 1 --2- 172.21.15.78:0/430843895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae88b390 0x5603aec9ad90 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fb088009d60 tx=0x7fb088004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6aae2db9f8400c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:36.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.229+0000 7fb072ffd640 1 -- 172.21.15.78:0/430843895 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb088046070 con 0x5603ae88b390 2024-09-17T03:12:36.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.229+0000 7fb072ffd640 1 -- 172.21.15.78:0/430843895 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb08802ccd0 con 0x5603ae88b390 2024-09-17T03:12:36.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.229+0000 7fb072ffd640 1 -- 172.21.15.78:0/430843895 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb088003bd0 con 0x5603ae88b390 2024-09-17T03:12:36.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.230+0000 7fb09ee6f740 1 -- 172.21.15.78:0/430843895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae88b390 msgr2=0x5603aec9ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.230+0000 7fb09ee6f740 1 --2- 172.21.15.78:0/430843895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae88b390 0x5603aec9ad90 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fb088009d60 tx=0x7fb088004a40 comp rx=0 tx=0).stop 2024-09-17T03:12:36.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.230+0000 7fb09ee6f740 1 -- 172.21.15.78:0/430843895 shutdown_connections 2024-09-17T03:12:36.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.230+0000 7fb09ee6f740 1 --2- 172.21.15.78:0/430843895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae88b390 0x5603aec9ad90 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.230+0000 7fb09ee6f740 1 --2- 172.21.15.78:0/430843895 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ae86a6b0 0x5603aec74060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.230+0000 7fb09ee6f740 1 --2- 172.21.15.78:0/430843895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae8624d0 0x5603aec73b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.230+0000 7fb09ee6f740 1 -- 172.21.15.78:0/430843895 >> 172.21.15.78:0/430843895 conn(0x5603ae87f4e0 msgr2=0x5603aec4c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:36.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.230+0000 7fb09ee6f740 1 -- 172.21.15.78:0/430843895 shutdown_connections 2024-09-17T03:12:36.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.230+0000 7fb09ee6f740 1 -- 172.21.15.78:0/430843895 wait complete. 2024-09-17T03:12:36.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.231+0000 7fb09ee6f740 1 -- start start 2024-09-17T03:12:36.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.231+0000 7fb09ee6f740 1 Processor -- start 2024-09-17T03:12:36.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb09ee6f740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae8624d0 0x5603aec9a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb09ee6f740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae86a6b0 0x5603aec9b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb09ee6f740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ae88b390 0x5603aecf6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb09ee6f740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb09014ff60 con 0x5603ae8624d0 2024-09-17T03:12:36.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb09ee6f740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5603aec9b210 con 0x5603ae86a6b0 2024-09-17T03:12:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb09ee6f740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5603aec59cd0 con 0x5603ae88b390 2024-09-17T03:12:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb09ee6f740 10 client.0 _ll_register_callbacks cb 0x7fb080062e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:12:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb095c9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae8624d0 0x5603aec9a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb095c9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae8624d0 0x5603aec9a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35622/0 (socket says 172.21.15.78:35622) 2024-09-17T03:12:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb095c9d640 1 -- 172.21.15.78:0/2214512038 learned_addr learned my addr 172.21.15.78:0/2214512038 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb09649e640 1 --2- 172.21.15.78:0/2214512038 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ae88b390 0x5603aecf6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb09549c640 1 --2- 172.21.15.78:0/2214512038 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae86a6b0 0x5603aec9b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb095c9d640 1 -- 172.21.15.78:0/2214512038 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ae88b390 msgr2=0x5603aecf6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb095c9d640 1 --2- 172.21.15.78:0/2214512038 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ae88b390 0x5603aecf6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb095c9d640 1 -- 172.21.15.78:0/2214512038 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae86a6b0 msgr2=0x5603aec9b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb095c9d640 1 --2- 172.21.15.78:0/2214512038 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae86a6b0 0x5603aec9b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb095c9d640 1 -- 172.21.15.78:0/2214512038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603aec74370 con 0x5603ae8624d0 2024-09-17T03:12:36.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb09649e640 1 --2- 172.21.15.78:0/2214512038 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ae88b390 0x5603aecf6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:36.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb09549c640 1 --2- 172.21.15.78:0/2214512038 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae86a6b0 0x5603aec9b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:36.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb095c9d640 1 --2- 172.21.15.78:0/2214512038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae8624d0 0x5603aec9a790 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb08c005040 tx=0x7fb08c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a0b0d044f033d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:36.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb070ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:12:36.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb070ff9640 1 -- 172.21.15.78:0/2214512038 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08c00eb50 con 0x5603ae8624d0 2024-09-17T03:12:36.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb070ff9640 1 -- 172.21.15.78:0/2214512038 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fb08c00ecf0 con 0x5603ae8624d0 2024-09-17T03:12:36.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.233+0000 7fb09ee6f740 1 -- 172.21.15.78:0/2214512038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb08802ccd0 con 0x5603ae8624d0 2024-09-17T03:12:36.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.234+0000 7fb070ff9640 1 -- 172.21.15.78:0/2214512038 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fb08c021450 con 0x5603ae8624d0 2024-09-17T03:12:36.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.234+0000 7fb09ee6f740 10 client.6696 fetch_fsmap learned FSMap version 54 2024-09-17T03:12:36.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.234+0000 7fb09ee6f740 1 -- 172.21.15.78:0/2214512038 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x5603aec9ba90 con 0x5603ae8624d0 2024-09-17T03:12:36.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.234+0000 7fb070ff9640 1 -- 172.21.15.78:0/2214512038 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb08802ccd0 con 0x5603ae8624d0 2024-09-17T03:12:36.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.234+0000 7fb070ff9640 1 -- 172.21.15.78:0/2214512038 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 54) ==== 3558+0+0 (secure 0 0 0) 0x7fb08c032030 con 0x5603ae8624d0 2024-09-17T03:12:36.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.234+0000 7fb09ee6f740 10 client.6696 fetch_fsmap finished waiting for FSMap version 54 2024-09-17T03:12:36.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.234+0000 7fb09ee6f740 10 client.6696 resolve_mds: resolved 4:1 to role '4:1' aka daemon mds.b 2024-09-17T03:12:36.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.234+0000 7fb09ee6f740 20 client.6696 populate_metadata read hostname 'smithi078' 2024-09-17T03:12:36.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.234+0000 7fb09ee6f740 1 --2- 172.21.15.78:0/2214512038 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x5603aecf6e60 0x5603aec79b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.234+0000 7fb09ee6f740 4 client.6696 mds_command: new command op to 5773 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-17T03:12:36.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.234+0000 7fb09ee6f740 1 -- 172.21.15.78:0/2214512038 --> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5603aeba32e0 con 0x5603aecf6e60 2024-09-17T03:12:36.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.234+0000 7fb09549c640 1 --2- 172.21.15.78:0/2214512038 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x5603aecf6e60 0x5603aec79b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.234+0000 7fb070ff9640 10 client.6696 ms_handle_connect on v2:172.21.15.193:6835/2730762656 2024-09-17T03:12:36.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.234+0000 7fb09549c640 1 --2- 172.21.15.78:0/2214512038 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x5603aecf6e60 0x5603aec79b30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=22dfbed71355d638 server_cookie=8d3323d67c217be2 in_seq=0 out_seq=0 2024-09-17T03:12:36.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.235+0000 7fb070ff9640 1 -- 172.21.15.78:0/2214512038 <== mds.1 v2:172.21.15.193:6835/2730762656 1 ==== command_reply(tid 0: 0 ) ==== 8+0+283 (crc 0 0 0) 0x5603aeba32e0 con 0x5603aecf6e60 2024-09-17T03:12:36.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.235+0000 7fb070ff9640 10 client.6696 handle_command_reply: tid=0 2024-09-17T03:12:36.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.235+0000 7fb09ee6f740 1 client.6696 shutdown 2024-09-17T03:12:36.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.235+0000 7fb09ee6f740 1 -- 172.21.15.78:0/2214512038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae8624d0 msgr2=0x5603aec9a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.235+0000 7fb09ee6f740 1 --2- 172.21.15.78:0/2214512038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae8624d0 0x5603aec9a790 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb08c005040 tx=0x7fb08c000bc0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.235+0000 7fb09ee6f740 1 -- 172.21.15.78:0/2214512038 shutdown_connections 2024-09-17T03:12:36.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.235+0000 7fb09ee6f740 1 --2- 172.21.15.78:0/2214512038 >> [v2:172.21.15.193:6835/2730762656,v1:172.21.15.193:6837/2730762656] conn(0x5603aecf6e60 0x5603aec79b30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.235+0000 7fb09ee6f740 1 --2- 172.21.15.78:0/2214512038 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5603ae88b390 0x5603aecf6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.235+0000 7fb070ff9640 0 client.6696 ms_handle_reset on v2:172.21.15.193:6835/2730762656 2024-09-17T03:12:36.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.235+0000 7fb09ee6f740 1 --2- 172.21.15.78:0/2214512038 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5603ae86a6b0 0x5603aec9b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.235+0000 7fb09ee6f740 1 --2- 172.21.15.78:0/2214512038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5603ae8624d0 0x5603aec9a790 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.235+0000 7fb09ee6f740 1 -- 172.21.15.78:0/2214512038 >> 172.21.15.78:0/2214512038 conn(0x5603ae87f4e0 msgr2=0x5603aec5d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:36.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.235+0000 7fb09ee6f740 1 -- 172.21.15.78:0/2214512038 shutdown_connections 2024-09-17T03:12:36.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.235+0000 7fb09ee6f740 1 -- 172.21.15.78:0/2214512038 wait complete. 2024-09-17T03:12:36.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.235+0000 7fb09ee6f740 20 client.6696 trim_cache size 0 max 16384 2024-09-17T03:12:36.239 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2024-09-17T03:12:36.240 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:36.240 INFO:teuthology.orchestra.run.smithi078.stdout: "damage_type": "backtrace", 2024-09-17T03:12:36.240 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 539332472, 2024-09-17T03:12:36.240 INFO:teuthology.orchestra.run.smithi078.stdout: "ino": 1099511627781, 2024-09-17T03:12:36.240 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3/d4/d5/d6" 2024-09-17T03:12:36.240 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:36.240 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:36.240 INFO:teuthology.orchestra.run.smithi078.stdout: "damage_type": "backtrace", 2024-09-17T03:12:36.240 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 1311494757, 2024-09-17T03:12:36.240 INFO:teuthology.orchestra.run.smithi078.stdout: "ino": 1099511627780, 2024-09-17T03:12:36.240 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3/d4/d5" 2024-09-17T03:12:36.240 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:36.241 INFO:teuthology.orchestra.run.smithi078.stdout:] 2024-09-17T03:12:36.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.236+0000 7fb097f01640 1 -- 172.21.15.78:0/3770045147 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb074078b90 msgr2=0x7fb07407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.236+0000 7fb097f01640 1 --2- 172.21.15.78:0/3770045147 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb074078b90 0x7fb07407b0a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb08c0015e0 tx=0x7fb08c009040 comp rx=0 tx=0).stop 2024-09-17T03:12:36.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.236+0000 7fb097f01640 1 -- 172.21.15.78:0/3770045147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0900ccbd0 msgr2=0x7fb09006e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.236+0000 7fb097f01640 1 --2- 172.21.15.78:0/3770045147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0900ccbd0 0x7fb09006e8d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fb08000e790 tx=0x7fb08000ec50 comp rx=0 tx=0).stop 2024-09-17T03:12:36.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.236+0000 7fb097f01640 1 -- 172.21.15.78:0/3770045147 shutdown_connections 2024-09-17T03:12:36.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.236+0000 7fb097f01640 1 --2- 172.21.15.78:0/3770045147 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb074078b90 0x7fb07407b0a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.236+0000 7fb097f01640 1 --2- 172.21.15.78:0/3770045147 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0900d12c0 0x7fb090150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.236+0000 7fb097f01640 1 --2- 172.21.15.78:0/3770045147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0900ccbd0 0x7fb09006e8d0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.236+0000 7fb097f01640 1 --2- 172.21.15.78:0/3770045147 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb0900b51c0 0x7fb09014e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.236+0000 7fb097f01640 1 -- 172.21.15.78:0/3770045147 >> 172.21.15.78:0/3770045147 conn(0x7fb090072ae0 msgr2=0x7fb09015e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:36.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.236+0000 7fb097f01640 1 -- 172.21.15.78:0/3770045147 shutdown_connections 2024-09-17T03:12:36.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.236+0000 7fb097f01640 1 -- 172.21.15.78:0/3770045147 wait complete. 2024-09-17T03:12:36.245 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:2 damage ls 2024-09-17T03:12:36.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.360+0000 7ff3a11df640 1 -- 172.21.15.78:0/3853950097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff39c1570e0 msgr2=0x7ff39c0d1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.360+0000 7ff3a11df640 1 --2- 172.21.15.78:0/3853950097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff39c1570e0 0x7ff39c0d1f20 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7ff39c071d80 tx=0x7ff38c02a530 comp rx=0 tx=0).stop 2024-09-17T03:12:36.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.360+0000 7ff3a11df640 1 -- 172.21.15.78:0/3853950097 shutdown_connections 2024-09-17T03:12:36.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.360+0000 7ff3a11df640 1 --2- 172.21.15.78:0/3853950097 >> v2:172.21.15.193:3300/0 conn(0x7ff39c0d2460 0x7ff39c15d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.360+0000 7ff3a11df640 1 --2- 172.21.15.78:0/3853950097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff39c1570e0 0x7ff39c0d1f20 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.360+0000 7ff3a11df640 1 -- 172.21.15.78:0/3853950097 >> 172.21.15.78:0/3853950097 conn(0x7ff39c06d550 msgr2=0x7ff39c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:36.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.360+0000 7ff3a11df640 1 -- 172.21.15.78:0/3853950097 shutdown_connections 2024-09-17T03:12:36.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.360+0000 7ff3a11df640 1 -- 172.21.15.78:0/3853950097 wait complete. 2024-09-17T03:12:36.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.362+0000 7ff3a11df640 1 Processor -- start 2024-09-17T03:12:36.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.362+0000 7ff3a11df640 1 -- start start 2024-09-17T03:12:36.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.363+0000 7ff3a11df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff39c0d2460 0x7ff39c1486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.363+0000 7ff3a11df640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff39c1570e0 0x7ff39c1f7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.363+0000 7ff3a11df640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff39c15d670 0x7ff39c1f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.363+0000 7ff3a11df640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c0b7d20 con 0x7ff39c0d2460 2024-09-17T03:12:36.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.363+0000 7ff3a11df640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c0b7ba0 con 0x7ff39c15d670 2024-09-17T03:12:36.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.363+0000 7ff3a11df640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff39c0b7ea0 con 0x7ff39c1570e0 2024-09-17T03:12:36.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.364+0000 7ff39ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff39c0d2460 0x7ff39c1486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.364+0000 7ff39ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff39c0d2460 0x7ff39c1486e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47922/0 (socket says 172.21.15.78:47922) 2024-09-17T03:12:36.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.364+0000 7ff39ad9d640 1 -- 172.21.15.78:0/669033587 learned_addr learned my addr 172.21.15.78:0/669033587 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:36.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.364+0000 7ff39b59e640 1 --2- 172.21.15.78:0/669033587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff39c15d670 0x7ff39c1f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.364+0000 7ff39259c640 1 --2- 172.21.15.78:0/669033587 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff39c1570e0 0x7ff39c1f7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.364+0000 7ff39ad9d640 1 -- 172.21.15.78:0/669033587 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff39c1570e0 msgr2=0x7ff39c1f7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.364+0000 7ff39ad9d640 1 --2- 172.21.15.78:0/669033587 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff39c1570e0 0x7ff39c1f7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.364+0000 7ff39ad9d640 1 -- 172.21.15.78:0/669033587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff39c15d670 msgr2=0x7ff39c1f77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.364+0000 7ff39ad9d640 1 --2- 172.21.15.78:0/669033587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff39c15d670 0x7ff39c1f77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.364+0000 7ff39ad9d640 1 -- 172.21.15.78:0/669033587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39c1f4f40 con 0x7ff39c0d2460 2024-09-17T03:12:36.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.364+0000 7ff39ad9d640 1 --2- 172.21.15.78:0/669033587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff39c0d2460 0x7ff39c1486e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009780 tx=0x7ff38c033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:36.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.365+0000 7ff393fff640 1 -- 172.21.15.78:0/669033587 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c031d60 con 0x7ff39c0d2460 2024-09-17T03:12:36.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.365+0000 7ff393fff640 1 -- 172.21.15.78:0/669033587 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff38c005020 con 0x7ff39c0d2460 2024-09-17T03:12:36.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.365+0000 7ff3a11df640 1 -- 172.21.15.78:0/669033587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff39c0b44d0 con 0x7ff39c0d2460 2024-09-17T03:12:36.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.365+0000 7ff393fff640 1 -- 172.21.15.78:0/669033587 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c005470 con 0x7ff39c0d2460 2024-09-17T03:12:36.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.365+0000 7ff3a11df640 1 -- 172.21.15.78:0/669033587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff39c1f54c0 con 0x7ff39c0d2460 2024-09-17T03:12:36.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.367+0000 7ff393fff640 1 -- 172.21.15.78:0/669033587 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff38c0047a0 con 0x7ff39c0d2460 2024-09-17T03:12:36.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.367+0000 7ff393fff640 1 --2- 172.21.15.78:0/669033587 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff37c078bc0 0x7ff37c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.367+0000 7ff393fff640 1 -- 172.21.15.78:0/669033587 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7ff38c0bbf10 con 0x7ff39c0d2460 2024-09-17T03:12:36.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.368+0000 7ff39259c640 1 --2- 172.21.15.78:0/669033587 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff37c078bc0 0x7ff37c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.368+0000 7ff3a8226740 1 Processor -- start 2024-09-17T03:12:36.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.368+0000 7ff39259c640 1 --2- 172.21.15.78:0/669033587 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff37c078bc0 0x7ff37c07b0d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff39c0cc970 tx=0x7ff384009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:36.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.368+0000 7ff3a8226740 1 -- start start 2024-09-17T03:12:36.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.370+0000 7ff3a8226740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687a2390 0x556268b741d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.370+0000 7ff3a8226740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687794d0 0x556268b74710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.370+0000 7ff3a8226740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687816b0 0x556268b91610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.370+0000 7ff3a8226740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x556268abc8e0 con 0x5562687794d0 2024-09-17T03:12:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.370+0000 7ff3a8226740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556268aabd10 con 0x5562687a2390 2024-09-17T03:12:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.370+0000 7ff3a8226740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x556268aafb20 con 0x5562687816b0 2024-09-17T03:12:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.370+0000 7ff39259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687794d0 0x556268b74710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.370+0000 7ff39259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687794d0 0x556268b74710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47924/0 (socket says 172.21.15.78:47924) 2024-09-17T03:12:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.370+0000 7ff39259c640 1 -- 172.21.15.78:0/3308147442 learned_addr learned my addr 172.21.15.78:0/3308147442 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.370+0000 7ff39ad9d640 1 --2- 172.21.15.78:0/3308147442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687a2390 0x556268b741d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.370+0000 7ff39b59e640 1 --2- 172.21.15.78:0/3308147442 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687816b0 0x556268b91610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.370+0000 7ff39259c640 1 -- 172.21.15.78:0/3308147442 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687816b0 msgr2=0x556268b91610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.370+0000 7ff39259c640 1 --2- 172.21.15.78:0/3308147442 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687816b0 0x556268b91610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.370+0000 7ff39259c640 1 -- 172.21.15.78:0/3308147442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687a2390 msgr2=0x556268b741d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.370+0000 7ff39259c640 1 --2- 172.21.15.78:0/3308147442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687a2390 0x556268b741d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.370+0000 7ff39259c640 1 -- 172.21.15.78:0/3308147442 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55626880d970 con 0x5562687794d0 2024-09-17T03:12:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.370+0000 7ff39259c640 1 --2- 172.21.15.78:0/3308147442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687794d0 0x556268b74710 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff38400eba0 tx=0x7ff384011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3482179d3fb12530 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.370+0000 7ff390d99640 1 -- 172.21.15.78:0/3308147442 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38401b040 con 0x5562687794d0 2024-09-17T03:12:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.371+0000 7ff390d99640 1 -- 172.21.15.78:0/3308147442 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff384024070 con 0x5562687794d0 2024-09-17T03:12:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.371+0000 7ff390d99640 1 -- 172.21.15.78:0/3308147442 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff384015e10 con 0x5562687794d0 2024-09-17T03:12:36.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.371+0000 7ff3a8226740 1 -- 172.21.15.78:0/3308147442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687794d0 msgr2=0x556268b74710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.371+0000 7ff3a8226740 1 --2- 172.21.15.78:0/3308147442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687794d0 0x556268b74710 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7ff38400eba0 tx=0x7ff384011000 comp rx=0 tx=0).stop 2024-09-17T03:12:36.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.371+0000 7ff3a8226740 1 -- 172.21.15.78:0/3308147442 shutdown_connections 2024-09-17T03:12:36.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.371+0000 7ff3a8226740 1 --2- 172.21.15.78:0/3308147442 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687816b0 0x556268b91610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.371+0000 7ff3a8226740 1 --2- 172.21.15.78:0/3308147442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687794d0 0x556268b74710 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.371+0000 7ff3a8226740 1 --2- 172.21.15.78:0/3308147442 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687a2390 0x556268b741d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.371+0000 7ff3a8226740 1 -- 172.21.15.78:0/3308147442 >> 172.21.15.78:0/3308147442 conn(0x5562687964e0 msgr2=0x556268b4a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:36.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.372+0000 7ff3a8226740 1 -- 172.21.15.78:0/3308147442 shutdown_connections 2024-09-17T03:12:36.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.372+0000 7ff3a8226740 1 -- 172.21.15.78:0/3308147442 wait complete. 2024-09-17T03:12:36.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.372+0000 7ff3a8226740 1 -- start start 2024-09-17T03:12:36.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.372+0000 7ff3a8226740 1 Processor -- start 2024-09-17T03:12:36.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.374+0000 7ff3a8226740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687794d0 0x556268b8f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.374+0000 7ff3a8226740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687816b0 0x556268b62080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.374+0000 7ff3a8226740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687a2390 0x556268b43cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.374+0000 7ff3a8226740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55626881c740 con 0x5562687816b0 2024-09-17T03:12:36.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.374+0000 7ff3a8226740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556268a517f0 con 0x5562687a2390 2024-09-17T03:12:36.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.374+0000 7ff3a8226740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x556268b74c50 con 0x5562687794d0 2024-09-17T03:12:36.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.374+0000 7ff3a8226740 10 client.0 _ll_register_callbacks cb 0x556268a552a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:12:36.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.374+0000 7ff39259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687816b0 0x556268b62080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.374+0000 7ff39259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687816b0 0x556268b62080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47938/0 (socket says 172.21.15.78:47938) 2024-09-17T03:12:36.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.374+0000 7ff39259c640 1 -- 172.21.15.78:0/1008085629 learned_addr learned my addr 172.21.15.78:0/1008085629 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:36.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.374+0000 7ff39b59e640 1 --2- 172.21.15.78:0/1008085629 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687a2390 0x556268b43cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.374+0000 7ff39ad9d640 1 --2- 172.21.15.78:0/1008085629 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687794d0 0x556268b8f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.374+0000 7ff39259c640 1 -- 172.21.15.78:0/1008085629 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687794d0 msgr2=0x556268b8f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.374+0000 7ff39259c640 1 --2- 172.21.15.78:0/1008085629 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687794d0 0x556268b8f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.374+0000 7ff39259c640 1 -- 172.21.15.78:0/1008085629 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687a2390 msgr2=0x556268b43cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.374+0000 7ff39259c640 1 --2- 172.21.15.78:0/1008085629 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687a2390 0x556268b43cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.374+0000 7ff39259c640 1 -- 172.21.15.78:0/1008085629 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562688847d0 con 0x5562687816b0 2024-09-17T03:12:36.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.374+0000 7ff39b59e640 1 --2- 172.21.15.78:0/1008085629 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687a2390 0x556268b43cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:36.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.374+0000 7ff39259c640 1 --2- 172.21.15.78:0/1008085629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687816b0 0x556268b62080 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ff384021040 tx=0x7ff384015f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf5b1d1d906abb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:36.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.374+0000 7ff379ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:12:36.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.375+0000 7ff379ffb640 1 -- 172.21.15.78:0/1008085629 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3840138e0 con 0x5562687816b0 2024-09-17T03:12:36.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.375+0000 7ff379ffb640 1 -- 172.21.15.78:0/1008085629 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7ff384033aa0 con 0x5562687816b0 2024-09-17T03:12:36.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.375+0000 7ff3a8226740 1 -- 172.21.15.78:0/1008085629 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff384024070 con 0x5562687816b0 2024-09-17T03:12:36.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.375+0000 7ff379ffb640 1 -- 172.21.15.78:0/1008085629 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7ff38403a050 con 0x5562687816b0 2024-09-17T03:12:36.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.375+0000 7ff3a8226740 10 client.6711 fetch_fsmap learned FSMap version 54 2024-09-17T03:12:36.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.375+0000 7ff3a8226740 1 -- 172.21.15.78:0/1008085629 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x556268b8fc20 con 0x5562687816b0 2024-09-17T03:12:36.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.375+0000 7ff379ffb640 1 -- 172.21.15.78:0/1008085629 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff384024070 con 0x5562687816b0 2024-09-17T03:12:36.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.375+0000 7ff379ffb640 1 -- 172.21.15.78:0/1008085629 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 54) ==== 3558+0+0 (secure 0 0 0) 0x7ff38403d020 con 0x5562687816b0 2024-09-17T03:12:36.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.375+0000 7ff3a8226740 10 client.6711 fetch_fsmap finished waiting for FSMap version 54 2024-09-17T03:12:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.375+0000 7ff3a8226740 10 client.6711 resolve_mds: resolved 4:2 to role '4:2' aka daemon mds.a 2024-09-17T03:12:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.375+0000 7ff3a8226740 20 client.6711 populate_metadata read hostname 'smithi078' 2024-09-17T03:12:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.375+0000 7ff3a8226740 1 --2- 172.21.15.78:0/1008085629 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x556268760f60 0x556268b60a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.375+0000 7ff3a8226740 4 client.6711 mds_command: new command op to 5758 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:12:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.375+0000 7ff3a8226740 1 -- 172.21.15.78:0/1008085629 --> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556268abe830 con 0x556268760f60 2024-09-17T03:12:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.375+0000 7ff39ad9d640 1 --2- 172.21.15.78:0/1008085629 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x556268760f60 0x556268b60a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.375+0000 7ff379ffb640 10 client.6711 ms_handle_connect on v2:172.21.15.78:6833/1865992966 2024-09-17T03:12:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.375+0000 7ff39ad9d640 1 --2- 172.21.15.78:0/1008085629 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x556268760f60 0x556268b60a50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4c332856346eff9e server_cookie=7a2f844da271ee20 in_seq=0 out_seq=0 2024-09-17T03:12:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.376+0000 7ff379ffb640 1 -- 172.21.15.78:0/1008085629 <== mds.2 v2:172.21.15.78:6833/1865992966 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556268abe830 con 0x556268760f60 2024-09-17T03:12:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.376+0000 7ff379ffb640 10 client.6711 handle_command_reply: tid=0 2024-09-17T03:12:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.376+0000 7ff3a8226740 1 client.6711 shutdown 2024-09-17T03:12:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.376+0000 7ff3a8226740 1 -- 172.21.15.78:0/1008085629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687816b0 msgr2=0x556268b62080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.376+0000 7ff3a8226740 1 --2- 172.21.15.78:0/1008085629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687816b0 0x556268b62080 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7ff384021040 tx=0x7ff384015f70 comp rx=0 tx=0).stop 2024-09-17T03:12:36.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.376+0000 7ff3a8226740 1 -- 172.21.15.78:0/1008085629 shutdown_connections 2024-09-17T03:12:36.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.376+0000 7ff3a8226740 1 --2- 172.21.15.78:0/1008085629 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x556268760f60 0x556268b60a50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.376+0000 7ff3a8226740 1 --2- 172.21.15.78:0/1008085629 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687a2390 0x556268b43cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.376+0000 7ff3a8226740 1 --2- 172.21.15.78:0/1008085629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687816b0 0x556268b62080 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.376+0000 7ff3a8226740 1 --2- 172.21.15.78:0/1008085629 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687794d0 0x556268b8f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.376+0000 7ff379ffb640 0 client.6711 ms_handle_reset on v2:172.21.15.78:6833/1865992966 2024-09-17T03:12:36.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.376+0000 7ff3a8226740 1 -- 172.21.15.78:0/1008085629 >> 172.21.15.78:0/1008085629 conn(0x5562687964e0 msgr2=0x556268b44d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:36.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.376+0000 7ff3a8226740 1 -- 172.21.15.78:0/1008085629 shutdown_connections 2024-09-17T03:12:36.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.376+0000 7ff3a8226740 1 -- 172.21.15.78:0/1008085629 wait complete. 2024-09-17T03:12:36.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.377+0000 7ff3a8226740 20 client.6711 trim_cache size 0 max 16384 2024-09-17T03:12:36.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.390+0000 7ff3a8226740 1 Processor -- start 2024-09-17T03:12:36.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.390+0000 7ff3a8226740 1 -- start start 2024-09-17T03:12:36.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.391+0000 7ff3a8226740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687794d0 0x556268b88c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.391+0000 7ff3a8226740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687816b0 0x556268bb1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.391+0000 7ff3a8226740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687a2390 0x556268bb2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.391+0000 7ff3a8226740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c200120 con 0x5562687a2390 2024-09-17T03:12:36.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.391+0000 7ff3a8226740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c1ff2c0 con 0x5562687794d0 2024-09-17T03:12:36.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.391+0000 7ff3a8226740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff39c1ff9f0 con 0x5562687816b0 2024-09-17T03:12:36.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.391+0000 7ff39b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687a2390 0x556268bb2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.391+0000 7ff39b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687a2390 0x556268bb2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47954/0 (socket says 172.21.15.78:47954) 2024-09-17T03:12:36.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.391+0000 7ff39b59e640 1 -- 172.21.15.78:0/3747621851 learned_addr learned my addr 172.21.15.78:0/3747621851 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:36.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.391+0000 7ff39259c640 1 --2- 172.21.15.78:0/3747621851 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687816b0 0x556268bb1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.391+0000 7ff39ad9d640 1 --2- 172.21.15.78:0/3747621851 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687794d0 0x556268b88c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.392+0000 7ff39b59e640 1 -- 172.21.15.78:0/3747621851 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687816b0 msgr2=0x556268bb1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.392+0000 7ff39b59e640 1 --2- 172.21.15.78:0/3747621851 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687816b0 0x556268bb1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.392+0000 7ff39b59e640 1 -- 172.21.15.78:0/3747621851 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687794d0 msgr2=0x556268b88c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.392+0000 7ff39b59e640 1 --2- 172.21.15.78:0/3747621851 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687794d0 0x556268b88c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.392+0000 7ff39b59e640 1 -- 172.21.15.78:0/3747621851 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556268b45ea0 con 0x5562687a2390 2024-09-17T03:12:36.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.392+0000 7ff39b59e640 1 --2- 172.21.15.78:0/3747621851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687a2390 0x556268bb2480 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7ff394014450 tx=0x7ff3940019d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835f2b1eac95649d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:36.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.392+0000 7ff37bfff640 1 -- 172.21.15.78:0/3747621851 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39401a070 con 0x5562687a2390 2024-09-17T03:12:36.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.392+0000 7ff37bfff640 1 -- 172.21.15.78:0/3747621851 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff394016800 con 0x5562687a2390 2024-09-17T03:12:36.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.392+0000 7ff37bfff640 1 -- 172.21.15.78:0/3747621851 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff394016c50 con 0x5562687a2390 2024-09-17T03:12:36.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.393+0000 7ff3a8226740 1 -- 172.21.15.78:0/3747621851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687a2390 msgr2=0x556268bb2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.393+0000 7ff3a8226740 1 --2- 172.21.15.78:0/3747621851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687a2390 0x556268bb2480 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7ff394014450 tx=0x7ff3940019d0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.393+0000 7ff3a8226740 1 -- 172.21.15.78:0/3747621851 shutdown_connections 2024-09-17T03:12:36.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.393+0000 7ff3a8226740 1 --2- 172.21.15.78:0/3747621851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687a2390 0x556268bb2480 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.393+0000 7ff3a8226740 1 --2- 172.21.15.78:0/3747621851 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687816b0 0x556268bb1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.393+0000 7ff3a8226740 1 --2- 172.21.15.78:0/3747621851 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687794d0 0x556268b88c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.393+0000 7ff3a8226740 1 -- 172.21.15.78:0/3747621851 >> 172.21.15.78:0/3747621851 conn(0x5562687964e0 msgr2=0x556268b4b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:36.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.393+0000 7ff3a8226740 1 -- 172.21.15.78:0/3747621851 shutdown_connections 2024-09-17T03:12:36.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.393+0000 7ff3a8226740 1 -- 172.21.15.78:0/3747621851 wait complete. 2024-09-17T03:12:36.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.394+0000 7ff3a8226740 1 -- start start 2024-09-17T03:12:36.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.394+0000 7ff3a8226740 1 Processor -- start 2024-09-17T03:12:36.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.395+0000 7ff3a8226740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687794d0 0x556268bf3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.395+0000 7ff3a8226740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687816b0 0x556268b9c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.395+0000 7ff3a8226740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687a2390 0x556268b9caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.395+0000 7ff3a8226740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c1fe3e0 con 0x5562687816b0 2024-09-17T03:12:36.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.395+0000 7ff3a8226740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556268c110a0 con 0x5562687794d0 2024-09-17T03:12:36.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.395+0000 7ff3a8226740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x556268c11380 con 0x5562687a2390 2024-09-17T03:12:36.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.395+0000 7ff3a8226740 10 client.0 _ll_register_callbacks cb 0x7ff384006ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:12:36.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.395+0000 7ff39259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687816b0 0x556268b9c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.395+0000 7ff39259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687816b0 0x556268b9c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47962/0 (socket says 172.21.15.78:47962) 2024-09-17T03:12:36.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.395+0000 7ff39259c640 1 -- 172.21.15.78:0/1838078447 learned_addr learned my addr 172.21.15.78:0/1838078447 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:36.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.395+0000 7ff39ad9d640 1 --2- 172.21.15.78:0/1838078447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687794d0 0x556268bf3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.395+0000 7ff39b59e640 1 --2- 172.21.15.78:0/1838078447 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687a2390 0x556268b9caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.395+0000 7ff39259c640 1 -- 172.21.15.78:0/1838078447 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687a2390 msgr2=0x556268b9caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.395+0000 7ff39259c640 1 --2- 172.21.15.78:0/1838078447 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687a2390 0x556268b9caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.395+0000 7ff39259c640 1 -- 172.21.15.78:0/1838078447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687794d0 msgr2=0x556268bf3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:12:36.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.395+0000 7ff39259c640 1 --2- 172.21.15.78:0/1838078447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687794d0 0x556268bf3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.395+0000 7ff39259c640 1 -- 172.21.15.78:0/1838078447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556268c11660 con 0x5562687816b0 2024-09-17T03:12:36.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.395+0000 7ff39ad9d640 1 --2- 172.21.15.78:0/1838078447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687794d0 0x556268bf3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:36.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.395+0000 7ff39b59e640 1 --2- 172.21.15.78:0/1838078447 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687a2390 0x556268b9caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:36.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.396+0000 7ff39259c640 1 --2- 172.21.15.78:0/1838078447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687816b0 0x556268b9c5b0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x556268b5f2e0 tx=0x7ff384013dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c70890a4ecd072 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:36.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.396+0000 7ff379ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:12:36.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.396+0000 7ff379ffb640 1 -- 172.21.15.78:0/1838078447 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3840325f0 con 0x5562687816b0 2024-09-17T03:12:36.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.396+0000 7ff379ffb640 1 -- 172.21.15.78:0/1838078447 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7ff384032790 con 0x5562687816b0 2024-09-17T03:12:36.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.396+0000 7ff3a8226740 1 -- 172.21.15.78:0/1838078447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff394016800 con 0x5562687816b0 2024-09-17T03:12:36.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.396+0000 7ff379ffb640 1 -- 172.21.15.78:0/1838078447 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7ff38404d050 con 0x5562687816b0 2024-09-17T03:12:36.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.396+0000 7ff3a8226740 10 client.6717 fetch_fsmap learned FSMap version 54 2024-09-17T03:12:36.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.396+0000 7ff3a8226740 1 -- 172.21.15.78:0/1838078447 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) -- 0x556268b90880 con 0x5562687816b0 2024-09-17T03:12:36.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.396+0000 7ff379ffb640 1 -- 172.21.15.78:0/1838078447 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff394016800 con 0x5562687816b0 2024-09-17T03:12:36.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.396+0000 7ff379ffb640 1 -- 172.21.15.78:0/1838078447 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 54) ==== 3558+0+0 (secure 0 0 0) 0x7ff384050020 con 0x5562687816b0 2024-09-17T03:12:36.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.396+0000 7ff3a8226740 10 client.6717 fetch_fsmap finished waiting for FSMap version 54 2024-09-17T03:12:36.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.396+0000 7ff3a8226740 10 client.6717 resolve_mds: resolved 4:2 to role '4:2' aka daemon mds.a 2024-09-17T03:12:36.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.396+0000 7ff3a8226740 20 client.6717 populate_metadata read hostname 'smithi078' 2024-09-17T03:12:36.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.396+0000 7ff3a8226740 1 --2- 172.21.15.78:0/1838078447 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x556268b43560 0x556268b5e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.396+0000 7ff3a8226740 4 client.6717 mds_command: new command op to 5758 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-17T03:12:36.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.396+0000 7ff3a8226740 1 -- 172.21.15.78:0/1838078447 --> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556268aba2e0 con 0x556268b43560 2024-09-17T03:12:36.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.396+0000 7ff39ad9d640 1 --2- 172.21.15.78:0/1838078447 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x556268b43560 0x556268b5e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.397+0000 7ff379ffb640 10 client.6717 ms_handle_connect on v2:172.21.15.78:6833/1865992966 2024-09-17T03:12:36.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.397+0000 7ff39ad9d640 1 --2- 172.21.15.78:0/1838078447 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x556268b43560 0x556268b5e120 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=46f408e1e317450f server_cookie=3a37f00773fff7af in_seq=0 out_seq=0 2024-09-17T03:12:36.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.397+0000 7ff379ffb640 1 -- 172.21.15.78:0/1838078447 <== mds.2 v2:172.21.15.78:6833/1865992966 1 ==== command_reply(tid 0: 0 ) ==== 8+0+295 (crc 0 0 0) 0x556268aba2e0 con 0x556268b43560 2024-09-17T03:12:36.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.397+0000 7ff379ffb640 10 client.6717 handle_command_reply: tid=0 2024-09-17T03:12:36.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.397+0000 7ff3a8226740 1 client.6717 shutdown 2024-09-17T03:12:36.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.397+0000 7ff3a8226740 1 -- 172.21.15.78:0/1838078447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687816b0 msgr2=0x556268b9c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.397+0000 7ff3a8226740 1 --2- 172.21.15.78:0/1838078447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687816b0 0x556268b9c5b0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x556268b5f2e0 tx=0x7ff384013dc0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.397+0000 7ff3a8226740 1 -- 172.21.15.78:0/1838078447 shutdown_connections 2024-09-17T03:12:36.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.397+0000 7ff3a8226740 1 --2- 172.21.15.78:0/1838078447 >> [v2:172.21.15.78:6833/1865992966,v1:172.21.15.78:6835/1865992966] conn(0x556268b43560 0x556268b5e120 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.397+0000 7ff3a8226740 1 --2- 172.21.15.78:0/1838078447 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5562687a2390 0x556268b9caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.397+0000 7ff379ffb640 0 client.6717 ms_handle_reset on v2:172.21.15.78:6833/1865992966 2024-09-17T03:12:36.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.397+0000 7ff3a8226740 1 --2- 172.21.15.78:0/1838078447 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5562687816b0 0x556268b9c5b0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.397+0000 7ff3a8226740 1 --2- 172.21.15.78:0/1838078447 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5562687794d0 0x556268bf3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.397+0000 7ff3a8226740 1 -- 172.21.15.78:0/1838078447 >> 172.21.15.78:0/1838078447 conn(0x5562687964e0 msgr2=0x556268b88c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:36.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.397+0000 7ff3a8226740 1 -- 172.21.15.78:0/1838078447 shutdown_connections 2024-09-17T03:12:36.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.397+0000 7ff3a8226740 1 -- 172.21.15.78:0/1838078447 wait complete. 2024-09-17T03:12:36.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.397+0000 7ff3a8226740 20 client.6717 trim_cache size 0 max 16384 2024-09-17T03:12:36.403 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2024-09-17T03:12:36.403 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:36.403 INFO:teuthology.orchestra.run.smithi078.stdout: "damage_type": "backtrace", 2024-09-17T03:12:36.403 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 903149839, 2024-09-17T03:12:36.403 INFO:teuthology.orchestra.run.smithi078.stdout: "ino": 1099511627782, 2024-09-17T03:12:36.403 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3/d4/d5/d6/d7" 2024-09-17T03:12:36.403 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:36.403 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:36.403 INFO:teuthology.orchestra.run.smithi078.stdout: "damage_type": "backtrace", 2024-09-17T03:12:36.403 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 2824917001, 2024-09-17T03:12:36.403 INFO:teuthology.orchestra.run.smithi078.stdout: "ino": 1099511627783, 2024-09-17T03:12:36.404 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3/d4/d5/d6/d7/d8" 2024-09-17T03:12:36.404 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:36.404 INFO:teuthology.orchestra.run.smithi078.stdout:] 2024-09-17T03:12:36.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.398+0000 7ff3a11df640 1 -- 172.21.15.78:0/669033587 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff37c078bc0 msgr2=0x7ff37c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.398+0000 7ff3a11df640 1 --2- 172.21.15.78:0/669033587 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff37c078bc0 0x7ff37c07b0d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff39c0cc970 tx=0x7ff384009060 comp rx=0 tx=0).stop 2024-09-17T03:12:36.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.398+0000 7ff3a11df640 1 -- 172.21.15.78:0/669033587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff39c0d2460 msgr2=0x7ff39c1486e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.398+0000 7ff3a11df640 1 --2- 172.21.15.78:0/669033587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff39c0d2460 0x7ff39c1486e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009780 tx=0x7ff38c033d60 comp rx=0 tx=0).stop 2024-09-17T03:12:36.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.398+0000 7ff3a11df640 1 -- 172.21.15.78:0/669033587 shutdown_connections 2024-09-17T03:12:36.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.398+0000 7ff3a11df640 1 --2- 172.21.15.78:0/669033587 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff37c078bc0 0x7ff37c07b0d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.398+0000 7ff3a11df640 1 --2- 172.21.15.78:0/669033587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff39c15d670 0x7ff39c1f77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.398+0000 7ff3a11df640 1 --2- 172.21.15.78:0/669033587 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff39c1570e0 0x7ff39c1f7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.398+0000 7ff3a11df640 1 --2- 172.21.15.78:0/669033587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff39c0d2460 0x7ff39c1486e0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.398+0000 7ff3a11df640 1 -- 172.21.15.78:0/669033587 >> 172.21.15.78:0/669033587 conn(0x7ff39c06d550 msgr2=0x7ff39c0d0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:36.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.398+0000 7ff3a11df640 1 -- 172.21.15.78:0/669033587 shutdown_connections 2024-09-17T03:12:36.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.398+0000 7ff3a11df640 1 -- 172.21.15.78:0/669033587 wait complete. 2024-09-17T03:12:36.408 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:12:36.408 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:12:36.460 DEBUG:teuthology.orchestra.run.smithi193:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:12:36.502 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:12:36.503 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:12:36.503 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:12:36.503 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:12:36.521 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:12:36.521 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:12:36.578 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:12:36.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.731+0000 7f1bd2f07640 1 -- 172.21.15.78:0/56476276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb4004d40 msgr2=0x7f1bb4005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.731+0000 7f1bd2f07640 1 --2- 172.21.15.78:0/56476276 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb4004d40 0x7f1bb4005150 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1bc400c610 tx=0x7f1bb4005830 comp rx=0 tx=0).stop 2024-09-17T03:12:36.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.731+0000 7f1bd14a4640 1 -- 172.21.15.78:0/56476276 reap_dead start 2024-09-17T03:12:36.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.731+0000 7f1bd2f07640 1 -- 172.21.15.78:0/56476276 shutdown_connections 2024-09-17T03:12:36.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.731+0000 7f1bd2f07640 1 -- 172.21.15.78:0/56476276 >> 172.21.15.78:0/56476276 conn(0x7f1bcc0cd530 msgr2=0x7f1bcc0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:36.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.731+0000 7f1bd2f07640 1 -- 172.21.15.78:0/56476276 shutdown_connections 2024-09-17T03:12:36.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.731+0000 7f1bd2f07640 1 -- 172.21.15.78:0/56476276 wait complete. 2024-09-17T03:12:36.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.733+0000 7f1bd2f07640 1 Processor -- start 2024-09-17T03:12:36.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.733+0000 7f1bd2f07640 1 -- start start 2024-09-17T03:12:36.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bd2f07640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bcc1f7f20 0x7f1bcc158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bd2f07640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bcc15a980 0x7f1bcc138040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bd2f07640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1bcc13b630 0x7f1bcc13ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bd2f07640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc0ccee0 con 0x7f1bcc1f7f20 2024-09-17T03:12:36.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bd2f07640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1bcc0ccd60 con 0x7f1bcc15a980 2024-09-17T03:12:36.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bd2f07640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f1bcc075cf0 con 0x7f1bcc13b630 2024-09-17T03:12:36.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bd0ca3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bcc1f7f20 0x7f1bcc158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bd0ca3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bcc1f7f20 0x7f1bcc158d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47974/0 (socket says 172.21.15.78:47974) 2024-09-17T03:12:36.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bd0ca3640 1 -- 172.21.15.78:0/2603061520 learned_addr learned my addr 172.21.15.78:0/2603061520 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:36.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bcbfff640 1 --2- 172.21.15.78:0/2603061520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bcc15a980 0x7f1bcc138040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bd14a4640 1 --2- 172.21.15.78:0/2603061520 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1bcc13b630 0x7f1bcc13ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bd0ca3640 1 -- 172.21.15.78:0/2603061520 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1bcc13b630 msgr2=0x7f1bcc13ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bd0ca3640 1 --2- 172.21.15.78:0/2603061520 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1bcc13b630 0x7f1bcc13ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bd0ca3640 1 -- 172.21.15.78:0/2603061520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bcc15a980 msgr2=0x7f1bcc138040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bd0ca3640 1 --2- 172.21.15.78:0/2603061520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bcc15a980 0x7f1bcc138040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bd0ca3640 1 -- 172.21.15.78:0/2603061520 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bcc13bf80 con 0x7f1bcc1f7f20 2024-09-17T03:12:36.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bd14a4640 1 --2- 172.21.15.78:0/2603061520 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1bcc13b630 0x7f1bcc13ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:12:36.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bcbfff640 1 --2- 172.21.15.78:0/2603061520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bcc15a980 0x7f1bcc138040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:36.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bd0ca3640 1 --2- 172.21.15.78:0/2603061520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bcc1f7f20 0x7f1bcc158d80 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc011ae0 tx=0x7f1bbc009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:36.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bc97fa640 1 -- 172.21.15.78:0/2603061520 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc00fcb0 con 0x7f1bcc1f7f20 2024-09-17T03:12:36.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bc97fa640 1 -- 172.21.15.78:0/2603061520 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bbc00fe50 con 0x7f1bcc1f7f20 2024-09-17T03:12:36.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bc97fa640 1 -- 172.21.15.78:0/2603061520 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc004280 con 0x7f1bcc1f7f20 2024-09-17T03:12:36.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bd2f07640 1 -- 172.21.15.78:0/2603061520 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bcc13a2a0 con 0x7f1bcc1f7f20 2024-09-17T03:12:36.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.735+0000 7f1bd2f07640 1 -- 172.21.15.78:0/2603061520 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bcc1f7440 con 0x7f1bcc1f7f20 2024-09-17T03:12:36.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.736+0000 7f1bd2f07640 1 -- 172.21.15.78:0/2603061520 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bcc1f7230 con 0x7f1bcc1f7f20 2024-09-17T03:12:36.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.737+0000 7f1bc97fa640 1 -- 172.21.15.78:0/2603061520 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1bbc0035f0 con 0x7f1bcc1f7f20 2024-09-17T03:12:36.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.738+0000 7f1bc97fa640 1 --2- 172.21.15.78:0/2603061520 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1bb8078b90 0x7f1bb807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:36.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.738+0000 7f1bc97fa640 1 -- 172.21.15.78:0/2603061520 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f1bbc09c060 con 0x7f1bcc1f7f20 2024-09-17T03:12:36.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.738+0000 7f1bcbfff640 1 --2- 172.21.15.78:0/2603061520 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1bb8078b90 0x7f1bb807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:36.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.738+0000 7f1bcbfff640 1 --2- 172.21.15.78:0/2603061520 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1bb8078b90 0x7f1bb807b0a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc1f8330 tx=0x7f1bc0005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:36.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.741+0000 7f1bc97fa640 1 -- 172.21.15.78:0/2603061520 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1bcc13bf80 con 0x7f1bcc1f7f20 2024-09-17T03:12:36.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.928+0000 7f1bd2f07640 1 -- 172.21.15.78:0/2603061520 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1bcc076280 con 0x7f1bcc1f7f20 2024-09-17T03:12:36.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.928+0000 7f1bc97fa640 1 -- 172.21.15.78:0/2603061520 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v58) ==== 80+0+0 (secure 0 0 0) 0x7f1bbc064610 con 0x7f1bcc1f7f20 2024-09-17T03:12:36.927 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-09-17T03:12:36.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.931+0000 7f1bd2f07640 1 -- 172.21.15.78:0/2603061520 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1bb8078b90 msgr2=0x7f1bb807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.931+0000 7f1bd2f07640 1 --2- 172.21.15.78:0/2603061520 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1bb8078b90 0x7f1bb807b0a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc1f8330 tx=0x7f1bc0005f90 comp rx=0 tx=0).stop 2024-09-17T03:12:36.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.931+0000 7f1bd2f07640 1 -- 172.21.15.78:0/2603061520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bcc1f7f20 msgr2=0x7f1bcc158d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:36.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.931+0000 7f1bd2f07640 1 --2- 172.21.15.78:0/2603061520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bcc1f7f20 0x7f1bcc158d80 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc011ae0 tx=0x7f1bbc009f10 comp rx=0 tx=0).stop 2024-09-17T03:12:36.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.931+0000 7f1bd2f07640 1 -- 172.21.15.78:0/2603061520 shutdown_connections 2024-09-17T03:12:36.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.931+0000 7f1bd2f07640 1 --2- 172.21.15.78:0/2603061520 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1bcc13b630 0x7f1bcc13ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.931+0000 7f1bd2f07640 1 --2- 172.21.15.78:0/2603061520 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1bb8078b90 0x7f1bb807b0a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.931+0000 7f1bd2f07640 1 --2- 172.21.15.78:0/2603061520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bcc15a980 0x7f1bcc138040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.931+0000 7f1bd2f07640 1 --2- 172.21.15.78:0/2603061520 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bcc1f7f20 0x7f1bcc158d80 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:36.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.931+0000 7f1bd2f07640 1 -- 172.21.15.78:0/2603061520 >> 172.21.15.78:0/2603061520 conn(0x7f1bcc0cd530 msgr2=0x7f1bcc0b64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:36.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.931+0000 7f1bd2f07640 1 -- 172.21.15.78:0/2603061520 shutdown_connections 2024-09-17T03:12:36.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:36.931+0000 7f1bd2f07640 1 -- 172.21.15.78:0/2603061520 wait complete. 2024-09-17T03:12:36.940 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:12:36.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:12:36.940 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:12:36.969 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T03:12:36.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:12:36.970 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:12:37.025 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:12:37.026 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:12:37.026 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:12:37.046 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:12:37.046 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:12:37.046 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:12:37.046 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:12:37.081 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056010,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1013 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:12:37.081 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:12:37.081 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:12:37.081 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:12:37.107 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:12:37.108 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:12:37.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.234+0000 7fe8534a2640 1 -- 172.21.15.78:0/1070065590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84c0cffd0 msgr2=0x7fe84c0d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:37.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.234+0000 7fe8534a2640 1 --2- 172.21.15.78:0/1070065590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84c0cffd0 0x7fe84c0d4940 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fe844005fd0 tx=0x7fe84402aa10 comp rx=0 tx=0).stop 2024-09-17T03:12:37.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.234+0000 7fe8534a2640 1 -- 172.21.15.78:0/1070065590 shutdown_connections 2024-09-17T03:12:37.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.234+0000 7fe8534a2640 1 --2- 172.21.15.78:0/1070065590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84c0cffd0 0x7fe84c0d4940 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:37.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.234+0000 7fe8534a2640 1 -- 172.21.15.78:0/1070065590 >> 172.21.15.78:0/1070065590 conn(0x7fe84c08bfc0 msgr2=0x7fe84c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:37.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.234+0000 7fe8534a2640 1 -- 172.21.15.78:0/1070065590 shutdown_connections 2024-09-17T03:12:37.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.234+0000 7fe8534a2640 1 -- 172.21.15.78:0/1070065590 wait complete. 2024-09-17T03:12:37.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.236+0000 7fe8534a2640 1 Processor -- start 2024-09-17T03:12:37.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.236+0000 7fe8534a2640 1 -- start start 2024-09-17T03:12:37.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.237+0000 7fe8534a2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe84c0b3910 0x7fe84c0c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:37.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.237+0000 7fe8534a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84c0cfbc0 0x7fe84c153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:37.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.237+0000 7fe8534a2640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe84c0cffd0 0x7fe84c0d1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:37.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.237+0000 7fe8534a2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c0b34c0 con 0x7fe84c0cfbc0 2024-09-17T03:12:37.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.237+0000 7fe8534a2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe84c0b3340 con 0x7fe84c0b3910 2024-09-17T03:12:37.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.237+0000 7fe8534a2640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe84c0b5a80 con 0x7fe84c0cffd0 2024-09-17T03:12:37.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.237+0000 7fe850a3d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84c0cfbc0 0x7fe84c153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:37.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.237+0000 7fe850a3d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84c0cfbc0 0x7fe84c153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47992/0 (socket says 172.21.15.78:47992) 2024-09-17T03:12:37.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.237+0000 7fe850a3d640 1 -- 172.21.15.78:0/3366585413 learned_addr learned my addr 172.21.15.78:0/3366585413 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:37.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.237+0000 7fe85123e640 1 --2- 172.21.15.78:0/3366585413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe84c0b3910 0x7fe84c0c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:37.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.237+0000 7fe851a3f640 1 --2- 172.21.15.78:0/3366585413 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe84c0cffd0 0x7fe84c0d1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:37.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.237+0000 7fe850a3d640 1 -- 172.21.15.78:0/3366585413 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe84c0cffd0 msgr2=0x7fe84c0d1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:37.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.237+0000 7fe850a3d640 1 --2- 172.21.15.78:0/3366585413 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe84c0cffd0 0x7fe84c0d1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:37.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.237+0000 7fe850a3d640 1 -- 172.21.15.78:0/3366585413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe84c0b3910 msgr2=0x7fe84c0c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:37.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.237+0000 7fe850a3d640 1 --2- 172.21.15.78:0/3366585413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe84c0b3910 0x7fe84c0c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:37.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.237+0000 7fe850a3d640 1 -- 172.21.15.78:0/3366585413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe84c0c9970 con 0x7fe84c0cfbc0 2024-09-17T03:12:37.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.237+0000 7fe85123e640 1 --2- 172.21.15.78:0/3366585413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe84c0b3910 0x7fe84c0c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:37.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.238+0000 7fe850a3d640 1 --2- 172.21.15.78:0/3366585413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84c0cfbc0 0x7fe84c153b90 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00b3f0 tx=0x7fe83c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:37.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.238+0000 7fe841ffb640 1 -- 172.21.15.78:0/3366585413 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83c015020 con 0x7fe84c0cfbc0 2024-09-17T03:12:37.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.238+0000 7fe841ffb640 1 -- 172.21.15.78:0/3366585413 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe83c011920 con 0x7fe84c0cfbc0 2024-09-17T03:12:37.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.238+0000 7fe8534a2640 1 -- 172.21.15.78:0/3366585413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe84c0c9c50 con 0x7fe84c0cfbc0 2024-09-17T03:12:37.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.238+0000 7fe841ffb640 1 -- 172.21.15.78:0/3366585413 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83c011d70 con 0x7fe84c0cfbc0 2024-09-17T03:12:37.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.238+0000 7fe8534a2640 1 -- 172.21.15.78:0/3366585413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe84c0ca210 con 0x7fe84c0cfbc0 2024-09-17T03:12:37.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.239+0000 7fe8534a2640 1 -- 172.21.15.78:0/3366585413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe84c0b4230 con 0x7fe84c0cfbc0 2024-09-17T03:12:37.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.240+0000 7fe841ffb640 1 -- 172.21.15.78:0/3366585413 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe83c018020 con 0x7fe84c0cfbc0 2024-09-17T03:12:37.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.240+0000 7fe841ffb640 1 --2- 172.21.15.78:0/3366585413 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe830078b90 0x7fe83007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:37.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.240+0000 7fe841ffb640 1 -- 172.21.15.78:0/3366585413 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fe83c09aa40 con 0x7fe84c0cfbc0 2024-09-17T03:12:37.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.240+0000 7fe85123e640 1 --2- 172.21.15.78:0/3366585413 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe830078b90 0x7fe83007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:37.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.241+0000 7fe85123e640 1 --2- 172.21.15.78:0/3366585413 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe830078b90 0x7fe83007b0a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe848007fd0 tx=0x7fe848009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:37.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.245+0000 7fe841ffb640 1 -- 172.21.15.78:0/3366585413 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe83c01f030 con 0x7fe84c0cfbc0 2024-09-17T03:12:37.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.458+0000 7fe8534a2640 1 -- 172.21.15.78:0/3366585413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe84c0c9700 con 0x7fe84c0cfbc0 2024-09-17T03:12:37.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.459+0000 7fe841ffb640 1 -- 172.21.15.78:0/3366585413 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5267 (secure 0 0 0) 0x7fe83c09ae20 con 0x7fe84c0cfbc0 2024-09-17T03:12:37.458 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:12:37.458 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":54,"btime":"2024-09-17T03:12:09:316430+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/33195895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":33195895},{"type":"v1","addr":"172.21.15.193:6836","nonce":33195895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:11:32.250686+0000","modified":"2024-09-17T03:12:09.271608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6231,"mds_1":5773,"mds_2":5758},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5758":{"gid":5758,"name":"a","rank":2,"incarnation":49,"state":"up:active","state_seq":12,"addr":"172.21.15.78:6835/1865992966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1865992966},{"type":"v1","addr":"172.21.15.78:6835","nonce":1865992966}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5773":{"gid":5773,"name":"b","rank":1,"incarnation":47,"state":"up:active","state_seq":12,"addr":"172.21.15.193:6837/2730762656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2730762656},{"type":"v1","addr":"172.21.15.193:6837","nonce":2730762656}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6231":{"gid":6231,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":12,"addr":"172.21.15.78:6834/936871583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":936871583},{"type":"v1","addr":"172.21.15.78:6834","nonce":936871583}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6231,"qdb_cluster":[5758,5773,6231]},"id":4}]} 2024-09-17T03:12:37.458 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 54 2024-09-17T03:12:37.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.461+0000 7fe8534a2640 1 -- 172.21.15.78:0/3366585413 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe830078b90 msgr2=0x7fe83007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:37.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.461+0000 7fe8534a2640 1 --2- 172.21.15.78:0/3366585413 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe830078b90 0x7fe83007b0a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe848007fd0 tx=0x7fe848009040 comp rx=0 tx=0).stop 2024-09-17T03:12:37.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.461+0000 7fe8534a2640 1 -- 172.21.15.78:0/3366585413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84c0cfbc0 msgr2=0x7fe84c153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:37.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.461+0000 7fe8534a2640 1 --2- 172.21.15.78:0/3366585413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84c0cfbc0 0x7fe84c153b90 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe83c00b3f0 tx=0x7fe83c00b8b0 comp rx=0 tx=0).stop 2024-09-17T03:12:37.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.461+0000 7fe8534a2640 1 -- 172.21.15.78:0/3366585413 shutdown_connections 2024-09-17T03:12:37.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.461+0000 7fe8534a2640 1 --2- 172.21.15.78:0/3366585413 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe84c0cffd0 0x7fe84c0d1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:37.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.461+0000 7fe8534a2640 1 --2- 172.21.15.78:0/3366585413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe84c0cfbc0 0x7fe84c153b90 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:37.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.461+0000 7fe8534a2640 1 --2- 172.21.15.78:0/3366585413 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe830078b90 0x7fe83007b0a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:37.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.461+0000 7fe8534a2640 1 --2- 172.21.15.78:0/3366585413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe84c0b3910 0x7fe84c0c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:37.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.461+0000 7fe8534a2640 1 -- 172.21.15.78:0/3366585413 >> 172.21.15.78:0/3366585413 conn(0x7fe84c08bfc0 msgr2=0x7fe84c0d4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:37.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.461+0000 7fe8534a2640 1 -- 172.21.15.78:0/3366585413 shutdown_connections 2024-09-17T03:12:37.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.461+0000 7fe8534a2640 1 -- 172.21.15.78:0/3366585413 wait complete. 2024-09-17T03:12:37.471 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:12:37.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.584+0000 7f55f184d640 1 -- 172.21.15.78:0/4064999176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0cf7a0 msgr2=0x7f55ec1626e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:37.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.584+0000 7f55f184d640 1 --2- 172.21.15.78:0/4064999176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0cf7a0 0x7f55ec1626e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f55ec08d4e0 tx=0x7f55e402a560 comp rx=0 tx=0).stop 2024-09-17T03:12:37.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.584+0000 7f55f184d640 1 -- 172.21.15.78:0/4064999176 shutdown_connections 2024-09-17T03:12:37.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.584+0000 7f55f184d640 1 --2- 172.21.15.78:0/4064999176 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0cf7a0 0x7f55ec1626e0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:37.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.584+0000 7f55f184d640 1 --2- 172.21.15.78:0/4064999176 >> v2:172.21.15.193:3300/0 conn(0x7f55ec0d2ed0 0x7f55ec0d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:37.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.584+0000 7f55f184d640 1 -- 172.21.15.78:0/4064999176 >> 172.21.15.78:0/4064999176 conn(0x7f55ec08bfc0 msgr2=0x7f55ec09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:37.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.584+0000 7f55f184d640 1 -- 172.21.15.78:0/4064999176 shutdown_connections 2024-09-17T03:12:37.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.584+0000 7f55f184d640 1 -- 172.21.15.78:0/4064999176 wait complete. 2024-09-17T03:12:37.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.586+0000 7f55f184d640 1 Processor -- start 2024-09-17T03:12:37.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.586+0000 7f55f184d640 1 -- start start 2024-09-17T03:12:37.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.587+0000 7f55f184d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0b9b70 0x7f55ec0cd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:37.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.587+0000 7f55f184d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f55ec0cf7a0 0x7f55ec0ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:37.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.587+0000 7f55f184d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55ec0d2ed0 0x7f55ec0ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:37.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.587+0000 7f55f184d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f55ec162c20 con 0x7f55ec0b9b70 2024-09-17T03:12:37.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.587+0000 7f55f184d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f55ec0cfed0 con 0x7f55ec0d2ed0 2024-09-17T03:12:37.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.587+0000 7f55f184d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f55ec162da0 con 0x7f55ec0cf7a0 2024-09-17T03:12:37.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.587+0000 7f55eaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0b9b70 0x7f55ec0cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:37.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.587+0000 7f55eaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0b9b70 0x7f55ec0cd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48006/0 (socket says 172.21.15.78:48006) 2024-09-17T03:12:37.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.587+0000 7f55eaffd640 1 -- 172.21.15.78:0/175241746 learned_addr learned my addr 172.21.15.78:0/175241746 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:37.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.587+0000 7f55ea7fc640 1 --2- 172.21.15.78:0/175241746 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f55ec0cf7a0 0x7f55ec0ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:37.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.587+0000 7f55eb7fe640 1 --2- 172.21.15.78:0/175241746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55ec0d2ed0 0x7f55ec0ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:37.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.587+0000 7f55eaffd640 1 -- 172.21.15.78:0/175241746 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f55ec0cf7a0 msgr2=0x7f55ec0ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:37.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.587+0000 7f55eaffd640 1 --2- 172.21.15.78:0/175241746 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f55ec0cf7a0 0x7f55ec0ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:37.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.587+0000 7f55eaffd640 1 -- 172.21.15.78:0/175241746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55ec0d2ed0 msgr2=0x7f55ec0ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:37.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.587+0000 7f55eaffd640 1 --2- 172.21.15.78:0/175241746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55ec0d2ed0 0x7f55ec0ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:37.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.587+0000 7f55eaffd640 1 -- 172.21.15.78:0/175241746 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55ec0cdc40 con 0x7f55ec0b9b70 2024-09-17T03:12:37.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.587+0000 7f55eaffd640 1 --2- 172.21.15.78:0/175241746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0b9b70 0x7f55ec0cd700 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00ba50 tx=0x7f55dc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:37.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.588+0000 7f55d3fff640 1 -- 172.21.15.78:0/175241746 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc019070 con 0x7f55ec0b9b70 2024-09-17T03:12:37.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.588+0000 7f55d3fff640 1 -- 172.21.15.78:0/175241746 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55dc00ccf0 con 0x7f55ec0b9b70 2024-09-17T03:12:37.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.588+0000 7f55f184d640 1 -- 172.21.15.78:0/175241746 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55ec0cded0 con 0x7f55ec0b9b70 2024-09-17T03:12:37.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.588+0000 7f55d3fff640 1 -- 172.21.15.78:0/175241746 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55dc0146a0 con 0x7f55ec0b9b70 2024-09-17T03:12:37.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.588+0000 7f55f184d640 1 -- 172.21.15.78:0/175241746 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55ec0c8bf0 con 0x7f55ec0b9b70 2024-09-17T03:12:37.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.589+0000 7f55f184d640 1 -- 172.21.15.78:0/175241746 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55ec1633b0 con 0x7f55ec0b9b70 2024-09-17T03:12:37.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.590+0000 7f55d3fff640 1 -- 172.21.15.78:0/175241746 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f55dc01c070 con 0x7f55ec0b9b70 2024-09-17T03:12:37.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.590+0000 7f55d3fff640 1 --2- 172.21.15.78:0/175241746 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f55d8078b90 0x7f55d807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:37.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.590+0000 7f55d3fff640 1 -- 172.21.15.78:0/175241746 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f55dc09abd0 con 0x7f55ec0b9b70 2024-09-17T03:12:37.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.590+0000 7f55ea7fc640 1 --2- 172.21.15.78:0/175241746 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f55d8078b90 0x7f55d807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:37.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.591+0000 7f55ea7fc640 1 --2- 172.21.15.78:0/175241746 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f55d8078b90 0x7f55d807b0a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f55e0006fd0 tx=0x7f55e0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:37.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.594+0000 7f55d3fff640 1 -- 172.21.15.78:0/175241746 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f55dc062f90 con 0x7f55ec0b9b70 2024-09-17T03:12:37.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.805+0000 7f55f184d640 1 -- 172.21.15.78:0/175241746 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55ec051040 con 0x7f55ec0b9b70 2024-09-17T03:12:37.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.806+0000 7f55d3fff640 1 -- 172.21.15.78:0/175241746 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5267 (secure 0 0 0) 0x7f55dc062890 con 0x7f55ec0b9b70 2024-09-17T03:12:37.805 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:12:37.805 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":54,"btime":"2024-09-17T03:12:09:316430+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/33195895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":33195895},{"type":"v1","addr":"172.21.15.193:6836","nonce":33195895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:11:32.250686+0000","modified":"2024-09-17T03:12:09.271608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6231,"mds_1":5773,"mds_2":5758},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5758":{"gid":5758,"name":"a","rank":2,"incarnation":49,"state":"up:active","state_seq":12,"addr":"172.21.15.78:6835/1865992966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1865992966},{"type":"v1","addr":"172.21.15.78:6835","nonce":1865992966}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5773":{"gid":5773,"name":"b","rank":1,"incarnation":47,"state":"up:active","state_seq":12,"addr":"172.21.15.193:6837/2730762656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2730762656},{"type":"v1","addr":"172.21.15.193:6837","nonce":2730762656}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6231":{"gid":6231,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":12,"addr":"172.21.15.78:6834/936871583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":936871583},{"type":"v1","addr":"172.21.15.78:6834","nonce":936871583}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6231,"qdb_cluster":[5758,5773,6231]},"id":4}]} 2024-09-17T03:12:37.805 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 54 2024-09-17T03:12:37.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.808+0000 7f55f184d640 1 -- 172.21.15.78:0/175241746 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f55d8078b90 msgr2=0x7f55d807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:37.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.808+0000 7f55f184d640 1 --2- 172.21.15.78:0/175241746 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f55d8078b90 0x7f55d807b0a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f55e0006fd0 tx=0x7f55e0008040 comp rx=0 tx=0).stop 2024-09-17T03:12:37.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.808+0000 7f55f184d640 1 -- 172.21.15.78:0/175241746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0b9b70 msgr2=0x7f55ec0cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:37.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.808+0000 7f55f184d640 1 --2- 172.21.15.78:0/175241746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0b9b70 0x7f55ec0cd700 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00ba50 tx=0x7f55dc00bf10 comp rx=0 tx=0).stop 2024-09-17T03:12:37.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.808+0000 7f55f184d640 1 -- 172.21.15.78:0/175241746 shutdown_connections 2024-09-17T03:12:37.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.808+0000 7f55f184d640 1 --2- 172.21.15.78:0/175241746 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f55d8078b90 0x7f55d807b0a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:37.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.808+0000 7f55f184d640 1 --2- 172.21.15.78:0/175241746 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55ec0d2ed0 0x7f55ec0ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:37.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.808+0000 7f55f184d640 1 --2- 172.21.15.78:0/175241746 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f55ec0cf7a0 0x7f55ec0ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:37.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.808+0000 7f55f184d640 1 --2- 172.21.15.78:0/175241746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55ec0b9b70 0x7f55ec0cd700 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:37.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.808+0000 7f55f184d640 1 -- 172.21.15.78:0/175241746 >> 172.21.15.78:0/175241746 conn(0x7f55ec08bfc0 msgr2=0x7f55ec0ce480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:37.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.808+0000 7f55f184d640 1 -- 172.21.15.78:0/175241746 shutdown_connections 2024-09-17T03:12:37.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.808+0000 7f55f184d640 1 -- 172.21.15.78:0/175241746 wait complete. 2024-09-17T03:12:37.818 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:12:37.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.932+0000 7f9e04b8b640 1 -- 172.21.15.78:0/2509800751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9de8003fd0 msgr2=0x7f9de8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:37.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.932+0000 7f9e04b8b640 1 --2- 172.21.15.78:0/2509800751 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9de8003fd0 0x7f9de8004800 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f9df400c290 tx=0x7f9de8005830 comp rx=0 tx=0).stop 2024-09-17T03:12:37.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.932+0000 7f9dfed9d640 1 -- 172.21.15.78:0/2509800751 reap_dead start 2024-09-17T03:12:37.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.932+0000 7f9e04b8b640 1 -- 172.21.15.78:0/2509800751 shutdown_connections 2024-09-17T03:12:37.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.932+0000 7f9e04b8b640 1 -- 172.21.15.78:0/2509800751 >> 172.21.15.78:0/2509800751 conn(0x7f9e000d15f0 msgr2=0x7f9e00073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:37.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.932+0000 7f9e04b8b640 1 -- 172.21.15.78:0/2509800751 shutdown_connections 2024-09-17T03:12:37.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.932+0000 7f9e04b8b640 1 -- 172.21.15.78:0/2509800751 wait complete. 2024-09-17T03:12:37.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.934+0000 7f9e04b8b640 1 Processor -- start 2024-09-17T03:12:37.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.934+0000 7f9e04b8b640 1 -- start start 2024-09-17T03:12:37.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9e04b8b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9de8003fd0 0x7f9e000ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:37.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9e04b8b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9e000cbf90 0x7f9e000cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:37.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9e04b8b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e0015a9b0 0x7f9e0015adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:37.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9e04b8b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9e000d03a0 con 0x7f9de8003fd0 2024-09-17T03:12:37.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9e04b8b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9e00142910 con 0x7f9e0015a9b0 2024-09-17T03:12:37.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9e04b8b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f9e000d0520 con 0x7f9e000cbf90 2024-09-17T03:12:37.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9dfe59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9de8003fd0 0x7f9e000ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:37.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9dfe59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9de8003fd0 0x7f9e000ca7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48030/0 (socket says 172.21.15.78:48030) 2024-09-17T03:12:37.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9dfe59c640 1 -- 172.21.15.78:0/1274490145 learned_addr learned my addr 172.21.15.78:0/1274490145 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:37.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9dfdd9b640 1 --2- 172.21.15.78:0/1274490145 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9e000cbf90 0x7f9e000cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:37.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9dfed9d640 1 --2- 172.21.15.78:0/1274490145 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e0015a9b0 0x7f9e0015adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:37.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9dfe59c640 1 -- 172.21.15.78:0/1274490145 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9e000cbf90 msgr2=0x7f9e000cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:37.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9dfe59c640 1 --2- 172.21.15.78:0/1274490145 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9e000cbf90 0x7f9e000cc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:37.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9dfe59c640 1 -- 172.21.15.78:0/1274490145 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e0015a9b0 msgr2=0x7f9e0015adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:37.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9dfe59c640 1 --2- 172.21.15.78:0/1274490145 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e0015a9b0 0x7f9e0015adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:37.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9dfe59c640 1 -- 172.21.15.78:0/1274490145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0015b300 con 0x7f9de8003fd0 2024-09-17T03:12:37.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9dfed9d640 1 --2- 172.21.15.78:0/1274490145 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e0015a9b0 0x7f9e0015adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:37.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9dfe59c640 1 --2- 172.21.15.78:0/1274490145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9de8003fd0 0x7f9e000ca7f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f9df0011b10 tx=0x7f9df0009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:37.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9deeffd640 1 -- 172.21.15.78:0/1274490145 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df001e070 con 0x7f9de8003fd0 2024-09-17T03:12:37.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9deeffd640 1 -- 172.21.15.78:0/1274490145 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9df0004460 con 0x7f9de8003fd0 2024-09-17T03:12:37.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9e04b8b640 1 -- 172.21.15.78:0/1274490145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e0013b360 con 0x7f9de8003fd0 2024-09-17T03:12:37.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9deeffd640 1 -- 172.21.15.78:0/1274490145 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9df000fc70 con 0x7f9de8003fd0 2024-09-17T03:12:37.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.936+0000 7f9e04b8b640 1 -- 172.21.15.78:0/1274490145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e000cb240 con 0x7f9de8003fd0 2024-09-17T03:12:37.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.937+0000 7f9e04b8b640 1 -- 172.21.15.78:0/1274490145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e000cfe60 con 0x7f9de8003fd0 2024-09-17T03:12:37.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.938+0000 7f9deeffd640 1 -- 172.21.15.78:0/1274490145 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9df0021070 con 0x7f9de8003fd0 2024-09-17T03:12:37.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.939+0000 7f9deeffd640 1 --2- 172.21.15.78:0/1274490145 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9de0078b90 0x7f9de007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:37.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.939+0000 7f9deeffd640 1 -- 172.21.15.78:0/1274490145 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f9df009b660 con 0x7f9de8003fd0 2024-09-17T03:12:37.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.939+0000 7f9dfdd9b640 1 --2- 172.21.15.78:0/1274490145 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9de0078b90 0x7f9de007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:37.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.940+0000 7f9dfdd9b640 1 --2- 172.21.15.78:0/1274490145 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9de0078b90 0x7f9de007b0a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9df4033000 tx=0x7f9df4038040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:37.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:37.943+0000 7f9deeffd640 1 -- 172.21.15.78:0/1274490145 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9e0015b300 con 0x7f9de8003fd0 2024-09-17T03:12:38.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.118+0000 7f9e04b8b640 1 -- 172.21.15.78:0/1274490145 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e0015fe10 con 0x7f9de8003fd0 2024-09-17T03:12:38.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.119+0000 7f9deeffd640 1 -- 172.21.15.78:0/1274490145 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+16701 (secure 0 0 0) 0x7f9df0063510 con 0x7f9de8003fd0 2024-09-17T03:12:38.118 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:12:38.118 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":58,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:11:33.896530+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:11:29.890641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T03:11:31.216226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:12:38.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.121+0000 7f9e04b8b640 1 -- 172.21.15.78:0/1274490145 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9de0078b90 msgr2=0x7f9de007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:38.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.121+0000 7f9e04b8b640 1 --2- 172.21.15.78:0/1274490145 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9de0078b90 0x7f9de007b0a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9df4033000 tx=0x7f9df4038040 comp rx=0 tx=0).stop 2024-09-17T03:12:38.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.121+0000 7f9e04b8b640 1 -- 172.21.15.78:0/1274490145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9de8003fd0 msgr2=0x7f9e000ca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:38.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.121+0000 7f9e04b8b640 1 --2- 172.21.15.78:0/1274490145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9de8003fd0 0x7f9e000ca7f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f9df0011b10 tx=0x7f9df0009e90 comp rx=0 tx=0).stop 2024-09-17T03:12:38.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.121+0000 7f9e04b8b640 1 -- 172.21.15.78:0/1274490145 shutdown_connections 2024-09-17T03:12:38.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.121+0000 7f9e04b8b640 1 --2- 172.21.15.78:0/1274490145 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9de0078b90 0x7f9de007b0a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.121+0000 7f9e04b8b640 1 --2- 172.21.15.78:0/1274490145 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e0015a9b0 0x7f9e0015adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.121+0000 7f9e04b8b640 1 --2- 172.21.15.78:0/1274490145 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9e000cbf90 0x7f9e000cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.121+0000 7f9e04b8b640 1 --2- 172.21.15.78:0/1274490145 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9de8003fd0 0x7f9e000ca7f0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.121+0000 7f9e04b8b640 1 -- 172.21.15.78:0/1274490145 >> 172.21.15.78:0/1274490145 conn(0x7f9e000d15f0 msgr2=0x7f9e00140800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:38.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.121+0000 7f9e04b8b640 1 -- 172.21.15.78:0/1274490145 shutdown_connections 2024-09-17T03:12:38.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.121+0000 7f9e04b8b640 1 -- 172.21.15.78:0/1274490145 wait complete. 2024-09-17T03:12:38.131 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:12:38.132 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:12:38.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.245+0000 7f653e9a8640 1 -- 172.21.15.78:0/1579893765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65380706c0 msgr2=0x7f6538072ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:38.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.245+0000 7f653e9a8640 1 --2- 172.21.15.78:0/1579893765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65380706c0 0x7f6538072ff0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f65380cffa0 tx=0x7f653002aa00 comp rx=0 tx=0).stop 2024-09-17T03:12:38.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.245+0000 7f653e9a8640 1 -- 172.21.15.78:0/1579893765 shutdown_connections 2024-09-17T03:12:38.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.245+0000 7f653e9a8640 1 --2- 172.21.15.78:0/1579893765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65380706c0 0x7f6538072ff0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.245+0000 7f653e9a8640 1 --2- 172.21.15.78:0/1579893765 >> v2:172.21.15.193:3300/0 conn(0x7f65380cd3e0 0x7f6538070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.245+0000 7f653e9a8640 1 --2- 172.21.15.78:0/1579893765 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f65380af780 0x7f65380b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.245+0000 7f653e9a8640 1 -- 172.21.15.78:0/1579893765 >> 172.21.15.78:0/1579893765 conn(0x7f653806d7d0 msgr2=0x7f65380b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:38.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.245+0000 7f653e9a8640 1 -- 172.21.15.78:0/1579893765 shutdown_connections 2024-09-17T03:12:38.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.245+0000 7f653e9a8640 1 -- 172.21.15.78:0/1579893765 wait complete. 2024-09-17T03:12:38.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.246+0000 7f653e9a8640 1 Processor -- start 2024-09-17T03:12:38.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.247+0000 7f653e9a8640 1 -- start start 2024-09-17T03:12:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.248+0000 7f653e9a8640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f65380706c0 0x7f65381f6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.248+0000 7f653e9a8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65380af780 0x7f65381582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.248+0000 7f653e9a8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65380cd3e0 0x7f65381547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.248+0000 7f653e9a8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6538073930 con 0x7f65380af780 2024-09-17T03:12:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.248+0000 7f653e9a8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f65380737b0 con 0x7f65380cd3e0 2024-09-17T03:12:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.248+0000 7f653e9a8640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f6538073ab0 con 0x7f65380706c0 2024-09-17T03:12:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.248+0000 7f65377fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65380af780 0x7f65381582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.248+0000 7f65377fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65380af780 0x7f65381582a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48046/0 (socket says 172.21.15.78:48046) 2024-09-17T03:12:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.248+0000 7f65377fe640 1 -- 172.21.15.78:0/3299181736 learned_addr learned my addr 172.21.15.78:0/3299181736 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.248+0000 7f6537fff640 1 --2- 172.21.15.78:0/3299181736 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f65380706c0 0x7f65381f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.248+0000 7f653cf45640 1 --2- 172.21.15.78:0/3299181736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65380cd3e0 0x7f65381547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.248+0000 7f65377fe640 1 -- 172.21.15.78:0/3299181736 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f65380706c0 msgr2=0x7f65381f6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.248+0000 7f65377fe640 1 --2- 172.21.15.78:0/3299181736 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f65380706c0 0x7f65381f6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.248+0000 7f65377fe640 1 -- 172.21.15.78:0/3299181736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65380cd3e0 msgr2=0x7f65381547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:38.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.248+0000 7f65377fe640 1 --2- 172.21.15.78:0/3299181736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65380cd3e0 0x7f65381547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.248+0000 7f65377fe640 1 -- 172.21.15.78:0/3299181736 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6538157fa0 con 0x7f65380af780 2024-09-17T03:12:38.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.248+0000 7f653cf45640 1 --2- 172.21.15.78:0/3299181736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65380cd3e0 0x7f65381547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:38.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.249+0000 7f65377fe640 1 --2- 172.21.15.78:0/3299181736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65380af780 0x7f65381582a0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f652c00c9a0 tx=0x7f652c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:38.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.249+0000 7f6534ff9640 1 -- 172.21.15.78:0/3299181736 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c007bb0 con 0x7f65380af780 2024-09-17T03:12:38.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.249+0000 7f6534ff9640 1 -- 172.21.15.78:0/3299181736 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f652c007e40 con 0x7f65380af780 2024-09-17T03:12:38.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.249+0000 7f6534ff9640 1 -- 172.21.15.78:0/3299181736 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c00f690 con 0x7f65380af780 2024-09-17T03:12:38.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.249+0000 7f653e9a8640 1 -- 172.21.15.78:0/3299181736 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65381e8d70 con 0x7f65380af780 2024-09-17T03:12:38.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.249+0000 7f653e9a8640 1 -- 172.21.15.78:0/3299181736 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65381e9330 con 0x7f65380af780 2024-09-17T03:12:38.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.250+0000 7f653e9a8640 1 -- 172.21.15.78:0/3299181736 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65380b39c0 con 0x7f65380af780 2024-09-17T03:12:38.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.250+0000 7f6534ff9640 1 -- 172.21.15.78:0/3299181736 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f652c00f830 con 0x7f65380af780 2024-09-17T03:12:38.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.251+0000 7f6534ff9640 1 --2- 172.21.15.78:0/3299181736 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6524078b90 0x7f652407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:38.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.251+0000 7f6534ff9640 1 -- 172.21.15.78:0/3299181736 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f652c09b460 con 0x7f65380af780 2024-09-17T03:12:38.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.251+0000 7f6537fff640 1 --2- 172.21.15.78:0/3299181736 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6524078b90 0x7f652407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:38.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.252+0000 7f6537fff640 1 --2- 172.21.15.78:0/3299181736 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6524078b90 0x7f652407b0a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f65280058c0 tx=0x7f6528005f60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:38.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.255+0000 7f6534ff9640 1 -- 172.21.15.78:0/3299181736 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f652c014030 con 0x7f65380af780 2024-09-17T03:12:38.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.467+0000 7f653e9a8640 1 -- 172.21.15.78:0/3299181736 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65381e9500 con 0x7f65380af780 2024-09-17T03:12:38.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.467+0000 7f6534ff9640 1 -- 172.21.15.78:0/3299181736 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5267 (secure 0 0 0) 0x7f652c0638a0 con 0x7f65380af780 2024-09-17T03:12:38.466 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:12:38.466 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":54,"btime":"2024-09-17T03:12:09:316430+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/33195895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":33195895},{"type":"v1","addr":"172.21.15.193:6836","nonce":33195895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:11:32.250686+0000","modified":"2024-09-17T03:12:09.271608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6231,"mds_1":5773,"mds_2":5758},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5758":{"gid":5758,"name":"a","rank":2,"incarnation":49,"state":"up:active","state_seq":12,"addr":"172.21.15.78:6835/1865992966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1865992966},{"type":"v1","addr":"172.21.15.78:6835","nonce":1865992966}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5773":{"gid":5773,"name":"b","rank":1,"incarnation":47,"state":"up:active","state_seq":12,"addr":"172.21.15.193:6837/2730762656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2730762656},{"type":"v1","addr":"172.21.15.193:6837","nonce":2730762656}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6231":{"gid":6231,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":12,"addr":"172.21.15.78:6834/936871583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":936871583},{"type":"v1","addr":"172.21.15.78:6834","nonce":936871583}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6231,"qdb_cluster":[5758,5773,6231]},"id":4}]} 2024-09-17T03:12:38.467 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 54 2024-09-17T03:12:38.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.469+0000 7f653e9a8640 1 -- 172.21.15.78:0/3299181736 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6524078b90 msgr2=0x7f652407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:38.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.469+0000 7f653e9a8640 1 --2- 172.21.15.78:0/3299181736 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6524078b90 0x7f652407b0a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f65280058c0 tx=0x7f6528005f60 comp rx=0 tx=0).stop 2024-09-17T03:12:38.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.469+0000 7f653e9a8640 1 -- 172.21.15.78:0/3299181736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65380af780 msgr2=0x7f65381582a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:38.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.469+0000 7f653e9a8640 1 --2- 172.21.15.78:0/3299181736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65380af780 0x7f65381582a0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f652c00c9a0 tx=0x7f652c00ce60 comp rx=0 tx=0).stop 2024-09-17T03:12:38.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.470+0000 7f653e9a8640 1 -- 172.21.15.78:0/3299181736 shutdown_connections 2024-09-17T03:12:38.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.470+0000 7f653e9a8640 1 --2- 172.21.15.78:0/3299181736 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6524078b90 0x7f652407b0a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.470+0000 7f653e9a8640 1 --2- 172.21.15.78:0/3299181736 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f65380cd3e0 0x7f65381547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.470+0000 7f653e9a8640 1 --2- 172.21.15.78:0/3299181736 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65380af780 0x7f65381582a0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.470+0000 7f653e9a8640 1 --2- 172.21.15.78:0/3299181736 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f65380706c0 0x7f65381f6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.470+0000 7f653e9a8640 1 -- 172.21.15.78:0/3299181736 >> 172.21.15.78:0/3299181736 conn(0x7f653806d7d0 msgr2=0x7f65380745b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:38.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.470+0000 7f653e9a8640 1 -- 172.21.15.78:0/3299181736 shutdown_connections 2024-09-17T03:12:38.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.470+0000 7f653e9a8640 1 -- 172.21.15.78:0/3299181736 wait complete. 2024-09-17T03:12:38.480 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:12:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.594+0000 7f30ed8bd640 1 -- 172.21.15.78:0/1004052420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30d0003a30 msgr2=0x7f30d0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.594+0000 7f30ed8bd640 1 --2- 172.21.15.78:0/1004052420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30d0003a30 0x7f30d0003ea0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f30d8006fc0 tx=0x7f30d0005830 comp rx=0 tx=0).stop 2024-09-17T03:12:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.594+0000 7f30e77fe640 1 -- 172.21.15.78:0/1004052420 reap_dead start 2024-09-17T03:12:38.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.594+0000 7f30ed8bd640 1 -- 172.21.15.78:0/1004052420 shutdown_connections 2024-09-17T03:12:38.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.594+0000 7f30ed8bd640 1 -- 172.21.15.78:0/1004052420 >> 172.21.15.78:0/1004052420 conn(0x7f30e808bfc0 msgr2=0x7f30e809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:38.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.594+0000 7f30ed8bd640 1 -- 172.21.15.78:0/1004052420 shutdown_connections 2024-09-17T03:12:38.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.594+0000 7f30ed8bd640 1 -- 172.21.15.78:0/1004052420 wait complete. 2024-09-17T03:12:38.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.596+0000 7f30ed8bd640 1 Processor -- start 2024-09-17T03:12:38.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.596+0000 7f30ed8bd640 1 -- start start 2024-09-17T03:12:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.597+0000 7f30ed8bd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30d0003a30 0x7f30e81f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.597+0000 7f30ed8bd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f30e80a18b0 0x7f30e80b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.597+0000 7f30ed8bd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e80a1cc0 0x7f30e80b7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.597+0000 7f30ed8bd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f30e80cf2e0 con 0x7f30e80a1cc0 2024-09-17T03:12:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.597+0000 7f30ed8bd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f30e80cf160 con 0x7f30e80a18b0 2024-09-17T03:12:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.597+0000 7f30ed8bd640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f30e80d0ce0 con 0x7f30d0003a30 2024-09-17T03:12:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.597+0000 7f30e77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e80a1cc0 0x7f30e80b7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.597+0000 7f30e77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e80a1cc0 0x7f30e80b7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48056/0 (socket says 172.21.15.78:48056) 2024-09-17T03:12:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.597+0000 7f30e77fe640 1 -- 172.21.15.78:0/1056419440 learned_addr learned my addr 172.21.15.78:0/1056419440 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.597+0000 7f30e6ffd640 1 --2- 172.21.15.78:0/1056419440 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30d0003a30 0x7f30e81f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.598+0000 7f30e67fc640 1 --2- 172.21.15.78:0/1056419440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f30e80a18b0 0x7f30e80b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.598+0000 7f30e77fe640 1 -- 172.21.15.78:0/1056419440 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30d0003a30 msgr2=0x7f30e81f4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.598+0000 7f30e77fe640 1 --2- 172.21.15.78:0/1056419440 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30d0003a30 0x7f30e81f4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.598+0000 7f30e77fe640 1 -- 172.21.15.78:0/1056419440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f30e80a18b0 msgr2=0x7f30e80b79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.598+0000 7f30e77fe640 1 --2- 172.21.15.78:0/1056419440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f30e80a18b0 0x7f30e80b79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.598+0000 7f30e77fe640 1 -- 172.21.15.78:0/1056419440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e81f5970 con 0x7f30e80a1cc0 2024-09-17T03:12:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.598+0000 7f30e77fe640 1 --2- 172.21.15.78:0/1056419440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e80a1cc0 0x7f30e80b7f00 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f30e80d0410 tx=0x7f30e0010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.598+0000 7f30cffff640 1 -- 172.21.15.78:0/1056419440 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e0003970 con 0x7f30e80a1cc0 2024-09-17T03:12:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.598+0000 7f30cffff640 1 -- 172.21.15.78:0/1056419440 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30e0015070 con 0x7f30e80a1cc0 2024-09-17T03:12:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.598+0000 7f30ed8bd640 1 -- 172.21.15.78:0/1056419440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e81f5c50 con 0x7f30e80a1cc0 2024-09-17T03:12:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.598+0000 7f30cffff640 1 -- 172.21.15.78:0/1056419440 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e0004030 con 0x7f30e80a1cc0 2024-09-17T03:12:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.598+0000 7f30ed8bd640 1 -- 172.21.15.78:0/1056419440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e81f53f0 con 0x7f30e80a1cc0 2024-09-17T03:12:38.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.599+0000 7f30ed8bd640 1 -- 172.21.15.78:0/1056419440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e806e170 con 0x7f30e80a1cc0 2024-09-17T03:12:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.600+0000 7f30cffff640 1 -- 172.21.15.78:0/1056419440 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f30e00041d0 con 0x7f30e80a1cc0 2024-09-17T03:12:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.600+0000 7f30cffff640 1 --2- 172.21.15.78:0/1056419440 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f30d4078b90 0x7f30d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:38.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.600+0000 7f30cffff640 1 -- 172.21.15.78:0/1056419440 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f30e009b660 con 0x7f30e80a1cc0 2024-09-17T03:12:38.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.601+0000 7f30e6ffd640 1 --2- 172.21.15.78:0/1056419440 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f30d4078b90 0x7f30d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:38.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.601+0000 7f30e6ffd640 1 --2- 172.21.15.78:0/1056419440 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f30d4078b90 0x7f30d407b0a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f30d8033000 tx=0x7f30d8038040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:38.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.605+0000 7f30cffff640 1 -- 172.21.15.78:0/1056419440 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f30e0063570 con 0x7f30e80a1cc0 2024-09-17T03:12:38.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.813+0000 7f30ed8bd640 1 -- 172.21.15.78:0/1056419440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30e81f5700 con 0x7f30e80a1cc0 2024-09-17T03:12:38.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.814+0000 7f30cffff640 1 -- 172.21.15.78:0/1056419440 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+5267 (secure 0 0 0) 0x7f30e0067fa0 con 0x7f30e80a1cc0 2024-09-17T03:12:38.813 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:12:38.813 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":54,"btime":"2024-09-17T03:12:09:316430+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/33195895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":33195895},{"type":"v1","addr":"172.21.15.193:6836","nonce":33195895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:11:32.250686+0000","modified":"2024-09-17T03:12:09.271608+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6231,"mds_1":5773,"mds_2":5758},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5758":{"gid":5758,"name":"a","rank":2,"incarnation":49,"state":"up:active","state_seq":12,"addr":"172.21.15.78:6835/1865992966","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1865992966},{"type":"v1","addr":"172.21.15.78:6835","nonce":1865992966}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_5773":{"gid":5773,"name":"b","rank":1,"incarnation":47,"state":"up:active","state_seq":12,"addr":"172.21.15.193:6837/2730762656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2730762656},{"type":"v1","addr":"172.21.15.193:6837","nonce":2730762656}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6231":{"gid":6231,"name":"c","rank":0,"incarnation":43,"state":"up:active","state_seq":12,"addr":"172.21.15.78:6834/936871583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":936871583},{"type":"v1","addr":"172.21.15.78:6834","nonce":936871583}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6231,"qdb_cluster":[5758,5773,6231]},"id":4}]} 2024-09-17T03:12:38.813 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 54 2024-09-17T03:12:38.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.816+0000 7f30ed8bd640 1 -- 172.21.15.78:0/1056419440 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f30d4078b90 msgr2=0x7f30d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:38.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.816+0000 7f30ed8bd640 1 --2- 172.21.15.78:0/1056419440 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f30d4078b90 0x7f30d407b0a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f30d8033000 tx=0x7f30d8038040 comp rx=0 tx=0).stop 2024-09-17T03:12:38.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.816+0000 7f30ed8bd640 1 -- 172.21.15.78:0/1056419440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e80a1cc0 msgr2=0x7f30e80b7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:38.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.816+0000 7f30ed8bd640 1 --2- 172.21.15.78:0/1056419440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e80a1cc0 0x7f30e80b7f00 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f30e80d0410 tx=0x7f30e0010f40 comp rx=0 tx=0).stop 2024-09-17T03:12:38.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.816+0000 7f30ed8bd640 1 -- 172.21.15.78:0/1056419440 shutdown_connections 2024-09-17T03:12:38.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.816+0000 7f30ed8bd640 1 --2- 172.21.15.78:0/1056419440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f30e80a1cc0 0x7f30e80b7f00 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.816+0000 7f30ed8bd640 1 --2- 172.21.15.78:0/1056419440 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f30d4078b90 0x7f30d407b0a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.816+0000 7f30ed8bd640 1 --2- 172.21.15.78:0/1056419440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f30e80a18b0 0x7f30e80b79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.816+0000 7f30ed8bd640 1 --2- 172.21.15.78:0/1056419440 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30d0003a30 0x7f30e81f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.816+0000 7f30ed8bd640 1 -- 172.21.15.78:0/1056419440 >> 172.21.15.78:0/1056419440 conn(0x7f30e808bfc0 msgr2=0x7f30e80b89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:38.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.816+0000 7f30ed8bd640 1 -- 172.21.15.78:0/1056419440 shutdown_connections 2024-09-17T03:12:38.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.816+0000 7f30ed8bd640 1 -- 172.21.15.78:0/1056419440 wait complete. 2024-09-17T03:12:38.826 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:12:38.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.940+0000 7f7dcb73a640 1 -- 172.21.15.78:0/3116377421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db0004d40 msgr2=0x7f7db0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:38.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.940+0000 7f7dcb73a640 1 --2- 172.21.15.78:0/3116377421 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db0004d40 0x7f7db0005210 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40c7ff0 tx=0x7f7db0005830 comp rx=0 tx=0).stop 2024-09-17T03:12:38.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.940+0000 7f7dc9cd7640 1 -- 172.21.15.78:0/3116377421 reap_dead start 2024-09-17T03:12:38.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.940+0000 7f7dcb73a640 1 -- 172.21.15.78:0/3116377421 shutdown_connections 2024-09-17T03:12:38.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.940+0000 7f7dcb73a640 1 -- 172.21.15.78:0/3116377421 >> 172.21.15.78:0/3116377421 conn(0x7f7dc408bfc0 msgr2=0x7f7dc409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:38.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.941+0000 7f7dcb73a640 1 -- 172.21.15.78:0/3116377421 shutdown_connections 2024-09-17T03:12:38.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.941+0000 7f7dcb73a640 1 -- 172.21.15.78:0/3116377421 wait complete. 2024-09-17T03:12:38.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.942+0000 7f7dcb73a640 1 Processor -- start 2024-09-17T03:12:38.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.942+0000 7f7dcb73a640 1 -- start start 2024-09-17T03:12:38.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7dcb73a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7db0004d40 0x7f7dc409e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:38.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7dcb73a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dc4160d70 0x7f7dc40b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:38.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7dcb73a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7dc4161180 0x7f7dc40b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:38.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7dcb73a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc40cf080 con 0x7f7dc4160d70 2024-09-17T03:12:38.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7dcb73a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc40d36d0 con 0x7f7dc4161180 2024-09-17T03:12:38.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7dcb73a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7dc40cf200 con 0x7f7db0004d40 2024-09-17T03:12:38.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7dc8cd5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dc4160d70 0x7f7dc40b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:38.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7dc8cd5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dc4160d70 0x7f7dc40b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48072/0 (socket says 172.21.15.78:48072) 2024-09-17T03:12:38.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7dc8cd5640 1 -- 172.21.15.78:0/2022826261 learned_addr learned my addr 172.21.15.78:0/2022826261 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:38.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7dc94d6640 1 --2- 172.21.15.78:0/2022826261 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7db0004d40 0x7f7dc409e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:38.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7dc9cd7640 1 --2- 172.21.15.78:0/2022826261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7dc4161180 0x7f7dc40b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:38.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7dc8cd5640 1 -- 172.21.15.78:0/2022826261 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7db0004d40 msgr2=0x7f7dc409e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:38.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7dc8cd5640 1 --2- 172.21.15.78:0/2022826261 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7db0004d40 0x7f7dc409e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7dc8cd5640 1 -- 172.21.15.78:0/2022826261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7dc4161180 msgr2=0x7f7dc40b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:38.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7dc8cd5640 1 --2- 172.21.15.78:0/2022826261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7dc4161180 0x7f7dc40b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:38.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7dc8cd5640 1 -- 172.21.15.78:0/2022826261 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc40ccb70 con 0x7f7dc4160d70 2024-09-17T03:12:38.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7dc8cd5640 1 --2- 172.21.15.78:0/2022826261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dc4160d70 0x7f7dc40b3f50 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f7db4003f10 tx=0x7f7db400b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:38.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7db9ffb640 1 -- 172.21.15.78:0/2022826261 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db4005220 con 0x7f7dc4160d70 2024-09-17T03:12:38.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7db9ffb640 1 -- 172.21.15.78:0/2022826261 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7db40053c0 con 0x7f7dc4160d70 2024-09-17T03:12:38.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7dcb73a640 1 -- 172.21.15.78:0/2022826261 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc40cc5b0 con 0x7f7dc4160d70 2024-09-17T03:12:38.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.944+0000 7f7db9ffb640 1 -- 172.21.15.78:0/2022826261 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db40047a0 con 0x7f7dc4160d70 2024-09-17T03:12:38.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.945+0000 7f7dcb73a640 1 -- 172.21.15.78:0/2022826261 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc40a0610 con 0x7f7dc4160d70 2024-09-17T03:12:38.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.946+0000 7f7dcb73a640 1 -- 172.21.15.78:0/2022826261 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dc406e170 con 0x7f7dc4160d70 2024-09-17T03:12:38.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.946+0000 7f7db9ffb640 1 -- 172.21.15.78:0/2022826261 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7db4004940 con 0x7f7dc4160d70 2024-09-17T03:12:38.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.947+0000 7f7db9ffb640 1 --2- 172.21.15.78:0/2022826261 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7da8078bc0 0x7f7da807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:38.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.947+0000 7f7db9ffb640 1 -- 172.21.15.78:0/2022826261 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f7db409b780 con 0x7f7dc4160d70 2024-09-17T03:12:38.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.947+0000 7f7dc94d6640 1 --2- 172.21.15.78:0/2022826261 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7da8078bc0 0x7f7da807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:38.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.948+0000 7f7dc94d6640 1 --2- 172.21.15.78:0/2022826261 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7da8078bc0 0x7f7da807b0d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0001880 tx=0x7f7dc0001650 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:38.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:38.951+0000 7f7db9ffb640 1 -- 172.21.15.78:0/2022826261 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7db4063bc0 con 0x7f7dc4160d70 2024-09-17T03:12:39.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.125+0000 7f7dcb73a640 1 -- 172.21.15.78:0/2022826261 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7dc40d0a60 con 0x7f7dc4160d70 2024-09-17T03:12:39.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.126+0000 7f7db9ffb640 1 -- 172.21.15.78:0/2022826261 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+16701 (secure 0 0 0) 0x7f7db40634c0 con 0x7f7dc4160d70 2024-09-17T03:12:39.125 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:12:39.125 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":58,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:11:33.896530+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:11:29.890641+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T03:11:31.216226+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:12:39.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.128+0000 7f7dcb73a640 1 -- 172.21.15.78:0/2022826261 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7da8078bc0 msgr2=0x7f7da807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:39.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.128+0000 7f7dcb73a640 1 --2- 172.21.15.78:0/2022826261 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7da8078bc0 0x7f7da807b0d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0001880 tx=0x7f7dc0001650 comp rx=0 tx=0).stop 2024-09-17T03:12:39.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.128+0000 7f7dcb73a640 1 -- 172.21.15.78:0/2022826261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dc4160d70 msgr2=0x7f7dc40b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:39.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.128+0000 7f7dcb73a640 1 --2- 172.21.15.78:0/2022826261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dc4160d70 0x7f7dc40b3f50 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f7db4003f10 tx=0x7f7db400b980 comp rx=0 tx=0).stop 2024-09-17T03:12:39.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.128+0000 7f7dcb73a640 1 -- 172.21.15.78:0/2022826261 shutdown_connections 2024-09-17T03:12:39.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.128+0000 7f7dcb73a640 1 --2- 172.21.15.78:0/2022826261 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7da8078bc0 0x7f7da807b0d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:39.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.128+0000 7f7dcb73a640 1 --2- 172.21.15.78:0/2022826261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7dc4161180 0x7f7dc40b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:39.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.128+0000 7f7dcb73a640 1 --2- 172.21.15.78:0/2022826261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dc4160d70 0x7f7dc40b3f50 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:39.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.128+0000 7f7dcb73a640 1 --2- 172.21.15.78:0/2022826261 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7db0004d40 0x7f7dc409e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:39.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.128+0000 7f7dcb73a640 1 -- 172.21.15.78:0/2022826261 >> 172.21.15.78:0/2022826261 conn(0x7f7dc408bfc0 msgr2=0x7f7dc40b8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:39.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.128+0000 7f7dcb73a640 1 -- 172.21.15.78:0/2022826261 shutdown_connections 2024-09-17T03:12:39.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.128+0000 7f7dcb73a640 1 -- 172.21.15.78:0/2022826261 wait complete. 2024-09-17T03:12:39.139 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:12:39.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.253+0000 7f496a99d640 1 -- 172.21.15.78:0/1817862719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640b5520 msgr2=0x7f49640cfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:39.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.253+0000 7f496a99d640 1 --2- 172.21.15.78:0/1817862719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640b5520 0x7f49640cfd70 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f4954005fd0 tx=0x7f495402aa10 comp rx=0 tx=0).stop 2024-09-17T03:12:39.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.253+0000 7f496a99d640 1 -- 172.21.15.78:0/1817862719 shutdown_connections 2024-09-17T03:12:39.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.253+0000 7f496a99d640 1 --2- 172.21.15.78:0/1817862719 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4964162d70 0x7f4964163180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:39.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.253+0000 7f496a99d640 1 --2- 172.21.15.78:0/1817862719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640b5520 0x7f49640cfd70 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:39.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.253+0000 7f496a99d640 1 -- 172.21.15.78:0/1817862719 >> 172.21.15.78:0/1817862719 conn(0x7f496409d680 msgr2=0x7f49640d4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:39.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.253+0000 7f496a99d640 1 -- 172.21.15.78:0/1817862719 shutdown_connections 2024-09-17T03:12:39.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.253+0000 7f496a99d640 1 -- 172.21.15.78:0/1817862719 wait complete. 2024-09-17T03:12:39.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.255+0000 7f496a99d640 1 Processor -- start 2024-09-17T03:12:39.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.255+0000 7f496a99d640 1 -- start start 2024-09-17T03:12:39.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.256+0000 7f496a99d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49640b5520 0x7f4964159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:39.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.256+0000 7f496a99d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640b71a0 0x7f496415e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:39.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.256+0000 7f496a99d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4964162d70 0x7f496415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:39.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.256+0000 7f496a99d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4964163a70 con 0x7f49640b71a0 2024-09-17T03:12:39.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.256+0000 7f496a99d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f49640d0d50 con 0x7f49640b5520 2024-09-17T03:12:39.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.256+0000 7f496a99d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f49640c97a0 con 0x7f4964162d70 2024-09-17T03:12:39.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.256+0000 7f496919a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640b71a0 0x7f496415e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:39.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.256+0000 7f496919a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640b71a0 0x7f496415e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48084/0 (socket says 172.21.15.78:48084) 2024-09-17T03:12:39.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.256+0000 7f496919a640 1 -- 172.21.15.78:0/1728071291 learned_addr learned my addr 172.21.15.78:0/1728071291 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:39.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.256+0000 7f496a19c640 1 --2- 172.21.15.78:0/1728071291 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4964162d70 0x7f496415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:39.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.256+0000 7f496999b640 1 --2- 172.21.15.78:0/1728071291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49640b5520 0x7f4964159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:39.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.257+0000 7f496919a640 1 -- 172.21.15.78:0/1728071291 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4964162d70 msgr2=0x7f496415e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:39.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.257+0000 7f496919a640 1 --2- 172.21.15.78:0/1728071291 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4964162d70 0x7f496415e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:39.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.257+0000 7f496919a640 1 -- 172.21.15.78:0/1728071291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49640b5520 msgr2=0x7f4964159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:39.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.257+0000 7f496919a640 1 --2- 172.21.15.78:0/1728071291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49640b5520 0x7f4964159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:39.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.257+0000 7f496919a640 1 -- 172.21.15.78:0/1728071291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4964158a30 con 0x7f49640b71a0 2024-09-17T03:12:39.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.257+0000 7f496a19c640 1 --2- 172.21.15.78:0/1728071291 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4964162d70 0x7f496415e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:39.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.257+0000 7f496999b640 1 --2- 172.21.15.78:0/1728071291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49640b5520 0x7f4964159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:39.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.257+0000 7f496919a640 1 --2- 172.21.15.78:0/1728071291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640b71a0 0x7f496415e2b0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f495800c340 tx=0x7f495800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:39.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.257+0000 7f49627fc640 1 -- 172.21.15.78:0/1728071291 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4958017070 con 0x7f49640b71a0 2024-09-17T03:12:39.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.257+0000 7f49627fc640 1 -- 172.21.15.78:0/1728071291 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49580053c0 con 0x7f49640b71a0 2024-09-17T03:12:39.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.257+0000 7f49627fc640 1 -- 172.21.15.78:0/1728071291 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4958003850 con 0x7f49640b71a0 2024-09-17T03:12:39.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.257+0000 7f496a99d640 1 -- 172.21.15.78:0/1728071291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4964157f80 con 0x7f49640b71a0 2024-09-17T03:12:39.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.257+0000 7f496a99d640 1 -- 172.21.15.78:0/1728071291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4964158d20 con 0x7f49640b71a0 2024-09-17T03:12:39.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.258+0000 7f496a99d640 1 -- 172.21.15.78:0/1728071291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49640cfd70 con 0x7f49640b71a0 2024-09-17T03:12:39.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.259+0000 7f49627fc640 1 -- 172.21.15.78:0/1728071291 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f495801a070 con 0x7f49640b71a0 2024-09-17T03:12:39.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.259+0000 7f49627fc640 1 --2- 172.21.15.78:0/1728071291 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4950078bc0 0x7f495007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:39.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.259+0000 7f49627fc640 1 -- 172.21.15.78:0/1728071291 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f495809a050 con 0x7f49640b71a0 2024-09-17T03:12:39.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.259+0000 7f496999b640 1 --2- 172.21.15.78:0/1728071291 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4950078bc0 0x7f495007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:39.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.260+0000 7f496999b640 1 --2- 172.21.15.78:0/1728071291 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4950078bc0 0x7f495007b0d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4954035000 tx=0x7f4954004ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:39.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.264+0000 7f49627fc640 1 -- 172.21.15.78:0/1728071291 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4958062490 con 0x7f49640b71a0 2024-09-17T03:12:39.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.473+0000 7f496a99d640 1 -- 172.21.15.78:0/1728071291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f496408e430 con 0x7f49640b71a0 2024-09-17T03:12:39.472 INFO:tasks.ceph.mon.a.smithi078.stderr:2024-09-17T03:12:39.474+0000 7f192af78640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:12:39.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.478+0000 7f49627fc640 1 -- 172.21.15.78:0/1728071291 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v55) ==== 161+0+0 (secure 0 0 0) 0x7f4958061d90 con 0x7f49640b71a0 2024-09-17T03:12:39.476 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:12:39.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.480+0000 7f496a99d640 1 -- 172.21.15.78:0/1728071291 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4950078bc0 msgr2=0x7f495007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:39.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.481+0000 7f496a99d640 1 --2- 172.21.15.78:0/1728071291 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4950078bc0 0x7f495007b0d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4954035000 tx=0x7f4954004ab0 comp rx=0 tx=0).stop 2024-09-17T03:12:39.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.481+0000 7f496a99d640 1 -- 172.21.15.78:0/1728071291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640b71a0 msgr2=0x7f496415e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:39.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.481+0000 7f496a99d640 1 --2- 172.21.15.78:0/1728071291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640b71a0 0x7f496415e2b0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f495800c340 tx=0x7f495800c800 comp rx=0 tx=0).stop 2024-09-17T03:12:39.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.481+0000 7f496a99d640 1 -- 172.21.15.78:0/1728071291 shutdown_connections 2024-09-17T03:12:39.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.481+0000 7f496a99d640 1 --2- 172.21.15.78:0/1728071291 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4964162d70 0x7f496415e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:39.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.481+0000 7f496a99d640 1 --2- 172.21.15.78:0/1728071291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49640b71a0 0x7f496415e2b0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:39.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.481+0000 7f496a99d640 1 --2- 172.21.15.78:0/1728071291 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4950078bc0 0x7f495007b0d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:39.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.481+0000 7f496a99d640 1 --2- 172.21.15.78:0/1728071291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49640b5520 0x7f4964159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:39.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.481+0000 7f496a99d640 1 -- 172.21.15.78:0/1728071291 >> 172.21.15.78:0/1728071291 conn(0x7f496409d680 msgr2=0x7f496406db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:39.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.481+0000 7f496a99d640 1 -- 172.21.15.78:0/1728071291 shutdown_connections 2024-09-17T03:12:39.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.481+0000 7f496a99d640 1 -- 172.21.15.78:0/1728071291 wait complete. 2024-09-17T03:12:39.484 INFO:tasks.ceph.mds.c.smithi078.stderr: -7865> 2024-09-17T03:11:48.869+0000 7f2163f89640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-17T03:12:39.484 INFO:tasks.ceph.mds.c.smithi078.stderr: -7863> 2024-09-17T03:11:48.869+0000 7f2163f89640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-17T03:12:39.487 INFO:tasks.ceph.mds.b.smithi193.stderr: -1495> 2024-09-17T03:12:05.559+0000 7efea2c16640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v14 ap=1 f(v0 m2024-09-17T03:11:48.041919+0000 1=0+1) n(v2 rc2024-09-17T03:11:48.273916+0000 4=0+4) (inest lock) (ifile excl) caps={5893=pAsLsXsFsx/pAsLsXsFsxcral@4},l=5893 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x5651c07f6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000004:[<0x10000000003/d5 v14>,<0x10000000002/d4 v17>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v20>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:11:48.041919+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:11:48.273916+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-17T03:11:48.041919+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-17T03:11:48.273916+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-17T03:12:39.487 INFO:tasks.ceph.mds.b.smithi193.stderr: -1345> 2024-09-17T03:12:05.561+0000 7efea9423640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v10 ap=2 f(v0 m2024-09-17T03:11:48.042919+0000 1=0+1) n(v1 rc2024-09-17T03:11:48.273916+0000 3=0+3) (inest sync->mix g=0,2 scatter_wanted) caps={5893=pAsLsXsFs/pAsLsXsFsxcral@7} | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x5651c07f6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000005:[<0x10000000004/d6 v10>,<0x10000000003/d5 v14>,<0x10000000002/d4 v17>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v20>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:11:48.042919+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:11:48.043919+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-17T03:11:48.042919+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-17T03:11:48.273916+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-17T03:12:39.487 INFO:tasks.ceph.mds.a.smithi078.stderr: -1374> 2024-09-17T03:12:05.561+0000 7f16cdaf6640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-17T03:11:48.043919+0000 1=0+1) n(v0 rc2024-09-17T03:11:48.043919+0000 2=0+2) (inest lock) (ifile excl) caps={5893=pAsLsXsFsx/pAsLsXsFsxcral@4},l=5893 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x557886dea000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v10>,<0x10000000003/d5 v14>,<0x10000000002/d4 v17>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v20>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:11:48.043919+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:11:48.043919+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-17T03:11:48.043919+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-17T03:11:48.043919+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-17T03:12:39.487 INFO:tasks.ceph.mds.a.smithi078.stderr: -1353> 2024-09-17T03:12:05.561+0000 7f16cdaf6640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) caps={5893=pAsLsXsFsx/AsLsXsFsx@2},l=5893 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x557886dea580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v10>,<0x10000000003/d5 v14>,<0x10000000002/d4 v17>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v20>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-17T03:12:39.489 INFO:tasks.ceph.mds.c.smithi078.stderr: -2761> 2024-09-17T03:12:05.559+0000 7f215ff81640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-17T03:11:48.040920+0000 1=0+1) n(v3 rc2024-09-17T03:11:48.273916+0000 6=0+6) (inest mix) (ifile excl) caps={5893=pAsLsXsFsx/pAsLsXsFsxcral@4},l=5893 | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=1 dirtyparent=0 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x56143e3ef080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v21>,<0x1/d1 v20>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:11:48.040920+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:11:48.273916+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-17T03:11:48.040920+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-17T03:11:48.273916+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-17T03:12:39.489 INFO:tasks.ceph.mds.c.smithi078.stderr: -2628> 2024-09-17T03:12:05.561+0000 7f216678e640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v17 ap=2 f(v0 m2024-09-17T03:11:48.041919+0000 1=0+1) n(v3 rc2024-09-17T03:11:48.273916+0000 5=0+5) (inest sync->mix g=1,2) caps={5893=pAsLsXsFs/pAsLsXsFsxcral@8} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x56143e3eeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000003:[<0x10000000002/d4 v17>,<0x10000000001/d3 v19>,<0x10000000000/d2 v21>,<0x1/d1 v20>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:11:48.041919+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:11:48.273916+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-17T03:11:48.041919+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-17T03:11:48.273916+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-17T03:12:39.495 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:12:39.540 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-09-17T03:12:39.540 INFO:tasks.ceph.mds.b.smithi193.stdout:starting mds.b at 2024-09-17T03:12:39.541 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2024-09-17T03:12:39.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.616+0000 7fbf39939640 1 -- 172.21.15.78:0/1160270148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf340b51c0 msgr2=0x7fbf3415c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:39.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.616+0000 7fbf39939640 1 --2- 172.21.15.78:0/1160270148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf340b51c0 0x7fbf3415c6e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fbf3415ce00 tx=0x7fbf2402aa00 comp rx=0 tx=0).stop 2024-09-17T03:12:39.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.616+0000 7fbf39939640 1 -- 172.21.15.78:0/1160270148 shutdown_connections 2024-09-17T03:12:39.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.616+0000 7fbf39939640 1 --2- 172.21.15.78:0/1160270148 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbf340d12c0 0x7fbf340d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:39.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.616+0000 7fbf39939640 1 --2- 172.21.15.78:0/1160270148 >> v2:172.21.15.193:3300/0 conn(0x7fbf340ccbd0 0x7fbf340d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:39.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.616+0000 7fbf39939640 1 --2- 172.21.15.78:0/1160270148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf340b51c0 0x7fbf3415c6e0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:39.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.616+0000 7fbf39939640 1 -- 172.21.15.78:0/1160270148 >> 172.21.15.78:0/1160270148 conn(0x7fbf34072ae0 msgr2=0x7fbf34072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:39.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.616+0000 7fbf39939640 1 -- 172.21.15.78:0/1160270148 shutdown_connections 2024-09-17T03:12:39.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.616+0000 7fbf39939640 1 -- 172.21.15.78:0/1160270148 wait complete. 2024-09-17T03:12:39.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.618+0000 7fbf39939640 1 Processor -- start 2024-09-17T03:12:39.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.618+0000 7fbf39939640 1 -- start start 2024-09-17T03:12:39.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.619+0000 7fbf39939640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf340b51c0 0x7fbf341f6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:39.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.619+0000 7fbf39939640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbf340ccbd0 0x7fbf3415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:39.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.619+0000 7fbf39939640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbf340d12c0 0x7fbf340cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:39.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.619+0000 7fbf39939640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbf34160760 con 0x7fbf340b51c0 2024-09-17T03:12:39.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.619+0000 7fbf39939640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbf341605e0 con 0x7fbf340ccbd0 2024-09-17T03:12:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.619+0000 7fbf39939640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fbf341608e0 con 0x7fbf340d12c0 2024-09-17T03:12:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.619+0000 7fbf32ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf340b51c0 0x7fbf341f6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.619+0000 7fbf32ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf340b51c0 0x7fbf341f6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48134/0 (socket says 172.21.15.78:48134) 2024-09-17T03:12:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.619+0000 7fbf32ffd640 1 -- 172.21.15.78:0/2651696228 learned_addr learned my addr 172.21.15.78:0/2651696228 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.619+0000 7fbf327fc640 1 --2- 172.21.15.78:0/2651696228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbf340ccbd0 0x7fbf3415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.619+0000 7fbf337fe640 1 --2- 172.21.15.78:0/2651696228 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbf340d12c0 0x7fbf340cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.620+0000 7fbf32ffd640 1 -- 172.21.15.78:0/2651696228 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbf340d12c0 msgr2=0x7fbf340cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.620+0000 7fbf32ffd640 1 --2- 172.21.15.78:0/2651696228 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbf340d12c0 0x7fbf340cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.620+0000 7fbf32ffd640 1 -- 172.21.15.78:0/2651696228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbf340ccbd0 msgr2=0x7fbf3415b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.620+0000 7fbf32ffd640 1 --2- 172.21.15.78:0/2651696228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbf340ccbd0 0x7fbf3415b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.620+0000 7fbf32ffd640 1 -- 172.21.15.78:0/2651696228 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf3406f920 con 0x7fbf340b51c0 2024-09-17T03:12:39.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.620+0000 7fbf327fc640 1 --2- 172.21.15.78:0/2651696228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbf340ccbd0 0x7fbf3415b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:39.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.620+0000 7fbf32ffd640 1 --2- 172.21.15.78:0/2651696228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf340b51c0 0x7fbf341f6690 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fbf2402aff0 tx=0x7fbf24003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:39.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.620+0000 7fbf1bfff640 1 -- 172.21.15.78:0/2651696228 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24033050 con 0x7fbf340b51c0 2024-09-17T03:12:39.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.620+0000 7fbf1bfff640 1 -- 172.21.15.78:0/2651696228 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf240044f0 con 0x7fbf340b51c0 2024-09-17T03:12:39.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.620+0000 7fbf39939640 1 -- 172.21.15.78:0/2651696228 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf3406fbc0 con 0x7fbf340b51c0 2024-09-17T03:12:39.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.620+0000 7fbf1bfff640 1 -- 172.21.15.78:0/2651696228 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf24038450 con 0x7fbf340b51c0 2024-09-17T03:12:39.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.620+0000 7fbf39939640 1 -- 172.21.15.78:0/2651696228 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf3415bb20 con 0x7fbf340b51c0 2024-09-17T03:12:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.621+0000 7fbf39939640 1 -- 172.21.15.78:0/2651696228 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf340694a0 con 0x7fbf340b51c0 2024-09-17T03:12:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.622+0000 7fbf1bfff640 1 -- 172.21.15.78:0/2651696228 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbf24036070 con 0x7fbf340b51c0 2024-09-17T03:12:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.622+0000 7fbf1bfff640 1 --2- 172.21.15.78:0/2651696228 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbf20078b90 0x7fbf2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.622+0000 7fbf1bfff640 1 -- 172.21.15.78:0/2651696228 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5967+0+0 (secure 0 0 0) 0x7fbf240bc1a0 con 0x7fbf340b51c0 2024-09-17T03:12:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.622+0000 7fbf327fc640 1 --2- 172.21.15.78:0/2651696228 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbf20078b90 0x7fbf2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:39.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.623+0000 7fbf327fc640 1 --2- 172.21.15.78:0/2651696228 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbf20078b90 0x7fbf2007b0a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbf340b7d60 tx=0x7fbf28005e70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:39.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.627+0000 7fbf1bfff640 1 -- 172.21.15.78:0/2651696228 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbf340694a0 con 0x7fbf340b51c0 2024-09-17T03:12:39.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:39.838+0000 7fbf39939640 1 -- 172.21.15.78:0/2651696228 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fbf340cfba0 con 0x7fbf340b51c0 2024-09-17T03:12:40.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.481+0000 7fbf1bfff640 1 -- 172.21.15.78:0/2651696228 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v56) ==== 104+0+0 (secure 0 0 0) 0x7fbf340cfba0 con 0x7fbf340b51c0 2024-09-17T03:12:40.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.484+0000 7fbf39939640 1 -- 172.21.15.78:0/2651696228 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbf20078b90 msgr2=0x7fbf2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:40.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.484+0000 7fbf39939640 1 --2- 172.21.15.78:0/2651696228 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbf20078b90 0x7fbf2007b0a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbf340b7d60 tx=0x7fbf28005e70 comp rx=0 tx=0).stop 2024-09-17T03:12:40.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.484+0000 7fbf39939640 1 -- 172.21.15.78:0/2651696228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf340b51c0 msgr2=0x7fbf341f6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:40.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.484+0000 7fbf39939640 1 --2- 172.21.15.78:0/2651696228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf340b51c0 0x7fbf341f6690 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fbf2402aff0 tx=0x7fbf24003f90 comp rx=0 tx=0).stop 2024-09-17T03:12:40.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.484+0000 7fbf39939640 1 -- 172.21.15.78:0/2651696228 shutdown_connections 2024-09-17T03:12:40.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.484+0000 7fbf39939640 1 --2- 172.21.15.78:0/2651696228 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbf340d12c0 0x7fbf340cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:40.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.484+0000 7fbf39939640 1 --2- 172.21.15.78:0/2651696228 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbf20078b90 0x7fbf2007b0a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:40.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.484+0000 7fbf39939640 1 --2- 172.21.15.78:0/2651696228 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbf340ccbd0 0x7fbf3415b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:40.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.484+0000 7fbf39939640 1 --2- 172.21.15.78:0/2651696228 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf340b51c0 0x7fbf341f6690 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:40.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.484+0000 7fbf39939640 1 -- 172.21.15.78:0/2651696228 >> 172.21.15.78:0/2651696228 conn(0x7fbf34072ae0 msgr2=0x7fbf34068d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:40.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.484+0000 7fbf39939640 1 -- 172.21.15.78:0/2651696228 shutdown_connections 2024-09-17T03:12:40.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.484+0000 7fbf39939640 1 -- 172.21.15.78:0/2651696228 wait complete. 2024-09-17T03:12:40.496 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:12:40.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.615+0000 7fc85dcde640 1 -- 172.21.15.78:0/1253296404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8580d18f0 msgr2=0x7fc85806e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:40.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.615+0000 7fc85dcde640 1 --2- 172.21.15.78:0/1253296404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8580d18f0 0x7fc85806e610 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc85808ca30 tx=0x7fc84802aa00 comp rx=0 tx=0).stop 2024-09-17T03:12:40.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.615+0000 7fc85dcde640 1 -- 172.21.15.78:0/1253296404 shutdown_connections 2024-09-17T03:12:40.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.615+0000 7fc85dcde640 1 --2- 172.21.15.78:0/1253296404 >> v2:172.21.15.193:3300/0 conn(0x7fc8580cfa70 0x7fc8580d23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:40.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.615+0000 7fc85dcde640 1 --2- 172.21.15.78:0/1253296404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8580d18f0 0x7fc85806e610 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:40.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.615+0000 7fc85dcde640 1 -- 172.21.15.78:0/1253296404 >> 172.21.15.78:0/1253296404 conn(0x7fc85809d8a0 msgr2=0x7fc85808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:40.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.615+0000 7fc85dcde640 1 -- 172.21.15.78:0/1253296404 shutdown_connections 2024-09-17T03:12:40.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.615+0000 7fc85dcde640 1 -- 172.21.15.78:0/1253296404 wait complete. 2024-09-17T03:12:40.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.617+0000 7fc85dcde640 1 Processor -- start 2024-09-17T03:12:40.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.617+0000 7fc85dcde640 1 -- start start 2024-09-17T03:12:40.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc85dcde640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8580b96c0 0x7fc858156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:40.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc85dcde640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8580d18f0 0x7fc8580cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:40.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc85dcde640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8580ce2f0 0x7fc8580ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:40.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc85dcde640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc8580d2db0 con 0x7fc8580d18f0 2024-09-17T03:12:40.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc85dcde640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc8580d2c30 con 0x7fc8580b96c0 2024-09-17T03:12:40.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc85dcde640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc8580d2f30 con 0x7fc8580ce2f0 2024-09-17T03:12:40.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc856ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8580d18f0 0x7fc8580cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:40.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc856ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8580d18f0 0x7fc8580cc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48140/0 (socket says 172.21.15.78:48140) 2024-09-17T03:12:40.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc856ffd640 1 -- 172.21.15.78:0/2850628524 learned_addr learned my addr 172.21.15.78:0/2850628524 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:40.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc8577fe640 1 --2- 172.21.15.78:0/2850628524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8580b96c0 0x7fc858156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:40.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc857fff640 1 --2- 172.21.15.78:0/2850628524 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8580ce2f0 0x7fc8580ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:40.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc856ffd640 1 -- 172.21.15.78:0/2850628524 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8580ce2f0 msgr2=0x7fc8580ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:40.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc856ffd640 1 --2- 172.21.15.78:0/2850628524 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8580ce2f0 0x7fc8580ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:40.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc856ffd640 1 -- 172.21.15.78:0/2850628524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8580b96c0 msgr2=0x7fc858156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:40.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc856ffd640 1 --2- 172.21.15.78:0/2850628524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8580b96c0 0x7fc858156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:40.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc856ffd640 1 -- 172.21.15.78:0/2850628524 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8581e7510 con 0x7fc8580d18f0 2024-09-17T03:12:40.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc856ffd640 1 --2- 172.21.15.78:0/2850628524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8580d18f0 0x7fc8580cc7c0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc84000b3e0 tx=0x7fc84000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:40.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc84ffff640 1 -- 172.21.15.78:0/2850628524 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc840015020 con 0x7fc8580d18f0 2024-09-17T03:12:40.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc84ffff640 1 -- 172.21.15.78:0/2850628524 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc840011940 con 0x7fc8580d18f0 2024-09-17T03:12:40.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc85dcde640 1 -- 172.21.15.78:0/2850628524 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8581e77f0 con 0x7fc8580d18f0 2024-09-17T03:12:40.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc84ffff640 1 -- 172.21.15.78:0/2850628524 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc840011d90 con 0x7fc8580d18f0 2024-09-17T03:12:40.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.619+0000 7fc85dcde640 1 -- 172.21.15.78:0/2850628524 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8581e7db0 con 0x7fc8580d18f0 2024-09-17T03:12:40.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.620+0000 7fc85dcde640 1 -- 172.21.15.78:0/2850628524 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8580cd800 con 0x7fc8580d18f0 2024-09-17T03:12:40.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.621+0000 7fc84ffff640 1 -- 172.21.15.78:0/2850628524 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc840018020 con 0x7fc8580d18f0 2024-09-17T03:12:40.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.622+0000 7fc84ffff640 1 --2- 172.21.15.78:0/2850628524 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc838078bc0 0x7fc83807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:40.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.622+0000 7fc84ffff640 1 -- 172.21.15.78:0/2850628524 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5967+0+0 (secure 0 0 0) 0x7fc84009ac90 con 0x7fc8580d18f0 2024-09-17T03:12:40.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.622+0000 7fc8577fe640 1 --2- 172.21.15.78:0/2850628524 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc838078bc0 0x7fc83807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:40.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.622+0000 7fc8577fe640 1 --2- 172.21.15.78:0/2850628524 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc838078bc0 0x7fc83807b0d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc848035000 tx=0x7fc84803b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:40.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.626+0000 7fc84ffff640 1 -- 172.21.15.78:0/2850628524 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc84001f020 con 0x7fc8580d18f0 2024-09-17T03:12:40.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:40.801+0000 7fc85dcde640 1 -- 172.21.15.78:0/2850628524 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc8580d23f0 con 0x7fc8580d18f0 2024-09-17T03:12:41.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.491+0000 7fc84ffff640 1 -- 172.21.15.78:0/2850628524 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v60) ==== 181+0+0 (secure 0 0 0) 0x7fc840063060 con 0x7fc8580d18f0 2024-09-17T03:12:41.490 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:12:41.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.493+0000 7fc85dcde640 1 -- 172.21.15.78:0/2850628524 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc838078bc0 msgr2=0x7fc83807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:41.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.493+0000 7fc85dcde640 1 --2- 172.21.15.78:0/2850628524 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc838078bc0 0x7fc83807b0d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc848035000 tx=0x7fc84803b040 comp rx=0 tx=0).stop 2024-09-17T03:12:41.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.493+0000 7fc85dcde640 1 -- 172.21.15.78:0/2850628524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8580d18f0 msgr2=0x7fc8580cc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:41.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.493+0000 7fc85dcde640 1 --2- 172.21.15.78:0/2850628524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8580d18f0 0x7fc8580cc7c0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc84000b3e0 tx=0x7fc84000b8a0 comp rx=0 tx=0).stop 2024-09-17T03:12:41.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.493+0000 7fc85dcde640 1 -- 172.21.15.78:0/2850628524 shutdown_connections 2024-09-17T03:12:41.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.493+0000 7fc85dcde640 1 --2- 172.21.15.78:0/2850628524 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8580ce2f0 0x7fc8580ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:41.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.493+0000 7fc85dcde640 1 --2- 172.21.15.78:0/2850628524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8580d18f0 0x7fc8580cc7c0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:41.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.493+0000 7fc85dcde640 1 --2- 172.21.15.78:0/2850628524 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc838078bc0 0x7fc83807b0d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:41.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.493+0000 7fc85dcde640 1 --2- 172.21.15.78:0/2850628524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc8580b96c0 0x7fc858156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:41.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.493+0000 7fc85dcde640 1 -- 172.21.15.78:0/2850628524 >> 172.21.15.78:0/2850628524 conn(0x7fc85809d8a0 msgr2=0x7fc85815f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:41.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.494+0000 7fc85dcde640 1 -- 172.21.15.78:0/2850628524 shutdown_connections 2024-09-17T03:12:41.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.494+0000 7fc85dcde640 1 -- 172.21.15.78:0/2850628524 wait complete. 2024-09-17T03:12:41.507 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:12:41.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.628+0000 7f28e2589640 1 -- 172.21.15.78:0/1228847398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c4003a50 msgr2=0x7f28c4003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:41.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.628+0000 7f28e2589640 1 --2- 172.21.15.78:0/1228847398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c4003a50 0x7f28c4003ec0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f28cc00c260 tx=0x7f28c4005830 comp rx=0 tx=0).stop 2024-09-17T03:12:41.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.628+0000 7f28e2589640 1 -- 172.21.15.78:0/1228847398 shutdown_connections 2024-09-17T03:12:41.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.628+0000 7f28e2589640 1 --2- 172.21.15.78:0/1228847398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28c4003a50 0x7f28c4003ec0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:41.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.628+0000 7f28e2589640 1 -- 172.21.15.78:0/1228847398 >> 172.21.15.78:0/1228847398 conn(0x7f28dc09d8a0 msgr2=0x7f28dc08bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:41.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.628+0000 7f28e2589640 1 -- 172.21.15.78:0/1228847398 shutdown_connections 2024-09-17T03:12:41.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.628+0000 7f28e2589640 1 -- 172.21.15.78:0/1228847398 wait complete. 2024-09-17T03:12:41.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.629+0000 7f28e2589640 1 Processor -- start 2024-09-17T03:12:41.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.630+0000 7f28e2589640 1 -- start start 2024-09-17T03:12:41.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.631+0000 7f28e2589640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28c4003a50 0x7f28dc0ca400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:41.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.631+0000 7f28e2589640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28dc0ca940 0x7f28dc14f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:41.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.631+0000 7f28e2589640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f28dc157ca0 0x7f28dc14fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:41.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.631+0000 7f28e2589640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc0cf360 con 0x7f28dc0ca940 2024-09-17T03:12:41.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.631+0000 7f28e2589640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f28dc0b9980 con 0x7f28c4003a50 2024-09-17T03:12:41.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.631+0000 7f28e2589640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f28dc0cf4e0 con 0x7f28dc157ca0 2024-09-17T03:12:41.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.631+0000 7f28db7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28dc0ca940 0x7f28dc14f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:41.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.631+0000 7f28db7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28dc0ca940 0x7f28dc14f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48162/0 (socket says 172.21.15.78:48162) 2024-09-17T03:12:41.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.631+0000 7f28db7fe640 1 -- 172.21.15.78:0/582932390 learned_addr learned my addr 172.21.15.78:0/582932390 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:41.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.631+0000 7f28e0b26640 1 --2- 172.21.15.78:0/582932390 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f28dc157ca0 0x7f28dc14fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:41.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.631+0000 7f28dbfff640 1 --2- 172.21.15.78:0/582932390 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28c4003a50 0x7f28dc0ca400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:41.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.631+0000 7f28db7fe640 1 -- 172.21.15.78:0/582932390 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f28dc157ca0 msgr2=0x7f28dc14fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:41.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.631+0000 7f28db7fe640 1 --2- 172.21.15.78:0/582932390 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f28dc157ca0 0x7f28dc14fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:41.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.631+0000 7f28db7fe640 1 -- 172.21.15.78:0/582932390 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28c4003a50 msgr2=0x7f28dc0ca400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:41.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.631+0000 7f28db7fe640 1 --2- 172.21.15.78:0/582932390 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28c4003a50 0x7f28dc0ca400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:41.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.631+0000 7f28db7fe640 1 -- 172.21.15.78:0/582932390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28dc0b5e20 con 0x7f28dc0ca940 2024-09-17T03:12:41.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.631+0000 7f28dbfff640 1 --2- 172.21.15.78:0/582932390 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28c4003a50 0x7f28dc0ca400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:41.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.632+0000 7f28db7fe640 1 --2- 172.21.15.78:0/582932390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28dc0ca940 0x7f28dc14f670 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f28d0004d60 tx=0x7f28d0001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:41.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.632+0000 7f28d8ff9640 1 -- 172.21.15.78:0/582932390 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d0015020 con 0x7f28dc0ca940 2024-09-17T03:12:41.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.632+0000 7f28d8ff9640 1 -- 172.21.15.78:0/582932390 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28d0004e50 con 0x7f28dc0ca940 2024-09-17T03:12:41.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.632+0000 7f28e2589640 1 -- 172.21.15.78:0/582932390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28dc0b60e0 con 0x7f28dc0ca940 2024-09-17T03:12:41.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.632+0000 7f28d8ff9640 1 -- 172.21.15.78:0/582932390 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d0011bc0 con 0x7f28dc0ca940 2024-09-17T03:12:41.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.632+0000 7f28e2589640 1 -- 172.21.15.78:0/582932390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28dc0ccd30 con 0x7f28dc0ca940 2024-09-17T03:12:41.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.633+0000 7f28e2589640 1 -- 172.21.15.78:0/582932390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28dc1f9ca0 con 0x7f28dc0ca940 2024-09-17T03:12:41.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.634+0000 7f28d8ff9640 1 -- 172.21.15.78:0/582932390 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f28d0018020 con 0x7f28dc0ca940 2024-09-17T03:12:41.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.634+0000 7f28d8ff9640 1 --2- 172.21.15.78:0/582932390 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f28c8078bc0 0x7f28c807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:41.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.634+0000 7f28d8ff9640 1 -- 172.21.15.78:0/582932390 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5529+0+0 (secure 0 0 0) 0x7f28d009b160 con 0x7f28dc0ca940 2024-09-17T03:12:41.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.634+0000 7f28dbfff640 1 --2- 172.21.15.78:0/582932390 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f28c8078bc0 0x7f28c807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:41.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.635+0000 7f28dbfff640 1 --2- 172.21.15.78:0/582932390 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f28c8078bc0 0x7f28c807b0d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f28cc033000 tx=0x7f28dc06f770 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:41.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.639+0000 7f28d8ff9640 1 -- 172.21.15.78:0/582932390 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f28d001f030 con 0x7f28dc0ca940 2024-09-17T03:12:41.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:41.815+0000 7f28e2589640 1 -- 172.21.15.78:0/582932390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f28dc0b6600 con 0x7f28dc0ca940 2024-09-17T03:12:42.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.492+0000 7f28d8ff9640 1 -- 172.21.15.78:0/582932390 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v61) ==== 169+0+0 (secure 0 0 0) 0x7f28dc0b6600 con 0x7f28dc0ca940 2024-09-17T03:12:42.491 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2024-09-17T03:12:42.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.494+0000 7f28e2589640 1 -- 172.21.15.78:0/582932390 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f28c8078bc0 msgr2=0x7f28c807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:42.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.494+0000 7f28e2589640 1 --2- 172.21.15.78:0/582932390 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f28c8078bc0 0x7f28c807b0d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f28cc033000 tx=0x7f28dc06f770 comp rx=0 tx=0).stop 2024-09-17T03:12:42.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.494+0000 7f28e2589640 1 -- 172.21.15.78:0/582932390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28dc0ca940 msgr2=0x7f28dc14f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:42.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.494+0000 7f28e2589640 1 --2- 172.21.15.78:0/582932390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28dc0ca940 0x7f28dc14f670 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f28d0004d60 tx=0x7f28d0001630 comp rx=0 tx=0).stop 2024-09-17T03:12:42.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.494+0000 7f28e2589640 1 -- 172.21.15.78:0/582932390 shutdown_connections 2024-09-17T03:12:42.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.494+0000 7f28e2589640 1 --2- 172.21.15.78:0/582932390 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f28dc157ca0 0x7f28dc14fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:42.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.494+0000 7f28e2589640 1 --2- 172.21.15.78:0/582932390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28dc0ca940 0x7f28dc14f670 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:42.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.494+0000 7f28e2589640 1 --2- 172.21.15.78:0/582932390 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f28c8078bc0 0x7f28c807b0d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:42.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.494+0000 7f28e2589640 1 --2- 172.21.15.78:0/582932390 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28c4003a50 0x7f28dc0ca400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:42.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.495+0000 7f28e2589640 1 -- 172.21.15.78:0/582932390 >> 172.21.15.78:0/582932390 conn(0x7f28dc09d8a0 msgr2=0x7f28dc0b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:42.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.495+0000 7f28e2589640 1 -- 172.21.15.78:0/582932390 shutdown_connections 2024-09-17T03:12:42.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.495+0000 7f28e2589640 1 -- 172.21.15.78:0/582932390 wait complete. 2024-09-17T03:12:42.507 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:12:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.622+0000 7fc6bf107640 1 -- 172.21.15.78:0/301921839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b80d2ed0 msgr2=0x7fc6b80d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.622+0000 7fc6bf107640 1 --2- 172.21.15.78:0/301921839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b80d2ed0 0x7fc6b80d1a80 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8005fd0 tx=0x7fc6a802a980 comp rx=0 tx=0).stop 2024-09-17T03:12:42.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.622+0000 7fc6bf107640 1 -- 172.21.15.78:0/301921839 shutdown_connections 2024-09-17T03:12:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.622+0000 7fc6bf107640 1 --2- 172.21.15.78:0/301921839 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc6b80b9b70 0x7fc6b80cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.622+0000 7fc6bf107640 1 --2- 172.21.15.78:0/301921839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b80d2ed0 0x7fc6b80d1a80 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.622+0000 7fc6bf107640 1 -- 172.21.15.78:0/301921839 >> 172.21.15.78:0/301921839 conn(0x7fc6b808bfc0 msgr2=0x7fc6b809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.622+0000 7fc6bf107640 1 -- 172.21.15.78:0/301921839 shutdown_connections 2024-09-17T03:12:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.622+0000 7fc6bf107640 1 -- 172.21.15.78:0/301921839 wait complete. 2024-09-17T03:12:42.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.624+0000 7fc6bf107640 1 Processor -- start 2024-09-17T03:12:42.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.624+0000 7fc6bf107640 1 -- start start 2024-09-17T03:12:42.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.625+0000 7fc6bf107640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b80b9b70 0x7fc6b80c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:42.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.625+0000 7fc6bf107640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6b80cf5d0 0x7fc6b80c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.625+0000 7fc6bf107640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc6b80d2ed0 0x7fc6b80c8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.625+0000 7fc6bf107640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b80d4940 con 0x7fc6b80b9b70 2024-09-17T03:12:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.625+0000 7fc6bf107640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b80cfde0 con 0x7fc6b80cf5d0 2024-09-17T03:12:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.625+0000 7fc6bf107640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc6b80d4ac0 con 0x7fc6b80d2ed0 2024-09-17T03:12:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.626+0000 7fc6bcea3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b80b9b70 0x7fc6b80c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.626+0000 7fc6bcea3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b80b9b70 0x7fc6b80c9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48194/0 (socket says 172.21.15.78:48194) 2024-09-17T03:12:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.626+0000 7fc6bcea3640 1 -- 172.21.15.78:0/4035677391 learned_addr learned my addr 172.21.15.78:0/4035677391 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.626+0000 7fc6b7fff640 1 --2- 172.21.15.78:0/4035677391 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6b80cf5d0 0x7fc6b80c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.626+0000 7fc6bd6a4640 1 --2- 172.21.15.78:0/4035677391 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc6b80d2ed0 0x7fc6b80c8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.626+0000 7fc6bcea3640 1 -- 172.21.15.78:0/4035677391 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc6b80d2ed0 msgr2=0x7fc6b80c8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.626+0000 7fc6bcea3640 1 --2- 172.21.15.78:0/4035677391 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc6b80d2ed0 0x7fc6b80c8920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.626+0000 7fc6bcea3640 1 -- 172.21.15.78:0/4035677391 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6b80cf5d0 msgr2=0x7fc6b80c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.626+0000 7fc6bcea3640 1 --2- 172.21.15.78:0/4035677391 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6b80cf5d0 0x7fc6b80c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:42.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.626+0000 7fc6bcea3640 1 -- 172.21.15.78:0/4035677391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b80c8e60 con 0x7fc6b80b9b70 2024-09-17T03:12:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.626+0000 7fc6bd6a4640 1 --2- 172.21.15.78:0/4035677391 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc6b80d2ed0 0x7fc6b80c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:12:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.626+0000 7fc6bcea3640 1 --2- 172.21.15.78:0/4035677391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b80b9b70 0x7fc6b80c9910 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009be0 tx=0x7fc6a8003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.626+0000 7fc6b57fa640 1 -- 172.21.15.78:0/4035677391 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8034040 con 0x7fc6b80b9b70 2024-09-17T03:12:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.626+0000 7fc6b57fa640 1 -- 172.21.15.78:0/4035677391 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6a8004e30 con 0x7fc6b80b9b70 2024-09-17T03:12:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.626+0000 7fc6bf107640 1 -- 172.21.15.78:0/4035677391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b815ae80 con 0x7fc6b80b9b70 2024-09-17T03:12:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.626+0000 7fc6b57fa640 1 -- 172.21.15.78:0/4035677391 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8004590 con 0x7fc6b80b9b70 2024-09-17T03:12:42.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.626+0000 7fc6bf107640 1 -- 172.21.15.78:0/4035677391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b815b440 con 0x7fc6b80b9b70 2024-09-17T03:12:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.627+0000 7fc6bf107640 1 -- 172.21.15.78:0/4035677391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6b80d50b0 con 0x7fc6b80b9b70 2024-09-17T03:12:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.628+0000 7fc6b57fa640 1 -- 172.21.15.78:0/4035677391 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc6a8037020 con 0x7fc6b80b9b70 2024-09-17T03:12:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.629+0000 7fc6b57fa640 1 --2- 172.21.15.78:0/4035677391 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc698078bc0 0x7fc69807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.629+0000 7fc6b57fa640 1 -- 172.21.15.78:0/4035677391 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5115+0+0 (secure 0 0 0) 0x7fc6a80bc180 con 0x7fc6b80b9b70 2024-09-17T03:12:42.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.629+0000 7fc6b7fff640 1 --2- 172.21.15.78:0/4035677391 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc698078bc0 0x7fc69807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:42.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.630+0000 7fc6b7fff640 1 --2- 172.21.15.78:0/4035677391 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc698078bc0 0x7fc69807b0d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc6b815f750 tx=0x7fc6a0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:42.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.633+0000 7fc6b57fa640 1 -- 172.21.15.78:0/4035677391 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc6a8084810 con 0x7fc6b80b9b70 2024-09-17T03:12:42.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.805+0000 7fc6bf107640 1 -- 172.21.15.78:0/4035677391 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fc6b80b4020 con 0x7fc6b80b9b70 2024-09-17T03:12:42.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.809+0000 7fc6b57fa640 1 -- 172.21.15.78:0/4035677391 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v37) ==== 71+0+0 (secure 0 0 0) 0x7fc6a8084110 con 0x7fc6b80b9b70 2024-09-17T03:12:42.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.812+0000 7fc6bf107640 1 -- 172.21.15.78:0/4035677391 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc698078bc0 msgr2=0x7fc69807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:42.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.812+0000 7fc6bf107640 1 --2- 172.21.15.78:0/4035677391 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc698078bc0 0x7fc69807b0d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc6b815f750 tx=0x7fc6a0008040 comp rx=0 tx=0).stop 2024-09-17T03:12:42.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.812+0000 7fc6bf107640 1 -- 172.21.15.78:0/4035677391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b80b9b70 msgr2=0x7fc6b80c9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:42.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.812+0000 7fc6bf107640 1 --2- 172.21.15.78:0/4035677391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b80b9b70 0x7fc6b80c9910 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009be0 tx=0x7fc6a8003f90 comp rx=0 tx=0).stop 2024-09-17T03:12:42.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.812+0000 7fc6bf107640 1 -- 172.21.15.78:0/4035677391 shutdown_connections 2024-09-17T03:12:42.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.812+0000 7fc6bf107640 1 --2- 172.21.15.78:0/4035677391 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc6b80d2ed0 0x7fc6b80c8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:42.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.812+0000 7fc6bf107640 1 --2- 172.21.15.78:0/4035677391 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc698078bc0 0x7fc69807b0d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:42.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.812+0000 7fc6bf107640 1 --2- 172.21.15.78:0/4035677391 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6b80cf5d0 0x7fc6b80c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:42.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.812+0000 7fc6bf107640 1 --2- 172.21.15.78:0/4035677391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6b80b9b70 0x7fc6b80c9910 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:42.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.812+0000 7fc6bf107640 1 -- 172.21.15.78:0/4035677391 >> 172.21.15.78:0/4035677391 conn(0x7fc6b808bfc0 msgr2=0x7fc6b80d24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:42.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.812+0000 7fc6bf107640 1 -- 172.21.15.78:0/4035677391 shutdown_connections 2024-09-17T03:12:42.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.812+0000 7fc6bf107640 1 -- 172.21.15.78:0/4035677391 wait complete. 2024-09-17T03:12:42.822 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace' 2024-09-17T03:12:42.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.934+0000 7fc870520640 1 -- 172.21.15.78:0/3958725444 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8680ceb40 msgr2=0x7fc8680cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:42.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.934+0000 7fc870520640 1 --2- 172.21.15.78:0/3958725444 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8680ceb40 0x7fc8680cef50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc860009830 tx=0x7fc86002a480 comp rx=0 tx=0).stop 2024-09-17T03:12:42.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.935+0000 7fc870520640 1 -- 172.21.15.78:0/3958725444 shutdown_connections 2024-09-17T03:12:42.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.935+0000 7fc870520640 1 --2- 172.21.15.78:0/3958725444 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8680ceb40 0x7fc8680cef50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:42.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.935+0000 7fc870520640 1 --2- 172.21.15.78:0/3958725444 >> v2:172.21.15.193:3300/0 conn(0x7fc86806e170 0x7fc8680b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:42.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.935+0000 7fc870520640 1 -- 172.21.15.78:0/3958725444 >> 172.21.15.78:0/3958725444 conn(0x7fc86808bfc0 msgr2=0x7fc86809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:42.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.935+0000 7fc870520640 1 -- 172.21.15.78:0/3958725444 shutdown_connections 2024-09-17T03:12:42.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.935+0000 7fc870520640 1 -- 172.21.15.78:0/3958725444 wait complete. 2024-09-17T03:12:42.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.936+0000 7fc870520640 1 Processor -- start 2024-09-17T03:12:42.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.936+0000 7fc870520640 1 -- start start 2024-09-17T03:12:42.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.938+0000 7fc870520640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc86806f4b0 0x7fc8681f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:42.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.938+0000 7fc870520640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8680ceb40 0x7fc8680cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:42.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.938+0000 7fc870520640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8680b62e0 0x7fc8680cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:42.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.938+0000 7fc870520640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc8680d0e60 con 0x7fc8680b62e0 2024-09-17T03:12:42.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.938+0000 7fc870520640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc8680d0ce0 con 0x7fc86806f4b0 2024-09-17T03:12:42.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.938+0000 7fc870520640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc8680d0fe0 con 0x7fc8680ceb40 2024-09-17T03:12:42.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.938+0000 7fc86eabd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8680b62e0 0x7fc8680cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:42.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.938+0000 7fc86eabd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8680b62e0 0x7fc8680cbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48210/0 (socket says 172.21.15.78:48210) 2024-09-17T03:12:42.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.938+0000 7fc86eabd640 1 -- 172.21.15.78:0/2852889086 learned_addr learned my addr 172.21.15.78:0/2852889086 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:42.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.938+0000 7fc86e2bc640 1 --2- 172.21.15.78:0/2852889086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc86806f4b0 0x7fc8681f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:42.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.938+0000 7fc86dabb640 1 --2- 172.21.15.78:0/2852889086 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8680ceb40 0x7fc8680cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:42.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.938+0000 7fc86eabd640 1 -- 172.21.15.78:0/2852889086 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8680ceb40 msgr2=0x7fc8680cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:42.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.938+0000 7fc86eabd640 1 --2- 172.21.15.78:0/2852889086 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8680ceb40 0x7fc8680cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:42.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.938+0000 7fc86eabd640 1 -- 172.21.15.78:0/2852889086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc86806f4b0 msgr2=0x7fc8681f4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:42.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.938+0000 7fc86eabd640 1 --2- 172.21.15.78:0/2852889086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc86806f4b0 0x7fc8681f4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:42.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.938+0000 7fc86eabd640 1 -- 172.21.15.78:0/2852889086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8681f8880 con 0x7fc8680b62e0 2024-09-17T03:12:42.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.938+0000 7fc86dabb640 1 --2- 172.21.15.78:0/2852889086 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8680ceb40 0x7fc8680cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:42.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.938+0000 7fc86eabd640 1 --2- 172.21.15.78:0/2852889086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8680b62e0 0x7fc8680cbb00 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fc86002aa70 tx=0x7fc860033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:42.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.939+0000 7fc866ffd640 1 -- 172.21.15.78:0/2852889086 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc860005c90 con 0x7fc8680b62e0 2024-09-17T03:12:42.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.939+0000 7fc866ffd640 1 -- 172.21.15.78:0/2852889086 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc860031e50 con 0x7fc8680b62e0 2024-09-17T03:12:42.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.939+0000 7fc866ffd640 1 -- 172.21.15.78:0/2852889086 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc860005280 con 0x7fc8680b62e0 2024-09-17T03:12:42.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.939+0000 7fc870520640 1 -- 172.21.15.78:0/2852889086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8681f8b60 con 0x7fc8680b62e0 2024-09-17T03:12:42.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.939+0000 7fc870520640 1 -- 172.21.15.78:0/2852889086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8681f9120 con 0x7fc8680b62e0 2024-09-17T03:12:42.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.940+0000 7fc870520640 1 -- 172.21.15.78:0/2852889086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8680d15a0 con 0x7fc8680b62e0 2024-09-17T03:12:42.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.940+0000 7fc866ffd640 1 -- 172.21.15.78:0/2852889086 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc860005420 con 0x7fc8680b62e0 2024-09-17T03:12:42.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.941+0000 7fc866ffd640 1 --2- 172.21.15.78:0/2852889086 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc854078b90 0x7fc85407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:42.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.941+0000 7fc866ffd640 1 -- 172.21.15.78:0/2852889086 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5115+0+0 (secure 0 0 0) 0x7fc8600bbb10 con 0x7fc8680b62e0 2024-09-17T03:12:42.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.941+0000 7fc86e2bc640 1 --2- 172.21.15.78:0/2852889086 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc854078b90 0x7fc85407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:42.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.942+0000 7fc86e2bc640 1 --2- 172.21.15.78:0/2852889086 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc854078b90 0x7fc85407b0a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc8580099a0 tx=0x7fc858009500 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:42.944 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:42.945+0000 7fc866ffd640 1 -- 172.21.15.78:0/2852889086 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc86003f030 con 0x7fc8680b62e0 2024-09-17T03:12:43.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.194+0000 7fc870520640 1 -- 172.21.15.78:0/2852889086 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace"]} v 0) -- 0x7fc8680b6770 con 0x7fc8680b62e0 2024-09-17T03:12:43.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.501+0000 7fc866ffd640 1 -- 172.21.15.78:0/2852889086 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_backtrace"]}]=0 v218) ==== 142+0+0 (secure 0 0 0) 0x7fc860083b50 con 0x7fc8680b62e0 2024-09-17T03:12:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.503+0000 7fc870520640 1 -- 172.21.15.78:0/2852889086 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc854078b90 msgr2=0x7fc85407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.503+0000 7fc870520640 1 --2- 172.21.15.78:0/2852889086 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc854078b90 0x7fc85407b0a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc8580099a0 tx=0x7fc858009500 comp rx=0 tx=0).stop 2024-09-17T03:12:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.503+0000 7fc870520640 1 -- 172.21.15.78:0/2852889086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8680b62e0 msgr2=0x7fc8680cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:43.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.503+0000 7fc870520640 1 --2- 172.21.15.78:0/2852889086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8680b62e0 0x7fc8680cbb00 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fc86002aa70 tx=0x7fc860033c20 comp rx=0 tx=0).stop 2024-09-17T03:12:43.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.503+0000 7fc870520640 1 -- 172.21.15.78:0/2852889086 shutdown_connections 2024-09-17T03:12:43.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.503+0000 7fc870520640 1 --2- 172.21.15.78:0/2852889086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc8680b62e0 0x7fc8680cbb00 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:43.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.503+0000 7fc870520640 1 --2- 172.21.15.78:0/2852889086 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc8680ceb40 0x7fc8680cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:43.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.503+0000 7fc870520640 1 --2- 172.21.15.78:0/2852889086 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc854078b90 0x7fc85407b0a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:43.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.503+0000 7fc870520640 1 --2- 172.21.15.78:0/2852889086 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc86806f4b0 0x7fc8681f4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:43.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.503+0000 7fc870520640 1 -- 172.21.15.78:0/2852889086 >> 172.21.15.78:0/2852889086 conn(0x7fc86808bfc0 msgr2=0x7fc86806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:43.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.503+0000 7fc870520640 1 -- 172.21.15.78:0/2852889086 shutdown_connections 2024-09-17T03:12:43.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.503+0000 7fc870520640 1 -- 172.21.15.78:0/2852889086 wait complete. 2024-09-17T03:12:43.514 INFO:tasks.cephfs_test_runner:test_scrub_backtrace (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2024-09-17T03:12:43.514 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_non_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) 2024-09-17T03:12:43.515 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:12:43.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.628+0000 7fb6595cf640 1 -- 172.21.15.78:0/550679681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb640004800 msgr2=0x7fb640004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:43.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.628+0000 7fb6595cf640 1 --2- 172.21.15.78:0/550679681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb640004800 0x7fb640004c10 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb654070050 tx=0x7fb640005830 comp rx=0 tx=0).stop 2024-09-17T03:12:43.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.629+0000 7fb6595cf640 1 -- 172.21.15.78:0/550679681 shutdown_connections 2024-09-17T03:12:43.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.629+0000 7fb6595cf640 1 --2- 172.21.15.78:0/550679681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb640004800 0x7fb640004c10 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:43.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.629+0000 7fb6595cf640 1 -- 172.21.15.78:0/550679681 >> 172.21.15.78:0/550679681 conn(0x7fb65409d7f0 msgr2=0x7fb6540d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:43.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.629+0000 7fb6595cf640 1 -- 172.21.15.78:0/550679681 shutdown_connections 2024-09-17T03:12:43.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.629+0000 7fb6595cf640 1 -- 172.21.15.78:0/550679681 wait complete. 2024-09-17T03:12:43.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.630+0000 7fb6595cf640 1 Processor -- start 2024-09-17T03:12:43.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.630+0000 7fb6595cf640 1 -- start start 2024-09-17T03:12:43.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.632+0000 7fb6595cf640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb640004800 0x7fb65415c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:43.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.632+0000 7fb6595cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6541e7da0 0x7fb6541f8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.632+0000 7fb6595cf640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6541e8500 0x7fb6541e8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.632+0000 7fb6595cf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb6540b6120 con 0x7fb6541e7da0 2024-09-17T03:12:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.632+0000 7fb6595cf640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb6540b5fa0 con 0x7fb6541e8500 2024-09-17T03:12:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.632+0000 7fb6595cf640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb6540b62a0 con 0x7fb640004800 2024-09-17T03:12:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.632+0000 7fb64a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6541e7da0 0x7fb6541f8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.632+0000 7fb64a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6541e7da0 0x7fb6541f8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48224/0 (socket says 172.21.15.78:48224) 2024-09-17T03:12:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.632+0000 7fb64a7fc640 1 -- 172.21.15.78:0/70132095 learned_addr learned my addr 172.21.15.78:0/70132095 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.632+0000 7fb652ffd640 1 --2- 172.21.15.78:0/70132095 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb640004800 0x7fb65415c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.632+0000 7fb6537fe640 1 --2- 172.21.15.78:0/70132095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6541e8500 0x7fb6541e8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:43.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.632+0000 7fb64a7fc640 1 -- 172.21.15.78:0/70132095 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb640004800 msgr2=0x7fb65415c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.632+0000 7fb64a7fc640 1 --2- 172.21.15.78:0/70132095 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb640004800 0x7fb65415c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.632+0000 7fb64a7fc640 1 -- 172.21.15.78:0/70132095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6541e8500 msgr2=0x7fb6541e8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.632+0000 7fb64a7fc640 1 --2- 172.21.15.78:0/70132095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6541e8500 0x7fb6541e8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.632+0000 7fb64a7fc640 1 -- 172.21.15.78:0/70132095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6541f97a0 con 0x7fb6541e7da0 2024-09-17T03:12:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.632+0000 7fb64a7fc640 1 --2- 172.21.15.78:0/70132095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6541e7da0 0x7fb6541f8bc0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009a70 tx=0x7fb63c0336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.632+0000 7fb64bfff640 1 -- 172.21.15.78:0/70132095 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c038040 con 0x7fb6541e7da0 2024-09-17T03:12:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.633+0000 7fb64bfff640 1 -- 172.21.15.78:0/70132095 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb63c041070 con 0x7fb6541e7da0 2024-09-17T03:12:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.633+0000 7fb6595cf640 1 -- 172.21.15.78:0/70132095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6541f9a80 con 0x7fb6541e7da0 2024-09-17T03:12:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.633+0000 7fb64bfff640 1 -- 172.21.15.78:0/70132095 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c03c430 con 0x7fb6541e7da0 2024-09-17T03:12:43.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.633+0000 7fb6595cf640 1 -- 172.21.15.78:0/70132095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6541e75c0 con 0x7fb6541e7da0 2024-09-17T03:12:43.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.634+0000 7fb6595cf640 1 -- 172.21.15.78:0/70132095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6540b6800 con 0x7fb6541e7da0 2024-09-17T03:12:43.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.634+0000 7fb64bfff640 1 -- 172.21.15.78:0/70132095 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb63c03c5d0 con 0x7fb6541e7da0 2024-09-17T03:12:43.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.635+0000 7fb64bfff640 1 --2- 172.21.15.78:0/70132095 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb634078b90 0x7fb63407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:43.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.635+0000 7fb64bfff640 1 -- 172.21.15.78:0/70132095 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5115+0+0 (secure 0 0 0) 0x7fb63c0bb520 con 0x7fb6541e7da0 2024-09-17T03:12:43.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.635+0000 7fb652ffd640 1 --2- 172.21.15.78:0/70132095 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb634078b90 0x7fb63407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:43.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.635+0000 7fb652ffd640 1 --2- 172.21.15.78:0/70132095 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb634078b90 0x7fb63407b0a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb6440019d0 tx=0x7fb6440066f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:43.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.639+0000 7fb64bfff640 1 -- 172.21.15.78:0/70132095 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb63c0835f0 con 0x7fb6541e7da0 2024-09-17T03:12:43.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.816+0000 7fb6595cf640 1 -- 172.21.15.78:0/70132095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6541f9530 con 0x7fb6541e7da0 2024-09-17T03:12:43.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.817+0000 7fb64bfff640 1 -- 172.21.15.78:0/70132095 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+13268 (secure 0 0 0) 0x7fb63c08a090 con 0x7fb6541e7da0 2024-09-17T03:12:43.815 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:12:43.816 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":61,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:12:42.491817+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.193:6835/2730762656":"2024-09-18T03:12:39.474869+0000","172.21.15.78:6834/936871583":"2024-09-18T03:12:39.474878+0000","172.21.15.193:6837/2730762656":"2024-09-18T03:12:39.474869+0000","172.21.15.78:6832/936871583":"2024-09-18T03:12:39.474878+0000","172.21.15.78:6835/1865992966":"2024-09-18T03:12:39.474847+0000","172.21.15.78:6833/1865992966":"2024-09-18T03:12:39.474847+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:12:43.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.819+0000 7fb6595cf640 1 -- 172.21.15.78:0/70132095 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb634078b90 msgr2=0x7fb63407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:43.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.819+0000 7fb6595cf640 1 --2- 172.21.15.78:0/70132095 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb634078b90 0x7fb63407b0a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb6440019d0 tx=0x7fb6440066f0 comp rx=0 tx=0).stop 2024-09-17T03:12:43.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.819+0000 7fb6595cf640 1 -- 172.21.15.78:0/70132095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6541e7da0 msgr2=0x7fb6541f8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:43.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.819+0000 7fb6595cf640 1 --2- 172.21.15.78:0/70132095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6541e7da0 0x7fb6541f8bc0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009a70 tx=0x7fb63c0336f0 comp rx=0 tx=0).stop 2024-09-17T03:12:43.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.819+0000 7fb6595cf640 1 -- 172.21.15.78:0/70132095 shutdown_connections 2024-09-17T03:12:43.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.819+0000 7fb6595cf640 1 --2- 172.21.15.78:0/70132095 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb634078b90 0x7fb63407b0a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:43.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.819+0000 7fb6595cf640 1 --2- 172.21.15.78:0/70132095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6541e8500 0x7fb6541e8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:43.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.819+0000 7fb6595cf640 1 --2- 172.21.15.78:0/70132095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6541e7da0 0x7fb6541f8bc0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:43.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.819+0000 7fb6595cf640 1 --2- 172.21.15.78:0/70132095 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb640004800 0x7fb65415c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:43.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.819+0000 7fb6595cf640 1 -- 172.21.15.78:0/70132095 >> 172.21.15.78:0/70132095 conn(0x7fb65409d7f0 msgr2=0x7fb6540d3400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:43.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.819+0000 7fb6595cf640 1 -- 172.21.15.78:0/70132095 shutdown_connections 2024-09-17T03:12:43.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.819+0000 7fb6595cf640 1 -- 172.21.15.78:0/70132095 wait complete. 2024-09-17T03:12:43.829 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:08:17.135915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:12:43.829 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:12:43.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.947+0000 7fc1b7bba640 1 -- 172.21.15.78:0/3239943589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc198003a80 msgr2=0x7fc198003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:43.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.947+0000 7fc1b7bba640 1 --2- 172.21.15.78:0/3239943589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc198003a80 0x7fc198003ef0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000c640 tx=0x7fc198005830 comp rx=0 tx=0).stop 2024-09-17T03:12:43.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.947+0000 7fc1b6157640 1 -- 172.21.15.78:0/3239943589 reap_dead start 2024-09-17T03:12:43.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.947+0000 7fc1b7bba640 1 -- 172.21.15.78:0/3239943589 shutdown_connections 2024-09-17T03:12:43.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.947+0000 7fc1b7bba640 1 -- 172.21.15.78:0/3239943589 >> 172.21.15.78:0/3239943589 conn(0x7fc1b00cdcb0 msgr2=0x7fc1b00ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:43.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.948+0000 7fc1b7bba640 1 -- 172.21.15.78:0/3239943589 shutdown_connections 2024-09-17T03:12:43.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.948+0000 7fc1b7bba640 1 -- 172.21.15.78:0/3239943589 wait complete. 2024-09-17T03:12:43.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.949+0000 7fc1b7bba640 1 Processor -- start 2024-09-17T03:12:43.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.949+0000 7fc1b7bba640 1 -- start start 2024-09-17T03:12:43.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1b7bba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc198003a80 0x7fc1b00b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:43.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1b7bba640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc1b00b1750 0x7fc1b009ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:43.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1b7bba640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1b009ebd0 0x7fc1b0156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:43.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1b7bba640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b00adfa0 con 0x7fc198003a80 2024-09-17T03:12:43.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1b7bba640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b0071ca0 con 0x7fc1b009ebd0 2024-09-17T03:12:43.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1b7bba640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b00ae120 con 0x7fc1b00b1750 2024-09-17T03:12:43.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1b5956640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc198003a80 0x7fc1b00b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:43.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1b5956640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc198003a80 0x7fc1b00b1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48244/0 (socket says 172.21.15.78:48244) 2024-09-17T03:12:43.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1b5956640 1 -- 172.21.15.78:0/2466210539 learned_addr learned my addr 172.21.15.78:0/2466210539 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:43.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1b6157640 1 --2- 172.21.15.78:0/2466210539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1b009ebd0 0x7fc1b0156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:43.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1b5155640 1 --2- 172.21.15.78:0/2466210539 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc1b00b1750 0x7fc1b009ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:43.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1b5956640 1 -- 172.21.15.78:0/2466210539 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc1b00b1750 msgr2=0x7fc1b009ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:43.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1b5956640 1 --2- 172.21.15.78:0/2466210539 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc1b00b1750 0x7fc1b009ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:43.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1b5956640 1 -- 172.21.15.78:0/2466210539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1b009ebd0 msgr2=0x7fc1b0156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:43.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1b5956640 1 --2- 172.21.15.78:0/2466210539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1b009ebd0 0x7fc1b0156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:43.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1b5956640 1 -- 172.21.15.78:0/2466210539 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b009db30 con 0x7fc198003a80 2024-09-17T03:12:43.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1b6157640 1 --2- 172.21.15.78:0/2466210539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1b009ebd0 0x7fc1b0156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:43.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1b5155640 1 --2- 172.21.15.78:0/2466210539 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc1b00b1750 0x7fc1b009ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:43.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1b5956640 1 --2- 172.21.15.78:0/2466210539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc198003a80 0x7fc1b00b1210 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000c730 tx=0x7fc1a0004c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:43.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1ae7fc640 1 -- 172.21.15.78:0/2466210539 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0039070 con 0x7fc198003a80 2024-09-17T03:12:43.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1ae7fc640 1 -- 172.21.15.78:0/2466210539 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1a0004e50 con 0x7fc198003a80 2024-09-17T03:12:43.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1b7bba640 1 -- 172.21.15.78:0/2466210539 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b009de10 con 0x7fc198003a80 2024-09-17T03:12:43.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.951+0000 7fc1ae7fc640 1 -- 172.21.15.78:0/2466210539 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0001ff0 con 0x7fc198003a80 2024-09-17T03:12:43.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.952+0000 7fc1b7bba640 1 -- 172.21.15.78:0/2466210539 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b009e3d0 con 0x7fc198003a80 2024-09-17T03:12:43.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.953+0000 7fc1b7bba640 1 -- 172.21.15.78:0/2466210539 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b009e810 con 0x7fc198003a80 2024-09-17T03:12:43.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.953+0000 7fc1ae7fc640 1 -- 172.21.15.78:0/2466210539 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc1a0045020 con 0x7fc198003a80 2024-09-17T03:12:43.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.954+0000 7fc1ae7fc640 1 --2- 172.21.15.78:0/2466210539 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc19c078b90 0x7fc19c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:43.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.954+0000 7fc1ae7fc640 1 -- 172.21.15.78:0/2466210539 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5115+0+0 (secure 0 0 0) 0x7fc1a00baff0 con 0x7fc198003a80 2024-09-17T03:12:43.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.954+0000 7fc1b5155640 1 --2- 172.21.15.78:0/2466210539 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc19c078b90 0x7fc19c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:43.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.955+0000 7fc1b5155640 1 --2- 172.21.15.78:0/2466210539 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc19c078b90 0x7fc19c07b0a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00b25d0 tx=0x7fc1a4005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:43.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:43.958+0000 7fc1ae7fc640 1 -- 172.21.15.78:0/2466210539 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc1a0083680 con 0x7fc198003a80 2024-09-17T03:12:44.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.134+0000 7fc1b7bba640 1 -- 172.21.15.78:0/2466210539 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc1b00af830 con 0x7fc198003a80 2024-09-17T03:12:44.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.135+0000 7fc1ae7fc640 1 -- 172.21.15.78:0/2466210539 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) ==== 93+0+10 (secure 0 0 0) 0x7fc1a0082f80 con 0x7fc198003a80 2024-09-17T03:12:44.134 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-09-17T03:12:44.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.137+0000 7fc1b7bba640 1 -- 172.21.15.78:0/2466210539 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc19c078b90 msgr2=0x7fc19c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:44.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.137+0000 7fc1b7bba640 1 --2- 172.21.15.78:0/2466210539 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc19c078b90 0x7fc19c07b0a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc1b00b25d0 tx=0x7fc1a4005f90 comp rx=0 tx=0).stop 2024-09-17T03:12:44.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.137+0000 7fc1b7bba640 1 -- 172.21.15.78:0/2466210539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc198003a80 msgr2=0x7fc1b00b1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:44.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.137+0000 7fc1b7bba640 1 --2- 172.21.15.78:0/2466210539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc198003a80 0x7fc1b00b1210 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000c730 tx=0x7fc1a0004c30 comp rx=0 tx=0).stop 2024-09-17T03:12:44.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.137+0000 7fc1b7bba640 1 -- 172.21.15.78:0/2466210539 shutdown_connections 2024-09-17T03:12:44.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.137+0000 7fc1b7bba640 1 --2- 172.21.15.78:0/2466210539 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc19c078b90 0x7fc19c07b0a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:44.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.137+0000 7fc1b7bba640 1 --2- 172.21.15.78:0/2466210539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc1b009ebd0 0x7fc1b0156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:44.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.137+0000 7fc1b7bba640 1 --2- 172.21.15.78:0/2466210539 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc1b00b1750 0x7fc1b009ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:44.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.137+0000 7fc1b7bba640 1 --2- 172.21.15.78:0/2466210539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc198003a80 0x7fc1b00b1210 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:44.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.137+0000 7fc1b7bba640 1 -- 172.21.15.78:0/2466210539 >> 172.21.15.78:0/2466210539 conn(0x7fc1b00cdcb0 msgr2=0x7fc1b00cbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:44.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.137+0000 7fc1b7bba640 1 -- 172.21.15.78:0/2466210539 shutdown_connections 2024-09-17T03:12:44.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.137+0000 7fc1b7bba640 1 -- 172.21.15.78:0/2466210539 wait complete. 2024-09-17T03:12:44.147 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0' 2024-09-17T03:12:44.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.260+0000 7fc4c4589640 1 -- 172.21.15.78:0/1631334602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4bc0cd360 msgr2=0x7fc4bc15c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:44.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.260+0000 7fc4c4589640 1 --2- 172.21.15.78:0/1631334602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4bc0cd360 0x7fc4bc15c6a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc0d22c0 tx=0x7fc4ac02a4f0 comp rx=0 tx=0).stop 2024-09-17T03:12:44.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.260+0000 7fc4c4589640 1 -- 172.21.15.78:0/1631334602 shutdown_connections 2024-09-17T03:12:44.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.260+0000 7fc4c4589640 1 --2- 172.21.15.78:0/1631334602 >> v2:172.21.15.193:3300/0 conn(0x7fc4bc0b7fe0 0x7fc4bc0ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:44.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.260+0000 7fc4c4589640 1 --2- 172.21.15.78:0/1631334602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4bc0cd360 0x7fc4bc15c6a0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:44.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.260+0000 7fc4c4589640 1 -- 172.21.15.78:0/1631334602 >> 172.21.15.78:0/1631334602 conn(0x7fc4bc0710b0 msgr2=0x7fc4bc0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:44.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.260+0000 7fc4c4589640 1 -- 172.21.15.78:0/1631334602 shutdown_connections 2024-09-17T03:12:44.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.260+0000 7fc4c4589640 1 -- 172.21.15.78:0/1631334602 wait complete. 2024-09-17T03:12:44.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.262+0000 7fc4c4589640 1 Processor -- start 2024-09-17T03:12:44.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.262+0000 7fc4c4589640 1 -- start start 2024-09-17T03:12:44.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.263+0000 7fc4c4589640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc4bc0b7fe0 0x7fc4bc14e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:44.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.263+0000 7fc4c4589640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc4bc0cd360 0x7fc4bc1f7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:44.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.263+0000 7fc4c4589640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4bc0cf270 0x7fc4bc0c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:44.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.263+0000 7fc4c4589640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc072f60 con 0x7fc4bc0cf270 2024-09-17T03:12:44.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.263+0000 7fc4c4589640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc0d13b0 con 0x7fc4bc0cd360 2024-09-17T03:12:44.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.263+0000 7fc4c4589640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc4bc0730e0 con 0x7fc4bc0b7fe0 2024-09-17T03:12:44.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.263+0000 7fc4c2b26640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4bc0cf270 0x7fc4bc0c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:44.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.263+0000 7fc4c2b26640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4bc0cf270 0x7fc4bc0c7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48262/0 (socket says 172.21.15.78:48262) 2024-09-17T03:12:44.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.263+0000 7fc4c2b26640 1 -- 172.21.15.78:0/39694876 learned_addr learned my addr 172.21.15.78:0/39694876 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:44.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.263+0000 7fc4c2325640 1 --2- 172.21.15.78:0/39694876 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc4bc0b7fe0 0x7fc4bc14e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:44.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.263+0000 7fc4c1b24640 1 --2- 172.21.15.78:0/39694876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc4bc0cd360 0x7fc4bc1f7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:44.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.263+0000 7fc4c2b26640 1 -- 172.21.15.78:0/39694876 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc4bc0b7fe0 msgr2=0x7fc4bc14e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:44.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.263+0000 7fc4c2b26640 1 --2- 172.21.15.78:0/39694876 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc4bc0b7fe0 0x7fc4bc14e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:44.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.263+0000 7fc4c2b26640 1 -- 172.21.15.78:0/39694876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc4bc0cd360 msgr2=0x7fc4bc1f7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:44.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.263+0000 7fc4c2b26640 1 --2- 172.21.15.78:0/39694876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc4bc0cd360 0x7fc4bc1f7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:44.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.263+0000 7fc4c2b26640 1 -- 172.21.15.78:0/39694876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4bc1f3bc0 con 0x7fc4bc0cf270 2024-09-17T03:12:44.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.263+0000 7fc4c1b24640 1 --2- 172.21.15.78:0/39694876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc4bc0cd360 0x7fc4bc1f7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:44.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.263+0000 7fc4c2b26640 1 --2- 172.21.15.78:0/39694876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4bc0cf270 0x7fc4bc0c7fe0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400b990 tx=0x7fc4b400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:44.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.264+0000 7fc4baffd640 1 -- 172.21.15.78:0/39694876 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4019070 con 0x7fc4bc0cf270 2024-09-17T03:12:44.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.264+0000 7fc4baffd640 1 -- 172.21.15.78:0/39694876 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4b400cc90 con 0x7fc4bc0cf270 2024-09-17T03:12:44.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.264+0000 7fc4c4589640 1 -- 172.21.15.78:0/39694876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4bc1f3ea0 con 0x7fc4bc0cf270 2024-09-17T03:12:44.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.264+0000 7fc4baffd640 1 -- 172.21.15.78:0/39694876 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b40146a0 con 0x7fc4bc0cf270 2024-09-17T03:12:44.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.264+0000 7fc4c4589640 1 -- 172.21.15.78:0/39694876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4bc1f4460 con 0x7fc4bc0cf270 2024-09-17T03:12:44.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.265+0000 7fc4c4589640 1 -- 172.21.15.78:0/39694876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4bc0b3c10 con 0x7fc4bc0cf270 2024-09-17T03:12:44.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.266+0000 7fc4baffd640 1 -- 172.21.15.78:0/39694876 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc4b401c070 con 0x7fc4bc0cf270 2024-09-17T03:12:44.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.266+0000 7fc4baffd640 1 --2- 172.21.15.78:0/39694876 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc4a8078b90 0x7fc4a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:44.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.266+0000 7fc4baffd640 1 -- 172.21.15.78:0/39694876 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5115+0+0 (secure 0 0 0) 0x7fc4b409a850 con 0x7fc4bc0cf270 2024-09-17T03:12:44.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.266+0000 7fc4c2325640 1 --2- 172.21.15.78:0/39694876 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc4a8078b90 0x7fc4a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:44.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.267+0000 7fc4c2325640 1 --2- 172.21.15.78:0/39694876 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc4a8078b90 0x7fc4a807b0a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac033000 tx=0x7fc4ac004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:44.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.270+0000 7fc4baffd640 1 -- 172.21.15.78:0/39694876 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc4b4062890 con 0x7fc4bc0cf270 2024-09-17T03:12:44.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:44.511+0000 7fc4c4589640 1 -- 172.21.15.78:0/39694876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0"]} v 0) -- 0x7fc4bc0b6810 con 0x7fc4bc0cf270 2024-09-17T03:12:45.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.509+0000 7fc4baffd640 1 -- 172.21.15.78:0/39694876 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0"]}]=0 v220) ==== 144+0+0 (secure 0 0 0) 0x7fc4b40672c0 con 0x7fc4bc0cf270 2024-09-17T03:12:45.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.512+0000 7fc4c4589640 1 -- 172.21.15.78:0/39694876 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc4a8078b90 msgr2=0x7fc4a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:45.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.512+0000 7fc4c4589640 1 --2- 172.21.15.78:0/39694876 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc4a8078b90 0x7fc4a807b0a0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac033000 tx=0x7fc4ac004730 comp rx=0 tx=0).stop 2024-09-17T03:12:45.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.512+0000 7fc4c4589640 1 -- 172.21.15.78:0/39694876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4bc0cf270 msgr2=0x7fc4bc0c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:45.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.512+0000 7fc4c4589640 1 --2- 172.21.15.78:0/39694876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4bc0cf270 0x7fc4bc0c7fe0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400b990 tx=0x7fc4b400be50 comp rx=0 tx=0).stop 2024-09-17T03:12:45.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.512+0000 7fc4c4589640 1 -- 172.21.15.78:0/39694876 shutdown_connections 2024-09-17T03:12:45.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.512+0000 7fc4c4589640 1 --2- 172.21.15.78:0/39694876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4bc0cf270 0x7fc4bc0c7fe0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:45.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.512+0000 7fc4c4589640 1 --2- 172.21.15.78:0/39694876 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc4a8078b90 0x7fc4a807b0a0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:45.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.512+0000 7fc4c4589640 1 --2- 172.21.15.78:0/39694876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc4bc0cd360 0x7fc4bc1f7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:45.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.512+0000 7fc4c4589640 1 --2- 172.21.15.78:0/39694876 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc4bc0b7fe0 0x7fc4bc14e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:45.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.512+0000 7fc4c4589640 1 -- 172.21.15.78:0/39694876 >> 172.21.15.78:0/39694876 conn(0x7fc4bc0710b0 msgr2=0x7fc4bc0b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:45.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.512+0000 7fc4c4589640 1 -- 172.21.15.78:0/39694876 shutdown_connections 2024-09-17T03:12:45.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.512+0000 7fc4c4589640 1 -- 172.21.15.78:0/39694876 wait complete. 2024-09-17T03:12:45.525 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:12:45.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.641+0000 7fce6c5ba640 1 -- 172.21.15.78:0/2806347764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce6406e170 msgr2=0x7fce640b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:45.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.641+0000 7fce6c5ba640 1 --2- 172.21.15.78:0/2806347764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce6406e170 0x7fce640b3540 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fce6408d9b0 tx=0x7fce6002a4f0 comp rx=0 tx=0).stop 2024-09-17T03:12:45.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.641+0000 7fce6c5ba640 1 -- 172.21.15.78:0/2806347764 shutdown_connections 2024-09-17T03:12:45.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.641+0000 7fce6c5ba640 1 --2- 172.21.15.78:0/2806347764 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fce640d3870 0x7fce640ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:45.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.641+0000 7fce6c5ba640 1 --2- 172.21.15.78:0/2806347764 >> v2:172.21.15.193:3300/0 conn(0x7fce6406f4b0 0x7fce640d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:45.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.641+0000 7fce6c5ba640 1 --2- 172.21.15.78:0/2806347764 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce6406e170 0x7fce640b3540 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:45.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.641+0000 7fce6c5ba640 1 -- 172.21.15.78:0/2806347764 >> 172.21.15.78:0/2806347764 conn(0x7fce6408bfc0 msgr2=0x7fce6409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:45.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.641+0000 7fce6c5ba640 1 -- 172.21.15.78:0/2806347764 shutdown_connections 2024-09-17T03:12:45.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.642+0000 7fce6c5ba640 1 -- 172.21.15.78:0/2806347764 wait complete. 2024-09-17T03:12:45.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.643+0000 7fce6c5ba640 1 Processor -- start 2024-09-17T03:12:45.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.643+0000 7fce6c5ba640 1 -- start start 2024-09-17T03:12:45.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce6c5ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce6406f4b0 0x7fce641512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:45.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce6c5ba640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce640d3870 0x7fce641f8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:45.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce6c5ba640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fce641f9350 0x7fce641f9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:45.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce6c5ba640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fce640cf490 con 0x7fce6406f4b0 2024-09-17T03:12:45.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce6c5ba640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fce640cf310 con 0x7fce640d3870 2024-09-17T03:12:45.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce6c5ba640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fce640d0ce0 con 0x7fce641f9350 2024-09-17T03:12:45.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce6a356640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce6406f4b0 0x7fce641512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:45.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce6a356640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce6406f4b0 0x7fce641512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48284/0 (socket says 172.21.15.78:48284) 2024-09-17T03:12:45.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce6a356640 1 -- 172.21.15.78:0/1830682251 learned_addr learned my addr 172.21.15.78:0/1830682251 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:45.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce6ab57640 1 --2- 172.21.15.78:0/1830682251 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fce641f9350 0x7fce641f9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce69b55640 1 --2- 172.21.15.78:0/1830682251 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce640d3870 0x7fce641f8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce6a356640 1 -- 172.21.15.78:0/1830682251 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fce641f9350 msgr2=0x7fce641f9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce6a356640 1 --2- 172.21.15.78:0/1830682251 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fce641f9350 0x7fce641f9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce6a356640 1 -- 172.21.15.78:0/1830682251 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce640d3870 msgr2=0x7fce641f8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce6a356640 1 --2- 172.21.15.78:0/1830682251 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce640d3870 0x7fce641f8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce6a356640 1 -- 172.21.15.78:0/1830682251 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce64151b80 con 0x7fce6406f4b0 2024-09-17T03:12:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce6a356640 1 --2- 172.21.15.78:0/1830682251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce6406f4b0 0x7fce641512a0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fce60000c00 tx=0x7fce60003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce5affd640 1 -- 172.21.15.78:0/1830682251 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6003e030 con 0x7fce6406f4b0 2024-09-17T03:12:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce5affd640 1 -- 172.21.15.78:0/1830682251 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce60003e00 con 0x7fce6406f4b0 2024-09-17T03:12:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce6c5ba640 1 -- 172.21.15.78:0/1830682251 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce641546c0 con 0x7fce6406f4b0 2024-09-17T03:12:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.645+0000 7fce5affd640 1 -- 172.21.15.78:0/1830682251 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60035040 con 0x7fce6406f4b0 2024-09-17T03:12:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.646+0000 7fce6c5ba640 1 -- 172.21.15.78:0/1830682251 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce640cc860 con 0x7fce6406f4b0 2024-09-17T03:12:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.646+0000 7fce6c5ba640 1 -- 172.21.15.78:0/1830682251 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce640b9d60 con 0x7fce6406f4b0 2024-09-17T03:12:45.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.647+0000 7fce5affd640 1 -- 172.21.15.78:0/1830682251 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce60041030 con 0x7fce6406f4b0 2024-09-17T03:12:45.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.648+0000 7fce5affd640 1 --2- 172.21.15.78:0/1830682251 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fce48078b90 0x7fce4807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:45.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.648+0000 7fce5affd640 1 -- 172.21.15.78:0/1830682251 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5115+0+0 (secure 0 0 0) 0x7fce600bb180 con 0x7fce6406f4b0 2024-09-17T03:12:45.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.648+0000 7fce69b55640 1 --2- 172.21.15.78:0/1830682251 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fce48078b90 0x7fce4807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:45.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.648+0000 7fce69b55640 1 --2- 172.21.15.78:0/1830682251 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fce48078b90 0x7fce4807b0a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fce640c8650 tx=0x7fce5400b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:45.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.652+0000 7fce5affd640 1 -- 172.21.15.78:0/1830682251 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fce640b9d60 con 0x7fce6406f4b0 2024-09-17T03:12:45.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.825+0000 7fce6c5ba640 1 -- 172.21.15.78:0/1830682251 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fce6406e170 con 0x7fce6406f4b0 2024-09-17T03:12:45.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.826+0000 7fce5affd640 1 -- 172.21.15.78:0/1830682251 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+2294 (secure 0 0 0) 0x7fce60083250 con 0x7fce6406f4b0 2024-09-17T03:12:45.826 INFO:teuthology.orchestra.run.smithi078.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:12:45.826 INFO:teuthology.orchestra.run.smithi078.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:12:45.826 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:12:45.826 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_client 20/20 2024-09-17T03:12:45.826 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:12:45.827 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:12:45.827 INFO:teuthology.orchestra.run.smithi078.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:12:45.827 INFO:teuthology.orchestra.run.smithi078.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:12:45.827 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4994.035848 2024-09-17T03:12:45.827 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5277.317911 2024-09-17T03:12:45.827 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4833.009828 2024-09-17T03:12:45.827 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7208.562209 2024-09-17T03:12:45.827 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4511.051809 2024-09-17T03:12:45.827 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4237.642218 2024-09-17T03:12:45.827 INFO:teuthology.orchestra.run.smithi078.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 6005.051341 2024-09-17T03:12:45.827 INFO:teuthology.orchestra.run.smithi078.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4677.613119 2024-09-17T03:12:45.828 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_mds 20/20 2024-09-17T03:12:45.828 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:12:45.828 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_ms 2/2 2024-09-17T03:12:45.828 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_debug_frag true 2024-09-17T03:12:45.828 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:12:45.828 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:12:45.828 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_verify_scatter true 2024-09-17T03:12:45.828 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:12:45.828 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:12:45.828 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:12:45.828 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced client_mount_timeout 600 2024-09-17T03:12:45.828 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced debug_client 20/20 2024-09-17T03:12:45.829 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced debug_ms 1/1 2024-09-17T03:12:45.829 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:12:45.829 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:12:45.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.828+0000 7fce6c5ba640 1 -- 172.21.15.78:0/1830682251 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fce48078b90 msgr2=0x7fce4807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:45.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.828+0000 7fce6c5ba640 1 --2- 172.21.15.78:0/1830682251 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fce48078b90 0x7fce4807b0a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fce640c8650 tx=0x7fce5400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:12:45.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.828+0000 7fce6c5ba640 1 -- 172.21.15.78:0/1830682251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce6406f4b0 msgr2=0x7fce641512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:45.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.828+0000 7fce6c5ba640 1 --2- 172.21.15.78:0/1830682251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce6406f4b0 0x7fce641512a0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fce60000c00 tx=0x7fce60003910 comp rx=0 tx=0).stop 2024-09-17T03:12:45.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.828+0000 7fce6c5ba640 1 -- 172.21.15.78:0/1830682251 shutdown_connections 2024-09-17T03:12:45.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.828+0000 7fce6c5ba640 1 --2- 172.21.15.78:0/1830682251 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fce641f9350 0x7fce641f9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:45.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.828+0000 7fce6c5ba640 1 --2- 172.21.15.78:0/1830682251 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fce48078b90 0x7fce4807b0a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:45.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.828+0000 7fce6c5ba640 1 --2- 172.21.15.78:0/1830682251 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce640d3870 0x7fce641f8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:45.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.828+0000 7fce6c5ba640 1 --2- 172.21.15.78:0/1830682251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce6406f4b0 0x7fce641512a0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:45.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.828+0000 7fce6c5ba640 1 -- 172.21.15.78:0/1830682251 >> 172.21.15.78:0/1830682251 conn(0x7fce6408bfc0 msgr2=0x7fce640d3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:45.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.828+0000 7fce6c5ba640 1 -- 172.21.15.78:0/1830682251 shutdown_connections 2024-09-17T03:12:45.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.828+0000 7fce6c5ba640 1 -- 172.21.15.78:0/1830682251 wait complete. 2024-09-17T03:12:45.839 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:12:45.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.954+0000 7fd8f62f9640 1 -- 172.21.15.78:0/1932000675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f00b3540 msgr2=0x7fd8f00d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:45.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.954+0000 7fd8f62f9640 1 --2- 172.21.15.78:0/1932000675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f00b3540 0x7fd8f00d3330 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009830 tx=0x7fd8e402a480 comp rx=0 tx=0).stop 2024-09-17T03:12:45.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.954+0000 7fd8f62f9640 1 -- 172.21.15.78:0/1932000675 shutdown_connections 2024-09-17T03:12:45.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.954+0000 7fd8f62f9640 1 --2- 172.21.15.78:0/1932000675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f00b3540 0x7fd8f00d3330 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:45.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.954+0000 7fd8f62f9640 1 -- 172.21.15.78:0/1932000675 >> 172.21.15.78:0/1932000675 conn(0x7fd8f008bfc0 msgr2=0x7fd8f009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:45.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.954+0000 7fd8f62f9640 1 -- 172.21.15.78:0/1932000675 shutdown_connections 2024-09-17T03:12:45.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.954+0000 7fd8f62f9640 1 -- 172.21.15.78:0/1932000675 wait complete. 2024-09-17T03:12:45.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.956+0000 7fd8f62f9640 1 Processor -- start 2024-09-17T03:12:45.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.956+0000 7fd8f62f9640 1 -- start start 2024-09-17T03:12:45.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.957+0000 7fd8f62f9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd8f00b3540 0x7fd8f01f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.957+0000 7fd8f62f9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f00d3870 0x7fd8f00cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.957+0000 7fd8f62f9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd8f00cd930 0x7fd8f00cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.957+0000 7fd8f62f9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f00d1070 con 0x7fd8f00d3870 2024-09-17T03:12:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.957+0000 7fd8f62f9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f00d0ef0 con 0x7fd8f00cd930 2024-09-17T03:12:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.957+0000 7fd8f62f9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f00d11f0 con 0x7fd8f00b3540 2024-09-17T03:12:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.958+0000 7fd8ef7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f00d3870 0x7fd8f00cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.958+0000 7fd8ef7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f00d3870 0x7fd8f00cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48314/0 (socket says 172.21.15.78:48314) 2024-09-17T03:12:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.958+0000 7fd8ef7fe640 1 -- 172.21.15.78:0/4157361200 learned_addr learned my addr 172.21.15.78:0/4157361200 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.958+0000 7fd8f4896640 1 --2- 172.21.15.78:0/4157361200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd8f00cd930 0x7fd8f00cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.958+0000 7fd8effff640 1 --2- 172.21.15.78:0/4157361200 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd8f00b3540 0x7fd8f01f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.958+0000 7fd8ef7fe640 1 -- 172.21.15.78:0/4157361200 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd8f00b3540 msgr2=0x7fd8f01f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.958+0000 7fd8ef7fe640 1 --2- 172.21.15.78:0/4157361200 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd8f00b3540 0x7fd8f01f4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:45.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.958+0000 7fd8ef7fe640 1 -- 172.21.15.78:0/4157361200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd8f00cd930 msgr2=0x7fd8f00cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:45.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.958+0000 7fd8ef7fe640 1 --2- 172.21.15.78:0/4157361200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd8f00cd930 0x7fd8f00cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:45.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.958+0000 7fd8ef7fe640 1 -- 172.21.15.78:0/4157361200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f00ce280 con 0x7fd8f00d3870 2024-09-17T03:12:45.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.958+0000 7fd8effff640 1 --2- 172.21.15.78:0/4157361200 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd8f00b3540 0x7fd8f01f4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:45.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.958+0000 7fd8ef7fe640 1 --2- 172.21.15.78:0/4157361200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f00d3870 0x7fd8f00cd3f0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009950 tx=0x7fd8e4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:45.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.958+0000 7fd8ecff9640 1 -- 172.21.15.78:0/4157361200 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4005c90 con 0x7fd8f00d3870 2024-09-17T03:12:45.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.958+0000 7fd8ecff9640 1 -- 172.21.15.78:0/4157361200 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8e4031e50 con 0x7fd8f00d3870 2024-09-17T03:12:45.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.958+0000 7fd8f62f9640 1 -- 172.21.15.78:0/4157361200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f00b8d60 con 0x7fd8f00d3870 2024-09-17T03:12:45.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.958+0000 7fd8ecff9640 1 -- 172.21.15.78:0/4157361200 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4005260 con 0x7fd8f00d3870 2024-09-17T03:12:45.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.958+0000 7fd8f62f9640 1 -- 172.21.15.78:0/4157361200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f00ccbf0 con 0x7fd8f00d3870 2024-09-17T03:12:45.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.959+0000 7fd8f62f9640 1 -- 172.21.15.78:0/4157361200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8f00cc9e0 con 0x7fd8f00d3870 2024-09-17T03:12:45.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.960+0000 7fd8ecff9640 1 -- 172.21.15.78:0/4157361200 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd8e4005400 con 0x7fd8f00d3870 2024-09-17T03:12:45.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.961+0000 7fd8ecff9640 1 --2- 172.21.15.78:0/4157361200 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd8dc078bc0 0x7fd8dc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:45.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.961+0000 7fd8ecff9640 1 -- 172.21.15.78:0/4157361200 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5115+0+0 (secure 0 0 0) 0x7fd8e40bbb60 con 0x7fd8f00d3870 2024-09-17T03:12:45.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.961+0000 7fd8effff640 1 --2- 172.21.15.78:0/4157361200 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd8dc078bc0 0x7fd8dc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:45.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.962+0000 7fd8effff640 1 --2- 172.21.15.78:0/4157361200 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd8dc078bc0 0x7fd8dc07b0d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0006fd0 tx=0x7fd8e0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:45.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:45.965+0000 7fd8ecff9640 1 -- 172.21.15.78:0/4157361200 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd8e403f030 con 0x7fd8f00d3870 2024-09-17T03:12:46.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.146+0000 7fd8f62f9640 1 -- 172.21.15.78:0/4157361200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd8f006e170 con 0x7fd8f00d3870 2024-09-17T03:12:46.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.150+0000 7fd8ecff9640 1 -- 172.21.15.78:0/4157361200 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7fd8e4083b20 con 0x7fd8f00d3870 2024-09-17T03:12:46.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.153+0000 7fd8f62f9640 1 -- 172.21.15.78:0/4157361200 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd8dc078bc0 msgr2=0x7fd8dc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:46.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.153+0000 7fd8f62f9640 1 --2- 172.21.15.78:0/4157361200 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd8dc078bc0 0x7fd8dc07b0d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0006fd0 tx=0x7fd8e0008040 comp rx=0 tx=0).stop 2024-09-17T03:12:46.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.153+0000 7fd8f62f9640 1 -- 172.21.15.78:0/4157361200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f00d3870 msgr2=0x7fd8f00cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:46.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.153+0000 7fd8f62f9640 1 --2- 172.21.15.78:0/4157361200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f00d3870 0x7fd8f00cd3f0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fd8e4009950 tx=0x7fd8e4033c20 comp rx=0 tx=0).stop 2024-09-17T03:12:46.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.153+0000 7fd8f62f9640 1 -- 172.21.15.78:0/4157361200 shutdown_connections 2024-09-17T03:12:46.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.153+0000 7fd8f62f9640 1 --2- 172.21.15.78:0/4157361200 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd8dc078bc0 0x7fd8dc07b0d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:46.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.153+0000 7fd8f62f9640 1 --2- 172.21.15.78:0/4157361200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd8f00cd930 0x7fd8f00cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:46.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.153+0000 7fd8f62f9640 1 --2- 172.21.15.78:0/4157361200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f00d3870 0x7fd8f00cd3f0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:46.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.153+0000 7fd8f62f9640 1 --2- 172.21.15.78:0/4157361200 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd8f00b3540 0x7fd8f01f4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:46.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.153+0000 7fd8f62f9640 1 -- 172.21.15.78:0/4157361200 >> 172.21.15.78:0/4157361200 conn(0x7fd8f008bfc0 msgr2=0x7fd8f00b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:46.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.153+0000 7fd8f62f9640 1 -- 172.21.15.78:0/4157361200 shutdown_connections 2024-09-17T03:12:46.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.153+0000 7fd8f62f9640 1 -- 172.21.15.78:0/4157361200 wait complete. 2024-09-17T03:12:46.164 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:12:46.164 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:12:46.217 DEBUG:teuthology.orchestra.run.smithi193:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:12:46.259 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:12:46.260 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:12:46.260 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:12:46.275 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056010,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1013 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:12:46.275 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:12:46.275 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:12:46.319 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:12:46.319 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:12:46.319 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:12:46.334 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056010,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1013 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:12:46.335 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:12:46.335 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:12:46.377 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:12:46.377 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:12:46.378 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:12:46.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.491+0000 7ff126d07640 1 -- 172.21.15.78:0/1562214937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff108004800 msgr2=0x7ff108004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:46.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.491+0000 7ff126d07640 1 --2- 172.21.15.78:0/1562214937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff108004800 0x7ff108004c10 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ff11400c3f0 tx=0x7ff108005830 comp rx=0 tx=0).stop 2024-09-17T03:12:46.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.491+0000 7ff1252a4640 1 -- 172.21.15.78:0/1562214937 reap_dead start 2024-09-17T03:12:46.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.491+0000 7ff126d07640 1 -- 172.21.15.78:0/1562214937 shutdown_connections 2024-09-17T03:12:46.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.491+0000 7ff126d07640 1 -- 172.21.15.78:0/1562214937 >> 172.21.15.78:0/1562214937 conn(0x7ff1200b3f10 msgr2=0x7ff1200b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:46.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.491+0000 7ff126d07640 1 -- 172.21.15.78:0/1562214937 shutdown_connections 2024-09-17T03:12:46.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.491+0000 7ff126d07640 1 -- 172.21.15.78:0/1562214937 wait complete. 2024-09-17T03:12:46.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.492+0000 7ff126d07640 1 Processor -- start 2024-09-17T03:12:46.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.492+0000 7ff126d07640 1 -- start start 2024-09-17T03:12:46.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.494+0000 7ff126d07640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff108004800 0x7ff12015ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:46.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.494+0000 7ff126d07640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff1200b0bc0 0x7ff12014d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:46.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.494+0000 7ff126d07640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff12014da50 0x7ff12014f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:46.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.494+0000 7ff126d07640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff1200d0fe0 con 0x7ff108004800 2024-09-17T03:12:46.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.494+0000 7ff126d07640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff1200d0e60 con 0x7ff12014da50 2024-09-17T03:12:46.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.494+0000 7ff126d07640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff1200d1160 con 0x7ff1200b0bc0 2024-09-17T03:12:46.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.494+0000 7ff124aa3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff108004800 0x7ff12015ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:46.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.494+0000 7ff124aa3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff108004800 0x7ff12015ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34772/0 (socket says 172.21.15.78:34772) 2024-09-17T03:12:46.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.494+0000 7ff124aa3640 1 -- 172.21.15.78:0/544870974 learned_addr learned my addr 172.21.15.78:0/544870974 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:46.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.494+0000 7ff124aa3640 1 -- 172.21.15.78:0/544870974 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff1200b0bc0 msgr2=0x7ff12014d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:46.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.494+0000 7ff124aa3640 1 --2- 172.21.15.78:0/544870974 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff1200b0bc0 0x7ff12014d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:46.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.494+0000 7ff124aa3640 1 -- 172.21.15.78:0/544870974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff12014da50 msgr2=0x7ff12014f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:46.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.494+0000 7ff1252a4640 1 --2- 172.21.15.78:0/544870974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff12014da50 0x7ff12014f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:46.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.494+0000 7ff124aa3640 1 --2- 172.21.15.78:0/544870974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff12014da50 0x7ff12014f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:46.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.494+0000 7ff124aa3640 1 -- 172.21.15.78:0/544870974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff12015db10 con 0x7ff108004800 2024-09-17T03:12:46.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.494+0000 7ff124aa3640 1 --2- 172.21.15.78:0/544870974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff108004800 0x7ff12015ebb0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7ff110003f50 tx=0x7ff1100016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:46.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.495+0000 7ff11d7fa640 1 -- 172.21.15.78:0/544870974 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff110011640 con 0x7ff108004800 2024-09-17T03:12:46.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.495+0000 7ff11d7fa640 1 -- 172.21.15.78:0/544870974 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff110016020 con 0x7ff108004800 2024-09-17T03:12:46.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.495+0000 7ff126d07640 1 -- 172.21.15.78:0/544870974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff12015ddf0 con 0x7ff108004800 2024-09-17T03:12:46.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.495+0000 7ff11d7fa640 1 -- 172.21.15.78:0/544870974 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff110011a60 con 0x7ff108004800 2024-09-17T03:12:46.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.495+0000 7ff126d07640 1 -- 172.21.15.78:0/544870974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff12015e3b0 con 0x7ff108004800 2024-09-17T03:12:46.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.496+0000 7ff126d07640 1 -- 172.21.15.78:0/544870974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff12006df80 con 0x7ff108004800 2024-09-17T03:12:46.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.496+0000 7ff11d7fa640 1 -- 172.21.15.78:0/544870974 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff110011c00 con 0x7ff108004800 2024-09-17T03:12:46.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.497+0000 7ff11d7fa640 1 --2- 172.21.15.78:0/544870974 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff10c078b90 0x7ff10c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:46.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.497+0000 7ff11d7fa640 1 -- 172.21.15.78:0/544870974 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5115+0+0 (secure 0 0 0) 0x7ff11009b780 con 0x7ff108004800 2024-09-17T03:12:46.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.497+0000 7ff11ffff640 1 --2- 172.21.15.78:0/544870974 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff10c078b90 0x7ff10c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:46.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.498+0000 7ff11ffff640 1 --2- 172.21.15.78:0/544870974 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff10c078b90 0x7ff10c07b0a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff114033000 tx=0x7ff1200cf6e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:46.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.501+0000 7ff11d7fa640 1 -- 172.21.15.78:0/544870974 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff12006df80 con 0x7ff108004800 2024-09-17T03:12:46.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.715+0000 7ff126d07640 1 -- 172.21.15.78:0/544870974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1200d16f0 con 0x7ff108004800 2024-09-17T03:12:46.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.715+0000 7ff11d7fa640 1 -- 172.21.15.78:0/544870974 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+3911 (secure 0 0 0) 0x7ff110020020 con 0x7ff108004800 2024-09-17T03:12:46.715 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:12:46.716 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":56,"btime":"2024-09-17T03:12:40:478575+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5474,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/33195895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":33195895},{"type":"v1","addr":"172.21.15.193:6836","nonce":33195895}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42},{"gid":5810,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/3086256440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":3086256440},{"type":"v1","addr":"172.21.15.193:6837","nonce":3086256440}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6783,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/1619350831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1619350831},{"type":"v1","addr":"172.21.15.78:6833","nonce":1619350831}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6786,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1889614631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1889614631},{"type":"v1","addr":"172.21.15.78:6835","nonce":1889614631}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[]} 2024-09-17T03:12:46.716 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 56 2024-09-17T03:12:46.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.718+0000 7ff126d07640 1 -- 172.21.15.78:0/544870974 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff10c078b90 msgr2=0x7ff10c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:46.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.718+0000 7ff126d07640 1 --2- 172.21.15.78:0/544870974 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff10c078b90 0x7ff10c07b0a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff114033000 tx=0x7ff1200cf6e0 comp rx=0 tx=0).stop 2024-09-17T03:12:46.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.718+0000 7ff126d07640 1 -- 172.21.15.78:0/544870974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff108004800 msgr2=0x7ff12015ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:46.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.718+0000 7ff126d07640 1 --2- 172.21.15.78:0/544870974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff108004800 0x7ff12015ebb0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7ff110003f50 tx=0x7ff1100016f0 comp rx=0 tx=0).stop 2024-09-17T03:12:46.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.718+0000 7ff126d07640 1 -- 172.21.15.78:0/544870974 shutdown_connections 2024-09-17T03:12:46.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.718+0000 7ff126d07640 1 --2- 172.21.15.78:0/544870974 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff10c078b90 0x7ff10c07b0a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:46.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.718+0000 7ff126d07640 1 --2- 172.21.15.78:0/544870974 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff12014da50 0x7ff12014f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:46.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.718+0000 7ff126d07640 1 --2- 172.21.15.78:0/544870974 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff1200b0bc0 0x7ff12014d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:46.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.718+0000 7ff126d07640 1 --2- 172.21.15.78:0/544870974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff108004800 0x7ff12015ebb0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:46.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.718+0000 7ff126d07640 1 -- 172.21.15.78:0/544870974 >> 172.21.15.78:0/544870974 conn(0x7ff1200b3f10 msgr2=0x7ff12006ec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:46.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.718+0000 7ff126d07640 1 -- 172.21.15.78:0/544870974 shutdown_connections 2024-09-17T03:12:46.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.718+0000 7ff126d07640 1 -- 172.21.15.78:0/544870974 wait complete. 2024-09-17T03:12:46.730 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:12:46.730 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:12:46.730 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:12:46.731 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:12:46.731 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:12:46.731 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:12:46.731 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:12:46.732 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:12:46.732 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:12:46.732 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:12:46.732 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:12:46.733 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:12:46.733 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:12:46.733 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:12:46.733 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:12:46.734 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:12:46.743 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:12:46.743 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:12:46.744 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:12:46.744 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:12:46.746 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:12:46.747 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:12:46.748 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:12:46.748 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:12:46.786 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:12:46.786 DEBUG:teuthology.parallel:result is None 2024-09-17T03:12:46.787 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:12:46.787 DEBUG:teuthology.parallel:result is None 2024-09-17T03:12:46.789 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:12:46.790 DEBUG:teuthology.parallel:result is None 2024-09-17T03:12:46.791 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:12:46.791 DEBUG:teuthology.parallel:result is None 2024-09-17T03:12:46.791 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:12:46.873 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2024-09-17T03:12:46.873 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-09-17T03:12:46.884 INFO:tasks.ceph.mds.b.smithi193.stdout:starting mds.b at 2024-09-17T03:12:46.884 INFO:tasks.ceph.mds.d.smithi193.stdout:starting mds.d at 2024-09-17T03:12:46.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.912+0000 7f75aa5df640 1 -- 172.21.15.78:0/354543398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a40b3540 msgr2=0x7f75a40d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:46.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.912+0000 7f75aa5df640 1 --2- 172.21.15.78:0/354543398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a40b3540 0x7f75a40d3330 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f75a40ba090 tx=0x7f759802a560 comp rx=0 tx=0).stop 2024-09-17T03:12:46.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.912+0000 7f75aa5df640 1 -- 172.21.15.78:0/354543398 shutdown_connections 2024-09-17T03:12:46.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.912+0000 7f75aa5df640 1 --2- 172.21.15.78:0/354543398 >> v2:172.21.15.193:3300/0 conn(0x7f75a40d3870 0x7f75a40ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:46.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.912+0000 7f75aa5df640 1 --2- 172.21.15.78:0/354543398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a40b3540 0x7f75a40d3330 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:46.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.912+0000 7f75aa5df640 1 -- 172.21.15.78:0/354543398 >> 172.21.15.78:0/354543398 conn(0x7f75a408bfc0 msgr2=0x7f75a409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:46.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.912+0000 7f75aa5df640 1 -- 172.21.15.78:0/354543398 shutdown_connections 2024-09-17T03:12:46.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.912+0000 7f75aa5df640 1 -- 172.21.15.78:0/354543398 wait complete. 2024-09-17T03:12:46.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.914+0000 7f75aa5df640 1 Processor -- start 2024-09-17T03:12:46.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.914+0000 7f75aa5df640 1 -- start start 2024-09-17T03:12:46.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.915+0000 7f75aa5df640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75a40b3540 0x7f75a41f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:46.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.915+0000 7f75aa5df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a40d3870 0x7f75a41f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:46.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.915+0000 7f75aa5df640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75a40cb5c0 0x7f75a40cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:46.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.915+0000 7f75aa5df640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f75a40d0ce0 con 0x7f75a40d3870 2024-09-17T03:12:46.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.915+0000 7f75aa5df640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f75a40cf490 con 0x7f75a40cb5c0 2024-09-17T03:12:46.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.915+0000 7f75a37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a40d3870 0x7f75a41f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:46.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.915+0000 7f75aa5df640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f75a40d0e60 con 0x7f75a40b3540 2024-09-17T03:12:46.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.915+0000 7f75a37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a40d3870 0x7f75a41f4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34820/0 (socket says 172.21.15.78:34820) 2024-09-17T03:12:46.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.915+0000 7f75a37fe640 1 -- 172.21.15.78:0/1454842862 learned_addr learned my addr 172.21.15.78:0/1454842862 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:46.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.915+0000 7f75a8b7c640 1 --2- 172.21.15.78:0/1454842862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75a40cb5c0 0x7f75a40cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:46.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.915+0000 7f75a3fff640 1 --2- 172.21.15.78:0/1454842862 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75a40b3540 0x7f75a41f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:46.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.916+0000 7f75a37fe640 1 -- 172.21.15.78:0/1454842862 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75a40b3540 msgr2=0x7f75a41f45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:46.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.916+0000 7f75a37fe640 1 --2- 172.21.15.78:0/1454842862 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75a40b3540 0x7f75a41f45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:46.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.916+0000 7f75a37fe640 1 -- 172.21.15.78:0/1454842862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75a40cb5c0 msgr2=0x7f75a40cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:46.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.916+0000 7f75a37fe640 1 --2- 172.21.15.78:0/1454842862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75a40cb5c0 0x7f75a40cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:46.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.916+0000 7f75a37fe640 1 -- 172.21.15.78:0/1454842862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75a40c8a00 con 0x7f75a40d3870 2024-09-17T03:12:46.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.916+0000 7f75a37fe640 1 --2- 172.21.15.78:0/1454842862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a40d3870 0x7f75a41f4b00 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f7598034040 tx=0x7f75980038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:46.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.916+0000 7f75a0ff9640 1 -- 172.21.15.78:0/1454842862 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759803e030 con 0x7f75a40d3870 2024-09-17T03:12:46.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.916+0000 7f75aa5df640 1 -- 172.21.15.78:0/1454842862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75a40c8ce0 con 0x7f75a40d3870 2024-09-17T03:12:46.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.916+0000 7f75a0ff9640 1 -- 172.21.15.78:0/1454842862 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7598003ca0 con 0x7f75a40d3870 2024-09-17T03:12:46.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.916+0000 7f75a0ff9640 1 -- 172.21.15.78:0/1454842862 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7598035040 con 0x7f75a40d3870 2024-09-17T03:12:46.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.916+0000 7f75aa5df640 1 -- 172.21.15.78:0/1454842862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75a40c92a0 con 0x7f75a40d3870 2024-09-17T03:12:46.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.917+0000 7f75aa5df640 1 -- 172.21.15.78:0/1454842862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75a40c96e0 con 0x7f75a40d3870 2024-09-17T03:12:46.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.918+0000 7f75a0ff9640 1 -- 172.21.15.78:0/1454842862 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7598041030 con 0x7f75a40d3870 2024-09-17T03:12:46.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.918+0000 7f75a0ff9640 1 --2- 172.21.15.78:0/1454842862 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7590078b90 0x7f759007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:46.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.918+0000 7f75a0ff9640 1 -- 172.21.15.78:0/1454842862 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5115+0+0 (secure 0 0 0) 0x7f75980bb120 con 0x7f75a40d3870 2024-09-17T03:12:46.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.919+0000 7f75a3fff640 1 --2- 172.21.15.78:0/1454842862 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7590078b90 0x7f759007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:46.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.919+0000 7f75a3fff640 1 --2- 172.21.15.78:0/1454842862 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7590078b90 0x7f759007b0a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7594007fd0 tx=0x7f7594009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:46.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:46.923+0000 7f75a0ff9640 1 -- 172.21.15.78:0/1454842862 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7598083170 con 0x7f75a40d3870 2024-09-17T03:12:47.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.106+0000 7f75aa5df640 1 -- 172.21.15.78:0/1454842862 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f75a40cb0b0 con 0x7f75a40d3870 2024-09-17T03:12:47.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.526+0000 7f75a0ff9640 1 -- 172.21.15.78:0/1454842862 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v63) ==== 97+0+0 (secure 0 0 0) 0x7f7598087ba0 con 0x7f75a40d3870 2024-09-17T03:12:47.526 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2024-09-17T03:12:47.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.528+0000 7f75aa5df640 1 -- 172.21.15.78:0/1454842862 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7590078b90 msgr2=0x7f759007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:47.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.528+0000 7f75aa5df640 1 --2- 172.21.15.78:0/1454842862 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7590078b90 0x7f759007b0a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7594007fd0 tx=0x7f7594009040 comp rx=0 tx=0).stop 2024-09-17T03:12:47.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.528+0000 7f75aa5df640 1 -- 172.21.15.78:0/1454842862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a40d3870 msgr2=0x7f75a41f4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:47.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.528+0000 7f75aa5df640 1 --2- 172.21.15.78:0/1454842862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a40d3870 0x7f75a41f4b00 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f7598034040 tx=0x7f75980038a0 comp rx=0 tx=0).stop 2024-09-17T03:12:47.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.528+0000 7f75aa5df640 1 -- 172.21.15.78:0/1454842862 shutdown_connections 2024-09-17T03:12:47.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.528+0000 7f75aa5df640 1 --2- 172.21.15.78:0/1454842862 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7590078b90 0x7f759007b0a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:47.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.528+0000 7f75aa5df640 1 --2- 172.21.15.78:0/1454842862 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75a40cb5c0 0x7f75a40cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:47.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.528+0000 7f75aa5df640 1 --2- 172.21.15.78:0/1454842862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75a40d3870 0x7f75a41f4b00 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:47.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.528+0000 7f75aa5df640 1 --2- 172.21.15.78:0/1454842862 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75a40b3540 0x7f75a41f45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:47.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.528+0000 7f75aa5df640 1 -- 172.21.15.78:0/1454842862 >> 172.21.15.78:0/1454842862 conn(0x7f75a408bfc0 msgr2=0x7f75a406f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:47.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.528+0000 7f75aa5df640 1 -- 172.21.15.78:0/1454842862 shutdown_connections 2024-09-17T03:12:47.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.529+0000 7f75aa5df640 1 -- 172.21.15.78:0/1454842862 wait complete. 2024-09-17T03:12:47.541 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:12:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.654+0000 7fed55b98640 1 -- 172.21.15.78:0/4208376994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed500cfb00 msgr2=0x7fed5015bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.654+0000 7fed55b98640 1 --2- 172.21.15.78:0/4208376994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed500cfb00 0x7fed5015bf20 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fed500cdc20 tx=0x7fed4002a530 comp rx=0 tx=0).stop 2024-09-17T03:12:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.654+0000 7fed55b98640 1 -- 172.21.15.78:0/4208376994 shutdown_connections 2024-09-17T03:12:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.654+0000 7fed55b98640 1 --2- 172.21.15.78:0/4208376994 >> v2:172.21.15.193:3300/0 conn(0x7fed500cb0b0 0x7fed5006ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:47.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.654+0000 7fed55b98640 1 --2- 172.21.15.78:0/4208376994 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed500cfb00 0x7fed5015bf20 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.654+0000 7fed55b98640 1 -- 172.21.15.78:0/4208376994 >> 172.21.15.78:0/4208376994 conn(0x7fed500b1cb0 msgr2=0x7fed500b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.654+0000 7fed55b98640 1 -- 172.21.15.78:0/4208376994 shutdown_connections 2024-09-17T03:12:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.654+0000 7fed55b98640 1 -- 172.21.15.78:0/4208376994 wait complete. 2024-09-17T03:12:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.656+0000 7fed55b98640 1 Processor -- start 2024-09-17T03:12:47.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.656+0000 7fed55b98640 1 -- start start 2024-09-17T03:12:47.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.657+0000 7fed55b98640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fed500cf160 0x7fed50074cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:47.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.657+0000 7fed55b98640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed500cfb00 0x7fed50156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:47.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.657+0000 7fed55b98640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed500c3c50 0x7fed50158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.657+0000 7fed55b98640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fed500ccba0 con 0x7fed500cfb00 2024-09-17T03:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.657+0000 7fed55b98640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fed500cf780 con 0x7fed500c3c50 2024-09-17T03:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.657+0000 7fed55b98640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fed500ccd20 con 0x7fed500cf160 2024-09-17T03:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.657+0000 7fed4effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed500cfb00 0x7fed50156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.657+0000 7fed4effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed500cfb00 0x7fed50156600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34838/0 (socket says 172.21.15.78:34838) 2024-09-17T03:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.657+0000 7fed4effd640 1 -- 172.21.15.78:0/387187361 learned_addr learned my addr 172.21.15.78:0/387187361 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.658+0000 7fed4f7fe640 1 --2- 172.21.15.78:0/387187361 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fed500cf160 0x7fed50074cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.658+0000 7fed4ffff640 1 --2- 172.21.15.78:0/387187361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed500c3c50 0x7fed50158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.658+0000 7fed4effd640 1 -- 172.21.15.78:0/387187361 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fed500cf160 msgr2=0x7fed50074cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.658+0000 7fed4effd640 1 --2- 172.21.15.78:0/387187361 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fed500cf160 0x7fed50074cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.658+0000 7fed4effd640 1 -- 172.21.15.78:0/387187361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed500c3c50 msgr2=0x7fed50158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.658+0000 7fed4effd640 1 --2- 172.21.15.78:0/387187361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed500c3c50 0x7fed50158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.658+0000 7fed4effd640 1 -- 172.21.15.78:0/387187361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed50073e30 con 0x7fed500cfb00 2024-09-17T03:12:47.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.658+0000 7fed4f7fe640 1 --2- 172.21.15.78:0/387187361 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fed500cf160 0x7fed50074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.658+0000 7fed4effd640 1 --2- 172.21.15.78:0/387187361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed500cfb00 0x7fed50156600 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fed4400e620 tx=0x7fed4400eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.658+0000 7fed37fff640 1 -- 172.21.15.78:0/387187361 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed44016070 con 0x7fed500cfb00 2024-09-17T03:12:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.658+0000 7fed37fff640 1 -- 172.21.15.78:0/387187361 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed4400cac0 con 0x7fed500cfb00 2024-09-17T03:12:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.658+0000 7fed55b98640 1 -- 172.21.15.78:0/387187361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed50073590 con 0x7fed500cfb00 2024-09-17T03:12:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.658+0000 7fed37fff640 1 -- 172.21.15.78:0/387187361 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed44011470 con 0x7fed500cfb00 2024-09-17T03:12:47.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.658+0000 7fed55b98640 1 -- 172.21.15.78:0/387187361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed50073b50 con 0x7fed500cfb00 2024-09-17T03:12:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.659+0000 7fed55b98640 1 -- 172.21.15.78:0/387187361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed500706e0 con 0x7fed500cfb00 2024-09-17T03:12:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.660+0000 7fed37fff640 1 -- 172.21.15.78:0/387187361 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fed44019070 con 0x7fed500cfb00 2024-09-17T03:12:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.660+0000 7fed37fff640 1 --2- 172.21.15.78:0/387187361 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fed3c078b90 0x7fed3c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.660+0000 7fed37fff640 1 -- 172.21.15.78:0/387187361 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7fed4409c980 con 0x7fed500cfb00 2024-09-17T03:12:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.661+0000 7fed4f7fe640 1 --2- 172.21.15.78:0/387187361 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fed3c078b90 0x7fed3c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:47.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.661+0000 7fed4f7fe640 1 --2- 172.21.15.78:0/387187361 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fed3c078b90 0x7fed3c07b0a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fed40034000 tx=0x7fed40004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:47.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.665+0000 7fed37fff640 1 -- 172.21.15.78:0/387187361 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fed500706e0 con 0x7fed500cfb00 2024-09-17T03:12:47.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.908+0000 7fed55b98640 1 -- 172.21.15.78:0/387187361 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fed500cd1f0 con 0x7fed500cfb00 2024-09-17T03:12:47.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.908+0000 7fed37fff640 1 -- 172.21.15.78:0/387187361 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7fed44064be0 con 0x7fed500cfb00 2024-09-17T03:12:47.908 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:12:47.908 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:12:47.909 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2024-09-17T03:12:47.909 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:47.909 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2024-09-17T03:12:47.909 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmF3icCRAAZEAXi3RiY/e4JSSr1nd2sQ==", 2024-09-17T03:12:47.909 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:12:47.909 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:12:47.909 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:12:47.909 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:12:47.909 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:12:47.909 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:47.909 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:47.909 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:47.909 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2024-09-17T03:12:47.910 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmzFPWFhAAptFKHxH9Xy3l9q0gxLARBQ==", 2024-09-17T03:12:47.910 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:12:47.910 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:12:47.910 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:12:47.910 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:12:47.910 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:12:47.910 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:47.910 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:47.910 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:47.910 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2024-09-17T03:12:47.910 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmFoc7ERAAlPpal3pKHjPKFotpPiJ9dA==", 2024-09-17T03:12:47.910 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:12:47.910 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:12:47.910 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:12:47.911 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:12:47.911 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:12:47.911 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:47.911 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:47.911 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:47.911 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2024-09-17T03:12:47.911 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmYJ2aHhAAhG6Sw6iZDy6s0qpiSLc//A==", 2024-09-17T03:12:47.911 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:12:47.911 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:12:47.911 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:12:47.911 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:12:47.911 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:12:47.911 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:47.911 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:47.911 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:47.912 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2024-09-17T03:12:47.912 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBy8uhmiaXeOhAAbhD0AqPz5JYg9CvycMk6cQ==", 2024-09-17T03:12:47.912 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:12:47.912 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:12:47.912 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:12:47.912 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:12:47.912 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:47.912 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:47.912 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:47.912 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2024-09-17T03:12:47.912 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB28uhmWT32HxAAATHdxAa6QOLYGnpPCx72iA==", 2024-09-17T03:12:47.913 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:12:47.913 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:12:47.913 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:12:47.913 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:12:47.913 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:47.913 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:47.913 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:47.913 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2024-09-17T03:12:47.913 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB58uhmTOOMMBAA4YSlpqeuxlIXypxCpxDJ+Q==", 2024-09-17T03:12:47.913 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:12:47.913 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:12:47.913 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:12:47.913 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:12:47.913 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:47.914 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:47.914 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:47.914 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2024-09-17T03:12:47.914 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB88uhmSgx6MxAAKHGCbjfVZTyeb0nX2xKkSQ==", 2024-09-17T03:12:47.914 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:12:47.914 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:12:47.914 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:12:47.914 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:12:47.914 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:47.914 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:47.914 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:47.914 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2024-09-17T03:12:47.914 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCD8uhmNKZkBBAAZwn1Xf+fd3GNeP4etvNePg==", 2024-09-17T03:12:47.914 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:12:47.915 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:12:47.915 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:12:47.915 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:12:47.915 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:47.915 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:47.915 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:47.915 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2024-09-17T03:12:47.915 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCG8uhmDTyzBhAAzeipRWM5M2fjCQt7xDGBwA==", 2024-09-17T03:12:47.915 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:12:47.915 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:12:47.915 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:12:47.915 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:12:47.915 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:47.916 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:47.916 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:47.916 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2024-09-17T03:12:47.916 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCJ8uhmDsZLGBAAB3VNeHQoty+fQwvYpRkltw==", 2024-09-17T03:12:47.916 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:12:47.916 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:12:47.916 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:12:47.916 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:12:47.916 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:47.916 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:47.916 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:47.916 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2024-09-17T03:12:47.917 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCM8uhm3PkQKRAAjJV2xFyyoACLkA3f/lFhWw==", 2024-09-17T03:12:47.917 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:12:47.917 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:12:47.917 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:12:47.917 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:12:47.917 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:47.917 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:47.917 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:47.917 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2024-09-17T03:12:47.917 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmn+c/IxAALXG+Qkwye7zc6PjcLBsk1g==", 2024-09-17T03:12:47.917 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:12:47.917 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:12:47.917 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow r", 2024-09-17T03:12:47.917 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:12:47.918 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:47.918 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:47.918 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:47.918 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2024-09-17T03:12:47.918 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmbzjQKhAAr/DB8TDsiWPsLHnsvUaTiw==", 2024-09-17T03:12:47.918 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:12:47.918 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:12:47.918 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2024-09-17T03:12:47.918 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2024-09-17T03:12:47.918 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2024-09-17T03:12:47.918 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:47.918 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:47.918 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:47.918 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.2", 2024-09-17T03:12:47.919 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmB9ABJxAATgS37nY3a3bX8wK1H3S/8A==", 2024-09-17T03:12:47.919 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:12:47.919 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:12:47.919 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2024-09-17T03:12:47.919 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2024-09-17T03:12:47.919 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2024-09-17T03:12:47.919 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:47.919 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:47.919 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:47.919 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.3", 2024-09-17T03:12:47.919 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmyhGmLhAAIfkcz3KW+qZ1qDOqQdPS5g==", 2024-09-17T03:12:47.919 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:12:47.919 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:12:47.919 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2024-09-17T03:12:47.920 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2024-09-17T03:12:47.920 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2024-09-17T03:12:47.920 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:47.920 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:47.920 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:47.920 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2024-09-17T03:12:47.920 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBu8uhmBgTvJxAAP2vhORVoAAnDSVpnLukIaA==", 2024-09-17T03:12:47.920 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:12:47.920 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2024-09-17T03:12:47.920 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:12:47.920 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:12:47.920 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:12:47.920 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:47.920 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:47.921 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:47.921 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2024-09-17T03:12:47.921 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmcpvVBRAA2JTbv0LrIc7seMyOmOIBmA==", 2024-09-17T03:12:47.921 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:12:47.921 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2024-09-17T03:12:47.921 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2024-09-17T03:12:47.921 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:12:47.921 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:47.921 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:12:47.921 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:47.921 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2024-09-17T03:12:47.921 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhm1SeKARAA2hyytqNjqToQ0K+RgQ8Tbg==", 2024-09-17T03:12:47.921 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:12:47.921 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2024-09-17T03:12:47.922 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2024-09-17T03:12:47.922 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:12:47.922 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:47.922 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:47.922 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-17T03:12:47.922 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:12:47.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.910+0000 7fed55b98640 1 -- 172.21.15.78:0/387187361 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fed3c078b90 msgr2=0x7fed3c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:47.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.911+0000 7fed55b98640 1 --2- 172.21.15.78:0/387187361 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fed3c078b90 0x7fed3c07b0a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fed40034000 tx=0x7fed40004730 comp rx=0 tx=0).stop 2024-09-17T03:12:47.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.911+0000 7fed55b98640 1 -- 172.21.15.78:0/387187361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed500cfb00 msgr2=0x7fed50156600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:47.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.911+0000 7fed55b98640 1 --2- 172.21.15.78:0/387187361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed500cfb00 0x7fed50156600 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fed4400e620 tx=0x7fed4400eae0 comp rx=0 tx=0).stop 2024-09-17T03:12:47.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.911+0000 7fed55b98640 1 -- 172.21.15.78:0/387187361 shutdown_connections 2024-09-17T03:12:47.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.911+0000 7fed55b98640 1 --2- 172.21.15.78:0/387187361 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fed3c078b90 0x7fed3c07b0a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:47.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.911+0000 7fed55b98640 1 --2- 172.21.15.78:0/387187361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed500c3c50 0x7fed50158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:47.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.911+0000 7fed55b98640 1 --2- 172.21.15.78:0/387187361 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed500cfb00 0x7fed50156600 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:47.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.911+0000 7fed55b98640 1 --2- 172.21.15.78:0/387187361 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fed500cf160 0x7fed50074cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:47.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.911+0000 7fed55b98640 1 -- 172.21.15.78:0/387187361 >> 172.21.15.78:0/387187361 conn(0x7fed500b1cb0 msgr2=0x7fed500b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:47.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.911+0000 7fed55b98640 1 -- 172.21.15.78:0/387187361 shutdown_connections 2024-09-17T03:12:47.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:47.911+0000 7fed55b98640 1 -- 172.21.15.78:0/387187361 wait complete. 2024-09-17T03:12:47.925 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:12:48.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.037+0000 7eff21e70640 1 -- 172.21.15.78:0/4209946585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c0b6680 msgr2=0x7eff1c0b0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:48.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.037+0000 7eff21e70640 1 --2- 172.21.15.78:0/4209946585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c0b6680 0x7eff1c0b0de0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009820 tx=0x7eff0c02a480 comp rx=0 tx=0).stop 2024-09-17T03:12:48.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.037+0000 7eff21e70640 1 -- 172.21.15.78:0/4209946585 shutdown_connections 2024-09-17T03:12:48.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.037+0000 7eff21e70640 1 --2- 172.21.15.78:0/4209946585 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c0b6680 0x7eff1c0b0de0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:48.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.037+0000 7eff21e70640 1 -- 172.21.15.78:0/4209946585 >> 172.21.15.78:0/4209946585 conn(0x7eff1c0d12a0 msgr2=0x7eff1c0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:48.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.037+0000 7eff21e70640 1 -- 172.21.15.78:0/4209946585 shutdown_connections 2024-09-17T03:12:48.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.037+0000 7eff21e70640 1 -- 172.21.15.78:0/4209946585 wait complete. 2024-09-17T03:12:48.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.039+0000 7eff21e70640 1 Processor -- start 2024-09-17T03:12:48.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.039+0000 7eff21e70640 1 -- start start 2024-09-17T03:12:48.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.040+0000 7eff21e70640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c0b6100 0x7eff1c1f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:48.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.040+0000 7eff21e70640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7eff1c0b6680 0x7eff1c159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:48.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.040+0000 7eff21e70640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7eff1c162f60 0x7eff1c1f4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:48.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.040+0000 7eff21e70640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c166c20 con 0x7eff1c0b6100 2024-09-17T03:12:48.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.040+0000 7eff21e70640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7eff1c166aa0 con 0x7eff1c0b6680 2024-09-17T03:12:48.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.040+0000 7eff21e70640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7eff1c166da0 con 0x7eff1c162f60 2024-09-17T03:12:48.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.041+0000 7eff1b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c0b6100 0x7eff1c1f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:48.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.041+0000 7eff1b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c0b6100 0x7eff1c1f3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34866/0 (socket says 172.21.15.78:34866) 2024-09-17T03:12:48.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.041+0000 7eff1b7fe640 1 -- 172.21.15.78:0/1033171892 learned_addr learned my addr 172.21.15.78:0/1033171892 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:48.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.041+0000 7eff1bfff640 1 --2- 172.21.15.78:0/1033171892 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7eff1c162f60 0x7eff1c1f4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:48.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.041+0000 7eff1affd640 1 --2- 172.21.15.78:0/1033171892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7eff1c0b6680 0x7eff1c159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:48.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.041+0000 7eff1b7fe640 1 -- 172.21.15.78:0/1033171892 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7eff1c162f60 msgr2=0x7eff1c1f4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:48.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.041+0000 7eff1b7fe640 1 --2- 172.21.15.78:0/1033171892 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7eff1c162f60 0x7eff1c1f4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:48.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.041+0000 7eff1b7fe640 1 -- 172.21.15.78:0/1033171892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7eff1c0b6680 msgr2=0x7eff1c159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:48.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.041+0000 7eff1b7fe640 1 --2- 172.21.15.78:0/1033171892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7eff1c0b6680 0x7eff1c159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:48.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.041+0000 7eff1b7fe640 1 -- 172.21.15.78:0/1033171892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1c159c40 con 0x7eff1c0b6100 2024-09-17T03:12:48.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.041+0000 7eff1b7fe640 1 --2- 172.21.15.78:0/1033171892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c0b6100 0x7eff1c1f3db0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009910 tx=0x7eff0c004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:48.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.041+0000 7eff03fff640 1 -- 172.21.15.78:0/1033171892 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c031b50 con 0x7eff1c0b6100 2024-09-17T03:12:48.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.041+0000 7eff03fff640 1 -- 172.21.15.78:0/1033171892 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff0c004e50 con 0x7eff1c0b6100 2024-09-17T03:12:48.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.041+0000 7eff03fff640 1 -- 172.21.15.78:0/1033171892 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c033330 con 0x7eff1c0b6100 2024-09-17T03:12:48.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.041+0000 7eff21e70640 1 -- 172.21.15.78:0/1033171892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1c1f4450 con 0x7eff1c0b6100 2024-09-17T03:12:48.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.041+0000 7eff21e70640 1 -- 172.21.15.78:0/1033171892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff1c158c20 con 0x7eff1c0b6100 2024-09-17T03:12:48.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.042+0000 7eff21e70640 1 -- 172.21.15.78:0/1033171892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff1c0b0de0 con 0x7eff1c0b6100 2024-09-17T03:12:48.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.043+0000 7eff03fff640 1 -- 172.21.15.78:0/1033171892 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7eff0c0334d0 con 0x7eff1c0b6100 2024-09-17T03:12:48.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.044+0000 7eff03fff640 1 --2- 172.21.15.78:0/1033171892 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7eff08078bc0 0x7eff0807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:48.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.044+0000 7eff03fff640 1 -- 172.21.15.78:0/1033171892 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7eff0c0bbd60 con 0x7eff1c0b6100 2024-09-17T03:12:48.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.044+0000 7eff1affd640 1 --2- 172.21.15.78:0/1033171892 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7eff08078bc0 0x7eff0807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:48.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.045+0000 7eff1affd640 1 --2- 172.21.15.78:0/1033171892 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7eff08078bc0 0x7eff0807b0d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7eff1c06d2a0 tx=0x7eff10007eb0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:48.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.049+0000 7eff03fff640 1 -- 172.21.15.78:0/1033171892 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7eff0c03f030 con 0x7eff1c0b6100 2024-09-17T03:12:48.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.223+0000 7eff21e70640 1 -- 172.21.15.78:0/1033171892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7eff1c06d890 con 0x7eff1c0b6100 2024-09-17T03:12:48.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.224+0000 7eff03fff640 1 -- 172.21.15.78:0/1033171892 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v65) ==== 84+0+65 (secure 0 0 0) 0x7eff0c086060 con 0x7eff1c0b6100 2024-09-17T03:12:48.224 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:12:48.224 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2024-09-17T03:12:48.224 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:12:48.224 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2024-09-17T03:12:48.224 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2024-09-17T03:12:48.224 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:12:48.224 INFO:teuthology.orchestra.run.smithi078.stdout:] 2024-09-17T03:12:48.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.226+0000 7eff21e70640 1 -- 172.21.15.78:0/1033171892 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7eff08078bc0 msgr2=0x7eff0807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:48.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.226+0000 7eff21e70640 1 --2- 172.21.15.78:0/1033171892 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7eff08078bc0 0x7eff0807b0d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7eff1c06d2a0 tx=0x7eff10007eb0 comp rx=0 tx=0).stop 2024-09-17T03:12:48.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.226+0000 7eff21e70640 1 -- 172.21.15.78:0/1033171892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c0b6100 msgr2=0x7eff1c1f3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:48.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.226+0000 7eff21e70640 1 --2- 172.21.15.78:0/1033171892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c0b6100 0x7eff1c1f3db0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009910 tx=0x7eff0c004a50 comp rx=0 tx=0).stop 2024-09-17T03:12:48.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.226+0000 7eff21e70640 1 -- 172.21.15.78:0/1033171892 shutdown_connections 2024-09-17T03:12:48.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.226+0000 7eff21e70640 1 --2- 172.21.15.78:0/1033171892 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7eff1c162f60 0x7eff1c1f4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:48.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.226+0000 7eff21e70640 1 --2- 172.21.15.78:0/1033171892 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7eff08078bc0 0x7eff0807b0d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:48.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.226+0000 7eff21e70640 1 --2- 172.21.15.78:0/1033171892 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7eff1c0b6680 0x7eff1c159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:48.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.226+0000 7eff21e70640 1 --2- 172.21.15.78:0/1033171892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c0b6100 0x7eff1c1f3db0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:48.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.226+0000 7eff21e70640 1 -- 172.21.15.78:0/1033171892 >> 172.21.15.78:0/1033171892 conn(0x7eff1c0d12a0 msgr2=0x7eff1c0ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:48.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.226+0000 7eff21e70640 1 -- 172.21.15.78:0/1033171892 shutdown_connections 2024-09-17T03:12:48.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.226+0000 7eff21e70640 1 -- 172.21.15.78:0/1033171892 wait complete. 2024-09-17T03:12:48.237 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:12:48.238 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:12:48.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.355+0000 7f8b3fa3f640 1 -- 172.21.15.78:0/4276549979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b380b96c0 msgr2=0x7f8b380cf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:48.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.355+0000 7f8b3fa3f640 1 --2- 172.21.15.78:0/4276549979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b380b96c0 0x7f8b380cf360 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009830 tx=0x7f8b2802a510 comp rx=0 tx=0).stop 2024-09-17T03:12:48.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.355+0000 7f8b3fa3f640 1 -- 172.21.15.78:0/4276549979 shutdown_connections 2024-09-17T03:12:48.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.355+0000 7f8b3fa3f640 1 --2- 172.21.15.78:0/4276549979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b380b96c0 0x7f8b380cf360 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:48.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.355+0000 7f8b3fa3f640 1 --2- 172.21.15.78:0/4276549979 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b380d18f0 0x7f8b3806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:48.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.355+0000 7f8b3fa3f640 1 -- 172.21.15.78:0/4276549979 >> 172.21.15.78:0/4276549979 conn(0x7f8b3809d8a0 msgr2=0x7f8b3808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:48.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.355+0000 7f8b3fa3f640 1 -- 172.21.15.78:0/4276549979 shutdown_connections 2024-09-17T03:12:48.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.355+0000 7f8b3fa3f640 1 -- 172.21.15.78:0/4276549979 wait complete. 2024-09-17T03:12:48.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.357+0000 7f8b3fa3f640 1 Processor -- start 2024-09-17T03:12:48.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.357+0000 7f8b3fa3f640 1 -- start start 2024-09-17T03:12:48.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b3fa3f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b380b96c0 0x7f8b38150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:48.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b3fa3f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b380cf8a0 0x7f8b38159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:48.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b3fa3f640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b380d18f0 0x7f8b38159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:48.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b3fa3f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8b380d3790 con 0x7f8b380cf8a0 2024-09-17T03:12:48.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b3fa3f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8b380d3610 con 0x7f8b380b96c0 2024-09-17T03:12:48.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b3fa3f640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8b380b66b0 con 0x7f8b380d18f0 2024-09-17T03:12:48.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b3cfda640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b380cf8a0 0x7f8b38159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:48.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b3cfda640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b380cf8a0 0x7f8b38159860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34882/0 (socket says 172.21.15.78:34882) 2024-09-17T03:12:48.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b3cfda640 1 -- 172.21.15.78:0/3694992591 learned_addr learned my addr 172.21.15.78:0/3694992591 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:48.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b3d7db640 1 --2- 172.21.15.78:0/3694992591 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b380b96c0 0x7f8b38150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:48.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b3dfdc640 1 --2- 172.21.15.78:0/3694992591 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b380d18f0 0x7f8b38159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:48.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b3cfda640 1 -- 172.21.15.78:0/3694992591 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b380d18f0 msgr2=0x7f8b38159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:48.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b3cfda640 1 --2- 172.21.15.78:0/3694992591 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b380d18f0 0x7f8b38159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:48.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b3cfda640 1 -- 172.21.15.78:0/3694992591 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b380b96c0 msgr2=0x7f8b38150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:48.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b3cfda640 1 --2- 172.21.15.78:0/3694992591 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b380b96c0 0x7f8b38150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:48.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b3cfda640 1 -- 172.21.15.78:0/3694992591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b3815a4f0 con 0x7f8b380cf8a0 2024-09-17T03:12:48.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b3cfda640 1 --2- 172.21.15.78:0/3694992591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b380cf8a0 0x7f8b38159860 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009950 tx=0x7f8b28033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:48.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b2dffb640 1 -- 172.21.15.78:0/3694992591 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b28005c90 con 0x7f8b380cf8a0 2024-09-17T03:12:48.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b2dffb640 1 -- 172.21.15.78:0/3694992591 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b28031e50 con 0x7f8b380cf8a0 2024-09-17T03:12:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b3fa3f640 1 -- 172.21.15.78:0/3694992591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b3815e220 con 0x7f8b380cf8a0 2024-09-17T03:12:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.359+0000 7f8b2dffb640 1 -- 172.21.15.78:0/3694992591 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b28005260 con 0x7f8b380cf8a0 2024-09-17T03:12:48.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.360+0000 7f8b3fa3f640 1 -- 172.21.15.78:0/3694992591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b3815e7e0 con 0x7f8b380cf8a0 2024-09-17T03:12:48.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.361+0000 7f8b3fa3f640 1 -- 172.21.15.78:0/3694992591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b380b6bf0 con 0x7f8b380cf8a0 2024-09-17T03:12:48.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.361+0000 7f8b2dffb640 1 -- 172.21.15.78:0/3694992591 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b28005400 con 0x7f8b380cf8a0 2024-09-17T03:12:48.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.362+0000 7f8b2dffb640 1 --2- 172.21.15.78:0/3694992591 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b1c078bc0 0x7f8b1c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:48.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.362+0000 7f8b2dffb640 1 -- 172.21.15.78:0/3694992591 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7f8b280bb9c0 con 0x7f8b380cf8a0 2024-09-17T03:12:48.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.362+0000 7f8b3d7db640 1 --2- 172.21.15.78:0/3694992591 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b1c078bc0 0x7f8b1c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:48.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.363+0000 7f8b3d7db640 1 --2- 172.21.15.78:0/3694992591 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b1c078bc0 0x7f8b1c07b0d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8b340098e0 tx=0x7f8b34009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:48.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.366+0000 7f8b2dffb640 1 -- 172.21.15.78:0/3694992591 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8b280bde20 con 0x7f8b380cf8a0 2024-09-17T03:12:48.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:48.542+0000 7f8b3fa3f640 1 -- 172.21.15.78:0/3694992591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8b38161f40 con 0x7f8b380cf8a0 2024-09-17T03:12:49.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.531+0000 7f8b2dffb640 1 -- 172.21.15.78:0/3694992591 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v66) ==== 138+0+0 (secure 0 0 0) 0x7f8b2803f030 con 0x7f8b380cf8a0 2024-09-17T03:12:49.531 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2024-09-17T03:12:49.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.534+0000 7f8b3fa3f640 1 -- 172.21.15.78:0/3694992591 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b1c078bc0 msgr2=0x7f8b1c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:49.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.534+0000 7f8b3fa3f640 1 --2- 172.21.15.78:0/3694992591 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b1c078bc0 0x7f8b1c07b0d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8b340098e0 tx=0x7f8b34009060 comp rx=0 tx=0).stop 2024-09-17T03:12:49.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.534+0000 7f8b3fa3f640 1 -- 172.21.15.78:0/3694992591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b380cf8a0 msgr2=0x7f8b38159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:49.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.534+0000 7f8b3fa3f640 1 --2- 172.21.15.78:0/3694992591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b380cf8a0 0x7f8b38159860 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009950 tx=0x7f8b28033c20 comp rx=0 tx=0).stop 2024-09-17T03:12:49.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.534+0000 7f8b3fa3f640 1 -- 172.21.15.78:0/3694992591 shutdown_connections 2024-09-17T03:12:49.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.534+0000 7f8b3fa3f640 1 --2- 172.21.15.78:0/3694992591 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b380d18f0 0x7f8b38159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:49.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.534+0000 7f8b3fa3f640 1 --2- 172.21.15.78:0/3694992591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b380cf8a0 0x7f8b38159860 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:49.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.534+0000 7f8b3fa3f640 1 --2- 172.21.15.78:0/3694992591 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b1c078bc0 0x7f8b1c07b0d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:49.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.534+0000 7f8b3fa3f640 1 --2- 172.21.15.78:0/3694992591 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b380b96c0 0x7f8b38150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:49.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.534+0000 7f8b3fa3f640 1 -- 172.21.15.78:0/3694992591 >> 172.21.15.78:0/3694992591 conn(0x7f8b3809d8a0 msgr2=0x7f8b380b5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:49.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.534+0000 7f8b3fa3f640 1 -- 172.21.15.78:0/3694992591 shutdown_connections 2024-09-17T03:12:49.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.535+0000 7f8b3fa3f640 1 -- 172.21.15.78:0/3694992591 wait complete. 2024-09-17T03:12:49.550 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:12:49.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.671+0000 7faf7e63f640 1 -- 172.21.15.78:0/3282178221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf780701c0 msgr2=0x7faf780705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:49.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.671+0000 7faf7e63f640 1 --2- 172.21.15.78:0/3282178221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf780701c0 0x7faf780705d0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7faf780711d0 tx=0x7faf7002b910 comp rx=0 tx=0).stop 2024-09-17T03:12:49.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.671+0000 7faf7e63f640 1 -- 172.21.15.78:0/3282178221 shutdown_connections 2024-09-17T03:12:49.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.671+0000 7faf7e63f640 1 --2- 172.21.15.78:0/3282178221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf780701c0 0x7faf780705d0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:49.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.671+0000 7faf7e63f640 1 --2- 172.21.15.78:0/3282178221 >> v2:172.21.15.193:3300/0 conn(0x7faf780cf940 0x7faf7806fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:49.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.671+0000 7faf7e63f640 1 --2- 172.21.15.78:0/3282178221 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faf780b4d90 0x7faf78072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:49.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.671+0000 7faf7e63f640 1 -- 172.21.15.78:0/3282178221 >> 172.21.15.78:0/3282178221 conn(0x7faf7806d7d0 msgr2=0x7faf780b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:49.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.671+0000 7faf7e63f640 1 -- 172.21.15.78:0/3282178221 shutdown_connections 2024-09-17T03:12:49.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.671+0000 7faf7e63f640 1 -- 172.21.15.78:0/3282178221 wait complete. 2024-09-17T03:12:49.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.673+0000 7faf7e63f640 1 Processor -- start 2024-09-17T03:12:49.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.673+0000 7faf7e63f640 1 -- start start 2024-09-17T03:12:49.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.674+0000 7faf7e63f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf780701c0 0x7faf781f30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:49.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.674+0000 7faf7e63f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf780cf940 0x7faf7815cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:49.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.674+0000 7faf7e63f640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faf7815d160 0x7faf781472e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:49.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.674+0000 7faf7e63f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7faf780cd000 con 0x7faf780cf940 2024-09-17T03:12:49.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.674+0000 7faf7e63f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faf780cce80 con 0x7faf780701c0 2024-09-17T03:12:49.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.674+0000 7faf7e63f640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7faf780cd180 con 0x7faf7815d160 2024-09-17T03:12:49.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.674+0000 7faf777fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf780cf940 0x7faf7815cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:49.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.674+0000 7faf777fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf780cf940 0x7faf7815cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34890/0 (socket says 172.21.15.78:34890) 2024-09-17T03:12:49.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.674+0000 7faf777fe640 1 -- 172.21.15.78:0/3964568657 learned_addr learned my addr 172.21.15.78:0/3964568657 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:49.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.674+0000 7faf77fff640 1 --2- 172.21.15.78:0/3964568657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf780701c0 0x7faf781f30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:49.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.674+0000 7faf7cbdc640 1 --2- 172.21.15.78:0/3964568657 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faf7815d160 0x7faf781472e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:49.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.675+0000 7faf777fe640 1 -- 172.21.15.78:0/3964568657 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faf7815d160 msgr2=0x7faf781472e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:49.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.675+0000 7faf777fe640 1 --2- 172.21.15.78:0/3964568657 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faf7815d160 0x7faf781472e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:49.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.675+0000 7faf777fe640 1 -- 172.21.15.78:0/3964568657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf780701c0 msgr2=0x7faf781f30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:49.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.675+0000 7faf777fe640 1 --2- 172.21.15.78:0/3964568657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf780701c0 0x7faf781f30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:49.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.675+0000 7faf777fe640 1 -- 172.21.15.78:0/3964568657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf781f3cd0 con 0x7faf780cf940 2024-09-17T03:12:49.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.675+0000 7faf777fe640 1 --2- 172.21.15.78:0/3964568657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf780cf940 0x7faf7815cc20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00d680 tx=0x7faf6c00db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:49.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.675+0000 7faf74ff9640 1 -- 172.21.15.78:0/3964568657 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c017070 con 0x7faf780cf940 2024-09-17T03:12:49.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.675+0000 7faf7e63f640 1 -- 172.21.15.78:0/3964568657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf781f3fb0 con 0x7faf780cf940 2024-09-17T03:12:49.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.675+0000 7faf74ff9640 1 -- 172.21.15.78:0/3964568657 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf6c005310 con 0x7faf780cf940 2024-09-17T03:12:49.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.675+0000 7faf74ff9640 1 -- 172.21.15.78:0/3964568657 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf6c009820 con 0x7faf780cf940 2024-09-17T03:12:49.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.675+0000 7faf7e63f640 1 -- 172.21.15.78:0/3964568657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf78148280 con 0x7faf780cf940 2024-09-17T03:12:49.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.676+0000 7faf7e63f640 1 -- 172.21.15.78:0/3964568657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf780b4d90 con 0x7faf780cf940 2024-09-17T03:12:49.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.677+0000 7faf74ff9640 1 -- 172.21.15.78:0/3964568657 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faf6c0099c0 con 0x7faf780cf940 2024-09-17T03:12:49.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.677+0000 7faf74ff9640 1 --2- 172.21.15.78:0/3964568657 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7faf64078bc0 0x7faf6407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:49.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.677+0000 7faf74ff9640 1 -- 172.21.15.78:0/3964568657 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5227+0+0 (secure 0 0 0) 0x7faf6c09a9d0 con 0x7faf780cf940 2024-09-17T03:12:49.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.677+0000 7faf77fff640 1 --2- 172.21.15.78:0/3964568657 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7faf64078bc0 0x7faf6407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:49.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.678+0000 7faf77fff640 1 --2- 172.21.15.78:0/3964568657 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7faf64078bc0 0x7faf6407b0d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faf68004630 tx=0x7faf6800b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:49.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.682+0000 7faf74ff9640 1 -- 172.21.15.78:0/3964568657 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf6c062a40 con 0x7faf780cf940 2024-09-17T03:12:49.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:49.858+0000 7faf7e63f640 1 -- 172.21.15.78:0/3964568657 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7faf7809e200 con 0x7faf780cf940 2024-09-17T03:12:50.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.533+0000 7faf74ff9640 1 -- 172.21.15.78:0/3964568657 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v67) ==== 170+0+0 (secure 0 0 0) 0x7faf6c067470 con 0x7faf780cf940 2024-09-17T03:12:50.533 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2024-09-17T03:12:50.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.536+0000 7faf7e63f640 1 -- 172.21.15.78:0/3964568657 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7faf64078bc0 msgr2=0x7faf6407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:50.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.536+0000 7faf7e63f640 1 --2- 172.21.15.78:0/3964568657 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7faf64078bc0 0x7faf6407b0d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7faf68004630 tx=0x7faf6800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:12:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.536+0000 7faf7e63f640 1 -- 172.21.15.78:0/3964568657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf780cf940 msgr2=0x7faf7815cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.536+0000 7faf7e63f640 1 --2- 172.21.15.78:0/3964568657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf780cf940 0x7faf7815cc20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00d680 tx=0x7faf6c00db40 comp rx=0 tx=0).stop 2024-09-17T03:12:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.537+0000 7faf7e63f640 1 -- 172.21.15.78:0/3964568657 shutdown_connections 2024-09-17T03:12:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.537+0000 7faf7e63f640 1 --2- 172.21.15.78:0/3964568657 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faf7815d160 0x7faf781472e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.537+0000 7faf7e63f640 1 --2- 172.21.15.78:0/3964568657 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf780cf940 0x7faf7815cc20 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.537+0000 7faf7e63f640 1 --2- 172.21.15.78:0/3964568657 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7faf64078bc0 0x7faf6407b0d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.537+0000 7faf7e63f640 1 --2- 172.21.15.78:0/3964568657 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf780701c0 0x7faf781f30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.537+0000 7faf7e63f640 1 -- 172.21.15.78:0/3964568657 >> 172.21.15.78:0/3964568657 conn(0x7faf7806d7d0 msgr2=0x7faf7815dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.537+0000 7faf7e63f640 1 -- 172.21.15.78:0/3964568657 shutdown_connections 2024-09-17T03:12:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.537+0000 7faf7e63f640 1 -- 172.21.15.78:0/3964568657 wait complete. 2024-09-17T03:12:50.563 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:12:50.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.681+0000 7f42fb5da640 1 -- 172.21.15.78:0/4041266249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42f406f4b0 msgr2=0x7f42f40d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:50.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.681+0000 7f42fb5da640 1 --2- 172.21.15.78:0/4041266249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42f406f4b0 0x7f42f40d3330 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f42f408d9b0 tx=0x7f42e402a4f0 comp rx=0 tx=0).stop 2024-09-17T03:12:50.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.681+0000 7f42fb5da640 1 -- 172.21.15.78:0/4041266249 shutdown_connections 2024-09-17T03:12:50.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.681+0000 7f42fb5da640 1 --2- 172.21.15.78:0/4041266249 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42f406f4b0 0x7f42f40d3330 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:50.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.681+0000 7f42fb5da640 1 --2- 172.21.15.78:0/4041266249 >> v2:172.21.15.193:3300/0 conn(0x7f42f406e170 0x7f42f40b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:50.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.681+0000 7f42fb5da640 1 -- 172.21.15.78:0/4041266249 >> 172.21.15.78:0/4041266249 conn(0x7f42f408bfc0 msgr2=0x7f42f409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:50.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.681+0000 7f42fb5da640 1 -- 172.21.15.78:0/4041266249 shutdown_connections 2024-09-17T03:12:50.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.681+0000 7f42fb5da640 1 -- 172.21.15.78:0/4041266249 wait complete. 2024-09-17T03:12:50.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.683+0000 7f42fb5da640 1 Processor -- start 2024-09-17T03:12:50.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.683+0000 7f42fb5da640 1 -- start start 2024-09-17T03:12:50.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.684+0000 7f42fb5da640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42f406f4b0 0x7f42f40cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:50.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.684+0000 7f42fb5da640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42f40d3870 0x7f42f40ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:50.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.684+0000 7f42fb5da640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42f40ca8e0 0x7f42f415f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:50.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.684+0000 7f42fb5da640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f42f40d0ce0 con 0x7f42f40d3870 2024-09-17T03:12:50.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.684+0000 7f42fb5da640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f42f40d0e60 con 0x7f42f406f4b0 2024-09-17T03:12:50.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.684+0000 7f42fb5da640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f42f40d0fe0 con 0x7f42f40ca8e0 2024-09-17T03:12:50.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.685+0000 7f42f8b75640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42f40d3870 0x7f42f40ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:50.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.685+0000 7f42f8b75640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42f40d3870 0x7f42f40ca3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34910/0 (socket says 172.21.15.78:34910) 2024-09-17T03:12:50.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.685+0000 7f42f8b75640 1 -- 172.21.15.78:0/229170443 learned_addr learned my addr 172.21.15.78:0/229170443 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.685+0000 7f42f9376640 1 --2- 172.21.15.78:0/229170443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42f406f4b0 0x7f42f40cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.685+0000 7f42f9b77640 1 --2- 172.21.15.78:0/229170443 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42f40ca8e0 0x7f42f415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.685+0000 7f42f8b75640 1 -- 172.21.15.78:0/229170443 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42f40ca8e0 msgr2=0x7f42f415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.685+0000 7f42f8b75640 1 --2- 172.21.15.78:0/229170443 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42f40ca8e0 0x7f42f415f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.685+0000 7f42f8b75640 1 -- 172.21.15.78:0/229170443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42f406f4b0 msgr2=0x7f42f40cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.685+0000 7f42f8b75640 1 --2- 172.21.15.78:0/229170443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42f406f4b0 0x7f42f40cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.685+0000 7f42f8b75640 1 -- 172.21.15.78:0/229170443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f40cc180 con 0x7f42f40d3870 2024-09-17T03:12:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.685+0000 7f42f8b75640 1 --2- 172.21.15.78:0/229170443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42f40d3870 0x7f42f40ca3a0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f42e4006010 tx=0x7f42e40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.685+0000 7f42e9ffb640 1 -- 172.21.15.78:0/229170443 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e403e030 con 0x7f42f40d3870 2024-09-17T03:12:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.685+0000 7f42e9ffb640 1 -- 172.21.15.78:0/229170443 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42e40047a0 con 0x7f42f40d3870 2024-09-17T03:12:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.685+0000 7f42fb5da640 1 -- 172.21.15.78:0/229170443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f40a0810 con 0x7f42f40d3870 2024-09-17T03:12:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.685+0000 7f42e9ffb640 1 -- 172.21.15.78:0/229170443 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4035040 con 0x7f42f40d3870 2024-09-17T03:12:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.686+0000 7f42fb5da640 1 -- 172.21.15.78:0/229170443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f40cc890 con 0x7f42f40d3870 2024-09-17T03:12:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.687+0000 7f42fb5da640 1 -- 172.21.15.78:0/229170443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f40d1580 con 0x7f42f40d3870 2024-09-17T03:12:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.687+0000 7f42e9ffb640 1 -- 172.21.15.78:0/229170443 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f42e4041030 con 0x7f42f40d3870 2024-09-17T03:12:50.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.688+0000 7f42e9ffb640 1 --2- 172.21.15.78:0/229170443 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42d8078bc0 0x7f42d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:50.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.688+0000 7f42e9ffb640 1 -- 172.21.15.78:0/229170443 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5609+0+0 (secure 0 0 0) 0x7f42e40bb410 con 0x7f42f40d3870 2024-09-17T03:12:50.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.688+0000 7f42f9376640 1 --2- 172.21.15.78:0/229170443 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42d8078bc0 0x7f42d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:50.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.689+0000 7f42f9376640 1 --2- 172.21.15.78:0/229170443 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42d8078bc0 0x7f42d807b0d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f42f00098e0 tx=0x7f42f0009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:50.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.693+0000 7f42e9ffb640 1 -- 172.21.15.78:0/229170443 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f42e40832f0 con 0x7f42f40d3870 2024-09-17T03:12:50.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:50.903+0000 7f42fb5da640 1 -- 172.21.15.78:0/229170443 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f42f40761a0 con 0x7f42f40d3870 2024-09-17T03:12:51.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.554+0000 7f42e9ffb640 1 -- 172.21.15.78:0/229170443 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v59) ==== 174+0+0 (secure 0 0 0) 0x7f42e4087d20 con 0x7f42f40d3870 2024-09-17T03:12:51.555 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 10 and data pool 11 2024-09-17T03:12:51.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.561+0000 7f42fb5da640 1 -- 172.21.15.78:0/229170443 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42d8078bc0 msgr2=0x7f42d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:51.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.561+0000 7f42fb5da640 1 --2- 172.21.15.78:0/229170443 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42d8078bc0 0x7f42d807b0d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f42f00098e0 tx=0x7f42f0009060 comp rx=0 tx=0).stop 2024-09-17T03:12:51.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.561+0000 7f42fb5da640 1 -- 172.21.15.78:0/229170443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42f40d3870 msgr2=0x7f42f40ca3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:51.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.561+0000 7f42fb5da640 1 --2- 172.21.15.78:0/229170443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42f40d3870 0x7f42f40ca3a0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f42e4006010 tx=0x7f42e40039e0 comp rx=0 tx=0).stop 2024-09-17T03:12:51.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.561+0000 7f42fb5da640 1 -- 172.21.15.78:0/229170443 shutdown_connections 2024-09-17T03:12:51.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.561+0000 7f42fb5da640 1 --2- 172.21.15.78:0/229170443 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42f40ca8e0 0x7f42f415f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:51.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.561+0000 7f42fb5da640 1 --2- 172.21.15.78:0/229170443 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42f40d3870 0x7f42f40ca3a0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:51.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.561+0000 7f42fb5da640 1 --2- 172.21.15.78:0/229170443 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42d8078bc0 0x7f42d807b0d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:51.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.561+0000 7f42fb5da640 1 --2- 172.21.15.78:0/229170443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42f406f4b0 0x7f42f40cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:51.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.561+0000 7f42fb5da640 1 -- 172.21.15.78:0/229170443 >> 172.21.15.78:0/229170443 conn(0x7f42f408bfc0 msgr2=0x7f42f40b5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:51.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.561+0000 7f42fb5da640 1 -- 172.21.15.78:0/229170443 shutdown_connections 2024-09-17T03:12:51.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.563+0000 7f42fb5da640 1 -- 172.21.15.78:0/229170443 wait complete. 2024-09-17T03:12:51.584 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:12:51.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.697+0000 7f6a3a40e640 1 -- 172.21.15.78:0/4190006136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a1c003c10 msgr2=0x7f6a1c004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:51.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.697+0000 7f6a3a40e640 1 --2- 172.21.15.78:0/4190006136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a1c003c10 0x7f6a1c004060 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f6a24001830 tx=0x7f6a1c005830 comp rx=0 tx=0).stop 2024-09-17T03:12:51.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.697+0000 7f6a389ab640 1 -- 172.21.15.78:0/4190006136 reap_dead start 2024-09-17T03:12:51.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.697+0000 7f6a3a40e640 1 -- 172.21.15.78:0/4190006136 shutdown_connections 2024-09-17T03:12:51.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.697+0000 7f6a3a40e640 1 -- 172.21.15.78:0/4190006136 >> 172.21.15.78:0/4190006136 conn(0x7f6a3406d4f0 msgr2=0x7f6a34071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:51.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.697+0000 7f6a3a40e640 1 -- 172.21.15.78:0/4190006136 shutdown_connections 2024-09-17T03:12:51.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.697+0000 7f6a3a40e640 1 -- 172.21.15.78:0/4190006136 wait complete. 2024-09-17T03:12:51.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.699+0000 7f6a3a40e640 1 Processor -- start 2024-09-17T03:12:51.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.699+0000 7f6a3a40e640 1 -- start start 2024-09-17T03:12:51.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.701+0000 7f6a3a40e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a1c003c10 0x7f6a34156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:51.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.701+0000 7f6a3a40e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a34153770 0x7f6a341459a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:51.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.701+0000 7f6a3a40e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6a34145ee0 0x7f6a340c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:51.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.701+0000 7f6a3a40e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6a340d1210 con 0x7f6a1c003c10 2024-09-17T03:12:51.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.701+0000 7f6a3a40e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6a340d1090 con 0x7f6a34153770 2024-09-17T03:12:51.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.701+0000 7f6a3a40e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f6a340d1390 con 0x7f6a34145ee0 2024-09-17T03:12:51.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.701+0000 7f6a33fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a1c003c10 0x7f6a34156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:51.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.701+0000 7f6a33fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a1c003c10 0x7f6a34156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34926/0 (socket says 172.21.15.78:34926) 2024-09-17T03:12:51.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.701+0000 7f6a33fff640 1 -- 172.21.15.78:0/3619989240 learned_addr learned my addr 172.21.15.78:0/3619989240 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:51.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.701+0000 7f6a337fe640 1 --2- 172.21.15.78:0/3619989240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a34153770 0x7f6a341459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:51.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.701+0000 7f6a389ab640 1 --2- 172.21.15.78:0/3619989240 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6a34145ee0 0x7f6a340c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:51.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.701+0000 7f6a33fff640 1 -- 172.21.15.78:0/3619989240 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6a34145ee0 msgr2=0x7f6a340c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:51.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.701+0000 7f6a33fff640 1 --2- 172.21.15.78:0/3619989240 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6a34145ee0 0x7f6a340c9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:51.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.701+0000 7f6a33fff640 1 -- 172.21.15.78:0/3619989240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a34153770 msgr2=0x7f6a341459a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:51.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.701+0000 7f6a33fff640 1 --2- 172.21.15.78:0/3619989240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a34153770 0x7f6a341459a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:51.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.701+0000 7f6a33fff640 1 -- 172.21.15.78:0/3619989240 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a34144900 con 0x7f6a1c003c10 2024-09-17T03:12:51.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.701+0000 7f6a33fff640 1 --2- 172.21.15.78:0/3619989240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a1c003c10 0x7f6a34156a60 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f6a24001920 tx=0x7f6a24006150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:51.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.701+0000 7f6a30ff9640 1 -- 172.21.15.78:0/3619989240 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24043070 con 0x7f6a1c003c10 2024-09-17T03:12:51.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.702+0000 7f6a30ff9640 1 -- 172.21.15.78:0/3619989240 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a24003af0 con 0x7f6a1c003c10 2024-09-17T03:12:51.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.702+0000 7f6a3a40e640 1 -- 172.21.15.78:0/3619989240 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a34144be0 con 0x7f6a1c003c10 2024-09-17T03:12:51.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.702+0000 7f6a30ff9640 1 -- 172.21.15.78:0/3619989240 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24033480 con 0x7f6a1c003c10 2024-09-17T03:12:51.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.702+0000 7f6a3a40e640 1 -- 172.21.15.78:0/3619989240 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a341451a0 con 0x7f6a1c003c10 2024-09-17T03:12:51.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.703+0000 7f6a3a40e640 1 -- 172.21.15.78:0/3619989240 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a340b2260 con 0x7f6a1c003c10 2024-09-17T03:12:51.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.703+0000 7f6a30ff9640 1 -- 172.21.15.78:0/3619989240 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6a24046070 con 0x7f6a1c003c10 2024-09-17T03:12:51.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.704+0000 7f6a30ff9640 1 --2- 172.21.15.78:0/3619989240 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6a20078b90 0x7f6a2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:51.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.704+0000 7f6a30ff9640 1 -- 172.21.15.78:0/3619989240 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f6a240baae0 con 0x7f6a1c003c10 2024-09-17T03:12:51.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.704+0000 7f6a337fe640 1 --2- 172.21.15.78:0/3619989240 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6a20078b90 0x7f6a2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:51.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.705+0000 7f6a337fe640 1 --2- 172.21.15.78:0/3619989240 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6a20078b90 0x7f6a2007b0a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6a28001880 tx=0x7f6a28001670 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:51.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.708+0000 7f6a30ff9640 1 -- 172.21.15.78:0/3619989240 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6a240829f0 con 0x7f6a1c003c10 2024-09-17T03:12:51.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.883+0000 7f6a3a40e640 1 -- 172.21.15.78:0/3619989240 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a340b1f80 con 0x7f6a1c003c10 2024-09-17T03:12:51.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.884+0000 7f6a30ff9640 1 -- 172.21.15.78:0/3619989240 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16717 (secure 0 0 0) 0x7f6a24087420 con 0x7f6a1c003c10 2024-09-17T03:12:51.884 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:12:51.884 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":68,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:12:50.905724+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:12:48.548227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T03:12:49.863501+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:12:51.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.887+0000 7f6a3a40e640 1 -- 172.21.15.78:0/3619989240 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6a20078b90 msgr2=0x7f6a2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:51.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.887+0000 7f6a3a40e640 1 --2- 172.21.15.78:0/3619989240 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6a20078b90 0x7f6a2007b0a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6a28001880 tx=0x7f6a28001670 comp rx=0 tx=0).stop 2024-09-17T03:12:51.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.887+0000 7f6a3a40e640 1 -- 172.21.15.78:0/3619989240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a1c003c10 msgr2=0x7f6a34156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:51.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.887+0000 7f6a3a40e640 1 --2- 172.21.15.78:0/3619989240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a1c003c10 0x7f6a34156a60 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f6a24001920 tx=0x7f6a24006150 comp rx=0 tx=0).stop 2024-09-17T03:12:51.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.887+0000 7f6a3a40e640 1 -- 172.21.15.78:0/3619989240 shutdown_connections 2024-09-17T03:12:51.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.887+0000 7f6a3a40e640 1 --2- 172.21.15.78:0/3619989240 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6a34145ee0 0x7f6a340c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:51.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.887+0000 7f6a3a40e640 1 --2- 172.21.15.78:0/3619989240 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6a20078b90 0x7f6a2007b0a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:51.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.887+0000 7f6a3a40e640 1 --2- 172.21.15.78:0/3619989240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6a34153770 0x7f6a341459a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:51.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.887+0000 7f6a3a40e640 1 --2- 172.21.15.78:0/3619989240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6a1c003c10 0x7f6a34156a60 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:51.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.887+0000 7f6a3a40e640 1 -- 172.21.15.78:0/3619989240 >> 172.21.15.78:0/3619989240 conn(0x7f6a3406d4f0 msgr2=0x7f6a340b2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:51.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.887+0000 7f6a3a40e640 1 -- 172.21.15.78:0/3619989240 shutdown_connections 2024-09-17T03:12:51.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:51.887+0000 7f6a3a40e640 1 -- 172.21.15.78:0/3619989240 wait complete. 2024-09-17T03:12:51.898 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:12:52.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.011+0000 7f7b52cf9640 1 -- 172.21.15.78:0/1625691880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b34003a00 msgr2=0x7f7b34003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:52.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.011+0000 7f7b52cf9640 1 --2- 172.21.15.78:0/1625691880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b34003a00 0x7f7b34003e70 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800bb20 tx=0x7f7b34005830 comp rx=0 tx=0).stop 2024-09-17T03:12:52.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.011+0000 7f7b51296640 1 -- 172.21.15.78:0/1625691880 reap_dead start 2024-09-17T03:12:52.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.011+0000 7f7b52cf9640 1 -- 172.21.15.78:0/1625691880 shutdown_connections 2024-09-17T03:12:52.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.011+0000 7f7b52cf9640 1 -- 172.21.15.78:0/1625691880 >> 172.21.15.78:0/1625691880 conn(0x7f7b4c0cd530 msgr2=0x7f7b4c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:52.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.011+0000 7f7b52cf9640 1 -- 172.21.15.78:0/1625691880 shutdown_connections 2024-09-17T03:12:52.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.011+0000 7f7b52cf9640 1 -- 172.21.15.78:0/1625691880 wait complete. 2024-09-17T03:12:52.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.013+0000 7f7b52cf9640 1 Processor -- start 2024-09-17T03:12:52.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.013+0000 7f7b52cf9640 1 -- start start 2024-09-17T03:12:52.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.014+0000 7f7b52cf9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7b34003a00 0x7f7b4c1f9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:52.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.014+0000 7f7b52cf9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b4c14d520 0x7f7b4c14c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:52.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.014+0000 7f7b52cf9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b4c14cf60 0x7f7b4c0b4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:52.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.014+0000 7f7b52cf9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c06e280 con 0x7f7b4c14d520 2024-09-17T03:12:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.014+0000 7f7b52cf9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7b4c06e100 con 0x7f7b4c14cf60 2024-09-17T03:12:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.014+0000 7f7b52cf9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7b4c06e400 con 0x7f7b34003a00 2024-09-17T03:12:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.015+0000 7f7b43fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b4c14d520 0x7f7b4c14c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.015+0000 7f7b43fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b4c14d520 0x7f7b4c14c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34950/0 (socket says 172.21.15.78:34950) 2024-09-17T03:12:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.015+0000 7f7b43fff640 1 -- 172.21.15.78:0/999848531 learned_addr learned my addr 172.21.15.78:0/999848531 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.015+0000 7f7b51296640 1 --2- 172.21.15.78:0/999848531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b4c14cf60 0x7f7b4c0b4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.015+0000 7f7b50a95640 1 --2- 172.21.15.78:0/999848531 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7b34003a00 0x7f7b4c1f9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.015+0000 7f7b43fff640 1 -- 172.21.15.78:0/999848531 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7b34003a00 msgr2=0x7f7b4c1f9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.015+0000 7f7b43fff640 1 --2- 172.21.15.78:0/999848531 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7b34003a00 0x7f7b4c1f9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.015+0000 7f7b43fff640 1 -- 172.21.15.78:0/999848531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b4c14cf60 msgr2=0x7f7b4c0b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.015+0000 7f7b43fff640 1 --2- 172.21.15.78:0/999848531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b4c14cf60 0x7f7b4c0b4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.015+0000 7f7b43fff640 1 -- 172.21.15.78:0/999848531 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b4c14cd60 con 0x7f7b4c14d520 2024-09-17T03:12:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.015+0000 7f7b43fff640 1 --2- 172.21.15.78:0/999848531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b4c14d520 0x7f7b4c14c820 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c001eb0 tx=0x7f7b3c00eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:52.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.015+0000 7f7b417fa640 1 -- 172.21.15.78:0/999848531 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c015070 con 0x7f7b4c14d520 2024-09-17T03:12:52.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.015+0000 7f7b417fa640 1 -- 172.21.15.78:0/999848531 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b3c00ca80 con 0x7f7b4c14d520 2024-09-17T03:12:52.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.015+0000 7f7b52cf9640 1 -- 172.21.15.78:0/999848531 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b4c1545a0 con 0x7f7b4c14d520 2024-09-17T03:12:52.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.015+0000 7f7b417fa640 1 -- 172.21.15.78:0/999848531 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c011460 con 0x7f7b4c14d520 2024-09-17T03:12:52.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.015+0000 7f7b52cf9640 1 -- 172.21.15.78:0/999848531 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b4c154b60 con 0x7f7b4c14d520 2024-09-17T03:12:52.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.016+0000 7f7b52cf9640 1 -- 172.21.15.78:0/999848531 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b4c154310 con 0x7f7b4c14d520 2024-09-17T03:12:52.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.017+0000 7f7b417fa640 1 -- 172.21.15.78:0/999848531 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7b3c018070 con 0x7f7b4c14d520 2024-09-17T03:12:52.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.017+0000 7f7b417fa640 1 --2- 172.21.15.78:0/999848531 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7b38078bc0 0x7f7b3807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:52.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.018+0000 7f7b417fa640 1 -- 172.21.15.78:0/999848531 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f7b3c09b1f0 con 0x7f7b4c14d520 2024-09-17T03:12:52.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.018+0000 7f7b50a95640 1 --2- 172.21.15.78:0/999848531 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7b38078bc0 0x7f7b3807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:52.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.018+0000 7f7b50a95640 1 --2- 172.21.15.78:0/999848531 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7b38078bc0 0x7f7b3807b0d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7b48036000 tx=0x7f7b480046c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:52.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.022+0000 7f7b417fa640 1 -- 172.21.15.78:0/999848531 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7b4c14cd60 con 0x7f7b4c14d520 2024-09-17T03:12:52.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.196+0000 7f7b52cf9640 1 -- 172.21.15.78:0/999848531 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b4c0cec40 con 0x7f7b4c14d520 2024-09-17T03:12:52.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.198+0000 7f7b417fa640 1 -- 172.21.15.78:0/999848531 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16717 (secure 0 0 0) 0x7f7b3c063630 con 0x7f7b4c14d520 2024-09-17T03:12:52.198 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:12:52.198 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":68,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:12:50.905724+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:12:48.548227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T03:12:49.863501+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:12:52.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.200+0000 7f7b52cf9640 1 -- 172.21.15.78:0/999848531 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7b38078bc0 msgr2=0x7f7b3807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:52.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.200+0000 7f7b52cf9640 1 --2- 172.21.15.78:0/999848531 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7b38078bc0 0x7f7b3807b0d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7b48036000 tx=0x7f7b480046c0 comp rx=0 tx=0).stop 2024-09-17T03:12:52.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.200+0000 7f7b52cf9640 1 -- 172.21.15.78:0/999848531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b4c14d520 msgr2=0x7f7b4c14c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:52.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.200+0000 7f7b52cf9640 1 --2- 172.21.15.78:0/999848531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b4c14d520 0x7f7b4c14c820 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c001eb0 tx=0x7f7b3c00eaa0 comp rx=0 tx=0).stop 2024-09-17T03:12:52.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.200+0000 7f7b52cf9640 1 -- 172.21.15.78:0/999848531 shutdown_connections 2024-09-17T03:12:52.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.200+0000 7f7b52cf9640 1 --2- 172.21.15.78:0/999848531 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7b38078bc0 0x7f7b3807b0d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:52.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.200+0000 7f7b52cf9640 1 --2- 172.21.15.78:0/999848531 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b4c14cf60 0x7f7b4c0b4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:52.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.200+0000 7f7b52cf9640 1 --2- 172.21.15.78:0/999848531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b4c14d520 0x7f7b4c14c820 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:52.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.200+0000 7f7b52cf9640 1 --2- 172.21.15.78:0/999848531 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7b34003a00 0x7f7b4c1f9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:52.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.200+0000 7f7b52cf9640 1 -- 172.21.15.78:0/999848531 >> 172.21.15.78:0/999848531 conn(0x7f7b4c0cd530 msgr2=0x7f7b4c0b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:52.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.200+0000 7f7b52cf9640 1 -- 172.21.15.78:0/999848531 shutdown_connections 2024-09-17T03:12:52.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.200+0000 7f7b52cf9640 1 -- 172.21.15.78:0/999848531 wait complete. 2024-09-17T03:12:52.211 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:12:52.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.327+0000 7fabb6294640 1 -- 172.21.15.78:0/3385918668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabb00cf360 msgr2=0x7fabb0156f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:52.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.327+0000 7fabb6294640 1 --2- 172.21.15.78:0/3385918668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabb00cf360 0x7fabb0156f10 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7faba8005fd0 tx=0x7faba802a940 comp rx=0 tx=0).stop 2024-09-17T03:12:52.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.327+0000 7fabb6294640 1 -- 172.21.15.78:0/3385918668 shutdown_connections 2024-09-17T03:12:52.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.327+0000 7fabb6294640 1 --2- 172.21.15.78:0/3385918668 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabb00cf360 0x7fabb0156f10 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:52.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.327+0000 7fabb6294640 1 -- 172.21.15.78:0/3385918668 >> 172.21.15.78:0/3385918668 conn(0x7fabb006d4f0 msgr2=0x7fabb0071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:52.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.327+0000 7fabb6294640 1 -- 172.21.15.78:0/3385918668 shutdown_connections 2024-09-17T03:12:52.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.327+0000 7fabb6294640 1 -- 172.21.15.78:0/3385918668 wait complete. 2024-09-17T03:12:52.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.329+0000 7fabb6294640 1 Processor -- start 2024-09-17T03:12:52.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.329+0000 7fabb6294640 1 -- start start 2024-09-17T03:12:52.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.330+0000 7fabb6294640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fabb00ccb70 0x7fabb0147700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:52.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.330+0000 7fabb6294640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fabb00cf360 0x7fabb015d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:52.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.330+0000 7fabb6294640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabb0161020 0x7fabb00b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:52.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.330+0000 7fabb6294640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fabb00d0a60 con 0x7fabb0161020 2024-09-17T03:12:52.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.330+0000 7fabb6294640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fabb00d08e0 con 0x7fabb00cf360 2024-09-17T03:12:52.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.330+0000 7fabb6294640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fabb00d0be0 con 0x7fabb00ccb70 2024-09-17T03:12:52.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.330+0000 7fabb4831640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabb0161020 0x7fabb00b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:52.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.330+0000 7fabb4831640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabb0161020 0x7fabb00b2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34964/0 (socket says 172.21.15.78:34964) 2024-09-17T03:12:52.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.330+0000 7fabb4831640 1 -- 172.21.15.78:0/4280050610 learned_addr learned my addr 172.21.15.78:0/4280050610 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:52.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.330+0000 7fabb4831640 1 -- 172.21.15.78:0/4280050610 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fabb00ccb70 msgr2=0x7fabb0147700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:52.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.330+0000 7fabb4831640 1 --2- 172.21.15.78:0/4280050610 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fabb00ccb70 0x7fabb0147700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:52.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.330+0000 7fabaf7fe640 1 --2- 172.21.15.78:0/4280050610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fabb00cf360 0x7fabb015d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:52.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.330+0000 7fabb4831640 1 -- 172.21.15.78:0/4280050610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fabb00cf360 msgr2=0x7fabb015d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:52.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.331+0000 7fabb4831640 1 --2- 172.21.15.78:0/4280050610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fabb00cf360 0x7fabb015d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:52.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.331+0000 7fabb4831640 1 -- 172.21.15.78:0/4280050610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb0147c40 con 0x7fabb0161020 2024-09-17T03:12:52.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.331+0000 7fabb4831640 1 --2- 172.21.15.78:0/4280050610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabb0161020 0x7fabb00b2310 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7faba8009cd0 tx=0x7faba8031ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:52.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.331+0000 7fabacff9640 1 -- 172.21.15.78:0/4280050610 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba803e070 con 0x7fabb0161020 2024-09-17T03:12:52.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.331+0000 7fabacff9640 1 -- 172.21.15.78:0/4280050610 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faba8004540 con 0x7fabb0161020 2024-09-17T03:12:52.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.331+0000 7fabb6294640 1 -- 172.21.15.78:0/4280050610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb01f7d80 con 0x7fabb0161020 2024-09-17T03:12:52.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.331+0000 7fabacff9640 1 -- 172.21.15.78:0/4280050610 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba8043460 con 0x7fabb0161020 2024-09-17T03:12:52.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.331+0000 7fabb6294640 1 -- 172.21.15.78:0/4280050610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb01f7aa0 con 0x7fabb0161020 2024-09-17T03:12:52.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.332+0000 7fabb6294640 1 -- 172.21.15.78:0/4280050610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb0156f10 con 0x7fabb0161020 2024-09-17T03:12:52.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.333+0000 7fabacff9640 1 -- 172.21.15.78:0/4280050610 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faba803a440 con 0x7fabb0161020 2024-09-17T03:12:52.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.334+0000 7fabacff9640 1 --2- 172.21.15.78:0/4280050610 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fab9c078b90 0x7fab9c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:52.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.334+0000 7fabacff9640 1 -- 172.21.15.78:0/4280050610 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7faba80bca40 con 0x7fabb0161020 2024-09-17T03:12:52.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.334+0000 7fabaffff640 1 --2- 172.21.15.78:0/4280050610 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fab9c078b90 0x7fab9c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:52.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.334+0000 7fabaffff640 1 --2- 172.21.15.78:0/4280050610 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fab9c078b90 0x7fab9c07b0a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faba0001510 tx=0x7faba0007930 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:52.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.338+0000 7fabacff9640 1 -- 172.21.15.78:0/4280050610 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fabb0147c40 con 0x7fabb0161020 2024-09-17T03:12:52.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.552+0000 7fabb6294640 1 -- 172.21.15.78:0/4280050610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fabb00c6690 con 0x7fabb0161020 2024-09-17T03:12:52.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.554+0000 7fabacff9640 1 -- 172.21.15.78:0/4280050610 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v60) ==== 118+0+0 (secure 0 0 0) 0x7faba8084fa0 con 0x7fabb0161020 2024-09-17T03:12:52.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.557+0000 7fabb6294640 1 -- 172.21.15.78:0/4280050610 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fab9c078b90 msgr2=0x7fab9c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:52.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.557+0000 7fabb6294640 1 --2- 172.21.15.78:0/4280050610 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fab9c078b90 0x7fab9c07b0a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7faba0001510 tx=0x7faba0007930 comp rx=0 tx=0).stop 2024-09-17T03:12:52.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.557+0000 7fabb6294640 1 -- 172.21.15.78:0/4280050610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabb0161020 msgr2=0x7fabb00b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:52.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.557+0000 7fabb6294640 1 --2- 172.21.15.78:0/4280050610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabb0161020 0x7fabb00b2310 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7faba8009cd0 tx=0x7faba8031ea0 comp rx=0 tx=0).stop 2024-09-17T03:12:52.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.557+0000 7fabb6294640 1 -- 172.21.15.78:0/4280050610 shutdown_connections 2024-09-17T03:12:52.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.557+0000 7fabb6294640 1 --2- 172.21.15.78:0/4280050610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fabb0161020 0x7fabb00b2310 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:52.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.557+0000 7fabb6294640 1 --2- 172.21.15.78:0/4280050610 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fab9c078b90 0x7fab9c07b0a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:52.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.557+0000 7fabb6294640 1 --2- 172.21.15.78:0/4280050610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fabb00cf360 0x7fabb015d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:52.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.557+0000 7fabb6294640 1 --2- 172.21.15.78:0/4280050610 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fabb00ccb70 0x7fabb0147700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:52.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.557+0000 7fabb6294640 1 -- 172.21.15.78:0/4280050610 >> 172.21.15.78:0/4280050610 conn(0x7fabb006d4f0 msgr2=0x7fabb00c6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:52.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.557+0000 7fabb6294640 1 -- 172.21.15.78:0/4280050610 shutdown_connections 2024-09-17T03:12:52.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.557+0000 7fabb6294640 1 -- 172.21.15.78:0/4280050610 wait complete. 2024-09-17T03:12:52.569 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:12:52.569 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:12:52.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.687+0000 7f8551e07640 1 -- 172.21.15.78:0/3794186273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8538004800 msgr2=0x7f8538004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:52.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.687+0000 7f8551e07640 1 --2- 172.21.15.78:0/3794186273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8538004800 0x7f8538004c10 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f8534006fa0 tx=0x7f8538005830 comp rx=0 tx=0).stop 2024-09-17T03:12:52.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.687+0000 7f8551e07640 1 -- 172.21.15.78:0/3794186273 shutdown_connections 2024-09-17T03:12:52.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.687+0000 7f8551e07640 1 --2- 172.21.15.78:0/3794186273 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8538004800 0x7f8538004c10 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:52.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.687+0000 7f8551e07640 1 -- 172.21.15.78:0/3794186273 >> 172.21.15.78:0/3794186273 conn(0x7f854c06d7d0 msgr2=0x7f854c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:52.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.687+0000 7f8551e07640 1 -- 172.21.15.78:0/3794186273 shutdown_connections 2024-09-17T03:12:52.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.687+0000 7f8551e07640 1 -- 172.21.15.78:0/3794186273 wait complete. 2024-09-17T03:12:52.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.689+0000 7f8551e07640 1 Processor -- start 2024-09-17T03:12:52.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.689+0000 7f8551e07640 1 -- start start 2024-09-17T03:12:52.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.690+0000 7f8551e07640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8538004800 0x7f854c159e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:52.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.690+0000 7f8551e07640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f854c1f54f0 0x7f854c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:52.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.690+0000 7f8551e07640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f854c1f5900 0x7f854c1e8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:52.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.690+0000 7f8551e07640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f854c0b3f10 con 0x7f8538004800 2024-09-17T03:12:52.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.690+0000 7f8551e07640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f854c0b3d90 con 0x7f854c1f5900 2024-09-17T03:12:52.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.690+0000 7f8551e07640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f854c070180 con 0x7f854c1f54f0 2024-09-17T03:12:52.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.690+0000 7f854b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8538004800 0x7f854c159e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.690+0000 7f854b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8538004800 0x7f854c159e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34986/0 (socket says 172.21.15.78:34986) 2024-09-17T03:12:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.690+0000 7f854b7fe640 1 -- 172.21.15.78:0/4174831626 learned_addr learned my addr 172.21.15.78:0/4174831626 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.690+0000 7f854bfff640 1 --2- 172.21.15.78:0/4174831626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f854c1f5900 0x7f854c1e8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.690+0000 7f8543fff640 1 --2- 172.21.15.78:0/4174831626 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f854c1f54f0 0x7f854c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.690+0000 7f854b7fe640 1 -- 172.21.15.78:0/4174831626 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f854c1f54f0 msgr2=0x7f854c09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.690+0000 7f854b7fe640 1 --2- 172.21.15.78:0/4174831626 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f854c1f54f0 0x7f854c09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.690+0000 7f854b7fe640 1 -- 172.21.15.78:0/4174831626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f854c1f5900 msgr2=0x7f854c1e8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.690+0000 7f854b7fe640 1 --2- 172.21.15.78:0/4174831626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f854c1f5900 0x7f854c1e8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.690+0000 7f854b7fe640 1 -- 172.21.15.78:0/4174831626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854c1593b0 con 0x7f8538004800 2024-09-17T03:12:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.690+0000 7f854b7fe640 1 --2- 172.21.15.78:0/4174831626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8538004800 0x7f854c159e50 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f853c004d60 tx=0x7f853c001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.691+0000 7f8548ff9640 1 -- 172.21.15.78:0/4174831626 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c017070 con 0x7f8538004800 2024-09-17T03:12:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.691+0000 7f8548ff9640 1 -- 172.21.15.78:0/4174831626 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f853c004e50 con 0x7f8538004800 2024-09-17T03:12:52.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.691+0000 7f8551e07640 1 -- 172.21.15.78:0/4174831626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854c1f6000 con 0x7f8538004800 2024-09-17T03:12:52.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.691+0000 7f8548ff9640 1 -- 172.21.15.78:0/4174831626 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c010b00 con 0x7f8538004800 2024-09-17T03:12:52.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.691+0000 7f8551e07640 1 -- 172.21.15.78:0/4174831626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f854c159650 con 0x7f8538004800 2024-09-17T03:12:52.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.692+0000 7f8551e07640 1 -- 172.21.15.78:0/4174831626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f854c0706e0 con 0x7f8538004800 2024-09-17T03:12:52.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.692+0000 7f8548ff9640 1 -- 172.21.15.78:0/4174831626 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f853c01a070 con 0x7f8538004800 2024-09-17T03:12:52.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.693+0000 7f8548ff9640 1 --2- 172.21.15.78:0/4174831626 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f852c078b90 0x7f852c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:52.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.693+0000 7f8548ff9640 1 -- 172.21.15.78:0/4174831626 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f853c09aa80 con 0x7f8538004800 2024-09-17T03:12:52.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.693+0000 7f8543fff640 1 --2- 172.21.15.78:0/4174831626 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f852c078b90 0x7f852c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:52.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.694+0000 7f8543fff640 1 --2- 172.21.15.78:0/4174831626 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f852c078b90 0x7f852c07b0a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8534033000 tx=0x7f854c0b33d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:52.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.697+0000 7f8548ff9640 1 -- 172.21.15.78:0/4174831626 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f853c062ec0 con 0x7f8538004800 2024-09-17T03:12:52.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:52.908+0000 7f8551e07640 1 -- 172.21.15.78:0/4174831626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f854c0cf0f0 con 0x7f8538004800 2024-09-17T03:12:53.531 INFO:tasks.ceph.mds.a.smithi078.stderr:2024-09-17T03:12:53.531+0000 7f709c4f2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:12:53.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.567+0000 7f8548ff9640 1 -- 172.21.15.78:0/4174831626 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v61) ==== 122+0+0 (secure 0 0 0) 0x7f853c0627c0 con 0x7f8538004800 2024-09-17T03:12:53.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.570+0000 7f8551e07640 1 -- 172.21.15.78:0/4174831626 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f852c078b90 msgr2=0x7f852c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:53.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.570+0000 7f8551e07640 1 --2- 172.21.15.78:0/4174831626 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f852c078b90 0x7f852c07b0a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8534033000 tx=0x7f854c0b33d0 comp rx=0 tx=0).stop 2024-09-17T03:12:53.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.570+0000 7f8551e07640 1 -- 172.21.15.78:0/4174831626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8538004800 msgr2=0x7f854c159e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:53.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.570+0000 7f8551e07640 1 --2- 172.21.15.78:0/4174831626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8538004800 0x7f854c159e50 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f853c004d60 tx=0x7f853c001630 comp rx=0 tx=0).stop 2024-09-17T03:12:53.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.570+0000 7f8551e07640 1 -- 172.21.15.78:0/4174831626 shutdown_connections 2024-09-17T03:12:53.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.570+0000 7f8551e07640 1 --2- 172.21.15.78:0/4174831626 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f852c078b90 0x7f852c07b0a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:53.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.570+0000 7f8551e07640 1 --2- 172.21.15.78:0/4174831626 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f854c1f5900 0x7f854c1e8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:53.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.570+0000 7f8551e07640 1 --2- 172.21.15.78:0/4174831626 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f854c1f54f0 0x7f854c09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:53.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.570+0000 7f8551e07640 1 --2- 172.21.15.78:0/4174831626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8538004800 0x7f854c159e50 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:53.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.570+0000 7f8551e07640 1 -- 172.21.15.78:0/4174831626 >> 172.21.15.78:0/4174831626 conn(0x7f854c06d7d0 msgr2=0x7f854c073400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:53.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.570+0000 7f8551e07640 1 -- 172.21.15.78:0/4174831626 shutdown_connections 2024-09-17T03:12:53.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.570+0000 7f8551e07640 1 -- 172.21.15.78:0/4174831626 wait complete. 2024-09-17T03:12:53.583 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:12:53.583 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:12:53.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.698+0000 7f07fc0d5640 1 -- 172.21.15.78:0/2171562150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07dc004800 msgr2=0x7f07dc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:53.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.698+0000 7f07fc0d5640 1 --2- 172.21.15.78:0/2171562150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07dc004800 0x7f07dc004c10 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f07e8001690 tx=0x7f07dc005830 comp rx=0 tx=0).stop 2024-09-17T03:12:53.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.698+0000 7f07fc0d5640 1 -- 172.21.15.78:0/2171562150 shutdown_connections 2024-09-17T03:12:53.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.698+0000 7f07fc0d5640 1 --2- 172.21.15.78:0/2171562150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07dc004800 0x7f07dc004c10 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:53.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.698+0000 7f07fc0d5640 1 -- 172.21.15.78:0/2171562150 >> 172.21.15.78:0/2171562150 conn(0x7f07f4072ae0 msgr2=0x7f07f4072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:53.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.698+0000 7f07fc0d5640 1 -- 172.21.15.78:0/2171562150 shutdown_connections 2024-09-17T03:12:53.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.698+0000 7f07fc0d5640 1 -- 172.21.15.78:0/2171562150 wait complete. 2024-09-17T03:12:53.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.699+0000 7f07fc0d5640 1 Processor -- start 2024-09-17T03:12:53.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.700+0000 7f07fc0d5640 1 -- start start 2024-09-17T03:12:53.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.701+0000 7f07fc0d5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07dc004800 0x7f07f40aa750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:53.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.701+0000 7f07fc0d5640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f07f4151dd0 0x7f07f41f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:53.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.701+0000 7f07fc0d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f41f6b40 0x7f07f414bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:53.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.701+0000 7f07fc0d5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f07f415c860 con 0x7f07f41f6b40 2024-09-17T03:12:53.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.701+0000 7f07fc0d5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f07f415c6e0 con 0x7f07dc004800 2024-09-17T03:12:53.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.701+0000 7f07fc0d5640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f07f415c9e0 con 0x7f07f4151dd0 2024-09-17T03:12:53.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.701+0000 7f07fa672640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f41f6b40 0x7f07f414bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:53.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.701+0000 7f07fa672640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f41f6b40 0x7f07f414bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35004/0 (socket says 172.21.15.78:35004) 2024-09-17T03:12:53.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.701+0000 7f07fa672640 1 -- 172.21.15.78:0/1086795158 learned_addr learned my addr 172.21.15.78:0/1086795158 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:53.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.701+0000 7f07f9e71640 1 --2- 172.21.15.78:0/1086795158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07dc004800 0x7f07f40aa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:53.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.701+0000 7f07f9670640 1 --2- 172.21.15.78:0/1086795158 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f07f4151dd0 0x7f07f41f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:53.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.701+0000 7f07fa672640 1 -- 172.21.15.78:0/1086795158 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f07f4151dd0 msgr2=0x7f07f41f6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:53.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.701+0000 7f07fa672640 1 --2- 172.21.15.78:0/1086795158 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f07f4151dd0 0x7f07f41f6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:53.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.701+0000 7f07fa672640 1 -- 172.21.15.78:0/1086795158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07dc004800 msgr2=0x7f07f40aa750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:53.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.701+0000 7f07fa672640 1 --2- 172.21.15.78:0/1086795158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07dc004800 0x7f07f40aa750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:53.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.701+0000 7f07fa672640 1 -- 172.21.15.78:0/1086795158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f41f6f50 con 0x7f07f41f6b40 2024-09-17T03:12:53.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.701+0000 7f07f9e71640 1 --2- 172.21.15.78:0/1086795158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07dc004800 0x7f07f40aa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:53.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.701+0000 7f07fa672640 1 --2- 172.21.15.78:0/1086795158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f41f6b40 0x7f07f414bb00 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f07f40ce1a0 tx=0x7f07ec00e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:53.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.701+0000 7f07f27fc640 1 -- 172.21.15.78:0/1086795158 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec011870 con 0x7f07f41f6b40 2024-09-17T03:12:53.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.702+0000 7f07f27fc640 1 -- 172.21.15.78:0/1086795158 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07ec017070 con 0x7f07f41f6b40 2024-09-17T03:12:53.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.702+0000 7f07f27fc640 1 -- 172.21.15.78:0/1086795158 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec011d60 con 0x7f07f41f6b40 2024-09-17T03:12:53.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.702+0000 7f07fc0d5640 1 -- 172.21.15.78:0/1086795158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07f40ac0f0 con 0x7f07f41f6b40 2024-09-17T03:12:53.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.702+0000 7f07fc0d5640 1 -- 172.21.15.78:0/1086795158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07f40ab330 con 0x7f07f41f6b40 2024-09-17T03:12:53.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.702+0000 7f07fc0d5640 1 -- 172.21.15.78:0/1086795158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07f40aadc0 con 0x7f07f41f6b40 2024-09-17T03:12:53.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.703+0000 7f07f27fc640 1 -- 172.21.15.78:0/1086795158 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f07ec01c460 con 0x7f07f41f6b40 2024-09-17T03:12:53.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.704+0000 7f07f27fc640 1 --2- 172.21.15.78:0/1086795158 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f07e0078bc0 0x7f07e007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:53.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.704+0000 7f07f27fc640 1 -- 172.21.15.78:0/1086795158 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f07ec09b0a0 con 0x7f07f41f6b40 2024-09-17T03:12:53.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.704+0000 7f07f9e71640 1 --2- 172.21.15.78:0/1086795158 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f07e0078bc0 0x7f07e007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:53.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.704+0000 7f07f9e71640 1 --2- 172.21.15.78:0/1086795158 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f07e0078bc0 0x7f07e007b0d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f07e4003ac0 tx=0x7f07e4003a50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:53.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.708+0000 7f07f27fc640 1 -- 172.21.15.78:0/1086795158 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f07f41f6f50 con 0x7f07f41f6b40 2024-09-17T03:12:53.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.919+0000 7f07fc0d5640 1 -- 172.21.15.78:0/1086795158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07f415cbc0 con 0x7f07f41f6b40 2024-09-17T03:12:53.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.920+0000 7f07f27fc640 1 -- 172.21.15.78:0/1086795158 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5231 (secure 0 0 0) 0x7f07ec0634e0 con 0x7f07f41f6b40 2024-09-17T03:12:53.920 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:12:53.920 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":61,"btime":"2024-09-17T03:12:53:561218+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5873,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/3831026382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3831026382},{"type":"v1","addr":"172.21.15.193:6836","nonce":3831026382}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/1431701139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1431701139},{"type":"v1","addr":"172.21.15.193:6837","nonce":1431701139}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6861,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/2905189397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2905189397},{"type":"v1","addr":"172.21.15.78:6834","nonce":2905189397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:12:50.905684+0000","modified":"2024-09-17T03:12:52.910658+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6864":{"gid":6864,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/2058899730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2058899730},{"type":"v1","addr":"172.21.15.78:6835","nonce":2058899730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6864,"qdb_cluster":[6864]},"id":5}]} 2024-09-17T03:12:53.920 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 61 2024-09-17T03:12:53.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.922+0000 7f07fc0d5640 1 -- 172.21.15.78:0/1086795158 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f07e0078bc0 msgr2=0x7f07e007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:53.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.922+0000 7f07fc0d5640 1 --2- 172.21.15.78:0/1086795158 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f07e0078bc0 0x7f07e007b0d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f07e4003ac0 tx=0x7f07e4003a50 comp rx=0 tx=0).stop 2024-09-17T03:12:53.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.922+0000 7f07fc0d5640 1 -- 172.21.15.78:0/1086795158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f41f6b40 msgr2=0x7f07f414bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:53.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.922+0000 7f07fc0d5640 1 --2- 172.21.15.78:0/1086795158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f41f6b40 0x7f07f414bb00 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f07f40ce1a0 tx=0x7f07ec00e980 comp rx=0 tx=0).stop 2024-09-17T03:12:53.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.922+0000 7f07fc0d5640 1 -- 172.21.15.78:0/1086795158 shutdown_connections 2024-09-17T03:12:53.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.922+0000 7f07fc0d5640 1 --2- 172.21.15.78:0/1086795158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07f41f6b40 0x7f07f414bb00 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:53.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.922+0000 7f07fc0d5640 1 --2- 172.21.15.78:0/1086795158 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f07f4151dd0 0x7f07f41f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:53.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.922+0000 7f07fc0d5640 1 --2- 172.21.15.78:0/1086795158 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f07e0078bc0 0x7f07e007b0d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:53.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.922+0000 7f07fc0d5640 1 --2- 172.21.15.78:0/1086795158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f07dc004800 0x7f07f40aa750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:53.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.922+0000 7f07fc0d5640 1 -- 172.21.15.78:0/1086795158 >> 172.21.15.78:0/1086795158 conn(0x7f07f4072ae0 msgr2=0x7f07f40cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:53.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.922+0000 7f07fc0d5640 1 -- 172.21.15.78:0/1086795158 shutdown_connections 2024-09-17T03:12:53.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:53.922+0000 7f07fc0d5640 1 -- 172.21.15.78:0/1086795158 wait complete. 2024-09-17T03:12:53.933 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:12:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.045+0000 7ff0ed09b640 1 -- 172.21.15.78:0/4051746158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0d0003a30 msgr2=0x7ff0d0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.045+0000 7ff0ed09b640 1 --2- 172.21.15.78:0/4051746158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0d0003a30 0x7ff0d0003ea0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8009b20 tx=0x7ff0d0005830 comp rx=0 tx=0).stop 2024-09-17T03:12:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.045+0000 7ff0e759e640 1 -- 172.21.15.78:0/4051746158 reap_dead start 2024-09-17T03:12:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.045+0000 7ff0ed09b640 1 -- 172.21.15.78:0/4051746158 shutdown_connections 2024-09-17T03:12:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.045+0000 7ff0ed09b640 1 -- 172.21.15.78:0/4051746158 >> 172.21.15.78:0/4051746158 conn(0x7ff0e80b1cb0 msgr2=0x7ff0e80b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.045+0000 7ff0ed09b640 1 -- 172.21.15.78:0/4051746158 shutdown_connections 2024-09-17T03:12:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.045+0000 7ff0ed09b640 1 -- 172.21.15.78:0/4051746158 wait complete. 2024-09-17T03:12:54.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.047+0000 7ff0ed09b640 1 Processor -- start 2024-09-17T03:12:54.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.047+0000 7ff0ed09b640 1 -- start start 2024-09-17T03:12:54.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0ed09b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff0d0003a30 0x7ff0e81f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0ed09b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff0e81f70d0 0x7ff0e80c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0ed09b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0e80c78a0 0x7ff0e8158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0ed09b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e8073cc0 con 0x7ff0e80c78a0 2024-09-17T03:12:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0ed09b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e80cbe00 con 0x7ff0e81f70d0 2024-09-17T03:12:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0ed09b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff0e8073e40 con 0x7ff0d0003a30 2024-09-17T03:12:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0e759e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0e80c78a0 0x7ff0e8158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0e759e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0e80c78a0 0x7ff0e8158210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35034/0 (socket says 172.21.15.78:35034) 2024-09-17T03:12:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0e759e640 1 -- 172.21.15.78:0/4082929144 learned_addr learned my addr 172.21.15.78:0/4082929144 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0e659c640 1 --2- 172.21.15.78:0/4082929144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff0e81f70d0 0x7ff0e80c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0e6d9d640 1 --2- 172.21.15.78:0/4082929144 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff0d0003a30 0x7ff0e81f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0e759e640 1 -- 172.21.15.78:0/4082929144 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff0d0003a30 msgr2=0x7ff0e81f3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0e759e640 1 --2- 172.21.15.78:0/4082929144 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff0d0003a30 0x7ff0e81f3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0e759e640 1 -- 172.21.15.78:0/4082929144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff0e81f70d0 msgr2=0x7ff0e80c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:54.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0e759e640 1 --2- 172.21.15.78:0/4082929144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff0e81f70d0 0x7ff0e80c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0e759e640 1 -- 172.21.15.78:0/4082929144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e815e400 con 0x7ff0e80c78a0 2024-09-17T03:12:54.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0e759e640 1 --2- 172.21.15.78:0/4082929144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0e80c78a0 0x7ff0e8158210 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80d11c0 tx=0x7ff0e0001950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:54.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0cf7fe640 1 -- 172.21.15.78:0/4082929144 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0011870 con 0x7ff0e80c78a0 2024-09-17T03:12:54.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0cf7fe640 1 -- 172.21.15.78:0/4082929144 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0e0017070 con 0x7ff0e80c78a0 2024-09-17T03:12:54.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0cf7fe640 1 -- 172.21.15.78:0/4082929144 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e0011da0 con 0x7ff0e80c78a0 2024-09-17T03:12:54.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.049+0000 7ff0ed09b640 1 -- 172.21.15.78:0/4082929144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e815e8a0 con 0x7ff0e80c78a0 2024-09-17T03:12:54.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.050+0000 7ff0ed09b640 1 -- 172.21.15.78:0/4082929144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e81f33e0 con 0x7ff0e80c78a0 2024-09-17T03:12:54.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.051+0000 7ff0ed09b640 1 -- 172.21.15.78:0/4082929144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e806efc0 con 0x7ff0e80c78a0 2024-09-17T03:12:54.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.051+0000 7ff0cf7fe640 1 -- 172.21.15.78:0/4082929144 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff0e001c460 con 0x7ff0e80c78a0 2024-09-17T03:12:54.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.052+0000 7ff0cf7fe640 1 --2- 172.21.15.78:0/4082929144 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff0d4078b90 0x7ff0d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:54.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.052+0000 7ff0cf7fe640 1 -- 172.21.15.78:0/4082929144 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7ff0e009b3d0 con 0x7ff0e80c78a0 2024-09-17T03:12:54.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.052+0000 7ff0e6d9d640 1 --2- 172.21.15.78:0/4082929144 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff0d4078b90 0x7ff0d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:54.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.053+0000 7ff0e6d9d640 1 --2- 172.21.15.78:0/4082929144 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff0d4078b90 0x7ff0d407b0a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8035000 tx=0x7ff0d802d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:54.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.056+0000 7ff0cf7fe640 1 -- 172.21.15.78:0/4082929144 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff0e00631c0 con 0x7ff0e80c78a0 2024-09-17T03:12:54.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.232+0000 7ff0ed09b640 1 -- 172.21.15.78:0/4082929144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0e815e630 con 0x7ff0e80c78a0 2024-09-17T03:12:54.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.233+0000 7ff0cf7fe640 1 -- 172.21.15.78:0/4082929144 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+16704 (secure 0 0 0) 0x7ff0e0067bf0 con 0x7ff0e80c78a0 2024-09-17T03:12:54.233 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:12:54.234 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":69,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:12:52.555644+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:12:48.548227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T03:12:49.863501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:12:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.236+0000 7ff0ed09b640 1 -- 172.21.15.78:0/4082929144 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff0d4078b90 msgr2=0x7ff0d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.236+0000 7ff0ed09b640 1 --2- 172.21.15.78:0/4082929144 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff0d4078b90 0x7ff0d407b0a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8035000 tx=0x7ff0d802d040 comp rx=0 tx=0).stop 2024-09-17T03:12:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.236+0000 7ff0ed09b640 1 -- 172.21.15.78:0/4082929144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0e80c78a0 msgr2=0x7ff0e8158210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.236+0000 7ff0ed09b640 1 --2- 172.21.15.78:0/4082929144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0e80c78a0 0x7ff0e8158210 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80d11c0 tx=0x7ff0e0001950 comp rx=0 tx=0).stop 2024-09-17T03:12:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.236+0000 7ff0ed09b640 1 -- 172.21.15.78:0/4082929144 shutdown_connections 2024-09-17T03:12:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.236+0000 7ff0ed09b640 1 --2- 172.21.15.78:0/4082929144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0e80c78a0 0x7ff0e8158210 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.236+0000 7ff0ed09b640 1 --2- 172.21.15.78:0/4082929144 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff0d4078b90 0x7ff0d407b0a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.236+0000 7ff0ed09b640 1 --2- 172.21.15.78:0/4082929144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff0e81f70d0 0x7ff0e80c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.236+0000 7ff0ed09b640 1 --2- 172.21.15.78:0/4082929144 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff0d0003a30 0x7ff0e81f3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.236+0000 7ff0ed09b640 1 -- 172.21.15.78:0/4082929144 >> 172.21.15.78:0/4082929144 conn(0x7ff0e80b1cb0 msgr2=0x7ff0e80af080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:54.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.236+0000 7ff0ed09b640 1 -- 172.21.15.78:0/4082929144 shutdown_connections 2024-09-17T03:12:54.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.236+0000 7ff0ed09b640 1 -- 172.21.15.78:0/4082929144 wait complete. 2024-09-17T03:12:54.247 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:12:54.247 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:12:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.359+0000 7fccc5027640 1 -- 172.21.15.78:0/1478766422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccc0070440 msgr2=0x7fccc0074b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.359+0000 7fccc5027640 1 --2- 172.21.15.78:0/1478766422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccc0070440 0x7fccc0074b80 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fccc00710f0 tx=0x7fccb802a530 comp rx=0 tx=0).stop 2024-09-17T03:12:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.359+0000 7fccc5027640 1 -- 172.21.15.78:0/1478766422 shutdown_connections 2024-09-17T03:12:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.359+0000 7fccc5027640 1 --2- 172.21.15.78:0/1478766422 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccc0070440 0x7fccc0074b80 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.359+0000 7fccc5027640 1 --2- 172.21.15.78:0/1478766422 >> v2:172.21.15.193:3300/0 conn(0x7fccc0070030 0x7fccc0074640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.359+0000 7fccc5027640 1 -- 172.21.15.78:0/1478766422 >> 172.21.15.78:0/1478766422 conn(0x7fccc00b1cb0 msgr2=0x7fccc00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.359+0000 7fccc5027640 1 -- 172.21.15.78:0/1478766422 shutdown_connections 2024-09-17T03:12:54.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.359+0000 7fccc5027640 1 -- 172.21.15.78:0/1478766422 wait complete. 2024-09-17T03:12:54.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.361+0000 7fccc5027640 1 Processor -- start 2024-09-17T03:12:54.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.361+0000 7fccc5027640 1 -- start start 2024-09-17T03:12:54.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.362+0000 7fccc5027640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fccc0070030 0x7fccc01e7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:54.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.362+0000 7fccc5027640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fccc0070440 0x7fccc014c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:54.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.362+0000 7fccc5027640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccc0073170 0x7fccc01e5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:54.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.362+0000 7fccc5027640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fccc00b39f0 con 0x7fccc0073170 2024-09-17T03:12:54.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.362+0000 7fccc5027640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fccc00b3870 con 0x7fccc0070030 2024-09-17T03:12:54.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.362+0000 7fccc5027640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fccc00b3b70 con 0x7fccc0070440 2024-09-17T03:12:54.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.362+0000 7fccbf59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccc0073170 0x7fccc01e5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:54.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.362+0000 7fccbf59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccc0073170 0x7fccc01e5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35060/0 (socket says 172.21.15.78:35060) 2024-09-17T03:12:54.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.362+0000 7fccbf59e640 1 -- 172.21.15.78:0/2923334163 learned_addr learned my addr 172.21.15.78:0/2923334163 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:54.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.363+0000 7fccbf59e640 1 -- 172.21.15.78:0/2923334163 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fccc0070440 msgr2=0x7fccc014c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:54.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.363+0000 7fccbf59e640 1 --2- 172.21.15.78:0/2923334163 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fccc0070440 0x7fccc014c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.363+0000 7fccbf59e640 1 -- 172.21.15.78:0/2923334163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fccc0070030 msgr2=0x7fccc01e7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:54.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.363+0000 7fccbed9d640 1 --2- 172.21.15.78:0/2923334163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fccc0070030 0x7fccc01e7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:54.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.363+0000 7fccbf59e640 1 --2- 172.21.15.78:0/2923334163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fccc0070030 0x7fccc01e7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.363+0000 7fccbf59e640 1 -- 172.21.15.78:0/2923334163 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc009aa30 con 0x7fccc0073170 2024-09-17T03:12:54.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.363+0000 7fccbf59e640 1 --2- 172.21.15.78:0/2923334163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccc0073170 0x7fccc01e5f80 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fccb802ab20 tx=0x7fccb8033cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:54.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.363+0000 7fcca77fe640 1 -- 172.21.15.78:0/2923334163 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb8031d60 con 0x7fccc0073170 2024-09-17T03:12:54.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.363+0000 7fcca77fe640 1 -- 172.21.15.78:0/2923334163 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccb8005020 con 0x7fccc0073170 2024-09-17T03:12:54.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.363+0000 7fccc5027640 1 -- 172.21.15.78:0/2923334163 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc01e57c0 con 0x7fccc0073170 2024-09-17T03:12:54.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.363+0000 7fcca77fe640 1 -- 172.21.15.78:0/2923334163 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb8005470 con 0x7fccc0073170 2024-09-17T03:12:54.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.363+0000 7fccc5027640 1 -- 172.21.15.78:0/2923334163 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc01e54e0 con 0x7fccc0073170 2024-09-17T03:12:54.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.364+0000 7fccc5027640 1 -- 172.21.15.78:0/2923334163 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc01e5230 con 0x7fccc0073170 2024-09-17T03:12:54.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.365+0000 7fcca77fe640 1 -- 172.21.15.78:0/2923334163 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fccb80047a0 con 0x7fccc0073170 2024-09-17T03:12:54.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.365+0000 7fcca77fe640 1 --2- 172.21.15.78:0/2923334163 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fccac078bc0 0x7fccac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:54.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.365+0000 7fcca77fe640 1 -- 172.21.15.78:0/2923334163 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fccb80bbfb0 con 0x7fccc0073170 2024-09-17T03:12:54.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.366+0000 7fccbed9d640 1 --2- 172.21.15.78:0/2923334163 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fccac078bc0 0x7fccac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:54.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.366+0000 7fccbed9d640 1 --2- 172.21.15.78:0/2923334163 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fccac078bc0 0x7fccac07b0d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fccb00012e0 tx=0x7fccb0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:54.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.370+0000 7fcca77fe640 1 -- 172.21.15.78:0/2923334163 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fccb803f030 con 0x7fccc0073170 2024-09-17T03:12:54.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.544+0000 7fccc5027640 1 -- 172.21.15.78:0/2923334163 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fccc00b4090 con 0x7fccac078bc0 2024-09-17T03:12:54.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.549+0000 7fcca77fe640 1 -- 172.21.15.78:0/2923334163 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247355 (secure 0 0 0) 0x7fccc00b4090 con 0x7fccac078bc0 2024-09-17T03:12:54.552 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:12:54.553 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:12:54.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.552+0000 7fccc5027640 1 -- 172.21.15.78:0/2923334163 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fccac078bc0 msgr2=0x7fccac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:54.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.552+0000 7fccc5027640 1 --2- 172.21.15.78:0/2923334163 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fccac078bc0 0x7fccac07b0d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fccb00012e0 tx=0x7fccb0009040 comp rx=0 tx=0).stop 2024-09-17T03:12:54.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.552+0000 7fccc5027640 1 -- 172.21.15.78:0/2923334163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccc0073170 msgr2=0x7fccc01e5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:54.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.552+0000 7fccc5027640 1 --2- 172.21.15.78:0/2923334163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccc0073170 0x7fccc01e5f80 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fccb802ab20 tx=0x7fccb8033cc0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.552+0000 7fccc5027640 1 -- 172.21.15.78:0/2923334163 shutdown_connections 2024-09-17T03:12:54.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.552+0000 7fccc5027640 1 --2- 172.21.15.78:0/2923334163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccc0073170 0x7fccc01e5f80 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.552+0000 7fccc5027640 1 --2- 172.21.15.78:0/2923334163 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fccc0070440 0x7fccc014c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.552+0000 7fccc5027640 1 --2- 172.21.15.78:0/2923334163 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fccac078bc0 0x7fccac07b0d0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.552+0000 7fccc5027640 1 --2- 172.21.15.78:0/2923334163 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fccc0070030 0x7fccc01e7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.552+0000 7fccc5027640 1 -- 172.21.15.78:0/2923334163 >> 172.21.15.78:0/2923334163 conn(0x7fccc00b1cb0 msgr2=0x7fccc00c9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:54.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.552+0000 7fccc5027640 1 -- 172.21.15.78:0/2923334163 shutdown_connections 2024-09-17T03:12:54.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.552+0000 7fccc5027640 1 -- 172.21.15.78:0/2923334163 wait complete. 2024-09-17T03:12:54.563 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-09-17T03:12:53.190614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":105,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236180,"kb_used_data":7448,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738540,"statfs":{"total":773094113280,"available":772852264960,"internally_reserved":0,"allocated":7626752,"data_stored":3864526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000951"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.549259+0000","last_change":"2024-09-17T03:12:50.549259+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.549259+0000","last_undegraded":"2024-09-17T03:12:50.549259+0000","last_fullsized":"2024-09-17T03:12:50.549259+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542089+0000","last_change":"2024-09-17T03:12:50.542089+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542089+0000","last_undegraded":"2024-09-17T03:12:50.542089+0000","last_fullsized":"2024-09-17T03:12:50.542089+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.571113+0000","last_change":"2024-09-17T03:12:51.568425+0000","last_active":"2024-09-17T03:12:51.571113+0000","last_peered":"2024-09-17T03:12:51.571113+0000","last_clean":"2024-09-17T03:12:51.571113+0000","last_became_active":"2024-09-17T03:12:51.568119+0000","last_became_peered":"2024-09-17T03:12:51.568119+0000","last_unstale":"2024-09-17T03:12:51.571113+0000","last_undegraded":"2024-09-17T03:12:51.571113+0000","last_fullsized":"2024-09-17T03:12:51.571113+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:20.849138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547005+0000","last_change":"2024-09-17T03:12:50.547005+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547005+0000","last_undegraded":"2024-09-17T03:12:50.547005+0000","last_fullsized":"2024-09-17T03:12:50.547005+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544321+0000","last_change":"2024-09-17T03:12:50.544321+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544321+0000","last_undegraded":"2024-09-17T03:12:50.544321+0000","last_fullsized":"2024-09-17T03:12:50.544321+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543291+0000","last_change":"2024-09-17T03:12:50.543291+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543291+0000","last_undegraded":"2024-09-17T03:12:50.543291+0000","last_fullsized":"2024-09-17T03:12:50.543291+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548217+0000","last_change":"2024-09-17T03:12:50.548217+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548217+0000","last_undegraded":"2024-09-17T03:12:50.548217+0000","last_fullsized":"2024-09-17T03:12:50.548217+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543369+0000","last_change":"2024-09-17T03:12:50.543369+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543369+0000","last_undegraded":"2024-09-17T03:12:50.543369+0000","last_fullsized":"2024-09-17T03:12:50.543369+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543505+0000","last_change":"2024-09-17T03:12:50.543505+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543505+0000","last_undegraded":"2024-09-17T03:12:50.543505+0000","last_fullsized":"2024-09-17T03:12:50.543505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.546281+0000","last_change":"2024-09-17T03:12:50.546281+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.546281+0000","last_undegraded":"2024-09-17T03:12:50.546281+0000","last_fullsized":"2024-09-17T03:12:50.546281+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548533+0000","last_change":"2024-09-17T03:12:50.548533+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548533+0000","last_undegraded":"2024-09-17T03:12:50.548533+0000","last_fullsized":"2024-09-17T03:12:50.548533+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541339+0000","last_change":"2024-09-17T03:12:50.541339+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541339+0000","last_undegraded":"2024-09-17T03:12:50.541339+0000","last_fullsized":"2024-09-17T03:12:50.541339+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543421+0000","last_change":"2024-09-17T03:12:50.543421+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543421+0000","last_undegraded":"2024-09-17T03:12:50.543421+0000","last_fullsized":"2024-09-17T03:12:50.543421+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541795+0000","last_change":"2024-09-17T03:12:50.541795+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541795+0000","last_undegraded":"2024-09-17T03:12:50.541795+0000","last_fullsized":"2024-09-17T03:12:50.541795+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544520+0000","last_change":"2024-09-17T03:12:50.544520+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544520+0000","last_undegraded":"2024-09-17T03:12:50.544520+0000","last_fullsized":"2024-09-17T03:12:50.544520+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544499+0000","last_change":"2024-09-17T03:12:50.544499+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544499+0000","last_undegraded":"2024-09-17T03:12:50.544499+0000","last_fullsized":"2024-09-17T03:12:50.544499+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543073+0000","last_change":"2024-09-17T03:12:50.543073+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543073+0000","last_undegraded":"2024-09-17T03:12:50.543073+0000","last_fullsized":"2024-09-17T03:12:50.543073+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.540843+0000","last_change":"2024-09-17T03:12:50.540843+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.540843+0000","last_undegraded":"2024-09-17T03:12:50.540843+0000","last_fullsized":"2024-09-17T03:12:50.540843+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542778+0000","last_change":"2024-09-17T03:12:50.542778+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542778+0000","last_undegraded":"2024-09-17T03:12:50.542778+0000","last_fullsized":"2024-09-17T03:12:50.542778+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543726+0000","last_change":"2024-09-17T03:12:50.543726+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543726+0000","last_undegraded":"2024-09-17T03:12:50.543726+0000","last_fullsized":"2024-09-17T03:12:50.543726+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.545843+0000","last_change":"2024-09-17T03:12:50.545843+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.545843+0000","last_undegraded":"2024-09-17T03:12:50.545843+0000","last_fullsized":"2024-09-17T03:12:50.545843+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.545390+0000","last_change":"2024-09-17T03:12:50.545390+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.545390+0000","last_undegraded":"2024-09-17T03:12:50.545390+0000","last_fullsized":"2024-09-17T03:12:50.545390+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.545880+0000","last_change":"2024-09-17T03:12:50.545880+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.545880+0000","last_undegraded":"2024-09-17T03:12:50.545880+0000","last_fullsized":"2024-09-17T03:12:50.545880+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.550258+0000","last_change":"2024-09-17T03:12:50.550258+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.550258+0000","last_undegraded":"2024-09-17T03:12:50.550258+0000","last_fullsized":"2024-09-17T03:12:50.550258+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543553+0000","last_change":"2024-09-17T03:12:50.543553+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543553+0000","last_undegraded":"2024-09-17T03:12:50.543553+0000","last_fullsized":"2024-09-17T03:12:50.543553+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.554449+0000","last_change":"2024-09-17T03:12:50.554449+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.554449+0000","last_undegraded":"2024-09-17T03:12:50.554449+0000","last_fullsized":"2024-09-17T03:12:50.554449+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.576563+0000","last_change":"2024-09-17T03:12:51.574817+0000","last_active":"2024-09-17T03:12:51.576563+0000","last_peered":"2024-09-17T03:12:51.576563+0000","last_clean":"2024-09-17T03:12:51.576563+0000","last_became_active":"2024-09-17T03:12:51.572559+0000","last_became_peered":"2024-09-17T03:12:51.572559+0000","last_unstale":"2024-09-17T03:12:51.576563+0000","last_undegraded":"2024-09-17T03:12:51.576563+0000","last_fullsized":"2024-09-17T03:12:51.576563+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:44.874908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544444+0000","last_change":"2024-09-17T03:12:50.544444+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544444+0000","last_undegraded":"2024-09-17T03:12:50.544444+0000","last_fullsized":"2024-09-17T03:12:50.544444+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.572237+0000","last_change":"2024-09-17T03:12:51.564402+0000","last_active":"2024-09-17T03:12:51.572237+0000","last_peered":"2024-09-17T03:12:51.572237+0000","last_clean":"2024-09-17T03:12:51.572237+0000","last_became_active":"2024-09-17T03:12:51.564089+0000","last_became_peered":"2024-09-17T03:12:51.564089+0000","last_unstale":"2024-09-17T03:12:51.572237+0000","last_undegraded":"2024-09-17T03:12:51.572237+0000","last_fullsized":"2024-09-17T03:12:51.572237+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:28.591233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547193+0000","last_change":"2024-09-17T03:12:50.547193+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547193+0000","last_undegraded":"2024-09-17T03:12:50.547193+0000","last_fullsized":"2024-09-17T03:12:50.547193+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547290+0000","last_change":"2024-09-17T03:12:50.547290+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547290+0000","last_undegraded":"2024-09-17T03:12:50.547290+0000","last_fullsized":"2024-09-17T03:12:50.547290+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541696+0000","last_change":"2024-09-17T03:12:50.541696+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541696+0000","last_undegraded":"2024-09-17T03:12:50.541696+0000","last_fullsized":"2024-09-17T03:12:50.541696+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548884+0000","last_change":"2024-09-17T03:12:50.548884+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548884+0000","last_undegraded":"2024-09-17T03:12:50.548884+0000","last_fullsized":"2024-09-17T03:12:50.548884+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.559713+0000","last_change":"2024-09-17T03:12:50.558227+0000","last_active":"2024-09-17T03:12:50.559713+0000","last_peered":"2024-09-17T03:12:50.559713+0000","last_clean":"2024-09-17T03:12:50.559713+0000","last_became_active":"2024-09-17T03:12:50.557908+0000","last_became_peered":"2024-09-17T03:12:50.557908+0000","last_unstale":"2024-09-17T03:12:50.559713+0000","last_undegraded":"2024-09-17T03:12:50.559713+0000","last_fullsized":"2024-09-17T03:12:50.559713+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:22.132155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542611+0000","last_change":"2024-09-17T03:12:50.542611+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542611+0000","last_undegraded":"2024-09-17T03:12:50.542611+0000","last_fullsized":"2024-09-17T03:12:50.542611+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.559626+0000","last_change":"2024-09-17T03:12:50.555455+0000","last_active":"2024-09-17T03:12:50.559626+0000","last_peered":"2024-09-17T03:12:50.559626+0000","last_clean":"2024-09-17T03:12:50.559626+0000","last_became_active":"2024-09-17T03:12:50.555094+0000","last_became_peered":"2024-09-17T03:12:50.555094+0000","last_unstale":"2024-09-17T03:12:50.559626+0000","last_undegraded":"2024-09-17T03:12:50.559626+0000","last_fullsized":"2024-09-17T03:12:50.559626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:05.621816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543226+0000","last_change":"2024-09-17T03:12:50.543226+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543226+0000","last_undegraded":"2024-09-17T03:12:50.543226+0000","last_fullsized":"2024-09-17T03:12:50.543226+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.561045+0000","last_change":"2024-09-17T03:12:50.556466+0000","last_active":"2024-09-17T03:12:50.561045+0000","last_peered":"2024-09-17T03:12:50.561045+0000","last_clean":"2024-09-17T03:12:50.561045+0000","last_became_active":"2024-09-17T03:12:50.556101+0000","last_became_peered":"2024-09-17T03:12:50.556101+0000","last_unstale":"2024-09-17T03:12:50.561045+0000","last_undegraded":"2024-09-17T03:12:50.561045+0000","last_fullsized":"2024-09-17T03:12:50.561045+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:34.693575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548062+0000","last_change":"2024-09-17T03:12:50.548062+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548062+0000","last_undegraded":"2024-09-17T03:12:50.548062+0000","last_fullsized":"2024-09-17T03:12:50.548062+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563574+0000","last_change":"2024-09-17T03:12:50.555688+0000","last_active":"2024-09-17T03:12:50.563574+0000","last_peered":"2024-09-17T03:12:50.563574+0000","last_clean":"2024-09-17T03:12:50.563574+0000","last_became_active":"2024-09-17T03:12:50.555240+0000","last_became_peered":"2024-09-17T03:12:50.555240+0000","last_unstale":"2024-09-17T03:12:50.563574+0000","last_undegraded":"2024-09-17T03:12:50.563574+0000","last_fullsized":"2024-09-17T03:12:50.563574+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:39.506557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.546628+0000","last_change":"2024-09-17T03:12:50.546628+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.546628+0000","last_undegraded":"2024-09-17T03:12:50.546628+0000","last_fullsized":"2024-09-17T03:12:50.546628+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.582382+0000","last_change":"2024-09-17T03:12:50.559708+0000","last_active":"2024-09-17T03:12:51.582382+0000","last_peered":"2024-09-17T03:12:51.582382+0000","last_clean":"2024-09-17T03:12:51.582382+0000","last_became_active":"2024-09-17T03:12:50.559377+0000","last_became_peered":"2024-09-17T03:12:50.559377+0000","last_unstale":"2024-09-17T03:12:51.582382+0000","last_undegraded":"2024-09-17T03:12:51.582382+0000","last_fullsized":"2024-09-17T03:12:51.582382+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:32.000927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544788+0000","last_change":"2024-09-17T03:12:50.544788+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544788+0000","last_undegraded":"2024-09-17T03:12:50.544788+0000","last_fullsized":"2024-09-17T03:12:50.544788+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.555568+0000","last_change":"2024-09-17T03:12:50.552181+0000","last_active":"2024-09-17T03:12:50.555568+0000","last_peered":"2024-09-17T03:12:50.555568+0000","last_clean":"2024-09-17T03:12:50.555568+0000","last_became_active":"2024-09-17T03:12:50.551138+0000","last_became_peered":"2024-09-17T03:12:50.551138+0000","last_unstale":"2024-09-17T03:12:50.555568+0000","last_undegraded":"2024-09-17T03:12:50.555568+0000","last_fullsized":"2024-09-17T03:12:50.555568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:34.904808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541261+0000","last_change":"2024-09-17T03:12:50.541261+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541261+0000","last_undegraded":"2024-09-17T03:12:50.541261+0000","last_fullsized":"2024-09-17T03:12:50.541261+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.564746+0000","last_change":"2024-09-17T03:12:50.558633+0000","last_active":"2024-09-17T03:12:50.564746+0000","last_peered":"2024-09-17T03:12:50.564746+0000","last_clean":"2024-09-17T03:12:50.564746+0000","last_became_active":"2024-09-17T03:12:50.558373+0000","last_became_peered":"2024-09-17T03:12:50.558373+0000","last_unstale":"2024-09-17T03:12:50.564746+0000","last_undegraded":"2024-09-17T03:12:50.564746+0000","last_fullsized":"2024-09-17T03:12:50.564746+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:06.856502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542435+0000","last_change":"2024-09-17T03:12:50.542435+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542435+0000","last_undegraded":"2024-09-17T03:12:50.542435+0000","last_fullsized":"2024-09-17T03:12:50.542435+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.559600+0000","last_change":"2024-09-17T03:12:50.554790+0000","last_active":"2024-09-17T03:12:50.559600+0000","last_peered":"2024-09-17T03:12:50.559600+0000","last_clean":"2024-09-17T03:12:50.559600+0000","last_became_active":"2024-09-17T03:12:50.554441+0000","last_became_peered":"2024-09-17T03:12:50.554441+0000","last_unstale":"2024-09-17T03:12:50.559600+0000","last_undegraded":"2024-09-17T03:12:50.559600+0000","last_fullsized":"2024-09-17T03:12:50.559600+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:29.490405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548759+0000","last_change":"2024-09-17T03:12:50.548759+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548759+0000","last_undegraded":"2024-09-17T03:12:50.548759+0000","last_fullsized":"2024-09-17T03:12:50.548759+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.558393+0000","last_change":"2024-09-17T03:12:50.553084+0000","last_active":"2024-09-17T03:12:50.558393+0000","last_peered":"2024-09-17T03:12:50.558393+0000","last_clean":"2024-09-17T03:12:50.558393+0000","last_became_active":"2024-09-17T03:12:50.552769+0000","last_became_peered":"2024-09-17T03:12:50.552769+0000","last_unstale":"2024-09-17T03:12:50.558393+0000","last_undegraded":"2024-09-17T03:12:50.558393+0000","last_fullsized":"2024-09-17T03:12:50.558393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:47.537133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548699+0000","last_change":"2024-09-17T03:12:50.548699+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548699+0000","last_undegraded":"2024-09-17T03:12:50.548699+0000","last_fullsized":"2024-09-17T03:12:50.548699+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563558+0000","last_change":"2024-09-17T03:12:50.558611+0000","last_active":"2024-09-17T03:12:50.563558+0000","last_peered":"2024-09-17T03:12:50.563558+0000","last_clean":"2024-09-17T03:12:50.563558+0000","last_became_active":"2024-09-17T03:12:50.558320+0000","last_became_peered":"2024-09-17T03:12:50.558320+0000","last_unstale":"2024-09-17T03:12:50.563558+0000","last_undegraded":"2024-09-17T03:12:50.563558+0000","last_fullsized":"2024-09-17T03:12:50.563558+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:06.039361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542447+0000","last_change":"2024-09-17T03:12:50.542447+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542447+0000","last_undegraded":"2024-09-17T03:12:50.542447+0000","last_fullsized":"2024-09-17T03:12:50.542447+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.580643+0000","last_change":"2024-09-17T03:12:50.560334+0000","last_active":"2024-09-17T03:12:51.580643+0000","last_peered":"2024-09-17T03:12:51.580643+0000","last_clean":"2024-09-17T03:12:51.580643+0000","last_became_active":"2024-09-17T03:12:50.560015+0000","last_became_peered":"2024-09-17T03:12:50.560015+0000","last_unstale":"2024-09-17T03:12:51.580643+0000","last_undegraded":"2024-09-17T03:12:51.580643+0000","last_fullsized":"2024-09-17T03:12:51.580643+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:33.899941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542401+0000","last_change":"2024-09-17T03:12:50.542401+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542401+0000","last_undegraded":"2024-09-17T03:12:50.542401+0000","last_fullsized":"2024-09-17T03:12:50.542401+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.557166+0000","last_change":"2024-09-17T03:12:50.551177+0000","last_active":"2024-09-17T03:12:50.557166+0000","last_peered":"2024-09-17T03:12:50.557166+0000","last_clean":"2024-09-17T03:12:50.557166+0000","last_became_active":"2024-09-17T03:12:50.550823+0000","last_became_peered":"2024-09-17T03:12:50.550823+0000","last_unstale":"2024-09-17T03:12:50.557166+0000","last_undegraded":"2024-09-17T03:12:50.557166+0000","last_fullsized":"2024-09-17T03:12:50.557166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:37.066429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.546344+0000","last_change":"2024-09-17T03:12:50.546344+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.546344+0000","last_undegraded":"2024-09-17T03:12:50.546344+0000","last_fullsized":"2024-09-17T03:12:50.546344+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.560350+0000","last_change":"2024-09-17T03:12:50.553725+0000","last_active":"2024-09-17T03:12:50.560350+0000","last_peered":"2024-09-17T03:12:50.560350+0000","last_clean":"2024-09-17T03:12:50.560350+0000","last_became_active":"2024-09-17T03:12:50.553296+0000","last_became_peered":"2024-09-17T03:12:50.553296+0000","last_unstale":"2024-09-17T03:12:50.560350+0000","last_undegraded":"2024-09-17T03:12:50.560350+0000","last_fullsized":"2024-09-17T03:12:50.560350+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:29.780411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547759+0000","last_change":"2024-09-17T03:12:50.547759+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547759+0000","last_undegraded":"2024-09-17T03:12:50.547759+0000","last_fullsized":"2024-09-17T03:12:50.547759+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.555592+0000","last_change":"2024-09-17T03:12:50.552439+0000","last_active":"2024-09-17T03:12:50.555592+0000","last_peered":"2024-09-17T03:12:50.555592+0000","last_clean":"2024-09-17T03:12:50.555592+0000","last_became_active":"2024-09-17T03:12:50.552147+0000","last_became_peered":"2024-09-17T03:12:50.552147+0000","last_unstale":"2024-09-17T03:12:50.555592+0000","last_undegraded":"2024-09-17T03:12:50.555592+0000","last_fullsized":"2024-09-17T03:12:50.555592+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:26.420432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542458+0000","last_change":"2024-09-17T03:12:50.542458+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542458+0000","last_undegraded":"2024-09-17T03:12:50.542458+0000","last_fullsized":"2024-09-17T03:12:50.542458+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563679+0000","last_change":"2024-09-17T03:12:50.558884+0000","last_active":"2024-09-17T03:12:50.563679+0000","last_peered":"2024-09-17T03:12:50.563679+0000","last_clean":"2024-09-17T03:12:50.563679+0000","last_became_active":"2024-09-17T03:12:50.558550+0000","last_became_peered":"2024-09-17T03:12:50.558550+0000","last_unstale":"2024-09-17T03:12:50.563679+0000","last_undegraded":"2024-09-17T03:12:50.563679+0000","last_fullsized":"2024-09-17T03:12:50.563679+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:18:36.626293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541278+0000","last_change":"2024-09-17T03:12:50.541278+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541278+0000","last_undegraded":"2024-09-17T03:12:50.541278+0000","last_fullsized":"2024-09-17T03:12:50.541278+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.561131+0000","last_change":"2024-09-17T03:12:50.556886+0000","last_active":"2024-09-17T03:12:50.561131+0000","last_peered":"2024-09-17T03:12:50.561131+0000","last_clean":"2024-09-17T03:12:50.561131+0000","last_became_active":"2024-09-17T03:12:50.556092+0000","last_became_peered":"2024-09-17T03:12:50.556092+0000","last_unstale":"2024-09-17T03:12:50.561131+0000","last_undegraded":"2024-09-17T03:12:50.561131+0000","last_fullsized":"2024-09-17T03:12:50.561131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:19.970449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.545286+0000","last_change":"2024-09-17T03:12:50.545286+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.545286+0000","last_undegraded":"2024-09-17T03:12:50.545286+0000","last_fullsized":"2024-09-17T03:12:50.545286+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.555534+0000","last_change":"2024-09-17T03:12:50.553551+0000","last_active":"2024-09-17T03:12:50.555534+0000","last_peered":"2024-09-17T03:12:50.555534+0000","last_clean":"2024-09-17T03:12:50.555534+0000","last_became_active":"2024-09-17T03:12:50.553028+0000","last_became_peered":"2024-09-17T03:12:50.553028+0000","last_unstale":"2024-09-17T03:12:50.555534+0000","last_undegraded":"2024-09-17T03:12:50.555534+0000","last_fullsized":"2024-09-17T03:12:50.555534+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:15.682903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547383+0000","last_change":"2024-09-17T03:12:50.547383+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547383+0000","last_undegraded":"2024-09-17T03:12:50.547383+0000","last_fullsized":"2024-09-17T03:12:50.547383+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.561103+0000","last_change":"2024-09-17T03:12:50.556871+0000","last_active":"2024-09-17T03:12:50.561103+0000","last_peered":"2024-09-17T03:12:50.561103+0000","last_clean":"2024-09-17T03:12:50.561103+0000","last_became_active":"2024-09-17T03:12:50.556543+0000","last_became_peered":"2024-09-17T03:12:50.556543+0000","last_unstale":"2024-09-17T03:12:50.561103+0000","last_undegraded":"2024-09-17T03:12:50.561103+0000","last_fullsized":"2024-09-17T03:12:50.561103+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:02.158974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.540760+0000","last_change":"2024-09-17T03:12:50.540760+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.540760+0000","last_undegraded":"2024-09-17T03:12:50.540760+0000","last_fullsized":"2024-09-17T03:12:50.540760+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563779+0000","last_change":"2024-09-17T03:12:50.559567+0000","last_active":"2024-09-17T03:12:50.563779+0000","last_peered":"2024-09-17T03:12:50.563779+0000","last_clean":"2024-09-17T03:12:50.563779+0000","last_became_active":"2024-09-17T03:12:50.559272+0000","last_became_peered":"2024-09-17T03:12:50.559272+0000","last_unstale":"2024-09-17T03:12:50.563779+0000","last_undegraded":"2024-09-17T03:12:50.563779+0000","last_fullsized":"2024-09-17T03:12:50.563779+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:25.932754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541762+0000","last_change":"2024-09-17T03:12:50.541762+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541762+0000","last_undegraded":"2024-09-17T03:12:50.541762+0000","last_fullsized":"2024-09-17T03:12:50.541762+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.562647+0000","last_change":"2024-09-17T03:12:50.561368+0000","last_active":"2024-09-17T03:12:50.562647+0000","last_peered":"2024-09-17T03:12:50.562647+0000","last_clean":"2024-09-17T03:12:50.562647+0000","last_became_active":"2024-09-17T03:12:50.561048+0000","last_became_peered":"2024-09-17T03:12:50.561048+0000","last_unstale":"2024-09-17T03:12:50.562647+0000","last_undegraded":"2024-09-17T03:12:50.562647+0000","last_fullsized":"2024-09-17T03:12:50.562647+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:05.621816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.572267+0000","last_change":"2024-09-17T03:12:51.569311+0000","last_active":"2024-09-17T03:12:51.572267+0000","last_peered":"2024-09-17T03:12:51.572267+0000","last_clean":"2024-09-17T03:12:51.572267+0000","last_became_active":"2024-09-17T03:12:51.568983+0000","last_became_peered":"2024-09-17T03:12:51.568983+0000","last_unstale":"2024-09-17T03:12:51.572267+0000","last_undegraded":"2024-09-17T03:12:51.572267+0000","last_fullsized":"2024-09-17T03:12:51.572267+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:15:30.514819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.555619+0000","last_change":"2024-09-17T03:12:50.553656+0000","last_active":"2024-09-17T03:12:50.555619+0000","last_peered":"2024-09-17T03:12:50.555619+0000","last_clean":"2024-09-17T03:12:50.555619+0000","last_became_active":"2024-09-17T03:12:50.553349+0000","last_became_peered":"2024-09-17T03:12:50.553349+0000","last_unstale":"2024-09-17T03:12:50.555619+0000","last_undegraded":"2024-09-17T03:12:50.555619+0000","last_fullsized":"2024-09-17T03:12:50.555619+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:08.565374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.572396+0000","last_change":"2024-09-17T03:12:51.570982+0000","last_active":"2024-09-17T03:12:51.572396+0000","last_peered":"2024-09-17T03:12:51.572396+0000","last_clean":"2024-09-17T03:12:51.572396+0000","last_became_active":"2024-09-17T03:12:51.570683+0000","last_became_peered":"2024-09-17T03:12:51.570683+0000","last_unstale":"2024-09-17T03:12:51.572396+0000","last_undegraded":"2024-09-17T03:12:51.572396+0000","last_fullsized":"2024-09-17T03:12:51.572396+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:55.497465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.569126+0000","last_change":"2024-09-17T03:12:50.561347+0000","last_active":"2024-09-17T03:12:50.569126+0000","last_peered":"2024-09-17T03:12:50.569126+0000","last_clean":"2024-09-17T03:12:50.569126+0000","last_became_active":"2024-09-17T03:12:50.561045+0000","last_became_peered":"2024-09-17T03:12:50.561045+0000","last_unstale":"2024-09-17T03:12:50.569126+0000","last_undegraded":"2024-09-17T03:12:50.569126+0000","last_fullsized":"2024-09-17T03:12:50.569126+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:30.710367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.571609+0000","last_change":"2024-09-17T03:12:51.570718+0000","last_active":"2024-09-17T03:12:51.571609+0000","last_peered":"2024-09-17T03:12:51.571609+0000","last_clean":"2024-09-17T03:12:51.571609+0000","last_became_active":"2024-09-17T03:12:51.570374+0000","last_became_peered":"2024-09-17T03:12:51.570374+0000","last_unstale":"2024-09-17T03:12:51.571609+0000","last_undegraded":"2024-09-17T03:12:51.571609+0000","last_fullsized":"2024-09-17T03:12:51.571609+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:29.522439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.556966+0000","last_change":"2024-09-17T03:12:50.552653+0000","last_active":"2024-09-17T03:12:50.556966+0000","last_peered":"2024-09-17T03:12:50.556966+0000","last_clean":"2024-09-17T03:12:50.556966+0000","last_became_active":"2024-09-17T03:12:50.552331+0000","last_became_peered":"2024-09-17T03:12:50.552331+0000","last_unstale":"2024-09-17T03:12:50.556966+0000","last_undegraded":"2024-09-17T03:12:50.556966+0000","last_fullsized":"2024-09-17T03:12:50.556966+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:22.132155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544145+0000","last_change":"2024-09-17T03:12:50.544145+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544145+0000","last_undegraded":"2024-09-17T03:12:50.544145+0000","last_fullsized":"2024-09-17T03:12:50.544145+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.555506+0000","last_change":"2024-09-17T03:12:50.552772+0000","last_active":"2024-09-17T03:12:50.555506+0000","last_peered":"2024-09-17T03:12:50.555506+0000","last_clean":"2024-09-17T03:12:50.555506+0000","last_became_active":"2024-09-17T03:12:50.552430+0000","last_became_peered":"2024-09-17T03:12:50.552430+0000","last_unstale":"2024-09-17T03:12:50.555506+0000","last_undegraded":"2024-09-17T03:12:50.555506+0000","last_fullsized":"2024-09-17T03:12:50.555506+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:55.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.549984+0000","last_change":"2024-09-17T03:12:50.549984+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.549984+0000","last_undegraded":"2024-09-17T03:12:50.549984+0000","last_fullsized":"2024-09-17T03:12:50.549984+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563760+0000","last_change":"2024-09-17T03:12:50.559793+0000","last_active":"2024-09-17T03:12:50.563760+0000","last_peered":"2024-09-17T03:12:50.563760+0000","last_clean":"2024-09-17T03:12:50.563760+0000","last_became_active":"2024-09-17T03:12:50.559454+0000","last_became_peered":"2024-09-17T03:12:50.559454+0000","last_unstale":"2024-09-17T03:12:50.563760+0000","last_undegraded":"2024-09-17T03:12:50.563760+0000","last_fullsized":"2024-09-17T03:12:50.563760+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:31.013515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547078+0000","last_change":"2024-09-17T03:12:50.547078+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547078+0000","last_undegraded":"2024-09-17T03:12:50.547078+0000","last_fullsized":"2024-09-17T03:12:50.547078+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.556806+0000","last_change":"2024-09-17T03:12:50.553233+0000","last_active":"2024-09-17T03:12:50.556806+0000","last_peered":"2024-09-17T03:12:50.556806+0000","last_clean":"2024-09-17T03:12:50.556806+0000","last_became_active":"2024-09-17T03:12:50.552920+0000","last_became_peered":"2024-09-17T03:12:50.552920+0000","last_unstale":"2024-09-17T03:12:50.556806+0000","last_undegraded":"2024-09-17T03:12:50.556806+0000","last_fullsized":"2024-09-17T03:12:50.556806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:07.400568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547310+0000","last_change":"2024-09-17T03:12:50.547310+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547310+0000","last_undegraded":"2024-09-17T03:12:50.547310+0000","last_fullsized":"2024-09-17T03:12:50.547310+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.564860+0000","last_change":"2024-09-17T03:12:50.559436+0000","last_active":"2024-09-17T03:12:50.564860+0000","last_peered":"2024-09-17T03:12:50.564860+0000","last_clean":"2024-09-17T03:12:50.564860+0000","last_became_active":"2024-09-17T03:12:50.559077+0000","last_became_peered":"2024-09-17T03:12:50.559077+0000","last_unstale":"2024-09-17T03:12:50.564860+0000","last_undegraded":"2024-09-17T03:12:50.564860+0000","last_fullsized":"2024-09-17T03:12:50.564860+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:41.572485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541233+0000","last_change":"2024-09-17T03:12:50.541233+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541233+0000","last_undegraded":"2024-09-17T03:12:50.541233+0000","last_fullsized":"2024-09-17T03:12:50.541233+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.564737+0000","last_change":"2024-09-17T03:12:50.560680+0000","last_active":"2024-09-17T03:12:50.564737+0000","last_peered":"2024-09-17T03:12:50.564737+0000","last_clean":"2024-09-17T03:12:50.564737+0000","last_became_active":"2024-09-17T03:12:50.560340+0000","last_became_peered":"2024-09-17T03:12:50.560340+0000","last_unstale":"2024-09-17T03:12:50.564737+0000","last_undegraded":"2024-09-17T03:12:50.564737+0000","last_fullsized":"2024-09-17T03:12:50.564737+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:12.420245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542062+0000","last_change":"2024-09-17T03:12:50.542062+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542062+0000","last_undegraded":"2024-09-17T03:12:50.542062+0000","last_fullsized":"2024-09-17T03:12:50.542062+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.564702+0000","last_change":"2024-09-17T03:12:50.557733+0000","last_active":"2024-09-17T03:12:50.564702+0000","last_peered":"2024-09-17T03:12:50.564702+0000","last_clean":"2024-09-17T03:12:50.564702+0000","last_became_active":"2024-09-17T03:12:50.557424+0000","last_became_peered":"2024-09-17T03:12:50.557424+0000","last_unstale":"2024-09-17T03:12:50.564702+0000","last_undegraded":"2024-09-17T03:12:50.564702+0000","last_fullsized":"2024-09-17T03:12:50.564702+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:32.780892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.540756+0000","last_change":"2024-09-17T03:12:50.540756+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.540756+0000","last_undegraded":"2024-09-17T03:12:50.540756+0000","last_fullsized":"2024-09-17T03:12:50.540756+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.561192+0000","last_change":"2024-09-17T03:12:50.557649+0000","last_active":"2024-09-17T03:12:50.561192+0000","last_peered":"2024-09-17T03:12:50.561192+0000","last_clean":"2024-09-17T03:12:50.561192+0000","last_became_active":"2024-09-17T03:12:50.557285+0000","last_became_peered":"2024-09-17T03:12:50.557285+0000","last_unstale":"2024-09-17T03:12:50.561192+0000","last_undegraded":"2024-09-17T03:12:50.561192+0000","last_fullsized":"2024-09-17T03:12:50.561192+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:08.528321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541432+0000","last_change":"2024-09-17T03:12:50.541432+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541432+0000","last_undegraded":"2024-09-17T03:12:50.541432+0000","last_fullsized":"2024-09-17T03:12:50.541432+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563547+0000","last_change":"2024-09-17T03:12:50.555756+0000","last_active":"2024-09-17T03:12:50.563547+0000","last_peered":"2024-09-17T03:12:50.563547+0000","last_clean":"2024-09-17T03:12:50.563547+0000","last_became_active":"2024-09-17T03:12:50.555359+0000","last_became_peered":"2024-09-17T03:12:50.555359+0000","last_unstale":"2024-09-17T03:12:50.563547+0000","last_undegraded":"2024-09-17T03:12:50.563547+0000","last_fullsized":"2024-09-17T03:12:50.563547+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:01.133168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.575596+0000","last_change":"2024-09-17T03:12:51.571810+0000","last_active":"2024-09-17T03:12:51.575596+0000","last_peered":"2024-09-17T03:12:51.575596+0000","last_clean":"2024-09-17T03:12:51.575596+0000","last_became_active":"2024-09-17T03:12:51.571483+0000","last_became_peered":"2024-09-17T03:12:51.571483+0000","last_unstale":"2024-09-17T03:12:51.575596+0000","last_undegraded":"2024-09-17T03:12:51.575596+0000","last_fullsized":"2024-09-17T03:12:51.575596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:22.216990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.560629+0000","last_change":"2024-09-17T03:12:50.554998+0000","last_active":"2024-09-17T03:12:50.560629+0000","last_peered":"2024-09-17T03:12:50.560629+0000","last_clean":"2024-09-17T03:12:50.560629+0000","last_became_active":"2024-09-17T03:12:50.554357+0000","last_became_peered":"2024-09-17T03:12:50.554357+0000","last_unstale":"2024-09-17T03:12:50.560629+0000","last_undegraded":"2024-09-17T03:12:50.560629+0000","last_fullsized":"2024-09-17T03:12:50.560629+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:57.263039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":190,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.550472+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:12:50.550472+0000","last_peered":"2024-09-17T03:12:50.550472+0000","last_clean":"2024-09-17T03:12:50.550472+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:12:50.550472+0000","last_undegraded":"2024-09-17T03:12:50.550472+0000","last_fullsized":"2024-09-17T03:12:50.550472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509499,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":1388544,"data_stored":921059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509499,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":794624,"data_stored":330691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509498,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":336966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":336966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509500,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":806912,"data_stored":336966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509499,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":806912,"data_stored":336966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509499,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1388544,"data_stored":921059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":827392,"data_stored":343853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:12:54.568 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:12:54.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.715+0000 7f21a2a2e640 1 -- 172.21.15.78:0/715824757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f219c0cd360 msgr2=0x7f219c15c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:54.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.715+0000 7f21a2a2e640 1 --2- 172.21.15.78:0/715824757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f219c0cd360 0x7f219c15c6a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f218c005fd0 tx=0x7f218c02a4a0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.715+0000 7f21a2a2e640 1 -- 172.21.15.78:0/715824757 shutdown_connections 2024-09-17T03:12:54.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.715+0000 7f21a2a2e640 1 --2- 172.21.15.78:0/715824757 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f219c0b7fe0 0x7f219c0ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.715+0000 7f21a2a2e640 1 --2- 172.21.15.78:0/715824757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f219c0cd360 0x7f219c15c6a0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.715+0000 7f21a2a2e640 1 -- 172.21.15.78:0/715824757 >> 172.21.15.78:0/715824757 conn(0x7f219c0710b0 msgr2=0x7f219c0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:54.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.715+0000 7f21a2a2e640 1 -- 172.21.15.78:0/715824757 shutdown_connections 2024-09-17T03:12:54.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.715+0000 7f21a2a2e640 1 -- 172.21.15.78:0/715824757 wait complete. 2024-09-17T03:12:54.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.717+0000 7f21a2a2e640 1 Processor -- start 2024-09-17T03:12:54.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.717+0000 7f21a2a2e640 1 -- start start 2024-09-17T03:12:54.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f21a2a2e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f219c0b7fe0 0x7f219c0c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:54.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f21a2a2e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f219c0cd360 0x7f219c1535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:54.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f21a2a2e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f219c0cf270 0x7f219c0cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:54.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f21a2a2e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f219c072f60 con 0x7f219c0cf270 2024-09-17T03:12:54.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f21a2a2e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f219c0d13b0 con 0x7f219c0cd360 2024-09-17T03:12:54.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f21a2a2e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f219c0730e0 con 0x7f219c0b7fe0 2024-09-17T03:12:54.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f21a0fcb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f219c0cf270 0x7f219c0cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:54.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f21a0fcb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f219c0cf270 0x7f219c0cb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35080/0 (socket says 172.21.15.78:35080) 2024-09-17T03:12:54.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f21a0fcb640 1 -- 172.21.15.78:0/746719727 learned_addr learned my addr 172.21.15.78:0/746719727 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:54.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f219b7fe640 1 --2- 172.21.15.78:0/746719727 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f219c0cd360 0x7f219c1535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:54.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f219bfff640 1 --2- 172.21.15.78:0/746719727 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f219c0b7fe0 0x7f219c0c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:54.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f21a0fcb640 1 -- 172.21.15.78:0/746719727 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f219c0b7fe0 msgr2=0x7f219c0c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:54.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f21a0fcb640 1 --2- 172.21.15.78:0/746719727 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f219c0b7fe0 0x7f219c0c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f21a0fcb640 1 -- 172.21.15.78:0/746719727 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f219c0cd360 msgr2=0x7f219c1535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:54.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f21a0fcb640 1 --2- 172.21.15.78:0/746719727 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f219c0cd360 0x7f219c1535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f21a0fcb640 1 -- 172.21.15.78:0/746719727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219c1f6e30 con 0x7f219c0cf270 2024-09-17T03:12:54.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f219bfff640 1 --2- 172.21.15.78:0/746719727 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f219c0b7fe0 0x7f219c0c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:54.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f219b7fe640 1 --2- 172.21.15.78:0/746719727 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f219c0cd360 0x7f219c1535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:12:54.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f21a0fcb640 1 --2- 172.21.15.78:0/746719727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f219c0cf270 0x7f219c0cb110 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f219400b970 tx=0x7f219400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:54.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f2198ff9640 1 -- 172.21.15.78:0/746719727 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2194019070 con 0x7f219c0cf270 2024-09-17T03:12:54.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f2198ff9640 1 -- 172.21.15.78:0/746719727 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f219400cc30 con 0x7f219c0cf270 2024-09-17T03:12:54.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f21a2a2e640 1 -- 172.21.15.78:0/746719727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f219c1f70d0 con 0x7f219c0cf270 2024-09-17T03:12:54.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f2198ff9640 1 -- 172.21.15.78:0/746719727 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f219400ce60 con 0x7f219c0cf270 2024-09-17T03:12:54.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.719+0000 7f21a2a2e640 1 -- 172.21.15.78:0/746719727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f219c1f7690 con 0x7f219c0cf270 2024-09-17T03:12:54.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.720+0000 7f21a2a2e640 1 -- 172.21.15.78:0/746719727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f219c06a5e0 con 0x7f219c0cf270 2024-09-17T03:12:54.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.721+0000 7f2198ff9640 1 -- 172.21.15.78:0/746719727 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f219401c070 con 0x7f219c0cf270 2024-09-17T03:12:54.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.721+0000 7f2198ff9640 1 --2- 172.21.15.78:0/746719727 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2188078b90 0x7f218807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:54.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.722+0000 7f2198ff9640 1 -- 172.21.15.78:0/746719727 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f219409a8d0 con 0x7f219c0cf270 2024-09-17T03:12:54.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.722+0000 7f219bfff640 1 --2- 172.21.15.78:0/746719727 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2188078b90 0x7f218807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:54.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.722+0000 7f219bfff640 1 --2- 172.21.15.78:0/746719727 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2188078b90 0x7f218807b0a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f218c033000 tx=0x7f218c004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:54.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.726+0000 7f2198ff9640 1 -- 172.21.15.78:0/746719727 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f219c1f6e30 con 0x7f219c0cf270 2024-09-17T03:12:54.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.897+0000 7f21a2a2e640 1 -- 172.21.15.78:0/746719727 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f219c1f7ce0 con 0x7f2188078b90 2024-09-17T03:12:54.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.902+0000 7f2198ff9640 1 -- 172.21.15.78:0/746719727 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247355 (secure 0 0 0) 0x7f219c1f7ce0 con 0x7f2188078b90 2024-09-17T03:12:54.904 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:12:54.905 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:12:54.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.904+0000 7f21a2a2e640 1 -- 172.21.15.78:0/746719727 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2188078b90 msgr2=0x7f218807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:54.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.904+0000 7f21a2a2e640 1 --2- 172.21.15.78:0/746719727 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2188078b90 0x7f218807b0a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f218c033000 tx=0x7f218c004730 comp rx=0 tx=0).stop 2024-09-17T03:12:54.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.904+0000 7f21a2a2e640 1 -- 172.21.15.78:0/746719727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f219c0cf270 msgr2=0x7f219c0cb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:54.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.904+0000 7f21a2a2e640 1 --2- 172.21.15.78:0/746719727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f219c0cf270 0x7f219c0cb110 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f219400b970 tx=0x7f219400be30 comp rx=0 tx=0).stop 2024-09-17T03:12:54.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.904+0000 7f21a2a2e640 1 -- 172.21.15.78:0/746719727 shutdown_connections 2024-09-17T03:12:54.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.904+0000 7f21a2a2e640 1 --2- 172.21.15.78:0/746719727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f219c0cf270 0x7f219c0cb110 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.904+0000 7f21a2a2e640 1 --2- 172.21.15.78:0/746719727 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2188078b90 0x7f218807b0a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.904+0000 7f21a2a2e640 1 --2- 172.21.15.78:0/746719727 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f219c0cd360 0x7f219c1535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.904+0000 7f21a2a2e640 1 --2- 172.21.15.78:0/746719727 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f219c0b7fe0 0x7f219c0c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:54.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.904+0000 7f21a2a2e640 1 -- 172.21.15.78:0/746719727 >> 172.21.15.78:0/746719727 conn(0x7f219c0710b0 msgr2=0x7f219c0b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:54.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.904+0000 7f21a2a2e640 1 -- 172.21.15.78:0/746719727 shutdown_connections 2024-09-17T03:12:54.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:54.904+0000 7f21a2a2e640 1 -- 172.21.15.78:0/746719727 wait complete. 2024-09-17T03:12:54.915 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-09-17T03:12:53.190614+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":105,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236180,"kb_used_data":7448,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738540,"statfs":{"total":773094113280,"available":772852264960,"internally_reserved":0,"allocated":7626752,"data_stored":3864526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000951"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.549259+0000","last_change":"2024-09-17T03:12:50.549259+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.549259+0000","last_undegraded":"2024-09-17T03:12:50.549259+0000","last_fullsized":"2024-09-17T03:12:50.549259+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542089+0000","last_change":"2024-09-17T03:12:50.542089+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542089+0000","last_undegraded":"2024-09-17T03:12:50.542089+0000","last_fullsized":"2024-09-17T03:12:50.542089+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.571113+0000","last_change":"2024-09-17T03:12:51.568425+0000","last_active":"2024-09-17T03:12:51.571113+0000","last_peered":"2024-09-17T03:12:51.571113+0000","last_clean":"2024-09-17T03:12:51.571113+0000","last_became_active":"2024-09-17T03:12:51.568119+0000","last_became_peered":"2024-09-17T03:12:51.568119+0000","last_unstale":"2024-09-17T03:12:51.571113+0000","last_undegraded":"2024-09-17T03:12:51.571113+0000","last_fullsized":"2024-09-17T03:12:51.571113+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:20.849138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547005+0000","last_change":"2024-09-17T03:12:50.547005+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547005+0000","last_undegraded":"2024-09-17T03:12:50.547005+0000","last_fullsized":"2024-09-17T03:12:50.547005+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544321+0000","last_change":"2024-09-17T03:12:50.544321+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544321+0000","last_undegraded":"2024-09-17T03:12:50.544321+0000","last_fullsized":"2024-09-17T03:12:50.544321+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543291+0000","last_change":"2024-09-17T03:12:50.543291+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543291+0000","last_undegraded":"2024-09-17T03:12:50.543291+0000","last_fullsized":"2024-09-17T03:12:50.543291+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548217+0000","last_change":"2024-09-17T03:12:50.548217+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548217+0000","last_undegraded":"2024-09-17T03:12:50.548217+0000","last_fullsized":"2024-09-17T03:12:50.548217+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543369+0000","last_change":"2024-09-17T03:12:50.543369+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543369+0000","last_undegraded":"2024-09-17T03:12:50.543369+0000","last_fullsized":"2024-09-17T03:12:50.543369+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543505+0000","last_change":"2024-09-17T03:12:50.543505+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543505+0000","last_undegraded":"2024-09-17T03:12:50.543505+0000","last_fullsized":"2024-09-17T03:12:50.543505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.546281+0000","last_change":"2024-09-17T03:12:50.546281+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.546281+0000","last_undegraded":"2024-09-17T03:12:50.546281+0000","last_fullsized":"2024-09-17T03:12:50.546281+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548533+0000","last_change":"2024-09-17T03:12:50.548533+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548533+0000","last_undegraded":"2024-09-17T03:12:50.548533+0000","last_fullsized":"2024-09-17T03:12:50.548533+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541339+0000","last_change":"2024-09-17T03:12:50.541339+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541339+0000","last_undegraded":"2024-09-17T03:12:50.541339+0000","last_fullsized":"2024-09-17T03:12:50.541339+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543421+0000","last_change":"2024-09-17T03:12:50.543421+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543421+0000","last_undegraded":"2024-09-17T03:12:50.543421+0000","last_fullsized":"2024-09-17T03:12:50.543421+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541795+0000","last_change":"2024-09-17T03:12:50.541795+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541795+0000","last_undegraded":"2024-09-17T03:12:50.541795+0000","last_fullsized":"2024-09-17T03:12:50.541795+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544520+0000","last_change":"2024-09-17T03:12:50.544520+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544520+0000","last_undegraded":"2024-09-17T03:12:50.544520+0000","last_fullsized":"2024-09-17T03:12:50.544520+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544499+0000","last_change":"2024-09-17T03:12:50.544499+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544499+0000","last_undegraded":"2024-09-17T03:12:50.544499+0000","last_fullsized":"2024-09-17T03:12:50.544499+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543073+0000","last_change":"2024-09-17T03:12:50.543073+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543073+0000","last_undegraded":"2024-09-17T03:12:50.543073+0000","last_fullsized":"2024-09-17T03:12:50.543073+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.540843+0000","last_change":"2024-09-17T03:12:50.540843+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.540843+0000","last_undegraded":"2024-09-17T03:12:50.540843+0000","last_fullsized":"2024-09-17T03:12:50.540843+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542778+0000","last_change":"2024-09-17T03:12:50.542778+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542778+0000","last_undegraded":"2024-09-17T03:12:50.542778+0000","last_fullsized":"2024-09-17T03:12:50.542778+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543726+0000","last_change":"2024-09-17T03:12:50.543726+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543726+0000","last_undegraded":"2024-09-17T03:12:50.543726+0000","last_fullsized":"2024-09-17T03:12:50.543726+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.545843+0000","last_change":"2024-09-17T03:12:50.545843+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.545843+0000","last_undegraded":"2024-09-17T03:12:50.545843+0000","last_fullsized":"2024-09-17T03:12:50.545843+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.545390+0000","last_change":"2024-09-17T03:12:50.545390+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.545390+0000","last_undegraded":"2024-09-17T03:12:50.545390+0000","last_fullsized":"2024-09-17T03:12:50.545390+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.545880+0000","last_change":"2024-09-17T03:12:50.545880+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.545880+0000","last_undegraded":"2024-09-17T03:12:50.545880+0000","last_fullsized":"2024-09-17T03:12:50.545880+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.550258+0000","last_change":"2024-09-17T03:12:50.550258+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.550258+0000","last_undegraded":"2024-09-17T03:12:50.550258+0000","last_fullsized":"2024-09-17T03:12:50.550258+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543553+0000","last_change":"2024-09-17T03:12:50.543553+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543553+0000","last_undegraded":"2024-09-17T03:12:50.543553+0000","last_fullsized":"2024-09-17T03:12:50.543553+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.554449+0000","last_change":"2024-09-17T03:12:50.554449+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.554449+0000","last_undegraded":"2024-09-17T03:12:50.554449+0000","last_fullsized":"2024-09-17T03:12:50.554449+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.576563+0000","last_change":"2024-09-17T03:12:51.574817+0000","last_active":"2024-09-17T03:12:51.576563+0000","last_peered":"2024-09-17T03:12:51.576563+0000","last_clean":"2024-09-17T03:12:51.576563+0000","last_became_active":"2024-09-17T03:12:51.572559+0000","last_became_peered":"2024-09-17T03:12:51.572559+0000","last_unstale":"2024-09-17T03:12:51.576563+0000","last_undegraded":"2024-09-17T03:12:51.576563+0000","last_fullsized":"2024-09-17T03:12:51.576563+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:44.874908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544444+0000","last_change":"2024-09-17T03:12:50.544444+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544444+0000","last_undegraded":"2024-09-17T03:12:50.544444+0000","last_fullsized":"2024-09-17T03:12:50.544444+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.572237+0000","last_change":"2024-09-17T03:12:51.564402+0000","last_active":"2024-09-17T03:12:51.572237+0000","last_peered":"2024-09-17T03:12:51.572237+0000","last_clean":"2024-09-17T03:12:51.572237+0000","last_became_active":"2024-09-17T03:12:51.564089+0000","last_became_peered":"2024-09-17T03:12:51.564089+0000","last_unstale":"2024-09-17T03:12:51.572237+0000","last_undegraded":"2024-09-17T03:12:51.572237+0000","last_fullsized":"2024-09-17T03:12:51.572237+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:28.591233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547193+0000","last_change":"2024-09-17T03:12:50.547193+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547193+0000","last_undegraded":"2024-09-17T03:12:50.547193+0000","last_fullsized":"2024-09-17T03:12:50.547193+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547290+0000","last_change":"2024-09-17T03:12:50.547290+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547290+0000","last_undegraded":"2024-09-17T03:12:50.547290+0000","last_fullsized":"2024-09-17T03:12:50.547290+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541696+0000","last_change":"2024-09-17T03:12:50.541696+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541696+0000","last_undegraded":"2024-09-17T03:12:50.541696+0000","last_fullsized":"2024-09-17T03:12:50.541696+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548884+0000","last_change":"2024-09-17T03:12:50.548884+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548884+0000","last_undegraded":"2024-09-17T03:12:50.548884+0000","last_fullsized":"2024-09-17T03:12:50.548884+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.559713+0000","last_change":"2024-09-17T03:12:50.558227+0000","last_active":"2024-09-17T03:12:50.559713+0000","last_peered":"2024-09-17T03:12:50.559713+0000","last_clean":"2024-09-17T03:12:50.559713+0000","last_became_active":"2024-09-17T03:12:50.557908+0000","last_became_peered":"2024-09-17T03:12:50.557908+0000","last_unstale":"2024-09-17T03:12:50.559713+0000","last_undegraded":"2024-09-17T03:12:50.559713+0000","last_fullsized":"2024-09-17T03:12:50.559713+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:22.132155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542611+0000","last_change":"2024-09-17T03:12:50.542611+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542611+0000","last_undegraded":"2024-09-17T03:12:50.542611+0000","last_fullsized":"2024-09-17T03:12:50.542611+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.559626+0000","last_change":"2024-09-17T03:12:50.555455+0000","last_active":"2024-09-17T03:12:50.559626+0000","last_peered":"2024-09-17T03:12:50.559626+0000","last_clean":"2024-09-17T03:12:50.559626+0000","last_became_active":"2024-09-17T03:12:50.555094+0000","last_became_peered":"2024-09-17T03:12:50.555094+0000","last_unstale":"2024-09-17T03:12:50.559626+0000","last_undegraded":"2024-09-17T03:12:50.559626+0000","last_fullsized":"2024-09-17T03:12:50.559626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:05.621816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543226+0000","last_change":"2024-09-17T03:12:50.543226+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543226+0000","last_undegraded":"2024-09-17T03:12:50.543226+0000","last_fullsized":"2024-09-17T03:12:50.543226+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.561045+0000","last_change":"2024-09-17T03:12:50.556466+0000","last_active":"2024-09-17T03:12:50.561045+0000","last_peered":"2024-09-17T03:12:50.561045+0000","last_clean":"2024-09-17T03:12:50.561045+0000","last_became_active":"2024-09-17T03:12:50.556101+0000","last_became_peered":"2024-09-17T03:12:50.556101+0000","last_unstale":"2024-09-17T03:12:50.561045+0000","last_undegraded":"2024-09-17T03:12:50.561045+0000","last_fullsized":"2024-09-17T03:12:50.561045+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:34.693575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548062+0000","last_change":"2024-09-17T03:12:50.548062+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548062+0000","last_undegraded":"2024-09-17T03:12:50.548062+0000","last_fullsized":"2024-09-17T03:12:50.548062+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563574+0000","last_change":"2024-09-17T03:12:50.555688+0000","last_active":"2024-09-17T03:12:50.563574+0000","last_peered":"2024-09-17T03:12:50.563574+0000","last_clean":"2024-09-17T03:12:50.563574+0000","last_became_active":"2024-09-17T03:12:50.555240+0000","last_became_peered":"2024-09-17T03:12:50.555240+0000","last_unstale":"2024-09-17T03:12:50.563574+0000","last_undegraded":"2024-09-17T03:12:50.563574+0000","last_fullsized":"2024-09-17T03:12:50.563574+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:39.506557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.546628+0000","last_change":"2024-09-17T03:12:50.546628+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.546628+0000","last_undegraded":"2024-09-17T03:12:50.546628+0000","last_fullsized":"2024-09-17T03:12:50.546628+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.582382+0000","last_change":"2024-09-17T03:12:50.559708+0000","last_active":"2024-09-17T03:12:51.582382+0000","last_peered":"2024-09-17T03:12:51.582382+0000","last_clean":"2024-09-17T03:12:51.582382+0000","last_became_active":"2024-09-17T03:12:50.559377+0000","last_became_peered":"2024-09-17T03:12:50.559377+0000","last_unstale":"2024-09-17T03:12:51.582382+0000","last_undegraded":"2024-09-17T03:12:51.582382+0000","last_fullsized":"2024-09-17T03:12:51.582382+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:32.000927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544788+0000","last_change":"2024-09-17T03:12:50.544788+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544788+0000","last_undegraded":"2024-09-17T03:12:50.544788+0000","last_fullsized":"2024-09-17T03:12:50.544788+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.555568+0000","last_change":"2024-09-17T03:12:50.552181+0000","last_active":"2024-09-17T03:12:50.555568+0000","last_peered":"2024-09-17T03:12:50.555568+0000","last_clean":"2024-09-17T03:12:50.555568+0000","last_became_active":"2024-09-17T03:12:50.551138+0000","last_became_peered":"2024-09-17T03:12:50.551138+0000","last_unstale":"2024-09-17T03:12:50.555568+0000","last_undegraded":"2024-09-17T03:12:50.555568+0000","last_fullsized":"2024-09-17T03:12:50.555568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:34.904808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541261+0000","last_change":"2024-09-17T03:12:50.541261+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541261+0000","last_undegraded":"2024-09-17T03:12:50.541261+0000","last_fullsized":"2024-09-17T03:12:50.541261+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.564746+0000","last_change":"2024-09-17T03:12:50.558633+0000","last_active":"2024-09-17T03:12:50.564746+0000","last_peered":"2024-09-17T03:12:50.564746+0000","last_clean":"2024-09-17T03:12:50.564746+0000","last_became_active":"2024-09-17T03:12:50.558373+0000","last_became_peered":"2024-09-17T03:12:50.558373+0000","last_unstale":"2024-09-17T03:12:50.564746+0000","last_undegraded":"2024-09-17T03:12:50.564746+0000","last_fullsized":"2024-09-17T03:12:50.564746+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:06.856502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542435+0000","last_change":"2024-09-17T03:12:50.542435+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542435+0000","last_undegraded":"2024-09-17T03:12:50.542435+0000","last_fullsized":"2024-09-17T03:12:50.542435+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.559600+0000","last_change":"2024-09-17T03:12:50.554790+0000","last_active":"2024-09-17T03:12:50.559600+0000","last_peered":"2024-09-17T03:12:50.559600+0000","last_clean":"2024-09-17T03:12:50.559600+0000","last_became_active":"2024-09-17T03:12:50.554441+0000","last_became_peered":"2024-09-17T03:12:50.554441+0000","last_unstale":"2024-09-17T03:12:50.559600+0000","last_undegraded":"2024-09-17T03:12:50.559600+0000","last_fullsized":"2024-09-17T03:12:50.559600+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:29.490405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548759+0000","last_change":"2024-09-17T03:12:50.548759+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548759+0000","last_undegraded":"2024-09-17T03:12:50.548759+0000","last_fullsized":"2024-09-17T03:12:50.548759+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.558393+0000","last_change":"2024-09-17T03:12:50.553084+0000","last_active":"2024-09-17T03:12:50.558393+0000","last_peered":"2024-09-17T03:12:50.558393+0000","last_clean":"2024-09-17T03:12:50.558393+0000","last_became_active":"2024-09-17T03:12:50.552769+0000","last_became_peered":"2024-09-17T03:12:50.552769+0000","last_unstale":"2024-09-17T03:12:50.558393+0000","last_undegraded":"2024-09-17T03:12:50.558393+0000","last_fullsized":"2024-09-17T03:12:50.558393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:47.537133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548699+0000","last_change":"2024-09-17T03:12:50.548699+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548699+0000","last_undegraded":"2024-09-17T03:12:50.548699+0000","last_fullsized":"2024-09-17T03:12:50.548699+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563558+0000","last_change":"2024-09-17T03:12:50.558611+0000","last_active":"2024-09-17T03:12:50.563558+0000","last_peered":"2024-09-17T03:12:50.563558+0000","last_clean":"2024-09-17T03:12:50.563558+0000","last_became_active":"2024-09-17T03:12:50.558320+0000","last_became_peered":"2024-09-17T03:12:50.558320+0000","last_unstale":"2024-09-17T03:12:50.563558+0000","last_undegraded":"2024-09-17T03:12:50.563558+0000","last_fullsized":"2024-09-17T03:12:50.563558+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:06.039361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542447+0000","last_change":"2024-09-17T03:12:50.542447+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542447+0000","last_undegraded":"2024-09-17T03:12:50.542447+0000","last_fullsized":"2024-09-17T03:12:50.542447+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.580643+0000","last_change":"2024-09-17T03:12:50.560334+0000","last_active":"2024-09-17T03:12:51.580643+0000","last_peered":"2024-09-17T03:12:51.580643+0000","last_clean":"2024-09-17T03:12:51.580643+0000","last_became_active":"2024-09-17T03:12:50.560015+0000","last_became_peered":"2024-09-17T03:12:50.560015+0000","last_unstale":"2024-09-17T03:12:51.580643+0000","last_undegraded":"2024-09-17T03:12:51.580643+0000","last_fullsized":"2024-09-17T03:12:51.580643+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:33.899941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542401+0000","last_change":"2024-09-17T03:12:50.542401+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542401+0000","last_undegraded":"2024-09-17T03:12:50.542401+0000","last_fullsized":"2024-09-17T03:12:50.542401+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.557166+0000","last_change":"2024-09-17T03:12:50.551177+0000","last_active":"2024-09-17T03:12:50.557166+0000","last_peered":"2024-09-17T03:12:50.557166+0000","last_clean":"2024-09-17T03:12:50.557166+0000","last_became_active":"2024-09-17T03:12:50.550823+0000","last_became_peered":"2024-09-17T03:12:50.550823+0000","last_unstale":"2024-09-17T03:12:50.557166+0000","last_undegraded":"2024-09-17T03:12:50.557166+0000","last_fullsized":"2024-09-17T03:12:50.557166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:37.066429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.546344+0000","last_change":"2024-09-17T03:12:50.546344+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.546344+0000","last_undegraded":"2024-09-17T03:12:50.546344+0000","last_fullsized":"2024-09-17T03:12:50.546344+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.560350+0000","last_change":"2024-09-17T03:12:50.553725+0000","last_active":"2024-09-17T03:12:50.560350+0000","last_peered":"2024-09-17T03:12:50.560350+0000","last_clean":"2024-09-17T03:12:50.560350+0000","last_became_active":"2024-09-17T03:12:50.553296+0000","last_became_peered":"2024-09-17T03:12:50.553296+0000","last_unstale":"2024-09-17T03:12:50.560350+0000","last_undegraded":"2024-09-17T03:12:50.560350+0000","last_fullsized":"2024-09-17T03:12:50.560350+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:29.780411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547759+0000","last_change":"2024-09-17T03:12:50.547759+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547759+0000","last_undegraded":"2024-09-17T03:12:50.547759+0000","last_fullsized":"2024-09-17T03:12:50.547759+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.555592+0000","last_change":"2024-09-17T03:12:50.552439+0000","last_active":"2024-09-17T03:12:50.555592+0000","last_peered":"2024-09-17T03:12:50.555592+0000","last_clean":"2024-09-17T03:12:50.555592+0000","last_became_active":"2024-09-17T03:12:50.552147+0000","last_became_peered":"2024-09-17T03:12:50.552147+0000","last_unstale":"2024-09-17T03:12:50.555592+0000","last_undegraded":"2024-09-17T03:12:50.555592+0000","last_fullsized":"2024-09-17T03:12:50.555592+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:26.420432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542458+0000","last_change":"2024-09-17T03:12:50.542458+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542458+0000","last_undegraded":"2024-09-17T03:12:50.542458+0000","last_fullsized":"2024-09-17T03:12:50.542458+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563679+0000","last_change":"2024-09-17T03:12:50.558884+0000","last_active":"2024-09-17T03:12:50.563679+0000","last_peered":"2024-09-17T03:12:50.563679+0000","last_clean":"2024-09-17T03:12:50.563679+0000","last_became_active":"2024-09-17T03:12:50.558550+0000","last_became_peered":"2024-09-17T03:12:50.558550+0000","last_unstale":"2024-09-17T03:12:50.563679+0000","last_undegraded":"2024-09-17T03:12:50.563679+0000","last_fullsized":"2024-09-17T03:12:50.563679+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:18:36.626293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541278+0000","last_change":"2024-09-17T03:12:50.541278+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541278+0000","last_undegraded":"2024-09-17T03:12:50.541278+0000","last_fullsized":"2024-09-17T03:12:50.541278+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.561131+0000","last_change":"2024-09-17T03:12:50.556886+0000","last_active":"2024-09-17T03:12:50.561131+0000","last_peered":"2024-09-17T03:12:50.561131+0000","last_clean":"2024-09-17T03:12:50.561131+0000","last_became_active":"2024-09-17T03:12:50.556092+0000","last_became_peered":"2024-09-17T03:12:50.556092+0000","last_unstale":"2024-09-17T03:12:50.561131+0000","last_undegraded":"2024-09-17T03:12:50.561131+0000","last_fullsized":"2024-09-17T03:12:50.561131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:19.970449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.545286+0000","last_change":"2024-09-17T03:12:50.545286+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.545286+0000","last_undegraded":"2024-09-17T03:12:50.545286+0000","last_fullsized":"2024-09-17T03:12:50.545286+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.555534+0000","last_change":"2024-09-17T03:12:50.553551+0000","last_active":"2024-09-17T03:12:50.555534+0000","last_peered":"2024-09-17T03:12:50.555534+0000","last_clean":"2024-09-17T03:12:50.555534+0000","last_became_active":"2024-09-17T03:12:50.553028+0000","last_became_peered":"2024-09-17T03:12:50.553028+0000","last_unstale":"2024-09-17T03:12:50.555534+0000","last_undegraded":"2024-09-17T03:12:50.555534+0000","last_fullsized":"2024-09-17T03:12:50.555534+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:15.682903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547383+0000","last_change":"2024-09-17T03:12:50.547383+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547383+0000","last_undegraded":"2024-09-17T03:12:50.547383+0000","last_fullsized":"2024-09-17T03:12:50.547383+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.561103+0000","last_change":"2024-09-17T03:12:50.556871+0000","last_active":"2024-09-17T03:12:50.561103+0000","last_peered":"2024-09-17T03:12:50.561103+0000","last_clean":"2024-09-17T03:12:50.561103+0000","last_became_active":"2024-09-17T03:12:50.556543+0000","last_became_peered":"2024-09-17T03:12:50.556543+0000","last_unstale":"2024-09-17T03:12:50.561103+0000","last_undegraded":"2024-09-17T03:12:50.561103+0000","last_fullsized":"2024-09-17T03:12:50.561103+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:02.158974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.540760+0000","last_change":"2024-09-17T03:12:50.540760+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.540760+0000","last_undegraded":"2024-09-17T03:12:50.540760+0000","last_fullsized":"2024-09-17T03:12:50.540760+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563779+0000","last_change":"2024-09-17T03:12:50.559567+0000","last_active":"2024-09-17T03:12:50.563779+0000","last_peered":"2024-09-17T03:12:50.563779+0000","last_clean":"2024-09-17T03:12:50.563779+0000","last_became_active":"2024-09-17T03:12:50.559272+0000","last_became_peered":"2024-09-17T03:12:50.559272+0000","last_unstale":"2024-09-17T03:12:50.563779+0000","last_undegraded":"2024-09-17T03:12:50.563779+0000","last_fullsized":"2024-09-17T03:12:50.563779+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:25.932754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541762+0000","last_change":"2024-09-17T03:12:50.541762+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541762+0000","last_undegraded":"2024-09-17T03:12:50.541762+0000","last_fullsized":"2024-09-17T03:12:50.541762+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.562647+0000","last_change":"2024-09-17T03:12:50.561368+0000","last_active":"2024-09-17T03:12:50.562647+0000","last_peered":"2024-09-17T03:12:50.562647+0000","last_clean":"2024-09-17T03:12:50.562647+0000","last_became_active":"2024-09-17T03:12:50.561048+0000","last_became_peered":"2024-09-17T03:12:50.561048+0000","last_unstale":"2024-09-17T03:12:50.562647+0000","last_undegraded":"2024-09-17T03:12:50.562647+0000","last_fullsized":"2024-09-17T03:12:50.562647+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:05.621816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.572267+0000","last_change":"2024-09-17T03:12:51.569311+0000","last_active":"2024-09-17T03:12:51.572267+0000","last_peered":"2024-09-17T03:12:51.572267+0000","last_clean":"2024-09-17T03:12:51.572267+0000","last_became_active":"2024-09-17T03:12:51.568983+0000","last_became_peered":"2024-09-17T03:12:51.568983+0000","last_unstale":"2024-09-17T03:12:51.572267+0000","last_undegraded":"2024-09-17T03:12:51.572267+0000","last_fullsized":"2024-09-17T03:12:51.572267+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:15:30.514819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.555619+0000","last_change":"2024-09-17T03:12:50.553656+0000","last_active":"2024-09-17T03:12:50.555619+0000","last_peered":"2024-09-17T03:12:50.555619+0000","last_clean":"2024-09-17T03:12:50.555619+0000","last_became_active":"2024-09-17T03:12:50.553349+0000","last_became_peered":"2024-09-17T03:12:50.553349+0000","last_unstale":"2024-09-17T03:12:50.555619+0000","last_undegraded":"2024-09-17T03:12:50.555619+0000","last_fullsized":"2024-09-17T03:12:50.555619+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:08.565374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.572396+0000","last_change":"2024-09-17T03:12:51.570982+0000","last_active":"2024-09-17T03:12:51.572396+0000","last_peered":"2024-09-17T03:12:51.572396+0000","last_clean":"2024-09-17T03:12:51.572396+0000","last_became_active":"2024-09-17T03:12:51.570683+0000","last_became_peered":"2024-09-17T03:12:51.570683+0000","last_unstale":"2024-09-17T03:12:51.572396+0000","last_undegraded":"2024-09-17T03:12:51.572396+0000","last_fullsized":"2024-09-17T03:12:51.572396+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:55.497465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.569126+0000","last_change":"2024-09-17T03:12:50.561347+0000","last_active":"2024-09-17T03:12:50.569126+0000","last_peered":"2024-09-17T03:12:50.569126+0000","last_clean":"2024-09-17T03:12:50.569126+0000","last_became_active":"2024-09-17T03:12:50.561045+0000","last_became_peered":"2024-09-17T03:12:50.561045+0000","last_unstale":"2024-09-17T03:12:50.569126+0000","last_undegraded":"2024-09-17T03:12:50.569126+0000","last_fullsized":"2024-09-17T03:12:50.569126+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:30.710367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.571609+0000","last_change":"2024-09-17T03:12:51.570718+0000","last_active":"2024-09-17T03:12:51.571609+0000","last_peered":"2024-09-17T03:12:51.571609+0000","last_clean":"2024-09-17T03:12:51.571609+0000","last_became_active":"2024-09-17T03:12:51.570374+0000","last_became_peered":"2024-09-17T03:12:51.570374+0000","last_unstale":"2024-09-17T03:12:51.571609+0000","last_undegraded":"2024-09-17T03:12:51.571609+0000","last_fullsized":"2024-09-17T03:12:51.571609+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:29.522439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.556966+0000","last_change":"2024-09-17T03:12:50.552653+0000","last_active":"2024-09-17T03:12:50.556966+0000","last_peered":"2024-09-17T03:12:50.556966+0000","last_clean":"2024-09-17T03:12:50.556966+0000","last_became_active":"2024-09-17T03:12:50.552331+0000","last_became_peered":"2024-09-17T03:12:50.552331+0000","last_unstale":"2024-09-17T03:12:50.556966+0000","last_undegraded":"2024-09-17T03:12:50.556966+0000","last_fullsized":"2024-09-17T03:12:50.556966+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:22.132155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544145+0000","last_change":"2024-09-17T03:12:50.544145+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544145+0000","last_undegraded":"2024-09-17T03:12:50.544145+0000","last_fullsized":"2024-09-17T03:12:50.544145+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.555506+0000","last_change":"2024-09-17T03:12:50.552772+0000","last_active":"2024-09-17T03:12:50.555506+0000","last_peered":"2024-09-17T03:12:50.555506+0000","last_clean":"2024-09-17T03:12:50.555506+0000","last_became_active":"2024-09-17T03:12:50.552430+0000","last_became_peered":"2024-09-17T03:12:50.552430+0000","last_unstale":"2024-09-17T03:12:50.555506+0000","last_undegraded":"2024-09-17T03:12:50.555506+0000","last_fullsized":"2024-09-17T03:12:50.555506+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:55.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.549984+0000","last_change":"2024-09-17T03:12:50.549984+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.549984+0000","last_undegraded":"2024-09-17T03:12:50.549984+0000","last_fullsized":"2024-09-17T03:12:50.549984+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563760+0000","last_change":"2024-09-17T03:12:50.559793+0000","last_active":"2024-09-17T03:12:50.563760+0000","last_peered":"2024-09-17T03:12:50.563760+0000","last_clean":"2024-09-17T03:12:50.563760+0000","last_became_active":"2024-09-17T03:12:50.559454+0000","last_became_peered":"2024-09-17T03:12:50.559454+0000","last_unstale":"2024-09-17T03:12:50.563760+0000","last_undegraded":"2024-09-17T03:12:50.563760+0000","last_fullsized":"2024-09-17T03:12:50.563760+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:31.013515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547078+0000","last_change":"2024-09-17T03:12:50.547078+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547078+0000","last_undegraded":"2024-09-17T03:12:50.547078+0000","last_fullsized":"2024-09-17T03:12:50.547078+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.556806+0000","last_change":"2024-09-17T03:12:50.553233+0000","last_active":"2024-09-17T03:12:50.556806+0000","last_peered":"2024-09-17T03:12:50.556806+0000","last_clean":"2024-09-17T03:12:50.556806+0000","last_became_active":"2024-09-17T03:12:50.552920+0000","last_became_peered":"2024-09-17T03:12:50.552920+0000","last_unstale":"2024-09-17T03:12:50.556806+0000","last_undegraded":"2024-09-17T03:12:50.556806+0000","last_fullsized":"2024-09-17T03:12:50.556806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:07.400568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547310+0000","last_change":"2024-09-17T03:12:50.547310+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547310+0000","last_undegraded":"2024-09-17T03:12:50.547310+0000","last_fullsized":"2024-09-17T03:12:50.547310+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.564860+0000","last_change":"2024-09-17T03:12:50.559436+0000","last_active":"2024-09-17T03:12:50.564860+0000","last_peered":"2024-09-17T03:12:50.564860+0000","last_clean":"2024-09-17T03:12:50.564860+0000","last_became_active":"2024-09-17T03:12:50.559077+0000","last_became_peered":"2024-09-17T03:12:50.559077+0000","last_unstale":"2024-09-17T03:12:50.564860+0000","last_undegraded":"2024-09-17T03:12:50.564860+0000","last_fullsized":"2024-09-17T03:12:50.564860+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:41.572485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541233+0000","last_change":"2024-09-17T03:12:50.541233+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541233+0000","last_undegraded":"2024-09-17T03:12:50.541233+0000","last_fullsized":"2024-09-17T03:12:50.541233+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.564737+0000","last_change":"2024-09-17T03:12:50.560680+0000","last_active":"2024-09-17T03:12:50.564737+0000","last_peered":"2024-09-17T03:12:50.564737+0000","last_clean":"2024-09-17T03:12:50.564737+0000","last_became_active":"2024-09-17T03:12:50.560340+0000","last_became_peered":"2024-09-17T03:12:50.560340+0000","last_unstale":"2024-09-17T03:12:50.564737+0000","last_undegraded":"2024-09-17T03:12:50.564737+0000","last_fullsized":"2024-09-17T03:12:50.564737+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:12.420245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542062+0000","last_change":"2024-09-17T03:12:50.542062+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542062+0000","last_undegraded":"2024-09-17T03:12:50.542062+0000","last_fullsized":"2024-09-17T03:12:50.542062+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.564702+0000","last_change":"2024-09-17T03:12:50.557733+0000","last_active":"2024-09-17T03:12:50.564702+0000","last_peered":"2024-09-17T03:12:50.564702+0000","last_clean":"2024-09-17T03:12:50.564702+0000","last_became_active":"2024-09-17T03:12:50.557424+0000","last_became_peered":"2024-09-17T03:12:50.557424+0000","last_unstale":"2024-09-17T03:12:50.564702+0000","last_undegraded":"2024-09-17T03:12:50.564702+0000","last_fullsized":"2024-09-17T03:12:50.564702+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:32.780892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.540756+0000","last_change":"2024-09-17T03:12:50.540756+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.540756+0000","last_undegraded":"2024-09-17T03:12:50.540756+0000","last_fullsized":"2024-09-17T03:12:50.540756+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.561192+0000","last_change":"2024-09-17T03:12:50.557649+0000","last_active":"2024-09-17T03:12:50.561192+0000","last_peered":"2024-09-17T03:12:50.561192+0000","last_clean":"2024-09-17T03:12:50.561192+0000","last_became_active":"2024-09-17T03:12:50.557285+0000","last_became_peered":"2024-09-17T03:12:50.557285+0000","last_unstale":"2024-09-17T03:12:50.561192+0000","last_undegraded":"2024-09-17T03:12:50.561192+0000","last_fullsized":"2024-09-17T03:12:50.561192+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:08.528321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541432+0000","last_change":"2024-09-17T03:12:50.541432+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541432+0000","last_undegraded":"2024-09-17T03:12:50.541432+0000","last_fullsized":"2024-09-17T03:12:50.541432+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563547+0000","last_change":"2024-09-17T03:12:50.555756+0000","last_active":"2024-09-17T03:12:50.563547+0000","last_peered":"2024-09-17T03:12:50.563547+0000","last_clean":"2024-09-17T03:12:50.563547+0000","last_became_active":"2024-09-17T03:12:50.555359+0000","last_became_peered":"2024-09-17T03:12:50.555359+0000","last_unstale":"2024-09-17T03:12:50.563547+0000","last_undegraded":"2024-09-17T03:12:50.563547+0000","last_fullsized":"2024-09-17T03:12:50.563547+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:01.133168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.575596+0000","last_change":"2024-09-17T03:12:51.571810+0000","last_active":"2024-09-17T03:12:51.575596+0000","last_peered":"2024-09-17T03:12:51.575596+0000","last_clean":"2024-09-17T03:12:51.575596+0000","last_became_active":"2024-09-17T03:12:51.571483+0000","last_became_peered":"2024-09-17T03:12:51.571483+0000","last_unstale":"2024-09-17T03:12:51.575596+0000","last_undegraded":"2024-09-17T03:12:51.575596+0000","last_fullsized":"2024-09-17T03:12:51.575596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:22.216990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.560629+0000","last_change":"2024-09-17T03:12:50.554998+0000","last_active":"2024-09-17T03:12:50.560629+0000","last_peered":"2024-09-17T03:12:50.560629+0000","last_clean":"2024-09-17T03:12:50.560629+0000","last_became_active":"2024-09-17T03:12:50.554357+0000","last_became_peered":"2024-09-17T03:12:50.554357+0000","last_unstale":"2024-09-17T03:12:50.560629+0000","last_undegraded":"2024-09-17T03:12:50.560629+0000","last_fullsized":"2024-09-17T03:12:50.560629+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:57.263039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":190,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.550472+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:12:50.550472+0000","last_peered":"2024-09-17T03:12:50.550472+0000","last_clean":"2024-09-17T03:12:50.550472+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:12:50.550472+0000","last_undegraded":"2024-09-17T03:12:50.550472+0000","last_fullsized":"2024-09-17T03:12:50.550472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509499,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":1388544,"data_stored":921059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509499,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":794624,"data_stored":330691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509498,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":336966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":336966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509500,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":806912,"data_stored":336966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509499,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":806912,"data_stored":336966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509499,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1388544,"data_stored":921059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":827392,"data_stored":343853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:12:54.920 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:12:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.068+0000 7f3cd8fad640 1 -- 172.21.15.78:0/955275759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cc0003a50 msgr2=0x7f3cc0003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.068+0000 7f3cd8fad640 1 --2- 172.21.15.78:0/955275759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cc0003a50 0x7f3cc0003ec0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400c470 tx=0x7f3cc0005830 comp rx=0 tx=0).stop 2024-09-17T03:12:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.069+0000 7f3cd8fad640 1 -- 172.21.15.78:0/955275759 shutdown_connections 2024-09-17T03:12:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.069+0000 7f3cd8fad640 1 --2- 172.21.15.78:0/955275759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cc0003a50 0x7f3cc0003ec0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.069+0000 7f3cd8fad640 1 -- 172.21.15.78:0/955275759 >> 172.21.15.78:0/955275759 conn(0x7f3cd40cdcb0 msgr2=0x7f3cd40ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.069+0000 7f3cd8fad640 1 -- 172.21.15.78:0/955275759 shutdown_connections 2024-09-17T03:12:55.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.069+0000 7f3cd8fad640 1 -- 172.21.15.78:0/955275759 wait complete. 2024-09-17T03:12:55.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.071+0000 7f3cd8fad640 1 Processor -- start 2024-09-17T03:12:55.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.071+0000 7f3cd8fad640 1 -- start start 2024-09-17T03:12:55.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.072+0000 7f3cd8fad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cc0003a50 0x7f3cd414f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:55.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.072+0000 7f3cd8fad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3cd4152960 0x7f3cd41f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:55.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.072+0000 7f3cd8fad640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3cd41f6180 0x7f3cd40b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:55.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.072+0000 7f3cd8fad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd40b3450 con 0x7f3cc0003a50 2024-09-17T03:12:55.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.072+0000 7f3cd8fad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd40b32d0 con 0x7f3cd4152960 2024-09-17T03:12:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.072+0000 7f3cd8fad640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3cd4071650 con 0x7f3cd41f6180 2024-09-17T03:12:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.072+0000 7f3cd259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cc0003a50 0x7f3cd414f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.072+0000 7f3cd259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cc0003a50 0x7f3cd414f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35108/0 (socket says 172.21.15.78:35108) 2024-09-17T03:12:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.072+0000 7f3cd259c640 1 -- 172.21.15.78:0/3342506569 learned_addr learned my addr 172.21.15.78:0/3342506569 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.072+0000 7f3cc9d9b640 1 --2- 172.21.15.78:0/3342506569 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3cd4152960 0x7f3cd41f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.072+0000 7f3cd259c640 1 -- 172.21.15.78:0/3342506569 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3cd41f6180 msgr2=0x7f3cd40b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.072+0000 7f3cd2d9d640 1 --2- 172.21.15.78:0/3342506569 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3cd41f6180 0x7f3cd40b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.072+0000 7f3cd259c640 1 --2- 172.21.15.78:0/3342506569 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3cd41f6180 0x7f3cd40b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.072+0000 7f3cd259c640 1 -- 172.21.15.78:0/3342506569 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3cd4152960 msgr2=0x7f3cd41f5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.072+0000 7f3cd259c640 1 --2- 172.21.15.78:0/3342506569 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3cd4152960 0x7f3cd41f5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.072+0000 7f3cd259c640 1 -- 172.21.15.78:0/3342506569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd414f920 con 0x7f3cc0003a50 2024-09-17T03:12:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.072+0000 7f3cc9d9b640 1 --2- 172.21.15.78:0/3342506569 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3cd4152960 0x7f3cd41f5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:12:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.072+0000 7f3cd2d9d640 1 --2- 172.21.15.78:0/3342506569 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3cd41f6180 0x7f3cd40b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:12:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.073+0000 7f3cd259c640 1 --2- 172.21.15.78:0/3342506569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cc0003a50 0x7f3cd414f3e0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400c560 tx=0x7f3cc40013c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:55.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.073+0000 7f3ccb7fe640 1 -- 172.21.15.78:0/3342506569 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4041020 con 0x7f3cc0003a50 2024-09-17T03:12:55.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.073+0000 7f3ccb7fe640 1 -- 172.21.15.78:0/3342506569 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3cc402b620 con 0x7f3cc0003a50 2024-09-17T03:12:55.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.073+0000 7f3cd8fad640 1 -- 172.21.15.78:0/3342506569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd41f6930 con 0x7f3cc0003a50 2024-09-17T03:12:55.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.073+0000 7f3ccb7fe640 1 -- 172.21.15.78:0/3342506569 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc402ba70 con 0x7f3cc0003a50 2024-09-17T03:12:55.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.073+0000 7f3cd8fad640 1 -- 172.21.15.78:0/3342506569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd4152160 con 0x7f3cc0003a50 2024-09-17T03:12:55.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.074+0000 7f3cd8fad640 1 -- 172.21.15.78:0/3342506569 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd40b0520 con 0x7f3cc0003a50 2024-09-17T03:12:55.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.074+0000 7f3ccb7fe640 1 -- 172.21.15.78:0/3342506569 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3cc4044020 con 0x7f3cc0003a50 2024-09-17T03:12:55.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.075+0000 7f3ccb7fe640 1 --2- 172.21.15.78:0/3342506569 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3cb4078bc0 0x7f3cb407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:55.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.075+0000 7f3ccb7fe640 1 -- 172.21.15.78:0/3342506569 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f3cc40bd6e0 con 0x7f3cc0003a50 2024-09-17T03:12:55.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.075+0000 7f3cc9d9b640 1 --2- 172.21.15.78:0/3342506569 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3cb4078bc0 0x7f3cb407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:55.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.076+0000 7f3cc9d9b640 1 --2- 172.21.15.78:0/3342506569 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3cb4078bc0 0x7f3cb407b0d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc006fd0 tx=0x7f3cbc006b10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:55.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.079+0000 7f3ccb7fe640 1 -- 172.21.15.78:0/3342506569 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3cc404b030 con 0x7f3cc0003a50 2024-09-17T03:12:55.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.255+0000 7f3cd8fad640 1 -- 172.21.15.78:0/3342506569 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3cd406a1c0 con 0x7f3cb4078bc0 2024-09-17T03:12:55.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.260+0000 7f3ccb7fe640 1 -- 172.21.15.78:0/3342506569 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247355 (secure 0 0 0) 0x7f3cbc011490 con 0x7f3cb4078bc0 2024-09-17T03:12:55.263 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:12:55.264 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:12:55.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.264+0000 7f3cd8fad640 1 -- 172.21.15.78:0/3342506569 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3cb4078bc0 msgr2=0x7f3cb407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:55.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.264+0000 7f3cd8fad640 1 --2- 172.21.15.78:0/3342506569 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3cb4078bc0 0x7f3cb407b0d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc006fd0 tx=0x7f3cbc006b10 comp rx=0 tx=0).stop 2024-09-17T03:12:55.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.264+0000 7f3cd8fad640 1 -- 172.21.15.78:0/3342506569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cc0003a50 msgr2=0x7f3cd414f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:55.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.264+0000 7f3cd8fad640 1 --2- 172.21.15.78:0/3342506569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cc0003a50 0x7f3cd414f3e0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400c560 tx=0x7f3cc40013c0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.264+0000 7f3cd8fad640 1 -- 172.21.15.78:0/3342506569 shutdown_connections 2024-09-17T03:12:55.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.264+0000 7f3cd8fad640 1 --2- 172.21.15.78:0/3342506569 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3cd41f6180 0x7f3cd40b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.264+0000 7f3cd8fad640 1 --2- 172.21.15.78:0/3342506569 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3cb4078bc0 0x7f3cb407b0d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.264+0000 7f3cd8fad640 1 --2- 172.21.15.78:0/3342506569 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3cd4152960 0x7f3cd41f5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.264+0000 7f3cd8fad640 1 --2- 172.21.15.78:0/3342506569 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3cc0003a50 0x7f3cd414f3e0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.264+0000 7f3cd8fad640 1 -- 172.21.15.78:0/3342506569 >> 172.21.15.78:0/3342506569 conn(0x7f3cd40cdcb0 msgr2=0x7f3cd40adfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:55.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.264+0000 7f3cd8fad640 1 -- 172.21.15.78:0/3342506569 shutdown_connections 2024-09-17T03:12:55.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.264+0000 7f3cd8fad640 1 -- 172.21.15.78:0/3342506569 wait complete. 2024-09-17T03:12:55.275 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-09-17T03:12:55.191233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":105,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236180,"kb_used_data":7448,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738540,"statfs":{"total":773094113280,"available":772852264960,"internally_reserved":0,"allocated":7626752,"data_stored":3864526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.657280"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.549259+0000","last_change":"2024-09-17T03:12:50.549259+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.549259+0000","last_undegraded":"2024-09-17T03:12:50.549259+0000","last_fullsized":"2024-09-17T03:12:50.549259+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542089+0000","last_change":"2024-09-17T03:12:50.542089+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542089+0000","last_undegraded":"2024-09-17T03:12:50.542089+0000","last_fullsized":"2024-09-17T03:12:50.542089+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.571113+0000","last_change":"2024-09-17T03:12:51.568425+0000","last_active":"2024-09-17T03:12:51.571113+0000","last_peered":"2024-09-17T03:12:51.571113+0000","last_clean":"2024-09-17T03:12:51.571113+0000","last_became_active":"2024-09-17T03:12:51.568119+0000","last_became_peered":"2024-09-17T03:12:51.568119+0000","last_unstale":"2024-09-17T03:12:51.571113+0000","last_undegraded":"2024-09-17T03:12:51.571113+0000","last_fullsized":"2024-09-17T03:12:51.571113+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:20.849138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547005+0000","last_change":"2024-09-17T03:12:50.547005+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547005+0000","last_undegraded":"2024-09-17T03:12:50.547005+0000","last_fullsized":"2024-09-17T03:12:50.547005+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544321+0000","last_change":"2024-09-17T03:12:50.544321+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544321+0000","last_undegraded":"2024-09-17T03:12:50.544321+0000","last_fullsized":"2024-09-17T03:12:50.544321+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543291+0000","last_change":"2024-09-17T03:12:50.543291+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543291+0000","last_undegraded":"2024-09-17T03:12:50.543291+0000","last_fullsized":"2024-09-17T03:12:50.543291+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548217+0000","last_change":"2024-09-17T03:12:50.548217+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548217+0000","last_undegraded":"2024-09-17T03:12:50.548217+0000","last_fullsized":"2024-09-17T03:12:50.548217+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543369+0000","last_change":"2024-09-17T03:12:50.543369+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543369+0000","last_undegraded":"2024-09-17T03:12:50.543369+0000","last_fullsized":"2024-09-17T03:12:50.543369+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543505+0000","last_change":"2024-09-17T03:12:50.543505+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543505+0000","last_undegraded":"2024-09-17T03:12:50.543505+0000","last_fullsized":"2024-09-17T03:12:50.543505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.546281+0000","last_change":"2024-09-17T03:12:50.546281+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.546281+0000","last_undegraded":"2024-09-17T03:12:50.546281+0000","last_fullsized":"2024-09-17T03:12:50.546281+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548533+0000","last_change":"2024-09-17T03:12:50.548533+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548533+0000","last_undegraded":"2024-09-17T03:12:50.548533+0000","last_fullsized":"2024-09-17T03:12:50.548533+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541339+0000","last_change":"2024-09-17T03:12:50.541339+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541339+0000","last_undegraded":"2024-09-17T03:12:50.541339+0000","last_fullsized":"2024-09-17T03:12:50.541339+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543421+0000","last_change":"2024-09-17T03:12:50.543421+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543421+0000","last_undegraded":"2024-09-17T03:12:50.543421+0000","last_fullsized":"2024-09-17T03:12:50.543421+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541795+0000","last_change":"2024-09-17T03:12:50.541795+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541795+0000","last_undegraded":"2024-09-17T03:12:50.541795+0000","last_fullsized":"2024-09-17T03:12:50.541795+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544520+0000","last_change":"2024-09-17T03:12:50.544520+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544520+0000","last_undegraded":"2024-09-17T03:12:50.544520+0000","last_fullsized":"2024-09-17T03:12:50.544520+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544499+0000","last_change":"2024-09-17T03:12:50.544499+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544499+0000","last_undegraded":"2024-09-17T03:12:50.544499+0000","last_fullsized":"2024-09-17T03:12:50.544499+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543073+0000","last_change":"2024-09-17T03:12:50.543073+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543073+0000","last_undegraded":"2024-09-17T03:12:50.543073+0000","last_fullsized":"2024-09-17T03:12:50.543073+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.540843+0000","last_change":"2024-09-17T03:12:50.540843+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.540843+0000","last_undegraded":"2024-09-17T03:12:50.540843+0000","last_fullsized":"2024-09-17T03:12:50.540843+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542778+0000","last_change":"2024-09-17T03:12:50.542778+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542778+0000","last_undegraded":"2024-09-17T03:12:50.542778+0000","last_fullsized":"2024-09-17T03:12:50.542778+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543726+0000","last_change":"2024-09-17T03:12:50.543726+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543726+0000","last_undegraded":"2024-09-17T03:12:50.543726+0000","last_fullsized":"2024-09-17T03:12:50.543726+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.545843+0000","last_change":"2024-09-17T03:12:50.545843+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.545843+0000","last_undegraded":"2024-09-17T03:12:50.545843+0000","last_fullsized":"2024-09-17T03:12:50.545843+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.545390+0000","last_change":"2024-09-17T03:12:50.545390+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.545390+0000","last_undegraded":"2024-09-17T03:12:50.545390+0000","last_fullsized":"2024-09-17T03:12:50.545390+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.545880+0000","last_change":"2024-09-17T03:12:50.545880+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.545880+0000","last_undegraded":"2024-09-17T03:12:50.545880+0000","last_fullsized":"2024-09-17T03:12:50.545880+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.550258+0000","last_change":"2024-09-17T03:12:50.550258+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.550258+0000","last_undegraded":"2024-09-17T03:12:50.550258+0000","last_fullsized":"2024-09-17T03:12:50.550258+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543553+0000","last_change":"2024-09-17T03:12:50.543553+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543553+0000","last_undegraded":"2024-09-17T03:12:50.543553+0000","last_fullsized":"2024-09-17T03:12:50.543553+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.554449+0000","last_change":"2024-09-17T03:12:50.554449+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.554449+0000","last_undegraded":"2024-09-17T03:12:50.554449+0000","last_fullsized":"2024-09-17T03:12:50.554449+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.576563+0000","last_change":"2024-09-17T03:12:51.574817+0000","last_active":"2024-09-17T03:12:51.576563+0000","last_peered":"2024-09-17T03:12:51.576563+0000","last_clean":"2024-09-17T03:12:51.576563+0000","last_became_active":"2024-09-17T03:12:51.572559+0000","last_became_peered":"2024-09-17T03:12:51.572559+0000","last_unstale":"2024-09-17T03:12:51.576563+0000","last_undegraded":"2024-09-17T03:12:51.576563+0000","last_fullsized":"2024-09-17T03:12:51.576563+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:44.874908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544444+0000","last_change":"2024-09-17T03:12:50.544444+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544444+0000","last_undegraded":"2024-09-17T03:12:50.544444+0000","last_fullsized":"2024-09-17T03:12:50.544444+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.572237+0000","last_change":"2024-09-17T03:12:51.564402+0000","last_active":"2024-09-17T03:12:51.572237+0000","last_peered":"2024-09-17T03:12:51.572237+0000","last_clean":"2024-09-17T03:12:51.572237+0000","last_became_active":"2024-09-17T03:12:51.564089+0000","last_became_peered":"2024-09-17T03:12:51.564089+0000","last_unstale":"2024-09-17T03:12:51.572237+0000","last_undegraded":"2024-09-17T03:12:51.572237+0000","last_fullsized":"2024-09-17T03:12:51.572237+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:28.591233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547193+0000","last_change":"2024-09-17T03:12:50.547193+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547193+0000","last_undegraded":"2024-09-17T03:12:50.547193+0000","last_fullsized":"2024-09-17T03:12:50.547193+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547290+0000","last_change":"2024-09-17T03:12:50.547290+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547290+0000","last_undegraded":"2024-09-17T03:12:50.547290+0000","last_fullsized":"2024-09-17T03:12:50.547290+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541696+0000","last_change":"2024-09-17T03:12:50.541696+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541696+0000","last_undegraded":"2024-09-17T03:12:50.541696+0000","last_fullsized":"2024-09-17T03:12:50.541696+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548884+0000","last_change":"2024-09-17T03:12:50.548884+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548884+0000","last_undegraded":"2024-09-17T03:12:50.548884+0000","last_fullsized":"2024-09-17T03:12:50.548884+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.559713+0000","last_change":"2024-09-17T03:12:50.558227+0000","last_active":"2024-09-17T03:12:50.559713+0000","last_peered":"2024-09-17T03:12:50.559713+0000","last_clean":"2024-09-17T03:12:50.559713+0000","last_became_active":"2024-09-17T03:12:50.557908+0000","last_became_peered":"2024-09-17T03:12:50.557908+0000","last_unstale":"2024-09-17T03:12:50.559713+0000","last_undegraded":"2024-09-17T03:12:50.559713+0000","last_fullsized":"2024-09-17T03:12:50.559713+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:22.132155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542611+0000","last_change":"2024-09-17T03:12:50.542611+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542611+0000","last_undegraded":"2024-09-17T03:12:50.542611+0000","last_fullsized":"2024-09-17T03:12:50.542611+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.559626+0000","last_change":"2024-09-17T03:12:50.555455+0000","last_active":"2024-09-17T03:12:50.559626+0000","last_peered":"2024-09-17T03:12:50.559626+0000","last_clean":"2024-09-17T03:12:50.559626+0000","last_became_active":"2024-09-17T03:12:50.555094+0000","last_became_peered":"2024-09-17T03:12:50.555094+0000","last_unstale":"2024-09-17T03:12:50.559626+0000","last_undegraded":"2024-09-17T03:12:50.559626+0000","last_fullsized":"2024-09-17T03:12:50.559626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:05.621816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543226+0000","last_change":"2024-09-17T03:12:50.543226+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543226+0000","last_undegraded":"2024-09-17T03:12:50.543226+0000","last_fullsized":"2024-09-17T03:12:50.543226+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.561045+0000","last_change":"2024-09-17T03:12:50.556466+0000","last_active":"2024-09-17T03:12:50.561045+0000","last_peered":"2024-09-17T03:12:50.561045+0000","last_clean":"2024-09-17T03:12:50.561045+0000","last_became_active":"2024-09-17T03:12:50.556101+0000","last_became_peered":"2024-09-17T03:12:50.556101+0000","last_unstale":"2024-09-17T03:12:50.561045+0000","last_undegraded":"2024-09-17T03:12:50.561045+0000","last_fullsized":"2024-09-17T03:12:50.561045+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:34.693575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548062+0000","last_change":"2024-09-17T03:12:50.548062+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548062+0000","last_undegraded":"2024-09-17T03:12:50.548062+0000","last_fullsized":"2024-09-17T03:12:50.548062+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563574+0000","last_change":"2024-09-17T03:12:50.555688+0000","last_active":"2024-09-17T03:12:50.563574+0000","last_peered":"2024-09-17T03:12:50.563574+0000","last_clean":"2024-09-17T03:12:50.563574+0000","last_became_active":"2024-09-17T03:12:50.555240+0000","last_became_peered":"2024-09-17T03:12:50.555240+0000","last_unstale":"2024-09-17T03:12:50.563574+0000","last_undegraded":"2024-09-17T03:12:50.563574+0000","last_fullsized":"2024-09-17T03:12:50.563574+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:39.506557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.546628+0000","last_change":"2024-09-17T03:12:50.546628+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.546628+0000","last_undegraded":"2024-09-17T03:12:50.546628+0000","last_fullsized":"2024-09-17T03:12:50.546628+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.582382+0000","last_change":"2024-09-17T03:12:50.559708+0000","last_active":"2024-09-17T03:12:51.582382+0000","last_peered":"2024-09-17T03:12:51.582382+0000","last_clean":"2024-09-17T03:12:51.582382+0000","last_became_active":"2024-09-17T03:12:50.559377+0000","last_became_peered":"2024-09-17T03:12:50.559377+0000","last_unstale":"2024-09-17T03:12:51.582382+0000","last_undegraded":"2024-09-17T03:12:51.582382+0000","last_fullsized":"2024-09-17T03:12:51.582382+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:32.000927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544788+0000","last_change":"2024-09-17T03:12:50.544788+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544788+0000","last_undegraded":"2024-09-17T03:12:50.544788+0000","last_fullsized":"2024-09-17T03:12:50.544788+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.555568+0000","last_change":"2024-09-17T03:12:50.552181+0000","last_active":"2024-09-17T03:12:50.555568+0000","last_peered":"2024-09-17T03:12:50.555568+0000","last_clean":"2024-09-17T03:12:50.555568+0000","last_became_active":"2024-09-17T03:12:50.551138+0000","last_became_peered":"2024-09-17T03:12:50.551138+0000","last_unstale":"2024-09-17T03:12:50.555568+0000","last_undegraded":"2024-09-17T03:12:50.555568+0000","last_fullsized":"2024-09-17T03:12:50.555568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:34.904808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541261+0000","last_change":"2024-09-17T03:12:50.541261+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541261+0000","last_undegraded":"2024-09-17T03:12:50.541261+0000","last_fullsized":"2024-09-17T03:12:50.541261+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.564746+0000","last_change":"2024-09-17T03:12:50.558633+0000","last_active":"2024-09-17T03:12:50.564746+0000","last_peered":"2024-09-17T03:12:50.564746+0000","last_clean":"2024-09-17T03:12:50.564746+0000","last_became_active":"2024-09-17T03:12:50.558373+0000","last_became_peered":"2024-09-17T03:12:50.558373+0000","last_unstale":"2024-09-17T03:12:50.564746+0000","last_undegraded":"2024-09-17T03:12:50.564746+0000","last_fullsized":"2024-09-17T03:12:50.564746+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:06.856502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542435+0000","last_change":"2024-09-17T03:12:50.542435+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542435+0000","last_undegraded":"2024-09-17T03:12:50.542435+0000","last_fullsized":"2024-09-17T03:12:50.542435+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.559600+0000","last_change":"2024-09-17T03:12:50.554790+0000","last_active":"2024-09-17T03:12:50.559600+0000","last_peered":"2024-09-17T03:12:50.559600+0000","last_clean":"2024-09-17T03:12:50.559600+0000","last_became_active":"2024-09-17T03:12:50.554441+0000","last_became_peered":"2024-09-17T03:12:50.554441+0000","last_unstale":"2024-09-17T03:12:50.559600+0000","last_undegraded":"2024-09-17T03:12:50.559600+0000","last_fullsized":"2024-09-17T03:12:50.559600+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:29.490405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548759+0000","last_change":"2024-09-17T03:12:50.548759+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548759+0000","last_undegraded":"2024-09-17T03:12:50.548759+0000","last_fullsized":"2024-09-17T03:12:50.548759+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.558393+0000","last_change":"2024-09-17T03:12:50.553084+0000","last_active":"2024-09-17T03:12:50.558393+0000","last_peered":"2024-09-17T03:12:50.558393+0000","last_clean":"2024-09-17T03:12:50.558393+0000","last_became_active":"2024-09-17T03:12:50.552769+0000","last_became_peered":"2024-09-17T03:12:50.552769+0000","last_unstale":"2024-09-17T03:12:50.558393+0000","last_undegraded":"2024-09-17T03:12:50.558393+0000","last_fullsized":"2024-09-17T03:12:50.558393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:47.537133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548699+0000","last_change":"2024-09-17T03:12:50.548699+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548699+0000","last_undegraded":"2024-09-17T03:12:50.548699+0000","last_fullsized":"2024-09-17T03:12:50.548699+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563558+0000","last_change":"2024-09-17T03:12:50.558611+0000","last_active":"2024-09-17T03:12:50.563558+0000","last_peered":"2024-09-17T03:12:50.563558+0000","last_clean":"2024-09-17T03:12:50.563558+0000","last_became_active":"2024-09-17T03:12:50.558320+0000","last_became_peered":"2024-09-17T03:12:50.558320+0000","last_unstale":"2024-09-17T03:12:50.563558+0000","last_undegraded":"2024-09-17T03:12:50.563558+0000","last_fullsized":"2024-09-17T03:12:50.563558+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:06.039361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542447+0000","last_change":"2024-09-17T03:12:50.542447+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542447+0000","last_undegraded":"2024-09-17T03:12:50.542447+0000","last_fullsized":"2024-09-17T03:12:50.542447+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.580643+0000","last_change":"2024-09-17T03:12:50.560334+0000","last_active":"2024-09-17T03:12:51.580643+0000","last_peered":"2024-09-17T03:12:51.580643+0000","last_clean":"2024-09-17T03:12:51.580643+0000","last_became_active":"2024-09-17T03:12:50.560015+0000","last_became_peered":"2024-09-17T03:12:50.560015+0000","last_unstale":"2024-09-17T03:12:51.580643+0000","last_undegraded":"2024-09-17T03:12:51.580643+0000","last_fullsized":"2024-09-17T03:12:51.580643+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:33.899941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542401+0000","last_change":"2024-09-17T03:12:50.542401+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542401+0000","last_undegraded":"2024-09-17T03:12:50.542401+0000","last_fullsized":"2024-09-17T03:12:50.542401+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.557166+0000","last_change":"2024-09-17T03:12:50.551177+0000","last_active":"2024-09-17T03:12:50.557166+0000","last_peered":"2024-09-17T03:12:50.557166+0000","last_clean":"2024-09-17T03:12:50.557166+0000","last_became_active":"2024-09-17T03:12:50.550823+0000","last_became_peered":"2024-09-17T03:12:50.550823+0000","last_unstale":"2024-09-17T03:12:50.557166+0000","last_undegraded":"2024-09-17T03:12:50.557166+0000","last_fullsized":"2024-09-17T03:12:50.557166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:37.066429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.546344+0000","last_change":"2024-09-17T03:12:50.546344+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.546344+0000","last_undegraded":"2024-09-17T03:12:50.546344+0000","last_fullsized":"2024-09-17T03:12:50.546344+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.560350+0000","last_change":"2024-09-17T03:12:50.553725+0000","last_active":"2024-09-17T03:12:50.560350+0000","last_peered":"2024-09-17T03:12:50.560350+0000","last_clean":"2024-09-17T03:12:50.560350+0000","last_became_active":"2024-09-17T03:12:50.553296+0000","last_became_peered":"2024-09-17T03:12:50.553296+0000","last_unstale":"2024-09-17T03:12:50.560350+0000","last_undegraded":"2024-09-17T03:12:50.560350+0000","last_fullsized":"2024-09-17T03:12:50.560350+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:29.780411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547759+0000","last_change":"2024-09-17T03:12:50.547759+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547759+0000","last_undegraded":"2024-09-17T03:12:50.547759+0000","last_fullsized":"2024-09-17T03:12:50.547759+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.555592+0000","last_change":"2024-09-17T03:12:50.552439+0000","last_active":"2024-09-17T03:12:50.555592+0000","last_peered":"2024-09-17T03:12:50.555592+0000","last_clean":"2024-09-17T03:12:50.555592+0000","last_became_active":"2024-09-17T03:12:50.552147+0000","last_became_peered":"2024-09-17T03:12:50.552147+0000","last_unstale":"2024-09-17T03:12:50.555592+0000","last_undegraded":"2024-09-17T03:12:50.555592+0000","last_fullsized":"2024-09-17T03:12:50.555592+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:26.420432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542458+0000","last_change":"2024-09-17T03:12:50.542458+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542458+0000","last_undegraded":"2024-09-17T03:12:50.542458+0000","last_fullsized":"2024-09-17T03:12:50.542458+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563679+0000","last_change":"2024-09-17T03:12:50.558884+0000","last_active":"2024-09-17T03:12:50.563679+0000","last_peered":"2024-09-17T03:12:50.563679+0000","last_clean":"2024-09-17T03:12:50.563679+0000","last_became_active":"2024-09-17T03:12:50.558550+0000","last_became_peered":"2024-09-17T03:12:50.558550+0000","last_unstale":"2024-09-17T03:12:50.563679+0000","last_undegraded":"2024-09-17T03:12:50.563679+0000","last_fullsized":"2024-09-17T03:12:50.563679+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:18:36.626293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541278+0000","last_change":"2024-09-17T03:12:50.541278+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541278+0000","last_undegraded":"2024-09-17T03:12:50.541278+0000","last_fullsized":"2024-09-17T03:12:50.541278+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.561131+0000","last_change":"2024-09-17T03:12:50.556886+0000","last_active":"2024-09-17T03:12:50.561131+0000","last_peered":"2024-09-17T03:12:50.561131+0000","last_clean":"2024-09-17T03:12:50.561131+0000","last_became_active":"2024-09-17T03:12:50.556092+0000","last_became_peered":"2024-09-17T03:12:50.556092+0000","last_unstale":"2024-09-17T03:12:50.561131+0000","last_undegraded":"2024-09-17T03:12:50.561131+0000","last_fullsized":"2024-09-17T03:12:50.561131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:19.970449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.545286+0000","last_change":"2024-09-17T03:12:50.545286+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.545286+0000","last_undegraded":"2024-09-17T03:12:50.545286+0000","last_fullsized":"2024-09-17T03:12:50.545286+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.555534+0000","last_change":"2024-09-17T03:12:50.553551+0000","last_active":"2024-09-17T03:12:50.555534+0000","last_peered":"2024-09-17T03:12:50.555534+0000","last_clean":"2024-09-17T03:12:50.555534+0000","last_became_active":"2024-09-17T03:12:50.553028+0000","last_became_peered":"2024-09-17T03:12:50.553028+0000","last_unstale":"2024-09-17T03:12:50.555534+0000","last_undegraded":"2024-09-17T03:12:50.555534+0000","last_fullsized":"2024-09-17T03:12:50.555534+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:15.682903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547383+0000","last_change":"2024-09-17T03:12:50.547383+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547383+0000","last_undegraded":"2024-09-17T03:12:50.547383+0000","last_fullsized":"2024-09-17T03:12:50.547383+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.561103+0000","last_change":"2024-09-17T03:12:50.556871+0000","last_active":"2024-09-17T03:12:50.561103+0000","last_peered":"2024-09-17T03:12:50.561103+0000","last_clean":"2024-09-17T03:12:50.561103+0000","last_became_active":"2024-09-17T03:12:50.556543+0000","last_became_peered":"2024-09-17T03:12:50.556543+0000","last_unstale":"2024-09-17T03:12:50.561103+0000","last_undegraded":"2024-09-17T03:12:50.561103+0000","last_fullsized":"2024-09-17T03:12:50.561103+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:02.158974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.540760+0000","last_change":"2024-09-17T03:12:50.540760+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.540760+0000","last_undegraded":"2024-09-17T03:12:50.540760+0000","last_fullsized":"2024-09-17T03:12:50.540760+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563779+0000","last_change":"2024-09-17T03:12:50.559567+0000","last_active":"2024-09-17T03:12:50.563779+0000","last_peered":"2024-09-17T03:12:50.563779+0000","last_clean":"2024-09-17T03:12:50.563779+0000","last_became_active":"2024-09-17T03:12:50.559272+0000","last_became_peered":"2024-09-17T03:12:50.559272+0000","last_unstale":"2024-09-17T03:12:50.563779+0000","last_undegraded":"2024-09-17T03:12:50.563779+0000","last_fullsized":"2024-09-17T03:12:50.563779+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:25.932754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541762+0000","last_change":"2024-09-17T03:12:50.541762+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541762+0000","last_undegraded":"2024-09-17T03:12:50.541762+0000","last_fullsized":"2024-09-17T03:12:50.541762+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.562647+0000","last_change":"2024-09-17T03:12:50.561368+0000","last_active":"2024-09-17T03:12:50.562647+0000","last_peered":"2024-09-17T03:12:50.562647+0000","last_clean":"2024-09-17T03:12:50.562647+0000","last_became_active":"2024-09-17T03:12:50.561048+0000","last_became_peered":"2024-09-17T03:12:50.561048+0000","last_unstale":"2024-09-17T03:12:50.562647+0000","last_undegraded":"2024-09-17T03:12:50.562647+0000","last_fullsized":"2024-09-17T03:12:50.562647+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:05.621816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.572267+0000","last_change":"2024-09-17T03:12:51.569311+0000","last_active":"2024-09-17T03:12:51.572267+0000","last_peered":"2024-09-17T03:12:51.572267+0000","last_clean":"2024-09-17T03:12:51.572267+0000","last_became_active":"2024-09-17T03:12:51.568983+0000","last_became_peered":"2024-09-17T03:12:51.568983+0000","last_unstale":"2024-09-17T03:12:51.572267+0000","last_undegraded":"2024-09-17T03:12:51.572267+0000","last_fullsized":"2024-09-17T03:12:51.572267+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:15:30.514819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.555619+0000","last_change":"2024-09-17T03:12:50.553656+0000","last_active":"2024-09-17T03:12:50.555619+0000","last_peered":"2024-09-17T03:12:50.555619+0000","last_clean":"2024-09-17T03:12:50.555619+0000","last_became_active":"2024-09-17T03:12:50.553349+0000","last_became_peered":"2024-09-17T03:12:50.553349+0000","last_unstale":"2024-09-17T03:12:50.555619+0000","last_undegraded":"2024-09-17T03:12:50.555619+0000","last_fullsized":"2024-09-17T03:12:50.555619+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:08.565374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.572396+0000","last_change":"2024-09-17T03:12:51.570982+0000","last_active":"2024-09-17T03:12:51.572396+0000","last_peered":"2024-09-17T03:12:51.572396+0000","last_clean":"2024-09-17T03:12:51.572396+0000","last_became_active":"2024-09-17T03:12:51.570683+0000","last_became_peered":"2024-09-17T03:12:51.570683+0000","last_unstale":"2024-09-17T03:12:51.572396+0000","last_undegraded":"2024-09-17T03:12:51.572396+0000","last_fullsized":"2024-09-17T03:12:51.572396+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:55.497465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.569126+0000","last_change":"2024-09-17T03:12:50.561347+0000","last_active":"2024-09-17T03:12:50.569126+0000","last_peered":"2024-09-17T03:12:50.569126+0000","last_clean":"2024-09-17T03:12:50.569126+0000","last_became_active":"2024-09-17T03:12:50.561045+0000","last_became_peered":"2024-09-17T03:12:50.561045+0000","last_unstale":"2024-09-17T03:12:50.569126+0000","last_undegraded":"2024-09-17T03:12:50.569126+0000","last_fullsized":"2024-09-17T03:12:50.569126+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:30.710367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.571609+0000","last_change":"2024-09-17T03:12:51.570718+0000","last_active":"2024-09-17T03:12:51.571609+0000","last_peered":"2024-09-17T03:12:51.571609+0000","last_clean":"2024-09-17T03:12:51.571609+0000","last_became_active":"2024-09-17T03:12:51.570374+0000","last_became_peered":"2024-09-17T03:12:51.570374+0000","last_unstale":"2024-09-17T03:12:51.571609+0000","last_undegraded":"2024-09-17T03:12:51.571609+0000","last_fullsized":"2024-09-17T03:12:51.571609+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:29.522439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.556966+0000","last_change":"2024-09-17T03:12:50.552653+0000","last_active":"2024-09-17T03:12:50.556966+0000","last_peered":"2024-09-17T03:12:50.556966+0000","last_clean":"2024-09-17T03:12:50.556966+0000","last_became_active":"2024-09-17T03:12:50.552331+0000","last_became_peered":"2024-09-17T03:12:50.552331+0000","last_unstale":"2024-09-17T03:12:50.556966+0000","last_undegraded":"2024-09-17T03:12:50.556966+0000","last_fullsized":"2024-09-17T03:12:50.556966+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:22.132155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544145+0000","last_change":"2024-09-17T03:12:50.544145+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544145+0000","last_undegraded":"2024-09-17T03:12:50.544145+0000","last_fullsized":"2024-09-17T03:12:50.544145+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.555506+0000","last_change":"2024-09-17T03:12:50.552772+0000","last_active":"2024-09-17T03:12:50.555506+0000","last_peered":"2024-09-17T03:12:50.555506+0000","last_clean":"2024-09-17T03:12:50.555506+0000","last_became_active":"2024-09-17T03:12:50.552430+0000","last_became_peered":"2024-09-17T03:12:50.552430+0000","last_unstale":"2024-09-17T03:12:50.555506+0000","last_undegraded":"2024-09-17T03:12:50.555506+0000","last_fullsized":"2024-09-17T03:12:50.555506+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:55.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.549984+0000","last_change":"2024-09-17T03:12:50.549984+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.549984+0000","last_undegraded":"2024-09-17T03:12:50.549984+0000","last_fullsized":"2024-09-17T03:12:50.549984+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563760+0000","last_change":"2024-09-17T03:12:50.559793+0000","last_active":"2024-09-17T03:12:50.563760+0000","last_peered":"2024-09-17T03:12:50.563760+0000","last_clean":"2024-09-17T03:12:50.563760+0000","last_became_active":"2024-09-17T03:12:50.559454+0000","last_became_peered":"2024-09-17T03:12:50.559454+0000","last_unstale":"2024-09-17T03:12:50.563760+0000","last_undegraded":"2024-09-17T03:12:50.563760+0000","last_fullsized":"2024-09-17T03:12:50.563760+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:31.013515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547078+0000","last_change":"2024-09-17T03:12:50.547078+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547078+0000","last_undegraded":"2024-09-17T03:12:50.547078+0000","last_fullsized":"2024-09-17T03:12:50.547078+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.556806+0000","last_change":"2024-09-17T03:12:50.553233+0000","last_active":"2024-09-17T03:12:50.556806+0000","last_peered":"2024-09-17T03:12:50.556806+0000","last_clean":"2024-09-17T03:12:50.556806+0000","last_became_active":"2024-09-17T03:12:50.552920+0000","last_became_peered":"2024-09-17T03:12:50.552920+0000","last_unstale":"2024-09-17T03:12:50.556806+0000","last_undegraded":"2024-09-17T03:12:50.556806+0000","last_fullsized":"2024-09-17T03:12:50.556806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:07.400568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547310+0000","last_change":"2024-09-17T03:12:50.547310+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547310+0000","last_undegraded":"2024-09-17T03:12:50.547310+0000","last_fullsized":"2024-09-17T03:12:50.547310+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.564860+0000","last_change":"2024-09-17T03:12:50.559436+0000","last_active":"2024-09-17T03:12:50.564860+0000","last_peered":"2024-09-17T03:12:50.564860+0000","last_clean":"2024-09-17T03:12:50.564860+0000","last_became_active":"2024-09-17T03:12:50.559077+0000","last_became_peered":"2024-09-17T03:12:50.559077+0000","last_unstale":"2024-09-17T03:12:50.564860+0000","last_undegraded":"2024-09-17T03:12:50.564860+0000","last_fullsized":"2024-09-17T03:12:50.564860+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:41.572485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541233+0000","last_change":"2024-09-17T03:12:50.541233+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541233+0000","last_undegraded":"2024-09-17T03:12:50.541233+0000","last_fullsized":"2024-09-17T03:12:50.541233+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.564737+0000","last_change":"2024-09-17T03:12:50.560680+0000","last_active":"2024-09-17T03:12:50.564737+0000","last_peered":"2024-09-17T03:12:50.564737+0000","last_clean":"2024-09-17T03:12:50.564737+0000","last_became_active":"2024-09-17T03:12:50.560340+0000","last_became_peered":"2024-09-17T03:12:50.560340+0000","last_unstale":"2024-09-17T03:12:50.564737+0000","last_undegraded":"2024-09-17T03:12:50.564737+0000","last_fullsized":"2024-09-17T03:12:50.564737+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:12.420245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542062+0000","last_change":"2024-09-17T03:12:50.542062+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542062+0000","last_undegraded":"2024-09-17T03:12:50.542062+0000","last_fullsized":"2024-09-17T03:12:50.542062+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.564702+0000","last_change":"2024-09-17T03:12:50.557733+0000","last_active":"2024-09-17T03:12:50.564702+0000","last_peered":"2024-09-17T03:12:50.564702+0000","last_clean":"2024-09-17T03:12:50.564702+0000","last_became_active":"2024-09-17T03:12:50.557424+0000","last_became_peered":"2024-09-17T03:12:50.557424+0000","last_unstale":"2024-09-17T03:12:50.564702+0000","last_undegraded":"2024-09-17T03:12:50.564702+0000","last_fullsized":"2024-09-17T03:12:50.564702+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:32.780892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.540756+0000","last_change":"2024-09-17T03:12:50.540756+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.540756+0000","last_undegraded":"2024-09-17T03:12:50.540756+0000","last_fullsized":"2024-09-17T03:12:50.540756+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.561192+0000","last_change":"2024-09-17T03:12:50.557649+0000","last_active":"2024-09-17T03:12:50.561192+0000","last_peered":"2024-09-17T03:12:50.561192+0000","last_clean":"2024-09-17T03:12:50.561192+0000","last_became_active":"2024-09-17T03:12:50.557285+0000","last_became_peered":"2024-09-17T03:12:50.557285+0000","last_unstale":"2024-09-17T03:12:50.561192+0000","last_undegraded":"2024-09-17T03:12:50.561192+0000","last_fullsized":"2024-09-17T03:12:50.561192+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:08.528321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541432+0000","last_change":"2024-09-17T03:12:50.541432+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541432+0000","last_undegraded":"2024-09-17T03:12:50.541432+0000","last_fullsized":"2024-09-17T03:12:50.541432+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563547+0000","last_change":"2024-09-17T03:12:50.555756+0000","last_active":"2024-09-17T03:12:50.563547+0000","last_peered":"2024-09-17T03:12:50.563547+0000","last_clean":"2024-09-17T03:12:50.563547+0000","last_became_active":"2024-09-17T03:12:50.555359+0000","last_became_peered":"2024-09-17T03:12:50.555359+0000","last_unstale":"2024-09-17T03:12:50.563547+0000","last_undegraded":"2024-09-17T03:12:50.563547+0000","last_fullsized":"2024-09-17T03:12:50.563547+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:01.133168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.575596+0000","last_change":"2024-09-17T03:12:51.571810+0000","last_active":"2024-09-17T03:12:51.575596+0000","last_peered":"2024-09-17T03:12:51.575596+0000","last_clean":"2024-09-17T03:12:51.575596+0000","last_became_active":"2024-09-17T03:12:51.571483+0000","last_became_peered":"2024-09-17T03:12:51.571483+0000","last_unstale":"2024-09-17T03:12:51.575596+0000","last_undegraded":"2024-09-17T03:12:51.575596+0000","last_fullsized":"2024-09-17T03:12:51.575596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:22.216990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.560629+0000","last_change":"2024-09-17T03:12:50.554998+0000","last_active":"2024-09-17T03:12:50.560629+0000","last_peered":"2024-09-17T03:12:50.560629+0000","last_clean":"2024-09-17T03:12:50.560629+0000","last_became_active":"2024-09-17T03:12:50.554357+0000","last_became_peered":"2024-09-17T03:12:50.554357+0000","last_unstale":"2024-09-17T03:12:50.560629+0000","last_undegraded":"2024-09-17T03:12:50.560629+0000","last_fullsized":"2024-09-17T03:12:50.560629+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:57.263039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":190,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.550472+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:12:50.550472+0000","last_peered":"2024-09-17T03:12:50.550472+0000","last_clean":"2024-09-17T03:12:50.550472+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:12:50.550472+0000","last_undegraded":"2024-09-17T03:12:50.550472+0000","last_fullsized":"2024-09-17T03:12:50.550472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509499,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":1388544,"data_stored":921059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509499,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":794624,"data_stored":330691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509498,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":336966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":336966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509500,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":806912,"data_stored":336966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509499,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":806912,"data_stored":336966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509499,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1388544,"data_stored":921059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":827392,"data_stored":343853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:12:55.281 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3f is not active+clean 2024-09-17T03:12:55.281 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.549259+0000', 'last_change': '2024-09-17T03:12:50.549259+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.549259+0000', 'last_undegraded': '2024-09-17T03:12:50.549259+0000', 'last_fullsized': '2024-09-17T03:12:50.549259+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:12:55.281 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3e is not active+clean 2024-09-17T03:12:55.281 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.542089+0000', 'last_change': '2024-09-17T03:12:50.542089+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.542089+0000', 'last_undegraded': '2024-09-17T03:12:50.542089+0000', 'last_fullsized': '2024-09-17T03:12:50.542089+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:12:55.281 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3c is not active+clean 2024-09-17T03:12:55.281 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.547005+0000', 'last_change': '2024-09-17T03:12:50.547005+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.547005+0000', 'last_undegraded': '2024-09-17T03:12:50.547005+0000', 'last_fullsized': '2024-09-17T03:12:50.547005+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:12:55.282 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3b is not active+clean 2024-09-17T03:12:55.282 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.544321+0000', 'last_change': '2024-09-17T03:12:50.544321+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.544321+0000', 'last_undegraded': '2024-09-17T03:12:50.544321+0000', 'last_fullsized': '2024-09-17T03:12:50.544321+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:12:55.282 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3a is not active+clean 2024-09-17T03:12:55.282 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.543291+0000', 'last_change': '2024-09-17T03:12:50.543291+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.543291+0000', 'last_undegraded': '2024-09-17T03:12:50.543291+0000', 'last_fullsized': '2024-09-17T03:12:50.543291+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:12:55.282 INFO:tasks.ceph.ceph_manager.ceph:PG 11.39 is not active+clean 2024-09-17T03:12:55.282 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.548217+0000', 'last_change': '2024-09-17T03:12:50.548217+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.548217+0000', 'last_undegraded': '2024-09-17T03:12:50.548217+0000', 'last_fullsized': '2024-09-17T03:12:50.548217+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:12:55.282 INFO:tasks.ceph.ceph_manager.ceph:PG 11.38 is not active+clean 2024-09-17T03:12:55.282 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.543369+0000', 'last_change': '2024-09-17T03:12:50.543369+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.543369+0000', 'last_undegraded': '2024-09-17T03:12:50.543369+0000', 'last_fullsized': '2024-09-17T03:12:50.543369+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:12:55.282 INFO:tasks.ceph.ceph_manager.ceph:PG 11.37 is not active+clean 2024-09-17T03:12:55.282 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.543505+0000', 'last_change': '2024-09-17T03:12:50.543505+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.543505+0000', 'last_undegraded': '2024-09-17T03:12:50.543505+0000', 'last_fullsized': '2024-09-17T03:12:50.543505+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:12:55.282 INFO:tasks.ceph.ceph_manager.ceph:PG 11.36 is not active+clean 2024-09-17T03:12:55.282 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.546281+0000', 'last_change': '2024-09-17T03:12:50.546281+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.546281+0000', 'last_undegraded': '2024-09-17T03:12:50.546281+0000', 'last_fullsized': '2024-09-17T03:12:50.546281+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:12:55.283 INFO:tasks.ceph.ceph_manager.ceph:PG 11.35 is not active+clean 2024-09-17T03:12:55.283 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.548533+0000', 'last_change': '2024-09-17T03:12:50.548533+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.548533+0000', 'last_undegraded': '2024-09-17T03:12:50.548533+0000', 'last_fullsized': '2024-09-17T03:12:50.548533+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:12:55.283 INFO:tasks.ceph.ceph_manager.ceph:PG 11.34 is not active+clean 2024-09-17T03:12:55.283 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.541339+0000', 'last_change': '2024-09-17T03:12:50.541339+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.541339+0000', 'last_undegraded': '2024-09-17T03:12:50.541339+0000', 'last_fullsized': '2024-09-17T03:12:50.541339+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:12:55.283 INFO:tasks.ceph.ceph_manager.ceph:PG 11.33 is not active+clean 2024-09-17T03:12:55.283 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.543421+0000', 'last_change': '2024-09-17T03:12:50.543421+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.543421+0000', 'last_undegraded': '2024-09-17T03:12:50.543421+0000', 'last_fullsized': '2024-09-17T03:12:50.543421+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:12:55.283 INFO:tasks.ceph.ceph_manager.ceph:PG 11.32 is not active+clean 2024-09-17T03:12:55.283 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.541795+0000', 'last_change': '2024-09-17T03:12:50.541795+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.541795+0000', 'last_undegraded': '2024-09-17T03:12:50.541795+0000', 'last_fullsized': '2024-09-17T03:12:50.541795+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:12:55.283 INFO:tasks.ceph.ceph_manager.ceph:PG 11.31 is not active+clean 2024-09-17T03:12:55.283 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.544520+0000', 'last_change': '2024-09-17T03:12:50.544520+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.544520+0000', 'last_undegraded': '2024-09-17T03:12:50.544520+0000', 'last_fullsized': '2024-09-17T03:12:50.544520+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:12:55.284 INFO:tasks.ceph.ceph_manager.ceph:PG 11.30 is not active+clean 2024-09-17T03:12:55.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.544499+0000', 'last_change': '2024-09-17T03:12:50.544499+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.544499+0000', 'last_undegraded': '2024-09-17T03:12:50.544499+0000', 'last_fullsized': '2024-09-17T03:12:50.544499+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:12:55.284 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2f is not active+clean 2024-09-17T03:12:55.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.543073+0000', 'last_change': '2024-09-17T03:12:50.543073+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.543073+0000', 'last_undegraded': '2024-09-17T03:12:50.543073+0000', 'last_fullsized': '2024-09-17T03:12:50.543073+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:12:55.284 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2e is not active+clean 2024-09-17T03:12:55.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.540843+0000', 'last_change': '2024-09-17T03:12:50.540843+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.540843+0000', 'last_undegraded': '2024-09-17T03:12:50.540843+0000', 'last_fullsized': '2024-09-17T03:12:50.540843+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:12:55.284 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2d is not active+clean 2024-09-17T03:12:55.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.542778+0000', 'last_change': '2024-09-17T03:12:50.542778+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.542778+0000', 'last_undegraded': '2024-09-17T03:12:50.542778+0000', 'last_fullsized': '2024-09-17T03:12:50.542778+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:12:55.284 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2c is not active+clean 2024-09-17T03:12:55.284 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.543726+0000', 'last_change': '2024-09-17T03:12:50.543726+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.543726+0000', 'last_undegraded': '2024-09-17T03:12:50.543726+0000', 'last_fullsized': '2024-09-17T03:12:50.543726+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:12:55.284 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2b is not active+clean 2024-09-17T03:12:55.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.545843+0000', 'last_change': '2024-09-17T03:12:50.545843+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.545843+0000', 'last_undegraded': '2024-09-17T03:12:50.545843+0000', 'last_fullsized': '2024-09-17T03:12:50.545843+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:12:55.285 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2a is not active+clean 2024-09-17T03:12:55.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.545390+0000', 'last_change': '2024-09-17T03:12:50.545390+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.545390+0000', 'last_undegraded': '2024-09-17T03:12:50.545390+0000', 'last_fullsized': '2024-09-17T03:12:50.545390+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:12:55.285 INFO:tasks.ceph.ceph_manager.ceph:PG 11.29 is not active+clean 2024-09-17T03:12:55.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.545880+0000', 'last_change': '2024-09-17T03:12:50.545880+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.545880+0000', 'last_undegraded': '2024-09-17T03:12:50.545880+0000', 'last_fullsized': '2024-09-17T03:12:50.545880+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:12:55.285 INFO:tasks.ceph.ceph_manager.ceph:PG 11.28 is not active+clean 2024-09-17T03:12:55.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.550258+0000', 'last_change': '2024-09-17T03:12:50.550258+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.550258+0000', 'last_undegraded': '2024-09-17T03:12:50.550258+0000', 'last_fullsized': '2024-09-17T03:12:50.550258+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:12:55.285 INFO:tasks.ceph.ceph_manager.ceph:PG 11.27 is not active+clean 2024-09-17T03:12:55.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.543553+0000', 'last_change': '2024-09-17T03:12:50.543553+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.543553+0000', 'last_undegraded': '2024-09-17T03:12:50.543553+0000', 'last_fullsized': '2024-09-17T03:12:50.543553+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:12:55.285 INFO:tasks.ceph.ceph_manager.ceph:PG 11.26 is not active+clean 2024-09-17T03:12:55.285 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.554449+0000', 'last_change': '2024-09-17T03:12:50.554449+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.554449+0000', 'last_undegraded': '2024-09-17T03:12:50.554449+0000', 'last_fullsized': '2024-09-17T03:12:50.554449+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:12:55.286 INFO:tasks.ceph.ceph_manager.ceph:PG 11.24 is not active+clean 2024-09-17T03:12:55.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.544444+0000', 'last_change': '2024-09-17T03:12:50.544444+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.544444+0000', 'last_undegraded': '2024-09-17T03:12:50.544444+0000', 'last_fullsized': '2024-09-17T03:12:50.544444+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:12:55.286 INFO:tasks.ceph.ceph_manager.ceph:PG 11.22 is not active+clean 2024-09-17T03:12:55.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.547193+0000', 'last_change': '2024-09-17T03:12:50.547193+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.547193+0000', 'last_undegraded': '2024-09-17T03:12:50.547193+0000', 'last_fullsized': '2024-09-17T03:12:50.547193+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:12:55.286 INFO:tasks.ceph.ceph_manager.ceph:PG 11.21 is not active+clean 2024-09-17T03:12:55.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.547290+0000', 'last_change': '2024-09-17T03:12:50.547290+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.547290+0000', 'last_undegraded': '2024-09-17T03:12:50.547290+0000', 'last_fullsized': '2024-09-17T03:12:50.547290+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:12:55.286 INFO:tasks.ceph.ceph_manager.ceph:PG 11.20 is not active+clean 2024-09-17T03:12:55.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.541696+0000', 'last_change': '2024-09-17T03:12:50.541696+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.541696+0000', 'last_undegraded': '2024-09-17T03:12:50.541696+0000', 'last_fullsized': '2024-09-17T03:12:50.541696+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:12:55.286 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1e is not active+clean 2024-09-17T03:12:55.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.548884+0000', 'last_change': '2024-09-17T03:12:50.548884+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.548884+0000', 'last_undegraded': '2024-09-17T03:12:50.548884+0000', 'last_fullsized': '2024-09-17T03:12:50.548884+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:12:55.286 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1f is not active+clean 2024-09-17T03:12:55.286 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.542611+0000', 'last_change': '2024-09-17T03:12:50.542611+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.542611+0000', 'last_undegraded': '2024-09-17T03:12:50.542611+0000', 'last_fullsized': '2024-09-17T03:12:50.542611+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:12:55.287 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1c is not active+clean 2024-09-17T03:12:55.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.543226+0000', 'last_change': '2024-09-17T03:12:50.543226+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.543226+0000', 'last_undegraded': '2024-09-17T03:12:50.543226+0000', 'last_fullsized': '2024-09-17T03:12:50.543226+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:12:55.287 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1d is not active+clean 2024-09-17T03:12:55.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.548062+0000', 'last_change': '2024-09-17T03:12:50.548062+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.548062+0000', 'last_undegraded': '2024-09-17T03:12:50.548062+0000', 'last_fullsized': '2024-09-17T03:12:50.548062+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:12:55.287 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1a is not active+clean 2024-09-17T03:12:55.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.546628+0000', 'last_change': '2024-09-17T03:12:50.546628+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.546628+0000', 'last_undegraded': '2024-09-17T03:12:50.546628+0000', 'last_fullsized': '2024-09-17T03:12:50.546628+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:12:55.287 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1b is not active+clean 2024-09-17T03:12:55.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.544788+0000', 'last_change': '2024-09-17T03:12:50.544788+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.544788+0000', 'last_undegraded': '2024-09-17T03:12:50.544788+0000', 'last_fullsized': '2024-09-17T03:12:50.544788+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:12:55.287 INFO:tasks.ceph.ceph_manager.ceph:PG 11.18 is not active+clean 2024-09-17T03:12:55.287 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.541261+0000', 'last_change': '2024-09-17T03:12:50.541261+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.541261+0000', 'last_undegraded': '2024-09-17T03:12:50.541261+0000', 'last_fullsized': '2024-09-17T03:12:50.541261+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:12:55.287 INFO:tasks.ceph.ceph_manager.ceph:PG 11.19 is not active+clean 2024-09-17T03:12:55.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.542435+0000', 'last_change': '2024-09-17T03:12:50.542435+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.542435+0000', 'last_undegraded': '2024-09-17T03:12:50.542435+0000', 'last_fullsized': '2024-09-17T03:12:50.542435+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:12:55.288 INFO:tasks.ceph.ceph_manager.ceph:PG 11.16 is not active+clean 2024-09-17T03:12:55.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.548759+0000', 'last_change': '2024-09-17T03:12:50.548759+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.548759+0000', 'last_undegraded': '2024-09-17T03:12:50.548759+0000', 'last_fullsized': '2024-09-17T03:12:50.548759+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:12:55.288 INFO:tasks.ceph.ceph_manager.ceph:PG 11.17 is not active+clean 2024-09-17T03:12:55.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.548699+0000', 'last_change': '2024-09-17T03:12:50.548699+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.548699+0000', 'last_undegraded': '2024-09-17T03:12:50.548699+0000', 'last_fullsized': '2024-09-17T03:12:50.548699+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:12:55.288 INFO:tasks.ceph.ceph_manager.ceph:PG 11.14 is not active+clean 2024-09-17T03:12:55.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.542447+0000', 'last_change': '2024-09-17T03:12:50.542447+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.542447+0000', 'last_undegraded': '2024-09-17T03:12:50.542447+0000', 'last_fullsized': '2024-09-17T03:12:50.542447+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:12:55.288 INFO:tasks.ceph.ceph_manager.ceph:PG 11.15 is not active+clean 2024-09-17T03:12:55.288 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.542401+0000', 'last_change': '2024-09-17T03:12:50.542401+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.542401+0000', 'last_undegraded': '2024-09-17T03:12:50.542401+0000', 'last_fullsized': '2024-09-17T03:12:50.542401+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:12:55.288 INFO:tasks.ceph.ceph_manager.ceph:PG 11.12 is not active+clean 2024-09-17T03:12:55.289 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.546344+0000', 'last_change': '2024-09-17T03:12:50.546344+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.546344+0000', 'last_undegraded': '2024-09-17T03:12:50.546344+0000', 'last_fullsized': '2024-09-17T03:12:50.546344+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:12:55.289 INFO:tasks.ceph.ceph_manager.ceph:PG 11.13 is not active+clean 2024-09-17T03:12:55.289 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.547759+0000', 'last_change': '2024-09-17T03:12:50.547759+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.547759+0000', 'last_undegraded': '2024-09-17T03:12:50.547759+0000', 'last_fullsized': '2024-09-17T03:12:50.547759+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:12:55.289 INFO:tasks.ceph.ceph_manager.ceph:PG 11.10 is not active+clean 2024-09-17T03:12:55.289 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.542458+0000', 'last_change': '2024-09-17T03:12:50.542458+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.542458+0000', 'last_undegraded': '2024-09-17T03:12:50.542458+0000', 'last_fullsized': '2024-09-17T03:12:50.542458+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:12:55.289 INFO:tasks.ceph.ceph_manager.ceph:PG 11.11 is not active+clean 2024-09-17T03:12:55.289 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.541278+0000', 'last_change': '2024-09-17T03:12:50.541278+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.541278+0000', 'last_undegraded': '2024-09-17T03:12:50.541278+0000', 'last_fullsized': '2024-09-17T03:12:50.541278+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:12:55.289 INFO:tasks.ceph.ceph_manager.ceph:PG 11.e is not active+clean 2024-09-17T03:12:55.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.545286+0000', 'last_change': '2024-09-17T03:12:50.545286+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.545286+0000', 'last_undegraded': '2024-09-17T03:12:50.545286+0000', 'last_fullsized': '2024-09-17T03:12:50.545286+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:12:55.290 INFO:tasks.ceph.ceph_manager.ceph:PG 11.f is not active+clean 2024-09-17T03:12:55.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.547383+0000', 'last_change': '2024-09-17T03:12:50.547383+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.547383+0000', 'last_undegraded': '2024-09-17T03:12:50.547383+0000', 'last_fullsized': '2024-09-17T03:12:50.547383+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:12:55.290 INFO:tasks.ceph.ceph_manager.ceph:PG 11.c is not active+clean 2024-09-17T03:12:55.290 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.540760+0000', 'last_change': '2024-09-17T03:12:50.540760+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.540760+0000', 'last_undegraded': '2024-09-17T03:12:50.540760+0000', 'last_fullsized': '2024-09-17T03:12:50.540760+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:12:55.290 INFO:tasks.ceph.ceph_manager.ceph:PG 11.d is not active+clean 2024-09-17T03:12:55.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.541762+0000', 'last_change': '2024-09-17T03:12:50.541762+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.541762+0000', 'last_undegraded': '2024-09-17T03:12:50.541762+0000', 'last_fullsized': '2024-09-17T03:12:50.541762+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:12:55.291 INFO:tasks.ceph.ceph_manager.ceph:PG 11.6 is not active+clean 2024-09-17T03:12:55.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.544145+0000', 'last_change': '2024-09-17T03:12:50.544145+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.544145+0000', 'last_undegraded': '2024-09-17T03:12:50.544145+0000', 'last_fullsized': '2024-09-17T03:12:50.544145+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:12:55.291 INFO:tasks.ceph.ceph_manager.ceph:PG 11.7 is not active+clean 2024-09-17T03:12:55.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.549984+0000', 'last_change': '2024-09-17T03:12:50.549984+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.549984+0000', 'last_undegraded': '2024-09-17T03:12:50.549984+0000', 'last_fullsized': '2024-09-17T03:12:50.549984+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T03:12:55.291 INFO:tasks.ceph.ceph_manager.ceph:PG 11.4 is not active+clean 2024-09-17T03:12:55.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.547078+0000', 'last_change': '2024-09-17T03:12:50.547078+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.547078+0000', 'last_undegraded': '2024-09-17T03:12:50.547078+0000', 'last_fullsized': '2024-09-17T03:12:50.547078+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:12:55.291 INFO:tasks.ceph.ceph_manager.ceph:PG 11.5 is not active+clean 2024-09-17T03:12:55.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.547310+0000', 'last_change': '2024-09-17T03:12:50.547310+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.547310+0000', 'last_undegraded': '2024-09-17T03:12:50.547310+0000', 'last_fullsized': '2024-09-17T03:12:50.547310+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T03:12:55.291 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2 is not active+clean 2024-09-17T03:12:55.291 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.541233+0000', 'last_change': '2024-09-17T03:12:50.541233+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.541233+0000', 'last_undegraded': '2024-09-17T03:12:50.541233+0000', 'last_fullsized': '2024-09-17T03:12:50.541233+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:12:55.292 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3 is not active+clean 2024-09-17T03:12:55.292 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.542062+0000', 'last_change': '2024-09-17T03:12:50.542062+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.542062+0000', 'last_undegraded': '2024-09-17T03:12:50.542062+0000', 'last_fullsized': '2024-09-17T03:12:50.542062+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:12:55.292 INFO:tasks.ceph.ceph_manager.ceph:PG 11.0 is not active+clean 2024-09-17T03:12:55.292 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.540756+0000', 'last_change': '2024-09-17T03:12:50.540756+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.540756+0000', 'last_undegraded': '2024-09-17T03:12:50.540756+0000', 'last_fullsized': '2024-09-17T03:12:50.540756+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T03:12:55.292 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1 is not active+clean 2024-09-17T03:12:55.292 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2024-09-17T03:12:50.541432+0000', 'last_change': '2024-09-17T03:12:50.541432+0000', 'last_active': '2024-09-17T03:12:50.532927+0000', 'last_peered': '2024-09-17T03:12:50.532927+0000', 'last_clean': '2024-09-17T03:12:50.532927+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:12:50.541432+0000', 'last_undegraded': '2024-09-17T03:12:50.541432+0000', 'last_fullsized': '2024-09-17T03:12:50.541432+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'last_clean_scrub_stamp': '2024-09-17T03:12:50.532927+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T03:12:55.293 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:12:55.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.426+0000 7fb00310b640 1 -- 172.21.15.78:0/622780772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faffc0d29d0 msgr2=0x7faffc0cff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:55.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.426+0000 7fb00310b640 1 --2- 172.21.15.78:0/622780772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faffc0d29d0 0x7faffc0cff00 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7faffc0747a0 tx=0x7faff402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.426+0000 7fb00310b640 1 -- 172.21.15.78:0/622780772 shutdown_connections 2024-09-17T03:12:55.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.426+0000 7fb00310b640 1 --2- 172.21.15.78:0/622780772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faffc0d29d0 0x7faffc0cff00 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.426+0000 7fb00310b640 1 --2- 172.21.15.78:0/622780772 >> v2:172.21.15.193:3300/0 conn(0x7faffc0d1d50 0x7faffc15c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.426+0000 7fb00310b640 1 -- 172.21.15.78:0/622780772 >> 172.21.15.78:0/622780772 conn(0x7faffc06d230 msgr2=0x7faffc06d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.426+0000 7fb00310b640 1 -- 172.21.15.78:0/622780772 shutdown_connections 2024-09-17T03:12:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.426+0000 7fb00310b640 1 -- 172.21.15.78:0/622780772 wait complete. 2024-09-17T03:12:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.428+0000 7fb00310b640 1 Processor -- start 2024-09-17T03:12:55.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.428+0000 7fb00310b640 1 -- start start 2024-09-17T03:12:55.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.429+0000 7fb00310b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faffc0b15b0 0x7faffc150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:55.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.429+0000 7fb00310b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faffc0d1d50 0x7faffc0c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:55.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.429+0000 7fb00310b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faffc1519e0 0x7faffc0b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:55.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.429+0000 7fb00310b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7faffc0d07d0 con 0x7faffc0b15b0 2024-09-17T03:12:55.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.429+0000 7fb00310b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faffc0d0650 con 0x7faffc0d1d50 2024-09-17T03:12:55.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.429+0000 7fb00310b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7faffc0d0950 con 0x7faffc1519e0 2024-09-17T03:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.429+0000 7fb000ea7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faffc0b15b0 0x7faffc150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.429+0000 7fb000ea7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faffc0b15b0 0x7faffc150d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35132/0 (socket says 172.21.15.78:35132) 2024-09-17T03:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.429+0000 7fb000ea7640 1 -- 172.21.15.78:0/704113306 learned_addr learned my addr 172.21.15.78:0/704113306 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.430+0000 7fb0016a8640 1 --2- 172.21.15.78:0/704113306 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faffc1519e0 0x7faffc0b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.430+0000 7faffbfff640 1 --2- 172.21.15.78:0/704113306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faffc0d1d50 0x7faffc0c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.430+0000 7fb000ea7640 1 -- 172.21.15.78:0/704113306 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faffc1519e0 msgr2=0x7faffc0b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.430+0000 7fb000ea7640 1 --2- 172.21.15.78:0/704113306 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faffc1519e0 0x7faffc0b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.430+0000 7fb000ea7640 1 -- 172.21.15.78:0/704113306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faffc0d1d50 msgr2=0x7faffc0c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.430+0000 7fb000ea7640 1 --2- 172.21.15.78:0/704113306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faffc0d1d50 0x7faffc0c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.430+0000 7fb000ea7640 1 -- 172.21.15.78:0/704113306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faffc15e250 con 0x7faffc0b15b0 2024-09-17T03:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.430+0000 7faffbfff640 1 --2- 172.21.15.78:0/704113306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faffc0d1d50 0x7faffc0c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.430+0000 7fb0016a8640 1 --2- 172.21.15.78:0/704113306 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faffc1519e0 0x7faffc0b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.430+0000 7fb000ea7640 1 --2- 172.21.15.78:0/704113306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faffc0b15b0 0x7faffc150d70 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fafec00d770 tx=0x7fafec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.430+0000 7faff97fa640 1 -- 172.21.15.78:0/704113306 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec017070 con 0x7faffc0b15b0 2024-09-17T03:12:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.430+0000 7faff97fa640 1 -- 172.21.15.78:0/704113306 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafec009d20 con 0x7faffc0b15b0 2024-09-17T03:12:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.430+0000 7fb00310b640 1 -- 172.21.15.78:0/704113306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faffc15e530 con 0x7faffc0b15b0 2024-09-17T03:12:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.430+0000 7faff97fa640 1 -- 172.21.15.78:0/704113306 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafec0106c0 con 0x7faffc0b15b0 2024-09-17T03:12:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.430+0000 7fb00310b640 1 -- 172.21.15.78:0/704113306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faffc0b1d40 con 0x7faffc0b15b0 2024-09-17T03:12:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.431+0000 7fb00310b640 1 -- 172.21.15.78:0/704113306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faffc0d0e90 con 0x7faffc0b15b0 2024-09-17T03:12:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.432+0000 7faff97fa640 1 -- 172.21.15.78:0/704113306 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fafec01a070 con 0x7faffc0b15b0 2024-09-17T03:12:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.432+0000 7faff97fa640 1 --2- 172.21.15.78:0/704113306 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fafe8078b90 0x7fafe807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.432+0000 7faff97fa640 1 -- 172.21.15.78:0/704113306 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fafec09adf0 con 0x7faffc0b15b0 2024-09-17T03:12:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.433+0000 7faffbfff640 1 --2- 172.21.15.78:0/704113306 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fafe8078b90 0x7fafe807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.433+0000 7faffbfff640 1 --2- 172.21.15.78:0/704113306 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fafe8078b90 0x7fafe807b0a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7faffc0d1420 tx=0x7faff0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.437+0000 7faff97fa640 1 -- 172.21.15.78:0/704113306 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fafec063350 con 0x7faffc0b15b0 2024-09-17T03:12:55.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.678+0000 7fb00310b640 1 -- 172.21.15.78:0/704113306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7faffc15f990 con 0x7faffc0b15b0 2024-09-17T03:12:55.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.679+0000 7faff97fa640 1 -- 172.21.15.78:0/704113306 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1559 (secure 0 0 0) 0x7fafec062c50 con 0x7faffc0b15b0 2024-09-17T03:12:55.680 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:12:55.680 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":292,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":69,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":57},{"state_name":"active+clean","count":40}],"num_pgs":97,"num_pools":3,"num_objects":4,"data_bytes":590458,"bytes_used":241848320,"bytes_avail":772852264960,"bytes_total":773094113280,"inactive_pgs_ratio":0.58762884140014648,"write_bytes_sec":181,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":61,"btime":"2024-09-17T03:12:53:561218+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":6864}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-17T03:12:31.185413+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:12:55.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.681+0000 7fb00310b640 1 -- 172.21.15.78:0/704113306 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fafe8078b90 msgr2=0x7fafe807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:55.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.681+0000 7fb00310b640 1 --2- 172.21.15.78:0/704113306 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fafe8078b90 0x7fafe807b0a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7faffc0d1420 tx=0x7faff0009040 comp rx=0 tx=0).stop 2024-09-17T03:12:55.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.681+0000 7fb00310b640 1 -- 172.21.15.78:0/704113306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faffc0b15b0 msgr2=0x7faffc150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:55.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.681+0000 7fb00310b640 1 --2- 172.21.15.78:0/704113306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faffc0b15b0 0x7faffc150d70 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fafec00d770 tx=0x7fafec00dc30 comp rx=0 tx=0).stop 2024-09-17T03:12:55.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.681+0000 7fb00310b640 1 -- 172.21.15.78:0/704113306 shutdown_connections 2024-09-17T03:12:55.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.681+0000 7fb00310b640 1 --2- 172.21.15.78:0/704113306 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faffc1519e0 0x7faffc0b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.681+0000 7fb00310b640 1 --2- 172.21.15.78:0/704113306 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fafe8078b90 0x7fafe807b0a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.681+0000 7fb00310b640 1 --2- 172.21.15.78:0/704113306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faffc0d1d50 0x7faffc0c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.681+0000 7fb00310b640 1 --2- 172.21.15.78:0/704113306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faffc0b15b0 0x7faffc150d70 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.681+0000 7fb00310b640 1 -- 172.21.15.78:0/704113306 >> 172.21.15.78:0/704113306 conn(0x7faffc06d230 msgr2=0x7faffc0cc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:55.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.681+0000 7fb00310b640 1 -- 172.21.15.78:0/704113306 shutdown_connections 2024-09-17T03:12:55.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.681+0000 7fb00310b640 1 -- 172.21.15.78:0/704113306 wait complete. 2024-09-17T03:12:55.693 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:12:55.694 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:12:55.789 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:12:55.792 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:12:55.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.809+0000 7fd9d49f1640 1 -- 172.21.15.78:0/2094707290 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd9d015dee0 msgr2=0x7fd9d015e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:55.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.809+0000 7fd9d49f1640 1 --2- 172.21.15.78:0/2094707290 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd9d015dee0 0x7fd9d015e2f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009ca0 tx=0x7fd9c802aac0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.809+0000 7fd9d49f1640 1 -- 172.21.15.78:0/2094707290 shutdown_connections 2024-09-17T03:12:55.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.809+0000 7fd9d49f1640 1 --2- 172.21.15.78:0/2094707290 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd9d015dee0 0x7fd9d015e2f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.809+0000 7fd9d49f1640 1 --2- 172.21.15.78:0/2094707290 >> v2:172.21.15.193:3300/0 conn(0x7fd9d015fc60 0x7fd9d00b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.809+0000 7fd9d49f1640 1 -- 172.21.15.78:0/2094707290 >> 172.21.15.78:0/2094707290 conn(0x7fd9d0073fa0 msgr2=0x7fd9d00743e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:55.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.809+0000 7fd9d49f1640 1 -- 172.21.15.78:0/2094707290 shutdown_connections 2024-09-17T03:12:55.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.809+0000 7fd9d49f1640 1 -- 172.21.15.78:0/2094707290 wait complete. 2024-09-17T03:12:55.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.811+0000 7fd9d49f1640 1 Processor -- start 2024-09-17T03:12:55.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.811+0000 7fd9d49f1640 1 -- start start 2024-09-17T03:12:55.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.813+0000 7fd9d49f1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9d015dee0 0x7fd9d0156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:55.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.813+0000 7fd9d49f1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd9d015fc60 0x7fd9d00af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:55.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.813+0000 7fd9d49f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9d0160210 0x7fd9d0150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:55.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.813+0000 7fd9d49f1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d015ebc0 con 0x7fd9d0160210 2024-09-17T03:12:55.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.813+0000 7fd9d49f1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d015ea40 con 0x7fd9d015dee0 2024-09-17T03:12:55.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.813+0000 7fd9d49f1640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd9d015ed40 con 0x7fd9d015fc60 2024-09-17T03:12:55.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.813+0000 7fd9ced9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9d0160210 0x7fd9d0150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:55.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.813+0000 7fd9ced9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9d0160210 0x7fd9d0150ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35146/0 (socket says 172.21.15.78:35146) 2024-09-17T03:12:55.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.813+0000 7fd9ced9d640 1 -- 172.21.15.78:0/3120457721 learned_addr learned my addr 172.21.15.78:0/3120457721 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:55.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.813+0000 7fd9ce59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9d015dee0 0x7fd9d0156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:55.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.813+0000 7fd9cdd9b640 1 --2- 172.21.15.78:0/3120457721 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd9d015fc60 0x7fd9d00af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:55.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.813+0000 7fd9ced9d640 1 -- 172.21.15.78:0/3120457721 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd9d015fc60 msgr2=0x7fd9d00af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:55.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.813+0000 7fd9ced9d640 1 --2- 172.21.15.78:0/3120457721 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd9d015fc60 0x7fd9d00af870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.813+0000 7fd9ced9d640 1 -- 172.21.15.78:0/3120457721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9d015dee0 msgr2=0x7fd9d0156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:55.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.813+0000 7fd9ced9d640 1 --2- 172.21.15.78:0/3120457721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9d015dee0 0x7fd9d0156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:55.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.813+0000 7fd9ced9d640 1 -- 172.21.15.78:0/3120457721 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d014f190 con 0x7fd9d0160210 2024-09-17T03:12:55.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.813+0000 7fd9ce59c640 1 --2- 172.21.15.78:0/3120457721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9d015dee0 0x7fd9d0156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:12:55.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.814+0000 7fd9ced9d640 1 --2- 172.21.15.78:0/3120457721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9d0160210 0x7fd9d0150ae0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009dc0 tx=0x7fd9c8003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:55.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.814+0000 7fd9c6ffd640 1 -- 172.21.15.78:0/3120457721 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8003e50 con 0x7fd9d0160210 2024-09-17T03:12:55.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.814+0000 7fd9c6ffd640 1 -- 172.21.15.78:0/3120457721 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9c8004250 con 0x7fd9d0160210 2024-09-17T03:12:55.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.814+0000 7fd9c6ffd640 1 -- 172.21.15.78:0/3120457721 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8004680 con 0x7fd9d0160210 2024-09-17T03:12:55.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.814+0000 7fd9d49f1640 1 -- 172.21.15.78:0/3120457721 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d00afdb0 con 0x7fd9d0160210 2024-09-17T03:12:55.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.814+0000 7fd9d49f1640 1 -- 172.21.15.78:0/3120457721 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d014f6e0 con 0x7fd9d0160210 2024-09-17T03:12:55.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.815+0000 7fd9d49f1640 1 -- 172.21.15.78:0/3120457721 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9d0156b30 con 0x7fd9d0160210 2024-09-17T03:12:55.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.816+0000 7fd9c6ffd640 1 -- 172.21.15.78:0/3120457721 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd9c8049440 con 0x7fd9d0160210 2024-09-17T03:12:55.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.816+0000 7fd9c6ffd640 1 --2- 172.21.15.78:0/3120457721 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd9b0078d30 0x7fd9b007b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:55.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.816+0000 7fd9c6ffd640 1 -- 172.21.15.78:0/3120457721 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fd9c80bbf90 con 0x7fd9d0160210 2024-09-17T03:12:55.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.816+0000 7fd9ce59c640 1 --2- 172.21.15.78:0/3120457721 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd9b0078d30 0x7fd9b007b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:55.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.817+0000 7fd9ce59c640 1 --2- 172.21.15.78:0/3120457721 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd9b0078d30 0x7fd9b007b240 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00095f0 tx=0x7fd9c0005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:55.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.821+0000 7fd9c6ffd640 1 -- 172.21.15.78:0/3120457721 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd9c8032030 con 0x7fd9d0160210 2024-09-17T03:12:55.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.993+0000 7fd9d49f1640 1 -- 172.21.15.78:0/3120457721 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd9d00d0480 con 0x7fd9b0078d30 2024-09-17T03:12:55.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:55.998+0000 7fd9c6ffd640 1 -- 172.21.15.78:0/3120457721 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247355 (secure 0 0 0) 0x7fd9d00d0480 con 0x7fd9b0078d30 2024-09-17T03:12:56.000 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:12:56.001 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:12:56.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:56.001+0000 7fd9d49f1640 1 -- 172.21.15.78:0/3120457721 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd9b0078d30 msgr2=0x7fd9b007b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:56.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:56.001+0000 7fd9d49f1640 1 --2- 172.21.15.78:0/3120457721 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd9b0078d30 0x7fd9b007b240 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd9c00095f0 tx=0x7fd9c0005f90 comp rx=0 tx=0).stop 2024-09-17T03:12:56.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:56.001+0000 7fd9d49f1640 1 -- 172.21.15.78:0/3120457721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9d0160210 msgr2=0x7fd9d0150ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:56.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:56.001+0000 7fd9d49f1640 1 --2- 172.21.15.78:0/3120457721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9d0160210 0x7fd9d0150ae0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009dc0 tx=0x7fd9c8003ce0 comp rx=0 tx=0).stop 2024-09-17T03:12:56.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:56.001+0000 7fd9d49f1640 1 -- 172.21.15.78:0/3120457721 shutdown_connections 2024-09-17T03:12:56.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:56.001+0000 7fd9d49f1640 1 --2- 172.21.15.78:0/3120457721 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9d0160210 0x7fd9d0150ae0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:56.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:56.001+0000 7fd9d49f1640 1 --2- 172.21.15.78:0/3120457721 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd9d015fc60 0x7fd9d00af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:56.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:56.001+0000 7fd9d49f1640 1 --2- 172.21.15.78:0/3120457721 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd9b0078d30 0x7fd9b007b240 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:56.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:56.001+0000 7fd9d49f1640 1 --2- 172.21.15.78:0/3120457721 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd9d015dee0 0x7fd9d0156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:56.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:56.001+0000 7fd9d49f1640 1 -- 172.21.15.78:0/3120457721 >> 172.21.15.78:0/3120457721 conn(0x7fd9d0073fa0 msgr2=0x7fd9d00b0650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:56.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:56.001+0000 7fd9d49f1640 1 -- 172.21.15.78:0/3120457721 shutdown_connections 2024-09-17T03:12:56.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:56.001+0000 7fd9d49f1640 1 -- 172.21.15.78:0/3120457721 wait complete. 2024-09-17T03:12:56.012 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-09-17T03:12:55.191233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590458,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":105,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236180,"kb_used_data":7448,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754738540,"statfs":{"total":773094113280,"available":772852264960,"internally_reserved":0,"allocated":7626752,"data_stored":3864526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.657280"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.549259+0000","last_change":"2024-09-17T03:12:50.549259+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.549259+0000","last_undegraded":"2024-09-17T03:12:50.549259+0000","last_fullsized":"2024-09-17T03:12:50.549259+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542089+0000","last_change":"2024-09-17T03:12:50.542089+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542089+0000","last_undegraded":"2024-09-17T03:12:50.542089+0000","last_fullsized":"2024-09-17T03:12:50.542089+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.571113+0000","last_change":"2024-09-17T03:12:51.568425+0000","last_active":"2024-09-17T03:12:51.571113+0000","last_peered":"2024-09-17T03:12:51.571113+0000","last_clean":"2024-09-17T03:12:51.571113+0000","last_became_active":"2024-09-17T03:12:51.568119+0000","last_became_peered":"2024-09-17T03:12:51.568119+0000","last_unstale":"2024-09-17T03:12:51.571113+0000","last_undegraded":"2024-09-17T03:12:51.571113+0000","last_fullsized":"2024-09-17T03:12:51.571113+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:20.849138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547005+0000","last_change":"2024-09-17T03:12:50.547005+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547005+0000","last_undegraded":"2024-09-17T03:12:50.547005+0000","last_fullsized":"2024-09-17T03:12:50.547005+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544321+0000","last_change":"2024-09-17T03:12:50.544321+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544321+0000","last_undegraded":"2024-09-17T03:12:50.544321+0000","last_fullsized":"2024-09-17T03:12:50.544321+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543291+0000","last_change":"2024-09-17T03:12:50.543291+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543291+0000","last_undegraded":"2024-09-17T03:12:50.543291+0000","last_fullsized":"2024-09-17T03:12:50.543291+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548217+0000","last_change":"2024-09-17T03:12:50.548217+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548217+0000","last_undegraded":"2024-09-17T03:12:50.548217+0000","last_fullsized":"2024-09-17T03:12:50.548217+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543369+0000","last_change":"2024-09-17T03:12:50.543369+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543369+0000","last_undegraded":"2024-09-17T03:12:50.543369+0000","last_fullsized":"2024-09-17T03:12:50.543369+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543505+0000","last_change":"2024-09-17T03:12:50.543505+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543505+0000","last_undegraded":"2024-09-17T03:12:50.543505+0000","last_fullsized":"2024-09-17T03:12:50.543505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.546281+0000","last_change":"2024-09-17T03:12:50.546281+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.546281+0000","last_undegraded":"2024-09-17T03:12:50.546281+0000","last_fullsized":"2024-09-17T03:12:50.546281+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548533+0000","last_change":"2024-09-17T03:12:50.548533+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548533+0000","last_undegraded":"2024-09-17T03:12:50.548533+0000","last_fullsized":"2024-09-17T03:12:50.548533+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541339+0000","last_change":"2024-09-17T03:12:50.541339+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541339+0000","last_undegraded":"2024-09-17T03:12:50.541339+0000","last_fullsized":"2024-09-17T03:12:50.541339+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543421+0000","last_change":"2024-09-17T03:12:50.543421+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543421+0000","last_undegraded":"2024-09-17T03:12:50.543421+0000","last_fullsized":"2024-09-17T03:12:50.543421+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541795+0000","last_change":"2024-09-17T03:12:50.541795+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541795+0000","last_undegraded":"2024-09-17T03:12:50.541795+0000","last_fullsized":"2024-09-17T03:12:50.541795+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544520+0000","last_change":"2024-09-17T03:12:50.544520+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544520+0000","last_undegraded":"2024-09-17T03:12:50.544520+0000","last_fullsized":"2024-09-17T03:12:50.544520+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544499+0000","last_change":"2024-09-17T03:12:50.544499+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544499+0000","last_undegraded":"2024-09-17T03:12:50.544499+0000","last_fullsized":"2024-09-17T03:12:50.544499+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543073+0000","last_change":"2024-09-17T03:12:50.543073+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543073+0000","last_undegraded":"2024-09-17T03:12:50.543073+0000","last_fullsized":"2024-09-17T03:12:50.543073+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.540843+0000","last_change":"2024-09-17T03:12:50.540843+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.540843+0000","last_undegraded":"2024-09-17T03:12:50.540843+0000","last_fullsized":"2024-09-17T03:12:50.540843+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542778+0000","last_change":"2024-09-17T03:12:50.542778+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542778+0000","last_undegraded":"2024-09-17T03:12:50.542778+0000","last_fullsized":"2024-09-17T03:12:50.542778+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543726+0000","last_change":"2024-09-17T03:12:50.543726+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543726+0000","last_undegraded":"2024-09-17T03:12:50.543726+0000","last_fullsized":"2024-09-17T03:12:50.543726+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.545843+0000","last_change":"2024-09-17T03:12:50.545843+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.545843+0000","last_undegraded":"2024-09-17T03:12:50.545843+0000","last_fullsized":"2024-09-17T03:12:50.545843+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.545390+0000","last_change":"2024-09-17T03:12:50.545390+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.545390+0000","last_undegraded":"2024-09-17T03:12:50.545390+0000","last_fullsized":"2024-09-17T03:12:50.545390+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.545880+0000","last_change":"2024-09-17T03:12:50.545880+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.545880+0000","last_undegraded":"2024-09-17T03:12:50.545880+0000","last_fullsized":"2024-09-17T03:12:50.545880+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.550258+0000","last_change":"2024-09-17T03:12:50.550258+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.550258+0000","last_undegraded":"2024-09-17T03:12:50.550258+0000","last_fullsized":"2024-09-17T03:12:50.550258+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543553+0000","last_change":"2024-09-17T03:12:50.543553+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543553+0000","last_undegraded":"2024-09-17T03:12:50.543553+0000","last_fullsized":"2024-09-17T03:12:50.543553+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.554449+0000","last_change":"2024-09-17T03:12:50.554449+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.554449+0000","last_undegraded":"2024-09-17T03:12:50.554449+0000","last_fullsized":"2024-09-17T03:12:50.554449+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.576563+0000","last_change":"2024-09-17T03:12:51.574817+0000","last_active":"2024-09-17T03:12:51.576563+0000","last_peered":"2024-09-17T03:12:51.576563+0000","last_clean":"2024-09-17T03:12:51.576563+0000","last_became_active":"2024-09-17T03:12:51.572559+0000","last_became_peered":"2024-09-17T03:12:51.572559+0000","last_unstale":"2024-09-17T03:12:51.576563+0000","last_undegraded":"2024-09-17T03:12:51.576563+0000","last_fullsized":"2024-09-17T03:12:51.576563+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:44.874908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544444+0000","last_change":"2024-09-17T03:12:50.544444+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544444+0000","last_undegraded":"2024-09-17T03:12:50.544444+0000","last_fullsized":"2024-09-17T03:12:50.544444+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.572237+0000","last_change":"2024-09-17T03:12:51.564402+0000","last_active":"2024-09-17T03:12:51.572237+0000","last_peered":"2024-09-17T03:12:51.572237+0000","last_clean":"2024-09-17T03:12:51.572237+0000","last_became_active":"2024-09-17T03:12:51.564089+0000","last_became_peered":"2024-09-17T03:12:51.564089+0000","last_unstale":"2024-09-17T03:12:51.572237+0000","last_undegraded":"2024-09-17T03:12:51.572237+0000","last_fullsized":"2024-09-17T03:12:51.572237+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:28.591233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547193+0000","last_change":"2024-09-17T03:12:50.547193+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547193+0000","last_undegraded":"2024-09-17T03:12:50.547193+0000","last_fullsized":"2024-09-17T03:12:50.547193+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547290+0000","last_change":"2024-09-17T03:12:50.547290+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547290+0000","last_undegraded":"2024-09-17T03:12:50.547290+0000","last_fullsized":"2024-09-17T03:12:50.547290+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541696+0000","last_change":"2024-09-17T03:12:50.541696+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541696+0000","last_undegraded":"2024-09-17T03:12:50.541696+0000","last_fullsized":"2024-09-17T03:12:50.541696+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548884+0000","last_change":"2024-09-17T03:12:50.548884+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548884+0000","last_undegraded":"2024-09-17T03:12:50.548884+0000","last_fullsized":"2024-09-17T03:12:50.548884+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.559713+0000","last_change":"2024-09-17T03:12:50.558227+0000","last_active":"2024-09-17T03:12:50.559713+0000","last_peered":"2024-09-17T03:12:50.559713+0000","last_clean":"2024-09-17T03:12:50.559713+0000","last_became_active":"2024-09-17T03:12:50.557908+0000","last_became_peered":"2024-09-17T03:12:50.557908+0000","last_unstale":"2024-09-17T03:12:50.559713+0000","last_undegraded":"2024-09-17T03:12:50.559713+0000","last_fullsized":"2024-09-17T03:12:50.559713+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:22.132155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542611+0000","last_change":"2024-09-17T03:12:50.542611+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542611+0000","last_undegraded":"2024-09-17T03:12:50.542611+0000","last_fullsized":"2024-09-17T03:12:50.542611+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.559626+0000","last_change":"2024-09-17T03:12:50.555455+0000","last_active":"2024-09-17T03:12:50.559626+0000","last_peered":"2024-09-17T03:12:50.559626+0000","last_clean":"2024-09-17T03:12:50.559626+0000","last_became_active":"2024-09-17T03:12:50.555094+0000","last_became_peered":"2024-09-17T03:12:50.555094+0000","last_unstale":"2024-09-17T03:12:50.559626+0000","last_undegraded":"2024-09-17T03:12:50.559626+0000","last_fullsized":"2024-09-17T03:12:50.559626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:05.621816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.543226+0000","last_change":"2024-09-17T03:12:50.543226+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.543226+0000","last_undegraded":"2024-09-17T03:12:50.543226+0000","last_fullsized":"2024-09-17T03:12:50.543226+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.561045+0000","last_change":"2024-09-17T03:12:50.556466+0000","last_active":"2024-09-17T03:12:50.561045+0000","last_peered":"2024-09-17T03:12:50.561045+0000","last_clean":"2024-09-17T03:12:50.561045+0000","last_became_active":"2024-09-17T03:12:50.556101+0000","last_became_peered":"2024-09-17T03:12:50.556101+0000","last_unstale":"2024-09-17T03:12:50.561045+0000","last_undegraded":"2024-09-17T03:12:50.561045+0000","last_fullsized":"2024-09-17T03:12:50.561045+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:34.693575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548062+0000","last_change":"2024-09-17T03:12:50.548062+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548062+0000","last_undegraded":"2024-09-17T03:12:50.548062+0000","last_fullsized":"2024-09-17T03:12:50.548062+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563574+0000","last_change":"2024-09-17T03:12:50.555688+0000","last_active":"2024-09-17T03:12:50.563574+0000","last_peered":"2024-09-17T03:12:50.563574+0000","last_clean":"2024-09-17T03:12:50.563574+0000","last_became_active":"2024-09-17T03:12:50.555240+0000","last_became_peered":"2024-09-17T03:12:50.555240+0000","last_unstale":"2024-09-17T03:12:50.563574+0000","last_undegraded":"2024-09-17T03:12:50.563574+0000","last_fullsized":"2024-09-17T03:12:50.563574+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:39.506557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.546628+0000","last_change":"2024-09-17T03:12:50.546628+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.546628+0000","last_undegraded":"2024-09-17T03:12:50.546628+0000","last_fullsized":"2024-09-17T03:12:50.546628+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.582382+0000","last_change":"2024-09-17T03:12:50.559708+0000","last_active":"2024-09-17T03:12:51.582382+0000","last_peered":"2024-09-17T03:12:51.582382+0000","last_clean":"2024-09-17T03:12:51.582382+0000","last_became_active":"2024-09-17T03:12:50.559377+0000","last_became_peered":"2024-09-17T03:12:50.559377+0000","last_unstale":"2024-09-17T03:12:51.582382+0000","last_undegraded":"2024-09-17T03:12:51.582382+0000","last_fullsized":"2024-09-17T03:12:51.582382+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:32.000927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544788+0000","last_change":"2024-09-17T03:12:50.544788+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544788+0000","last_undegraded":"2024-09-17T03:12:50.544788+0000","last_fullsized":"2024-09-17T03:12:50.544788+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.555568+0000","last_change":"2024-09-17T03:12:50.552181+0000","last_active":"2024-09-17T03:12:50.555568+0000","last_peered":"2024-09-17T03:12:50.555568+0000","last_clean":"2024-09-17T03:12:50.555568+0000","last_became_active":"2024-09-17T03:12:50.551138+0000","last_became_peered":"2024-09-17T03:12:50.551138+0000","last_unstale":"2024-09-17T03:12:50.555568+0000","last_undegraded":"2024-09-17T03:12:50.555568+0000","last_fullsized":"2024-09-17T03:12:50.555568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:34.904808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541261+0000","last_change":"2024-09-17T03:12:50.541261+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541261+0000","last_undegraded":"2024-09-17T03:12:50.541261+0000","last_fullsized":"2024-09-17T03:12:50.541261+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.564746+0000","last_change":"2024-09-17T03:12:50.558633+0000","last_active":"2024-09-17T03:12:50.564746+0000","last_peered":"2024-09-17T03:12:50.564746+0000","last_clean":"2024-09-17T03:12:50.564746+0000","last_became_active":"2024-09-17T03:12:50.558373+0000","last_became_peered":"2024-09-17T03:12:50.558373+0000","last_unstale":"2024-09-17T03:12:50.564746+0000","last_undegraded":"2024-09-17T03:12:50.564746+0000","last_fullsized":"2024-09-17T03:12:50.564746+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:52:06.856502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542435+0000","last_change":"2024-09-17T03:12:50.542435+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542435+0000","last_undegraded":"2024-09-17T03:12:50.542435+0000","last_fullsized":"2024-09-17T03:12:50.542435+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.559600+0000","last_change":"2024-09-17T03:12:50.554790+0000","last_active":"2024-09-17T03:12:50.559600+0000","last_peered":"2024-09-17T03:12:50.559600+0000","last_clean":"2024-09-17T03:12:50.559600+0000","last_became_active":"2024-09-17T03:12:50.554441+0000","last_became_peered":"2024-09-17T03:12:50.554441+0000","last_unstale":"2024-09-17T03:12:50.559600+0000","last_undegraded":"2024-09-17T03:12:50.559600+0000","last_fullsized":"2024-09-17T03:12:50.559600+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:21:29.490405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548759+0000","last_change":"2024-09-17T03:12:50.548759+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548759+0000","last_undegraded":"2024-09-17T03:12:50.548759+0000","last_fullsized":"2024-09-17T03:12:50.548759+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.558393+0000","last_change":"2024-09-17T03:12:50.553084+0000","last_active":"2024-09-17T03:12:50.558393+0000","last_peered":"2024-09-17T03:12:50.558393+0000","last_clean":"2024-09-17T03:12:50.558393+0000","last_became_active":"2024-09-17T03:12:50.552769+0000","last_became_peered":"2024-09-17T03:12:50.552769+0000","last_unstale":"2024-09-17T03:12:50.558393+0000","last_undegraded":"2024-09-17T03:12:50.558393+0000","last_fullsized":"2024-09-17T03:12:50.558393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:47.537133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.548699+0000","last_change":"2024-09-17T03:12:50.548699+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.548699+0000","last_undegraded":"2024-09-17T03:12:50.548699+0000","last_fullsized":"2024-09-17T03:12:50.548699+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563558+0000","last_change":"2024-09-17T03:12:50.558611+0000","last_active":"2024-09-17T03:12:50.563558+0000","last_peered":"2024-09-17T03:12:50.563558+0000","last_clean":"2024-09-17T03:12:50.563558+0000","last_became_active":"2024-09-17T03:12:50.558320+0000","last_became_peered":"2024-09-17T03:12:50.558320+0000","last_unstale":"2024-09-17T03:12:50.563558+0000","last_undegraded":"2024-09-17T03:12:50.563558+0000","last_fullsized":"2024-09-17T03:12:50.563558+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:06.039361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542447+0000","last_change":"2024-09-17T03:12:50.542447+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542447+0000","last_undegraded":"2024-09-17T03:12:50.542447+0000","last_fullsized":"2024-09-17T03:12:50.542447+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.580643+0000","last_change":"2024-09-17T03:12:50.560334+0000","last_active":"2024-09-17T03:12:51.580643+0000","last_peered":"2024-09-17T03:12:51.580643+0000","last_clean":"2024-09-17T03:12:51.580643+0000","last_became_active":"2024-09-17T03:12:50.560015+0000","last_became_peered":"2024-09-17T03:12:50.560015+0000","last_unstale":"2024-09-17T03:12:51.580643+0000","last_undegraded":"2024-09-17T03:12:51.580643+0000","last_fullsized":"2024-09-17T03:12:51.580643+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:33.899941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542401+0000","last_change":"2024-09-17T03:12:50.542401+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542401+0000","last_undegraded":"2024-09-17T03:12:50.542401+0000","last_fullsized":"2024-09-17T03:12:50.542401+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.557166+0000","last_change":"2024-09-17T03:12:50.551177+0000","last_active":"2024-09-17T03:12:50.557166+0000","last_peered":"2024-09-17T03:12:50.557166+0000","last_clean":"2024-09-17T03:12:50.557166+0000","last_became_active":"2024-09-17T03:12:50.550823+0000","last_became_peered":"2024-09-17T03:12:50.550823+0000","last_unstale":"2024-09-17T03:12:50.557166+0000","last_undegraded":"2024-09-17T03:12:50.557166+0000","last_fullsized":"2024-09-17T03:12:50.557166+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:37.066429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.546344+0000","last_change":"2024-09-17T03:12:50.546344+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.546344+0000","last_undegraded":"2024-09-17T03:12:50.546344+0000","last_fullsized":"2024-09-17T03:12:50.546344+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.560350+0000","last_change":"2024-09-17T03:12:50.553725+0000","last_active":"2024-09-17T03:12:50.560350+0000","last_peered":"2024-09-17T03:12:50.560350+0000","last_clean":"2024-09-17T03:12:50.560350+0000","last_became_active":"2024-09-17T03:12:50.553296+0000","last_became_peered":"2024-09-17T03:12:50.553296+0000","last_unstale":"2024-09-17T03:12:50.560350+0000","last_undegraded":"2024-09-17T03:12:50.560350+0000","last_fullsized":"2024-09-17T03:12:50.560350+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:29.780411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547759+0000","last_change":"2024-09-17T03:12:50.547759+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547759+0000","last_undegraded":"2024-09-17T03:12:50.547759+0000","last_fullsized":"2024-09-17T03:12:50.547759+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.555592+0000","last_change":"2024-09-17T03:12:50.552439+0000","last_active":"2024-09-17T03:12:50.555592+0000","last_peered":"2024-09-17T03:12:50.555592+0000","last_clean":"2024-09-17T03:12:50.555592+0000","last_became_active":"2024-09-17T03:12:50.552147+0000","last_became_peered":"2024-09-17T03:12:50.552147+0000","last_unstale":"2024-09-17T03:12:50.555592+0000","last_undegraded":"2024-09-17T03:12:50.555592+0000","last_fullsized":"2024-09-17T03:12:50.555592+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:26.420432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542458+0000","last_change":"2024-09-17T03:12:50.542458+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542458+0000","last_undegraded":"2024-09-17T03:12:50.542458+0000","last_fullsized":"2024-09-17T03:12:50.542458+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563679+0000","last_change":"2024-09-17T03:12:50.558884+0000","last_active":"2024-09-17T03:12:50.563679+0000","last_peered":"2024-09-17T03:12:50.563679+0000","last_clean":"2024-09-17T03:12:50.563679+0000","last_became_active":"2024-09-17T03:12:50.558550+0000","last_became_peered":"2024-09-17T03:12:50.558550+0000","last_unstale":"2024-09-17T03:12:50.563679+0000","last_undegraded":"2024-09-17T03:12:50.563679+0000","last_fullsized":"2024-09-17T03:12:50.563679+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:18:36.626293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541278+0000","last_change":"2024-09-17T03:12:50.541278+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541278+0000","last_undegraded":"2024-09-17T03:12:50.541278+0000","last_fullsized":"2024-09-17T03:12:50.541278+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.561131+0000","last_change":"2024-09-17T03:12:50.556886+0000","last_active":"2024-09-17T03:12:50.561131+0000","last_peered":"2024-09-17T03:12:50.561131+0000","last_clean":"2024-09-17T03:12:50.561131+0000","last_became_active":"2024-09-17T03:12:50.556092+0000","last_became_peered":"2024-09-17T03:12:50.556092+0000","last_unstale":"2024-09-17T03:12:50.561131+0000","last_undegraded":"2024-09-17T03:12:50.561131+0000","last_fullsized":"2024-09-17T03:12:50.561131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:19.970449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.545286+0000","last_change":"2024-09-17T03:12:50.545286+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.545286+0000","last_undegraded":"2024-09-17T03:12:50.545286+0000","last_fullsized":"2024-09-17T03:12:50.545286+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.555534+0000","last_change":"2024-09-17T03:12:50.553551+0000","last_active":"2024-09-17T03:12:50.555534+0000","last_peered":"2024-09-17T03:12:50.555534+0000","last_clean":"2024-09-17T03:12:50.555534+0000","last_became_active":"2024-09-17T03:12:50.553028+0000","last_became_peered":"2024-09-17T03:12:50.553028+0000","last_unstale":"2024-09-17T03:12:50.555534+0000","last_undegraded":"2024-09-17T03:12:50.555534+0000","last_fullsized":"2024-09-17T03:12:50.555534+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:15.682903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547383+0000","last_change":"2024-09-17T03:12:50.547383+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547383+0000","last_undegraded":"2024-09-17T03:12:50.547383+0000","last_fullsized":"2024-09-17T03:12:50.547383+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.561103+0000","last_change":"2024-09-17T03:12:50.556871+0000","last_active":"2024-09-17T03:12:50.561103+0000","last_peered":"2024-09-17T03:12:50.561103+0000","last_clean":"2024-09-17T03:12:50.561103+0000","last_became_active":"2024-09-17T03:12:50.556543+0000","last_became_peered":"2024-09-17T03:12:50.556543+0000","last_unstale":"2024-09-17T03:12:50.561103+0000","last_undegraded":"2024-09-17T03:12:50.561103+0000","last_fullsized":"2024-09-17T03:12:50.561103+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:02.158974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.540760+0000","last_change":"2024-09-17T03:12:50.540760+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.540760+0000","last_undegraded":"2024-09-17T03:12:50.540760+0000","last_fullsized":"2024-09-17T03:12:50.540760+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563779+0000","last_change":"2024-09-17T03:12:50.559567+0000","last_active":"2024-09-17T03:12:50.563779+0000","last_peered":"2024-09-17T03:12:50.563779+0000","last_clean":"2024-09-17T03:12:50.563779+0000","last_became_active":"2024-09-17T03:12:50.559272+0000","last_became_peered":"2024-09-17T03:12:50.559272+0000","last_unstale":"2024-09-17T03:12:50.563779+0000","last_undegraded":"2024-09-17T03:12:50.563779+0000","last_fullsized":"2024-09-17T03:12:50.563779+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:38:25.932754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541762+0000","last_change":"2024-09-17T03:12:50.541762+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541762+0000","last_undegraded":"2024-09-17T03:12:50.541762+0000","last_fullsized":"2024-09-17T03:12:50.541762+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.562647+0000","last_change":"2024-09-17T03:12:50.561368+0000","last_active":"2024-09-17T03:12:50.562647+0000","last_peered":"2024-09-17T03:12:50.562647+0000","last_clean":"2024-09-17T03:12:50.562647+0000","last_became_active":"2024-09-17T03:12:50.561048+0000","last_became_peered":"2024-09-17T03:12:50.561048+0000","last_unstale":"2024-09-17T03:12:50.562647+0000","last_undegraded":"2024-09-17T03:12:50.562647+0000","last_fullsized":"2024-09-17T03:12:50.562647+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:05.621816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.572267+0000","last_change":"2024-09-17T03:12:51.569311+0000","last_active":"2024-09-17T03:12:51.572267+0000","last_peered":"2024-09-17T03:12:51.572267+0000","last_clean":"2024-09-17T03:12:51.572267+0000","last_became_active":"2024-09-17T03:12:51.568983+0000","last_became_peered":"2024-09-17T03:12:51.568983+0000","last_unstale":"2024-09-17T03:12:51.572267+0000","last_undegraded":"2024-09-17T03:12:51.572267+0000","last_fullsized":"2024-09-17T03:12:51.572267+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:15:30.514819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.555619+0000","last_change":"2024-09-17T03:12:50.553656+0000","last_active":"2024-09-17T03:12:50.555619+0000","last_peered":"2024-09-17T03:12:50.555619+0000","last_clean":"2024-09-17T03:12:50.555619+0000","last_became_active":"2024-09-17T03:12:50.553349+0000","last_became_peered":"2024-09-17T03:12:50.553349+0000","last_unstale":"2024-09-17T03:12:50.555619+0000","last_undegraded":"2024-09-17T03:12:50.555619+0000","last_fullsized":"2024-09-17T03:12:50.555619+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:08.565374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.572396+0000","last_change":"2024-09-17T03:12:51.570982+0000","last_active":"2024-09-17T03:12:51.572396+0000","last_peered":"2024-09-17T03:12:51.572396+0000","last_clean":"2024-09-17T03:12:51.572396+0000","last_became_active":"2024-09-17T03:12:51.570683+0000","last_became_peered":"2024-09-17T03:12:51.570683+0000","last_unstale":"2024-09-17T03:12:51.572396+0000","last_undegraded":"2024-09-17T03:12:51.572396+0000","last_fullsized":"2024-09-17T03:12:51.572396+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:55.497465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.569126+0000","last_change":"2024-09-17T03:12:50.561347+0000","last_active":"2024-09-17T03:12:50.569126+0000","last_peered":"2024-09-17T03:12:50.569126+0000","last_clean":"2024-09-17T03:12:50.569126+0000","last_became_active":"2024-09-17T03:12:50.561045+0000","last_became_peered":"2024-09-17T03:12:50.561045+0000","last_unstale":"2024-09-17T03:12:50.569126+0000","last_undegraded":"2024-09-17T03:12:50.569126+0000","last_fullsized":"2024-09-17T03:12:50.569126+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:30.710367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.571609+0000","last_change":"2024-09-17T03:12:51.570718+0000","last_active":"2024-09-17T03:12:51.571609+0000","last_peered":"2024-09-17T03:12:51.571609+0000","last_clean":"2024-09-17T03:12:51.571609+0000","last_became_active":"2024-09-17T03:12:51.570374+0000","last_became_peered":"2024-09-17T03:12:51.570374+0000","last_unstale":"2024-09-17T03:12:51.571609+0000","last_undegraded":"2024-09-17T03:12:51.571609+0000","last_fullsized":"2024-09-17T03:12:51.571609+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:37:29.522439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.556966+0000","last_change":"2024-09-17T03:12:50.552653+0000","last_active":"2024-09-17T03:12:50.556966+0000","last_peered":"2024-09-17T03:12:50.556966+0000","last_clean":"2024-09-17T03:12:50.556966+0000","last_became_active":"2024-09-17T03:12:50.552331+0000","last_became_peered":"2024-09-17T03:12:50.552331+0000","last_unstale":"2024-09-17T03:12:50.556966+0000","last_undegraded":"2024-09-17T03:12:50.556966+0000","last_fullsized":"2024-09-17T03:12:50.556966+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:22.132155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.544145+0000","last_change":"2024-09-17T03:12:50.544145+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.544145+0000","last_undegraded":"2024-09-17T03:12:50.544145+0000","last_fullsized":"2024-09-17T03:12:50.544145+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.555506+0000","last_change":"2024-09-17T03:12:50.552772+0000","last_active":"2024-09-17T03:12:50.555506+0000","last_peered":"2024-09-17T03:12:50.555506+0000","last_clean":"2024-09-17T03:12:50.555506+0000","last_became_active":"2024-09-17T03:12:50.552430+0000","last_became_peered":"2024-09-17T03:12:50.552430+0000","last_unstale":"2024-09-17T03:12:50.555506+0000","last_undegraded":"2024-09-17T03:12:50.555506+0000","last_fullsized":"2024-09-17T03:12:50.555506+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:55.322671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.549984+0000","last_change":"2024-09-17T03:12:50.549984+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.549984+0000","last_undegraded":"2024-09-17T03:12:50.549984+0000","last_fullsized":"2024-09-17T03:12:50.549984+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563760+0000","last_change":"2024-09-17T03:12:50.559793+0000","last_active":"2024-09-17T03:12:50.563760+0000","last_peered":"2024-09-17T03:12:50.563760+0000","last_clean":"2024-09-17T03:12:50.563760+0000","last_became_active":"2024-09-17T03:12:50.559454+0000","last_became_peered":"2024-09-17T03:12:50.559454+0000","last_unstale":"2024-09-17T03:12:50.563760+0000","last_undegraded":"2024-09-17T03:12:50.563760+0000","last_fullsized":"2024-09-17T03:12:50.563760+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:31.013515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547078+0000","last_change":"2024-09-17T03:12:50.547078+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547078+0000","last_undegraded":"2024-09-17T03:12:50.547078+0000","last_fullsized":"2024-09-17T03:12:50.547078+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.556806+0000","last_change":"2024-09-17T03:12:50.553233+0000","last_active":"2024-09-17T03:12:50.556806+0000","last_peered":"2024-09-17T03:12:50.556806+0000","last_clean":"2024-09-17T03:12:50.556806+0000","last_became_active":"2024-09-17T03:12:50.552920+0000","last_became_peered":"2024-09-17T03:12:50.552920+0000","last_unstale":"2024-09-17T03:12:50.556806+0000","last_undegraded":"2024-09-17T03:12:50.556806+0000","last_fullsized":"2024-09-17T03:12:50.556806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:07.400568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.547310+0000","last_change":"2024-09-17T03:12:50.547310+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.547310+0000","last_undegraded":"2024-09-17T03:12:50.547310+0000","last_fullsized":"2024-09-17T03:12:50.547310+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.564860+0000","last_change":"2024-09-17T03:12:50.559436+0000","last_active":"2024-09-17T03:12:50.564860+0000","last_peered":"2024-09-17T03:12:50.564860+0000","last_clean":"2024-09-17T03:12:50.564860+0000","last_became_active":"2024-09-17T03:12:50.559077+0000","last_became_peered":"2024-09-17T03:12:50.559077+0000","last_unstale":"2024-09-17T03:12:50.564860+0000","last_undegraded":"2024-09-17T03:12:50.564860+0000","last_fullsized":"2024-09-17T03:12:50.564860+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:41.572485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541233+0000","last_change":"2024-09-17T03:12:50.541233+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541233+0000","last_undegraded":"2024-09-17T03:12:50.541233+0000","last_fullsized":"2024-09-17T03:12:50.541233+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.564737+0000","last_change":"2024-09-17T03:12:50.560680+0000","last_active":"2024-09-17T03:12:50.564737+0000","last_peered":"2024-09-17T03:12:50.564737+0000","last_clean":"2024-09-17T03:12:50.564737+0000","last_became_active":"2024-09-17T03:12:50.560340+0000","last_became_peered":"2024-09-17T03:12:50.560340+0000","last_unstale":"2024-09-17T03:12:50.564737+0000","last_undegraded":"2024-09-17T03:12:50.564737+0000","last_fullsized":"2024-09-17T03:12:50.564737+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:22:12.420245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.542062+0000","last_change":"2024-09-17T03:12:50.542062+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.542062+0000","last_undegraded":"2024-09-17T03:12:50.542062+0000","last_fullsized":"2024-09-17T03:12:50.542062+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.564702+0000","last_change":"2024-09-17T03:12:50.557733+0000","last_active":"2024-09-17T03:12:50.564702+0000","last_peered":"2024-09-17T03:12:50.564702+0000","last_clean":"2024-09-17T03:12:50.564702+0000","last_became_active":"2024-09-17T03:12:50.557424+0000","last_became_peered":"2024-09-17T03:12:50.557424+0000","last_unstale":"2024-09-17T03:12:50.564702+0000","last_undegraded":"2024-09-17T03:12:50.564702+0000","last_fullsized":"2024-09-17T03:12:50.564702+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:32.780892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.540756+0000","last_change":"2024-09-17T03:12:50.540756+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.540756+0000","last_undegraded":"2024-09-17T03:12:50.540756+0000","last_fullsized":"2024-09-17T03:12:50.540756+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.561192+0000","last_change":"2024-09-17T03:12:50.557649+0000","last_active":"2024-09-17T03:12:50.561192+0000","last_peered":"2024-09-17T03:12:50.561192+0000","last_clean":"2024-09-17T03:12:50.561192+0000","last_became_active":"2024-09-17T03:12:50.557285+0000","last_became_peered":"2024-09-17T03:12:50.557285+0000","last_unstale":"2024-09-17T03:12:50.561192+0000","last_undegraded":"2024-09-17T03:12:50.561192+0000","last_fullsized":"2024-09-17T03:12:50.561192+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:08.528321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2024-09-17T03:12:50.541432+0000","last_change":"2024-09-17T03:12:50.541432+0000","last_active":"2024-09-17T03:12:50.532927+0000","last_peered":"2024-09-17T03:12:50.532927+0000","last_clean":"2024-09-17T03:12:50.532927+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:12:50.541432+0000","last_undegraded":"2024-09-17T03:12:50.541432+0000","last_fullsized":"2024-09-17T03:12:50.541432+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.563547+0000","last_change":"2024-09-17T03:12:50.555756+0000","last_active":"2024-09-17T03:12:50.563547+0000","last_peered":"2024-09-17T03:12:50.563547+0000","last_clean":"2024-09-17T03:12:50.563547+0000","last_became_active":"2024-09-17T03:12:50.555359+0000","last_became_peered":"2024-09-17T03:12:50.555359+0000","last_unstale":"2024-09-17T03:12:50.563547+0000","last_undegraded":"2024-09-17T03:12:50.563547+0000","last_fullsized":"2024-09-17T03:12:50.563547+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:34:01.133168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-17T03:12:51.575596+0000","last_change":"2024-09-17T03:12:51.571810+0000","last_active":"2024-09-17T03:12:51.575596+0000","last_peered":"2024-09-17T03:12:51.575596+0000","last_clean":"2024-09-17T03:12:51.575596+0000","last_became_active":"2024-09-17T03:12:51.571483+0000","last_became_peered":"2024-09-17T03:12:51.571483+0000","last_unstale":"2024-09-17T03:12:51.575596+0000","last_undegraded":"2024-09-17T03:12:51.575596+0000","last_fullsized":"2024-09-17T03:12:51.575596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:22.216990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.560629+0000","last_change":"2024-09-17T03:12:50.554998+0000","last_active":"2024-09-17T03:12:50.560629+0000","last_peered":"2024-09-17T03:12:50.560629+0000","last_clean":"2024-09-17T03:12:50.560629+0000","last_became_active":"2024-09-17T03:12:50.554357+0000","last_became_peered":"2024-09-17T03:12:50.554357+0000","last_unstale":"2024-09-17T03:12:50.560629+0000","last_undegraded":"2024-09-17T03:12:50.560629+0000","last_fullsized":"2024-09-17T03:12:50.560629+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:16:57.263039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":190,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-09-17T03:12:50.550472+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:12:50.550472+0000","last_peered":"2024-09-17T03:12:50.550472+0000","last_clean":"2024-09-17T03:12:50.550472+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:12:50.550472+0000","last_undegraded":"2024-09-17T03:12:50.550472+0000","last_fullsized":"2024-09-17T03:12:50.550472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509499,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":1388544,"data_stored":921059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509499,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":794624,"data_stored":330691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509498,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":806912,"data_stored":336966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":806912,"data_stored":336966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509500,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":806912,"data_stored":336966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509499,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":806912,"data_stored":336966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509499,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1388544,"data_stored":921059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32000,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339840,"statfs":{"total":96636764160,"available":96603996160,"internally_reserved":0,"allocated":827392,"data_stored":343853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:12:59.017 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:12:59.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.143+0000 7fe59d962640 1 -- 172.21.15.78:0/2908223921 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5980b97e0 msgr2=0x7fe59806f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:59.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.143+0000 7fe59d962640 1 --2- 172.21.15.78:0/2908223921 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5980b97e0 0x7fe59806f6e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe58c009830 tx=0x7fe58c02a3f0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.143+0000 7fe59d962640 1 -- 172.21.15.78:0/2908223921 shutdown_connections 2024-09-17T03:12:59.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.143+0000 7fe59d962640 1 --2- 172.21.15.78:0/2908223921 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe5980d0e50 0x7fe5980d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.143+0000 7fe59d962640 1 --2- 172.21.15.78:0/2908223921 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5980b97e0 0x7fe59806f6e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.143+0000 7fe59d962640 1 -- 172.21.15.78:0/2908223921 >> 172.21.15.78:0/2908223921 conn(0x7fe59809d840 msgr2=0x7fe59808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:59.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.143+0000 7fe59d962640 1 -- 172.21.15.78:0/2908223921 shutdown_connections 2024-09-17T03:12:59.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.144+0000 7fe59d962640 1 -- 172.21.15.78:0/2908223921 wait complete. 2024-09-17T03:12:59.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.145+0000 7fe59d962640 1 Processor -- start 2024-09-17T03:12:59.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.145+0000 7fe59d962640 1 -- start start 2024-09-17T03:12:59.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.147+0000 7fe59d962640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe59806e0a0 0x7fe5981f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:59.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.147+0000 7fe59d962640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5980b97e0 0x7fe5981f89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:59.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.147+0000 7fe59d962640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe5980d0e50 0x7fe5981f8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:59.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.147+0000 7fe59d962640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe5980cfea0 con 0x7fe59806e0a0 2024-09-17T03:12:59.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.147+0000 7fe59d962640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe5980cfd20 con 0x7fe5980b97e0 2024-09-17T03:12:59.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.147+0000 7fe59d962640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe5980d0020 con 0x7fe5980d0e50 2024-09-17T03:12:59.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.147+0000 7fe596ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe59806e0a0 0x7fe5981f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:59.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.147+0000 7fe596ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe59806e0a0 0x7fe5981f4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45652/0 (socket says 172.21.15.78:45652) 2024-09-17T03:12:59.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.147+0000 7fe596ffd640 1 -- 172.21.15.78:0/1091840880 learned_addr learned my addr 172.21.15.78:0/1091840880 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:59.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.147+0000 7fe5967fc640 1 --2- 172.21.15.78:0/1091840880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5980b97e0 0x7fe5981f89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:59.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.147+0000 7fe5977fe640 1 --2- 172.21.15.78:0/1091840880 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe5980d0e50 0x7fe5981f8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:59.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.147+0000 7fe596ffd640 1 -- 172.21.15.78:0/1091840880 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe5980d0e50 msgr2=0x7fe5981f8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:59.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.147+0000 7fe596ffd640 1 --2- 172.21.15.78:0/1091840880 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe5980d0e50 0x7fe5981f8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.147+0000 7fe596ffd640 1 -- 172.21.15.78:0/1091840880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5980b97e0 msgr2=0x7fe5981f89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:59.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.147+0000 7fe596ffd640 1 --2- 172.21.15.78:0/1091840880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5980b97e0 0x7fe5981f89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.147+0000 7fe596ffd640 1 -- 172.21.15.78:0/1091840880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5980cdac0 con 0x7fe59806e0a0 2024-09-17T03:12:59.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.147+0000 7fe596ffd640 1 --2- 172.21.15.78:0/1091840880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe59806e0a0 0x7fe5981f4d50 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fe58800c390 tx=0x7fe58800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:59.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.148+0000 7fe57ffff640 1 -- 172.21.15.78:0/1091840880 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588017070 con 0x7fe59806e0a0 2024-09-17T03:12:59.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.148+0000 7fe57ffff640 1 -- 172.21.15.78:0/1091840880 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5880053c0 con 0x7fe59806e0a0 2024-09-17T03:12:59.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.148+0000 7fe59d962640 1 -- 172.21.15.78:0/1091840880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5980cdda0 con 0x7fe59806e0a0 2024-09-17T03:12:59.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.148+0000 7fe57ffff640 1 -- 172.21.15.78:0/1091840880 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588003880 con 0x7fe59806e0a0 2024-09-17T03:12:59.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.148+0000 7fe59d962640 1 -- 172.21.15.78:0/1091840880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5980ce360 con 0x7fe59806e0a0 2024-09-17T03:12:59.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.149+0000 7fe59d962640 1 -- 172.21.15.78:0/1091840880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5980d0420 con 0x7fe59806e0a0 2024-09-17T03:12:59.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.149+0000 7fe57ffff640 1 -- 172.21.15.78:0/1091840880 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe58801a070 con 0x7fe59806e0a0 2024-09-17T03:12:59.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.150+0000 7fe57ffff640 1 --2- 172.21.15.78:0/1091840880 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe584078b90 0x7fe58407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:59.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.150+0000 7fe57ffff640 1 -- 172.21.15.78:0/1091840880 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fe58809a090 con 0x7fe59806e0a0 2024-09-17T03:12:59.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.150+0000 7fe5967fc640 1 --2- 172.21.15.78:0/1091840880 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe584078b90 0x7fe58407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:59.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.151+0000 7fe5967fc640 1 --2- 172.21.15.78:0/1091840880 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe584078b90 0x7fe58407b0a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe58c034000 tx=0x7fe58c004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:59.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.155+0000 7fe57ffff640 1 -- 172.21.15.78:0/1091840880 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe5980d17a0 con 0x7fe59806e0a0 2024-09-17T03:12:59.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.326+0000 7fe59d962640 1 -- 172.21.15.78:0/1091840880 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe5981f5290 con 0x7fe584078b90 2024-09-17T03:12:59.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.331+0000 7fe57ffff640 1 -- 172.21.15.78:0/1091840880 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252046 (secure 0 0 0) 0x7fe5981f5290 con 0x7fe584078b90 2024-09-17T03:12:59.332 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:12:59.334 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:12:59.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.334+0000 7fe59d962640 1 -- 172.21.15.78:0/1091840880 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe584078b90 msgr2=0x7fe58407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:59.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.334+0000 7fe59d962640 1 --2- 172.21.15.78:0/1091840880 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe584078b90 0x7fe58407b0a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe58c034000 tx=0x7fe58c004730 comp rx=0 tx=0).stop 2024-09-17T03:12:59.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.334+0000 7fe59d962640 1 -- 172.21.15.78:0/1091840880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe59806e0a0 msgr2=0x7fe5981f4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:59.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.334+0000 7fe59d962640 1 --2- 172.21.15.78:0/1091840880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe59806e0a0 0x7fe5981f4d50 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fe58800c390 tx=0x7fe58800c850 comp rx=0 tx=0).stop 2024-09-17T03:12:59.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.334+0000 7fe59d962640 1 -- 172.21.15.78:0/1091840880 shutdown_connections 2024-09-17T03:12:59.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.334+0000 7fe59d962640 1 --2- 172.21.15.78:0/1091840880 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe5980d0e50 0x7fe5981f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.334+0000 7fe59d962640 1 --2- 172.21.15.78:0/1091840880 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe584078b90 0x7fe58407b0a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.334+0000 7fe59d962640 1 --2- 172.21.15.78:0/1091840880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe5980b97e0 0x7fe5981f89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.334+0000 7fe59d962640 1 --2- 172.21.15.78:0/1091840880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe59806e0a0 0x7fe5981f4d50 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.334+0000 7fe59d962640 1 -- 172.21.15.78:0/1091840880 >> 172.21.15.78:0/1091840880 conn(0x7fe59809d840 msgr2=0x7fe598068e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:59.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.335+0000 7fe59d962640 1 -- 172.21.15.78:0/1091840880 shutdown_connections 2024-09-17T03:12:59.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.335+0000 7fe59d962640 1 -- 172.21.15.78:0/1091840880 wait complete. 2024-09-17T03:12:59.345 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-09-17T03:12:59.192438+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240596,"kb_used_data":7720,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734124,"statfs":{"total":773094113280,"available":772847742976,"internally_reserved":0,"allocated":7905280,"data_stored":3985884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002443"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.039053+0000","last_change":"2024-09-17T03:12:51.571713+0000","last_active":"2024-09-17T03:12:53.039053+0000","last_peered":"2024-09-17T03:12:53.039053+0000","last_clean":"2024-09-17T03:12:53.039053+0000","last_became_active":"2024-09-17T03:12:51.570485+0000","last_became_peered":"2024-09-17T03:12:51.570485+0000","last_unstale":"2024-09-17T03:12:53.039053+0000","last_undegraded":"2024-09-17T03:12:53.039053+0000","last_fullsized":"2024-09-17T03:12:53.039053+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:05.152657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.565607+0000","last_change":"2024-09-17T03:12:51.567611+0000","last_active":"2024-09-17T03:12:52.565607+0000","last_peered":"2024-09-17T03:12:52.565607+0000","last_clean":"2024-09-17T03:12:52.565607+0000","last_became_active":"2024-09-17T03:12:51.566022+0000","last_became_peered":"2024-09-17T03:12:51.566022+0000","last_unstale":"2024-09-17T03:12:52.565607+0000","last_undegraded":"2024-09-17T03:12:52.565607+0000","last_fullsized":"2024-09-17T03:12:52.565607+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:23.078025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.532023+0000","last_change":"2024-09-17T03:12:51.568425+0000","last_active":"2024-09-17T03:12:53.532023+0000","last_peered":"2024-09-17T03:12:53.532023+0000","last_clean":"2024-09-17T03:12:53.532023+0000","last_became_active":"2024-09-17T03:12:51.568119+0000","last_became_peered":"2024-09-17T03:12:51.568119+0000","last_unstale":"2024-09-17T03:12:53.532023+0000","last_undegraded":"2024-09-17T03:12:53.532023+0000","last_fullsized":"2024-09-17T03:12:53.532023+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:47.528018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:54.070207+0000","last_change":"2024-09-17T03:12:51.568463+0000","last_active":"2024-09-17T03:12:54.070207+0000","last_peered":"2024-09-17T03:12:54.070207+0000","last_clean":"2024-09-17T03:12:54.070207+0000","last_became_active":"2024-09-17T03:12:51.568118+0000","last_became_peered":"2024-09-17T03:12:51.568118+0000","last_unstale":"2024-09-17T03:12:54.070207+0000","last_undegraded":"2024-09-17T03:12:54.070207+0000","last_fullsized":"2024-09-17T03:12:54.070207+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:25.798782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.563307+0000","last_change":"2024-09-17T03:12:51.567360+0000","last_active":"2024-09-17T03:12:52.563307+0000","last_peered":"2024-09-17T03:12:52.563307+0000","last_clean":"2024-09-17T03:12:52.563307+0000","last_became_active":"2024-09-17T03:12:51.567010+0000","last_became_peered":"2024-09-17T03:12:51.567010+0000","last_unstale":"2024-09-17T03:12:52.563307+0000","last_undegraded":"2024-09-17T03:12:52.563307+0000","last_fullsized":"2024-09-17T03:12:52.563307+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:25:52.903221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.564401+0000","last_change":"2024-09-17T03:12:51.571597+0000","last_active":"2024-09-17T03:12:52.564401+0000","last_peered":"2024-09-17T03:12:52.564401+0000","last_clean":"2024-09-17T03:12:52.564401+0000","last_became_active":"2024-09-17T03:12:51.571052+0000","last_became_peered":"2024-09-17T03:12:51.571052+0000","last_unstale":"2024-09-17T03:12:52.564401+0000","last_undegraded":"2024-09-17T03:12:52.564401+0000","last_fullsized":"2024-09-17T03:12:52.564401+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:25:16.869986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:54.176955+0000","last_change":"2024-09-17T03:12:51.568387+0000","last_active":"2024-09-17T03:12:54.176955+0000","last_peered":"2024-09-17T03:12:54.176955+0000","last_clean":"2024-09-17T03:12:54.176955+0000","last_became_active":"2024-09-17T03:12:51.568066+0000","last_became_peered":"2024-09-17T03:12:51.568066+0000","last_unstale":"2024-09-17T03:12:54.176955+0000","last_undegraded":"2024-09-17T03:12:54.176955+0000","last_fullsized":"2024-09-17T03:12:54.176955+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:34:38.371892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.564401+0000","last_change":"2024-09-17T03:12:51.579509+0000","last_active":"2024-09-17T03:12:52.564401+0000","last_peered":"2024-09-17T03:12:52.564401+0000","last_clean":"2024-09-17T03:12:52.564401+0000","last_became_active":"2024-09-17T03:12:51.577423+0000","last_became_peered":"2024-09-17T03:12:51.577423+0000","last_unstale":"2024-09-17T03:12:52.564401+0000","last_undegraded":"2024-09-17T03:12:52.564401+0000","last_fullsized":"2024-09-17T03:12:52.564401+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:12.077671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.563947+0000","last_change":"2024-09-17T03:12:51.575036+0000","last_active":"2024-09-17T03:12:52.563947+0000","last_peered":"2024-09-17T03:12:52.563947+0000","last_clean":"2024-09-17T03:12:52.563947+0000","last_became_active":"2024-09-17T03:12:51.574724+0000","last_became_peered":"2024-09-17T03:12:51.574724+0000","last_unstale":"2024-09-17T03:12:52.563947+0000","last_undegraded":"2024-09-17T03:12:52.563947+0000","last_fullsized":"2024-09-17T03:12:52.563947+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:03:49.611154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.566001+0000","last_change":"2024-09-17T03:12:51.577684+0000","last_active":"2024-09-17T03:12:52.566001+0000","last_peered":"2024-09-17T03:12:52.566001+0000","last_clean":"2024-09-17T03:12:52.566001+0000","last_became_active":"2024-09-17T03:12:51.573750+0000","last_became_peered":"2024-09-17T03:12:51.573750+0000","last_unstale":"2024-09-17T03:12:52.566001+0000","last_undegraded":"2024-09-17T03:12:52.566001+0000","last_fullsized":"2024-09-17T03:12:52.566001+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:01.112366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.038814+0000","last_change":"2024-09-17T03:12:51.575551+0000","last_active":"2024-09-17T03:12:53.038814+0000","last_peered":"2024-09-17T03:12:53.038814+0000","last_clean":"2024-09-17T03:12:53.038814+0000","last_became_active":"2024-09-17T03:12:51.575212+0000","last_became_peered":"2024-09-17T03:12:51.575212+0000","last_unstale":"2024-09-17T03:12:53.038814+0000","last_undegraded":"2024-09-17T03:12:53.038814+0000","last_fullsized":"2024-09-17T03:12:53.038814+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:16:49.134199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:54.070231+0000","last_change":"2024-09-17T03:12:51.568450+0000","last_active":"2024-09-17T03:12:54.070231+0000","last_peered":"2024-09-17T03:12:54.070231+0000","last_clean":"2024-09-17T03:12:54.070231+0000","last_became_active":"2024-09-17T03:12:51.567848+0000","last_became_peered":"2024-09-17T03:12:51.567848+0000","last_unstale":"2024-09-17T03:12:54.070231+0000","last_undegraded":"2024-09-17T03:12:54.070231+0000","last_fullsized":"2024-09-17T03:12:54.070231+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:17.110040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.401633+0000","last_change":"2024-09-17T03:12:51.563889+0000","last_active":"2024-09-17T03:12:53.401633+0000","last_peered":"2024-09-17T03:12:53.401633+0000","last_clean":"2024-09-17T03:12:53.401633+0000","last_became_active":"2024-09-17T03:12:51.563614+0000","last_became_peered":"2024-09-17T03:12:51.563614+0000","last_unstale":"2024-09-17T03:12:53.401633+0000","last_undegraded":"2024-09-17T03:12:53.401633+0000","last_fullsized":"2024-09-17T03:12:53.401633+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:20.118726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.563491+0000","last_change":"2024-09-17T03:12:51.559952+0000","last_active":"2024-09-17T03:12:52.563491+0000","last_peered":"2024-09-17T03:12:52.563491+0000","last_clean":"2024-09-17T03:12:52.563491+0000","last_became_active":"2024-09-17T03:12:51.559647+0000","last_became_peered":"2024-09-17T03:12:51.559647+0000","last_unstale":"2024-09-17T03:12:52.563491+0000","last_undegraded":"2024-09-17T03:12:52.563491+0000","last_fullsized":"2024-09-17T03:12:52.563491+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:35.809821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.401443+0000","last_change":"2024-09-17T03:12:51.562552+0000","last_active":"2024-09-17T03:12:53.401443+0000","last_peered":"2024-09-17T03:12:53.401443+0000","last_clean":"2024-09-17T03:12:53.401443+0000","last_became_active":"2024-09-17T03:12:51.562210+0000","last_became_peered":"2024-09-17T03:12:51.562210+0000","last_unstale":"2024-09-17T03:12:53.401443+0000","last_undegraded":"2024-09-17T03:12:53.401443+0000","last_fullsized":"2024-09-17T03:12:53.401443+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:42.601150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.564018+0000","last_change":"2024-09-17T03:12:51.567097+0000","last_active":"2024-09-17T03:12:52.564018+0000","last_peered":"2024-09-17T03:12:52.564018+0000","last_clean":"2024-09-17T03:12:52.564018+0000","last_became_active":"2024-09-17T03:12:51.566516+0000","last_became_peered":"2024-09-17T03:12:51.566516+0000","last_unstale":"2024-09-17T03:12:52.564018+0000","last_undegraded":"2024-09-17T03:12:52.564018+0000","last_fullsized":"2024-09-17T03:12:52.564018+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:47.626422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.564004+0000","last_change":"2024-09-17T03:12:51.574486+0000","last_active":"2024-09-17T03:12:52.564004+0000","last_peered":"2024-09-17T03:12:52.564004+0000","last_clean":"2024-09-17T03:12:52.564004+0000","last_became_active":"2024-09-17T03:12:51.573615+0000","last_became_peered":"2024-09-17T03:12:51.573615+0000","last_unstale":"2024-09-17T03:12:52.564004+0000","last_undegraded":"2024-09-17T03:12:52.564004+0000","last_fullsized":"2024-09-17T03:12:52.564004+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:38.071341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:54.070330+0000","last_change":"2024-09-17T03:12:51.567335+0000","last_active":"2024-09-17T03:12:54.070330+0000","last_peered":"2024-09-17T03:12:54.070330+0000","last_clean":"2024-09-17T03:12:54.070330+0000","last_became_active":"2024-09-17T03:12:51.566914+0000","last_became_peered":"2024-09-17T03:12:51.566914+0000","last_unstale":"2024-09-17T03:12:54.070330+0000","last_undegraded":"2024-09-17T03:12:54.070330+0000","last_fullsized":"2024-09-17T03:12:54.070330+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:47.382230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.564722+0000","last_change":"2024-09-17T03:12:51.575657+0000","last_active":"2024-09-17T03:12:52.564722+0000","last_peered":"2024-09-17T03:12:52.564722+0000","last_clean":"2024-09-17T03:12:52.564722+0000","last_became_active":"2024-09-17T03:12:51.572163+0000","last_became_peered":"2024-09-17T03:12:51.572163+0000","last_unstale":"2024-09-17T03:12:52.564722+0000","last_undegraded":"2024-09-17T03:12:52.564722+0000","last_fullsized":"2024-09-17T03:12:52.564722+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:08.386975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.401605+0000","last_change":"2024-09-17T03:12:51.571083+0000","last_active":"2024-09-17T03:12:53.401605+0000","last_peered":"2024-09-17T03:12:53.401605+0000","last_clean":"2024-09-17T03:12:53.401605+0000","last_became_active":"2024-09-17T03:12:51.570752+0000","last_became_peered":"2024-09-17T03:12:51.570752+0000","last_unstale":"2024-09-17T03:12:53.401605+0000","last_undegraded":"2024-09-17T03:12:53.401605+0000","last_fullsized":"2024-09-17T03:12:53.401605+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:17.831626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.564606+0000","last_change":"2024-09-17T03:12:51.568540+0000","last_active":"2024-09-17T03:12:52.564606+0000","last_peered":"2024-09-17T03:12:52.564606+0000","last_clean":"2024-09-17T03:12:52.564606+0000","last_became_active":"2024-09-17T03:12:51.567811+0000","last_became_peered":"2024-09-17T03:12:51.567811+0000","last_unstale":"2024-09-17T03:12:52.564606+0000","last_undegraded":"2024-09-17T03:12:52.564606+0000","last_fullsized":"2024-09-17T03:12:52.564606+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:48.909703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.565008+0000","last_change":"2024-09-17T03:12:51.566831+0000","last_active":"2024-09-17T03:12:52.565008+0000","last_peered":"2024-09-17T03:12:52.565008+0000","last_clean":"2024-09-17T03:12:52.565008+0000","last_became_active":"2024-09-17T03:12:51.566531+0000","last_became_peered":"2024-09-17T03:12:51.566531+0000","last_unstale":"2024-09-17T03:12:52.565008+0000","last_undegraded":"2024-09-17T03:12:52.565008+0000","last_fullsized":"2024-09-17T03:12:52.565008+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:21:24.705262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.038579+0000","last_change":"2024-09-17T03:12:51.577059+0000","last_active":"2024-09-17T03:12:53.038579+0000","last_peered":"2024-09-17T03:12:53.038579+0000","last_clean":"2024-09-17T03:12:53.038579+0000","last_became_active":"2024-09-17T03:12:51.576695+0000","last_became_peered":"2024-09-17T03:12:51.576695+0000","last_unstale":"2024-09-17T03:12:53.038579+0000","last_undegraded":"2024-09-17T03:12:53.038579+0000","last_fullsized":"2024-09-17T03:12:53.038579+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:17.455920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.038418+0000","last_change":"2024-09-17T03:12:51.573641+0000","last_active":"2024-09-17T03:12:53.038418+0000","last_peered":"2024-09-17T03:12:53.038418+0000","last_clean":"2024-09-17T03:12:53.038418+0000","last_became_active":"2024-09-17T03:12:51.571731+0000","last_became_peered":"2024-09-17T03:12:51.571731+0000","last_unstale":"2024-09-17T03:12:53.038418+0000","last_undegraded":"2024-09-17T03:12:53.038418+0000","last_fullsized":"2024-09-17T03:12:53.038418+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:20.118726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.565659+0000","last_change":"2024-09-17T03:12:51.564951+0000","last_active":"2024-09-17T03:12:52.565659+0000","last_peered":"2024-09-17T03:12:52.565659+0000","last_clean":"2024-09-17T03:12:52.565659+0000","last_became_active":"2024-09-17T03:12:51.564600+0000","last_became_peered":"2024-09-17T03:12:51.564600+0000","last_unstale":"2024-09-17T03:12:52.565659+0000","last_undegraded":"2024-09-17T03:12:52.565659+0000","last_fullsized":"2024-09-17T03:12:52.565659+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:23.783485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:54.177280+0000","last_change":"2024-09-17T03:12:51.571236+0000","last_active":"2024-09-17T03:12:54.177280+0000","last_peered":"2024-09-17T03:12:54.177280+0000","last_clean":"2024-09-17T03:12:54.177280+0000","last_became_active":"2024-09-17T03:12:51.570718+0000","last_became_peered":"2024-09-17T03:12:51.570718+0000","last_unstale":"2024-09-17T03:12:54.177280+0000","last_undegraded":"2024-09-17T03:12:54.177280+0000","last_fullsized":"2024-09-17T03:12:54.177280+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:14:56.031272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.532063+0000","last_change":"2024-09-17T03:12:51.574817+0000","last_active":"2024-09-17T03:12:53.532063+0000","last_peered":"2024-09-17T03:12:53.532063+0000","last_clean":"2024-09-17T03:12:53.532063+0000","last_became_active":"2024-09-17T03:12:51.572559+0000","last_became_peered":"2024-09-17T03:12:51.572559+0000","last_unstale":"2024-09-17T03:12:53.532063+0000","last_undegraded":"2024-09-17T03:12:53.532063+0000","last_fullsized":"2024-09-17T03:12:53.532063+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:41.155553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.565929+0000","last_change":"2024-09-17T03:12:51.566020+0000","last_active":"2024-09-17T03:12:52.565929+0000","last_peered":"2024-09-17T03:12:52.565929+0000","last_clean":"2024-09-17T03:12:52.565929+0000","last_became_active":"2024-09-17T03:12:51.565705+0000","last_became_peered":"2024-09-17T03:12:51.565705+0000","last_unstale":"2024-09-17T03:12:52.565929+0000","last_undegraded":"2024-09-17T03:12:52.565929+0000","last_fullsized":"2024-09-17T03:12:52.565929+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:07:43.943308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.531748+0000","last_change":"2024-09-17T03:12:51.564402+0000","last_active":"2024-09-17T03:12:53.531748+0000","last_peered":"2024-09-17T03:12:53.531748+0000","last_clean":"2024-09-17T03:12:53.531748+0000","last_became_active":"2024-09-17T03:12:51.564089+0000","last_became_peered":"2024-09-17T03:12:51.564089+0000","last_unstale":"2024-09-17T03:12:53.531748+0000","last_undegraded":"2024-09-17T03:12:53.531748+0000","last_fullsized":"2024-09-17T03:12:53.531748+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:48:49.571256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:54.177022+0000","last_change":"2024-09-17T03:12:51.569580+0000","last_active":"2024-09-17T03:12:54.177022+0000","last_peered":"2024-09-17T03:12:54.177022+0000","last_clean":"2024-09-17T03:12:54.177022+0000","last_became_active":"2024-09-17T03:12:51.569240+0000","last_became_peered":"2024-09-17T03:12:51.569240+0000","last_unstale":"2024-09-17T03:12:54.177022+0000","last_undegraded":"2024-09-17T03:12:54.177022+0000","last_fullsized":"2024-09-17T03:12:54.177022+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:10.923876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:54.177307+0000","last_change":"2024-09-17T03:12:51.567619+0000","last_active":"2024-09-17T03:12:54.177307+0000","last_peered":"2024-09-17T03:12:54.177307+0000","last_clean":"2024-09-17T03:12:54.177307+0000","last_became_active":"2024-09-17T03:12:51.567162+0000","last_became_peered":"2024-09-17T03:12:51.567162+0000","last_unstale":"2024-09-17T03:12:54.177307+0000","last_undegraded":"2024-09-17T03:12:54.177307+0000","last_fullsized":"2024-09-17T03:12:54.177307+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:25:21.741970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.565242+0000","last_change":"2024-09-17T03:12:51.578091+0000","last_active":"2024-09-17T03:12:52.565242+0000","last_peered":"2024-09-17T03:12:52.565242+0000","last_clean":"2024-09-17T03:12:52.565242+0000","last_became_active":"2024-09-17T03:12:51.577588+0000","last_became_peered":"2024-09-17T03:12:51.577588+0000","last_unstale":"2024-09-17T03:12:52.565242+0000","last_undegraded":"2024-09-17T03:12:52.565242+0000","last_fullsized":"2024-09-17T03:12:52.565242+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:29.549819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.038980+0000","last_change":"2024-09-17T03:12:51.573245+0000","last_active":"2024-09-17T03:12:53.038980+0000","last_peered":"2024-09-17T03:12:53.038980+0000","last_clean":"2024-09-17T03:12:53.038980+0000","last_became_active":"2024-09-17T03:12:51.572540+0000","last_became_peered":"2024-09-17T03:12:51.572540+0000","last_unstale":"2024-09-17T03:12:53.038980+0000","last_undegraded":"2024-09-17T03:12:53.038980+0000","last_fullsized":"2024-09-17T03:12:53.038980+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:59.791229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"68'4","reported_seq":19,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.039275+0000","last_change":"2024-09-17T03:12:50.558227+0000","last_active":"2024-09-17T03:12:53.039275+0000","last_peered":"2024-09-17T03:12:53.039275+0000","last_clean":"2024-09-17T03:12:53.039275+0000","last_became_active":"2024-09-17T03:12:50.557908+0000","last_became_peered":"2024-09-17T03:12:50.557908+0000","last_unstale":"2024-09-17T03:12:53.039275+0000","last_undegraded":"2024-09-17T03:12:53.039275+0000","last_fullsized":"2024-09-17T03:12:53.039275+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:27.420186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.564153+0000","last_change":"2024-09-17T03:12:51.574060+0000","last_active":"2024-09-17T03:12:52.564153+0000","last_peered":"2024-09-17T03:12:52.564153+0000","last_clean":"2024-09-17T03:12:52.564153+0000","last_became_active":"2024-09-17T03:12:51.573491+0000","last_became_peered":"2024-09-17T03:12:51.573491+0000","last_unstale":"2024-09-17T03:12:52.564153+0000","last_undegraded":"2024-09-17T03:12:52.564153+0000","last_fullsized":"2024-09-17T03:12:52.564153+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:30.785323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.401734+0000","last_change":"2024-09-17T03:12:50.555455+0000","last_active":"2024-09-17T03:12:53.401734+0000","last_peered":"2024-09-17T03:12:53.401734+0000","last_clean":"2024-09-17T03:12:53.401734+0000","last_became_active":"2024-09-17T03:12:50.555094+0000","last_became_peered":"2024-09-17T03:12:50.555094+0000","last_unstale":"2024-09-17T03:12:53.401734+0000","last_undegraded":"2024-09-17T03:12:53.401734+0000","last_fullsized":"2024-09-17T03:12:53.401734+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:50.277464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.564803+0000","last_change":"2024-09-17T03:12:51.561415+0000","last_active":"2024-09-17T03:12:52.564803+0000","last_peered":"2024-09-17T03:12:52.564803+0000","last_clean":"2024-09-17T03:12:52.564803+0000","last_became_active":"2024-09-17T03:12:51.561097+0000","last_became_peered":"2024-09-17T03:12:51.561097+0000","last_unstale":"2024-09-17T03:12:52.564803+0000","last_undegraded":"2024-09-17T03:12:52.564803+0000","last_fullsized":"2024-09-17T03:12:52.564803+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:09.993696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.565893+0000","last_change":"2024-09-17T03:12:50.556466+0000","last_active":"2024-09-17T03:12:52.565893+0000","last_peered":"2024-09-17T03:12:52.565893+0000","last_clean":"2024-09-17T03:12:52.565893+0000","last_became_active":"2024-09-17T03:12:50.556101+0000","last_became_peered":"2024-09-17T03:12:50.556101+0000","last_unstale":"2024-09-17T03:12:52.565893+0000","last_undegraded":"2024-09-17T03:12:52.565893+0000","last_fullsized":"2024-09-17T03:12:52.565893+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:24:16.105128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.038942+0000","last_change":"2024-09-17T03:12:51.568981+0000","last_active":"2024-09-17T03:12:53.038942+0000","last_peered":"2024-09-17T03:12:53.038942+0000","last_clean":"2024-09-17T03:12:53.038942+0000","last_became_active":"2024-09-17T03:12:51.568643+0000","last_became_peered":"2024-09-17T03:12:51.568643+0000","last_unstale":"2024-09-17T03:12:53.038942+0000","last_undegraded":"2024-09-17T03:12:53.038942+0000","last_fullsized":"2024-09-17T03:12:53.038942+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:28.784789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.565019+0000","last_change":"2024-09-17T03:12:50.555688+0000","last_active":"2024-09-17T03:12:52.565019+0000","last_peered":"2024-09-17T03:12:52.565019+0000","last_clean":"2024-09-17T03:12:52.565019+0000","last_became_active":"2024-09-17T03:12:50.555240+0000","last_became_peered":"2024-09-17T03:12:50.555240+0000","last_unstale":"2024-09-17T03:12:52.565019+0000","last_undegraded":"2024-09-17T03:12:52.565019+0000","last_fullsized":"2024-09-17T03:12:52.565019+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:39:23.572655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:54.177247+0000","last_change":"2024-09-17T03:12:51.571776+0000","last_active":"2024-09-17T03:12:54.177247+0000","last_peered":"2024-09-17T03:12:54.177247+0000","last_clean":"2024-09-17T03:12:54.177247+0000","last_became_active":"2024-09-17T03:12:51.570789+0000","last_became_peered":"2024-09-17T03:12:51.570789+0000","last_unstale":"2024-09-17T03:12:54.177247+0000","last_undegraded":"2024-09-17T03:12:54.177247+0000","last_fullsized":"2024-09-17T03:12:54.177247+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:03.445248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.531977+0000","last_change":"2024-09-17T03:12:50.559708+0000","last_active":"2024-09-17T03:12:53.531977+0000","last_peered":"2024-09-17T03:12:53.531977+0000","last_clean":"2024-09-17T03:12:53.531977+0000","last_became_active":"2024-09-17T03:12:50.559377+0000","last_became_peered":"2024-09-17T03:12:50.559377+0000","last_unstale":"2024-09-17T03:12:53.531977+0000","last_undegraded":"2024-09-17T03:12:53.531977+0000","last_fullsized":"2024-09-17T03:12:53.531977+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:32.000927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.564878+0000","last_change":"2024-09-17T03:12:51.568214+0000","last_active":"2024-09-17T03:12:52.564878+0000","last_peered":"2024-09-17T03:12:52.564878+0000","last_clean":"2024-09-17T03:12:52.564878+0000","last_became_active":"2024-09-17T03:12:51.567483+0000","last_became_peered":"2024-09-17T03:12:51.567483+0000","last_unstale":"2024-09-17T03:12:52.564878+0000","last_undegraded":"2024-09-17T03:12:52.564878+0000","last_fullsized":"2024-09-17T03:12:52.564878+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:53.159263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.564627+0000","last_change":"2024-09-17T03:12:50.552181+0000","last_active":"2024-09-17T03:12:52.564627+0000","last_peered":"2024-09-17T03:12:52.564627+0000","last_clean":"2024-09-17T03:12:52.564627+0000","last_became_active":"2024-09-17T03:12:50.551138+0000","last_became_peered":"2024-09-17T03:12:50.551138+0000","last_unstale":"2024-09-17T03:12:52.564627+0000","last_undegraded":"2024-09-17T03:12:52.564627+0000","last_fullsized":"2024-09-17T03:12:52.564627+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:32.397645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.563193+0000","last_change":"2024-09-17T03:12:51.567407+0000","last_active":"2024-09-17T03:12:52.563193+0000","last_peered":"2024-09-17T03:12:52.563193+0000","last_clean":"2024-09-17T03:12:52.563193+0000","last_became_active":"2024-09-17T03:12:51.567088+0000","last_became_peered":"2024-09-17T03:12:51.567088+0000","last_unstale":"2024-09-17T03:12:52.563193+0000","last_undegraded":"2024-09-17T03:12:52.563193+0000","last_fullsized":"2024-09-17T03:12:52.563193+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:20.575188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:54.069995+0000","last_change":"2024-09-17T03:12:50.558633+0000","last_active":"2024-09-17T03:12:54.069995+0000","last_peered":"2024-09-17T03:12:54.069995+0000","last_clean":"2024-09-17T03:12:54.069995+0000","last_became_active":"2024-09-17T03:12:50.558373+0000","last_became_peered":"2024-09-17T03:12:50.558373+0000","last_unstale":"2024-09-17T03:12:54.069995+0000","last_undegraded":"2024-09-17T03:12:54.069995+0000","last_fullsized":"2024-09-17T03:12:54.069995+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:12:42.341591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.401509+0000","last_change":"2024-09-17T03:12:51.561736+0000","last_active":"2024-09-17T03:12:53.401509+0000","last_peered":"2024-09-17T03:12:53.401509+0000","last_clean":"2024-09-17T03:12:53.401509+0000","last_became_active":"2024-09-17T03:12:51.561397+0000","last_became_peered":"2024-09-17T03:12:51.561397+0000","last_unstale":"2024-09-17T03:12:53.401509+0000","last_undegraded":"2024-09-17T03:12:53.401509+0000","last_fullsized":"2024-09-17T03:12:53.401509+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:27.189783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.563576+0000","last_change":"2024-09-17T03:12:50.554790+0000","last_active":"2024-09-17T03:12:52.563576+0000","last_peered":"2024-09-17T03:12:52.563576+0000","last_clean":"2024-09-17T03:12:52.563576+0000","last_became_active":"2024-09-17T03:12:50.554441+0000","last_became_peered":"2024-09-17T03:12:50.554441+0000","last_unstale":"2024-09-17T03:12:52.563576+0000","last_undegraded":"2024-09-17T03:12:52.563576+0000","last_fullsized":"2024-09-17T03:12:52.563576+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:45:40.937899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:54.177482+0000","last_change":"2024-09-17T03:12:51.570982+0000","last_active":"2024-09-17T03:12:54.177482+0000","last_peered":"2024-09-17T03:12:54.177482+0000","last_clean":"2024-09-17T03:12:54.177482+0000","last_became_active":"2024-09-17T03:12:51.570303+0000","last_became_peered":"2024-09-17T03:12:51.570303+0000","last_unstale":"2024-09-17T03:12:54.177482+0000","last_undegraded":"2024-09-17T03:12:54.177482+0000","last_fullsized":"2024-09-17T03:12:54.177482+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:17.831626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.565753+0000","last_change":"2024-09-17T03:12:50.553084+0000","last_active":"2024-09-17T03:12:52.565753+0000","last_peered":"2024-09-17T03:12:52.565753+0000","last_clean":"2024-09-17T03:12:52.565753+0000","last_became_active":"2024-09-17T03:12:50.552769+0000","last_became_peered":"2024-09-17T03:12:50.552769+0000","last_unstale":"2024-09-17T03:12:52.565753+0000","last_undegraded":"2024-09-17T03:12:52.565753+0000","last_fullsized":"2024-09-17T03:12:52.565753+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:31.894520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.039102+0000","last_change":"2024-09-17T03:12:51.572511+0000","last_active":"2024-09-17T03:12:53.039102+0000","last_peered":"2024-09-17T03:12:53.039102+0000","last_clean":"2024-09-17T03:12:53.039102+0000","last_became_active":"2024-09-17T03:12:51.572191+0000","last_became_peered":"2024-09-17T03:12:51.572191+0000","last_unstale":"2024-09-17T03:12:53.039102+0000","last_undegraded":"2024-09-17T03:12:53.039102+0000","last_fullsized":"2024-09-17T03:12:53.039102+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:47:24.352838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.565583+0000","last_change":"2024-09-17T03:12:50.558611+0000","last_active":"2024-09-17T03:12:52.565583+0000","last_peered":"2024-09-17T03:12:52.565583+0000","last_clean":"2024-09-17T03:12:52.565583+0000","last_became_active":"2024-09-17T03:12:50.558320+0000","last_became_peered":"2024-09-17T03:12:50.558320+0000","last_unstale":"2024-09-17T03:12:52.565583+0000","last_undegraded":"2024-09-17T03:12:52.565583+0000","last_fullsized":"2024-09-17T03:12:52.565583+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:03:00.095104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.565077+0000","last_change":"2024-09-17T03:12:51.569107+0000","last_active":"2024-09-17T03:12:52.565077+0000","last_peered":"2024-09-17T03:12:52.565077+0000","last_clean":"2024-09-17T03:12:52.565077+0000","last_became_active":"2024-09-17T03:12:51.568767+0000","last_became_peered":"2024-09-17T03:12:51.568767+0000","last_unstale":"2024-09-17T03:12:52.565077+0000","last_undegraded":"2024-09-17T03:12:52.565077+0000","last_fullsized":"2024-09-17T03:12:52.565077+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:35.097327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.532151+0000","last_change":"2024-09-17T03:12:50.560334+0000","last_active":"2024-09-17T03:12:53.532151+0000","last_peered":"2024-09-17T03:12:53.532151+0000","last_clean":"2024-09-17T03:12:53.532151+0000","last_became_active":"2024-09-17T03:12:50.560015+0000","last_became_peered":"2024-09-17T03:12:50.560015+0000","last_unstale":"2024-09-17T03:12:53.532151+0000","last_undegraded":"2024-09-17T03:12:53.532151+0000","last_fullsized":"2024-09-17T03:12:53.532151+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:33.899941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.563461+0000","last_change":"2024-09-17T03:12:51.574355+0000","last_active":"2024-09-17T03:12:52.563461+0000","last_peered":"2024-09-17T03:12:52.563461+0000","last_clean":"2024-09-17T03:12:52.563461+0000","last_became_active":"2024-09-17T03:12:51.574062+0000","last_became_peered":"2024-09-17T03:12:51.574062+0000","last_unstale":"2024-09-17T03:12:52.563461+0000","last_undegraded":"2024-09-17T03:12:52.563461+0000","last_fullsized":"2024-09-17T03:12:52.563461+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:53.986351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"68'6","reported_seq":21,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:54.070424+0000","last_change":"2024-09-17T03:12:50.551177+0000","last_active":"2024-09-17T03:12:54.070424+0000","last_peered":"2024-09-17T03:12:54.070424+0000","last_clean":"2024-09-17T03:12:54.070424+0000","last_became_active":"2024-09-17T03:12:50.550823+0000","last_became_peered":"2024-09-17T03:12:50.550823+0000","last_unstale":"2024-09-17T03:12:54.070424+0000","last_undegraded":"2024-09-17T03:12:54.070424+0000","last_fullsized":"2024-09-17T03:12:54.070424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:14:54.602621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.038475+0000","last_change":"2024-09-17T03:12:51.571046+0000","last_active":"2024-09-17T03:12:53.038475+0000","last_peered":"2024-09-17T03:12:53.038475+0000","last_clean":"2024-09-17T03:12:53.038475+0000","last_became_active":"2024-09-17T03:12:51.570720+0000","last_became_peered":"2024-09-17T03:12:51.570720+0000","last_unstale":"2024-09-17T03:12:53.038475+0000","last_undegraded":"2024-09-17T03:12:53.038475+0000","last_fullsized":"2024-09-17T03:12:53.038475+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:08:17.831626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:54.070011+0000","last_change":"2024-09-17T03:12:50.553725+0000","last_active":"2024-09-17T03:12:54.070011+0000","last_peered":"2024-09-17T03:12:54.070011+0000","last_clean":"2024-09-17T03:12:54.070011+0000","last_became_active":"2024-09-17T03:12:50.553296+0000","last_became_peered":"2024-09-17T03:12:50.553296+0000","last_unstale":"2024-09-17T03:12:54.070011+0000","last_undegraded":"2024-09-17T03:12:54.070011+0000","last_fullsized":"2024-09-17T03:12:54.070011+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:46.148402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:54.177246+0000","last_change":"2024-09-17T03:12:51.579398+0000","last_active":"2024-09-17T03:12:54.177246+0000","last_peered":"2024-09-17T03:12:54.177246+0000","last_clean":"2024-09-17T03:12:54.177246+0000","last_became_active":"2024-09-17T03:12:51.579096+0000","last_became_peered":"2024-09-17T03:12:51.579096+0000","last_unstale":"2024-09-17T03:12:54.177246+0000","last_undegraded":"2024-09-17T03:12:54.177246+0000","last_fullsized":"2024-09-17T03:12:54.177246+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:30:42.601150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.564769+0000","last_change":"2024-09-17T03:12:50.552439+0000","last_active":"2024-09-17T03:12:52.564769+0000","last_peered":"2024-09-17T03:12:52.564769+0000","last_clean":"2024-09-17T03:12:52.564769+0000","last_became_active":"2024-09-17T03:12:50.552147+0000","last_became_peered":"2024-09-17T03:12:50.552147+0000","last_unstale":"2024-09-17T03:12:52.564769+0000","last_undegraded":"2024-09-17T03:12:52.564769+0000","last_fullsized":"2024-09-17T03:12:52.564769+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:50:40.498994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.401422+0000","last_change":"2024-09-17T03:12:51.565970+0000","last_active":"2024-09-17T03:12:53.401422+0000","last_peered":"2024-09-17T03:12:53.401422+0000","last_clean":"2024-09-17T03:12:53.401422+0000","last_became_active":"2024-09-17T03:12:51.565654+0000","last_became_peered":"2024-09-17T03:12:51.565654+0000","last_unstale":"2024-09-17T03:12:53.401422+0000","last_undegraded":"2024-09-17T03:12:53.401422+0000","last_fullsized":"2024-09-17T03:12:53.401422+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:27.928679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:54.176959+0000","last_change":"2024-09-17T03:12:50.558884+0000","last_active":"2024-09-17T03:12:54.176959+0000","last_peered":"2024-09-17T03:12:54.176959+0000","last_clean":"2024-09-17T03:12:54.176959+0000","last_became_active":"2024-09-17T03:12:50.558550+0000","last_became_peered":"2024-09-17T03:12:50.558550+0000","last_unstale":"2024-09-17T03:12:54.176959+0000","last_undegraded":"2024-09-17T03:12:54.176959+0000","last_fullsized":"2024-09-17T03:12:54.176959+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:12:22.132155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.563398+0000","last_change":"2024-09-17T03:12:51.565330+0000","last_active":"2024-09-17T03:12:52.563398+0000","last_peered":"2024-09-17T03:12:52.563398+0000","last_clean":"2024-09-17T03:12:52.563398+0000","last_became_active":"2024-09-17T03:12:51.564851+0000","last_became_peered":"2024-09-17T03:12:51.564851+0000","last_unstale":"2024-09-17T03:12:52.563398+0000","last_undegraded":"2024-09-17T03:12:52.563398+0000","last_fullsized":"2024-09-17T03:12:52.563398+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:55.247277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"68'8","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.564226+0000","last_change":"2024-09-17T03:12:50.556886+0000","last_active":"2024-09-17T03:12:52.564226+0000","last_peered":"2024-09-17T03:12:52.564226+0000","last_clean":"2024-09-17T03:12:52.564226+0000","last_became_active":"2024-09-17T03:12:50.556092+0000","last_became_peered":"2024-09-17T03:12:50.556092+0000","last_unstale":"2024-09-17T03:12:52.564226+0000","last_undegraded":"2024-09-17T03:12:52.564226+0000","last_fullsized":"2024-09-17T03:12:52.564226+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:48:24.793870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.566001+0000","last_change":"2024-09-17T03:12:51.575507+0000","last_active":"2024-09-17T03:12:52.566001+0000","last_peered":"2024-09-17T03:12:52.566001+0000","last_clean":"2024-09-17T03:12:52.566001+0000","last_became_active":"2024-09-17T03:12:51.575184+0000","last_became_peered":"2024-09-17T03:12:51.575184+0000","last_unstale":"2024-09-17T03:12:52.566001+0000","last_undegraded":"2024-09-17T03:12:52.566001+0000","last_fullsized":"2024-09-17T03:12:52.566001+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:34.810559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.565505+0000","last_change":"2024-09-17T03:12:50.553551+0000","last_active":"2024-09-17T03:12:52.565505+0000","last_peered":"2024-09-17T03:12:52.565505+0000","last_clean":"2024-09-17T03:12:52.565505+0000","last_became_active":"2024-09-17T03:12:50.553028+0000","last_became_peered":"2024-09-17T03:12:50.553028+0000","last_unstale":"2024-09-17T03:12:52.565505+0000","last_undegraded":"2024-09-17T03:12:52.565505+0000","last_fullsized":"2024-09-17T03:12:52.565505+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:02:36.885078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.039301+0000","last_change":"2024-09-17T03:12:51.569856+0000","last_active":"2024-09-17T03:12:53.039301+0000","last_peered":"2024-09-17T03:12:53.039301+0000","last_clean":"2024-09-17T03:12:53.039301+0000","last_became_active":"2024-09-17T03:12:51.569562+0000","last_became_peered":"2024-09-17T03:12:51.569562+0000","last_unstale":"2024-09-17T03:12:53.039301+0000","last_undegraded":"2024-09-17T03:12:53.039301+0000","last_fullsized":"2024-09-17T03:12:53.039301+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:28:17.906119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.566208+0000","last_change":"2024-09-17T03:12:50.556871+0000","last_active":"2024-09-17T03:12:52.566208+0000","last_peered":"2024-09-17T03:12:52.566208+0000","last_clean":"2024-09-17T03:12:52.566208+0000","last_became_active":"2024-09-17T03:12:50.556543+0000","last_became_peered":"2024-09-17T03:12:50.556543+0000","last_unstale":"2024-09-17T03:12:52.566208+0000","last_undegraded":"2024-09-17T03:12:52.566208+0000","last_fullsized":"2024-09-17T03:12:52.566208+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:19:46.377318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:54.070391+0000","last_change":"2024-09-17T03:12:51.568152+0000","last_active":"2024-09-17T03:12:54.070391+0000","last_peered":"2024-09-17T03:12:54.070391+0000","last_clean":"2024-09-17T03:12:54.070391+0000","last_became_active":"2024-09-17T03:12:51.567799+0000","last_became_peered":"2024-09-17T03:12:51.567799+0000","last_unstale":"2024-09-17T03:12:54.070391+0000","last_undegraded":"2024-09-17T03:12:54.070391+0000","last_fullsized":"2024-09-17T03:12:54.070391+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:32.899432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.565293+0000","last_change":"2024-09-17T03:12:50.559567+0000","last_active":"2024-09-17T03:12:52.565293+0000","last_peered":"2024-09-17T03:12:52.565293+0000","last_clean":"2024-09-17T03:12:52.565293+0000","last_became_active":"2024-09-17T03:12:50.559272+0000","last_became_peered":"2024-09-17T03:12:50.559272+0000","last_unstale":"2024-09-17T03:12:52.565293+0000","last_undegraded":"2024-09-17T03:12:52.565293+0000","last_fullsized":"2024-09-17T03:12:52.565293+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:03:53.561388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.563555+0000","last_change":"2024-09-17T03:12:51.567380+0000","last_active":"2024-09-17T03:12:52.563555+0000","last_peered":"2024-09-17T03:12:52.563555+0000","last_clean":"2024-09-17T03:12:52.563555+0000","last_became_active":"2024-09-17T03:12:51.566881+0000","last_became_peered":"2024-09-17T03:12:51.566881+0000","last_unstale":"2024-09-17T03:12:52.563555+0000","last_undegraded":"2024-09-17T03:12:52.563555+0000","last_fullsized":"2024-09-17T03:12:52.563555+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:42.465433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.038704+0000","last_change":"2024-09-17T03:12:50.561368+0000","last_active":"2024-09-17T03:12:53.038704+0000","last_peered":"2024-09-17T03:12:53.038704+0000","last_clean":"2024-09-17T03:12:53.038704+0000","last_became_active":"2024-09-17T03:12:50.561048+0000","last_became_peered":"2024-09-17T03:12:50.561048+0000","last_unstale":"2024-09-17T03:12:53.038704+0000","last_undegraded":"2024-09-17T03:12:53.038704+0000","last_fullsized":"2024-09-17T03:12:53.038704+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:41.572485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.531733+0000","last_change":"2024-09-17T03:12:51.569311+0000","last_active":"2024-09-17T03:12:53.531733+0000","last_peered":"2024-09-17T03:12:53.531733+0000","last_clean":"2024-09-17T03:12:53.531733+0000","last_became_active":"2024-09-17T03:12:51.568983+0000","last_became_peered":"2024-09-17T03:12:51.568983+0000","last_unstale":"2024-09-17T03:12:53.531733+0000","last_undegraded":"2024-09-17T03:12:53.531733+0000","last_fullsized":"2024-09-17T03:12:53.531733+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:23.746990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.564904+0000","last_change":"2024-09-17T03:12:50.553656+0000","last_active":"2024-09-17T03:12:52.564904+0000","last_peered":"2024-09-17T03:12:52.564904+0000","last_clean":"2024-09-17T03:12:52.564904+0000","last_became_active":"2024-09-17T03:12:50.553349+0000","last_became_peered":"2024-09-17T03:12:50.553349+0000","last_unstale":"2024-09-17T03:12:52.564904+0000","last_undegraded":"2024-09-17T03:12:52.564904+0000","last_fullsized":"2024-09-17T03:12:52.564904+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:51.542863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.531748+0000","last_change":"2024-09-17T03:12:51.570982+0000","last_active":"2024-09-17T03:12:53.531748+0000","last_peered":"2024-09-17T03:12:53.531748+0000","last_clean":"2024-09-17T03:12:53.531748+0000","last_became_active":"2024-09-17T03:12:51.570683+0000","last_became_peered":"2024-09-17T03:12:51.570683+0000","last_unstale":"2024-09-17T03:12:53.531748+0000","last_undegraded":"2024-09-17T03:12:53.531748+0000","last_fullsized":"2024-09-17T03:12:53.531748+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:51:13.968602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:54.177209+0000","last_change":"2024-09-17T03:12:50.561347+0000","last_active":"2024-09-17T03:12:54.177209+0000","last_peered":"2024-09-17T03:12:54.177209+0000","last_clean":"2024-09-17T03:12:54.177209+0000","last_became_active":"2024-09-17T03:12:50.561045+0000","last_became_peered":"2024-09-17T03:12:50.561045+0000","last_unstale":"2024-09-17T03:12:54.177209+0000","last_undegraded":"2024-09-17T03:12:54.177209+0000","last_fullsized":"2024-09-17T03:12:54.177209+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:52:43.341326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.531732+0000","last_change":"2024-09-17T03:12:51.570718+0000","last_active":"2024-09-17T03:12:53.531732+0000","last_peered":"2024-09-17T03:12:53.531732+0000","last_clean":"2024-09-17T03:12:53.531732+0000","last_became_active":"2024-09-17T03:12:51.570374+0000","last_became_peered":"2024-09-17T03:12:51.570374+0000","last_unstale":"2024-09-17T03:12:53.531732+0000","last_undegraded":"2024-09-17T03:12:53.531732+0000","last_fullsized":"2024-09-17T03:12:53.531732+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:57.265832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.401331+0000","last_change":"2024-09-17T03:12:50.552653+0000","last_active":"2024-09-17T03:12:53.401331+0000","last_peered":"2024-09-17T03:12:53.401331+0000","last_clean":"2024-09-17T03:12:53.401331+0000","last_became_active":"2024-09-17T03:12:50.552331+0000","last_became_peered":"2024-09-17T03:12:50.552331+0000","last_unstale":"2024-09-17T03:12:53.401331+0000","last_undegraded":"2024-09-17T03:12:53.401331+0000","last_fullsized":"2024-09-17T03:12:53.401331+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:27.420186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.401740+0000","last_change":"2024-09-17T03:12:51.562084+0000","last_active":"2024-09-17T03:12:53.401740+0000","last_peered":"2024-09-17T03:12:53.401740+0000","last_clean":"2024-09-17T03:12:53.401740+0000","last_became_active":"2024-09-17T03:12:51.561783+0000","last_became_peered":"2024-09-17T03:12:51.561783+0000","last_unstale":"2024-09-17T03:12:53.401740+0000","last_undegraded":"2024-09-17T03:12:53.401740+0000","last_fullsized":"2024-09-17T03:12:53.401740+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:17.455920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.565647+0000","last_change":"2024-09-17T03:12:50.552772+0000","last_active":"2024-09-17T03:12:52.565647+0000","last_peered":"2024-09-17T03:12:52.565647+0000","last_clean":"2024-09-17T03:12:52.565647+0000","last_became_active":"2024-09-17T03:12:50.552430+0000","last_became_peered":"2024-09-17T03:12:50.552430+0000","last_unstale":"2024-09-17T03:12:52.565647+0000","last_undegraded":"2024-09-17T03:12:52.565647+0000","last_fullsized":"2024-09-17T03:12:52.565647+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:20.240451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:54.177451+0000","last_change":"2024-09-17T03:12:51.568301+0000","last_active":"2024-09-17T03:12:54.177451+0000","last_peered":"2024-09-17T03:12:54.177451+0000","last_clean":"2024-09-17T03:12:54.177451+0000","last_became_active":"2024-09-17T03:12:51.567961+0000","last_became_peered":"2024-09-17T03:12:51.567961+0000","last_unstale":"2024-09-17T03:12:54.177451+0000","last_undegraded":"2024-09-17T03:12:54.177451+0000","last_fullsized":"2024-09-17T03:12:54.177451+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:58:20.118726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:54.177587+0000","last_change":"2024-09-17T03:12:50.559793+0000","last_active":"2024-09-17T03:12:54.177587+0000","last_peered":"2024-09-17T03:12:54.177587+0000","last_clean":"2024-09-17T03:12:54.177587+0000","last_became_active":"2024-09-17T03:12:50.559454+0000","last_became_peered":"2024-09-17T03:12:50.559454+0000","last_unstale":"2024-09-17T03:12:54.177587+0000","last_undegraded":"2024-09-17T03:12:54.177587+0000","last_fullsized":"2024-09-17T03:12:54.177587+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:05.621816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.038747+0000","last_change":"2024-09-17T03:12:51.572193+0000","last_active":"2024-09-17T03:12:53.038747+0000","last_peered":"2024-09-17T03:12:53.038747+0000","last_clean":"2024-09-17T03:12:53.038747+0000","last_became_active":"2024-09-17T03:12:51.571872+0000","last_became_peered":"2024-09-17T03:12:51.571872+0000","last_unstale":"2024-09-17T03:12:53.038747+0000","last_undegraded":"2024-09-17T03:12:53.038747+0000","last_fullsized":"2024-09-17T03:12:53.038747+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:38:45.413755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.563745+0000","last_change":"2024-09-17T03:12:50.553233+0000","last_active":"2024-09-17T03:12:52.563745+0000","last_peered":"2024-09-17T03:12:52.563745+0000","last_clean":"2024-09-17T03:12:52.563745+0000","last_became_active":"2024-09-17T03:12:50.552920+0000","last_became_peered":"2024-09-17T03:12:50.552920+0000","last_unstale":"2024-09-17T03:12:52.563745+0000","last_undegraded":"2024-09-17T03:12:52.563745+0000","last_fullsized":"2024-09-17T03:12:52.563745+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:30.646331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.039076+0000","last_change":"2024-09-17T03:12:51.575413+0000","last_active":"2024-09-17T03:12:53.039076+0000","last_peered":"2024-09-17T03:12:53.039076+0000","last_clean":"2024-09-17T03:12:53.039076+0000","last_became_active":"2024-09-17T03:12:51.575099+0000","last_became_peered":"2024-09-17T03:12:51.575099+0000","last_unstale":"2024-09-17T03:12:53.039076+0000","last_undegraded":"2024-09-17T03:12:53.039076+0000","last_fullsized":"2024-09-17T03:12:53.039076+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:51.060188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.401491+0000","last_change":"2024-09-17T03:12:50.559436+0000","last_active":"2024-09-17T03:12:53.401491+0000","last_peered":"2024-09-17T03:12:53.401491+0000","last_clean":"2024-09-17T03:12:53.401491+0000","last_became_active":"2024-09-17T03:12:50.559077+0000","last_became_peered":"2024-09-17T03:12:50.559077+0000","last_unstale":"2024-09-17T03:12:53.401491+0000","last_undegraded":"2024-09-17T03:12:53.401491+0000","last_fullsized":"2024-09-17T03:12:53.401491+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:31:19.627856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.563737+0000","last_change":"2024-09-17T03:12:51.564235+0000","last_active":"2024-09-17T03:12:52.563737+0000","last_peered":"2024-09-17T03:12:52.563737+0000","last_clean":"2024-09-17T03:12:52.563737+0000","last_became_active":"2024-09-17T03:12:51.563927+0000","last_became_peered":"2024-09-17T03:12:51.563927+0000","last_unstale":"2024-09-17T03:12:52.563737+0000","last_undegraded":"2024-09-17T03:12:52.563737+0000","last_fullsized":"2024-09-17T03:12:52.563737+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:34.520881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.563385+0000","last_change":"2024-09-17T03:12:50.560680+0000","last_active":"2024-09-17T03:12:52.563385+0000","last_peered":"2024-09-17T03:12:52.563385+0000","last_clean":"2024-09-17T03:12:52.563385+0000","last_became_active":"2024-09-17T03:12:50.560340+0000","last_became_peered":"2024-09-17T03:12:50.560340+0000","last_unstale":"2024-09-17T03:12:52.563385+0000","last_undegraded":"2024-09-17T03:12:52.563385+0000","last_fullsized":"2024-09-17T03:12:52.563385+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:24.636686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.564272+0000","last_change":"2024-09-17T03:12:51.562343+0000","last_active":"2024-09-17T03:12:52.564272+0000","last_peered":"2024-09-17T03:12:52.564272+0000","last_clean":"2024-09-17T03:12:52.564272+0000","last_became_active":"2024-09-17T03:12:51.561931+0000","last_became_peered":"2024-09-17T03:12:51.561931+0000","last_unstale":"2024-09-17T03:12:52.564272+0000","last_undegraded":"2024-09-17T03:12:52.564272+0000","last_fullsized":"2024-09-17T03:12:52.564272+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:36:48.557395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:54.069918+0000","last_change":"2024-09-17T03:12:50.557733+0000","last_active":"2024-09-17T03:12:54.069918+0000","last_peered":"2024-09-17T03:12:54.069918+0000","last_clean":"2024-09-17T03:12:54.069918+0000","last_became_active":"2024-09-17T03:12:50.557424+0000","last_became_peered":"2024-09-17T03:12:50.557424+0000","last_unstale":"2024-09-17T03:12:54.069918+0000","last_undegraded":"2024-09-17T03:12:54.069918+0000","last_fullsized":"2024-09-17T03:12:54.069918+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:11:52.456553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:54.070046+0000","last_change":"2024-09-17T03:12:51.564088+0000","last_active":"2024-09-17T03:12:54.070046+0000","last_peered":"2024-09-17T03:12:54.070046+0000","last_clean":"2024-09-17T03:12:54.070046+0000","last_became_active":"2024-09-17T03:12:51.563756+0000","last_became_peered":"2024-09-17T03:12:51.563756+0000","last_unstale":"2024-09-17T03:12:54.070046+0000","last_undegraded":"2024-09-17T03:12:54.070046+0000","last_fullsized":"2024-09-17T03:12:54.070046+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:44.200621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.565310+0000","last_change":"2024-09-17T03:12:50.557649+0000","last_active":"2024-09-17T03:12:52.565310+0000","last_peered":"2024-09-17T03:12:52.565310+0000","last_clean":"2024-09-17T03:12:52.565310+0000","last_became_active":"2024-09-17T03:12:50.557285+0000","last_became_peered":"2024-09-17T03:12:50.557285+0000","last_unstale":"2024-09-17T03:12:52.565310+0000","last_undegraded":"2024-09-17T03:12:52.565310+0000","last_fullsized":"2024-09-17T03:12:52.565310+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:43.195709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.564541+0000","last_change":"2024-09-17T03:12:51.575253+0000","last_active":"2024-09-17T03:12:52.564541+0000","last_peered":"2024-09-17T03:12:52.564541+0000","last_clean":"2024-09-17T03:12:52.564541+0000","last_became_active":"2024-09-17T03:12:51.573755+0000","last_became_peered":"2024-09-17T03:12:51.573755+0000","last_unstale":"2024-09-17T03:12:52.564541+0000","last_undegraded":"2024-09-17T03:12:52.564541+0000","last_fullsized":"2024-09-17T03:12:52.564541+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:32.442425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.565430+0000","last_change":"2024-09-17T03:12:50.555756+0000","last_active":"2024-09-17T03:12:52.565430+0000","last_peered":"2024-09-17T03:12:52.565430+0000","last_clean":"2024-09-17T03:12:52.565430+0000","last_became_active":"2024-09-17T03:12:50.555359+0000","last_became_peered":"2024-09-17T03:12:50.555359+0000","last_unstale":"2024-09-17T03:12:52.565430+0000","last_undegraded":"2024-09-17T03:12:52.565430+0000","last_fullsized":"2024-09-17T03:12:52.565430+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:45.172786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.531739+0000","last_change":"2024-09-17T03:12:51.571810+0000","last_active":"2024-09-17T03:12:53.531739+0000","last_peered":"2024-09-17T03:12:53.531739+0000","last_clean":"2024-09-17T03:12:53.531739+0000","last_became_active":"2024-09-17T03:12:51.571483+0000","last_became_peered":"2024-09-17T03:12:51.571483+0000","last_unstale":"2024-09-17T03:12:53.531739+0000","last_undegraded":"2024-09-17T03:12:53.531739+0000","last_fullsized":"2024-09-17T03:12:53.531739+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:50.532927+0000","last_clean_scrub_stamp":"2024-09-17T03:12:50.532927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:49:02.877131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:52.564436+0000","last_change":"2024-09-17T03:12:50.554998+0000","last_active":"2024-09-17T03:12:52.564436+0000","last_peered":"2024-09-17T03:12:52.564436+0000","last_clean":"2024-09-17T03:12:52.564436+0000","last_became_active":"2024-09-17T03:12:50.554357+0000","last_became_peered":"2024-09-17T03:12:50.554357+0000","last_unstale":"2024-09-17T03:12:52.564436+0000","last_undegraded":"2024-09-17T03:12:52.564436+0000","last_fullsized":"2024-09-17T03:12:52.564436+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:12:49.528015+0000","last_clean_scrub_stamp":"2024-09-17T03:12:49.528015+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:53.585518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":194,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T03:12:53.038433+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:12:53.038433+0000","last_peered":"2024-09-17T03:12:53.038433+0000","last_clean":"2024-09-17T03:12:53.038433+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:12:53.038433+0000","last_undegraded":"2024-09-17T03:12:53.038433+0000","last_fullsized":"2024-09-17T03:12:53.038433+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509500,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28432,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343408,"statfs":{"total":96636764160,"available":96607649792,"internally_reserved":0,"allocated":1433600,"data_stored":941025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509500,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":839680,"data_stored":350133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509499,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":350131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509500,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":835584,"data_stored":350111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509501,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":843776,"data_stored":351653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509500,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":851968,"data_stored":352269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509500,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1425408,"data_stored":940409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574908,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":839680,"data_stored":350153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:12:59.349 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:12:59.349 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:12:59.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.506+0000 7fccf23da640 1 -- 172.21.15.78:0/4128142320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccec075170 msgr2=0x7fccec0b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:59.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.506+0000 7fccf23da640 1 --2- 172.21.15.78:0/4128142320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccec075170 0x7fccec0b51d0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fccdc009830 tx=0x7fccdc02a480 comp rx=0 tx=0).stop 2024-09-17T03:12:59.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.506+0000 7fccf23da640 1 -- 172.21.15.78:0/4128142320 shutdown_connections 2024-09-17T03:12:59.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.506+0000 7fccf23da640 1 --2- 172.21.15.78:0/4128142320 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fccec0b5710 0x7fccec0b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.506+0000 7fccf23da640 1 --2- 172.21.15.78:0/4128142320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccec075170 0x7fccec0b51d0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.506+0000 7fccf23da640 1 -- 172.21.15.78:0/4128142320 >> 172.21.15.78:0/4128142320 conn(0x7fccec0cdcc0 msgr2=0x7fccec0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:59.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.506+0000 7fccf23da640 1 -- 172.21.15.78:0/4128142320 shutdown_connections 2024-09-17T03:12:59.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.506+0000 7fccf23da640 1 -- 172.21.15.78:0/4128142320 wait complete. 2024-09-17T03:12:59.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.508+0000 7fccf23da640 1 Processor -- start 2024-09-17T03:12:59.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.508+0000 7fccf23da640 1 -- start start 2024-09-17T03:12:59.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.509+0000 7fccf23da640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccec0b45d0 0x7fccec1530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:59.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.509+0000 7fccf23da640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fccec0b5710 0x7fccec14efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:59.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.509+0000 7fccf23da640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fccec158890 0x7fccec158ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:59.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.509+0000 7fccf23da640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fccec0b3960 con 0x7fccec0b45d0 2024-09-17T03:12:59.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.509+0000 7fccf23da640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fccec0b37e0 con 0x7fccec158890 2024-09-17T03:12:59.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.509+0000 7fccf23da640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fccec0b3ae0 con 0x7fccec0b5710 2024-09-17T03:12:59.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.509+0000 7fccebfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccec0b45d0 0x7fccec1530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:59.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.509+0000 7fccebfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccec0b45d0 0x7fccec1530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45662/0 (socket says 172.21.15.78:45662) 2024-09-17T03:12:59.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.509+0000 7fccebfff640 1 -- 172.21.15.78:0/985466114 learned_addr learned my addr 172.21.15.78:0/985466114 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:59.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.510+0000 7fcceb7fe640 1 --2- 172.21.15.78:0/985466114 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fccec0b5710 0x7fccec14efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:59.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.510+0000 7fccebfff640 1 -- 172.21.15.78:0/985466114 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fccec0b5710 msgr2=0x7fccec14efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:59.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.510+0000 7fccf0977640 1 --2- 172.21.15.78:0/985466114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fccec158890 0x7fccec158ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:59.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.510+0000 7fccebfff640 1 --2- 172.21.15.78:0/985466114 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fccec0b5710 0x7fccec14efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.510+0000 7fccebfff640 1 -- 172.21.15.78:0/985466114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fccec158890 msgr2=0x7fccec158ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:59.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.510+0000 7fccebfff640 1 --2- 172.21.15.78:0/985466114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fccec158890 0x7fccec158ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.510+0000 7fccebfff640 1 -- 172.21.15.78:0/985466114 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccec1591e0 con 0x7fccec0b45d0 2024-09-17T03:12:59.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.510+0000 7fcceb7fe640 1 --2- 172.21.15.78:0/985466114 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fccec0b5710 0x7fccec14efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:12:59.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.510+0000 7fccf0977640 1 --2- 172.21.15.78:0/985466114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fccec158890 0x7fccec158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:12:59.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.510+0000 7fccebfff640 1 --2- 172.21.15.78:0/985466114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccec0b45d0 0x7fccec1530b0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fccdc000c00 tx=0x7fccdc033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:59.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.510+0000 7fcce8ff9640 1 -- 172.21.15.78:0/985466114 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc005c90 con 0x7fccec0b45d0 2024-09-17T03:12:59.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.510+0000 7fcce8ff9640 1 -- 172.21.15.78:0/985466114 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccdc031e50 con 0x7fccec0b45d0 2024-09-17T03:12:59.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.510+0000 7fccf23da640 1 -- 172.21.15.78:0/985466114 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccec159bb0 con 0x7fccec0b45d0 2024-09-17T03:12:59.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.510+0000 7fcce8ff9640 1 -- 172.21.15.78:0/985466114 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccdc0332b0 con 0x7fccec0b45d0 2024-09-17T03:12:59.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.510+0000 7fccf23da640 1 -- 172.21.15.78:0/985466114 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccec153d70 con 0x7fccec0b45d0 2024-09-17T03:12:59.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.511+0000 7fccf23da640 1 -- 172.21.15.78:0/985466114 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccec075170 con 0x7fccec0b45d0 2024-09-17T03:12:59.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.512+0000 7fcce8ff9640 1 -- 172.21.15.78:0/985466114 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fccdc033450 con 0x7fccec0b45d0 2024-09-17T03:12:59.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.512+0000 7fcce8ff9640 1 --2- 172.21.15.78:0/985466114 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fccd8078b90 0x7fccd807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:59.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.512+0000 7fcce8ff9640 1 -- 172.21.15.78:0/985466114 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fccdc0bc160 con 0x7fccec0b45d0 2024-09-17T03:12:59.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.513+0000 7fcceb7fe640 1 --2- 172.21.15.78:0/985466114 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fccd8078b90 0x7fccd807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:59.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.513+0000 7fcceb7fe640 1 --2- 172.21.15.78:0/985466114 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fccd8078b90 0x7fccd807b0a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fccec06d0c0 tx=0x7fcce0005dd0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:59.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.517+0000 7fcce8ff9640 1 -- 172.21.15.78:0/985466114 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fccec1591e0 con 0x7fccec0b45d0 2024-09-17T03:12:59.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.766+0000 7fccf23da640 1 -- 172.21.15.78:0/985466114 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fccec068e30 con 0x7fccec0b45d0 2024-09-17T03:12:59.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.769+0000 7fcce8ff9640 1 -- 172.21.15.78:0/985466114 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7fccdc03f030 con 0x7fccec0b45d0 2024-09-17T03:12:59.767 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2024-09-17T03:12:59.768 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBv8uhmn+c/IxAALXG+Qkwye7zc6PjcLBsk1g== 2024-09-17T03:12:59.768 INFO:teuthology.orchestra.run.smithi078.stdout: caps mds = "allow" 2024-09-17T03:12:59.768 INFO:teuthology.orchestra.run.smithi078.stdout: caps mon = "allow r" 2024-09-17T03:12:59.768 INFO:teuthology.orchestra.run.smithi078.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:12:59.768 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2024-09-17T03:12:59.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.771+0000 7fccf23da640 1 -- 172.21.15.78:0/985466114 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fccd8078b90 msgr2=0x7fccd807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:59.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.771+0000 7fccf23da640 1 --2- 172.21.15.78:0/985466114 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fccd8078b90 0x7fccd807b0a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fccec06d0c0 tx=0x7fcce0005dd0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.771+0000 7fccf23da640 1 -- 172.21.15.78:0/985466114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccec0b45d0 msgr2=0x7fccec1530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:59.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.771+0000 7fccf23da640 1 --2- 172.21.15.78:0/985466114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccec0b45d0 0x7fccec1530b0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fccdc000c00 tx=0x7fccdc033c90 comp rx=0 tx=0).stop 2024-09-17T03:12:59.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.771+0000 7fccf23da640 1 -- 172.21.15.78:0/985466114 shutdown_connections 2024-09-17T03:12:59.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.771+0000 7fccf23da640 1 --2- 172.21.15.78:0/985466114 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fccd8078b90 0x7fccd807b0a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.771+0000 7fccf23da640 1 --2- 172.21.15.78:0/985466114 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fccec158890 0x7fccec158ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.771+0000 7fccf23da640 1 --2- 172.21.15.78:0/985466114 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fccec0b5710 0x7fccec14efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.771+0000 7fccf23da640 1 --2- 172.21.15.78:0/985466114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fccec0b45d0 0x7fccec1530b0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.771+0000 7fccf23da640 1 -- 172.21.15.78:0/985466114 >> 172.21.15.78:0/985466114 conn(0x7fccec0cdcc0 msgr2=0x7fccec0d1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:59.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.771+0000 7fccf23da640 1 -- 172.21.15.78:0/985466114 shutdown_connections 2024-09-17T03:12:59.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.771+0000 7fccf23da640 1 -- 172.21.15.78:0/985466114 wait complete. 2024-09-17T03:12:59.782 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:12:59.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.896+0000 7fa555b58640 1 -- 172.21.15.78:0/98069292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5500b66b0 msgr2=0x7fa5500d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:59.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.896+0000 7fa555b58640 1 --2- 172.21.15.78:0/98069292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5500b66b0 0x7fa5500d4d80 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fa5500d00e0 tx=0x7fa54402a410 comp rx=0 tx=0).stop 2024-09-17T03:12:59.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.896+0000 7fa555b58640 1 -- 172.21.15.78:0/98069292 shutdown_connections 2024-09-17T03:12:59.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.896+0000 7fa555b58640 1 --2- 172.21.15.78:0/98069292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5500b66b0 0x7fa5500d4d80 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.896+0000 7fa555b58640 1 -- 172.21.15.78:0/98069292 >> 172.21.15.78:0/98069292 conn(0x7fa55009d7f0 msgr2=0x7fa5500d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:12:59.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.896+0000 7fa555b58640 1 -- 172.21.15.78:0/98069292 shutdown_connections 2024-09-17T03:12:59.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.896+0000 7fa555b58640 1 -- 172.21.15.78:0/98069292 wait complete. 2024-09-17T03:12:59.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.897+0000 7fa555b58640 1 Processor -- start 2024-09-17T03:12:59.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.898+0000 7fa555b58640 1 -- start start 2024-09-17T03:12:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.899+0000 7fa555b58640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5500b9b60 0x7fa5500caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.899+0000 7fa555b58640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5500cf540 0x7fa55015c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.899+0000 7fa555b58640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa550160600 0x7fa550160a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.899+0000 7fa555b58640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa55006f7f0 con 0x7fa5500b9b60 2024-09-17T03:12:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.899+0000 7fa555b58640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa55006f670 con 0x7fa5500cf540 2024-09-17T03:12:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.899+0000 7fa555b58640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa55006f970 con 0x7fa550160600 2024-09-17T03:12:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.899+0000 7fa54f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5500b9b60 0x7fa5500caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.899+0000 7fa54f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5500b9b60 0x7fa5500caa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45694/0 (socket says 172.21.15.78:45694) 2024-09-17T03:12:59.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.899+0000 7fa54f7fe640 1 -- 172.21.15.78:0/2531133528 learned_addr learned my addr 172.21.15.78:0/2531133528 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:12:59.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.899+0000 7fa54f7fe640 1 -- 172.21.15.78:0/2531133528 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa550160600 msgr2=0x7fa550160a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:59.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.899+0000 7fa54f7fe640 1 --2- 172.21.15.78:0/2531133528 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa550160600 0x7fa550160a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.899+0000 7fa54f7fe640 1 -- 172.21.15.78:0/2531133528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5500cf540 msgr2=0x7fa55015c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:12:59.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.899+0000 7fa54f7fe640 1 --2- 172.21.15.78:0/2531133528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5500cf540 0x7fa55015c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:12:59.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.899+0000 7fa54f7fe640 1 -- 172.21.15.78:0/2531133528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa550160f50 con 0x7fa5500b9b60 2024-09-17T03:12:59.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.899+0000 7fa54f7fe640 1 --2- 172.21.15.78:0/2531133528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5500b9b60 0x7fa5500caa50 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fa54000c410 tx=0x7fa54000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:59.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.900+0000 7fa537fff640 1 -- 172.21.15.78:0/2531133528 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540017070 con 0x7fa5500b9b60 2024-09-17T03:12:59.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.900+0000 7fa537fff640 1 -- 172.21.15.78:0/2531133528 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5400035f0 con 0x7fa5500b9b60 2024-09-17T03:12:59.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.900+0000 7fa555b58640 1 -- 172.21.15.78:0/2531133528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa55015cdc0 con 0x7fa5500b9b60 2024-09-17T03:12:59.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.900+0000 7fa537fff640 1 -- 172.21.15.78:0/2531133528 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540003a80 con 0x7fa5500b9b60 2024-09-17T03:12:59.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.900+0000 7fa555b58640 1 -- 172.21.15.78:0/2531133528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa55015ea50 con 0x7fa5500b9b60 2024-09-17T03:12:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.901+0000 7fa555b58640 1 -- 172.21.15.78:0/2531133528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5500d4d80 con 0x7fa5500b9b60 2024-09-17T03:12:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.902+0000 7fa537fff640 1 -- 172.21.15.78:0/2531133528 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa54001a070 con 0x7fa5500b9b60 2024-09-17T03:12:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.902+0000 7fa537fff640 1 --2- 172.21.15.78:0/2531133528 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa53c078bc0 0x7fa53c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:12:59.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.902+0000 7fa537fff640 1 -- 172.21.15.78:0/2531133528 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fa540099fc0 con 0x7fa5500b9b60 2024-09-17T03:12:59.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.902+0000 7fa54effd640 1 --2- 172.21.15.78:0/2531133528 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa53c078bc0 0x7fa53c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:12:59.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.903+0000 7fa54effd640 1 --2- 172.21.15.78:0/2531133528 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa53c078bc0 0x7fa53c07b0d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa544034000 tx=0x7fa5440046c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:12:59.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:12:59.906+0000 7fa537fff640 1 -- 172.21.15.78:0/2531133528 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa550160f50 con 0x7fa5500b9b60 2024-09-17T03:13:00.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.116+0000 7fa555b58640 1 -- 172.21.15.78:0/2531133528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5501eb050 con 0x7fa5500b9b60 2024-09-17T03:13:00.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.117+0000 7fa537fff640 1 -- 172.21.15.78:0/2531133528 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5231 (secure 0 0 0) 0x7fa540062490 con 0x7fa5500b9b60 2024-09-17T03:13:00.116 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:00.116 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":61,"btime":"2024-09-17T03:12:53:561218+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5873,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/3831026382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3831026382},{"type":"v1","addr":"172.21.15.193:6836","nonce":3831026382}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/1431701139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1431701139},{"type":"v1","addr":"172.21.15.193:6837","nonce":1431701139}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6861,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/2905189397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2905189397},{"type":"v1","addr":"172.21.15.78:6834","nonce":2905189397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:12:50.905684+0000","modified":"2024-09-17T03:12:52.910658+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6864},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6864":{"gid":6864,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/2058899730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2058899730},{"type":"v1","addr":"172.21.15.78:6835","nonce":2058899730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6864,"qdb_cluster":[6864]},"id":5}]} 2024-09-17T03:13:00.116 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 61 2024-09-17T03:13:00.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.119+0000 7fa555b58640 1 -- 172.21.15.78:0/2531133528 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa53c078bc0 msgr2=0x7fa53c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:00.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.119+0000 7fa555b58640 1 --2- 172.21.15.78:0/2531133528 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa53c078bc0 0x7fa53c07b0d0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa544034000 tx=0x7fa5440046c0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.119+0000 7fa555b58640 1 -- 172.21.15.78:0/2531133528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5500b9b60 msgr2=0x7fa5500caa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:00.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.119+0000 7fa555b58640 1 --2- 172.21.15.78:0/2531133528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5500b9b60 0x7fa5500caa50 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fa54000c410 tx=0x7fa54000c8d0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.119+0000 7fa555b58640 1 -- 172.21.15.78:0/2531133528 shutdown_connections 2024-09-17T03:13:00.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.119+0000 7fa555b58640 1 --2- 172.21.15.78:0/2531133528 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa550160600 0x7fa550160a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.119+0000 7fa555b58640 1 --2- 172.21.15.78:0/2531133528 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa53c078bc0 0x7fa53c07b0d0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.119+0000 7fa555b58640 1 --2- 172.21.15.78:0/2531133528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5500cf540 0x7fa55015c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.119+0000 7fa555b58640 1 --2- 172.21.15.78:0/2531133528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5500b9b60 0x7fa5500caa50 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.119+0000 7fa555b58640 1 -- 172.21.15.78:0/2531133528 >> 172.21.15.78:0/2531133528 conn(0x7fa55009d7f0 msgr2=0x7fa5500b7370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:00.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.119+0000 7fa555b58640 1 -- 172.21.15.78:0/2531133528 shutdown_connections 2024-09-17T03:13:00.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.119+0000 7fa555b58640 1 -- 172.21.15.78:0/2531133528 wait complete. 2024-09-17T03:13:00.532 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 61, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:12:50.905684+0000', 'modified': '2024-09-17T03:12:52.910658+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6864}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6864': {'gid': 6864, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6835/2058899730', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6833', 'nonce': 2058899730}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 2058899730}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6864, 'qdb_cluster': [6864]} 2024-09-17T03:13:00.532 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:13:00.532 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:13:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.648+0000 7f1457407640 1 -- 172.21.15.78:0/394695835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14500b2cb0 msgr2=0x7f14500b30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.648+0000 7f1457407640 1 --2- 172.21.15.78:0/394695835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14500b2cb0 0x7f14500b30c0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f1450075570 tx=0x7f144802aa30 comp rx=0 tx=0).stop 2024-09-17T03:13:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.648+0000 7f1457407640 1 -- 172.21.15.78:0/394695835 shutdown_connections 2024-09-17T03:13:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.648+0000 7f1457407640 1 --2- 172.21.15.78:0/394695835 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14500b2cb0 0x7f14500b30c0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.648+0000 7f1457407640 1 --2- 172.21.15.78:0/394695835 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14500b0520 0x7f1450071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.648+0000 7f1457407640 1 --2- 172.21.15.78:0/394695835 >> v2:172.21.15.193:3300/0 conn(0x7f145015b8f0 0x7f14500cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.648+0000 7f1457407640 1 -- 172.21.15.78:0/394695835 >> 172.21.15.78:0/394695835 conn(0x7f14500cdcb0 msgr2=0x7f14500ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:00.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.648+0000 7f1457407640 1 -- 172.21.15.78:0/394695835 shutdown_connections 2024-09-17T03:13:00.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.648+0000 7f1457407640 1 -- 172.21.15.78:0/394695835 wait complete. 2024-09-17T03:13:00.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.650+0000 7f1457407640 1 Processor -- start 2024-09-17T03:13:00.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.650+0000 7f1457407640 1 -- start start 2024-09-17T03:13:00.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.651+0000 7f1457407640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14500b0520 0x7f145014c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.651+0000 7f1457407640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14500b2cb0 0x7f14500b4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.651+0000 7f1457407640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f145015b8f0 0x7f14500b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.651+0000 7f1457407640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f14500adfa0 con 0x7f14500b0520 2024-09-17T03:13:00.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.651+0000 7f1457407640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1450071da0 con 0x7f14500b2cb0 2024-09-17T03:13:00.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.651+0000 7f1457407640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f14500ae120 con 0x7f145015b8f0 2024-09-17T03:13:00.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.651+0000 7f14551a3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14500b0520 0x7f145014c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:00.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.652+0000 7f14551a3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14500b0520 0x7f145014c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45700/0 (socket says 172.21.15.78:45700) 2024-09-17T03:13:00.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.652+0000 7f14551a3640 1 -- 172.21.15.78:0/87146488 learned_addr learned my addr 172.21.15.78:0/87146488 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:00.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.652+0000 7f14559a4640 1 --2- 172.21.15.78:0/87146488 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f145015b8f0 0x7f14500b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:00.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.652+0000 7f14549a2640 1 --2- 172.21.15.78:0/87146488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14500b2cb0 0x7f14500b4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:00.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.652+0000 7f14551a3640 1 -- 172.21.15.78:0/87146488 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f145015b8f0 msgr2=0x7f14500b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:00.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.652+0000 7f14551a3640 1 --2- 172.21.15.78:0/87146488 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f145015b8f0 0x7f14500b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.652+0000 7f14551a3640 1 -- 172.21.15.78:0/87146488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14500b2cb0 msgr2=0x7f14500b4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:00.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.652+0000 7f14551a3640 1 --2- 172.21.15.78:0/87146488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14500b2cb0 0x7f14500b4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.652+0000 7f14551a3640 1 -- 172.21.15.78:0/87146488 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1450157790 con 0x7f14500b0520 2024-09-17T03:13:00.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.652+0000 7f14549a2640 1 --2- 172.21.15.78:0/87146488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14500b2cb0 0x7f14500b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:00.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.652+0000 7f14551a3640 1 --2- 172.21.15.78:0/87146488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14500b0520 0x7f145014c060 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f144c00d770 tx=0x7f144c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:00.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.652+0000 7f1445ffb640 1 -- 172.21.15.78:0/87146488 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c017070 con 0x7f14500b0520 2024-09-17T03:13:00.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.652+0000 7f1445ffb640 1 -- 172.21.15.78:0/87146488 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f144c009d20 con 0x7f14500b0520 2024-09-17T03:13:00.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.652+0000 7f1457407640 1 -- 172.21.15.78:0/87146488 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14501f74d0 con 0x7f14500b0520 2024-09-17T03:13:00.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.652+0000 7f1445ffb640 1 -- 172.21.15.78:0/87146488 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c0106c0 con 0x7f14500b0520 2024-09-17T03:13:00.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.652+0000 7f1457407640 1 -- 172.21.15.78:0/87146488 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1450157a70 con 0x7f14500b0520 2024-09-17T03:13:00.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.654+0000 7f1445ffb640 1 -- 172.21.15.78:0/87146488 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f144c01a070 con 0x7f14500b0520 2024-09-17T03:13:00.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.655+0000 7f1445ffb640 1 --2- 172.21.15.78:0/87146488 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1434078b90 0x7f143407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.655+0000 7f1445ffb640 1 -- 172.21.15.78:0/87146488 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f144c09ad10 con 0x7f14500b0520 2024-09-17T03:13:00.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.655+0000 7f14549a2640 1 --2- 172.21.15.78:0/87146488 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1434078b90 0x7f143407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:00.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.655+0000 7f145e44c740 1 Processor -- start 2024-09-17T03:13:00.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.655+0000 7f145e44c740 1 -- start start 2024-09-17T03:13:00.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.656+0000 7f14549a2640 1 --2- 172.21.15.78:0/87146488 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1434078b90 0x7f143407b0a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1440005fd0 tx=0x7f144000f360 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:00.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f145e44c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de89270 0x55cc1e249990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f145e44c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de603b0 0x55cc1e257e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f145e44c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cc1de68590 0x55cc1e2583d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f145e44c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55cc1e1a3820 con 0x55cc1de603b0 2024-09-17T03:13:00.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f145e44c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55cc1e192c50 con 0x55cc1de68590 2024-09-17T03:13:00.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f145e44c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55cc1e196a60 con 0x55cc1de89270 2024-09-17T03:13:00.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f14549a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de603b0 0x55cc1e257e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:00.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f14549a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de603b0 0x55cc1e257e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45716/0 (socket says 172.21.15.78:45716) 2024-09-17T03:13:00.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f14549a2640 1 -- 172.21.15.78:0/4122085774 learned_addr learned my addr 172.21.15.78:0/4122085774 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:00.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f14559a4640 1 --2- 172.21.15.78:0/4122085774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cc1de68590 0x55cc1e2583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:00.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f14551a3640 1 --2- 172.21.15.78:0/4122085774 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de89270 0x55cc1e249990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:00.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f14549a2640 1 -- 172.21.15.78:0/4122085774 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de89270 msgr2=0x55cc1e249990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:00.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f14549a2640 1 --2- 172.21.15.78:0/4122085774 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de89270 0x55cc1e249990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f14549a2640 1 -- 172.21.15.78:0/4122085774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cc1de68590 msgr2=0x55cc1e2583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:00.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f14549a2640 1 --2- 172.21.15.78:0/4122085774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cc1de68590 0x55cc1e2583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f14549a2640 1 -- 172.21.15.78:0/4122085774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc1def4850 con 0x55cc1de603b0 2024-09-17T03:13:00.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f14559a4640 1 --2- 172.21.15.78:0/4122085774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cc1de68590 0x55cc1e2583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:00.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f14551a3640 1 --2- 172.21.15.78:0/4122085774 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de89270 0x55cc1e249990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:00.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f14549a2640 1 --2- 172.21.15.78:0/4122085774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de603b0 0x55cc1e257e90 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f144000fea0 tx=0x7f1440012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b4e4ab9f4df256d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:00.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f143affd640 1 -- 172.21.15.78:0/4122085774 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1440022070 con 0x55cc1de603b0 2024-09-17T03:13:00.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f143affd640 1 -- 172.21.15.78:0/4122085774 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1440011e50 con 0x55cc1de603b0 2024-09-17T03:13:00.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.657+0000 7f143affd640 1 -- 172.21.15.78:0/4122085774 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144001e940 con 0x55cc1de603b0 2024-09-17T03:13:00.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.658+0000 7f145e44c740 1 -- 172.21.15.78:0/4122085774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de603b0 msgr2=0x55cc1e257e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:00.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.658+0000 7f145e44c740 1 --2- 172.21.15.78:0/4122085774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de603b0 0x55cc1e257e90 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f144000fea0 tx=0x7f1440012000 comp rx=0 tx=0).stop 2024-09-17T03:13:00.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.658+0000 7f145e44c740 1 -- 172.21.15.78:0/4122085774 shutdown_connections 2024-09-17T03:13:00.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.658+0000 7f145e44c740 1 --2- 172.21.15.78:0/4122085774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cc1de68590 0x55cc1e2583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.658+0000 7f145e44c740 1 --2- 172.21.15.78:0/4122085774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de603b0 0x55cc1e257e90 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.658+0000 7f145e44c740 1 --2- 172.21.15.78:0/4122085774 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de89270 0x55cc1e249990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.658+0000 7f145e44c740 1 -- 172.21.15.78:0/4122085774 >> 172.21.15.78:0/4122085774 conn(0x55cc1de7d3c0 msgr2=0x55cc1e231280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:00.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.658+0000 7f145e44c740 1 -- 172.21.15.78:0/4122085774 shutdown_connections 2024-09-17T03:13:00.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.658+0000 7f145e44c740 1 -- 172.21.15.78:0/4122085774 wait complete. 2024-09-17T03:13:00.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.659+0000 7f145e44c740 1 -- start start 2024-09-17T03:13:00.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.659+0000 7f145e44c740 1 Processor -- start 2024-09-17T03:13:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f145e44c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de603b0 0x55cc1e26d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f145e44c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de68590 0x55cc1e26e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f145e44c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cc1de89270 0x55cc1e2482c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f145e44c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55cc1df03620 con 0x55cc1de603b0 2024-09-17T03:13:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f145e44c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55cc1e1385f0 con 0x55cc1de89270 2024-09-17T03:13:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f145e44c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55cc1e26eab0 con 0x55cc1de68590 2024-09-17T03:13:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f14551a3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de603b0 0x55cc1e26d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f145e44c740 10 client.0 _ll_register_callbacks cb 0x55cc1e13c0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f14551a3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de603b0 0x55cc1e26d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45726/0 (socket says 172.21.15.78:45726) 2024-09-17T03:13:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f14551a3640 1 -- 172.21.15.78:0/3136641809 learned_addr learned my addr 172.21.15.78:0/3136641809 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f14549a2640 1 --2- 172.21.15.78:0/3136641809 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de68590 0x55cc1e26e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:00.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f14559a4640 1 --2- 172.21.15.78:0/3136641809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cc1de89270 0x55cc1e2482c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:00.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f14551a3640 1 -- 172.21.15.78:0/3136641809 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de68590 msgr2=0x55cc1e26e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:00.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f14551a3640 1 --2- 172.21.15.78:0/3136641809 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de68590 0x55cc1e26e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f14551a3640 1 -- 172.21.15.78:0/3136641809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cc1de89270 msgr2=0x55cc1e2482c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:00.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f14551a3640 1 --2- 172.21.15.78:0/3136641809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cc1de89270 0x55cc1e2482c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f14551a3640 1 -- 172.21.15.78:0/3136641809 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc1df6b6b0 con 0x55cc1de603b0 2024-09-17T03:13:00.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f14549a2640 1 --2- 172.21.15.78:0/3136641809 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de68590 0x55cc1e26e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:00.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f14551a3640 1 --2- 172.21.15.78:0/3136641809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de603b0 0x55cc1e26d7c0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f144c062910 tx=0x7f144c062690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff85383c884d50df server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:00.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f142ffff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:00.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f142ffff640 1 -- 172.21.15.78:0/3136641809 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f144c021070 con 0x55cc1de603b0 2024-09-17T03:13:00.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f142ffff640 1 -- 172.21.15.78:0/3136641809 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f144c04bc00 con 0x55cc1de603b0 2024-09-17T03:13:00.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f145e44c740 1 -- 172.21.15.78:0/3136641809 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1440011e50 con 0x55cc1de603b0 2024-09-17T03:13:00.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f142ffff640 1 -- 172.21.15.78:0/3136641809 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f144c062720 con 0x55cc1de603b0 2024-09-17T03:13:00.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.661+0000 7f145e44c740 10 client.7032 fetch_fsmap learned FSMap version 61 2024-09-17T03:13:00.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.662+0000 7f145e44c740 1 -- 172.21.15.78:0/3136641809 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55cc1e248800 con 0x55cc1de603b0 2024-09-17T03:13:00.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.662+0000 7f142ffff640 1 -- 172.21.15.78:0/3136641809 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1440011e50 con 0x55cc1de603b0 2024-09-17T03:13:00.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.662+0000 7f142ffff640 1 -- 172.21.15.78:0/3136641809 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 61) ==== 3502+0+0 (secure 0 0 0) 0x7f144c087020 con 0x55cc1de603b0 2024-09-17T03:13:00.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.662+0000 7f145e44c740 10 client.7032 fetch_fsmap finished waiting for FSMap version 61 2024-09-17T03:13:00.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.662+0000 7f145e44c740 10 client.7032 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:13:00.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.662+0000 7f145e44c740 20 client.7032 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:00.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.662+0000 7f145e44c740 1 --2- 172.21.15.78:0/3136641809 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55cc1de47e40 0x55cc1e28c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.662+0000 7f145e44c740 4 client.7032 mds_command: new command op to 6864 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:13:00.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.662+0000 7f145e44c740 1 -- 172.21.15.78:0/3136641809 --> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc1e1a5770 con 0x55cc1de47e40 2024-09-17T03:13:00.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.662+0000 7f14549a2640 1 --2- 172.21.15.78:0/3136641809 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55cc1de47e40 0x55cc1e28c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:00.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.662+0000 7f142ffff640 10 client.7032 ms_handle_connect on v2:172.21.15.78:6833/2058899730 2024-09-17T03:13:00.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.662+0000 7f14549a2640 1 --2- 172.21.15.78:0/3136641809 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55cc1de47e40 0x55cc1e28c980 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f860ced555effcb server_cookie=211af6025db1586 in_seq=0 out_seq=0 2024-09-17T03:13:00.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.663+0000 7f142ffff640 1 -- 172.21.15.78:0/3136641809 <== mds.0 v2:172.21.15.78:6833/2058899730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cc1e1a5770 con 0x55cc1de47e40 2024-09-17T03:13:00.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.663+0000 7f142ffff640 10 client.7032 handle_command_reply: tid=0 2024-09-17T03:13:00.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.663+0000 7f145e44c740 1 client.7032 shutdown 2024-09-17T03:13:00.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.663+0000 7f145e44c740 1 -- 172.21.15.78:0/3136641809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de603b0 msgr2=0x55cc1e26d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:00.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.663+0000 7f145e44c740 1 --2- 172.21.15.78:0/3136641809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de603b0 0x55cc1e26d7c0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f144c062910 tx=0x7f144c062690 comp rx=0 tx=0).stop 2024-09-17T03:13:00.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.663+0000 7f145e44c740 1 -- 172.21.15.78:0/3136641809 shutdown_connections 2024-09-17T03:13:00.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.663+0000 7f145e44c740 1 --2- 172.21.15.78:0/3136641809 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cc1de89270 0x55cc1e2482c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.663+0000 7f145e44c740 1 --2- 172.21.15.78:0/3136641809 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55cc1de47e40 0x55cc1e28c980 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.663+0000 7f145e44c740 1 --2- 172.21.15.78:0/3136641809 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de68590 0x55cc1e26e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.663+0000 7f145e44c740 1 --2- 172.21.15.78:0/3136641809 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de603b0 0x55cc1e26d7c0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.663+0000 7f142ffff640 0 client.7032 ms_handle_reset on v2:172.21.15.78:6833/2058899730 2024-09-17T03:13:00.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.663+0000 7f145e44c740 1 -- 172.21.15.78:0/3136641809 >> 172.21.15.78:0/3136641809 conn(0x55cc1de7d3c0 msgr2=0x55cc1e24b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:00.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.663+0000 7f145e44c740 1 -- 172.21.15.78:0/3136641809 shutdown_connections 2024-09-17T03:13:00.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.663+0000 7f145e44c740 1 -- 172.21.15.78:0/3136641809 wait complete. 2024-09-17T03:13:00.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.663+0000 7f145e44c740 20 client.7032 trim_cache size 0 max 16384 2024-09-17T03:13:00.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.682+0000 7f145e44c740 1 Processor -- start 2024-09-17T03:13:00.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.682+0000 7f145e44c740 1 -- start start 2024-09-17T03:13:00.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.683+0000 7f145e44c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cc1de603b0 0x55cc1e25b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.683+0000 7f145e44c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de68590 0x55cc1e26ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.683+0000 7f145e44c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de89270 0x55cc1e29cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.683+0000 7f145e44c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1450167760 con 0x55cc1de89270 2024-09-17T03:13:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.683+0000 7f145e44c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f14501f4210 con 0x55cc1de603b0 2024-09-17T03:13:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.683+0000 7f145e44c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f1450156bb0 con 0x55cc1de68590 2024-09-17T03:13:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.683+0000 7f14559a4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de89270 0x55cc1e29cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.683+0000 7f14559a4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de89270 0x55cc1e29cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45730/0 (socket says 172.21.15.78:45730) 2024-09-17T03:13:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.683+0000 7f14559a4640 1 -- 172.21.15.78:0/260666638 learned_addr learned my addr 172.21.15.78:0/260666638 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.683+0000 7f14559a4640 1 -- 172.21.15.78:0/260666638 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de68590 msgr2=0x55cc1e26ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.683+0000 7f14559a4640 1 --2- 172.21.15.78:0/260666638 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de68590 0x55cc1e26ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.683+0000 7f14559a4640 1 -- 172.21.15.78:0/260666638 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cc1de603b0 msgr2=0x55cc1e25b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.683+0000 7f14559a4640 1 --2- 172.21.15.78:0/260666638 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cc1de603b0 0x55cc1e25b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.683+0000 7f14559a4640 1 -- 172.21.15.78:0/260666638 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc1e226a40 con 0x55cc1de89270 2024-09-17T03:13:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.684+0000 7f14559a4640 1 --2- 172.21.15.78:0/260666638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de89270 0x55cc1e29cd50 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f1448009910 tx=0x7f1448004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16cd6f4b3756275e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.684+0000 7f143a7fc640 1 -- 172.21.15.78:0/260666638 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1448033040 con 0x55cc1de89270 2024-09-17T03:13:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.684+0000 7f143a7fc640 1 -- 172.21.15.78:0/260666638 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f144802fc00 con 0x55cc1de89270 2024-09-17T03:13:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.684+0000 7f143a7fc640 1 -- 172.21.15.78:0/260666638 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1448003970 con 0x55cc1de89270 2024-09-17T03:13:00.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.684+0000 7f145e44c740 1 -- 172.21.15.78:0/260666638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de89270 msgr2=0x55cc1e29cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:00.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.684+0000 7f145e44c740 1 --2- 172.21.15.78:0/260666638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de89270 0x55cc1e29cd50 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f1448009910 tx=0x7f1448004ab0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.684+0000 7f145e44c740 1 -- 172.21.15.78:0/260666638 shutdown_connections 2024-09-17T03:13:00.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.684+0000 7f145e44c740 1 --2- 172.21.15.78:0/260666638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de89270 0x55cc1e29cd50 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.684+0000 7f145e44c740 1 --2- 172.21.15.78:0/260666638 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de68590 0x55cc1e26ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.684+0000 7f145e44c740 1 --2- 172.21.15.78:0/260666638 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cc1de603b0 0x55cc1e25b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.684+0000 7f145e44c740 1 -- 172.21.15.78:0/260666638 >> 172.21.15.78:0/260666638 conn(0x55cc1de7d3c0 msgr2=0x55cc1e26f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:00.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.684+0000 7f145e44c740 1 -- 172.21.15.78:0/260666638 shutdown_connections 2024-09-17T03:13:00.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.685+0000 7f145e44c740 1 -- 172.21.15.78:0/260666638 wait complete. 2024-09-17T03:13:00.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.685+0000 7f145e44c740 1 -- start start 2024-09-17T03:13:00.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.685+0000 7f145e44c740 1 Processor -- start 2024-09-17T03:13:00.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.687+0000 7f145e44c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cc1de603b0 0x55cc1e2e2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.687+0000 7f145e44c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de68590 0x55cc1e26f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.687+0000 7f145e44c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de89270 0x55cc1e26fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.687+0000 7f145e44c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55cc1e2309e0 con 0x55cc1de89270 2024-09-17T03:13:00.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.687+0000 7f145e44c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55cc1e26e7f0 con 0x55cc1de603b0 2024-09-17T03:13:00.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.687+0000 7f145e44c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55cc1e272cc0 con 0x55cc1de68590 2024-09-17T03:13:00.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.687+0000 7f145e44c740 10 client.0 _ll_register_callbacks cb 0x7f144c00b5f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:00.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.687+0000 7f14559a4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de89270 0x55cc1e26fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:00.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.687+0000 7f14559a4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de89270 0x55cc1e26fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45746/0 (socket says 172.21.15.78:45746) 2024-09-17T03:13:00.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.687+0000 7f14559a4640 1 -- 172.21.15.78:0/2654033754 learned_addr learned my addr 172.21.15.78:0/2654033754 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:00.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.687+0000 7f14549a2640 1 --2- 172.21.15.78:0/2654033754 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de68590 0x55cc1e26f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:00.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.687+0000 7f14551a3640 1 --2- 172.21.15.78:0/2654033754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cc1de603b0 0x55cc1e2e2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:00.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.687+0000 7f14559a4640 1 -- 172.21.15.78:0/2654033754 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de68590 msgr2=0x55cc1e26f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:00.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.687+0000 7f14559a4640 1 --2- 172.21.15.78:0/2654033754 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de68590 0x55cc1e26f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.687+0000 7f14559a4640 1 -- 172.21.15.78:0/2654033754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cc1de603b0 msgr2=0x55cc1e2e2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.687+0000 7f14559a4640 1 --2- 172.21.15.78:0/2654033754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cc1de603b0 0x55cc1e2e2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.687+0000 7f14559a4640 1 -- 172.21.15.78:0/2654033754 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc1e270900 con 0x55cc1de89270 2024-09-17T03:13:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.687+0000 7f14559a4640 1 --2- 172.21.15.78:0/2654033754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de89270 0x55cc1e26fd40 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f144802b020 tx=0x7f1448003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff34ed785ad5263f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.687+0000 7f142ffff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.688+0000 7f142ffff640 1 -- 172.21.15.78:0/2654033754 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1448033040 con 0x55cc1de89270 2024-09-17T03:13:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.688+0000 7f142ffff640 1 -- 172.21.15.78:0/2654033754 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f144804caa0 con 0x55cc1de89270 2024-09-17T03:13:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.688+0000 7f145e44c740 1 -- 172.21.15.78:0/2654033754 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f144802fc00 con 0x55cc1de89270 2024-09-17T03:13:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.688+0000 7f142ffff640 1 -- 172.21.15.78:0/2654033754 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f144804cca0 con 0x55cc1de89270 2024-09-17T03:13:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.688+0000 7f145e44c740 10 client.7038 fetch_fsmap learned FSMap version 61 2024-09-17T03:13:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.688+0000 7f145e44c740 1 -- 172.21.15.78:0/2654033754 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=2+}) -- 0x55cc1e29d320 con 0x55cc1de89270 2024-09-17T03:13:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.688+0000 7f142ffff640 1 -- 172.21.15.78:0/2654033754 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f144802fc00 con 0x55cc1de89270 2024-09-17T03:13:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.688+0000 7f142ffff640 1 -- 172.21.15.78:0/2654033754 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 61) ==== 3502+0+0 (secure 0 0 0) 0x7f1448004210 con 0x55cc1de89270 2024-09-17T03:13:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.688+0000 7f145e44c740 10 client.7038 fetch_fsmap finished waiting for FSMap version 61 2024-09-17T03:13:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.688+0000 7f145e44c740 10 client.7038 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:13:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.688+0000 7f145e44c740 20 client.7038 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.688+0000 7f145e44c740 1 --2- 172.21.15.78:0/2654033754 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55cc1e277c10 0x55cc1e2fcca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.688+0000 7f145e44c740 4 client.7038 mds_command: new command op to 6864 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:13:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.688+0000 7f145e44c740 1 -- 172.21.15.78:0/2654033754 --> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] -- command(tid 0: {"prefix": "status"}) -- 0x55cc1e1a1220 con 0x55cc1e277c10 2024-09-17T03:13:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.688+0000 7f14551a3640 1 --2- 172.21.15.78:0/2654033754 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55cc1e277c10 0x55cc1e2fcca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.689+0000 7f142ffff640 10 client.7038 ms_handle_connect on v2:172.21.15.78:6833/2058899730 2024-09-17T03:13:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.689+0000 7f14551a3640 1 --2- 172.21.15.78:0/2654033754 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55cc1e277c10 0x55cc1e2fcca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd1b628b4d5b41b4 server_cookie=725e3a6547208f66 in_seq=0 out_seq=0 2024-09-17T03:13:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.689+0000 7f142ffff640 1 -- 172.21.15.78:0/2654033754 <== mds.0 v2:172.21.15.78:6833/2058899730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55cc1e1a1220 con 0x55cc1e277c10 2024-09-17T03:13:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.689+0000 7f142ffff640 10 client.7038 handle_command_reply: tid=0 2024-09-17T03:13:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.689+0000 7f145e44c740 1 client.7038 shutdown 2024-09-17T03:13:00.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.689+0000 7f145e44c740 1 -- 172.21.15.78:0/2654033754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de89270 msgr2=0x55cc1e26fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.689+0000 7f145e44c740 1 --2- 172.21.15.78:0/2654033754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de89270 0x55cc1e26fd40 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f144802b020 tx=0x7f1448003e90 comp rx=0 tx=0).stop 2024-09-17T03:13:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.689+0000 7f145e44c740 1 -- 172.21.15.78:0/2654033754 shutdown_connections 2024-09-17T03:13:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.689+0000 7f145e44c740 1 --2- 172.21.15.78:0/2654033754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55cc1de89270 0x55cc1e26fd40 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.689+0000 7f145e44c740 1 --2- 172.21.15.78:0/2654033754 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55cc1e277c10 0x55cc1e2fcca0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.689+0000 7f145e44c740 1 --2- 172.21.15.78:0/2654033754 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55cc1de68590 0x55cc1e26f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.689+0000 7f142ffff640 0 client.7038 ms_handle_reset on v2:172.21.15.78:6833/2058899730 2024-09-17T03:13:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.689+0000 7f145e44c740 1 --2- 172.21.15.78:0/2654033754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55cc1de603b0 0x55cc1e2e2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.689+0000 7f145e44c740 1 -- 172.21.15.78:0/2654033754 >> 172.21.15.78:0/2654033754 conn(0x55cc1de7d3c0 msgr2=0x55cc1e257c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.689+0000 7f145e44c740 1 -- 172.21.15.78:0/2654033754 shutdown_connections 2024-09-17T03:13:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.689+0000 7f145e44c740 1 -- 172.21.15.78:0/2654033754 wait complete. 2024-09-17T03:13:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.689+0000 7f145e44c740 20 client.7038 trim_cache size 0 max 16384 2024-09-17T03:13:00.694 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:13:00.694 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:13:00.694 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-09-17T03:13:00.694 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 6864, 2024-09-17T03:13:00.694 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:13:00.694 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:13:00.694 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:13:00.694 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 9.1338615829999998, 2024-09-17T03:13:00.694 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 61, 2024-09-17T03:13:00.694 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 69, 2024-09-17T03:13:00.694 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 69, 2024-09-17T03:13:00.694 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 13.812427246 2024-09-17T03:13:00.695 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:13:00.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.690+0000 7f1457407640 1 -- 172.21.15.78:0/87146488 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1434078b90 msgr2=0x7f143407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:00.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.690+0000 7f1457407640 1 --2- 172.21.15.78:0/87146488 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1434078b90 0x7f143407b0a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1440005fd0 tx=0x7f144000f360 comp rx=0 tx=0).stop 2024-09-17T03:13:00.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.690+0000 7f1457407640 1 -- 172.21.15.78:0/87146488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14500b0520 msgr2=0x7f145014c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:00.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.690+0000 7f1457407640 1 --2- 172.21.15.78:0/87146488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14500b0520 0x7f145014c060 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f144c00d770 tx=0x7f144c00dc30 comp rx=0 tx=0).stop 2024-09-17T03:13:00.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.690+0000 7f1457407640 1 -- 172.21.15.78:0/87146488 shutdown_connections 2024-09-17T03:13:00.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.690+0000 7f1457407640 1 --2- 172.21.15.78:0/87146488 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f145015b8f0 0x7f14500b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.690+0000 7f1457407640 1 --2- 172.21.15.78:0/87146488 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1434078b90 0x7f143407b0a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.690+0000 7f1457407640 1 --2- 172.21.15.78:0/87146488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14500b2cb0 0x7f14500b4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.690+0000 7f1457407640 1 --2- 172.21.15.78:0/87146488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14500b0520 0x7f145014c060 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.690+0000 7f1457407640 1 -- 172.21.15.78:0/87146488 >> 172.21.15.78:0/87146488 conn(0x7f14500cdcb0 msgr2=0x7f14500b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:00.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.690+0000 7f1457407640 1 -- 172.21.15.78:0/87146488 shutdown_connections 2024-09-17T03:13:00.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.690+0000 7f1457407640 1 -- 172.21.15.78:0/87146488 wait complete. 2024-09-17T03:13:00.700 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:13:00.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.814+0000 7fa12c14a640 1 -- 172.21.15.78:0/846519501 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa12406e170 msgr2=0x7fa1240b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:00.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.814+0000 7fa12c14a640 1 --2- 172.21.15.78:0/846519501 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa12406e170 0x7fa1240b3540 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa120005fd0 tx=0x7fa12002a540 comp rx=0 tx=0).stop 2024-09-17T03:13:00.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.814+0000 7fa12c14a640 1 -- 172.21.15.78:0/846519501 shutdown_connections 2024-09-17T03:13:00.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.814+0000 7fa12c14a640 1 --2- 172.21.15.78:0/846519501 >> v2:172.21.15.193:3300/0 conn(0x7fa12406f4b0 0x7fa1240d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.814+0000 7fa12c14a640 1 --2- 172.21.15.78:0/846519501 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa12406e170 0x7fa1240b3540 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.814+0000 7fa12c14a640 1 -- 172.21.15.78:0/846519501 >> 172.21.15.78:0/846519501 conn(0x7fa12408bfc0 msgr2=0x7fa12409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:00.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.814+0000 7fa12c14a640 1 -- 172.21.15.78:0/846519501 shutdown_connections 2024-09-17T03:13:00.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.814+0000 7fa12c14a640 1 -- 172.21.15.78:0/846519501 wait complete. 2024-09-17T03:13:00.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.815+0000 7fa12c14a640 1 Processor -- start 2024-09-17T03:13:00.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.815+0000 7fa12c14a640 1 -- start start 2024-09-17T03:13:00.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.817+0000 7fa12c14a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa12406f4b0 0x7fa124151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.817+0000 7fa12c14a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1240d3870 0x7fa1240b5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.817+0000 7fa12c14a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa1240c8a80 0x7fa1240ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.817+0000 7fa12c14a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa1240d0e60 con 0x7fa12406f4b0 2024-09-17T03:13:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.817+0000 7fa12c14a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa1240d0ce0 con 0x7fa1240d3870 2024-09-17T03:13:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.817+0000 7fa12c14a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa1240d0fe0 con 0x7fa1240c8a80 2024-09-17T03:13:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.817+0000 7fa129ee6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa12406f4b0 0x7fa124151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.817+0000 7fa129ee6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa12406f4b0 0x7fa124151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45752/0 (socket says 172.21.15.78:45752) 2024-09-17T03:13:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.817+0000 7fa129ee6640 1 -- 172.21.15.78:0/1067376368 learned_addr learned my addr 172.21.15.78:0/1067376368 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.817+0000 7fa1296e5640 1 --2- 172.21.15.78:0/1067376368 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1240d3870 0x7fa1240b5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.817+0000 7fa12a6e7640 1 --2- 172.21.15.78:0/1067376368 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa1240c8a80 0x7fa1240ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.817+0000 7fa129ee6640 1 -- 172.21.15.78:0/1067376368 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa1240c8a80 msgr2=0x7fa1240ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.817+0000 7fa129ee6640 1 --2- 172.21.15.78:0/1067376368 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa1240c8a80 0x7fa1240ce000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.817+0000 7fa129ee6640 1 -- 172.21.15.78:0/1067376368 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1240d3870 msgr2=0x7fa1240b5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:00.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.817+0000 7fa129ee6640 1 --2- 172.21.15.78:0/1067376368 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1240d3870 0x7fa1240b5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:00.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.817+0000 7fa129ee6640 1 -- 172.21.15.78:0/1067376368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa124151ea0 con 0x7fa12406f4b0 2024-09-17T03:13:00.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.817+0000 7fa129ee6640 1 --2- 172.21.15.78:0/1067376368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa12406f4b0 0x7fa124151960 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fa1200099f0 tx=0x7fa1200038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:00.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.817+0000 7fa11a7fc640 1 -- 172.21.15.78:0/1067376368 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12003e030 con 0x7fa12406f4b0 2024-09-17T03:13:00.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.818+0000 7fa11a7fc640 1 -- 172.21.15.78:0/1067376368 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa120003db0 con 0x7fa12406f4b0 2024-09-17T03:13:00.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.818+0000 7fa12c14a640 1 -- 172.21.15.78:0/1067376368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1240b4b90 con 0x7fa12406f4b0 2024-09-17T03:13:00.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.818+0000 7fa11a7fc640 1 -- 172.21.15.78:0/1067376368 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa120035040 con 0x7fa12406f4b0 2024-09-17T03:13:00.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.818+0000 7fa12c14a640 1 -- 172.21.15.78:0/1067376368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1240b5150 con 0x7fa12406f4b0 2024-09-17T03:13:00.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.818+0000 7fa12c14a640 1 -- 172.21.15.78:0/1067376368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1240b19f0 con 0x7fa12406f4b0 2024-09-17T03:13:00.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.819+0000 7fa11a7fc640 1 -- 172.21.15.78:0/1067376368 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa120041030 con 0x7fa12406f4b0 2024-09-17T03:13:00.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.820+0000 7fa11a7fc640 1 --2- 172.21.15.78:0/1067376368 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa108078bc0 0x7fa10807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:00.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.820+0000 7fa11a7fc640 1 -- 172.21.15.78:0/1067376368 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fa1200bb730 con 0x7fa12406f4b0 2024-09-17T03:13:00.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.820+0000 7fa1296e5640 1 --2- 172.21.15.78:0/1067376368 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa108078bc0 0x7fa10807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:00.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.821+0000 7fa1296e5640 1 --2- 172.21.15.78:0/1067376368 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa108078bc0 0x7fa10807b0d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa1240761e0 tx=0x7fa114005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:00.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:00.824+0000 7fa11a7fc640 1 -- 172.21.15.78:0/1067376368 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa1240b19f0 con 0x7fa12406f4b0 2024-09-17T03:13:01.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:01.036+0000 7fa12c14a640 1 -- 172.21.15.78:0/1067376368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa1240d1500 con 0x7fa12406f4b0 2024-09-17T03:13:01.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:01.036+0000 7fa11a7fc640 1 -- 172.21.15.78:0/1067376368 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v61) ==== 53+0+73 (secure 0 0 0) 0x7fa124151ea0 con 0x7fa12406f4b0 2024-09-17T03:13:01.035 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:13:01.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:01.038+0000 7fa12c14a640 1 -- 172.21.15.78:0/1067376368 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa108078bc0 msgr2=0x7fa10807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:01.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:01.038+0000 7fa12c14a640 1 --2- 172.21.15.78:0/1067376368 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa108078bc0 0x7fa10807b0d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa1240761e0 tx=0x7fa114005f90 comp rx=0 tx=0).stop 2024-09-17T03:13:01.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:01.038+0000 7fa12c14a640 1 -- 172.21.15.78:0/1067376368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa12406f4b0 msgr2=0x7fa124151960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:01.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:01.038+0000 7fa12c14a640 1 --2- 172.21.15.78:0/1067376368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa12406f4b0 0x7fa124151960 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fa1200099f0 tx=0x7fa1200038a0 comp rx=0 tx=0).stop 2024-09-17T03:13:01.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:01.038+0000 7fa12c14a640 1 -- 172.21.15.78:0/1067376368 shutdown_connections 2024-09-17T03:13:01.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:01.038+0000 7fa12c14a640 1 --2- 172.21.15.78:0/1067376368 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa1240c8a80 0x7fa1240ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:01.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:01.038+0000 7fa12c14a640 1 --2- 172.21.15.78:0/1067376368 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa108078bc0 0x7fa10807b0d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:01.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:01.038+0000 7fa12c14a640 1 --2- 172.21.15.78:0/1067376368 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa1240d3870 0x7fa1240b5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:01.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:01.038+0000 7fa12c14a640 1 --2- 172.21.15.78:0/1067376368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa12406f4b0 0x7fa124151960 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:01.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:01.038+0000 7fa12c14a640 1 -- 172.21.15.78:0/1067376368 >> 172.21.15.78:0/1067376368 conn(0x7fa12408bfc0 msgr2=0x7fa1240b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:01.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:01.038+0000 7fa12c14a640 1 -- 172.21.15.78:0/1067376368 shutdown_connections 2024-09-17T03:13:01.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:01.038+0000 7fa12c14a640 1 -- 172.21.15.78:0/1067376368 wait complete. 2024-09-17T03:13:01.050 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:13:01.050 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:13:01.050 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2024-09-17T03:13:01.050 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:13:01.050 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:13:01.050 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:13:01.050 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:13:01.050 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:13:01.051 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:13:01.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:01.051 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2024-09-17T03:13:01.082 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:13:01.082 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:13:01.082 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:13:01.082 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:13:01.082 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2024-09-17T03:13:01.082 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:13:01.083 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:13:01.083 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:13:01.083 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2024-09-17T03:13:01.083 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:13:01.083 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:13:01.083 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2024-09-17T03:13:01.083 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:13:01.083 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:13:01.083 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:13:01.083 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:13:01.083 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:13:01.084 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42484sec preferred_lft 42484sec 2024-09-17T03:13:01.084 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link noprefixroute 2024-09-17T03:13:01.084 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:13:01.084 INFO:teuthology.orchestra.run.smithi078.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:13:01.084 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0e:9b:80:f7:8b:c2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:13:01.084 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:13:01.084 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:13:01.084 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::58a0:47ff:fe97:6de8/64 scope link 2024-09-17T03:13:01.084 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:13:01.084 INFO:teuthology.orchestra.run.smithi078.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:13:01.084 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether e6:fb:78:d9:ba:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:13:01.085 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::e4fb:78ff:fed9:ba75/64 scope link 2024-09-17T03:13:01.085 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:13:01.085 INFO:teuthology.orchestra.run.smithi078.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:13:01.085 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0e:9b:80:f7:8b:c2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:13:01.085 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::c9b:80ff:fef7:8bc2/64 scope link 2024-09-17T03:13:01.085 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:13:01.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:01.086 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:13:01.165 INFO:teuthology.orchestra.run.smithi078.stdout:1 2024-09-17T03:13:01.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:01.167 DEBUG:teuthology.orchestra.run.smithi078:> route 2024-09-17T03:13:01.236 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2024-09-17T03:13:01.236 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:13:01.237 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:13:01.237 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:13:01.237 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:13:01.237 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:13:01.237 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-17T03:13:01.237 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:13:01.238 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:13:01.238 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:13:01.238 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-17T03:13:01.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:13:01.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:13:01.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:01.388 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-17T03:13:01.444 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:13:01.444 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:13:01.445 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:13:01.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:01.445 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2024-09-17T03:13:01.509 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:13:01.510 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:13:01.566 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:13:01.567 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:13:01.567 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:13:01.622 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:13:01.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:01.623 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:13:01.717 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:13:01.717 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:13:01.718 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:13:01.728 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:13:01.728 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:13:01.728 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:13:01.728 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-09-17T03:13:01.728 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:13:01.734 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:13:01.734 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:13:01.734 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:13:01.734 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-09-17T03:13:01.734 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:13:01.734 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:6789,172.21.15.193:6789,172.21.15.193:6790" 2024-09-17T03:13:01.734 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.78:6789,172.21.15.193:6789,172.21.15.193:6790:/ 2024-09-17T03:13:01.734 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f3c59ba9-dab4-4ee6-8989-d80d11d430b6" will pass to kernel 2024-09-17T03:13:01.735 INFO:teuthology.orchestra.run.smithi078.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:13:01.735 INFO:teuthology.orchestra.run.smithi078.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:13:01.735 INFO:teuthology.orchestra.run.smithi078.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:13:01.735 INFO:teuthology.orchestra.run.smithi078.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:13:01.735 INFO:teuthology.orchestra.run.smithi078.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:13:01.736 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:13:01.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:01.736 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:13:01.762 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:13:01.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:01 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:13:01.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:13:01.864 INFO:teuthology.orchestra.run.smithi078.stdout:client5963 2024-09-17T03:13:01.864 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:13:01.864 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:13:01.881 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-17T03:13:02.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.038+0000 7f214a7a1640 1 -- 172.21.15.78:0/4246024815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2130004000 msgr2=0x7f2130004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:02.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.038+0000 7f214a7a1640 1 --2- 172.21.15.78:0/4246024815 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2130004000 0x7f2130004800 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f212c009b20 tx=0x7f2130005830 comp rx=0 tx=0).stop 2024-09-17T03:13:02.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.038+0000 7f2148d3e640 1 -- 172.21.15.78:0/4246024815 reap_dead start 2024-09-17T03:13:02.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.038+0000 7f214a7a1640 1 -- 172.21.15.78:0/4246024815 shutdown_connections 2024-09-17T03:13:02.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.038+0000 7f214a7a1640 1 -- 172.21.15.78:0/4246024815 >> 172.21.15.78:0/4246024815 conn(0x7f21440b1cb0 msgr2=0x7f21440b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:02.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.038+0000 7f214a7a1640 1 -- 172.21.15.78:0/4246024815 shutdown_connections 2024-09-17T03:13:02.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.038+0000 7f214a7a1640 1 -- 172.21.15.78:0/4246024815 wait complete. 2024-09-17T03:13:02.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.040+0000 7f214a7a1640 1 Processor -- start 2024-09-17T03:13:02.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.040+0000 7f214a7a1640 1 -- start start 2024-09-17T03:13:02.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.041+0000 7f214a7a1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2130004000 0x7f214415c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:02.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.041+0000 7f214a7a1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2144154e30 0x7f21441511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:02.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.041+0000 7f214a7a1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2144074400 0x7f2144074810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:02.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.041+0000 7f214a7a1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f214415b310 con 0x7f2144154e30 2024-09-17T03:13:02.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.041+0000 7f214a7a1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f214415b190 con 0x7f2144074400 2024-09-17T03:13:02.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.041+0000 7f214a7a1640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f21440ca9a0 con 0x7f2130004000 2024-09-17T03:13:02.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.041+0000 7f213bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2144154e30 0x7f21441511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:02.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.041+0000 7f213bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2144154e30 0x7f21441511f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45776/0 (socket says 172.21.15.78:45776) 2024-09-17T03:13:02.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.041+0000 7f213bfff640 1 -- 172.21.15.78:0/2355669516 learned_addr learned my addr 172.21.15.78:0/2355669516 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:02.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.041+0000 7f2148d3e640 1 --2- 172.21.15.78:0/2355669516 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2144074400 0x7f2144074810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:02.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.041+0000 7f2143fff640 1 --2- 172.21.15.78:0/2355669516 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2130004000 0x7f214415c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:02.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.041+0000 7f213bfff640 1 -- 172.21.15.78:0/2355669516 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2130004000 msgr2=0x7f214415c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:02.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.041+0000 7f213bfff640 1 --2- 172.21.15.78:0/2355669516 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2130004000 0x7f214415c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:02.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.041+0000 7f213bfff640 1 -- 172.21.15.78:0/2355669516 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2144074400 msgr2=0x7f2144074810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:02.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.041+0000 7f213bfff640 1 --2- 172.21.15.78:0/2355669516 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2144074400 0x7f2144074810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:02.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.041+0000 7f213bfff640 1 -- 172.21.15.78:0/2355669516 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2144074d50 con 0x7f2144154e30 2024-09-17T03:13:02.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.041+0000 7f2148d3e640 1 --2- 172.21.15.78:0/2355669516 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2144074400 0x7f2144074810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:02.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.042+0000 7f213bfff640 1 --2- 172.21.15.78:0/2355669516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2144154e30 0x7f21441511f0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f212c036040 tx=0x7f212c0336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:02.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.042+0000 7f21417fa640 1 -- 172.21.15.78:0/2355669516 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c038040 con 0x7f2144154e30 2024-09-17T03:13:02.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.042+0000 7f21417fa640 1 -- 172.21.15.78:0/2355669516 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f212c041070 con 0x7f2144154e30 2024-09-17T03:13:02.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.042+0000 7f214a7a1640 1 -- 172.21.15.78:0/2355669516 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f214415ce00 con 0x7f2144154e30 2024-09-17T03:13:02.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.042+0000 7f21417fa640 1 -- 172.21.15.78:0/2355669516 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212c033c50 con 0x7f2144154e30 2024-09-17T03:13:02.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.042+0000 7f214a7a1640 1 -- 172.21.15.78:0/2355669516 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f214415d3c0 con 0x7f2144154e30 2024-09-17T03:13:02.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.043+0000 7f214a7a1640 1 -- 172.21.15.78:0/2355669516 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21440cf160 con 0x7f2144154e30 2024-09-17T03:13:02.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.043+0000 7f21417fa640 1 -- 172.21.15.78:0/2355669516 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f212c046460 con 0x7f2144154e30 2024-09-17T03:13:02.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.044+0000 7f21417fa640 1 --2- 172.21.15.78:0/2355669516 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2124078b90 0x7f212407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:02.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.044+0000 7f21417fa640 1 -- 172.21.15.78:0/2355669516 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f212c0bb6b0 con 0x7f2144154e30 2024-09-17T03:13:02.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.044+0000 7f2143fff640 1 --2- 172.21.15.78:0/2355669516 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2124078b90 0x7f212407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:02.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.045+0000 7f2143fff640 1 --2- 172.21.15.78:0/2355669516 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2124078b90 0x7f212407b0a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f21440c3c20 tx=0x7f21340011f0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:02.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.048+0000 7f21417fa640 1 -- 172.21.15.78:0/2355669516 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2144074d50 con 0x7f2144154e30 2024-09-17T03:13:02.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.259+0000 7f214a7a1640 1 -- 172.21.15.78:0/2355669516 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f214415cb90 con 0x7f2144154e30 2024-09-17T03:13:02.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.597+0000 7f21417fa640 1 -- 172.21.15.78:0/2355669516 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v62) ==== 105+0+0 (secure 0 0 0) 0x7f212c083af0 con 0x7f2144154e30 2024-09-17T03:13:02.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.599+0000 7f214a7a1640 1 -- 172.21.15.78:0/2355669516 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2124078b90 msgr2=0x7f212407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:02.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.599+0000 7f214a7a1640 1 --2- 172.21.15.78:0/2355669516 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2124078b90 0x7f212407b0a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f21440c3c20 tx=0x7f21340011f0 comp rx=0 tx=0).stop 2024-09-17T03:13:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.599+0000 7f214a7a1640 1 -- 172.21.15.78:0/2355669516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2144154e30 msgr2=0x7f21441511f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.599+0000 7f214a7a1640 1 --2- 172.21.15.78:0/2355669516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2144154e30 0x7f21441511f0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f212c036040 tx=0x7f212c0336f0 comp rx=0 tx=0).stop 2024-09-17T03:13:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.599+0000 7f214a7a1640 1 -- 172.21.15.78:0/2355669516 shutdown_connections 2024-09-17T03:13:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.599+0000 7f214a7a1640 1 --2- 172.21.15.78:0/2355669516 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2124078b90 0x7f212407b0a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.600+0000 7f214a7a1640 1 --2- 172.21.15.78:0/2355669516 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2144074400 0x7f2144074810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.600+0000 7f214a7a1640 1 --2- 172.21.15.78:0/2355669516 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2144154e30 0x7f21441511f0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.600+0000 7f214a7a1640 1 --2- 172.21.15.78:0/2355669516 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2130004000 0x7f214415c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.600+0000 7f214a7a1640 1 -- 172.21.15.78:0/2355669516 >> 172.21.15.78:0/2355669516 conn(0x7f21440b1cb0 msgr2=0x7f21440b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.600+0000 7f214a7a1640 1 -- 172.21.15.78:0/2355669516 shutdown_connections 2024-09-17T03:13:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.600+0000 7f214a7a1640 1 -- 172.21.15.78:0/2355669516 wait complete. 2024-09-17T03:13:02.614 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:13:02.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.728+0000 7f02aa9da640 1 -- 172.21.15.78:0/308796737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02a40cf130 msgr2=0x7f02a4071650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:02.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.728+0000 7f02aa9da640 1 --2- 172.21.15.78:0/308796737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02a40cf130 0x7f02a4071650 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f0298009830 tx=0x7f029802a530 comp rx=0 tx=0).stop 2024-09-17T03:13:02.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.728+0000 7f02aa9da640 1 -- 172.21.15.78:0/308796737 shutdown_connections 2024-09-17T03:13:02.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.728+0000 7f02aa9da640 1 --2- 172.21.15.78:0/308796737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02a40cf130 0x7f02a4071650 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:02.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.728+0000 7f02aa9da640 1 --2- 172.21.15.78:0/308796737 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f02a40b2cb0 0x7f02a40b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:02.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.728+0000 7f02aa9da640 1 -- 172.21.15.78:0/308796737 >> 172.21.15.78:0/308796737 conn(0x7f02a40cdcb0 msgr2=0x7f02a40ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:02.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.728+0000 7f02aa9da640 1 -- 172.21.15.78:0/308796737 shutdown_connections 2024-09-17T03:13:02.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.728+0000 7f02aa9da640 1 -- 172.21.15.78:0/308796737 wait complete. 2024-09-17T03:13:02.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.730+0000 7f02aa9da640 1 Processor -- start 2024-09-17T03:13:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.730+0000 7f02aa9da640 1 -- start start 2024-09-17T03:13:02.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.731+0000 7f02aa9da640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f02a40b2cb0 0x7f02a415a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:02.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.731+0000 7f02aa9da640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02a40cf130 0x7f02a41e83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:02.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.731+0000 7f02aa9da640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f02a415b8f0 0x7f02a41e8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:02.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.731+0000 7f02aa9da640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f02a40ae330 con 0x7f02a40cf130 2024-09-17T03:13:02.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.731+0000 7f02aa9da640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f02a40ae1b0 con 0x7f02a40b2cb0 2024-09-17T03:13:02.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.731+0000 7f02aa9da640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f02a40ae4b0 con 0x7f02a415b8f0 2024-09-17T03:13:02.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.731+0000 7f02a37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02a40cf130 0x7f02a41e83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:02.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.731+0000 7f02a37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02a40cf130 0x7f02a41e83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45800/0 (socket says 172.21.15.78:45800) 2024-09-17T03:13:02.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.731+0000 7f02a37fe640 1 -- 172.21.15.78:0/2953188224 learned_addr learned my addr 172.21.15.78:0/2953188224 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:02.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.732+0000 7f02a8f77640 1 --2- 172.21.15.78:0/2953188224 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f02a415b8f0 0x7f02a41e8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:02.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.732+0000 7f02a3fff640 1 --2- 172.21.15.78:0/2953188224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f02a40b2cb0 0x7f02a415a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:02.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.732+0000 7f02a37fe640 1 -- 172.21.15.78:0/2953188224 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f02a415b8f0 msgr2=0x7f02a41e8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:02.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.732+0000 7f02a37fe640 1 --2- 172.21.15.78:0/2953188224 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f02a415b8f0 0x7f02a41e8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:02.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.732+0000 7f02a37fe640 1 -- 172.21.15.78:0/2953188224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f02a40b2cb0 msgr2=0x7f02a415a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:02.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.732+0000 7f02a37fe640 1 --2- 172.21.15.78:0/2953188224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f02a40b2cb0 0x7f02a415a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:02.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.732+0000 7f02a37fe640 1 -- 172.21.15.78:0/2953188224 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a41f7470 con 0x7f02a40cf130 2024-09-17T03:13:02.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.732+0000 7f02a8f77640 1 --2- 172.21.15.78:0/2953188224 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f02a415b8f0 0x7f02a41e8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:02.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.732+0000 7f02a37fe640 1 --2- 172.21.15.78:0/2953188224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02a40cf130 0x7f02a41e83d0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f0298009950 tx=0x7f0298004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:02.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.732+0000 7f02a0ff9640 1 -- 172.21.15.78:0/2953188224 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0298005220 con 0x7f02a40cf130 2024-09-17T03:13:02.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.732+0000 7f02a0ff9640 1 -- 172.21.15.78:0/2953188224 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02980054d0 con 0x7f02a40cf130 2024-09-17T03:13:02.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.732+0000 7f02aa9da640 1 -- 172.21.15.78:0/2953188224 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a41f7750 con 0x7f02a40cf130 2024-09-17T03:13:02.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.732+0000 7f02a0ff9640 1 -- 172.21.15.78:0/2953188224 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0298003a60 con 0x7f02a40cf130 2024-09-17T03:13:02.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.732+0000 7f02aa9da640 1 -- 172.21.15.78:0/2953188224 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a41f7d10 con 0x7f02a40cf130 2024-09-17T03:13:02.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.733+0000 7f02aa9da640 1 -- 172.21.15.78:0/2953188224 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a41f71e0 con 0x7f02a40cf130 2024-09-17T03:13:02.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.734+0000 7f02a0ff9640 1 -- 172.21.15.78:0/2953188224 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0298003c00 con 0x7f02a40cf130 2024-09-17T03:13:02.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.734+0000 7f02a0ff9640 1 --2- 172.21.15.78:0/2953188224 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0290078b90 0x7f029007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:02.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.735+0000 7f02a0ff9640 1 -- 172.21.15.78:0/2953188224 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f02980bc110 con 0x7f02a40cf130 2024-09-17T03:13:02.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.735+0000 7f02a3fff640 1 --2- 172.21.15.78:0/2953188224 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0290078b90 0x7f029007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:02.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.735+0000 7f02a3fff640 1 --2- 172.21.15.78:0/2953188224 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0290078b90 0x7f029007b0a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f02a4073d40 tx=0x7f0294009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:02.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.739+0000 7f02a0ff9640 1 -- 172.21.15.78:0/2953188224 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f029803f030 con 0x7f02a40cf130 2024-09-17T03:13:02.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.947+0000 7f02aa9da640 1 -- 172.21.15.78:0/2953188224 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f02a40b30c0 con 0x7f02a40cf130 2024-09-17T03:13:02.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.947+0000 7f02a0ff9640 1 -- 172.21.15.78:0/2953188224 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5247 (secure 0 0 0) 0x7f0298031e20 con 0x7f02a40cf130 2024-09-17T03:13:02.946 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:02.946 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":63,"btime":"2024-09-17T03:13:02:600628+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5873,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/3831026382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3831026382},{"type":"v1","addr":"172.21.15.193:6836","nonce":3831026382}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6271,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/1431701139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1431701139},{"type":"v1","addr":"172.21.15.193:6837","nonce":1431701139}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:12:50.905684+0000","modified":"2024-09-17T03:13:02.600609+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":6864,"mds_1":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"c","rank":1,"incarnation":63,"state":"up:creating","state_seq":1,"addr":"172.21.15.78:6834/2905189397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2905189397},{"type":"v1","addr":"172.21.15.78:6834","nonce":2905189397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6864":{"gid":6864,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/2058899730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2058899730},{"type":"v1","addr":"172.21.15.78:6835","nonce":2058899730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6864,"qdb_cluster":[6864]},"id":5}]} 2024-09-17T03:13:02.947 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 63 2024-09-17T03:13:02.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.949+0000 7f02aa9da640 1 -- 172.21.15.78:0/2953188224 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0290078b90 msgr2=0x7f029007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:02.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.949+0000 7f02aa9da640 1 --2- 172.21.15.78:0/2953188224 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0290078b90 0x7f029007b0a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f02a4073d40 tx=0x7f0294009040 comp rx=0 tx=0).stop 2024-09-17T03:13:02.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.949+0000 7f02aa9da640 1 -- 172.21.15.78:0/2953188224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02a40cf130 msgr2=0x7f02a41e83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:02.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.949+0000 7f02aa9da640 1 --2- 172.21.15.78:0/2953188224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02a40cf130 0x7f02a41e83d0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f0298009950 tx=0x7f0298004360 comp rx=0 tx=0).stop 2024-09-17T03:13:02.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.949+0000 7f02aa9da640 1 -- 172.21.15.78:0/2953188224 shutdown_connections 2024-09-17T03:13:02.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.949+0000 7f02aa9da640 1 --2- 172.21.15.78:0/2953188224 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f02a415b8f0 0x7f02a41e8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:02.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.949+0000 7f02aa9da640 1 --2- 172.21.15.78:0/2953188224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f02a40cf130 0x7f02a41e83d0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:02.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.949+0000 7f02aa9da640 1 --2- 172.21.15.78:0/2953188224 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0290078b90 0x7f029007b0a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:02.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.949+0000 7f02aa9da640 1 --2- 172.21.15.78:0/2953188224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f02a40b2cb0 0x7f02a415a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:02.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.949+0000 7f02aa9da640 1 -- 172.21.15.78:0/2953188224 >> 172.21.15.78:0/2953188224 conn(0x7f02a40cdcb0 msgr2=0x7f02a40b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:02.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.949+0000 7f02aa9da640 1 -- 172.21.15.78:0/2953188224 shutdown_connections 2024-09-17T03:13:02.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:02.949+0000 7f02aa9da640 1 -- 172.21.15.78:0/2953188224 wait complete. 2024-09-17T03:13:03.362 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:12:50.905684+0000', 'modified': '2024-09-17T03:13:02.600609+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 6864, 'mds_1': 6861}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6861': {'gid': 6861, 'name': 'c', 'rank': 1, 'incarnation': 63, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.78:6834/2905189397', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6832', 'nonce': 2905189397}, {'type': 'v1', 'addr': '172.21.15.78:6834', 'nonce': 2905189397}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_6864': {'gid': 6864, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6835/2058899730', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6833', 'nonce': 2058899730}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 2058899730}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6864, 'qdb_cluster': [6864]} 2024-09-17T03:13:03.363 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6861:up:creating 2024-09-17T03:13:04.364 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:13:04.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.489+0000 7f5c7f3f1640 1 -- 172.21.15.78:0/1404088935 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c780b40f0 msgr2=0x7f5c780cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:04.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.489+0000 7f5c7f3f1640 1 --2- 172.21.15.78:0/1404088935 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c780b40f0 0x7f5c780cdf50 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f5c780736f0 tx=0x7f5c6c02a560 comp rx=0 tx=0).stop 2024-09-17T03:13:04.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.489+0000 7f5c7f3f1640 1 -- 172.21.15.78:0/1404088935 shutdown_connections 2024-09-17T03:13:04.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.489+0000 7f5c7f3f1640 1 --2- 172.21.15.78:0/1404088935 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c780b40f0 0x7f5c780cdf50 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:04.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.489+0000 7f5c7f3f1640 1 --2- 172.21.15.78:0/1404088935 >> v2:172.21.15.193:3300/0 conn(0x7f5c780b66f0 0x7f5c780b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:04.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.489+0000 7f5c7f3f1640 1 -- 172.21.15.78:0/1404088935 >> 172.21.15.78:0/1404088935 conn(0x7f5c780d12a0 msgr2=0x7f5c780d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:04.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.489+0000 7f5c7f3f1640 1 -- 172.21.15.78:0/1404088935 shutdown_connections 2024-09-17T03:13:04.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.489+0000 7f5c7f3f1640 1 -- 172.21.15.78:0/1404088935 wait complete. 2024-09-17T03:13:04.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.491+0000 7f5c7f3f1640 1 Processor -- start 2024-09-17T03:13:04.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.491+0000 7f5c7f3f1640 1 -- start start 2024-09-17T03:13:04.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.492+0000 7f5c7f3f1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c780b40f0 0x7f5c780b2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:04.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.492+0000 7f5c7f3f1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c780b66f0 0x7f5c7815d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:04.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.492+0000 7f5c7f3f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c780ce490 0x7f5c7815d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:04.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.492+0000 7f5c7f3f1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7806d4f0 con 0x7f5c780ce490 2024-09-17T03:13:04.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.492+0000 7f5c7f3f1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5c780ceab0 con 0x7f5c780b40f0 2024-09-17T03:13:04.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.492+0000 7f5c7f3f1640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5c7806d670 con 0x7f5c780b66f0 2024-09-17T03:13:04.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.493+0000 7f5c7d98e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c780ce490 0x7f5c7815d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:04.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.493+0000 7f5c7d98e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c780ce490 0x7f5c7815d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45826/0 (socket says 172.21.15.78:45826) 2024-09-17T03:13:04.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.493+0000 7f5c7d98e640 1 -- 172.21.15.78:0/785014260 learned_addr learned my addr 172.21.15.78:0/785014260 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:04.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.493+0000 7f5c7d18d640 1 --2- 172.21.15.78:0/785014260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c780b40f0 0x7f5c780b2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:04.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.493+0000 7f5c7c98c640 1 --2- 172.21.15.78:0/785014260 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c780b66f0 0x7f5c7815d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:04.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.493+0000 7f5c7d98e640 1 -- 172.21.15.78:0/785014260 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c780b66f0 msgr2=0x7f5c7815d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:04.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.493+0000 7f5c7d98e640 1 --2- 172.21.15.78:0/785014260 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c780b66f0 0x7f5c7815d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:04.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.493+0000 7f5c7d98e640 1 -- 172.21.15.78:0/785014260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c780b40f0 msgr2=0x7f5c780b2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:04.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.493+0000 7f5c7d98e640 1 --2- 172.21.15.78:0/785014260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c780b40f0 0x7f5c780b2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:04.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.493+0000 7f5c7d98e640 1 -- 172.21.15.78:0/785014260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c780aecd0 con 0x7f5c780ce490 2024-09-17T03:13:04.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.493+0000 7f5c7c98c640 1 --2- 172.21.15.78:0/785014260 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c780b66f0 0x7f5c7815d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:04.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.493+0000 7f5c7d98e640 1 --2- 172.21.15.78:0/785014260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c780ce490 0x7f5c7815d8a0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000c730 tx=0x7f5c7000cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:04.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.493+0000 7f5c75ffb640 1 -- 172.21.15.78:0/785014260 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c70003b70 con 0x7f5c780ce490 2024-09-17T03:13:04.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.493+0000 7f5c75ffb640 1 -- 172.21.15.78:0/785014260 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c70003d10 con 0x7f5c780ce490 2024-09-17T03:13:04.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.493+0000 7f5c7f3f1640 1 -- 172.21.15.78:0/785014260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c781f95c0 con 0x7f5c780ce490 2024-09-17T03:13:04.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.493+0000 7f5c75ffb640 1 -- 172.21.15.78:0/785014260 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c70005330 con 0x7f5c780ce490 2024-09-17T03:13:04.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.493+0000 7f5c7f3f1640 1 -- 172.21.15.78:0/785014260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c781f9b80 con 0x7f5c780ce490 2024-09-17T03:13:04.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.494+0000 7f5c7f3f1640 1 -- 172.21.15.78:0/785014260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c780aea40 con 0x7f5c780ce490 2024-09-17T03:13:04.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.495+0000 7f5c75ffb640 1 -- 172.21.15.78:0/785014260 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5c700054d0 con 0x7f5c780ce490 2024-09-17T03:13:04.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.496+0000 7f5c75ffb640 1 --2- 172.21.15.78:0/785014260 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5c64078b90 0x7f5c6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:04.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.496+0000 7f5c75ffb640 1 -- 172.21.15.78:0/785014260 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f5c7009a980 con 0x7f5c780ce490 2024-09-17T03:13:04.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.496+0000 7f5c7d18d640 1 --2- 172.21.15.78:0/785014260 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5c64078b90 0x7f5c6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:04.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.497+0000 7f5c7d18d640 1 --2- 172.21.15.78:0/785014260 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5c64078b90 0x7f5c6407b0a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5c6800bb30 tx=0x7f5c6800b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:04.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.500+0000 7f5c75ffb640 1 -- 172.21.15.78:0/785014260 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5c70062e50 con 0x7f5c780ce490 2024-09-17T03:13:04.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.711+0000 7f5c7f3f1640 1 -- 172.21.15.78:0/785014260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c7806da90 con 0x7f5c780ce490 2024-09-17T03:13:04.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.711+0000 7f5c75ffb640 1 -- 172.21.15.78:0/785014260 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5269 (secure 0 0 0) 0x7f5c70062750 con 0x7f5c780ce490 2024-09-17T03:13:04.710 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:04.710 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":66,"btime":"2024-09-17T03:13:04:617892+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5873,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/3831026382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3831026382},{"type":"v1","addr":"172.21.15.193:6836","nonce":3831026382}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:12:50.905684+0000","modified":"2024-09-17T03:13:04.617885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6864,"mds_1":6861,"mds_2":6271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6271":{"gid":6271,"name":"d","rank":2,"incarnation":65,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6837/1431701139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1431701139},{"type":"v1","addr":"172.21.15.193:6837","nonce":1431701139}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6861":{"gid":6861,"name":"c","rank":1,"incarnation":63,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6834/2905189397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2905189397},{"type":"v1","addr":"172.21.15.78:6834","nonce":2905189397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6864":{"gid":6864,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/2058899730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2058899730},{"type":"v1","addr":"172.21.15.78:6835","nonce":2058899730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6864,"qdb_cluster":[6271,6861,6864]},"id":5}]} 2024-09-17T03:13:04.711 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 66 2024-09-17T03:13:04.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.714+0000 7f5c7f3f1640 1 -- 172.21.15.78:0/785014260 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5c64078b90 msgr2=0x7f5c6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:04.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.714+0000 7f5c7f3f1640 1 --2- 172.21.15.78:0/785014260 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5c64078b90 0x7f5c6407b0a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5c6800bb30 tx=0x7f5c6800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:13:04.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.714+0000 7f5c7f3f1640 1 -- 172.21.15.78:0/785014260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c780ce490 msgr2=0x7f5c7815d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:04.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.714+0000 7f5c7f3f1640 1 --2- 172.21.15.78:0/785014260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c780ce490 0x7f5c7815d8a0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f5c7000c730 tx=0x7f5c7000cb30 comp rx=0 tx=0).stop 2024-09-17T03:13:04.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.714+0000 7f5c7f3f1640 1 -- 172.21.15.78:0/785014260 shutdown_connections 2024-09-17T03:13:04.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.714+0000 7f5c7f3f1640 1 --2- 172.21.15.78:0/785014260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c780ce490 0x7f5c7815d8a0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:04.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.714+0000 7f5c7f3f1640 1 --2- 172.21.15.78:0/785014260 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c780b66f0 0x7f5c7815d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:04.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.714+0000 7f5c7f3f1640 1 --2- 172.21.15.78:0/785014260 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5c64078b90 0x7f5c6407b0a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:04.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.714+0000 7f5c7f3f1640 1 --2- 172.21.15.78:0/785014260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c780b40f0 0x7f5c780b2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:04.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.714+0000 7f5c7f3f1640 1 -- 172.21.15.78:0/785014260 >> 172.21.15.78:0/785014260 conn(0x7f5c780d12a0 msgr2=0x7f5c7815e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:04.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.714+0000 7f5c7f3f1640 1 -- 172.21.15.78:0/785014260 shutdown_connections 2024-09-17T03:13:04.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:04.714+0000 7f5c7f3f1640 1 -- 172.21.15.78:0/785014260 wait complete. 2024-09-17T03:13:05.127 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:12:50.905684+0000', 'modified': '2024-09-17T03:13:04.617885+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 6864, 'mds_1': 6861, 'mds_2': 6271}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6271': {'gid': 6271, 'name': 'd', 'rank': 2, 'incarnation': 65, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.193:6837/1431701139', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6835', 'nonce': 1431701139}, {'type': 'v1', 'addr': '172.21.15.193:6837', 'nonce': 1431701139}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_6861': {'gid': 6861, 'name': 'c', 'rank': 1, 'incarnation': 63, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.78:6834/2905189397', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6832', 'nonce': 2905189397}, {'type': 'v1', 'addr': '172.21.15.78:6834', 'nonce': 2905189397}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_6864': {'gid': 6864, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6835/2058899730', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6833', 'nonce': 2058899730}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 2058899730}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6864, 'qdb_cluster': [6271, 6861, 6864]} 2024-09-17T03:13:05.127 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-17T03:13:05.128 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T03:13:05.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.245+0000 7f8552562640 1 -- 172.21.15.78:0/2078750561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f854c15d840 msgr2=0x7f854c0b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.245+0000 7f8552562640 1 --2- 172.21.15.78:0/2078750561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f854c15d840 0x7f854c0b7490 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f8544005fd0 tx=0x7f854402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.245+0000 7f8552562640 1 -- 172.21.15.78:0/2078750561 shutdown_connections 2024-09-17T03:13:05.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.245+0000 7f8552562640 1 --2- 172.21.15.78:0/2078750561 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f854c15d840 0x7f854c0b7490 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.245+0000 7f8552562640 1 -- 172.21.15.78:0/2078750561 >> 172.21.15.78:0/2078750561 conn(0x7f854c06d550 msgr2=0x7f854c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:05.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.245+0000 7f8552562640 1 -- 172.21.15.78:0/2078750561 shutdown_connections 2024-09-17T03:13:05.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.245+0000 7f8552562640 1 -- 172.21.15.78:0/2078750561 wait complete. 2024-09-17T03:13:05.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.247+0000 7f8552562640 1 Processor -- start 2024-09-17T03:13:05.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.247+0000 7f8552562640 1 -- start start 2024-09-17T03:13:05.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.248+0000 7f8552562640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f854c1570e0 0x7f854c1463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.248+0000 7f8552562640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f854c15d840 0x7f854c146910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.248+0000 7f8552562640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f854c0cbfa0 0x7f854c0cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.248+0000 7f8552562640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f854c0b7d60 con 0x7f854c15d840 2024-09-17T03:13:05.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.248+0000 7f8552562640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f854c0b7be0 con 0x7f854c0cbfa0 2024-09-17T03:13:05.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.248+0000 7f8552562640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f854c0b7ee0 con 0x7f854c1570e0 2024-09-17T03:13:05.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.248+0000 7f854b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f854c15d840 0x7f854c146910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.248+0000 7f854b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f854c15d840 0x7f854c146910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45852/0 (socket says 172.21.15.78:45852) 2024-09-17T03:13:05.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.248+0000 7f854b7fe640 1 -- 172.21.15.78:0/1924790522 learned_addr learned my addr 172.21.15.78:0/1924790522 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:05.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.248+0000 7f8550aff640 1 --2- 172.21.15.78:0/1924790522 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f854c0cbfa0 0x7f854c0cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.248+0000 7f854bfff640 1 --2- 172.21.15.78:0/1924790522 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f854c1570e0 0x7f854c1463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.248+0000 7f854b7fe640 1 -- 172.21.15.78:0/1924790522 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f854c1570e0 msgr2=0x7f854c1463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.248+0000 7f854b7fe640 1 --2- 172.21.15.78:0/1924790522 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f854c1570e0 0x7f854c1463d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.248+0000 7f854b7fe640 1 -- 172.21.15.78:0/1924790522 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f854c0cbfa0 msgr2=0x7f854c0cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.248+0000 7f854b7fe640 1 --2- 172.21.15.78:0/1924790522 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f854c0cbfa0 0x7f854c0cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.248+0000 7f854b7fe640 1 -- 172.21.15.78:0/1924790522 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854c0c8a90 con 0x7f854c15d840 2024-09-17T03:13:05.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.248+0000 7f8550aff640 1 --2- 172.21.15.78:0/1924790522 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f854c0cbfa0 0x7f854c0cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:05.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.249+0000 7f854b7fe640 1 --2- 172.21.15.78:0/1924790522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f854c15d840 0x7f854c146910 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f854000c3a0 tx=0x7f854000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:05.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.249+0000 7f8548ff9640 1 -- 172.21.15.78:0/1924790522 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8540011790 con 0x7f854c15d840 2024-09-17T03:13:05.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.249+0000 7f8548ff9640 1 -- 172.21.15.78:0/1924790522 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8540017070 con 0x7f854c15d840 2024-09-17T03:13:05.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.249+0000 7f8552562640 1 -- 172.21.15.78:0/1924790522 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854c1f36e0 con 0x7f854c15d840 2024-09-17T03:13:05.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.249+0000 7f8548ff9640 1 -- 172.21.15.78:0/1924790522 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8540011cc0 con 0x7f854c15d840 2024-09-17T03:13:05.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.249+0000 7f8552562640 1 -- 172.21.15.78:0/1924790522 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f854c0c7fb0 con 0x7f854c15d840 2024-09-17T03:13:05.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.251+0000 7f8548ff9640 1 -- 172.21.15.78:0/1924790522 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f854001c460 con 0x7f854c15d840 2024-09-17T03:13:05.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.251+0000 7f8548ff9640 1 --2- 172.21.15.78:0/1924790522 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8538078b90 0x7f853807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.252+0000 7f8548ff9640 1 -- 172.21.15.78:0/1924790522 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f854009aaf0 con 0x7f854c15d840 2024-09-17T03:13:05.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.252+0000 7f854bfff640 1 --2- 172.21.15.78:0/1924790522 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8538078b90 0x7f853807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.252+0000 7f854bfff640 1 --2- 172.21.15.78:0/1924790522 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8538078b90 0x7f853807b0a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f853c00a750 tx=0x7f853c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:05.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.252+0000 7f85594d2740 1 Processor -- start 2024-09-17T03:13:05.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.252+0000 7f85594d2740 1 -- start start 2024-09-17T03:13:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f85594d2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b6542270 0x5623b6913fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f85594d2740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b65193b0 0x5623b69144e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f85594d2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6521590 0x5623b69313e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f85594d2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5623b685c820 con 0x5623b6542270 2024-09-17T03:13:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f85594d2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5623b684bc50 con 0x5623b6521590 2024-09-17T03:13:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f85594d2740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5623b684fa60 con 0x5623b65193b0 2024-09-17T03:13:05.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f854bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b6542270 0x5623b6913fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f854bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b6542270 0x5623b6913fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45858/0 (socket says 172.21.15.78:45858) 2024-09-17T03:13:05.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f854bfff640 1 -- 172.21.15.78:0/2142084854 learned_addr learned my addr 172.21.15.78:0/2142084854 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:05.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f854b7fe640 1 --2- 172.21.15.78:0/2142084854 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b65193b0 0x5623b69144e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f8550aff640 1 --2- 172.21.15.78:0/2142084854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6521590 0x5623b69313e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f854bfff640 1 -- 172.21.15.78:0/2142084854 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b65193b0 msgr2=0x5623b69144e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f854bfff640 1 --2- 172.21.15.78:0/2142084854 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b65193b0 0x5623b69144e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f854bfff640 1 -- 172.21.15.78:0/2142084854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6521590 msgr2=0x5623b69313e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f854bfff640 1 --2- 172.21.15.78:0/2142084854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6521590 0x5623b69313e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f854bfff640 1 -- 172.21.15.78:0/2142084854 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623b65ad850 con 0x5623b6542270 2024-09-17T03:13:05.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f8550aff640 1 --2- 172.21.15.78:0/2142084854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6521590 0x5623b69313e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:05.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f854bfff640 1 --2- 172.21.15.78:0/2142084854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b6542270 0x5623b6913fa0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f853c00c930 tx=0x7f853c00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d5df622b25b8f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:05.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f8531ffb640 1 -- 172.21.15.78:0/2142084854 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c019040 con 0x5623b6542270 2024-09-17T03:13:05.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f8531ffb640 1 -- 172.21.15.78:0/2142084854 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f853c022070 con 0x5623b6542270 2024-09-17T03:13:05.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.254+0000 7f8531ffb640 1 -- 172.21.15.78:0/2142084854 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c01d3f0 con 0x5623b6542270 2024-09-17T03:13:05.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.255+0000 7f85594d2740 1 -- 172.21.15.78:0/2142084854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b6542270 msgr2=0x5623b6913fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.255+0000 7f85594d2740 1 --2- 172.21.15.78:0/2142084854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b6542270 0x5623b6913fa0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f853c00c930 tx=0x7f853c00f000 comp rx=0 tx=0).stop 2024-09-17T03:13:05.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.255+0000 7f85594d2740 1 -- 172.21.15.78:0/2142084854 shutdown_connections 2024-09-17T03:13:05.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.255+0000 7f85594d2740 1 --2- 172.21.15.78:0/2142084854 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6521590 0x5623b69313e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.255+0000 7f85594d2740 1 --2- 172.21.15.78:0/2142084854 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b65193b0 0x5623b69144e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.255+0000 7f85594d2740 1 --2- 172.21.15.78:0/2142084854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b6542270 0x5623b6913fa0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.255+0000 7f85594d2740 1 -- 172.21.15.78:0/2142084854 >> 172.21.15.78:0/2142084854 conn(0x5623b65363c0 msgr2=0x5623b68ea260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:05.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.255+0000 7f85594d2740 1 -- 172.21.15.78:0/2142084854 shutdown_connections 2024-09-17T03:13:05.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.255+0000 7f85594d2740 1 -- 172.21.15.78:0/2142084854 wait complete. 2024-09-17T03:13:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.256+0000 7f85594d2740 1 -- start start 2024-09-17T03:13:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.256+0000 7f85594d2740 1 Processor -- start 2024-09-17T03:13:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f85594d2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 0x5623b690cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f85594d2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6521590 0x5623b6901ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f85594d2740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b6542270 0x5623b69122a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f85594d2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5623b65bc620 con 0x5623b65193b0 2024-09-17T03:13:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f85594d2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5623b67f15f0 con 0x5623b6521590 2024-09-17T03:13:05.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f85594d2740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5623b6914a20 con 0x5623b6542270 2024-09-17T03:13:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f85594d2740 10 client.0 _ll_register_callbacks cb 0x5623b67f50a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f854bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 0x5623b690cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f854bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 0x5623b690cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45872/0 (socket says 172.21.15.78:45872) 2024-09-17T03:13:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f854bfff640 1 -- 172.21.15.78:0/793985124 learned_addr learned my addr 172.21.15.78:0/793985124 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f8550aff640 1 --2- 172.21.15.78:0/793985124 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b6542270 0x5623b69122a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f854b7fe640 1 --2- 172.21.15.78:0/793985124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6521590 0x5623b6901ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f854bfff640 1 -- 172.21.15.78:0/793985124 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b6542270 msgr2=0x5623b69122a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f854bfff640 1 --2- 172.21.15.78:0/793985124 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b6542270 0x5623b69122a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f854bfff640 1 -- 172.21.15.78:0/793985124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6521590 msgr2=0x5623b6901ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f854bfff640 1 --2- 172.21.15.78:0/793985124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6521590 0x5623b6901ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f854bfff640 1 -- 172.21.15.78:0/793985124 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623b66246b0 con 0x5623b65193b0 2024-09-17T03:13:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f854bfff640 1 --2- 172.21.15.78:0/793985124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 0x5623b690cc50 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f853c01f040 tx=0x7f853c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14347170ad60441 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:05.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f852affd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f852affd640 1 -- 172.21.15.78:0/793985124 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c02a070 con 0x5623b65193b0 2024-09-17T03:13:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f852affd640 1 -- 172.21.15.78:0/793985124 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f853c0035f0 con 0x5623b65193b0 2024-09-17T03:13:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.258+0000 7f85594d2740 1 -- 172.21.15.78:0/793985124 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f853c022070 con 0x5623b65193b0 2024-09-17T03:13:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.259+0000 7f852affd640 1 -- 172.21.15.78:0/793985124 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f853c037050 con 0x5623b65193b0 2024-09-17T03:13:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.259+0000 7f85594d2740 10 client.7077 fetch_fsmap learned FSMap version 66 2024-09-17T03:13:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.259+0000 7f85594d2740 1 -- 172.21.15.78:0/793985124 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x5623b6902010 con 0x5623b65193b0 2024-09-17T03:13:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.259+0000 7f852affd640 1 -- 172.21.15.78:0/793985124 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f853c022070 con 0x5623b65193b0 2024-09-17T03:13:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.259+0000 7f852affd640 1 -- 172.21.15.78:0/793985124 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 66) ==== 3542+0+0 (secure 0 0 0) 0x7f853c03a020 con 0x5623b65193b0 2024-09-17T03:13:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.259+0000 7f85594d2740 10 client.7077 fetch_fsmap finished waiting for FSMap version 66 2024-09-17T03:13:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.259+0000 7f85594d2740 10 client.7077 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:13:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.259+0000 7f85594d2740 20 client.7077 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.259+0000 7f85594d2740 1 --2- 172.21.15.78:0/793985124 >> [v2:172.21.15.193:6835/1431701139,v1:172.21.15.193:6837/1431701139] conn(0x5623b6500e40 0x5623b6927110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.259+0000 7f85594d2740 4 client.7077 mds_command: new command op to 6271 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:13:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.259+0000 7f85594d2740 1 -- 172.21.15.78:0/793985124 --> [v2:172.21.15.193:6835/1431701139,v1:172.21.15.193:6837/1431701139] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623b685e770 con 0x5623b6500e40 2024-09-17T03:13:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.259+0000 7f854b7fe640 1 --2- 172.21.15.78:0/793985124 >> [v2:172.21.15.193:6835/1431701139,v1:172.21.15.193:6837/1431701139] conn(0x5623b6500e40 0x5623b6927110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.260+0000 7f852affd640 10 client.7077 ms_handle_connect on v2:172.21.15.193:6835/1431701139 2024-09-17T03:13:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.260+0000 7f854b7fe640 1 --2- 172.21.15.78:0/793985124 >> [v2:172.21.15.193:6835/1431701139,v1:172.21.15.193:6837/1431701139] conn(0x5623b6500e40 0x5623b6927110 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c53a821bf3814ae4 server_cookie=5a7ecca30b5ff38a in_seq=0 out_seq=0 2024-09-17T03:13:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.260+0000 7f852affd640 1 -- 172.21.15.78:0/793985124 <== mds.2 v2:172.21.15.193:6835/1431701139 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5623b685e770 con 0x5623b6500e40 2024-09-17T03:13:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.260+0000 7f852affd640 10 client.7077 handle_command_reply: tid=0 2024-09-17T03:13:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.260+0000 7f85594d2740 1 client.7077 shutdown 2024-09-17T03:13:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.261+0000 7f85594d2740 1 -- 172.21.15.78:0/793985124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 msgr2=0x5623b690cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.261+0000 7f85594d2740 1 --2- 172.21.15.78:0/793985124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 0x5623b690cc50 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f853c01f040 tx=0x7f853c0042f0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.261+0000 7f85594d2740 1 -- 172.21.15.78:0/793985124 shutdown_connections 2024-09-17T03:13:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.261+0000 7f85594d2740 1 --2- 172.21.15.78:0/793985124 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b6542270 0x5623b69122a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.261+0000 7f85594d2740 1 --2- 172.21.15.78:0/793985124 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6521590 0x5623b6901ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.261+0000 7f85594d2740 1 --2- 172.21.15.78:0/793985124 >> [v2:172.21.15.193:6835/1431701139,v1:172.21.15.193:6837/1431701139] conn(0x5623b6500e40 0x5623b6927110 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.261+0000 7f85594d2740 1 --2- 172.21.15.78:0/793985124 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 0x5623b690cc50 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.261+0000 7f852affd640 0 client.7077 ms_handle_reset on v2:172.21.15.193:6835/1431701139 2024-09-17T03:13:05.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.261+0000 7f85594d2740 1 -- 172.21.15.78:0/793985124 >> 172.21.15.78:0/793985124 conn(0x5623b65363c0 msgr2=0x5623b69309b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:05.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.261+0000 7f85594d2740 1 -- 172.21.15.78:0/793985124 shutdown_connections 2024-09-17T03:13:05.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.261+0000 7f85594d2740 1 -- 172.21.15.78:0/793985124 wait complete. 2024-09-17T03:13:05.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.261+0000 7f85594d2740 20 client.7077 trim_cache size 0 max 16384 2024-09-17T03:13:05.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.279+0000 7f85594d2740 1 Processor -- start 2024-09-17T03:13:05.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.279+0000 7f85594d2740 1 -- start start 2024-09-17T03:13:05.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.280+0000 7f85594d2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 0x5623b69a7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.280+0000 7f85594d2740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b6521590 0x5623b6911c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.280+0000 7f85594d2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6542270 0x5623b6912160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.280+0000 7f85594d2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f854c1ff210 con 0x5623b65193b0 2024-09-17T03:13:05.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.280+0000 7f85594d2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f854c1ff8e0 con 0x5623b6542270 2024-09-17T03:13:05.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.280+0000 7f85594d2740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f854c1f7950 con 0x5623b6521590 2024-09-17T03:13:05.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.280+0000 7f854bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 0x5623b69a7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.280+0000 7f854bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 0x5623b69a7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45886/0 (socket says 172.21.15.78:45886) 2024-09-17T03:13:05.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.280+0000 7f854bfff640 1 -- 172.21.15.78:0/3719798685 learned_addr learned my addr 172.21.15.78:0/3719798685 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:05.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.281+0000 7f8550aff640 1 --2- 172.21.15.78:0/3719798685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6542270 0x5623b6912160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.281+0000 7f854bfff640 1 -- 172.21.15.78:0/3719798685 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b6521590 msgr2=0x5623b6911c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.281+0000 7f854b7fe640 1 --2- 172.21.15.78:0/3719798685 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b6521590 0x5623b6911c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.281+0000 7f854bfff640 1 --2- 172.21.15.78:0/3719798685 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b6521590 0x5623b6911c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.281+0000 7f854bfff640 1 -- 172.21.15.78:0/3719798685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6542270 msgr2=0x5623b6912160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.281+0000 7f854bfff640 1 --2- 172.21.15.78:0/3719798685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6542270 0x5623b6912160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.281+0000 7f854bfff640 1 -- 172.21.15.78:0/3719798685 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623b6914960 con 0x5623b65193b0 2024-09-17T03:13:05.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.281+0000 7f8550aff640 1 --2- 172.21.15.78:0/3719798685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6542270 0x5623b6912160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:05.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.281+0000 7f854b7fe640 1 --2- 172.21.15.78:0/3719798685 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b6521590 0x5623b6911c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:05.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.281+0000 7f854bfff640 1 --2- 172.21.15.78:0/3719798685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 0x5623b69a7ff0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f853c00c320 tx=0x7f853c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890de56bba6cabb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:05.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.281+0000 7f85317fa640 1 -- 172.21.15.78:0/3719798685 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c02a040 con 0x5623b65193b0 2024-09-17T03:13:05.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.281+0000 7f85317fa640 1 -- 172.21.15.78:0/3719798685 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f853c022040 con 0x5623b65193b0 2024-09-17T03:13:05.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.281+0000 7f85317fa640 1 -- 172.21.15.78:0/3719798685 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c013880 con 0x5623b65193b0 2024-09-17T03:13:05.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.282+0000 7f85594d2740 1 -- 172.21.15.78:0/3719798685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 msgr2=0x5623b69a7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.282+0000 7f85594d2740 1 --2- 172.21.15.78:0/3719798685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 0x5623b69a7ff0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f853c00c320 tx=0x7f853c00c800 comp rx=0 tx=0).stop 2024-09-17T03:13:05.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.282+0000 7f85594d2740 1 -- 172.21.15.78:0/3719798685 shutdown_connections 2024-09-17T03:13:05.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.282+0000 7f85594d2740 1 --2- 172.21.15.78:0/3719798685 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6542270 0x5623b6912160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.282+0000 7f85594d2740 1 --2- 172.21.15.78:0/3719798685 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b6521590 0x5623b6911c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.282+0000 7f85594d2740 1 --2- 172.21.15.78:0/3719798685 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 0x5623b69a7ff0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.282+0000 7f85594d2740 1 -- 172.21.15.78:0/3719798685 >> 172.21.15.78:0/3719798685 conn(0x5623b65363c0 msgr2=0x5623b693c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:05.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.282+0000 7f85594d2740 1 -- 172.21.15.78:0/3719798685 shutdown_connections 2024-09-17T03:13:05.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.282+0000 7f85594d2740 1 -- 172.21.15.78:0/3719798685 wait complete. 2024-09-17T03:13:05.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.283+0000 7f85594d2740 1 -- start start 2024-09-17T03:13:05.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.283+0000 7f85594d2740 1 Processor -- start 2024-09-17T03:13:05.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.284+0000 7f85594d2740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 0x5623b69a3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.284+0000 7f85594d2740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b6521590 0x5623b690c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.284+0000 7f85594d2740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6542270 0x5623b690ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.284+0000 7f85594d2740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5623b69127e0 con 0x5623b65193b0 2024-09-17T03:13:05.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.284+0000 7f85594d2740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5623b6926ab0 con 0x5623b6542270 2024-09-17T03:13:05.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.284+0000 7f85594d2740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5623b6940fb0 con 0x5623b6521590 2024-09-17T03:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.284+0000 7f85594d2740 10 client.0 _ll_register_callbacks cb 0x7f854005ef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.284+0000 7f854bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 0x5623b69a3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.284+0000 7f854bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 0x5623b69a3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45890/0 (socket says 172.21.15.78:45890) 2024-09-17T03:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.284+0000 7f854bfff640 1 -- 172.21.15.78:0/1316987193 learned_addr learned my addr 172.21.15.78:0/1316987193 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.284+0000 7f8550aff640 1 --2- 172.21.15.78:0/1316987193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6542270 0x5623b690ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.284+0000 7f854b7fe640 1 --2- 172.21.15.78:0/1316987193 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b6521590 0x5623b690c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.284+0000 7f854bfff640 1 -- 172.21.15.78:0/1316987193 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b6521590 msgr2=0x5623b690c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.284+0000 7f854bfff640 1 --2- 172.21.15.78:0/1316987193 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b6521590 0x5623b690c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.284+0000 7f854bfff640 1 -- 172.21.15.78:0/1316987193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6542270 msgr2=0x5623b690ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.284+0000 7f854bfff640 1 --2- 172.21.15.78:0/1316987193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6542270 0x5623b690ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.284+0000 7f854bfff640 1 -- 172.21.15.78:0/1316987193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623b68ebbc0 con 0x5623b65193b0 2024-09-17T03:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.285+0000 7f854b7fe640 1 --2- 172.21.15.78:0/1316987193 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b6521590 0x5623b690c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.285+0000 7f8550aff640 1 --2- 172.21.15.78:0/1316987193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6542270 0x5623b690ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:05.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.285+0000 7f854bfff640 1 --2- 172.21.15.78:0/1316987193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 0x5623b69a3e00 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f853c015010 tx=0x7f853c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84fa4815833e2aa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:05.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.285+0000 7f852affd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:05.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.285+0000 7f852affd640 1 -- 172.21.15.78:0/1316987193 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c048020 con 0x5623b65193b0 2024-09-17T03:13:05.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.285+0000 7f852affd640 1 -- 172.21.15.78:0/1316987193 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f853c02f460 con 0x5623b65193b0 2024-09-17T03:13:05.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.285+0000 7f85594d2740 1 -- 172.21.15.78:0/1316987193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f853c022040 con 0x5623b65193b0 2024-09-17T03:13:05.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.285+0000 7f852affd640 1 -- 172.21.15.78:0/1316987193 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f853c02a040 con 0x5623b65193b0 2024-09-17T03:13:05.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.285+0000 7f85594d2740 10 client.7083 fetch_fsmap learned FSMap version 66 2024-09-17T03:13:05.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.285+0000 7f85594d2740 1 -- 172.21.15.78:0/1316987193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x5623b69a3460 con 0x5623b65193b0 2024-09-17T03:13:05.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.285+0000 7f852affd640 1 -- 172.21.15.78:0/1316987193 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f853c022040 con 0x5623b65193b0 2024-09-17T03:13:05.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.285+0000 7f852affd640 1 -- 172.21.15.78:0/1316987193 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 66) ==== 3542+0+0 (secure 0 0 0) 0x7f853c03a030 con 0x5623b65193b0 2024-09-17T03:13:05.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.285+0000 7f85594d2740 10 client.7083 fetch_fsmap finished waiting for FSMap version 66 2024-09-17T03:13:05.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.285+0000 7f85594d2740 10 client.7083 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:13:05.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.285+0000 7f85594d2740 20 client.7083 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:05.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.285+0000 7f85594d2740 1 --2- 172.21.15.78:0/1316987193 >> [v2:172.21.15.193:6835/1431701139,v1:172.21.15.193:6837/1431701139] conn(0x5623b68e3490 0x5623b68e38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.285+0000 7f85594d2740 4 client.7083 mds_command: new command op to 6271 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:13:05.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.285+0000 7f85594d2740 1 -- 172.21.15.78:0/1316987193 --> [v2:172.21.15.193:6835/1431701139,v1:172.21.15.193:6837/1431701139] -- command(tid 0: {"prefix": "status"}) -- 0x5623b68dff80 con 0x5623b68e3490 2024-09-17T03:13:05.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.286+0000 7f854b7fe640 1 --2- 172.21.15.78:0/1316987193 >> [v2:172.21.15.193:6835/1431701139,v1:172.21.15.193:6837/1431701139] conn(0x5623b68e3490 0x5623b68e38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.286+0000 7f852affd640 10 client.7083 ms_handle_connect on v2:172.21.15.193:6835/1431701139 2024-09-17T03:13:05.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.286+0000 7f854b7fe640 1 --2- 172.21.15.78:0/1316987193 >> [v2:172.21.15.193:6835/1431701139,v1:172.21.15.193:6837/1431701139] conn(0x5623b68e3490 0x5623b68e38a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b8a45f887c69418b server_cookie=554e48d2b7e66418 in_seq=0 out_seq=0 2024-09-17T03:13:05.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.286+0000 7f852affd640 1 -- 172.21.15.78:0/1316987193 <== mds.2 v2:172.21.15.193:6835/1431701139 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x5623b68dff80 con 0x5623b68e3490 2024-09-17T03:13:05.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.286+0000 7f852affd640 10 client.7083 handle_command_reply: tid=0 2024-09-17T03:13:05.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.286+0000 7f85594d2740 1 client.7083 shutdown 2024-09-17T03:13:05.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.286+0000 7f85594d2740 1 -- 172.21.15.78:0/1316987193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 msgr2=0x5623b69a3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.286+0000 7f85594d2740 1 --2- 172.21.15.78:0/1316987193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 0x5623b69a3e00 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f853c015010 tx=0x7f853c00c6a0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.286+0000 7f85594d2740 1 -- 172.21.15.78:0/1316987193 shutdown_connections 2024-09-17T03:13:05.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.286+0000 7f85594d2740 1 --2- 172.21.15.78:0/1316987193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5623b6542270 0x5623b690ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.286+0000 7f85594d2740 1 --2- 172.21.15.78:0/1316987193 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5623b6521590 0x5623b690c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.286+0000 7f85594d2740 1 --2- 172.21.15.78:0/1316987193 >> [v2:172.21.15.193:6835/1431701139,v1:172.21.15.193:6837/1431701139] conn(0x5623b68e3490 0x5623b68e38a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.286+0000 7f85594d2740 1 --2- 172.21.15.78:0/1316987193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5623b65193b0 0x5623b69a3e00 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.287+0000 7f852affd640 0 client.7083 ms_handle_reset on v2:172.21.15.193:6835/1431701139 2024-09-17T03:13:05.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.287+0000 7f85594d2740 1 -- 172.21.15.78:0/1316987193 >> 172.21.15.78:0/1316987193 conn(0x5623b65363c0 msgr2=0x5623b690db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:05.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.287+0000 7f85594d2740 1 -- 172.21.15.78:0/1316987193 shutdown_connections 2024-09-17T03:13:05.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.287+0000 7f85594d2740 1 -- 172.21.15.78:0/1316987193 wait complete. 2024-09-17T03:13:05.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.287+0000 7f85594d2740 20 client.7083 trim_cache size 0 max 16384 2024-09-17T03:13:05.292 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:13:05.292 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:13:05.293 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 2, 2024-09-17T03:13:05.293 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 6271, 2024-09-17T03:13:05.293 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:13:05.293 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:13:05.293 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:13:05.293 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 1.66859782, 2024-09-17T03:13:05.293 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 66, 2024-09-17T03:13:05.293 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 69, 2024-09-17T03:13:05.293 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 69, 2024-09-17T03:13:05.293 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 18.399265164999999 2024-09-17T03:13:05.293 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:13:05.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.287+0000 7f8552562640 1 -- 172.21.15.78:0/1924790522 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8538078b90 msgr2=0x7f853807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.287+0000 7f8552562640 1 --2- 172.21.15.78:0/1924790522 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8538078b90 0x7f853807b0a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f853c00a750 tx=0x7f853c008040 comp rx=0 tx=0).stop 2024-09-17T03:13:05.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.287+0000 7f8552562640 1 -- 172.21.15.78:0/1924790522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f854c15d840 msgr2=0x7f854c146910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.287+0000 7f8552562640 1 --2- 172.21.15.78:0/1924790522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f854c15d840 0x7f854c146910 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f854000c3a0 tx=0x7f854000c860 comp rx=0 tx=0).stop 2024-09-17T03:13:05.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.287+0000 7f8552562640 1 -- 172.21.15.78:0/1924790522 shutdown_connections 2024-09-17T03:13:05.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.287+0000 7f8552562640 1 --2- 172.21.15.78:0/1924790522 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8538078b90 0x7f853807b0a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.287+0000 7f8552562640 1 --2- 172.21.15.78:0/1924790522 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f854c0cbfa0 0x7f854c0cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.287+0000 7f8552562640 1 --2- 172.21.15.78:0/1924790522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f854c15d840 0x7f854c146910 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.287+0000 7f8552562640 1 --2- 172.21.15.78:0/1924790522 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f854c1570e0 0x7f854c1463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.287+0000 7f8552562640 1 -- 172.21.15.78:0/1924790522 >> 172.21.15.78:0/1924790522 conn(0x7f854c06d550 msgr2=0x7f854c0b3db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:05.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.287+0000 7f8552562640 1 -- 172.21.15.78:0/1924790522 shutdown_connections 2024-09-17T03:13:05.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.287+0000 7f8552562640 1 -- 172.21.15.78:0/1924790522 wait complete. 2024-09-17T03:13:05.297 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:13:05.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.411+0000 7fe159077640 1 -- 172.21.15.78:0/2972172958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe15406f4b0 msgr2=0x7fe1540d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.411+0000 7fe159077640 1 --2- 172.21.15.78:0/2972172958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe15406f4b0 0x7fe1540d3330 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fe1540ba570 tx=0x7fe13c02a4f0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.411+0000 7fe159077640 1 -- 172.21.15.78:0/2972172958 shutdown_connections 2024-09-17T03:13:05.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.411+0000 7fe159077640 1 --2- 172.21.15.78:0/2972172958 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe1540d3870 0x7fe1540ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.411+0000 7fe159077640 1 --2- 172.21.15.78:0/2972172958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe15406f4b0 0x7fe1540d3330 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.411+0000 7fe159077640 1 --2- 172.21.15.78:0/2972172958 >> v2:172.21.15.193:3300/0 conn(0x7fe15406e170 0x7fe1540b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.411+0000 7fe159077640 1 -- 172.21.15.78:0/2972172958 >> 172.21.15.78:0/2972172958 conn(0x7fe15408bfc0 msgr2=0x7fe15409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:05.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.411+0000 7fe159077640 1 -- 172.21.15.78:0/2972172958 shutdown_connections 2024-09-17T03:13:05.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.411+0000 7fe159077640 1 -- 172.21.15.78:0/2972172958 wait complete. 2024-09-17T03:13:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.413+0000 7fe159077640 1 Processor -- start 2024-09-17T03:13:05.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.413+0000 7fe159077640 1 -- start start 2024-09-17T03:13:05.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.414+0000 7fe159077640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe15406f4b0 0x7fe1541e83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.414+0000 7fe159077640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe1540d3870 0x7fe1541e9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.414+0000 7fe159077640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1540cc200 0x7fe1541e7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.414+0000 7fe159077640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe1540cf490 con 0x7fe1540cc200 2024-09-17T03:13:05.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.414+0000 7fe159077640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe1540cf310 con 0x7fe15406f4b0 2024-09-17T03:13:05.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.414+0000 7fe159077640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe1540d0ce0 con 0x7fe1540d3870 2024-09-17T03:13:05.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.414+0000 7fe15359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1540cc200 0x7fe1541e7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.414+0000 7fe15359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1540cc200 0x7fe1541e7210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45908/0 (socket says 172.21.15.78:45908) 2024-09-17T03:13:05.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.414+0000 7fe15359e640 1 -- 172.21.15.78:0/557739524 learned_addr learned my addr 172.21.15.78:0/557739524 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:05.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.415+0000 7fe152d9d640 1 --2- 172.21.15.78:0/557739524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe15406f4b0 0x7fe1541e83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.415+0000 7fe15259c640 1 --2- 172.21.15.78:0/557739524 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe1540d3870 0x7fe1541e9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.415+0000 7fe15359e640 1 -- 172.21.15.78:0/557739524 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe1540d3870 msgr2=0x7fe1541e9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.415+0000 7fe15359e640 1 --2- 172.21.15.78:0/557739524 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe1540d3870 0x7fe1541e9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.415+0000 7fe15359e640 1 -- 172.21.15.78:0/557739524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe15406f4b0 msgr2=0x7fe1541e83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.415+0000 7fe15359e640 1 --2- 172.21.15.78:0/557739524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe15406f4b0 0x7fe1541e83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.415+0000 7fe15359e640 1 -- 172.21.15.78:0/557739524 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1541e88f0 con 0x7fe1540cc200 2024-09-17T03:13:05.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.415+0000 7fe15359e640 1 --2- 172.21.15.78:0/557739524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1540cc200 0x7fe1541e7210 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fe14c00e960 tx=0x7fe14c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:05.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.415+0000 7fe14b7fe640 1 -- 172.21.15.78:0/557739524 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c004d20 con 0x7fe1540cc200 2024-09-17T03:13:05.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.415+0000 7fe14b7fe640 1 -- 172.21.15.78:0/557739524 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe14c00cb20 con 0x7fe1540cc200 2024-09-17T03:13:05.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.415+0000 7fe159077640 1 -- 172.21.15.78:0/557739524 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1540cb740 con 0x7fe1540cc200 2024-09-17T03:13:05.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.415+0000 7fe14b7fe640 1 -- 172.21.15.78:0/557739524 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c005020 con 0x7fe1540cc200 2024-09-17T03:13:05.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.415+0000 7fe159077640 1 -- 172.21.15.78:0/557739524 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1540cba00 con 0x7fe1540cc200 2024-09-17T03:13:05.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.417+0000 7fe14b7fe640 1 -- 172.21.15.78:0/557739524 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe14c0051c0 con 0x7fe1540cc200 2024-09-17T03:13:05.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.417+0000 7fe14b7fe640 1 --2- 172.21.15.78:0/557739524 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe134078b90 0x7fe13407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.417+0000 7fe14b7fe640 1 -- 172.21.15.78:0/557739524 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fe14c09b510 con 0x7fe1540cc200 2024-09-17T03:13:05.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.418+0000 7fe152d9d640 1 --2- 172.21.15.78:0/557739524 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe134078b90 0x7fe13407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.418+0000 7fe152d9d640 1 --2- 172.21.15.78:0/557739524 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe134078b90 0x7fe13407b0a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe14400bb50 tx=0x7fe14400b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:05.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.418+0000 7fe15ffe0740 1 Processor -- start 2024-09-17T03:13:05.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.418+0000 7fe15ffe0740 1 -- start start 2024-09-17T03:13:05.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.420+0000 7fe15ffe0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff84e270 0x556effc1ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.420+0000 7fe15ffe0740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556eff8253b0 0x556effc204e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.420+0000 7fe15ffe0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556eff82d590 0x556effc3d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.420+0000 7fe15ffe0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x556effb68820 con 0x556eff84e270 2024-09-17T03:13:05.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.420+0000 7fe15ffe0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556effb57c50 con 0x556eff82d590 2024-09-17T03:13:05.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.420+0000 7fe15ffe0740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x556effb5ba60 con 0x556eff8253b0 2024-09-17T03:13:05.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.420+0000 7fe152d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff84e270 0x556effc1ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.420+0000 7fe152d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff84e270 0x556effc1ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45912/0 (socket says 172.21.15.78:45912) 2024-09-17T03:13:05.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.420+0000 7fe152d9d640 1 -- 172.21.15.78:0/2196778289 learned_addr learned my addr 172.21.15.78:0/2196778289 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:05.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.420+0000 7fe15259c640 1 --2- 172.21.15.78:0/2196778289 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556eff8253b0 0x556effc204e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.420+0000 7fe152d9d640 1 -- 172.21.15.78:0/2196778289 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556eff8253b0 msgr2=0x556effc204e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.420+0000 7fe15359e640 1 --2- 172.21.15.78:0/2196778289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556eff82d590 0x556effc3d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.420+0000 7fe152d9d640 1 --2- 172.21.15.78:0/2196778289 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556eff8253b0 0x556effc204e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.420+0000 7fe152d9d640 1 -- 172.21.15.78:0/2196778289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556eff82d590 msgr2=0x556effc3d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.420+0000 7fe152d9d640 1 --2- 172.21.15.78:0/2196778289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556eff82d590 0x556effc3d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.420+0000 7fe152d9d640 1 -- 172.21.15.78:0/2196778289 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556eff8b9850 con 0x556eff84e270 2024-09-17T03:13:05.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.420+0000 7fe15259c640 1 --2- 172.21.15.78:0/2196778289 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556eff8253b0 0x556effc204e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:05.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.420+0000 7fe152d9d640 1 --2- 172.21.15.78:0/2196778289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff84e270 0x556effc1ffa0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fe144005d00 tx=0x7fe144013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ee4d94129581f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:05.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.421+0000 7fe148ff9640 1 -- 172.21.15.78:0/2196778289 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14401e620 con 0x556eff84e270 2024-09-17T03:13:05.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.421+0000 7fe148ff9640 1 -- 172.21.15.78:0/2196778289 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe14401e7c0 con 0x556eff84e270 2024-09-17T03:13:05.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.421+0000 7fe148ff9640 1 -- 172.21.15.78:0/2196778289 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14401ebb0 con 0x556eff84e270 2024-09-17T03:13:05.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.421+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2196778289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff84e270 msgr2=0x556effc1ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.421+0000 7fe15ffe0740 1 --2- 172.21.15.78:0/2196778289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff84e270 0x556effc1ffa0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fe144005d00 tx=0x7fe144013000 comp rx=0 tx=0).stop 2024-09-17T03:13:05.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.421+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2196778289 shutdown_connections 2024-09-17T03:13:05.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.421+0000 7fe15ffe0740 1 --2- 172.21.15.78:0/2196778289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556eff82d590 0x556effc3d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.421+0000 7fe15ffe0740 1 --2- 172.21.15.78:0/2196778289 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556eff8253b0 0x556effc204e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.421+0000 7fe15ffe0740 1 --2- 172.21.15.78:0/2196778289 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff84e270 0x556effc1ffa0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.421+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2196778289 >> 172.21.15.78:0/2196778289 conn(0x556eff8423c0 msgr2=0x556effbf6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:05.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.422+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2196778289 shutdown_connections 2024-09-17T03:13:05.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.422+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2196778289 wait complete. 2024-09-17T03:13:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.422+0000 7fe15ffe0740 1 -- start start 2024-09-17T03:13:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.422+0000 7fe15ffe0740 1 Processor -- start 2024-09-17T03:13:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe15ffe0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556eff8253b0 0x556effc3d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe15ffe0740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556eff82d590 0x556effc4d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe15ffe0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff84e270 0x556effc33590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe15ffe0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x556eff8c8620 con 0x556eff84e270 2024-09-17T03:13:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe15ffe0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556effafd5f0 con 0x556eff8253b0 2024-09-17T03:13:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe15ffe0740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x556effc20a20 con 0x556eff82d590 2024-09-17T03:13:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe15ffe0740 10 client.0 _ll_register_callbacks cb 0x556effb010a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe15359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff84e270 0x556effc33590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe15359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff84e270 0x556effc33590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45914/0 (socket says 172.21.15.78:45914) 2024-09-17T03:13:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe15359e640 1 -- 172.21.15.78:0/2828809098 learned_addr learned my addr 172.21.15.78:0/2828809098 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe15259c640 1 --2- 172.21.15.78:0/2828809098 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556eff82d590 0x556effc4d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe152d9d640 1 --2- 172.21.15.78:0/2828809098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556eff8253b0 0x556effc3d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe15359e640 1 -- 172.21.15.78:0/2828809098 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556eff82d590 msgr2=0x556effc4d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe15359e640 1 --2- 172.21.15.78:0/2828809098 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556eff82d590 0x556effc4d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe15359e640 1 -- 172.21.15.78:0/2828809098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556eff8253b0 msgr2=0x556effc3d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe15359e640 1 --2- 172.21.15.78:0/2828809098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556eff8253b0 0x556effc3d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe15359e640 1 -- 172.21.15.78:0/2828809098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556eff9306b0 con 0x556eff84e270 2024-09-17T03:13:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe152d9d640 1 --2- 172.21.15.78:0/2828809098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556eff8253b0 0x556effc3d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe15359e640 1 --2- 172.21.15.78:0/2828809098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff84e270 0x556effc33590 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe14c099a60 tx=0x7fe14c063990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd231baaa3525639 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe131ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.424+0000 7fe131ffb640 1 -- 172.21.15.78:0/2828809098 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c089020 con 0x556eff84e270 2024-09-17T03:13:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.425+0000 7fe131ffb640 1 -- 172.21.15.78:0/2828809098 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fe14c0625f0 con 0x556eff84e270 2024-09-17T03:13:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.425+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2828809098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe14401e7c0 con 0x556eff84e270 2024-09-17T03:13:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.425+0000 7fe131ffb640 1 -- 172.21.15.78:0/2828809098 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fe14c099e60 con 0x556eff84e270 2024-09-17T03:13:05.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.425+0000 7fe15ffe0740 10 client.7095 fetch_fsmap learned FSMap version 66 2024-09-17T03:13:05.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.425+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2828809098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x556effc3d9c0 con 0x556eff84e270 2024-09-17T03:13:05.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.425+0000 7fe131ffb640 1 -- 172.21.15.78:0/2828809098 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe14401e7c0 con 0x556eff84e270 2024-09-17T03:13:05.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.425+0000 7fe131ffb640 1 -- 172.21.15.78:0/2828809098 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 66) ==== 3542+0+0 (secure 0 0 0) 0x7fe14c00f040 con 0x556eff84e270 2024-09-17T03:13:05.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.425+0000 7fe15ffe0740 10 client.7095 fetch_fsmap finished waiting for FSMap version 66 2024-09-17T03:13:05.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.425+0000 7fe15ffe0740 10 client.7095 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:13:05.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.425+0000 7fe15ffe0740 20 client.7095 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:05.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.425+0000 7fe15ffe0740 1 --2- 172.21.15.78:0/2828809098 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x556eff80ce40 0x556effc31b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.425+0000 7fe15ffe0740 4 client.7095 mds_command: new command op to 6861 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:13:05.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.425+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2828809098 --> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556effb6a770 con 0x556eff80ce40 2024-09-17T03:13:05.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.425+0000 7fe152d9d640 1 --2- 172.21.15.78:0/2828809098 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x556eff80ce40 0x556effc31b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.425+0000 7fe131ffb640 10 client.7095 ms_handle_connect on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:05.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.425+0000 7fe152d9d640 1 --2- 172.21.15.78:0/2828809098 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x556eff80ce40 0x556effc31b90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c8147eced2d3b0e9 server_cookie=683e5f2a8cbbf4f5 in_seq=0 out_seq=0 2024-09-17T03:13:05.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.426+0000 7fe131ffb640 1 -- 172.21.15.78:0/2828809098 <== mds.1 v2:172.21.15.78:6832/2905189397 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556effb6a770 con 0x556eff80ce40 2024-09-17T03:13:05.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.426+0000 7fe131ffb640 10 client.7095 handle_command_reply: tid=0 2024-09-17T03:13:05.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.426+0000 7fe15ffe0740 1 client.7095 shutdown 2024-09-17T03:13:05.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.426+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2828809098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff84e270 msgr2=0x556effc33590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.426+0000 7fe15ffe0740 1 --2- 172.21.15.78:0/2828809098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff84e270 0x556effc33590 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fe14c099a60 tx=0x7fe14c063990 comp rx=0 tx=0).stop 2024-09-17T03:13:05.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.426+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2828809098 shutdown_connections 2024-09-17T03:13:05.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.426+0000 7fe15ffe0740 1 --2- 172.21.15.78:0/2828809098 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x556eff80ce40 0x556effc31b90 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.426+0000 7fe15ffe0740 1 --2- 172.21.15.78:0/2828809098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff84e270 0x556effc33590 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.426+0000 7fe15ffe0740 1 --2- 172.21.15.78:0/2828809098 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556eff82d590 0x556effc4d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.426+0000 7fe131ffb640 0 client.7095 ms_handle_reset on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:05.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.426+0000 7fe15ffe0740 1 --2- 172.21.15.78:0/2828809098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556eff8253b0 0x556effc3d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.426+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2828809098 >> 172.21.15.78:0/2828809098 conn(0x556eff8423c0 msgr2=0x556effc3c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:05.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.427+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2828809098 shutdown_connections 2024-09-17T03:13:05.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.427+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2828809098 wait complete. 2024-09-17T03:13:05.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.427+0000 7fe15ffe0740 20 client.7095 trim_cache size 0 max 16384 2024-09-17T03:13:05.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.445+0000 7fe15ffe0740 1 Processor -- start 2024-09-17T03:13:05.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.445+0000 7fe15ffe0740 1 -- start start 2024-09-17T03:13:05.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.446+0000 7fe15ffe0740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556eff80ce40 0x556effbf60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.446+0000 7fe15ffe0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556eff8253b0 0x556effbf6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.446+0000 7fe15ffe0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff82d590 0x556effc5dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.446+0000 7fe15ffe0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe1541f9230 con 0x556eff82d590 2024-09-17T03:13:05.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.446+0000 7fe15ffe0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe154201ca0 con 0x556eff8253b0 2024-09-17T03:13:05.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.446+0000 7fe15ffe0740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe1541f4e00 con 0x556eff80ce40 2024-09-17T03:13:05.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.446+0000 7fe15359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff82d590 0x556effc5dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.446+0000 7fe15359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff82d590 0x556effc5dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45922/0 (socket says 172.21.15.78:45922) 2024-09-17T03:13:05.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.446+0000 7fe15359e640 1 -- 172.21.15.78:0/835155092 learned_addr learned my addr 172.21.15.78:0/835155092 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:05.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.447+0000 7fe15359e640 1 -- 172.21.15.78:0/835155092 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556eff80ce40 msgr2=0x556effbf60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.447+0000 7fe15359e640 1 --2- 172.21.15.78:0/835155092 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556eff80ce40 0x556effbf60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.447+0000 7fe15359e640 1 -- 172.21.15.78:0/835155092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556eff8253b0 msgr2=0x556effbf6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.447+0000 7fe15359e640 1 --2- 172.21.15.78:0/835155092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556eff8253b0 0x556effbf6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.447+0000 7fe15359e640 1 -- 172.21.15.78:0/835155092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556effc37ac0 con 0x556eff82d590 2024-09-17T03:13:05.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.447+0000 7fe15359e640 1 --2- 172.21.15.78:0/835155092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff82d590 0x556effc5dc80 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe14c063090 tx=0x7fe14c004fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94922b3ebe642127 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:05.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.447+0000 7fe133fff640 1 -- 172.21.15.78:0/835155092 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c089040 con 0x556eff82d590 2024-09-17T03:13:05.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.447+0000 7fe133fff640 1 -- 172.21.15.78:0/835155092 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe14c062ea0 con 0x556eff82d590 2024-09-17T03:13:05.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.447+0000 7fe133fff640 1 -- 172.21.15.78:0/835155092 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c01f040 con 0x556eff82d590 2024-09-17T03:13:05.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.448+0000 7fe15ffe0740 1 -- 172.21.15.78:0/835155092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff82d590 msgr2=0x556effc5dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.448+0000 7fe15ffe0740 1 --2- 172.21.15.78:0/835155092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff82d590 0x556effc5dc80 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fe14c063090 tx=0x7fe14c004fb0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.448+0000 7fe15ffe0740 1 -- 172.21.15.78:0/835155092 shutdown_connections 2024-09-17T03:13:05.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.448+0000 7fe15ffe0740 1 --2- 172.21.15.78:0/835155092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff82d590 0x556effc5dc80 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.448+0000 7fe15ffe0740 1 --2- 172.21.15.78:0/835155092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556eff8253b0 0x556effbf6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.448+0000 7fe15ffe0740 1 --2- 172.21.15.78:0/835155092 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556eff80ce40 0x556effbf60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.448+0000 7fe15ffe0740 1 -- 172.21.15.78:0/835155092 >> 172.21.15.78:0/835155092 conn(0x556eff8423c0 msgr2=0x556effc36ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:05.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.448+0000 7fe15ffe0740 1 -- 172.21.15.78:0/835155092 shutdown_connections 2024-09-17T03:13:05.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.448+0000 7fe15ffe0740 1 -- 172.21.15.78:0/835155092 wait complete. 2024-09-17T03:13:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.448+0000 7fe15ffe0740 1 -- start start 2024-09-17T03:13:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.449+0000 7fe15ffe0740 1 Processor -- start 2024-09-17T03:13:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.450+0000 7fe15ffe0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556eff80ce40 0x556effcbe460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.450+0000 7fe15ffe0740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556eff8253b0 0x556effcb42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.450+0000 7fe15ffe0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff82d590 0x556effcba460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.450+0000 7fe15ffe0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x556effc33b70 con 0x556eff82d590 2024-09-17T03:13:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.450+0000 7fe15ffe0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556effc4aec0 con 0x556eff80ce40 2024-09-17T03:13:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.450+0000 7fe15ffe0740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x556effc34440 con 0x556eff8253b0 2024-09-17T03:13:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.450+0000 7fe15ffe0740 10 client.0 _ll_register_callbacks cb 0x7fe14c068f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.450+0000 7fe15359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff82d590 0x556effcba460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.450+0000 7fe15359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff82d590 0x556effcba460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45936/0 (socket says 172.21.15.78:45936) 2024-09-17T03:13:05.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.450+0000 7fe15359e640 1 -- 172.21.15.78:0/2280249842 learned_addr learned my addr 172.21.15.78:0/2280249842 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:05.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.450+0000 7fe15359e640 1 -- 172.21.15.78:0/2280249842 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556eff8253b0 msgr2=0x556effcb42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.450+0000 7fe15359e640 1 --2- 172.21.15.78:0/2280249842 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556eff8253b0 0x556effcb42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.450+0000 7fe15359e640 1 -- 172.21.15.78:0/2280249842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556eff80ce40 msgr2=0x556effcbe460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.450+0000 7fe15359e640 1 --2- 172.21.15.78:0/2280249842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556eff80ce40 0x556effcbe460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.450+0000 7fe15359e640 1 -- 172.21.15.78:0/2280249842 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556effcbe9a0 con 0x556eff82d590 2024-09-17T03:13:05.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.450+0000 7fe15359e640 1 --2- 172.21.15.78:0/2280249842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff82d590 0x556effcba460 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fe14c063320 tx=0x7fe14c0629d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51f5b2e66bcf483 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:05.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.450+0000 7fe131ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:05.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.450+0000 7fe131ffb640 1 -- 172.21.15.78:0/2280249842 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14c01f070 con 0x556eff82d590 2024-09-17T03:13:05.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.451+0000 7fe131ffb640 1 -- 172.21.15.78:0/2280249842 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fe14c05eef0 con 0x556eff82d590 2024-09-17T03:13:05.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.451+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2280249842 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe14c062ea0 con 0x556eff82d590 2024-09-17T03:13:05.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.451+0000 7fe131ffb640 1 -- 172.21.15.78:0/2280249842 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fe14c089040 con 0x556eff82d590 2024-09-17T03:13:05.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.451+0000 7fe15ffe0740 10 client.7101 fetch_fsmap learned FSMap version 66 2024-09-17T03:13:05.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.451+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2280249842 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x556effcbae90 con 0x556eff82d590 2024-09-17T03:13:05.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.451+0000 7fe131ffb640 1 -- 172.21.15.78:0/2280249842 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe14c062ea0 con 0x556eff82d590 2024-09-17T03:13:05.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.451+0000 7fe131ffb640 1 -- 172.21.15.78:0/2280249842 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 66) ==== 3542+0+0 (secure 0 0 0) 0x7fe14c085400 con 0x556eff82d590 2024-09-17T03:13:05.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.451+0000 7fe15ffe0740 10 client.7101 fetch_fsmap finished waiting for FSMap version 66 2024-09-17T03:13:05.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.451+0000 7fe15ffe0740 10 client.7101 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:13:05.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.451+0000 7fe15ffe0740 20 client.7101 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:05.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.451+0000 7fe15ffe0740 1 --2- 172.21.15.78:0/2280249842 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x556eff7e2280 0x556effbf6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.451+0000 7fe15ffe0740 4 client.7101 mds_command: new command op to 6861 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:13:05.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.451+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2280249842 --> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] -- command(tid 0: {"prefix": "status"}) -- 0x556effb66220 con 0x556eff7e2280 2024-09-17T03:13:05.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.451+0000 7fe152d9d640 1 --2- 172.21.15.78:0/2280249842 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x556eff7e2280 0x556effbf6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.451+0000 7fe131ffb640 10 client.7101 ms_handle_connect on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:05.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.451+0000 7fe152d9d640 1 --2- 172.21.15.78:0/2280249842 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x556eff7e2280 0x556effbf6450 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6ef495e03b66acce server_cookie=fcc0467073a3c36a in_seq=0 out_seq=0 2024-09-17T03:13:05.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.452+0000 7fe131ffb640 1 -- 172.21.15.78:0/2280249842 <== mds.1 v2:172.21.15.78:6832/2905189397 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x556effb66220 con 0x556eff7e2280 2024-09-17T03:13:05.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.452+0000 7fe131ffb640 10 client.7101 handle_command_reply: tid=0 2024-09-17T03:13:05.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.452+0000 7fe15ffe0740 1 client.7101 shutdown 2024-09-17T03:13:05.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.452+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2280249842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff82d590 msgr2=0x556effcba460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.452+0000 7fe15ffe0740 1 --2- 172.21.15.78:0/2280249842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff82d590 0x556effcba460 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fe14c063320 tx=0x7fe14c0629d0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.452+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2280249842 shutdown_connections 2024-09-17T03:13:05.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.452+0000 7fe15ffe0740 1 --2- 172.21.15.78:0/2280249842 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x556eff7e2280 0x556effbf6450 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.452+0000 7fe15ffe0740 1 --2- 172.21.15.78:0/2280249842 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556eff82d590 0x556effcba460 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.452+0000 7fe15ffe0740 1 --2- 172.21.15.78:0/2280249842 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556eff8253b0 0x556effcb42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.452+0000 7fe131ffb640 0 client.7101 ms_handle_reset on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:05.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.452+0000 7fe15ffe0740 1 --2- 172.21.15.78:0/2280249842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556eff80ce40 0x556effcbe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.452+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2280249842 >> 172.21.15.78:0/2280249842 conn(0x556eff8423c0 msgr2=0x556effc33030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:05.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.452+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2280249842 shutdown_connections 2024-09-17T03:13:05.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.452+0000 7fe15ffe0740 1 -- 172.21.15.78:0/2280249842 wait complete. 2024-09-17T03:13:05.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.452+0000 7fe15ffe0740 20 client.7101 trim_cache size 0 max 16384 2024-09-17T03:13:05.458 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:13:05.458 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:13:05.459 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 1, 2024-09-17T03:13:05.459 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 6861, 2024-09-17T03:13:05.459 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:13:05.459 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:13:05.459 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:13:05.459 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 2.8476047480000002, 2024-09-17T03:13:05.459 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 66, 2024-09-17T03:13:05.459 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 69, 2024-09-17T03:13:05.459 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 69, 2024-09-17T03:13:05.459 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 18.575750241000001 2024-09-17T03:13:05.460 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:13:05.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.452+0000 7fe159077640 1 -- 172.21.15.78:0/557739524 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe134078b90 msgr2=0x7fe13407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.452+0000 7fe159077640 1 --2- 172.21.15.78:0/557739524 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe134078b90 0x7fe13407b0a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe14400bb50 tx=0x7fe14400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.452+0000 7fe159077640 1 -- 172.21.15.78:0/557739524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1540cc200 msgr2=0x7fe1541e7210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.452+0000 7fe159077640 1 --2- 172.21.15.78:0/557739524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1540cc200 0x7fe1541e7210 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fe14c00e960 tx=0x7fe14c00ee20 comp rx=0 tx=0).stop 2024-09-17T03:13:05.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.453+0000 7fe159077640 1 -- 172.21.15.78:0/557739524 shutdown_connections 2024-09-17T03:13:05.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.453+0000 7fe159077640 1 --2- 172.21.15.78:0/557739524 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1540cc200 0x7fe1541e7210 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.453+0000 7fe159077640 1 --2- 172.21.15.78:0/557739524 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe1540d3870 0x7fe1541e9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.453+0000 7fe159077640 1 --2- 172.21.15.78:0/557739524 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe134078b90 0x7fe13407b0a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.453+0000 7fe159077640 1 --2- 172.21.15.78:0/557739524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe15406f4b0 0x7fe1541e83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.453+0000 7fe159077640 1 -- 172.21.15.78:0/557739524 >> 172.21.15.78:0/557739524 conn(0x7fe15408bfc0 msgr2=0x7fe154161950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:05.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.453+0000 7fe159077640 1 -- 172.21.15.78:0/557739524 shutdown_connections 2024-09-17T03:13:05.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.453+0000 7fe159077640 1 -- 172.21.15.78:0/557739524 wait complete. 2024-09-17T03:13:05.462 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:13:05.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.577+0000 7f0255af2640 1 -- 172.21.15.78:0/3779432805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0238005250 msgr2=0x7f023800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.577+0000 7f0255af2640 1 --2- 172.21.15.78:0/3779432805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0238005250 0x7f023800b9c0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f0248001dc0 tx=0x7f0238005830 comp rx=0 tx=0).stop 2024-09-17T03:13:05.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.577+0000 7f0255af2640 1 -- 172.21.15.78:0/3779432805 shutdown_connections 2024-09-17T03:13:05.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.577+0000 7f0255af2640 1 --2- 172.21.15.78:0/3779432805 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0238005250 0x7f023800b9c0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.577+0000 7f0255af2640 1 -- 172.21.15.78:0/3779432805 >> 172.21.15.78:0/3779432805 conn(0x7f0250072ae0 msgr2=0x7f0250072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:05.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.577+0000 7f0255af2640 1 -- 172.21.15.78:0/3779432805 shutdown_connections 2024-09-17T03:13:05.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.577+0000 7f0255af2640 1 -- 172.21.15.78:0/3779432805 wait complete. 2024-09-17T03:13:05.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.579+0000 7f0255af2640 1 Processor -- start 2024-09-17T03:13:05.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.579+0000 7f0255af2640 1 -- start start 2024-09-17T03:13:05.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.580+0000 7f0255af2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0238005250 0x7f02500b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.580+0000 7f0255af2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f025006f570 0x7f025014e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.580+0000 7f0255af2640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f025014e7e0 0x7f02501f8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.580+0000 7f0255af2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f02500d1a60 con 0x7f025006f570 2024-09-17T03:13:05.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.580+0000 7f0255af2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f02500d18e0 con 0x7f0238005250 2024-09-17T03:13:05.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.580+0000 7f0255af2640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f02500d1100 con 0x7f025014e7e0 2024-09-17T03:13:05.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.580+0000 7f024effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f025006f570 0x7f025014e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.580+0000 7f024effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f025006f570 0x7f025014e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45950/0 (socket says 172.21.15.78:45950) 2024-09-17T03:13:05.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.580+0000 7f024effd640 1 -- 172.21.15.78:0/2248986466 learned_addr learned my addr 172.21.15.78:0/2248986466 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:05.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.581+0000 7f024effd640 1 -- 172.21.15.78:0/2248986466 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f025014e7e0 msgr2=0x7f02501f8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.581+0000 7f024effd640 1 --2- 172.21.15.78:0/2248986466 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f025014e7e0 0x7f02501f8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.581+0000 7f024effd640 1 -- 172.21.15.78:0/2248986466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0238005250 msgr2=0x7f02500b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.581+0000 7f024f7fe640 1 --2- 172.21.15.78:0/2248986466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0238005250 0x7f02500b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.581+0000 7f024effd640 1 --2- 172.21.15.78:0/2248986466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0238005250 0x7f02500b13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.581+0000 7f024effd640 1 -- 172.21.15.78:0/2248986466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02500b1910 con 0x7f025006f570 2024-09-17T03:13:05.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.581+0000 7f024effd640 1 --2- 172.21.15.78:0/2248986466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f025006f570 0x7f025014e2a0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f0244011ab0 tx=0x7f0244011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:05.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.581+0000 7f0237fff640 1 -- 172.21.15.78:0/2248986466 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024401e070 con 0x7f025006f570 2024-09-17T03:13:05.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.581+0000 7f0237fff640 1 -- 172.21.15.78:0/2248986466 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f024400fe70 con 0x7f025006f570 2024-09-17T03:13:05.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.581+0000 7f0255af2640 1 -- 172.21.15.78:0/2248986466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f025015a660 con 0x7f025006f570 2024-09-17T03:13:05.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.581+0000 7f0237fff640 1 -- 172.21.15.78:0/2248986466 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02440042b0 con 0x7f025006f570 2024-09-17T03:13:05.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.581+0000 7f0255af2640 1 -- 172.21.15.78:0/2248986466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f025006e7b0 con 0x7f025006f570 2024-09-17T03:13:05.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.583+0000 7f0237fff640 1 -- 172.21.15.78:0/2248986466 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0244021070 con 0x7f025006f570 2024-09-17T03:13:05.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.583+0000 7f0237fff640 1 --2- 172.21.15.78:0/2248986466 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f023c078b90 0x7f023c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.584+0000 7f0237fff640 1 -- 172.21.15.78:0/2248986466 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f024409b7c0 con 0x7f025006f570 2024-09-17T03:13:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.584+0000 7f024f7fe640 1 --2- 172.21.15.78:0/2248986466 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f023c078b90 0x7f023c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.584+0000 7f024f7fe640 1 --2- 172.21.15.78:0/2248986466 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f023c078b90 0x7f023c07b0a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0240001850 tx=0x7f0240006720 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.584+0000 7f025ca5e740 1 Processor -- start 2024-09-17T03:13:05.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.584+0000 7f025ca5e740 1 -- start start 2024-09-17T03:13:05.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.586+0000 7f025ca5e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a625973270 0x55a625d44fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.586+0000 7f025ca5e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a62594a3b0 0x55a625d45500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.586+0000 7f025ca5e740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a625952590 0x55a625d62400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.586+0000 7f025ca5e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a625c8d820 con 0x55a62594a3b0 2024-09-17T03:13:05.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.586+0000 7f025ca5e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a625c7cc50 con 0x55a625973270 2024-09-17T03:13:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.586+0000 7f025ca5e740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a625c80a60 con 0x55a625952590 2024-09-17T03:13:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.586+0000 7f024effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a62594a3b0 0x55a625d45500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.586+0000 7f024effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a62594a3b0 0x55a625d45500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45958/0 (socket says 172.21.15.78:45958) 2024-09-17T03:13:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.586+0000 7f024effd640 1 -- 172.21.15.78:0/2325549209 learned_addr learned my addr 172.21.15.78:0/2325549209 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.586+0000 7f024f7fe640 1 --2- 172.21.15.78:0/2325549209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a625973270 0x55a625d44fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.586+0000 7f024effd640 1 -- 172.21.15.78:0/2325549209 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a625952590 msgr2=0x55a625d62400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.586+0000 7f024ffff640 1 --2- 172.21.15.78:0/2325549209 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a625952590 0x55a625d62400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.586+0000 7f024effd640 1 --2- 172.21.15.78:0/2325549209 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a625952590 0x55a625d62400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.586+0000 7f024effd640 1 -- 172.21.15.78:0/2325549209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a625973270 msgr2=0x55a625d44fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.586+0000 7f024effd640 1 --2- 172.21.15.78:0/2325549209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a625973270 0x55a625d44fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.586+0000 7f024effd640 1 -- 172.21.15.78:0/2325549209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6259de850 con 0x55a62594a3b0 2024-09-17T03:13:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.586+0000 7f024effd640 1 --2- 172.21.15.78:0/2325549209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a62594a3b0 0x55a625d45500 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f0244099c60 tx=0x7f024405f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821ca7cdc628fae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.587+0000 7f02357fa640 1 -- 172.21.15.78:0/2325549209 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244089070 con 0x55a62594a3b0 2024-09-17T03:13:05.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.587+0000 7f02357fa640 1 -- 172.21.15.78:0/2325549209 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f024406cf20 con 0x55a62594a3b0 2024-09-17T03:13:05.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.587+0000 7f02357fa640 1 -- 172.21.15.78:0/2325549209 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244062810 con 0x55a62594a3b0 2024-09-17T03:13:05.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.587+0000 7f025ca5e740 1 -- 172.21.15.78:0/2325549209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a62594a3b0 msgr2=0x55a625d45500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.587+0000 7f025ca5e740 1 --2- 172.21.15.78:0/2325549209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a62594a3b0 0x55a625d45500 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f0244099c60 tx=0x7f024405f580 comp rx=0 tx=0).stop 2024-09-17T03:13:05.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.588+0000 7f025ca5e740 1 -- 172.21.15.78:0/2325549209 shutdown_connections 2024-09-17T03:13:05.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.588+0000 7f025ca5e740 1 --2- 172.21.15.78:0/2325549209 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a625952590 0x55a625d62400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.588+0000 7f025ca5e740 1 --2- 172.21.15.78:0/2325549209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a62594a3b0 0x55a625d45500 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.588+0000 7f025ca5e740 1 --2- 172.21.15.78:0/2325549209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a625973270 0x55a625d44fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.588+0000 7f025ca5e740 1 -- 172.21.15.78:0/2325549209 >> 172.21.15.78:0/2325549209 conn(0x55a6259673c0 msgr2=0x55a625d1b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:05.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.588+0000 7f025ca5e740 1 -- 172.21.15.78:0/2325549209 shutdown_connections 2024-09-17T03:13:05.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.588+0000 7f025ca5e740 1 -- 172.21.15.78:0/2325549209 wait complete. 2024-09-17T03:13:05.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.588+0000 7f025ca5e740 1 -- start start 2024-09-17T03:13:05.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.588+0000 7f025ca5e740 1 Processor -- start 2024-09-17T03:13:05.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f025ca5e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a62594a3b0 0x55a625d327d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f025ca5e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a625952590 0x55a625d5a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f025ca5e740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a625973270 0x55a625d58010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f025ca5e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a6259ed620 con 0x55a62594a3b0 2024-09-17T03:13:05.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f025ca5e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a625c225f0 con 0x55a625952590 2024-09-17T03:13:05.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f025ca5e740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a625d45a40 con 0x55a625973270 2024-09-17T03:13:05.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f025ca5e740 10 client.0 _ll_register_callbacks cb 0x55a625c260a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:05.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f024f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a62594a3b0 0x55a625d327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f024f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a62594a3b0 0x55a625d327d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45970/0 (socket says 172.21.15.78:45970) 2024-09-17T03:13:05.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f024f7fe640 1 -- 172.21.15.78:0/1746371784 learned_addr learned my addr 172.21.15.78:0/1746371784 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:05.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f024ffff640 1 --2- 172.21.15.78:0/1746371784 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a625973270 0x55a625d58010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f024effd640 1 --2- 172.21.15.78:0/1746371784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a625952590 0x55a625d5a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f024f7fe640 1 -- 172.21.15.78:0/1746371784 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a625973270 msgr2=0x55a625d58010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f024f7fe640 1 --2- 172.21.15.78:0/1746371784 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a625973270 0x55a625d58010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f024f7fe640 1 -- 172.21.15.78:0/1746371784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a625952590 msgr2=0x55a625d5a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f024f7fe640 1 --2- 172.21.15.78:0/1746371784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a625952590 0x55a625d5a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f024f7fe640 1 -- 172.21.15.78:0/1746371784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a625a556b0 con 0x55a62594a3b0 2024-09-17T03:13:05.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f024f7fe640 1 --2- 172.21.15.78:0/1746371784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a62594a3b0 0x55a625d327d0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f0240003a40 tx=0x7f02500d2cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1c8816a3e4922b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:05.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f022e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:05.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f022e7fc640 1 -- 172.21.15.78:0/1746371784 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240016070 con 0x55a62594a3b0 2024-09-17T03:13:05.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.590+0000 7f022e7fc640 1 -- 172.21.15.78:0/1746371784 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f0240012a10 con 0x55a62594a3b0 2024-09-17T03:13:05.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.591+0000 7f025ca5e740 1 -- 172.21.15.78:0/1746371784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f024406cf20 con 0x55a62594a3b0 2024-09-17T03:13:05.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.591+0000 7f022e7fc640 1 -- 172.21.15.78:0/1746371784 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f024002d050 con 0x55a62594a3b0 2024-09-17T03:13:05.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.591+0000 7f025ca5e740 10 client.7113 fetch_fsmap learned FSMap version 66 2024-09-17T03:13:05.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.591+0000 7f025ca5e740 1 -- 172.21.15.78:0/1746371784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x55a625d5aaa0 con 0x55a62594a3b0 2024-09-17T03:13:05.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.591+0000 7f022e7fc640 1 -- 172.21.15.78:0/1746371784 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f024406cf20 con 0x55a62594a3b0 2024-09-17T03:13:05.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.591+0000 7f022e7fc640 1 -- 172.21.15.78:0/1746371784 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 66) ==== 3542+0+0 (secure 0 0 0) 0x7f0240030020 con 0x55a62594a3b0 2024-09-17T03:13:05.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.591+0000 7f025ca5e740 10 client.7113 fetch_fsmap finished waiting for FSMap version 66 2024-09-17T03:13:05.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.591+0000 7f025ca5e740 10 client.7113 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:13:05.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.591+0000 7f025ca5e740 20 client.7113 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:05.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.591+0000 7f025ca5e740 1 --2- 172.21.15.78:0/1746371784 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55a625931e40 0x55a625d6f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.591+0000 7f025ca5e740 4 client.7113 mds_command: new command op to 6864 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:13:05.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.591+0000 7f025ca5e740 1 -- 172.21.15.78:0/1746371784 --> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a625c8f770 con 0x55a625931e40 2024-09-17T03:13:05.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.591+0000 7f024effd640 1 --2- 172.21.15.78:0/1746371784 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55a625931e40 0x55a625d6f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.591+0000 7f022e7fc640 10 client.7113 ms_handle_connect on v2:172.21.15.78:6833/2058899730 2024-09-17T03:13:05.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.591+0000 7f024effd640 1 --2- 172.21.15.78:0/1746371784 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55a625931e40 0x55a625d6f520 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83c1dead4aff37b3 server_cookie=97e02b1a1cdd2ad8 in_seq=0 out_seq=0 2024-09-17T03:13:05.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.592+0000 7f022e7fc640 1 -- 172.21.15.78:0/1746371784 <== mds.0 v2:172.21.15.78:6833/2058899730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a625c8f770 con 0x55a625931e40 2024-09-17T03:13:05.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.592+0000 7f022e7fc640 10 client.7113 handle_command_reply: tid=0 2024-09-17T03:13:05.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.592+0000 7f025ca5e740 1 client.7113 shutdown 2024-09-17T03:13:05.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.592+0000 7f025ca5e740 1 -- 172.21.15.78:0/1746371784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a62594a3b0 msgr2=0x55a625d327d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.592+0000 7f025ca5e740 1 --2- 172.21.15.78:0/1746371784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a62594a3b0 0x55a625d327d0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f0240003a40 tx=0x7f02500d2cf0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.592+0000 7f025ca5e740 1 -- 172.21.15.78:0/1746371784 shutdown_connections 2024-09-17T03:13:05.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.592+0000 7f025ca5e740 1 --2- 172.21.15.78:0/1746371784 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55a625931e40 0x55a625d6f520 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.592+0000 7f025ca5e740 1 --2- 172.21.15.78:0/1746371784 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a625973270 0x55a625d58010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.592+0000 7f022e7fc640 0 client.7113 ms_handle_reset on v2:172.21.15.78:6833/2058899730 2024-09-17T03:13:05.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.592+0000 7f025ca5e740 1 --2- 172.21.15.78:0/1746371784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a625952590 0x55a625d5a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.592+0000 7f025ca5e740 1 --2- 172.21.15.78:0/1746371784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a62594a3b0 0x55a625d327d0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.592+0000 7f025ca5e740 1 -- 172.21.15.78:0/1746371784 >> 172.21.15.78:0/1746371784 conn(0x55a6259673c0 msgr2=0x55a625d15b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:05.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.592+0000 7f025ca5e740 1 -- 172.21.15.78:0/1746371784 shutdown_connections 2024-09-17T03:13:05.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.592+0000 7f025ca5e740 1 -- 172.21.15.78:0/1746371784 wait complete. 2024-09-17T03:13:05.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.592+0000 7f025ca5e740 20 client.7113 trim_cache size 0 max 16384 2024-09-17T03:13:05.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.611+0000 7f025ca5e740 1 Processor -- start 2024-09-17T03:13:05.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.611+0000 7f025ca5e740 1 -- start start 2024-09-17T03:13:05.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.612+0000 7f025ca5e740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a62594a3b0 0x55a625d1b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.612+0000 7f025ca5e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a625952590 0x55a625d81e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.612+0000 7f025ca5e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a625973270 0x55a625d82370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.612+0000 7f025ca5e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0250201b90 con 0x55a625973270 2024-09-17T03:13:05.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.612+0000 7f025ca5e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0250202260 con 0x55a625952590 2024-09-17T03:13:05.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.612+0000 7f025ca5e740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0250151140 con 0x55a62594a3b0 2024-09-17T03:13:05.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.612+0000 7f024ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a625973270 0x55a625d82370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.612+0000 7f024ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a625973270 0x55a625d82370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45984/0 (socket says 172.21.15.78:45984) 2024-09-17T03:13:05.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.612+0000 7f024ffff640 1 -- 172.21.15.78:0/547219651 learned_addr learned my addr 172.21.15.78:0/547219651 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:05.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.612+0000 7f024effd640 1 --2- 172.21.15.78:0/547219651 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a625952590 0x55a625d81e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.612+0000 7f024f7fe640 1 --2- 172.21.15.78:0/547219651 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a62594a3b0 0x55a625d1b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.613+0000 7f024ffff640 1 -- 172.21.15.78:0/547219651 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a62594a3b0 msgr2=0x55a625d1b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.613+0000 7f024ffff640 1 --2- 172.21.15.78:0/547219651 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a62594a3b0 0x55a625d1b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.613+0000 7f024ffff640 1 -- 172.21.15.78:0/547219651 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a625952590 msgr2=0x55a625d81e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.613+0000 7f024ffff640 1 --2- 172.21.15.78:0/547219651 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a625952590 0x55a625d81e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.613+0000 7f024ffff640 1 -- 172.21.15.78:0/547219651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a625d32710 con 0x55a625973270 2024-09-17T03:13:05.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.613+0000 7f024ffff640 1 --2- 172.21.15.78:0/547219651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a625973270 0x55a625d82370 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f0248001b30 tx=0x7f0248003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b322191e3ab8a341 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:05.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.613+0000 7f0234ff9640 1 -- 172.21.15.78:0/547219651 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248003d10 con 0x55a625973270 2024-09-17T03:13:05.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.613+0000 7f0234ff9640 1 -- 172.21.15.78:0/547219651 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0248006170 con 0x55a625973270 2024-09-17T03:13:05.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.613+0000 7f0234ff9640 1 -- 172.21.15.78:0/547219651 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0248006520 con 0x55a625973270 2024-09-17T03:13:05.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.614+0000 7f025ca5e740 1 -- 172.21.15.78:0/547219651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a625973270 msgr2=0x55a625d82370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.614+0000 7f025ca5e740 1 --2- 172.21.15.78:0/547219651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a625973270 0x55a625d82370 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f0248001b30 tx=0x7f0248003970 comp rx=0 tx=0).stop 2024-09-17T03:13:05.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.614+0000 7f025ca5e740 1 -- 172.21.15.78:0/547219651 shutdown_connections 2024-09-17T03:13:05.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.614+0000 7f025ca5e740 1 --2- 172.21.15.78:0/547219651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a625973270 0x55a625d82370 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.614+0000 7f025ca5e740 1 --2- 172.21.15.78:0/547219651 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a625952590 0x55a625d81e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.614+0000 7f025ca5e740 1 --2- 172.21.15.78:0/547219651 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a62594a3b0 0x55a625d1b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.614+0000 7f025ca5e740 1 -- 172.21.15.78:0/547219651 >> 172.21.15.78:0/547219651 conn(0x55a6259673c0 msgr2=0x55a625d14550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:05.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.614+0000 7f025ca5e740 1 -- 172.21.15.78:0/547219651 shutdown_connections 2024-09-17T03:13:05.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.614+0000 7f025ca5e740 1 -- 172.21.15.78:0/547219651 wait complete. 2024-09-17T03:13:05.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.615+0000 7f025ca5e740 1 -- start start 2024-09-17T03:13:05.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.615+0000 7f025ca5e740 1 Processor -- start 2024-09-17T03:13:05.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.616+0000 7f025ca5e740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a62594a3b0 0x55a625d73aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.616+0000 7f025ca5e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a625952590 0x55a625dddef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.616+0000 7f025ca5e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a625973270 0x55a625d71bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.616+0000 7f025ca5e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a625d333f0 con 0x55a625973270 2024-09-17T03:13:05.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.616+0000 7f025ca5e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a625d58550 con 0x55a625952590 2024-09-17T03:13:05.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.616+0000 7f025ca5e740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a625d72a90 con 0x55a62594a3b0 2024-09-17T03:13:05.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.616+0000 7f025ca5e740 10 client.0 _ll_register_callbacks cb 0x7f02400036c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:05.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.616+0000 7f024ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a625973270 0x55a625d71bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.616+0000 7f024ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a625973270 0x55a625d71bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45988/0 (socket says 172.21.15.78:45988) 2024-09-17T03:13:05.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.616+0000 7f024ffff640 1 -- 172.21.15.78:0/2564305917 learned_addr learned my addr 172.21.15.78:0/2564305917 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:05.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.616+0000 7f024ffff640 1 -- 172.21.15.78:0/2564305917 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a62594a3b0 msgr2=0x55a625d73aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.616+0000 7f024ffff640 1 --2- 172.21.15.78:0/2564305917 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a62594a3b0 0x55a625d73aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f024effd640 1 --2- 172.21.15.78:0/2564305917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a625952590 0x55a625dddef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f024ffff640 1 -- 172.21.15.78:0/2564305917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a625952590 msgr2=0x55a625dddef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:05.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f024ffff640 1 --2- 172.21.15.78:0/2564305917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a625952590 0x55a625dddef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f024ffff640 1 -- 172.21.15.78:0/2564305917 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a625de1590 con 0x55a625973270 2024-09-17T03:13:05.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f024ffff640 1 --2- 172.21.15.78:0/2564305917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a625973270 0x55a625d71bf0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f0248001370 tx=0x7f02480063b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0131134c7542c2f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:05.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f022e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:05.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f022e7fc640 1 -- 172.21.15.78:0/2564305917 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02480065e0 con 0x55a625973270 2024-09-17T03:13:05.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f022e7fc640 1 -- 172.21.15.78:0/2564305917 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f0248006780 con 0x55a625973270 2024-09-17T03:13:05.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f025ca5e740 1 -- 172.21.15.78:0/2564305917 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0248006170 con 0x55a625973270 2024-09-17T03:13:05.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f022e7fc640 1 -- 172.21.15.78:0/2564305917 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f0248032470 con 0x55a625973270 2024-09-17T03:13:05.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f025ca5e740 10 client.7119 fetch_fsmap learned FSMap version 66 2024-09-17T03:13:05.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f025ca5e740 1 -- 172.21.15.78:0/2564305917 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) -- 0x55a625d57530 con 0x55a625973270 2024-09-17T03:13:05.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f022e7fc640 1 -- 172.21.15.78:0/2564305917 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0248006170 con 0x55a625973270 2024-09-17T03:13:05.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f022e7fc640 1 -- 172.21.15.78:0/2564305917 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 66) ==== 3542+0+0 (secure 0 0 0) 0x7f0248032610 con 0x55a625973270 2024-09-17T03:13:05.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f025ca5e740 10 client.7119 fetch_fsmap finished waiting for FSMap version 66 2024-09-17T03:13:05.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f025ca5e740 10 client.7119 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:13:05.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f025ca5e740 20 client.7119 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:05.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f025ca5e740 1 --2- 172.21.15.78:0/2564305917 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55a625d82370 0x55a625d82780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f025ca5e740 4 client.7119 mds_command: new command op to 6864 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:13:05.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f025ca5e740 1 -- 172.21.15.78:0/2564305917 --> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] -- command(tid 0: {"prefix": "status"}) -- 0x55a625c8b220 con 0x55a625d82370 2024-09-17T03:13:05.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.617+0000 7f024f7fe640 1 --2- 172.21.15.78:0/2564305917 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55a625d82370 0x55a625d82780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.618+0000 7f022e7fc640 10 client.7119 ms_handle_connect on v2:172.21.15.78:6833/2058899730 2024-09-17T03:13:05.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.618+0000 7f024f7fe640 1 --2- 172.21.15.78:0/2564305917 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55a625d82370 0x55a625d82780 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64f1216311caff67 server_cookie=86378fec3ab7b36f in_seq=0 out_seq=0 2024-09-17T03:13:05.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.618+0000 7f022e7fc640 1 -- 172.21.15.78:0/2564305917 <== mds.0 v2:172.21.15.78:6833/2058899730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55a625c8b220 con 0x55a625d82370 2024-09-17T03:13:05.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.618+0000 7f022e7fc640 10 client.7119 handle_command_reply: tid=0 2024-09-17T03:13:05.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.618+0000 7f025ca5e740 1 client.7119 shutdown 2024-09-17T03:13:05.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.618+0000 7f025ca5e740 1 -- 172.21.15.78:0/2564305917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a625973270 msgr2=0x55a625d71bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.618+0000 7f025ca5e740 1 --2- 172.21.15.78:0/2564305917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a625973270 0x55a625d71bf0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f0248001370 tx=0x7f02480063b0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.618+0000 7f025ca5e740 1 -- 172.21.15.78:0/2564305917 shutdown_connections 2024-09-17T03:13:05.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.618+0000 7f025ca5e740 1 --2- 172.21.15.78:0/2564305917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a625973270 0x55a625d71bf0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.618+0000 7f025ca5e740 1 --2- 172.21.15.78:0/2564305917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a625952590 0x55a625dddef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.618+0000 7f025ca5e740 1 --2- 172.21.15.78:0/2564305917 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55a625d82370 0x55a625d82780 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.618+0000 7f025ca5e740 1 --2- 172.21.15.78:0/2564305917 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a62594a3b0 0x55a625d73aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.618+0000 7f022e7fc640 0 client.7119 ms_handle_reset on v2:172.21.15.78:6833/2058899730 2024-09-17T03:13:05.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.618+0000 7f025ca5e740 1 -- 172.21.15.78:0/2564305917 >> 172.21.15.78:0/2564305917 conn(0x55a6259673c0 msgr2=0x55a625d14550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:05.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.618+0000 7f025ca5e740 1 -- 172.21.15.78:0/2564305917 shutdown_connections 2024-09-17T03:13:05.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.618+0000 7f025ca5e740 1 -- 172.21.15.78:0/2564305917 wait complete. 2024-09-17T03:13:05.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.618+0000 7f025ca5e740 20 client.7119 trim_cache size 0 max 16384 2024-09-17T03:13:05.622 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:13:05.623 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:13:05.623 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-09-17T03:13:05.623 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 6864, 2024-09-17T03:13:05.623 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:13:05.623 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:13:05.623 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:13:05.623 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 14.062962413999999, 2024-09-17T03:13:05.623 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 66, 2024-09-17T03:13:05.623 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 69, 2024-09-17T03:13:05.623 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 69, 2024-09-17T03:13:05.623 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 18.741528303999999 2024-09-17T03:13:05.623 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:13:05.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.619+0000 7f0255af2640 1 -- 172.21.15.78:0/2248986466 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f023c078b90 msgr2=0x7f023c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.619+0000 7f0255af2640 1 --2- 172.21.15.78:0/2248986466 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f023c078b90 0x7f023c07b0a0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f0240001850 tx=0x7f0240006720 comp rx=0 tx=0).stop 2024-09-17T03:13:05.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.619+0000 7f0255af2640 1 -- 172.21.15.78:0/2248986466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f025006f570 msgr2=0x7f025014e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.619+0000 7f0255af2640 1 --2- 172.21.15.78:0/2248986466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f025006f570 0x7f025014e2a0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f0244011ab0 tx=0x7f0244011f70 comp rx=0 tx=0).stop 2024-09-17T03:13:05.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.619+0000 7f0255af2640 1 -- 172.21.15.78:0/2248986466 shutdown_connections 2024-09-17T03:13:05.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.619+0000 7f0255af2640 1 --2- 172.21.15.78:0/2248986466 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f025014e7e0 0x7f02501f8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.619+0000 7f0255af2640 1 --2- 172.21.15.78:0/2248986466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f025006f570 0x7f025014e2a0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.619+0000 7f0255af2640 1 --2- 172.21.15.78:0/2248986466 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f023c078b90 0x7f023c07b0a0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.619+0000 7f0255af2640 1 --2- 172.21.15.78:0/2248986466 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0238005250 0x7f02500b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.619+0000 7f0255af2640 1 -- 172.21.15.78:0/2248986466 >> 172.21.15.78:0/2248986466 conn(0x7f0250072ae0 msgr2=0x7f02500b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:05.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.619+0000 7f0255af2640 1 -- 172.21.15.78:0/2248986466 shutdown_connections 2024-09-17T03:13:05.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.619+0000 7f0255af2640 1 -- 172.21.15.78:0/2248986466 wait complete. 2024-09-17T03:13:05.630 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:13:05.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.742+0000 7feb23d57640 1 -- 172.21.15.78:0/3495022600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb1c0cf7a0 msgr2=0x7feb1c169a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.742+0000 7feb23d57640 1 --2- 172.21.15.78:0/3495022600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb1c0cf7a0 0x7feb1c169a10 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7feb14009830 tx=0x7feb1402a5c0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.742+0000 7feb23d57640 1 -- 172.21.15.78:0/3495022600 shutdown_connections 2024-09-17T03:13:05.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.742+0000 7feb23d57640 1 --2- 172.21.15.78:0/3495022600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb1c0cf7a0 0x7feb1c169a10 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.742+0000 7feb23d57640 1 -- 172.21.15.78:0/3495022600 >> 172.21.15.78:0/3495022600 conn(0x7feb1c08bfc0 msgr2=0x7feb1c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:05.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.742+0000 7feb23d57640 1 -- 172.21.15.78:0/3495022600 shutdown_connections 2024-09-17T03:13:05.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.742+0000 7feb23d57640 1 -- 172.21.15.78:0/3495022600 wait complete. 2024-09-17T03:13:05.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.744+0000 7feb23d57640 1 Processor -- start 2024-09-17T03:13:05.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.744+0000 7feb23d57640 1 -- start start 2024-09-17T03:13:05.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.745+0000 7feb23d57640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb1c0cf7a0 0x7feb1c15c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.745+0000 7feb23d57640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb1c0d1a80 0x7feb1c15cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.745+0000 7feb23d57640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb1c0d2ed0 0x7feb1c1618a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.745+0000 7feb23d57640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feb1c16a0d0 con 0x7feb1c0d2ed0 2024-09-17T03:13:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.745+0000 7feb23d57640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7feb1c169f50 con 0x7feb1c0cf7a0 2024-09-17T03:13:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.745+0000 7feb23d57640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7feb1c16a250 con 0x7feb1c0d1a80 2024-09-17T03:13:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.745+0000 7feb222f4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb1c0d2ed0 0x7feb1c1618a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.745+0000 7feb222f4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb1c0d2ed0 0x7feb1c1618a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:46002/0 (socket says 172.21.15.78:46002) 2024-09-17T03:13:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.745+0000 7feb222f4640 1 -- 172.21.15.78:0/945460164 learned_addr learned my addr 172.21.15.78:0/945460164 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:05.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.745+0000 7feb21af3640 1 --2- 172.21.15.78:0/945460164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb1c0cf7a0 0x7feb1c15c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.745+0000 7feb212f2640 1 --2- 172.21.15.78:0/945460164 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb1c0d1a80 0x7feb1c15cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.745+0000 7feb222f4640 1 -- 172.21.15.78:0/945460164 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb1c0d1a80 msgr2=0x7feb1c15cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.745+0000 7feb222f4640 1 --2- 172.21.15.78:0/945460164 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb1c0d1a80 0x7feb1c15cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.745+0000 7feb222f4640 1 -- 172.21.15.78:0/945460164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb1c0cf7a0 msgr2=0x7feb1c15c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.745+0000 7feb222f4640 1 --2- 172.21.15.78:0/945460164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb1c0cf7a0 0x7feb1c15c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.745+0000 7feb222f4640 1 -- 172.21.15.78:0/945460164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb1c161260 con 0x7feb1c0d2ed0 2024-09-17T03:13:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.746+0000 7feb222f4640 1 --2- 172.21.15.78:0/945460164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb1c0d2ed0 0x7feb1c1618a0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7feb14009920 tx=0x7feb14033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.746+0000 7feb127fc640 1 -- 172.21.15.78:0/945460164 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14005c90 con 0x7feb1c0d2ed0 2024-09-17T03:13:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.746+0000 7feb127fc640 1 -- 172.21.15.78:0/945460164 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb14031e50 con 0x7feb1c0d2ed0 2024-09-17T03:13:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.746+0000 7feb23d57640 1 -- 172.21.15.78:0/945460164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb1c0a2150 con 0x7feb1c0d2ed0 2024-09-17T03:13:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.746+0000 7feb127fc640 1 -- 172.21.15.78:0/945460164 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14005260 con 0x7feb1c0d2ed0 2024-09-17T03:13:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.746+0000 7feb23d57640 1 -- 172.21.15.78:0/945460164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb1c0cc030 con 0x7feb1c0d2ed0 2024-09-17T03:13:05.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.747+0000 7feb23d57640 1 -- 172.21.15.78:0/945460164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb1c0cf090 con 0x7feb1c0d2ed0 2024-09-17T03:13:05.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.748+0000 7feb127fc640 1 -- 172.21.15.78:0/945460164 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feb14005400 con 0x7feb1c0d2ed0 2024-09-17T03:13:05.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.748+0000 7feb127fc640 1 --2- 172.21.15.78:0/945460164 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feb00078b90 0x7feb0007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:05.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.749+0000 7feb127fc640 1 -- 172.21.15.78:0/945460164 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7feb140bbdd0 con 0x7feb1c0d2ed0 2024-09-17T03:13:05.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.749+0000 7feb21af3640 1 --2- 172.21.15.78:0/945460164 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feb00078b90 0x7feb0007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:05.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.749+0000 7feb21af3640 1 --2- 172.21.15.78:0/945460164 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feb00078b90 0x7feb0007b0a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7feb18001d10 tx=0x7feb18009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:05.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.753+0000 7feb127fc640 1 -- 172.21.15.78:0/945460164 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feb1403f030 con 0x7feb1c0d2ed0 2024-09-17T03:13:05.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.964+0000 7feb23d57640 1 -- 172.21.15.78:0/945460164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feb1c0b1190 con 0x7feb1c0d2ed0 2024-09-17T03:13:05.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.965+0000 7feb127fc640 1 -- 172.21.15.78:0/945460164 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5269 (secure 0 0 0) 0x7feb140bd090 con 0x7feb1c0d2ed0 2024-09-17T03:13:05.964 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:05.964 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":66,"btime":"2024-09-17T03:13:04:617892+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5873,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/3831026382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3831026382},{"type":"v1","addr":"172.21.15.193:6836","nonce":3831026382}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:12:50.905684+0000","modified":"2024-09-17T03:13:04.617885+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6864,"mds_1":6861,"mds_2":6271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6271":{"gid":6271,"name":"d","rank":2,"incarnation":65,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6837/1431701139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1431701139},{"type":"v1","addr":"172.21.15.193:6837","nonce":1431701139}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6861":{"gid":6861,"name":"c","rank":1,"incarnation":63,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6834/2905189397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2905189397},{"type":"v1","addr":"172.21.15.78:6834","nonce":2905189397}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6864":{"gid":6864,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/2058899730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2058899730},{"type":"v1","addr":"172.21.15.78:6835","nonce":2058899730}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6864,"qdb_cluster":[6271,6861,6864]},"id":5}]} 2024-09-17T03:13:05.964 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 66 2024-09-17T03:13:05.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.967+0000 7feb23d57640 1 -- 172.21.15.78:0/945460164 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feb00078b90 msgr2=0x7feb0007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.967+0000 7feb23d57640 1 --2- 172.21.15.78:0/945460164 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feb00078b90 0x7feb0007b0a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7feb18001d10 tx=0x7feb18009040 comp rx=0 tx=0).stop 2024-09-17T03:13:05.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.967+0000 7feb23d57640 1 -- 172.21.15.78:0/945460164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb1c0d2ed0 msgr2=0x7feb1c1618a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:05.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.967+0000 7feb23d57640 1 --2- 172.21.15.78:0/945460164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb1c0d2ed0 0x7feb1c1618a0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7feb14009920 tx=0x7feb14033c20 comp rx=0 tx=0).stop 2024-09-17T03:13:05.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.967+0000 7feb23d57640 1 -- 172.21.15.78:0/945460164 shutdown_connections 2024-09-17T03:13:05.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.967+0000 7feb23d57640 1 --2- 172.21.15.78:0/945460164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb1c0d2ed0 0x7feb1c1618a0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.967+0000 7feb23d57640 1 --2- 172.21.15.78:0/945460164 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb1c0d1a80 0x7feb1c15cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.967+0000 7feb23d57640 1 --2- 172.21.15.78:0/945460164 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feb00078b90 0x7feb0007b0a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.967+0000 7feb23d57640 1 --2- 172.21.15.78:0/945460164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb1c0cf7a0 0x7feb1c15c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:05.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.967+0000 7feb23d57640 1 -- 172.21.15.78:0/945460164 >> 172.21.15.78:0/945460164 conn(0x7feb1c08bfc0 msgr2=0x7feb1c0b1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:05.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.967+0000 7feb23d57640 1 -- 172.21.15.78:0/945460164 shutdown_connections 2024-09-17T03:13:05.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:05.967+0000 7feb23d57640 1 -- 172.21.15.78:0/945460164 wait complete. 2024-09-17T03:13:05.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:05.977 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-17T03:13:06.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:06.001 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-17T03:13:06.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:06.066 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2024-09-17T03:13:06.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:06.123 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2024-09-17T03:13:06.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:06.179 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2024-09-17T03:13:06.235 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:13:06.398 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:13:06.399 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:13:06.399 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:13:08.400 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:13:08.546 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:13:08.547 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:13:08.547 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:13:10.548 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:13:10.683 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:13:10.683 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:13:10.683 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:13:12.684 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:13:12.819 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2024-09-17T03:13:12.820 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-17T03:13:12.820 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:13:12.820 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:13:12.943 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2024-09-17T03:13:12.944 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-17T03:13:12.944 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:13:14.946 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:13:15.083 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2024-09-17T03:13:15.084 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-17T03:13:15.084 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:13:17.085 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:13:17.219 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}}] 2024-09-17T03:13:17.220 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-17T03:13:17.220 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:13:19.222 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:13:19.356 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2024-09-17T03:13:19.356 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-17T03:13:19.357 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:13:19.357 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-17T03:13:19.492 INFO:teuthology.orchestra.run.smithi193.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}}] 2024-09-17T03:13:19.493 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-17T03:13:19.493 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:13:19.493 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 flush journal 2024-09-17T03:13:19.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.610+0000 7f252edc6640 1 -- 172.21.15.78:0/715592889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2518003a00 msgr2=0x7f2518003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.610+0000 7f252edc6640 1 --2- 172.21.15.78:0/715592889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2518003a00 0x7f2518003e70 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f251c00c2e0 tx=0x7f2518005830 comp rx=0 tx=0).stop 2024-09-17T03:13:19.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.610+0000 7f252d363640 1 -- 172.21.15.78:0/715592889 reap_dead start 2024-09-17T03:13:19.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.610+0000 7f252edc6640 1 -- 172.21.15.78:0/715592889 shutdown_connections 2024-09-17T03:13:19.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.610+0000 7f252edc6640 1 -- 172.21.15.78:0/715592889 >> 172.21.15.78:0/715592889 conn(0x7f252806d230 msgr2=0x7f252806d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:19.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.610+0000 7f252edc6640 1 -- 172.21.15.78:0/715592889 shutdown_connections 2024-09-17T03:13:19.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.610+0000 7f252edc6640 1 -- 172.21.15.78:0/715592889 wait complete. 2024-09-17T03:13:19.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.612+0000 7f252edc6640 1 Processor -- start 2024-09-17T03:13:19.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.612+0000 7f252edc6640 1 -- start start 2024-09-17T03:13:19.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.613+0000 7f252edc6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2518003a00 0x7f25280b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.613+0000 7f252edc6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f25280cb9a0 0x7f25280cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.613+0000 7f252edc6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f25281f68f0 0x7f25281f6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.613+0000 7f252edc6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f252815db60 con 0x7f2518003a00 2024-09-17T03:13:19.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.613+0000 7f252edc6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f252815d9e0 con 0x7f25280cb9a0 2024-09-17T03:13:19.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.613+0000 7f252edc6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f252815dce0 con 0x7f25281f68f0 2024-09-17T03:13:19.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.613+0000 7f252cb62640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2518003a00 0x7f25280b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.613+0000 7f252cb62640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2518003a00 0x7f25280b1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34162/0 (socket says 172.21.15.78:34162) 2024-09-17T03:13:19.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.613+0000 7f252cb62640 1 -- 172.21.15.78:0/1353882055 learned_addr learned my addr 172.21.15.78:0/1353882055 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:19.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.613+0000 7f2527fff640 1 --2- 172.21.15.78:0/1353882055 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f25280cb9a0 0x7f25280cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.613+0000 7f252d363640 1 --2- 172.21.15.78:0/1353882055 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f25281f68f0 0x7f25281f6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.614+0000 7f252cb62640 1 -- 172.21.15.78:0/1353882055 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f25281f68f0 msgr2=0x7f25281f6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.614+0000 7f252cb62640 1 --2- 172.21.15.78:0/1353882055 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f25281f68f0 0x7f25281f6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.614+0000 7f252cb62640 1 -- 172.21.15.78:0/1353882055 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f25280cb9a0 msgr2=0x7f25280cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.614+0000 7f252cb62640 1 --2- 172.21.15.78:0/1353882055 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f25280cb9a0 0x7f25280cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.614+0000 7f252cb62640 1 -- 172.21.15.78:0/1353882055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25281f7240 con 0x7f2518003a00 2024-09-17T03:13:19.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.614+0000 7f252cb62640 1 --2- 172.21.15.78:0/1353882055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2518003a00 0x7f25280b1ea0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f251c000c00 tx=0x7f251c006c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:19.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.614+0000 7f25257fa640 1 -- 172.21.15.78:0/1353882055 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251c031040 con 0x7f2518003a00 2024-09-17T03:13:19.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.614+0000 7f25257fa640 1 -- 172.21.15.78:0/1353882055 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f251c003610 con 0x7f2518003a00 2024-09-17T03:13:19.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.614+0000 7f25257fa640 1 -- 172.21.15.78:0/1353882055 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251c003a40 con 0x7f2518003a00 2024-09-17T03:13:19.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.614+0000 7f252edc6640 1 -- 172.21.15.78:0/1353882055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25280b4a70 con 0x7f2518003a00 2024-09-17T03:13:19.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.614+0000 7f252edc6640 1 -- 172.21.15.78:0/1353882055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2528158df0 con 0x7f2518003a00 2024-09-17T03:13:19.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.616+0000 7f25257fa640 1 -- 172.21.15.78:0/1353882055 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f251c034070 con 0x7f2518003a00 2024-09-17T03:13:19.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.616+0000 7f25257fa640 1 --2- 172.21.15.78:0/1353882055 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f250c078bc0 0x7f250c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.616+0000 7f25257fa640 1 -- 172.21.15.78:0/1353882055 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f251c0bb210 con 0x7f2518003a00 2024-09-17T03:13:19.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.617+0000 7f2527fff640 1 --2- 172.21.15.78:0/1353882055 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f250c078bc0 0x7f250c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.617+0000 7f2527fff640 1 --2- 172.21.15.78:0/1353882055 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f250c078bc0 0x7f250c07b0d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2514005eb0 tx=0x7f2514005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:19.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.617+0000 7f2535e16740 1 Processor -- start 2024-09-17T03:13:19.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.617+0000 7f2535e16740 1 -- start start 2024-09-17T03:13:19.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.619+0000 7f2535e16740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b886390 0x55ba0bc72a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.619+0000 7f2535e16740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ba0b85d4d0 0x55ba0bc47860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.619+0000 7f2535e16740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba0b8656b0 0x55ba0bc47da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.619+0000 7f2535e16740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ba0bba0a60 con 0x55ba0b886390 2024-09-17T03:13:19.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.619+0000 7f2535e16740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ba0bb8fe90 con 0x55ba0b8656b0 2024-09-17T03:13:19.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.619+0000 7f2535e16740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ba0bb93ca0 con 0x55ba0b85d4d0 2024-09-17T03:13:19.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.619+0000 7f252cb62640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b886390 0x55ba0bc72a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.619+0000 7f252cb62640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b886390 0x55ba0bc72a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34164/0 (socket says 172.21.15.78:34164) 2024-09-17T03:13:19.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.619+0000 7f252cb62640 1 -- 172.21.15.78:0/1750852797 learned_addr learned my addr 172.21.15.78:0/1750852797 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:19.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.619+0000 7f2527fff640 1 --2- 172.21.15.78:0/1750852797 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ba0b85d4d0 0x55ba0bc47860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.619+0000 7f252d363640 1 --2- 172.21.15.78:0/1750852797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba0b8656b0 0x55ba0bc47da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.619+0000 7f252cb62640 1 -- 172.21.15.78:0/1750852797 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ba0b85d4d0 msgr2=0x55ba0bc47860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.619+0000 7f252cb62640 1 --2- 172.21.15.78:0/1750852797 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ba0b85d4d0 0x55ba0bc47860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.619+0000 7f252cb62640 1 -- 172.21.15.78:0/1750852797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba0b8656b0 msgr2=0x55ba0bc47da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.619+0000 7f252cb62640 1 --2- 172.21.15.78:0/1750852797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba0b8656b0 0x55ba0bc47da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.619+0000 7f252cb62640 1 -- 172.21.15.78:0/1750852797 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba0b9687d0 con 0x55ba0b886390 2024-09-17T03:13:19.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.619+0000 7f252cb62640 1 --2- 172.21.15.78:0/1750852797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b886390 0x55ba0bc72a10 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f251c083030 tx=0x7f251c082fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b75492254562611 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:19.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.619+0000 7f25127fc640 1 -- 172.21.15.78:0/1750852797 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251c087ad0 con 0x55ba0b886390 2024-09-17T03:13:19.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.619+0000 7f25127fc640 1 -- 172.21.15.78:0/1750852797 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f251c08ca10 con 0x55ba0b886390 2024-09-17T03:13:19.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.619+0000 7f25127fc640 1 -- 172.21.15.78:0/1750852797 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251c082560 con 0x55ba0b886390 2024-09-17T03:13:19.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.620+0000 7f2535e16740 1 -- 172.21.15.78:0/1750852797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b886390 msgr2=0x55ba0bc72a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.620+0000 7f2535e16740 1 --2- 172.21.15.78:0/1750852797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b886390 0x55ba0bc72a10 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f251c083030 tx=0x7f251c082fa0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.620+0000 7f2535e16740 1 -- 172.21.15.78:0/1750852797 shutdown_connections 2024-09-17T03:13:19.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.620+0000 7f2535e16740 1 --2- 172.21.15.78:0/1750852797 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba0b8656b0 0x55ba0bc47da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.620+0000 7f2535e16740 1 --2- 172.21.15.78:0/1750852797 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ba0b85d4d0 0x55ba0bc47860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.620+0000 7f2535e16740 1 --2- 172.21.15.78:0/1750852797 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b886390 0x55ba0bc72a10 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.620+0000 7f2535e16740 1 -- 172.21.15.78:0/1750852797 >> 172.21.15.78:0/1750852797 conn(0x55ba0b87a4e0 msgr2=0x55ba0bc2dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:19.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.620+0000 7f2535e16740 1 -- 172.21.15.78:0/1750852797 shutdown_connections 2024-09-17T03:13:19.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.620+0000 7f2535e16740 1 -- 172.21.15.78:0/1750852797 wait complete. 2024-09-17T03:13:19.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.621+0000 7f2535e16740 1 -- start start 2024-09-17T03:13:19.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.621+0000 7f2535e16740 1 Processor -- start 2024-09-17T03:13:19.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f2535e16740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba0b85d4d0 0x55ba0bc6fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f2535e16740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b8656b0 0x55ba0bc687a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f2535e16740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ba0b886390 0x55ba0bc85900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f2535e16740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ba0b900740 con 0x55ba0b8656b0 2024-09-17T03:13:19.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f2535e16740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ba0bb35970 con 0x55ba0b85d4d0 2024-09-17T03:13:19.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f2535e16740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ba0bb8fe90 con 0x55ba0b886390 2024-09-17T03:13:19.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f2535e16740 10 client.0 _ll_register_callbacks cb 0x55ba0bb44780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:19.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f2527fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b8656b0 0x55ba0bc687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f2527fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b8656b0 0x55ba0bc687a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34166/0 (socket says 172.21.15.78:34166) 2024-09-17T03:13:19.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f2527fff640 1 -- 172.21.15.78:0/2608732205 learned_addr learned my addr 172.21.15.78:0/2608732205 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:19.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f252cb62640 1 --2- 172.21.15.78:0/2608732205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba0b85d4d0 0x55ba0bc6fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f252d363640 1 --2- 172.21.15.78:0/2608732205 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ba0b886390 0x55ba0bc85900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f2527fff640 1 -- 172.21.15.78:0/2608732205 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ba0b886390 msgr2=0x55ba0bc85900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f2527fff640 1 --2- 172.21.15.78:0/2608732205 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ba0b886390 0x55ba0bc85900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f2527fff640 1 -- 172.21.15.78:0/2608732205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba0b85d4d0 msgr2=0x55ba0bc6fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f2527fff640 1 --2- 172.21.15.78:0/2608732205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba0b85d4d0 0x55ba0bc6fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f2527fff640 1 -- 172.21.15.78:0/2608732205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba0b8f1970 con 0x55ba0b8656b0 2024-09-17T03:13:19.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f2527fff640 1 --2- 172.21.15.78:0/2608732205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b8656b0 0x55ba0bc687a0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f251401f6c0 tx=0x7f25140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09ce276b53fd249 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:19.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f25077fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:19.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f25077fe640 1 -- 172.21.15.78:0/2608732205 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2514004260 con 0x55ba0b8656b0 2024-09-17T03:13:19.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f25077fe640 1 -- 172.21.15.78:0/2608732205 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f2514004400 con 0x55ba0b8656b0 2024-09-17T03:13:19.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.623+0000 7f2535e16740 1 -- 172.21.15.78:0/2608732205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f251c08ca10 con 0x55ba0b8656b0 2024-09-17T03:13:19.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.624+0000 7f25077fe640 1 -- 172.21.15.78:0/2608732205 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f25140035f0 con 0x55ba0b8656b0 2024-09-17T03:13:19.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.624+0000 7f2535e16740 10 client.7140 fetch_fsmap learned FSMap version 68 2024-09-17T03:13:19.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.624+0000 7f2535e16740 1 -- 172.21.15.78:0/2608732205 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55ba0b8cf6a0 con 0x55ba0b8656b0 2024-09-17T03:13:19.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.624+0000 7f25077fe640 1 -- 172.21.15.78:0/2608732205 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f251c08ca10 con 0x55ba0b8656b0 2024-09-17T03:13:19.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.624+0000 7f25077fe640 1 -- 172.21.15.78:0/2608732205 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 68) ==== 3554+0+0 (secure 0 0 0) 0x7f2514032050 con 0x55ba0b8656b0 2024-09-17T03:13:19.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.624+0000 7f2535e16740 10 client.7140 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T03:13:19.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.624+0000 7f2535e16740 10 client.7140 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-09-17T03:13:19.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.624+0000 7f2535e16740 20 client.7140 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:19.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.624+0000 7f2535e16740 1 --2- 172.21.15.78:0/2608732205 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55ba0b844f60 0x55ba0bc85e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.624+0000 7f2535e16740 4 client.7140 mds_command: new command op to 6864 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:13:19.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.624+0000 7f2535e16740 1 -- 172.21.15.78:0/2608732205 --> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba0bba29b0 con 0x55ba0b844f60 2024-09-17T03:13:19.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.624+0000 7f252cb62640 1 --2- 172.21.15.78:0/2608732205 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55ba0b844f60 0x55ba0bc85e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.624+0000 7f25077fe640 10 client.7140 ms_handle_connect on v2:172.21.15.78:6833/2058899730 2024-09-17T03:13:19.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.624+0000 7f252cb62640 1 --2- 172.21.15.78:0/2608732205 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55ba0b844f60 0x55ba0bc85e40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=901d55612b2db068 server_cookie=336cb0a47bcff519 in_seq=0 out_seq=0 2024-09-17T03:13:19.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.625+0000 7f25077fe640 1 -- 172.21.15.78:0/2608732205 <== mds.0 v2:172.21.15.78:6833/2058899730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ba0bba29b0 con 0x55ba0b844f60 2024-09-17T03:13:19.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.625+0000 7f25077fe640 10 client.7140 handle_command_reply: tid=0 2024-09-17T03:13:19.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.625+0000 7f2535e16740 1 client.7140 shutdown 2024-09-17T03:13:19.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.625+0000 7f2535e16740 1 -- 172.21.15.78:0/2608732205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b8656b0 msgr2=0x55ba0bc687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.625+0000 7f2535e16740 1 --2- 172.21.15.78:0/2608732205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b8656b0 0x55ba0bc687a0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f251401f6c0 tx=0x7f25140046c0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.625+0000 7f2535e16740 1 -- 172.21.15.78:0/2608732205 shutdown_connections 2024-09-17T03:13:19.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.625+0000 7f2535e16740 1 --2- 172.21.15.78:0/2608732205 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55ba0b844f60 0x55ba0bc85e40 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.625+0000 7f2535e16740 1 --2- 172.21.15.78:0/2608732205 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ba0b886390 0x55ba0bc85900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.625+0000 7f2535e16740 1 --2- 172.21.15.78:0/2608732205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b8656b0 0x55ba0bc687a0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.625+0000 7f25077fe640 0 client.7140 ms_handle_reset on v2:172.21.15.78:6833/2058899730 2024-09-17T03:13:19.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.625+0000 7f2535e16740 1 --2- 172.21.15.78:0/2608732205 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba0b85d4d0 0x55ba0bc6fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.625+0000 7f2535e16740 1 -- 172.21.15.78:0/2608732205 >> 172.21.15.78:0/2608732205 conn(0x55ba0b87a4e0 msgr2=0x55ba0bc28a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:19.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.625+0000 7f2535e16740 1 -- 172.21.15.78:0/2608732205 shutdown_connections 2024-09-17T03:13:19.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.625+0000 7f2535e16740 1 -- 172.21.15.78:0/2608732205 wait complete. 2024-09-17T03:13:19.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.626+0000 7f2535e16740 20 client.7140 trim_cache size 0 max 16384 2024-09-17T03:13:19.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.640+0000 7f2535e16740 1 Processor -- start 2024-09-17T03:13:19.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.640+0000 7f2535e16740 1 -- start start 2024-09-17T03:13:19.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.642+0000 7f2535e16740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b85d4d0 0x55ba0bc81dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.642+0000 7f2535e16740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba0b8656b0 0x55ba0bc68380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.642+0000 7f2535e16740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ba0b886390 0x55ba0bc688c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.642+0000 7f2535e16740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2528200230 con 0x55ba0b85d4d0 2024-09-17T03:13:19.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.642+0000 7f2535e16740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f25281f3c40 con 0x55ba0b8656b0 2024-09-17T03:13:19.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.642+0000 7f2535e16740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f25281ffc90 con 0x55ba0b886390 2024-09-17T03:13:19.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.642+0000 7f252cb62640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b85d4d0 0x55ba0bc81dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.642+0000 7f252cb62640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b85d4d0 0x55ba0bc81dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34182/0 (socket says 172.21.15.78:34182) 2024-09-17T03:13:19.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.642+0000 7f252cb62640 1 -- 172.21.15.78:0/1601920878 learned_addr learned my addr 172.21.15.78:0/1601920878 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:19.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.642+0000 7f2527fff640 1 --2- 172.21.15.78:0/1601920878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba0b8656b0 0x55ba0bc68380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.642+0000 7f252cb62640 1 -- 172.21.15.78:0/1601920878 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ba0b886390 msgr2=0x55ba0bc688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.642+0000 7f252cb62640 1 --2- 172.21.15.78:0/1601920878 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ba0b886390 0x55ba0bc688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.642+0000 7f252cb62640 1 -- 172.21.15.78:0/1601920878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba0b8656b0 msgr2=0x55ba0bc68380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.642+0000 7f252cb62640 1 --2- 172.21.15.78:0/1601920878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba0b8656b0 0x55ba0bc68380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.642+0000 7f252cb62640 1 -- 172.21.15.78:0/1601920878 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba0bc29cd0 con 0x55ba0b85d4d0 2024-09-17T03:13:19.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.642+0000 7f252cb62640 1 --2- 172.21.15.78:0/1601920878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b85d4d0 0x55ba0bc81dd0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f251c001df0 tx=0x7f251c0a7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd7574b67ee40ee server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.642+0000 7f2511ffb640 1 -- 172.21.15.78:0/1601920878 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251c07f6f0 con 0x55ba0b85d4d0 2024-09-17T03:13:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.642+0000 7f2511ffb640 1 -- 172.21.15.78:0/1601920878 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f251c0a1020 con 0x55ba0b85d4d0 2024-09-17T03:13:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.642+0000 7f2511ffb640 1 -- 172.21.15.78:0/1601920878 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251c08ca10 con 0x55ba0b85d4d0 2024-09-17T03:13:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.643+0000 7f2535e16740 1 -- 172.21.15.78:0/1601920878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b85d4d0 msgr2=0x55ba0bc81dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.643+0000 7f2535e16740 1 --2- 172.21.15.78:0/1601920878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b85d4d0 0x55ba0bc81dd0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f251c001df0 tx=0x7f251c0a7040 comp rx=0 tx=0).stop 2024-09-17T03:13:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.643+0000 7f2535e16740 1 -- 172.21.15.78:0/1601920878 shutdown_connections 2024-09-17T03:13:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.643+0000 7f2535e16740 1 --2- 172.21.15.78:0/1601920878 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ba0b886390 0x55ba0bc688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.643+0000 7f2535e16740 1 --2- 172.21.15.78:0/1601920878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba0b8656b0 0x55ba0bc68380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.643+0000 7f2535e16740 1 --2- 172.21.15.78:0/1601920878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b85d4d0 0x55ba0bc81dd0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.643+0000 7f2535e16740 1 -- 172.21.15.78:0/1601920878 >> 172.21.15.78:0/1601920878 conn(0x55ba0b87a4e0 msgr2=0x55ba0bc28a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.643+0000 7f2535e16740 1 -- 172.21.15.78:0/1601920878 shutdown_connections 2024-09-17T03:13:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.643+0000 7f2535e16740 1 -- 172.21.15.78:0/1601920878 wait complete. 2024-09-17T03:13:19.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.644+0000 7f2535e16740 1 -- start start 2024-09-17T03:13:19.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.644+0000 7f2535e16740 1 Processor -- start 2024-09-17T03:13:19.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.645+0000 7f2535e16740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ba0b85d4d0 0x55ba0bcf1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.645+0000 7f2535e16740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba0b8656b0 0x55ba0bc44380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.645+0000 7f2535e16740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b886390 0x55ba0bc448c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.645+0000 7f2535e16740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ba0bba0a60 con 0x55ba0b886390 2024-09-17T03:13:19.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.645+0000 7f2535e16740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f25281f6200 con 0x55ba0b8656b0 2024-09-17T03:13:19.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.645+0000 7f2535e16740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ba0bc293d0 con 0x55ba0b85d4d0 2024-09-17T03:13:19.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.645+0000 7f2535e16740 10 client.0 _ll_register_callbacks cb 0x7f2514012ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:19.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.646+0000 7f252d363640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b886390 0x55ba0bc448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.646+0000 7f252d363640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b886390 0x55ba0bc448c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34184/0 (socket says 172.21.15.78:34184) 2024-09-17T03:13:19.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.646+0000 7f252d363640 1 -- 172.21.15.78:0/3523870069 learned_addr learned my addr 172.21.15.78:0/3523870069 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:19.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.646+0000 7f252cb62640 1 --2- 172.21.15.78:0/3523870069 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ba0b85d4d0 0x55ba0bcf1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.646+0000 7f2527fff640 1 --2- 172.21.15.78:0/3523870069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba0b8656b0 0x55ba0bc44380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.646+0000 7f252d363640 1 -- 172.21.15.78:0/3523870069 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ba0b85d4d0 msgr2=0x55ba0bcf1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.646+0000 7f252d363640 1 --2- 172.21.15.78:0/3523870069 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ba0b85d4d0 0x55ba0bcf1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.646+0000 7f252d363640 1 -- 172.21.15.78:0/3523870069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba0b8656b0 msgr2=0x55ba0bc44380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.646+0000 7f252d363640 1 --2- 172.21.15.78:0/3523870069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba0b8656b0 0x55ba0bc44380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.646+0000 7f252d363640 1 -- 172.21.15.78:0/3523870069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba0bc2a860 con 0x55ba0b886390 2024-09-17T03:13:19.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.646+0000 7f252d363640 1 --2- 172.21.15.78:0/3523870069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b886390 0x55ba0bc448c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f2518004780 tx=0x7f2520011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12f8265e7795af5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:19.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.646+0000 7f25077fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:19.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.646+0000 7f25077fe640 1 -- 172.21.15.78:0/3523870069 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2520021060 con 0x55ba0b886390 2024-09-17T03:13:19.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.646+0000 7f25077fe640 1 -- 172.21.15.78:0/3523870069 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f2520009850 con 0x55ba0b886390 2024-09-17T03:13:19.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.646+0000 7f2535e16740 1 -- 172.21.15.78:0/3523870069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f251c0a1020 con 0x55ba0b886390 2024-09-17T03:13:19.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.646+0000 7f25077fe640 1 -- 172.21.15.78:0/3523870069 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f2520027050 con 0x55ba0b886390 2024-09-17T03:13:19.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.646+0000 7f2535e16740 10 client.7146 fetch_fsmap learned FSMap version 68 2024-09-17T03:13:19.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.646+0000 7f2535e16740 1 -- 172.21.15.78:0/3523870069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55ba0bc26dd0 con 0x55ba0b886390 2024-09-17T03:13:19.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.646+0000 7f25077fe640 1 -- 172.21.15.78:0/3523870069 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f251c0a1020 con 0x55ba0b886390 2024-09-17T03:13:19.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.647+0000 7f25077fe640 1 -- 172.21.15.78:0/3523870069 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 68) ==== 3554+0+0 (secure 0 0 0) 0x7f252002a020 con 0x55ba0b886390 2024-09-17T03:13:19.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.647+0000 7f2535e16740 10 client.7146 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T03:13:19.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.647+0000 7f2535e16740 10 client.7146 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-09-17T03:13:19.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.647+0000 7f2535e16740 20 client.7146 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:19.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.647+0000 7f2535e16740 1 --2- 172.21.15.78:0/3523870069 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55ba0bc44e00 0x55ba0bc805c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.647+0000 7f2535e16740 4 client.7146 mds_command: new command op to 6864 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T03:13:19.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.647+0000 7f2535e16740 1 -- 172.21.15.78:0/3523870069 --> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ba0bb9e460 con 0x55ba0bc44e00 2024-09-17T03:13:19.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.647+0000 7f252cb62640 1 --2- 172.21.15.78:0/3523870069 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55ba0bc44e00 0x55ba0bc805c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.647+0000 7f25077fe640 10 client.7146 ms_handle_connect on v2:172.21.15.78:6833/2058899730 2024-09-17T03:13:19.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.647+0000 7f252cb62640 1 --2- 172.21.15.78:0/3523870069 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55ba0bc44e00 0x55ba0bc805c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6860b34fa7ba4aa server_cookie=5afabd989b817d26 in_seq=0 out_seq=0 2024-09-17T03:13:19.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.659+0000 7f25077fe640 1 -- 172.21.15.78:0/3523870069 <== mds.0 v2:172.21.15.78:6833/2058899730 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ba0bb9e460 con 0x55ba0bc44e00 2024-09-17T03:13:19.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.659+0000 7f25077fe640 10 client.7146 handle_command_reply: tid=0 2024-09-17T03:13:19.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.659+0000 7f2535e16740 1 client.7146 shutdown 2024-09-17T03:13:19.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.659+0000 7f2535e16740 1 -- 172.21.15.78:0/3523870069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b886390 msgr2=0x55ba0bc448c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.659+0000 7f2535e16740 1 --2- 172.21.15.78:0/3523870069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b886390 0x55ba0bc448c0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f2518004780 tx=0x7f2520011810 comp rx=0 tx=0).stop 2024-09-17T03:13:19.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.659+0000 7f2535e16740 1 -- 172.21.15.78:0/3523870069 shutdown_connections 2024-09-17T03:13:19.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.659+0000 7f2535e16740 1 --2- 172.21.15.78:0/3523870069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ba0b886390 0x55ba0bc448c0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.659+0000 7f2535e16740 1 --2- 172.21.15.78:0/3523870069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ba0b8656b0 0x55ba0bc44380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.659+0000 7f2535e16740 1 --2- 172.21.15.78:0/3523870069 >> [v2:172.21.15.78:6833/2058899730,v1:172.21.15.78:6835/2058899730] conn(0x55ba0bc44e00 0x55ba0bc805c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.659+0000 7f2535e16740 1 --2- 172.21.15.78:0/3523870069 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ba0b85d4d0 0x55ba0bcf1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.659+0000 7f25077fe640 0 client.7146 ms_handle_reset on v2:172.21.15.78:6833/2058899730 2024-09-17T03:13:19.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.660+0000 7f2535e16740 1 -- 172.21.15.78:0/3523870069 >> 172.21.15.78:0/3523870069 conn(0x55ba0b87a4e0 msgr2=0x55ba0bc70080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:19.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.660+0000 7f2535e16740 1 -- 172.21.15.78:0/3523870069 shutdown_connections 2024-09-17T03:13:19.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.660+0000 7f2535e16740 1 -- 172.21.15.78:0/3523870069 wait complete. 2024-09-17T03:13:19.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.660+0000 7f2535e16740 20 client.7146 trim_cache size 0 max 16384 2024-09-17T03:13:19.660 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:13:19.660 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:13:19.660 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:13:19.660 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:13:19.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.660+0000 7f252edc6640 1 -- 172.21.15.78:0/1353882055 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f250c078bc0 msgr2=0x7f250c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.660+0000 7f252edc6640 1 --2- 172.21.15.78:0/1353882055 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f250c078bc0 0x7f250c07b0d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2514005eb0 tx=0x7f2514005f90 comp rx=0 tx=0).stop 2024-09-17T03:13:19.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.660+0000 7f252edc6640 1 -- 172.21.15.78:0/1353882055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2518003a00 msgr2=0x7f25280b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.660+0000 7f252edc6640 1 --2- 172.21.15.78:0/1353882055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2518003a00 0x7f25280b1ea0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f251c000c00 tx=0x7f251c006c90 comp rx=0 tx=0).stop 2024-09-17T03:13:19.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.660+0000 7f252edc6640 1 -- 172.21.15.78:0/1353882055 shutdown_connections 2024-09-17T03:13:19.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.660+0000 7f252edc6640 1 --2- 172.21.15.78:0/1353882055 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f25281f68f0 0x7f25281f6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.660+0000 7f252edc6640 1 --2- 172.21.15.78:0/1353882055 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f250c078bc0 0x7f250c07b0d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.660+0000 7f252edc6640 1 --2- 172.21.15.78:0/1353882055 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f25280cb9a0 0x7f25280cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.660+0000 7f252edc6640 1 --2- 172.21.15.78:0/1353882055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2518003a00 0x7f25280b1ea0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.660+0000 7f252edc6640 1 -- 172.21.15.78:0/1353882055 >> 172.21.15.78:0/1353882055 conn(0x7f252806d230 msgr2=0x7f252815ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:19.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.660+0000 7f252edc6640 1 -- 172.21.15.78:0/1353882055 shutdown_connections 2024-09-17T03:13:19.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.660+0000 7f252edc6640 1 -- 172.21.15.78:0/1353882055 wait complete. 2024-09-17T03:13:19.670 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:1 flush journal 2024-09-17T03:13:19.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.787+0000 7f34d1c9b640 1 -- 172.21.15.78:0/38511947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34cc0b4570 msgr2=0x7f34cc06d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.787+0000 7f34d1c9b640 1 --2- 172.21.15.78:0/38511947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34cc0b4570 0x7f34cc06d320 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f34c0005fd0 tx=0x7f34c002a530 comp rx=0 tx=0).stop 2024-09-17T03:13:19.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.787+0000 7f34d1c9b640 1 -- 172.21.15.78:0/38511947 shutdown_connections 2024-09-17T03:13:19.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.787+0000 7f34d1c9b640 1 --2- 172.21.15.78:0/38511947 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34cc0b4570 0x7f34cc06d320 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.787+0000 7f34d1c9b640 1 --2- 172.21.15.78:0/38511947 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f34cc162040 0x7f34cc06cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.787+0000 7f34d1c9b640 1 -- 172.21.15.78:0/38511947 >> 172.21.15.78:0/38511947 conn(0x7f34cc0cdcc0 msgr2=0x7f34cc0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:19.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.787+0000 7f34d1c9b640 1 -- 172.21.15.78:0/38511947 shutdown_connections 2024-09-17T03:13:19.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.787+0000 7f34d1c9b640 1 -- 172.21.15.78:0/38511947 wait complete. 2024-09-17T03:13:19.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.789+0000 7f34d1c9b640 1 Processor -- start 2024-09-17T03:13:19.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.789+0000 7f34d1c9b640 1 -- start start 2024-09-17T03:13:19.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.791+0000 7f34d1c9b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f34cc073f00 0x7f34cc0c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.791+0000 7f34d1c9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34cc0b4570 0x7f34cc1f9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.791+0000 7f34d1c9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34cc0c7be0 0x7f34cc1f99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.791+0000 7f34d1c9b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc0b4100 con 0x7f34cc0c7be0 2024-09-17T03:13:19.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.791+0000 7f34d1c9b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc0b0520 con 0x7f34cc0b4570 2024-09-17T03:13:19.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.791+0000 7f34d1c9b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f34cc0b4280 con 0x7f34cc073f00 2024-09-17T03:13:19.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.791+0000 7f34cbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34cc0c7be0 0x7f34cc1f99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.791+0000 7f34cbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34cc0c7be0 0x7f34cc1f99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34200/0 (socket says 172.21.15.78:34200) 2024-09-17T03:13:19.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.791+0000 7f34cbfff640 1 -- 172.21.15.78:0/2932792056 learned_addr learned my addr 172.21.15.78:0/2932792056 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:19.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.791+0000 7f34cb7fe640 1 --2- 172.21.15.78:0/2932792056 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f34cc073f00 0x7f34cc0c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.791+0000 7f34caffd640 1 --2- 172.21.15.78:0/2932792056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34cc0b4570 0x7f34cc1f9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.791+0000 7f34cbfff640 1 -- 172.21.15.78:0/2932792056 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f34cc073f00 msgr2=0x7f34cc0c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.791+0000 7f34cbfff640 1 --2- 172.21.15.78:0/2932792056 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f34cc073f00 0x7f34cc0c76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.791+0000 7f34cbfff640 1 -- 172.21.15.78:0/2932792056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34cc0b4570 msgr2=0x7f34cc1f9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.791+0000 7f34cbfff640 1 --2- 172.21.15.78:0/2932792056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34cc0b4570 0x7f34cc1f9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.791+0000 7f34cbfff640 1 -- 172.21.15.78:0/2932792056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc1608a0 con 0x7f34cc0c7be0 2024-09-17T03:13:19.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.791+0000 7f34cbfff640 1 --2- 172.21.15.78:0/2932792056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34cc0c7be0 0x7f34cc1f99d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f34c400b440 tx=0x7f34c400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:19.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.791+0000 7f34b3fff640 1 -- 172.21.15.78:0/2932792056 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c4004020 con 0x7f34cc0c7be0 2024-09-17T03:13:19.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.792+0000 7f34b3fff640 1 -- 172.21.15.78:0/2932792056 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34c40042b0 con 0x7f34cc0c7be0 2024-09-17T03:13:19.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.792+0000 7f34d1c9b640 1 -- 172.21.15.78:0/2932792056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34cc160b80 con 0x7f34cc0c7be0 2024-09-17T03:13:19.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.792+0000 7f34b3fff640 1 -- 172.21.15.78:0/2932792056 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c40044a0 con 0x7f34cc0c7be0 2024-09-17T03:13:19.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.792+0000 7f34d1c9b640 1 -- 172.21.15.78:0/2932792056 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34cc161140 con 0x7f34cc0c7be0 2024-09-17T03:13:19.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.794+0000 7f34b3fff640 1 -- 172.21.15.78:0/2932792056 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f34c4018020 con 0x7f34cc0c7be0 2024-09-17T03:13:19.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.794+0000 7f34b3fff640 1 --2- 172.21.15.78:0/2932792056 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f34b8078b90 0x7f34b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.795+0000 7f34b3fff640 1 -- 172.21.15.78:0/2932792056 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f34c409a280 con 0x7f34cc0c7be0 2024-09-17T03:13:19.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.795+0000 7f34cb7fe640 1 --2- 172.21.15.78:0/2932792056 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f34b8078b90 0x7f34b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.795+0000 7f34d8c10740 1 Processor -- start 2024-09-17T03:13:19.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.795+0000 7f34d8c10740 1 -- start start 2024-09-17T03:13:19.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.795+0000 7f34cb7fe640 1 --2- 172.21.15.78:0/2932792056 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f34b8078b90 0x7f34b807b0a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f34bc00a400 tx=0x7f34bc00d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:19.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.796+0000 7f34d8c10740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 0x562b453b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.796+0000 7f34d8c10740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fa34d0 0x562b4538d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.796+0000 7f34d8c10740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b44fab6b0 0x562b4538dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.796+0000 7f34d8c10740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x562b452e6a60 con 0x562b44fcc390 2024-09-17T03:13:19.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.796+0000 7f34d8c10740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562b452d5e90 con 0x562b44fa34d0 2024-09-17T03:13:19.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.796+0000 7f34d8c10740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x562b452d9ca0 con 0x562b44fab6b0 2024-09-17T03:13:19.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.797+0000 7f34cb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 0x562b453b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.797+0000 7f34cb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 0x562b453b8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34216/0 (socket says 172.21.15.78:34216) 2024-09-17T03:13:19.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.797+0000 7f34cb7fe640 1 -- 172.21.15.78:0/1110057599 learned_addr learned my addr 172.21.15.78:0/1110057599 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:19.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.797+0000 7f34caffd640 1 --2- 172.21.15.78:0/1110057599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fa34d0 0x562b4538d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.797+0000 7f34cbfff640 1 --2- 172.21.15.78:0/1110057599 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b44fab6b0 0x562b4538dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.797+0000 7f34cb7fe640 1 -- 172.21.15.78:0/1110057599 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b44fab6b0 msgr2=0x562b4538dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.797+0000 7f34cb7fe640 1 --2- 172.21.15.78:0/1110057599 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b44fab6b0 0x562b4538dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.797+0000 7f34cb7fe640 1 -- 172.21.15.78:0/1110057599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fa34d0 msgr2=0x562b4538d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.797+0000 7f34cb7fe640 1 --2- 172.21.15.78:0/1110057599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fa34d0 0x562b4538d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.797+0000 7f34cb7fe640 1 -- 172.21.15.78:0/1110057599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b450ae7d0 con 0x562b44fcc390 2024-09-17T03:13:19.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.797+0000 7f34cb7fe640 1 --2- 172.21.15.78:0/1110057599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 0x562b453b8a10 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f34bc016760 tx=0x7f34bc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8552f1ff7bd206a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:19.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.797+0000 7f34b17fa640 1 -- 172.21.15.78:0/1110057599 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc025070 con 0x562b44fcc390 2024-09-17T03:13:19.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.797+0000 7f34b17fa640 1 -- 172.21.15.78:0/1110057599 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34bc015970 con 0x562b44fcc390 2024-09-17T03:13:19.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.797+0000 7f34b17fa640 1 -- 172.21.15.78:0/1110057599 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc015d60 con 0x562b44fcc390 2024-09-17T03:13:19.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.798+0000 7f34d8c10740 1 -- 172.21.15.78:0/1110057599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 msgr2=0x562b453b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.798+0000 7f34d8c10740 1 --2- 172.21.15.78:0/1110057599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 0x562b453b8a10 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f34bc016760 tx=0x7f34bc011000 comp rx=0 tx=0).stop 2024-09-17T03:13:19.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.798+0000 7f34d8c10740 1 -- 172.21.15.78:0/1110057599 shutdown_connections 2024-09-17T03:13:19.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.798+0000 7f34d8c10740 1 --2- 172.21.15.78:0/1110057599 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b44fab6b0 0x562b4538dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.798+0000 7f34d8c10740 1 --2- 172.21.15.78:0/1110057599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fa34d0 0x562b4538d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.798+0000 7f34d8c10740 1 --2- 172.21.15.78:0/1110057599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 0x562b453b8a10 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.798+0000 7f34d8c10740 1 -- 172.21.15.78:0/1110057599 >> 172.21.15.78:0/1110057599 conn(0x562b44fc04e0 msgr2=0x562b45373d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:19.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.798+0000 7f34d8c10740 1 -- 172.21.15.78:0/1110057599 shutdown_connections 2024-09-17T03:13:19.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.798+0000 7f34d8c10740 1 -- 172.21.15.78:0/1110057599 wait complete. 2024-09-17T03:13:19.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.799+0000 7f34d8c10740 1 -- start start 2024-09-17T03:13:19.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.799+0000 7f34d8c10740 1 Processor -- start 2024-09-17T03:13:19.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.800+0000 7f34d8c10740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b44fa34d0 0x562b453cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.800+0000 7f34d8c10740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fab6b0 0x562b453ae610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.800+0000 7f34d8c10740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 0x562b453b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.800+0000 7f34d8c10740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x562b45046740 con 0x562b44fcc390 2024-09-17T03:13:19.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.800+0000 7f34d8c10740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562b4527b970 con 0x562b44fab6b0 2024-09-17T03:13:19.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.800+0000 7f34d8c10740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x562b453b0920 con 0x562b44fa34d0 2024-09-17T03:13:19.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.800+0000 7f34d8c10740 10 client.0 _ll_register_callbacks cb 0x562b4528a780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:19.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.800+0000 7f34cbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 0x562b453b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.800+0000 7f34cbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 0x562b453b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34226/0 (socket says 172.21.15.78:34226) 2024-09-17T03:13:19.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.801+0000 7f34cbfff640 1 -- 172.21.15.78:0/4277432388 learned_addr learned my addr 172.21.15.78:0/4277432388 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:19.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.801+0000 7f34cb7fe640 1 --2- 172.21.15.78:0/4277432388 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b44fa34d0 0x562b453cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.801+0000 7f34caffd640 1 --2- 172.21.15.78:0/4277432388 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fab6b0 0x562b453ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.801+0000 7f34cbfff640 1 -- 172.21.15.78:0/4277432388 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b44fa34d0 msgr2=0x562b453cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.801+0000 7f34cbfff640 1 --2- 172.21.15.78:0/4277432388 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b44fa34d0 0x562b453cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.801+0000 7f34cbfff640 1 -- 172.21.15.78:0/4277432388 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fab6b0 msgr2=0x562b453ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.801+0000 7f34cbfff640 1 --2- 172.21.15.78:0/4277432388 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fab6b0 0x562b453ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.801+0000 7f34cbfff640 1 -- 172.21.15.78:0/4277432388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b45037970 con 0x562b44fcc390 2024-09-17T03:13:19.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.801+0000 7f34caffd640 1 --2- 172.21.15.78:0/4277432388 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fab6b0 0x562b453ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:19.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.801+0000 7f34cbfff640 1 --2- 172.21.15.78:0/4277432388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 0x562b453b4620 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f34c400b410 tx=0x7f34c4061bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8c00fd58fd6622 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:19.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.801+0000 7f34aa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:19.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.801+0000 7f34aa7fc640 1 -- 172.21.15.78:0/4277432388 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c406b900 con 0x562b44fcc390 2024-09-17T03:13:19.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.801+0000 7f34aa7fc640 1 -- 172.21.15.78:0/4277432388 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f34c4088200 con 0x562b44fcc390 2024-09-17T03:13:19.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.801+0000 7f34d8c10740 1 -- 172.21.15.78:0/4277432388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34bc015970 con 0x562b44fcc390 2024-09-17T03:13:19.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.801+0000 7f34aa7fc640 1 -- 172.21.15.78:0/4277432388 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f34c4082050 con 0x562b44fcc390 2024-09-17T03:13:19.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.801+0000 7f34d8c10740 10 client.7158 fetch_fsmap learned FSMap version 68 2024-09-17T03:13:19.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.801+0000 7f34d8c10740 1 -- 172.21.15.78:0/4277432388 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x562b450156a0 con 0x562b44fcc390 2024-09-17T03:13:19.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.801+0000 7f34aa7fc640 1 -- 172.21.15.78:0/4277432388 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34bc015970 con 0x562b44fcc390 2024-09-17T03:13:19.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.801+0000 7f34aa7fc640 1 -- 172.21.15.78:0/4277432388 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 68) ==== 3554+0+0 (secure 0 0 0) 0x7f34c406bb50 con 0x562b44fcc390 2024-09-17T03:13:19.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.802+0000 7f34d8c10740 10 client.7158 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T03:13:19.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.802+0000 7f34d8c10740 10 client.7158 resolve_mds: resolved 5:1 to role '5:1' aka daemon mds.c 2024-09-17T03:13:19.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.802+0000 7f34d8c10740 20 client.7158 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:19.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.802+0000 7f34d8c10740 1 --2- 172.21.15.78:0/4277432388 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x562b44f8af60 0x562b453af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.802+0000 7f34d8c10740 4 client.7158 mds_command: new command op to 6861 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:13:19.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.802+0000 7f34d8c10740 1 -- 172.21.15.78:0/4277432388 --> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b452e89b0 con 0x562b44f8af60 2024-09-17T03:13:19.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.802+0000 7f34cb7fe640 1 --2- 172.21.15.78:0/4277432388 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x562b44f8af60 0x562b453af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.802+0000 7f34aa7fc640 10 client.7158 ms_handle_connect on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:19.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.802+0000 7f34cb7fe640 1 --2- 172.21.15.78:0/4277432388 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x562b44f8af60 0x562b453af970 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a826e90884816fa1 server_cookie=cba7e70d49c7d225 in_seq=0 out_seq=0 2024-09-17T03:13:19.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.803+0000 7f34aa7fc640 1 -- 172.21.15.78:0/4277432388 <== mds.1 v2:172.21.15.78:6832/2905189397 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562b452e89b0 con 0x562b44f8af60 2024-09-17T03:13:19.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.803+0000 7f34aa7fc640 10 client.7158 handle_command_reply: tid=0 2024-09-17T03:13:19.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.803+0000 7f34d8c10740 1 client.7158 shutdown 2024-09-17T03:13:19.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.803+0000 7f34d8c10740 1 -- 172.21.15.78:0/4277432388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 msgr2=0x562b453b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.803+0000 7f34d8c10740 1 --2- 172.21.15.78:0/4277432388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 0x562b453b4620 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f34c400b410 tx=0x7f34c4061bf0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.803+0000 7f34d8c10740 1 -- 172.21.15.78:0/4277432388 shutdown_connections 2024-09-17T03:13:19.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.803+0000 7f34d8c10740 1 --2- 172.21.15.78:0/4277432388 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x562b44f8af60 0x562b453af970 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.803+0000 7f34d8c10740 1 --2- 172.21.15.78:0/4277432388 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 0x562b453b4620 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.803+0000 7f34d8c10740 1 --2- 172.21.15.78:0/4277432388 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fab6b0 0x562b453ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.803+0000 7f34aa7fc640 0 client.7158 ms_handle_reset on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:19.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.803+0000 7f34d8c10740 1 --2- 172.21.15.78:0/4277432388 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b44fa34d0 0x562b453cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.803+0000 7f34d8c10740 1 -- 172.21.15.78:0/4277432388 >> 172.21.15.78:0/4277432388 conn(0x562b44fc04e0 msgr2=0x562b4536ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:19.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.803+0000 7f34d8c10740 1 -- 172.21.15.78:0/4277432388 shutdown_connections 2024-09-17T03:13:19.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.803+0000 7f34d8c10740 1 -- 172.21.15.78:0/4277432388 wait complete. 2024-09-17T03:13:19.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.803+0000 7f34d8c10740 20 client.7158 trim_cache size 0 max 16384 2024-09-17T03:13:19.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.818+0000 7f34d8c10740 1 Processor -- start 2024-09-17T03:13:19.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.818+0000 7f34d8c10740 1 -- start start 2024-09-17T03:13:19.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.819+0000 7f34d8c10740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b44fa34d0 0x562b453db990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.819+0000 7f34d8c10740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fab6b0 0x562b453dbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.819+0000 7f34d8c10740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fcc390 0x562b453c6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.819+0000 7f34d8c10740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc202560 con 0x562b44fab6b0 2024-09-17T03:13:19.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.819+0000 7f34d8c10740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc201820 con 0x562b44fcc390 2024-09-17T03:13:19.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.819+0000 7f34d8c10740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f34cc201e30 con 0x562b44fa34d0 2024-09-17T03:13:19.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.819+0000 7f34caffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fab6b0 0x562b453dbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.819+0000 7f34caffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fab6b0 0x562b453dbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34230/0 (socket says 172.21.15.78:34230) 2024-09-17T03:13:19.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.819+0000 7f34caffd640 1 -- 172.21.15.78:0/935002383 learned_addr learned my addr 172.21.15.78:0/935002383 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:19.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.820+0000 7f34caffd640 1 -- 172.21.15.78:0/935002383 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b44fa34d0 msgr2=0x562b453db990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.820+0000 7f34caffd640 1 --2- 172.21.15.78:0/935002383 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b44fa34d0 0x562b453db990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.820+0000 7f34caffd640 1 -- 172.21.15.78:0/935002383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fcc390 msgr2=0x562b453c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.820+0000 7f34caffd640 1 --2- 172.21.15.78:0/935002383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fcc390 0x562b453c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.820+0000 7f34caffd640 1 -- 172.21.15.78:0/935002383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b4538d390 con 0x562b44fab6b0 2024-09-17T03:13:19.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.820+0000 7f34caffd640 1 --2- 172.21.15.78:0/935002383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fab6b0 0x562b453dbed0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009230 tx=0x7f34c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69a6afaed64b9c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:19.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.820+0000 7f34b0ff9640 1 -- 172.21.15.78:0/935002383 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c0035040 con 0x562b44fab6b0 2024-09-17T03:13:19.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.820+0000 7f34b0ff9640 1 -- 172.21.15.78:0/935002383 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34c00035f0 con 0x562b44fab6b0 2024-09-17T03:13:19.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.820+0000 7f34b0ff9640 1 -- 172.21.15.78:0/935002383 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c0003a40 con 0x562b44fab6b0 2024-09-17T03:13:19.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.821+0000 7f34d8c10740 1 -- 172.21.15.78:0/935002383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fab6b0 msgr2=0x562b453dbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.821+0000 7f34d8c10740 1 --2- 172.21.15.78:0/935002383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fab6b0 0x562b453dbed0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f34c0009230 tx=0x7f34c00046c0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.821+0000 7f34d8c10740 1 -- 172.21.15.78:0/935002383 shutdown_connections 2024-09-17T03:13:19.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.821+0000 7f34d8c10740 1 --2- 172.21.15.78:0/935002383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fcc390 0x562b453c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.821+0000 7f34d8c10740 1 --2- 172.21.15.78:0/935002383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fab6b0 0x562b453dbed0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.821+0000 7f34d8c10740 1 --2- 172.21.15.78:0/935002383 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b44fa34d0 0x562b453db990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.821+0000 7f34d8c10740 1 -- 172.21.15.78:0/935002383 >> 172.21.15.78:0/935002383 conn(0x562b44fc04e0 msgr2=0x562b4539c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.821+0000 7f34d8c10740 1 -- 172.21.15.78:0/935002383 shutdown_connections 2024-09-17T03:13:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.821+0000 7f34d8c10740 1 -- 172.21.15.78:0/935002383 wait complete. 2024-09-17T03:13:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.822+0000 7f34d8c10740 1 -- start start 2024-09-17T03:13:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.822+0000 7f34d8c10740 1 Processor -- start 2024-09-17T03:13:19.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.823+0000 7f34d8c10740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fa34d0 0x562b453dbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.823+0000 7f34d8c10740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b44fab6b0 0x562b4541fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.823+0000 7f34d8c10740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 0x562b453ad590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.823+0000 7f34d8c10740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc06ef00 con 0x562b44fcc390 2024-09-17T03:13:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.823+0000 7f34d8c10740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562b452e89b0 con 0x562b44fa34d0 2024-09-17T03:13:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.823+0000 7f34d8c10740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x562b453c7800 con 0x562b44fab6b0 2024-09-17T03:13:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.823+0000 7f34d8c10740 10 client.0 _ll_register_callbacks cb 0x7f34c405e670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.823+0000 7f34cbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 0x562b453ad590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.823+0000 7f34cbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 0x562b453ad590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34244/0 (socket says 172.21.15.78:34244) 2024-09-17T03:13:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.823+0000 7f34cbfff640 1 -- 172.21.15.78:0/1273506973 learned_addr learned my addr 172.21.15.78:0/1273506973 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.823+0000 7f34cb7fe640 1 --2- 172.21.15.78:0/1273506973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fa34d0 0x562b453dbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.823+0000 7f34caffd640 1 --2- 172.21.15.78:0/1273506973 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b44fab6b0 0x562b4541fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.823+0000 7f34cbfff640 1 -- 172.21.15.78:0/1273506973 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b44fab6b0 msgr2=0x562b4541fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.823+0000 7f34cbfff640 1 --2- 172.21.15.78:0/1273506973 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b44fab6b0 0x562b4541fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34cbfff640 1 -- 172.21.15.78:0/1273506973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fa34d0 msgr2=0x562b453dbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34cbfff640 1 --2- 172.21.15.78:0/1273506973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fa34d0 0x562b453dbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34cbfff640 1 -- 172.21.15.78:0/1273506973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b45420390 con 0x562b44fcc390 2024-09-17T03:13:19.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34cb7fe640 1 --2- 172.21.15.78:0/1273506973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fa34d0 0x562b453dbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:19.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34caffd640 1 --2- 172.21.15.78:0/1273506973 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b44fab6b0 0x562b4541fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:19.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34cbfff640 1 --2- 172.21.15.78:0/1273506973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 0x562b453ad590 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f34c4061d20 tx=0x7f34c407c2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f859ac55ad21f2a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:19.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34aa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:19.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34aa7fc640 1 -- 172.21.15.78:0/1273506973 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34c406b900 con 0x562b44fcc390 2024-09-17T03:13:19.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34aa7fc640 1 -- 172.21.15.78:0/1273506973 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f34c4061280 con 0x562b44fcc390 2024-09-17T03:13:19.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34d8c10740 1 -- 172.21.15.78:0/1273506973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f34c00035f0 con 0x562b44fcc390 2024-09-17T03:13:19.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34aa7fc640 1 -- 172.21.15.78:0/1273506973 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f34c4061790 con 0x562b44fcc390 2024-09-17T03:13:19.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34d8c10740 10 client.7164 fetch_fsmap learned FSMap version 68 2024-09-17T03:13:19.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34d8c10740 1 -- 172.21.15.78:0/1273506973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x562b4542d850 con 0x562b44fcc390 2024-09-17T03:13:19.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34aa7fc640 1 -- 172.21.15.78:0/1273506973 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f34c00035f0 con 0x562b44fcc390 2024-09-17T03:13:19.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34aa7fc640 1 -- 172.21.15.78:0/1273506973 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 68) ==== 3554+0+0 (secure 0 0 0) 0x7f34c405d970 con 0x562b44fcc390 2024-09-17T03:13:19.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34d8c10740 10 client.7164 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T03:13:19.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34d8c10740 10 client.7164 resolve_mds: resolved 5:1 to role '5:1' aka daemon mds.c 2024-09-17T03:13:19.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34d8c10740 20 client.7164 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:19.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34d8c10740 1 --2- 172.21.15.78:0/1273506973 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x562b453adad0 0x562b453c6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34d8c10740 4 client.7164 mds_command: new command op to 6861 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T03:13:19.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34d8c10740 1 -- 172.21.15.78:0/1273506973 --> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562b452e4460 con 0x562b453adad0 2024-09-17T03:13:19.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.824+0000 7f34cb7fe640 1 --2- 172.21.15.78:0/1273506973 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x562b453adad0 0x562b453c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.825+0000 7f34aa7fc640 10 client.7164 ms_handle_connect on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:19.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.825+0000 7f34cb7fe640 1 --2- 172.21.15.78:0/1273506973 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x562b453adad0 0x562b453c6900 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=348deb13d051e8fd server_cookie=f853209851b94670 in_seq=0 out_seq=0 2024-09-17T03:13:19.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.837+0000 7f34aa7fc640 1 -- 172.21.15.78:0/1273506973 <== mds.1 v2:172.21.15.78:6832/2905189397 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562b452e4460 con 0x562b453adad0 2024-09-17T03:13:19.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.837+0000 7f34aa7fc640 10 client.7164 handle_command_reply: tid=0 2024-09-17T03:13:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.837+0000 7f34d8c10740 1 client.7164 shutdown 2024-09-17T03:13:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.837+0000 7f34d8c10740 1 -- 172.21.15.78:0/1273506973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 msgr2=0x562b453ad590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.837+0000 7f34d8c10740 1 --2- 172.21.15.78:0/1273506973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 0x562b453ad590 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f34c4061d20 tx=0x7f34c407c2c0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.837+0000 7f34d8c10740 1 -- 172.21.15.78:0/1273506973 shutdown_connections 2024-09-17T03:13:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.837+0000 7f34d8c10740 1 --2- 172.21.15.78:0/1273506973 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x562b453adad0 0x562b453c6900 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.837+0000 7f34d8c10740 1 --2- 172.21.15.78:0/1273506973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562b44fcc390 0x562b453ad590 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.837+0000 7f34aa7fc640 0 client.7164 ms_handle_reset on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.837+0000 7f34d8c10740 1 --2- 172.21.15.78:0/1273506973 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b44fab6b0 0x562b4541fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.837+0000 7f34d8c10740 1 --2- 172.21.15.78:0/1273506973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b44fa34d0 0x562b453dbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.837+0000 7f34d8c10740 1 -- 172.21.15.78:0/1273506973 >> 172.21.15.78:0/1273506973 conn(0x562b44fc04e0 msgr2=0x562b4536e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.837+0000 7f34d8c10740 1 -- 172.21.15.78:0/1273506973 shutdown_connections 2024-09-17T03:13:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.837+0000 7f34d8c10740 1 -- 172.21.15.78:0/1273506973 wait complete. 2024-09-17T03:13:19.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.837+0000 7f34d8c10740 20 client.7164 trim_cache size 0 max 16384 2024-09-17T03:13:19.838 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:13:19.838 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:13:19.838 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:13:19.838 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:13:19.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.838+0000 7f34d1c9b640 1 -- 172.21.15.78:0/2932792056 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f34b8078b90 msgr2=0x7f34b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.838+0000 7f34d1c9b640 1 --2- 172.21.15.78:0/2932792056 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f34b8078b90 0x7f34b807b0a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f34bc00a400 tx=0x7f34bc00d040 comp rx=0 tx=0).stop 2024-09-17T03:13:19.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.838+0000 7f34d1c9b640 1 -- 172.21.15.78:0/2932792056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34cc0c7be0 msgr2=0x7f34cc1f99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.838+0000 7f34d1c9b640 1 --2- 172.21.15.78:0/2932792056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34cc0c7be0 0x7f34cc1f99d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f34c400b440 tx=0x7f34c400b900 comp rx=0 tx=0).stop 2024-09-17T03:13:19.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.838+0000 7f34d1c9b640 1 -- 172.21.15.78:0/2932792056 shutdown_connections 2024-09-17T03:13:19.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.838+0000 7f34d1c9b640 1 --2- 172.21.15.78:0/2932792056 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34cc0c7be0 0x7f34cc1f99d0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.838+0000 7f34d1c9b640 1 --2- 172.21.15.78:0/2932792056 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f34b8078b90 0x7f34b807b0a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.838+0000 7f34d1c9b640 1 --2- 172.21.15.78:0/2932792056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f34cc0b4570 0x7f34cc1f9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.838+0000 7f34d1c9b640 1 --2- 172.21.15.78:0/2932792056 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f34cc073f00 0x7f34cc0c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.838+0000 7f34d1c9b640 1 -- 172.21.15.78:0/2932792056 >> 172.21.15.78:0/2932792056 conn(0x7f34cc0cdcc0 msgr2=0x7f34cc0cee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:19.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.838+0000 7f34d1c9b640 1 -- 172.21.15.78:0/2932792056 shutdown_connections 2024-09-17T03:13:19.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.838+0000 7f34d1c9b640 1 -- 172.21.15.78:0/2932792056 wait complete. 2024-09-17T03:13:19.848 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:2 flush journal 2024-09-17T03:13:19.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.962+0000 7feb26470640 1 -- 172.21.15.78:0/114612988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb200b66b0 msgr2=0x7feb200d3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.962+0000 7feb26470640 1 --2- 172.21.15.78:0/114612988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb200b66b0 0x7feb200d3530 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7feb14009830 tx=0x7feb1402a510 comp rx=0 tx=0).stop 2024-09-17T03:13:19.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.962+0000 7feb26470640 1 -- 172.21.15.78:0/114612988 shutdown_connections 2024-09-17T03:13:19.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.962+0000 7feb26470640 1 --2- 172.21.15.78:0/114612988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb200b66b0 0x7feb200d3530 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.962+0000 7feb26470640 1 --2- 172.21.15.78:0/114612988 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb201620e0 0x7feb200cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.962+0000 7feb26470640 1 -- 172.21.15.78:0/114612988 >> 172.21.15.78:0/114612988 conn(0x7feb2009d870 msgr2=0x7feb200d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:19.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.962+0000 7feb26470640 1 -- 172.21.15.78:0/114612988 shutdown_connections 2024-09-17T03:13:19.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.962+0000 7feb26470640 1 -- 172.21.15.78:0/114612988 wait complete. 2024-09-17T03:13:19.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.964+0000 7feb26470640 1 Processor -- start 2024-09-17T03:13:19.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.964+0000 7feb26470640 1 -- start start 2024-09-17T03:13:19.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb26470640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb200b9d00 0x7feb201f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb26470640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb201620e0 0x7feb200c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb26470640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb2015b930 0x7feb2015e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb26470640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feb2006e420 con 0x7feb2015b930 2024-09-17T03:13:19.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb26470640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7feb2006e2a0 con 0x7feb200b9d00 2024-09-17T03:13:19.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb26470640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7feb2006e5a0 con 0x7feb201620e0 2024-09-17T03:13:19.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb24a0d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb2015b930 0x7feb2015e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb24a0d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb2015b930 0x7feb2015e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34258/0 (socket says 172.21.15.78:34258) 2024-09-17T03:13:19.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb24a0d640 1 -- 172.21.15.78:0/4133965245 learned_addr learned my addr 172.21.15.78:0/4133965245 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:19.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb1f7fe640 1 --2- 172.21.15.78:0/4133965245 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb201620e0 0x7feb200c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb1ffff640 1 --2- 172.21.15.78:0/4133965245 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb200b9d00 0x7feb201f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb24a0d640 1 -- 172.21.15.78:0/4133965245 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb201620e0 msgr2=0x7feb200c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb24a0d640 1 --2- 172.21.15.78:0/4133965245 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb201620e0 0x7feb200c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb24a0d640 1 -- 172.21.15.78:0/4133965245 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb200b9d00 msgr2=0x7feb201f5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb24a0d640 1 --2- 172.21.15.78:0/4133965245 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb200b9d00 0x7feb201f5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb24a0d640 1 -- 172.21.15.78:0/4133965245 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb201f9610 con 0x7feb2015b930 2024-09-17T03:13:19.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb1ffff640 1 --2- 172.21.15.78:0/4133965245 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb200b9d00 0x7feb201f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:19.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb1f7fe640 1 --2- 172.21.15.78:0/4133965245 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb201620e0 0x7feb200c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:19.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb24a0d640 1 --2- 172.21.15.78:0/4133965245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb2015b930 0x7feb2015e8e0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7feb1800e960 tx=0x7feb1800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:19.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb1cff9640 1 -- 172.21.15.78:0/4133965245 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb18004d20 con 0x7feb2015b930 2024-09-17T03:13:19.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb1cff9640 1 -- 172.21.15.78:0/4133965245 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb1800cac0 con 0x7feb2015b930 2024-09-17T03:13:19.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb26470640 1 -- 172.21.15.78:0/4133965245 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb201f98f0 con 0x7feb2015b930 2024-09-17T03:13:19.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.966+0000 7feb1cff9640 1 -- 172.21.15.78:0/4133965245 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb18005020 con 0x7feb2015b930 2024-09-17T03:13:19.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.967+0000 7feb26470640 1 -- 172.21.15.78:0/4133965245 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb201f9eb0 con 0x7feb2015b930 2024-09-17T03:13:19.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.968+0000 7feb1cff9640 1 -- 172.21.15.78:0/4133965245 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feb180051c0 con 0x7feb2015b930 2024-09-17T03:13:19.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.969+0000 7feb1cff9640 1 --2- 172.21.15.78:0/4133965245 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feb0c078b90 0x7feb0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.969+0000 7feb1cff9640 1 -- 172.21.15.78:0/4133965245 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7feb1809b610 con 0x7feb2015b930 2024-09-17T03:13:19.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.969+0000 7feb1ffff640 1 --2- 172.21.15.78:0/4133965245 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feb0c078b90 0x7feb0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.969+0000 7feb1ffff640 1 --2- 172.21.15.78:0/4133965245 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feb0c078b90 0x7feb0c07b0a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7feb200d0f70 tx=0x7feb10009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:19.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.970+0000 7feb2d3db740 1 Processor -- start 2024-09-17T03:13:19.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.970+0000 7feb2d3db740 1 -- start start 2024-09-17T03:13:19.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.971+0000 7feb2d3db740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f7025a3390 0x55f70298fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.971+0000 7feb2d3db740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f70257a4d0 0x55f702964860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.971+0000 7feb2d3db740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025826b0 0x55f702964da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.971+0000 7feb2d3db740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f7028bda60 con 0x55f7025826b0 2024-09-17T03:13:19.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.971+0000 7feb2d3db740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f7028ace90 con 0x55f7025a3390 2024-09-17T03:13:19.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.971+0000 7feb2d3db740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f7028b0ca0 con 0x55f70257a4d0 2024-09-17T03:13:19.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.971+0000 7feb24a0d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025826b0 0x55f702964da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.971+0000 7feb24a0d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025826b0 0x55f702964da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34262/0 (socket says 172.21.15.78:34262) 2024-09-17T03:13:19.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.971+0000 7feb24a0d640 1 -- 172.21.15.78:0/523240641 learned_addr learned my addr 172.21.15.78:0/523240641 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:19.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.971+0000 7feb1ffff640 1 --2- 172.21.15.78:0/523240641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f7025a3390 0x55f70298fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.971+0000 7feb1f7fe640 1 --2- 172.21.15.78:0/523240641 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f70257a4d0 0x55f702964860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.971+0000 7feb24a0d640 1 -- 172.21.15.78:0/523240641 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f70257a4d0 msgr2=0x55f702964860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.971+0000 7feb24a0d640 1 --2- 172.21.15.78:0/523240641 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f70257a4d0 0x55f702964860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.971+0000 7feb24a0d640 1 -- 172.21.15.78:0/523240641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f7025a3390 msgr2=0x55f70298fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.971+0000 7feb24a0d640 1 --2- 172.21.15.78:0/523240641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f7025a3390 0x55f70298fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.971+0000 7feb24a0d640 1 -- 172.21.15.78:0/523240641 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7026857d0 con 0x55f7025826b0 2024-09-17T03:13:19.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.971+0000 7feb1f7fe640 1 --2- 172.21.15.78:0/523240641 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f70257a4d0 0x55f702964860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:19.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.971+0000 7feb24a0d640 1 --2- 172.21.15.78:0/523240641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025826b0 0x55f702964da0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7feb180630a0 tx=0x7feb1805fb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfca66faa34d25b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:19.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.971+0000 7feb05ffb640 1 -- 172.21.15.78:0/523240641 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1801f040 con 0x55f7025826b0 2024-09-17T03:13:19.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.972+0000 7feb05ffb640 1 -- 172.21.15.78:0/523240641 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb18067e80 con 0x55f7025826b0 2024-09-17T03:13:19.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.972+0000 7feb05ffb640 1 -- 172.21.15.78:0/523240641 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1806c040 con 0x55f7025826b0 2024-09-17T03:13:19.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.972+0000 7feb2d3db740 1 -- 172.21.15.78:0/523240641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025826b0 msgr2=0x55f702964da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.972+0000 7feb2d3db740 1 --2- 172.21.15.78:0/523240641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025826b0 0x55f702964da0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7feb180630a0 tx=0x7feb1805fb20 comp rx=0 tx=0).stop 2024-09-17T03:13:19.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.972+0000 7feb2d3db740 1 -- 172.21.15.78:0/523240641 shutdown_connections 2024-09-17T03:13:19.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.972+0000 7feb2d3db740 1 --2- 172.21.15.78:0/523240641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025826b0 0x55f702964da0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.972+0000 7feb2d3db740 1 --2- 172.21.15.78:0/523240641 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f70257a4d0 0x55f702964860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.972+0000 7feb2d3db740 1 --2- 172.21.15.78:0/523240641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f7025a3390 0x55f70298fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.972+0000 7feb2d3db740 1 -- 172.21.15.78:0/523240641 >> 172.21.15.78:0/523240641 conn(0x55f7025974e0 msgr2=0x55f70294ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:19.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.972+0000 7feb2d3db740 1 -- 172.21.15.78:0/523240641 shutdown_connections 2024-09-17T03:13:19.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.972+0000 7feb2d3db740 1 -- 172.21.15.78:0/523240641 wait complete. 2024-09-17T03:13:19.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.973+0000 7feb2d3db740 1 -- start start 2024-09-17T03:13:19.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.974+0000 7feb2d3db740 1 Processor -- start 2024-09-17T03:13:19.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feb2d3db740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f70257a4d0 0x55f70298b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feb2d3db740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f7025826b0 0x55f702962090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feb2d3db740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025a3390 0x55f702986990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feb2d3db740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f70261d740 con 0x55f7025a3390 2024-09-17T03:13:19.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feb2d3db740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f702852970 con 0x55f70257a4d0 2024-09-17T03:13:19.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feb2d3db740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f702987700 con 0x55f7025826b0 2024-09-17T03:13:19.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feb2d3db740 10 client.0 _ll_register_callbacks cb 0x55f702861780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:19.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feb24a0d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025a3390 0x55f702986990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feb24a0d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025a3390 0x55f702986990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34270/0 (socket says 172.21.15.78:34270) 2024-09-17T03:13:19.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feb24a0d640 1 -- 172.21.15.78:0/704144468 learned_addr learned my addr 172.21.15.78:0/704144468 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:19.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feb1f7fe640 1 --2- 172.21.15.78:0/704144468 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f7025826b0 0x55f702962090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feb1ffff640 1 --2- 172.21.15.78:0/704144468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f70257a4d0 0x55f70298b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feb24a0d640 1 -- 172.21.15.78:0/704144468 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f7025826b0 msgr2=0x55f702962090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feb24a0d640 1 --2- 172.21.15.78:0/704144468 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f7025826b0 0x55f702962090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feb24a0d640 1 -- 172.21.15.78:0/704144468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f70257a4d0 msgr2=0x55f70298b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feb24a0d640 1 --2- 172.21.15.78:0/704144468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f70257a4d0 0x55f70298b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feb24a0d640 1 -- 172.21.15.78:0/704144468 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f70260e970 con 0x55f7025a3390 2024-09-17T03:13:19.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feb24a0d640 1 --2- 172.21.15.78:0/704144468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025a3390 0x55f702986990 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7feb18099b50 tx=0x7feb18085d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe275c389b95aa50 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:19.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feafeffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:19.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feafeffd640 1 -- 172.21.15.78:0/704144468 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1801f070 con 0x55f7025a3390 2024-09-17T03:13:19.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feafeffd640 1 -- 172.21.15.78:0/704144468 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7feb1805ef00 con 0x55f7025a3390 2024-09-17T03:13:19.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.975+0000 7feb2d3db740 1 -- 172.21.15.78:0/704144468 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb18067e80 con 0x55f7025a3390 2024-09-17T03:13:19.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.976+0000 7feafeffd640 1 -- 172.21.15.78:0/704144468 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7feb1806c040 con 0x55f7025a3390 2024-09-17T03:13:19.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.976+0000 7feb2d3db740 10 client.7179 fetch_fsmap learned FSMap version 68 2024-09-17T03:13:19.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.976+0000 7feb2d3db740 1 -- 172.21.15.78:0/704144468 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55f7025ec6a0 con 0x55f7025a3390 2024-09-17T03:13:19.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.976+0000 7feafeffd640 1 -- 172.21.15.78:0/704144468 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb18083070 con 0x55f7025a3390 2024-09-17T03:13:19.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.976+0000 7feafeffd640 1 -- 172.21.15.78:0/704144468 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 68) ==== 3554+0+0 (secure 0 0 0) 0x7feb1804ace0 con 0x55f7025a3390 2024-09-17T03:13:19.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.976+0000 7feb2d3db740 10 client.7179 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T03:13:19.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.976+0000 7feb2d3db740 10 client.7179 resolve_mds: resolved 5:2 to role '5:2' aka daemon mds.d 2024-09-17T03:13:19.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.976+0000 7feb2d3db740 20 client.7179 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:19.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.976+0000 7feb2d3db740 1 --2- 172.21.15.78:0/704144468 >> [v2:172.21.15.193:6835/1431701139,v1:172.21.15.193:6837/1431701139] conn(0x55f702561f60 0x55f702986ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.976+0000 7feb2d3db740 4 client.7179 mds_command: new command op to 6271 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:13:19.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.976+0000 7feb2d3db740 1 -- 172.21.15.78:0/704144468 --> [v2:172.21.15.193:6835/1431701139,v1:172.21.15.193:6837/1431701139] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7028bf9b0 con 0x55f702561f60 2024-09-17T03:13:19.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.976+0000 7feb1ffff640 1 --2- 172.21.15.78:0/704144468 >> [v2:172.21.15.193:6835/1431701139,v1:172.21.15.193:6837/1431701139] conn(0x55f702561f60 0x55f702986ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.977+0000 7feb1ffff640 1 --2- 172.21.15.78:0/704144468 >> [v2:172.21.15.193:6835/1431701139,v1:172.21.15.193:6837/1431701139] conn(0x55f702561f60 0x55f702986ed0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4e9b3da8297135a server_cookie=cf7f5d75a7a789cb in_seq=0 out_seq=0 2024-09-17T03:13:19.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.977+0000 7feafeffd640 10 client.7179 ms_handle_connect on v2:172.21.15.193:6835/1431701139 2024-09-17T03:13:19.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.977+0000 7feafeffd640 1 -- 172.21.15.78:0/704144468 <== mds.2 v2:172.21.15.193:6835/1431701139 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f7028bf9b0 con 0x55f702561f60 2024-09-17T03:13:19.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.977+0000 7feafeffd640 10 client.7179 handle_command_reply: tid=0 2024-09-17T03:13:19.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.977+0000 7feb2d3db740 1 client.7179 shutdown 2024-09-17T03:13:19.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.977+0000 7feb2d3db740 1 -- 172.21.15.78:0/704144468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025a3390 msgr2=0x55f702986990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.977+0000 7feb2d3db740 1 --2- 172.21.15.78:0/704144468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025a3390 0x55f702986990 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7feb18099b50 tx=0x7feb18085d40 comp rx=0 tx=0).stop 2024-09-17T03:13:19.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.977+0000 7feb2d3db740 1 -- 172.21.15.78:0/704144468 shutdown_connections 2024-09-17T03:13:19.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.977+0000 7feb2d3db740 1 --2- 172.21.15.78:0/704144468 >> [v2:172.21.15.193:6835/1431701139,v1:172.21.15.193:6837/1431701139] conn(0x55f702561f60 0x55f702986ed0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.978+0000 7feafeffd640 0 client.7179 ms_handle_reset on v2:172.21.15.193:6835/1431701139 2024-09-17T03:13:19.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.977+0000 7feb2d3db740 1 --2- 172.21.15.78:0/704144468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025a3390 0x55f702986990 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.978+0000 7feb2d3db740 1 --2- 172.21.15.78:0/704144468 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f7025826b0 0x55f702962090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.978+0000 7feb2d3db740 1 --2- 172.21.15.78:0/704144468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f70257a4d0 0x55f70298b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.978+0000 7feb2d3db740 1 -- 172.21.15.78:0/704144468 >> 172.21.15.78:0/704144468 conn(0x55f7025974e0 msgr2=0x55f702943e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:19.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.978+0000 7feb2d3db740 1 -- 172.21.15.78:0/704144468 shutdown_connections 2024-09-17T03:13:19.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.978+0000 7feb2d3db740 1 -- 172.21.15.78:0/704144468 wait complete. 2024-09-17T03:13:19.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.978+0000 7feb2d3db740 20 client.7179 trim_cache size 0 max 16384 2024-09-17T03:13:19.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.992+0000 7feb2d3db740 1 Processor -- start 2024-09-17T03:13:19.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.992+0000 7feb2d3db740 1 -- start start 2024-09-17T03:13:19.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.993+0000 7feb2d3db740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f702561f60 0x55f702986920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.993+0000 7feb2d3db740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f70257a4d0 0x55f702972710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.993+0000 7feb2d3db740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025826b0 0x55f7029b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:19.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.993+0000 7feb2d3db740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feb20202490 con 0x55f7025826b0 2024-09-17T03:13:19.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.993+0000 7feb2d3db740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7feb20201680 con 0x55f70257a4d0 2024-09-17T03:13:19.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.993+0000 7feb2d3db740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7feb20201d60 con 0x55f702561f60 2024-09-17T03:13:19.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.994+0000 7feb24a0d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025826b0 0x55f7029b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.994+0000 7feb24a0d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025826b0 0x55f7029b2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34274/0 (socket says 172.21.15.78:34274) 2024-09-17T03:13:19.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.994+0000 7feb24a0d640 1 -- 172.21.15.78:0/2225900632 learned_addr learned my addr 172.21.15.78:0/2225900632 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:19.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.994+0000 7feb1f7fe640 1 --2- 172.21.15.78:0/2225900632 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f70257a4d0 0x55f702972710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.994+0000 7feb24a0d640 1 -- 172.21.15.78:0/2225900632 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f702561f60 msgr2=0x55f702986920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.994+0000 7feb1ffff640 1 --2- 172.21.15.78:0/2225900632 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f702561f60 0x55f702986920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:19.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.994+0000 7feb24a0d640 1 --2- 172.21.15.78:0/2225900632 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f702561f60 0x55f702986920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.994+0000 7feb24a0d640 1 -- 172.21.15.78:0/2225900632 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f70257a4d0 msgr2=0x55f702972710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:19.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.994+0000 7feb24a0d640 1 --2- 172.21.15.78:0/2225900632 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f70257a4d0 0x55f702972710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.994+0000 7feb24a0d640 1 -- 172.21.15.78:0/2225900632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70298bc50 con 0x55f7025826b0 2024-09-17T03:13:19.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.994+0000 7feb1ffff640 1 --2- 172.21.15.78:0/2225900632 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f702561f60 0x55f702986920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:19.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.994+0000 7feb1f7fe640 1 --2- 172.21.15.78:0/2225900632 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f70257a4d0 0x55f702972710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:19.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.994+0000 7feb24a0d640 1 --2- 172.21.15.78:0/2225900632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025826b0 0x55f7029b2c90 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7feb18099af0 tx=0x7feb18063500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbd70bcff7515d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:19.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.994+0000 7feb057fa640 1 -- 172.21.15.78:0/2225900632 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1801f070 con 0x55f7025826b0 2024-09-17T03:13:19.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.994+0000 7feb057fa640 1 -- 172.21.15.78:0/2225900632 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb18083070 con 0x55f7025826b0 2024-09-17T03:13:19.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.994+0000 7feb057fa640 1 -- 172.21.15.78:0/2225900632 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1804e040 con 0x55f7025826b0 2024-09-17T03:13:19.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.995+0000 7feb2d3db740 1 -- 172.21.15.78:0/2225900632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025826b0 msgr2=0x55f7029b2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:19.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.995+0000 7feb2d3db740 1 --2- 172.21.15.78:0/2225900632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025826b0 0x55f7029b2c90 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7feb18099af0 tx=0x7feb18063500 comp rx=0 tx=0).stop 2024-09-17T03:13:19.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.995+0000 7feb2d3db740 1 -- 172.21.15.78:0/2225900632 shutdown_connections 2024-09-17T03:13:19.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.995+0000 7feb2d3db740 1 --2- 172.21.15.78:0/2225900632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f7025826b0 0x55f7029b2c90 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.995+0000 7feb2d3db740 1 --2- 172.21.15.78:0/2225900632 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f70257a4d0 0x55f702972710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.995+0000 7feb2d3db740 1 --2- 172.21.15.78:0/2225900632 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f702561f60 0x55f702986920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:19.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.995+0000 7feb2d3db740 1 -- 172.21.15.78:0/2225900632 >> 172.21.15.78:0/2225900632 conn(0x55f7025974e0 msgr2=0x55f702961360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:19.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.995+0000 7feb2d3db740 1 -- 172.21.15.78:0/2225900632 shutdown_connections 2024-09-17T03:13:19.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.995+0000 7feb2d3db740 1 -- 172.21.15.78:0/2225900632 wait complete. 2024-09-17T03:13:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.996+0000 7feb2d3db740 1 -- start start 2024-09-17T03:13:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.996+0000 7feb2d3db740 1 Processor -- start 2024-09-17T03:13:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.997+0000 7feb2d3db740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f702561f60 0x55f70299ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.997+0000 7feb2d3db740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f70257a4d0 0x55f702962040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.997+0000 7feb2d3db740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f7025826b0 0x55f702962580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.997+0000 7feb2d3db740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f70294a770 con 0x55f70257a4d0 2024-09-17T03:13:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.997+0000 7feb2d3db740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7feb200b1370 con 0x55f7025826b0 2024-09-17T03:13:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.997+0000 7feb2d3db740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f702a0ec50 con 0x55f702561f60 2024-09-17T03:13:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.997+0000 7feb2d3db740 10 client.0 _ll_register_callbacks cb 0x7feb10001ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.997+0000 7feb1f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f70257a4d0 0x55f702962040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.997+0000 7feb1f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f70257a4d0 0x55f702962040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34286/0 (socket says 172.21.15.78:34286) 2024-09-17T03:13:20.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.997+0000 7feb1f7fe640 1 -- 172.21.15.78:0/1514571783 learned_addr learned my addr 172.21.15.78:0/1514571783 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.997+0000 7feb1ffff640 1 --2- 172.21.15.78:0/1514571783 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f702561f60 0x55f70299ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feb24a0d640 1 --2- 172.21.15.78:0/1514571783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f7025826b0 0x55f702962580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feb1f7fe640 1 -- 172.21.15.78:0/1514571783 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f702561f60 msgr2=0x55f70299ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feb1f7fe640 1 --2- 172.21.15.78:0/1514571783 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f702561f60 0x55f70299ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feb1f7fe640 1 -- 172.21.15.78:0/1514571783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f7025826b0 msgr2=0x55f702962580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feb1f7fe640 1 --2- 172.21.15.78:0/1514571783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f7025826b0 0x55f702962580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feb1f7fe640 1 -- 172.21.15.78:0/1514571783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f70298a580 con 0x55f70257a4d0 2024-09-17T03:13:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feb1ffff640 1 --2- 172.21.15.78:0/1514571783 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f702561f60 0x55f70299ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feb24a0d640 1 --2- 172.21.15.78:0/1514571783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f7025826b0 0x55f702962580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feb1f7fe640 1 --2- 172.21.15.78:0/1514571783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f70257a4d0 0x55f702962040 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7feb14009950 tx=0x7feb14003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fff7066765c5a32 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feafeffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:20.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feafeffd640 1 -- 172.21.15.78:0/1514571783 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14003e20 con 0x55f70257a4d0 2024-09-17T03:13:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feafeffd640 1 -- 172.21.15.78:0/1514571783 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7feb1403b410 con 0x55f70257a4d0 2024-09-17T03:13:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feb2d3db740 1 -- 172.21.15.78:0/1514571783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb18083070 con 0x55f70257a4d0 2024-09-17T03:13:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feafeffd640 1 -- 172.21.15.78:0/1514571783 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7feb1404c050 con 0x55f70257a4d0 2024-09-17T03:13:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feb2d3db740 10 client.7185 fetch_fsmap learned FSMap version 68 2024-09-17T03:13:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feb2d3db740 1 -- 172.21.15.78:0/1514571783 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55f7029869e0 con 0x55f70257a4d0 2024-09-17T03:13:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feafeffd640 1 -- 172.21.15.78:0/1514571783 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb18083070 con 0x55f70257a4d0 2024-09-17T03:13:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feafeffd640 1 -- 172.21.15.78:0/1514571783 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 68) ==== 3554+0+0 (secure 0 0 0) 0x7feb1404f020 con 0x55f70257a4d0 2024-09-17T03:13:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feb2d3db740 10 client.7185 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T03:13:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feb2d3db740 10 client.7185 resolve_mds: resolved 5:2 to role '5:2' aka daemon mds.d 2024-09-17T03:13:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feb2d3db740 20 client.7185 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feb2d3db740 1 --2- 172.21.15.78:0/1514571783 >> [v2:172.21.15.193:6835/1431701139,v1:172.21.15.193:6837/1431701139] conn(0x55f7025373a0 0x55f7029852a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feb2d3db740 4 client.7185 mds_command: new command op to 6271 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T03:13:20.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.998+0000 7feb2d3db740 1 -- 172.21.15.78:0/1514571783 --> [v2:172.21.15.193:6835/1431701139,v1:172.21.15.193:6837/1431701139] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f7028bb460 con 0x55f7025373a0 2024-09-17T03:13:20.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.999+0000 7feb1ffff640 1 --2- 172.21.15.78:0/1514571783 >> [v2:172.21.15.193:6835/1431701139,v1:172.21.15.193:6837/1431701139] conn(0x55f7025373a0 0x55f7029852a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.999+0000 7feafeffd640 10 client.7185 ms_handle_connect on v2:172.21.15.193:6835/1431701139 2024-09-17T03:13:20.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:19.999+0000 7feb1ffff640 1 --2- 172.21.15.78:0/1514571783 >> [v2:172.21.15.193:6835/1431701139,v1:172.21.15.193:6837/1431701139] conn(0x55f7025373a0 0x55f7029852a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a433ec4388eb8ba2 server_cookie=951f5139a1a04ba0 in_seq=0 out_seq=0 2024-09-17T03:13:20.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.011+0000 7feafeffd640 1 -- 172.21.15.78:0/1514571783 <== mds.2 v2:172.21.15.193:6835/1431701139 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f7028bb460 con 0x55f7025373a0 2024-09-17T03:13:20.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.011+0000 7feafeffd640 10 client.7185 handle_command_reply: tid=0 2024-09-17T03:13:20.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.011+0000 7feb2d3db740 1 client.7185 shutdown 2024-09-17T03:13:20.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.011+0000 7feb2d3db740 1 -- 172.21.15.78:0/1514571783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f70257a4d0 msgr2=0x55f702962040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.011+0000 7feb2d3db740 1 --2- 172.21.15.78:0/1514571783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f70257a4d0 0x55f702962040 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7feb14009950 tx=0x7feb14003820 comp rx=0 tx=0).stop 2024-09-17T03:13:20.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.011+0000 7feb2d3db740 1 -- 172.21.15.78:0/1514571783 shutdown_connections 2024-09-17T03:13:20.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.011+0000 7feb2d3db740 1 --2- 172.21.15.78:0/1514571783 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f7025826b0 0x55f702962580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.011+0000 7feb2d3db740 1 --2- 172.21.15.78:0/1514571783 >> [v2:172.21.15.193:6835/1431701139,v1:172.21.15.193:6837/1431701139] conn(0x55f7025373a0 0x55f7029852a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.011+0000 7feb2d3db740 1 --2- 172.21.15.78:0/1514571783 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f70257a4d0 0x55f702962040 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.011+0000 7feb2d3db740 1 --2- 172.21.15.78:0/1514571783 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f702561f60 0x55f70299ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.011+0000 7feafeffd640 0 client.7185 ms_handle_reset on v2:172.21.15.193:6835/1431701139 2024-09-17T03:13:20.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.011+0000 7feb2d3db740 1 -- 172.21.15.78:0/1514571783 >> 172.21.15.78:0/1514571783 conn(0x55f7025974e0 msgr2=0x55f702945790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.011+0000 7feb2d3db740 1 -- 172.21.15.78:0/1514571783 shutdown_connections 2024-09-17T03:13:20.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.011+0000 7feb2d3db740 1 -- 172.21.15.78:0/1514571783 wait complete. 2024-09-17T03:13:20.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.011+0000 7feb2d3db740 20 client.7185 trim_cache size 0 max 16384 2024-09-17T03:13:20.012 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:13:20.012 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:13:20.012 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:13:20.012 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:13:20.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.012+0000 7feb26470640 1 -- 172.21.15.78:0/4133965245 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feb0c078b90 msgr2=0x7feb0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.012+0000 7feb26470640 1 --2- 172.21.15.78:0/4133965245 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feb0c078b90 0x7feb0c07b0a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7feb200d0f70 tx=0x7feb10009040 comp rx=0 tx=0).stop 2024-09-17T03:13:20.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.012+0000 7feb26470640 1 -- 172.21.15.78:0/4133965245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb2015b930 msgr2=0x7feb2015e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.012+0000 7feb26470640 1 --2- 172.21.15.78:0/4133965245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb2015b930 0x7feb2015e8e0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7feb1800e960 tx=0x7feb1800ee20 comp rx=0 tx=0).stop 2024-09-17T03:13:20.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.012+0000 7feb26470640 1 -- 172.21.15.78:0/4133965245 shutdown_connections 2024-09-17T03:13:20.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.012+0000 7feb26470640 1 --2- 172.21.15.78:0/4133965245 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb2015b930 0x7feb2015e8e0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.012+0000 7feb26470640 1 --2- 172.21.15.78:0/4133965245 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb201620e0 0x7feb200c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.012+0000 7feb26470640 1 --2- 172.21.15.78:0/4133965245 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feb0c078b90 0x7feb0c07b0a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.012+0000 7feb26470640 1 --2- 172.21.15.78:0/4133965245 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb200b9d00 0x7feb201f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.012+0000 7feb26470640 1 -- 172.21.15.78:0/4133965245 >> 172.21.15.78:0/4133965245 conn(0x7feb2009d870 msgr2=0x7feb200d2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.012+0000 7feb26470640 1 -- 172.21.15.78:0/4133965245 shutdown_connections 2024-09-17T03:13:20.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.012+0000 7feb26470640 1 -- 172.21.15.78:0/4133965245 wait complete. 2024-09-17T03:13:20.022 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:13:20.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.136+0000 7f32f90f9640 1 -- 172.21.15.78:0/3038808656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32dc003a50 msgr2=0x7f32dc003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.136+0000 7f32f90f9640 1 --2- 172.21.15.78:0/3038808656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32dc003a50 0x7f32dc003ec0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f32e40016c0 tx=0x7f32dc005830 comp rx=0 tx=0).stop 2024-09-17T03:13:20.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.136+0000 7f32f90f9640 1 -- 172.21.15.78:0/3038808656 shutdown_connections 2024-09-17T03:13:20.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.136+0000 7f32f90f9640 1 --2- 172.21.15.78:0/3038808656 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32dc003a50 0x7f32dc003ec0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.136+0000 7f32f90f9640 1 -- 172.21.15.78:0/3038808656 >> 172.21.15.78:0/3038808656 conn(0x7f32f406d230 msgr2=0x7f32f406d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.136+0000 7f32f90f9640 1 -- 172.21.15.78:0/3038808656 shutdown_connections 2024-09-17T03:13:20.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.136+0000 7f32f90f9640 1 -- 172.21.15.78:0/3038808656 wait complete. 2024-09-17T03:13:20.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.138+0000 7f32f90f9640 1 Processor -- start 2024-09-17T03:13:20.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.138+0000 7f32f90f9640 1 -- start start 2024-09-17T03:13:20.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.139+0000 7f32f90f9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32dc003a50 0x7f32f4144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.139+0000 7f32f90f9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32f40b49d0 0x7f32f41448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.139+0000 7f32f90f9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32f41e6f20 0x7f32f41e7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.139+0000 7f32f90f9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f32f40ccc60 con 0x7f32f40b49d0 2024-09-17T03:13:20.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.139+0000 7f32f90f9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f32f415dcb0 con 0x7f32f41e6f20 2024-09-17T03:13:20.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.139+0000 7f32f90f9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f32f40ccde0 con 0x7f32dc003a50 2024-09-17T03:13:20.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.139+0000 7f32f259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32f40b49d0 0x7f32f41448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.139+0000 7f32f259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32f40b49d0 0x7f32f41448b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34290/0 (socket says 172.21.15.78:34290) 2024-09-17T03:13:20.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.139+0000 7f32f259c640 1 -- 172.21.15.78:0/2350904572 learned_addr learned my addr 172.21.15.78:0/2350904572 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:20.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.139+0000 7f32f359e640 1 --2- 172.21.15.78:0/2350904572 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32f41e6f20 0x7f32f41e7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.139+0000 7f32f2d9d640 1 --2- 172.21.15.78:0/2350904572 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32dc003a50 0x7f32f4144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.139+0000 7f32f259c640 1 -- 172.21.15.78:0/2350904572 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32dc003a50 msgr2=0x7f32f4144370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.139+0000 7f32f259c640 1 --2- 172.21.15.78:0/2350904572 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32dc003a50 0x7f32f4144370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.139+0000 7f32f259c640 1 -- 172.21.15.78:0/2350904572 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32f41e6f20 msgr2=0x7f32f41e7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.139+0000 7f32f259c640 1 --2- 172.21.15.78:0/2350904572 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32f41e6f20 0x7f32f41e7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.139+0000 7f32f259c640 1 -- 172.21.15.78:0/2350904572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32f40b2410 con 0x7f32f40b49d0 2024-09-17T03:13:20.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.140+0000 7f32f259c640 1 --2- 172.21.15.78:0/2350904572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32f40b49d0 0x7f32f41448b0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f32e8011ae0 tx=0x7f32e8009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.140+0000 7f32db7fe640 1 -- 172.21.15.78:0/2350904572 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e800fcb0 con 0x7f32f40b49d0 2024-09-17T03:13:20.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.140+0000 7f32db7fe640 1 -- 172.21.15.78:0/2350904572 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32e800fe50 con 0x7f32f40b49d0 2024-09-17T03:13:20.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.140+0000 7f32f90f9640 1 -- 172.21.15.78:0/2350904572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32f40b57a0 con 0x7f32f40b49d0 2024-09-17T03:13:20.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.140+0000 7f32db7fe640 1 -- 172.21.15.78:0/2350904572 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e8004280 con 0x7f32f40b49d0 2024-09-17T03:13:20.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.140+0000 7f32f90f9640 1 -- 172.21.15.78:0/2350904572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32f40b5d60 con 0x7f32f40b49d0 2024-09-17T03:13:20.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.141+0000 7f32f90f9640 1 -- 172.21.15.78:0/2350904572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32f40b2180 con 0x7f32f40b49d0 2024-09-17T03:13:20.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.142+0000 7f32db7fe640 1 -- 172.21.15.78:0/2350904572 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f32e80035f0 con 0x7f32f40b49d0 2024-09-17T03:13:20.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.142+0000 7f32db7fe640 1 --2- 172.21.15.78:0/2350904572 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f32e0078b90 0x7f32e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.142+0000 7f32db7fe640 1 -- 172.21.15.78:0/2350904572 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f32e809b7a0 con 0x7f32f40b49d0 2024-09-17T03:13:20.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.142+0000 7f32f2d9d640 1 --2- 172.21.15.78:0/2350904572 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f32e0078b90 0x7f32e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.143+0000 7f32f2d9d640 1 --2- 172.21.15.78:0/2350904572 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f32e0078b90 0x7f32e007b0a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f32e4032000 tx=0x7f32e402c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.147+0000 7f32db7fe640 1 -- 172.21.15.78:0/2350904572 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f32e8063550 con 0x7f32f40b49d0 2024-09-17T03:13:20.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.355+0000 7f32f90f9640 1 -- 172.21.15.78:0/2350904572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32f40cd2f0 con 0x7f32f40b49d0 2024-09-17T03:13:20.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.356+0000 7f32db7fe640 1 -- 172.21.15.78:0/2350904572 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5273 (secure 0 0 0) 0x7f32e8067f80 con 0x7f32f40b49d0 2024-09-17T03:13:20.354 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:20.355 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":68,"btime":"2024-09-17T03:13:17:667511+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5873,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/3831026382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3831026382},{"type":"v1","addr":"172.21.15.193:6836","nonce":3831026382}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:12:50.905684+0000","modified":"2024-09-17T03:13:16.881050+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6864,"mds_1":6861,"mds_2":6271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6271":{"gid":6271,"name":"d","rank":2,"incarnation":65,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6837/1431701139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1431701139},{"type":"v1","addr":"172.21.15.193:6837","nonce":1431701139}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6861":{"gid":6861,"name":"c","rank":1,"incarnation":63,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6834/2905189397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2905189397},{"type":"v1","addr":"172.21.15.78:6834","nonce":2905189397}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6864":{"gid":6864,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/2058899730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2058899730},{"type":"v1","addr":"172.21.15.78:6835","nonce":2058899730}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6864,"qdb_cluster":[6271,6861,6864]},"id":5}]} 2024-09-17T03:13:20.355 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 68 2024-09-17T03:13:20.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.358+0000 7f32f90f9640 1 -- 172.21.15.78:0/2350904572 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f32e0078b90 msgr2=0x7f32e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.358+0000 7f32f90f9640 1 --2- 172.21.15.78:0/2350904572 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f32e0078b90 0x7f32e007b0a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f32e4032000 tx=0x7f32e402c040 comp rx=0 tx=0).stop 2024-09-17T03:13:20.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.358+0000 7f32f90f9640 1 -- 172.21.15.78:0/2350904572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32f40b49d0 msgr2=0x7f32f41448b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.358+0000 7f32f90f9640 1 --2- 172.21.15.78:0/2350904572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32f40b49d0 0x7f32f41448b0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f32e8011ae0 tx=0x7f32e8009f10 comp rx=0 tx=0).stop 2024-09-17T03:13:20.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.358+0000 7f32f90f9640 1 -- 172.21.15.78:0/2350904572 shutdown_connections 2024-09-17T03:13:20.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.358+0000 7f32f90f9640 1 --2- 172.21.15.78:0/2350904572 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f32e0078b90 0x7f32e007b0a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.358+0000 7f32f90f9640 1 --2- 172.21.15.78:0/2350904572 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32f41e6f20 0x7f32f41e7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.358+0000 7f32f90f9640 1 --2- 172.21.15.78:0/2350904572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32f40b49d0 0x7f32f41448b0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.358+0000 7f32f90f9640 1 --2- 172.21.15.78:0/2350904572 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32dc003a50 0x7f32f4144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.358+0000 7f32f90f9640 1 -- 172.21.15.78:0/2350904572 >> 172.21.15.78:0/2350904572 conn(0x7f32f406d230 msgr2=0x7f32f415f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.358+0000 7f32f90f9640 1 -- 172.21.15.78:0/2350904572 shutdown_connections 2024-09-17T03:13:20.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.358+0000 7f32f90f9640 1 -- 172.21.15.78:0/2350904572 wait complete. 2024-09-17T03:13:20.368 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub start /d1/d2/d3 2024-09-17T03:13:20.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.485+0000 7fc617a27640 1 -- 172.21.15.78:0/1890106738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc610070440 msgr2=0x7fc610074b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.485+0000 7fc617a27640 1 --2- 172.21.15.78:0/1890106738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc610070440 0x7fc610074b80 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fc610160370 tx=0x7fc60802a4d0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.485+0000 7fc617a27640 1 -- 172.21.15.78:0/1890106738 shutdown_connections 2024-09-17T03:13:20.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.485+0000 7fc617a27640 1 --2- 172.21.15.78:0/1890106738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc610070440 0x7fc610074b80 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.485+0000 7fc617a27640 1 --2- 172.21.15.78:0/1890106738 >> v2:172.21.15.193:3300/0 conn(0x7fc610070030 0x7fc610074640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.485+0000 7fc617a27640 1 --2- 172.21.15.78:0/1890106738 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc610073170 0x7fc61015c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.485+0000 7fc617a27640 1 -- 172.21.15.78:0/1890106738 >> 172.21.15.78:0/1890106738 conn(0x7fc6100b1cb0 msgr2=0x7fc6100b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.485+0000 7fc617a27640 1 -- 172.21.15.78:0/1890106738 shutdown_connections 2024-09-17T03:13:20.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.485+0000 7fc617a27640 1 -- 172.21.15.78:0/1890106738 wait complete. 2024-09-17T03:13:20.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.487+0000 7fc617a27640 1 Processor -- start 2024-09-17T03:13:20.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.487+0000 7fc617a27640 1 -- start start 2024-09-17T03:13:20.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.488+0000 7fc617a27640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc610070030 0x7fc6101f9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.488+0000 7fc617a27640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc610070440 0x7fc6100d0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.488+0000 7fc617a27640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc610073170 0x7fc61009cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.488+0000 7fc617a27640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc61006f690 con 0x7fc610073170 2024-09-17T03:13:20.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.488+0000 7fc617a27640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc61006f510 con 0x7fc610070440 2024-09-17T03:13:20.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.488+0000 7fc617a27640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc61006f810 con 0x7fc610070030 2024-09-17T03:13:20.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.488+0000 7fc615fc4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc610073170 0x7fc61009cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.488+0000 7fc615fc4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc610073170 0x7fc61009cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34302/0 (socket says 172.21.15.78:34302) 2024-09-17T03:13:20.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.488+0000 7fc615fc4640 1 -- 172.21.15.78:0/988392238 learned_addr learned my addr 172.21.15.78:0/988392238 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:20.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.488+0000 7fc6157c3640 1 --2- 172.21.15.78:0/988392238 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc610070030 0x7fc6101f9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.488+0000 7fc614fc2640 1 --2- 172.21.15.78:0/988392238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc610070440 0x7fc6100d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.488+0000 7fc615fc4640 1 -- 172.21.15.78:0/988392238 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc610070030 msgr2=0x7fc6101f9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.488+0000 7fc615fc4640 1 --2- 172.21.15.78:0/988392238 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc610070030 0x7fc6101f9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.488+0000 7fc615fc4640 1 -- 172.21.15.78:0/988392238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc610070440 msgr2=0x7fc6100d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.488+0000 7fc615fc4640 1 --2- 172.21.15.78:0/988392238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc610070440 0x7fc6100d0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.488+0000 7fc615fc4640 1 -- 172.21.15.78:0/988392238 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6101f9fd0 con 0x7fc610073170 2024-09-17T03:13:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.488+0000 7fc614fc2640 1 --2- 172.21.15.78:0/988392238 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc610070440 0x7fc6100d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.489+0000 7fc615fc4640 1 --2- 172.21.15.78:0/988392238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc610073170 0x7fc61009cf60 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fc608034040 tx=0x7fc608003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.489+0000 7fc605ffb640 1 -- 172.21.15.78:0/988392238 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60803e030 con 0x7fc610073170 2024-09-17T03:13:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.489+0000 7fc605ffb640 1 -- 172.21.15.78:0/988392238 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc608003e50 con 0x7fc610073170 2024-09-17T03:13:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.489+0000 7fc617a27640 1 -- 172.21.15.78:0/988392238 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6101f5cb0 con 0x7fc610073170 2024-09-17T03:13:20.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.489+0000 7fc605ffb640 1 -- 172.21.15.78:0/988392238 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608035040 con 0x7fc610073170 2024-09-17T03:13:20.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.489+0000 7fc617a27640 1 -- 172.21.15.78:0/988392238 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6101f5f70 con 0x7fc610073170 2024-09-17T03:13:20.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.491+0000 7fc605ffb640 1 -- 172.21.15.78:0/988392238 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc608041030 con 0x7fc610073170 2024-09-17T03:13:20.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.492+0000 7fc605ffb640 1 --2- 172.21.15.78:0/988392238 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc5f4078bc0 0x7fc5f407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.492+0000 7fc605ffb640 1 -- 172.21.15.78:0/988392238 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7fc6080bb5f0 con 0x7fc610073170 2024-09-17T03:13:20.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.492+0000 7fc6157c3640 1 --2- 172.21.15.78:0/988392238 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc5f4078bc0 0x7fc5f407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.492+0000 7fc6157c3640 1 --2- 172.21.15.78:0/988392238 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc5f4078bc0 0x7fc5f407b0d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc60c0092f0 tx=0x7fc60c009280 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.493+0000 7fc61ea6d740 1 Processor -- start 2024-09-17T03:13:20.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.493+0000 7fc61ea6d740 1 -- start start 2024-09-17T03:13:20.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.494+0000 7fc61ea6d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732f3220 0x5564736c4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.494+0000 7fc61ea6d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732ca360 0x5564736c4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.494+0000 7fc61ea6d740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732d2540 0x5564736e1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.494+0000 7fc61ea6d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55647360dad0 con 0x5564732ca360 2024-09-17T03:13:20.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.494+0000 7fc61ea6d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5564735fcf00 con 0x5564732f3220 2024-09-17T03:13:20.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.494+0000 7fc61ea6d740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x556473600d10 con 0x5564732d2540 2024-09-17T03:13:20.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.494+0000 7fc614fc2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732ca360 0x5564736c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.494+0000 7fc614fc2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732ca360 0x5564736c4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34310/0 (socket says 172.21.15.78:34310) 2024-09-17T03:13:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.494+0000 7fc614fc2640 1 -- 172.21.15.78:0/4096389677 learned_addr learned my addr 172.21.15.78:0/4096389677 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.494+0000 7fc6157c3640 1 --2- 172.21.15.78:0/4096389677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732f3220 0x5564736c4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.494+0000 7fc615fc4640 1 --2- 172.21.15.78:0/4096389677 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732d2540 0x5564736e1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.494+0000 7fc614fc2640 1 -- 172.21.15.78:0/4096389677 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732d2540 msgr2=0x5564736e1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.494+0000 7fc614fc2640 1 --2- 172.21.15.78:0/4096389677 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732d2540 0x5564736e1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.494+0000 7fc614fc2640 1 -- 172.21.15.78:0/4096389677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732f3220 msgr2=0x5564736c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.494+0000 7fc614fc2640 1 --2- 172.21.15.78:0/4096389677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732f3220 0x5564736c4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.494+0000 7fc614fc2640 1 -- 172.21.15.78:0/4096389677 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564732ef280 con 0x5564732ca360 2024-09-17T03:13:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.494+0000 7fc6157c3640 1 --2- 172.21.15.78:0/4096389677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732f3220 0x5564736c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.494+0000 7fc615fc4640 1 --2- 172.21.15.78:0/4096389677 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732d2540 0x5564736e1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.494+0000 7fc614fc2640 1 --2- 172.21.15.78:0/4096389677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732ca360 0x5564736c4840 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fc610071340 tx=0x7fc600009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fe92904896ab96 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.494+0000 7fc5faffd640 1 -- 172.21.15.78:0/4096389677 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600016070 con 0x5564732ca360 2024-09-17T03:13:20.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.495+0000 7fc5faffd640 1 -- 172.21.15.78:0/4096389677 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc60000eda0 con 0x5564732ca360 2024-09-17T03:13:20.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.495+0000 7fc5faffd640 1 -- 172.21.15.78:0/4096389677 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc600004280 con 0x5564732ca360 2024-09-17T03:13:20.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.495+0000 7fc61ea6d740 1 -- 172.21.15.78:0/4096389677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732ca360 msgr2=0x5564736c4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.495+0000 7fc61ea6d740 1 --2- 172.21.15.78:0/4096389677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732ca360 0x5564736c4840 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fc610071340 tx=0x7fc600009f80 comp rx=0 tx=0).stop 2024-09-17T03:13:20.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.495+0000 7fc61ea6d740 1 -- 172.21.15.78:0/4096389677 shutdown_connections 2024-09-17T03:13:20.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.495+0000 7fc61ea6d740 1 --2- 172.21.15.78:0/4096389677 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732d2540 0x5564736e1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.495+0000 7fc61ea6d740 1 --2- 172.21.15.78:0/4096389677 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732ca360 0x5564736c4840 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.495+0000 7fc61ea6d740 1 --2- 172.21.15.78:0/4096389677 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732f3220 0x5564736c4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.495+0000 7fc61ea6d740 1 -- 172.21.15.78:0/4096389677 >> 172.21.15.78:0/4096389677 conn(0x5564732e7370 msgr2=0x55647369a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.495+0000 7fc61ea6d740 1 -- 172.21.15.78:0/4096389677 shutdown_connections 2024-09-17T03:13:20.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.495+0000 7fc61ea6d740 1 -- 172.21.15.78:0/4096389677 wait complete. 2024-09-17T03:13:20.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.496+0000 7fc61ea6d740 1 -- start start 2024-09-17T03:13:20.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.496+0000 7fc61ea6d740 1 Processor -- start 2024-09-17T03:13:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc61ea6d740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732ca360 0x5564736d7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc61ea6d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732d2540 0x5564736b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc61ea6d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732f3220 0x5564736d8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc61ea6d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55647336d5d0 con 0x5564732f3220 2024-09-17T03:13:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc61ea6d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5564735a2460 con 0x5564732d2540 2024-09-17T03:13:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc61ea6d740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5564736c4d80 con 0x5564732ca360 2024-09-17T03:13:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc61ea6d740 10 client.0 _ll_register_callbacks cb 0x5564735b1b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc615fc4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732f3220 0x5564736d8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc615fc4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732f3220 0x5564736d8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34314/0 (socket says 172.21.15.78:34314) 2024-09-17T03:13:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc615fc4640 1 -- 172.21.15.78:0/1366460895 learned_addr learned my addr 172.21.15.78:0/1366460895 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc6157c3640 1 --2- 172.21.15.78:0/1366460895 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732ca360 0x5564736d7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc614fc2640 1 --2- 172.21.15.78:0/1366460895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732d2540 0x5564736b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc615fc4640 1 -- 172.21.15.78:0/1366460895 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732ca360 msgr2=0x5564736d7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc615fc4640 1 --2- 172.21.15.78:0/1366460895 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732ca360 0x5564736d7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc615fc4640 1 -- 172.21.15.78:0/1366460895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732d2540 msgr2=0x5564736b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc615fc4640 1 --2- 172.21.15.78:0/1366460895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732d2540 0x5564736b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc615fc4640 1 -- 172.21.15.78:0/1366460895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564733d7690 con 0x5564732f3220 2024-09-17T03:13:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc6157c3640 1 --2- 172.21.15.78:0/1366460895 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732ca360 0x5564736d7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc614fc2640 1 --2- 172.21.15.78:0/1366460895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732d2540 0x5564736b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc615fc4640 1 --2- 172.21.15.78:0/1366460895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732f3220 0x5564736d8730 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fc6080b9a40 tx=0x7fc608083150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6da635e9bfde429 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc5effff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc5effff640 1 -- 172.21.15.78:0/1366460895 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608048070 con 0x5564732f3220 2024-09-17T03:13:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc5effff640 1 -- 172.21.15.78:0/1366460895 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7fc6080824b0 con 0x5564732f3220 2024-09-17T03:13:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.498+0000 7fc61ea6d740 1 -- 172.21.15.78:0/1366460895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc60000eda0 con 0x5564732f3220 2024-09-17T03:13:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.499+0000 7fc5effff640 1 -- 172.21.15.78:0/1366460895 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7fc608083950 con 0x5564732f3220 2024-09-17T03:13:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.499+0000 7fc61ea6d740 10 client.7203 fetch_fsmap learned FSMap version 68 2024-09-17T03:13:20.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.499+0000 7fc61ea6d740 1 -- 172.21.15.78:0/1366460895 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x556473437e20 con 0x5564732f3220 2024-09-17T03:13:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.499+0000 7fc5effff640 1 -- 172.21.15.78:0/1366460895 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc60000eda0 con 0x5564732f3220 2024-09-17T03:13:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.499+0000 7fc5effff640 1 -- 172.21.15.78:0/1366460895 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 68) ==== 3554+0+0 (secure 0 0 0) 0x7fc60806ab90 con 0x5564732f3220 2024-09-17T03:13:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.499+0000 7fc61ea6d740 10 client.7203 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T03:13:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.499+0000 7fc61ea6d740 10 client.7203 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:13:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.499+0000 7fc61ea6d740 20 client.7203 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.499+0000 7fc61ea6d740 1 --2- 172.21.15.78:0/1366460895 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x5564732b2000 0x5564736c0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.499+0000 7fc61ea6d740 4 client.7203 mds_command: new command op to 6861 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:13:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.499+0000 7fc61ea6d740 1 -- 172.21.15.78:0/1366460895 --> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55647360fa20 con 0x5564732b2000 2024-09-17T03:13:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.499+0000 7fc6157c3640 1 --2- 172.21.15.78:0/1366460895 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x5564732b2000 0x5564736c0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.499+0000 7fc5effff640 10 client.7203 ms_handle_connect on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.499+0000 7fc6157c3640 1 --2- 172.21.15.78:0/1366460895 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x5564732b2000 0x5564736c0070 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=234aa39de54d8b86 server_cookie=a4f57c8e4db56171 in_seq=0 out_seq=0 2024-09-17T03:13:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.500+0000 7fc5effff640 1 -- 172.21.15.78:0/1366460895 <== mds.1 v2:172.21.15.78:6832/2905189397 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55647360fa20 con 0x5564732b2000 2024-09-17T03:13:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.500+0000 7fc5effff640 10 client.7203 handle_command_reply: tid=0 2024-09-17T03:13:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.500+0000 7fc61ea6d740 1 client.7203 shutdown 2024-09-17T03:13:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.500+0000 7fc61ea6d740 1 -- 172.21.15.78:0/1366460895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732f3220 msgr2=0x5564736d8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.500+0000 7fc61ea6d740 1 --2- 172.21.15.78:0/1366460895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732f3220 0x5564736d8730 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fc6080b9a40 tx=0x7fc608083150 comp rx=0 tx=0).stop 2024-09-17T03:13:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.500+0000 7fc61ea6d740 1 -- 172.21.15.78:0/1366460895 shutdown_connections 2024-09-17T03:13:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.500+0000 7fc61ea6d740 1 --2- 172.21.15.78:0/1366460895 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x5564732b2000 0x5564736c0070 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.500+0000 7fc61ea6d740 1 --2- 172.21.15.78:0/1366460895 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732f3220 0x5564736d8730 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.500+0000 7fc61ea6d740 1 --2- 172.21.15.78:0/1366460895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732d2540 0x5564736b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.500+0000 7fc5effff640 0 client.7203 ms_handle_reset on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.500+0000 7fc61ea6d740 1 --2- 172.21.15.78:0/1366460895 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732ca360 0x5564736d7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.500+0000 7fc61ea6d740 1 -- 172.21.15.78:0/1366460895 >> 172.21.15.78:0/1366460895 conn(0x5564732e7370 msgr2=0x5564736d56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.500+0000 7fc61ea6d740 1 -- 172.21.15.78:0/1366460895 shutdown_connections 2024-09-17T03:13:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.500+0000 7fc61ea6d740 1 -- 172.21.15.78:0/1366460895 wait complete. 2024-09-17T03:13:20.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.501+0000 7fc61ea6d740 20 client.7203 trim_cache size 0 max 16384 2024-09-17T03:13:20.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.518+0000 7fc61ea6d740 1 Processor -- start 2024-09-17T03:13:20.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.518+0000 7fc61ea6d740 1 -- start start 2024-09-17T03:13:20.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.519+0000 7fc61ea6d740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732ca360 0x5564736f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.520+0000 7fc61ea6d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732d2540 0x5564736901e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.520+0000 7fc61ea6d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732f3220 0x5564736b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.520+0000 7fc61ea6d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc610201470 con 0x5564732f3220 2024-09-17T03:13:20.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.520+0000 7fc61ea6d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc610201b50 con 0x5564732d2540 2024-09-17T03:13:20.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.520+0000 7fc61ea6d740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc610150e60 con 0x5564732ca360 2024-09-17T03:13:20.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.520+0000 7fc615fc4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732f3220 0x5564736b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.520+0000 7fc615fc4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732f3220 0x5564736b40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34328/0 (socket says 172.21.15.78:34328) 2024-09-17T03:13:20.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.520+0000 7fc615fc4640 1 -- 172.21.15.78:0/3000193679 learned_addr learned my addr 172.21.15.78:0/3000193679 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:20.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.520+0000 7fc6157c3640 1 --2- 172.21.15.78:0/3000193679 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732ca360 0x5564736f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.520+0000 7fc614fc2640 1 --2- 172.21.15.78:0/3000193679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732d2540 0x5564736901e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.520+0000 7fc615fc4640 1 -- 172.21.15.78:0/3000193679 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732ca360 msgr2=0x5564736f7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.520+0000 7fc615fc4640 1 --2- 172.21.15.78:0/3000193679 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732ca360 0x5564736f7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.520+0000 7fc615fc4640 1 -- 172.21.15.78:0/3000193679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732d2540 msgr2=0x5564736901e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.520+0000 7fc615fc4640 1 --2- 172.21.15.78:0/3000193679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732d2540 0x5564736901e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.520+0000 7fc615fc4640 1 -- 172.21.15.78:0/3000193679 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55647333c530 con 0x5564732f3220 2024-09-17T03:13:20.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.520+0000 7fc614fc2640 1 --2- 172.21.15.78:0/3000193679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732d2540 0x5564736901e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:20.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.520+0000 7fc615fc4640 1 --2- 172.21.15.78:0/3000193679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732f3220 0x5564736b40e0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc6080804c0 tx=0x7fc608009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da5cc06495561fa server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.520+0000 7fc5fa7fc640 1 -- 172.21.15.78:0/3000193679 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc608048040 con 0x5564732f3220 2024-09-17T03:13:20.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.520+0000 7fc5fa7fc640 1 -- 172.21.15.78:0/3000193679 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc60808cc70 con 0x5564732f3220 2024-09-17T03:13:20.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.520+0000 7fc5fa7fc640 1 -- 172.21.15.78:0/3000193679 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6080bb0f0 con 0x5564732f3220 2024-09-17T03:13:20.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.521+0000 7fc61ea6d740 1 -- 172.21.15.78:0/3000193679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732f3220 msgr2=0x5564736b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.521+0000 7fc61ea6d740 1 --2- 172.21.15.78:0/3000193679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732f3220 0x5564736b40e0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc6080804c0 tx=0x7fc608009560 comp rx=0 tx=0).stop 2024-09-17T03:13:20.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.521+0000 7fc61ea6d740 1 -- 172.21.15.78:0/3000193679 shutdown_connections 2024-09-17T03:13:20.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.521+0000 7fc61ea6d740 1 --2- 172.21.15.78:0/3000193679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732f3220 0x5564736b40e0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.521+0000 7fc61ea6d740 1 --2- 172.21.15.78:0/3000193679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732d2540 0x5564736901e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.521+0000 7fc61ea6d740 1 --2- 172.21.15.78:0/3000193679 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732ca360 0x5564736f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.521+0000 7fc61ea6d740 1 -- 172.21.15.78:0/3000193679 >> 172.21.15.78:0/3000193679 conn(0x5564732e7370 msgr2=0x5564736f85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.521+0000 7fc61ea6d740 1 -- 172.21.15.78:0/3000193679 shutdown_connections 2024-09-17T03:13:20.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.521+0000 7fc61ea6d740 1 -- 172.21.15.78:0/3000193679 wait complete. 2024-09-17T03:13:20.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.522+0000 7fc61ea6d740 1 -- start start 2024-09-17T03:13:20.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.522+0000 7fc61ea6d740 1 Processor -- start 2024-09-17T03:13:20.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.523+0000 7fc61ea6d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732ca360 0x55647375e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.523+0000 7fc61ea6d740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732d2540 0x556473694040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.523+0000 7fc61ea6d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732f3220 0x556473694580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.523+0000 7fc61ea6d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5564736dfbf0 con 0x5564732ca360 2024-09-17T03:13:20.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.523+0000 7fc61ea6d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55647336d5d0 con 0x5564732f3220 2024-09-17T03:13:20.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.523+0000 7fc61ea6d740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5564736d8d90 con 0x5564732d2540 2024-09-17T03:13:20.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.523+0000 7fc61ea6d740 10 client.0 _ll_register_callbacks cb 0x7fc608005e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:20.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc6157c3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732ca360 0x55647375e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc6157c3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732ca360 0x55647375e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34330/0 (socket says 172.21.15.78:34330) 2024-09-17T03:13:20.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc6157c3640 1 -- 172.21.15.78:0/432677427 learned_addr learned my addr 172.21.15.78:0/432677427 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:20.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc614fc2640 1 --2- 172.21.15.78:0/432677427 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732d2540 0x556473694040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc615fc4640 1 --2- 172.21.15.78:0/432677427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732f3220 0x556473694580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc6157c3640 1 -- 172.21.15.78:0/432677427 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732d2540 msgr2=0x556473694040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc6157c3640 1 --2- 172.21.15.78:0/432677427 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732d2540 0x556473694040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc6157c3640 1 -- 172.21.15.78:0/432677427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732f3220 msgr2=0x556473694580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc6157c3640 1 --2- 172.21.15.78:0/432677427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732f3220 0x556473694580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc6157c3640 1 -- 172.21.15.78:0/432677427 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556473702a00 con 0x5564732ca360 2024-09-17T03:13:20.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc615fc4640 1 --2- 172.21.15.78:0/432677427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732f3220 0x556473694580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:20.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc614fc2640 1 --2- 172.21.15.78:0/432677427 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732d2540 0x556473694040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:20.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc6157c3640 1 --2- 172.21.15.78:0/432677427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732ca360 0x55647375e850 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fc60c011010 tx=0x7fc60c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1516046fdca2efa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc5effff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:20.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc5effff640 1 -- 172.21.15.78:0/432677427 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c034060 con 0x5564732ca360 2024-09-17T03:13:20.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc5effff640 1 -- 172.21.15.78:0/432677427 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7fc60c02f420 con 0x5564732ca360 2024-09-17T03:13:20.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc61ea6d740 1 -- 172.21.15.78:0/432677427 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc60808cc70 con 0x5564732ca360 2024-09-17T03:13:20.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc5effff640 1 -- 172.21.15.78:0/432677427 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7fc60c03a050 con 0x5564732ca360 2024-09-17T03:13:20.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc61ea6d740 10 client.7209 fetch_fsmap learned FSMap version 68 2024-09-17T03:13:20.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc61ea6d740 1 -- 172.21.15.78:0/432677427 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x556473693c60 con 0x5564732ca360 2024-09-17T03:13:20.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.524+0000 7fc5effff640 1 -- 172.21.15.78:0/432677427 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc60808cc70 con 0x5564732ca360 2024-09-17T03:13:20.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.525+0000 7fc5effff640 1 -- 172.21.15.78:0/432677427 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 68) ==== 3554+0+0 (secure 0 0 0) 0x7fc60c03d020 con 0x5564732ca360 2024-09-17T03:13:20.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.525+0000 7fc61ea6d740 10 client.7209 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T03:13:20.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.525+0000 7fc61ea6d740 10 client.7209 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:13:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.525+0000 7fc61ea6d740 20 client.7209 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.525+0000 7fc61ea6d740 1 --2- 172.21.15.78:0/432677427 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x556473762d40 0x556473698140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.525+0000 7fc61ea6d740 4 client.7209 mds_command: new command op to 6861 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/d1/d2/d3"}] 2024-09-17T03:13:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.525+0000 7fc61ea6d740 1 -- 172.21.15.78:0/432677427 --> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3"}) -- 0x55647360b4d0 con 0x556473762d40 2024-09-17T03:13:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.525+0000 7fc614fc2640 1 --2- 172.21.15.78:0/432677427 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x556473762d40 0x556473698140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.525+0000 7fc5effff640 10 client.7209 ms_handle_connect on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.525+0000 7fc614fc2640 1 --2- 172.21.15.78:0/432677427 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x556473762d40 0x556473698140 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e8262823a1958506 server_cookie=ccb82e956d1a2c6 in_seq=0 out_seq=0 2024-09-17T03:13:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.525+0000 7fc5effff640 1 -- 172.21.15.78:0/432677427 <== mds.1 v2:172.21.15.78:6832/2905189397 1 ==== command_reply(tid 0: -18 Not rank 0) ==== 18+0+0 (crc 0 0 0) 0x55647360b4d0 con 0x556473762d40 2024-09-17T03:13:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.525+0000 7fc5effff640 10 client.7209 handle_command_reply: tid=0 2024-09-17T03:13:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.525+0000 7fc61ea6d740 1 client.7209 shutdown 2024-09-17T03:13:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.525+0000 7fc61ea6d740 1 -- 172.21.15.78:0/432677427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732ca360 msgr2=0x55647375e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.525+0000 7fc61ea6d740 1 --2- 172.21.15.78:0/432677427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732ca360 0x55647375e850 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fc60c011010 tx=0x7fc60c013000 comp rx=0 tx=0).stop 2024-09-17T03:13:20.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.526+0000 7fc61ea6d740 1 -- 172.21.15.78:0/432677427 shutdown_connections 2024-09-17T03:13:20.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.526+0000 7fc61ea6d740 1 --2- 172.21.15.78:0/432677427 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x556473762d40 0x556473698140 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.526+0000 7fc5effff640 0 client.7209 ms_handle_reset on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:20.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.526+0000 7fc61ea6d740 1 --2- 172.21.15.78:0/432677427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5564732f3220 0x556473694580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.526+0000 7fc61ea6d740 1 --2- 172.21.15.78:0/432677427 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5564732d2540 0x556473694040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.526+0000 7fc61ea6d740 1 --2- 172.21.15.78:0/432677427 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5564732ca360 0x55647375e850 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.526+0000 7fc61ea6d740 1 -- 172.21.15.78:0/432677427 >> 172.21.15.78:0/432677427 conn(0x5564732e7370 msgr2=0x5564736d5170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.526+0000 7fc61ea6d740 1 -- 172.21.15.78:0/432677427 shutdown_connections 2024-09-17T03:13:20.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.526+0000 7fc61ea6d740 1 -- 172.21.15.78:0/432677427 wait complete. 2024-09-17T03:13:20.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.526+0000 7fc61ea6d740 20 client.7209 trim_cache size 0 max 16384 2024-09-17T03:13:20.530 INFO:teuthology.orchestra.run.smithi078.stderr:Error EXDEV: Not rank 0 2024-09-17T03:13:20.531 DEBUG:teuthology.orchestra.run:got remote process result: 18 2024-09-17T03:13:20.531 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub abort 2024-09-17T03:13:20.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.647+0000 7f0496038640 1 -- 172.21.15.78:0/2094687253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0478003a50 msgr2=0x7f0478003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.647+0000 7f0496038640 1 --2- 172.21.15.78:0/2094687253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0478003a50 0x7f0478003ec0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f048400c290 tx=0x7f0478005830 comp rx=0 tx=0).stop 2024-09-17T03:13:20.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.647+0000 7f0496038640 1 -- 172.21.15.78:0/2094687253 shutdown_connections 2024-09-17T03:13:20.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.647+0000 7f0496038640 1 --2- 172.21.15.78:0/2094687253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0478003a50 0x7f0478003ec0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.647+0000 7f0496038640 1 -- 172.21.15.78:0/2094687253 >> 172.21.15.78:0/2094687253 conn(0x7f049008bfc0 msgr2=0x7f049009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.647+0000 7f0496038640 1 -- 172.21.15.78:0/2094687253 shutdown_connections 2024-09-17T03:13:20.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.647+0000 7f0496038640 1 -- 172.21.15.78:0/2094687253 wait complete. 2024-09-17T03:13:20.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.649+0000 7f0496038640 1 Processor -- start 2024-09-17T03:13:20.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.649+0000 7f0496038640 1 -- start start 2024-09-17T03:13:20.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.650+0000 7f0496038640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0478003a50 0x7f04900cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.650+0000 7f0496038640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f04901f52b0 0x7f04900cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.650+0000 7f0496038640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04900b27c0 0x7f04900b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.650+0000 7f0496038640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f04900d34b0 con 0x7f0478003a50 2024-09-17T03:13:20.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.650+0000 7f0496038640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f04900d3330 con 0x7f04900b27c0 2024-09-17T03:13:20.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.650+0000 7f0496038640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f04900d3630 con 0x7f04901f52b0 2024-09-17T03:13:20.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.650+0000 7f048f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0478003a50 0x7f04900cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.650+0000 7f048f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0478003a50 0x7f04900cb5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34344/0 (socket says 172.21.15.78:34344) 2024-09-17T03:13:20.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.650+0000 7f048f7fe640 1 -- 172.21.15.78:0/2458527025 learned_addr learned my addr 172.21.15.78:0/2458527025 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:20.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.651+0000 7f048f7fe640 1 -- 172.21.15.78:0/2458527025 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f04901f52b0 msgr2=0x7f04900cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.651+0000 7f048f7fe640 1 --2- 172.21.15.78:0/2458527025 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f04901f52b0 0x7f04900cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.651+0000 7f048f7fe640 1 -- 172.21.15.78:0/2458527025 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04900b27c0 msgr2=0x7f04900b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.651+0000 7f048f7fe640 1 --2- 172.21.15.78:0/2458527025 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04900b27c0 0x7f04900b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.651+0000 7f048f7fe640 1 -- 172.21.15.78:0/2458527025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04901f59e0 con 0x7f0478003a50 2024-09-17T03:13:20.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.651+0000 7f048f7fe640 1 --2- 172.21.15.78:0/2458527025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0478003a50 0x7f04900cb5c0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f048402b110 tx=0x7f0484004dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.651+0000 7f0477fff640 1 -- 172.21.15.78:0/2458527025 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484031040 con 0x7f0478003a50 2024-09-17T03:13:20.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.651+0000 7f0477fff640 1 -- 172.21.15.78:0/2458527025 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0484006440 con 0x7f0478003a50 2024-09-17T03:13:20.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.651+0000 7f0496038640 1 -- 172.21.15.78:0/2458527025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04901f5cc0 con 0x7f0478003a50 2024-09-17T03:13:20.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.651+0000 7f0477fff640 1 -- 172.21.15.78:0/2458527025 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484006c30 con 0x7f0478003a50 2024-09-17T03:13:20.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.651+0000 7f0496038640 1 -- 172.21.15.78:0/2458527025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04900c9210 con 0x7f0478003a50 2024-09-17T03:13:20.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.653+0000 7f0477fff640 1 -- 172.21.15.78:0/2458527025 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0484034070 con 0x7f0478003a50 2024-09-17T03:13:20.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.654+0000 7f0477fff640 1 --2- 172.21.15.78:0/2458527025 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f047c078bc0 0x7f047c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.654+0000 7f0477fff640 1 -- 172.21.15.78:0/2458527025 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f04840baef0 con 0x7f0478003a50 2024-09-17T03:13:20.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.654+0000 7f048effd640 1 --2- 172.21.15.78:0/2458527025 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f047c078bc0 0x7f047c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.654+0000 7f049d083740 1 Processor -- start 2024-09-17T03:13:20.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.655+0000 7f049d083740 1 -- start start 2024-09-17T03:13:20.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.655+0000 7f048effd640 1 --2- 172.21.15.78:0/2458527025 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f047c078bc0 0x7f047c07b0d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0480005eb0 tx=0x7f0480009f20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.656+0000 7f049d083740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf410c0 0x55e8bc312970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.656+0000 7f049d083740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e8bbf18200 0x55e8bc312eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.656+0000 7f049d083740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 0x55e8bc32fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.656+0000 7f049d083740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55e8bc25bc60 con 0x55e8bbf203e0 2024-09-17T03:13:20.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.656+0000 7f049d083740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e8bc24b090 con 0x55e8bbf410c0 2024-09-17T03:13:20.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.656+0000 7f049d083740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55e8bc24eea0 con 0x55e8bbf18200 2024-09-17T03:13:20.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.656+0000 7f048ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 0x55e8bc32fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.656+0000 7f048ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 0x55e8bc32fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34360/0 (socket says 172.21.15.78:34360) 2024-09-17T03:13:20.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.656+0000 7f048ffff640 1 -- 172.21.15.78:0/2145191308 learned_addr learned my addr 172.21.15.78:0/2145191308 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:20.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.656+0000 7f048f7fe640 1 --2- 172.21.15.78:0/2145191308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf410c0 0x55e8bc312970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.656+0000 7f048effd640 1 --2- 172.21.15.78:0/2145191308 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e8bbf18200 0x55e8bc312eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.656+0000 7f048ffff640 1 -- 172.21.15.78:0/2145191308 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e8bbf18200 msgr2=0x55e8bc312eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.656+0000 7f048ffff640 1 --2- 172.21.15.78:0/2145191308 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e8bbf18200 0x55e8bc312eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.656+0000 7f048ffff640 1 -- 172.21.15.78:0/2145191308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf410c0 msgr2=0x55e8bc312970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.656+0000 7f048ffff640 1 --2- 172.21.15.78:0/2145191308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf410c0 0x55e8bc312970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.656+0000 7f048ffff640 1 -- 172.21.15.78:0/2145191308 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8bbf3d120 con 0x55e8bbf203e0 2024-09-17T03:13:20.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.657+0000 7f048ffff640 1 --2- 172.21.15.78:0/2145191308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 0x55e8bc32fdb0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f04900c7fc0 tx=0x7f0488006420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cceaffe5fce40d2b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.657+0000 7f04757fa640 1 -- 172.21.15.78:0/2145191308 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488001960 con 0x55e8bbf203e0 2024-09-17T03:13:20.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.657+0000 7f04757fa640 1 -- 172.21.15.78:0/2145191308 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0488017070 con 0x55e8bbf203e0 2024-09-17T03:13:20.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.657+0000 7f04757fa640 1 -- 172.21.15.78:0/2145191308 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488001e70 con 0x55e8bbf203e0 2024-09-17T03:13:20.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.657+0000 7f049d083740 1 -- 172.21.15.78:0/2145191308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 msgr2=0x55e8bc32fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.657+0000 7f049d083740 1 --2- 172.21.15.78:0/2145191308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 0x55e8bc32fdb0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f04900c7fc0 tx=0x7f0488006420 comp rx=0 tx=0).stop 2024-09-17T03:13:20.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.658+0000 7f049d083740 1 -- 172.21.15.78:0/2145191308 shutdown_connections 2024-09-17T03:13:20.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.658+0000 7f049d083740 1 --2- 172.21.15.78:0/2145191308 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 0x55e8bc32fdb0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.658+0000 7f049d083740 1 --2- 172.21.15.78:0/2145191308 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e8bbf18200 0x55e8bc312eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.658+0000 7f049d083740 1 --2- 172.21.15.78:0/2145191308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf410c0 0x55e8bc312970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.658+0000 7f049d083740 1 -- 172.21.15.78:0/2145191308 >> 172.21.15.78:0/2145191308 conn(0x55e8bbf35210 msgr2=0x55e8bc2e8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.658+0000 7f049d083740 1 -- 172.21.15.78:0/2145191308 shutdown_connections 2024-09-17T03:13:20.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.658+0000 7f049d083740 1 -- 172.21.15.78:0/2145191308 wait complete. 2024-09-17T03:13:20.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.658+0000 7f049d083740 1 -- start start 2024-09-17T03:13:20.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.659+0000 7f049d083740 1 Processor -- start 2024-09-17T03:13:20.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.660+0000 7f049d083740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e8bbf18200 0x55e8bc327440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.660+0000 7f049d083740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 0x55e8bc32df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.660+0000 7f049d083740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf410c0 0x55e8bc329710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.660+0000 7f049d083740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55e8bbfbb470 con 0x55e8bbf203e0 2024-09-17T03:13:20.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.660+0000 7f049d083740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e8bc1d1410 con 0x55e8bbf410c0 2024-09-17T03:13:20.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.660+0000 7f049d083740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55e8bc326060 con 0x55e8bbf18200 2024-09-17T03:13:20.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.660+0000 7f049d083740 10 client.0 _ll_register_callbacks cb 0x55e8bc2441c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:20.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.660+0000 7f048effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 0x55e8bc32df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.660+0000 7f048effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 0x55e8bc32df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34366/0 (socket says 172.21.15.78:34366) 2024-09-17T03:13:20.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.660+0000 7f048effd640 1 -- 172.21.15.78:0/2399265224 learned_addr learned my addr 172.21.15.78:0/2399265224 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:20.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.660+0000 7f048f7fe640 1 --2- 172.21.15.78:0/2399265224 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e8bbf18200 0x55e8bc327440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.660+0000 7f048ffff640 1 --2- 172.21.15.78:0/2399265224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf410c0 0x55e8bc329710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.660+0000 7f048effd640 1 -- 172.21.15.78:0/2399265224 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e8bbf18200 msgr2=0x55e8bc327440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.660+0000 7f048effd640 1 --2- 172.21.15.78:0/2399265224 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e8bbf18200 0x55e8bc327440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.660+0000 7f048effd640 1 -- 172.21.15.78:0/2399265224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf410c0 msgr2=0x55e8bc329710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.660+0000 7f048effd640 1 --2- 172.21.15.78:0/2399265224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf410c0 0x55e8bc329710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.660+0000 7f048effd640 1 -- 172.21.15.78:0/2399265224 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8bc023500 con 0x55e8bbf203e0 2024-09-17T03:13:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.660+0000 7f048ffff640 1 --2- 172.21.15.78:0/2399265224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf410c0 0x55e8bc329710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.660+0000 7f048effd640 1 --2- 172.21.15.78:0/2399265224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 0x55e8bc32df30 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f048001d760 tx=0x7f0480005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42fc711d0adbd4b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.660+0000 7f046e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.661+0000 7f046e7fc640 1 -- 172.21.15.78:0/2399265224 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048002b060 con 0x55e8bbf203e0 2024-09-17T03:13:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.661+0000 7f046e7fc640 1 -- 172.21.15.78:0/2399265224 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f048001c610 con 0x55e8bbf203e0 2024-09-17T03:13:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.661+0000 7f049d083740 1 -- 172.21.15.78:0/2399265224 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0488017070 con 0x55e8bbf203e0 2024-09-17T03:13:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.661+0000 7f046e7fc640 1 -- 172.21.15.78:0/2399265224 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f0480031050 con 0x55e8bbf203e0 2024-09-17T03:13:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.661+0000 7f049d083740 10 client.7221 fetch_fsmap learned FSMap version 68 2024-09-17T03:13:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.661+0000 7f049d083740 1 -- 172.21.15.78:0/2399265224 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55e8bc083c90 con 0x55e8bbf203e0 2024-09-17T03:13:20.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.661+0000 7f046e7fc640 1 -- 172.21.15.78:0/2399265224 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0488017070 con 0x55e8bbf203e0 2024-09-17T03:13:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.661+0000 7f046e7fc640 1 -- 172.21.15.78:0/2399265224 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 68) ==== 3554+0+0 (secure 0 0 0) 0x7f0480034020 con 0x55e8bbf203e0 2024-09-17T03:13:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.661+0000 7f049d083740 10 client.7221 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T03:13:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.661+0000 7f049d083740 10 client.7221 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:13:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.661+0000 7f049d083740 20 client.7221 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.661+0000 7f049d083740 1 --2- 172.21.15.78:0/2399265224 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x55e8bbeffea0 0x55e8bc324dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.661+0000 7f049d083740 4 client.7221 mds_command: new command op to 6861 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:13:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.661+0000 7f049d083740 1 -- 172.21.15.78:0/2399265224 --> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8bc25dbb0 con 0x55e8bbeffea0 2024-09-17T03:13:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.661+0000 7f048f7fe640 1 --2- 172.21.15.78:0/2399265224 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x55e8bbeffea0 0x55e8bc324dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.662+0000 7f046e7fc640 10 client.7221 ms_handle_connect on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.662+0000 7f048f7fe640 1 --2- 172.21.15.78:0/2399265224 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x55e8bbeffea0 0x55e8bc324dc0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=34a1c3927dd73922 server_cookie=5f1b444471d23174 in_seq=0 out_seq=0 2024-09-17T03:13:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.662+0000 7f046e7fc640 1 -- 172.21.15.78:0/2399265224 <== mds.1 v2:172.21.15.78:6832/2905189397 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e8bc25dbb0 con 0x55e8bbeffea0 2024-09-17T03:13:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.662+0000 7f046e7fc640 10 client.7221 handle_command_reply: tid=0 2024-09-17T03:13:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.662+0000 7f049d083740 1 client.7221 shutdown 2024-09-17T03:13:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.663+0000 7f049d083740 1 -- 172.21.15.78:0/2399265224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 msgr2=0x55e8bc32df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.663+0000 7f049d083740 1 --2- 172.21.15.78:0/2399265224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 0x55e8bc32df30 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f048001d760 tx=0x7f0480005f90 comp rx=0 tx=0).stop 2024-09-17T03:13:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.663+0000 7f049d083740 1 -- 172.21.15.78:0/2399265224 shutdown_connections 2024-09-17T03:13:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.663+0000 7f049d083740 1 --2- 172.21.15.78:0/2399265224 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x55e8bbeffea0 0x55e8bc324dc0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.663+0000 7f049d083740 1 --2- 172.21.15.78:0/2399265224 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf410c0 0x55e8bc329710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.663+0000 7f046e7fc640 0 client.7221 ms_handle_reset on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.663+0000 7f049d083740 1 --2- 172.21.15.78:0/2399265224 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 0x55e8bc32df30 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.663+0000 7f049d083740 1 --2- 172.21.15.78:0/2399265224 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e8bbf18200 0x55e8bc327440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.663+0000 7f049d083740 1 -- 172.21.15.78:0/2399265224 >> 172.21.15.78:0/2399265224 conn(0x55e8bbf35210 msgr2=0x55e8bc2e8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.663+0000 7f049d083740 1 -- 172.21.15.78:0/2399265224 shutdown_connections 2024-09-17T03:13:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.663+0000 7f049d083740 1 -- 172.21.15.78:0/2399265224 wait complete. 2024-09-17T03:13:20.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.663+0000 7f049d083740 20 client.7221 trim_cache size 0 max 16384 2024-09-17T03:13:20.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.680+0000 7f049d083740 1 Processor -- start 2024-09-17T03:13:20.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.680+0000 7f049d083740 1 -- start start 2024-09-17T03:13:20.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.682+0000 7f049d083740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf18200 0x55e8bc32d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.682+0000 7f049d083740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf203e0 0x55e8bc327e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.682+0000 7f049d083740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e8bbf410c0 0x55e8bc2ffcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.682+0000 7f049d083740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f04902018b0 con 0x55e8bbf18200 2024-09-17T03:13:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.682+0000 7f049d083740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0490201fb0 con 0x55e8bbf203e0 2024-09-17T03:13:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.682+0000 7f049d083740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f04901f9610 con 0x55e8bbf410c0 2024-09-17T03:13:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.682+0000 7f048f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf18200 0x55e8bc32d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.682+0000 7f048f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf18200 0x55e8bc32d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34374/0 (socket says 172.21.15.78:34374) 2024-09-17T03:13:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.682+0000 7f048f7fe640 1 -- 172.21.15.78:0/2219175370 learned_addr learned my addr 172.21.15.78:0/2219175370 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.682+0000 7f048effd640 1 --2- 172.21.15.78:0/2219175370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf203e0 0x55e8bc327e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.682+0000 7f048ffff640 1 --2- 172.21.15.78:0/2219175370 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e8bbf410c0 0x55e8bc2ffcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.682+0000 7f048f7fe640 1 -- 172.21.15.78:0/2219175370 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e8bbf410c0 msgr2=0x55e8bc2ffcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.682+0000 7f048f7fe640 1 --2- 172.21.15.78:0/2219175370 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e8bbf410c0 0x55e8bc2ffcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.682+0000 7f048f7fe640 1 -- 172.21.15.78:0/2219175370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf203e0 msgr2=0x55e8bc327e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.682+0000 7f048f7fe640 1 --2- 172.21.15.78:0/2219175370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf203e0 0x55e8bc327e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.682+0000 7f048f7fe640 1 -- 172.21.15.78:0/2219175370 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8bbf8a3d0 con 0x55e8bbf18200 2024-09-17T03:13:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.682+0000 7f048f7fe640 1 --2- 172.21.15.78:0/2219175370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf18200 0x55e8bc32d810 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f0484082850 tx=0x7f048407f2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e79a8c5109fd23 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.682+0000 7f0474ff9640 1 -- 172.21.15.78:0/2219175370 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484083250 con 0x55e8bbf18200 2024-09-17T03:13:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.682+0000 7f0474ff9640 1 -- 172.21.15.78:0/2219175370 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0484006630 con 0x55e8bbf18200 2024-09-17T03:13:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.682+0000 7f0474ff9640 1 -- 172.21.15.78:0/2219175370 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484082b50 con 0x55e8bbf18200 2024-09-17T03:13:20.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.683+0000 7f049d083740 1 -- 172.21.15.78:0/2219175370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf18200 msgr2=0x55e8bc32d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.683+0000 7f049d083740 1 --2- 172.21.15.78:0/2219175370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf18200 0x55e8bc32d810 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f0484082850 tx=0x7f048407f2d0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.683+0000 7f049d083740 1 -- 172.21.15.78:0/2219175370 shutdown_connections 2024-09-17T03:13:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.683+0000 7f049d083740 1 --2- 172.21.15.78:0/2219175370 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e8bbf410c0 0x55e8bc2ffcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.683+0000 7f049d083740 1 --2- 172.21.15.78:0/2219175370 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf203e0 0x55e8bc327e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.683+0000 7f049d083740 1 --2- 172.21.15.78:0/2219175370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf18200 0x55e8bc32d810 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.683+0000 7f049d083740 1 -- 172.21.15.78:0/2219175370 >> 172.21.15.78:0/2219175370 conn(0x55e8bbf35210 msgr2=0x55e8bc2e34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.683+0000 7f049d083740 1 -- 172.21.15.78:0/2219175370 shutdown_connections 2024-09-17T03:13:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.683+0000 7f049d083740 1 -- 172.21.15.78:0/2219175370 wait complete. 2024-09-17T03:13:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.684+0000 7f049d083740 1 -- start start 2024-09-17T03:13:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.684+0000 7f049d083740 1 Processor -- start 2024-09-17T03:13:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f049d083740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e8bbf18200 0x55e8bc3aa300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f049d083740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 0x55e8bc32d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f049d083740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf410c0 0x55e8bc32dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f049d083740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55e8bc32a0a0 con 0x55e8bbf203e0 2024-09-17T03:13:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f049d083740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e8bc329c50 con 0x55e8bbf410c0 2024-09-17T03:13:20.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f049d083740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55e8bc340030 con 0x55e8bbf18200 2024-09-17T03:13:20.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f049d083740 10 client.0 _ll_register_callbacks cb 0x7f0480005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:20.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f048effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 0x55e8bc32d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f048effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 0x55e8bc32d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34384/0 (socket says 172.21.15.78:34384) 2024-09-17T03:13:20.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f048effd640 1 -- 172.21.15.78:0/3175393475 learned_addr learned my addr 172.21.15.78:0/3175393475 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:20.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f048f7fe640 1 --2- 172.21.15.78:0/3175393475 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e8bbf18200 0x55e8bc3aa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f048ffff640 1 --2- 172.21.15.78:0/3175393475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf410c0 0x55e8bc32dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f048effd640 1 -- 172.21.15.78:0/3175393475 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e8bbf18200 msgr2=0x55e8bc3aa300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f048effd640 1 --2- 172.21.15.78:0/3175393475 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e8bbf18200 0x55e8bc3aa300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f048effd640 1 -- 172.21.15.78:0/3175393475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf410c0 msgr2=0x55e8bc32dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f048effd640 1 --2- 172.21.15.78:0/3175393475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf410c0 0x55e8bc32dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f048effd640 1 -- 172.21.15.78:0/3175393475 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8bc2e9730 con 0x55e8bbf203e0 2024-09-17T03:13:20.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f048effd640 1 --2- 172.21.15.78:0/3175393475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 0x55e8bc32d690 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f0480005940 tx=0x7f048001dc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47eecdbe7e5144f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f046e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:20.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f046e7fc640 1 -- 172.21.15.78:0/3175393475 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0480027680 con 0x55e8bbf203e0 2024-09-17T03:13:20.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f046e7fc640 1 -- 172.21.15.78:0/3175393475 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f0480009040 con 0x55e8bbf203e0 2024-09-17T03:13:20.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.686+0000 7f049d083740 1 -- 172.21.15.78:0/3175393475 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0484006630 con 0x55e8bbf203e0 2024-09-17T03:13:20.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.687+0000 7f046e7fc640 1 -- 172.21.15.78:0/3175393475 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f0480043050 con 0x55e8bbf203e0 2024-09-17T03:13:20.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.687+0000 7f049d083740 10 client.7227 fetch_fsmap learned FSMap version 68 2024-09-17T03:13:20.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.687+0000 7f049d083740 1 -- 172.21.15.78:0/3175393475 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x55e8bc350e70 con 0x55e8bbf203e0 2024-09-17T03:13:20.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.687+0000 7f046e7fc640 1 -- 172.21.15.78:0/3175393475 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0484006630 con 0x55e8bbf203e0 2024-09-17T03:13:20.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.687+0000 7f046e7fc640 1 -- 172.21.15.78:0/3175393475 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 68) ==== 3554+0+0 (secure 0 0 0) 0x7f0480046020 con 0x55e8bbf203e0 2024-09-17T03:13:20.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.687+0000 7f049d083740 10 client.7227 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T03:13:20.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.687+0000 7f049d083740 10 client.7227 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:13:20.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.687+0000 7f049d083740 20 client.7227 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:20.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.687+0000 7f049d083740 1 --2- 172.21.15.78:0/3175393475 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x55e8bc340e70 0x55e8bc2ff920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.687+0000 7f049d083740 4 client.7227 mds_command: new command op to 6861 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-17T03:13:20.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.687+0000 7f049d083740 1 -- 172.21.15.78:0/3175393475 --> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x55e8bc259660 con 0x55e8bc340e70 2024-09-17T03:13:20.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.687+0000 7f048f7fe640 1 --2- 172.21.15.78:0/3175393475 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x55e8bc340e70 0x55e8bc2ff920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.687+0000 7f046e7fc640 10 client.7227 ms_handle_connect on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:20.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.687+0000 7f048f7fe640 1 --2- 172.21.15.78:0/3175393475 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x55e8bc340e70 0x55e8bc2ff920 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c155004fe1be1c47 server_cookie=7d0fe5c3492e443 in_seq=0 out_seq=0 2024-09-17T03:13:20.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.688+0000 7f046e7fc640 1 -- 172.21.15.78:0/3175393475 <== mds.1 v2:172.21.15.78:6832/2905189397 1 ==== command_reply(tid 0: -18 Not rank 0) ==== 18+0+0 (crc 0 0 0) 0x55e8bc259660 con 0x55e8bc340e70 2024-09-17T03:13:20.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.688+0000 7f046e7fc640 10 client.7227 handle_command_reply: tid=0 2024-09-17T03:13:20.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.688+0000 7f049d083740 1 client.7227 shutdown 2024-09-17T03:13:20.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.688+0000 7f049d083740 1 -- 172.21.15.78:0/3175393475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 msgr2=0x55e8bc32d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.688+0000 7f049d083740 1 --2- 172.21.15.78:0/3175393475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 0x55e8bc32d690 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f0480005940 tx=0x7f048001dc20 comp rx=0 tx=0).stop 2024-09-17T03:13:20.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.688+0000 7f049d083740 1 -- 172.21.15.78:0/3175393475 shutdown_connections 2024-09-17T03:13:20.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.688+0000 7f049d083740 1 --2- 172.21.15.78:0/3175393475 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x55e8bc340e70 0x55e8bc2ff920 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.688+0000 7f049d083740 1 --2- 172.21.15.78:0/3175393475 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e8bbf410c0 0x55e8bc32dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.688+0000 7f049d083740 1 --2- 172.21.15.78:0/3175393475 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e8bbf203e0 0x55e8bc32d690 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.688+0000 7f046e7fc640 0 client.7227 ms_handle_reset on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:20.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.688+0000 7f049d083740 1 --2- 172.21.15.78:0/3175393475 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e8bbf18200 0x55e8bc3aa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.688+0000 7f049d083740 1 -- 172.21.15.78:0/3175393475 >> 172.21.15.78:0/3175393475 conn(0x55e8bbf35210 msgr2=0x55e8bc328be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.688+0000 7f049d083740 1 -- 172.21.15.78:0/3175393475 shutdown_connections 2024-09-17T03:13:20.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.688+0000 7f049d083740 1 -- 172.21.15.78:0/3175393475 wait complete. 2024-09-17T03:13:20.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.688+0000 7f049d083740 20 client.7227 trim_cache size 0 max 16384 2024-09-17T03:13:20.692 INFO:teuthology.orchestra.run.smithi078.stderr:Error EXDEV: Not rank 0 2024-09-17T03:13:20.693 DEBUG:teuthology.orchestra.run:got remote process result: 18 2024-09-17T03:13:20.693 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub pause 2024-09-17T03:13:20.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.808+0000 7f6c52751640 1 -- 172.21.15.78:0/3304460514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c4c0d1a80 msgr2=0x7f6c4c0cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.808+0000 7f6c52751640 1 --2- 172.21.15.78:0/3304460514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c4c0d1a80 0x7f6c4c0cf090 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009830 tx=0x7f6c4002a530 comp rx=0 tx=0).stop 2024-09-17T03:13:20.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.808+0000 7f6c52751640 1 -- 172.21.15.78:0/3304460514 shutdown_connections 2024-09-17T03:13:20.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.808+0000 7f6c52751640 1 --2- 172.21.15.78:0/3304460514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c4c0d1a80 0x7f6c4c0cf090 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.808+0000 7f6c52751640 1 --2- 172.21.15.78:0/3304460514 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6c4c0cf5d0 0x7f6c4c0cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.808+0000 7f6c52751640 1 -- 172.21.15.78:0/3304460514 >> 172.21.15.78:0/3304460514 conn(0x7f6c4c08bfc0 msgr2=0x7f6c4c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.808+0000 7f6c52751640 1 -- 172.21.15.78:0/3304460514 shutdown_connections 2024-09-17T03:13:20.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.808+0000 7f6c52751640 1 -- 172.21.15.78:0/3304460514 wait complete. 2024-09-17T03:13:20.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.810+0000 7f6c52751640 1 Processor -- start 2024-09-17T03:13:20.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.810+0000 7f6c52751640 1 -- start start 2024-09-17T03:13:20.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.811+0000 7f6c52751640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c4c0cf5d0 0x7f6c4c0ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.811+0000 7f6c52751640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6c4c0d1a80 0x7f6c4c15eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.812+0000 7f6c52751640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c4c0d2ed0 0x7f6c4c0b8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.812+0000 7f6c52751640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c162c60 con 0x7f6c4c0cf5d0 2024-09-17T03:13:20.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.812+0000 7f6c52751640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c162ae0 con 0x7f6c4c0d2ed0 2024-09-17T03:13:20.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.812+0000 7f6c52751640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4c162de0 con 0x7f6c4c0d1a80 2024-09-17T03:13:20.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.812+0000 7f6c4bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c4c0cf5d0 0x7f6c4c0ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.812+0000 7f6c4bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c4c0cf5d0 0x7f6c4c0ca7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34400/0 (socket says 172.21.15.78:34400) 2024-09-17T03:13:20.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.812+0000 7f6c4bfff640 1 -- 172.21.15.78:0/59389260 learned_addr learned my addr 172.21.15.78:0/59389260 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:20.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.812+0000 7f6c4b7fe640 1 --2- 172.21.15.78:0/59389260 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6c4c0d1a80 0x7f6c4c15eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.812+0000 7f6c50cee640 1 --2- 172.21.15.78:0/59389260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c4c0d2ed0 0x7f6c4c0b8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.812+0000 7f6c4bfff640 1 -- 172.21.15.78:0/59389260 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6c4c0d1a80 msgr2=0x7f6c4c15eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.812+0000 7f6c4bfff640 1 --2- 172.21.15.78:0/59389260 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6c4c0d1a80 0x7f6c4c15eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.812+0000 7f6c4bfff640 1 -- 172.21.15.78:0/59389260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c4c0d2ed0 msgr2=0x7f6c4c0b8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.812+0000 7f6c4bfff640 1 --2- 172.21.15.78:0/59389260 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c4c0d2ed0 0x7f6c4c0b8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.812+0000 7f6c4bfff640 1 -- 172.21.15.78:0/59389260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c4c0a1a60 con 0x7f6c4c0cf5d0 2024-09-17T03:13:20.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.812+0000 7f6c4bfff640 1 --2- 172.21.15.78:0/59389260 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c4c0cf5d0 0x7f6c4c0ca7e0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c00c3f0 tx=0x7f6c3c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.812+0000 7f6c48ff9640 1 -- 172.21.15.78:0/59389260 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c017070 con 0x7f6c4c0cf5d0 2024-09-17T03:13:20.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.812+0000 7f6c48ff9640 1 -- 172.21.15.78:0/59389260 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c3c0035f0 con 0x7f6c4c0cf5d0 2024-09-17T03:13:20.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.812+0000 7f6c52751640 1 -- 172.21.15.78:0/59389260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c4c15efe0 con 0x7f6c4c0cf5d0 2024-09-17T03:13:20.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.812+0000 7f6c48ff9640 1 -- 172.21.15.78:0/59389260 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c003a40 con 0x7f6c4c0cf5d0 2024-09-17T03:13:20.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.812+0000 7f6c52751640 1 -- 172.21.15.78:0/59389260 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c4c1f9600 con 0x7f6c4c0cf5d0 2024-09-17T03:13:20.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.814+0000 7f6c48ff9640 1 -- 172.21.15.78:0/59389260 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6c3c01a070 con 0x7f6c4c0cf5d0 2024-09-17T03:13:20.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.815+0000 7f6c48ff9640 1 --2- 172.21.15.78:0/59389260 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6c38078b90 0x7f6c3807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.815+0000 7f6c48ff9640 1 -- 172.21.15.78:0/59389260 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f6c3c09a0b0 con 0x7f6c4c0cf5d0 2024-09-17T03:13:20.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.815+0000 7f6c4b7fe640 1 --2- 172.21.15.78:0/59389260 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6c38078b90 0x7f6c3807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.815+0000 7f6c596b8740 1 Processor -- start 2024-09-17T03:13:20.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.816+0000 7f6c596b8740 1 -- start start 2024-09-17T03:13:20.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.816+0000 7f6c4b7fe640 1 --2- 172.21.15.78:0/59389260 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6c38078b90 0x7f6c3807b0a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6c40034000 tx=0x7f6c40004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c596b8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a9a0c0 0x559ec8e6b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c596b8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 0x559ec8e6beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c596b8740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a793e0 0x559ec8e88db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c596b8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x559ec8db4c60 con 0x559ec8a71200 2024-09-17T03:13:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c596b8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559ec8da4090 con 0x559ec8a9a0c0 2024-09-17T03:13:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c596b8740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x559ec8da7ea0 con 0x559ec8a793e0 2024-09-17T03:13:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c4b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 0x559ec8e6beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c4b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 0x559ec8e6beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34402/0 (socket says 172.21.15.78:34402) 2024-09-17T03:13:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c4b7fe640 1 -- 172.21.15.78:0/1821368976 learned_addr learned my addr 172.21.15.78:0/1821368976 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c4bfff640 1 --2- 172.21.15.78:0/1821368976 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a9a0c0 0x559ec8e6b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c50cee640 1 --2- 172.21.15.78:0/1821368976 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a793e0 0x559ec8e88db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c4b7fe640 1 -- 172.21.15.78:0/1821368976 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a793e0 msgr2=0x559ec8e88db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c4b7fe640 1 --2- 172.21.15.78:0/1821368976 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a793e0 0x559ec8e88db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c4b7fe640 1 -- 172.21.15.78:0/1821368976 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a9a0c0 msgr2=0x559ec8e6b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c4b7fe640 1 --2- 172.21.15.78:0/1821368976 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a9a0c0 0x559ec8e6b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c4b7fe640 1 -- 172.21.15.78:0/1821368976 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec8a96120 con 0x559ec8a71200 2024-09-17T03:13:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c50cee640 1 --2- 172.21.15.78:0/1821368976 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a793e0 0x559ec8e88db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c4b7fe640 1 --2- 172.21.15.78:0/1821368976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 0x559ec8e6beb0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f6c4002ab20 tx=0x7f6c4003e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b5e14210da33ac server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c31ffb640 1 -- 172.21.15.78:0/1821368976 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4003c420 con 0x559ec8a71200 2024-09-17T03:13:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c31ffb640 1 -- 172.21.15.78:0/1821368976 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c4003c6b0 con 0x559ec8a71200 2024-09-17T03:13:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.817+0000 7f6c31ffb640 1 -- 172.21.15.78:0/1821368976 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4003ca60 con 0x559ec8a71200 2024-09-17T03:13:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.818+0000 7f6c596b8740 1 -- 172.21.15.78:0/1821368976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 msgr2=0x559ec8e6beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.818+0000 7f6c596b8740 1 --2- 172.21.15.78:0/1821368976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 0x559ec8e6beb0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f6c4002ab20 tx=0x7f6c4003e070 comp rx=0 tx=0).stop 2024-09-17T03:13:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.818+0000 7f6c596b8740 1 -- 172.21.15.78:0/1821368976 shutdown_connections 2024-09-17T03:13:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.818+0000 7f6c596b8740 1 --2- 172.21.15.78:0/1821368976 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a793e0 0x559ec8e88db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.818+0000 7f6c596b8740 1 --2- 172.21.15.78:0/1821368976 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 0x559ec8e6beb0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.818+0000 7f6c596b8740 1 --2- 172.21.15.78:0/1821368976 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a9a0c0 0x559ec8e6b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.818+0000 7f6c596b8740 1 -- 172.21.15.78:0/1821368976 >> 172.21.15.78:0/1821368976 conn(0x559ec8a8e210 msgr2=0x559ec8e41c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.818+0000 7f6c596b8740 1 -- 172.21.15.78:0/1821368976 shutdown_connections 2024-09-17T03:13:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.818+0000 7f6c596b8740 1 -- 172.21.15.78:0/1821368976 wait complete. 2024-09-17T03:13:20.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.819+0000 7f6c596b8740 1 -- start start 2024-09-17T03:13:20.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.819+0000 7f6c596b8740 1 Processor -- start 2024-09-17T03:13:20.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c596b8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 0x559ec8e80370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c596b8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a793e0 0x559ec8e65e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c596b8740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a9a0c0 0x559ec8e64170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c596b8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x559ec8b14470 con 0x559ec8a71200 2024-09-17T03:13:20.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c596b8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559ec8d2a410 con 0x559ec8a793e0 2024-09-17T03:13:20.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c596b8740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x559ec8e6c3f0 con 0x559ec8a9a0c0 2024-09-17T03:13:20.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c596b8740 10 client.0 _ll_register_callbacks cb 0x559ec8d9d1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:20.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c4bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 0x559ec8e80370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c4bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 0x559ec8e80370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34414/0 (socket says 172.21.15.78:34414) 2024-09-17T03:13:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c4bfff640 1 -- 172.21.15.78:0/3510833393 learned_addr learned my addr 172.21.15.78:0/3510833393 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c4b7fe640 1 --2- 172.21.15.78:0/3510833393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a793e0 0x559ec8e65e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c50cee640 1 --2- 172.21.15.78:0/3510833393 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a9a0c0 0x559ec8e64170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c4bfff640 1 -- 172.21.15.78:0/3510833393 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a9a0c0 msgr2=0x559ec8e64170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c4bfff640 1 --2- 172.21.15.78:0/3510833393 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a9a0c0 0x559ec8e64170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c4bfff640 1 -- 172.21.15.78:0/3510833393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a793e0 msgr2=0x559ec8e65e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c4bfff640 1 --2- 172.21.15.78:0/3510833393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a793e0 0x559ec8e65e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c4bfff640 1 -- 172.21.15.78:0/3510833393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ec8b7c500 con 0x559ec8a71200 2024-09-17T03:13:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c50cee640 1 --2- 172.21.15.78:0/3510833393 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a9a0c0 0x559ec8e64170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c4bfff640 1 --2- 172.21.15.78:0/3510833393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 0x559ec8e80370 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c05f0b0 tx=0x7f6c3c061950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba786d4d86ca8a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c2affd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:20.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c2affd640 1 -- 172.21.15.78:0/3510833393 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c07c060 con 0x559ec8a71200 2024-09-17T03:13:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c2affd640 1 -- 172.21.15.78:0/3510833393 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f6c3c06b540 con 0x559ec8a71200 2024-09-17T03:13:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.821+0000 7f6c596b8740 1 -- 172.21.15.78:0/3510833393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c4003c6b0 con 0x559ec8a71200 2024-09-17T03:13:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.822+0000 7f6c2affd640 1 -- 172.21.15.78:0/3510833393 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f6c3c082050 con 0x559ec8a71200 2024-09-17T03:13:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.822+0000 7f6c596b8740 10 client.7242 fetch_fsmap learned FSMap version 68 2024-09-17T03:13:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.822+0000 7f6c596b8740 1 -- 172.21.15.78:0/3510833393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x559ec8bdcc90 con 0x559ec8a71200 2024-09-17T03:13:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.822+0000 7f6c2affd640 1 -- 172.21.15.78:0/3510833393 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c4003c6b0 con 0x559ec8a71200 2024-09-17T03:13:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.822+0000 7f6c2affd640 1 -- 172.21.15.78:0/3510833393 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 68) ==== 3554+0+0 (secure 0 0 0) 0x7f6c3c0610a0 con 0x559ec8a71200 2024-09-17T03:13:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.822+0000 7f6c596b8740 10 client.7242 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T03:13:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.822+0000 7f6c596b8740 10 client.7242 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:13:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.822+0000 7f6c596b8740 20 client.7242 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.822+0000 7f6c596b8740 1 --2- 172.21.15.78:0/3510833393 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x559ec8a58ea0 0x559ec8e7f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.822+0000 7f6c596b8740 4 client.7242 mds_command: new command op to 6861 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:13:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.822+0000 7f6c596b8740 1 -- 172.21.15.78:0/3510833393 --> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ec8db6bb0 con 0x559ec8a58ea0 2024-09-17T03:13:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.822+0000 7f6c4b7fe640 1 --2- 172.21.15.78:0/3510833393 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x559ec8a58ea0 0x559ec8e7f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.822+0000 7f6c2affd640 10 client.7242 ms_handle_connect on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.822+0000 7f6c4b7fe640 1 --2- 172.21.15.78:0/3510833393 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x559ec8a58ea0 0x559ec8e7f080 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8b9ac1510baaaf28 server_cookie=95153882f40fc355 in_seq=0 out_seq=0 2024-09-17T03:13:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.823+0000 7f6c2affd640 1 -- 172.21.15.78:0/3510833393 <== mds.1 v2:172.21.15.78:6832/2905189397 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559ec8db6bb0 con 0x559ec8a58ea0 2024-09-17T03:13:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.823+0000 7f6c2affd640 10 client.7242 handle_command_reply: tid=0 2024-09-17T03:13:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.823+0000 7f6c596b8740 1 client.7242 shutdown 2024-09-17T03:13:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.823+0000 7f6c596b8740 1 -- 172.21.15.78:0/3510833393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 msgr2=0x559ec8e80370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.823+0000 7f6c596b8740 1 --2- 172.21.15.78:0/3510833393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 0x559ec8e80370 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c05f0b0 tx=0x7f6c3c061950 comp rx=0 tx=0).stop 2024-09-17T03:13:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.823+0000 7f6c596b8740 1 -- 172.21.15.78:0/3510833393 shutdown_connections 2024-09-17T03:13:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.823+0000 7f6c596b8740 1 --2- 172.21.15.78:0/3510833393 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x559ec8a58ea0 0x559ec8e7f080 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.823+0000 7f6c596b8740 1 --2- 172.21.15.78:0/3510833393 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a9a0c0 0x559ec8e64170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.823+0000 7f6c596b8740 1 --2- 172.21.15.78:0/3510833393 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a793e0 0x559ec8e65e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.823+0000 7f6c596b8740 1 --2- 172.21.15.78:0/3510833393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 0x559ec8e80370 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.823+0000 7f6c2affd640 0 client.7242 ms_handle_reset on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:20.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.823+0000 7f6c596b8740 1 -- 172.21.15.78:0/3510833393 >> 172.21.15.78:0/3510833393 conn(0x559ec8a8e210 msgr2=0x559ec8e3af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.823+0000 7f6c596b8740 1 -- 172.21.15.78:0/3510833393 shutdown_connections 2024-09-17T03:13:20.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.823+0000 7f6c596b8740 1 -- 172.21.15.78:0/3510833393 wait complete. 2024-09-17T03:13:20.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.824+0000 7f6c596b8740 20 client.7242 trim_cache size 0 max 16384 2024-09-17T03:13:20.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.841+0000 7f6c596b8740 1 Processor -- start 2024-09-17T03:13:20.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.841+0000 7f6c596b8740 1 -- start start 2024-09-17T03:13:20.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.842+0000 7f6c596b8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 0x559ec8e3c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.842+0000 7f6c596b8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a793e0 0x559ec8e3c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.842+0000 7f6c596b8740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a9a0c0 0x559ec8eaa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.842+0000 7f6c596b8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c1f6b40 con 0x559ec8a71200 2024-09-17T03:13:20.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.842+0000 7f6c596b8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4c201a50 con 0x559ec8a793e0 2024-09-17T03:13:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.842+0000 7f6c596b8740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4c0c8fc0 con 0x559ec8a9a0c0 2024-09-17T03:13:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.842+0000 7f6c4bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 0x559ec8e3c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.842+0000 7f6c4bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 0x559ec8e3c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34426/0 (socket says 172.21.15.78:34426) 2024-09-17T03:13:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.842+0000 7f6c4bfff640 1 -- 172.21.15.78:0/1244758981 learned_addr learned my addr 172.21.15.78:0/1244758981 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.842+0000 7f6c4b7fe640 1 --2- 172.21.15.78:0/1244758981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a793e0 0x559ec8e3c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.842+0000 7f6c50cee640 1 --2- 172.21.15.78:0/1244758981 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a9a0c0 0x559ec8eaa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.842+0000 7f6c4bfff640 1 -- 172.21.15.78:0/1244758981 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a9a0c0 msgr2=0x559ec8eaa1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.842+0000 7f6c4bfff640 1 --2- 172.21.15.78:0/1244758981 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a9a0c0 0x559ec8eaa1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.842+0000 7f6c4bfff640 1 -- 172.21.15.78:0/1244758981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a793e0 msgr2=0x559ec8e3c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.842+0000 7f6c4bfff640 1 --2- 172.21.15.78:0/1244758981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a793e0 0x559ec8e3c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.842+0000 7f6c4bfff640 1 -- 172.21.15.78:0/1244758981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec8ae33d0 con 0x559ec8a71200 2024-09-17T03:13:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.842+0000 7f6c50cee640 1 --2- 172.21.15.78:0/1244758981 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a9a0c0 0x559ec8eaa1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.842+0000 7f6c4bfff640 1 --2- 172.21.15.78:0/1244758981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 0x559ec8e3c350 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c007e80 tx=0x7f6c3c061a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de468f1fdba633bd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.842+0000 7f6c317fa640 1 -- 172.21.15.78:0/1244758981 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c07c050 con 0x559ec8a71200 2024-09-17T03:13:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.843+0000 7f6c317fa640 1 -- 172.21.15.78:0/1244758981 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c3c066920 con 0x559ec8a71200 2024-09-17T03:13:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.843+0000 7f6c317fa640 1 -- 172.21.15.78:0/1244758981 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c088070 con 0x559ec8a71200 2024-09-17T03:13:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.843+0000 7f6c596b8740 1 -- 172.21.15.78:0/1244758981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 msgr2=0x559ec8e3c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.843+0000 7f6c596b8740 1 --2- 172.21.15.78:0/1244758981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 0x559ec8e3c350 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c007e80 tx=0x7f6c3c061a80 comp rx=0 tx=0).stop 2024-09-17T03:13:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.843+0000 7f6c596b8740 1 -- 172.21.15.78:0/1244758981 shutdown_connections 2024-09-17T03:13:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.843+0000 7f6c596b8740 1 --2- 172.21.15.78:0/1244758981 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a9a0c0 0x559ec8eaa1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.843+0000 7f6c596b8740 1 --2- 172.21.15.78:0/1244758981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a793e0 0x559ec8e3c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.843+0000 7f6c596b8740 1 --2- 172.21.15.78:0/1244758981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a71200 0x559ec8e3c350 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.843+0000 7f6c596b8740 1 -- 172.21.15.78:0/1244758981 >> 172.21.15.78:0/1244758981 conn(0x559ec8a8e210 msgr2=0x559ec8e86f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.843+0000 7f6c596b8740 1 -- 172.21.15.78:0/1244758981 shutdown_connections 2024-09-17T03:13:20.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.843+0000 7f6c596b8740 1 -- 172.21.15.78:0/1244758981 wait complete. 2024-09-17T03:13:20.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.844+0000 7f6c596b8740 1 -- start start 2024-09-17T03:13:20.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.844+0000 7f6c596b8740 1 Processor -- start 2024-09-17T03:13:20.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c596b8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a71200 0x559ec8f09ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c596b8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a793e0 0x559ec8efd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c596b8740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a9a0c0 0x559ec8e86370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c596b8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x559ec8e5a3e0 con 0x559ec8a793e0 2024-09-17T03:13:20.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c596b8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x559ec8e66510 con 0x559ec8a71200 2024-09-17T03:13:20.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c596b8740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x559ec8e64f00 con 0x559ec8a9a0c0 2024-09-17T03:13:20.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c596b8740 10 client.0 _ll_register_callbacks cb 0x7f6c3c05ddd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:20.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c4b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a793e0 0x559ec8efd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c4b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a793e0 0x559ec8efd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34442/0 (socket says 172.21.15.78:34442) 2024-09-17T03:13:20.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c4b7fe640 1 -- 172.21.15.78:0/1346150729 learned_addr learned my addr 172.21.15.78:0/1346150729 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:20.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c50cee640 1 --2- 172.21.15.78:0/1346150729 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a9a0c0 0x559ec8e86370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c4bfff640 1 --2- 172.21.15.78:0/1346150729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a71200 0x559ec8f09ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c4b7fe640 1 -- 172.21.15.78:0/1346150729 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a9a0c0 msgr2=0x559ec8e86370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c4b7fe640 1 --2- 172.21.15.78:0/1346150729 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a9a0c0 0x559ec8e86370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c4b7fe640 1 -- 172.21.15.78:0/1346150729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a71200 msgr2=0x559ec8f09ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c4b7fe640 1 --2- 172.21.15.78:0/1346150729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a71200 0x559ec8f09ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c4b7fe640 1 -- 172.21.15.78:0/1346150729 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ec8efd880 con 0x559ec8a793e0 2024-09-17T03:13:20.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c4bfff640 1 --2- 172.21.15.78:0/1346150729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a71200 0x559ec8f09ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:20.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c4b7fe640 1 --2- 172.21.15.78:0/1346150729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a793e0 0x559ec8efd340 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009830 tx=0x7f6c400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16234a76754e821d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c2affd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:20.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.846+0000 7f6c2affd640 1 -- 172.21.15.78:0/1346150729 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4003c8b0 con 0x559ec8a793e0 2024-09-17T03:13:20.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.847+0000 7f6c2affd640 1 -- 172.21.15.78:0/1346150729 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f6c4003ca50 con 0x559ec8a793e0 2024-09-17T03:13:20.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.847+0000 7f6c596b8740 1 -- 172.21.15.78:0/1346150729 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c3c066920 con 0x559ec8a793e0 2024-09-17T03:13:20.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.847+0000 7f6c2affd640 1 -- 172.21.15.78:0/1346150729 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f6c4006e050 con 0x559ec8a793e0 2024-09-17T03:13:20.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.847+0000 7f6c596b8740 10 client.7248 fetch_fsmap learned FSMap version 68 2024-09-17T03:13:20.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.847+0000 7f6c596b8740 1 -- 172.21.15.78:0/1346150729 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x559ec8e85ec0 con 0x559ec8a793e0 2024-09-17T03:13:20.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.847+0000 7f6c2affd640 1 -- 172.21.15.78:0/1346150729 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c3c066920 con 0x559ec8a793e0 2024-09-17T03:13:20.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.847+0000 7f6c2affd640 1 -- 172.21.15.78:0/1346150729 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 68) ==== 3554+0+0 (secure 0 0 0) 0x7f6c40071020 con 0x559ec8a793e0 2024-09-17T03:13:20.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.847+0000 7f6c596b8740 10 client.7248 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T03:13:20.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.847+0000 7f6c596b8740 10 client.7248 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:13:20.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.847+0000 7f6c596b8740 20 client.7248 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:20.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.847+0000 7f6c596b8740 1 --2- 172.21.15.78:0/1346150729 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x559ec8e3ca70 0x559ec8e82ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.847+0000 7f6c596b8740 4 client.7248 mds_command: new command op to 6861 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-17T03:13:20.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.847+0000 7f6c596b8740 1 -- 172.21.15.78:0/1346150729 --> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x559ec8db2660 con 0x559ec8e3ca70 2024-09-17T03:13:20.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.847+0000 7f6c4bfff640 1 --2- 172.21.15.78:0/1346150729 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x559ec8e3ca70 0x559ec8e82ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.847+0000 7f6c2affd640 10 client.7248 ms_handle_connect on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:20.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.848+0000 7f6c4bfff640 1 --2- 172.21.15.78:0/1346150729 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x559ec8e3ca70 0x559ec8e82ca0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6d6312bed13ce0a9 server_cookie=a9c2a00b2a2a9f80 in_seq=0 out_seq=0 2024-09-17T03:13:20.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.848+0000 7f6c2affd640 1 -- 172.21.15.78:0/1346150729 <== mds.1 v2:172.21.15.78:6832/2905189397 1 ==== command_reply(tid 0: -18 Not rank 0) ==== 18+0+0 (crc 0 0 0) 0x559ec8db2660 con 0x559ec8e3ca70 2024-09-17T03:13:20.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.848+0000 7f6c2affd640 10 client.7248 handle_command_reply: tid=0 2024-09-17T03:13:20.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.848+0000 7f6c596b8740 1 client.7248 shutdown 2024-09-17T03:13:20.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.848+0000 7f6c596b8740 1 -- 172.21.15.78:0/1346150729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a793e0 msgr2=0x559ec8efd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.848+0000 7f6c596b8740 1 --2- 172.21.15.78:0/1346150729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a793e0 0x559ec8efd340 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009830 tx=0x7f6c400046c0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.848+0000 7f6c596b8740 1 -- 172.21.15.78:0/1346150729 shutdown_connections 2024-09-17T03:13:20.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.848+0000 7f6c596b8740 1 --2- 172.21.15.78:0/1346150729 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x559ec8e3ca70 0x559ec8e82ca0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.848+0000 7f6c596b8740 1 --2- 172.21.15.78:0/1346150729 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x559ec8a9a0c0 0x559ec8e86370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.848+0000 7f6c596b8740 1 --2- 172.21.15.78:0/1346150729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x559ec8a793e0 0x559ec8efd340 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.848+0000 7f6c2affd640 0 client.7248 ms_handle_reset on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:20.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.848+0000 7f6c596b8740 1 --2- 172.21.15.78:0/1346150729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x559ec8a71200 0x559ec8f09ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.848+0000 7f6c596b8740 1 -- 172.21.15.78:0/1346150729 >> 172.21.15.78:0/1346150729 conn(0x559ec8a8e210 msgr2=0x559ec8e86f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.848+0000 7f6c596b8740 1 -- 172.21.15.78:0/1346150729 shutdown_connections 2024-09-17T03:13:20.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.848+0000 7f6c596b8740 1 -- 172.21.15.78:0/1346150729 wait complete. 2024-09-17T03:13:20.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.848+0000 7f6c596b8740 20 client.7248 trim_cache size 0 max 16384 2024-09-17T03:13:20.853 INFO:teuthology.orchestra.run.smithi078.stderr:Error EXDEV: Not rank 0 2024-09-17T03:13:20.853 DEBUG:teuthology.orchestra.run:got remote process result: 18 2024-09-17T03:13:20.854 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c scrub resume 2024-09-17T03:13:20.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.970+0000 7f0241519640 1 -- 172.21.15.78:0/1641029121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0228004d40 msgr2=0x7f02280051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.970+0000 7f0241519640 1 --2- 172.21.15.78:0/1641029121 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0228004d40 0x7f02280051f0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f0234001d90 tx=0x7f0228005830 comp rx=0 tx=0).stop 2024-09-17T03:13:20.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.970+0000 7f023b7fe640 1 -- 172.21.15.78:0/1641029121 reap_dead start 2024-09-17T03:13:20.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.970+0000 7f0241519640 1 -- 172.21.15.78:0/1641029121 shutdown_connections 2024-09-17T03:13:20.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.970+0000 7f0241519640 1 -- 172.21.15.78:0/1641029121 >> 172.21.15.78:0/1641029121 conn(0x7f023c08bfc0 msgr2=0x7f023c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.970+0000 7f0241519640 1 -- 172.21.15.78:0/1641029121 shutdown_connections 2024-09-17T03:13:20.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.970+0000 7f0241519640 1 -- 172.21.15.78:0/1641029121 wait complete. 2024-09-17T03:13:20.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.972+0000 7f0241519640 1 Processor -- start 2024-09-17T03:13:20.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.972+0000 7f0241519640 1 -- start start 2024-09-17T03:13:20.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.973+0000 7f0241519640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0228004d40 0x7f023c0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.973+0000 7f0241519640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f023c0a1e00 0x7f023c153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.973+0000 7f0241519640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f023c153c80 0x7f023c0c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.973+0000 7f0241519640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f023c0d1c00 con 0x7f0228004d40 2024-09-17T03:13:20.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.973+0000 7f0241519640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f023c0d1a80 con 0x7f023c153c80 2024-09-17T03:13:20.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.973+0000 7f0241519640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f023c0d1d80 con 0x7f023c0a1e00 2024-09-17T03:13:20.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.973+0000 7f023affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0228004d40 0x7f023c0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.973+0000 7f023affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0228004d40 0x7f023c0cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34470/0 (socket says 172.21.15.78:34470) 2024-09-17T03:13:20.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.973+0000 7f023affd640 1 -- 172.21.15.78:0/1958446725 learned_addr learned my addr 172.21.15.78:0/1958446725 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:20.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.974+0000 7f023affd640 1 -- 172.21.15.78:0/1958446725 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f023c0a1e00 msgr2=0x7f023c153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.974+0000 7f023affd640 1 --2- 172.21.15.78:0/1958446725 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f023c0a1e00 0x7f023c153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.974+0000 7f023affd640 1 -- 172.21.15.78:0/1958446725 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f023c153c80 msgr2=0x7f023c0c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.974+0000 7f023affd640 1 --2- 172.21.15.78:0/1958446725 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f023c153c80 0x7f023c0c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.974+0000 7f023affd640 1 -- 172.21.15.78:0/1958446725 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023c157320 con 0x7f0228004d40 2024-09-17T03:13:20.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.974+0000 7f023affd640 1 --2- 172.21.15.78:0/1958446725 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0228004d40 0x7f023c0cb350 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f022c011ae0 tx=0x7f022c009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.974+0000 7f0233fff640 1 -- 172.21.15.78:0/1958446725 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c01e070 con 0x7f0228004d40 2024-09-17T03:13:20.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.974+0000 7f0233fff640 1 -- 172.21.15.78:0/1958446725 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f022c00fbc0 con 0x7f0228004d40 2024-09-17T03:13:20.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.974+0000 7f0241519640 1 -- 172.21.15.78:0/1958446725 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f023c0c8710 con 0x7f0228004d40 2024-09-17T03:13:20.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.974+0000 7f0233fff640 1 -- 172.21.15.78:0/1958446725 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c004030 con 0x7f0228004d40 2024-09-17T03:13:20.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.974+0000 7f0241519640 1 -- 172.21.15.78:0/1958446725 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f023c0c8cd0 con 0x7f0228004d40 2024-09-17T03:13:20.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.976+0000 7f0233fff640 1 -- 172.21.15.78:0/1958446725 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f022c021070 con 0x7f0228004d40 2024-09-17T03:13:20.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.977+0000 7f0233fff640 1 --2- 172.21.15.78:0/1958446725 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f021c078b90 0x7f021c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.977+0000 7f0233fff640 1 -- 172.21.15.78:0/1958446725 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f022c09b6c0 con 0x7f0228004d40 2024-09-17T03:13:20.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.977+0000 7f02327fc640 1 --2- 172.21.15.78:0/1958446725 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f021c078b90 0x7f021c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.977+0000 7f02327fc640 1 --2- 172.21.15.78:0/1958446725 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f021c078b90 0x7f021c07b0a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0224001860 tx=0x7f0224000ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.977+0000 7f0248487740 1 Processor -- start 2024-09-17T03:13:20.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.978+0000 7f0248487740 1 -- start start 2024-09-17T03:13:20.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.979+0000 7f0248487740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b241390 0x56044b630310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.979+0000 7f0248487740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b2184d0 0x56044b612fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.979+0000 7f0248487740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56044b2206b0 0x56044b613520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.979+0000 7f0248487740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56044b55bbd0 con 0x56044b2184d0 2024-09-17T03:13:20.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.979+0000 7f0248487740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56044b54b000 con 0x56044b2206b0 2024-09-17T03:13:20.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.979+0000 7f0248487740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x56044b54ee10 con 0x56044b241390 2024-09-17T03:13:20.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.979+0000 7f02327fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b2184d0 0x56044b612fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.979+0000 7f02327fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b2184d0 0x56044b612fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34480/0 (socket says 172.21.15.78:34480) 2024-09-17T03:13:20.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.979+0000 7f02327fc640 1 -- 172.21.15.78:0/1465630735 learned_addr learned my addr 172.21.15.78:0/1465630735 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:20.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.979+0000 7f023affd640 1 --2- 172.21.15.78:0/1465630735 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b241390 0x56044b630310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.979+0000 7f023b7fe640 1 --2- 172.21.15.78:0/1465630735 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56044b2206b0 0x56044b613520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.979+0000 7f02327fc640 1 -- 172.21.15.78:0/1465630735 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b241390 msgr2=0x56044b630310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.979+0000 7f02327fc640 1 --2- 172.21.15.78:0/1465630735 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b241390 0x56044b630310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.979+0000 7f02327fc640 1 -- 172.21.15.78:0/1465630735 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56044b2206b0 msgr2=0x56044b613520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.979+0000 7f02327fc640 1 --2- 172.21.15.78:0/1465630735 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56044b2206b0 0x56044b613520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.979+0000 7f02327fc640 1 -- 172.21.15.78:0/1465630735 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56044b3237d0 con 0x56044b2184d0 2024-09-17T03:13:20.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.979+0000 7f02327fc640 1 --2- 172.21.15.78:0/1465630735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b2184d0 0x56044b612fe0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f022400ebb0 tx=0x7f0224011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ebc4d57be39222 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.980+0000 7f0230ff9640 1 -- 172.21.15.78:0/1465630735 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0224024070 con 0x56044b2184d0 2024-09-17T03:13:20.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.980+0000 7f0230ff9640 1 -- 172.21.15.78:0/1465630735 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0224011d90 con 0x56044b2184d0 2024-09-17T03:13:20.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.980+0000 7f0230ff9640 1 -- 172.21.15.78:0/1465630735 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022401d5e0 con 0x56044b2184d0 2024-09-17T03:13:20.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.980+0000 7f0248487740 1 -- 172.21.15.78:0/1465630735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b2184d0 msgr2=0x56044b612fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.980+0000 7f0248487740 1 --2- 172.21.15.78:0/1465630735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b2184d0 0x56044b612fe0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f022400ebb0 tx=0x7f0224011000 comp rx=0 tx=0).stop 2024-09-17T03:13:20.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.981+0000 7f0248487740 1 -- 172.21.15.78:0/1465630735 shutdown_connections 2024-09-17T03:13:20.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.981+0000 7f0248487740 1 --2- 172.21.15.78:0/1465630735 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56044b2206b0 0x56044b613520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.981+0000 7f0248487740 1 --2- 172.21.15.78:0/1465630735 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b2184d0 0x56044b612fe0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.981+0000 7f0248487740 1 --2- 172.21.15.78:0/1465630735 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b241390 0x56044b630310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.981+0000 7f0248487740 1 -- 172.21.15.78:0/1465630735 >> 172.21.15.78:0/1465630735 conn(0x56044b2354e0 msgr2=0x56044b5e9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.981+0000 7f0248487740 1 -- 172.21.15.78:0/1465630735 shutdown_connections 2024-09-17T03:13:20.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.981+0000 7f0248487740 1 -- 172.21.15.78:0/1465630735 wait complete. 2024-09-17T03:13:20.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.981+0000 7f0248487740 1 -- start start 2024-09-17T03:13:20.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.982+0000 7f0248487740 1 Processor -- start 2024-09-17T03:13:20.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.983+0000 7f0248487740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b2184d0 0x56044b600c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.983+0000 7f0248487740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56044b2206b0 0x56044b6272c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.983+0000 7f0248487740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b241390 0x56044b627800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.983+0000 7f0248487740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56044b2bb740 con 0x56044b2184d0 2024-09-17T03:13:20.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.983+0000 7f0248487740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56044b4f0540 con 0x56044b2206b0 2024-09-17T03:13:20.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.983+0000 7f0248487740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x56044b625af0 con 0x56044b241390 2024-09-17T03:13:20.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.983+0000 7f0248487740 10 client.0 _ll_register_callbacks cb 0x56044b4ef0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:20.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.983+0000 7f023affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b2184d0 0x56044b600c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.983+0000 7f023affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b2184d0 0x56044b600c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34486/0 (socket says 172.21.15.78:34486) 2024-09-17T03:13:20.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.983+0000 7f023affd640 1 -- 172.21.15.78:0/392055655 learned_addr learned my addr 172.21.15.78:0/392055655 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:20.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.983+0000 7f02327fc640 1 --2- 172.21.15.78:0/392055655 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56044b2206b0 0x56044b6272c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.983+0000 7f023b7fe640 1 --2- 172.21.15.78:0/392055655 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b241390 0x56044b627800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.983+0000 7f023affd640 1 -- 172.21.15.78:0/392055655 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b241390 msgr2=0x56044b627800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.983+0000 7f023affd640 1 --2- 172.21.15.78:0/392055655 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b241390 0x56044b627800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.983+0000 7f023affd640 1 -- 172.21.15.78:0/392055655 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56044b2206b0 msgr2=0x56044b6272c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:20.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.983+0000 7f023affd640 1 --2- 172.21.15.78:0/392055655 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56044b2206b0 0x56044b6272c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.983+0000 7f023affd640 1 -- 172.21.15.78:0/392055655 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56044b28a6a0 con 0x56044b2184d0 2024-09-17T03:13:20.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.983+0000 7f023affd640 1 --2- 172.21.15.78:0/392055655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b2184d0 0x56044b600c20 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f022c009fd0 tx=0x7f022c0639a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a1f6986c02b10b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:20.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.983+0000 7f0219ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:20.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.983+0000 7f0219ffb640 1 -- 172.21.15.78:0/392055655 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022c06cd40 con 0x56044b2184d0 2024-09-17T03:13:20.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.984+0000 7f0219ffb640 1 -- 172.21.15.78:0/392055655 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f022c085b20 con 0x56044b2184d0 2024-09-17T03:13:20.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.984+0000 7f0248487740 1 -- 172.21.15.78:0/392055655 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0224011d90 con 0x56044b2184d0 2024-09-17T03:13:20.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.984+0000 7f0219ffb640 1 -- 172.21.15.78:0/392055655 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f022c085d20 con 0x56044b2184d0 2024-09-17T03:13:20.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.984+0000 7f0248487740 10 client.7260 fetch_fsmap learned FSMap version 68 2024-09-17T03:13:20.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.984+0000 7f0248487740 1 -- 172.21.15.78:0/392055655 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x56044b383f60 con 0x56044b2184d0 2024-09-17T03:13:20.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.984+0000 7f0219ffb640 1 -- 172.21.15.78:0/392055655 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0224011d90 con 0x56044b2184d0 2024-09-17T03:13:20.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.984+0000 7f0219ffb640 1 -- 172.21.15.78:0/392055655 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 68) ==== 3554+0+0 (secure 0 0 0) 0x7f022c05ed20 con 0x56044b2184d0 2024-09-17T03:13:20.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.984+0000 7f0248487740 10 client.7260 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T03:13:20.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.984+0000 7f0248487740 10 client.7260 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:13:20.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.984+0000 7f0248487740 20 client.7260 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:20.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.984+0000 7f0248487740 1 --2- 172.21.15.78:0/392055655 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x56044b1fff60 0x56044b63d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.984+0000 7f0248487740 4 client.7260 mds_command: new command op to 6861 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:13:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.984+0000 7f0248487740 1 -- 172.21.15.78:0/392055655 --> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56044b55db20 con 0x56044b1fff60 2024-09-17T03:13:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.984+0000 7f02327fc640 1 --2- 172.21.15.78:0/392055655 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x56044b1fff60 0x56044b63d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.984+0000 7f0219ffb640 10 client.7260 ms_handle_connect on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.984+0000 7f02327fc640 1 --2- 172.21.15.78:0/392055655 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x56044b1fff60 0x56044b63d530 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=86f1f6ca533d0a5a server_cookie=4e905586117da1eb in_seq=0 out_seq=0 2024-09-17T03:13:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.985+0000 7f0219ffb640 1 -- 172.21.15.78:0/392055655 <== mds.1 v2:172.21.15.78:6832/2905189397 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56044b55db20 con 0x56044b1fff60 2024-09-17T03:13:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.985+0000 7f0219ffb640 10 client.7260 handle_command_reply: tid=0 2024-09-17T03:13:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.985+0000 7f0248487740 1 client.7260 shutdown 2024-09-17T03:13:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.985+0000 7f0248487740 1 -- 172.21.15.78:0/392055655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b2184d0 msgr2=0x56044b600c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.985+0000 7f0248487740 1 --2- 172.21.15.78:0/392055655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b2184d0 0x56044b600c20 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f022c009fd0 tx=0x7f022c0639a0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.985+0000 7f0248487740 1 -- 172.21.15.78:0/392055655 shutdown_connections 2024-09-17T03:13:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.985+0000 7f0248487740 1 --2- 172.21.15.78:0/392055655 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x56044b1fff60 0x56044b63d530 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.985+0000 7f0248487740 1 --2- 172.21.15.78:0/392055655 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b241390 0x56044b627800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.985+0000 7f0219ffb640 0 client.7260 ms_handle_reset on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:20.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.985+0000 7f0248487740 1 --2- 172.21.15.78:0/392055655 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56044b2206b0 0x56044b6272c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.985+0000 7f0248487740 1 --2- 172.21.15.78:0/392055655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b2184d0 0x56044b600c20 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:20.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.985+0000 7f0248487740 1 -- 172.21.15.78:0/392055655 >> 172.21.15.78:0/392055655 conn(0x56044b2354e0 msgr2=0x56044b6027a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:20.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.985+0000 7f0248487740 1 -- 172.21.15.78:0/392055655 shutdown_connections 2024-09-17T03:13:20.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.985+0000 7f0248487740 1 -- 172.21.15.78:0/392055655 wait complete. 2024-09-17T03:13:20.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:20.985+0000 7f0248487740 20 client.7260 trim_cache size 0 max 16384 2024-09-17T03:13:21.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.003+0000 7f0248487740 1 Processor -- start 2024-09-17T03:13:21.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.003+0000 7f0248487740 1 -- start start 2024-09-17T03:13:21.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.004+0000 7f0248487740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56044b2184d0 0x56044b651480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:21.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.004+0000 7f0248487740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b2206b0 0x56044b60dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:21.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.004+0000 7f0248487740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b241390 0x56044b631630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:21.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.004+0000 7f0248487740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f023c201a80 con 0x56044b241390 2024-09-17T03:13:21.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.004+0000 7f0248487740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f023c202180 con 0x56044b2184d0 2024-09-17T03:13:21.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.004+0000 7f0248487740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f023c1f97a0 con 0x56044b2206b0 2024-09-17T03:13:21.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.004+0000 7f023b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b241390 0x56044b631630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:21.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.004+0000 7f023b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b241390 0x56044b631630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34492/0 (socket says 172.21.15.78:34492) 2024-09-17T03:13:21.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.004+0000 7f023b7fe640 1 -- 172.21.15.78:0/7406985 learned_addr learned my addr 172.21.15.78:0/7406985 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:21.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.004+0000 7f02327fc640 1 --2- 172.21.15.78:0/7406985 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b2206b0 0x56044b60dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:21.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.004+0000 7f023affd640 1 --2- 172.21.15.78:0/7406985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56044b2184d0 0x56044b651480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:21.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.005+0000 7f023b7fe640 1 -- 172.21.15.78:0/7406985 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b2206b0 msgr2=0x56044b60dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:21.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.005+0000 7f023b7fe640 1 --2- 172.21.15.78:0/7406985 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b2206b0 0x56044b60dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.005+0000 7f023b7fe640 1 -- 172.21.15.78:0/7406985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56044b2184d0 msgr2=0x56044b651480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:21.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.005+0000 7f023b7fe640 1 --2- 172.21.15.78:0/7406985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56044b2184d0 0x56044b651480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.005+0000 7f023b7fe640 1 -- 172.21.15.78:0/7406985 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56044b321ad0 con 0x56044b241390 2024-09-17T03:13:21.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.005+0000 7f023b7fe640 1 --2- 172.21.15.78:0/7406985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b241390 0x56044b631630 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f0234001eb0 tx=0x7f0234037040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eecc57d5981129f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:21.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.005+0000 7f021bfff640 1 -- 172.21.15.78:0/7406985 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0234003bf0 con 0x56044b241390 2024-09-17T03:13:21.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.005+0000 7f021bfff640 1 -- 172.21.15.78:0/7406985 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02340060b0 con 0x56044b241390 2024-09-17T03:13:21.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.005+0000 7f021bfff640 1 -- 172.21.15.78:0/7406985 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0234006500 con 0x56044b241390 2024-09-17T03:13:21.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.006+0000 7f0248487740 1 -- 172.21.15.78:0/7406985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b241390 msgr2=0x56044b631630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:21.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.006+0000 7f0248487740 1 --2- 172.21.15.78:0/7406985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b241390 0x56044b631630 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f0234001eb0 tx=0x7f0234037040 comp rx=0 tx=0).stop 2024-09-17T03:13:21.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.006+0000 7f0248487740 1 -- 172.21.15.78:0/7406985 shutdown_connections 2024-09-17T03:13:21.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.006+0000 7f0248487740 1 --2- 172.21.15.78:0/7406985 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b241390 0x56044b631630 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.006+0000 7f0248487740 1 --2- 172.21.15.78:0/7406985 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b2206b0 0x56044b60dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.006+0000 7f0248487740 1 --2- 172.21.15.78:0/7406985 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56044b2184d0 0x56044b651480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.006+0000 7f0248487740 1 -- 172.21.15.78:0/7406985 >> 172.21.15.78:0/7406985 conn(0x56044b2354e0 msgr2=0x56044b623ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:21.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.006+0000 7f0248487740 1 -- 172.21.15.78:0/7406985 shutdown_connections 2024-09-17T03:13:21.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.006+0000 7f0248487740 1 -- 172.21.15.78:0/7406985 wait complete. 2024-09-17T03:13:21.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.006+0000 7f0248487740 1 -- start start 2024-09-17T03:13:21.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.007+0000 7f0248487740 1 Processor -- start 2024-09-17T03:13:21.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.008+0000 7f0248487740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56044b2184d0 0x56044b6a7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:21.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.008+0000 7f0248487740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b2206b0 0x56044b6b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:21.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.008+0000 7f0248487740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b241390 0x56044b631400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:21.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.008+0000 7f0248487740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56044b6104b0 con 0x56044b241390 2024-09-17T03:13:21.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.008+0000 7f0248487740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56044b6258e0 con 0x56044b2184d0 2024-09-17T03:13:21.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.008+0000 7f0248487740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x56044b624bd0 con 0x56044b2206b0 2024-09-17T03:13:21.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.008+0000 7f0248487740 10 client.0 _ll_register_callbacks cb 0x7f022c05f270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:21.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.008+0000 7f023b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b241390 0x56044b631400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:21.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.008+0000 7f023b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b241390 0x56044b631400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34498/0 (socket says 172.21.15.78:34498) 2024-09-17T03:13:21.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.008+0000 7f023b7fe640 1 -- 172.21.15.78:0/3814377924 learned_addr learned my addr 172.21.15.78:0/3814377924 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:21.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.008+0000 7f02327fc640 1 --2- 172.21.15.78:0/3814377924 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b2206b0 0x56044b6b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:21.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.008+0000 7f023affd640 1 --2- 172.21.15.78:0/3814377924 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56044b2184d0 0x56044b6a7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:21.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.008+0000 7f023b7fe640 1 -- 172.21.15.78:0/3814377924 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b2206b0 msgr2=0x56044b6b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:21.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.008+0000 7f023b7fe640 1 --2- 172.21.15.78:0/3814377924 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b2206b0 0x56044b6b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.008+0000 7f023b7fe640 1 -- 172.21.15.78:0/3814377924 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56044b2184d0 msgr2=0x56044b6a7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:21.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.008+0000 7f023b7fe640 1 --2- 172.21.15.78:0/3814377924 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56044b2184d0 0x56044b6a7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.008+0000 7f023b7fe640 1 -- 172.21.15.78:0/3814377924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56044b6b2060 con 0x56044b241390 2024-09-17T03:13:21.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.008+0000 7f02327fc640 1 --2- 172.21.15.78:0/3814377924 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b2206b0 0x56044b6b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:21.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.008+0000 7f023b7fe640 1 --2- 172.21.15.78:0/3814377924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b241390 0x56044b631400 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f0234042040 tx=0x7f0234006260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15bd93364b21c935 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:21.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.008+0000 7f0219ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:21.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.009+0000 7f0219ffb640 1 -- 172.21.15.78:0/3814377924 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023404f070 con 0x56044b241390 2024-09-17T03:13:21.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.009+0000 7f0219ffb640 1 -- 172.21.15.78:0/3814377924 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f0234006450 con 0x56044b241390 2024-09-17T03:13:21.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.009+0000 7f0248487740 1 -- 172.21.15.78:0/3814377924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02340060b0 con 0x56044b241390 2024-09-17T03:13:21.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.009+0000 7f0219ffb640 1 -- 172.21.15.78:0/3814377924 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f023405a050 con 0x56044b241390 2024-09-17T03:13:21.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.009+0000 7f0248487740 10 client.7266 fetch_fsmap learned FSMap version 68 2024-09-17T03:13:21.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.009+0000 7f0248487740 1 -- 172.21.15.78:0/3814377924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x56044b643b30 con 0x56044b241390 2024-09-17T03:13:21.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.009+0000 7f0219ffb640 1 -- 172.21.15.78:0/3814377924 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02340060b0 con 0x56044b241390 2024-09-17T03:13:21.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.009+0000 7f0219ffb640 1 -- 172.21.15.78:0/3814377924 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 68) ==== 3554+0+0 (secure 0 0 0) 0x7f023405d020 con 0x56044b241390 2024-09-17T03:13:21.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.009+0000 7f0248487740 10 client.7266 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T03:13:21.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.009+0000 7f0248487740 10 client.7266 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:13:21.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.009+0000 7f0248487740 20 client.7266 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:21.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.009+0000 7f0248487740 1 --2- 172.21.15.78:0/3814377924 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x56044b6ae350 0x56044b625c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:21.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.009+0000 7f0248487740 4 client.7266 mds_command: new command op to 6861 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-17T03:13:21.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.009+0000 7f0248487740 1 -- 172.21.15.78:0/3814377924 --> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x56044b5595d0 con 0x56044b6ae350 2024-09-17T03:13:21.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.009+0000 7f023affd640 1 --2- 172.21.15.78:0/3814377924 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x56044b6ae350 0x56044b625c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:21.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.009+0000 7f0219ffb640 10 client.7266 ms_handle_connect on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:21.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.010+0000 7f023affd640 1 --2- 172.21.15.78:0/3814377924 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x56044b6ae350 0x56044b625c80 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7ae1207238afbee3 server_cookie=7b52d8600aad727e in_seq=0 out_seq=0 2024-09-17T03:13:21.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.010+0000 7f0219ffb640 1 -- 172.21.15.78:0/3814377924 <== mds.1 v2:172.21.15.78:6832/2905189397 1 ==== command_reply(tid 0: -18 Not rank 0) ==== 18+0+0 (crc 0 0 0) 0x56044b5595d0 con 0x56044b6ae350 2024-09-17T03:13:21.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.010+0000 7f0219ffb640 10 client.7266 handle_command_reply: tid=0 2024-09-17T03:13:21.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.010+0000 7f0248487740 1 client.7266 shutdown 2024-09-17T03:13:21.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.010+0000 7f0248487740 1 -- 172.21.15.78:0/3814377924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b241390 msgr2=0x56044b631400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:21.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.010+0000 7f0248487740 1 --2- 172.21.15.78:0/3814377924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b241390 0x56044b631400 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f0234042040 tx=0x7f0234006260 comp rx=0 tx=0).stop 2024-09-17T03:13:21.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.010+0000 7f0248487740 1 -- 172.21.15.78:0/3814377924 shutdown_connections 2024-09-17T03:13:21.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.010+0000 7f0248487740 1 --2- 172.21.15.78:0/3814377924 >> [v2:172.21.15.78:6832/2905189397,v1:172.21.15.78:6834/2905189397] conn(0x56044b6ae350 0x56044b625c80 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.010+0000 7f0248487740 1 --2- 172.21.15.78:0/3814377924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56044b241390 0x56044b631400 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.010+0000 7f0248487740 1 --2- 172.21.15.78:0/3814377924 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56044b2206b0 0x56044b6b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.010+0000 7f0219ffb640 0 client.7266 ms_handle_reset on v2:172.21.15.78:6832/2905189397 2024-09-17T03:13:21.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.010+0000 7f0248487740 1 --2- 172.21.15.78:0/3814377924 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56044b2184d0 0x56044b6a7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.010+0000 7f0248487740 1 -- 172.21.15.78:0/3814377924 >> 172.21.15.78:0/3814377924 conn(0x56044b2354e0 msgr2=0x56044b62e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:21.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.010+0000 7f0248487740 1 -- 172.21.15.78:0/3814377924 shutdown_connections 2024-09-17T03:13:21.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.010+0000 7f0248487740 1 -- 172.21.15.78:0/3814377924 wait complete. 2024-09-17T03:13:21.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.010+0000 7f0248487740 20 client.7266 trim_cache size 0 max 16384 2024-09-17T03:13:21.015 INFO:teuthology.orchestra.run.smithi078.stderr:Error EXDEV: Not rank 0 2024-09-17T03:13:21.015 DEBUG:teuthology.orchestra.run:got remote process result: 18 2024-09-17T03:13:21.016 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:13:21.016 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:13:21.060 DEBUG:teuthology.orchestra.run.smithi193:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:13:21.105 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:13:21.105 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:13:21.106 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:13:21.106 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:13:21.122 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:13:21.122 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:13:21.178 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:13:21.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.331+0000 7fb6cd01d640 1 -- 172.21.15.78:0/540086759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c80704e0 msgr2=0x7fb6c80cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:21.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.331+0000 7fb6cd01d640 1 --2- 172.21.15.78:0/540086759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c80704e0 0x7fb6c80cc830 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80b2c80 tx=0x7fb6c002aa30 comp rx=0 tx=0).stop 2024-09-17T03:13:21.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.331+0000 7fb6cd01d640 1 -- 172.21.15.78:0/540086759 shutdown_connections 2024-09-17T03:13:21.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.331+0000 7fb6cd01d640 1 --2- 172.21.15.78:0/540086759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c80704e0 0x7fb6c80cc830 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.331+0000 7fb6cd01d640 1 --2- 172.21.15.78:0/540086759 >> v2:172.21.15.193:3300/0 conn(0x7fb6c80cad30 0x7fb6c806ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.331+0000 7fb6cd01d640 1 --2- 172.21.15.78:0/540086759 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6c80ca800 0x7fb6c80cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.331+0000 7fb6cd01d640 1 -- 172.21.15.78:0/540086759 >> 172.21.15.78:0/540086759 conn(0x7fb6c80b1cb0 msgr2=0x7fb6c80b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:21.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.331+0000 7fb6cd01d640 1 -- 172.21.15.78:0/540086759 shutdown_connections 2024-09-17T03:13:21.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.331+0000 7fb6cd01d640 1 -- 172.21.15.78:0/540086759 wait complete. 2024-09-17T03:13:21.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.333+0000 7fb6cd01d640 1 Processor -- start 2024-09-17T03:13:21.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.333+0000 7fb6cd01d640 1 -- start start 2024-09-17T03:13:21.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.334+0000 7fb6cd01d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6c80704e0 0x7fb6c814cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:21.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.334+0000 7fb6cd01d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c80ca800 0x7fb6c8155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:21.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.334+0000 7fb6cd01d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6c80cad30 0x7fb6c80ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:21.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.334+0000 7fb6cd01d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c80ccf80 con 0x7fb6c80ca800 2024-09-17T03:13:21.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.334+0000 7fb6cd01d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb6c80cec60 con 0x7fb6c80704e0 2024-09-17T03:13:21.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.334+0000 7fb6cd01d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb6c80cd100 con 0x7fb6c80cad30 2024-09-17T03:13:21.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.334+0000 7fb6be59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c80ca800 0x7fb6c8155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:21.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.334+0000 7fb6be59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c80ca800 0x7fb6c8155130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34510/0 (socket says 172.21.15.78:34510) 2024-09-17T03:13:21.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.334+0000 7fb6be59c640 1 -- 172.21.15.78:0/2129043293 learned_addr learned my addr 172.21.15.78:0/2129043293 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:21.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.334+0000 7fb6c6d9d640 1 --2- 172.21.15.78:0/2129043293 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6c80704e0 0x7fb6c814cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:21.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.334+0000 7fb6c759e640 1 --2- 172.21.15.78:0/2129043293 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6c80cad30 0x7fb6c80ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:21.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.335+0000 7fb6be59c640 1 -- 172.21.15.78:0/2129043293 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6c80cad30 msgr2=0x7fb6c80ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:21.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.335+0000 7fb6be59c640 1 --2- 172.21.15.78:0/2129043293 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6c80cad30 0x7fb6c80ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.335+0000 7fb6be59c640 1 -- 172.21.15.78:0/2129043293 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6c80704e0 msgr2=0x7fb6c814cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:21.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.335+0000 7fb6be59c640 1 --2- 172.21.15.78:0/2129043293 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6c80704e0 0x7fb6c814cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.335+0000 7fb6be59c640 1 -- 172.21.15.78:0/2129043293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6c8159c50 con 0x7fb6c80ca800 2024-09-17T03:13:21.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.335+0000 7fb6be59c640 1 --2- 172.21.15.78:0/2129043293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c80ca800 0x7fb6c8155130 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000c9a0 tx=0x7fb6b000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:21.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.335+0000 7fb6bffff640 1 -- 172.21.15.78:0/2129043293 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0007bb0 con 0x7fb6c80ca800 2024-09-17T03:13:21.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.335+0000 7fb6bffff640 1 -- 172.21.15.78:0/2129043293 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6b0007e40 con 0x7fb6c80ca800 2024-09-17T03:13:21.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.335+0000 7fb6cd01d640 1 -- 172.21.15.78:0/2129043293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6c8159970 con 0x7fb6c80ca800 2024-09-17T03:13:21.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.335+0000 7fb6bffff640 1 -- 172.21.15.78:0/2129043293 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0005280 con 0x7fb6c80ca800 2024-09-17T03:13:21.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.335+0000 7fb6cd01d640 1 -- 172.21.15.78:0/2129043293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6c8153780 con 0x7fb6c80ca800 2024-09-17T03:13:21.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.336+0000 7fb6cd01d640 1 -- 172.21.15.78:0/2129043293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6c80cd690 con 0x7fb6c80ca800 2024-09-17T03:13:21.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.337+0000 7fb6bffff640 1 -- 172.21.15.78:0/2129043293 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb6b0005420 con 0x7fb6c80ca800 2024-09-17T03:13:21.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.337+0000 7fb6bffff640 1 --2- 172.21.15.78:0/2129043293 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb6a8078bc0 0x7fb6a807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:21.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.337+0000 7fb6bffff640 1 -- 172.21.15.78:0/2129043293 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7fb6b009b0c0 con 0x7fb6c80ca800 2024-09-17T03:13:21.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.338+0000 7fb6c6d9d640 1 --2- 172.21.15.78:0/2129043293 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb6a8078bc0 0x7fb6a807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:21.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.338+0000 7fb6c6d9d640 1 --2- 172.21.15.78:0/2129043293 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb6a8078bc0 0x7fb6a807b0d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80cb250 tx=0x7fb6b8009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:21.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.342+0000 7fb6bffff640 1 -- 172.21.15.78:0/2129043293 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb6b0014030 con 0x7fb6c80ca800 2024-09-17T03:13:21.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.528+0000 7fb6cd01d640 1 -- 172.21.15.78:0/2129043293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb6c80d0a70 con 0x7fb6c80ca800 2024-09-17T03:13:21.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.528+0000 7fb6bffff640 1 -- 172.21.15.78:0/2129043293 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v71) ==== 80+0+0 (secure 0 0 0) 0x7fb6b0062fc0 con 0x7fb6c80ca800 2024-09-17T03:13:21.527 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-09-17T03:13:21.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.530+0000 7fb6cd01d640 1 -- 172.21.15.78:0/2129043293 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb6a8078bc0 msgr2=0x7fb6a807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:21.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.530+0000 7fb6cd01d640 1 --2- 172.21.15.78:0/2129043293 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb6a8078bc0 0x7fb6a807b0d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb6c80cb250 tx=0x7fb6b8009060 comp rx=0 tx=0).stop 2024-09-17T03:13:21.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.530+0000 7fb6cd01d640 1 -- 172.21.15.78:0/2129043293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c80ca800 msgr2=0x7fb6c8155130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:21.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.530+0000 7fb6cd01d640 1 --2- 172.21.15.78:0/2129043293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c80ca800 0x7fb6c8155130 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000c9a0 tx=0x7fb6b000ce60 comp rx=0 tx=0).stop 2024-09-17T03:13:21.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.530+0000 7fb6cd01d640 1 -- 172.21.15.78:0/2129043293 shutdown_connections 2024-09-17T03:13:21.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.530+0000 7fb6cd01d640 1 --2- 172.21.15.78:0/2129043293 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6c80cad30 0x7fb6c80ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.530+0000 7fb6cd01d640 1 --2- 172.21.15.78:0/2129043293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6c80ca800 0x7fb6c8155130 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.530+0000 7fb6cd01d640 1 --2- 172.21.15.78:0/2129043293 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb6a8078bc0 0x7fb6a807b0d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.530+0000 7fb6cd01d640 1 --2- 172.21.15.78:0/2129043293 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6c80704e0 0x7fb6c814cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.530+0000 7fb6cd01d640 1 -- 172.21.15.78:0/2129043293 >> 172.21.15.78:0/2129043293 conn(0x7fb6c80b1cb0 msgr2=0x7fb6c8074400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:21.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.530+0000 7fb6cd01d640 1 -- 172.21.15.78:0/2129043293 shutdown_connections 2024-09-17T03:13:21.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.530+0000 7fb6cd01d640 1 -- 172.21.15.78:0/2129043293 wait complete. 2024-09-17T03:13:21.540 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:13:21.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:21.541 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:13:21.569 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T03:13:21.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:21.569 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:13:21.625 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:13:21.625 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:13:21.626 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:13:21.645 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:13:21.645 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:13:21.645 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:13:21.645 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:13:21.683 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056010,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1013 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:13:21.683 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:13:21.683 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:13:21.683 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:13:21.704 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:13:21.704 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:13:21.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.838+0000 7f4c29543640 1 -- 172.21.15.78:0/2523702885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c240b66b0 msgr2=0x7f4c240b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:21.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.838+0000 7f4c29543640 1 --2- 172.21.15.78:0/2523702885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c240b66b0 0x7f4c240b3710 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c009900 tx=0x7f4c0c02a610 comp rx=0 tx=0).stop 2024-09-17T03:13:21.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.838+0000 7f4c29543640 1 -- 172.21.15.78:0/2523702885 shutdown_connections 2024-09-17T03:13:21.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.838+0000 7f4c29543640 1 --2- 172.21.15.78:0/2523702885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c240b66b0 0x7f4c240b3710 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.838+0000 7f4c29543640 1 --2- 172.21.15.78:0/2523702885 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c2406e0e0 0x7f4c2406e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.838+0000 7f4c29543640 1 -- 172.21.15.78:0/2523702885 >> 172.21.15.78:0/2523702885 conn(0x7f4c2409d7f0 msgr2=0x7f4c240d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:21.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.838+0000 7f4c29543640 1 -- 172.21.15.78:0/2523702885 shutdown_connections 2024-09-17T03:13:21.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.838+0000 7f4c29543640 1 -- 172.21.15.78:0/2523702885 wait complete. 2024-09-17T03:13:21.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.840+0000 7f4c29543640 1 Processor -- start 2024-09-17T03:13:21.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.840+0000 7f4c29543640 1 -- start start 2024-09-17T03:13:21.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.841+0000 7f4c29543640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c2406e0e0 0x7f4c241f8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:21.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.841+0000 7f4c29543640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c240b9970 0x7f4c240c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:21.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.841+0000 7f4c29543640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c241f91c0 0x7f4c240ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:21.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.842+0000 7f4c29543640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2406ea30 con 0x7f4c240b9970 2024-09-17T03:13:21.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.842+0000 7f4c29543640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4c240d5010 con 0x7f4c2406e0e0 2024-09-17T03:13:21.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.842+0000 7f4c29543640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4c2406ebb0 con 0x7f4c241f91c0 2024-09-17T03:13:21.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.842+0000 7f4c1a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c240b9970 0x7f4c240c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:21.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.842+0000 7f4c1a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c240b9970 0x7f4c240c9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34522/0 (socket says 172.21.15.78:34522) 2024-09-17T03:13:21.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.842+0000 7f4c1a7fc640 1 -- 172.21.15.78:0/4222995194 learned_addr learned my addr 172.21.15.78:0/4222995194 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:21.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.842+0000 7f4c237fe640 1 --2- 172.21.15.78:0/4222995194 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c241f91c0 0x7f4c240ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:21.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.842+0000 7f4c1a7fc640 1 -- 172.21.15.78:0/4222995194 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c241f91c0 msgr2=0x7f4c240ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:21.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.842+0000 7f4c1a7fc640 1 --2- 172.21.15.78:0/4222995194 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c241f91c0 0x7f4c240ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.842+0000 7f4c22ffd640 1 --2- 172.21.15.78:0/4222995194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c2406e0e0 0x7f4c241f8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:21.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.842+0000 7f4c1a7fc640 1 -- 172.21.15.78:0/4222995194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c2406e0e0 msgr2=0x7f4c241f8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:21.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.842+0000 7f4c1a7fc640 1 --2- 172.21.15.78:0/4222995194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c2406e0e0 0x7f4c241f8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:21.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.842+0000 7f4c1a7fc640 1 -- 172.21.15.78:0/4222995194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c240cab20 con 0x7f4c240b9970 2024-09-17T03:13:21.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.842+0000 7f4c1a7fc640 1 --2- 172.21.15.78:0/4222995194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c240b9970 0x7f4c240c9d80 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c034040 tx=0x7f4c0c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:21.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.842+0000 7f4c1bfff640 1 -- 172.21.15.78:0/4222995194 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c03e030 con 0x7f4c240b9970 2024-09-17T03:13:21.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.842+0000 7f4c1bfff640 1 -- 172.21.15.78:0/4222995194 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c0c003ca0 con 0x7f4c240b9970 2024-09-17T03:13:21.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.842+0000 7f4c29543640 1 -- 172.21.15.78:0/4222995194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c240cae00 con 0x7f4c240b9970 2024-09-17T03:13:21.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.842+0000 7f4c1bfff640 1 -- 172.21.15.78:0/4222995194 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c035040 con 0x7f4c240b9970 2024-09-17T03:13:21.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.842+0000 7f4c29543640 1 -- 172.21.15.78:0/4222995194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c2415b1e0 con 0x7f4c240b9970 2024-09-17T03:13:21.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.844+0000 7f4c29543640 1 -- 172.21.15.78:0/4222995194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c240ca890 con 0x7f4c240b9970 2024-09-17T03:13:21.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.844+0000 7f4c1bfff640 1 -- 172.21.15.78:0/4222995194 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4c0c041030 con 0x7f4c240b9970 2024-09-17T03:13:21.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.845+0000 7f4c1bfff640 1 --2- 172.21.15.78:0/4222995194 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4c04078b90 0x7f4c0407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:21.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.845+0000 7f4c1bfff640 1 -- 172.21.15.78:0/4222995194 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f4c0c0bb340 con 0x7f4c240b9970 2024-09-17T03:13:21.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.845+0000 7f4c22ffd640 1 --2- 172.21.15.78:0/4222995194 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4c04078b90 0x7f4c0407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:21.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.846+0000 7f4c22ffd640 1 --2- 172.21.15.78:0/4222995194 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4c04078b90 0x7f4c0407b0a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4c14000fd0 tx=0x7f4c14009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:21.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:21.849+0000 7f4c1bfff640 1 -- 172.21.15.78:0/4222995194 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4c0c083740 con 0x7f4c240b9970 2024-09-17T03:13:22.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.056+0000 7f4c29543640 1 -- 172.21.15.78:0/4222995194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c240b3710 con 0x7f4c240b9970 2024-09-17T03:13:22.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.057+0000 7f4c1bfff640 1 -- 172.21.15.78:0/4222995194 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5273 (secure 0 0 0) 0x7f4c0c083040 con 0x7f4c240b9970 2024-09-17T03:13:22.056 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:22.056 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":68,"btime":"2024-09-17T03:13:17:667511+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5873,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/3831026382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3831026382},{"type":"v1","addr":"172.21.15.193:6836","nonce":3831026382}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:12:50.905684+0000","modified":"2024-09-17T03:13:16.881050+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6864,"mds_1":6861,"mds_2":6271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6271":{"gid":6271,"name":"d","rank":2,"incarnation":65,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6837/1431701139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1431701139},{"type":"v1","addr":"172.21.15.193:6837","nonce":1431701139}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6861":{"gid":6861,"name":"c","rank":1,"incarnation":63,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6834/2905189397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2905189397},{"type":"v1","addr":"172.21.15.78:6834","nonce":2905189397}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6864":{"gid":6864,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/2058899730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2058899730},{"type":"v1","addr":"172.21.15.78:6835","nonce":2058899730}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6864,"qdb_cluster":[6271,6861,6864]},"id":5}]} 2024-09-17T03:13:22.056 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 68 2024-09-17T03:13:22.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.059+0000 7f4c29543640 1 -- 172.21.15.78:0/4222995194 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4c04078b90 msgr2=0x7f4c0407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:22.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.059+0000 7f4c29543640 1 --2- 172.21.15.78:0/4222995194 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4c04078b90 0x7f4c0407b0a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4c14000fd0 tx=0x7f4c14009040 comp rx=0 tx=0).stop 2024-09-17T03:13:22.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.059+0000 7f4c29543640 1 -- 172.21.15.78:0/4222995194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c240b9970 msgr2=0x7f4c240c9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:22.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.059+0000 7f4c29543640 1 --2- 172.21.15.78:0/4222995194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c240b9970 0x7f4c240c9d80 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c034040 tx=0x7f4c0c0038a0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.059+0000 7f4c29543640 1 -- 172.21.15.78:0/4222995194 shutdown_connections 2024-09-17T03:13:22.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.059+0000 7f4c29543640 1 --2- 172.21.15.78:0/4222995194 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c241f91c0 0x7f4c240ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.059+0000 7f4c29543640 1 --2- 172.21.15.78:0/4222995194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4c240b9970 0x7f4c240c9d80 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.059+0000 7f4c29543640 1 --2- 172.21.15.78:0/4222995194 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4c04078b90 0x7f4c0407b0a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.059+0000 7f4c29543640 1 --2- 172.21.15.78:0/4222995194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c2406e0e0 0x7f4c241f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.059+0000 7f4c29543640 1 -- 172.21.15.78:0/4222995194 >> 172.21.15.78:0/4222995194 conn(0x7f4c2409d7f0 msgr2=0x7f4c2415e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:22.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.059+0000 7f4c29543640 1 -- 172.21.15.78:0/4222995194 shutdown_connections 2024-09-17T03:13:22.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.059+0000 7f4c29543640 1 -- 172.21.15.78:0/4222995194 wait complete. 2024-09-17T03:13:22.070 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:13:22.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.184+0000 7fde6beb4640 1 -- 172.21.15.78:0/1840655604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde50004800 msgr2=0x7fde50004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:22.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.184+0000 7fde6beb4640 1 --2- 172.21.15.78:0/1840655604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde50004800 0x7fde50004c10 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fde640ba1b0 tx=0x7fde50005830 comp rx=0 tx=0).stop 2024-09-17T03:13:22.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.184+0000 7fde6beb4640 1 -- 172.21.15.78:0/1840655604 shutdown_connections 2024-09-17T03:13:22.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.184+0000 7fde6beb4640 1 --2- 172.21.15.78:0/1840655604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde50004800 0x7fde50004c10 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.184+0000 7fde6beb4640 1 -- 172.21.15.78:0/1840655604 >> 172.21.15.78:0/1840655604 conn(0x7fde6408bfc0 msgr2=0x7fde6409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:22.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.184+0000 7fde6beb4640 1 -- 172.21.15.78:0/1840655604 shutdown_connections 2024-09-17T03:13:22.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.184+0000 7fde6beb4640 1 -- 172.21.15.78:0/1840655604 wait complete. 2024-09-17T03:13:22.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.186+0000 7fde6beb4640 1 Processor -- start 2024-09-17T03:13:22.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.186+0000 7fde6beb4640 1 -- start start 2024-09-17T03:13:22.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.187+0000 7fde6beb4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde50004800 0x7fde641f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:22.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.187+0000 7fde6beb4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fde640c7ff0 0x7fde640cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:22.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.187+0000 7fde6beb4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde641f91e0 0x7fde640ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:22.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.187+0000 7fde6beb4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fde640b36c0 con 0x7fde641f91e0 2024-09-17T03:13:22.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.187+0000 7fde6beb4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fde640b3540 con 0x7fde50004800 2024-09-17T03:13:22.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.187+0000 7fde6beb4640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fde640b3840 con 0x7fde640c7ff0 2024-09-17T03:13:22.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.187+0000 7fde6a451640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde641f91e0 0x7fde640ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:22.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.187+0000 7fde6a451640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde641f91e0 0x7fde640ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34546/0 (socket says 172.21.15.78:34546) 2024-09-17T03:13:22.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.187+0000 7fde6a451640 1 -- 172.21.15.78:0/1648309473 learned_addr learned my addr 172.21.15.78:0/1648309473 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:22.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.187+0000 7fde69c50640 1 --2- 172.21.15.78:0/1648309473 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde50004800 0x7fde641f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:22.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.187+0000 7fde6944f640 1 --2- 172.21.15.78:0/1648309473 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fde640c7ff0 0x7fde640cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:22.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.187+0000 7fde6a451640 1 -- 172.21.15.78:0/1648309473 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fde640c7ff0 msgr2=0x7fde640cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:22.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.187+0000 7fde6a451640 1 --2- 172.21.15.78:0/1648309473 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fde640c7ff0 0x7fde640cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.187+0000 7fde6a451640 1 -- 172.21.15.78:0/1648309473 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde50004800 msgr2=0x7fde641f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:22.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.187+0000 7fde6a451640 1 --2- 172.21.15.78:0/1648309473 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde50004800 0x7fde641f4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.187+0000 7fde6a451640 1 -- 172.21.15.78:0/1648309473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde640cd520 con 0x7fde641f91e0 2024-09-17T03:13:22.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.187+0000 7fde6944f640 1 --2- 172.21.15.78:0/1648309473 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fde640c7ff0 0x7fde640cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:22.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.188+0000 7fde6a451640 1 --2- 172.21.15.78:0/1648309473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde641f91e0 0x7fde640ca200 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fde640c7fc0 tx=0x7fde5c0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:22.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.188+0000 7fde5a7fc640 1 -- 172.21.15.78:0/1648309473 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5c011870 con 0x7fde641f91e0 2024-09-17T03:13:22.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.188+0000 7fde5a7fc640 1 -- 172.21.15.78:0/1648309473 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde5c017070 con 0x7fde641f91e0 2024-09-17T03:13:22.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.188+0000 7fde6beb4640 1 -- 172.21.15.78:0/1648309473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde640cd800 con 0x7fde641f91e0 2024-09-17T03:13:22.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.188+0000 7fde5a7fc640 1 -- 172.21.15.78:0/1648309473 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5c011da0 con 0x7fde641f91e0 2024-09-17T03:13:22.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.188+0000 7fde6beb4640 1 -- 172.21.15.78:0/1648309473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde6415adf0 con 0x7fde641f91e0 2024-09-17T03:13:22.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.189+0000 7fde6beb4640 1 -- 172.21.15.78:0/1648309473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde640b9d60 con 0x7fde641f91e0 2024-09-17T03:13:22.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.189+0000 7fde5a7fc640 1 -- 172.21.15.78:0/1648309473 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fde5c01c460 con 0x7fde641f91e0 2024-09-17T03:13:22.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.190+0000 7fde5a7fc640 1 --2- 172.21.15.78:0/1648309473 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fde48078bc0 0x7fde4807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:22.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.190+0000 7fde5a7fc640 1 -- 172.21.15.78:0/1648309473 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7fde5c09b470 con 0x7fde641f91e0 2024-09-17T03:13:22.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.190+0000 7fde69c50640 1 --2- 172.21.15.78:0/1648309473 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fde48078bc0 0x7fde4807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:22.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.191+0000 7fde69c50640 1 --2- 172.21.15.78:0/1648309473 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fde48078bc0 0x7fde4807b0d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fde60009cd0 tx=0x7fde60005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:22.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.195+0000 7fde5a7fc640 1 -- 172.21.15.78:0/1648309473 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fde640b9d60 con 0x7fde641f91e0 2024-09-17T03:13:22.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.404+0000 7fde6beb4640 1 -- 172.21.15.78:0/1648309473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde640cf110 con 0x7fde641f91e0 2024-09-17T03:13:22.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.404+0000 7fde5a7fc640 1 -- 172.21.15.78:0/1648309473 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5273 (secure 0 0 0) 0x7fde5c063900 con 0x7fde641f91e0 2024-09-17T03:13:22.403 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:22.403 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":68,"btime":"2024-09-17T03:13:17:667511+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5873,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/3831026382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3831026382},{"type":"v1","addr":"172.21.15.193:6836","nonce":3831026382}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:12:50.905684+0000","modified":"2024-09-17T03:13:16.881050+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6864,"mds_1":6861,"mds_2":6271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6271":{"gid":6271,"name":"d","rank":2,"incarnation":65,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6837/1431701139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1431701139},{"type":"v1","addr":"172.21.15.193:6837","nonce":1431701139}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6861":{"gid":6861,"name":"c","rank":1,"incarnation":63,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6834/2905189397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2905189397},{"type":"v1","addr":"172.21.15.78:6834","nonce":2905189397}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6864":{"gid":6864,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/2058899730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2058899730},{"type":"v1","addr":"172.21.15.78:6835","nonce":2058899730}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6864,"qdb_cluster":[6271,6861,6864]},"id":5}]} 2024-09-17T03:13:22.403 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 68 2024-09-17T03:13:22.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.406+0000 7fde6beb4640 1 -- 172.21.15.78:0/1648309473 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fde48078bc0 msgr2=0x7fde4807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:22.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.406+0000 7fde6beb4640 1 --2- 172.21.15.78:0/1648309473 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fde48078bc0 0x7fde4807b0d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fde60009cd0 tx=0x7fde60005f90 comp rx=0 tx=0).stop 2024-09-17T03:13:22.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.406+0000 7fde6beb4640 1 -- 172.21.15.78:0/1648309473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde641f91e0 msgr2=0x7fde640ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:22.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.406+0000 7fde6beb4640 1 --2- 172.21.15.78:0/1648309473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde641f91e0 0x7fde640ca200 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fde640c7fc0 tx=0x7fde5c0019b0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.406+0000 7fde6beb4640 1 -- 172.21.15.78:0/1648309473 shutdown_connections 2024-09-17T03:13:22.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.406+0000 7fde6beb4640 1 --2- 172.21.15.78:0/1648309473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde641f91e0 0x7fde640ca200 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.406+0000 7fde6beb4640 1 --2- 172.21.15.78:0/1648309473 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fde640c7ff0 0x7fde640cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.406+0000 7fde6beb4640 1 --2- 172.21.15.78:0/1648309473 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fde48078bc0 0x7fde4807b0d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.406+0000 7fde6beb4640 1 --2- 172.21.15.78:0/1648309473 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fde50004800 0x7fde641f4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.406+0000 7fde6beb4640 1 -- 172.21.15.78:0/1648309473 >> 172.21.15.78:0/1648309473 conn(0x7fde6408bfc0 msgr2=0x7fde6406ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:22.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.406+0000 7fde6beb4640 1 -- 172.21.15.78:0/1648309473 shutdown_connections 2024-09-17T03:13:22.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.406+0000 7fde6beb4640 1 -- 172.21.15.78:0/1648309473 wait complete. 2024-09-17T03:13:22.417 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:13:22.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.531+0000 7f73e7d4a640 1 -- 172.21.15.78:0/2653104760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73cc004800 msgr2=0x7f73cc004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:22.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.531+0000 7f73e7d4a640 1 --2- 172.21.15.78:0/2653104760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73cc004800 0x7f73cc004c10 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f73d4006fc0 tx=0x7f73cc005830 comp rx=0 tx=0).stop 2024-09-17T03:13:22.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.531+0000 7f73e7d4a640 1 -- 172.21.15.78:0/2653104760 shutdown_connections 2024-09-17T03:13:22.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.531+0000 7f73e7d4a640 1 --2- 172.21.15.78:0/2653104760 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73cc004800 0x7f73cc004c10 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.531+0000 7f73e7d4a640 1 -- 172.21.15.78:0/2653104760 >> 172.21.15.78:0/2653104760 conn(0x7f73e0074170 msgr2=0x7f73e00b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:22.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.531+0000 7f73e7d4a640 1 -- 172.21.15.78:0/2653104760 shutdown_connections 2024-09-17T03:13:22.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.531+0000 7f73e7d4a640 1 -- 172.21.15.78:0/2653104760 wait complete. 2024-09-17T03:13:22.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.533+0000 7f73e7d4a640 1 Processor -- start 2024-09-17T03:13:22.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.533+0000 7f73e7d4a640 1 -- start start 2024-09-17T03:13:22.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.534+0000 7f73e7d4a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73cc004800 0x7f73e0156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:22.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.534+0000 7f73e7d4a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f73e0151db0 0x7f73e00b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:22.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.534+0000 7f73e7d4a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73e00b4cd0 0x7f73e01f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:22.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.534+0000 7f73e7d4a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f73e00ae1b0 con 0x7f73e00b4cd0 2024-09-17T03:13:22.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.534+0000 7f73e7d4a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f73e00ae330 con 0x7f73cc004800 2024-09-17T03:13:22.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.534+0000 7f73e7d4a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f73e00ae4b0 con 0x7f73e0151db0 2024-09-17T03:13:22.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.534+0000 7f73e62e7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73e00b4cd0 0x7f73e01f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:22.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.534+0000 7f73e62e7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73e00b4cd0 0x7f73e01f6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34564/0 (socket says 172.21.15.78:34564) 2024-09-17T03:13:22.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.534+0000 7f73e62e7640 1 -- 172.21.15.78:0/3667341694 learned_addr learned my addr 172.21.15.78:0/3667341694 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:22.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.535+0000 7f73e62e7640 1 -- 172.21.15.78:0/3667341694 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f73e0151db0 msgr2=0x7f73e00b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:22.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.535+0000 7f73e62e7640 1 --2- 172.21.15.78:0/3667341694 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f73e0151db0 0x7f73e00b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.535+0000 7f73e62e7640 1 -- 172.21.15.78:0/3667341694 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73cc004800 msgr2=0x7f73e0156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:22.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.535+0000 7f73e62e7640 1 --2- 172.21.15.78:0/3667341694 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73cc004800 0x7f73e0156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.535+0000 7f73e62e7640 1 -- 172.21.15.78:0/3667341694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73e00b50e0 con 0x7f73e00b4cd0 2024-09-17T03:13:22.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.535+0000 7f73e62e7640 1 --2- 172.21.15.78:0/3667341694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73e00b4cd0 0x7f73e01f6300 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f73d8005fd0 tx=0x7f73d8010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:22.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.535+0000 7f73d27fc640 1 -- 172.21.15.78:0/3667341694 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d8003970 con 0x7f73e00b4cd0 2024-09-17T03:13:22.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.535+0000 7f73d27fc640 1 -- 172.21.15.78:0/3667341694 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73d8015070 con 0x7f73e00b4cd0 2024-09-17T03:13:22.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.535+0000 7f73e7d4a640 1 -- 172.21.15.78:0/3667341694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73e0157b10 con 0x7f73e00b4cd0 2024-09-17T03:13:22.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.535+0000 7f73d27fc640 1 -- 172.21.15.78:0/3667341694 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d8004030 con 0x7f73e00b4cd0 2024-09-17T03:13:22.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.535+0000 7f73e7d4a640 1 -- 172.21.15.78:0/3667341694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73e0157830 con 0x7f73e00b4cd0 2024-09-17T03:13:22.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.536+0000 7f73e7d4a640 1 -- 172.21.15.78:0/3667341694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73e0155e00 con 0x7f73e00b4cd0 2024-09-17T03:13:22.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.537+0000 7f73d27fc640 1 -- 172.21.15.78:0/3667341694 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f73d80041d0 con 0x7f73e00b4cd0 2024-09-17T03:13:22.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.537+0000 7f73d27fc640 1 --2- 172.21.15.78:0/3667341694 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f73c4078b90 0x7f73c407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:22.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.537+0000 7f73d27fc640 1 -- 172.21.15.78:0/3667341694 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f73d809b950 con 0x7f73e00b4cd0 2024-09-17T03:13:22.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.538+0000 7f73e5ae6640 1 --2- 172.21.15.78:0/3667341694 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f73c4078b90 0x7f73c407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:22.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.538+0000 7f73e5ae6640 1 --2- 172.21.15.78:0/3667341694 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f73c4078b90 0x7f73c407b0a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f73dc006fd0 tx=0x7f73dc0069d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:22.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.542+0000 7f73d27fc640 1 -- 172.21.15.78:0/3667341694 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f73e00b50e0 con 0x7f73e00b4cd0 2024-09-17T03:13:22.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.720+0000 7f73e7d4a640 1 -- 172.21.15.78:0/3667341694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f73e00cf100 con 0x7f73e00b4cd0 2024-09-17T03:13:22.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.721+0000 7f73d27fc640 1 -- 172.21.15.78:0/3667341694 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+16801 (secure 0 0 0) 0x7f73d8063de0 con 0x7f73e00b4cd0 2024-09-17T03:13:22.720 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:22.720 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":71,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:13:09.638657+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:12:48.548227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T03:12:49.863501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.3","mappings":[{"from":6,"to":0}]},{"pgid":"11.3e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:13:22.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.723+0000 7f73e7d4a640 1 -- 172.21.15.78:0/3667341694 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f73c4078b90 msgr2=0x7f73c407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:22.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.723+0000 7f73e7d4a640 1 --2- 172.21.15.78:0/3667341694 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f73c4078b90 0x7f73c407b0a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f73dc006fd0 tx=0x7f73dc0069d0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.723+0000 7f73e7d4a640 1 -- 172.21.15.78:0/3667341694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73e00b4cd0 msgr2=0x7f73e01f6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:22.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.723+0000 7f73e7d4a640 1 --2- 172.21.15.78:0/3667341694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73e00b4cd0 0x7f73e01f6300 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f73d8005fd0 tx=0x7f73d8010f40 comp rx=0 tx=0).stop 2024-09-17T03:13:22.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.723+0000 7f73e7d4a640 1 -- 172.21.15.78:0/3667341694 shutdown_connections 2024-09-17T03:13:22.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.723+0000 7f73e7d4a640 1 --2- 172.21.15.78:0/3667341694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73e00b4cd0 0x7f73e01f6300 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.723+0000 7f73e7d4a640 1 --2- 172.21.15.78:0/3667341694 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f73e0151db0 0x7f73e00b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.723+0000 7f73e7d4a640 1 --2- 172.21.15.78:0/3667341694 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f73c4078b90 0x7f73c407b0a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.723+0000 7f73e7d4a640 1 --2- 172.21.15.78:0/3667341694 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f73cc004800 0x7f73e0156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.723+0000 7f73e7d4a640 1 -- 172.21.15.78:0/3667341694 >> 172.21.15.78:0/3667341694 conn(0x7f73e0074170 msgr2=0x7f73e015ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:22.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.723+0000 7f73e7d4a640 1 -- 172.21.15.78:0/3667341694 shutdown_connections 2024-09-17T03:13:22.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.723+0000 7f73e7d4a640 1 -- 172.21.15.78:0/3667341694 wait complete. 2024-09-17T03:13:22.733 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:13:22.734 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:13:22.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.848+0000 7f7bd507e640 1 -- 172.21.15.78:0/3989946931 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7bd00caee0 msgr2=0x7f7bd006ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:22.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.848+0000 7f7bd507e640 1 --2- 172.21.15.78:0/3989946931 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7bd00caee0 0x7f7bd006ee90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8005fd0 tx=0x7f7bc802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.848+0000 7f7bd507e640 1 -- 172.21.15.78:0/3989946931 shutdown_connections 2024-09-17T03:13:22.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.848+0000 7f7bd507e640 1 --2- 172.21.15.78:0/3989946931 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7bd00caee0 0x7f7bd006ee90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.848+0000 7f7bd507e640 1 --2- 172.21.15.78:0/3989946931 >> v2:172.21.15.193:3300/0 conn(0x7f7bd015bf20 0x7f7bd00ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.848+0000 7f7bd507e640 1 -- 172.21.15.78:0/3989946931 >> 172.21.15.78:0/3989946931 conn(0x7f7bd00b1cb0 msgr2=0x7f7bd00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:22.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.848+0000 7f7bd507e640 1 -- 172.21.15.78:0/3989946931 shutdown_connections 2024-09-17T03:13:22.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.848+0000 7f7bd507e640 1 -- 172.21.15.78:0/3989946931 wait complete. 2024-09-17T03:13:22.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.849+0000 7f7bd507e640 1 Processor -- start 2024-09-17T03:13:22.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.850+0000 7f7bd507e640 1 -- start start 2024-09-17T03:13:22.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.851+0000 7f7bd507e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7bd00caee0 0x7f7bd00c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:22.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.851+0000 7f7bd507e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bd00cfb00 0x7f7bd01f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:22.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.851+0000 7f7bd507e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bd015bf20 0x7f7bd009d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:22.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.851+0000 7f7bd507e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd00ccba0 con 0x7f7bd015bf20 2024-09-17T03:13:22.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.851+0000 7f7bd507e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd00ccd20 con 0x7f7bd00cfb00 2024-09-17T03:13:22.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.851+0000 7f7bd507e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd00ccea0 con 0x7f7bd00caee0 2024-09-17T03:13:22.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.851+0000 7f7bcf59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bd015bf20 0x7f7bd009d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:22.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.851+0000 7f7bcf59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bd015bf20 0x7f7bd009d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34572/0 (socket says 172.21.15.78:34572) 2024-09-17T03:13:22.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.851+0000 7f7bcf59e640 1 -- 172.21.15.78:0/2255076356 learned_addr learned my addr 172.21.15.78:0/2255076356 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:22.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.851+0000 7f7bc659c640 1 --2- 172.21.15.78:0/2255076356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bd00cfb00 0x7f7bd01f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:22.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.851+0000 7f7bced9d640 1 --2- 172.21.15.78:0/2255076356 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7bd00caee0 0x7f7bd00c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:22.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.851+0000 7f7bcf59e640 1 -- 172.21.15.78:0/2255076356 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7bd00caee0 msgr2=0x7f7bd00c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:22.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.851+0000 7f7bcf59e640 1 --2- 172.21.15.78:0/2255076356 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7bd00caee0 0x7f7bd00c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.851+0000 7f7bcf59e640 1 -- 172.21.15.78:0/2255076356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bd00cfb00 msgr2=0x7f7bd01f5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:22.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.851+0000 7f7bcf59e640 1 --2- 172.21.15.78:0/2255076356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bd00cfb00 0x7f7bd01f5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:22.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.851+0000 7f7bcf59e640 1 -- 172.21.15.78:0/2255076356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd01f6a50 con 0x7f7bd015bf20 2024-09-17T03:13:22.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.852+0000 7f7bcf59e640 1 --2- 172.21.15.78:0/2255076356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bd015bf20 0x7f7bd009d2d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f7bc802aea0 tx=0x7f7bc8003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:22.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.852+0000 7f7bc7fff640 1 -- 172.21.15.78:0/2255076356 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8031990 con 0x7f7bd015bf20 2024-09-17T03:13:22.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.852+0000 7f7bc7fff640 1 -- 172.21.15.78:0/2255076356 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bc8031c40 con 0x7f7bd015bf20 2024-09-17T03:13:22.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.852+0000 7f7bc7fff640 1 -- 172.21.15.78:0/2255076356 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8033330 con 0x7f7bd015bf20 2024-09-17T03:13:22.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.852+0000 7f7bd507e640 1 -- 172.21.15.78:0/2255076356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd01f6d30 con 0x7f7bd015bf20 2024-09-17T03:13:22.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.852+0000 7f7bd507e640 1 -- 172.21.15.78:0/2255076356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd00c4140 con 0x7f7bd015bf20 2024-09-17T03:13:22.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.853+0000 7f7bd507e640 1 -- 172.21.15.78:0/2255076356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd00ca9a0 con 0x7f7bd015bf20 2024-09-17T03:13:22.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.854+0000 7f7bc7fff640 1 -- 172.21.15.78:0/2255076356 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7bc80334d0 con 0x7f7bd015bf20 2024-09-17T03:13:22.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.854+0000 7f7bc7fff640 1 --2- 172.21.15.78:0/2255076356 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7bb0078b90 0x7f7bb007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:22.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.854+0000 7f7bc7fff640 1 -- 172.21.15.78:0/2255076356 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f7bc80bc0f0 con 0x7f7bd015bf20 2024-09-17T03:13:22.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.854+0000 7f7bced9d640 1 --2- 172.21.15.78:0/2255076356 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7bb0078b90 0x7f7bb007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:22.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.855+0000 7f7bced9d640 1 --2- 172.21.15.78:0/2255076356 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7bb0078b90 0x7f7bb007b0a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0001720 tx=0x7f7bc0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:22.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:22.859+0000 7f7bc7fff640 1 -- 172.21.15.78:0/2255076356 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7bc803f030 con 0x7f7bd015bf20 2024-09-17T03:13:23.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.069+0000 7f7bd507e640 1 -- 172.21.15.78:0/2255076356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7bd0070600 con 0x7f7bd015bf20 2024-09-17T03:13:23.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.069+0000 7f7bc7fff640 1 -- 172.21.15.78:0/2255076356 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5275 (secure 0 0 0) 0x7f7bc80317b0 con 0x7f7bd015bf20 2024-09-17T03:13:23.068 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:23.068 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":69,"btime":"2024-09-17T03:13:22:686999+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5873,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/3831026382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3831026382},{"type":"v1","addr":"172.21.15.193:6836","nonce":3831026382}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:12:50.905684+0000","modified":"2024-09-17T03:13:21.880758+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6864,"mds_1":6861,"mds_2":6271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6271":{"gid":6271,"name":"d","rank":2,"incarnation":65,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6837/1431701139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1431701139},{"type":"v1","addr":"172.21.15.193:6837","nonce":1431701139}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6861":{"gid":6861,"name":"c","rank":1,"incarnation":63,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6834/2905189397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2905189397},{"type":"v1","addr":"172.21.15.78:6834","nonce":2905189397}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6864":{"gid":6864,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/2058899730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2058899730},{"type":"v1","addr":"172.21.15.78:6835","nonce":2058899730}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6864,"qdb_cluster":[6864,6861,6271]},"id":5}]} 2024-09-17T03:13:23.068 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 69 2024-09-17T03:13:23.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.071+0000 7f7bd507e640 1 -- 172.21.15.78:0/2255076356 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7bb0078b90 msgr2=0x7f7bb007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:23.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.071+0000 7f7bd507e640 1 --2- 172.21.15.78:0/2255076356 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7bb0078b90 0x7f7bb007b0a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0001720 tx=0x7f7bc0009040 comp rx=0 tx=0).stop 2024-09-17T03:13:23.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.071+0000 7f7bd507e640 1 -- 172.21.15.78:0/2255076356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bd015bf20 msgr2=0x7f7bd009d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:23.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.071+0000 7f7bd507e640 1 --2- 172.21.15.78:0/2255076356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bd015bf20 0x7f7bd009d2d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f7bc802aea0 tx=0x7f7bc8003970 comp rx=0 tx=0).stop 2024-09-17T03:13:23.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.071+0000 7f7bd507e640 1 -- 172.21.15.78:0/2255076356 shutdown_connections 2024-09-17T03:13:23.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.071+0000 7f7bd507e640 1 --2- 172.21.15.78:0/2255076356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7bd015bf20 0x7f7bd009d2d0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.071+0000 7f7bd507e640 1 --2- 172.21.15.78:0/2255076356 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7bb0078b90 0x7f7bb007b0a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.071+0000 7f7bd507e640 1 --2- 172.21.15.78:0/2255076356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bd00cfb00 0x7f7bd01f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.071+0000 7f7bd507e640 1 --2- 172.21.15.78:0/2255076356 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7bd00caee0 0x7f7bd00c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.071+0000 7f7bd507e640 1 -- 172.21.15.78:0/2255076356 >> 172.21.15.78:0/2255076356 conn(0x7f7bd00b1cb0 msgr2=0x7f7bd00b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:23.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.071+0000 7f7bd507e640 1 -- 172.21.15.78:0/2255076356 shutdown_connections 2024-09-17T03:13:23.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.071+0000 7f7bd507e640 1 -- 172.21.15.78:0/2255076356 wait complete. 2024-09-17T03:13:23.081 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:13:23.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.194+0000 7f423d9ad640 1 -- 172.21.15.78:0/2266957563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42380b9b70 msgr2=0x7f42380cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:23.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.194+0000 7f423d9ad640 1 --2- 172.21.15.78:0/2266957563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42380b9b70 0x7f42380cf090 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f4220005fd0 tx=0x7f422002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.194+0000 7f423d9ad640 1 -- 172.21.15.78:0/2266957563 shutdown_connections 2024-09-17T03:13:23.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.194+0000 7f423d9ad640 1 --2- 172.21.15.78:0/2266957563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42380b9b70 0x7f42380cf090 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.194+0000 7f423d9ad640 1 --2- 172.21.15.78:0/2266957563 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42380d2ed0 0x7f42380d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.194+0000 7f423d9ad640 1 -- 172.21.15.78:0/2266957563 >> 172.21.15.78:0/2266957563 conn(0x7f423808bfc0 msgr2=0x7f423809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:23.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.194+0000 7f423d9ad640 1 -- 172.21.15.78:0/2266957563 shutdown_connections 2024-09-17T03:13:23.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.194+0000 7f423d9ad640 1 -- 172.21.15.78:0/2266957563 wait complete. 2024-09-17T03:13:23.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.196+0000 7f423d9ad640 1 Processor -- start 2024-09-17T03:13:23.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.196+0000 7f423d9ad640 1 -- start start 2024-09-17T03:13:23.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.198+0000 7f423d9ad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42380b9b70 0x7f42381f9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:23.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.198+0000 7f423d9ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42380cf5d0 0x7f42381f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:23.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.198+0000 7f423d9ad640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42380d2ed0 0x7f42380ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:23.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.198+0000 7f423d9ad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f42380d4940 con 0x7f42380cf5d0 2024-09-17T03:13:23.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.198+0000 7f423d9ad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f42380cfde0 con 0x7f42380b9b70 2024-09-17T03:13:23.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.198+0000 7f423d9ad640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f42380d4ac0 con 0x7f42380d2ed0 2024-09-17T03:13:23.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.198+0000 7f422e7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42380cf5d0 0x7f42381f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:23.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.198+0000 7f422e7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42380cf5d0 0x7f42381f5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34592/0 (socket says 172.21.15.78:34592) 2024-09-17T03:13:23.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.198+0000 7f422e7fc640 1 -- 172.21.15.78:0/557165502 learned_addr learned my addr 172.21.15.78:0/557165502 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:23.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.198+0000 7f4236ffd640 1 --2- 172.21.15.78:0/557165502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42380b9b70 0x7f42381f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:23.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.198+0000 7f42377fe640 1 --2- 172.21.15.78:0/557165502 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42380d2ed0 0x7f42380ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:23.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.198+0000 7f422e7fc640 1 -- 172.21.15.78:0/557165502 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42380d2ed0 msgr2=0x7f42380ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:23.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.198+0000 7f422e7fc640 1 --2- 172.21.15.78:0/557165502 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42380d2ed0 0x7f42380ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.198+0000 7f422e7fc640 1 -- 172.21.15.78:0/557165502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42380b9b70 msgr2=0x7f42381f9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:23.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.198+0000 7f422e7fc640 1 --2- 172.21.15.78:0/557165502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42380b9b70 0x7f42381f9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.198+0000 7f422e7fc640 1 -- 172.21.15.78:0/557165502 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f423815d300 con 0x7f42380cf5d0 2024-09-17T03:13:23.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.198+0000 7f422e7fc640 1 --2- 172.21.15.78:0/557165502 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42380cf5d0 0x7f42381f5950 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f4220034040 tx=0x7f42200038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:23.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.198+0000 7f4234ff9640 1 -- 172.21.15.78:0/557165502 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f422003e030 con 0x7f42380cf5d0 2024-09-17T03:13:23.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.198+0000 7f4234ff9640 1 -- 172.21.15.78:0/557165502 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4220003ca0 con 0x7f42380cf5d0 2024-09-17T03:13:23.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.198+0000 7f4234ff9640 1 -- 172.21.15.78:0/557165502 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4220035040 con 0x7f42380cf5d0 2024-09-17T03:13:23.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.199+0000 7f423d9ad640 1 -- 172.21.15.78:0/557165502 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f423815d5e0 con 0x7f42380cf5d0 2024-09-17T03:13:23.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.199+0000 7f423d9ad640 1 -- 172.21.15.78:0/557165502 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42381f8f40 con 0x7f42380cf5d0 2024-09-17T03:13:23.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.200+0000 7f423d9ad640 1 -- 172.21.15.78:0/557165502 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42380d5050 con 0x7f42380cf5d0 2024-09-17T03:13:23.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.200+0000 7f4234ff9640 1 -- 172.21.15.78:0/557165502 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4220041030 con 0x7f42380cf5d0 2024-09-17T03:13:23.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.201+0000 7f4234ff9640 1 --2- 172.21.15.78:0/557165502 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4218078b90 0x7f421807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:23.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.201+0000 7f4234ff9640 1 -- 172.21.15.78:0/557165502 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f42200bb360 con 0x7f42380cf5d0 2024-09-17T03:13:23.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.201+0000 7f4236ffd640 1 --2- 172.21.15.78:0/557165502 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4218078b90 0x7f421807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:23.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.202+0000 7f4236ffd640 1 --2- 172.21.15.78:0/557165502 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4218078b90 0x7f421807b0a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f422800bb30 tx=0x7f422800b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:23.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.205+0000 7f4234ff9640 1 -- 172.21.15.78:0/557165502 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4220083110 con 0x7f42380cf5d0 2024-09-17T03:13:23.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.412+0000 7f423d9ad640 1 -- 172.21.15.78:0/557165502 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42380b4020 con 0x7f42380cf5d0 2024-09-17T03:13:23.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.412+0000 7f4234ff9640 1 -- 172.21.15.78:0/557165502 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5275 (secure 0 0 0) 0x7f4220087b40 con 0x7f42380cf5d0 2024-09-17T03:13:23.412 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:23.412 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":69,"btime":"2024-09-17T03:13:22:686999+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5873,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/3831026382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3831026382},{"type":"v1","addr":"172.21.15.193:6836","nonce":3831026382}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:12:50.905684+0000","modified":"2024-09-17T03:13:21.880758+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":6864,"mds_1":6861,"mds_2":6271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6271":{"gid":6271,"name":"d","rank":2,"incarnation":65,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6837/1431701139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1431701139},{"type":"v1","addr":"172.21.15.193:6837","nonce":1431701139}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6861":{"gid":6861,"name":"c","rank":1,"incarnation":63,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6834/2905189397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2905189397},{"type":"v1","addr":"172.21.15.78:6834","nonce":2905189397}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_6864":{"gid":6864,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/2058899730","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":2058899730},{"type":"v1","addr":"172.21.15.78:6835","nonce":2058899730}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6864,"qdb_cluster":[6864,6861,6271]},"id":5}]} 2024-09-17T03:13:23.412 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 69 2024-09-17T03:13:23.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.414+0000 7f423d9ad640 1 -- 172.21.15.78:0/557165502 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4218078b90 msgr2=0x7f421807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:23.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.414+0000 7f423d9ad640 1 --2- 172.21.15.78:0/557165502 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4218078b90 0x7f421807b0a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f422800bb30 tx=0x7f422800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.414+0000 7f423d9ad640 1 -- 172.21.15.78:0/557165502 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42380cf5d0 msgr2=0x7f42381f5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:23.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.414+0000 7f423d9ad640 1 --2- 172.21.15.78:0/557165502 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42380cf5d0 0x7f42381f5950 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f4220034040 tx=0x7f42200038a0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.414+0000 7f423d9ad640 1 -- 172.21.15.78:0/557165502 shutdown_connections 2024-09-17T03:13:23.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.414+0000 7f423d9ad640 1 --2- 172.21.15.78:0/557165502 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42380d2ed0 0x7f42380ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.414+0000 7f423d9ad640 1 --2- 172.21.15.78:0/557165502 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42380cf5d0 0x7f42381f5950 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.414+0000 7f423d9ad640 1 --2- 172.21.15.78:0/557165502 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4218078b90 0x7f421807b0a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.414+0000 7f423d9ad640 1 --2- 172.21.15.78:0/557165502 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42380b9b70 0x7f42381f9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.414+0000 7f423d9ad640 1 -- 172.21.15.78:0/557165502 >> 172.21.15.78:0/557165502 conn(0x7f423808bfc0 msgr2=0x7f423806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:23.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.414+0000 7f423d9ad640 1 -- 172.21.15.78:0/557165502 shutdown_connections 2024-09-17T03:13:23.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.414+0000 7f423d9ad640 1 -- 172.21.15.78:0/557165502 wait complete. 2024-09-17T03:13:23.425 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:13:23.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.538+0000 7f8c86ea4640 1 -- 172.21.15.78:0/3728215055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c8006f4b0 msgr2=0x7f8c800d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:23.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.538+0000 7f8c86ea4640 1 --2- 172.21.15.78:0/3728215055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c8006f4b0 0x7f8c800d3330 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f8c800ba570 tx=0x7f8c6c02a4f0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.538+0000 7f8c86ea4640 1 -- 172.21.15.78:0/3728215055 shutdown_connections 2024-09-17T03:13:23.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.538+0000 7f8c86ea4640 1 --2- 172.21.15.78:0/3728215055 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c800d3870 0x7f8c800ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.538+0000 7f8c86ea4640 1 --2- 172.21.15.78:0/3728215055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c8006f4b0 0x7f8c800d3330 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.538+0000 7f8c86ea4640 1 --2- 172.21.15.78:0/3728215055 >> v2:172.21.15.193:3300/0 conn(0x7f8c8006e170 0x7f8c800b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.538+0000 7f8c86ea4640 1 -- 172.21.15.78:0/3728215055 >> 172.21.15.78:0/3728215055 conn(0x7f8c8008bfc0 msgr2=0x7f8c8009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:23.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.538+0000 7f8c86ea4640 1 -- 172.21.15.78:0/3728215055 shutdown_connections 2024-09-17T03:13:23.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.538+0000 7f8c86ea4640 1 -- 172.21.15.78:0/3728215055 wait complete. 2024-09-17T03:13:23.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.540+0000 7f8c86ea4640 1 Processor -- start 2024-09-17T03:13:23.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.540+0000 7f8c86ea4640 1 -- start start 2024-09-17T03:13:23.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.541+0000 7f8c86ea4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c8006f4b0 0x7f8c800c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:23.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.541+0000 7f8c86ea4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c800d3870 0x7f8c800c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:23.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.541+0000 7f8c86ea4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c801f5e50 0x7f8c8009eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:23.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.541+0000 7f8c86ea4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8c800cf490 con 0x7f8c8006f4b0 2024-09-17T03:13:23.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.542+0000 7f8c86ea4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8c800cf310 con 0x7f8c800d3870 2024-09-17T03:13:23.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.542+0000 7f8c86ea4640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8c800d0ce0 con 0x7f8c801f5e50 2024-09-17T03:13:23.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.542+0000 7f8c84c40640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c8006f4b0 0x7f8c800c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:23.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.542+0000 7f8c84c40640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c8006f4b0 0x7f8c800c99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34614/0 (socket says 172.21.15.78:34614) 2024-09-17T03:13:23.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.542+0000 7f8c84c40640 1 -- 172.21.15.78:0/621901178 learned_addr learned my addr 172.21.15.78:0/621901178 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:23.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.542+0000 7f8c7ffff640 1 --2- 172.21.15.78:0/621901178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c800d3870 0x7f8c800c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:23.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.542+0000 7f8c85441640 1 --2- 172.21.15.78:0/621901178 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c801f5e50 0x7f8c8009eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:23.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.542+0000 7f8c84c40640 1 -- 172.21.15.78:0/621901178 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c801f5e50 msgr2=0x7f8c8009eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:23.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.542+0000 7f8c84c40640 1 --2- 172.21.15.78:0/621901178 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c801f5e50 0x7f8c8009eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.542+0000 7f8c84c40640 1 -- 172.21.15.78:0/621901178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c800d3870 msgr2=0x7f8c800c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:23.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.542+0000 7f8c84c40640 1 --2- 172.21.15.78:0/621901178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c800d3870 0x7f8c800c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.542+0000 7f8c84c40640 1 -- 172.21.15.78:0/621901178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c800c89d0 con 0x7f8c8006f4b0 2024-09-17T03:13:23.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.542+0000 7f8c84c40640 1 --2- 172.21.15.78:0/621901178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c8006f4b0 0x7f8c800c99c0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400b410 tx=0x7f8c7400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:23.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.542+0000 7f8c7d7fa640 1 -- 172.21.15.78:0/621901178 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74015020 con 0x7f8c8006f4b0 2024-09-17T03:13:23.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.542+0000 7f8c7d7fa640 1 -- 172.21.15.78:0/621901178 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c74011940 con 0x7f8c8006f4b0 2024-09-17T03:13:23.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.542+0000 7f8c86ea4640 1 -- 172.21.15.78:0/621901178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c800c8cb0 con 0x7f8c8006f4b0 2024-09-17T03:13:23.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.542+0000 7f8c7d7fa640 1 -- 172.21.15.78:0/621901178 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74011d90 con 0x7f8c8006f4b0 2024-09-17T03:13:23.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.542+0000 7f8c86ea4640 1 -- 172.21.15.78:0/621901178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c800c9fd0 con 0x7f8c8006f4b0 2024-09-17T03:13:23.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.544+0000 7f8c86ea4640 1 -- 172.21.15.78:0/621901178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c800ca230 con 0x7f8c8006f4b0 2024-09-17T03:13:23.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.544+0000 7f8c7d7fa640 1 -- 172.21.15.78:0/621901178 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8c74018020 con 0x7f8c8006f4b0 2024-09-17T03:13:23.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.544+0000 7f8c7d7fa640 1 --2- 172.21.15.78:0/621901178 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c64078b90 0x7f8c6407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:23.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.544+0000 7f8c7d7fa640 1 -- 172.21.15.78:0/621901178 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f8c7409ab70 con 0x7f8c8006f4b0 2024-09-17T03:13:23.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.545+0000 7f8c7ffff640 1 --2- 172.21.15.78:0/621901178 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c64078b90 0x7f8c6407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:23.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.545+0000 7f8c7ffff640 1 --2- 172.21.15.78:0/621901178 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c64078b90 0x7f8c6407b0a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c033000 tx=0x7f8c6c004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:23.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.549+0000 7f8c7d7fa640 1 -- 172.21.15.78:0/621901178 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8c7401f020 con 0x7f8c8006f4b0 2024-09-17T03:13:23.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.729+0000 7f8c86ea4640 1 -- 172.21.15.78:0/621901178 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c8006e170 con 0x7f8c8006f4b0 2024-09-17T03:13:23.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.730+0000 7f8c7d7fa640 1 -- 172.21.15.78:0/621901178 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) ==== 74+0+16801 (secure 0 0 0) 0x7f8c740629b0 con 0x7f8c8006f4b0 2024-09-17T03:13:23.729 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:23.729 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":71,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:13:09.638657+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:12:48.548227+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T03:12:49.863501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.3","mappings":[{"from":6,"to":0}]},{"pgid":"11.3e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:13:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.732+0000 7f8c86ea4640 1 -- 172.21.15.78:0/621901178 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c64078b90 msgr2=0x7f8c6407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.732+0000 7f8c86ea4640 1 --2- 172.21.15.78:0/621901178 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c64078b90 0x7f8c6407b0a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c033000 tx=0x7f8c6c004730 comp rx=0 tx=0).stop 2024-09-17T03:13:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.732+0000 7f8c86ea4640 1 -- 172.21.15.78:0/621901178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c8006f4b0 msgr2=0x7f8c800c99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.732+0000 7f8c86ea4640 1 --2- 172.21.15.78:0/621901178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c8006f4b0 0x7f8c800c99c0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400b410 tx=0x7f8c7400b8d0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.732+0000 7f8c86ea4640 1 -- 172.21.15.78:0/621901178 shutdown_connections 2024-09-17T03:13:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.732+0000 7f8c86ea4640 1 --2- 172.21.15.78:0/621901178 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c801f5e50 0x7f8c8009eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.732+0000 7f8c86ea4640 1 --2- 172.21.15.78:0/621901178 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c64078b90 0x7f8c6407b0a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.732+0000 7f8c86ea4640 1 --2- 172.21.15.78:0/621901178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c800d3870 0x7f8c800c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.732+0000 7f8c86ea4640 1 --2- 172.21.15.78:0/621901178 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c8006f4b0 0x7f8c800c99c0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.732+0000 7f8c86ea4640 1 -- 172.21.15.78:0/621901178 >> 172.21.15.78:0/621901178 conn(0x7f8c8008bfc0 msgr2=0x7f8c80161950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:23.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.732+0000 7f8c86ea4640 1 -- 172.21.15.78:0/621901178 shutdown_connections 2024-09-17T03:13:23.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.732+0000 7f8c86ea4640 1 -- 172.21.15.78:0/621901178 wait complete. 2024-09-17T03:13:23.742 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:13:23.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.858+0000 7f1793e20640 1 -- 172.21.15.78:0/339056775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f178c075fa0 msgr2=0x7f178c070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:23.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.858+0000 7f1793e20640 1 --2- 172.21.15.78:0/339056775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f178c075fa0 0x7f178c070e40 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f178c0cbe10 tx=0x7f178802a5f0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.858+0000 7f1793e20640 1 -- 172.21.15.78:0/339056775 shutdown_connections 2024-09-17T03:13:23.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.858+0000 7f1793e20640 1 --2- 172.21.15.78:0/339056775 >> v2:172.21.15.193:3300/0 conn(0x7f178c06e100 0x7f178c15f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.858+0000 7f1793e20640 1 --2- 172.21.15.78:0/339056775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f178c075fa0 0x7f178c070e40 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.858+0000 7f1793e20640 1 -- 172.21.15.78:0/339056775 >> 172.21.15.78:0/339056775 conn(0x7f178c0cd530 msgr2=0x7f178c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:23.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.858+0000 7f1793e20640 1 -- 172.21.15.78:0/339056775 shutdown_connections 2024-09-17T03:13:23.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.858+0000 7f1793e20640 1 -- 172.21.15.78:0/339056775 wait complete. 2024-09-17T03:13:23.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.860+0000 7f1793e20640 1 Processor -- start 2024-09-17T03:13:23.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.860+0000 7f1793e20640 1 -- start start 2024-09-17T03:13:23.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.861+0000 7f1793e20640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f178c06e100 0x7f178c1484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:23.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.861+0000 7f1793e20640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f178c075fa0 0x7f178c073660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:23.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.861+0000 7f1793e20640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f178c15f7e0 0x7f178c073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:23.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.861+0000 7f1793e20640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f178c15c3c0 con 0x7f178c075fa0 2024-09-17T03:13:23.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.861+0000 7f1793e20640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f178c0cf8a0 con 0x7f178c15f7e0 2024-09-17T03:13:23.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.861+0000 7f1793e20640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f178c15c540 con 0x7f178c06e100 2024-09-17T03:13:23.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.861+0000 7f17913bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f178c075fa0 0x7f178c073660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:23.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.861+0000 7f17913bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f178c075fa0 0x7f178c073660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34628/0 (socket says 172.21.15.78:34628) 2024-09-17T03:13:23.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.861+0000 7f17913bb640 1 -- 172.21.15.78:0/4114226456 learned_addr learned my addr 172.21.15.78:0/4114226456 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:23.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.861+0000 7f1791bbc640 1 --2- 172.21.15.78:0/4114226456 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f178c06e100 0x7f178c1484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:23.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.861+0000 7f17923bd640 1 --2- 172.21.15.78:0/4114226456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f178c15f7e0 0x7f178c073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:23.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.861+0000 7f17913bb640 1 -- 172.21.15.78:0/4114226456 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f178c06e100 msgr2=0x7f178c1484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:23.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.861+0000 7f17913bb640 1 --2- 172.21.15.78:0/4114226456 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f178c06e100 0x7f178c1484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.861+0000 7f17913bb640 1 -- 172.21.15.78:0/4114226456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f178c15f7e0 msgr2=0x7f178c073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:23.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.861+0000 7f17913bb640 1 --2- 172.21.15.78:0/4114226456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f178c15f7e0 0x7f178c073ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:23.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.861+0000 7f17913bb640 1 -- 172.21.15.78:0/4114226456 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f178c1f6e80 con 0x7f178c075fa0 2024-09-17T03:13:23.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.862+0000 7f17913bb640 1 --2- 172.21.15.78:0/4114226456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f178c075fa0 0x7f178c073660 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f177c00d770 tx=0x7f177c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:23.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.862+0000 7f17827fc640 1 -- 172.21.15.78:0/4114226456 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c017070 con 0x7f178c075fa0 2024-09-17T03:13:23.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.862+0000 7f17827fc640 1 -- 172.21.15.78:0/4114226456 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f177c009d20 con 0x7f178c075fa0 2024-09-17T03:13:23.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.862+0000 7f1793e20640 1 -- 172.21.15.78:0/4114226456 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f178c1f7160 con 0x7f178c075fa0 2024-09-17T03:13:23.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.862+0000 7f17827fc640 1 -- 172.21.15.78:0/4114226456 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c004280 con 0x7f178c075fa0 2024-09-17T03:13:23.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.862+0000 7f1793e20640 1 -- 172.21.15.78:0/4114226456 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f178c1f7720 con 0x7f178c075fa0 2024-09-17T03:13:23.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.863+0000 7f1793e20640 1 -- 172.21.15.78:0/4114226456 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f178c15cad0 con 0x7f178c075fa0 2024-09-17T03:13:23.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.863+0000 7f17827fc640 1 -- 172.21.15.78:0/4114226456 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f177c005020 con 0x7f178c075fa0 2024-09-17T03:13:23.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.864+0000 7f17827fc640 1 --2- 172.21.15.78:0/4114226456 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1770078b90 0x7f177007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:23.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.864+0000 7f17827fc640 1 -- 172.21.15.78:0/4114226456 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f177c09b1a0 con 0x7f178c075fa0 2024-09-17T03:13:23.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.864+0000 7f1791bbc640 1 --2- 172.21.15.78:0/4114226456 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1770078b90 0x7f177007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:23.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.865+0000 7f1791bbc640 1 --2- 172.21.15.78:0/4114226456 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1770078b90 0x7f177007b0a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1788033000 tx=0x7f1788004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:23.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:23.868+0000 7f17827fc640 1 -- 172.21.15.78:0/4114226456 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f177c020020 con 0x7f178c075fa0 2024-09-17T03:13:24.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.076+0000 7f1793e20640 1 -- 172.21.15.78:0/4114226456 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f178c160120 con 0x7f178c075fa0 2024-09-17T03:13:24.075 INFO:tasks.ceph.mon.a.smithi078.stderr:2024-09-17T03:13:24.077+0000 7f192af78640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:13:24.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.080+0000 7f17827fc640 1 -- 172.21.15.78:0/4114226456 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v70) ==== 161+0+0 (secure 0 0 0) 0x7f177c063630 con 0x7f178c075fa0 2024-09-17T03:13:24.079 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:13:24.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.083+0000 7f1793e20640 1 -- 172.21.15.78:0/4114226456 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1770078b90 msgr2=0x7f177007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.083+0000 7f1793e20640 1 --2- 172.21.15.78:0/4114226456 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1770078b90 0x7f177007b0a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1788033000 tx=0x7f1788004730 comp rx=0 tx=0).stop 2024-09-17T03:13:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.083+0000 7f1793e20640 1 -- 172.21.15.78:0/4114226456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f178c075fa0 msgr2=0x7f178c073660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.083+0000 7f1793e20640 1 --2- 172.21.15.78:0/4114226456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f178c075fa0 0x7f178c073660 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f177c00d770 tx=0x7f177c00dc30 comp rx=0 tx=0).stop 2024-09-17T03:13:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.083+0000 7f1793e20640 1 -- 172.21.15.78:0/4114226456 shutdown_connections 2024-09-17T03:13:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.083+0000 7f1793e20640 1 --2- 172.21.15.78:0/4114226456 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1770078b90 0x7f177007b0a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.083+0000 7f1793e20640 1 --2- 172.21.15.78:0/4114226456 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f178c15f7e0 0x7f178c073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.083+0000 7f1793e20640 1 --2- 172.21.15.78:0/4114226456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f178c075fa0 0x7f178c073660 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.083+0000 7f1793e20640 1 --2- 172.21.15.78:0/4114226456 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f178c06e100 0x7f178c1484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.083+0000 7f1793e20640 1 -- 172.21.15.78:0/4114226456 >> 172.21.15.78:0/4114226456 conn(0x7f178c0cd530 msgr2=0x7f178c0b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.084+0000 7f1793e20640 1 -- 172.21.15.78:0/4114226456 shutdown_connections 2024-09-17T03:13:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.084+0000 7f1793e20640 1 -- 172.21.15.78:0/4114226456 wait complete. 2024-09-17T03:13:24.084 INFO:tasks.ceph.mds.a.smithi078.stderr: -9568> 2024-09-17T03:12:53.531+0000 7f709c4f2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:13:24.095 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:13:24.138 INFO:tasks.ceph.mds.d.smithi193.stdout:starting mds.d at 2024-09-17T03:13:24.139 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2024-09-17T03:13:24.146 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-09-17T03:13:24.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.215+0000 7f3f51141640 1 -- 172.21.15.78:0/2330658738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4c0cf940 msgr2=0x7f3f4c06fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:24.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.215+0000 7f3f51141640 1 --2- 172.21.15.78:0/2330658738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4c0cf940 0x7f3f4c06fc80 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c070fe0 tx=0x7f3f3402a560 comp rx=0 tx=0).stop 2024-09-17T03:13:24.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.215+0000 7f3f51141640 1 -- 172.21.15.78:0/2330658738 shutdown_connections 2024-09-17T03:13:24.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.215+0000 7f3f51141640 1 --2- 172.21.15.78:0/2330658738 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3f4c0701c0 0x7f3f4c0705d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:24.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.215+0000 7f3f51141640 1 --2- 172.21.15.78:0/2330658738 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4c0cf940 0x7f3f4c06fc80 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:24.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.215+0000 7f3f51141640 1 --2- 172.21.15.78:0/2330658738 >> v2:172.21.15.193:3300/0 conn(0x7f3f4c0b4d90 0x7f3f4c072e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:24.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.215+0000 7f3f51141640 1 -- 172.21.15.78:0/2330658738 >> 172.21.15.78:0/2330658738 conn(0x7f3f4c06d7d0 msgr2=0x7f3f4c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:24.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.215+0000 7f3f51141640 1 -- 172.21.15.78:0/2330658738 shutdown_connections 2024-09-17T03:13:24.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.215+0000 7f3f51141640 1 -- 172.21.15.78:0/2330658738 wait complete. 2024-09-17T03:13:24.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.217+0000 7f3f51141640 1 Processor -- start 2024-09-17T03:13:24.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.217+0000 7f3f51141640 1 -- start start 2024-09-17T03:13:24.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.218+0000 7f3f51141640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f4c0701c0 0x7f3f4c1f4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:24.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.218+0000 7f3f51141640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3f4c0cf940 0x7f3f4c09d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:24.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.218+0000 7f3f51141640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4c15a600 0x7f3f4c14b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:24.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.218+0000 7f3f51141640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c15ed70 con 0x7f3f4c15a600 2024-09-17T03:13:24.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.218+0000 7f3f51141640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c15ebf0 con 0x7f3f4c0701c0 2024-09-17T03:13:24.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.218+0000 7f3f51141640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3f4c15eef0 con 0x7f3f4c0cf940 2024-09-17T03:13:24.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.218+0000 7f3f4b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4c15a600 0x7f3f4c14b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:24.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.218+0000 7f3f4b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4c15a600 0x7f3f4c14b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34670/0 (socket says 172.21.15.78:34670) 2024-09-17T03:13:24.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.218+0000 7f3f4b59e640 1 -- 172.21.15.78:0/2977150136 learned_addr learned my addr 172.21.15.78:0/2977150136 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:24.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.218+0000 7f3f4ad9d640 1 --2- 172.21.15.78:0/2977150136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f4c0701c0 0x7f3f4c1f4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:24.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.218+0000 7f3f4259c640 1 --2- 172.21.15.78:0/2977150136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3f4c0cf940 0x7f3f4c09d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:24.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.219+0000 7f3f4b59e640 1 -- 172.21.15.78:0/2977150136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3f4c0cf940 msgr2=0x7f3f4c09d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:24.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.219+0000 7f3f4b59e640 1 --2- 172.21.15.78:0/2977150136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3f4c0cf940 0x7f3f4c09d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:24.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.219+0000 7f3f4b59e640 1 -- 172.21.15.78:0/2977150136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f4c0701c0 msgr2=0x7f3f4c1f4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:24.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.219+0000 7f3f4b59e640 1 --2- 172.21.15.78:0/2977150136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f4c0701c0 0x7f3f4c1f4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:24.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.219+0000 7f3f4b59e640 1 -- 172.21.15.78:0/2977150136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c09c490 con 0x7f3f4c15a600 2024-09-17T03:13:24.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.219+0000 7f3f4259c640 1 --2- 172.21.15.78:0/2977150136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3f4c0cf940 0x7f3f4c09d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:24.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.219+0000 7f3f4b59e640 1 --2- 172.21.15.78:0/2977150136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4c15a600 0x7f3f4c14b420 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400cab0 tx=0x7f3f4400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:24.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.219+0000 7f3f43fff640 1 -- 172.21.15.78:0/2977150136 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f44007d90 con 0x7f3f4c15a600 2024-09-17T03:13:24.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.219+0000 7f3f43fff640 1 -- 172.21.15.78:0/2977150136 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f44003a80 con 0x7f3f4c15a600 2024-09-17T03:13:24.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.219+0000 7f3f51141640 1 -- 172.21.15.78:0/2977150136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4c09c770 con 0x7f3f4c15a600 2024-09-17T03:13:24.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.219+0000 7f3f43fff640 1 -- 172.21.15.78:0/2977150136 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f44004020 con 0x7f3f4c15a600 2024-09-17T03:13:24.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.219+0000 7f3f51141640 1 -- 172.21.15.78:0/2977150136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f4c09cd30 con 0x7f3f4c15a600 2024-09-17T03:13:24.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.220+0000 7f3f51141640 1 -- 172.21.15.78:0/2977150136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f4c0b4d90 con 0x7f3f4c15a600 2024-09-17T03:13:24.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.221+0000 7f3f43fff640 1 -- 172.21.15.78:0/2977150136 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3f440041c0 con 0x7f3f4c15a600 2024-09-17T03:13:24.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.221+0000 7f3f43fff640 1 --2- 172.21.15.78:0/2977150136 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f2c078bc0 0x7f3f2c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:24.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.221+0000 7f3f43fff640 1 -- 172.21.15.78:0/2977150136 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6025+0+0 (secure 0 0 0) 0x7f3f4409b380 con 0x7f3f4c15a600 2024-09-17T03:13:24.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.221+0000 7f3f4ad9d640 1 --2- 172.21.15.78:0/2977150136 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f2c078bc0 0x7f3f2c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:24.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.222+0000 7f3f4ad9d640 1 --2- 172.21.15.78:0/2977150136 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f2c078bc0 0x7f3f2c07b0d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00a490 tx=0x7f3f3c00a420 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:24.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.226+0000 7f3f43fff640 1 -- 172.21.15.78:0/2977150136 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3f44014070 con 0x7f3f4c15a600 2024-09-17T03:13:24.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:24.435+0000 7f3f51141640 1 -- 172.21.15.78:0/2977150136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3f4c09c1b0 con 0x7f3f4c15a600 2024-09-17T03:13:25.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.081+0000 7f3f43fff640 1 -- 172.21.15.78:0/2977150136 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v71) ==== 104+0+0 (secure 0 0 0) 0x7f3f44063150 con 0x7f3f4c15a600 2024-09-17T03:13:25.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.084+0000 7f3f51141640 1 -- 172.21.15.78:0/2977150136 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f2c078bc0 msgr2=0x7f3f2c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:25.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.084+0000 7f3f51141640 1 --2- 172.21.15.78:0/2977150136 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f2c078bc0 0x7f3f2c07b0d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c00a490 tx=0x7f3f3c00a420 comp rx=0 tx=0).stop 2024-09-17T03:13:25.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.084+0000 7f3f51141640 1 -- 172.21.15.78:0/2977150136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4c15a600 msgr2=0x7f3f4c14b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:25.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.084+0000 7f3f51141640 1 --2- 172.21.15.78:0/2977150136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4c15a600 0x7f3f4c14b420 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400cab0 tx=0x7f3f4400cf70 comp rx=0 tx=0).stop 2024-09-17T03:13:25.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.084+0000 7f3f51141640 1 -- 172.21.15.78:0/2977150136 shutdown_connections 2024-09-17T03:13:25.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.084+0000 7f3f51141640 1 --2- 172.21.15.78:0/2977150136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f4c15a600 0x7f3f4c14b420 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:25.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.084+0000 7f3f51141640 1 --2- 172.21.15.78:0/2977150136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3f4c0cf940 0x7f3f4c09d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:25.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.084+0000 7f3f51141640 1 --2- 172.21.15.78:0/2977150136 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f2c078bc0 0x7f3f2c07b0d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:25.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.084+0000 7f3f51141640 1 --2- 172.21.15.78:0/2977150136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3f4c0701c0 0x7f3f4c1f4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:25.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.084+0000 7f3f51141640 1 -- 172.21.15.78:0/2977150136 >> 172.21.15.78:0/2977150136 conn(0x7f3f4c06d7d0 msgr2=0x7f3f4c15af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:25.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.084+0000 7f3f51141640 1 -- 172.21.15.78:0/2977150136 shutdown_connections 2024-09-17T03:13:25.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.084+0000 7f3f51141640 1 -- 172.21.15.78:0/2977150136 wait complete. 2024-09-17T03:13:25.096 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:13:25.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.214+0000 7fe6bfd6e640 1 -- 172.21.15.78:0/3841221411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b80b96c0 msgr2=0x7fe6b80d23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:25.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.214+0000 7fe6bfd6e640 1 --2- 172.21.15.78:0/3841221411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b80b96c0 0x7fe6b80d23f0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009830 tx=0x7fe6b002a510 comp rx=0 tx=0).stop 2024-09-17T03:13:25.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.214+0000 7fe6bfd6e640 1 -- 172.21.15.78:0/3841221411 shutdown_connections 2024-09-17T03:13:25.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.214+0000 7fe6bfd6e640 1 --2- 172.21.15.78:0/3841221411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b80b96c0 0x7fe6b80d23f0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:25.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.214+0000 7fe6bfd6e640 1 --2- 172.21.15.78:0/3841221411 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe6b80cfa70 0x7fe6b806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:25.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.214+0000 7fe6bfd6e640 1 -- 172.21.15.78:0/3841221411 >> 172.21.15.78:0/3841221411 conn(0x7fe6b809d8a0 msgr2=0x7fe6b808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:25.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.214+0000 7fe6bfd6e640 1 -- 172.21.15.78:0/3841221411 shutdown_connections 2024-09-17T03:13:25.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.214+0000 7fe6bfd6e640 1 -- 172.21.15.78:0/3841221411 wait complete. 2024-09-17T03:13:25.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.216+0000 7fe6bfd6e640 1 Processor -- start 2024-09-17T03:13:25.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.216+0000 7fe6bfd6e640 1 -- start start 2024-09-17T03:13:25.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.217+0000 7fe6bfd6e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b80b96c0 0x7fe6b8154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:25.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.217+0000 7fe6bfd6e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe6b80d18f0 0x7fe6b8151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:25.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.217+0000 7fe6bfd6e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe6b81f8f90 0x7fe6b81f93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:25.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.217+0000 7fe6bfd6e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b80d2e60 con 0x7fe6b80b96c0 2024-09-17T03:13:25.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.217+0000 7fe6bfd6e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe6b80d2ce0 con 0x7fe6b81f8f90 2024-09-17T03:13:25.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.217+0000 7fe6bfd6e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe6b80d2fe0 con 0x7fe6b80d18f0 2024-09-17T03:13:25.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.217+0000 7fe6bdb0a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b80b96c0 0x7fe6b8154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:25.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.217+0000 7fe6bdb0a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b80b96c0 0x7fe6b8154760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34688/0 (socket says 172.21.15.78:34688) 2024-09-17T03:13:25.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.217+0000 7fe6bdb0a640 1 -- 172.21.15.78:0/3466681113 learned_addr learned my addr 172.21.15.78:0/3466681113 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:25.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.218+0000 7fe6bd309640 1 --2- 172.21.15.78:0/3466681113 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe6b80d18f0 0x7fe6b8151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:25.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.218+0000 7fe6be30b640 1 --2- 172.21.15.78:0/3466681113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe6b81f8f90 0x7fe6b81f93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:25.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.218+0000 7fe6bdb0a640 1 -- 172.21.15.78:0/3466681113 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe6b80d18f0 msgr2=0x7fe6b8151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:25.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.218+0000 7fe6bdb0a640 1 --2- 172.21.15.78:0/3466681113 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe6b80d18f0 0x7fe6b8151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:25.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.218+0000 7fe6bdb0a640 1 -- 172.21.15.78:0/3466681113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe6b81f8f90 msgr2=0x7fe6b81f93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:25.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.218+0000 7fe6bdb0a640 1 --2- 172.21.15.78:0/3466681113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe6b81f8f90 0x7fe6b81f93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:25.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.218+0000 7fe6bdb0a640 1 -- 172.21.15.78:0/3466681113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6b8154ca0 con 0x7fe6b80b96c0 2024-09-17T03:13:25.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.218+0000 7fe6bd309640 1 --2- 172.21.15.78:0/3466681113 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe6b80d18f0 0x7fe6b8151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:25.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.218+0000 7fe6be30b640 1 --2- 172.21.15.78:0/3466681113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe6b81f8f90 0x7fe6b81f93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:25.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.218+0000 7fe6bdb0a640 1 --2- 172.21.15.78:0/3466681113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b80b96c0 0x7fe6b8154760 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800cb40 tx=0x7fe6a800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:25.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.218+0000 7fe6b67fc640 1 -- 172.21.15.78:0/3466681113 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8016020 con 0x7fe6b80b96c0 2024-09-17T03:13:25.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.218+0000 7fe6b67fc640 1 -- 172.21.15.78:0/3466681113 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe6a800ad50 con 0x7fe6b80b96c0 2024-09-17T03:13:25.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.218+0000 7fe6bfd6e640 1 -- 172.21.15.78:0/3466681113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6b81519d0 con 0x7fe6b80b96c0 2024-09-17T03:13:25.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.218+0000 7fe6b67fc640 1 -- 172.21.15.78:0/3466681113 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a8012680 con 0x7fe6b80b96c0 2024-09-17T03:13:25.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.218+0000 7fe6bfd6e640 1 -- 172.21.15.78:0/3466681113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6b8151cc0 con 0x7fe6b80b96c0 2024-09-17T03:13:25.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.219+0000 7fe6bfd6e640 1 -- 172.21.15.78:0/3466681113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6b80d3500 con 0x7fe6b80b96c0 2024-09-17T03:13:25.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.220+0000 7fe6b67fc640 1 -- 172.21.15.78:0/3466681113 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe6a8019020 con 0x7fe6b80b96c0 2024-09-17T03:13:25.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.220+0000 7fe6b67fc640 1 --2- 172.21.15.78:0/3466681113 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe6a4078b90 0x7fe6a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:25.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.220+0000 7fe6b67fc640 1 -- 172.21.15.78:0/3466681113 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6025+0+0 (secure 0 0 0) 0x7fe6a809b480 con 0x7fe6b80b96c0 2024-09-17T03:13:25.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.221+0000 7fe6bd309640 1 --2- 172.21.15.78:0/3466681113 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe6a4078b90 0x7fe6a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:25.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.221+0000 7fe6bd309640 1 --2- 172.21.15.78:0/3466681113 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe6a4078b90 0x7fe6a407b0a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80d1fa0 tx=0x7fe6ac008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:25.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.225+0000 7fe6b67fc640 1 -- 172.21.15.78:0/3466681113 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe6a8020020 con 0x7fe6b80b96c0 2024-09-17T03:13:25.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:25.400+0000 7fe6bfd6e640 1 -- 172.21.15.78:0/3466681113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe6b81f98e0 con 0x7fe6b80b96c0 2024-09-17T03:13:25.949 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:13:25.952 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:13:26.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.089+0000 7fe6b67fc640 1 -- 172.21.15.78:0/3466681113 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v73) ==== 181+0+0 (secure 0 0 0) 0x7fe6b8154ca0 con 0x7fe6b80b96c0 2024-09-17T03:13:26.088 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:13:26.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.091+0000 7fe6bfd6e640 1 -- 172.21.15.78:0/3466681113 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe6a4078b90 msgr2=0x7fe6a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:26.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.091+0000 7fe6bfd6e640 1 --2- 172.21.15.78:0/3466681113 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe6a4078b90 0x7fe6a407b0a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80d1fa0 tx=0x7fe6ac008040 comp rx=0 tx=0).stop 2024-09-17T03:13:26.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.091+0000 7fe6bfd6e640 1 -- 172.21.15.78:0/3466681113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b80b96c0 msgr2=0x7fe6b8154760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:26.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.091+0000 7fe6bfd6e640 1 --2- 172.21.15.78:0/3466681113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b80b96c0 0x7fe6b8154760 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fe6a800cb40 tx=0x7fe6a800a060 comp rx=0 tx=0).stop 2024-09-17T03:13:26.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.091+0000 7fe6bfd6e640 1 -- 172.21.15.78:0/3466681113 shutdown_connections 2024-09-17T03:13:26.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.091+0000 7fe6bfd6e640 1 --2- 172.21.15.78:0/3466681113 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe6a4078b90 0x7fe6a407b0a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:26.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.091+0000 7fe6bfd6e640 1 --2- 172.21.15.78:0/3466681113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe6b81f8f90 0x7fe6b81f93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:26.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.091+0000 7fe6bfd6e640 1 --2- 172.21.15.78:0/3466681113 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe6b80d18f0 0x7fe6b8151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:26.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.091+0000 7fe6bfd6e640 1 --2- 172.21.15.78:0/3466681113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe6b80b96c0 0x7fe6b8154760 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:26.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.091+0000 7fe6bfd6e640 1 -- 172.21.15.78:0/3466681113 >> 172.21.15.78:0/3466681113 conn(0x7fe6b809d8a0 msgr2=0x7fe6b80cf150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:26.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.091+0000 7fe6bfd6e640 1 -- 172.21.15.78:0/3466681113 shutdown_connections 2024-09-17T03:13:26.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.091+0000 7fe6bfd6e640 1 -- 172.21.15.78:0/3466681113 wait complete. 2024-09-17T03:13:26.103 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:13:26.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.222+0000 7fbde040a640 1 -- 172.21.15.78:0/257556479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdc4004800 msgr2=0x7fbdc4004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:26.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.222+0000 7fbde040a640 1 --2- 172.21.15.78:0/257556479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdc4004800 0x7fbdc4004c10 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fbdc8001660 tx=0x7fbdc4005830 comp rx=0 tx=0).stop 2024-09-17T03:13:26.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.222+0000 7fbdde9a7640 1 -- 172.21.15.78:0/257556479 reap_dead start 2024-09-17T03:13:26.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.222+0000 7fbde040a640 1 -- 172.21.15.78:0/257556479 shutdown_connections 2024-09-17T03:13:26.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.222+0000 7fbde040a640 1 -- 172.21.15.78:0/257556479 >> 172.21.15.78:0/257556479 conn(0x7fbdd80d1370 msgr2=0x7fbdd8073760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:26.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.222+0000 7fbde040a640 1 -- 172.21.15.78:0/257556479 shutdown_connections 2024-09-17T03:13:26.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.222+0000 7fbde040a640 1 -- 172.21.15.78:0/257556479 wait complete. 2024-09-17T03:13:26.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.224+0000 7fbde040a640 1 Processor -- start 2024-09-17T03:13:26.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.224+0000 7fbde040a640 1 -- start start 2024-09-17T03:13:26.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.225+0000 7fbde040a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbdc4004800 0x7fbdd815d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:26.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.225+0000 7fbde040a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbdd813da20 0x7fbdd815a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:26.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.225+0000 7fbde040a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdd8142c40 0x7fbdd8143050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:26.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.225+0000 7fbde040a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd80b4280 con 0x7fbdd8142c40 2024-09-17T03:13:26.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.225+0000 7fbde040a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd80b4100 con 0x7fbdc4004800 2024-09-17T03:13:26.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.225+0000 7fbde040a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd8075cf0 con 0x7fbdd813da20 2024-09-17T03:13:26.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.225+0000 7fbdde9a7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdd8142c40 0x7fbdd8143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:26.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.225+0000 7fbdde9a7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdd8142c40 0x7fbdd8143050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:34704/0 (socket says 172.21.15.78:34704) 2024-09-17T03:13:26.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.225+0000 7fbdde9a7640 1 -- 172.21.15.78:0/3871755863 learned_addr learned my addr 172.21.15.78:0/3871755863 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:26.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.226+0000 7fbddd9a5640 1 --2- 172.21.15.78:0/3871755863 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbdd813da20 0x7fbdd815a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:26.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.226+0000 7fbdde1a6640 1 --2- 172.21.15.78:0/3871755863 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbdc4004800 0x7fbdd815d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:26.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.226+0000 7fbdde9a7640 1 -- 172.21.15.78:0/3871755863 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbdd813da20 msgr2=0x7fbdd815a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:26.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.226+0000 7fbdde9a7640 1 --2- 172.21.15.78:0/3871755863 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbdd813da20 0x7fbdd815a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:26.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.226+0000 7fbdde9a7640 1 -- 172.21.15.78:0/3871755863 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbdc4004800 msgr2=0x7fbdd815d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:26.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.226+0000 7fbdde9a7640 1 --2- 172.21.15.78:0/3871755863 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbdc4004800 0x7fbdd815d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:26.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.226+0000 7fbdde9a7640 1 -- 172.21.15.78:0/3871755863 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd8143590 con 0x7fbdd8142c40 2024-09-17T03:13:26.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.226+0000 7fbddd9a5640 1 --2- 172.21.15.78:0/3871755863 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbdd813da20 0x7fbdd815a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:26.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.226+0000 7fbdde9a7640 1 --2- 172.21.15.78:0/3871755863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdd8142c40 0x7fbdd8143050 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80b4c60 tx=0x7fbdd000fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:26.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.226+0000 7fbdceffd640 1 -- 172.21.15.78:0/3871755863 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0003d80 con 0x7fbdd8142c40 2024-09-17T03:13:26.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.226+0000 7fbdceffd640 1 -- 172.21.15.78:0/3871755863 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdd0004b20 con 0x7fbdd8142c40 2024-09-17T03:13:26.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.226+0000 7fbde040a640 1 -- 172.21.15.78:0/3871755863 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd815df80 con 0x7fbdd8142c40 2024-09-17T03:13:26.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.226+0000 7fbdceffd640 1 -- 172.21.15.78:0/3871755863 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd000d810 con 0x7fbdd8142c40 2024-09-17T03:13:26.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.226+0000 7fbde040a640 1 -- 172.21.15.78:0/3871755863 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd81f1af0 con 0x7fbdd8142c40 2024-09-17T03:13:26.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.227+0000 7fbde040a640 1 -- 172.21.15.78:0/3871755863 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdd815dcf0 con 0x7fbdd8142c40 2024-09-17T03:13:26.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.228+0000 7fbdceffd640 1 -- 172.21.15.78:0/3871755863 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbdd000d9b0 con 0x7fbdd8142c40 2024-09-17T03:13:26.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.228+0000 7fbdceffd640 1 --2- 172.21.15.78:0/3871755863 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbdbc078b90 0x7fbdbc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:26.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.229+0000 7fbdceffd640 1 -- 172.21.15.78:0/3871755863 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 5587+0+0 (secure 0 0 0) 0x7fbdd009b140 con 0x7fbdd8142c40 2024-09-17T03:13:26.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.229+0000 7fbdde1a6640 1 --2- 172.21.15.78:0/3871755863 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbdbc078b90 0x7fbdbc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:26.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.229+0000 7fbdde1a6640 1 --2- 172.21.15.78:0/3871755863 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbdbc078b90 0x7fbdbc07b0a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4001860 tx=0x7fbdd4001110 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:26.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.233+0000 7fbdceffd640 1 -- 172.21.15.78:0/3871755863 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbdd001d060 con 0x7fbdd8142c40 2024-09-17T03:13:26.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:26.407+0000 7fbde040a640 1 -- 172.21.15.78:0/3871755863 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbdd81441b0 con 0x7fbdd8142c40 2024-09-17T03:13:27.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.090+0000 7fbdceffd640 1 -- 172.21.15.78:0/3871755863 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v74) ==== 169+0+0 (secure 0 0 0) 0x7fbdd81441b0 con 0x7fbdd8142c40 2024-09-17T03:13:27.089 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2024-09-17T03:13:27.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.093+0000 7fbde040a640 1 -- 172.21.15.78:0/3871755863 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbdbc078b90 msgr2=0x7fbdbc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.093+0000 7fbde040a640 1 --2- 172.21.15.78:0/3871755863 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbdbc078b90 0x7fbdbc07b0a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4001860 tx=0x7fbdd4001110 comp rx=0 tx=0).stop 2024-09-17T03:13:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.093+0000 7fbde040a640 1 -- 172.21.15.78:0/3871755863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdd8142c40 msgr2=0x7fbdd8143050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.093+0000 7fbde040a640 1 --2- 172.21.15.78:0/3871755863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdd8142c40 0x7fbdd8143050 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fbdd80b4c60 tx=0x7fbdd000fc00 comp rx=0 tx=0).stop 2024-09-17T03:13:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.093+0000 7fbde040a640 1 -- 172.21.15.78:0/3871755863 shutdown_connections 2024-09-17T03:13:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.093+0000 7fbde040a640 1 --2- 172.21.15.78:0/3871755863 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbdd8142c40 0x7fbdd8143050 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.093+0000 7fbde040a640 1 --2- 172.21.15.78:0/3871755863 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbdd813da20 0x7fbdd815a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.093+0000 7fbde040a640 1 --2- 172.21.15.78:0/3871755863 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbdbc078b90 0x7fbdbc07b0a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.093+0000 7fbde040a640 1 --2- 172.21.15.78:0/3871755863 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbdc4004800 0x7fbdd815d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.093+0000 7fbde040a640 1 -- 172.21.15.78:0/3871755863 >> 172.21.15.78:0/3871755863 conn(0x7fbdd80d1370 msgr2=0x7fbdd80cfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.093+0000 7fbde040a640 1 -- 172.21.15.78:0/3871755863 shutdown_connections 2024-09-17T03:13:27.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.093+0000 7fbde040a640 1 -- 172.21.15.78:0/3871755863 wait complete. 2024-09-17T03:13:27.105 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:13:27.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.221+0000 7f7780f43640 1 -- 172.21.15.78:0/2276094207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f777c0b9b70 msgr2=0x7f777c0cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:27.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.221+0000 7f7780f43640 1 --2- 172.21.15.78:0/2276094207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f777c0b9b70 0x7f777c0cf090 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f777c08d4e0 tx=0x7f776402a530 comp rx=0 tx=0).stop 2024-09-17T03:13:27.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.221+0000 7f7780f43640 1 -- 172.21.15.78:0/2276094207 shutdown_connections 2024-09-17T03:13:27.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.221+0000 7f7780f43640 1 --2- 172.21.15.78:0/2276094207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f777c0b9b70 0x7f777c0cf090 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.221+0000 7f7780f43640 1 --2- 172.21.15.78:0/2276094207 >> v2:172.21.15.193:3300/0 conn(0x7f777c0d2ed0 0x7f777c0d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.221+0000 7f7780f43640 1 -- 172.21.15.78:0/2276094207 >> 172.21.15.78:0/2276094207 conn(0x7f777c08bfc0 msgr2=0x7f777c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:27.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.221+0000 7f7780f43640 1 -- 172.21.15.78:0/2276094207 shutdown_connections 2024-09-17T03:13:27.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.221+0000 7f7780f43640 1 -- 172.21.15.78:0/2276094207 wait complete. 2024-09-17T03:13:27.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.223+0000 7f7780f43640 1 Processor -- start 2024-09-17T03:13:27.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.223+0000 7f7780f43640 1 -- start start 2024-09-17T03:13:27.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.224+0000 7f7780f43640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f777c0b9b70 0x7f777c154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:27.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.224+0000 7f7780f43640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f777c0cf5d0 0x7f777c09e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:27.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.224+0000 7f7780f43640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f777c0d2ed0 0x7f777c0cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:27.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.224+0000 7f7780f43640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f777c0cfe50 con 0x7f777c0cf5d0 2024-09-17T03:13:27.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.224+0000 7f7780f43640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f777c0cfcd0 con 0x7f777c0d2ed0 2024-09-17T03:13:27.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.224+0000 7f7780f43640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f777c0d4940 con 0x7f777c0b9b70 2024-09-17T03:13:27.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.224+0000 7f7771d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f777c0cf5d0 0x7f777c09e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:27.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.224+0000 7f7771d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f777c0cf5d0 0x7f777c09e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50004/0 (socket says 172.21.15.78:50004) 2024-09-17T03:13:27.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.224+0000 7f7771d9b640 1 -- 172.21.15.78:0/676081774 learned_addr learned my addr 172.21.15.78:0/676081774 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:27.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.225+0000 7f777ad9d640 1 --2- 172.21.15.78:0/676081774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f777c0d2ed0 0x7f777c0cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:27.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.225+0000 7f777a59c640 1 --2- 172.21.15.78:0/676081774 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f777c0b9b70 0x7f777c154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:27.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.225+0000 7f7771d9b640 1 -- 172.21.15.78:0/676081774 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f777c0b9b70 msgr2=0x7f777c154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:27.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.225+0000 7f7771d9b640 1 --2- 172.21.15.78:0/676081774 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f777c0b9b70 0x7f777c154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.225+0000 7f7771d9b640 1 -- 172.21.15.78:0/676081774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f777c0d2ed0 msgr2=0x7f777c0cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:27.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.225+0000 7f7771d9b640 1 --2- 172.21.15.78:0/676081774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f777c0d2ed0 0x7f777c0cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.225+0000 7f7771d9b640 1 -- 172.21.15.78:0/676081774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777c0a0dd0 con 0x7f777c0cf5d0 2024-09-17T03:13:27.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.225+0000 7f7771d9b640 1 --2- 172.21.15.78:0/676081774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f777c0cf5d0 0x7f777c09e270 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f7764009920 tx=0x7f7764033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:27.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.225+0000 7f77737fe640 1 -- 172.21.15.78:0/676081774 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7764031d60 con 0x7f777c0cf5d0 2024-09-17T03:13:27.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.225+0000 7f77737fe640 1 -- 172.21.15.78:0/676081774 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7764005020 con 0x7f777c0cf5d0 2024-09-17T03:13:27.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.225+0000 7f7780f43640 1 -- 172.21.15.78:0/676081774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f777c0a10b0 con 0x7f777c0cf5d0 2024-09-17T03:13:27.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.225+0000 7f77737fe640 1 -- 172.21.15.78:0/676081774 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7764005470 con 0x7f777c0cf5d0 2024-09-17T03:13:27.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.225+0000 7f7780f43640 1 -- 172.21.15.78:0/676081774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f777c0a1670 con 0x7f777c0cf5d0 2024-09-17T03:13:27.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.226+0000 7f7780f43640 1 -- 172.21.15.78:0/676081774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f777c0d4ed0 con 0x7f777c0cf5d0 2024-09-17T03:13:27.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.227+0000 7f77737fe640 1 -- 172.21.15.78:0/676081774 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f77640047a0 con 0x7f777c0cf5d0 2024-09-17T03:13:27.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.228+0000 7f77737fe640 1 --2- 172.21.15.78:0/676081774 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f775c078b90 0x7f775c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:27.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.228+0000 7f77737fe640 1 -- 172.21.15.78:0/676081774 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7f77640bbd50 con 0x7f777c0cf5d0 2024-09-17T03:13:27.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.228+0000 7f777a59c640 1 --2- 172.21.15.78:0/676081774 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f775c078b90 0x7f775c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:27.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.228+0000 7f777a59c640 1 --2- 172.21.15.78:0/676081774 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f775c078b90 0x7f775c07b0a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f776c006fd0 tx=0x7f776c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:27.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.232+0000 7f77737fe640 1 -- 172.21.15.78:0/676081774 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f77640bf030 con 0x7f777c0cf5d0 2024-09-17T03:13:27.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.414+0000 7f7780f43640 1 -- 172.21.15.78:0/676081774 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f777c069550 con 0x7f777c0cf5d0 2024-09-17T03:13:27.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.418+0000 7f77737fe640 1 -- 172.21.15.78:0/676081774 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v39) ==== 71+0+0 (secure 0 0 0) 0x7f776403f030 con 0x7f777c0cf5d0 2024-09-17T03:13:27.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.420+0000 7f7780f43640 1 -- 172.21.15.78:0/676081774 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f775c078b90 msgr2=0x7f775c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:27.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.420+0000 7f7780f43640 1 --2- 172.21.15.78:0/676081774 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f775c078b90 0x7f775c07b0a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f776c006fd0 tx=0x7f776c008040 comp rx=0 tx=0).stop 2024-09-17T03:13:27.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.420+0000 7f7780f43640 1 -- 172.21.15.78:0/676081774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f777c0cf5d0 msgr2=0x7f777c09e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:27.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.420+0000 7f7780f43640 1 --2- 172.21.15.78:0/676081774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f777c0cf5d0 0x7f777c09e270 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f7764009920 tx=0x7f7764033d60 comp rx=0 tx=0).stop 2024-09-17T03:13:27.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.420+0000 7f7780f43640 1 -- 172.21.15.78:0/676081774 shutdown_connections 2024-09-17T03:13:27.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.420+0000 7f7780f43640 1 --2- 172.21.15.78:0/676081774 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f775c078b90 0x7f775c07b0a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.420+0000 7f7780f43640 1 --2- 172.21.15.78:0/676081774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f777c0d2ed0 0x7f777c0cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.420+0000 7f7780f43640 1 --2- 172.21.15.78:0/676081774 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f777c0cf5d0 0x7f777c09e270 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.420+0000 7f7780f43640 1 --2- 172.21.15.78:0/676081774 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f777c0b9b70 0x7f777c154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.420+0000 7f7780f43640 1 -- 172.21.15.78:0/676081774 >> 172.21.15.78:0/676081774 conn(0x7f777c08bfc0 msgr2=0x7f777c06e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:27.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.420+0000 7f7780f43640 1 -- 172.21.15.78:0/676081774 shutdown_connections 2024-09-17T03:13:27.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.420+0000 7f7780f43640 1 -- 172.21.15.78:0/676081774 wait complete. 2024-09-17T03:13:27.430 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0' 2024-09-17T03:13:27.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.543+0000 7ff90604a640 1 -- 172.21.15.78:0/2545772036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e8003a50 msgr2=0x7ff8e8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:27.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.543+0000 7ff90604a640 1 --2- 172.21.15.78:0/2545772036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e8003a50 0x7ff8e8003ec0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000bbb0 tx=0x7ff8e8005830 comp rx=0 tx=0).stop 2024-09-17T03:13:27.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.543+0000 7ff90604a640 1 -- 172.21.15.78:0/2545772036 shutdown_connections 2024-09-17T03:13:27.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.543+0000 7ff90604a640 1 --2- 172.21.15.78:0/2545772036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff8e8003a50 0x7ff8e8003ec0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.543+0000 7ff90604a640 1 -- 172.21.15.78:0/2545772036 >> 172.21.15.78:0/2545772036 conn(0x7ff90006d4f0 msgr2=0x7ff900071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:27.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.543+0000 7ff90604a640 1 -- 172.21.15.78:0/2545772036 shutdown_connections 2024-09-17T03:13:27.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.543+0000 7ff90604a640 1 -- 172.21.15.78:0/2545772036 wait complete. 2024-09-17T03:13:27.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.544+0000 7ff90604a640 1 Processor -- start 2024-09-17T03:13:27.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.545+0000 7ff90604a640 1 -- start start 2024-09-17T03:13:27.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.546+0000 7ff90604a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff8e8003a50 0x7ff9000ca000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:27.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.546+0000 7ff90604a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9000caf20 0x7ff9001f3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:27.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.546+0000 7ff90604a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9000cb330 0x7ff9000a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:27.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.546+0000 7ff90604a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff9000cec10 con 0x7ff9000caf20 2024-09-17T03:13:27.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.546+0000 7ff90604a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff9000ccfe0 con 0x7ff9000cb330 2024-09-17T03:13:27.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.546+0000 7ff90604a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff9000ced90 con 0x7ff8e8003a50 2024-09-17T03:13:27.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.546+0000 7ff8feffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9000caf20 0x7ff9001f3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:27.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.546+0000 7ff8feffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9000caf20 0x7ff9001f3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50028/0 (socket says 172.21.15.78:50028) 2024-09-17T03:13:27.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.546+0000 7ff8feffd640 1 -- 172.21.15.78:0/4216055430 learned_addr learned my addr 172.21.15.78:0/4216055430 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:27.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.546+0000 7ff8ff7fe640 1 --2- 172.21.15.78:0/4216055430 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff8e8003a50 0x7ff9000ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:27.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.546+0000 7ff8fffff640 1 --2- 172.21.15.78:0/4216055430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9000cb330 0x7ff9000a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:27.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.546+0000 7ff8feffd640 1 -- 172.21.15.78:0/4216055430 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff8e8003a50 msgr2=0x7ff9000ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:27.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.546+0000 7ff8feffd640 1 --2- 172.21.15.78:0/4216055430 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff8e8003a50 0x7ff9000ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.546+0000 7ff8feffd640 1 -- 172.21.15.78:0/4216055430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9000cb330 msgr2=0x7ff9000a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:27.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.546+0000 7ff8feffd640 1 --2- 172.21.15.78:0/4216055430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9000cb330 0x7ff9000a94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:27.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.546+0000 7ff8feffd640 1 -- 172.21.15.78:0/4216055430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9000cb9c0 con 0x7ff9000caf20 2024-09-17T03:13:27.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.546+0000 7ff8ff7fe640 1 --2- 172.21.15.78:0/4216055430 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff8e8003a50 0x7ff9000ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:27.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.546+0000 7ff8feffd640 1 --2- 172.21.15.78:0/4216055430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9000caf20 0x7ff9001f3da0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4004eb0 tx=0x7ff8f4001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:27.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.547+0000 7ff8e7fff640 1 -- 172.21.15.78:0/4216055430 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4015020 con 0x7ff9000caf20 2024-09-17T03:13:27.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.547+0000 7ff8e7fff640 1 -- 172.21.15.78:0/4216055430 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8f4011960 con 0x7ff9000caf20 2024-09-17T03:13:27.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.547+0000 7ff90604a640 1 -- 172.21.15.78:0/4216055430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9000c9520 con 0x7ff9000caf20 2024-09-17T03:13:27.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.547+0000 7ff8e7fff640 1 -- 172.21.15.78:0/4216055430 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4011d90 con 0x7ff9000caf20 2024-09-17T03:13:27.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.547+0000 7ff90604a640 1 -- 172.21.15.78:0/4216055430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9000a9f70 con 0x7ff9000caf20 2024-09-17T03:13:27.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.548+0000 7ff90604a640 1 -- 172.21.15.78:0/4216055430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9000b3d50 con 0x7ff9000caf20 2024-09-17T03:13:27.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.548+0000 7ff8e7fff640 1 -- 172.21.15.78:0/4216055430 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff8f4018020 con 0x7ff9000caf20 2024-09-17T03:13:27.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.549+0000 7ff8e7fff640 1 --2- 172.21.15.78:0/4216055430 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff8ec078b90 0x7ff8ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:27.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.549+0000 7ff8e7fff640 1 -- 172.21.15.78:0/4216055430 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7ff8f409b540 con 0x7ff9000caf20 2024-09-17T03:13:27.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.549+0000 7ff8ff7fe640 1 --2- 172.21.15.78:0/4216055430 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff8ec078b90 0x7ff8ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:27.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.550+0000 7ff8ff7fe640 1 --2- 172.21.15.78:0/4216055430 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff8ec078b90 0x7ff8ec07b0a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0036000 tx=0x7ff8f00046c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:27.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.553+0000 7ff8e7fff640 1 -- 172.21.15.78:0/4216055430 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ff8f401f020 con 0x7ff9000caf20 2024-09-17T03:13:27.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:27.793+0000 7ff90604a640 1 -- 172.21.15.78:0/4216055430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0"]} v 0) -- 0x7ff9000cb750 con 0x7ff9000caf20 2024-09-17T03:13:28.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.095+0000 7ff8e7fff640 1 -- 172.21.15.78:0/4216055430 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_non_mds0"]}]=0 v256) ==== 141+0+0 (secure 0 0 0) 0x7ff8f4063c60 con 0x7ff9000caf20 2024-09-17T03:13:28.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.098+0000 7ff90604a640 1 -- 172.21.15.78:0/4216055430 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff8ec078b90 msgr2=0x7ff8ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:28.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.098+0000 7ff90604a640 1 --2- 172.21.15.78:0/4216055430 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff8ec078b90 0x7ff8ec07b0a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0036000 tx=0x7ff8f00046c0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.098+0000 7ff90604a640 1 -- 172.21.15.78:0/4216055430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9000caf20 msgr2=0x7ff9001f3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:28.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.098+0000 7ff90604a640 1 --2- 172.21.15.78:0/4216055430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9000caf20 0x7ff9001f3da0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4004eb0 tx=0x7ff8f4001630 comp rx=0 tx=0).stop 2024-09-17T03:13:28.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.098+0000 7ff90604a640 1 -- 172.21.15.78:0/4216055430 shutdown_connections 2024-09-17T03:13:28.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.098+0000 7ff90604a640 1 --2- 172.21.15.78:0/4216055430 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff8ec078b90 0x7ff8ec07b0a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.098+0000 7ff90604a640 1 --2- 172.21.15.78:0/4216055430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9000cb330 0x7ff9000a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.098+0000 7ff90604a640 1 --2- 172.21.15.78:0/4216055430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9000caf20 0x7ff9001f3da0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.098+0000 7ff90604a640 1 --2- 172.21.15.78:0/4216055430 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff8e8003a50 0x7ff9000ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.098+0000 7ff90604a640 1 -- 172.21.15.78:0/4216055430 >> 172.21.15.78:0/4216055430 conn(0x7ff90006d4f0 msgr2=0x7ff9000b5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:28.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.098+0000 7ff90604a640 1 -- 172.21.15.78:0/4216055430 shutdown_connections 2024-09-17T03:13:28.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.098+0000 7ff90604a640 1 -- 172.21.15.78:0/4216055430 wait complete. 2024-09-17T03:13:28.109 INFO:tasks.cephfs_test_runner:test_scrub_non_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2024-09-17T03:13:28.109 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) 2024-09-17T03:13:28.110 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:13:28.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.223+0000 7fe046e27640 1 -- 172.21.15.78:0/1833862287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0401600b0 msgr2=0x7fe0400ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:28.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.223+0000 7fe046e27640 1 --2- 172.21.15.78:0/1833862287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0401600b0 0x7fe0400ccbc0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fe03c005fd0 tx=0x7fe03c02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.223+0000 7fe046e27640 1 -- 172.21.15.78:0/1833862287 shutdown_connections 2024-09-17T03:13:28.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.223+0000 7fe046e27640 1 --2- 172.21.15.78:0/1833862287 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0400b7cc0 0x7fe0400cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.223+0000 7fe046e27640 1 --2- 172.21.15.78:0/1833862287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0401600b0 0x7fe0400ccbc0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.223+0000 7fe046e27640 1 -- 172.21.15.78:0/1833862287 >> 172.21.15.78:0/1833862287 conn(0x7fe04006d4f0 msgr2=0x7fe040071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:28.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.223+0000 7fe046e27640 1 -- 172.21.15.78:0/1833862287 shutdown_connections 2024-09-17T03:13:28.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.223+0000 7fe046e27640 1 -- 172.21.15.78:0/1833862287 wait complete. 2024-09-17T03:13:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.225+0000 7fe046e27640 1 Processor -- start 2024-09-17T03:13:28.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.225+0000 7fe046e27640 1 -- start start 2024-09-17T03:13:28.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.226+0000 7fe046e27640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0400b7cc0 0x7fe04014a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:28.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.226+0000 7fe046e27640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0400cf150 0x7fe0400b5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:28.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe046e27640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0401600b0 0x7fe0400b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:28.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe046e27640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe0400b4460 con 0x7fe0400b7cc0 2024-09-17T03:13:28.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe046e27640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe0400d1ba0 con 0x7fe0401600b0 2024-09-17T03:13:28.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe046e27640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe0400b45e0 con 0x7fe0400cf150 2024-09-17T03:13:28.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe044bc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0400b7cc0 0x7fe04014a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:28.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe044bc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0400b7cc0 0x7fe04014a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50046/0 (socket says 172.21.15.78:50046) 2024-09-17T03:13:28.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe044bc3640 1 -- 172.21.15.78:0/4167660696 learned_addr learned my addr 172.21.15.78:0/4167660696 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:28.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe037fff640 1 --2- 172.21.15.78:0/4167660696 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0400cf150 0x7fe0400b5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:28.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe0453c4640 1 --2- 172.21.15.78:0/4167660696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0401600b0 0x7fe0400b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:28.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe044bc3640 1 -- 172.21.15.78:0/4167660696 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0400cf150 msgr2=0x7fe0400b5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:28.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe044bc3640 1 --2- 172.21.15.78:0/4167660696 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0400cf150 0x7fe0400b5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe044bc3640 1 -- 172.21.15.78:0/4167660696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0401600b0 msgr2=0x7fe0400b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:28.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe044bc3640 1 --2- 172.21.15.78:0/4167660696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0401600b0 0x7fe0400b5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe044bc3640 1 -- 172.21.15.78:0/4167660696 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe040155800 con 0x7fe0400b7cc0 2024-09-17T03:13:28.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe0453c4640 1 --2- 172.21.15.78:0/4167660696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0401600b0 0x7fe0400b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:28.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe037fff640 1 --2- 172.21.15.78:0/4167660696 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0400cf150 0x7fe0400b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:28.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe044bc3640 1 --2- 172.21.15.78:0/4167660696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0400b7cc0 0x7fe04014a760 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009cd0 tx=0x7fe03c0316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:28.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe0357fa640 1 -- 172.21.15.78:0/4167660696 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03c031990 con 0x7fe0400b7cc0 2024-09-17T03:13:28.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe0357fa640 1 -- 172.21.15.78:0/4167660696 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe03c031c20 con 0x7fe0400b7cc0 2024-09-17T03:13:28.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe046e27640 1 -- 172.21.15.78:0/4167660696 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe040155ae0 con 0x7fe0400b7cc0 2024-09-17T03:13:28.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe0357fa640 1 -- 172.21.15.78:0/4167660696 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03c0332d0 con 0x7fe0400b7cc0 2024-09-17T03:13:28.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.227+0000 7fe046e27640 1 -- 172.21.15.78:0/4167660696 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0401560a0 con 0x7fe0400b7cc0 2024-09-17T03:13:28.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.228+0000 7fe046e27640 1 -- 172.21.15.78:0/4167660696 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0400cec10 con 0x7fe0400b7cc0 2024-09-17T03:13:28.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.229+0000 7fe0357fa640 1 -- 172.21.15.78:0/4167660696 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe03c033470 con 0x7fe0400b7cc0 2024-09-17T03:13:28.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.230+0000 7fe0357fa640 1 --2- 172.21.15.78:0/4167660696 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe02c078bc0 0x7fe02c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:28.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.230+0000 7fe0357fa640 1 -- 172.21.15.78:0/4167660696 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7fe03c0bc070 con 0x7fe0400b7cc0 2024-09-17T03:13:28.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.230+0000 7fe037fff640 1 --2- 172.21.15.78:0/4167660696 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe02c078bc0 0x7fe02c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:28.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.231+0000 7fe037fff640 1 --2- 172.21.15.78:0/4167660696 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe02c078bc0 0x7fe02c07b0d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe0400b7410 tx=0x7fe030005f10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:28.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.234+0000 7fe0357fa640 1 -- 172.21.15.78:0/4167660696 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe03c03f030 con 0x7fe0400b7cc0 2024-09-17T03:13:28.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.409+0000 7fe046e27640 1 -- 172.21.15.78:0/4167660696 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0400d2ac0 con 0x7fe0400b7cc0 2024-09-17T03:13:28.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.410+0000 7fe0357fa640 1 -- 172.21.15.78:0/4167660696 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) ==== 74+0+13271 (secure 0 0 0) 0x7fe03c084700 con 0x7fe0400b7cc0 2024-09-17T03:13:28.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:28.409 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":74,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:13:27.089769+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.193:6837/1431701139":"2024-09-18T03:13:24.077741+0000","172.21.15.193:6835/1431701139":"2024-09-18T03:13:24.077741+0000","172.21.15.78:6834/2905189397":"2024-09-18T03:13:24.077758+0000","172.21.15.78:6832/2905189397":"2024-09-18T03:13:24.077758+0000","172.21.15.78:6835/2058899730":"2024-09-18T03:13:24.077763+0000","172.21.15.78:6833/2058899730":"2024-09-18T03:13:24.077763+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:13:28.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.412+0000 7fe046e27640 1 -- 172.21.15.78:0/4167660696 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe02c078bc0 msgr2=0x7fe02c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:28.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.412+0000 7fe046e27640 1 --2- 172.21.15.78:0/4167660696 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe02c078bc0 0x7fe02c07b0d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe0400b7410 tx=0x7fe030005f10 comp rx=0 tx=0).stop 2024-09-17T03:13:28.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.412+0000 7fe046e27640 1 -- 172.21.15.78:0/4167660696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0400b7cc0 msgr2=0x7fe04014a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:28.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.412+0000 7fe046e27640 1 --2- 172.21.15.78:0/4167660696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0400b7cc0 0x7fe04014a760 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009cd0 tx=0x7fe03c0316f0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.412+0000 7fe046e27640 1 -- 172.21.15.78:0/4167660696 shutdown_connections 2024-09-17T03:13:28.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.412+0000 7fe046e27640 1 --2- 172.21.15.78:0/4167660696 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe02c078bc0 0x7fe02c07b0d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.412+0000 7fe046e27640 1 --2- 172.21.15.78:0/4167660696 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0401600b0 0x7fe0400b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.412+0000 7fe046e27640 1 --2- 172.21.15.78:0/4167660696 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0400cf150 0x7fe0400b5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.412+0000 7fe046e27640 1 --2- 172.21.15.78:0/4167660696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0400b7cc0 0x7fe04014a760 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.412+0000 7fe046e27640 1 -- 172.21.15.78:0/4167660696 >> 172.21.15.78:0/4167660696 conn(0x7fe04006d4f0 msgr2=0x7fe04015e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:28.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.412+0000 7fe046e27640 1 -- 172.21.15.78:0/4167660696 shutdown_connections 2024-09-17T03:13:28.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.412+0000 7fe046e27640 1 -- 172.21.15.78:0/4167660696 wait complete. 2024-09-17T03:13:28.422 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:08:17.135915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:13:28.423 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:13:28.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.539+0000 7f7cf17e4640 1 -- 172.21.15.78:0/3728653511 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7cec0d1a80 msgr2=0x7f7cec0cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:28.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.539+0000 7f7cf17e4640 1 --2- 172.21.15.78:0/3728653511 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7cec0d1a80 0x7f7cec0cf090 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0005fd0 tx=0x7f7ce002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.539+0000 7f7cf17e4640 1 -- 172.21.15.78:0/3728653511 shutdown_connections 2024-09-17T03:13:28.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.539+0000 7f7cf17e4640 1 --2- 172.21.15.78:0/3728653511 >> v2:172.21.15.193:3300/0 conn(0x7f7cec0cf5d0 0x7f7cec0cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.539+0000 7f7cf17e4640 1 --2- 172.21.15.78:0/3728653511 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7cec0d1a80 0x7f7cec0cf090 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.539+0000 7f7cf17e4640 1 -- 172.21.15.78:0/3728653511 >> 172.21.15.78:0/3728653511 conn(0x7f7cec08bfc0 msgr2=0x7f7cec09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:28.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.539+0000 7f7cf17e4640 1 -- 172.21.15.78:0/3728653511 shutdown_connections 2024-09-17T03:13:28.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.539+0000 7f7cf17e4640 1 -- 172.21.15.78:0/3728653511 wait complete. 2024-09-17T03:13:28.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.541+0000 7f7cf17e4640 1 Processor -- start 2024-09-17T03:13:28.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.541+0000 7f7cf17e4640 1 -- start start 2024-09-17T03:13:28.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.542+0000 7f7cf17e4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cec0cf5d0 0x7f7cec0b8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:28.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.542+0000 7f7cf17e4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7cec0d1a80 0x7f7cec15ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:28.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.542+0000 7f7cf17e4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7cec0d2ed0 0x7f7cec15e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:28.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.542+0000 7f7cf17e4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7cec162cb0 con 0x7f7cec0cf5d0 2024-09-17T03:13:28.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.542+0000 7f7cf17e4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7cec162b30 con 0x7f7cec0d1a80 2024-09-17T03:13:28.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.542+0000 7f7cf17e4640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7cec162e30 con 0x7f7cec0d2ed0 2024-09-17T03:13:28.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.542+0000 7f7ceaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cec0cf5d0 0x7f7cec0b8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:28.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.543+0000 7f7ceaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cec0cf5d0 0x7f7cec0b8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50050/0 (socket says 172.21.15.78:50050) 2024-09-17T03:13:28.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.543+0000 7f7ceaffd640 1 -- 172.21.15.78:0/3147208161 learned_addr learned my addr 172.21.15.78:0/3147208161 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:28.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.543+0000 7f7ceb7fe640 1 --2- 172.21.15.78:0/3147208161 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7cec0d2ed0 0x7f7cec15e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:28.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.543+0000 7f7cea7fc640 1 --2- 172.21.15.78:0/3147208161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7cec0d1a80 0x7f7cec15ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:28.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.543+0000 7f7ceaffd640 1 -- 172.21.15.78:0/3147208161 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7cec0d2ed0 msgr2=0x7f7cec15e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:28.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.543+0000 7f7ceaffd640 1 --2- 172.21.15.78:0/3147208161 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7cec0d2ed0 0x7f7cec15e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.543+0000 7f7ceaffd640 1 -- 172.21.15.78:0/3147208161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7cec0d1a80 msgr2=0x7f7cec15ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:28.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.543+0000 7f7ceaffd640 1 --2- 172.21.15.78:0/3147208161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7cec0d1a80 0x7f7cec15ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.543+0000 7f7ceaffd640 1 -- 172.21.15.78:0/3147208161 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cec0c9af0 con 0x7f7cec0cf5d0 2024-09-17T03:13:28.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.543+0000 7f7ceaffd640 1 --2- 172.21.15.78:0/3147208161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cec0cf5d0 0x7f7cec0b8640 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc00c430 tx=0x7f7cdc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:28.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.543+0000 7f7cd37fe640 1 -- 172.21.15.78:0/3147208161 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc017070 con 0x7f7cec0cf5d0 2024-09-17T03:13:28.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.543+0000 7f7cf17e4640 1 -- 172.21.15.78:0/3147208161 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cec0ce1e0 con 0x7f7cec0cf5d0 2024-09-17T03:13:28.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.543+0000 7f7cd37fe640 1 -- 172.21.15.78:0/3147208161 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7cdc0053e0 con 0x7f7cec0cf5d0 2024-09-17T03:13:28.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.543+0000 7f7cd37fe640 1 -- 172.21.15.78:0/3147208161 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc0038a0 con 0x7f7cec0cf5d0 2024-09-17T03:13:28.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.543+0000 7f7cf17e4640 1 -- 172.21.15.78:0/3147208161 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cec0c9d60 con 0x7f7cec0cf5d0 2024-09-17T03:13:28.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.544+0000 7f7cf17e4640 1 -- 172.21.15.78:0/3147208161 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cec1633c0 con 0x7f7cec0cf5d0 2024-09-17T03:13:28.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.545+0000 7f7cd37fe640 1 -- 172.21.15.78:0/3147208161 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7cdc01a070 con 0x7f7cec0cf5d0 2024-09-17T03:13:28.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.546+0000 7f7cd37fe640 1 --2- 172.21.15.78:0/3147208161 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7cd8078bc0 0x7f7cd807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:28.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.546+0000 7f7cd37fe640 1 -- 172.21.15.78:0/3147208161 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7f7cdc099db0 con 0x7f7cec0cf5d0 2024-09-17T03:13:28.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.546+0000 7f7cea7fc640 1 --2- 172.21.15.78:0/3147208161 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7cd8078bc0 0x7f7cd807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:28.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.546+0000 7f7cea7fc640 1 --2- 172.21.15.78:0/3147208161 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7cd8078bc0 0x7f7cd807b0d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0033000 tx=0x7f7ce0004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:28.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.550+0000 7f7cd37fe640 1 -- 172.21.15.78:0/3147208161 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7cdc061e00 con 0x7f7cec0cf5d0 2024-09-17T03:13:28.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.722+0000 7f7cf17e4640 1 -- 172.21.15.78:0/3147208161 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7cec15f310 con 0x7f7cec0cf5d0 2024-09-17T03:13:28.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.722+0000 7f7cd37fe640 1 -- 172.21.15.78:0/3147208161 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) ==== 93+0+10 (secure 0 0 0) 0x7f7cdc066830 con 0x7f7cec0cf5d0 2024-09-17T03:13:28.721 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-09-17T03:13:28.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.724+0000 7f7cf17e4640 1 -- 172.21.15.78:0/3147208161 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7cd8078bc0 msgr2=0x7f7cd807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:28.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.724+0000 7f7cf17e4640 1 --2- 172.21.15.78:0/3147208161 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7cd8078bc0 0x7f7cd807b0d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0033000 tx=0x7f7ce0004730 comp rx=0 tx=0).stop 2024-09-17T03:13:28.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.724+0000 7f7cf17e4640 1 -- 172.21.15.78:0/3147208161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cec0cf5d0 msgr2=0x7f7cec0b8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:28.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.724+0000 7f7cf17e4640 1 --2- 172.21.15.78:0/3147208161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cec0cf5d0 0x7f7cec0b8640 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc00c430 tx=0x7f7cdc00c830 comp rx=0 tx=0).stop 2024-09-17T03:13:28.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.724+0000 7f7cf17e4640 1 -- 172.21.15.78:0/3147208161 shutdown_connections 2024-09-17T03:13:28.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.724+0000 7f7cf17e4640 1 --2- 172.21.15.78:0/3147208161 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7cec0d2ed0 0x7f7cec15e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.724+0000 7f7cf17e4640 1 --2- 172.21.15.78:0/3147208161 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7cd8078bc0 0x7f7cd807b0d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.724+0000 7f7cf17e4640 1 --2- 172.21.15.78:0/3147208161 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7cec0d1a80 0x7f7cec15ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.724+0000 7f7cf17e4640 1 --2- 172.21.15.78:0/3147208161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7cec0cf5d0 0x7f7cec0b8640 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.724+0000 7f7cf17e4640 1 -- 172.21.15.78:0/3147208161 >> 172.21.15.78:0/3147208161 conn(0x7f7cec08bfc0 msgr2=0x7f7cec0d4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:28.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.725+0000 7f7cf17e4640 1 -- 172.21.15.78:0/3147208161 shutdown_connections 2024-09-17T03:13:28.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.725+0000 7f7cf17e4640 1 -- 172.21.15.78:0/3147208161 wait complete. 2024-09-17T03:13:28.735 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0' 2024-09-17T03:13:28.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.850+0000 7fb14f5ad640 1 -- 172.21.15.78:0/2462052325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb134003a50 msgr2=0x7fb134003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:28.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.850+0000 7fb14f5ad640 1 --2- 172.21.15.78:0/2462052325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb134003a50 0x7fb134003ec0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fb144009b50 tx=0x7fb134005830 comp rx=0 tx=0).stop 2024-09-17T03:13:28.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.850+0000 7fb14f5ad640 1 -- 172.21.15.78:0/2462052325 shutdown_connections 2024-09-17T03:13:28.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.850+0000 7fb14f5ad640 1 --2- 172.21.15.78:0/2462052325 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb134003a50 0x7fb134003ec0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.850+0000 7fb14f5ad640 1 -- 172.21.15.78:0/2462052325 >> 172.21.15.78:0/2462052325 conn(0x7fb14808bfc0 msgr2=0x7fb14809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:28.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.850+0000 7fb14f5ad640 1 -- 172.21.15.78:0/2462052325 shutdown_connections 2024-09-17T03:13:28.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.850+0000 7fb14f5ad640 1 -- 172.21.15.78:0/2462052325 wait complete. 2024-09-17T03:13:28.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.852+0000 7fb14f5ad640 1 Processor -- start 2024-09-17T03:13:28.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.852+0000 7fb14f5ad640 1 -- start start 2024-09-17T03:13:28.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.853+0000 7fb14f5ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb134003a50 0x7fb14815c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:28.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.853+0000 7fb14f5ad640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb14815b510 0x7fb1481e9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:28.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.853+0000 7fb14f5ad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb14815ba60 0x7fb1481e9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:28.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.853+0000 7fb14f5ad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb1480b36c0 con 0x7fb134003a50 2024-09-17T03:13:28.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.853+0000 7fb14f5ad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb1480b3540 con 0x7fb14815ba60 2024-09-17T03:13:28.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.853+0000 7fb14f5ad640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb1480b3840 con 0x7fb14815b510 2024-09-17T03:13:28.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.853+0000 7fb14d349640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb134003a50 0x7fb14815c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:28.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.853+0000 7fb14d349640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb134003a50 0x7fb14815c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50058/0 (socket says 172.21.15.78:50058) 2024-09-17T03:13:28.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.853+0000 7fb14d349640 1 -- 172.21.15.78:0/2202973978 learned_addr learned my addr 172.21.15.78:0/2202973978 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:28.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.853+0000 7fb14cb48640 1 --2- 172.21.15.78:0/2202973978 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb14815b510 0x7fb1481e9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:28.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.853+0000 7fb14db4a640 1 --2- 172.21.15.78:0/2202973978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb14815ba60 0x7fb1481e9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:28.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.853+0000 7fb14d349640 1 -- 172.21.15.78:0/2202973978 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb14815b510 msgr2=0x7fb1481e9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:28.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.853+0000 7fb14d349640 1 --2- 172.21.15.78:0/2202973978 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb14815b510 0x7fb1481e9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.853+0000 7fb14d349640 1 -- 172.21.15.78:0/2202973978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb14815ba60 msgr2=0x7fb1481e9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:28.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.853+0000 7fb14d349640 1 --2- 172.21.15.78:0/2202973978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb14815ba60 0x7fb1481e9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:28.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.853+0000 7fb14d349640 1 -- 172.21.15.78:0/2202973978 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1480ce5e0 con 0x7fb134003a50 2024-09-17T03:13:28.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.854+0000 7fb14d349640 1 --2- 172.21.15.78:0/2202973978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb134003a50 0x7fb14815c570 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fb144009a70 tx=0x7fb1440336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:28.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.854+0000 7fb13dffb640 1 -- 172.21.15.78:0/2202973978 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb144038040 con 0x7fb134003a50 2024-09-17T03:13:28.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.854+0000 7fb13dffb640 1 -- 172.21.15.78:0/2202973978 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb1440339d0 con 0x7fb134003a50 2024-09-17T03:13:28.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.854+0000 7fb14f5ad640 1 -- 172.21.15.78:0/2202973978 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1481e8720 con 0x7fb134003a50 2024-09-17T03:13:28.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.854+0000 7fb13dffb640 1 -- 172.21.15.78:0/2202973978 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb144033e20 con 0x7fb134003a50 2024-09-17T03:13:28.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.854+0000 7fb14f5ad640 1 -- 172.21.15.78:0/2202973978 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1481e91f0 con 0x7fb134003a50 2024-09-17T03:13:28.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.855+0000 7fb14f5ad640 1 -- 172.21.15.78:0/2202973978 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1480cf110 con 0x7fb134003a50 2024-09-17T03:13:28.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.856+0000 7fb13dffb640 1 -- 172.21.15.78:0/2202973978 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb144043020 con 0x7fb134003a50 2024-09-17T03:13:28.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.856+0000 7fb13dffb640 1 --2- 172.21.15.78:0/2202973978 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb12c078bc0 0x7fb12c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:28.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.856+0000 7fb13dffb640 1 -- 172.21.15.78:0/2202973978 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7fb1440bac60 con 0x7fb134003a50 2024-09-17T03:13:28.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.856+0000 7fb14cb48640 1 --2- 172.21.15.78:0/2202973978 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb12c078bc0 0x7fb12c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:28.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.857+0000 7fb14cb48640 1 --2- 172.21.15.78:0/2202973978 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb12c078bc0 0x7fb12c07b0d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb1480c7be0 tx=0x7fb138006d50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:28.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:28.861+0000 7fb13dffb640 1 -- 172.21.15.78:0/2202973978 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb14404a020 con 0x7fb134003a50 2024-09-17T03:13:29.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:29.105+0000 7fb14f5ad640 1 -- 172.21.15.78:0/2202973978 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0"]} v 0) -- 0x7fb1480b8a40 con 0x7fb134003a50 2024-09-17T03:13:30.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.102+0000 7fb13dffb640 1 -- 172.21.15.78:0/2202973978 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0"]}]=0 v258) ==== 157+0+0 (secure 0 0 0) 0x7fb144082ca0 con 0x7fb134003a50 2024-09-17T03:13:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.106+0000 7fb14f5ad640 1 -- 172.21.15.78:0/2202973978 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb12c078bc0 msgr2=0x7fb12c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.106+0000 7fb14f5ad640 1 --2- 172.21.15.78:0/2202973978 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb12c078bc0 0x7fb12c07b0d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb1480c7be0 tx=0x7fb138006d50 comp rx=0 tx=0).stop 2024-09-17T03:13:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.106+0000 7fb14f5ad640 1 -- 172.21.15.78:0/2202973978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb134003a50 msgr2=0x7fb14815c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.106+0000 7fb14f5ad640 1 --2- 172.21.15.78:0/2202973978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb134003a50 0x7fb14815c570 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fb144009a70 tx=0x7fb1440336f0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.106+0000 7fb14f5ad640 1 -- 172.21.15.78:0/2202973978 shutdown_connections 2024-09-17T03:13:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.106+0000 7fb14f5ad640 1 --2- 172.21.15.78:0/2202973978 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb12c078bc0 0x7fb12c07b0d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.106+0000 7fb14f5ad640 1 --2- 172.21.15.78:0/2202973978 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb14815ba60 0x7fb1481e9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.106+0000 7fb14f5ad640 1 --2- 172.21.15.78:0/2202973978 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb14815b510 0x7fb1481e9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.106+0000 7fb14f5ad640 1 --2- 172.21.15.78:0/2202973978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb134003a50 0x7fb14815c570 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.106+0000 7fb14f5ad640 1 -- 172.21.15.78:0/2202973978 >> 172.21.15.78:0/2202973978 conn(0x7fb14808bfc0 msgr2=0x7fb1480b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:30.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.106+0000 7fb14f5ad640 1 -- 172.21.15.78:0/2202973978 shutdown_connections 2024-09-17T03:13:30.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.106+0000 7fb14f5ad640 1 -- 172.21.15.78:0/2202973978 wait complete. 2024-09-17T03:13:30.118 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:13:30.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.234+0000 7fcd845df640 1 -- 172.21.15.78:0/3663114680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd68003a30 msgr2=0x7fcd68003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:30.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.234+0000 7fcd845df640 1 --2- 172.21.15.78:0/3663114680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd68003a30 0x7fcd68003ea0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fcd780016c0 tx=0x7fcd68005830 comp rx=0 tx=0).stop 2024-09-17T03:13:30.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.234+0000 7fcd82b7c640 1 -- 172.21.15.78:0/3663114680 reap_dead start 2024-09-17T03:13:30.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.234+0000 7fcd845df640 1 -- 172.21.15.78:0/3663114680 shutdown_connections 2024-09-17T03:13:30.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.234+0000 7fcd845df640 1 -- 172.21.15.78:0/3663114680 >> 172.21.15.78:0/3663114680 conn(0x7fcd7c06d550 msgr2=0x7fcd7c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:30.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.234+0000 7fcd845df640 1 -- 172.21.15.78:0/3663114680 shutdown_connections 2024-09-17T03:13:30.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.234+0000 7fcd845df640 1 -- 172.21.15.78:0/3663114680 wait complete. 2024-09-17T03:13:30.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.236+0000 7fcd845df640 1 Processor -- start 2024-09-17T03:13:30.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.236+0000 7fcd845df640 1 -- start start 2024-09-17T03:13:30.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.237+0000 7fcd845df640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd68003a30 0x7fcd7c15f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:30.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.237+0000 7fcd845df640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcd7c1536a0 0x7fcd7c15e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:30.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.237+0000 7fcd845df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7c15e650 0x7fcd7c1f6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:30.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.237+0000 7fcd845df640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7c0b7820 con 0x7fcd7c15e650 2024-09-17T03:13:30.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.237+0000 7fcd845df640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcd7c0b76a0 con 0x7fcd68003a30 2024-09-17T03:13:30.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.237+0000 7fcd845df640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fcd7c0b79a0 con 0x7fcd7c1536a0 2024-09-17T03:13:30.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.237+0000 7fcd82b7c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7c15e650 0x7fcd7c1f6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:30.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.237+0000 7fcd82b7c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7c15e650 0x7fcd7c1f6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50074/0 (socket says 172.21.15.78:50074) 2024-09-17T03:13:30.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.237+0000 7fcd82b7c640 1 -- 172.21.15.78:0/1614779016 learned_addr learned my addr 172.21.15.78:0/1614779016 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:30.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.238+0000 7fcd8237b640 1 --2- 172.21.15.78:0/1614779016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd68003a30 0x7fcd7c15f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:30.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.238+0000 7fcd82b7c640 1 -- 172.21.15.78:0/1614779016 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcd7c1536a0 msgr2=0x7fcd7c15e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:30.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.238+0000 7fcd82b7c640 1 --2- 172.21.15.78:0/1614779016 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcd7c1536a0 0x7fcd7c15e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.238+0000 7fcd82b7c640 1 -- 172.21.15.78:0/1614779016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd68003a30 msgr2=0x7fcd7c15f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:30.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.238+0000 7fcd82b7c640 1 --2- 172.21.15.78:0/1614779016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd68003a30 0x7fcd7c15f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.238+0000 7fcd82b7c640 1 -- 172.21.15.78:0/1614779016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd7c152600 con 0x7fcd7c15e650 2024-09-17T03:13:30.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.238+0000 7fcd82b7c640 1 --2- 172.21.15.78:0/1614779016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7c15e650 0x7fcd7c1f6b40 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fcd74005fd0 tx=0x7fcd74009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:30.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.238+0000 7fcd72ffd640 1 -- 172.21.15.78:0/1614779016 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd74016030 con 0x7fcd7c15e650 2024-09-17T03:13:30.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.238+0000 7fcd72ffd640 1 -- 172.21.15.78:0/1614779016 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd74004c10 con 0x7fcd7c15e650 2024-09-17T03:13:30.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.238+0000 7fcd845df640 1 -- 172.21.15.78:0/1614779016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd7c1528e0 con 0x7fcd7c15e650 2024-09-17T03:13:30.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.238+0000 7fcd72ffd640 1 -- 172.21.15.78:0/1614779016 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd74011710 con 0x7fcd7c15e650 2024-09-17T03:13:30.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.238+0000 7fcd845df640 1 -- 172.21.15.78:0/1614779016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd7c152ea0 con 0x7fcd7c15e650 2024-09-17T03:13:30.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.239+0000 7fcd845df640 1 -- 172.21.15.78:0/1614779016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd7c0b7f00 con 0x7fcd7c15e650 2024-09-17T03:13:30.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.240+0000 7fcd72ffd640 1 -- 172.21.15.78:0/1614779016 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcd740118b0 con 0x7fcd7c15e650 2024-09-17T03:13:30.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.240+0000 7fcd72ffd640 1 --2- 172.21.15.78:0/1614779016 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcd60078b90 0x7fcd6007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:30.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.240+0000 7fcd72ffd640 1 -- 172.21.15.78:0/1614779016 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7fcd7409b0b0 con 0x7fcd7c15e650 2024-09-17T03:13:30.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.241+0000 7fcd8237b640 1 --2- 172.21.15.78:0/1614779016 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcd60078b90 0x7fcd6007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:30.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.241+0000 7fcd8237b640 1 --2- 172.21.15.78:0/1614779016 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcd60078b90 0x7fcd6007b0a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcd78032000 tx=0x7fcd78001190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:30.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.245+0000 7fcd72ffd640 1 -- 172.21.15.78:0/1614779016 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcd74063860 con 0x7fcd7c15e650 2024-09-17T03:13:30.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.418+0000 7fcd845df640 1 -- 172.21.15.78:0/1614779016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fcd7c14dfe0 con 0x7fcd7c15e650 2024-09-17T03:13:30.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.419+0000 7fcd72ffd640 1 -- 172.21.15.78:0/1614779016 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v39) ==== 59+0+2294 (secure 0 0 0) 0x7fcd74063160 con 0x7fcd7c15e650 2024-09-17T03:13:30.418 INFO:teuthology.orchestra.run.smithi078.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:13:30.418 INFO:teuthology.orchestra.run.smithi078.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:13:30.418 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:13:30.418 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_client 20/20 2024-09-17T03:13:30.418 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:13:30.418 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:13:30.418 INFO:teuthology.orchestra.run.smithi078.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:13:30.418 INFO:teuthology.orchestra.run.smithi078.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:13:30.419 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4994.035848 2024-09-17T03:13:30.419 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5277.317911 2024-09-17T03:13:30.419 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4833.009828 2024-09-17T03:13:30.419 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7208.562209 2024-09-17T03:13:30.419 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4511.051809 2024-09-17T03:13:30.419 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4237.642218 2024-09-17T03:13:30.419 INFO:teuthology.orchestra.run.smithi078.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 6005.051341 2024-09-17T03:13:30.419 INFO:teuthology.orchestra.run.smithi078.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4677.613119 2024-09-17T03:13:30.419 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_mds 20/20 2024-09-17T03:13:30.419 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:13:30.419 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_ms 2/2 2024-09-17T03:13:30.419 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_debug_frag true 2024-09-17T03:13:30.419 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:13:30.419 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:13:30.420 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_verify_scatter true 2024-09-17T03:13:30.420 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:13:30.420 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:13:30.420 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:13:30.420 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced client_mount_timeout 600 2024-09-17T03:13:30.420 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced debug_client 20/20 2024-09-17T03:13:30.420 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced debug_ms 1/1 2024-09-17T03:13:30.420 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:13:30.420 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:13:30.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.421+0000 7fcd845df640 1 -- 172.21.15.78:0/1614779016 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcd60078b90 msgr2=0x7fcd6007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:30.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.421+0000 7fcd845df640 1 --2- 172.21.15.78:0/1614779016 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcd60078b90 0x7fcd6007b0a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcd78032000 tx=0x7fcd78001190 comp rx=0 tx=0).stop 2024-09-17T03:13:30.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.421+0000 7fcd845df640 1 -- 172.21.15.78:0/1614779016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7c15e650 msgr2=0x7fcd7c1f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:30.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.421+0000 7fcd845df640 1 --2- 172.21.15.78:0/1614779016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7c15e650 0x7fcd7c1f6b40 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fcd74005fd0 tx=0x7fcd74009b00 comp rx=0 tx=0).stop 2024-09-17T03:13:30.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.421+0000 7fcd845df640 1 -- 172.21.15.78:0/1614779016 shutdown_connections 2024-09-17T03:13:30.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.421+0000 7fcd845df640 1 --2- 172.21.15.78:0/1614779016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcd7c15e650 0x7fcd7c1f6b40 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.421+0000 7fcd845df640 1 --2- 172.21.15.78:0/1614779016 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcd7c1536a0 0x7fcd7c15e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.421+0000 7fcd845df640 1 --2- 172.21.15.78:0/1614779016 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcd60078b90 0x7fcd6007b0a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.421+0000 7fcd845df640 1 --2- 172.21.15.78:0/1614779016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcd68003a30 0x7fcd7c15f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.421+0000 7fcd845df640 1 -- 172.21.15.78:0/1614779016 >> 172.21.15.78:0/1614779016 conn(0x7fcd7c06d550 msgr2=0x7fcd7c160c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:30.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.422+0000 7fcd845df640 1 -- 172.21.15.78:0/1614779016 shutdown_connections 2024-09-17T03:13:30.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.422+0000 7fcd845df640 1 -- 172.21.15.78:0/1614779016 wait complete. 2024-09-17T03:13:30.432 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:13:30.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.548+0000 7f8594158640 1 -- 172.21.15.78:0/1832831640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f858c0d2ed0 msgr2=0x7f858c0d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:30.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.548+0000 7f8594158640 1 --2- 172.21.15.78:0/1832831640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f858c0d2ed0 0x7f858c0d1a80 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f8588009820 tx=0x7f858802a510 comp rx=0 tx=0).stop 2024-09-17T03:13:30.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.548+0000 7f8594158640 1 -- 172.21.15.78:0/1832831640 shutdown_connections 2024-09-17T03:13:30.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.548+0000 7f8594158640 1 --2- 172.21.15.78:0/1832831640 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f858c0b9b70 0x7f858c0cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.548+0000 7f8594158640 1 --2- 172.21.15.78:0/1832831640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f858c0d2ed0 0x7f858c0d1a80 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.548+0000 7f8594158640 1 -- 172.21.15.78:0/1832831640 >> 172.21.15.78:0/1832831640 conn(0x7f858c08bfc0 msgr2=0x7f858c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:30.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.548+0000 7f8594158640 1 -- 172.21.15.78:0/1832831640 shutdown_connections 2024-09-17T03:13:30.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.548+0000 7f8594158640 1 -- 172.21.15.78:0/1832831640 wait complete. 2024-09-17T03:13:30.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.550+0000 7f8594158640 1 Processor -- start 2024-09-17T03:13:30.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.550+0000 7f8594158640 1 -- start start 2024-09-17T03:13:30.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.551+0000 7f8594158640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f858c0b9b70 0x7f858c157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:30.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.551+0000 7f8594158640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f858c0cf5d0 0x7f858c09e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:30.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.551+0000 7f8594158640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f858c0d2ed0 0x7f858c0ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:30.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.551+0000 7f8594158640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f858c0d4940 con 0x7f858c0cf5d0 2024-09-17T03:13:30.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.551+0000 7f8594158640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f858c0cfde0 con 0x7f858c0d2ed0 2024-09-17T03:13:30.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.551+0000 7f8594158640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f858c0d4ac0 con 0x7f858c0b9b70 2024-09-17T03:13:30.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.552+0000 7f85916f3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f858c0cf5d0 0x7f858c09e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:30.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.552+0000 7f85916f3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f858c0cf5d0 0x7f858c09e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50084/0 (socket says 172.21.15.78:50084) 2024-09-17T03:13:30.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.552+0000 7f85916f3640 1 -- 172.21.15.78:0/1202145469 learned_addr learned my addr 172.21.15.78:0/1202145469 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:30.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.552+0000 7f8591ef4640 1 --2- 172.21.15.78:0/1202145469 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f858c0b9b70 0x7f858c157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:30.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.552+0000 7f85926f5640 1 --2- 172.21.15.78:0/1202145469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f858c0d2ed0 0x7f858c0ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:30.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.552+0000 7f85916f3640 1 -- 172.21.15.78:0/1202145469 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f858c0b9b70 msgr2=0x7f858c157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:30.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.552+0000 7f85916f3640 1 --2- 172.21.15.78:0/1202145469 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f858c0b9b70 0x7f858c157f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.552+0000 7f85916f3640 1 -- 172.21.15.78:0/1202145469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f858c0d2ed0 msgr2=0x7f858c0ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:30.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.552+0000 7f85916f3640 1 --2- 172.21.15.78:0/1202145469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f858c0d2ed0 0x7f858c0ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.552+0000 7f85916f3640 1 -- 172.21.15.78:0/1202145469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858c0a0ab0 con 0x7f858c0cf5d0 2024-09-17T03:13:30.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.552+0000 7f85916f3640 1 --2- 172.21.15.78:0/1202145469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f858c0cf5d0 0x7f858c09e200 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f857c00d650 tx=0x7f857c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:30.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.552+0000 7f85827fc640 1 -- 172.21.15.78:0/1202145469 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c017070 con 0x7f858c0cf5d0 2024-09-17T03:13:30.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.552+0000 7f85827fc640 1 -- 172.21.15.78:0/1202145469 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f857c005310 con 0x7f858c0cf5d0 2024-09-17T03:13:30.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.552+0000 7f85827fc640 1 -- 172.21.15.78:0/1202145469 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c009820 con 0x7f858c0cf5d0 2024-09-17T03:13:30.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.552+0000 7f8594158640 1 -- 172.21.15.78:0/1202145469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f858c0a1b30 con 0x7f858c0cf5d0 2024-09-17T03:13:30.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.552+0000 7f8594158640 1 -- 172.21.15.78:0/1202145469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f858c0a1050 con 0x7f858c0cf5d0 2024-09-17T03:13:30.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.554+0000 7f8594158640 1 -- 172.21.15.78:0/1202145469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f858c0b9660 con 0x7f858c0cf5d0 2024-09-17T03:13:30.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.554+0000 7f85827fc640 1 -- 172.21.15.78:0/1202145469 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f857c0099c0 con 0x7f858c0cf5d0 2024-09-17T03:13:30.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.555+0000 7f85827fc640 1 --2- 172.21.15.78:0/1202145469 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8570078bf0 0x7f857007b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:30.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.555+0000 7f85827fc640 1 -- 172.21.15.78:0/1202145469 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7f857c09aa80 con 0x7f858c0cf5d0 2024-09-17T03:13:30.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.555+0000 7f8591ef4640 1 --2- 172.21.15.78:0/1202145469 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8570078bf0 0x7f857007b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:30.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.555+0000 7f8591ef4640 1 --2- 172.21.15.78:0/1202145469 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8570078bf0 0x7f857007b100 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8588034000 tx=0x7f8588004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:30.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.559+0000 7f85827fc640 1 -- 172.21.15.78:0/1202145469 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f858c0b9660 con 0x7f858c0cf5d0 2024-09-17T03:13:30.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.733+0000 7f8594158640 1 -- 172.21.15.78:0/1202145469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f858c0b5880 con 0x7f858c0cf5d0 2024-09-17T03:13:30.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.737+0000 7f85827fc640 1 -- 172.21.15.78:0/1202145469 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7f858c0b5880 con 0x7f858c0cf5d0 2024-09-17T03:13:30.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.739+0000 7f8594158640 1 -- 172.21.15.78:0/1202145469 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8570078bf0 msgr2=0x7f857007b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:30.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.739+0000 7f8594158640 1 --2- 172.21.15.78:0/1202145469 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8570078bf0 0x7f857007b100 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8588034000 tx=0x7f8588004730 comp rx=0 tx=0).stop 2024-09-17T03:13:30.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.739+0000 7f8594158640 1 -- 172.21.15.78:0/1202145469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f858c0cf5d0 msgr2=0x7f858c09e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:30.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.739+0000 7f8594158640 1 --2- 172.21.15.78:0/1202145469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f858c0cf5d0 0x7f858c09e200 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f857c00d650 tx=0x7f857c00db10 comp rx=0 tx=0).stop 2024-09-17T03:13:30.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.739+0000 7f8594158640 1 -- 172.21.15.78:0/1202145469 shutdown_connections 2024-09-17T03:13:30.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.739+0000 7f8594158640 1 --2- 172.21.15.78:0/1202145469 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8570078bf0 0x7f857007b100 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.739+0000 7f8594158640 1 --2- 172.21.15.78:0/1202145469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f858c0d2ed0 0x7f858c0ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.739+0000 7f8594158640 1 --2- 172.21.15.78:0/1202145469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f858c0cf5d0 0x7f858c09e200 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.739+0000 7f8594158640 1 --2- 172.21.15.78:0/1202145469 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f858c0b9b70 0x7f858c157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:30.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.739+0000 7f8594158640 1 -- 172.21.15.78:0/1202145469 >> 172.21.15.78:0/1202145469 conn(0x7f858c08bfc0 msgr2=0x7f858c0b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:30.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.739+0000 7f8594158640 1 -- 172.21.15.78:0/1202145469 shutdown_connections 2024-09-17T03:13:30.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:30.739+0000 7f8594158640 1 -- 172.21.15.78:0/1202145469 wait complete. 2024-09-17T03:13:30.749 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:13:30.749 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:13:30.799 DEBUG:teuthology.orchestra.run.smithi193:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:13:30.848 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:13:30.848 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:13:30.848 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:13:30.864 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056010,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1013 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:13:30.864 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:13:30.864 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:13:30.881 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:13:30.882 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:13:30.882 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:13:30.920 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056010,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1013 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:13:30.920 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:13:30.920 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:13:30.938 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:13:30.939 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:13:30.939 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:13:31.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.071+0000 7f20e70f2640 1 -- 172.21.15.78:0/715124627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20e006f4b0 msgr2=0x7f20e00d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:31.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.071+0000 7f20e70f2640 1 --2- 172.21.15.78:0/715124627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20e006f4b0 0x7f20e00d3330 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f20d0009860 tx=0x7f20d002a4b0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.071+0000 7f20e70f2640 1 -- 172.21.15.78:0/715124627 shutdown_connections 2024-09-17T03:13:31.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.071+0000 7f20e70f2640 1 --2- 172.21.15.78:0/715124627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20e006f4b0 0x7f20e00d3330 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.071+0000 7f20e70f2640 1 --2- 172.21.15.78:0/715124627 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f20e006e170 0x7f20e00b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.071+0000 7f20e70f2640 1 -- 172.21.15.78:0/715124627 >> 172.21.15.78:0/715124627 conn(0x7f20e008bfc0 msgr2=0x7f20e009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:31.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.071+0000 7f20e70f2640 1 -- 172.21.15.78:0/715124627 shutdown_connections 2024-09-17T03:13:31.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.071+0000 7f20e70f2640 1 -- 172.21.15.78:0/715124627 wait complete. 2024-09-17T03:13:31.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.073+0000 7f20e70f2640 1 Processor -- start 2024-09-17T03:13:31.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.073+0000 7f20e70f2640 1 -- start start 2024-09-17T03:13:31.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.074+0000 7f20e70f2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20e006f4b0 0x7f20e01f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:31.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.074+0000 7f20e70f2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20e00d3870 0x7f20e01f92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:31.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20e70f2640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f20e00cdef0 0x7f20e01e9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:31.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20e70f2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f20e00d0e60 con 0x7f20e006f4b0 2024-09-17T03:13:31.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20e70f2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f20e00d0ce0 con 0x7f20e00d3870 2024-09-17T03:13:31.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20e70f2640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f20e00d0fe0 con 0x7f20e00cdef0 2024-09-17T03:13:31.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20e4e8e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20e006f4b0 0x7f20e01f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:31.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20e4e8e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20e006f4b0 0x7f20e01f5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50110/0 (socket says 172.21.15.78:50110) 2024-09-17T03:13:31.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20e4e8e640 1 -- 172.21.15.78:0/3994014921 learned_addr learned my addr 172.21.15.78:0/3994014921 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:31.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20e568f640 1 --2- 172.21.15.78:0/3994014921 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f20e00cdef0 0x7f20e01e9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:31.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20e4e8e640 1 -- 172.21.15.78:0/3994014921 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f20e00cdef0 msgr2=0x7f20e01e9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:31.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20dffff640 1 --2- 172.21.15.78:0/3994014921 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20e00d3870 0x7f20e01f92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:31.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20e4e8e640 1 --2- 172.21.15.78:0/3994014921 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f20e00cdef0 0x7f20e01e9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20e4e8e640 1 -- 172.21.15.78:0/3994014921 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20e00d3870 msgr2=0x7f20e01f92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:31.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20e4e8e640 1 --2- 172.21.15.78:0/3994014921 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20e00d3870 0x7f20e01f92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20e4e8e640 1 -- 172.21.15.78:0/3994014921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20e00ce900 con 0x7f20e006f4b0 2024-09-17T03:13:31.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20e568f640 1 --2- 172.21.15.78:0/3994014921 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f20e00cdef0 0x7f20e01e9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:31.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20dffff640 1 --2- 172.21.15.78:0/3994014921 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20e00d3870 0x7f20e01f92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:31.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20e4e8e640 1 --2- 172.21.15.78:0/3994014921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20e006f4b0 0x7f20e01f5e80 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c9a0 tx=0x7f20c800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:31.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20dd7fa640 1 -- 172.21.15.78:0/3994014921 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8007b50 con 0x7f20e006f4b0 2024-09-17T03:13:31.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20dd7fa640 1 -- 172.21.15.78:0/3994014921 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20c8007de0 con 0x7f20e006f4b0 2024-09-17T03:13:31.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20e70f2640 1 -- 172.21.15.78:0/3994014921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20e01e9dc0 con 0x7f20e006f4b0 2024-09-17T03:13:31.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20dd7fa640 1 -- 172.21.15.78:0/3994014921 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c800f6b0 con 0x7f20e006f4b0 2024-09-17T03:13:31.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.075+0000 7f20e70f2640 1 -- 172.21.15.78:0/3994014921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20e01f53a0 con 0x7f20e006f4b0 2024-09-17T03:13:31.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.076+0000 7f20e70f2640 1 -- 172.21.15.78:0/3994014921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20e00d1500 con 0x7f20e006f4b0 2024-09-17T03:13:31.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.077+0000 7f20dd7fa640 1 -- 172.21.15.78:0/3994014921 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f20c800f850 con 0x7f20e006f4b0 2024-09-17T03:13:31.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.078+0000 7f20dd7fa640 1 --2- 172.21.15.78:0/3994014921 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f20c0078b90 0x7f20c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:31.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.078+0000 7f20dd7fa640 1 -- 172.21.15.78:0/3994014921 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7f20c809b190 con 0x7f20e006f4b0 2024-09-17T03:13:31.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.078+0000 7f20dffff640 1 --2- 172.21.15.78:0/3994014921 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f20c0078b90 0x7f20c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:31.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.079+0000 7f20dffff640 1 --2- 172.21.15.78:0/3994014921 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f20c0078b90 0x7f20c007b0a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f20d0034000 tx=0x7f20d0004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:31.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.082+0000 7f20dd7fa640 1 -- 172.21.15.78:0/3994014921 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f20c8014030 con 0x7f20e006f4b0 2024-09-17T03:13:31.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.293+0000 7f20e70f2640 1 -- 172.21.15.78:0/3994014921 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20e006f100 con 0x7f20e006f4b0 2024-09-17T03:13:31.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.294+0000 7f20dd7fa640 1 -- 172.21.15.78:0/3994014921 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+3908 (secure 0 0 0) 0x7f20c8063940 con 0x7f20e006f4b0 2024-09-17T03:13:31.293 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:31.293 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":71,"btime":"2024-09-17T03:13:25:081164+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5873,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/3831026382","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":3831026382},{"type":"v1","addr":"172.21.15.193:6836","nonce":3831026382}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58},{"gid":6125,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/74200210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":74200210},{"type":"v1","addr":"172.21.15.193:6837","nonce":74200210}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7329,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/468076829","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":468076829},{"type":"v1","addr":"172.21.15.78:6833","nonce":468076829}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":7335,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/1309976792","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":1309976792},{"type":"v1","addr":"172.21.15.78:6835","nonce":1309976792}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[]} 2024-09-17T03:13:31.293 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 71 2024-09-17T03:13:31.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.296+0000 7f20e70f2640 1 -- 172.21.15.78:0/3994014921 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f20c0078b90 msgr2=0x7f20c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:31.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.296+0000 7f20e70f2640 1 --2- 172.21.15.78:0/3994014921 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f20c0078b90 0x7f20c007b0a0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f20d0034000 tx=0x7f20d0004730 comp rx=0 tx=0).stop 2024-09-17T03:13:31.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.296+0000 7f20e70f2640 1 -- 172.21.15.78:0/3994014921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20e006f4b0 msgr2=0x7f20e01f5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:31.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.296+0000 7f20e70f2640 1 --2- 172.21.15.78:0/3994014921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20e006f4b0 0x7f20e01f5e80 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c9a0 tx=0x7f20c800ce60 comp rx=0 tx=0).stop 2024-09-17T03:13:31.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.296+0000 7f20e70f2640 1 -- 172.21.15.78:0/3994014921 shutdown_connections 2024-09-17T03:13:31.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.296+0000 7f20e70f2640 1 --2- 172.21.15.78:0/3994014921 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f20e00cdef0 0x7f20e01e9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.296+0000 7f20e70f2640 1 --2- 172.21.15.78:0/3994014921 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f20c0078b90 0x7f20c007b0a0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.296+0000 7f20e70f2640 1 --2- 172.21.15.78:0/3994014921 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20e00d3870 0x7f20e01f92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.296+0000 7f20e70f2640 1 --2- 172.21.15.78:0/3994014921 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20e006f4b0 0x7f20e01f5e80 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.296+0000 7f20e70f2640 1 -- 172.21.15.78:0/3994014921 >> 172.21.15.78:0/3994014921 conn(0x7f20e008bfc0 msgr2=0x7f20e0068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:31.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.296+0000 7f20e70f2640 1 -- 172.21.15.78:0/3994014921 shutdown_connections 2024-09-17T03:13:31.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.296+0000 7f20e70f2640 1 -- 172.21.15.78:0/3994014921 wait complete. 2024-09-17T03:13:31.306 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:13:31.306 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:13:31.307 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:13:31.307 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:13:31.307 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:13:31.307 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:13:31.307 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:13:31.308 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:13:31.308 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:13:31.308 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:13:31.308 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:13:31.308 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:13:31.309 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:13:31.309 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:13:31.309 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:13:31.309 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:13:31.318 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:13:31.319 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:13:31.320 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:13:31.320 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:13:31.321 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:13:31.321 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:13:31.323 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:13:31.324 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:13:31.363 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:13:31.363 DEBUG:teuthology.parallel:result is None 2024-09-17T03:13:31.364 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:13:31.364 DEBUG:teuthology.parallel:result is None 2024-09-17T03:13:31.365 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:13:31.366 DEBUG:teuthology.parallel:result is None 2024-09-17T03:13:31.367 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:13:31.367 DEBUG:teuthology.parallel:result is None 2024-09-17T03:13:31.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:13:31.449 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-09-17T03:13:31.449 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2024-09-17T03:13:31.450 INFO:tasks.ceph.mds.a.smithi078.stderr:2024-09-17T03:13:31.451+0000 7f4bce734640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-17T03:13:31.450 INFO:tasks.ceph.mds.c.smithi078.stderr:2024-09-17T03:13:31.451+0000 7fc47238e640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-17T03:13:31.450 INFO:tasks.ceph.mds.c.smithi078.stderr:2024-09-17T03:13:31.451+0000 7fc47238e640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6833/0: (98) Address already in use 2024-09-17T03:13:31.460 INFO:tasks.ceph.mds.b.smithi193.stdout:starting mds.b at 2024-09-17T03:13:31.461 INFO:tasks.ceph.mds.d.smithi193.stdout:starting mds.d at 2024-09-17T03:13:31.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.487+0000 7f2e0a3b6640 1 -- 172.21.15.78:0/1877966626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e040b9b60 msgr2=0x7f2e040d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:31.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.487+0000 7f2e0a3b6640 1 --2- 172.21.15.78:0/1877966626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e040b9b60 0x7f2e040d4d80 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009820 tx=0x7f2df402a2e0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.487+0000 7f2e0a3b6640 1 -- 172.21.15.78:0/1877966626 shutdown_connections 2024-09-17T03:13:31.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.487+0000 7f2e0a3b6640 1 --2- 172.21.15.78:0/1877966626 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2e040b66b0 0x7f2e0406eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.487+0000 7f2e0a3b6640 1 --2- 172.21.15.78:0/1877966626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e040b9b60 0x7f2e040d4d80 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.487+0000 7f2e0a3b6640 1 -- 172.21.15.78:0/1877966626 >> 172.21.15.78:0/1877966626 conn(0x7f2e0409d7f0 msgr2=0x7f2e040d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:31.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.487+0000 7f2e0a3b6640 1 -- 172.21.15.78:0/1877966626 shutdown_connections 2024-09-17T03:13:31.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.487+0000 7f2e0a3b6640 1 -- 172.21.15.78:0/1877966626 wait complete. 2024-09-17T03:13:31.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.489+0000 7f2e0a3b6640 1 Processor -- start 2024-09-17T03:13:31.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.489+0000 7f2e0a3b6640 1 -- start start 2024-09-17T03:13:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.490+0000 7f2e0a3b6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e040b9b60 0x7f2e041f5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.490+0000 7f2e0a3b6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e040cf540 0x7f2e040c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.490+0000 7f2e0a3b6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2e040c8e90 0x7f2e041f94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.490+0000 7f2e0a3b6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0406f680 con 0x7f2e040cf540 2024-09-17T03:13:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.490+0000 7f2e0a3b6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0406f500 con 0x7f2e040b9b60 2024-09-17T03:13:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.490+0000 7f2e0a3b6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f2e0406f800 con 0x7f2e040c8e90 2024-09-17T03:13:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.490+0000 7f2e037fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e040cf540 0x7f2e040c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.490+0000 7f2e037fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e040cf540 0x7f2e040c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50166/0 (socket says 172.21.15.78:50166) 2024-09-17T03:13:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.491+0000 7f2e037fe640 1 -- 172.21.15.78:0/378321408 learned_addr learned my addr 172.21.15.78:0/378321408 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:31.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.491+0000 7f2e03fff640 1 --2- 172.21.15.78:0/378321408 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e040b9b60 0x7f2e041f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:31.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.491+0000 7f2e08953640 1 --2- 172.21.15.78:0/378321408 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2e040c8e90 0x7f2e041f94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:31.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.491+0000 7f2e037fe640 1 -- 172.21.15.78:0/378321408 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2e040c8e90 msgr2=0x7f2e041f94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:31.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.491+0000 7f2e037fe640 1 --2- 172.21.15.78:0/378321408 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2e040c8e90 0x7f2e041f94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.491+0000 7f2e037fe640 1 -- 172.21.15.78:0/378321408 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e040b9b60 msgr2=0x7f2e041f5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:31.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.491+0000 7f2e037fe640 1 --2- 172.21.15.78:0/378321408 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e040b9b60 0x7f2e041f5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:31.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.491+0000 7f2e037fe640 1 -- 172.21.15.78:0/378321408 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e041fa330 con 0x7f2e040cf540 2024-09-17T03:13:31.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.491+0000 7f2e037fe640 1 --2- 172.21.15.78:0/378321408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e040cf540 0x7f2e040c8950 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f2df800c520 tx=0x7f2df800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:31.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.491+0000 7f2e00ff9640 1 -- 172.21.15.78:0/378321408 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df8017070 con 0x7f2e040cf540 2024-09-17T03:13:31.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.491+0000 7f2e00ff9640 1 -- 172.21.15.78:0/378321408 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2df80035f0 con 0x7f2e040cf540 2024-09-17T03:13:31.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.491+0000 7f2e0a3b6640 1 -- 172.21.15.78:0/378321408 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e040c9480 con 0x7f2e040cf540 2024-09-17T03:13:31.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.491+0000 7f2e00ff9640 1 -- 172.21.15.78:0/378321408 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df8003a40 con 0x7f2e040cf540 2024-09-17T03:13:31.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.491+0000 7f2e0a3b6640 1 -- 172.21.15.78:0/378321408 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e040c9a40 con 0x7f2e040cf540 2024-09-17T03:13:31.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.492+0000 7f2e0a3b6640 1 -- 172.21.15.78:0/378321408 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e0406eab0 con 0x7f2e040cf540 2024-09-17T03:13:31.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.493+0000 7f2e00ff9640 1 -- 172.21.15.78:0/378321408 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2df801a070 con 0x7f2e040cf540 2024-09-17T03:13:31.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.494+0000 7f2e00ff9640 1 --2- 172.21.15.78:0/378321408 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2df0078bc0 0x7f2df007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:31.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.494+0000 7f2e00ff9640 1 -- 172.21.15.78:0/378321408 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5115+0+0 (secure 0 0 0) 0x7f2df8099e80 con 0x7f2e040cf540 2024-09-17T03:13:31.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.494+0000 7f2e03fff640 1 --2- 172.21.15.78:0/378321408 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2df0078bc0 0x7f2df007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:31.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.494+0000 7f2e03fff640 1 --2- 172.21.15.78:0/378321408 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2df0078bc0 0x7f2df007b0d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2df4034000 tx=0x7f2df4004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:31.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.498+0000 7f2e00ff9640 1 -- 172.21.15.78:0/378321408 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2df8061ec0 con 0x7f2e040cf540 2024-09-17T03:13:31.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:31.683+0000 7f2e0a3b6640 1 -- 172.21.15.78:0/378321408 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f2e040d3fb0 con 0x7f2e040cf540 2024-09-17T03:13:32.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.116+0000 7f2e00ff9640 1 -- 172.21.15.78:0/378321408 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v76) ==== 97+0+0 (secure 0 0 0) 0x7f2df80668f0 con 0x7f2e040cf540 2024-09-17T03:13:32.115 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2024-09-17T03:13:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.119+0000 7f2e0a3b6640 1 -- 172.21.15.78:0/378321408 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2df0078bc0 msgr2=0x7f2df007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.119+0000 7f2e0a3b6640 1 --2- 172.21.15.78:0/378321408 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2df0078bc0 0x7f2df007b0d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2df4034000 tx=0x7f2df4004730 comp rx=0 tx=0).stop 2024-09-17T03:13:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.119+0000 7f2e0a3b6640 1 -- 172.21.15.78:0/378321408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e040cf540 msgr2=0x7f2e040c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.119+0000 7f2e0a3b6640 1 --2- 172.21.15.78:0/378321408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e040cf540 0x7f2e040c8950 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f2df800c520 tx=0x7f2df800c9e0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.119+0000 7f2e0a3b6640 1 -- 172.21.15.78:0/378321408 shutdown_connections 2024-09-17T03:13:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.119+0000 7f2e0a3b6640 1 --2- 172.21.15.78:0/378321408 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2e040c8e90 0x7f2e041f94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.119+0000 7f2e0a3b6640 1 --2- 172.21.15.78:0/378321408 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2e040cf540 0x7f2e040c8950 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.119+0000 7f2e0a3b6640 1 --2- 172.21.15.78:0/378321408 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2df0078bc0 0x7f2df007b0d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.119+0000 7f2e0a3b6640 1 --2- 172.21.15.78:0/378321408 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2e040b9b60 0x7f2e041f5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.119+0000 7f2e0a3b6640 1 -- 172.21.15.78:0/378321408 >> 172.21.15.78:0/378321408 conn(0x7f2e0409d7f0 msgr2=0x7f2e040d4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:32.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.119+0000 7f2e0a3b6640 1 -- 172.21.15.78:0/378321408 shutdown_connections 2024-09-17T03:13:32.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.119+0000 7f2e0a3b6640 1 -- 172.21.15.78:0/378321408 wait complete. 2024-09-17T03:13:32.130 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:13:32.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.242+0000 7fa55fade640 1 -- 172.21.15.78:0/351238526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580cc1e0 msgr2=0x7fa5580af3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:32.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.242+0000 7fa55fade640 1 --2- 172.21.15.78:0/351238526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580cc1e0 0x7fa5580af3c0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fa558072bc0 tx=0x7fa54802aa30 comp rx=0 tx=0).stop 2024-09-17T03:13:32.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.242+0000 7fa55fade640 1 -- 172.21.15.78:0/351238526 shutdown_connections 2024-09-17T03:13:32.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.242+0000 7fa55fade640 1 --2- 172.21.15.78:0/351238526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa5580ccb50 0x7fa5580ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.242+0000 7fa55fade640 1 --2- 172.21.15.78:0/351238526 >> v2:172.21.15.193:3300/0 conn(0x7fa55815d8a0 0x7fa5580b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.242+0000 7fa55fade640 1 --2- 172.21.15.78:0/351238526 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580cc1e0 0x7fa5580af3c0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.242+0000 7fa55fade640 1 -- 172.21.15.78:0/351238526 >> 172.21.15.78:0/351238526 conn(0x7fa55806d7d0 msgr2=0x7fa5580b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:32.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.242+0000 7fa55fade640 1 -- 172.21.15.78:0/351238526 shutdown_connections 2024-09-17T03:13:32.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.242+0000 7fa55fade640 1 -- 172.21.15.78:0/351238526 wait complete. 2024-09-17T03:13:32.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.244+0000 7fa55fade640 1 Processor -- start 2024-09-17T03:13:32.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.244+0000 7fa55fade640 1 -- start start 2024-09-17T03:13:32.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.245+0000 7fa55fade640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5580cc1e0 0x7fa5581419c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:32.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.245+0000 7fa55fade640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580ccb50 0x7fa55806f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:32.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.245+0000 7fa55fade640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa55815d8a0 0x7fa55806fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:32.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.245+0000 7fa55fade640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa5580b4770 con 0x7fa5580ccb50 2024-09-17T03:13:32.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.245+0000 7fa55fade640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa5580b45f0 con 0x7fa5580cc1e0 2024-09-17T03:13:32.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.245+0000 7fa55fade640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa5581533a0 con 0x7fa55815d8a0 2024-09-17T03:13:32.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.245+0000 7fa55d079640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580ccb50 0x7fa55806f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:32.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.245+0000 7fa55d079640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580ccb50 0x7fa55806f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50176/0 (socket says 172.21.15.78:50176) 2024-09-17T03:13:32.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.245+0000 7fa55d079640 1 -- 172.21.15.78:0/1777068375 learned_addr learned my addr 172.21.15.78:0/1777068375 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:32.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.245+0000 7fa55d87a640 1 --2- 172.21.15.78:0/1777068375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5580cc1e0 0x7fa5581419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:32.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.245+0000 7fa55e07b640 1 --2- 172.21.15.78:0/1777068375 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa55815d8a0 0x7fa55806fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:32.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.245+0000 7fa55d079640 1 -- 172.21.15.78:0/1777068375 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa55815d8a0 msgr2=0x7fa55806fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:32.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.245+0000 7fa55d079640 1 --2- 172.21.15.78:0/1777068375 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa55815d8a0 0x7fa55806fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.245+0000 7fa55d079640 1 -- 172.21.15.78:0/1777068375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5580cc1e0 msgr2=0x7fa5581419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:32.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.245+0000 7fa55d079640 1 --2- 172.21.15.78:0/1777068375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5580cc1e0 0x7fa5581419c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.245+0000 7fa55d079640 1 -- 172.21.15.78:0/1777068375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55809ceb0 con 0x7fa5580ccb50 2024-09-17T03:13:32.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.246+0000 7fa55d079640 1 --2- 172.21.15.78:0/1777068375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580ccb50 0x7fa55806f650 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00c9a0 tx=0x7fa54c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:32.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.246+0000 7fa5567fc640 1 -- 172.21.15.78:0/1777068375 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c007bb0 con 0x7fa5580ccb50 2024-09-17T03:13:32.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.246+0000 7fa5567fc640 1 -- 172.21.15.78:0/1777068375 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa54c007e40 con 0x7fa5580ccb50 2024-09-17T03:13:32.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.246+0000 7fa55fade640 1 -- 172.21.15.78:0/1777068375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa55809d150 con 0x7fa5580ccb50 2024-09-17T03:13:32.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.246+0000 7fa5567fc640 1 -- 172.21.15.78:0/1777068375 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54c005280 con 0x7fa5580ccb50 2024-09-17T03:13:32.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.246+0000 7fa55fade640 1 -- 172.21.15.78:0/1777068375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa55809d710 con 0x7fa5580ccb50 2024-09-17T03:13:32.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.247+0000 7fa55fade640 1 -- 172.21.15.78:0/1777068375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa558142540 con 0x7fa5580ccb50 2024-09-17T03:13:32.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.248+0000 7fa5567fc640 1 -- 172.21.15.78:0/1777068375 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa54c005420 con 0x7fa5580ccb50 2024-09-17T03:13:32.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.248+0000 7fa5567fc640 1 --2- 172.21.15.78:0/1777068375 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa544078bc0 0x7fa54407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:32.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.248+0000 7fa5567fc640 1 -- 172.21.15.78:0/1777068375 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 4857+0+0 (secure 0 0 0) 0x7fa54c09ad60 con 0x7fa5580ccb50 2024-09-17T03:13:32.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.248+0000 7fa55d87a640 1 --2- 172.21.15.78:0/1777068375 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa544078bc0 0x7fa54407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:32.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.249+0000 7fa55d87a640 1 --2- 172.21.15.78:0/1777068375 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa544078bc0 0x7fa54407b0d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa548035000 tx=0x7fa548004ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:32.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.252+0000 7fa5567fc640 1 -- 172.21.15.78:0/1777068375 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa54c014030 con 0x7fa5580ccb50 2024-09-17T03:13:32.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.497+0000 7fa55fade640 1 -- 172.21.15.78:0/1777068375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa5580ccf60 con 0x7fa5580ccb50 2024-09-17T03:13:32.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.497+0000 7fa5567fc640 1 -- 172.21.15.78:0/1777068375 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7fa54c063640 con 0x7fa5580ccb50 2024-09-17T03:13:32.496 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:32.496 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:13:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2024-09-17T03:13:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:13:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2024-09-17T03:13:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmF3icCRAAZEAXi3RiY/e4JSSr1nd2sQ==", 2024-09-17T03:13:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:13:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:13:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:13:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:13:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:13:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:13:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:13:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2024-09-17T03:13:32.497 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmzFPWFhAAptFKHxH9Xy3l9q0gxLARBQ==", 2024-09-17T03:13:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:13:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:13:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:13:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:13:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:13:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:13:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:13:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2024-09-17T03:13:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmFoc7ERAAlPpal3pKHjPKFotpPiJ9dA==", 2024-09-17T03:13:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:13:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:13:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:13:32.498 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:13:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:13:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:13:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:13:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2024-09-17T03:13:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmYJ2aHhAAhG6Sw6iZDy6s0qpiSLc//A==", 2024-09-17T03:13:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:13:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:13:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:13:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:13:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:13:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.499 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:13:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:13:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2024-09-17T03:13:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBy8uhmiaXeOhAAbhD0AqPz5JYg9CvycMk6cQ==", 2024-09-17T03:13:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:13:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:13:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:13:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:13:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:13:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:13:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2024-09-17T03:13:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB28uhmWT32HxAAATHdxAa6QOLYGnpPCx72iA==", 2024-09-17T03:13:32.500 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:13:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:13:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:13:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:13:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:13:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:13:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2024-09-17T03:13:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB58uhmTOOMMBAA4YSlpqeuxlIXypxCpxDJ+Q==", 2024-09-17T03:13:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:13:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:13:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:13:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:13:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.501 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:13:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:13:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2024-09-17T03:13:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB88uhmSgx6MxAAKHGCbjfVZTyeb0nX2xKkSQ==", 2024-09-17T03:13:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:13:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:13:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:13:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:13:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:13:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:13:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2024-09-17T03:13:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCD8uhmNKZkBBAAZwn1Xf+fd3GNeP4etvNePg==", 2024-09-17T03:13:32.502 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:13:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:13:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:13:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:13:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:13:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:13:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2024-09-17T03:13:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCG8uhmDTyzBhAAzeipRWM5M2fjCQt7xDGBwA==", 2024-09-17T03:13:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:13:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:13:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:13:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:13:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.503 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:13:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:13:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2024-09-17T03:13:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCJ8uhmDsZLGBAAB3VNeHQoty+fQwvYpRkltw==", 2024-09-17T03:13:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:13:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:13:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:13:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:13:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:13:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:13:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2024-09-17T03:13:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCM8uhm3PkQKRAAjJV2xFyyoACLkA3f/lFhWw==", 2024-09-17T03:13:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:13:32.504 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:13:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:13:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:13:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:13:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:13:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2024-09-17T03:13:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmn+c/IxAALXG+Qkwye7zc6PjcLBsk1g==", 2024-09-17T03:13:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:13:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:13:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow r", 2024-09-17T03:13:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:13:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:13:32.505 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:13:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2024-09-17T03:13:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmbzjQKhAAr/DB8TDsiWPsLHnsvUaTiw==", 2024-09-17T03:13:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:13:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:13:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2024-09-17T03:13:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2024-09-17T03:13:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2024-09-17T03:13:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:13:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:13:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.2", 2024-09-17T03:13:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmB9ABJxAATgS37nY3a3bX8wK1H3S/8A==", 2024-09-17T03:13:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:13:32.506 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:13:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2024-09-17T03:13:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2024-09-17T03:13:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2024-09-17T03:13:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:13:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:13:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.3", 2024-09-17T03:13:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmyhGmLhAAIfkcz3KW+qZ1qDOqQdPS5g==", 2024-09-17T03:13:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:13:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:13:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2024-09-17T03:13:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2024-09-17T03:13:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2024-09-17T03:13:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.507 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:13:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:13:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2024-09-17T03:13:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBu8uhmBgTvJxAAP2vhORVoAAnDSVpnLukIaA==", 2024-09-17T03:13:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:13:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2024-09-17T03:13:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:13:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:13:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:13:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:13:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:13:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2024-09-17T03:13:32.508 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmcpvVBRAA2JTbv0LrIc7seMyOmOIBmA==", 2024-09-17T03:13:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:13:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2024-09-17T03:13:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2024-09-17T03:13:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:13:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:13:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:13:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2024-09-17T03:13:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhm1SeKARAA2hyytqNjqToQ0K+RgQ8Tbg==", 2024-09-17T03:13:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:13:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2024-09-17T03:13:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2024-09-17T03:13:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:13:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.509 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.510 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-17T03:13:32.510 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:13:32.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.500+0000 7fa55fade640 1 -- 172.21.15.78:0/1777068375 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa544078bc0 msgr2=0x7fa54407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:32.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.500+0000 7fa55fade640 1 --2- 172.21.15.78:0/1777068375 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa544078bc0 0x7fa54407b0d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa548035000 tx=0x7fa548004ab0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.500+0000 7fa55fade640 1 -- 172.21.15.78:0/1777068375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580ccb50 msgr2=0x7fa55806f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:32.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.500+0000 7fa55fade640 1 --2- 172.21.15.78:0/1777068375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580ccb50 0x7fa55806f650 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00c9a0 tx=0x7fa54c00ce60 comp rx=0 tx=0).stop 2024-09-17T03:13:32.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.500+0000 7fa55fade640 1 -- 172.21.15.78:0/1777068375 shutdown_connections 2024-09-17T03:13:32.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.500+0000 7fa55fade640 1 --2- 172.21.15.78:0/1777068375 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa55815d8a0 0x7fa55806fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.500+0000 7fa55fade640 1 --2- 172.21.15.78:0/1777068375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5580ccb50 0x7fa55806f650 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.500+0000 7fa55fade640 1 --2- 172.21.15.78:0/1777068375 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa544078bc0 0x7fa54407b0d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.500+0000 7fa55fade640 1 --2- 172.21.15.78:0/1777068375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5580cc1e0 0x7fa5581419c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.500+0000 7fa55fade640 1 -- 172.21.15.78:0/1777068375 >> 172.21.15.78:0/1777068375 conn(0x7fa55806d7d0 msgr2=0x7fa5580b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:32.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.500+0000 7fa55fade640 1 -- 172.21.15.78:0/1777068375 shutdown_connections 2024-09-17T03:13:32.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.500+0000 7fa55fade640 1 -- 172.21.15.78:0/1777068375 wait complete. 2024-09-17T03:13:32.512 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:13:32.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.668+0000 7f2279f7b640 1 -- 172.21.15.78:0/937700317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2274144270 msgr2=0x7f22740b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:32.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.668+0000 7f2279f7b640 1 --2- 172.21.15.78:0/937700317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2274144270 0x7f22740b5680 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f2264009830 tx=0x7f226402a510 comp rx=0 tx=0).stop 2024-09-17T03:13:32.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.668+0000 7f2279f7b640 1 -- 172.21.15.78:0/937700317 shutdown_connections 2024-09-17T03:13:32.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.668+0000 7f2279f7b640 1 --2- 172.21.15.78:0/937700317 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2274142270 0x7f2274073e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.668+0000 7f2279f7b640 1 --2- 172.21.15.78:0/937700317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2274144270 0x7f22740b5680 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.668+0000 7f2279f7b640 1 -- 172.21.15.78:0/937700317 >> 172.21.15.78:0/937700317 conn(0x7f22740d15f0 msgr2=0x7f2274073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:32.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.668+0000 7f2279f7b640 1 -- 172.21.15.78:0/937700317 shutdown_connections 2024-09-17T03:13:32.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.668+0000 7f2279f7b640 1 -- 172.21.15.78:0/937700317 wait complete. 2024-09-17T03:13:32.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.669+0000 7f2279f7b640 1 Processor -- start 2024-09-17T03:13:32.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.670+0000 7f2279f7b640 1 -- start start 2024-09-17T03:13:32.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.671+0000 7f2279f7b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2274142270 0x7f2274152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:32.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.671+0000 7f2279f7b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2274142680 0x7f2274143520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:32.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.671+0000 7f2279f7b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2274144270 0x7f22741577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:32.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.671+0000 7f2279f7b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f22740d06f0 con 0x7f2274142680 2024-09-17T03:13:32.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.671+0000 7f2279f7b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f22740d0570 con 0x7f2274142270 2024-09-17T03:13:32.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.671+0000 7f2279f7b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f22740d0870 con 0x7f2274144270 2024-09-17T03:13:32.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.671+0000 7f2272ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2274142680 0x7f2274143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:32.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.671+0000 7f2272ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2274142680 0x7f2274143520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50208/0 (socket says 172.21.15.78:50208) 2024-09-17T03:13:32.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.671+0000 7f2272ffd640 1 -- 172.21.15.78:0/3517490494 learned_addr learned my addr 172.21.15.78:0/3517490494 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:32.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.671+0000 7f22737fe640 1 --2- 172.21.15.78:0/3517490494 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2274142270 0x7f2274152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:32.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.671+0000 7f2273fff640 1 --2- 172.21.15.78:0/3517490494 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2274144270 0x7f22741577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:32.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.671+0000 7f2272ffd640 1 -- 172.21.15.78:0/3517490494 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2274144270 msgr2=0x7f22741577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:32.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.671+0000 7f2272ffd640 1 --2- 172.21.15.78:0/3517490494 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2274144270 0x7f22741577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.671+0000 7f2272ffd640 1 -- 172.21.15.78:0/3517490494 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2274142270 msgr2=0x7f2274152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:32.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.671+0000 7f2272ffd640 1 --2- 172.21.15.78:0/3517490494 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2274142270 0x7f2274152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.671+0000 7f2272ffd640 1 -- 172.21.15.78:0/3517490494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22741540f0 con 0x7f2274142680 2024-09-17T03:13:32.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.672+0000 7f2272ffd640 1 --2- 172.21.15.78:0/3517490494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2274142680 0x7f2274143520 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f226800d740 tx=0x7f226800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:32.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.672+0000 7f225bfff640 1 -- 172.21.15.78:0/3517490494 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2268017070 con 0x7f2274142680 2024-09-17T03:13:32.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.672+0000 7f225bfff640 1 -- 172.21.15.78:0/3517490494 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2268009d20 con 0x7f2274142680 2024-09-17T03:13:32.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.672+0000 7f2279f7b640 1 -- 172.21.15.78:0/3517490494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22741543d0 con 0x7f2274142680 2024-09-17T03:13:32.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.672+0000 7f225bfff640 1 -- 172.21.15.78:0/3517490494 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22680106c0 con 0x7f2274142680 2024-09-17T03:13:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.672+0000 7f2279f7b640 1 -- 172.21.15.78:0/3517490494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2274154990 con 0x7f2274142680 2024-09-17T03:13:32.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.673+0000 7f2279f7b640 1 -- 172.21.15.78:0/3517490494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2274074550 con 0x7f2274142680 2024-09-17T03:13:32.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.673+0000 7f225bfff640 1 -- 172.21.15.78:0/3517490494 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f226801a070 con 0x7f2274142680 2024-09-17T03:13:32.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.674+0000 7f225bfff640 1 --2- 172.21.15.78:0/3517490494 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2260078b90 0x7f226007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:32.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.674+0000 7f225bfff640 1 -- 172.21.15.78:0/3517490494 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 4857+0+0 (secure 0 0 0) 0x7f226809abc0 con 0x7f2274142680 2024-09-17T03:13:32.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.674+0000 7f22737fe640 1 --2- 172.21.15.78:0/3517490494 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2260078b90 0x7f226007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:32.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.675+0000 7f22737fe640 1 --2- 172.21.15.78:0/3517490494 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2260078b90 0x7f226007b0a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2264034000 tx=0x7f2264004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:32.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.678+0000 7f225bfff640 1 -- 172.21.15.78:0/3517490494 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2268063350 con 0x7f2274142680 2024-09-17T03:13:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.856+0000 7f2279f7b640 1 -- 172.21.15.78:0/3517490494 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f227415e310 con 0x7f2274142680 2024-09-17T03:13:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.857+0000 7f225bfff640 1 -- 172.21.15.78:0/3517490494 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v78) ==== 84+0+65 (secure 0 0 0) 0x7f2268062c50 con 0x7f2274142680 2024-09-17T03:13:32.856 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:32.856 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2024-09-17T03:13:32.856 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:13:32.856 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2024-09-17T03:13:32.856 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2024-09-17T03:13:32.856 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:13:32.856 INFO:teuthology.orchestra.run.smithi078.stdout:] 2024-09-17T03:13:32.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.859+0000 7f2279f7b640 1 -- 172.21.15.78:0/3517490494 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2260078b90 msgr2=0x7f226007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:32.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.859+0000 7f2279f7b640 1 --2- 172.21.15.78:0/3517490494 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2260078b90 0x7f226007b0a0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2264034000 tx=0x7f2264004730 comp rx=0 tx=0).stop 2024-09-17T03:13:32.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.859+0000 7f2279f7b640 1 -- 172.21.15.78:0/3517490494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2274142680 msgr2=0x7f2274143520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:32.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.859+0000 7f2279f7b640 1 --2- 172.21.15.78:0/3517490494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2274142680 0x7f2274143520 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f226800d740 tx=0x7f226800dc00 comp rx=0 tx=0).stop 2024-09-17T03:13:32.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.859+0000 7f2279f7b640 1 -- 172.21.15.78:0/3517490494 shutdown_connections 2024-09-17T03:13:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.859+0000 7f2279f7b640 1 --2- 172.21.15.78:0/3517490494 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2274144270 0x7f22741577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.859+0000 7f2279f7b640 1 --2- 172.21.15.78:0/3517490494 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2274142680 0x7f2274143520 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.859+0000 7f2279f7b640 1 --2- 172.21.15.78:0/3517490494 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2260078b90 0x7f226007b0a0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.859+0000 7f2279f7b640 1 --2- 172.21.15.78:0/3517490494 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2274142270 0x7f2274152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.859+0000 7f2279f7b640 1 -- 172.21.15.78:0/3517490494 >> 172.21.15.78:0/3517490494 conn(0x7f22740d15f0 msgr2=0x7f2274073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.859+0000 7f2279f7b640 1 -- 172.21.15.78:0/3517490494 shutdown_connections 2024-09-17T03:13:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.859+0000 7f2279f7b640 1 -- 172.21.15.78:0/3517490494 wait complete. 2024-09-17T03:13:32.869 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:13:32.870 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:13:32.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.987+0000 7fcbadd20640 1 -- 172.21.15.78:0/4014322997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcba81601c0 msgr2=0x7fcba80d1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:32.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.987+0000 7fcbadd20640 1 --2- 172.21.15.78:0/4014322997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcba81601c0 0x7fcba80d1b60 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fcba81605d0 tx=0x7fcb9802a560 comp rx=0 tx=0).stop 2024-09-17T03:13:32.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.988+0000 7fcbadd20640 1 -- 172.21.15.78:0/4014322997 shutdown_connections 2024-09-17T03:13:32.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.988+0000 7fcbadd20640 1 --2- 172.21.15.78:0/4014322997 >> v2:172.21.15.193:3300/0 conn(0x7fcba80d0340 0x7fcba80ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.988+0000 7fcbadd20640 1 --2- 172.21.15.78:0/4014322997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcba81601c0 0x7fcba80d1b60 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.988+0000 7fcbadd20640 1 -- 172.21.15.78:0/4014322997 >> 172.21.15.78:0/4014322997 conn(0x7fcba8072a90 msgr2=0x7fcba8072ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:32.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.988+0000 7fcbadd20640 1 -- 172.21.15.78:0/4014322997 shutdown_connections 2024-09-17T03:13:32.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.988+0000 7fcbadd20640 1 -- 172.21.15.78:0/4014322997 wait complete. 2024-09-17T03:13:32.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.989+0000 7fcbadd20640 1 Processor -- start 2024-09-17T03:13:32.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.990+0000 7fcbadd20640 1 -- start start 2024-09-17T03:13:32.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.991+0000 7fcbadd20640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcba80cff30 0x7fcba80b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:32.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.991+0000 7fcbadd20640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcba80d0340 0x7fcba80b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:32.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.991+0000 7fcbadd20640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcba81601c0 0x7fcba80b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:32.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.991+0000 7fcbadd20640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcba815d460 con 0x7fcba80d0340 2024-09-17T03:13:32.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.991+0000 7fcbadd20640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcba815d2e0 con 0x7fcba81601c0 2024-09-17T03:13:32.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.991+0000 7fcbadd20640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fcba815d5e0 con 0x7fcba80cff30 2024-09-17T03:13:32.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.991+0000 7fcba6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcba80d0340 0x7fcba80b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:32.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.991+0000 7fcba6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcba80d0340 0x7fcba80b25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50212/0 (socket says 172.21.15.78:50212) 2024-09-17T03:13:32.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.991+0000 7fcba6ffd640 1 -- 172.21.15.78:0/130482659 learned_addr learned my addr 172.21.15.78:0/130482659 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:32.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.991+0000 7fcba77fe640 1 --2- 172.21.15.78:0/130482659 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcba80cff30 0x7fcba80b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:32.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.991+0000 7fcba7fff640 1 --2- 172.21.15.78:0/130482659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcba81601c0 0x7fcba80b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:32.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.991+0000 7fcba6ffd640 1 -- 172.21.15.78:0/130482659 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcba80cff30 msgr2=0x7fcba80b65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:32.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.991+0000 7fcba6ffd640 1 --2- 172.21.15.78:0/130482659 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcba80cff30 0x7fcba80b65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.991+0000 7fcba6ffd640 1 -- 172.21.15.78:0/130482659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcba81601c0 msgr2=0x7fcba80b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:32.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.991+0000 7fcba6ffd640 1 --2- 172.21.15.78:0/130482659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcba81601c0 0x7fcba80b2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:32.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.991+0000 7fcba6ffd640 1 -- 172.21.15.78:0/130482659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcba80b7bd0 con 0x7fcba80d0340 2024-09-17T03:13:32.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.991+0000 7fcba6ffd640 1 --2- 172.21.15.78:0/130482659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcba80d0340 0x7fcba80b25f0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00b3c0 tx=0x7fcb9c00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:32.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.992+0000 7fcb8ffff640 1 -- 172.21.15.78:0/130482659 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c011830 con 0x7fcba80d0340 2024-09-17T03:13:32.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.992+0000 7fcb8ffff640 1 -- 172.21.15.78:0/130482659 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb9c016070 con 0x7fcba80d0340 2024-09-17T03:13:32.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.992+0000 7fcb8ffff640 1 -- 172.21.15.78:0/130482659 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c011d60 con 0x7fcba80d0340 2024-09-17T03:13:32.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.992+0000 7fcbadd20640 1 -- 172.21.15.78:0/130482659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcba80b7eb0 con 0x7fcba80d0340 2024-09-17T03:13:32.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.992+0000 7fcbadd20640 1 -- 172.21.15.78:0/130482659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcba80ca520 con 0x7fcba80d0340 2024-09-17T03:13:32.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.993+0000 7fcbadd20640 1 -- 172.21.15.78:0/130482659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcba8076820 con 0x7fcba80d0340 2024-09-17T03:13:32.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.993+0000 7fcb8ffff640 1 -- 172.21.15.78:0/130482659 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcb9c01b460 con 0x7fcba80d0340 2024-09-17T03:13:32.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.994+0000 7fcb8ffff640 1 --2- 172.21.15.78:0/130482659 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcb94078b90 0x7fcb9407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:32.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.994+0000 7fcb8ffff640 1 -- 172.21.15.78:0/130482659 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 4857+0+0 (secure 0 0 0) 0x7fcb9c09a340 con 0x7fcba80d0340 2024-09-17T03:13:32.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.994+0000 7fcba77fe640 1 --2- 172.21.15.78:0/130482659 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcb94078b90 0x7fcb9407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:32.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.995+0000 7fcba77fe640 1 --2- 172.21.15.78:0/130482659 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcb94078b90 0x7fcb9407b0a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcb98033000 tx=0x7fcb98004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:32.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:32.998+0000 7fcb8ffff640 1 -- 172.21.15.78:0/130482659 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcb9c020020 con 0x7fcba80d0340 2024-09-17T03:13:33.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:33.173+0000 7fcbadd20640 1 -- 172.21.15.78:0/130482659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fcba815daf0 con 0x7fcba80d0340 2024-09-17T03:13:34.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.123+0000 7fcb8ffff640 1 -- 172.21.15.78:0/130482659 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v79) ==== 138+0+0 (secure 0 0 0) 0x7fcb9c062480 con 0x7fcba80d0340 2024-09-17T03:13:34.122 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2024-09-17T03:13:34.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.127+0000 7fcbadd20640 1 -- 172.21.15.78:0/130482659 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcb94078b90 msgr2=0x7fcb9407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:34.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.127+0000 7fcbadd20640 1 --2- 172.21.15.78:0/130482659 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcb94078b90 0x7fcb9407b0a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcb98033000 tx=0x7fcb98004730 comp rx=0 tx=0).stop 2024-09-17T03:13:34.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.127+0000 7fcbadd20640 1 -- 172.21.15.78:0/130482659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcba80d0340 msgr2=0x7fcba80b25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:34.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.127+0000 7fcbadd20640 1 --2- 172.21.15.78:0/130482659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcba80d0340 0x7fcba80b25f0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c00b3c0 tx=0x7fcb9c00b880 comp rx=0 tx=0).stop 2024-09-17T03:13:34.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.127+0000 7fcbadd20640 1 -- 172.21.15.78:0/130482659 shutdown_connections 2024-09-17T03:13:34.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.127+0000 7fcbadd20640 1 --2- 172.21.15.78:0/130482659 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcb94078b90 0x7fcb9407b0a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:34.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.127+0000 7fcbadd20640 1 --2- 172.21.15.78:0/130482659 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcba81601c0 0x7fcba80b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:34.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.127+0000 7fcbadd20640 1 --2- 172.21.15.78:0/130482659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcba80d0340 0x7fcba80b25f0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:34.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.127+0000 7fcbadd20640 1 --2- 172.21.15.78:0/130482659 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcba80cff30 0x7fcba80b65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:34.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.127+0000 7fcbadd20640 1 -- 172.21.15.78:0/130482659 >> 172.21.15.78:0/130482659 conn(0x7fcba8072a90 msgr2=0x7fcba80d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:34.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.127+0000 7fcbadd20640 1 -- 172.21.15.78:0/130482659 shutdown_connections 2024-09-17T03:13:34.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.127+0000 7fcbadd20640 1 -- 172.21.15.78:0/130482659 wait complete. 2024-09-17T03:13:34.144 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:13:34.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.270+0000 7f74ca320640 1 -- 172.21.15.78:0/288827177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74c406f4b0 msgr2=0x7f74c40d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:34.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.270+0000 7f74ca320640 1 --2- 172.21.15.78:0/288827177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74c406f4b0 0x7f74c40d3330 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009860 tx=0x7f74b802a4b0 comp rx=0 tx=0).stop 2024-09-17T03:13:34.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.270+0000 7f74ca320640 1 -- 172.21.15.78:0/288827177 shutdown_connections 2024-09-17T03:13:34.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.270+0000 7f74ca320640 1 --2- 172.21.15.78:0/288827177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74c406f4b0 0x7f74c40d3330 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:34.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.270+0000 7f74ca320640 1 --2- 172.21.15.78:0/288827177 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74c406e170 0x7f74c40b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:34.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.270+0000 7f74ca320640 1 -- 172.21.15.78:0/288827177 >> 172.21.15.78:0/288827177 conn(0x7f74c408bfc0 msgr2=0x7f74c409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:34.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.270+0000 7f74ca320640 1 -- 172.21.15.78:0/288827177 shutdown_connections 2024-09-17T03:13:34.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.271+0000 7f74ca320640 1 -- 172.21.15.78:0/288827177 wait complete. 2024-09-17T03:13:34.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.272+0000 7f74ca320640 1 Processor -- start 2024-09-17T03:13:34.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.272+0000 7f74ca320640 1 -- start start 2024-09-17T03:13:34.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.274+0000 7f74ca320640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74c406f4b0 0x7f74c415cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:34.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.274+0000 7f74ca320640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74c40d3870 0x7f74c40b7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:34.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.274+0000 7f74ca320640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74c415dc20 0x7f74c40b8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:34.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.274+0000 7f74ca320640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f74c40d0e60 con 0x7f74c40d3870 2024-09-17T03:13:34.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.274+0000 7f74ca320640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f74c40d0ce0 con 0x7f74c415dc20 2024-09-17T03:13:34.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.274+0000 7f74ca320640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f74c40d0fe0 con 0x7f74c406f4b0 2024-09-17T03:13:34.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.274+0000 7f74c37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74c40d3870 0x7f74c40b7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:34.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.274+0000 7f74c37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74c40d3870 0x7f74c40b7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50232/0 (socket says 172.21.15.78:50232) 2024-09-17T03:13:34.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.274+0000 7f74c37fe640 1 -- 172.21.15.78:0/244853706 learned_addr learned my addr 172.21.15.78:0/244853706 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:34.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.274+0000 7f74c3fff640 1 --2- 172.21.15.78:0/244853706 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74c406f4b0 0x7f74c415cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:34.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.274+0000 7f74c88bd640 1 --2- 172.21.15.78:0/244853706 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74c415dc20 0x7f74c40b8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:34.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.274+0000 7f74c37fe640 1 -- 172.21.15.78:0/244853706 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74c406f4b0 msgr2=0x7f74c415cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:34.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.274+0000 7f74c37fe640 1 --2- 172.21.15.78:0/244853706 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74c406f4b0 0x7f74c415cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:34.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.274+0000 7f74c37fe640 1 -- 172.21.15.78:0/244853706 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74c415dc20 msgr2=0x7f74c40b8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:34.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.274+0000 7f74c37fe640 1 --2- 172.21.15.78:0/244853706 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74c415dc20 0x7f74c40b8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:34.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.274+0000 7f74c37fe640 1 -- 172.21.15.78:0/244853706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74c41f97f0 con 0x7f74c40d3870 2024-09-17T03:13:34.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.274+0000 7f74c37fe640 1 --2- 172.21.15.78:0/244853706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74c40d3870 0x7f74c40b7b00 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009950 tx=0x7f74b8033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:34.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.274+0000 7f74c0ff9640 1 -- 172.21.15.78:0/244853706 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b8031d60 con 0x7f74c40d3870 2024-09-17T03:13:34.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.275+0000 7f74c0ff9640 1 -- 172.21.15.78:0/244853706 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74b8005020 con 0x7f74c40d3870 2024-09-17T03:13:34.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.275+0000 7f74ca320640 1 -- 172.21.15.78:0/244853706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74c40cb290 con 0x7f74c40d3870 2024-09-17T03:13:34.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.275+0000 7f74c0ff9640 1 -- 172.21.15.78:0/244853706 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b8005470 con 0x7f74c40d3870 2024-09-17T03:13:34.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.275+0000 7f74ca320640 1 -- 172.21.15.78:0/244853706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74c41e8c00 con 0x7f74c40d3870 2024-09-17T03:13:34.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.276+0000 7f74ca320640 1 -- 172.21.15.78:0/244853706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74c40d1500 con 0x7f74c40d3870 2024-09-17T03:13:34.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.276+0000 7f74c0ff9640 1 -- 172.21.15.78:0/244853706 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f74b80047a0 con 0x7f74c40d3870 2024-09-17T03:13:34.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.277+0000 7f74c0ff9640 1 --2- 172.21.15.78:0/244853706 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74b0078bc0 0x7f74b007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:34.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.277+0000 7f74c0ff9640 1 -- 172.21.15.78:0/244853706 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5227+0+0 (secure 0 0 0) 0x7f74b80bbdd0 con 0x7f74c40d3870 2024-09-17T03:13:34.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.277+0000 7f74c3fff640 1 --2- 172.21.15.78:0/244853706 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74b0078bc0 0x7f74b007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:34.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.278+0000 7f74c3fff640 1 --2- 172.21.15.78:0/244853706 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74b0078bc0 0x7f74b007b0d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f74b400a490 tx=0x7f74b400a420 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:34.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.282+0000 7f74c0ff9640 1 -- 172.21.15.78:0/244853706 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f74b803f030 con 0x7f74c40d3870 2024-09-17T03:13:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:34.456+0000 7f74ca320640 1 -- 172.21.15.78:0/244853706 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f74c40cf850 con 0x7f74c40d3870 2024-09-17T03:13:35.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.126+0000 7f74c0ff9640 1 -- 172.21.15.78:0/244853706 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v80) ==== 170+0+0 (secure 0 0 0) 0x7f74b80bd020 con 0x7f74c40d3870 2024-09-17T03:13:35.125 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2024-09-17T03:13:35.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.128+0000 7f74ca320640 1 -- 172.21.15.78:0/244853706 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74b0078bc0 msgr2=0x7f74b007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:35.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.128+0000 7f74ca320640 1 --2- 172.21.15.78:0/244853706 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74b0078bc0 0x7f74b007b0d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f74b400a490 tx=0x7f74b400a420 comp rx=0 tx=0).stop 2024-09-17T03:13:35.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.128+0000 7f74ca320640 1 -- 172.21.15.78:0/244853706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74c40d3870 msgr2=0x7f74c40b7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:35.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.128+0000 7f74ca320640 1 --2- 172.21.15.78:0/244853706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74c40d3870 0x7f74c40b7b00 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009950 tx=0x7f74b8033c90 comp rx=0 tx=0).stop 2024-09-17T03:13:35.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.128+0000 7f74ca320640 1 -- 172.21.15.78:0/244853706 shutdown_connections 2024-09-17T03:13:35.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.128+0000 7f74ca320640 1 --2- 172.21.15.78:0/244853706 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74b0078bc0 0x7f74b007b0d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:35.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.128+0000 7f74ca320640 1 --2- 172.21.15.78:0/244853706 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f74c415dc20 0x7f74c40b8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:35.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.128+0000 7f74ca320640 1 --2- 172.21.15.78:0/244853706 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74c40d3870 0x7f74c40b7b00 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:35.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.128+0000 7f74ca320640 1 --2- 172.21.15.78:0/244853706 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74c406f4b0 0x7f74c415cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:35.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.128+0000 7f74ca320640 1 -- 172.21.15.78:0/244853706 >> 172.21.15.78:0/244853706 conn(0x7f74c408bfc0 msgr2=0x7f74c40b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:35.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.128+0000 7f74ca320640 1 -- 172.21.15.78:0/244853706 shutdown_connections 2024-09-17T03:13:35.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.128+0000 7f74ca320640 1 -- 172.21.15.78:0/244853706 wait complete. 2024-09-17T03:13:35.149 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:13:35.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.266+0000 7f91045da640 1 -- 172.21.15.78:0/3537176057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc0b6100 msgr2=0x7f90fc0b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:35.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.266+0000 7f91045da640 1 --2- 172.21.15.78:0/3537176057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc0b6100 0x7f90fc0b14f0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f90f0009830 tx=0x7f90f002a480 comp rx=0 tx=0).stop 2024-09-17T03:13:35.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.266+0000 7f91045da640 1 -- 172.21.15.78:0/3537176057 shutdown_connections 2024-09-17T03:13:35.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.266+0000 7f91045da640 1 --2- 172.21.15.78:0/3537176057 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc0b6100 0x7f90fc0b14f0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:35.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.266+0000 7f91045da640 1 -- 172.21.15.78:0/3537176057 >> 172.21.15.78:0/3537176057 conn(0x7f90fc0d12a0 msgr2=0x7f90fc0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:35.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.266+0000 7f91045da640 1 -- 172.21.15.78:0/3537176057 shutdown_connections 2024-09-17T03:13:35.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.266+0000 7f91045da640 1 -- 172.21.15.78:0/3537176057 wait complete. 2024-09-17T03:13:35.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.268+0000 7f91045da640 1 Processor -- start 2024-09-17T03:13:35.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.268+0000 7f91045da640 1 -- start start 2024-09-17T03:13:35.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.269+0000 7f91045da640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90fc0b6100 0x7f90fc15dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:35.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.269+0000 7f91045da640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc0b6680 0x7f90fc165880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:35.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.269+0000 7f91045da640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f90fc162f60 0x7f90fc165dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:35.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.269+0000 7f91045da640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc166c20 con 0x7f90fc0b6680 2024-09-17T03:13:35.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.269+0000 7f91045da640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f90fc166aa0 con 0x7f90fc0b6100 2024-09-17T03:13:35.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.269+0000 7f91045da640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f90fc166da0 con 0x7f90fc162f60 2024-09-17T03:13:35.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.269+0000 7f9101b75640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc0b6680 0x7f90fc165880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:35.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.269+0000 7f9101b75640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc0b6680 0x7f90fc165880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50250/0 (socket says 172.21.15.78:50250) 2024-09-17T03:13:35.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.269+0000 7f9101b75640 1 -- 172.21.15.78:0/1929264253 learned_addr learned my addr 172.21.15.78:0/1929264253 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:35.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.270+0000 7f9102376640 1 --2- 172.21.15.78:0/1929264253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90fc0b6100 0x7f90fc15dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:35.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.270+0000 7f9102b77640 1 --2- 172.21.15.78:0/1929264253 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f90fc162f60 0x7f90fc165dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:35.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.270+0000 7f9101b75640 1 -- 172.21.15.78:0/1929264253 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f90fc162f60 msgr2=0x7f90fc165dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:35.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.270+0000 7f9101b75640 1 --2- 172.21.15.78:0/1929264253 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f90fc162f60 0x7f90fc165dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:35.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.270+0000 7f9101b75640 1 -- 172.21.15.78:0/1929264253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90fc0b6100 msgr2=0x7f90fc15dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:35.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.270+0000 7f9101b75640 1 --2- 172.21.15.78:0/1929264253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90fc0b6100 0x7f90fc15dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:35.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.270+0000 7f9101b75640 1 -- 172.21.15.78:0/1929264253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90fc06cf90 con 0x7f90fc0b6680 2024-09-17T03:13:35.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.270+0000 7f9102b77640 1 --2- 172.21.15.78:0/1929264253 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f90fc162f60 0x7f90fc165dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:35.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.270+0000 7f9102376640 1 --2- 172.21.15.78:0/1929264253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90fc0b6100 0x7f90fc15dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:35.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.270+0000 7f9101b75640 1 --2- 172.21.15.78:0/1929264253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc0b6680 0x7f90fc165880 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f90f002aa70 tx=0x7f90f0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:35.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.270+0000 7f90faffd640 1 -- 172.21.15.78:0/1929264253 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0031d60 con 0x7f90fc0b6680 2024-09-17T03:13:35.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.270+0000 7f90faffd640 1 -- 172.21.15.78:0/1929264253 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90f0033e10 con 0x7f90fc0b6680 2024-09-17T03:13:35.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.270+0000 7f91045da640 1 -- 172.21.15.78:0/1929264253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90fc06d270 con 0x7f90fc0b6680 2024-09-17T03:13:35.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.270+0000 7f90faffd640 1 -- 172.21.15.78:0/1929264253 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0005260 con 0x7f90fc0b6680 2024-09-17T03:13:35.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.270+0000 7f91045da640 1 -- 172.21.15.78:0/1929264253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90fc09bbe0 con 0x7f90fc0b6680 2024-09-17T03:13:35.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.271+0000 7f91045da640 1 -- 172.21.15.78:0/1929264253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90fc0b0de0 con 0x7f90fc0b6680 2024-09-17T03:13:35.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.272+0000 7f90faffd640 1 -- 172.21.15.78:0/1929264253 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f90f0005400 con 0x7f90fc0b6680 2024-09-17T03:13:35.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.272+0000 7f90faffd640 1 --2- 172.21.15.78:0/1929264253 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f90e8078bc0 0x7f90e807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:35.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.272+0000 7f90faffd640 1 -- 172.21.15.78:0/1929264253 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5609+0+0 (secure 0 0 0) 0x7f90f00bbef0 con 0x7f90fc0b6680 2024-09-17T03:13:35.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.273+0000 7f9102376640 1 --2- 172.21.15.78:0/1929264253 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f90e8078bc0 0x7f90e807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:35.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.273+0000 7f9102376640 1 --2- 172.21.15.78:0/1929264253 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f90e8078bc0 0x7f90e807b0d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0ceda0 tx=0x7f90ec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:35.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.277+0000 7f90faffd640 1 -- 172.21.15.78:0/1929264253 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f90f003f030 con 0x7f90fc0b6680 2024-09-17T03:13:35.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:35.488+0000 7f91045da640 1 -- 172.21.15.78:0/1929264253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f90fc0b5dd0 con 0x7f90fc0b6680 2024-09-17T03:13:36.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.159+0000 7f90faffd640 1 -- 172.21.15.78:0/1929264253 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v74) ==== 174+0+0 (secure 0 0 0) 0x7f90f0084420 con 0x7f90fc0b6680 2024-09-17T03:13:36.164 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 12 and data pool 13 2024-09-17T03:13:36.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.175+0000 7f91045da640 1 -- 172.21.15.78:0/1929264253 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f90e8078bc0 msgr2=0x7f90e807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:36.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.175+0000 7f91045da640 1 --2- 172.21.15.78:0/1929264253 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f90e8078bc0 0x7f90e807b0d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f90fc0ceda0 tx=0x7f90ec008040 comp rx=0 tx=0).stop 2024-09-17T03:13:36.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.175+0000 7f91045da640 1 -- 172.21.15.78:0/1929264253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc0b6680 msgr2=0x7f90fc165880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:36.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.175+0000 7f91045da640 1 --2- 172.21.15.78:0/1929264253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc0b6680 0x7f90fc165880 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f90f002aa70 tx=0x7f90f0033c20 comp rx=0 tx=0).stop 2024-09-17T03:13:36.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.179+0000 7f91045da640 1 -- 172.21.15.78:0/1929264253 shutdown_connections 2024-09-17T03:13:36.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.179+0000 7f91045da640 1 --2- 172.21.15.78:0/1929264253 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f90fc162f60 0x7f90fc165dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.179+0000 7f91045da640 1 --2- 172.21.15.78:0/1929264253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90fc0b6680 0x7f90fc165880 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.179+0000 7f91045da640 1 --2- 172.21.15.78:0/1929264253 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f90e8078bc0 0x7f90e807b0d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.179+0000 7f91045da640 1 --2- 172.21.15.78:0/1929264253 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f90fc0b6100 0x7f90fc15dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.179+0000 7f91045da640 1 -- 172.21.15.78:0/1929264253 >> 172.21.15.78:0/1929264253 conn(0x7f90fc0d12a0 msgr2=0x7f90fc0b49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:36.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.179+0000 7f91045da640 1 -- 172.21.15.78:0/1929264253 shutdown_connections 2024-09-17T03:13:36.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.179+0000 7f91045da640 1 -- 172.21.15.78:0/1929264253 wait complete. 2024-09-17T03:13:36.192 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:13:36.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.307+0000 7f014398e640 1 -- 172.21.15.78:0/1154970065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0128004d90 msgr2=0x7f0128005240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:36.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.307+0000 7f014398e640 1 --2- 172.21.15.78:0/1154970065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0128004d90 0x7f0128005240 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f0134001f00 tx=0x7f0128005830 comp rx=0 tx=0).stop 2024-09-17T03:13:36.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.307+0000 7f0141f2b640 1 -- 172.21.15.78:0/1154970065 reap_dead start 2024-09-17T03:13:36.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.307+0000 7f014398e640 1 -- 172.21.15.78:0/1154970065 shutdown_connections 2024-09-17T03:13:36.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.307+0000 7f014398e640 1 -- 172.21.15.78:0/1154970065 >> 172.21.15.78:0/1154970065 conn(0x7f013c08bfc0 msgr2=0x7f013c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:36.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.307+0000 7f014398e640 1 -- 172.21.15.78:0/1154970065 shutdown_connections 2024-09-17T03:13:36.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.307+0000 7f014398e640 1 -- 172.21.15.78:0/1154970065 wait complete. 2024-09-17T03:13:36.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.309+0000 7f014398e640 1 Processor -- start 2024-09-17T03:13:36.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.309+0000 7f014398e640 1 -- start start 2024-09-17T03:13:36.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.310+0000 7f014398e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0128004d90 0x7f013c0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:36.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.310+0000 7f014398e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f013c0c8a60 0x7f013c0c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:36.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.310+0000 7f014398e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f013c0c93b0 0x7f013c0cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:36.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.310+0000 7f014398e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f013c0cfd70 con 0x7f013c0c93b0 2024-09-17T03:13:36.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.310+0000 7f014398e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f013c0cfbf0 con 0x7f013c0c8a60 2024-09-17T03:13:36.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.310+0000 7f014398e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f013c0cd900 con 0x7f0128004d90 2024-09-17T03:13:36.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.310+0000 7f0141f2b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f013c0c93b0 0x7f013c0cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:36.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.310+0000 7f0141f2b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f013c0c93b0 0x7f013c0cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50268/0 (socket says 172.21.15.78:50268) 2024-09-17T03:13:36.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.310+0000 7f0141f2b640 1 -- 172.21.15.78:0/2769170662 learned_addr learned my addr 172.21.15.78:0/2769170662 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:36.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.310+0000 7f0140f29640 1 --2- 172.21.15.78:0/2769170662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f013c0c8a60 0x7f013c0c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:36.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.310+0000 7f014172a640 1 --2- 172.21.15.78:0/2769170662 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0128004d90 0x7f013c0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:36.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.310+0000 7f0141f2b640 1 -- 172.21.15.78:0/2769170662 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0128004d90 msgr2=0x7f013c0c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:36.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.310+0000 7f0141f2b640 1 --2- 172.21.15.78:0/2769170662 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0128004d90 0x7f013c0c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.310+0000 7f0141f2b640 1 -- 172.21.15.78:0/2769170662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f013c0c8a60 msgr2=0x7f013c0c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:36.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.310+0000 7f0141f2b640 1 --2- 172.21.15.78:0/2769170662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f013c0c8a60 0x7f013c0c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.310+0000 7f0141f2b640 1 -- 172.21.15.78:0/2769170662 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013c0ce6d0 con 0x7f013c0c93b0 2024-09-17T03:13:36.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.311+0000 7f0141f2b640 1 --2- 172.21.15.78:0/2769170662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f013c0c93b0 0x7f013c0cc5c0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f013402ada0 tx=0x7f0134006c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:36.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.311+0000 7f0131ffb640 1 -- 172.21.15.78:0/2769170662 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0134003d40 con 0x7f013c0c93b0 2024-09-17T03:13:36.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.311+0000 7f0131ffb640 1 -- 172.21.15.78:0/2769170662 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01340060b0 con 0x7f013c0c93b0 2024-09-17T03:13:36.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.311+0000 7f014398e640 1 -- 172.21.15.78:0/2769170662 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013c0cbae0 con 0x7f013c0c93b0 2024-09-17T03:13:36.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.311+0000 7f0131ffb640 1 -- 172.21.15.78:0/2769170662 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01340064c0 con 0x7f013c0c93b0 2024-09-17T03:13:36.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.311+0000 7f014398e640 1 -- 172.21.15.78:0/2769170662 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f013c0ca3c0 con 0x7f013c0c93b0 2024-09-17T03:13:36.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.312+0000 7f014398e640 1 -- 172.21.15.78:0/2769170662 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f013c1630e0 con 0x7f013c0c93b0 2024-09-17T03:13:36.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.313+0000 7f0131ffb640 1 -- 172.21.15.78:0/2769170662 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f013403d030 con 0x7f013c0c93b0 2024-09-17T03:13:36.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.313+0000 7f0131ffb640 1 --2- 172.21.15.78:0/2769170662 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0120078bc0 0x7f012007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:36.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.313+0000 7f0131ffb640 1 -- 172.21.15.78:0/2769170662 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f01340ba0d0 con 0x7f013c0c93b0 2024-09-17T03:13:36.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.313+0000 7f014172a640 1 --2- 172.21.15.78:0/2769170662 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0120078bc0 0x7f012007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:36.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.314+0000 7f014172a640 1 --2- 172.21.15.78:0/2769170662 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0120078bc0 0x7f012007b0d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0138001180 tx=0x7f0138001000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:36.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.318+0000 7f0131ffb640 1 -- 172.21.15.78:0/2769170662 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0134081ec0 con 0x7f013c0c93b0 2024-09-17T03:13:36.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.493+0000 7f014398e640 1 -- 172.21.15.78:0/2769170662 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f013c0d0760 con 0x7f013c0c93b0 2024-09-17T03:13:36.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.494+0000 7f0131ffb640 1 -- 172.21.15.78:0/2769170662 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+16709 (secure 0 0 0) 0x7f01340868f0 con 0x7f013c0c93b0 2024-09-17T03:13:36.493 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:36.494 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":81,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:13:35.489625+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:13:33.178329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T03:13:34.460993+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:13:36.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.496+0000 7f014398e640 1 -- 172.21.15.78:0/2769170662 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0120078bc0 msgr2=0x7f012007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:36.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.496+0000 7f014398e640 1 --2- 172.21.15.78:0/2769170662 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0120078bc0 0x7f012007b0d0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0138001180 tx=0x7f0138001000 comp rx=0 tx=0).stop 2024-09-17T03:13:36.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.496+0000 7f014398e640 1 -- 172.21.15.78:0/2769170662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f013c0c93b0 msgr2=0x7f013c0cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:36.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.496+0000 7f014398e640 1 --2- 172.21.15.78:0/2769170662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f013c0c93b0 0x7f013c0cc5c0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f013402ada0 tx=0x7f0134006c40 comp rx=0 tx=0).stop 2024-09-17T03:13:36.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.496+0000 7f014398e640 1 -- 172.21.15.78:0/2769170662 shutdown_connections 2024-09-17T03:13:36.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.496+0000 7f014398e640 1 --2- 172.21.15.78:0/2769170662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f013c0c93b0 0x7f013c0cc5c0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.496+0000 7f014398e640 1 --2- 172.21.15.78:0/2769170662 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0120078bc0 0x7f012007b0d0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.496+0000 7f014398e640 1 --2- 172.21.15.78:0/2769170662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f013c0c8a60 0x7f013c0c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.496+0000 7f014398e640 1 --2- 172.21.15.78:0/2769170662 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0128004d90 0x7f013c0c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.496+0000 7f014398e640 1 -- 172.21.15.78:0/2769170662 >> 172.21.15.78:0/2769170662 conn(0x7f013c08bfc0 msgr2=0x7f013c0d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:36.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.496+0000 7f014398e640 1 -- 172.21.15.78:0/2769170662 shutdown_connections 2024-09-17T03:13:36.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.496+0000 7f014398e640 1 -- 172.21.15.78:0/2769170662 wait complete. 2024-09-17T03:13:36.507 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:13:36.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.619+0000 7f9867c8b640 1 -- 172.21.15.78:0/2481853461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f986006cde0 msgr2=0x7f986006d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.619+0000 7f9867c8b640 1 --2- 172.21.15.78:0/2481853461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f986006cde0 0x7f986006d1f0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f9858005fd0 tx=0x7f985802a8d0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.619+0000 7f9867c8b640 1 -- 172.21.15.78:0/2481853461 shutdown_connections 2024-09-17T03:13:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.619+0000 7f9867c8b640 1 --2- 172.21.15.78:0/2481853461 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f986006cde0 0x7f986006d1f0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.619+0000 7f9867c8b640 1 --2- 172.21.15.78:0/2481853461 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f98600701b0 0x7f986015c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.619+0000 7f9867c8b640 1 -- 172.21.15.78:0/2481853461 >> 172.21.15.78:0/2481853461 conn(0x7f98600cdcb0 msgr2=0x7f98600ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.620+0000 7f9867c8b640 1 -- 172.21.15.78:0/2481853461 shutdown_connections 2024-09-17T03:13:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.620+0000 7f9867c8b640 1 -- 172.21.15.78:0/2481853461 wait complete. 2024-09-17T03:13:36.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.621+0000 7f9867c8b640 1 Processor -- start 2024-09-17T03:13:36.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.621+0000 7f9867c8b640 1 -- start start 2024-09-17T03:13:36.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9867c8b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f986006cde0 0x7f98601ea4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:36.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9867c8b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98600701b0 0x7f986014a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:36.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9867c8b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f986015f9f0 0x7f98600b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:36.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9867c8b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f98600b3560 con 0x7f98600701b0 2024-09-17T03:13:36.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9867c8b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f98600b33e0 con 0x7f986006cde0 2024-09-17T03:13:36.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9867c8b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f98600b36e0 con 0x7f986015f9f0 2024-09-17T03:13:36.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9865226640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98600701b0 0x7f986014a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:36.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9865226640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98600701b0 0x7f986014a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39358/0 (socket says 172.21.15.78:39358) 2024-09-17T03:13:36.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9865226640 1 -- 172.21.15.78:0/990610209 learned_addr learned my addr 172.21.15.78:0/990610209 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:36.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9866228640 1 --2- 172.21.15.78:0/990610209 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f986015f9f0 0x7f98600b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:36.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9865a27640 1 --2- 172.21.15.78:0/990610209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f986006cde0 0x7f98601ea4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:36.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9865226640 1 -- 172.21.15.78:0/990610209 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f986015f9f0 msgr2=0x7f98600b5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9865226640 1 --2- 172.21.15.78:0/990610209 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f986015f9f0 0x7f98600b5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9865226640 1 -- 172.21.15.78:0/990610209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f986006cde0 msgr2=0x7f98601ea4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9865226640 1 --2- 172.21.15.78:0/990610209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f986006cde0 0x7f98601ea4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9865226640 1 -- 172.21.15.78:0/990610209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986014b270 con 0x7f98600701b0 2024-09-17T03:13:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9865a27640 1 --2- 172.21.15.78:0/990610209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f986006cde0 0x7f98601ea4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9866228640 1 --2- 172.21.15.78:0/990610209 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f986015f9f0 0x7f98600b5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9865226640 1 --2- 172.21.15.78:0/990610209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98600701b0 0x7f986014a5b0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f98601624c0 tx=0x7f985000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f98567fc640 1 -- 172.21.15.78:0/990610209 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9850017070 con 0x7f98600701b0 2024-09-17T03:13:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f98567fc640 1 -- 172.21.15.78:0/990610209 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f98500035f0 con 0x7f98600701b0 2024-09-17T03:13:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9867c8b640 1 -- 172.21.15.78:0/990610209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98601486c0 con 0x7f98600701b0 2024-09-17T03:13:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f98567fc640 1 -- 172.21.15.78:0/990610209 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9850003a20 con 0x7f98600701b0 2024-09-17T03:13:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.623+0000 7f9867c8b640 1 -- 172.21.15.78:0/990610209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f986014a220 con 0x7f98600701b0 2024-09-17T03:13:36.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.624+0000 7f9867c8b640 1 -- 172.21.15.78:0/990610209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f986014afe0 con 0x7f98600701b0 2024-09-17T03:13:36.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.625+0000 7f98567fc640 1 -- 172.21.15.78:0/990610209 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f985001a070 con 0x7f98600701b0 2024-09-17T03:13:36.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.626+0000 7f98567fc640 1 --2- 172.21.15.78:0/990610209 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9844078b90 0x7f984407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:36.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.626+0000 7f98567fc640 1 -- 172.21.15.78:0/990610209 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f9850099e90 con 0x7f98600701b0 2024-09-17T03:13:36.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.626+0000 7f9865a27640 1 --2- 172.21.15.78:0/990610209 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9844078b90 0x7f984407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:36.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.626+0000 7f9865a27640 1 --2- 172.21.15.78:0/990610209 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9844078b90 0x7f984407b0a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f985c005fd0 tx=0x7f985c00f360 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:36.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.630+0000 7f98567fc640 1 -- 172.21.15.78:0/990610209 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f986006d730 con 0x7f98600701b0 2024-09-17T03:13:36.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.806+0000 7f9867c8b640 1 -- 172.21.15.78:0/990610209 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98600b3c00 con 0x7f98600701b0 2024-09-17T03:13:36.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.807+0000 7f98567fc640 1 -- 172.21.15.78:0/990610209 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+16709 (secure 0 0 0) 0x7f9850061cc0 con 0x7f98600701b0 2024-09-17T03:13:36.806 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:36.806 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":81,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:13:35.489625+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:13:33.178329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T03:13:34.460993+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:13:36.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.809+0000 7f9867c8b640 1 -- 172.21.15.78:0/990610209 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9844078b90 msgr2=0x7f984407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:36.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.809+0000 7f9867c8b640 1 --2- 172.21.15.78:0/990610209 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9844078b90 0x7f984407b0a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f985c005fd0 tx=0x7f985c00f360 comp rx=0 tx=0).stop 2024-09-17T03:13:36.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.809+0000 7f9867c8b640 1 -- 172.21.15.78:0/990610209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98600701b0 msgr2=0x7f986014a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:36.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.809+0000 7f9867c8b640 1 --2- 172.21.15.78:0/990610209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98600701b0 0x7f986014a5b0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f98601624c0 tx=0x7f985000c820 comp rx=0 tx=0).stop 2024-09-17T03:13:36.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.809+0000 7f9867c8b640 1 -- 172.21.15.78:0/990610209 shutdown_connections 2024-09-17T03:13:36.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.809+0000 7f9867c8b640 1 --2- 172.21.15.78:0/990610209 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f986015f9f0 0x7f98600b5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.809+0000 7f9867c8b640 1 --2- 172.21.15.78:0/990610209 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98600701b0 0x7f986014a5b0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.809+0000 7f9867c8b640 1 --2- 172.21.15.78:0/990610209 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9844078b90 0x7f984407b0a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.809+0000 7f9867c8b640 1 --2- 172.21.15.78:0/990610209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f986006cde0 0x7f98601ea4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.809+0000 7f9867c8b640 1 -- 172.21.15.78:0/990610209 >> 172.21.15.78:0/990610209 conn(0x7f98600cdcb0 msgr2=0x7f98600b4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:36.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.809+0000 7f9867c8b640 1 -- 172.21.15.78:0/990610209 shutdown_connections 2024-09-17T03:13:36.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.809+0000 7f9867c8b640 1 -- 172.21.15.78:0/990610209 wait complete. 2024-09-17T03:13:36.820 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:13:36.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.937+0000 7f42db884640 1 -- 172.21.15.78:0/1080268297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d40ca800 msgr2=0x7f42d40cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:36.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.937+0000 7f42db884640 1 --2- 172.21.15.78:0/1080268297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d40ca800 0x7f42d40cba00 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f42d0009830 tx=0x7f42d002a510 comp rx=0 tx=0).stop 2024-09-17T03:13:36.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.937+0000 7f42db884640 1 -- 172.21.15.78:0/1080268297 shutdown_connections 2024-09-17T03:13:36.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.937+0000 7f42db884640 1 --2- 172.21.15.78:0/1080268297 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d40ca800 0x7f42d40cba00 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.937+0000 7f42db884640 1 -- 172.21.15.78:0/1080268297 >> 172.21.15.78:0/1080268297 conn(0x7f42d40b1cb0 msgr2=0x7f42d40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:36.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.937+0000 7f42db884640 1 -- 172.21.15.78:0/1080268297 shutdown_connections 2024-09-17T03:13:36.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.937+0000 7f42db884640 1 -- 172.21.15.78:0/1080268297 wait complete. 2024-09-17T03:13:36.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.939+0000 7f42db884640 1 Processor -- start 2024-09-17T03:13:36.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.939+0000 7f42db884640 1 -- start start 2024-09-17T03:13:36.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.940+0000 7f42db884640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d40ca800 0x7f42d415e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:36.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.940+0000 7f42db884640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42d40cad30 0x7f42d406f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:36.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.940+0000 7f42db884640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d406f5b0 0x7f42d41f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:36.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.940+0000 7f42db884640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f42d4074130 con 0x7f42d406f5b0 2024-09-17T03:13:36.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.940+0000 7f42db884640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f42d4073fb0 con 0x7f42d40ca800 2024-09-17T03:13:36.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.940+0000 7f42db884640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f42d40742b0 con 0x7f42d40cad30 2024-09-17T03:13:36.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.940+0000 7f42d9e21640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d406f5b0 0x7f42d41f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:36.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.940+0000 7f42d9e21640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d406f5b0 0x7f42d41f6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39380/0 (socket says 172.21.15.78:39380) 2024-09-17T03:13:36.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.940+0000 7f42d9e21640 1 -- 172.21.15.78:0/740772087 learned_addr learned my addr 172.21.15.78:0/740772087 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:36.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.940+0000 7f42d9620640 1 --2- 172.21.15.78:0/740772087 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d40ca800 0x7f42d415e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:36.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.940+0000 7f42d9e21640 1 -- 172.21.15.78:0/740772087 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42d40cad30 msgr2=0x7f42d406f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:36.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.940+0000 7f42d8e1f640 1 --2- 172.21.15.78:0/740772087 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42d40cad30 0x7f42d406f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:36.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.940+0000 7f42d9e21640 1 --2- 172.21.15.78:0/740772087 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42d40cad30 0x7f42d406f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.940+0000 7f42d9e21640 1 -- 172.21.15.78:0/740772087 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d40ca800 msgr2=0x7f42d415e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.940+0000 7f42d9e21640 1 --2- 172.21.15.78:0/740772087 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d40ca800 0x7f42d415e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.941+0000 7f42d9e21640 1 -- 172.21.15.78:0/740772087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d415c6d0 con 0x7f42d406f5b0 2024-09-17T03:13:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.941+0000 7f42d9620640 1 --2- 172.21.15.78:0/740772087 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d40ca800 0x7f42d415e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.941+0000 7f42d9e21640 1 --2- 172.21.15.78:0/740772087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d406f5b0 0x7f42d41f6a10 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00c730 tx=0x7f42cc00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.941+0000 7f42c9ffb640 1 -- 172.21.15.78:0/740772087 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc003b70 con 0x7f42d406f5b0 2024-09-17T03:13:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.941+0000 7f42c9ffb640 1 -- 172.21.15.78:0/740772087 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42cc003d10 con 0x7f42d406f5b0 2024-09-17T03:13:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.941+0000 7f42db884640 1 -- 172.21.15.78:0/740772087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d415c9b0 con 0x7f42d406f5b0 2024-09-17T03:13:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.941+0000 7f42c9ffb640 1 -- 172.21.15.78:0/740772087 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0052d0 con 0x7f42d406f5b0 2024-09-17T03:13:36.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.941+0000 7f42db884640 1 -- 172.21.15.78:0/740772087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d415cf70 con 0x7f42d406f5b0 2024-09-17T03:13:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.942+0000 7f42db884640 1 -- 172.21.15.78:0/740772087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d415ea50 con 0x7f42d406f5b0 2024-09-17T03:13:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.943+0000 7f42c9ffb640 1 -- 172.21.15.78:0/740772087 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f42cc005470 con 0x7f42d406f5b0 2024-09-17T03:13:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.943+0000 7f42c9ffb640 1 --2- 172.21.15.78:0/740772087 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42b8078b90 0x7f42b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.943+0000 7f42c9ffb640 1 -- 172.21.15.78:0/740772087 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5709+0+0 (secure 0 0 0) 0x7f42cc09aac0 con 0x7f42d406f5b0 2024-09-17T03:13:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.943+0000 7f42d9620640 1 --2- 172.21.15.78:0/740772087 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42b8078b90 0x7f42b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:36.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.944+0000 7f42d9620640 1 --2- 172.21.15.78:0/740772087 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42b8078b90 0x7f42b807b0a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f42d0034000 tx=0x7f42d0004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:36.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:36.948+0000 7f42c9ffb640 1 -- 172.21.15.78:0/740772087 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f42cc062f90 con 0x7f42d406f5b0 2024-09-17T03:13:37.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.156+0000 7f42db884640 1 -- 172.21.15.78:0/740772087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f42d415d3b0 con 0x7f42d406f5b0 2024-09-17T03:13:37.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.158+0000 7f42c9ffb640 1 -- 172.21.15.78:0/740772087 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v75) ==== 118+0+0 (secure 0 0 0) 0x7f42cc062890 con 0x7f42d406f5b0 2024-09-17T03:13:37.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.160+0000 7f42db884640 1 -- 172.21.15.78:0/740772087 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42b8078b90 msgr2=0x7f42b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:37.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.160+0000 7f42db884640 1 --2- 172.21.15.78:0/740772087 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42b8078b90 0x7f42b807b0a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f42d0034000 tx=0x7f42d0004730 comp rx=0 tx=0).stop 2024-09-17T03:13:37.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.160+0000 7f42db884640 1 -- 172.21.15.78:0/740772087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d406f5b0 msgr2=0x7f42d41f6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.160+0000 7f42db884640 1 --2- 172.21.15.78:0/740772087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d406f5b0 0x7f42d41f6a10 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00c730 tx=0x7f42cc00cb30 comp rx=0 tx=0).stop 2024-09-17T03:13:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.160+0000 7f42db884640 1 -- 172.21.15.78:0/740772087 shutdown_connections 2024-09-17T03:13:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.160+0000 7f42db884640 1 --2- 172.21.15.78:0/740772087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42d406f5b0 0x7f42d41f6a10 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.160+0000 7f42db884640 1 --2- 172.21.15.78:0/740772087 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42d40cad30 0x7f42d406f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.160+0000 7f42db884640 1 --2- 172.21.15.78:0/740772087 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42b8078b90 0x7f42b807b0a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.160+0000 7f42db884640 1 --2- 172.21.15.78:0/740772087 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42d40ca800 0x7f42d415e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.160+0000 7f42db884640 1 -- 172.21.15.78:0/740772087 >> 172.21.15.78:0/740772087 conn(0x7f42d40b1cb0 msgr2=0x7f42d40aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.160+0000 7f42db884640 1 -- 172.21.15.78:0/740772087 shutdown_connections 2024-09-17T03:13:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.160+0000 7f42db884640 1 -- 172.21.15.78:0/740772087 wait complete. 2024-09-17T03:13:37.172 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:13:37.172 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:13:37.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.289+0000 7f7f04558640 1 -- 172.21.15.78:0/3310083391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7efc15c930 msgr2=0x7f7efc0d1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:37.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.289+0000 7f7f04558640 1 --2- 172.21.15.78:0/3310083391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7efc15c930 0x7f7efc0d1da0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f7efc0d22e0 tx=0x7f7ef002a530 comp rx=0 tx=0).stop 2024-09-17T03:13:37.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.289+0000 7f7f04558640 1 -- 172.21.15.78:0/3310083391 shutdown_connections 2024-09-17T03:13:37.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.289+0000 7f7f04558640 1 --2- 172.21.15.78:0/3310083391 >> v2:172.21.15.193:3300/0 conn(0x7f7efc0b3e20 0x7f7efc0b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:37.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.289+0000 7f7f04558640 1 --2- 172.21.15.78:0/3310083391 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7efc15c930 0x7f7efc0d1da0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:37.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.289+0000 7f7f04558640 1 -- 172.21.15.78:0/3310083391 >> 172.21.15.78:0/3310083391 conn(0x7f7efc0cee20 msgr2=0x7f7efc0cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:37.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.289+0000 7f7f04558640 1 -- 172.21.15.78:0/3310083391 shutdown_connections 2024-09-17T03:13:37.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.289+0000 7f7f04558640 1 -- 172.21.15.78:0/3310083391 wait complete. 2024-09-17T03:13:37.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.291+0000 7f7f04558640 1 Processor -- start 2024-09-17T03:13:37.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.291+0000 7f7f04558640 1 -- start start 2024-09-17T03:13:37.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.292+0000 7f7f04558640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7efc0b3e20 0x7f7efc1f5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:37.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.292+0000 7f7f04558640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7efc0cff70 0x7f7efc1f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:37.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.292+0000 7f7f04558640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7efc15c930 0x7f7efc0b6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:37.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.292+0000 7f7f04558640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc0c6470 con 0x7f7efc0cff70 2024-09-17T03:13:37.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.292+0000 7f7f04558640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7efc0c62f0 con 0x7f7efc0b3e20 2024-09-17T03:13:37.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.292+0000 7f7f04558640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7efc0c65f0 con 0x7f7efc15c930 2024-09-17T03:13:37.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.292+0000 7f7f01af3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7efc0cff70 0x7f7efc1f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:37.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.292+0000 7f7f01af3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7efc0cff70 0x7f7efc1f6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39394/0 (socket says 172.21.15.78:39394) 2024-09-17T03:13:37.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.292+0000 7f7f01af3640 1 -- 172.21.15.78:0/2638556144 learned_addr learned my addr 172.21.15.78:0/2638556144 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:37.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.293+0000 7f7f022f4640 1 --2- 172.21.15.78:0/2638556144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7efc0b3e20 0x7f7efc1f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:37.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.293+0000 7f7f02af5640 1 --2- 172.21.15.78:0/2638556144 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7efc15c930 0x7f7efc0b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:37.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.293+0000 7f7f01af3640 1 -- 172.21.15.78:0/2638556144 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7efc15c930 msgr2=0x7f7efc0b6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:37.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.293+0000 7f7f01af3640 1 --2- 172.21.15.78:0/2638556144 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7efc15c930 0x7f7efc0b6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:37.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.293+0000 7f7f01af3640 1 -- 172.21.15.78:0/2638556144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7efc0b3e20 msgr2=0x7f7efc1f5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:37.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.293+0000 7f7f01af3640 1 --2- 172.21.15.78:0/2638556144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7efc0b3e20 0x7f7efc1f5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:37.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.293+0000 7f7f01af3640 1 -- 172.21.15.78:0/2638556144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7efc06def0 con 0x7f7efc0cff70 2024-09-17T03:13:37.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.293+0000 7f7f022f4640 1 --2- 172.21.15.78:0/2638556144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7efc0b3e20 0x7f7efc1f5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:37.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.293+0000 7f7f01af3640 1 --2- 172.21.15.78:0/2638556144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7efc0cff70 0x7f7efc1f6180 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f7ef002ab20 tx=0x7f7ef0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:37.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.293+0000 7f7efaffd640 1 -- 172.21.15.78:0/2638556144 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0031d60 con 0x7f7efc0cff70 2024-09-17T03:13:37.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.293+0000 7f7efaffd640 1 -- 172.21.15.78:0/2638556144 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ef0033e10 con 0x7f7efc0cff70 2024-09-17T03:13:37.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.293+0000 7f7f04558640 1 -- 172.21.15.78:0/2638556144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7efc06e3f0 con 0x7f7efc0cff70 2024-09-17T03:13:37.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.293+0000 7f7efaffd640 1 -- 172.21.15.78:0/2638556144 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0005260 con 0x7f7efc0cff70 2024-09-17T03:13:37.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.293+0000 7f7f04558640 1 -- 172.21.15.78:0/2638556144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7efc06e9b0 con 0x7f7efc0cff70 2024-09-17T03:13:37.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.294+0000 7f7f04558640 1 -- 172.21.15.78:0/2638556144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7efc06e160 con 0x7f7efc0cff70 2024-09-17T03:13:37.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.295+0000 7f7efaffd640 1 -- 172.21.15.78:0/2638556144 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7ef0005400 con 0x7f7efc0cff70 2024-09-17T03:13:37.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.295+0000 7f7efaffd640 1 --2- 172.21.15.78:0/2638556144 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7ee8078b90 0x7f7ee807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:37.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.295+0000 7f7efaffd640 1 -- 172.21.15.78:0/2638556144 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f7ef00bbec0 con 0x7f7efc0cff70 2024-09-17T03:13:37.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.296+0000 7f7f022f4640 1 --2- 172.21.15.78:0/2638556144 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7ee8078b90 0x7f7ee807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:37.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.296+0000 7f7f022f4640 1 --2- 172.21.15.78:0/2638556144 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7ee8078b90 0x7f7ee807b0a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0012e0 tx=0x7f7eec009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:37.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.300+0000 7f7efaffd640 1 -- 172.21.15.78:0/2638556144 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7ef003f030 con 0x7f7efc0cff70 2024-09-17T03:13:37.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:37.509+0000 7f7f04558640 1 -- 172.21.15.78:0/2638556144 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7efc0c6aa0 con 0x7f7efc0cff70 2024-09-17T03:13:38.122 INFO:tasks.ceph.mds.a.smithi078.stderr:2024-09-17T03:13:38.123+0000 7f4bc8728640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:13:38.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.171+0000 7f7efaffd640 1 -- 172.21.15.78:0/2638556144 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v76) ==== 122+0+0 (secure 0 0 0) 0x7f7ef0005d00 con 0x7f7efc0cff70 2024-09-17T03:13:38.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.173+0000 7f7f04558640 1 -- 172.21.15.78:0/2638556144 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7ee8078b90 msgr2=0x7f7ee807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:38.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.173+0000 7f7f04558640 1 --2- 172.21.15.78:0/2638556144 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7ee8078b90 0x7f7ee807b0a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0012e0 tx=0x7f7eec009040 comp rx=0 tx=0).stop 2024-09-17T03:13:38.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.173+0000 7f7f04558640 1 -- 172.21.15.78:0/2638556144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7efc0cff70 msgr2=0x7f7efc1f6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:38.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.173+0000 7f7f04558640 1 --2- 172.21.15.78:0/2638556144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7efc0cff70 0x7f7efc1f6180 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f7ef002ab20 tx=0x7f7ef0033c20 comp rx=0 tx=0).stop 2024-09-17T03:13:38.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.173+0000 7f7f04558640 1 -- 172.21.15.78:0/2638556144 shutdown_connections 2024-09-17T03:13:38.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.173+0000 7f7f04558640 1 --2- 172.21.15.78:0/2638556144 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7efc15c930 0x7f7efc0b6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.173+0000 7f7f04558640 1 --2- 172.21.15.78:0/2638556144 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7efc0cff70 0x7f7efc1f6180 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.173+0000 7f7f04558640 1 --2- 172.21.15.78:0/2638556144 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7ee8078b90 0x7f7ee807b0a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.174+0000 7f7f04558640 1 --2- 172.21.15.78:0/2638556144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7efc0b3e20 0x7f7efc1f5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.174+0000 7f7f04558640 1 -- 172.21.15.78:0/2638556144 >> 172.21.15.78:0/2638556144 conn(0x7f7efc0cee20 msgr2=0x7f7efc068e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:38.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.174+0000 7f7f04558640 1 -- 172.21.15.78:0/2638556144 shutdown_connections 2024-09-17T03:13:38.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.174+0000 7f7f04558640 1 -- 172.21.15.78:0/2638556144 wait complete. 2024-09-17T03:13:38.186 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:13:38.186 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:13:38.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.304+0000 7fad5b53a640 1 -- 172.21.15.78:0/509562016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad540b3a60 msgr2=0x7fad540b3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:38.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.304+0000 7fad5b53a640 1 --2- 172.21.15.78:0/509562016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad540b3a60 0x7fad540b3e70 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fad4c009830 tx=0x7fad4c02a4a0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.304+0000 7fad5b53a640 1 -- 172.21.15.78:0/509562016 shutdown_connections 2024-09-17T03:13:38.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.304+0000 7fad5b53a640 1 --2- 172.21.15.78:0/509562016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad540b3a60 0x7fad540b3e70 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.304+0000 7fad5b53a640 1 --2- 172.21.15.78:0/509562016 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fad540b4f80 0x7fad54162f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.304+0000 7fad5b53a640 1 -- 172.21.15.78:0/509562016 >> 172.21.15.78:0/509562016 conn(0x7fad540d15f0 msgr2=0x7fad54073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:38.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.304+0000 7fad5b53a640 1 -- 172.21.15.78:0/509562016 shutdown_connections 2024-09-17T03:13:38.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.304+0000 7fad5b53a640 1 -- 172.21.15.78:0/509562016 wait complete. 2024-09-17T03:13:38.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.306+0000 7fad5b53a640 1 Processor -- start 2024-09-17T03:13:38.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.306+0000 7fad5b53a640 1 -- start start 2024-09-17T03:13:38.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.307+0000 7fad5b53a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fad540b3a60 0x7fad54147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:38.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.307+0000 7fad5b53a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad540b4f80 0x7fad540ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:38.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.307+0000 7fad5b53a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad5415e8b0 0x7fad540aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:38.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.307+0000 7fad5b53a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fad54073fd0 con 0x7fad5415e8b0 2024-09-17T03:13:38.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.307+0000 7fad5b53a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fad54073e50 con 0x7fad540b4f80 2024-09-17T03:13:38.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.307+0000 7fad5b53a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fad54074150 con 0x7fad540b3a60 2024-09-17T03:13:38.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.307+0000 7fad59ad7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad5415e8b0 0x7fad540aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:38.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.307+0000 7fad59ad7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad5415e8b0 0x7fad540aee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39418/0 (socket says 172.21.15.78:39418) 2024-09-17T03:13:38.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.307+0000 7fad59ad7640 1 -- 172.21.15.78:0/3746067787 learned_addr learned my addr 172.21.15.78:0/3746067787 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:38.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.307+0000 7fad58ad5640 1 --2- 172.21.15.78:0/3746067787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad540b4f80 0x7fad540ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:38.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.307+0000 7fad592d6640 1 --2- 172.21.15.78:0/3746067787 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fad540b3a60 0x7fad54147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:38.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.307+0000 7fad59ad7640 1 -- 172.21.15.78:0/3746067787 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fad540b3a60 msgr2=0x7fad54147570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:38.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.307+0000 7fad59ad7640 1 --2- 172.21.15.78:0/3746067787 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fad540b3a60 0x7fad54147570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.307+0000 7fad59ad7640 1 -- 172.21.15.78:0/3746067787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad540b4f80 msgr2=0x7fad540ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:38.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.307+0000 7fad59ad7640 1 --2- 172.21.15.78:0/3746067787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad540b4f80 0x7fad540ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.307+0000 7fad59ad7640 1 -- 172.21.15.78:0/3746067787 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad54153eb0 con 0x7fad5415e8b0 2024-09-17T03:13:38.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.307+0000 7fad58ad5640 1 --2- 172.21.15.78:0/3746067787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad540b4f80 0x7fad540ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:38.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.307+0000 7fad592d6640 1 --2- 172.21.15.78:0/3746067787 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fad540b3a60 0x7fad54147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:38.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.307+0000 7fad59ad7640 1 --2- 172.21.15.78:0/3746067787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad5415e8b0 0x7fad540aee00 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fad4c009920 tx=0x7fad4c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:38.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.308+0000 7fad49ffb640 1 -- 172.21.15.78:0/3746067787 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c031d60 con 0x7fad5415e8b0 2024-09-17T03:13:38.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.308+0000 7fad49ffb640 1 -- 172.21.15.78:0/3746067787 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fad4c033e10 con 0x7fad5415e8b0 2024-09-17T03:13:38.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.308+0000 7fad5b53a640 1 -- 172.21.15.78:0/3746067787 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad5415c230 con 0x7fad5415e8b0 2024-09-17T03:13:38.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.308+0000 7fad49ffb640 1 -- 172.21.15.78:0/3746067787 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad4c005220 con 0x7fad5415e8b0 2024-09-17T03:13:38.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.308+0000 7fad5b53a640 1 -- 172.21.15.78:0/3746067787 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad5415c7f0 con 0x7fad5415e8b0 2024-09-17T03:13:38.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.309+0000 7fad5b53a640 1 -- 172.21.15.78:0/3746067787 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad54074620 con 0x7fad5415e8b0 2024-09-17T03:13:38.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.309+0000 7fad49ffb640 1 -- 172.21.15.78:0/3746067787 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fad4c0053c0 con 0x7fad5415e8b0 2024-09-17T03:13:38.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.310+0000 7fad49ffb640 1 --2- 172.21.15.78:0/3746067787 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fad38078b90 0x7fad3807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:38.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.310+0000 7fad49ffb640 1 -- 172.21.15.78:0/3746067787 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fad4c0bbed0 con 0x7fad5415e8b0 2024-09-17T03:13:38.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.310+0000 7fad592d6640 1 --2- 172.21.15.78:0/3746067787 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fad38078b90 0x7fad3807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:38.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.311+0000 7fad592d6640 1 --2- 172.21.15.78:0/3746067787 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fad38078b90 0x7fad3807b0a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fad50005fd0 tx=0x7fad50009480 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:38.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.315+0000 7fad49ffb640 1 -- 172.21.15.78:0/3746067787 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fad4c03f030 con 0x7fad5415e8b0 2024-09-17T03:13:38.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.524+0000 7fad5b53a640 1 -- 172.21.15.78:0/3746067787 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad54163190 con 0x7fad5415e8b0 2024-09-17T03:13:38.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.525+0000 7fad49ffb640 1 -- 172.21.15.78:0/3746067787 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5231 (secure 0 0 0) 0x7fad4c084310 con 0x7fad5415e8b0 2024-09-17T03:13:38.524 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:38.524 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":76,"btime":"2024-09-17T03:13:38:163162+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/1005450673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1005450673},{"type":"v1","addr":"172.21.15.193:6837","nonce":1005450673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/4018023271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4018023271},{"type":"v1","addr":"172.21.15.78:6835","nonce":4018023271}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:35.489582+0000","modified":"2024-09-17T03:13:37.510616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7428":{"gid":7428,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6832/3357123265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":3357123265},{"type":"v1","addr":"172.21.15.78:6832","nonce":3357123265}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7428,"qdb_cluster":[7428]},"id":6}]} 2024-09-17T03:13:38.524 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 76 2024-09-17T03:13:38.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.527+0000 7fad5b53a640 1 -- 172.21.15.78:0/3746067787 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fad38078b90 msgr2=0x7fad3807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:38.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.527+0000 7fad5b53a640 1 --2- 172.21.15.78:0/3746067787 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fad38078b90 0x7fad3807b0a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fad50005fd0 tx=0x7fad50009480 comp rx=0 tx=0).stop 2024-09-17T03:13:38.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.527+0000 7fad5b53a640 1 -- 172.21.15.78:0/3746067787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad5415e8b0 msgr2=0x7fad540aee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:38.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.527+0000 7fad5b53a640 1 --2- 172.21.15.78:0/3746067787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad5415e8b0 0x7fad540aee00 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fad4c009920 tx=0x7fad4c033c20 comp rx=0 tx=0).stop 2024-09-17T03:13:38.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.527+0000 7fad5b53a640 1 -- 172.21.15.78:0/3746067787 shutdown_connections 2024-09-17T03:13:38.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.527+0000 7fad5b53a640 1 --2- 172.21.15.78:0/3746067787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad5415e8b0 0x7fad540aee00 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.527+0000 7fad5b53a640 1 --2- 172.21.15.78:0/3746067787 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fad38078b90 0x7fad3807b0a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.527+0000 7fad5b53a640 1 --2- 172.21.15.78:0/3746067787 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad540b4f80 0x7fad540ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.527+0000 7fad5b53a640 1 --2- 172.21.15.78:0/3746067787 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fad540b3a60 0x7fad54147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.527+0000 7fad5b53a640 1 -- 172.21.15.78:0/3746067787 >> 172.21.15.78:0/3746067787 conn(0x7fad540d15f0 msgr2=0x7fad5415ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:38.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.527+0000 7fad5b53a640 1 -- 172.21.15.78:0/3746067787 shutdown_connections 2024-09-17T03:13:38.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.527+0000 7fad5b53a640 1 -- 172.21.15.78:0/3746067787 wait complete. 2024-09-17T03:13:38.538 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:13:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.652+0000 7f4d5dcbe640 1 -- 172.21.15.78:0/2346756765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d58075fa0 msgr2=0x7f4d58070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.652+0000 7f4d5dcbe640 1 --2- 172.21.15.78:0/2346756765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d58075fa0 0x7f4d58070e40 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f4d580b66f0 tx=0x7f4d4802a580 comp rx=0 tx=0).stop 2024-09-17T03:13:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.652+0000 7f4d5dcbe640 1 -- 172.21.15.78:0/2346756765 shutdown_connections 2024-09-17T03:13:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.652+0000 7f4d5dcbe640 1 --2- 172.21.15.78:0/2346756765 >> v2:172.21.15.193:3300/0 conn(0x7f4d5815f7e0 0x7f4d5815bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.652+0000 7f4d5dcbe640 1 --2- 172.21.15.78:0/2346756765 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4d5806e100 0x7f4d5815f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.652+0000 7f4d5dcbe640 1 --2- 172.21.15.78:0/2346756765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d58075fa0 0x7f4d58070e40 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.652+0000 7f4d5dcbe640 1 -- 172.21.15.78:0/2346756765 >> 172.21.15.78:0/2346756765 conn(0x7f4d580cd530 msgr2=0x7f4d580cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.652+0000 7f4d5dcbe640 1 -- 172.21.15.78:0/2346756765 shutdown_connections 2024-09-17T03:13:38.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.652+0000 7f4d5dcbe640 1 -- 172.21.15.78:0/2346756765 wait complete. 2024-09-17T03:13:38.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.653+0000 7f4d5dcbe640 1 Processor -- start 2024-09-17T03:13:38.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.654+0000 7f4d5dcbe640 1 -- start start 2024-09-17T03:13:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.655+0000 7f4d5dcbe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d5806e100 0x7f4d58150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.655+0000 7f4d5dcbe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d58075fa0 0x7f4d5815a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.655+0000 7f4d5dcbe640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4d5815f7e0 0x7f4d5815ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.655+0000 7f4d5dcbe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5815c580 con 0x7f4d58075fa0 2024-09-17T03:13:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.655+0000 7f4d5dcbe640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4d5815c400 con 0x7f4d5806e100 2024-09-17T03:13:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.655+0000 7f4d5dcbe640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4d5815c700 con 0x7f4d5815f7e0 2024-09-17T03:13:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.655+0000 7f4d56ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d58075fa0 0x7f4d5815a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.655+0000 7f4d56ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d58075fa0 0x7f4d5815a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39434/0 (socket says 172.21.15.78:39434) 2024-09-17T03:13:38.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.655+0000 7f4d56ffd640 1 -- 172.21.15.78:0/42924413 learned_addr learned my addr 172.21.15.78:0/42924413 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.655+0000 7f4d577fe640 1 --2- 172.21.15.78:0/42924413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d5806e100 0x7f4d58150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.655+0000 7f4d57fff640 1 --2- 172.21.15.78:0/42924413 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4d5815f7e0 0x7f4d5815ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.655+0000 7f4d56ffd640 1 -- 172.21.15.78:0/42924413 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4d5815f7e0 msgr2=0x7f4d5815ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.655+0000 7f4d56ffd640 1 --2- 172.21.15.78:0/42924413 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4d5815f7e0 0x7f4d5815ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.655+0000 7f4d56ffd640 1 -- 172.21.15.78:0/42924413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d5806e100 msgr2=0x7f4d58150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.655+0000 7f4d56ffd640 1 --2- 172.21.15.78:0/42924413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d5806e100 0x7f4d58150230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.655+0000 7f4d56ffd640 1 -- 172.21.15.78:0/42924413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d581f9a60 con 0x7f4d58075fa0 2024-09-17T03:13:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.656+0000 7f4d56ffd640 1 --2- 172.21.15.78:0/42924413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d58075fa0 0x7f4d5815a720 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00d750 tx=0x7f4d4c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.656+0000 7f4d3ffff640 1 -- 172.21.15.78:0/42924413 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c017070 con 0x7f4d58075fa0 2024-09-17T03:13:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.656+0000 7f4d3ffff640 1 -- 172.21.15.78:0/42924413 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d4c009d20 con 0x7f4d58075fa0 2024-09-17T03:13:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.656+0000 7f4d3ffff640 1 -- 172.21.15.78:0/42924413 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c00de60 con 0x7f4d58075fa0 2024-09-17T03:13:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.656+0000 7f4d5dcbe640 1 -- 172.21.15.78:0/42924413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d581f9d40 con 0x7f4d58075fa0 2024-09-17T03:13:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.656+0000 7f4d5dcbe640 1 -- 172.21.15.78:0/42924413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d580b0c60 con 0x7f4d58075fa0 2024-09-17T03:13:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.657+0000 7f4d5dcbe640 1 -- 172.21.15.78:0/42924413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d581f97d0 con 0x7f4d58075fa0 2024-09-17T03:13:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.658+0000 7f4d3ffff640 1 -- 172.21.15.78:0/42924413 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4d4c004280 con 0x7f4d58075fa0 2024-09-17T03:13:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.658+0000 7f4d3ffff640 1 --2- 172.21.15.78:0/42924413 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4d44078b90 0x7f4d4407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.658+0000 7f4d3ffff640 1 -- 172.21.15.78:0/42924413 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f4d4c09aef0 con 0x7f4d58075fa0 2024-09-17T03:13:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.658+0000 7f4d577fe640 1 --2- 172.21.15.78:0/42924413 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4d44078b90 0x7f4d4407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:38.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.659+0000 7f4d577fe640 1 --2- 172.21.15.78:0/42924413 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4d44078b90 0x7f4d4407b0a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4d48033000 tx=0x7f4d48004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:38.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.663+0000 7f4d3ffff640 1 -- 172.21.15.78:0/42924413 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4d4c020020 con 0x7f4d58075fa0 2024-09-17T03:13:38.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.837+0000 7f4d5dcbe640 1 -- 172.21.15.78:0/42924413 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d580b0a50 con 0x7f4d58075fa0 2024-09-17T03:13:38.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.838+0000 7f4d3ffff640 1 -- 172.21.15.78:0/42924413 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+16696 (secure 0 0 0) 0x7f4d4c062d70 con 0x7f4d58075fa0 2024-09-17T03:13:38.837 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:38.837 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":82,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:13:37.157909+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:13:33.178329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T03:13:34.460993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:13:38.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.840+0000 7f4d5dcbe640 1 -- 172.21.15.78:0/42924413 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4d44078b90 msgr2=0x7f4d4407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:38.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.840+0000 7f4d5dcbe640 1 --2- 172.21.15.78:0/42924413 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4d44078b90 0x7f4d4407b0a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4d48033000 tx=0x7f4d48004730 comp rx=0 tx=0).stop 2024-09-17T03:13:38.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.840+0000 7f4d5dcbe640 1 -- 172.21.15.78:0/42924413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d58075fa0 msgr2=0x7f4d5815a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:38.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.840+0000 7f4d5dcbe640 1 --2- 172.21.15.78:0/42924413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d58075fa0 0x7f4d5815a720 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00d750 tx=0x7f4d4c00dc10 comp rx=0 tx=0).stop 2024-09-17T03:13:38.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.840+0000 7f4d5dcbe640 1 -- 172.21.15.78:0/42924413 shutdown_connections 2024-09-17T03:13:38.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.840+0000 7f4d5dcbe640 1 --2- 172.21.15.78:0/42924413 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4d5815f7e0 0x7f4d5815ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.840+0000 7f4d5dcbe640 1 --2- 172.21.15.78:0/42924413 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d58075fa0 0x7f4d5815a720 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.840+0000 7f4d5dcbe640 1 --2- 172.21.15.78:0/42924413 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4d44078b90 0x7f4d4407b0a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.840+0000 7f4d5dcbe640 1 --2- 172.21.15.78:0/42924413 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d5806e100 0x7f4d58150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.840+0000 7f4d5dcbe640 1 -- 172.21.15.78:0/42924413 >> 172.21.15.78:0/42924413 conn(0x7f4d580cd530 msgr2=0x7f4d580cfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:38.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.840+0000 7f4d5dcbe640 1 -- 172.21.15.78:0/42924413 shutdown_connections 2024-09-17T03:13:38.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.840+0000 7f4d5dcbe640 1 -- 172.21.15.78:0/42924413 wait complete. 2024-09-17T03:13:38.851 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:13:38.851 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:13:38.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.965+0000 7f3209b69640 1 -- 172.21.15.78:0/3697591667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f320406f4b0 msgr2=0x7f32040d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:38.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.965+0000 7f3209b69640 1 --2- 172.21.15.78:0/3697591667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f320406f4b0 0x7f32040d3330 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f32040b70e0 tx=0x7f31ec02a4a0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.965+0000 7f3209b69640 1 -- 172.21.15.78:0/3697591667 shutdown_connections 2024-09-17T03:13:38.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.965+0000 7f3209b69640 1 --2- 172.21.15.78:0/3697591667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f320406f4b0 0x7f32040d3330 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.965+0000 7f3209b69640 1 --2- 172.21.15.78:0/3697591667 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f320406e170 0x7f32040b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.965+0000 7f3209b69640 1 -- 172.21.15.78:0/3697591667 >> 172.21.15.78:0/3697591667 conn(0x7f320408bfc0 msgr2=0x7f320409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:38.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.965+0000 7f3209b69640 1 -- 172.21.15.78:0/3697591667 shutdown_connections 2024-09-17T03:13:38.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.965+0000 7f3209b69640 1 -- 172.21.15.78:0/3697591667 wait complete. 2024-09-17T03:13:38.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.966+0000 7f3209b69640 1 Processor -- start 2024-09-17T03:13:38.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.966+0000 7f3209b69640 1 -- start start 2024-09-17T03:13:38.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.968+0000 7f3209b69640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f320406f4b0 0x7f32041f92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:38.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.968+0000 7f3209b69640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32040d3870 0x7f3204153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:38.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.968+0000 7f3209b69640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32040b6140 0x7f32040b6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:38.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.968+0000 7f3209b69640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f32040d0e60 con 0x7f32040b6140 2024-09-17T03:13:38.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.968+0000 7f3209b69640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f32040d0ce0 con 0x7f32040d3870 2024-09-17T03:13:38.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.968+0000 7f3209b69640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f32040d0fe0 con 0x7f320406f4b0 2024-09-17T03:13:38.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.968+0000 7f3203fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32040b6140 0x7f32040b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:38.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.968+0000 7f3203fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32040b6140 0x7f32040b6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39460/0 (socket says 172.21.15.78:39460) 2024-09-17T03:13:38.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.968+0000 7f3203fff640 1 -- 172.21.15.78:0/1813254518 learned_addr learned my addr 172.21.15.78:0/1813254518 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:38.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.968+0000 7f32037fe640 1 --2- 172.21.15.78:0/1813254518 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f320406f4b0 0x7f32041f92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:38.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.968+0000 7f31fbfff640 1 --2- 172.21.15.78:0/1813254518 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32040d3870 0x7f3204153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:38.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.968+0000 7f3203fff640 1 -- 172.21.15.78:0/1813254518 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f320406f4b0 msgr2=0x7f32041f92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:38.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.968+0000 7f3203fff640 1 --2- 172.21.15.78:0/1813254518 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f320406f4b0 0x7f32041f92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.968+0000 7f3203fff640 1 -- 172.21.15.78:0/1813254518 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32040d3870 msgr2=0x7f3204153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:38.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.968+0000 7f3203fff640 1 --2- 172.21.15.78:0/1813254518 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32040d3870 0x7f3204153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:38.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.968+0000 7f3203fff640 1 -- 172.21.15.78:0/1813254518 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32041574c0 con 0x7f32040b6140 2024-09-17T03:13:38.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.968+0000 7f31fbfff640 1 --2- 172.21.15.78:0/1813254518 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32040d3870 0x7f3204153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:38.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.968+0000 7f3203fff640 1 --2- 172.21.15.78:0/1813254518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32040b6140 0x7f32040b6550 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00b9a0 tx=0x7f31fc00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:38.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.968+0000 7f3200ff9640 1 -- 172.21.15.78:0/1813254518 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc019070 con 0x7f32040b6140 2024-09-17T03:13:38.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.968+0000 7f3200ff9640 1 -- 172.21.15.78:0/1813254518 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31fc00cc90 con 0x7f32040b6140 2024-09-17T03:13:38.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.969+0000 7f3200ff9640 1 -- 172.21.15.78:0/1813254518 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc0146a0 con 0x7f32040b6140 2024-09-17T03:13:38.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.969+0000 7f3209b69640 1 -- 172.21.15.78:0/1813254518 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3204153d70 con 0x7f32040b6140 2024-09-17T03:13:38.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.969+0000 7f3209b69640 1 -- 172.21.15.78:0/1813254518 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32041f87c0 con 0x7f32040b6140 2024-09-17T03:13:38.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.970+0000 7f3209b69640 1 -- 172.21.15.78:0/1813254518 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32040d1500 con 0x7f32040b6140 2024-09-17T03:13:38.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.970+0000 7f3200ff9640 1 -- 172.21.15.78:0/1813254518 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f31fc01c070 con 0x7f32040b6140 2024-09-17T03:13:38.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.971+0000 7f3200ff9640 1 --2- 172.21.15.78:0/1813254518 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f31e4078b90 0x7f31e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:38.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.971+0000 7f3200ff9640 1 -- 172.21.15.78:0/1813254518 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f31fc09a9f0 con 0x7f32040b6140 2024-09-17T03:13:38.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.971+0000 7f32037fe640 1 --2- 172.21.15.78:0/1813254518 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f31e4078b90 0x7f31e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:38.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.972+0000 7f32037fe640 1 --2- 172.21.15.78:0/1813254518 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f31e4078b90 0x7f31e407b0a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f31f4005d70 tx=0x7f31f4005d00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:38.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:38.976+0000 7f3200ff9640 1 -- 172.21.15.78:0/1813254518 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f31fc062db0 con 0x7f32040b6140 2024-09-17T03:13:39.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.147+0000 7f3209b69640 1 -- 172.21.15.78:0/1813254518 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3204153b00 con 0x7f31e4078b90 2024-09-17T03:13:39.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.152+0000 7f3200ff9640 1 -- 172.21.15.78:0/1813254518 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250513 (secure 0 0 0) 0x7f3204153b00 con 0x7f31e4078b90 2024-09-17T03:13:39.154 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:39.155 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:13:39.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.155+0000 7f3209b69640 1 -- 172.21.15.78:0/1813254518 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f31e4078b90 msgr2=0x7f31e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.155+0000 7f3209b69640 1 --2- 172.21.15.78:0/1813254518 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f31e4078b90 0x7f31e407b0a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f31f4005d70 tx=0x7f31f4005d00 comp rx=0 tx=0).stop 2024-09-17T03:13:39.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.155+0000 7f3209b69640 1 -- 172.21.15.78:0/1813254518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32040b6140 msgr2=0x7f32040b6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.155+0000 7f3209b69640 1 --2- 172.21.15.78:0/1813254518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32040b6140 0x7f32040b6550 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00b9a0 tx=0x7f31fc00be60 comp rx=0 tx=0).stop 2024-09-17T03:13:39.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.155+0000 7f3209b69640 1 -- 172.21.15.78:0/1813254518 shutdown_connections 2024-09-17T03:13:39.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.155+0000 7f3209b69640 1 --2- 172.21.15.78:0/1813254518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32040b6140 0x7f32040b6550 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.155+0000 7f3209b69640 1 --2- 172.21.15.78:0/1813254518 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f31e4078b90 0x7f31e407b0a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.155+0000 7f3209b69640 1 --2- 172.21.15.78:0/1813254518 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32040d3870 0x7f3204153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.155+0000 7f3209b69640 1 --2- 172.21.15.78:0/1813254518 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f320406f4b0 0x7f32041f92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.155+0000 7f3209b69640 1 -- 172.21.15.78:0/1813254518 >> 172.21.15.78:0/1813254518 conn(0x7f320408bfc0 msgr2=0x7f3204161850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:39.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.155+0000 7f3209b69640 1 -- 172.21.15.78:0/1813254518 shutdown_connections 2024-09-17T03:13:39.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.155+0000 7f3209b69640 1 -- 172.21.15.78:0/1813254518 wait complete. 2024-09-17T03:13:39.166 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":237,"stamp":"2024-09-17T03:13:37.202956+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591838,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":130,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":245800,"kb_used_data":8752,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754728920,"statfs":{"total":773094113280,"available":772842414080,"internally_reserved":0,"allocated":8962048,"data_stored":4475172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":242535986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1470,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000917"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171675+0000","last_change":"2024-09-17T03:13:36.164503+0000","last_active":"2024-09-17T03:13:36.171675+0000","last_peered":"2024-09-17T03:13:36.171675+0000","last_clean":"2024-09-17T03:13:36.171675+0000","last_became_active":"2024-09-17T03:13:36.164189+0000","last_became_peered":"2024-09-17T03:13:36.164189+0000","last_unstale":"2024-09-17T03:13:36.171675+0000","last_undegraded":"2024-09-17T03:13:36.171675+0000","last_fullsized":"2024-09-17T03:13:36.171675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:24.415909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168002+0000","last_change":"2024-09-17T03:13:36.163785+0000","last_active":"2024-09-17T03:13:36.168002+0000","last_peered":"2024-09-17T03:13:36.168002+0000","last_clean":"2024-09-17T03:13:36.168002+0000","last_became_active":"2024-09-17T03:13:36.163491+0000","last_became_peered":"2024-09-17T03:13:36.163491+0000","last_unstale":"2024-09-17T03:13:36.168002+0000","last_undegraded":"2024-09-17T03:13:36.168002+0000","last_fullsized":"2024-09-17T03:13:36.168002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:16.451197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.166961+0000","last_change":"2024-09-17T03:13:36.158610+0000","last_active":"2024-09-17T03:13:36.166961+0000","last_peered":"2024-09-17T03:13:36.166961+0000","last_clean":"2024-09-17T03:13:36.166961+0000","last_became_active":"2024-09-17T03:13:36.158308+0000","last_became_peered":"2024-09-17T03:13:36.158308+0000","last_unstale":"2024-09-17T03:13:36.166961+0000","last_undegraded":"2024-09-17T03:13:36.166961+0000","last_fullsized":"2024-09-17T03:13:36.166961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:54.875053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2024-09-17T03:13:36.156096+0000","last_change":"2024-09-17T03:13:36.156096+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:36.156096+0000","last_undegraded":"2024-09-17T03:13:36.156096+0000","last_fullsized":"2024-09-17T03:13:36.156096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174907+0000","last_change":"2024-09-17T03:13:36.171195+0000","last_active":"2024-09-17T03:13:36.174907+0000","last_peered":"2024-09-17T03:13:36.174907+0000","last_clean":"2024-09-17T03:13:36.174907+0000","last_became_active":"2024-09-17T03:13:36.170849+0000","last_became_peered":"2024-09-17T03:13:36.170849+0000","last_unstale":"2024-09-17T03:13:36.174907+0000","last_undegraded":"2024-09-17T03:13:36.174907+0000","last_fullsized":"2024-09-17T03:13:36.174907+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:54.973430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168655+0000","last_change":"2024-09-17T03:13:36.164233+0000","last_active":"2024-09-17T03:13:36.168655+0000","last_peered":"2024-09-17T03:13:36.168655+0000","last_clean":"2024-09-17T03:13:36.168655+0000","last_became_active":"2024-09-17T03:13:36.163925+0000","last_became_peered":"2024-09-17T03:13:36.163925+0000","last_unstale":"2024-09-17T03:13:36.168655+0000","last_undegraded":"2024-09-17T03:13:36.168655+0000","last_fullsized":"2024-09-17T03:13:36.168655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:24.380925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174980+0000","last_change":"2024-09-17T03:13:36.171062+0000","last_active":"2024-09-17T03:13:36.174980+0000","last_peered":"2024-09-17T03:13:36.174980+0000","last_clean":"2024-09-17T03:13:36.174980+0000","last_became_active":"2024-09-17T03:13:36.170264+0000","last_became_peered":"2024-09-17T03:13:36.170264+0000","last_unstale":"2024-09-17T03:13:36.174980+0000","last_undegraded":"2024-09-17T03:13:36.174980+0000","last_fullsized":"2024-09-17T03:13:36.174980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:44.954526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.159417+0000","last_change":"2024-09-17T03:13:36.154137+0000","last_active":"2024-09-17T03:13:36.159417+0000","last_peered":"2024-09-17T03:13:36.159417+0000","last_clean":"2024-09-17T03:13:36.159417+0000","last_became_active":"2024-09-17T03:13:36.153776+0000","last_became_peered":"2024-09-17T03:13:36.153776+0000","last_unstale":"2024-09-17T03:13:36.159417+0000","last_undegraded":"2024-09-17T03:13:36.159417+0000","last_fullsized":"2024-09-17T03:13:36.159417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:54.973430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172327+0000","last_change":"2024-09-17T03:13:36.165365+0000","last_active":"2024-09-17T03:13:36.172327+0000","last_peered":"2024-09-17T03:13:36.172327+0000","last_clean":"2024-09-17T03:13:36.172327+0000","last_became_active":"2024-09-17T03:13:36.165047+0000","last_became_peered":"2024-09-17T03:13:36.165047+0000","last_unstale":"2024-09-17T03:13:36.172327+0000","last_undegraded":"2024-09-17T03:13:36.172327+0000","last_fullsized":"2024-09-17T03:13:36.172327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:35.013596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.163241+0000","last_change":"2024-09-17T03:13:36.158884+0000","last_active":"2024-09-17T03:13:36.163241+0000","last_peered":"2024-09-17T03:13:36.163241+0000","last_clean":"2024-09-17T03:13:36.163241+0000","last_became_active":"2024-09-17T03:13:36.157801+0000","last_became_peered":"2024-09-17T03:13:36.157801+0000","last_unstale":"2024-09-17T03:13:36.163241+0000","last_undegraded":"2024-09-17T03:13:36.163241+0000","last_fullsized":"2024-09-17T03:13:36.163241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:34.514645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.165971+0000","last_change":"2024-09-17T03:13:36.159357+0000","last_active":"2024-09-17T03:13:36.165971+0000","last_peered":"2024-09-17T03:13:36.165971+0000","last_clean":"2024-09-17T03:13:36.165971+0000","last_became_active":"2024-09-17T03:13:36.159037+0000","last_became_peered":"2024-09-17T03:13:36.159037+0000","last_unstale":"2024-09-17T03:13:36.165971+0000","last_undegraded":"2024-09-17T03:13:36.165971+0000","last_fullsized":"2024-09-17T03:13:36.165971+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:10.901422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.162938+0000","last_change":"2024-09-17T03:13:36.157305+0000","last_active":"2024-09-17T03:13:36.162938+0000","last_peered":"2024-09-17T03:13:36.162938+0000","last_clean":"2024-09-17T03:13:36.162938+0000","last_became_active":"2024-09-17T03:13:36.156967+0000","last_became_peered":"2024-09-17T03:13:36.156967+0000","last_unstale":"2024-09-17T03:13:36.162938+0000","last_undegraded":"2024-09-17T03:13:36.162938+0000","last_fullsized":"2024-09-17T03:13:36.162938+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:46.504996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171798+0000","last_change":"2024-09-17T03:13:36.170755+0000","last_active":"2024-09-17T03:13:36.171798+0000","last_peered":"2024-09-17T03:13:36.171798+0000","last_clean":"2024-09-17T03:13:36.171798+0000","last_became_active":"2024-09-17T03:13:36.170436+0000","last_became_peered":"2024-09-17T03:13:36.170436+0000","last_unstale":"2024-09-17T03:13:36.171798+0000","last_undegraded":"2024-09-17T03:13:36.171798+0000","last_fullsized":"2024-09-17T03:13:36.171798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:03.088723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.175020+0000","last_change":"2024-09-17T03:13:36.171144+0000","last_active":"2024-09-17T03:13:36.175020+0000","last_peered":"2024-09-17T03:13:36.175020+0000","last_clean":"2024-09-17T03:13:36.175020+0000","last_became_active":"2024-09-17T03:13:36.170849+0000","last_became_peered":"2024-09-17T03:13:36.170849+0000","last_unstale":"2024-09-17T03:13:36.175020+0000","last_undegraded":"2024-09-17T03:13:36.175020+0000","last_fullsized":"2024-09-17T03:13:36.175020+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:49.302326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:13:35.124535+0000","last_change":"2024-09-17T03:13:35.124535+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:35.124535+0000","last_undegraded":"2024-09-17T03:13:35.124535+0000","last_fullsized":"2024-09-17T03:13:35.124535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.164882+0000","last_change":"2024-09-17T03:13:36.159093+0000","last_active":"2024-09-17T03:13:36.164882+0000","last_peered":"2024-09-17T03:13:36.164882+0000","last_clean":"2024-09-17T03:13:36.164882+0000","last_became_active":"2024-09-17T03:13:36.158546+0000","last_became_peered":"2024-09-17T03:13:36.158546+0000","last_unstale":"2024-09-17T03:13:36.164882+0000","last_undegraded":"2024-09-17T03:13:36.164882+0000","last_fullsized":"2024-09-17T03:13:36.164882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:44.382837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172830+0000","last_change":"2024-09-17T03:13:36.172719+0000","last_active":"2024-09-17T03:13:36.172830+0000","last_peered":"2024-09-17T03:13:36.172830+0000","last_clean":"2024-09-17T03:13:36.172830+0000","last_became_active":"2024-09-17T03:13:36.172362+0000","last_became_peered":"2024-09-17T03:13:36.172362+0000","last_unstale":"2024-09-17T03:13:36.172830+0000","last_undegraded":"2024-09-17T03:13:36.172830+0000","last_fullsized":"2024-09-17T03:13:36.172830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:43.797527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172392+0000","last_change":"2024-09-17T03:13:36.170457+0000","last_active":"2024-09-17T03:13:36.172392+0000","last_peered":"2024-09-17T03:13:36.172392+0000","last_clean":"2024-09-17T03:13:36.172392+0000","last_became_active":"2024-09-17T03:13:36.170155+0000","last_became_peered":"2024-09-17T03:13:36.170155+0000","last_unstale":"2024-09-17T03:13:36.172392+0000","last_undegraded":"2024-09-17T03:13:36.172392+0000","last_fullsized":"2024-09-17T03:13:36.172392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:16.330644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.167407+0000","last_change":"2024-09-17T03:13:36.167306+0000","last_active":"2024-09-17T03:13:36.167407+0000","last_peered":"2024-09-17T03:13:36.167407+0000","last_clean":"2024-09-17T03:13:36.167407+0000","last_became_active":"2024-09-17T03:13:36.167004+0000","last_became_peered":"2024-09-17T03:13:36.167004+0000","last_unstale":"2024-09-17T03:13:36.167407+0000","last_undegraded":"2024-09-17T03:13:36.167407+0000","last_fullsized":"2024-09-17T03:13:36.167407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:25.624815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.170731+0000","last_change":"2024-09-17T03:13:36.164087+0000","last_active":"2024-09-17T03:13:36.170731+0000","last_peered":"2024-09-17T03:13:36.170731+0000","last_clean":"2024-09-17T03:13:36.170731+0000","last_became_active":"2024-09-17T03:13:36.163793+0000","last_became_peered":"2024-09-17T03:13:36.163793+0000","last_unstale":"2024-09-17T03:13:36.170731+0000","last_undegraded":"2024-09-17T03:13:36.170731+0000","last_fullsized":"2024-09-17T03:13:36.170731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:39.687980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172698+0000","last_change":"2024-09-17T03:13:36.170832+0000","last_active":"2024-09-17T03:13:36.172698+0000","last_peered":"2024-09-17T03:13:36.172698+0000","last_clean":"2024-09-17T03:13:36.172698+0000","last_became_active":"2024-09-17T03:13:36.170477+0000","last_became_peered":"2024-09-17T03:13:36.170477+0000","last_unstale":"2024-09-17T03:13:36.172698+0000","last_undegraded":"2024-09-17T03:13:36.172698+0000","last_fullsized":"2024-09-17T03:13:36.172698+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:50.642766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173666+0000","last_change":"2024-09-17T03:13:36.166922+0000","last_active":"2024-09-17T03:13:36.173666+0000","last_peered":"2024-09-17T03:13:36.173666+0000","last_clean":"2024-09-17T03:13:36.173666+0000","last_became_active":"2024-09-17T03:13:36.166609+0000","last_became_peered":"2024-09-17T03:13:36.166609+0000","last_unstale":"2024-09-17T03:13:36.173666+0000","last_undegraded":"2024-09-17T03:13:36.173666+0000","last_fullsized":"2024-09-17T03:13:36.173666+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:55.515484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171645+0000","last_change":"2024-09-17T03:13:36.164280+0000","last_active":"2024-09-17T03:13:36.171645+0000","last_peered":"2024-09-17T03:13:36.171645+0000","last_clean":"2024-09-17T03:13:36.171645+0000","last_became_active":"2024-09-17T03:13:36.163689+0000","last_became_peered":"2024-09-17T03:13:36.163689+0000","last_unstale":"2024-09-17T03:13:36.171645+0000","last_undegraded":"2024-09-17T03:13:36.171645+0000","last_fullsized":"2024-09-17T03:13:36.171645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:19.690392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.170927+0000","last_change":"2024-09-17T03:13:36.166970+0000","last_active":"2024-09-17T03:13:36.170927+0000","last_peered":"2024-09-17T03:13:36.170927+0000","last_clean":"2024-09-17T03:13:36.170927+0000","last_became_active":"2024-09-17T03:13:36.166665+0000","last_became_peered":"2024-09-17T03:13:36.166665+0000","last_unstale":"2024-09-17T03:13:36.170927+0000","last_undegraded":"2024-09-17T03:13:36.170927+0000","last_fullsized":"2024-09-17T03:13:36.170927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:05.146731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.165529+0000","last_change":"2024-09-17T03:13:36.156703+0000","last_active":"2024-09-17T03:13:36.165529+0000","last_peered":"2024-09-17T03:13:36.165529+0000","last_clean":"2024-09-17T03:13:36.165529+0000","last_became_active":"2024-09-17T03:13:36.156367+0000","last_became_peered":"2024-09-17T03:13:36.156367+0000","last_unstale":"2024-09-17T03:13:36.165529+0000","last_undegraded":"2024-09-17T03:13:36.165529+0000","last_fullsized":"2024-09-17T03:13:36.165529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:05.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168674+0000","last_change":"2024-09-17T03:13:36.166639+0000","last_active":"2024-09-17T03:13:36.168674+0000","last_peered":"2024-09-17T03:13:36.168674+0000","last_clean":"2024-09-17T03:13:36.168674+0000","last_became_active":"2024-09-17T03:13:36.166289+0000","last_became_peered":"2024-09-17T03:13:36.166289+0000","last_unstale":"2024-09-17T03:13:36.168674+0000","last_undegraded":"2024-09-17T03:13:36.168674+0000","last_fullsized":"2024-09-17T03:13:36.168674+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:38.480507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173441+0000","last_change":"2024-09-17T03:13:36.173311+0000","last_active":"2024-09-17T03:13:36.173441+0000","last_peered":"2024-09-17T03:13:36.173441+0000","last_clean":"2024-09-17T03:13:36.173441+0000","last_became_active":"2024-09-17T03:13:36.172541+0000","last_became_peered":"2024-09-17T03:13:36.172541+0000","last_unstale":"2024-09-17T03:13:36.173441+0000","last_undegraded":"2024-09-17T03:13:36.173441+0000","last_fullsized":"2024-09-17T03:13:36.173441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:24.380925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171475+0000","last_change":"2024-09-17T03:13:36.164574+0000","last_active":"2024-09-17T03:13:36.171475+0000","last_peered":"2024-09-17T03:13:36.171475+0000","last_clean":"2024-09-17T03:13:36.171475+0000","last_became_active":"2024-09-17T03:13:36.164233+0000","last_became_peered":"2024-09-17T03:13:36.164233+0000","last_unstale":"2024-09-17T03:13:36.171475+0000","last_undegraded":"2024-09-17T03:13:36.171475+0000","last_fullsized":"2024-09-17T03:13:36.171475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:13.580635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.166364+0000","last_change":"2024-09-17T03:13:36.159680+0000","last_active":"2024-09-17T03:13:36.166364+0000","last_peered":"2024-09-17T03:13:36.166364+0000","last_clean":"2024-09-17T03:13:36.166364+0000","last_became_active":"2024-09-17T03:13:36.159385+0000","last_became_peered":"2024-09-17T03:13:36.159385+0000","last_unstale":"2024-09-17T03:13:36.166364+0000","last_undegraded":"2024-09-17T03:13:36.166364+0000","last_fullsized":"2024-09-17T03:13:36.166364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:05.330405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174358+0000","last_change":"2024-09-17T03:13:36.174241+0000","last_active":"2024-09-17T03:13:36.174358+0000","last_peered":"2024-09-17T03:13:36.174358+0000","last_clean":"2024-09-17T03:13:36.174358+0000","last_became_active":"2024-09-17T03:13:36.173940+0000","last_became_peered":"2024-09-17T03:13:36.173940+0000","last_unstale":"2024-09-17T03:13:36.174358+0000","last_undegraded":"2024-09-17T03:13:36.174358+0000","last_fullsized":"2024-09-17T03:13:36.174358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:31:27.192758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171890+0000","last_change":"2024-09-17T03:13:36.168808+0000","last_active":"2024-09-17T03:13:36.171890+0000","last_peered":"2024-09-17T03:13:36.171890+0000","last_clean":"2024-09-17T03:13:36.171890+0000","last_became_active":"2024-09-17T03:13:36.167241+0000","last_became_peered":"2024-09-17T03:13:36.167241+0000","last_unstale":"2024-09-17T03:13:36.171890+0000","last_undegraded":"2024-09-17T03:13:36.171890+0000","last_fullsized":"2024-09-17T03:13:36.171890+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:02.497727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172893+0000","last_change":"2024-09-17T03:13:36.167980+0000","last_active":"2024-09-17T03:13:36.172893+0000","last_peered":"2024-09-17T03:13:36.172893+0000","last_clean":"2024-09-17T03:13:36.172893+0000","last_became_active":"2024-09-17T03:13:36.167284+0000","last_became_peered":"2024-09-17T03:13:36.167284+0000","last_unstale":"2024-09-17T03:13:36.172893+0000","last_undegraded":"2024-09-17T03:13:36.172893+0000","last_fullsized":"2024-09-17T03:13:36.172893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:00.786078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173348+0000","last_change":"2024-09-17T03:13:36.173114+0000","last_active":"2024-09-17T03:13:36.173348+0000","last_peered":"2024-09-17T03:13:36.173348+0000","last_clean":"2024-09-17T03:13:36.173348+0000","last_became_active":"2024-09-17T03:13:36.172653+0000","last_became_peered":"2024-09-17T03:13:36.172653+0000","last_unstale":"2024-09-17T03:13:36.173348+0000","last_undegraded":"2024-09-17T03:13:36.173348+0000","last_fullsized":"2024-09-17T03:13:36.173348+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:51.574328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"81'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.185157+0000","last_change":"2024-09-17T03:13:35.147001+0000","last_active":"2024-09-17T03:13:36.185157+0000","last_peered":"2024-09-17T03:13:36.185157+0000","last_clean":"2024-09-17T03:13:36.185157+0000","last_became_active":"2024-09-17T03:13:35.146658+0000","last_became_peered":"2024-09-17T03:13:35.146658+0000","last_unstale":"2024-09-17T03:13:36.185157+0000","last_undegraded":"2024-09-17T03:13:36.185157+0000","last_fullsized":"2024-09-17T03:13:36.185157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:06.031844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172305+0000","last_change":"2024-09-17T03:13:36.168877+0000","last_active":"2024-09-17T03:13:36.172305+0000","last_peered":"2024-09-17T03:13:36.172305+0000","last_clean":"2024-09-17T03:13:36.172305+0000","last_became_active":"2024-09-17T03:13:36.168545+0000","last_became_peered":"2024-09-17T03:13:36.168545+0000","last_unstale":"2024-09-17T03:13:36.172305+0000","last_undegraded":"2024-09-17T03:13:36.172305+0000","last_fullsized":"2024-09-17T03:13:36.172305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:01.055085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"81'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160707+0000","last_change":"2024-09-17T03:13:35.151241+0000","last_active":"2024-09-17T03:13:36.160707+0000","last_peered":"2024-09-17T03:13:36.160707+0000","last_clean":"2024-09-17T03:13:36.160707+0000","last_became_active":"2024-09-17T03:13:35.150775+0000","last_became_peered":"2024-09-17T03:13:35.150775+0000","last_unstale":"2024-09-17T03:13:36.160707+0000","last_undegraded":"2024-09-17T03:13:36.160707+0000","last_fullsized":"2024-09-17T03:13:36.160707+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:48.739118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160679+0000","last_change":"2024-09-17T03:13:36.156147+0000","last_active":"2024-09-17T03:13:36.160679+0000","last_peered":"2024-09-17T03:13:36.160679+0000","last_clean":"2024-09-17T03:13:36.160679+0000","last_became_active":"2024-09-17T03:13:36.155807+0000","last_became_peered":"2024-09-17T03:13:36.155807+0000","last_unstale":"2024-09-17T03:13:36.160679+0000","last_undegraded":"2024-09-17T03:13:36.160679+0000","last_fullsized":"2024-09-17T03:13:36.160679+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:41:23.077488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.163253+0000","last_change":"2024-09-17T03:13:35.147739+0000","last_active":"2024-09-17T03:13:36.163253+0000","last_peered":"2024-09-17T03:13:36.163253+0000","last_clean":"2024-09-17T03:13:36.163253+0000","last_became_active":"2024-09-17T03:13:35.147321+0000","last_became_peered":"2024-09-17T03:13:35.147321+0000","last_unstale":"2024-09-17T03:13:36.163253+0000","last_undegraded":"2024-09-17T03:13:36.163253+0000","last_fullsized":"2024-09-17T03:13:36.163253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:33.977477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171514+0000","last_change":"2024-09-17T03:13:36.168055+0000","last_active":"2024-09-17T03:13:36.171514+0000","last_peered":"2024-09-17T03:13:36.171514+0000","last_clean":"2024-09-17T03:13:36.171514+0000","last_became_active":"2024-09-17T03:13:36.167764+0000","last_became_peered":"2024-09-17T03:13:36.167764+0000","last_unstale":"2024-09-17T03:13:36.171514+0000","last_undegraded":"2024-09-17T03:13:36.171514+0000","last_fullsized":"2024-09-17T03:13:36.171514+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:15.268158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.161068+0000","last_change":"2024-09-17T03:13:35.148688+0000","last_active":"2024-09-17T03:13:36.161068+0000","last_peered":"2024-09-17T03:13:36.161068+0000","last_clean":"2024-09-17T03:13:36.161068+0000","last_became_active":"2024-09-17T03:13:35.148412+0000","last_became_peered":"2024-09-17T03:13:35.148412+0000","last_unstale":"2024-09-17T03:13:36.161068+0000","last_undegraded":"2024-09-17T03:13:36.161068+0000","last_fullsized":"2024-09-17T03:13:36.161068+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:20.696636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173396+0000","last_change":"2024-09-17T03:13:36.173304+0000","last_active":"2024-09-17T03:13:36.173396+0000","last_peered":"2024-09-17T03:13:36.173396+0000","last_clean":"2024-09-17T03:13:36.173396+0000","last_became_active":"2024-09-17T03:13:36.172846+0000","last_became_peered":"2024-09-17T03:13:36.172846+0000","last_unstale":"2024-09-17T03:13:36.173396+0000","last_undegraded":"2024-09-17T03:13:36.173396+0000","last_fullsized":"2024-09-17T03:13:36.173396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:12.520288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"81'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.162218+0000","last_change":"2024-09-17T03:13:35.141265+0000","last_active":"2024-09-17T03:13:36.162218+0000","last_peered":"2024-09-17T03:13:36.162218+0000","last_clean":"2024-09-17T03:13:36.162218+0000","last_became_active":"2024-09-17T03:13:35.140530+0000","last_became_peered":"2024-09-17T03:13:35.140530+0000","last_unstale":"2024-09-17T03:13:36.162218+0000","last_undegraded":"2024-09-17T03:13:36.162218+0000","last_fullsized":"2024-09-17T03:13:36.162218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:50.135257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174383+0000","last_change":"2024-09-17T03:13:36.174281+0000","last_active":"2024-09-17T03:13:36.174383+0000","last_peered":"2024-09-17T03:13:36.174383+0000","last_clean":"2024-09-17T03:13:36.174383+0000","last_became_active":"2024-09-17T03:13:36.173946+0000","last_became_peered":"2024-09-17T03:13:36.173946+0000","last_unstale":"2024-09-17T03:13:36.174383+0000","last_undegraded":"2024-09-17T03:13:36.174383+0000","last_fullsized":"2024-09-17T03:13:36.174383+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:35.013596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"81'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.153914+0000","last_change":"2024-09-17T03:13:35.151157+0000","last_active":"2024-09-17T03:13:36.153914+0000","last_peered":"2024-09-17T03:13:36.153914+0000","last_clean":"2024-09-17T03:13:36.153914+0000","last_became_active":"2024-09-17T03:13:35.150743+0000","last_became_peered":"2024-09-17T03:13:35.150743+0000","last_unstale":"2024-09-17T03:13:36.153914+0000","last_undegraded":"2024-09-17T03:13:36.153914+0000","last_fullsized":"2024-09-17T03:13:36.153914+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:29.000215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168607+0000","last_change":"2024-09-17T03:13:36.164002+0000","last_active":"2024-09-17T03:13:36.168607+0000","last_peered":"2024-09-17T03:13:36.168607+0000","last_clean":"2024-09-17T03:13:36.168607+0000","last_became_active":"2024-09-17T03:13:36.163678+0000","last_became_peered":"2024-09-17T03:13:36.163678+0000","last_unstale":"2024-09-17T03:13:36.168607+0000","last_undegraded":"2024-09-17T03:13:36.168607+0000","last_fullsized":"2024-09-17T03:13:36.168607+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:05.685914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160617+0000","last_change":"2024-09-17T03:13:35.148352+0000","last_active":"2024-09-17T03:13:36.160617+0000","last_peered":"2024-09-17T03:13:36.160617+0000","last_clean":"2024-09-17T03:13:36.160617+0000","last_became_active":"2024-09-17T03:13:35.148059+0000","last_became_peered":"2024-09-17T03:13:35.148059+0000","last_unstale":"2024-09-17T03:13:36.160617+0000","last_undegraded":"2024-09-17T03:13:36.160617+0000","last_fullsized":"2024-09-17T03:13:36.160617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:56.223035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:13:35.124535+0000","last_change":"2024-09-17T03:13:35.124535+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:35.124535+0000","last_undegraded":"2024-09-17T03:13:35.124535+0000","last_fullsized":"2024-09-17T03:13:35.124535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150270+0000","last_change":"2024-09-17T03:13:35.136863+0000","last_active":"2024-09-17T03:13:36.150270+0000","last_peered":"2024-09-17T03:13:36.150270+0000","last_clean":"2024-09-17T03:13:36.150270+0000","last_became_active":"2024-09-17T03:13:35.136521+0000","last_became_peered":"2024-09-17T03:13:35.136521+0000","last_unstale":"2024-09-17T03:13:36.150270+0000","last_undegraded":"2024-09-17T03:13:36.150270+0000","last_fullsized":"2024-09-17T03:13:36.150270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:26.163857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:13:35.124535+0000","last_change":"2024-09-17T03:13:35.124535+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:35.124535+0000","last_undegraded":"2024-09-17T03:13:35.124535+0000","last_fullsized":"2024-09-17T03:13:35.124535+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150785+0000","last_change":"2024-09-17T03:13:35.150085+0000","last_active":"2024-09-17T03:13:36.150785+0000","last_peered":"2024-09-17T03:13:36.150785+0000","last_clean":"2024-09-17T03:13:36.150785+0000","last_became_active":"2024-09-17T03:13:35.149724+0000","last_became_peered":"2024-09-17T03:13:35.149724+0000","last_unstale":"2024-09-17T03:13:36.150785+0000","last_undegraded":"2024-09-17T03:13:36.150785+0000","last_fullsized":"2024-09-17T03:13:36.150785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:43.977125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173013+0000","last_change":"2024-09-17T03:13:36.170595+0000","last_active":"2024-09-17T03:13:36.173013+0000","last_peered":"2024-09-17T03:13:36.173013+0000","last_clean":"2024-09-17T03:13:36.173013+0000","last_became_active":"2024-09-17T03:13:36.170264+0000","last_became_peered":"2024-09-17T03:13:36.170264+0000","last_unstale":"2024-09-17T03:13:36.173013+0000","last_undegraded":"2024-09-17T03:13:36.173013+0000","last_fullsized":"2024-09-17T03:13:36.173013+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:18.976321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150763+0000","last_change":"2024-09-17T03:13:35.144777+0000","last_active":"2024-09-17T03:13:36.150763+0000","last_peered":"2024-09-17T03:13:36.150763+0000","last_clean":"2024-09-17T03:13:36.150763+0000","last_became_active":"2024-09-17T03:13:35.144435+0000","last_became_peered":"2024-09-17T03:13:35.144435+0000","last_unstale":"2024-09-17T03:13:36.150763+0000","last_undegraded":"2024-09-17T03:13:36.150763+0000","last_fullsized":"2024-09-17T03:13:36.150763+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:03.012283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2024-09-17T03:13:36.157315+0000","last_change":"2024-09-17T03:13:36.157315+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:36.157315+0000","last_undegraded":"2024-09-17T03:13:36.157315+0000","last_fullsized":"2024-09-17T03:13:36.157315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"81'3","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.182085+0000","last_change":"2024-09-17T03:13:35.140368+0000","last_active":"2024-09-17T03:13:36.182085+0000","last_peered":"2024-09-17T03:13:36.182085+0000","last_clean":"2024-09-17T03:13:36.182085+0000","last_became_active":"2024-09-17T03:13:35.139934+0000","last_became_peered":"2024-09-17T03:13:35.139934+0000","last_unstale":"2024-09-17T03:13:36.182085+0000","last_undegraded":"2024-09-17T03:13:36.182085+0000","last_fullsized":"2024-09-17T03:13:36.182085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:31.279064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2024-09-17T03:13:36.161033+0000","last_change":"2024-09-17T03:13:36.161033+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:36.161033+0000","last_undegraded":"2024-09-17T03:13:36.161033+0000","last_fullsized":"2024-09-17T03:13:36.161033+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"81'5","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.175388+0000","last_change":"2024-09-17T03:13:35.148650+0000","last_active":"2024-09-17T03:13:36.175388+0000","last_peered":"2024-09-17T03:13:36.175388+0000","last_clean":"2024-09-17T03:13:36.175388+0000","last_became_active":"2024-09-17T03:13:35.148261+0000","last_became_peered":"2024-09-17T03:13:35.148261+0000","last_unstale":"2024-09-17T03:13:36.175388+0000","last_undegraded":"2024-09-17T03:13:36.175388+0000","last_fullsized":"2024-09-17T03:13:36.175388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:34.187583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2024-09-17T03:13:36.156718+0000","last_change":"2024-09-17T03:13:36.156718+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:36.156718+0000","last_undegraded":"2024-09-17T03:13:36.156718+0000","last_fullsized":"2024-09-17T03:13:36.156718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.151021+0000","last_change":"2024-09-17T03:13:35.147131+0000","last_active":"2024-09-17T03:13:36.151021+0000","last_peered":"2024-09-17T03:13:36.151021+0000","last_clean":"2024-09-17T03:13:36.151021+0000","last_became_active":"2024-09-17T03:13:35.146813+0000","last_became_peered":"2024-09-17T03:13:35.146813+0000","last_unstale":"2024-09-17T03:13:36.151021+0000","last_undegraded":"2024-09-17T03:13:36.151021+0000","last_fullsized":"2024-09-17T03:13:36.151021+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:34.868836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171407+0000","last_change":"2024-09-17T03:13:36.167033+0000","last_active":"2024-09-17T03:13:36.171407+0000","last_peered":"2024-09-17T03:13:36.171407+0000","last_clean":"2024-09-17T03:13:36.171407+0000","last_became_active":"2024-09-17T03:13:36.166686+0000","last_became_peered":"2024-09-17T03:13:36.166686+0000","last_unstale":"2024-09-17T03:13:36.171407+0000","last_undegraded":"2024-09-17T03:13:36.171407+0000","last_fullsized":"2024-09-17T03:13:36.171407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:32.691348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:13:34.119387+0000","last_change":"2024-09-17T03:13:34.119387+0000","last_active":"2024-09-17T03:13:34.119387+0000","last_peered":"2024-09-17T03:13:34.119387+0000","last_clean":"2024-09-17T03:13:34.119387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:34.119387+0000","last_undegraded":"2024-09-17T03:13:34.119387+0000","last_fullsized":"2024-09-17T03:13:34.119387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172441+0000","last_change":"2024-09-17T03:13:36.172337+0000","last_active":"2024-09-17T03:13:36.172441+0000","last_peered":"2024-09-17T03:13:36.172441+0000","last_clean":"2024-09-17T03:13:36.172441+0000","last_became_active":"2024-09-17T03:13:36.172033+0000","last_became_peered":"2024-09-17T03:13:36.172033+0000","last_unstale":"2024-09-17T03:13:36.172441+0000","last_undegraded":"2024-09-17T03:13:36.172441+0000","last_fullsized":"2024-09-17T03:13:36.172441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:48.036856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.148597+0000","last_change":"2024-09-17T03:13:35.145883+0000","last_active":"2024-09-17T03:13:36.148597+0000","last_peered":"2024-09-17T03:13:36.148597+0000","last_clean":"2024-09-17T03:13:36.148597+0000","last_became_active":"2024-09-17T03:13:35.145485+0000","last_became_peered":"2024-09-17T03:13:35.145485+0000","last_unstale":"2024-09-17T03:13:36.148597+0000","last_undegraded":"2024-09-17T03:13:36.148597+0000","last_fullsized":"2024-09-17T03:13:36.148597+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:33.828573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.167821+0000","last_change":"2024-09-17T03:13:36.162558+0000","last_active":"2024-09-17T03:13:36.167821+0000","last_peered":"2024-09-17T03:13:36.167821+0000","last_clean":"2024-09-17T03:13:36.167821+0000","last_became_active":"2024-09-17T03:13:36.162263+0000","last_became_peered":"2024-09-17T03:13:36.162263+0000","last_unstale":"2024-09-17T03:13:36.167821+0000","last_undegraded":"2024-09-17T03:13:36.167821+0000","last_fullsized":"2024-09-17T03:13:36.167821+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:26.393514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"81'5","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160497+0000","last_change":"2024-09-17T03:13:35.147811+0000","last_active":"2024-09-17T03:13:36.160497+0000","last_peered":"2024-09-17T03:13:36.160497+0000","last_clean":"2024-09-17T03:13:36.160497+0000","last_became_active":"2024-09-17T03:13:35.147540+0000","last_became_peered":"2024-09-17T03:13:35.147540+0000","last_unstale":"2024-09-17T03:13:36.160497+0000","last_undegraded":"2024-09-17T03:13:36.160497+0000","last_fullsized":"2024-09-17T03:13:36.160497+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:21.660023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168645+0000","last_change":"2024-09-17T03:13:36.160764+0000","last_active":"2024-09-17T03:13:36.168645+0000","last_peered":"2024-09-17T03:13:36.168645+0000","last_clean":"2024-09-17T03:13:36.168645+0000","last_became_active":"2024-09-17T03:13:36.160458+0000","last_became_peered":"2024-09-17T03:13:36.160458+0000","last_unstale":"2024-09-17T03:13:36.168645+0000","last_undegraded":"2024-09-17T03:13:36.168645+0000","last_fullsized":"2024-09-17T03:13:36.168645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:57.043310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.181628+0000","last_change":"2024-09-17T03:13:35.146348+0000","last_active":"2024-09-17T03:13:36.181628+0000","last_peered":"2024-09-17T03:13:36.181628+0000","last_clean":"2024-09-17T03:13:36.181628+0000","last_became_active":"2024-09-17T03:13:35.145718+0000","last_became_peered":"2024-09-17T03:13:35.145718+0000","last_unstale":"2024-09-17T03:13:36.181628+0000","last_undegraded":"2024-09-17T03:13:36.181628+0000","last_fullsized":"2024-09-17T03:13:36.181628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:39.536551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.163461+0000","last_change":"2024-09-17T03:13:36.158379+0000","last_active":"2024-09-17T03:13:36.163461+0000","last_peered":"2024-09-17T03:13:36.163461+0000","last_clean":"2024-09-17T03:13:36.163461+0000","last_became_active":"2024-09-17T03:13:36.157894+0000","last_became_peered":"2024-09-17T03:13:36.157894+0000","last_unstale":"2024-09-17T03:13:36.163461+0000","last_undegraded":"2024-09-17T03:13:36.163461+0000","last_fullsized":"2024-09-17T03:13:36.163461+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:36.956392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.162873+0000","last_change":"2024-09-17T03:13:35.148036+0000","last_active":"2024-09-17T03:13:36.162873+0000","last_peered":"2024-09-17T03:13:36.162873+0000","last_clean":"2024-09-17T03:13:36.162873+0000","last_became_active":"2024-09-17T03:13:35.147436+0000","last_became_peered":"2024-09-17T03:13:35.147436+0000","last_unstale":"2024-09-17T03:13:36.162873+0000","last_undegraded":"2024-09-17T03:13:36.162873+0000","last_fullsized":"2024-09-17T03:13:36.162873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:37.475359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171851+0000","last_change":"2024-09-17T03:13:36.167162+0000","last_active":"2024-09-17T03:13:36.171851+0000","last_peered":"2024-09-17T03:13:36.171851+0000","last_clean":"2024-09-17T03:13:36.171851+0000","last_became_active":"2024-09-17T03:13:36.166834+0000","last_became_peered":"2024-09-17T03:13:36.166834+0000","last_unstale":"2024-09-17T03:13:36.171851+0000","last_undegraded":"2024-09-17T03:13:36.171851+0000","last_fullsized":"2024-09-17T03:13:36.171851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:08.944447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160953+0000","last_change":"2024-09-17T03:13:35.150447+0000","last_active":"2024-09-17T03:13:36.160953+0000","last_peered":"2024-09-17T03:13:36.160953+0000","last_clean":"2024-09-17T03:13:36.160953+0000","last_became_active":"2024-09-17T03:13:35.150117+0000","last_became_peered":"2024-09-17T03:13:35.150117+0000","last_unstale":"2024-09-17T03:13:36.160953+0000","last_undegraded":"2024-09-17T03:13:36.160953+0000","last_fullsized":"2024-09-17T03:13:36.160953+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:03.128187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171406+0000","last_change":"2024-09-17T03:13:36.169959+0000","last_active":"2024-09-17T03:13:36.171406+0000","last_peered":"2024-09-17T03:13:36.171406+0000","last_clean":"2024-09-17T03:13:36.171406+0000","last_became_active":"2024-09-17T03:13:36.169633+0000","last_became_peered":"2024-09-17T03:13:36.169633+0000","last_unstale":"2024-09-17T03:13:36.171406+0000","last_undegraded":"2024-09-17T03:13:36.171406+0000","last_fullsized":"2024-09-17T03:13:36.171406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:53.203069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:13:34.119387+0000","last_change":"2024-09-17T03:13:34.119387+0000","last_active":"2024-09-17T03:13:34.119387+0000","last_peered":"2024-09-17T03:13:34.119387+0000","last_clean":"2024-09-17T03:13:34.119387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:34.119387+0000","last_undegraded":"2024-09-17T03:13:34.119387+0000","last_fullsized":"2024-09-17T03:13:34.119387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160547+0000","last_change":"2024-09-17T03:13:36.158573+0000","last_active":"2024-09-17T03:13:36.160547+0000","last_peered":"2024-09-17T03:13:36.160547+0000","last_clean":"2024-09-17T03:13:36.160547+0000","last_became_active":"2024-09-17T03:13:36.158208+0000","last_became_peered":"2024-09-17T03:13:36.158208+0000","last_unstale":"2024-09-17T03:13:36.160547+0000","last_undegraded":"2024-09-17T03:13:36.160547+0000","last_fullsized":"2024-09-17T03:13:36.160547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:43.797527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.158436+0000","last_change":"2024-09-17T03:13:35.148924+0000","last_active":"2024-09-17T03:13:36.158436+0000","last_peered":"2024-09-17T03:13:36.158436+0000","last_clean":"2024-09-17T03:13:36.158436+0000","last_became_active":"2024-09-17T03:13:35.148637+0000","last_became_peered":"2024-09-17T03:13:35.148637+0000","last_unstale":"2024-09-17T03:13:36.158436+0000","last_undegraded":"2024-09-17T03:13:36.158436+0000","last_fullsized":"2024-09-17T03:13:36.158436+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:35.581909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.169086+0000","last_change":"2024-09-17T03:13:36.162958+0000","last_active":"2024-09-17T03:13:36.169086+0000","last_peered":"2024-09-17T03:13:36.169086+0000","last_clean":"2024-09-17T03:13:36.169086+0000","last_became_active":"2024-09-17T03:13:36.162656+0000","last_became_peered":"2024-09-17T03:13:36.162656+0000","last_unstale":"2024-09-17T03:13:36.169086+0000","last_undegraded":"2024-09-17T03:13:36.169086+0000","last_fullsized":"2024-09-17T03:13:36.169086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:05.566969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.154780+0000","last_change":"2024-09-17T03:13:35.142641+0000","last_active":"2024-09-17T03:13:36.154780+0000","last_peered":"2024-09-17T03:13:36.154780+0000","last_clean":"2024-09-17T03:13:36.154780+0000","last_became_active":"2024-09-17T03:13:35.142331+0000","last_became_peered":"2024-09-17T03:13:35.142331+0000","last_unstale":"2024-09-17T03:13:36.154780+0000","last_undegraded":"2024-09-17T03:13:36.154780+0000","last_fullsized":"2024-09-17T03:13:36.154780+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:06.927325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172373+0000","last_change":"2024-09-17T03:13:36.167894+0000","last_active":"2024-09-17T03:13:36.172373+0000","last_peered":"2024-09-17T03:13:36.172373+0000","last_clean":"2024-09-17T03:13:36.172373+0000","last_became_active":"2024-09-17T03:13:36.167509+0000","last_became_peered":"2024-09-17T03:13:36.167509+0000","last_unstale":"2024-09-17T03:13:36.172373+0000","last_undegraded":"2024-09-17T03:13:36.172373+0000","last_fullsized":"2024-09-17T03:13:36.172373+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:24.063918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T03:13:34.119387+0000","last_change":"2024-09-17T03:13:34.119387+0000","last_active":"2024-09-17T03:13:34.119387+0000","last_peered":"2024-09-17T03:13:34.119387+0000","last_clean":"2024-09-17T03:13:34.119387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:34.119387+0000","last_undegraded":"2024-09-17T03:13:34.119387+0000","last_fullsized":"2024-09-17T03:13:34.119387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174824+0000","last_change":"2024-09-17T03:13:36.169746+0000","last_active":"2024-09-17T03:13:36.174824+0000","last_peered":"2024-09-17T03:13:36.174824+0000","last_clean":"2024-09-17T03:13:36.174824+0000","last_became_active":"2024-09-17T03:13:36.169430+0000","last_became_peered":"2024-09-17T03:13:36.169430+0000","last_unstale":"2024-09-17T03:13:36.174824+0000","last_undegraded":"2024-09-17T03:13:36.174824+0000","last_fullsized":"2024-09-17T03:13:36.174824+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:35.192731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150221+0000","last_change":"2024-09-17T03:13:35.145283+0000","last_active":"2024-09-17T03:13:36.150221+0000","last_peered":"2024-09-17T03:13:36.150221+0000","last_clean":"2024-09-17T03:13:36.150221+0000","last_became_active":"2024-09-17T03:13:35.144986+0000","last_became_peered":"2024-09-17T03:13:35.144986+0000","last_unstale":"2024-09-17T03:13:36.150221+0000","last_undegraded":"2024-09-17T03:13:36.150221+0000","last_fullsized":"2024-09-17T03:13:36.150221+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:50.213189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168708+0000","last_change":"2024-09-17T03:13:36.164579+0000","last_active":"2024-09-17T03:13:36.168708+0000","last_peered":"2024-09-17T03:13:36.168708+0000","last_clean":"2024-09-17T03:13:36.168708+0000","last_became_active":"2024-09-17T03:13:36.164264+0000","last_became_peered":"2024-09-17T03:13:36.164264+0000","last_unstale":"2024-09-17T03:13:36.168708+0000","last_undegraded":"2024-09-17T03:13:36.168708+0000","last_fullsized":"2024-09-17T03:13:36.168708+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:04.660596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150709+0000","last_change":"2024-09-17T03:13:35.148815+0000","last_active":"2024-09-17T03:13:36.150709+0000","last_peered":"2024-09-17T03:13:36.150709+0000","last_clean":"2024-09-17T03:13:36.150709+0000","last_became_active":"2024-09-17T03:13:35.148507+0000","last_became_peered":"2024-09-17T03:13:35.148507+0000","last_unstale":"2024-09-17T03:13:36.150709+0000","last_undegraded":"2024-09-17T03:13:36.150709+0000","last_fullsized":"2024-09-17T03:13:36.150709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:12.011558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.169507+0000","last_change":"2024-09-17T03:13:36.161389+0000","last_active":"2024-09-17T03:13:36.169507+0000","last_peered":"2024-09-17T03:13:36.169507+0000","last_clean":"2024-09-17T03:13:36.169507+0000","last_became_active":"2024-09-17T03:13:36.161086+0000","last_became_peered":"2024-09-17T03:13:36.161086+0000","last_unstale":"2024-09-17T03:13:36.169507+0000","last_undegraded":"2024-09-17T03:13:36.169507+0000","last_fullsized":"2024-09-17T03:13:36.169507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:46.792762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150388+0000","last_change":"2024-09-17T03:13:35.146844+0000","last_active":"2024-09-17T03:13:36.150388+0000","last_peered":"2024-09-17T03:13:36.150388+0000","last_clean":"2024-09-17T03:13:36.150388+0000","last_became_active":"2024-09-17T03:13:35.146239+0000","last_became_peered":"2024-09-17T03:13:35.146239+0000","last_unstale":"2024-09-17T03:13:36.150388+0000","last_undegraded":"2024-09-17T03:13:36.150388+0000","last_fullsized":"2024-09-17T03:13:36.150388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:16.862049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174913+0000","last_change":"2024-09-17T03:13:36.169810+0000","last_active":"2024-09-17T03:13:36.174913+0000","last_peered":"2024-09-17T03:13:36.174913+0000","last_clean":"2024-09-17T03:13:36.174913+0000","last_became_active":"2024-09-17T03:13:36.169472+0000","last_became_peered":"2024-09-17T03:13:36.169472+0000","last_unstale":"2024-09-17T03:13:36.174913+0000","last_undegraded":"2024-09-17T03:13:36.174913+0000","last_fullsized":"2024-09-17T03:13:36.174913+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:34.833721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150452+0000","last_change":"2024-09-17T03:13:35.149436+0000","last_active":"2024-09-17T03:13:36.150452+0000","last_peered":"2024-09-17T03:13:36.150452+0000","last_clean":"2024-09-17T03:13:36.150452+0000","last_became_active":"2024-09-17T03:13:35.147481+0000","last_became_peered":"2024-09-17T03:13:35.147481+0000","last_unstale":"2024-09-17T03:13:36.150452+0000","last_undegraded":"2024-09-17T03:13:36.150452+0000","last_fullsized":"2024-09-17T03:13:36.150452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:09.546632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160538+0000","last_change":"2024-09-17T03:13:36.158743+0000","last_active":"2024-09-17T03:13:36.160538+0000","last_peered":"2024-09-17T03:13:36.160538+0000","last_clean":"2024-09-17T03:13:36.160538+0000","last_became_active":"2024-09-17T03:13:36.158441+0000","last_became_peered":"2024-09-17T03:13:36.158441+0000","last_unstale":"2024-09-17T03:13:36.160538+0000","last_undegraded":"2024-09-17T03:13:36.160538+0000","last_fullsized":"2024-09-17T03:13:36.160538+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:51.574328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160954+0000","last_change":"2024-09-17T03:13:35.145764+0000","last_active":"2024-09-17T03:13:36.160954+0000","last_peered":"2024-09-17T03:13:36.160954+0000","last_clean":"2024-09-17T03:13:36.160954+0000","last_became_active":"2024-09-17T03:13:35.145453+0000","last_became_peered":"2024-09-17T03:13:35.145453+0000","last_unstale":"2024-09-17T03:13:36.160954+0000","last_undegraded":"2024-09-17T03:13:36.160954+0000","last_fullsized":"2024-09-17T03:13:36.160954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:04.680766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2024-09-17T03:13:36.157325+0000","last_change":"2024-09-17T03:13:36.157325+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:36.157325+0000","last_undegraded":"2024-09-17T03:13:36.157325+0000","last_fullsized":"2024-09-17T03:13:36.157325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.154152+0000","last_change":"2024-09-17T03:13:35.149928+0000","last_active":"2024-09-17T03:13:36.154152+0000","last_peered":"2024-09-17T03:13:36.154152+0000","last_clean":"2024-09-17T03:13:36.154152+0000","last_became_active":"2024-09-17T03:13:35.149571+0000","last_became_peered":"2024-09-17T03:13:35.149571+0000","last_unstale":"2024-09-17T03:13:36.154152+0000","last_undegraded":"2024-09-17T03:13:36.154152+0000","last_fullsized":"2024-09-17T03:13:36.154152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:32.720660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171470+0000","last_change":"2024-09-17T03:13:36.166632+0000","last_active":"2024-09-17T03:13:36.171470+0000","last_peered":"2024-09-17T03:13:36.171470+0000","last_clean":"2024-09-17T03:13:36.171470+0000","last_became_active":"2024-09-17T03:13:36.166308+0000","last_became_peered":"2024-09-17T03:13:36.166308+0000","last_unstale":"2024-09-17T03:13:36.171470+0000","last_undegraded":"2024-09-17T03:13:36.171470+0000","last_fullsized":"2024-09-17T03:13:36.171470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:07.609432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150305+0000","last_change":"2024-09-17T03:13:35.148824+0000","last_active":"2024-09-17T03:13:36.150305+0000","last_peered":"2024-09-17T03:13:36.150305+0000","last_clean":"2024-09-17T03:13:36.150305+0000","last_became_active":"2024-09-17T03:13:35.148417+0000","last_became_peered":"2024-09-17T03:13:35.148417+0000","last_unstale":"2024-09-17T03:13:36.150305+0000","last_undegraded":"2024-09-17T03:13:36.150305+0000","last_fullsized":"2024-09-17T03:13:36.150305+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:58.224149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171614+0000","last_change":"2024-09-17T03:13:36.163897+0000","last_active":"2024-09-17T03:13:36.171614+0000","last_peered":"2024-09-17T03:13:36.171614+0000","last_clean":"2024-09-17T03:13:36.171614+0000","last_became_active":"2024-09-17T03:13:36.163275+0000","last_became_peered":"2024-09-17T03:13:36.163275+0000","last_unstale":"2024-09-17T03:13:36.171614+0000","last_undegraded":"2024-09-17T03:13:36.171614+0000","last_fullsized":"2024-09-17T03:13:36.171614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:37.972855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.154338+0000","last_change":"2024-09-17T03:13:35.142421+0000","last_active":"2024-09-17T03:13:36.154338+0000","last_peered":"2024-09-17T03:13:36.154338+0000","last_clean":"2024-09-17T03:13:36.154338+0000","last_became_active":"2024-09-17T03:13:35.142113+0000","last_became_peered":"2024-09-17T03:13:35.142113+0000","last_unstale":"2024-09-17T03:13:36.154338+0000","last_undegraded":"2024-09-17T03:13:36.154338+0000","last_fullsized":"2024-09-17T03:13:36.154338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:12.371249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173952+0000","last_change":"2024-09-17T03:13:36.166539+0000","last_active":"2024-09-17T03:13:36.173952+0000","last_peered":"2024-09-17T03:13:36.173952+0000","last_clean":"2024-09-17T03:13:36.173952+0000","last_became_active":"2024-09-17T03:13:36.166189+0000","last_became_peered":"2024-09-17T03:13:36.166189+0000","last_unstale":"2024-09-17T03:13:36.173952+0000","last_undegraded":"2024-09-17T03:13:36.173952+0000","last_fullsized":"2024-09-17T03:13:36.173952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:22.963501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"81'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.155281+0000","last_change":"2024-09-17T03:13:35.148171+0000","last_active":"2024-09-17T03:13:36.155281+0000","last_peered":"2024-09-17T03:13:36.155281+0000","last_clean":"2024-09-17T03:13:36.155281+0000","last_became_active":"2024-09-17T03:13:35.147822+0000","last_became_peered":"2024-09-17T03:13:35.147822+0000","last_unstale":"2024-09-17T03:13:36.155281+0000","last_undegraded":"2024-09-17T03:13:36.155281+0000","last_fullsized":"2024-09-17T03:13:36.155281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:17.971173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":216,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.153800+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:13:36.153800+0000","last_peered":"2024-09-17T03:13:36.153800+0000","last_clean":"2024-09-17T03:13:36.153800+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:13:36.153800+0000","last_undegraded":"2024-09-17T03:13:36.153800+0000","last_fullsized":"2024-09-17T03:13:36.153800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":122,"acting":122,"num_store_stats":7},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":1470,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":58,"acting":58,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509508,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28564,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343276,"statfs":{"total":96636764160,"available":96607514624,"internally_reserved":0,"allocated":1568768,"data_stored":1003684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509508,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":974848,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509507,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":974848,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509508,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":974848,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":974848,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":974848,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509508,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1568768,"data_stored":1003684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574915,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32120,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":950272,"data_stored":401224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:13:39.170 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:13:39.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.320+0000 7f5361f58640 1 -- 172.21.15.78:0/2055319127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535c06cde0 msgr2=0x7f535c06d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.320+0000 7f5361f58640 1 --2- 172.21.15.78:0/2055319127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535c06cde0 0x7f535c06d1f0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f5350009830 tx=0x7f535002a480 comp rx=0 tx=0).stop 2024-09-17T03:13:39.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.320+0000 7f5361f58640 1 -- 172.21.15.78:0/2055319127 shutdown_connections 2024-09-17T03:13:39.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.320+0000 7f5361f58640 1 --2- 172.21.15.78:0/2055319127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535c06cde0 0x7f535c06d1f0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.320+0000 7f5361f58640 1 -- 172.21.15.78:0/2055319127 >> 172.21.15.78:0/2055319127 conn(0x7f535c0cd530 msgr2=0x7f535c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:39.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.320+0000 7f5361f58640 1 -- 172.21.15.78:0/2055319127 shutdown_connections 2024-09-17T03:13:39.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.320+0000 7f5361f58640 1 -- 172.21.15.78:0/2055319127 wait complete. 2024-09-17T03:13:39.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.322+0000 7f5361f58640 1 Processor -- start 2024-09-17T03:13:39.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.322+0000 7f5361f58640 1 -- start start 2024-09-17T03:13:39.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.323+0000 7f5361f58640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f535c06cde0 0x7f535c0c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:39.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.323+0000 7f5361f58640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535c06e470 0x7f535c0c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:39.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.323+0000 7f5361f58640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f535c160340 0x7f535c14e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:39.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.323+0000 7f5361f58640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f535c160e60 con 0x7f535c06e470 2024-09-17T03:13:39.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.323+0000 7f5361f58640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f535c0cbc00 con 0x7f535c06cde0 2024-09-17T03:13:39.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.323+0000 7f5361f58640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f535c160fe0 con 0x7f535c160340 2024-09-17T03:13:39.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.323+0000 7f535affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535c06e470 0x7f535c0c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:39.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.323+0000 7f535affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535c06e470 0x7f535c0c59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39478/0 (socket says 172.21.15.78:39478) 2024-09-17T03:13:39.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.323+0000 7f535affd640 1 -- 172.21.15.78:0/2893906517 learned_addr learned my addr 172.21.15.78:0/2893906517 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:39.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.323+0000 7f535b7fe640 1 --2- 172.21.15.78:0/2893906517 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f535c06cde0 0x7f535c0c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:39.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.323+0000 7f535bfff640 1 --2- 172.21.15.78:0/2893906517 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f535c160340 0x7f535c14e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:39.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.323+0000 7f535affd640 1 -- 172.21.15.78:0/2893906517 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f535c160340 msgr2=0x7f535c14e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.323+0000 7f535affd640 1 --2- 172.21.15.78:0/2893906517 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f535c160340 0x7f535c14e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.323+0000 7f535affd640 1 -- 172.21.15.78:0/2893906517 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f535c06cde0 msgr2=0x7f535c0c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.323+0000 7f535affd640 1 --2- 172.21.15.78:0/2893906517 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f535c06cde0 0x7f535c0c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.324+0000 7f535affd640 1 -- 172.21.15.78:0/2893906517 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535c1f49f0 con 0x7f535c06e470 2024-09-17T03:13:39.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.324+0000 7f535bfff640 1 --2- 172.21.15.78:0/2893906517 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f535c160340 0x7f535c14e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:39.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.324+0000 7f535b7fe640 1 --2- 172.21.15.78:0/2893906517 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f535c06cde0 0x7f535c0c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:39.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.324+0000 7f535affd640 1 --2- 172.21.15.78:0/2893906517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535c06e470 0x7f535c0c59d0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f5350000c00 tx=0x7f5350033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:39.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.324+0000 7f5343fff640 1 -- 172.21.15.78:0/2893906517 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5350031d60 con 0x7f535c06e470 2024-09-17T03:13:39.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.324+0000 7f5343fff640 1 -- 172.21.15.78:0/2893906517 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53500330d0 con 0x7f535c06e470 2024-09-17T03:13:39.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.324+0000 7f5361f58640 1 -- 172.21.15.78:0/2893906517 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f535c0c8c50 con 0x7f535c06e470 2024-09-17T03:13:39.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.324+0000 7f5343fff640 1 -- 172.21.15.78:0/2893906517 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5350033520 con 0x7f535c06e470 2024-09-17T03:13:39.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.324+0000 7f5361f58640 1 -- 172.21.15.78:0/2893906517 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f535c0c9c70 con 0x7f535c06e470 2024-09-17T03:13:39.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.325+0000 7f5361f58640 1 -- 172.21.15.78:0/2893906517 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f535c0b1fd0 con 0x7f535c06e470 2024-09-17T03:13:39.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.326+0000 7f5343fff640 1 -- 172.21.15.78:0/2893906517 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f53500035f0 con 0x7f535c06e470 2024-09-17T03:13:39.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.326+0000 7f5343fff640 1 --2- 172.21.15.78:0/2893906517 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5348078b90 0x7f534807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:39.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.326+0000 7f5343fff640 1 -- 172.21.15.78:0/2893906517 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f53500bc290 con 0x7f535c06e470 2024-09-17T03:13:39.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.326+0000 7f535b7fe640 1 --2- 172.21.15.78:0/2893906517 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5348078b90 0x7f534807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:39.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.327+0000 7f535b7fe640 1 --2- 172.21.15.78:0/2893906517 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5348078b90 0x7f534807b0a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f534c006fd0 tx=0x7f534c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:39.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.331+0000 7f5343fff640 1 -- 172.21.15.78:0/2893906517 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f535003f030 con 0x7f535c06e470 2024-09-17T03:13:39.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.501+0000 7f5361f58640 1 -- 172.21.15.78:0/2893906517 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f535c0b63c0 con 0x7f5348078b90 2024-09-17T03:13:39.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.505+0000 7f5343fff640 1 -- 172.21.15.78:0/2893906517 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251672 (secure 0 0 0) 0x7f535c0b63c0 con 0x7f5348078b90 2024-09-17T03:13:39.507 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:39.508 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:13:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.509+0000 7f5361f58640 1 -- 172.21.15.78:0/2893906517 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5348078b90 msgr2=0x7f534807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.509+0000 7f5361f58640 1 --2- 172.21.15.78:0/2893906517 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5348078b90 0x7f534807b0a0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f534c006fd0 tx=0x7f534c008040 comp rx=0 tx=0).stop 2024-09-17T03:13:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.509+0000 7f5361f58640 1 -- 172.21.15.78:0/2893906517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535c06e470 msgr2=0x7f535c0c59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.509+0000 7f5361f58640 1 --2- 172.21.15.78:0/2893906517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535c06e470 0x7f535c0c59d0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f5350000c00 tx=0x7f5350033d60 comp rx=0 tx=0).stop 2024-09-17T03:13:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.509+0000 7f5361f58640 1 -- 172.21.15.78:0/2893906517 shutdown_connections 2024-09-17T03:13:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.509+0000 7f5361f58640 1 --2- 172.21.15.78:0/2893906517 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f535c160340 0x7f535c14e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.509+0000 7f5361f58640 1 --2- 172.21.15.78:0/2893906517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f535c06e470 0x7f535c0c59d0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.509+0000 7f5361f58640 1 --2- 172.21.15.78:0/2893906517 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5348078b90 0x7f534807b0a0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.509+0000 7f5361f58640 1 --2- 172.21.15.78:0/2893906517 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f535c06cde0 0x7f535c0c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.509+0000 7f5361f58640 1 -- 172.21.15.78:0/2893906517 >> 172.21.15.78:0/2893906517 conn(0x7f535c0cd530 msgr2=0x7f535c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:39.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.509+0000 7f5361f58640 1 -- 172.21.15.78:0/2893906517 shutdown_connections 2024-09-17T03:13:39.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.509+0000 7f5361f58640 1 -- 172.21.15.78:0/2893906517 wait complete. 2024-09-17T03:13:39.519 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2024-09-17T03:13:39.203452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591838,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":131,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245864,"kb_used_data":8812,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754728856,"statfs":{"total":773094113280,"available":772842348544,"internally_reserved":0,"allocated":9023488,"data_stored":4501951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":242535986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1470,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.077822"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171675+0000","last_change":"2024-09-17T03:13:36.164503+0000","last_active":"2024-09-17T03:13:36.171675+0000","last_peered":"2024-09-17T03:13:36.171675+0000","last_clean":"2024-09-17T03:13:36.171675+0000","last_became_active":"2024-09-17T03:13:36.164189+0000","last_became_peered":"2024-09-17T03:13:36.164189+0000","last_unstale":"2024-09-17T03:13:36.171675+0000","last_undegraded":"2024-09-17T03:13:36.171675+0000","last_fullsized":"2024-09-17T03:13:36.171675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:24.415909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168002+0000","last_change":"2024-09-17T03:13:36.163785+0000","last_active":"2024-09-17T03:13:36.168002+0000","last_peered":"2024-09-17T03:13:36.168002+0000","last_clean":"2024-09-17T03:13:36.168002+0000","last_became_active":"2024-09-17T03:13:36.163491+0000","last_became_peered":"2024-09-17T03:13:36.163491+0000","last_unstale":"2024-09-17T03:13:36.168002+0000","last_undegraded":"2024-09-17T03:13:36.168002+0000","last_fullsized":"2024-09-17T03:13:36.168002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:16.451197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.166961+0000","last_change":"2024-09-17T03:13:36.158610+0000","last_active":"2024-09-17T03:13:36.166961+0000","last_peered":"2024-09-17T03:13:36.166961+0000","last_clean":"2024-09-17T03:13:36.166961+0000","last_became_active":"2024-09-17T03:13:36.158308+0000","last_became_peered":"2024-09-17T03:13:36.158308+0000","last_unstale":"2024-09-17T03:13:36.166961+0000","last_undegraded":"2024-09-17T03:13:36.166961+0000","last_fullsized":"2024-09-17T03:13:36.166961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:54.875053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2024-09-17T03:13:36.156096+0000","last_change":"2024-09-17T03:13:36.156096+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:36.156096+0000","last_undegraded":"2024-09-17T03:13:36.156096+0000","last_fullsized":"2024-09-17T03:13:36.156096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174907+0000","last_change":"2024-09-17T03:13:36.171195+0000","last_active":"2024-09-17T03:13:36.174907+0000","last_peered":"2024-09-17T03:13:36.174907+0000","last_clean":"2024-09-17T03:13:36.174907+0000","last_became_active":"2024-09-17T03:13:36.170849+0000","last_became_peered":"2024-09-17T03:13:36.170849+0000","last_unstale":"2024-09-17T03:13:36.174907+0000","last_undegraded":"2024-09-17T03:13:36.174907+0000","last_fullsized":"2024-09-17T03:13:36.174907+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:54.973430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168655+0000","last_change":"2024-09-17T03:13:36.164233+0000","last_active":"2024-09-17T03:13:36.168655+0000","last_peered":"2024-09-17T03:13:36.168655+0000","last_clean":"2024-09-17T03:13:36.168655+0000","last_became_active":"2024-09-17T03:13:36.163925+0000","last_became_peered":"2024-09-17T03:13:36.163925+0000","last_unstale":"2024-09-17T03:13:36.168655+0000","last_undegraded":"2024-09-17T03:13:36.168655+0000","last_fullsized":"2024-09-17T03:13:36.168655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:24.380925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174980+0000","last_change":"2024-09-17T03:13:36.171062+0000","last_active":"2024-09-17T03:13:36.174980+0000","last_peered":"2024-09-17T03:13:36.174980+0000","last_clean":"2024-09-17T03:13:36.174980+0000","last_became_active":"2024-09-17T03:13:36.170264+0000","last_became_peered":"2024-09-17T03:13:36.170264+0000","last_unstale":"2024-09-17T03:13:36.174980+0000","last_undegraded":"2024-09-17T03:13:36.174980+0000","last_fullsized":"2024-09-17T03:13:36.174980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:44.954526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.159417+0000","last_change":"2024-09-17T03:13:36.154137+0000","last_active":"2024-09-17T03:13:36.159417+0000","last_peered":"2024-09-17T03:13:36.159417+0000","last_clean":"2024-09-17T03:13:36.159417+0000","last_became_active":"2024-09-17T03:13:36.153776+0000","last_became_peered":"2024-09-17T03:13:36.153776+0000","last_unstale":"2024-09-17T03:13:36.159417+0000","last_undegraded":"2024-09-17T03:13:36.159417+0000","last_fullsized":"2024-09-17T03:13:36.159417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:54.973430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172327+0000","last_change":"2024-09-17T03:13:36.165365+0000","last_active":"2024-09-17T03:13:36.172327+0000","last_peered":"2024-09-17T03:13:36.172327+0000","last_clean":"2024-09-17T03:13:36.172327+0000","last_became_active":"2024-09-17T03:13:36.165047+0000","last_became_peered":"2024-09-17T03:13:36.165047+0000","last_unstale":"2024-09-17T03:13:36.172327+0000","last_undegraded":"2024-09-17T03:13:36.172327+0000","last_fullsized":"2024-09-17T03:13:36.172327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:35.013596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.163241+0000","last_change":"2024-09-17T03:13:36.158884+0000","last_active":"2024-09-17T03:13:36.163241+0000","last_peered":"2024-09-17T03:13:36.163241+0000","last_clean":"2024-09-17T03:13:36.163241+0000","last_became_active":"2024-09-17T03:13:36.157801+0000","last_became_peered":"2024-09-17T03:13:36.157801+0000","last_unstale":"2024-09-17T03:13:36.163241+0000","last_undegraded":"2024-09-17T03:13:36.163241+0000","last_fullsized":"2024-09-17T03:13:36.163241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:34.514645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.165971+0000","last_change":"2024-09-17T03:13:36.159357+0000","last_active":"2024-09-17T03:13:36.165971+0000","last_peered":"2024-09-17T03:13:36.165971+0000","last_clean":"2024-09-17T03:13:36.165971+0000","last_became_active":"2024-09-17T03:13:36.159037+0000","last_became_peered":"2024-09-17T03:13:36.159037+0000","last_unstale":"2024-09-17T03:13:36.165971+0000","last_undegraded":"2024-09-17T03:13:36.165971+0000","last_fullsized":"2024-09-17T03:13:36.165971+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:10.901422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.162938+0000","last_change":"2024-09-17T03:13:36.157305+0000","last_active":"2024-09-17T03:13:36.162938+0000","last_peered":"2024-09-17T03:13:36.162938+0000","last_clean":"2024-09-17T03:13:36.162938+0000","last_became_active":"2024-09-17T03:13:36.156967+0000","last_became_peered":"2024-09-17T03:13:36.156967+0000","last_unstale":"2024-09-17T03:13:36.162938+0000","last_undegraded":"2024-09-17T03:13:36.162938+0000","last_fullsized":"2024-09-17T03:13:36.162938+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:46.504996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171798+0000","last_change":"2024-09-17T03:13:36.170755+0000","last_active":"2024-09-17T03:13:36.171798+0000","last_peered":"2024-09-17T03:13:36.171798+0000","last_clean":"2024-09-17T03:13:36.171798+0000","last_became_active":"2024-09-17T03:13:36.170436+0000","last_became_peered":"2024-09-17T03:13:36.170436+0000","last_unstale":"2024-09-17T03:13:36.171798+0000","last_undegraded":"2024-09-17T03:13:36.171798+0000","last_fullsized":"2024-09-17T03:13:36.171798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:03.088723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.175020+0000","last_change":"2024-09-17T03:13:36.171144+0000","last_active":"2024-09-17T03:13:36.175020+0000","last_peered":"2024-09-17T03:13:36.175020+0000","last_clean":"2024-09-17T03:13:36.175020+0000","last_became_active":"2024-09-17T03:13:36.170849+0000","last_became_peered":"2024-09-17T03:13:36.170849+0000","last_unstale":"2024-09-17T03:13:36.175020+0000","last_undegraded":"2024-09-17T03:13:36.175020+0000","last_fullsized":"2024-09-17T03:13:36.175020+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:49.302326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275265+0000","last_change":"2024-09-17T03:13:36.161513+0000","last_active":"2024-09-17T03:13:37.275265+0000","last_peered":"2024-09-17T03:13:37.275265+0000","last_clean":"2024-09-17T03:13:37.275265+0000","last_became_active":"2024-09-17T03:13:36.161196+0000","last_became_peered":"2024-09-17T03:13:36.161196+0000","last_unstale":"2024-09-17T03:13:37.275265+0000","last_undegraded":"2024-09-17T03:13:37.275265+0000","last_fullsized":"2024-09-17T03:13:37.275265+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:11.223567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.164882+0000","last_change":"2024-09-17T03:13:36.159093+0000","last_active":"2024-09-17T03:13:36.164882+0000","last_peered":"2024-09-17T03:13:36.164882+0000","last_clean":"2024-09-17T03:13:36.164882+0000","last_became_active":"2024-09-17T03:13:36.158546+0000","last_became_peered":"2024-09-17T03:13:36.158546+0000","last_unstale":"2024-09-17T03:13:36.164882+0000","last_undegraded":"2024-09-17T03:13:36.164882+0000","last_fullsized":"2024-09-17T03:13:36.164882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:44.382837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172830+0000","last_change":"2024-09-17T03:13:36.172719+0000","last_active":"2024-09-17T03:13:36.172830+0000","last_peered":"2024-09-17T03:13:36.172830+0000","last_clean":"2024-09-17T03:13:36.172830+0000","last_became_active":"2024-09-17T03:13:36.172362+0000","last_became_peered":"2024-09-17T03:13:36.172362+0000","last_unstale":"2024-09-17T03:13:36.172830+0000","last_undegraded":"2024-09-17T03:13:36.172830+0000","last_fullsized":"2024-09-17T03:13:36.172830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:43.797527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172392+0000","last_change":"2024-09-17T03:13:36.170457+0000","last_active":"2024-09-17T03:13:36.172392+0000","last_peered":"2024-09-17T03:13:36.172392+0000","last_clean":"2024-09-17T03:13:36.172392+0000","last_became_active":"2024-09-17T03:13:36.170155+0000","last_became_peered":"2024-09-17T03:13:36.170155+0000","last_unstale":"2024-09-17T03:13:36.172392+0000","last_undegraded":"2024-09-17T03:13:36.172392+0000","last_fullsized":"2024-09-17T03:13:36.172392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:16.330644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.167407+0000","last_change":"2024-09-17T03:13:36.167306+0000","last_active":"2024-09-17T03:13:36.167407+0000","last_peered":"2024-09-17T03:13:36.167407+0000","last_clean":"2024-09-17T03:13:36.167407+0000","last_became_active":"2024-09-17T03:13:36.167004+0000","last_became_peered":"2024-09-17T03:13:36.167004+0000","last_unstale":"2024-09-17T03:13:36.167407+0000","last_undegraded":"2024-09-17T03:13:36.167407+0000","last_fullsized":"2024-09-17T03:13:36.167407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:25.624815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.170731+0000","last_change":"2024-09-17T03:13:36.164087+0000","last_active":"2024-09-17T03:13:36.170731+0000","last_peered":"2024-09-17T03:13:36.170731+0000","last_clean":"2024-09-17T03:13:36.170731+0000","last_became_active":"2024-09-17T03:13:36.163793+0000","last_became_peered":"2024-09-17T03:13:36.163793+0000","last_unstale":"2024-09-17T03:13:36.170731+0000","last_undegraded":"2024-09-17T03:13:36.170731+0000","last_fullsized":"2024-09-17T03:13:36.170731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:39.687980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172698+0000","last_change":"2024-09-17T03:13:36.170832+0000","last_active":"2024-09-17T03:13:36.172698+0000","last_peered":"2024-09-17T03:13:36.172698+0000","last_clean":"2024-09-17T03:13:36.172698+0000","last_became_active":"2024-09-17T03:13:36.170477+0000","last_became_peered":"2024-09-17T03:13:36.170477+0000","last_unstale":"2024-09-17T03:13:36.172698+0000","last_undegraded":"2024-09-17T03:13:36.172698+0000","last_fullsized":"2024-09-17T03:13:36.172698+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:50.642766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173666+0000","last_change":"2024-09-17T03:13:36.166922+0000","last_active":"2024-09-17T03:13:36.173666+0000","last_peered":"2024-09-17T03:13:36.173666+0000","last_clean":"2024-09-17T03:13:36.173666+0000","last_became_active":"2024-09-17T03:13:36.166609+0000","last_became_peered":"2024-09-17T03:13:36.166609+0000","last_unstale":"2024-09-17T03:13:36.173666+0000","last_undegraded":"2024-09-17T03:13:36.173666+0000","last_fullsized":"2024-09-17T03:13:36.173666+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:55.515484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171645+0000","last_change":"2024-09-17T03:13:36.164280+0000","last_active":"2024-09-17T03:13:36.171645+0000","last_peered":"2024-09-17T03:13:36.171645+0000","last_clean":"2024-09-17T03:13:36.171645+0000","last_became_active":"2024-09-17T03:13:36.163689+0000","last_became_peered":"2024-09-17T03:13:36.163689+0000","last_unstale":"2024-09-17T03:13:36.171645+0000","last_undegraded":"2024-09-17T03:13:36.171645+0000","last_fullsized":"2024-09-17T03:13:36.171645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:19.690392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.170927+0000","last_change":"2024-09-17T03:13:36.166970+0000","last_active":"2024-09-17T03:13:36.170927+0000","last_peered":"2024-09-17T03:13:36.170927+0000","last_clean":"2024-09-17T03:13:36.170927+0000","last_became_active":"2024-09-17T03:13:36.166665+0000","last_became_peered":"2024-09-17T03:13:36.166665+0000","last_unstale":"2024-09-17T03:13:36.170927+0000","last_undegraded":"2024-09-17T03:13:36.170927+0000","last_fullsized":"2024-09-17T03:13:36.170927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:05.146731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.165529+0000","last_change":"2024-09-17T03:13:36.156703+0000","last_active":"2024-09-17T03:13:36.165529+0000","last_peered":"2024-09-17T03:13:36.165529+0000","last_clean":"2024-09-17T03:13:36.165529+0000","last_became_active":"2024-09-17T03:13:36.156367+0000","last_became_peered":"2024-09-17T03:13:36.156367+0000","last_unstale":"2024-09-17T03:13:36.165529+0000","last_undegraded":"2024-09-17T03:13:36.165529+0000","last_fullsized":"2024-09-17T03:13:36.165529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:05.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168674+0000","last_change":"2024-09-17T03:13:36.166639+0000","last_active":"2024-09-17T03:13:36.168674+0000","last_peered":"2024-09-17T03:13:36.168674+0000","last_clean":"2024-09-17T03:13:36.168674+0000","last_became_active":"2024-09-17T03:13:36.166289+0000","last_became_peered":"2024-09-17T03:13:36.166289+0000","last_unstale":"2024-09-17T03:13:36.168674+0000","last_undegraded":"2024-09-17T03:13:36.168674+0000","last_fullsized":"2024-09-17T03:13:36.168674+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:38.480507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173441+0000","last_change":"2024-09-17T03:13:36.173311+0000","last_active":"2024-09-17T03:13:36.173441+0000","last_peered":"2024-09-17T03:13:36.173441+0000","last_clean":"2024-09-17T03:13:36.173441+0000","last_became_active":"2024-09-17T03:13:36.172541+0000","last_became_peered":"2024-09-17T03:13:36.172541+0000","last_unstale":"2024-09-17T03:13:36.173441+0000","last_undegraded":"2024-09-17T03:13:36.173441+0000","last_fullsized":"2024-09-17T03:13:36.173441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:24.380925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171475+0000","last_change":"2024-09-17T03:13:36.164574+0000","last_active":"2024-09-17T03:13:36.171475+0000","last_peered":"2024-09-17T03:13:36.171475+0000","last_clean":"2024-09-17T03:13:36.171475+0000","last_became_active":"2024-09-17T03:13:36.164233+0000","last_became_peered":"2024-09-17T03:13:36.164233+0000","last_unstale":"2024-09-17T03:13:36.171475+0000","last_undegraded":"2024-09-17T03:13:36.171475+0000","last_fullsized":"2024-09-17T03:13:36.171475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:13.580635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.166364+0000","last_change":"2024-09-17T03:13:36.159680+0000","last_active":"2024-09-17T03:13:36.166364+0000","last_peered":"2024-09-17T03:13:36.166364+0000","last_clean":"2024-09-17T03:13:36.166364+0000","last_became_active":"2024-09-17T03:13:36.159385+0000","last_became_peered":"2024-09-17T03:13:36.159385+0000","last_unstale":"2024-09-17T03:13:36.166364+0000","last_undegraded":"2024-09-17T03:13:36.166364+0000","last_fullsized":"2024-09-17T03:13:36.166364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:05.330405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174358+0000","last_change":"2024-09-17T03:13:36.174241+0000","last_active":"2024-09-17T03:13:36.174358+0000","last_peered":"2024-09-17T03:13:36.174358+0000","last_clean":"2024-09-17T03:13:36.174358+0000","last_became_active":"2024-09-17T03:13:36.173940+0000","last_became_peered":"2024-09-17T03:13:36.173940+0000","last_unstale":"2024-09-17T03:13:36.174358+0000","last_undegraded":"2024-09-17T03:13:36.174358+0000","last_fullsized":"2024-09-17T03:13:36.174358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:31:27.192758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171890+0000","last_change":"2024-09-17T03:13:36.168808+0000","last_active":"2024-09-17T03:13:36.171890+0000","last_peered":"2024-09-17T03:13:36.171890+0000","last_clean":"2024-09-17T03:13:36.171890+0000","last_became_active":"2024-09-17T03:13:36.167241+0000","last_became_peered":"2024-09-17T03:13:36.167241+0000","last_unstale":"2024-09-17T03:13:36.171890+0000","last_undegraded":"2024-09-17T03:13:36.171890+0000","last_fullsized":"2024-09-17T03:13:36.171890+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:02.497727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172893+0000","last_change":"2024-09-17T03:13:36.167980+0000","last_active":"2024-09-17T03:13:36.172893+0000","last_peered":"2024-09-17T03:13:36.172893+0000","last_clean":"2024-09-17T03:13:36.172893+0000","last_became_active":"2024-09-17T03:13:36.167284+0000","last_became_peered":"2024-09-17T03:13:36.167284+0000","last_unstale":"2024-09-17T03:13:36.172893+0000","last_undegraded":"2024-09-17T03:13:36.172893+0000","last_fullsized":"2024-09-17T03:13:36.172893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:00.786078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173348+0000","last_change":"2024-09-17T03:13:36.173114+0000","last_active":"2024-09-17T03:13:36.173348+0000","last_peered":"2024-09-17T03:13:36.173348+0000","last_clean":"2024-09-17T03:13:36.173348+0000","last_became_active":"2024-09-17T03:13:36.172653+0000","last_became_peered":"2024-09-17T03:13:36.172653+0000","last_unstale":"2024-09-17T03:13:36.173348+0000","last_undegraded":"2024-09-17T03:13:36.173348+0000","last_fullsized":"2024-09-17T03:13:36.173348+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:51.574328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"81'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.185157+0000","last_change":"2024-09-17T03:13:35.147001+0000","last_active":"2024-09-17T03:13:36.185157+0000","last_peered":"2024-09-17T03:13:36.185157+0000","last_clean":"2024-09-17T03:13:36.185157+0000","last_became_active":"2024-09-17T03:13:35.146658+0000","last_became_peered":"2024-09-17T03:13:35.146658+0000","last_unstale":"2024-09-17T03:13:36.185157+0000","last_undegraded":"2024-09-17T03:13:36.185157+0000","last_fullsized":"2024-09-17T03:13:36.185157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:06.031844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172305+0000","last_change":"2024-09-17T03:13:36.168877+0000","last_active":"2024-09-17T03:13:36.172305+0000","last_peered":"2024-09-17T03:13:36.172305+0000","last_clean":"2024-09-17T03:13:36.172305+0000","last_became_active":"2024-09-17T03:13:36.168545+0000","last_became_peered":"2024-09-17T03:13:36.168545+0000","last_unstale":"2024-09-17T03:13:36.172305+0000","last_undegraded":"2024-09-17T03:13:36.172305+0000","last_fullsized":"2024-09-17T03:13:36.172305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:01.055085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"81'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160707+0000","last_change":"2024-09-17T03:13:35.151241+0000","last_active":"2024-09-17T03:13:36.160707+0000","last_peered":"2024-09-17T03:13:36.160707+0000","last_clean":"2024-09-17T03:13:36.160707+0000","last_became_active":"2024-09-17T03:13:35.150775+0000","last_became_peered":"2024-09-17T03:13:35.150775+0000","last_unstale":"2024-09-17T03:13:36.160707+0000","last_undegraded":"2024-09-17T03:13:36.160707+0000","last_fullsized":"2024-09-17T03:13:36.160707+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:48.739118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160679+0000","last_change":"2024-09-17T03:13:36.156147+0000","last_active":"2024-09-17T03:13:36.160679+0000","last_peered":"2024-09-17T03:13:36.160679+0000","last_clean":"2024-09-17T03:13:36.160679+0000","last_became_active":"2024-09-17T03:13:36.155807+0000","last_became_peered":"2024-09-17T03:13:36.155807+0000","last_unstale":"2024-09-17T03:13:36.160679+0000","last_undegraded":"2024-09-17T03:13:36.160679+0000","last_fullsized":"2024-09-17T03:13:36.160679+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:41:23.077488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.163253+0000","last_change":"2024-09-17T03:13:35.147739+0000","last_active":"2024-09-17T03:13:36.163253+0000","last_peered":"2024-09-17T03:13:36.163253+0000","last_clean":"2024-09-17T03:13:36.163253+0000","last_became_active":"2024-09-17T03:13:35.147321+0000","last_became_peered":"2024-09-17T03:13:35.147321+0000","last_unstale":"2024-09-17T03:13:36.163253+0000","last_undegraded":"2024-09-17T03:13:36.163253+0000","last_fullsized":"2024-09-17T03:13:36.163253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:33.977477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171514+0000","last_change":"2024-09-17T03:13:36.168055+0000","last_active":"2024-09-17T03:13:36.171514+0000","last_peered":"2024-09-17T03:13:36.171514+0000","last_clean":"2024-09-17T03:13:36.171514+0000","last_became_active":"2024-09-17T03:13:36.167764+0000","last_became_peered":"2024-09-17T03:13:36.167764+0000","last_unstale":"2024-09-17T03:13:36.171514+0000","last_undegraded":"2024-09-17T03:13:36.171514+0000","last_fullsized":"2024-09-17T03:13:36.171514+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:15.268158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.161068+0000","last_change":"2024-09-17T03:13:35.148688+0000","last_active":"2024-09-17T03:13:36.161068+0000","last_peered":"2024-09-17T03:13:36.161068+0000","last_clean":"2024-09-17T03:13:36.161068+0000","last_became_active":"2024-09-17T03:13:35.148412+0000","last_became_peered":"2024-09-17T03:13:35.148412+0000","last_unstale":"2024-09-17T03:13:36.161068+0000","last_undegraded":"2024-09-17T03:13:36.161068+0000","last_fullsized":"2024-09-17T03:13:36.161068+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:20.696636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173396+0000","last_change":"2024-09-17T03:13:36.173304+0000","last_active":"2024-09-17T03:13:36.173396+0000","last_peered":"2024-09-17T03:13:36.173396+0000","last_clean":"2024-09-17T03:13:36.173396+0000","last_became_active":"2024-09-17T03:13:36.172846+0000","last_became_peered":"2024-09-17T03:13:36.172846+0000","last_unstale":"2024-09-17T03:13:36.173396+0000","last_undegraded":"2024-09-17T03:13:36.173396+0000","last_fullsized":"2024-09-17T03:13:36.173396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:12.520288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"81'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.162218+0000","last_change":"2024-09-17T03:13:35.141265+0000","last_active":"2024-09-17T03:13:36.162218+0000","last_peered":"2024-09-17T03:13:36.162218+0000","last_clean":"2024-09-17T03:13:36.162218+0000","last_became_active":"2024-09-17T03:13:35.140530+0000","last_became_peered":"2024-09-17T03:13:35.140530+0000","last_unstale":"2024-09-17T03:13:36.162218+0000","last_undegraded":"2024-09-17T03:13:36.162218+0000","last_fullsized":"2024-09-17T03:13:36.162218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:50.135257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174383+0000","last_change":"2024-09-17T03:13:36.174281+0000","last_active":"2024-09-17T03:13:36.174383+0000","last_peered":"2024-09-17T03:13:36.174383+0000","last_clean":"2024-09-17T03:13:36.174383+0000","last_became_active":"2024-09-17T03:13:36.173946+0000","last_became_peered":"2024-09-17T03:13:36.173946+0000","last_unstale":"2024-09-17T03:13:36.174383+0000","last_undegraded":"2024-09-17T03:13:36.174383+0000","last_fullsized":"2024-09-17T03:13:36.174383+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:35.013596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"81'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.153914+0000","last_change":"2024-09-17T03:13:35.151157+0000","last_active":"2024-09-17T03:13:36.153914+0000","last_peered":"2024-09-17T03:13:36.153914+0000","last_clean":"2024-09-17T03:13:36.153914+0000","last_became_active":"2024-09-17T03:13:35.150743+0000","last_became_peered":"2024-09-17T03:13:35.150743+0000","last_unstale":"2024-09-17T03:13:36.153914+0000","last_undegraded":"2024-09-17T03:13:36.153914+0000","last_fullsized":"2024-09-17T03:13:36.153914+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:29.000215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168607+0000","last_change":"2024-09-17T03:13:36.164002+0000","last_active":"2024-09-17T03:13:36.168607+0000","last_peered":"2024-09-17T03:13:36.168607+0000","last_clean":"2024-09-17T03:13:36.168607+0000","last_became_active":"2024-09-17T03:13:36.163678+0000","last_became_peered":"2024-09-17T03:13:36.163678+0000","last_unstale":"2024-09-17T03:13:36.168607+0000","last_undegraded":"2024-09-17T03:13:36.168607+0000","last_fullsized":"2024-09-17T03:13:36.168607+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:05.685914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160617+0000","last_change":"2024-09-17T03:13:35.148352+0000","last_active":"2024-09-17T03:13:36.160617+0000","last_peered":"2024-09-17T03:13:36.160617+0000","last_clean":"2024-09-17T03:13:36.160617+0000","last_became_active":"2024-09-17T03:13:35.148059+0000","last_became_peered":"2024-09-17T03:13:35.148059+0000","last_unstale":"2024-09-17T03:13:36.160617+0000","last_undegraded":"2024-09-17T03:13:36.160617+0000","last_fullsized":"2024-09-17T03:13:36.160617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:56.223035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275525+0000","last_change":"2024-09-17T03:13:36.159112+0000","last_active":"2024-09-17T03:13:37.275525+0000","last_peered":"2024-09-17T03:13:37.275525+0000","last_clean":"2024-09-17T03:13:37.275525+0000","last_became_active":"2024-09-17T03:13:36.158801+0000","last_became_peered":"2024-09-17T03:13:36.158801+0000","last_unstale":"2024-09-17T03:13:37.275525+0000","last_undegraded":"2024-09-17T03:13:37.275525+0000","last_fullsized":"2024-09-17T03:13:37.275525+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:51.179243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150270+0000","last_change":"2024-09-17T03:13:35.136863+0000","last_active":"2024-09-17T03:13:36.150270+0000","last_peered":"2024-09-17T03:13:36.150270+0000","last_clean":"2024-09-17T03:13:36.150270+0000","last_became_active":"2024-09-17T03:13:35.136521+0000","last_became_peered":"2024-09-17T03:13:35.136521+0000","last_unstale":"2024-09-17T03:13:36.150270+0000","last_undegraded":"2024-09-17T03:13:36.150270+0000","last_fullsized":"2024-09-17T03:13:36.150270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:26.163857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275914+0000","last_change":"2024-09-17T03:13:36.166439+0000","last_active":"2024-09-17T03:13:37.275914+0000","last_peered":"2024-09-17T03:13:37.275914+0000","last_clean":"2024-09-17T03:13:37.275914+0000","last_became_active":"2024-09-17T03:13:36.166100+0000","last_became_peered":"2024-09-17T03:13:36.166100+0000","last_unstale":"2024-09-17T03:13:37.275914+0000","last_undegraded":"2024-09-17T03:13:37.275914+0000","last_fullsized":"2024-09-17T03:13:37.275914+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:47.088092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150785+0000","last_change":"2024-09-17T03:13:35.150085+0000","last_active":"2024-09-17T03:13:36.150785+0000","last_peered":"2024-09-17T03:13:36.150785+0000","last_clean":"2024-09-17T03:13:36.150785+0000","last_became_active":"2024-09-17T03:13:35.149724+0000","last_became_peered":"2024-09-17T03:13:35.149724+0000","last_unstale":"2024-09-17T03:13:36.150785+0000","last_undegraded":"2024-09-17T03:13:36.150785+0000","last_fullsized":"2024-09-17T03:13:36.150785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:43.977125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173013+0000","last_change":"2024-09-17T03:13:36.170595+0000","last_active":"2024-09-17T03:13:36.173013+0000","last_peered":"2024-09-17T03:13:36.173013+0000","last_clean":"2024-09-17T03:13:36.173013+0000","last_became_active":"2024-09-17T03:13:36.170264+0000","last_became_peered":"2024-09-17T03:13:36.170264+0000","last_unstale":"2024-09-17T03:13:36.173013+0000","last_undegraded":"2024-09-17T03:13:36.173013+0000","last_fullsized":"2024-09-17T03:13:36.173013+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:18.976321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150763+0000","last_change":"2024-09-17T03:13:35.144777+0000","last_active":"2024-09-17T03:13:36.150763+0000","last_peered":"2024-09-17T03:13:36.150763+0000","last_clean":"2024-09-17T03:13:36.150763+0000","last_became_active":"2024-09-17T03:13:35.144435+0000","last_became_peered":"2024-09-17T03:13:35.144435+0000","last_unstale":"2024-09-17T03:13:36.150763+0000","last_undegraded":"2024-09-17T03:13:36.150763+0000","last_fullsized":"2024-09-17T03:13:36.150763+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:03.012283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2024-09-17T03:13:36.157315+0000","last_change":"2024-09-17T03:13:36.157315+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:36.157315+0000","last_undegraded":"2024-09-17T03:13:36.157315+0000","last_fullsized":"2024-09-17T03:13:36.157315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"81'3","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.182085+0000","last_change":"2024-09-17T03:13:35.140368+0000","last_active":"2024-09-17T03:13:36.182085+0000","last_peered":"2024-09-17T03:13:36.182085+0000","last_clean":"2024-09-17T03:13:36.182085+0000","last_became_active":"2024-09-17T03:13:35.139934+0000","last_became_peered":"2024-09-17T03:13:35.139934+0000","last_unstale":"2024-09-17T03:13:36.182085+0000","last_undegraded":"2024-09-17T03:13:36.182085+0000","last_fullsized":"2024-09-17T03:13:36.182085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:31.279064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2024-09-17T03:13:36.161033+0000","last_change":"2024-09-17T03:13:36.161033+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:36.161033+0000","last_undegraded":"2024-09-17T03:13:36.161033+0000","last_fullsized":"2024-09-17T03:13:36.161033+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"81'5","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.175388+0000","last_change":"2024-09-17T03:13:35.148650+0000","last_active":"2024-09-17T03:13:36.175388+0000","last_peered":"2024-09-17T03:13:36.175388+0000","last_clean":"2024-09-17T03:13:36.175388+0000","last_became_active":"2024-09-17T03:13:35.148261+0000","last_became_peered":"2024-09-17T03:13:35.148261+0000","last_unstale":"2024-09-17T03:13:36.175388+0000","last_undegraded":"2024-09-17T03:13:36.175388+0000","last_fullsized":"2024-09-17T03:13:36.175388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:34.187583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2024-09-17T03:13:36.156718+0000","last_change":"2024-09-17T03:13:36.156718+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:36.156718+0000","last_undegraded":"2024-09-17T03:13:36.156718+0000","last_fullsized":"2024-09-17T03:13:36.156718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.151021+0000","last_change":"2024-09-17T03:13:35.147131+0000","last_active":"2024-09-17T03:13:36.151021+0000","last_peered":"2024-09-17T03:13:36.151021+0000","last_clean":"2024-09-17T03:13:36.151021+0000","last_became_active":"2024-09-17T03:13:35.146813+0000","last_became_peered":"2024-09-17T03:13:35.146813+0000","last_unstale":"2024-09-17T03:13:36.151021+0000","last_undegraded":"2024-09-17T03:13:36.151021+0000","last_fullsized":"2024-09-17T03:13:36.151021+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:34.868836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171407+0000","last_change":"2024-09-17T03:13:36.167033+0000","last_active":"2024-09-17T03:13:36.171407+0000","last_peered":"2024-09-17T03:13:36.171407+0000","last_clean":"2024-09-17T03:13:36.171407+0000","last_became_active":"2024-09-17T03:13:36.166686+0000","last_became_peered":"2024-09-17T03:13:36.166686+0000","last_unstale":"2024-09-17T03:13:36.171407+0000","last_undegraded":"2024-09-17T03:13:36.171407+0000","last_fullsized":"2024-09-17T03:13:36.171407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:32.691348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275342+0000","last_change":"2024-09-17T03:13:35.148416+0000","last_active":"2024-09-17T03:13:37.275342+0000","last_peered":"2024-09-17T03:13:37.275342+0000","last_clean":"2024-09-17T03:13:37.275342+0000","last_became_active":"2024-09-17T03:13:35.147902+0000","last_became_peered":"2024-09-17T03:13:35.147902+0000","last_unstale":"2024-09-17T03:13:37.275342+0000","last_undegraded":"2024-09-17T03:13:37.275342+0000","last_fullsized":"2024-09-17T03:13:37.275342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:53.553162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172441+0000","last_change":"2024-09-17T03:13:36.172337+0000","last_active":"2024-09-17T03:13:36.172441+0000","last_peered":"2024-09-17T03:13:36.172441+0000","last_clean":"2024-09-17T03:13:36.172441+0000","last_became_active":"2024-09-17T03:13:36.172033+0000","last_became_peered":"2024-09-17T03:13:36.172033+0000","last_unstale":"2024-09-17T03:13:36.172441+0000","last_undegraded":"2024-09-17T03:13:36.172441+0000","last_fullsized":"2024-09-17T03:13:36.172441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:48.036856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.148597+0000","last_change":"2024-09-17T03:13:35.145883+0000","last_active":"2024-09-17T03:13:36.148597+0000","last_peered":"2024-09-17T03:13:36.148597+0000","last_clean":"2024-09-17T03:13:36.148597+0000","last_became_active":"2024-09-17T03:13:35.145485+0000","last_became_peered":"2024-09-17T03:13:35.145485+0000","last_unstale":"2024-09-17T03:13:36.148597+0000","last_undegraded":"2024-09-17T03:13:36.148597+0000","last_fullsized":"2024-09-17T03:13:36.148597+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:33.828573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.167821+0000","last_change":"2024-09-17T03:13:36.162558+0000","last_active":"2024-09-17T03:13:36.167821+0000","last_peered":"2024-09-17T03:13:36.167821+0000","last_clean":"2024-09-17T03:13:36.167821+0000","last_became_active":"2024-09-17T03:13:36.162263+0000","last_became_peered":"2024-09-17T03:13:36.162263+0000","last_unstale":"2024-09-17T03:13:36.167821+0000","last_undegraded":"2024-09-17T03:13:36.167821+0000","last_fullsized":"2024-09-17T03:13:36.167821+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:26.393514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"81'5","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160497+0000","last_change":"2024-09-17T03:13:35.147811+0000","last_active":"2024-09-17T03:13:36.160497+0000","last_peered":"2024-09-17T03:13:36.160497+0000","last_clean":"2024-09-17T03:13:36.160497+0000","last_became_active":"2024-09-17T03:13:35.147540+0000","last_became_peered":"2024-09-17T03:13:35.147540+0000","last_unstale":"2024-09-17T03:13:36.160497+0000","last_undegraded":"2024-09-17T03:13:36.160497+0000","last_fullsized":"2024-09-17T03:13:36.160497+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:21.660023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168645+0000","last_change":"2024-09-17T03:13:36.160764+0000","last_active":"2024-09-17T03:13:36.168645+0000","last_peered":"2024-09-17T03:13:36.168645+0000","last_clean":"2024-09-17T03:13:36.168645+0000","last_became_active":"2024-09-17T03:13:36.160458+0000","last_became_peered":"2024-09-17T03:13:36.160458+0000","last_unstale":"2024-09-17T03:13:36.168645+0000","last_undegraded":"2024-09-17T03:13:36.168645+0000","last_fullsized":"2024-09-17T03:13:36.168645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:57.043310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.181628+0000","last_change":"2024-09-17T03:13:35.146348+0000","last_active":"2024-09-17T03:13:36.181628+0000","last_peered":"2024-09-17T03:13:36.181628+0000","last_clean":"2024-09-17T03:13:36.181628+0000","last_became_active":"2024-09-17T03:13:35.145718+0000","last_became_peered":"2024-09-17T03:13:35.145718+0000","last_unstale":"2024-09-17T03:13:36.181628+0000","last_undegraded":"2024-09-17T03:13:36.181628+0000","last_fullsized":"2024-09-17T03:13:36.181628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:39.536551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.163461+0000","last_change":"2024-09-17T03:13:36.158379+0000","last_active":"2024-09-17T03:13:36.163461+0000","last_peered":"2024-09-17T03:13:36.163461+0000","last_clean":"2024-09-17T03:13:36.163461+0000","last_became_active":"2024-09-17T03:13:36.157894+0000","last_became_peered":"2024-09-17T03:13:36.157894+0000","last_unstale":"2024-09-17T03:13:36.163461+0000","last_undegraded":"2024-09-17T03:13:36.163461+0000","last_fullsized":"2024-09-17T03:13:36.163461+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:36.956392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.162873+0000","last_change":"2024-09-17T03:13:35.148036+0000","last_active":"2024-09-17T03:13:36.162873+0000","last_peered":"2024-09-17T03:13:36.162873+0000","last_clean":"2024-09-17T03:13:36.162873+0000","last_became_active":"2024-09-17T03:13:35.147436+0000","last_became_peered":"2024-09-17T03:13:35.147436+0000","last_unstale":"2024-09-17T03:13:36.162873+0000","last_undegraded":"2024-09-17T03:13:36.162873+0000","last_fullsized":"2024-09-17T03:13:36.162873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:37.475359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171851+0000","last_change":"2024-09-17T03:13:36.167162+0000","last_active":"2024-09-17T03:13:36.171851+0000","last_peered":"2024-09-17T03:13:36.171851+0000","last_clean":"2024-09-17T03:13:36.171851+0000","last_became_active":"2024-09-17T03:13:36.166834+0000","last_became_peered":"2024-09-17T03:13:36.166834+0000","last_unstale":"2024-09-17T03:13:36.171851+0000","last_undegraded":"2024-09-17T03:13:36.171851+0000","last_fullsized":"2024-09-17T03:13:36.171851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:08.944447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160953+0000","last_change":"2024-09-17T03:13:35.150447+0000","last_active":"2024-09-17T03:13:36.160953+0000","last_peered":"2024-09-17T03:13:36.160953+0000","last_clean":"2024-09-17T03:13:36.160953+0000","last_became_active":"2024-09-17T03:13:35.150117+0000","last_became_peered":"2024-09-17T03:13:35.150117+0000","last_unstale":"2024-09-17T03:13:36.160953+0000","last_undegraded":"2024-09-17T03:13:36.160953+0000","last_fullsized":"2024-09-17T03:13:36.160953+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:03.128187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171406+0000","last_change":"2024-09-17T03:13:36.169959+0000","last_active":"2024-09-17T03:13:36.171406+0000","last_peered":"2024-09-17T03:13:36.171406+0000","last_clean":"2024-09-17T03:13:36.171406+0000","last_became_active":"2024-09-17T03:13:36.169633+0000","last_became_peered":"2024-09-17T03:13:36.169633+0000","last_unstale":"2024-09-17T03:13:36.171406+0000","last_undegraded":"2024-09-17T03:13:36.171406+0000","last_fullsized":"2024-09-17T03:13:36.171406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:53.203069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"81'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275792+0000","last_change":"2024-09-17T03:13:35.150519+0000","last_active":"2024-09-17T03:13:37.275792+0000","last_peered":"2024-09-17T03:13:37.275792+0000","last_clean":"2024-09-17T03:13:37.275792+0000","last_became_active":"2024-09-17T03:13:35.150226+0000","last_became_peered":"2024-09-17T03:13:35.150226+0000","last_unstale":"2024-09-17T03:13:37.275792+0000","last_undegraded":"2024-09-17T03:13:37.275792+0000","last_fullsized":"2024-09-17T03:13:37.275792+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:26.002514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160547+0000","last_change":"2024-09-17T03:13:36.158573+0000","last_active":"2024-09-17T03:13:36.160547+0000","last_peered":"2024-09-17T03:13:36.160547+0000","last_clean":"2024-09-17T03:13:36.160547+0000","last_became_active":"2024-09-17T03:13:36.158208+0000","last_became_peered":"2024-09-17T03:13:36.158208+0000","last_unstale":"2024-09-17T03:13:36.160547+0000","last_undegraded":"2024-09-17T03:13:36.160547+0000","last_fullsized":"2024-09-17T03:13:36.160547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:43.797527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.158436+0000","last_change":"2024-09-17T03:13:35.148924+0000","last_active":"2024-09-17T03:13:36.158436+0000","last_peered":"2024-09-17T03:13:36.158436+0000","last_clean":"2024-09-17T03:13:36.158436+0000","last_became_active":"2024-09-17T03:13:35.148637+0000","last_became_peered":"2024-09-17T03:13:35.148637+0000","last_unstale":"2024-09-17T03:13:36.158436+0000","last_undegraded":"2024-09-17T03:13:36.158436+0000","last_fullsized":"2024-09-17T03:13:36.158436+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:35.581909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.169086+0000","last_change":"2024-09-17T03:13:36.162958+0000","last_active":"2024-09-17T03:13:36.169086+0000","last_peered":"2024-09-17T03:13:36.169086+0000","last_clean":"2024-09-17T03:13:36.169086+0000","last_became_active":"2024-09-17T03:13:36.162656+0000","last_became_peered":"2024-09-17T03:13:36.162656+0000","last_unstale":"2024-09-17T03:13:36.169086+0000","last_undegraded":"2024-09-17T03:13:36.169086+0000","last_fullsized":"2024-09-17T03:13:36.169086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:05.566969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.154780+0000","last_change":"2024-09-17T03:13:35.142641+0000","last_active":"2024-09-17T03:13:36.154780+0000","last_peered":"2024-09-17T03:13:36.154780+0000","last_clean":"2024-09-17T03:13:36.154780+0000","last_became_active":"2024-09-17T03:13:35.142331+0000","last_became_peered":"2024-09-17T03:13:35.142331+0000","last_unstale":"2024-09-17T03:13:36.154780+0000","last_undegraded":"2024-09-17T03:13:36.154780+0000","last_fullsized":"2024-09-17T03:13:36.154780+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:06.927325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172373+0000","last_change":"2024-09-17T03:13:36.167894+0000","last_active":"2024-09-17T03:13:36.172373+0000","last_peered":"2024-09-17T03:13:36.172373+0000","last_clean":"2024-09-17T03:13:36.172373+0000","last_became_active":"2024-09-17T03:13:36.167509+0000","last_became_peered":"2024-09-17T03:13:36.167509+0000","last_unstale":"2024-09-17T03:13:36.172373+0000","last_undegraded":"2024-09-17T03:13:36.172373+0000","last_fullsized":"2024-09-17T03:13:36.172373+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:24.063918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275150+0000","last_change":"2024-09-17T03:13:35.150284+0000","last_active":"2024-09-17T03:13:37.275150+0000","last_peered":"2024-09-17T03:13:37.275150+0000","last_clean":"2024-09-17T03:13:37.275150+0000","last_became_active":"2024-09-17T03:13:35.149842+0000","last_became_peered":"2024-09-17T03:13:35.149842+0000","last_unstale":"2024-09-17T03:13:37.275150+0000","last_undegraded":"2024-09-17T03:13:37.275150+0000","last_fullsized":"2024-09-17T03:13:37.275150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:04.403550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174824+0000","last_change":"2024-09-17T03:13:36.169746+0000","last_active":"2024-09-17T03:13:36.174824+0000","last_peered":"2024-09-17T03:13:36.174824+0000","last_clean":"2024-09-17T03:13:36.174824+0000","last_became_active":"2024-09-17T03:13:36.169430+0000","last_became_peered":"2024-09-17T03:13:36.169430+0000","last_unstale":"2024-09-17T03:13:36.174824+0000","last_undegraded":"2024-09-17T03:13:36.174824+0000","last_fullsized":"2024-09-17T03:13:36.174824+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:35.192731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150221+0000","last_change":"2024-09-17T03:13:35.145283+0000","last_active":"2024-09-17T03:13:36.150221+0000","last_peered":"2024-09-17T03:13:36.150221+0000","last_clean":"2024-09-17T03:13:36.150221+0000","last_became_active":"2024-09-17T03:13:35.144986+0000","last_became_peered":"2024-09-17T03:13:35.144986+0000","last_unstale":"2024-09-17T03:13:36.150221+0000","last_undegraded":"2024-09-17T03:13:36.150221+0000","last_fullsized":"2024-09-17T03:13:36.150221+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:50.213189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168708+0000","last_change":"2024-09-17T03:13:36.164579+0000","last_active":"2024-09-17T03:13:36.168708+0000","last_peered":"2024-09-17T03:13:36.168708+0000","last_clean":"2024-09-17T03:13:36.168708+0000","last_became_active":"2024-09-17T03:13:36.164264+0000","last_became_peered":"2024-09-17T03:13:36.164264+0000","last_unstale":"2024-09-17T03:13:36.168708+0000","last_undegraded":"2024-09-17T03:13:36.168708+0000","last_fullsized":"2024-09-17T03:13:36.168708+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:04.660596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150709+0000","last_change":"2024-09-17T03:13:35.148815+0000","last_active":"2024-09-17T03:13:36.150709+0000","last_peered":"2024-09-17T03:13:36.150709+0000","last_clean":"2024-09-17T03:13:36.150709+0000","last_became_active":"2024-09-17T03:13:35.148507+0000","last_became_peered":"2024-09-17T03:13:35.148507+0000","last_unstale":"2024-09-17T03:13:36.150709+0000","last_undegraded":"2024-09-17T03:13:36.150709+0000","last_fullsized":"2024-09-17T03:13:36.150709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:12.011558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.169507+0000","last_change":"2024-09-17T03:13:36.161389+0000","last_active":"2024-09-17T03:13:36.169507+0000","last_peered":"2024-09-17T03:13:36.169507+0000","last_clean":"2024-09-17T03:13:36.169507+0000","last_became_active":"2024-09-17T03:13:36.161086+0000","last_became_peered":"2024-09-17T03:13:36.161086+0000","last_unstale":"2024-09-17T03:13:36.169507+0000","last_undegraded":"2024-09-17T03:13:36.169507+0000","last_fullsized":"2024-09-17T03:13:36.169507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:46.792762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150388+0000","last_change":"2024-09-17T03:13:35.146844+0000","last_active":"2024-09-17T03:13:36.150388+0000","last_peered":"2024-09-17T03:13:36.150388+0000","last_clean":"2024-09-17T03:13:36.150388+0000","last_became_active":"2024-09-17T03:13:35.146239+0000","last_became_peered":"2024-09-17T03:13:35.146239+0000","last_unstale":"2024-09-17T03:13:36.150388+0000","last_undegraded":"2024-09-17T03:13:36.150388+0000","last_fullsized":"2024-09-17T03:13:36.150388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:16.862049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174913+0000","last_change":"2024-09-17T03:13:36.169810+0000","last_active":"2024-09-17T03:13:36.174913+0000","last_peered":"2024-09-17T03:13:36.174913+0000","last_clean":"2024-09-17T03:13:36.174913+0000","last_became_active":"2024-09-17T03:13:36.169472+0000","last_became_peered":"2024-09-17T03:13:36.169472+0000","last_unstale":"2024-09-17T03:13:36.174913+0000","last_undegraded":"2024-09-17T03:13:36.174913+0000","last_fullsized":"2024-09-17T03:13:36.174913+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:34.833721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150452+0000","last_change":"2024-09-17T03:13:35.149436+0000","last_active":"2024-09-17T03:13:36.150452+0000","last_peered":"2024-09-17T03:13:36.150452+0000","last_clean":"2024-09-17T03:13:36.150452+0000","last_became_active":"2024-09-17T03:13:35.147481+0000","last_became_peered":"2024-09-17T03:13:35.147481+0000","last_unstale":"2024-09-17T03:13:36.150452+0000","last_undegraded":"2024-09-17T03:13:36.150452+0000","last_fullsized":"2024-09-17T03:13:36.150452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:09.546632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160538+0000","last_change":"2024-09-17T03:13:36.158743+0000","last_active":"2024-09-17T03:13:36.160538+0000","last_peered":"2024-09-17T03:13:36.160538+0000","last_clean":"2024-09-17T03:13:36.160538+0000","last_became_active":"2024-09-17T03:13:36.158441+0000","last_became_peered":"2024-09-17T03:13:36.158441+0000","last_unstale":"2024-09-17T03:13:36.160538+0000","last_undegraded":"2024-09-17T03:13:36.160538+0000","last_fullsized":"2024-09-17T03:13:36.160538+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:51.574328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160954+0000","last_change":"2024-09-17T03:13:35.145764+0000","last_active":"2024-09-17T03:13:36.160954+0000","last_peered":"2024-09-17T03:13:36.160954+0000","last_clean":"2024-09-17T03:13:36.160954+0000","last_became_active":"2024-09-17T03:13:35.145453+0000","last_became_peered":"2024-09-17T03:13:35.145453+0000","last_unstale":"2024-09-17T03:13:36.160954+0000","last_undegraded":"2024-09-17T03:13:36.160954+0000","last_fullsized":"2024-09-17T03:13:36.160954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:04.680766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2024-09-17T03:13:36.157325+0000","last_change":"2024-09-17T03:13:36.157325+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:36.157325+0000","last_undegraded":"2024-09-17T03:13:36.157325+0000","last_fullsized":"2024-09-17T03:13:36.157325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.154152+0000","last_change":"2024-09-17T03:13:35.149928+0000","last_active":"2024-09-17T03:13:36.154152+0000","last_peered":"2024-09-17T03:13:36.154152+0000","last_clean":"2024-09-17T03:13:36.154152+0000","last_became_active":"2024-09-17T03:13:35.149571+0000","last_became_peered":"2024-09-17T03:13:35.149571+0000","last_unstale":"2024-09-17T03:13:36.154152+0000","last_undegraded":"2024-09-17T03:13:36.154152+0000","last_fullsized":"2024-09-17T03:13:36.154152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:32.720660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171470+0000","last_change":"2024-09-17T03:13:36.166632+0000","last_active":"2024-09-17T03:13:36.171470+0000","last_peered":"2024-09-17T03:13:36.171470+0000","last_clean":"2024-09-17T03:13:36.171470+0000","last_became_active":"2024-09-17T03:13:36.166308+0000","last_became_peered":"2024-09-17T03:13:36.166308+0000","last_unstale":"2024-09-17T03:13:36.171470+0000","last_undegraded":"2024-09-17T03:13:36.171470+0000","last_fullsized":"2024-09-17T03:13:36.171470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:07.609432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150305+0000","last_change":"2024-09-17T03:13:35.148824+0000","last_active":"2024-09-17T03:13:36.150305+0000","last_peered":"2024-09-17T03:13:36.150305+0000","last_clean":"2024-09-17T03:13:36.150305+0000","last_became_active":"2024-09-17T03:13:35.148417+0000","last_became_peered":"2024-09-17T03:13:35.148417+0000","last_unstale":"2024-09-17T03:13:36.150305+0000","last_undegraded":"2024-09-17T03:13:36.150305+0000","last_fullsized":"2024-09-17T03:13:36.150305+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:58.224149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171614+0000","last_change":"2024-09-17T03:13:36.163897+0000","last_active":"2024-09-17T03:13:36.171614+0000","last_peered":"2024-09-17T03:13:36.171614+0000","last_clean":"2024-09-17T03:13:36.171614+0000","last_became_active":"2024-09-17T03:13:36.163275+0000","last_became_peered":"2024-09-17T03:13:36.163275+0000","last_unstale":"2024-09-17T03:13:36.171614+0000","last_undegraded":"2024-09-17T03:13:36.171614+0000","last_fullsized":"2024-09-17T03:13:36.171614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:37.972855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.154338+0000","last_change":"2024-09-17T03:13:35.142421+0000","last_active":"2024-09-17T03:13:36.154338+0000","last_peered":"2024-09-17T03:13:36.154338+0000","last_clean":"2024-09-17T03:13:36.154338+0000","last_became_active":"2024-09-17T03:13:35.142113+0000","last_became_peered":"2024-09-17T03:13:35.142113+0000","last_unstale":"2024-09-17T03:13:36.154338+0000","last_undegraded":"2024-09-17T03:13:36.154338+0000","last_fullsized":"2024-09-17T03:13:36.154338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:12.371249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173952+0000","last_change":"2024-09-17T03:13:36.166539+0000","last_active":"2024-09-17T03:13:36.173952+0000","last_peered":"2024-09-17T03:13:36.173952+0000","last_clean":"2024-09-17T03:13:36.173952+0000","last_became_active":"2024-09-17T03:13:36.166189+0000","last_became_peered":"2024-09-17T03:13:36.166189+0000","last_unstale":"2024-09-17T03:13:36.173952+0000","last_undegraded":"2024-09-17T03:13:36.173952+0000","last_fullsized":"2024-09-17T03:13:36.173952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:22.963501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"81'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.155281+0000","last_change":"2024-09-17T03:13:35.148171+0000","last_active":"2024-09-17T03:13:36.155281+0000","last_peered":"2024-09-17T03:13:36.155281+0000","last_clean":"2024-09-17T03:13:36.155281+0000","last_became_active":"2024-09-17T03:13:35.147822+0000","last_became_peered":"2024-09-17T03:13:35.147822+0000","last_unstale":"2024-09-17T03:13:36.155281+0000","last_undegraded":"2024-09-17T03:13:36.155281+0000","last_fullsized":"2024-09-17T03:13:36.155281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:17.971173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":216,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.153800+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:13:36.153800+0000","last_peered":"2024-09-17T03:13:36.153800+0000","last_clean":"2024-09-17T03:13:36.153800+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:13:36.153800+0000","last_undegraded":"2024-09-17T03:13:36.153800+0000","last_fullsized":"2024-09-17T03:13:36.153800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":1470,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509508,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28564,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343276,"statfs":{"total":96636764160,"available":96607514624,"internally_reserved":0,"allocated":1568768,"data_stored":1003684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509508,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":974848,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509507,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":974848,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509508,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":974848,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":974848,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":974848,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509508,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1568768,"data_stored":1003684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1011712,"data_stored":428003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:13:39.523 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:13:39.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.672+0000 7fdd717f1640 1 -- 172.21.15.78:0/325085375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd6c0d2ed0 msgr2=0x7fdd6c0d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.672+0000 7fdd717f1640 1 --2- 172.21.15.78:0/325085375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd6c0d2ed0 0x7fdd6c0d1a80 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c009bb0 tx=0x7fdd5c02a8d0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.672+0000 7fdd717f1640 1 -- 172.21.15.78:0/325085375 shutdown_connections 2024-09-17T03:13:39.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.672+0000 7fdd717f1640 1 --2- 172.21.15.78:0/325085375 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd6c0cf7a0 0x7fdd6c1626e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.672+0000 7fdd717f1640 1 --2- 172.21.15.78:0/325085375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd6c0d2ed0 0x7fdd6c0d1a80 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.672+0000 7fdd717f1640 1 -- 172.21.15.78:0/325085375 >> 172.21.15.78:0/325085375 conn(0x7fdd6c08bfc0 msgr2=0x7fdd6c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:39.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.672+0000 7fdd717f1640 1 -- 172.21.15.78:0/325085375 shutdown_connections 2024-09-17T03:13:39.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.672+0000 7fdd717f1640 1 -- 172.21.15.78:0/325085375 wait complete. 2024-09-17T03:13:39.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.674+0000 7fdd717f1640 1 Processor -- start 2024-09-17T03:13:39.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.674+0000 7fdd717f1640 1 -- start start 2024-09-17T03:13:39.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd717f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd6c0b9b70 0x7fdd6c1613d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:39.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd717f1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd6c0cf7a0 0x7fdd6c0ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:39.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd717f1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd6c0d2ed0 0x7fdd6c160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:39.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd717f1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c162da0 con 0x7fdd6c0b9b70 2024-09-17T03:13:39.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd717f1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdd6c162c20 con 0x7fdd6c0cf7a0 2024-09-17T03:13:39.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd717f1640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fdd6c162f20 con 0x7fdd6c0d2ed0 2024-09-17T03:13:39.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd6affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd6c0b9b70 0x7fdd6c1613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:39.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd6affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd6c0b9b70 0x7fdd6c1613d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39510/0 (socket says 172.21.15.78:39510) 2024-09-17T03:13:39.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd6affd640 1 -- 172.21.15.78:0/4260900202 learned_addr learned my addr 172.21.15.78:0/4260900202 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:39.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd6a7fc640 1 --2- 172.21.15.78:0/4260900202 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd6c0cf7a0 0x7fdd6c0ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:39.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd6affd640 1 -- 172.21.15.78:0/4260900202 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd6c0d2ed0 msgr2=0x7fdd6c160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd6b7fe640 1 --2- 172.21.15.78:0/4260900202 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd6c0d2ed0 0x7fdd6c160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:39.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd6affd640 1 --2- 172.21.15.78:0/4260900202 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd6c0d2ed0 0x7fdd6c160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd6affd640 1 -- 172.21.15.78:0/4260900202 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd6c0cf7a0 msgr2=0x7fdd6c0ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd6affd640 1 --2- 172.21.15.78:0/4260900202 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd6c0cf7a0 0x7fdd6c0ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd6affd640 1 -- 172.21.15.78:0/4260900202 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd6c0ce3d0 con 0x7fdd6c0b9b70 2024-09-17T03:13:39.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd6a7fc640 1 --2- 172.21.15.78:0/4260900202 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd6c0cf7a0 0x7fdd6c0ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:39.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd6b7fe640 1 --2- 172.21.15.78:0/4260900202 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd6c0d2ed0 0x7fdd6c160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:39.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd6affd640 1 --2- 172.21.15.78:0/4260900202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd6c0b9b70 0x7fdd6c1613d0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c000f80 tx=0x7fdd5c003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:39.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd537fe640 1 -- 172.21.15.78:0/4260900202 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c0332e0 con 0x7fdd6c0b9b70 2024-09-17T03:13:39.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd537fe640 1 -- 172.21.15.78:0/4260900202 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd5c0338f0 con 0x7fdd6c0b9b70 2024-09-17T03:13:39.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd717f1640 1 -- 172.21.15.78:0/4260900202 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd6c0cd610 con 0x7fdd6c0b9b70 2024-09-17T03:13:39.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.676+0000 7fdd537fe640 1 -- 172.21.15.78:0/4260900202 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c033d20 con 0x7fdd6c0b9b70 2024-09-17T03:13:39.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.677+0000 7fdd717f1640 1 -- 172.21.15.78:0/4260900202 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd6c0cdbd0 con 0x7fdd6c0b9b70 2024-09-17T03:13:39.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.678+0000 7fdd717f1640 1 -- 172.21.15.78:0/4260900202 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd6c1634b0 con 0x7fdd6c0b9b70 2024-09-17T03:13:39.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.678+0000 7fdd537fe640 1 -- 172.21.15.78:0/4260900202 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdd5c031460 con 0x7fdd6c0b9b70 2024-09-17T03:13:39.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.679+0000 7fdd537fe640 1 --2- 172.21.15.78:0/4260900202 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdd58078b90 0x7fdd5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:39.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.679+0000 7fdd537fe640 1 -- 172.21.15.78:0/4260900202 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fdd5c0bc040 con 0x7fdd6c0b9b70 2024-09-17T03:13:39.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.679+0000 7fdd6a7fc640 1 --2- 172.21.15.78:0/4260900202 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdd58078b90 0x7fdd5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:39.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.680+0000 7fdd6a7fc640 1 --2- 172.21.15.78:0/4260900202 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdd58078b90 0x7fdd5807b0a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c0d07f0 tx=0x7fdd60009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:39.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.684+0000 7fdd537fe640 1 -- 172.21.15.78:0/4260900202 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdd5c04a070 con 0x7fdd6c0b9b70 2024-09-17T03:13:39.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.853+0000 7fdd717f1640 1 -- 172.21.15.78:0/4260900202 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdd6c0caee0 con 0x7fdd58078b90 2024-09-17T03:13:39.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.858+0000 7fdd537fe640 1 -- 172.21.15.78:0/4260900202 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251672 (secure 0 0 0) 0x7fdd6c0caee0 con 0x7fdd58078b90 2024-09-17T03:13:39.865 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:39.867 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:13:39.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.861+0000 7fdd717f1640 1 -- 172.21.15.78:0/4260900202 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdd58078b90 msgr2=0x7fdd5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.861+0000 7fdd717f1640 1 --2- 172.21.15.78:0/4260900202 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdd58078b90 0x7fdd5807b0a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdd6c0d07f0 tx=0x7fdd60009040 comp rx=0 tx=0).stop 2024-09-17T03:13:39.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.861+0000 7fdd717f1640 1 -- 172.21.15.78:0/4260900202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd6c0b9b70 msgr2=0x7fdd6c1613d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:39.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.861+0000 7fdd717f1640 1 --2- 172.21.15.78:0/4260900202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd6c0b9b70 0x7fdd6c1613d0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c000f80 tx=0x7fdd5c003c90 comp rx=0 tx=0).stop 2024-09-17T03:13:39.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.861+0000 7fdd717f1640 1 -- 172.21.15.78:0/4260900202 shutdown_connections 2024-09-17T03:13:39.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.861+0000 7fdd717f1640 1 --2- 172.21.15.78:0/4260900202 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd6c0d2ed0 0x7fdd6c160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.861+0000 7fdd717f1640 1 --2- 172.21.15.78:0/4260900202 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdd58078b90 0x7fdd5807b0a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.861+0000 7fdd717f1640 1 --2- 172.21.15.78:0/4260900202 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd6c0cf7a0 0x7fdd6c0ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.861+0000 7fdd717f1640 1 --2- 172.21.15.78:0/4260900202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd6c0b9b70 0x7fdd6c1613d0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:39.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.861+0000 7fdd717f1640 1 -- 172.21.15.78:0/4260900202 >> 172.21.15.78:0/4260900202 conn(0x7fdd6c08bfc0 msgr2=0x7fdd6c0cf090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:39.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.861+0000 7fdd717f1640 1 -- 172.21.15.78:0/4260900202 shutdown_connections 2024-09-17T03:13:39.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:39.861+0000 7fdd717f1640 1 -- 172.21.15.78:0/4260900202 wait complete. 2024-09-17T03:13:39.873 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2024-09-17T03:13:39.203452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591838,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":131,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245864,"kb_used_data":8812,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754728856,"statfs":{"total":773094113280,"available":772842348544,"internally_reserved":0,"allocated":9023488,"data_stored":4501951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":242535986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1470,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.077822"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171675+0000","last_change":"2024-09-17T03:13:36.164503+0000","last_active":"2024-09-17T03:13:36.171675+0000","last_peered":"2024-09-17T03:13:36.171675+0000","last_clean":"2024-09-17T03:13:36.171675+0000","last_became_active":"2024-09-17T03:13:36.164189+0000","last_became_peered":"2024-09-17T03:13:36.164189+0000","last_unstale":"2024-09-17T03:13:36.171675+0000","last_undegraded":"2024-09-17T03:13:36.171675+0000","last_fullsized":"2024-09-17T03:13:36.171675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:24.415909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168002+0000","last_change":"2024-09-17T03:13:36.163785+0000","last_active":"2024-09-17T03:13:36.168002+0000","last_peered":"2024-09-17T03:13:36.168002+0000","last_clean":"2024-09-17T03:13:36.168002+0000","last_became_active":"2024-09-17T03:13:36.163491+0000","last_became_peered":"2024-09-17T03:13:36.163491+0000","last_unstale":"2024-09-17T03:13:36.168002+0000","last_undegraded":"2024-09-17T03:13:36.168002+0000","last_fullsized":"2024-09-17T03:13:36.168002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:16.451197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.166961+0000","last_change":"2024-09-17T03:13:36.158610+0000","last_active":"2024-09-17T03:13:36.166961+0000","last_peered":"2024-09-17T03:13:36.166961+0000","last_clean":"2024-09-17T03:13:36.166961+0000","last_became_active":"2024-09-17T03:13:36.158308+0000","last_became_peered":"2024-09-17T03:13:36.158308+0000","last_unstale":"2024-09-17T03:13:36.166961+0000","last_undegraded":"2024-09-17T03:13:36.166961+0000","last_fullsized":"2024-09-17T03:13:36.166961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:54.875053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2024-09-17T03:13:36.156096+0000","last_change":"2024-09-17T03:13:36.156096+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:36.156096+0000","last_undegraded":"2024-09-17T03:13:36.156096+0000","last_fullsized":"2024-09-17T03:13:36.156096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174907+0000","last_change":"2024-09-17T03:13:36.171195+0000","last_active":"2024-09-17T03:13:36.174907+0000","last_peered":"2024-09-17T03:13:36.174907+0000","last_clean":"2024-09-17T03:13:36.174907+0000","last_became_active":"2024-09-17T03:13:36.170849+0000","last_became_peered":"2024-09-17T03:13:36.170849+0000","last_unstale":"2024-09-17T03:13:36.174907+0000","last_undegraded":"2024-09-17T03:13:36.174907+0000","last_fullsized":"2024-09-17T03:13:36.174907+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:54.973430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168655+0000","last_change":"2024-09-17T03:13:36.164233+0000","last_active":"2024-09-17T03:13:36.168655+0000","last_peered":"2024-09-17T03:13:36.168655+0000","last_clean":"2024-09-17T03:13:36.168655+0000","last_became_active":"2024-09-17T03:13:36.163925+0000","last_became_peered":"2024-09-17T03:13:36.163925+0000","last_unstale":"2024-09-17T03:13:36.168655+0000","last_undegraded":"2024-09-17T03:13:36.168655+0000","last_fullsized":"2024-09-17T03:13:36.168655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:24.380925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174980+0000","last_change":"2024-09-17T03:13:36.171062+0000","last_active":"2024-09-17T03:13:36.174980+0000","last_peered":"2024-09-17T03:13:36.174980+0000","last_clean":"2024-09-17T03:13:36.174980+0000","last_became_active":"2024-09-17T03:13:36.170264+0000","last_became_peered":"2024-09-17T03:13:36.170264+0000","last_unstale":"2024-09-17T03:13:36.174980+0000","last_undegraded":"2024-09-17T03:13:36.174980+0000","last_fullsized":"2024-09-17T03:13:36.174980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:44.954526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.159417+0000","last_change":"2024-09-17T03:13:36.154137+0000","last_active":"2024-09-17T03:13:36.159417+0000","last_peered":"2024-09-17T03:13:36.159417+0000","last_clean":"2024-09-17T03:13:36.159417+0000","last_became_active":"2024-09-17T03:13:36.153776+0000","last_became_peered":"2024-09-17T03:13:36.153776+0000","last_unstale":"2024-09-17T03:13:36.159417+0000","last_undegraded":"2024-09-17T03:13:36.159417+0000","last_fullsized":"2024-09-17T03:13:36.159417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:54.973430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172327+0000","last_change":"2024-09-17T03:13:36.165365+0000","last_active":"2024-09-17T03:13:36.172327+0000","last_peered":"2024-09-17T03:13:36.172327+0000","last_clean":"2024-09-17T03:13:36.172327+0000","last_became_active":"2024-09-17T03:13:36.165047+0000","last_became_peered":"2024-09-17T03:13:36.165047+0000","last_unstale":"2024-09-17T03:13:36.172327+0000","last_undegraded":"2024-09-17T03:13:36.172327+0000","last_fullsized":"2024-09-17T03:13:36.172327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:35.013596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.163241+0000","last_change":"2024-09-17T03:13:36.158884+0000","last_active":"2024-09-17T03:13:36.163241+0000","last_peered":"2024-09-17T03:13:36.163241+0000","last_clean":"2024-09-17T03:13:36.163241+0000","last_became_active":"2024-09-17T03:13:36.157801+0000","last_became_peered":"2024-09-17T03:13:36.157801+0000","last_unstale":"2024-09-17T03:13:36.163241+0000","last_undegraded":"2024-09-17T03:13:36.163241+0000","last_fullsized":"2024-09-17T03:13:36.163241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:34.514645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.165971+0000","last_change":"2024-09-17T03:13:36.159357+0000","last_active":"2024-09-17T03:13:36.165971+0000","last_peered":"2024-09-17T03:13:36.165971+0000","last_clean":"2024-09-17T03:13:36.165971+0000","last_became_active":"2024-09-17T03:13:36.159037+0000","last_became_peered":"2024-09-17T03:13:36.159037+0000","last_unstale":"2024-09-17T03:13:36.165971+0000","last_undegraded":"2024-09-17T03:13:36.165971+0000","last_fullsized":"2024-09-17T03:13:36.165971+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:10.901422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.162938+0000","last_change":"2024-09-17T03:13:36.157305+0000","last_active":"2024-09-17T03:13:36.162938+0000","last_peered":"2024-09-17T03:13:36.162938+0000","last_clean":"2024-09-17T03:13:36.162938+0000","last_became_active":"2024-09-17T03:13:36.156967+0000","last_became_peered":"2024-09-17T03:13:36.156967+0000","last_unstale":"2024-09-17T03:13:36.162938+0000","last_undegraded":"2024-09-17T03:13:36.162938+0000","last_fullsized":"2024-09-17T03:13:36.162938+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:46.504996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171798+0000","last_change":"2024-09-17T03:13:36.170755+0000","last_active":"2024-09-17T03:13:36.171798+0000","last_peered":"2024-09-17T03:13:36.171798+0000","last_clean":"2024-09-17T03:13:36.171798+0000","last_became_active":"2024-09-17T03:13:36.170436+0000","last_became_peered":"2024-09-17T03:13:36.170436+0000","last_unstale":"2024-09-17T03:13:36.171798+0000","last_undegraded":"2024-09-17T03:13:36.171798+0000","last_fullsized":"2024-09-17T03:13:36.171798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:03.088723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.175020+0000","last_change":"2024-09-17T03:13:36.171144+0000","last_active":"2024-09-17T03:13:36.175020+0000","last_peered":"2024-09-17T03:13:36.175020+0000","last_clean":"2024-09-17T03:13:36.175020+0000","last_became_active":"2024-09-17T03:13:36.170849+0000","last_became_peered":"2024-09-17T03:13:36.170849+0000","last_unstale":"2024-09-17T03:13:36.175020+0000","last_undegraded":"2024-09-17T03:13:36.175020+0000","last_fullsized":"2024-09-17T03:13:36.175020+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:49.302326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275265+0000","last_change":"2024-09-17T03:13:36.161513+0000","last_active":"2024-09-17T03:13:37.275265+0000","last_peered":"2024-09-17T03:13:37.275265+0000","last_clean":"2024-09-17T03:13:37.275265+0000","last_became_active":"2024-09-17T03:13:36.161196+0000","last_became_peered":"2024-09-17T03:13:36.161196+0000","last_unstale":"2024-09-17T03:13:37.275265+0000","last_undegraded":"2024-09-17T03:13:37.275265+0000","last_fullsized":"2024-09-17T03:13:37.275265+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:11.223567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.164882+0000","last_change":"2024-09-17T03:13:36.159093+0000","last_active":"2024-09-17T03:13:36.164882+0000","last_peered":"2024-09-17T03:13:36.164882+0000","last_clean":"2024-09-17T03:13:36.164882+0000","last_became_active":"2024-09-17T03:13:36.158546+0000","last_became_peered":"2024-09-17T03:13:36.158546+0000","last_unstale":"2024-09-17T03:13:36.164882+0000","last_undegraded":"2024-09-17T03:13:36.164882+0000","last_fullsized":"2024-09-17T03:13:36.164882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:44.382837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172830+0000","last_change":"2024-09-17T03:13:36.172719+0000","last_active":"2024-09-17T03:13:36.172830+0000","last_peered":"2024-09-17T03:13:36.172830+0000","last_clean":"2024-09-17T03:13:36.172830+0000","last_became_active":"2024-09-17T03:13:36.172362+0000","last_became_peered":"2024-09-17T03:13:36.172362+0000","last_unstale":"2024-09-17T03:13:36.172830+0000","last_undegraded":"2024-09-17T03:13:36.172830+0000","last_fullsized":"2024-09-17T03:13:36.172830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:43.797527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172392+0000","last_change":"2024-09-17T03:13:36.170457+0000","last_active":"2024-09-17T03:13:36.172392+0000","last_peered":"2024-09-17T03:13:36.172392+0000","last_clean":"2024-09-17T03:13:36.172392+0000","last_became_active":"2024-09-17T03:13:36.170155+0000","last_became_peered":"2024-09-17T03:13:36.170155+0000","last_unstale":"2024-09-17T03:13:36.172392+0000","last_undegraded":"2024-09-17T03:13:36.172392+0000","last_fullsized":"2024-09-17T03:13:36.172392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:16.330644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.167407+0000","last_change":"2024-09-17T03:13:36.167306+0000","last_active":"2024-09-17T03:13:36.167407+0000","last_peered":"2024-09-17T03:13:36.167407+0000","last_clean":"2024-09-17T03:13:36.167407+0000","last_became_active":"2024-09-17T03:13:36.167004+0000","last_became_peered":"2024-09-17T03:13:36.167004+0000","last_unstale":"2024-09-17T03:13:36.167407+0000","last_undegraded":"2024-09-17T03:13:36.167407+0000","last_fullsized":"2024-09-17T03:13:36.167407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:25.624815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.170731+0000","last_change":"2024-09-17T03:13:36.164087+0000","last_active":"2024-09-17T03:13:36.170731+0000","last_peered":"2024-09-17T03:13:36.170731+0000","last_clean":"2024-09-17T03:13:36.170731+0000","last_became_active":"2024-09-17T03:13:36.163793+0000","last_became_peered":"2024-09-17T03:13:36.163793+0000","last_unstale":"2024-09-17T03:13:36.170731+0000","last_undegraded":"2024-09-17T03:13:36.170731+0000","last_fullsized":"2024-09-17T03:13:36.170731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:39.687980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172698+0000","last_change":"2024-09-17T03:13:36.170832+0000","last_active":"2024-09-17T03:13:36.172698+0000","last_peered":"2024-09-17T03:13:36.172698+0000","last_clean":"2024-09-17T03:13:36.172698+0000","last_became_active":"2024-09-17T03:13:36.170477+0000","last_became_peered":"2024-09-17T03:13:36.170477+0000","last_unstale":"2024-09-17T03:13:36.172698+0000","last_undegraded":"2024-09-17T03:13:36.172698+0000","last_fullsized":"2024-09-17T03:13:36.172698+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:50.642766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173666+0000","last_change":"2024-09-17T03:13:36.166922+0000","last_active":"2024-09-17T03:13:36.173666+0000","last_peered":"2024-09-17T03:13:36.173666+0000","last_clean":"2024-09-17T03:13:36.173666+0000","last_became_active":"2024-09-17T03:13:36.166609+0000","last_became_peered":"2024-09-17T03:13:36.166609+0000","last_unstale":"2024-09-17T03:13:36.173666+0000","last_undegraded":"2024-09-17T03:13:36.173666+0000","last_fullsized":"2024-09-17T03:13:36.173666+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:55.515484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171645+0000","last_change":"2024-09-17T03:13:36.164280+0000","last_active":"2024-09-17T03:13:36.171645+0000","last_peered":"2024-09-17T03:13:36.171645+0000","last_clean":"2024-09-17T03:13:36.171645+0000","last_became_active":"2024-09-17T03:13:36.163689+0000","last_became_peered":"2024-09-17T03:13:36.163689+0000","last_unstale":"2024-09-17T03:13:36.171645+0000","last_undegraded":"2024-09-17T03:13:36.171645+0000","last_fullsized":"2024-09-17T03:13:36.171645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:19.690392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.170927+0000","last_change":"2024-09-17T03:13:36.166970+0000","last_active":"2024-09-17T03:13:36.170927+0000","last_peered":"2024-09-17T03:13:36.170927+0000","last_clean":"2024-09-17T03:13:36.170927+0000","last_became_active":"2024-09-17T03:13:36.166665+0000","last_became_peered":"2024-09-17T03:13:36.166665+0000","last_unstale":"2024-09-17T03:13:36.170927+0000","last_undegraded":"2024-09-17T03:13:36.170927+0000","last_fullsized":"2024-09-17T03:13:36.170927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:05.146731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.165529+0000","last_change":"2024-09-17T03:13:36.156703+0000","last_active":"2024-09-17T03:13:36.165529+0000","last_peered":"2024-09-17T03:13:36.165529+0000","last_clean":"2024-09-17T03:13:36.165529+0000","last_became_active":"2024-09-17T03:13:36.156367+0000","last_became_peered":"2024-09-17T03:13:36.156367+0000","last_unstale":"2024-09-17T03:13:36.165529+0000","last_undegraded":"2024-09-17T03:13:36.165529+0000","last_fullsized":"2024-09-17T03:13:36.165529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:05.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168674+0000","last_change":"2024-09-17T03:13:36.166639+0000","last_active":"2024-09-17T03:13:36.168674+0000","last_peered":"2024-09-17T03:13:36.168674+0000","last_clean":"2024-09-17T03:13:36.168674+0000","last_became_active":"2024-09-17T03:13:36.166289+0000","last_became_peered":"2024-09-17T03:13:36.166289+0000","last_unstale":"2024-09-17T03:13:36.168674+0000","last_undegraded":"2024-09-17T03:13:36.168674+0000","last_fullsized":"2024-09-17T03:13:36.168674+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:38.480507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173441+0000","last_change":"2024-09-17T03:13:36.173311+0000","last_active":"2024-09-17T03:13:36.173441+0000","last_peered":"2024-09-17T03:13:36.173441+0000","last_clean":"2024-09-17T03:13:36.173441+0000","last_became_active":"2024-09-17T03:13:36.172541+0000","last_became_peered":"2024-09-17T03:13:36.172541+0000","last_unstale":"2024-09-17T03:13:36.173441+0000","last_undegraded":"2024-09-17T03:13:36.173441+0000","last_fullsized":"2024-09-17T03:13:36.173441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:24.380925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171475+0000","last_change":"2024-09-17T03:13:36.164574+0000","last_active":"2024-09-17T03:13:36.171475+0000","last_peered":"2024-09-17T03:13:36.171475+0000","last_clean":"2024-09-17T03:13:36.171475+0000","last_became_active":"2024-09-17T03:13:36.164233+0000","last_became_peered":"2024-09-17T03:13:36.164233+0000","last_unstale":"2024-09-17T03:13:36.171475+0000","last_undegraded":"2024-09-17T03:13:36.171475+0000","last_fullsized":"2024-09-17T03:13:36.171475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:13.580635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.166364+0000","last_change":"2024-09-17T03:13:36.159680+0000","last_active":"2024-09-17T03:13:36.166364+0000","last_peered":"2024-09-17T03:13:36.166364+0000","last_clean":"2024-09-17T03:13:36.166364+0000","last_became_active":"2024-09-17T03:13:36.159385+0000","last_became_peered":"2024-09-17T03:13:36.159385+0000","last_unstale":"2024-09-17T03:13:36.166364+0000","last_undegraded":"2024-09-17T03:13:36.166364+0000","last_fullsized":"2024-09-17T03:13:36.166364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:05.330405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174358+0000","last_change":"2024-09-17T03:13:36.174241+0000","last_active":"2024-09-17T03:13:36.174358+0000","last_peered":"2024-09-17T03:13:36.174358+0000","last_clean":"2024-09-17T03:13:36.174358+0000","last_became_active":"2024-09-17T03:13:36.173940+0000","last_became_peered":"2024-09-17T03:13:36.173940+0000","last_unstale":"2024-09-17T03:13:36.174358+0000","last_undegraded":"2024-09-17T03:13:36.174358+0000","last_fullsized":"2024-09-17T03:13:36.174358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:31:27.192758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171890+0000","last_change":"2024-09-17T03:13:36.168808+0000","last_active":"2024-09-17T03:13:36.171890+0000","last_peered":"2024-09-17T03:13:36.171890+0000","last_clean":"2024-09-17T03:13:36.171890+0000","last_became_active":"2024-09-17T03:13:36.167241+0000","last_became_peered":"2024-09-17T03:13:36.167241+0000","last_unstale":"2024-09-17T03:13:36.171890+0000","last_undegraded":"2024-09-17T03:13:36.171890+0000","last_fullsized":"2024-09-17T03:13:36.171890+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:02.497727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172893+0000","last_change":"2024-09-17T03:13:36.167980+0000","last_active":"2024-09-17T03:13:36.172893+0000","last_peered":"2024-09-17T03:13:36.172893+0000","last_clean":"2024-09-17T03:13:36.172893+0000","last_became_active":"2024-09-17T03:13:36.167284+0000","last_became_peered":"2024-09-17T03:13:36.167284+0000","last_unstale":"2024-09-17T03:13:36.172893+0000","last_undegraded":"2024-09-17T03:13:36.172893+0000","last_fullsized":"2024-09-17T03:13:36.172893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:00.786078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173348+0000","last_change":"2024-09-17T03:13:36.173114+0000","last_active":"2024-09-17T03:13:36.173348+0000","last_peered":"2024-09-17T03:13:36.173348+0000","last_clean":"2024-09-17T03:13:36.173348+0000","last_became_active":"2024-09-17T03:13:36.172653+0000","last_became_peered":"2024-09-17T03:13:36.172653+0000","last_unstale":"2024-09-17T03:13:36.173348+0000","last_undegraded":"2024-09-17T03:13:36.173348+0000","last_fullsized":"2024-09-17T03:13:36.173348+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:51.574328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"81'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.185157+0000","last_change":"2024-09-17T03:13:35.147001+0000","last_active":"2024-09-17T03:13:36.185157+0000","last_peered":"2024-09-17T03:13:36.185157+0000","last_clean":"2024-09-17T03:13:36.185157+0000","last_became_active":"2024-09-17T03:13:35.146658+0000","last_became_peered":"2024-09-17T03:13:35.146658+0000","last_unstale":"2024-09-17T03:13:36.185157+0000","last_undegraded":"2024-09-17T03:13:36.185157+0000","last_fullsized":"2024-09-17T03:13:36.185157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:06.031844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172305+0000","last_change":"2024-09-17T03:13:36.168877+0000","last_active":"2024-09-17T03:13:36.172305+0000","last_peered":"2024-09-17T03:13:36.172305+0000","last_clean":"2024-09-17T03:13:36.172305+0000","last_became_active":"2024-09-17T03:13:36.168545+0000","last_became_peered":"2024-09-17T03:13:36.168545+0000","last_unstale":"2024-09-17T03:13:36.172305+0000","last_undegraded":"2024-09-17T03:13:36.172305+0000","last_fullsized":"2024-09-17T03:13:36.172305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:01.055085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"81'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160707+0000","last_change":"2024-09-17T03:13:35.151241+0000","last_active":"2024-09-17T03:13:36.160707+0000","last_peered":"2024-09-17T03:13:36.160707+0000","last_clean":"2024-09-17T03:13:36.160707+0000","last_became_active":"2024-09-17T03:13:35.150775+0000","last_became_peered":"2024-09-17T03:13:35.150775+0000","last_unstale":"2024-09-17T03:13:36.160707+0000","last_undegraded":"2024-09-17T03:13:36.160707+0000","last_fullsized":"2024-09-17T03:13:36.160707+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:48.739118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160679+0000","last_change":"2024-09-17T03:13:36.156147+0000","last_active":"2024-09-17T03:13:36.160679+0000","last_peered":"2024-09-17T03:13:36.160679+0000","last_clean":"2024-09-17T03:13:36.160679+0000","last_became_active":"2024-09-17T03:13:36.155807+0000","last_became_peered":"2024-09-17T03:13:36.155807+0000","last_unstale":"2024-09-17T03:13:36.160679+0000","last_undegraded":"2024-09-17T03:13:36.160679+0000","last_fullsized":"2024-09-17T03:13:36.160679+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:41:23.077488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.163253+0000","last_change":"2024-09-17T03:13:35.147739+0000","last_active":"2024-09-17T03:13:36.163253+0000","last_peered":"2024-09-17T03:13:36.163253+0000","last_clean":"2024-09-17T03:13:36.163253+0000","last_became_active":"2024-09-17T03:13:35.147321+0000","last_became_peered":"2024-09-17T03:13:35.147321+0000","last_unstale":"2024-09-17T03:13:36.163253+0000","last_undegraded":"2024-09-17T03:13:36.163253+0000","last_fullsized":"2024-09-17T03:13:36.163253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:33.977477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171514+0000","last_change":"2024-09-17T03:13:36.168055+0000","last_active":"2024-09-17T03:13:36.171514+0000","last_peered":"2024-09-17T03:13:36.171514+0000","last_clean":"2024-09-17T03:13:36.171514+0000","last_became_active":"2024-09-17T03:13:36.167764+0000","last_became_peered":"2024-09-17T03:13:36.167764+0000","last_unstale":"2024-09-17T03:13:36.171514+0000","last_undegraded":"2024-09-17T03:13:36.171514+0000","last_fullsized":"2024-09-17T03:13:36.171514+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:15.268158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.161068+0000","last_change":"2024-09-17T03:13:35.148688+0000","last_active":"2024-09-17T03:13:36.161068+0000","last_peered":"2024-09-17T03:13:36.161068+0000","last_clean":"2024-09-17T03:13:36.161068+0000","last_became_active":"2024-09-17T03:13:35.148412+0000","last_became_peered":"2024-09-17T03:13:35.148412+0000","last_unstale":"2024-09-17T03:13:36.161068+0000","last_undegraded":"2024-09-17T03:13:36.161068+0000","last_fullsized":"2024-09-17T03:13:36.161068+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:20.696636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173396+0000","last_change":"2024-09-17T03:13:36.173304+0000","last_active":"2024-09-17T03:13:36.173396+0000","last_peered":"2024-09-17T03:13:36.173396+0000","last_clean":"2024-09-17T03:13:36.173396+0000","last_became_active":"2024-09-17T03:13:36.172846+0000","last_became_peered":"2024-09-17T03:13:36.172846+0000","last_unstale":"2024-09-17T03:13:36.173396+0000","last_undegraded":"2024-09-17T03:13:36.173396+0000","last_fullsized":"2024-09-17T03:13:36.173396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:12.520288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"81'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.162218+0000","last_change":"2024-09-17T03:13:35.141265+0000","last_active":"2024-09-17T03:13:36.162218+0000","last_peered":"2024-09-17T03:13:36.162218+0000","last_clean":"2024-09-17T03:13:36.162218+0000","last_became_active":"2024-09-17T03:13:35.140530+0000","last_became_peered":"2024-09-17T03:13:35.140530+0000","last_unstale":"2024-09-17T03:13:36.162218+0000","last_undegraded":"2024-09-17T03:13:36.162218+0000","last_fullsized":"2024-09-17T03:13:36.162218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:50.135257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174383+0000","last_change":"2024-09-17T03:13:36.174281+0000","last_active":"2024-09-17T03:13:36.174383+0000","last_peered":"2024-09-17T03:13:36.174383+0000","last_clean":"2024-09-17T03:13:36.174383+0000","last_became_active":"2024-09-17T03:13:36.173946+0000","last_became_peered":"2024-09-17T03:13:36.173946+0000","last_unstale":"2024-09-17T03:13:36.174383+0000","last_undegraded":"2024-09-17T03:13:36.174383+0000","last_fullsized":"2024-09-17T03:13:36.174383+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:35.013596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"81'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.153914+0000","last_change":"2024-09-17T03:13:35.151157+0000","last_active":"2024-09-17T03:13:36.153914+0000","last_peered":"2024-09-17T03:13:36.153914+0000","last_clean":"2024-09-17T03:13:36.153914+0000","last_became_active":"2024-09-17T03:13:35.150743+0000","last_became_peered":"2024-09-17T03:13:35.150743+0000","last_unstale":"2024-09-17T03:13:36.153914+0000","last_undegraded":"2024-09-17T03:13:36.153914+0000","last_fullsized":"2024-09-17T03:13:36.153914+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:29.000215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168607+0000","last_change":"2024-09-17T03:13:36.164002+0000","last_active":"2024-09-17T03:13:36.168607+0000","last_peered":"2024-09-17T03:13:36.168607+0000","last_clean":"2024-09-17T03:13:36.168607+0000","last_became_active":"2024-09-17T03:13:36.163678+0000","last_became_peered":"2024-09-17T03:13:36.163678+0000","last_unstale":"2024-09-17T03:13:36.168607+0000","last_undegraded":"2024-09-17T03:13:36.168607+0000","last_fullsized":"2024-09-17T03:13:36.168607+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:05.685914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160617+0000","last_change":"2024-09-17T03:13:35.148352+0000","last_active":"2024-09-17T03:13:36.160617+0000","last_peered":"2024-09-17T03:13:36.160617+0000","last_clean":"2024-09-17T03:13:36.160617+0000","last_became_active":"2024-09-17T03:13:35.148059+0000","last_became_peered":"2024-09-17T03:13:35.148059+0000","last_unstale":"2024-09-17T03:13:36.160617+0000","last_undegraded":"2024-09-17T03:13:36.160617+0000","last_fullsized":"2024-09-17T03:13:36.160617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:56.223035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275525+0000","last_change":"2024-09-17T03:13:36.159112+0000","last_active":"2024-09-17T03:13:37.275525+0000","last_peered":"2024-09-17T03:13:37.275525+0000","last_clean":"2024-09-17T03:13:37.275525+0000","last_became_active":"2024-09-17T03:13:36.158801+0000","last_became_peered":"2024-09-17T03:13:36.158801+0000","last_unstale":"2024-09-17T03:13:37.275525+0000","last_undegraded":"2024-09-17T03:13:37.275525+0000","last_fullsized":"2024-09-17T03:13:37.275525+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:51.179243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150270+0000","last_change":"2024-09-17T03:13:35.136863+0000","last_active":"2024-09-17T03:13:36.150270+0000","last_peered":"2024-09-17T03:13:36.150270+0000","last_clean":"2024-09-17T03:13:36.150270+0000","last_became_active":"2024-09-17T03:13:35.136521+0000","last_became_peered":"2024-09-17T03:13:35.136521+0000","last_unstale":"2024-09-17T03:13:36.150270+0000","last_undegraded":"2024-09-17T03:13:36.150270+0000","last_fullsized":"2024-09-17T03:13:36.150270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:26.163857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275914+0000","last_change":"2024-09-17T03:13:36.166439+0000","last_active":"2024-09-17T03:13:37.275914+0000","last_peered":"2024-09-17T03:13:37.275914+0000","last_clean":"2024-09-17T03:13:37.275914+0000","last_became_active":"2024-09-17T03:13:36.166100+0000","last_became_peered":"2024-09-17T03:13:36.166100+0000","last_unstale":"2024-09-17T03:13:37.275914+0000","last_undegraded":"2024-09-17T03:13:37.275914+0000","last_fullsized":"2024-09-17T03:13:37.275914+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:47.088092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150785+0000","last_change":"2024-09-17T03:13:35.150085+0000","last_active":"2024-09-17T03:13:36.150785+0000","last_peered":"2024-09-17T03:13:36.150785+0000","last_clean":"2024-09-17T03:13:36.150785+0000","last_became_active":"2024-09-17T03:13:35.149724+0000","last_became_peered":"2024-09-17T03:13:35.149724+0000","last_unstale":"2024-09-17T03:13:36.150785+0000","last_undegraded":"2024-09-17T03:13:36.150785+0000","last_fullsized":"2024-09-17T03:13:36.150785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:43.977125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173013+0000","last_change":"2024-09-17T03:13:36.170595+0000","last_active":"2024-09-17T03:13:36.173013+0000","last_peered":"2024-09-17T03:13:36.173013+0000","last_clean":"2024-09-17T03:13:36.173013+0000","last_became_active":"2024-09-17T03:13:36.170264+0000","last_became_peered":"2024-09-17T03:13:36.170264+0000","last_unstale":"2024-09-17T03:13:36.173013+0000","last_undegraded":"2024-09-17T03:13:36.173013+0000","last_fullsized":"2024-09-17T03:13:36.173013+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:18.976321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150763+0000","last_change":"2024-09-17T03:13:35.144777+0000","last_active":"2024-09-17T03:13:36.150763+0000","last_peered":"2024-09-17T03:13:36.150763+0000","last_clean":"2024-09-17T03:13:36.150763+0000","last_became_active":"2024-09-17T03:13:35.144435+0000","last_became_peered":"2024-09-17T03:13:35.144435+0000","last_unstale":"2024-09-17T03:13:36.150763+0000","last_undegraded":"2024-09-17T03:13:36.150763+0000","last_fullsized":"2024-09-17T03:13:36.150763+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:03.012283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2024-09-17T03:13:36.157315+0000","last_change":"2024-09-17T03:13:36.157315+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:36.157315+0000","last_undegraded":"2024-09-17T03:13:36.157315+0000","last_fullsized":"2024-09-17T03:13:36.157315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"81'3","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.182085+0000","last_change":"2024-09-17T03:13:35.140368+0000","last_active":"2024-09-17T03:13:36.182085+0000","last_peered":"2024-09-17T03:13:36.182085+0000","last_clean":"2024-09-17T03:13:36.182085+0000","last_became_active":"2024-09-17T03:13:35.139934+0000","last_became_peered":"2024-09-17T03:13:35.139934+0000","last_unstale":"2024-09-17T03:13:36.182085+0000","last_undegraded":"2024-09-17T03:13:36.182085+0000","last_fullsized":"2024-09-17T03:13:36.182085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:31.279064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2024-09-17T03:13:36.161033+0000","last_change":"2024-09-17T03:13:36.161033+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:36.161033+0000","last_undegraded":"2024-09-17T03:13:36.161033+0000","last_fullsized":"2024-09-17T03:13:36.161033+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"81'5","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.175388+0000","last_change":"2024-09-17T03:13:35.148650+0000","last_active":"2024-09-17T03:13:36.175388+0000","last_peered":"2024-09-17T03:13:36.175388+0000","last_clean":"2024-09-17T03:13:36.175388+0000","last_became_active":"2024-09-17T03:13:35.148261+0000","last_became_peered":"2024-09-17T03:13:35.148261+0000","last_unstale":"2024-09-17T03:13:36.175388+0000","last_undegraded":"2024-09-17T03:13:36.175388+0000","last_fullsized":"2024-09-17T03:13:36.175388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:34.187583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2024-09-17T03:13:36.156718+0000","last_change":"2024-09-17T03:13:36.156718+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:36.156718+0000","last_undegraded":"2024-09-17T03:13:36.156718+0000","last_fullsized":"2024-09-17T03:13:36.156718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.151021+0000","last_change":"2024-09-17T03:13:35.147131+0000","last_active":"2024-09-17T03:13:36.151021+0000","last_peered":"2024-09-17T03:13:36.151021+0000","last_clean":"2024-09-17T03:13:36.151021+0000","last_became_active":"2024-09-17T03:13:35.146813+0000","last_became_peered":"2024-09-17T03:13:35.146813+0000","last_unstale":"2024-09-17T03:13:36.151021+0000","last_undegraded":"2024-09-17T03:13:36.151021+0000","last_fullsized":"2024-09-17T03:13:36.151021+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:34.868836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171407+0000","last_change":"2024-09-17T03:13:36.167033+0000","last_active":"2024-09-17T03:13:36.171407+0000","last_peered":"2024-09-17T03:13:36.171407+0000","last_clean":"2024-09-17T03:13:36.171407+0000","last_became_active":"2024-09-17T03:13:36.166686+0000","last_became_peered":"2024-09-17T03:13:36.166686+0000","last_unstale":"2024-09-17T03:13:36.171407+0000","last_undegraded":"2024-09-17T03:13:36.171407+0000","last_fullsized":"2024-09-17T03:13:36.171407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:32.691348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275342+0000","last_change":"2024-09-17T03:13:35.148416+0000","last_active":"2024-09-17T03:13:37.275342+0000","last_peered":"2024-09-17T03:13:37.275342+0000","last_clean":"2024-09-17T03:13:37.275342+0000","last_became_active":"2024-09-17T03:13:35.147902+0000","last_became_peered":"2024-09-17T03:13:35.147902+0000","last_unstale":"2024-09-17T03:13:37.275342+0000","last_undegraded":"2024-09-17T03:13:37.275342+0000","last_fullsized":"2024-09-17T03:13:37.275342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:53.553162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172441+0000","last_change":"2024-09-17T03:13:36.172337+0000","last_active":"2024-09-17T03:13:36.172441+0000","last_peered":"2024-09-17T03:13:36.172441+0000","last_clean":"2024-09-17T03:13:36.172441+0000","last_became_active":"2024-09-17T03:13:36.172033+0000","last_became_peered":"2024-09-17T03:13:36.172033+0000","last_unstale":"2024-09-17T03:13:36.172441+0000","last_undegraded":"2024-09-17T03:13:36.172441+0000","last_fullsized":"2024-09-17T03:13:36.172441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:48.036856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.148597+0000","last_change":"2024-09-17T03:13:35.145883+0000","last_active":"2024-09-17T03:13:36.148597+0000","last_peered":"2024-09-17T03:13:36.148597+0000","last_clean":"2024-09-17T03:13:36.148597+0000","last_became_active":"2024-09-17T03:13:35.145485+0000","last_became_peered":"2024-09-17T03:13:35.145485+0000","last_unstale":"2024-09-17T03:13:36.148597+0000","last_undegraded":"2024-09-17T03:13:36.148597+0000","last_fullsized":"2024-09-17T03:13:36.148597+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:33.828573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.167821+0000","last_change":"2024-09-17T03:13:36.162558+0000","last_active":"2024-09-17T03:13:36.167821+0000","last_peered":"2024-09-17T03:13:36.167821+0000","last_clean":"2024-09-17T03:13:36.167821+0000","last_became_active":"2024-09-17T03:13:36.162263+0000","last_became_peered":"2024-09-17T03:13:36.162263+0000","last_unstale":"2024-09-17T03:13:36.167821+0000","last_undegraded":"2024-09-17T03:13:36.167821+0000","last_fullsized":"2024-09-17T03:13:36.167821+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:26.393514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"81'5","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160497+0000","last_change":"2024-09-17T03:13:35.147811+0000","last_active":"2024-09-17T03:13:36.160497+0000","last_peered":"2024-09-17T03:13:36.160497+0000","last_clean":"2024-09-17T03:13:36.160497+0000","last_became_active":"2024-09-17T03:13:35.147540+0000","last_became_peered":"2024-09-17T03:13:35.147540+0000","last_unstale":"2024-09-17T03:13:36.160497+0000","last_undegraded":"2024-09-17T03:13:36.160497+0000","last_fullsized":"2024-09-17T03:13:36.160497+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:21.660023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168645+0000","last_change":"2024-09-17T03:13:36.160764+0000","last_active":"2024-09-17T03:13:36.168645+0000","last_peered":"2024-09-17T03:13:36.168645+0000","last_clean":"2024-09-17T03:13:36.168645+0000","last_became_active":"2024-09-17T03:13:36.160458+0000","last_became_peered":"2024-09-17T03:13:36.160458+0000","last_unstale":"2024-09-17T03:13:36.168645+0000","last_undegraded":"2024-09-17T03:13:36.168645+0000","last_fullsized":"2024-09-17T03:13:36.168645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:57.043310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.181628+0000","last_change":"2024-09-17T03:13:35.146348+0000","last_active":"2024-09-17T03:13:36.181628+0000","last_peered":"2024-09-17T03:13:36.181628+0000","last_clean":"2024-09-17T03:13:36.181628+0000","last_became_active":"2024-09-17T03:13:35.145718+0000","last_became_peered":"2024-09-17T03:13:35.145718+0000","last_unstale":"2024-09-17T03:13:36.181628+0000","last_undegraded":"2024-09-17T03:13:36.181628+0000","last_fullsized":"2024-09-17T03:13:36.181628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:39.536551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.163461+0000","last_change":"2024-09-17T03:13:36.158379+0000","last_active":"2024-09-17T03:13:36.163461+0000","last_peered":"2024-09-17T03:13:36.163461+0000","last_clean":"2024-09-17T03:13:36.163461+0000","last_became_active":"2024-09-17T03:13:36.157894+0000","last_became_peered":"2024-09-17T03:13:36.157894+0000","last_unstale":"2024-09-17T03:13:36.163461+0000","last_undegraded":"2024-09-17T03:13:36.163461+0000","last_fullsized":"2024-09-17T03:13:36.163461+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:36.956392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.162873+0000","last_change":"2024-09-17T03:13:35.148036+0000","last_active":"2024-09-17T03:13:36.162873+0000","last_peered":"2024-09-17T03:13:36.162873+0000","last_clean":"2024-09-17T03:13:36.162873+0000","last_became_active":"2024-09-17T03:13:35.147436+0000","last_became_peered":"2024-09-17T03:13:35.147436+0000","last_unstale":"2024-09-17T03:13:36.162873+0000","last_undegraded":"2024-09-17T03:13:36.162873+0000","last_fullsized":"2024-09-17T03:13:36.162873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:37.475359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171851+0000","last_change":"2024-09-17T03:13:36.167162+0000","last_active":"2024-09-17T03:13:36.171851+0000","last_peered":"2024-09-17T03:13:36.171851+0000","last_clean":"2024-09-17T03:13:36.171851+0000","last_became_active":"2024-09-17T03:13:36.166834+0000","last_became_peered":"2024-09-17T03:13:36.166834+0000","last_unstale":"2024-09-17T03:13:36.171851+0000","last_undegraded":"2024-09-17T03:13:36.171851+0000","last_fullsized":"2024-09-17T03:13:36.171851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:08.944447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160953+0000","last_change":"2024-09-17T03:13:35.150447+0000","last_active":"2024-09-17T03:13:36.160953+0000","last_peered":"2024-09-17T03:13:36.160953+0000","last_clean":"2024-09-17T03:13:36.160953+0000","last_became_active":"2024-09-17T03:13:35.150117+0000","last_became_peered":"2024-09-17T03:13:35.150117+0000","last_unstale":"2024-09-17T03:13:36.160953+0000","last_undegraded":"2024-09-17T03:13:36.160953+0000","last_fullsized":"2024-09-17T03:13:36.160953+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:03.128187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171406+0000","last_change":"2024-09-17T03:13:36.169959+0000","last_active":"2024-09-17T03:13:36.171406+0000","last_peered":"2024-09-17T03:13:36.171406+0000","last_clean":"2024-09-17T03:13:36.171406+0000","last_became_active":"2024-09-17T03:13:36.169633+0000","last_became_peered":"2024-09-17T03:13:36.169633+0000","last_unstale":"2024-09-17T03:13:36.171406+0000","last_undegraded":"2024-09-17T03:13:36.171406+0000","last_fullsized":"2024-09-17T03:13:36.171406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:53.203069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"81'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275792+0000","last_change":"2024-09-17T03:13:35.150519+0000","last_active":"2024-09-17T03:13:37.275792+0000","last_peered":"2024-09-17T03:13:37.275792+0000","last_clean":"2024-09-17T03:13:37.275792+0000","last_became_active":"2024-09-17T03:13:35.150226+0000","last_became_peered":"2024-09-17T03:13:35.150226+0000","last_unstale":"2024-09-17T03:13:37.275792+0000","last_undegraded":"2024-09-17T03:13:37.275792+0000","last_fullsized":"2024-09-17T03:13:37.275792+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:26.002514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160547+0000","last_change":"2024-09-17T03:13:36.158573+0000","last_active":"2024-09-17T03:13:36.160547+0000","last_peered":"2024-09-17T03:13:36.160547+0000","last_clean":"2024-09-17T03:13:36.160547+0000","last_became_active":"2024-09-17T03:13:36.158208+0000","last_became_peered":"2024-09-17T03:13:36.158208+0000","last_unstale":"2024-09-17T03:13:36.160547+0000","last_undegraded":"2024-09-17T03:13:36.160547+0000","last_fullsized":"2024-09-17T03:13:36.160547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:43.797527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.158436+0000","last_change":"2024-09-17T03:13:35.148924+0000","last_active":"2024-09-17T03:13:36.158436+0000","last_peered":"2024-09-17T03:13:36.158436+0000","last_clean":"2024-09-17T03:13:36.158436+0000","last_became_active":"2024-09-17T03:13:35.148637+0000","last_became_peered":"2024-09-17T03:13:35.148637+0000","last_unstale":"2024-09-17T03:13:36.158436+0000","last_undegraded":"2024-09-17T03:13:36.158436+0000","last_fullsized":"2024-09-17T03:13:36.158436+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:35.581909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.169086+0000","last_change":"2024-09-17T03:13:36.162958+0000","last_active":"2024-09-17T03:13:36.169086+0000","last_peered":"2024-09-17T03:13:36.169086+0000","last_clean":"2024-09-17T03:13:36.169086+0000","last_became_active":"2024-09-17T03:13:36.162656+0000","last_became_peered":"2024-09-17T03:13:36.162656+0000","last_unstale":"2024-09-17T03:13:36.169086+0000","last_undegraded":"2024-09-17T03:13:36.169086+0000","last_fullsized":"2024-09-17T03:13:36.169086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:05.566969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.154780+0000","last_change":"2024-09-17T03:13:35.142641+0000","last_active":"2024-09-17T03:13:36.154780+0000","last_peered":"2024-09-17T03:13:36.154780+0000","last_clean":"2024-09-17T03:13:36.154780+0000","last_became_active":"2024-09-17T03:13:35.142331+0000","last_became_peered":"2024-09-17T03:13:35.142331+0000","last_unstale":"2024-09-17T03:13:36.154780+0000","last_undegraded":"2024-09-17T03:13:36.154780+0000","last_fullsized":"2024-09-17T03:13:36.154780+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:06.927325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172373+0000","last_change":"2024-09-17T03:13:36.167894+0000","last_active":"2024-09-17T03:13:36.172373+0000","last_peered":"2024-09-17T03:13:36.172373+0000","last_clean":"2024-09-17T03:13:36.172373+0000","last_became_active":"2024-09-17T03:13:36.167509+0000","last_became_peered":"2024-09-17T03:13:36.167509+0000","last_unstale":"2024-09-17T03:13:36.172373+0000","last_undegraded":"2024-09-17T03:13:36.172373+0000","last_fullsized":"2024-09-17T03:13:36.172373+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:24.063918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275150+0000","last_change":"2024-09-17T03:13:35.150284+0000","last_active":"2024-09-17T03:13:37.275150+0000","last_peered":"2024-09-17T03:13:37.275150+0000","last_clean":"2024-09-17T03:13:37.275150+0000","last_became_active":"2024-09-17T03:13:35.149842+0000","last_became_peered":"2024-09-17T03:13:35.149842+0000","last_unstale":"2024-09-17T03:13:37.275150+0000","last_undegraded":"2024-09-17T03:13:37.275150+0000","last_fullsized":"2024-09-17T03:13:37.275150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:04.403550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174824+0000","last_change":"2024-09-17T03:13:36.169746+0000","last_active":"2024-09-17T03:13:36.174824+0000","last_peered":"2024-09-17T03:13:36.174824+0000","last_clean":"2024-09-17T03:13:36.174824+0000","last_became_active":"2024-09-17T03:13:36.169430+0000","last_became_peered":"2024-09-17T03:13:36.169430+0000","last_unstale":"2024-09-17T03:13:36.174824+0000","last_undegraded":"2024-09-17T03:13:36.174824+0000","last_fullsized":"2024-09-17T03:13:36.174824+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:35.192731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150221+0000","last_change":"2024-09-17T03:13:35.145283+0000","last_active":"2024-09-17T03:13:36.150221+0000","last_peered":"2024-09-17T03:13:36.150221+0000","last_clean":"2024-09-17T03:13:36.150221+0000","last_became_active":"2024-09-17T03:13:35.144986+0000","last_became_peered":"2024-09-17T03:13:35.144986+0000","last_unstale":"2024-09-17T03:13:36.150221+0000","last_undegraded":"2024-09-17T03:13:36.150221+0000","last_fullsized":"2024-09-17T03:13:36.150221+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:50.213189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168708+0000","last_change":"2024-09-17T03:13:36.164579+0000","last_active":"2024-09-17T03:13:36.168708+0000","last_peered":"2024-09-17T03:13:36.168708+0000","last_clean":"2024-09-17T03:13:36.168708+0000","last_became_active":"2024-09-17T03:13:36.164264+0000","last_became_peered":"2024-09-17T03:13:36.164264+0000","last_unstale":"2024-09-17T03:13:36.168708+0000","last_undegraded":"2024-09-17T03:13:36.168708+0000","last_fullsized":"2024-09-17T03:13:36.168708+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:04.660596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150709+0000","last_change":"2024-09-17T03:13:35.148815+0000","last_active":"2024-09-17T03:13:36.150709+0000","last_peered":"2024-09-17T03:13:36.150709+0000","last_clean":"2024-09-17T03:13:36.150709+0000","last_became_active":"2024-09-17T03:13:35.148507+0000","last_became_peered":"2024-09-17T03:13:35.148507+0000","last_unstale":"2024-09-17T03:13:36.150709+0000","last_undegraded":"2024-09-17T03:13:36.150709+0000","last_fullsized":"2024-09-17T03:13:36.150709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:12.011558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.169507+0000","last_change":"2024-09-17T03:13:36.161389+0000","last_active":"2024-09-17T03:13:36.169507+0000","last_peered":"2024-09-17T03:13:36.169507+0000","last_clean":"2024-09-17T03:13:36.169507+0000","last_became_active":"2024-09-17T03:13:36.161086+0000","last_became_peered":"2024-09-17T03:13:36.161086+0000","last_unstale":"2024-09-17T03:13:36.169507+0000","last_undegraded":"2024-09-17T03:13:36.169507+0000","last_fullsized":"2024-09-17T03:13:36.169507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:46.792762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150388+0000","last_change":"2024-09-17T03:13:35.146844+0000","last_active":"2024-09-17T03:13:36.150388+0000","last_peered":"2024-09-17T03:13:36.150388+0000","last_clean":"2024-09-17T03:13:36.150388+0000","last_became_active":"2024-09-17T03:13:35.146239+0000","last_became_peered":"2024-09-17T03:13:35.146239+0000","last_unstale":"2024-09-17T03:13:36.150388+0000","last_undegraded":"2024-09-17T03:13:36.150388+0000","last_fullsized":"2024-09-17T03:13:36.150388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:16.862049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174913+0000","last_change":"2024-09-17T03:13:36.169810+0000","last_active":"2024-09-17T03:13:36.174913+0000","last_peered":"2024-09-17T03:13:36.174913+0000","last_clean":"2024-09-17T03:13:36.174913+0000","last_became_active":"2024-09-17T03:13:36.169472+0000","last_became_peered":"2024-09-17T03:13:36.169472+0000","last_unstale":"2024-09-17T03:13:36.174913+0000","last_undegraded":"2024-09-17T03:13:36.174913+0000","last_fullsized":"2024-09-17T03:13:36.174913+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:34.833721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150452+0000","last_change":"2024-09-17T03:13:35.149436+0000","last_active":"2024-09-17T03:13:36.150452+0000","last_peered":"2024-09-17T03:13:36.150452+0000","last_clean":"2024-09-17T03:13:36.150452+0000","last_became_active":"2024-09-17T03:13:35.147481+0000","last_became_peered":"2024-09-17T03:13:35.147481+0000","last_unstale":"2024-09-17T03:13:36.150452+0000","last_undegraded":"2024-09-17T03:13:36.150452+0000","last_fullsized":"2024-09-17T03:13:36.150452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:09.546632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160538+0000","last_change":"2024-09-17T03:13:36.158743+0000","last_active":"2024-09-17T03:13:36.160538+0000","last_peered":"2024-09-17T03:13:36.160538+0000","last_clean":"2024-09-17T03:13:36.160538+0000","last_became_active":"2024-09-17T03:13:36.158441+0000","last_became_peered":"2024-09-17T03:13:36.158441+0000","last_unstale":"2024-09-17T03:13:36.160538+0000","last_undegraded":"2024-09-17T03:13:36.160538+0000","last_fullsized":"2024-09-17T03:13:36.160538+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:51.574328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160954+0000","last_change":"2024-09-17T03:13:35.145764+0000","last_active":"2024-09-17T03:13:36.160954+0000","last_peered":"2024-09-17T03:13:36.160954+0000","last_clean":"2024-09-17T03:13:36.160954+0000","last_became_active":"2024-09-17T03:13:35.145453+0000","last_became_peered":"2024-09-17T03:13:35.145453+0000","last_unstale":"2024-09-17T03:13:36.160954+0000","last_undegraded":"2024-09-17T03:13:36.160954+0000","last_fullsized":"2024-09-17T03:13:36.160954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:04.680766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2024-09-17T03:13:36.157325+0000","last_change":"2024-09-17T03:13:36.157325+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:36.157325+0000","last_undegraded":"2024-09-17T03:13:36.157325+0000","last_fullsized":"2024-09-17T03:13:36.157325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.154152+0000","last_change":"2024-09-17T03:13:35.149928+0000","last_active":"2024-09-17T03:13:36.154152+0000","last_peered":"2024-09-17T03:13:36.154152+0000","last_clean":"2024-09-17T03:13:36.154152+0000","last_became_active":"2024-09-17T03:13:35.149571+0000","last_became_peered":"2024-09-17T03:13:35.149571+0000","last_unstale":"2024-09-17T03:13:36.154152+0000","last_undegraded":"2024-09-17T03:13:36.154152+0000","last_fullsized":"2024-09-17T03:13:36.154152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:32.720660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171470+0000","last_change":"2024-09-17T03:13:36.166632+0000","last_active":"2024-09-17T03:13:36.171470+0000","last_peered":"2024-09-17T03:13:36.171470+0000","last_clean":"2024-09-17T03:13:36.171470+0000","last_became_active":"2024-09-17T03:13:36.166308+0000","last_became_peered":"2024-09-17T03:13:36.166308+0000","last_unstale":"2024-09-17T03:13:36.171470+0000","last_undegraded":"2024-09-17T03:13:36.171470+0000","last_fullsized":"2024-09-17T03:13:36.171470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:07.609432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150305+0000","last_change":"2024-09-17T03:13:35.148824+0000","last_active":"2024-09-17T03:13:36.150305+0000","last_peered":"2024-09-17T03:13:36.150305+0000","last_clean":"2024-09-17T03:13:36.150305+0000","last_became_active":"2024-09-17T03:13:35.148417+0000","last_became_peered":"2024-09-17T03:13:35.148417+0000","last_unstale":"2024-09-17T03:13:36.150305+0000","last_undegraded":"2024-09-17T03:13:36.150305+0000","last_fullsized":"2024-09-17T03:13:36.150305+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:58.224149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171614+0000","last_change":"2024-09-17T03:13:36.163897+0000","last_active":"2024-09-17T03:13:36.171614+0000","last_peered":"2024-09-17T03:13:36.171614+0000","last_clean":"2024-09-17T03:13:36.171614+0000","last_became_active":"2024-09-17T03:13:36.163275+0000","last_became_peered":"2024-09-17T03:13:36.163275+0000","last_unstale":"2024-09-17T03:13:36.171614+0000","last_undegraded":"2024-09-17T03:13:36.171614+0000","last_fullsized":"2024-09-17T03:13:36.171614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:37.972855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.154338+0000","last_change":"2024-09-17T03:13:35.142421+0000","last_active":"2024-09-17T03:13:36.154338+0000","last_peered":"2024-09-17T03:13:36.154338+0000","last_clean":"2024-09-17T03:13:36.154338+0000","last_became_active":"2024-09-17T03:13:35.142113+0000","last_became_peered":"2024-09-17T03:13:35.142113+0000","last_unstale":"2024-09-17T03:13:36.154338+0000","last_undegraded":"2024-09-17T03:13:36.154338+0000","last_fullsized":"2024-09-17T03:13:36.154338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:12.371249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173952+0000","last_change":"2024-09-17T03:13:36.166539+0000","last_active":"2024-09-17T03:13:36.173952+0000","last_peered":"2024-09-17T03:13:36.173952+0000","last_clean":"2024-09-17T03:13:36.173952+0000","last_became_active":"2024-09-17T03:13:36.166189+0000","last_became_peered":"2024-09-17T03:13:36.166189+0000","last_unstale":"2024-09-17T03:13:36.173952+0000","last_undegraded":"2024-09-17T03:13:36.173952+0000","last_fullsized":"2024-09-17T03:13:36.173952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:22.963501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"81'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.155281+0000","last_change":"2024-09-17T03:13:35.148171+0000","last_active":"2024-09-17T03:13:36.155281+0000","last_peered":"2024-09-17T03:13:36.155281+0000","last_clean":"2024-09-17T03:13:36.155281+0000","last_became_active":"2024-09-17T03:13:35.147822+0000","last_became_peered":"2024-09-17T03:13:35.147822+0000","last_unstale":"2024-09-17T03:13:36.155281+0000","last_undegraded":"2024-09-17T03:13:36.155281+0000","last_fullsized":"2024-09-17T03:13:36.155281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:17.971173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":216,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.153800+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:13:36.153800+0000","last_peered":"2024-09-17T03:13:36.153800+0000","last_clean":"2024-09-17T03:13:36.153800+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:13:36.153800+0000","last_undegraded":"2024-09-17T03:13:36.153800+0000","last_fullsized":"2024-09-17T03:13:36.153800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":1470,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509508,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28564,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343276,"statfs":{"total":96636764160,"available":96607514624,"internally_reserved":0,"allocated":1568768,"data_stored":1003684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509508,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":974848,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509507,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":974848,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509508,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":974848,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":974848,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":974848,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509508,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1568768,"data_stored":1003684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1011712,"data_stored":428003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:13:39.880 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3c is not active+clean 2024-09-17T03:13:39.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 81, 'state': 'creating+activating', 'last_fresh': '2024-09-17T03:13:36.156096+0000', 'last_change': '2024-09-17T03:13:36.156096+0000', 'last_active': '2024-09-17T03:13:35.124535+0000', 'last_peered': '2024-09-17T03:13:35.124535+0000', 'last_clean': '2024-09-17T03:13:35.124535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:13:36.156096+0000', 'last_undegraded': '2024-09-17T03:13:36.156096+0000', 'last_fullsized': '2024-09-17T03:13:36.156096+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:13:35.124535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:13:35.124535+0000', 'last_clean_scrub_stamp': '2024-09-17T03:13:35.124535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': ['2', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T03:13:39.881 INFO:tasks.ceph.ceph_manager.ceph:PG 13.14 is not active+clean 2024-09-17T03:13:39.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 81, 'state': 'creating+activating', 'last_fresh': '2024-09-17T03:13:36.157315+0000', 'last_change': '2024-09-17T03:13:36.157315+0000', 'last_active': '2024-09-17T03:13:35.124535+0000', 'last_peered': '2024-09-17T03:13:35.124535+0000', 'last_clean': '2024-09-17T03:13:35.124535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:13:36.157315+0000', 'last_undegraded': '2024-09-17T03:13:36.157315+0000', 'last_fullsized': '2024-09-17T03:13:36.157315+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:13:35.124535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:13:35.124535+0000', 'last_clean_scrub_stamp': '2024-09-17T03:13:35.124535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': ['0', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:13:39.881 INFO:tasks.ceph.ceph_manager.ceph:PG 13.15 is not active+clean 2024-09-17T03:13:39.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 81, 'state': 'creating+activating', 'last_fresh': '2024-09-17T03:13:36.161033+0000', 'last_change': '2024-09-17T03:13:36.161033+0000', 'last_active': '2024-09-17T03:13:35.124535+0000', 'last_peered': '2024-09-17T03:13:35.124535+0000', 'last_clean': '2024-09-17T03:13:35.124535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:13:36.161033+0000', 'last_undegraded': '2024-09-17T03:13:36.161033+0000', 'last_fullsized': '2024-09-17T03:13:36.161033+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:13:35.124535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:13:35.124535+0000', 'last_clean_scrub_stamp': '2024-09-17T03:13:35.124535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': ['4', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T03:13:39.881 INFO:tasks.ceph.ceph_manager.ceph:PG 13.12 is not active+clean 2024-09-17T03:13:39.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 81, 'state': 'creating+activating', 'last_fresh': '2024-09-17T03:13:36.156718+0000', 'last_change': '2024-09-17T03:13:36.156718+0000', 'last_active': '2024-09-17T03:13:35.124535+0000', 'last_peered': '2024-09-17T03:13:35.124535+0000', 'last_clean': '2024-09-17T03:13:35.124535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:13:36.156718+0000', 'last_undegraded': '2024-09-17T03:13:36.156718+0000', 'last_fullsized': '2024-09-17T03:13:36.156718+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:13:35.124535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:13:35.124535+0000', 'last_clean_scrub_stamp': '2024-09-17T03:13:35.124535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': ['0', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:13:39.881 INFO:tasks.ceph.ceph_manager.ceph:PG 13.3 is not active+clean 2024-09-17T03:13:39.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 81, 'state': 'creating+activating', 'last_fresh': '2024-09-17T03:13:36.157325+0000', 'last_change': '2024-09-17T03:13:36.157325+0000', 'last_active': '2024-09-17T03:13:35.124535+0000', 'last_peered': '2024-09-17T03:13:35.124535+0000', 'last_clean': '2024-09-17T03:13:35.124535+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T03:13:36.157325+0000', 'last_undegraded': '2024-09-17T03:13:36.157325+0000', 'last_fullsized': '2024-09-17T03:13:36.157325+0000', 'mapping_epoch': 80, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 80, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T03:13:35.124535+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T03:13:35.124535+0000', 'last_clean_scrub_stamp': '2024-09-17T03:13:35.124535+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': ['0', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T03:13:39.882 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:13:40.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.027+0000 7fedf2a63640 1 -- 172.21.15.78:0/151450664 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fedec0af3c0 msgr2=0x7fedec0b40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:40.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.027+0000 7fedf2a63640 1 --2- 172.21.15.78:0/151450664 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fedec0af3c0 0x7fedec0b40b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009830 tx=0x7fedd402a510 comp rx=0 tx=0).stop 2024-09-17T03:13:40.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.027+0000 7fedf2a63640 1 -- 172.21.15.78:0/151450664 shutdown_connections 2024-09-17T03:13:40.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.027+0000 7fedf2a63640 1 --2- 172.21.15.78:0/151450664 >> v2:172.21.15.193:3300/0 conn(0x7fedec0ccb50 0x7fedec0ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.027+0000 7fedf2a63640 1 --2- 172.21.15.78:0/151450664 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fedec0af3c0 0x7fedec0b40b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.027+0000 7fedf2a63640 1 -- 172.21.15.78:0/151450664 >> 172.21.15.78:0/151450664 conn(0x7fedec06d7d0 msgr2=0x7fedec0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:40.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.027+0000 7fedf2a63640 1 -- 172.21.15.78:0/151450664 shutdown_connections 2024-09-17T03:13:40.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.027+0000 7fedf2a63640 1 -- 172.21.15.78:0/151450664 wait complete. 2024-09-17T03:13:40.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.029+0000 7fedf2a63640 1 Processor -- start 2024-09-17T03:13:40.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.029+0000 7fedf2a63640 1 -- start start 2024-09-17T03:13:40.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.030+0000 7fedf2a63640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedec0af3c0 0x7fedec09bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:40.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.030+0000 7fedf2a63640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fedec0cc1e0 0x7fedec09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:40.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.030+0000 7fedf2a63640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fedec0ccb50 0x7fedec154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:40.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.030+0000 7fedf2a63640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fedec153520 con 0x7fedec0af3c0 2024-09-17T03:13:40.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.030+0000 7fedf2a63640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fedec1533a0 con 0x7fedec0cc1e0 2024-09-17T03:13:40.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.030+0000 7fedf2a63640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fedec1536a0 con 0x7fedec0ccb50 2024-09-17T03:13:40.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.030+0000 7fedebfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedec0af3c0 0x7fedec09bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:40.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.030+0000 7fedebfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedec0af3c0 0x7fedec09bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39524/0 (socket says 172.21.15.78:39524) 2024-09-17T03:13:40.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.030+0000 7fedebfff640 1 -- 172.21.15.78:0/2078600589 learned_addr learned my addr 172.21.15.78:0/2078600589 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:40.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.030+0000 7fedf1000640 1 --2- 172.21.15.78:0/2078600589 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fedec0ccb50 0x7fedec154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:40.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.030+0000 7fede3fff640 1 --2- 172.21.15.78:0/2078600589 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fedec0cc1e0 0x7fedec09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:40.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.031+0000 7fedebfff640 1 -- 172.21.15.78:0/2078600589 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fedec0ccb50 msgr2=0x7fedec154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:40.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.031+0000 7fedebfff640 1 --2- 172.21.15.78:0/2078600589 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fedec0ccb50 0x7fedec154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.031+0000 7fedebfff640 1 -- 172.21.15.78:0/2078600589 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fedec0cc1e0 msgr2=0x7fedec09aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:40.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.031+0000 7fedebfff640 1 --2- 172.21.15.78:0/2078600589 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fedec0cc1e0 0x7fedec09aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.031+0000 7fedebfff640 1 -- 172.21.15.78:0/2078600589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedec09af70 con 0x7fedec0af3c0 2024-09-17T03:13:40.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.031+0000 7fedebfff640 1 --2- 172.21.15.78:0/2078600589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedec0af3c0 0x7fedec09bf30 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7feddc00c730 tx=0x7feddc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:40.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.031+0000 7fede97fa640 1 -- 172.21.15.78:0/2078600589 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc016020 con 0x7fedec0af3c0 2024-09-17T03:13:40.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.031+0000 7fedf2a63640 1 -- 172.21.15.78:0/2078600589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedec1f4400 con 0x7fedec0af3c0 2024-09-17T03:13:40.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.031+0000 7fede97fa640 1 -- 172.21.15.78:0/2078600589 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feddc00a950 con 0x7fedec0af3c0 2024-09-17T03:13:40.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.031+0000 7fede97fa640 1 -- 172.21.15.78:0/2078600589 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc00ada0 con 0x7fedec0af3c0 2024-09-17T03:13:40.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.031+0000 7fedf2a63640 1 -- 172.21.15.78:0/2078600589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedec154790 con 0x7fedec0af3c0 2024-09-17T03:13:40.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.032+0000 7fedf2a63640 1 -- 172.21.15.78:0/2078600589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedec153bc0 con 0x7fedec0af3c0 2024-09-17T03:13:40.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.033+0000 7fede97fa640 1 -- 172.21.15.78:0/2078600589 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feddc019020 con 0x7fedec0af3c0 2024-09-17T03:13:40.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.033+0000 7fede97fa640 1 --2- 172.21.15.78:0/2078600589 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fedcc078bc0 0x7fedcc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:40.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.033+0000 7fede97fa640 1 -- 172.21.15.78:0/2078600589 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7feddc09ac90 con 0x7fedec0af3c0 2024-09-17T03:13:40.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.033+0000 7fede3fff640 1 --2- 172.21.15.78:0/2078600589 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fedcc078bc0 0x7fedcc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:40.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.034+0000 7fede3fff640 1 --2- 172.21.15.78:0/2078600589 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fedcc078bc0 0x7fedcc07b0d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fedd4034000 tx=0x7fedd4004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:40.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.037+0000 7fede97fa640 1 -- 172.21.15.78:0/2078600589 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feddc020020 con 0x7fedec0af3c0 2024-09-17T03:13:40.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.284+0000 7fedf2a63640 1 -- 172.21.15.78:0/2078600589 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fedec06ddf0 con 0x7fedec0af3c0 2024-09-17T03:13:40.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.284+0000 7fede97fa640 1 -- 172.21.15.78:0/2078600589 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1564 (secure 0 0 0) 0x7fedec0cd4a0 con 0x7fedec0af3c0 2024-09-17T03:13:40.283 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:40.283 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":337,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":82,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":92},{"state_name":"creating+activating","count":5}],"num_pgs":97,"num_pools":3,"num_objects":18,"data_bytes":591838,"bytes_used":251764736,"bytes_avail":772842348544,"bytes_total":773094113280,"inactive_pgs_ratio":0.051546391099691391,"write_bytes_sec":2621,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":76,"btime":"2024-09-17T03:13:38:163162+0000","id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7428}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-17T03:12:31.185413+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:13:40.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.286+0000 7fedf2a63640 1 -- 172.21.15.78:0/2078600589 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fedcc078bc0 msgr2=0x7fedcc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:40.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.286+0000 7fedf2a63640 1 --2- 172.21.15.78:0/2078600589 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fedcc078bc0 0x7fedcc07b0d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fedd4034000 tx=0x7fedd4004730 comp rx=0 tx=0).stop 2024-09-17T03:13:40.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.286+0000 7fedf2a63640 1 -- 172.21.15.78:0/2078600589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedec0af3c0 msgr2=0x7fedec09bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:40.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.286+0000 7fedf2a63640 1 --2- 172.21.15.78:0/2078600589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedec0af3c0 0x7fedec09bf30 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7feddc00c730 tx=0x7feddc00cbf0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.286+0000 7fedf2a63640 1 -- 172.21.15.78:0/2078600589 shutdown_connections 2024-09-17T03:13:40.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.286+0000 7fedf2a63640 1 --2- 172.21.15.78:0/2078600589 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fedec0ccb50 0x7fedec154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.286+0000 7fedf2a63640 1 --2- 172.21.15.78:0/2078600589 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fedcc078bc0 0x7fedcc07b0d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.286+0000 7fedf2a63640 1 --2- 172.21.15.78:0/2078600589 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fedec0cc1e0 0x7fedec09aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.286+0000 7fedf2a63640 1 --2- 172.21.15.78:0/2078600589 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fedec0af3c0 0x7fedec09bf30 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.286+0000 7fedf2a63640 1 -- 172.21.15.78:0/2078600589 >> 172.21.15.78:0/2078600589 conn(0x7fedec06d7d0 msgr2=0x7fedec1526d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:40.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.286+0000 7fedf2a63640 1 -- 172.21.15.78:0/2078600589 shutdown_connections 2024-09-17T03:13:40.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.286+0000 7fedf2a63640 1 -- 172.21.15.78:0/2078600589 wait complete. 2024-09-17T03:13:40.297 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T03:13:40.297 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:13:40.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.409+0000 7feffbc4d640 1 -- 172.21.15.78:0/225336629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff40cf160 msgr2=0x7feff40ca9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.409+0000 7feffbc4d640 1 --2- 172.21.15.78:0/225336629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff40cf160 0x7feff40ca9a0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7feff4071270 tx=0x7fefe402a560 comp rx=0 tx=0).stop 2024-09-17T03:13:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.409+0000 7feffbc4d640 1 -- 172.21.15.78:0/225336629 shutdown_connections 2024-09-17T03:13:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.409+0000 7feffbc4d640 1 --2- 172.21.15.78:0/225336629 >> v2:172.21.15.193:3300/0 conn(0x7feff40cf570 0x7feff40caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.409+0000 7feffbc4d640 1 --2- 172.21.15.78:0/225336629 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff40cf160 0x7feff40ca9a0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.409+0000 7feffbc4d640 1 --2- 172.21.15.78:0/225336629 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feff40cfb00 0x7feff415bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.409+0000 7feffbc4d640 1 -- 172.21.15.78:0/225336629 >> 172.21.15.78:0/225336629 conn(0x7feff40b1cb0 msgr2=0x7feff40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.409+0000 7feffbc4d640 1 -- 172.21.15.78:0/225336629 shutdown_connections 2024-09-17T03:13:40.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.410+0000 7feffbc4d640 1 -- 172.21.15.78:0/225336629 wait complete. 2024-09-17T03:13:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.411+0000 7feffbc4d640 1 Processor -- start 2024-09-17T03:13:40.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.411+0000 7feffbc4d640 1 -- start start 2024-09-17T03:13:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feffbc4d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feff40cf160 0x7feff415a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feffbc4d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feff40cf570 0x7feff409b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feffbc4d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff40cfb00 0x7feff409b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feffbc4d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feff40ccf30 con 0x7feff40cfb00 2024-09-17T03:13:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feffbc4d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7feff40ccdb0 con 0x7feff40cf160 2024-09-17T03:13:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feffbc4d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7feff40cd0b0 con 0x7feff40cf570 2024-09-17T03:13:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feffa1ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff40cfb00 0x7feff409b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feffa1ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff40cfb00 0x7feff409b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39552/0 (socket says 172.21.15.78:39552) 2024-09-17T03:13:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feffa1ea640 1 -- 172.21.15.78:0/3391763934 learned_addr learned my addr 172.21.15.78:0/3391763934 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:40.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feff99e9640 1 --2- 172.21.15.78:0/3391763934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feff40cf160 0x7feff415a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feff91e8640 1 --2- 172.21.15.78:0/3391763934 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feff40cf570 0x7feff409b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feffa1ea640 1 -- 172.21.15.78:0/3391763934 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feff40cf570 msgr2=0x7feff409b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feffa1ea640 1 --2- 172.21.15.78:0/3391763934 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feff40cf570 0x7feff409b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feffa1ea640 1 -- 172.21.15.78:0/3391763934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feff40cf160 msgr2=0x7feff415a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feffa1ea640 1 --2- 172.21.15.78:0/3391763934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feff40cf160 0x7feff415a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feffa1ea640 1 -- 172.21.15.78:0/3391763934 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff41568d0 con 0x7feff40cfb00 2024-09-17T03:13:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feff91e8640 1 --2- 172.21.15.78:0/3391763934 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feff40cf570 0x7feff409b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feff99e9640 1 --2- 172.21.15.78:0/3391763934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feff40cf160 0x7feff415a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:40.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feffa1ea640 1 --2- 172.21.15.78:0/3391763934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff40cfb00 0x7feff409b680 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fefec00e8e0 tx=0x7fefec00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:40.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7fefea7fc640 1 -- 172.21.15.78:0/3391763934 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec004d20 con 0x7feff40cfb00 2024-09-17T03:13:40.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7fefea7fc640 1 -- 172.21.15.78:0/3391763934 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefec00ca60 con 0x7feff40cfb00 2024-09-17T03:13:40.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7fefea7fc640 1 -- 172.21.15.78:0/3391763934 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec005020 con 0x7feff40cfb00 2024-09-17T03:13:40.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feffbc4d640 1 -- 172.21.15.78:0/3391763934 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff4156bb0 con 0x7feff40cfb00 2024-09-17T03:13:40.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.413+0000 7feffbc4d640 1 -- 172.21.15.78:0/3391763934 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff409d6d0 con 0x7feff40cfb00 2024-09-17T03:13:40.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.414+0000 7feffbc4d640 1 -- 172.21.15.78:0/3391763934 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff409d220 con 0x7feff40cfb00 2024-09-17T03:13:40.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.415+0000 7fefea7fc640 1 -- 172.21.15.78:0/3391763934 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fefec0051c0 con 0x7feff40cfb00 2024-09-17T03:13:40.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.415+0000 7fefea7fc640 1 --2- 172.21.15.78:0/3391763934 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fefd8078b90 0x7fefd807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:40.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.416+0000 7fefea7fc640 1 -- 172.21.15.78:0/3391763934 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fefec09b6c0 con 0x7feff40cfb00 2024-09-17T03:13:40.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.416+0000 7feff99e9640 1 --2- 172.21.15.78:0/3391763934 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fefd8078b90 0x7fefd807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:40.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.416+0000 7feff99e9640 1 --2- 172.21.15.78:0/3391763934 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fefd8078b90 0x7fefd807b0a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feff0005fd0 tx=0x7feff000f360 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:40.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.420+0000 7fefea7fc640 1 -- 172.21.15.78:0/3391763934 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fefec016030 con 0x7feff40cfb00 2024-09-17T03:13:40.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.590+0000 7feffbc4d640 1 -- 172.21.15.78:0/3391763934 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feff415bf20 con 0x7fefd8078b90 2024-09-17T03:13:40.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.595+0000 7fefea7fc640 1 -- 172.21.15.78:0/3391763934 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251672 (secure 0 0 0) 0x7feff415bf20 con 0x7fefd8078b90 2024-09-17T03:13:40.597 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:40.598 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:13:40.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.598+0000 7feffbc4d640 1 -- 172.21.15.78:0/3391763934 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fefd8078b90 msgr2=0x7fefd807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:40.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.598+0000 7feffbc4d640 1 --2- 172.21.15.78:0/3391763934 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fefd8078b90 0x7fefd807b0a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7feff0005fd0 tx=0x7feff000f360 comp rx=0 tx=0).stop 2024-09-17T03:13:40.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.598+0000 7feffbc4d640 1 -- 172.21.15.78:0/3391763934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff40cfb00 msgr2=0x7feff409b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:40.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.598+0000 7feffbc4d640 1 --2- 172.21.15.78:0/3391763934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff40cfb00 0x7feff409b680 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fefec00e8e0 tx=0x7fefec00eda0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.598+0000 7feffbc4d640 1 -- 172.21.15.78:0/3391763934 shutdown_connections 2024-09-17T03:13:40.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.598+0000 7feffbc4d640 1 --2- 172.21.15.78:0/3391763934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feff40cfb00 0x7feff409b680 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.598+0000 7feffbc4d640 1 --2- 172.21.15.78:0/3391763934 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feff40cf570 0x7feff409b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.598+0000 7feffbc4d640 1 --2- 172.21.15.78:0/3391763934 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fefd8078b90 0x7fefd807b0a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.598+0000 7feffbc4d640 1 --2- 172.21.15.78:0/3391763934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feff40cf160 0x7feff415a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:40.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.598+0000 7feffbc4d640 1 -- 172.21.15.78:0/3391763934 >> 172.21.15.78:0/3391763934 conn(0x7feff40b1cb0 msgr2=0x7feff40d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:40.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.598+0000 7feffbc4d640 1 -- 172.21.15.78:0/3391763934 shutdown_connections 2024-09-17T03:13:40.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:40.598+0000 7feffbc4d640 1 -- 172.21.15.78:0/3391763934 wait complete. 2024-09-17T03:13:40.608 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2024-09-17T03:13:39.203452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591838,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":131,"num_write_kb":1641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":43,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":245864,"kb_used_data":8812,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754728856,"statfs":{"total":773094113280,"available":772842348544,"internally_reserved":0,"allocated":9023488,"data_stored":4501951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":242535986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1470,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.077822"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171675+0000","last_change":"2024-09-17T03:13:36.164503+0000","last_active":"2024-09-17T03:13:36.171675+0000","last_peered":"2024-09-17T03:13:36.171675+0000","last_clean":"2024-09-17T03:13:36.171675+0000","last_became_active":"2024-09-17T03:13:36.164189+0000","last_became_peered":"2024-09-17T03:13:36.164189+0000","last_unstale":"2024-09-17T03:13:36.171675+0000","last_undegraded":"2024-09-17T03:13:36.171675+0000","last_fullsized":"2024-09-17T03:13:36.171675+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:24.415909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168002+0000","last_change":"2024-09-17T03:13:36.163785+0000","last_active":"2024-09-17T03:13:36.168002+0000","last_peered":"2024-09-17T03:13:36.168002+0000","last_clean":"2024-09-17T03:13:36.168002+0000","last_became_active":"2024-09-17T03:13:36.163491+0000","last_became_peered":"2024-09-17T03:13:36.163491+0000","last_unstale":"2024-09-17T03:13:36.168002+0000","last_undegraded":"2024-09-17T03:13:36.168002+0000","last_fullsized":"2024-09-17T03:13:36.168002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:16.451197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.166961+0000","last_change":"2024-09-17T03:13:36.158610+0000","last_active":"2024-09-17T03:13:36.166961+0000","last_peered":"2024-09-17T03:13:36.166961+0000","last_clean":"2024-09-17T03:13:36.166961+0000","last_became_active":"2024-09-17T03:13:36.158308+0000","last_became_peered":"2024-09-17T03:13:36.158308+0000","last_unstale":"2024-09-17T03:13:36.166961+0000","last_undegraded":"2024-09-17T03:13:36.166961+0000","last_fullsized":"2024-09-17T03:13:36.166961+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:54.875053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2024-09-17T03:13:36.156096+0000","last_change":"2024-09-17T03:13:36.156096+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:36.156096+0000","last_undegraded":"2024-09-17T03:13:36.156096+0000","last_fullsized":"2024-09-17T03:13:36.156096+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":["2","1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174907+0000","last_change":"2024-09-17T03:13:36.171195+0000","last_active":"2024-09-17T03:13:36.174907+0000","last_peered":"2024-09-17T03:13:36.174907+0000","last_clean":"2024-09-17T03:13:36.174907+0000","last_became_active":"2024-09-17T03:13:36.170849+0000","last_became_peered":"2024-09-17T03:13:36.170849+0000","last_unstale":"2024-09-17T03:13:36.174907+0000","last_undegraded":"2024-09-17T03:13:36.174907+0000","last_fullsized":"2024-09-17T03:13:36.174907+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:54.973430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168655+0000","last_change":"2024-09-17T03:13:36.164233+0000","last_active":"2024-09-17T03:13:36.168655+0000","last_peered":"2024-09-17T03:13:36.168655+0000","last_clean":"2024-09-17T03:13:36.168655+0000","last_became_active":"2024-09-17T03:13:36.163925+0000","last_became_peered":"2024-09-17T03:13:36.163925+0000","last_unstale":"2024-09-17T03:13:36.168655+0000","last_undegraded":"2024-09-17T03:13:36.168655+0000","last_fullsized":"2024-09-17T03:13:36.168655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:24.380925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174980+0000","last_change":"2024-09-17T03:13:36.171062+0000","last_active":"2024-09-17T03:13:36.174980+0000","last_peered":"2024-09-17T03:13:36.174980+0000","last_clean":"2024-09-17T03:13:36.174980+0000","last_became_active":"2024-09-17T03:13:36.170264+0000","last_became_peered":"2024-09-17T03:13:36.170264+0000","last_unstale":"2024-09-17T03:13:36.174980+0000","last_undegraded":"2024-09-17T03:13:36.174980+0000","last_fullsized":"2024-09-17T03:13:36.174980+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:44.954526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.159417+0000","last_change":"2024-09-17T03:13:36.154137+0000","last_active":"2024-09-17T03:13:36.159417+0000","last_peered":"2024-09-17T03:13:36.159417+0000","last_clean":"2024-09-17T03:13:36.159417+0000","last_became_active":"2024-09-17T03:13:36.153776+0000","last_became_peered":"2024-09-17T03:13:36.153776+0000","last_unstale":"2024-09-17T03:13:36.159417+0000","last_undegraded":"2024-09-17T03:13:36.159417+0000","last_fullsized":"2024-09-17T03:13:36.159417+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:54.973430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172327+0000","last_change":"2024-09-17T03:13:36.165365+0000","last_active":"2024-09-17T03:13:36.172327+0000","last_peered":"2024-09-17T03:13:36.172327+0000","last_clean":"2024-09-17T03:13:36.172327+0000","last_became_active":"2024-09-17T03:13:36.165047+0000","last_became_peered":"2024-09-17T03:13:36.165047+0000","last_unstale":"2024-09-17T03:13:36.172327+0000","last_undegraded":"2024-09-17T03:13:36.172327+0000","last_fullsized":"2024-09-17T03:13:36.172327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:35.013596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.163241+0000","last_change":"2024-09-17T03:13:36.158884+0000","last_active":"2024-09-17T03:13:36.163241+0000","last_peered":"2024-09-17T03:13:36.163241+0000","last_clean":"2024-09-17T03:13:36.163241+0000","last_became_active":"2024-09-17T03:13:36.157801+0000","last_became_peered":"2024-09-17T03:13:36.157801+0000","last_unstale":"2024-09-17T03:13:36.163241+0000","last_undegraded":"2024-09-17T03:13:36.163241+0000","last_fullsized":"2024-09-17T03:13:36.163241+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:34.514645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.165971+0000","last_change":"2024-09-17T03:13:36.159357+0000","last_active":"2024-09-17T03:13:36.165971+0000","last_peered":"2024-09-17T03:13:36.165971+0000","last_clean":"2024-09-17T03:13:36.165971+0000","last_became_active":"2024-09-17T03:13:36.159037+0000","last_became_peered":"2024-09-17T03:13:36.159037+0000","last_unstale":"2024-09-17T03:13:36.165971+0000","last_undegraded":"2024-09-17T03:13:36.165971+0000","last_fullsized":"2024-09-17T03:13:36.165971+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:10.901422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.162938+0000","last_change":"2024-09-17T03:13:36.157305+0000","last_active":"2024-09-17T03:13:36.162938+0000","last_peered":"2024-09-17T03:13:36.162938+0000","last_clean":"2024-09-17T03:13:36.162938+0000","last_became_active":"2024-09-17T03:13:36.156967+0000","last_became_peered":"2024-09-17T03:13:36.156967+0000","last_unstale":"2024-09-17T03:13:36.162938+0000","last_undegraded":"2024-09-17T03:13:36.162938+0000","last_fullsized":"2024-09-17T03:13:36.162938+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:46.504996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171798+0000","last_change":"2024-09-17T03:13:36.170755+0000","last_active":"2024-09-17T03:13:36.171798+0000","last_peered":"2024-09-17T03:13:36.171798+0000","last_clean":"2024-09-17T03:13:36.171798+0000","last_became_active":"2024-09-17T03:13:36.170436+0000","last_became_peered":"2024-09-17T03:13:36.170436+0000","last_unstale":"2024-09-17T03:13:36.171798+0000","last_undegraded":"2024-09-17T03:13:36.171798+0000","last_fullsized":"2024-09-17T03:13:36.171798+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:03.088723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.175020+0000","last_change":"2024-09-17T03:13:36.171144+0000","last_active":"2024-09-17T03:13:36.175020+0000","last_peered":"2024-09-17T03:13:36.175020+0000","last_clean":"2024-09-17T03:13:36.175020+0000","last_became_active":"2024-09-17T03:13:36.170849+0000","last_became_peered":"2024-09-17T03:13:36.170849+0000","last_unstale":"2024-09-17T03:13:36.175020+0000","last_undegraded":"2024-09-17T03:13:36.175020+0000","last_fullsized":"2024-09-17T03:13:36.175020+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:49.302326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275265+0000","last_change":"2024-09-17T03:13:36.161513+0000","last_active":"2024-09-17T03:13:37.275265+0000","last_peered":"2024-09-17T03:13:37.275265+0000","last_clean":"2024-09-17T03:13:37.275265+0000","last_became_active":"2024-09-17T03:13:36.161196+0000","last_became_peered":"2024-09-17T03:13:36.161196+0000","last_unstale":"2024-09-17T03:13:37.275265+0000","last_undegraded":"2024-09-17T03:13:37.275265+0000","last_fullsized":"2024-09-17T03:13:37.275265+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:11.223567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.164882+0000","last_change":"2024-09-17T03:13:36.159093+0000","last_active":"2024-09-17T03:13:36.164882+0000","last_peered":"2024-09-17T03:13:36.164882+0000","last_clean":"2024-09-17T03:13:36.164882+0000","last_became_active":"2024-09-17T03:13:36.158546+0000","last_became_peered":"2024-09-17T03:13:36.158546+0000","last_unstale":"2024-09-17T03:13:36.164882+0000","last_undegraded":"2024-09-17T03:13:36.164882+0000","last_fullsized":"2024-09-17T03:13:36.164882+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:44.382837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172830+0000","last_change":"2024-09-17T03:13:36.172719+0000","last_active":"2024-09-17T03:13:36.172830+0000","last_peered":"2024-09-17T03:13:36.172830+0000","last_clean":"2024-09-17T03:13:36.172830+0000","last_became_active":"2024-09-17T03:13:36.172362+0000","last_became_peered":"2024-09-17T03:13:36.172362+0000","last_unstale":"2024-09-17T03:13:36.172830+0000","last_undegraded":"2024-09-17T03:13:36.172830+0000","last_fullsized":"2024-09-17T03:13:36.172830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:43.797527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172392+0000","last_change":"2024-09-17T03:13:36.170457+0000","last_active":"2024-09-17T03:13:36.172392+0000","last_peered":"2024-09-17T03:13:36.172392+0000","last_clean":"2024-09-17T03:13:36.172392+0000","last_became_active":"2024-09-17T03:13:36.170155+0000","last_became_peered":"2024-09-17T03:13:36.170155+0000","last_unstale":"2024-09-17T03:13:36.172392+0000","last_undegraded":"2024-09-17T03:13:36.172392+0000","last_fullsized":"2024-09-17T03:13:36.172392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:16.330644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.167407+0000","last_change":"2024-09-17T03:13:36.167306+0000","last_active":"2024-09-17T03:13:36.167407+0000","last_peered":"2024-09-17T03:13:36.167407+0000","last_clean":"2024-09-17T03:13:36.167407+0000","last_became_active":"2024-09-17T03:13:36.167004+0000","last_became_peered":"2024-09-17T03:13:36.167004+0000","last_unstale":"2024-09-17T03:13:36.167407+0000","last_undegraded":"2024-09-17T03:13:36.167407+0000","last_fullsized":"2024-09-17T03:13:36.167407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:25.624815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.170731+0000","last_change":"2024-09-17T03:13:36.164087+0000","last_active":"2024-09-17T03:13:36.170731+0000","last_peered":"2024-09-17T03:13:36.170731+0000","last_clean":"2024-09-17T03:13:36.170731+0000","last_became_active":"2024-09-17T03:13:36.163793+0000","last_became_peered":"2024-09-17T03:13:36.163793+0000","last_unstale":"2024-09-17T03:13:36.170731+0000","last_undegraded":"2024-09-17T03:13:36.170731+0000","last_fullsized":"2024-09-17T03:13:36.170731+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:06:39.687980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172698+0000","last_change":"2024-09-17T03:13:36.170832+0000","last_active":"2024-09-17T03:13:36.172698+0000","last_peered":"2024-09-17T03:13:36.172698+0000","last_clean":"2024-09-17T03:13:36.172698+0000","last_became_active":"2024-09-17T03:13:36.170477+0000","last_became_peered":"2024-09-17T03:13:36.170477+0000","last_unstale":"2024-09-17T03:13:36.172698+0000","last_undegraded":"2024-09-17T03:13:36.172698+0000","last_fullsized":"2024-09-17T03:13:36.172698+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:54:50.642766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173666+0000","last_change":"2024-09-17T03:13:36.166922+0000","last_active":"2024-09-17T03:13:36.173666+0000","last_peered":"2024-09-17T03:13:36.173666+0000","last_clean":"2024-09-17T03:13:36.173666+0000","last_became_active":"2024-09-17T03:13:36.166609+0000","last_became_peered":"2024-09-17T03:13:36.166609+0000","last_unstale":"2024-09-17T03:13:36.173666+0000","last_undegraded":"2024-09-17T03:13:36.173666+0000","last_fullsized":"2024-09-17T03:13:36.173666+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:55.515484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171645+0000","last_change":"2024-09-17T03:13:36.164280+0000","last_active":"2024-09-17T03:13:36.171645+0000","last_peered":"2024-09-17T03:13:36.171645+0000","last_clean":"2024-09-17T03:13:36.171645+0000","last_became_active":"2024-09-17T03:13:36.163689+0000","last_became_peered":"2024-09-17T03:13:36.163689+0000","last_unstale":"2024-09-17T03:13:36.171645+0000","last_undegraded":"2024-09-17T03:13:36.171645+0000","last_fullsized":"2024-09-17T03:13:36.171645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:19.690392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.170927+0000","last_change":"2024-09-17T03:13:36.166970+0000","last_active":"2024-09-17T03:13:36.170927+0000","last_peered":"2024-09-17T03:13:36.170927+0000","last_clean":"2024-09-17T03:13:36.170927+0000","last_became_active":"2024-09-17T03:13:36.166665+0000","last_became_peered":"2024-09-17T03:13:36.166665+0000","last_unstale":"2024-09-17T03:13:36.170927+0000","last_undegraded":"2024-09-17T03:13:36.170927+0000","last_fullsized":"2024-09-17T03:13:36.170927+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:05.146731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.165529+0000","last_change":"2024-09-17T03:13:36.156703+0000","last_active":"2024-09-17T03:13:36.165529+0000","last_peered":"2024-09-17T03:13:36.165529+0000","last_clean":"2024-09-17T03:13:36.165529+0000","last_became_active":"2024-09-17T03:13:36.156367+0000","last_became_peered":"2024-09-17T03:13:36.156367+0000","last_unstale":"2024-09-17T03:13:36.165529+0000","last_undegraded":"2024-09-17T03:13:36.165529+0000","last_fullsized":"2024-09-17T03:13:36.165529+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:32:05.224377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168674+0000","last_change":"2024-09-17T03:13:36.166639+0000","last_active":"2024-09-17T03:13:36.168674+0000","last_peered":"2024-09-17T03:13:36.168674+0000","last_clean":"2024-09-17T03:13:36.168674+0000","last_became_active":"2024-09-17T03:13:36.166289+0000","last_became_peered":"2024-09-17T03:13:36.166289+0000","last_unstale":"2024-09-17T03:13:36.168674+0000","last_undegraded":"2024-09-17T03:13:36.168674+0000","last_fullsized":"2024-09-17T03:13:36.168674+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:38.480507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173441+0000","last_change":"2024-09-17T03:13:36.173311+0000","last_active":"2024-09-17T03:13:36.173441+0000","last_peered":"2024-09-17T03:13:36.173441+0000","last_clean":"2024-09-17T03:13:36.173441+0000","last_became_active":"2024-09-17T03:13:36.172541+0000","last_became_peered":"2024-09-17T03:13:36.172541+0000","last_unstale":"2024-09-17T03:13:36.173441+0000","last_undegraded":"2024-09-17T03:13:36.173441+0000","last_fullsized":"2024-09-17T03:13:36.173441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:24.380925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171475+0000","last_change":"2024-09-17T03:13:36.164574+0000","last_active":"2024-09-17T03:13:36.171475+0000","last_peered":"2024-09-17T03:13:36.171475+0000","last_clean":"2024-09-17T03:13:36.171475+0000","last_became_active":"2024-09-17T03:13:36.164233+0000","last_became_peered":"2024-09-17T03:13:36.164233+0000","last_unstale":"2024-09-17T03:13:36.171475+0000","last_undegraded":"2024-09-17T03:13:36.171475+0000","last_fullsized":"2024-09-17T03:13:36.171475+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:13.580635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.166364+0000","last_change":"2024-09-17T03:13:36.159680+0000","last_active":"2024-09-17T03:13:36.166364+0000","last_peered":"2024-09-17T03:13:36.166364+0000","last_clean":"2024-09-17T03:13:36.166364+0000","last_became_active":"2024-09-17T03:13:36.159385+0000","last_became_peered":"2024-09-17T03:13:36.159385+0000","last_unstale":"2024-09-17T03:13:36.166364+0000","last_undegraded":"2024-09-17T03:13:36.166364+0000","last_fullsized":"2024-09-17T03:13:36.166364+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:05.330405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174358+0000","last_change":"2024-09-17T03:13:36.174241+0000","last_active":"2024-09-17T03:13:36.174358+0000","last_peered":"2024-09-17T03:13:36.174358+0000","last_clean":"2024-09-17T03:13:36.174358+0000","last_became_active":"2024-09-17T03:13:36.173940+0000","last_became_peered":"2024-09-17T03:13:36.173940+0000","last_unstale":"2024-09-17T03:13:36.174358+0000","last_undegraded":"2024-09-17T03:13:36.174358+0000","last_fullsized":"2024-09-17T03:13:36.174358+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:31:27.192758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171890+0000","last_change":"2024-09-17T03:13:36.168808+0000","last_active":"2024-09-17T03:13:36.171890+0000","last_peered":"2024-09-17T03:13:36.171890+0000","last_clean":"2024-09-17T03:13:36.171890+0000","last_became_active":"2024-09-17T03:13:36.167241+0000","last_became_peered":"2024-09-17T03:13:36.167241+0000","last_unstale":"2024-09-17T03:13:36.171890+0000","last_undegraded":"2024-09-17T03:13:36.171890+0000","last_fullsized":"2024-09-17T03:13:36.171890+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:29:02.497727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172893+0000","last_change":"2024-09-17T03:13:36.167980+0000","last_active":"2024-09-17T03:13:36.172893+0000","last_peered":"2024-09-17T03:13:36.172893+0000","last_clean":"2024-09-17T03:13:36.172893+0000","last_became_active":"2024-09-17T03:13:36.167284+0000","last_became_peered":"2024-09-17T03:13:36.167284+0000","last_unstale":"2024-09-17T03:13:36.172893+0000","last_undegraded":"2024-09-17T03:13:36.172893+0000","last_fullsized":"2024-09-17T03:13:36.172893+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:35:00.786078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173348+0000","last_change":"2024-09-17T03:13:36.173114+0000","last_active":"2024-09-17T03:13:36.173348+0000","last_peered":"2024-09-17T03:13:36.173348+0000","last_clean":"2024-09-17T03:13:36.173348+0000","last_became_active":"2024-09-17T03:13:36.172653+0000","last_became_peered":"2024-09-17T03:13:36.172653+0000","last_unstale":"2024-09-17T03:13:36.173348+0000","last_undegraded":"2024-09-17T03:13:36.173348+0000","last_fullsized":"2024-09-17T03:13:36.173348+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:51.574328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"81'4","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.185157+0000","last_change":"2024-09-17T03:13:35.147001+0000","last_active":"2024-09-17T03:13:36.185157+0000","last_peered":"2024-09-17T03:13:36.185157+0000","last_clean":"2024-09-17T03:13:36.185157+0000","last_became_active":"2024-09-17T03:13:35.146658+0000","last_became_peered":"2024-09-17T03:13:35.146658+0000","last_unstale":"2024-09-17T03:13:36.185157+0000","last_undegraded":"2024-09-17T03:13:36.185157+0000","last_fullsized":"2024-09-17T03:13:36.185157+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:06.031844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172305+0000","last_change":"2024-09-17T03:13:36.168877+0000","last_active":"2024-09-17T03:13:36.172305+0000","last_peered":"2024-09-17T03:13:36.172305+0000","last_clean":"2024-09-17T03:13:36.172305+0000","last_became_active":"2024-09-17T03:13:36.168545+0000","last_became_peered":"2024-09-17T03:13:36.168545+0000","last_unstale":"2024-09-17T03:13:36.172305+0000","last_undegraded":"2024-09-17T03:13:36.172305+0000","last_fullsized":"2024-09-17T03:13:36.172305+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:01.055085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"81'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160707+0000","last_change":"2024-09-17T03:13:35.151241+0000","last_active":"2024-09-17T03:13:36.160707+0000","last_peered":"2024-09-17T03:13:36.160707+0000","last_clean":"2024-09-17T03:13:36.160707+0000","last_became_active":"2024-09-17T03:13:35.150775+0000","last_became_peered":"2024-09-17T03:13:35.150775+0000","last_unstale":"2024-09-17T03:13:36.160707+0000","last_undegraded":"2024-09-17T03:13:36.160707+0000","last_fullsized":"2024-09-17T03:13:36.160707+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:48.739118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160679+0000","last_change":"2024-09-17T03:13:36.156147+0000","last_active":"2024-09-17T03:13:36.160679+0000","last_peered":"2024-09-17T03:13:36.160679+0000","last_clean":"2024-09-17T03:13:36.160679+0000","last_became_active":"2024-09-17T03:13:36.155807+0000","last_became_peered":"2024-09-17T03:13:36.155807+0000","last_unstale":"2024-09-17T03:13:36.160679+0000","last_undegraded":"2024-09-17T03:13:36.160679+0000","last_fullsized":"2024-09-17T03:13:36.160679+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:41:23.077488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.163253+0000","last_change":"2024-09-17T03:13:35.147739+0000","last_active":"2024-09-17T03:13:36.163253+0000","last_peered":"2024-09-17T03:13:36.163253+0000","last_clean":"2024-09-17T03:13:36.163253+0000","last_became_active":"2024-09-17T03:13:35.147321+0000","last_became_peered":"2024-09-17T03:13:35.147321+0000","last_unstale":"2024-09-17T03:13:36.163253+0000","last_undegraded":"2024-09-17T03:13:36.163253+0000","last_fullsized":"2024-09-17T03:13:36.163253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:33.977477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171514+0000","last_change":"2024-09-17T03:13:36.168055+0000","last_active":"2024-09-17T03:13:36.171514+0000","last_peered":"2024-09-17T03:13:36.171514+0000","last_clean":"2024-09-17T03:13:36.171514+0000","last_became_active":"2024-09-17T03:13:36.167764+0000","last_became_peered":"2024-09-17T03:13:36.167764+0000","last_unstale":"2024-09-17T03:13:36.171514+0000","last_undegraded":"2024-09-17T03:13:36.171514+0000","last_fullsized":"2024-09-17T03:13:36.171514+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:15.268158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.161068+0000","last_change":"2024-09-17T03:13:35.148688+0000","last_active":"2024-09-17T03:13:36.161068+0000","last_peered":"2024-09-17T03:13:36.161068+0000","last_clean":"2024-09-17T03:13:36.161068+0000","last_became_active":"2024-09-17T03:13:35.148412+0000","last_became_peered":"2024-09-17T03:13:35.148412+0000","last_unstale":"2024-09-17T03:13:36.161068+0000","last_undegraded":"2024-09-17T03:13:36.161068+0000","last_fullsized":"2024-09-17T03:13:36.161068+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:20.696636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173396+0000","last_change":"2024-09-17T03:13:36.173304+0000","last_active":"2024-09-17T03:13:36.173396+0000","last_peered":"2024-09-17T03:13:36.173396+0000","last_clean":"2024-09-17T03:13:36.173396+0000","last_became_active":"2024-09-17T03:13:36.172846+0000","last_became_peered":"2024-09-17T03:13:36.172846+0000","last_unstale":"2024-09-17T03:13:36.173396+0000","last_undegraded":"2024-09-17T03:13:36.173396+0000","last_fullsized":"2024-09-17T03:13:36.173396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:12.520288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"81'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.162218+0000","last_change":"2024-09-17T03:13:35.141265+0000","last_active":"2024-09-17T03:13:36.162218+0000","last_peered":"2024-09-17T03:13:36.162218+0000","last_clean":"2024-09-17T03:13:36.162218+0000","last_became_active":"2024-09-17T03:13:35.140530+0000","last_became_peered":"2024-09-17T03:13:35.140530+0000","last_unstale":"2024-09-17T03:13:36.162218+0000","last_undegraded":"2024-09-17T03:13:36.162218+0000","last_fullsized":"2024-09-17T03:13:36.162218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:50.135257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174383+0000","last_change":"2024-09-17T03:13:36.174281+0000","last_active":"2024-09-17T03:13:36.174383+0000","last_peered":"2024-09-17T03:13:36.174383+0000","last_clean":"2024-09-17T03:13:36.174383+0000","last_became_active":"2024-09-17T03:13:36.173946+0000","last_became_peered":"2024-09-17T03:13:36.173946+0000","last_unstale":"2024-09-17T03:13:36.174383+0000","last_undegraded":"2024-09-17T03:13:36.174383+0000","last_fullsized":"2024-09-17T03:13:36.174383+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:35.013596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"81'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.153914+0000","last_change":"2024-09-17T03:13:35.151157+0000","last_active":"2024-09-17T03:13:36.153914+0000","last_peered":"2024-09-17T03:13:36.153914+0000","last_clean":"2024-09-17T03:13:36.153914+0000","last_became_active":"2024-09-17T03:13:35.150743+0000","last_became_peered":"2024-09-17T03:13:35.150743+0000","last_unstale":"2024-09-17T03:13:36.153914+0000","last_undegraded":"2024-09-17T03:13:36.153914+0000","last_fullsized":"2024-09-17T03:13:36.153914+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:29.000215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168607+0000","last_change":"2024-09-17T03:13:36.164002+0000","last_active":"2024-09-17T03:13:36.168607+0000","last_peered":"2024-09-17T03:13:36.168607+0000","last_clean":"2024-09-17T03:13:36.168607+0000","last_became_active":"2024-09-17T03:13:36.163678+0000","last_became_peered":"2024-09-17T03:13:36.163678+0000","last_unstale":"2024-09-17T03:13:36.168607+0000","last_undegraded":"2024-09-17T03:13:36.168607+0000","last_fullsized":"2024-09-17T03:13:36.168607+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:05.685914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160617+0000","last_change":"2024-09-17T03:13:35.148352+0000","last_active":"2024-09-17T03:13:36.160617+0000","last_peered":"2024-09-17T03:13:36.160617+0000","last_clean":"2024-09-17T03:13:36.160617+0000","last_became_active":"2024-09-17T03:13:35.148059+0000","last_became_peered":"2024-09-17T03:13:35.148059+0000","last_unstale":"2024-09-17T03:13:36.160617+0000","last_undegraded":"2024-09-17T03:13:36.160617+0000","last_fullsized":"2024-09-17T03:13:36.160617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:56.223035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275525+0000","last_change":"2024-09-17T03:13:36.159112+0000","last_active":"2024-09-17T03:13:37.275525+0000","last_peered":"2024-09-17T03:13:37.275525+0000","last_clean":"2024-09-17T03:13:37.275525+0000","last_became_active":"2024-09-17T03:13:36.158801+0000","last_became_peered":"2024-09-17T03:13:36.158801+0000","last_unstale":"2024-09-17T03:13:37.275525+0000","last_undegraded":"2024-09-17T03:13:37.275525+0000","last_fullsized":"2024-09-17T03:13:37.275525+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:51.179243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150270+0000","last_change":"2024-09-17T03:13:35.136863+0000","last_active":"2024-09-17T03:13:36.150270+0000","last_peered":"2024-09-17T03:13:36.150270+0000","last_clean":"2024-09-17T03:13:36.150270+0000","last_became_active":"2024-09-17T03:13:35.136521+0000","last_became_peered":"2024-09-17T03:13:35.136521+0000","last_unstale":"2024-09-17T03:13:36.150270+0000","last_undegraded":"2024-09-17T03:13:36.150270+0000","last_fullsized":"2024-09-17T03:13:36.150270+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:26.163857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275914+0000","last_change":"2024-09-17T03:13:36.166439+0000","last_active":"2024-09-17T03:13:37.275914+0000","last_peered":"2024-09-17T03:13:37.275914+0000","last_clean":"2024-09-17T03:13:37.275914+0000","last_became_active":"2024-09-17T03:13:36.166100+0000","last_became_peered":"2024-09-17T03:13:36.166100+0000","last_unstale":"2024-09-17T03:13:37.275914+0000","last_undegraded":"2024-09-17T03:13:37.275914+0000","last_fullsized":"2024-09-17T03:13:37.275914+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:47.088092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150785+0000","last_change":"2024-09-17T03:13:35.150085+0000","last_active":"2024-09-17T03:13:36.150785+0000","last_peered":"2024-09-17T03:13:36.150785+0000","last_clean":"2024-09-17T03:13:36.150785+0000","last_became_active":"2024-09-17T03:13:35.149724+0000","last_became_peered":"2024-09-17T03:13:35.149724+0000","last_unstale":"2024-09-17T03:13:36.150785+0000","last_undegraded":"2024-09-17T03:13:36.150785+0000","last_fullsized":"2024-09-17T03:13:36.150785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:43.977125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173013+0000","last_change":"2024-09-17T03:13:36.170595+0000","last_active":"2024-09-17T03:13:36.173013+0000","last_peered":"2024-09-17T03:13:36.173013+0000","last_clean":"2024-09-17T03:13:36.173013+0000","last_became_active":"2024-09-17T03:13:36.170264+0000","last_became_peered":"2024-09-17T03:13:36.170264+0000","last_unstale":"2024-09-17T03:13:36.173013+0000","last_undegraded":"2024-09-17T03:13:36.173013+0000","last_fullsized":"2024-09-17T03:13:36.173013+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:18.976321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150763+0000","last_change":"2024-09-17T03:13:35.144777+0000","last_active":"2024-09-17T03:13:36.150763+0000","last_peered":"2024-09-17T03:13:36.150763+0000","last_clean":"2024-09-17T03:13:36.150763+0000","last_became_active":"2024-09-17T03:13:35.144435+0000","last_became_peered":"2024-09-17T03:13:35.144435+0000","last_unstale":"2024-09-17T03:13:36.150763+0000","last_undegraded":"2024-09-17T03:13:36.150763+0000","last_fullsized":"2024-09-17T03:13:36.150763+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:03.012283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2024-09-17T03:13:36.157315+0000","last_change":"2024-09-17T03:13:36.157315+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:36.157315+0000","last_undegraded":"2024-09-17T03:13:36.157315+0000","last_fullsized":"2024-09-17T03:13:36.157315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":["0","6"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"81'3","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.182085+0000","last_change":"2024-09-17T03:13:35.140368+0000","last_active":"2024-09-17T03:13:36.182085+0000","last_peered":"2024-09-17T03:13:36.182085+0000","last_clean":"2024-09-17T03:13:36.182085+0000","last_became_active":"2024-09-17T03:13:35.139934+0000","last_became_peered":"2024-09-17T03:13:35.139934+0000","last_unstale":"2024-09-17T03:13:36.182085+0000","last_undegraded":"2024-09-17T03:13:36.182085+0000","last_fullsized":"2024-09-17T03:13:36.182085+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:31.279064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2024-09-17T03:13:36.161033+0000","last_change":"2024-09-17T03:13:36.161033+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:36.161033+0000","last_undegraded":"2024-09-17T03:13:36.161033+0000","last_fullsized":"2024-09-17T03:13:36.161033+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":["4","0"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"81'5","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.175388+0000","last_change":"2024-09-17T03:13:35.148650+0000","last_active":"2024-09-17T03:13:36.175388+0000","last_peered":"2024-09-17T03:13:36.175388+0000","last_clean":"2024-09-17T03:13:36.175388+0000","last_became_active":"2024-09-17T03:13:35.148261+0000","last_became_peered":"2024-09-17T03:13:35.148261+0000","last_unstale":"2024-09-17T03:13:36.175388+0000","last_undegraded":"2024-09-17T03:13:36.175388+0000","last_fullsized":"2024-09-17T03:13:36.175388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:34.187583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2024-09-17T03:13:36.156718+0000","last_change":"2024-09-17T03:13:36.156718+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:36.156718+0000","last_undegraded":"2024-09-17T03:13:36.156718+0000","last_fullsized":"2024-09-17T03:13:36.156718+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.151021+0000","last_change":"2024-09-17T03:13:35.147131+0000","last_active":"2024-09-17T03:13:36.151021+0000","last_peered":"2024-09-17T03:13:36.151021+0000","last_clean":"2024-09-17T03:13:36.151021+0000","last_became_active":"2024-09-17T03:13:35.146813+0000","last_became_peered":"2024-09-17T03:13:35.146813+0000","last_unstale":"2024-09-17T03:13:36.151021+0000","last_undegraded":"2024-09-17T03:13:36.151021+0000","last_fullsized":"2024-09-17T03:13:36.151021+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:34.868836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171407+0000","last_change":"2024-09-17T03:13:36.167033+0000","last_active":"2024-09-17T03:13:36.171407+0000","last_peered":"2024-09-17T03:13:36.171407+0000","last_clean":"2024-09-17T03:13:36.171407+0000","last_became_active":"2024-09-17T03:13:36.166686+0000","last_became_peered":"2024-09-17T03:13:36.166686+0000","last_unstale":"2024-09-17T03:13:36.171407+0000","last_undegraded":"2024-09-17T03:13:36.171407+0000","last_fullsized":"2024-09-17T03:13:36.171407+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:32.691348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275342+0000","last_change":"2024-09-17T03:13:35.148416+0000","last_active":"2024-09-17T03:13:37.275342+0000","last_peered":"2024-09-17T03:13:37.275342+0000","last_clean":"2024-09-17T03:13:37.275342+0000","last_became_active":"2024-09-17T03:13:35.147902+0000","last_became_peered":"2024-09-17T03:13:35.147902+0000","last_unstale":"2024-09-17T03:13:37.275342+0000","last_undegraded":"2024-09-17T03:13:37.275342+0000","last_fullsized":"2024-09-17T03:13:37.275342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:53.553162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172441+0000","last_change":"2024-09-17T03:13:36.172337+0000","last_active":"2024-09-17T03:13:36.172441+0000","last_peered":"2024-09-17T03:13:36.172441+0000","last_clean":"2024-09-17T03:13:36.172441+0000","last_became_active":"2024-09-17T03:13:36.172033+0000","last_became_peered":"2024-09-17T03:13:36.172033+0000","last_unstale":"2024-09-17T03:13:36.172441+0000","last_undegraded":"2024-09-17T03:13:36.172441+0000","last_fullsized":"2024-09-17T03:13:36.172441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:48.036856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.148597+0000","last_change":"2024-09-17T03:13:35.145883+0000","last_active":"2024-09-17T03:13:36.148597+0000","last_peered":"2024-09-17T03:13:36.148597+0000","last_clean":"2024-09-17T03:13:36.148597+0000","last_became_active":"2024-09-17T03:13:35.145485+0000","last_became_peered":"2024-09-17T03:13:35.145485+0000","last_unstale":"2024-09-17T03:13:36.148597+0000","last_undegraded":"2024-09-17T03:13:36.148597+0000","last_fullsized":"2024-09-17T03:13:36.148597+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:33.828573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.167821+0000","last_change":"2024-09-17T03:13:36.162558+0000","last_active":"2024-09-17T03:13:36.167821+0000","last_peered":"2024-09-17T03:13:36.167821+0000","last_clean":"2024-09-17T03:13:36.167821+0000","last_became_active":"2024-09-17T03:13:36.162263+0000","last_became_peered":"2024-09-17T03:13:36.162263+0000","last_unstale":"2024-09-17T03:13:36.167821+0000","last_undegraded":"2024-09-17T03:13:36.167821+0000","last_fullsized":"2024-09-17T03:13:36.167821+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:26.393514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"81'5","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160497+0000","last_change":"2024-09-17T03:13:35.147811+0000","last_active":"2024-09-17T03:13:36.160497+0000","last_peered":"2024-09-17T03:13:36.160497+0000","last_clean":"2024-09-17T03:13:36.160497+0000","last_became_active":"2024-09-17T03:13:35.147540+0000","last_became_peered":"2024-09-17T03:13:35.147540+0000","last_unstale":"2024-09-17T03:13:36.160497+0000","last_undegraded":"2024-09-17T03:13:36.160497+0000","last_fullsized":"2024-09-17T03:13:36.160497+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:21.660023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168645+0000","last_change":"2024-09-17T03:13:36.160764+0000","last_active":"2024-09-17T03:13:36.168645+0000","last_peered":"2024-09-17T03:13:36.168645+0000","last_clean":"2024-09-17T03:13:36.168645+0000","last_became_active":"2024-09-17T03:13:36.160458+0000","last_became_peered":"2024-09-17T03:13:36.160458+0000","last_unstale":"2024-09-17T03:13:36.168645+0000","last_undegraded":"2024-09-17T03:13:36.168645+0000","last_fullsized":"2024-09-17T03:13:36.168645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:57.043310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"81'1","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.181628+0000","last_change":"2024-09-17T03:13:35.146348+0000","last_active":"2024-09-17T03:13:36.181628+0000","last_peered":"2024-09-17T03:13:36.181628+0000","last_clean":"2024-09-17T03:13:36.181628+0000","last_became_active":"2024-09-17T03:13:35.145718+0000","last_became_peered":"2024-09-17T03:13:35.145718+0000","last_unstale":"2024-09-17T03:13:36.181628+0000","last_undegraded":"2024-09-17T03:13:36.181628+0000","last_fullsized":"2024-09-17T03:13:36.181628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:39.536551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.163461+0000","last_change":"2024-09-17T03:13:36.158379+0000","last_active":"2024-09-17T03:13:36.163461+0000","last_peered":"2024-09-17T03:13:36.163461+0000","last_clean":"2024-09-17T03:13:36.163461+0000","last_became_active":"2024-09-17T03:13:36.157894+0000","last_became_peered":"2024-09-17T03:13:36.157894+0000","last_unstale":"2024-09-17T03:13:36.163461+0000","last_undegraded":"2024-09-17T03:13:36.163461+0000","last_fullsized":"2024-09-17T03:13:36.163461+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:36.956392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.162873+0000","last_change":"2024-09-17T03:13:35.148036+0000","last_active":"2024-09-17T03:13:36.162873+0000","last_peered":"2024-09-17T03:13:36.162873+0000","last_clean":"2024-09-17T03:13:36.162873+0000","last_became_active":"2024-09-17T03:13:35.147436+0000","last_became_peered":"2024-09-17T03:13:35.147436+0000","last_unstale":"2024-09-17T03:13:36.162873+0000","last_undegraded":"2024-09-17T03:13:36.162873+0000","last_fullsized":"2024-09-17T03:13:36.162873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:37.475359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171851+0000","last_change":"2024-09-17T03:13:36.167162+0000","last_active":"2024-09-17T03:13:36.171851+0000","last_peered":"2024-09-17T03:13:36.171851+0000","last_clean":"2024-09-17T03:13:36.171851+0000","last_became_active":"2024-09-17T03:13:36.166834+0000","last_became_peered":"2024-09-17T03:13:36.166834+0000","last_unstale":"2024-09-17T03:13:36.171851+0000","last_undegraded":"2024-09-17T03:13:36.171851+0000","last_fullsized":"2024-09-17T03:13:36.171851+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:48:08.944447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160953+0000","last_change":"2024-09-17T03:13:35.150447+0000","last_active":"2024-09-17T03:13:36.160953+0000","last_peered":"2024-09-17T03:13:36.160953+0000","last_clean":"2024-09-17T03:13:36.160953+0000","last_became_active":"2024-09-17T03:13:35.150117+0000","last_became_peered":"2024-09-17T03:13:35.150117+0000","last_unstale":"2024-09-17T03:13:36.160953+0000","last_undegraded":"2024-09-17T03:13:36.160953+0000","last_fullsized":"2024-09-17T03:13:36.160953+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:03.128187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171406+0000","last_change":"2024-09-17T03:13:36.169959+0000","last_active":"2024-09-17T03:13:36.171406+0000","last_peered":"2024-09-17T03:13:36.171406+0000","last_clean":"2024-09-17T03:13:36.171406+0000","last_became_active":"2024-09-17T03:13:36.169633+0000","last_became_peered":"2024-09-17T03:13:36.169633+0000","last_unstale":"2024-09-17T03:13:36.171406+0000","last_undegraded":"2024-09-17T03:13:36.171406+0000","last_fullsized":"2024-09-17T03:13:36.171406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:35:53.203069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"81'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275792+0000","last_change":"2024-09-17T03:13:35.150519+0000","last_active":"2024-09-17T03:13:37.275792+0000","last_peered":"2024-09-17T03:13:37.275792+0000","last_clean":"2024-09-17T03:13:37.275792+0000","last_became_active":"2024-09-17T03:13:35.150226+0000","last_became_peered":"2024-09-17T03:13:35.150226+0000","last_unstale":"2024-09-17T03:13:37.275792+0000","last_undegraded":"2024-09-17T03:13:37.275792+0000","last_fullsized":"2024-09-17T03:13:37.275792+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:26.002514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160547+0000","last_change":"2024-09-17T03:13:36.158573+0000","last_active":"2024-09-17T03:13:36.160547+0000","last_peered":"2024-09-17T03:13:36.160547+0000","last_clean":"2024-09-17T03:13:36.160547+0000","last_became_active":"2024-09-17T03:13:36.158208+0000","last_became_peered":"2024-09-17T03:13:36.158208+0000","last_unstale":"2024-09-17T03:13:36.160547+0000","last_undegraded":"2024-09-17T03:13:36.160547+0000","last_fullsized":"2024-09-17T03:13:36.160547+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:43.797527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.158436+0000","last_change":"2024-09-17T03:13:35.148924+0000","last_active":"2024-09-17T03:13:36.158436+0000","last_peered":"2024-09-17T03:13:36.158436+0000","last_clean":"2024-09-17T03:13:36.158436+0000","last_became_active":"2024-09-17T03:13:35.148637+0000","last_became_peered":"2024-09-17T03:13:35.148637+0000","last_unstale":"2024-09-17T03:13:36.158436+0000","last_undegraded":"2024-09-17T03:13:36.158436+0000","last_fullsized":"2024-09-17T03:13:36.158436+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:35.581909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.169086+0000","last_change":"2024-09-17T03:13:36.162958+0000","last_active":"2024-09-17T03:13:36.169086+0000","last_peered":"2024-09-17T03:13:36.169086+0000","last_clean":"2024-09-17T03:13:36.169086+0000","last_became_active":"2024-09-17T03:13:36.162656+0000","last_became_peered":"2024-09-17T03:13:36.162656+0000","last_unstale":"2024-09-17T03:13:36.169086+0000","last_undegraded":"2024-09-17T03:13:36.169086+0000","last_fullsized":"2024-09-17T03:13:36.169086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:05.566969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.154780+0000","last_change":"2024-09-17T03:13:35.142641+0000","last_active":"2024-09-17T03:13:36.154780+0000","last_peered":"2024-09-17T03:13:36.154780+0000","last_clean":"2024-09-17T03:13:36.154780+0000","last_became_active":"2024-09-17T03:13:35.142331+0000","last_became_peered":"2024-09-17T03:13:35.142331+0000","last_unstale":"2024-09-17T03:13:36.154780+0000","last_undegraded":"2024-09-17T03:13:36.154780+0000","last_fullsized":"2024-09-17T03:13:36.154780+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:06.927325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.172373+0000","last_change":"2024-09-17T03:13:36.167894+0000","last_active":"2024-09-17T03:13:36.172373+0000","last_peered":"2024-09-17T03:13:36.172373+0000","last_clean":"2024-09-17T03:13:36.172373+0000","last_became_active":"2024-09-17T03:13:36.167509+0000","last_became_peered":"2024-09-17T03:13:36.167509+0000","last_unstale":"2024-09-17T03:13:36.172373+0000","last_undegraded":"2024-09-17T03:13:36.172373+0000","last_fullsized":"2024-09-17T03:13:36.172373+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:24.063918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275150+0000","last_change":"2024-09-17T03:13:35.150284+0000","last_active":"2024-09-17T03:13:37.275150+0000","last_peered":"2024-09-17T03:13:37.275150+0000","last_clean":"2024-09-17T03:13:37.275150+0000","last_became_active":"2024-09-17T03:13:35.149842+0000","last_became_peered":"2024-09-17T03:13:35.149842+0000","last_unstale":"2024-09-17T03:13:37.275150+0000","last_undegraded":"2024-09-17T03:13:37.275150+0000","last_fullsized":"2024-09-17T03:13:37.275150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:04.403550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174824+0000","last_change":"2024-09-17T03:13:36.169746+0000","last_active":"2024-09-17T03:13:36.174824+0000","last_peered":"2024-09-17T03:13:36.174824+0000","last_clean":"2024-09-17T03:13:36.174824+0000","last_became_active":"2024-09-17T03:13:36.169430+0000","last_became_peered":"2024-09-17T03:13:36.169430+0000","last_unstale":"2024-09-17T03:13:36.174824+0000","last_undegraded":"2024-09-17T03:13:36.174824+0000","last_fullsized":"2024-09-17T03:13:36.174824+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:35.192731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150221+0000","last_change":"2024-09-17T03:13:35.145283+0000","last_active":"2024-09-17T03:13:36.150221+0000","last_peered":"2024-09-17T03:13:36.150221+0000","last_clean":"2024-09-17T03:13:36.150221+0000","last_became_active":"2024-09-17T03:13:35.144986+0000","last_became_peered":"2024-09-17T03:13:35.144986+0000","last_unstale":"2024-09-17T03:13:36.150221+0000","last_undegraded":"2024-09-17T03:13:36.150221+0000","last_fullsized":"2024-09-17T03:13:36.150221+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:50.213189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.168708+0000","last_change":"2024-09-17T03:13:36.164579+0000","last_active":"2024-09-17T03:13:36.168708+0000","last_peered":"2024-09-17T03:13:36.168708+0000","last_clean":"2024-09-17T03:13:36.168708+0000","last_became_active":"2024-09-17T03:13:36.164264+0000","last_became_peered":"2024-09-17T03:13:36.164264+0000","last_unstale":"2024-09-17T03:13:36.168708+0000","last_undegraded":"2024-09-17T03:13:36.168708+0000","last_fullsized":"2024-09-17T03:13:36.168708+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:04.660596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150709+0000","last_change":"2024-09-17T03:13:35.148815+0000","last_active":"2024-09-17T03:13:36.150709+0000","last_peered":"2024-09-17T03:13:36.150709+0000","last_clean":"2024-09-17T03:13:36.150709+0000","last_became_active":"2024-09-17T03:13:35.148507+0000","last_became_peered":"2024-09-17T03:13:35.148507+0000","last_unstale":"2024-09-17T03:13:36.150709+0000","last_undegraded":"2024-09-17T03:13:36.150709+0000","last_fullsized":"2024-09-17T03:13:36.150709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:12.011558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.169507+0000","last_change":"2024-09-17T03:13:36.161389+0000","last_active":"2024-09-17T03:13:36.169507+0000","last_peered":"2024-09-17T03:13:36.169507+0000","last_clean":"2024-09-17T03:13:36.169507+0000","last_became_active":"2024-09-17T03:13:36.161086+0000","last_became_peered":"2024-09-17T03:13:36.161086+0000","last_unstale":"2024-09-17T03:13:36.169507+0000","last_undegraded":"2024-09-17T03:13:36.169507+0000","last_fullsized":"2024-09-17T03:13:36.169507+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:46.792762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150388+0000","last_change":"2024-09-17T03:13:35.146844+0000","last_active":"2024-09-17T03:13:36.150388+0000","last_peered":"2024-09-17T03:13:36.150388+0000","last_clean":"2024-09-17T03:13:36.150388+0000","last_became_active":"2024-09-17T03:13:35.146239+0000","last_became_peered":"2024-09-17T03:13:35.146239+0000","last_unstale":"2024-09-17T03:13:36.150388+0000","last_undegraded":"2024-09-17T03:13:36.150388+0000","last_fullsized":"2024-09-17T03:13:36.150388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:16.862049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.174913+0000","last_change":"2024-09-17T03:13:36.169810+0000","last_active":"2024-09-17T03:13:36.174913+0000","last_peered":"2024-09-17T03:13:36.174913+0000","last_clean":"2024-09-17T03:13:36.174913+0000","last_became_active":"2024-09-17T03:13:36.169472+0000","last_became_peered":"2024-09-17T03:13:36.169472+0000","last_unstale":"2024-09-17T03:13:36.174913+0000","last_undegraded":"2024-09-17T03:13:36.174913+0000","last_fullsized":"2024-09-17T03:13:36.174913+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:34.833721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150452+0000","last_change":"2024-09-17T03:13:35.149436+0000","last_active":"2024-09-17T03:13:36.150452+0000","last_peered":"2024-09-17T03:13:36.150452+0000","last_clean":"2024-09-17T03:13:36.150452+0000","last_became_active":"2024-09-17T03:13:35.147481+0000","last_became_peered":"2024-09-17T03:13:35.147481+0000","last_unstale":"2024-09-17T03:13:36.150452+0000","last_undegraded":"2024-09-17T03:13:36.150452+0000","last_fullsized":"2024-09-17T03:13:36.150452+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:09.546632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160538+0000","last_change":"2024-09-17T03:13:36.158743+0000","last_active":"2024-09-17T03:13:36.160538+0000","last_peered":"2024-09-17T03:13:36.160538+0000","last_clean":"2024-09-17T03:13:36.160538+0000","last_became_active":"2024-09-17T03:13:36.158441+0000","last_became_peered":"2024-09-17T03:13:36.158441+0000","last_unstale":"2024-09-17T03:13:36.160538+0000","last_undegraded":"2024-09-17T03:13:36.160538+0000","last_fullsized":"2024-09-17T03:13:36.160538+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:51.574328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.160954+0000","last_change":"2024-09-17T03:13:35.145764+0000","last_active":"2024-09-17T03:13:36.160954+0000","last_peered":"2024-09-17T03:13:36.160954+0000","last_clean":"2024-09-17T03:13:36.160954+0000","last_became_active":"2024-09-17T03:13:35.145453+0000","last_became_peered":"2024-09-17T03:13:35.145453+0000","last_unstale":"2024-09-17T03:13:36.160954+0000","last_undegraded":"2024-09-17T03:13:36.160954+0000","last_fullsized":"2024-09-17T03:13:36.160954+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:04.680766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":3,"reported_epoch":81,"state":"creating+activating","last_fresh":"2024-09-17T03:13:36.157325+0000","last_change":"2024-09-17T03:13:36.157325+0000","last_active":"2024-09-17T03:13:35.124535+0000","last_peered":"2024-09-17T03:13:35.124535+0000","last_clean":"2024-09-17T03:13:35.124535+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T03:13:36.157325+0000","last_undegraded":"2024-09-17T03:13:36.157325+0000","last_fullsized":"2024-09-17T03:13:36.157325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.154152+0000","last_change":"2024-09-17T03:13:35.149928+0000","last_active":"2024-09-17T03:13:36.154152+0000","last_peered":"2024-09-17T03:13:36.154152+0000","last_clean":"2024-09-17T03:13:36.154152+0000","last_became_active":"2024-09-17T03:13:35.149571+0000","last_became_peered":"2024-09-17T03:13:35.149571+0000","last_unstale":"2024-09-17T03:13:36.154152+0000","last_undegraded":"2024-09-17T03:13:36.154152+0000","last_fullsized":"2024-09-17T03:13:36.154152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:32.720660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171470+0000","last_change":"2024-09-17T03:13:36.166632+0000","last_active":"2024-09-17T03:13:36.171470+0000","last_peered":"2024-09-17T03:13:36.171470+0000","last_clean":"2024-09-17T03:13:36.171470+0000","last_became_active":"2024-09-17T03:13:36.166308+0000","last_became_peered":"2024-09-17T03:13:36.166308+0000","last_unstale":"2024-09-17T03:13:36.171470+0000","last_undegraded":"2024-09-17T03:13:36.171470+0000","last_fullsized":"2024-09-17T03:13:36.171470+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:07.609432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.150305+0000","last_change":"2024-09-17T03:13:35.148824+0000","last_active":"2024-09-17T03:13:36.150305+0000","last_peered":"2024-09-17T03:13:36.150305+0000","last_clean":"2024-09-17T03:13:36.150305+0000","last_became_active":"2024-09-17T03:13:35.148417+0000","last_became_peered":"2024-09-17T03:13:35.148417+0000","last_unstale":"2024-09-17T03:13:36.150305+0000","last_undegraded":"2024-09-17T03:13:36.150305+0000","last_fullsized":"2024-09-17T03:13:36.150305+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:58.224149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.171614+0000","last_change":"2024-09-17T03:13:36.163897+0000","last_active":"2024-09-17T03:13:36.171614+0000","last_peered":"2024-09-17T03:13:36.171614+0000","last_clean":"2024-09-17T03:13:36.171614+0000","last_became_active":"2024-09-17T03:13:36.163275+0000","last_became_peered":"2024-09-17T03:13:36.163275+0000","last_unstale":"2024-09-17T03:13:36.171614+0000","last_undegraded":"2024-09-17T03:13:36.171614+0000","last_fullsized":"2024-09-17T03:13:36.171614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:37.972855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.154338+0000","last_change":"2024-09-17T03:13:35.142421+0000","last_active":"2024-09-17T03:13:36.154338+0000","last_peered":"2024-09-17T03:13:36.154338+0000","last_clean":"2024-09-17T03:13:36.154338+0000","last_became_active":"2024-09-17T03:13:35.142113+0000","last_became_peered":"2024-09-17T03:13:35.142113+0000","last_unstale":"2024-09-17T03:13:36.154338+0000","last_undegraded":"2024-09-17T03:13:36.154338+0000","last_fullsized":"2024-09-17T03:13:36.154338+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:12.371249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.173952+0000","last_change":"2024-09-17T03:13:36.166539+0000","last_active":"2024-09-17T03:13:36.173952+0000","last_peered":"2024-09-17T03:13:36.173952+0000","last_clean":"2024-09-17T03:13:36.173952+0000","last_became_active":"2024-09-17T03:13:36.166189+0000","last_became_peered":"2024-09-17T03:13:36.166189+0000","last_unstale":"2024-09-17T03:13:36.173952+0000","last_undegraded":"2024-09-17T03:13:36.173952+0000","last_fullsized":"2024-09-17T03:13:36.173952+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:35:22.963501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"81'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.155281+0000","last_change":"2024-09-17T03:13:35.148171+0000","last_active":"2024-09-17T03:13:36.155281+0000","last_peered":"2024-09-17T03:13:36.155281+0000","last_clean":"2024-09-17T03:13:36.155281+0000","last_became_active":"2024-09-17T03:13:35.147822+0000","last_became_peered":"2024-09-17T03:13:35.147822+0000","last_unstale":"2024-09-17T03:13:36.155281+0000","last_undegraded":"2024-09-17T03:13:36.155281+0000","last_fullsized":"2024-09-17T03:13:36.155281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:17.971173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":216,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-09-17T03:13:36.153800+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:13:36.153800+0000","last_peered":"2024-09-17T03:13:36.153800+0000","last_clean":"2024-09-17T03:13:36.153800+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:13:36.153800+0000","last_undegraded":"2024-09-17T03:13:36.153800+0000","last_fullsized":"2024-09-17T03:13:36.153800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":1470,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":28,"ondisk_log_size":28,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509508,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28564,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343276,"statfs":{"total":96636764160,"available":96607514624,"internally_reserved":0,"allocated":1568768,"data_stored":1003684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509508,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":974848,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509507,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":974848,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509508,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":974848,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":974848,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":974848,"data_stored":413316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509508,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1568768,"data_stored":1003684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1011712,"data_stored":428003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:13:43.613 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:13:43.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.744+0000 7f5d8196e640 1 -- 172.21.15.78:0/552376144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d7c15d840 msgr2=0x7f5d7c0b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:43.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.744+0000 7f5d8196e640 1 --2- 172.21.15.78:0/552376144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d7c15d840 0x7f5d7c0b7490 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c005fd0 tx=0x7f5d6c02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:13:43.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.744+0000 7f5d8196e640 1 -- 172.21.15.78:0/552376144 shutdown_connections 2024-09-17T03:13:43.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.744+0000 7f5d8196e640 1 --2- 172.21.15.78:0/552376144 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d7c15d840 0x7f5d7c0b7490 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:43.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.744+0000 7f5d8196e640 1 --2- 172.21.15.78:0/552376144 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5d7c1570e0 0x7f5d7c0d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:43.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.744+0000 7f5d8196e640 1 -- 172.21.15.78:0/552376144 >> 172.21.15.78:0/552376144 conn(0x7f5d7c06d550 msgr2=0x7f5d7c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:43.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.744+0000 7f5d8196e640 1 -- 172.21.15.78:0/552376144 shutdown_connections 2024-09-17T03:13:43.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.744+0000 7f5d8196e640 1 -- 172.21.15.78:0/552376144 wait complete. 2024-09-17T03:13:43.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.746+0000 7f5d8196e640 1 Processor -- start 2024-09-17T03:13:43.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.746+0000 7f5d8196e640 1 -- start start 2024-09-17T03:13:43.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.748+0000 7f5d8196e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d7c0d2460 0x7f5d7c155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:43.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.748+0000 7f5d8196e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d7c1570e0 0x7f5d7c157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:43.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.748+0000 7f5d8196e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5d7c15d840 0x7f5d7c157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:43.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.748+0000 7f5d8196e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c0b7d60 con 0x7f5d7c1570e0 2024-09-17T03:13:43.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.748+0000 7f5d8196e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5d7c0b7be0 con 0x7f5d7c0d2460 2024-09-17T03:13:43.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.748+0000 7f5d8196e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5d7c0b7ee0 con 0x7f5d7c15d840 2024-09-17T03:13:43.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.748+0000 7f5d7a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d7c1570e0 0x7f5d7c157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:43.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.748+0000 7f5d7a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d7c1570e0 0x7f5d7c157610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39564/0 (socket says 172.21.15.78:39564) 2024-09-17T03:13:43.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.748+0000 7f5d7a7fc640 1 -- 172.21.15.78:0/3610984227 learned_addr learned my addr 172.21.15.78:0/3610984227 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:43.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.748+0000 7f5d7affd640 1 --2- 172.21.15.78:0/3610984227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d7c0d2460 0x7f5d7c155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:43.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.748+0000 7f5d7b7fe640 1 --2- 172.21.15.78:0/3610984227 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5d7c15d840 0x7f5d7c157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:43.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.748+0000 7f5d7a7fc640 1 -- 172.21.15.78:0/3610984227 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5d7c15d840 msgr2=0x7f5d7c157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:43.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.748+0000 7f5d7a7fc640 1 --2- 172.21.15.78:0/3610984227 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5d7c15d840 0x7f5d7c157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:43.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.748+0000 7f5d7a7fc640 1 -- 172.21.15.78:0/3610984227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d7c0d2460 msgr2=0x7f5d7c155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:43.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.748+0000 7f5d7a7fc640 1 --2- 172.21.15.78:0/3610984227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d7c0d2460 0x7f5d7c155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:43.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.748+0000 7f5d7a7fc640 1 -- 172.21.15.78:0/3610984227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d7c0cb4a0 con 0x7f5d7c1570e0 2024-09-17T03:13:43.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.748+0000 7f5d7b7fe640 1 --2- 172.21.15.78:0/3610984227 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5d7c15d840 0x7f5d7c157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:43.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.748+0000 7f5d7affd640 1 --2- 172.21.15.78:0/3610984227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d7c0d2460 0x7f5d7c155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:43.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.748+0000 7f5d7a7fc640 1 --2- 172.21.15.78:0/3610984227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d7c1570e0 0x7f5d7c157610 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400c730 tx=0x7f5d6400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:43.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.749+0000 7f5d73fff640 1 -- 172.21.15.78:0/3610984227 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d640052d0 con 0x7f5d7c1570e0 2024-09-17T03:13:43.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.749+0000 7f5d73fff640 1 -- 172.21.15.78:0/3610984227 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d64005490 con 0x7f5d7c1570e0 2024-09-17T03:13:43.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.749+0000 7f5d73fff640 1 -- 172.21.15.78:0/3610984227 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6400a8a0 con 0x7f5d7c1570e0 2024-09-17T03:13:43.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.749+0000 7f5d8196e640 1 -- 172.21.15.78:0/3610984227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d7c155fa0 con 0x7f5d7c1570e0 2024-09-17T03:13:43.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.749+0000 7f5d8196e640 1 -- 172.21.15.78:0/3610984227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d7c0cb1c0 con 0x7f5d7c1570e0 2024-09-17T03:13:43.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.750+0000 7f5d8196e640 1 -- 172.21.15.78:0/3610984227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d7c0d1f20 con 0x7f5d7c1570e0 2024-09-17T03:13:43.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.750+0000 7f5d73fff640 1 -- 172.21.15.78:0/3610984227 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5d6400aa40 con 0x7f5d7c1570e0 2024-09-17T03:13:43.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.751+0000 7f5d73fff640 1 --2- 172.21.15.78:0/3610984227 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5d5c078b90 0x7f5d5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:43.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.751+0000 7f5d73fff640 1 -- 172.21.15.78:0/3610984227 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f5d6409a920 con 0x7f5d7c1570e0 2024-09-17T03:13:43.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.751+0000 7f5d7affd640 1 --2- 172.21.15.78:0/3610984227 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5d5c078b90 0x7f5d5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:43.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.752+0000 7f5d7affd640 1 --2- 172.21.15.78:0/3610984227 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5d5c078b90 0x7f5d5c07b0a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5d74005fd0 tx=0x7f5d74009260 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:43.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.756+0000 7f5d73fff640 1 -- 172.21.15.78:0/3610984227 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5d7c0d2870 con 0x7f5d7c1570e0 2024-09-17T03:13:43.928 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.929+0000 7f5d8196e640 1 -- 172.21.15.78:0/3610984227 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5d7c0cac70 con 0x7f5d5c078b90 2024-09-17T03:13:43.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.934+0000 7f5d73fff640 1 -- 172.21.15.78:0/3610984227 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252056 (secure 0 0 0) 0x7f5d7c0cac70 con 0x7f5d5c078b90 2024-09-17T03:13:43.935 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:43.937 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:13:43.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.937+0000 7f5d8196e640 1 -- 172.21.15.78:0/3610984227 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5d5c078b90 msgr2=0x7f5d5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:43.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.937+0000 7f5d8196e640 1 --2- 172.21.15.78:0/3610984227 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5d5c078b90 0x7f5d5c07b0a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5d74005fd0 tx=0x7f5d74009260 comp rx=0 tx=0).stop 2024-09-17T03:13:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.938+0000 7f5d8196e640 1 -- 172.21.15.78:0/3610984227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d7c1570e0 msgr2=0x7f5d7c157610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.938+0000 7f5d8196e640 1 --2- 172.21.15.78:0/3610984227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d7c1570e0 0x7f5d7c157610 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400c730 tx=0x7f5d6400cbf0 comp rx=0 tx=0).stop 2024-09-17T03:13:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.938+0000 7f5d8196e640 1 -- 172.21.15.78:0/3610984227 shutdown_connections 2024-09-17T03:13:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.938+0000 7f5d8196e640 1 --2- 172.21.15.78:0/3610984227 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5d7c15d840 0x7f5d7c157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.938+0000 7f5d8196e640 1 --2- 172.21.15.78:0/3610984227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5d7c1570e0 0x7f5d7c157610 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.938+0000 7f5d8196e640 1 --2- 172.21.15.78:0/3610984227 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5d5c078b90 0x7f5d5c07b0a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.938+0000 7f5d8196e640 1 --2- 172.21.15.78:0/3610984227 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5d7c0d2460 0x7f5d7c155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.938+0000 7f5d8196e640 1 -- 172.21.15.78:0/3610984227 >> 172.21.15.78:0/3610984227 conn(0x7f5d7c06d550 msgr2=0x7f5d7c0b6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.938+0000 7f5d8196e640 1 -- 172.21.15.78:0/3610984227 shutdown_connections 2024-09-17T03:13:43.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:43.938+0000 7f5d8196e640 1 -- 172.21.15.78:0/3610984227 wait complete. 2024-09-17T03:13:43.948 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":240,"stamp":"2024-09-17T03:13:43.204688+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":246088,"kb_used_data":9032,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754728632,"statfs":{"total":773094113280,"available":772842119168,"internally_reserved":0,"allocated":9248768,"data_stored":4596684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":242535986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002143"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166433+0000","last_change":"2024-09-17T03:13:36.164503+0000","last_active":"2024-09-17T03:13:37.166433+0000","last_peered":"2024-09-17T03:13:37.166433+0000","last_clean":"2024-09-17T03:13:37.166433+0000","last_became_active":"2024-09-17T03:13:36.164189+0000","last_became_peered":"2024-09-17T03:13:36.164189+0000","last_unstale":"2024-09-17T03:13:37.166433+0000","last_undegraded":"2024-09-17T03:13:37.166433+0000","last_fullsized":"2024-09-17T03:13:37.166433+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:47:42.490176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.170876+0000","last_change":"2024-09-17T03:13:36.163785+0000","last_active":"2024-09-17T03:13:37.170876+0000","last_peered":"2024-09-17T03:13:37.170876+0000","last_clean":"2024-09-17T03:13:37.170876+0000","last_became_active":"2024-09-17T03:13:36.163491+0000","last_became_peered":"2024-09-17T03:13:36.163491+0000","last_unstale":"2024-09-17T03:13:37.170876+0000","last_undegraded":"2024-09-17T03:13:37.170876+0000","last_fullsized":"2024-09-17T03:13:37.170876+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:13.376397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.276746+0000","last_change":"2024-09-17T03:13:36.158610+0000","last_active":"2024-09-17T03:13:37.276746+0000","last_peered":"2024-09-17T03:13:37.276746+0000","last_clean":"2024-09-17T03:13:37.276746+0000","last_became_active":"2024-09-17T03:13:36.158308+0000","last_became_peered":"2024-09-17T03:13:36.158308+0000","last_unstale":"2024-09-17T03:13:37.276746+0000","last_undegraded":"2024-09-17T03:13:37.276746+0000","last_fullsized":"2024-09-17T03:13:37.276746+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:04.429912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.276087+0000","last_change":"2024-09-17T03:13:36.178901+0000","last_active":"2024-09-17T03:13:37.276087+0000","last_peered":"2024-09-17T03:13:37.276087+0000","last_clean":"2024-09-17T03:13:37.276087+0000","last_became_active":"2024-09-17T03:13:36.178557+0000","last_became_peered":"2024-09-17T03:13:36.178557+0000","last_unstale":"2024-09-17T03:13:37.276087+0000","last_undegraded":"2024-09-17T03:13:37.276087+0000","last_fullsized":"2024-09-17T03:13:37.276087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:23:01.775576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.167807+0000","last_change":"2024-09-17T03:13:36.171195+0000","last_active":"2024-09-17T03:13:37.167807+0000","last_peered":"2024-09-17T03:13:37.167807+0000","last_clean":"2024-09-17T03:13:37.167807+0000","last_became_active":"2024-09-17T03:13:36.170849+0000","last_became_peered":"2024-09-17T03:13:36.170849+0000","last_unstale":"2024-09-17T03:13:37.167807+0000","last_undegraded":"2024-09-17T03:13:37.167807+0000","last_fullsized":"2024-09-17T03:13:37.167807+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:32.691348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275713+0000","last_change":"2024-09-17T03:13:36.164233+0000","last_active":"2024-09-17T03:13:37.275713+0000","last_peered":"2024-09-17T03:13:37.275713+0000","last_clean":"2024-09-17T03:13:37.275713+0000","last_became_active":"2024-09-17T03:13:36.163925+0000","last_became_peered":"2024-09-17T03:13:36.163925+0000","last_unstale":"2024-09-17T03:13:37.275713+0000","last_undegraded":"2024-09-17T03:13:37.275713+0000","last_fullsized":"2024-09-17T03:13:37.275713+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:21.701784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275425+0000","last_change":"2024-09-17T03:13:36.171062+0000","last_active":"2024-09-17T03:13:37.275425+0000","last_peered":"2024-09-17T03:13:37.275425+0000","last_clean":"2024-09-17T03:13:37.275425+0000","last_became_active":"2024-09-17T03:13:36.170264+0000","last_became_peered":"2024-09-17T03:13:36.170264+0000","last_unstale":"2024-09-17T03:13:37.275425+0000","last_undegraded":"2024-09-17T03:13:37.275425+0000","last_fullsized":"2024-09-17T03:13:37.275425+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:25.224694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275596+0000","last_change":"2024-09-17T03:13:36.154137+0000","last_active":"2024-09-17T03:13:37.275596+0000","last_peered":"2024-09-17T03:13:37.275596+0000","last_clean":"2024-09-17T03:13:37.275596+0000","last_became_active":"2024-09-17T03:13:36.153776+0000","last_became_peered":"2024-09-17T03:13:36.153776+0000","last_unstale":"2024-09-17T03:13:37.275596+0000","last_undegraded":"2024-09-17T03:13:37.275596+0000","last_fullsized":"2024-09-17T03:13:37.275596+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:54.875053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275776+0000","last_change":"2024-09-17T03:13:36.165365+0000","last_active":"2024-09-17T03:13:37.275776+0000","last_peered":"2024-09-17T03:13:37.275776+0000","last_clean":"2024-09-17T03:13:37.275776+0000","last_became_active":"2024-09-17T03:13:36.165047+0000","last_became_peered":"2024-09-17T03:13:36.165047+0000","last_unstale":"2024-09-17T03:13:37.275776+0000","last_undegraded":"2024-09-17T03:13:37.275776+0000","last_fullsized":"2024-09-17T03:13:37.275776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:05.685914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166517+0000","last_change":"2024-09-17T03:13:36.158884+0000","last_active":"2024-09-17T03:13:37.166517+0000","last_peered":"2024-09-17T03:13:37.166517+0000","last_clean":"2024-09-17T03:13:37.166517+0000","last_became_active":"2024-09-17T03:13:36.157801+0000","last_became_peered":"2024-09-17T03:13:36.157801+0000","last_unstale":"2024-09-17T03:13:37.166517+0000","last_undegraded":"2024-09-17T03:13:37.166517+0000","last_fullsized":"2024-09-17T03:13:37.166517+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:55:30.171917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.170877+0000","last_change":"2024-09-17T03:13:36.159357+0000","last_active":"2024-09-17T03:13:37.170877+0000","last_peered":"2024-09-17T03:13:37.170877+0000","last_clean":"2024-09-17T03:13:37.170877+0000","last_became_active":"2024-09-17T03:13:36.159037+0000","last_became_peered":"2024-09-17T03:13:36.159037+0000","last_unstale":"2024-09-17T03:13:37.170877+0000","last_undegraded":"2024-09-17T03:13:37.170877+0000","last_fullsized":"2024-09-17T03:13:37.170877+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:00.105205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.168157+0000","last_change":"2024-09-17T03:13:36.157305+0000","last_active":"2024-09-17T03:13:37.168157+0000","last_peered":"2024-09-17T03:13:37.168157+0000","last_clean":"2024-09-17T03:13:37.168157+0000","last_became_active":"2024-09-17T03:13:36.156967+0000","last_became_peered":"2024-09-17T03:13:36.156967+0000","last_unstale":"2024-09-17T03:13:37.168157+0000","last_undegraded":"2024-09-17T03:13:37.168157+0000","last_fullsized":"2024-09-17T03:13:37.168157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:08:33.776295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.276668+0000","last_change":"2024-09-17T03:13:36.170755+0000","last_active":"2024-09-17T03:13:37.276668+0000","last_peered":"2024-09-17T03:13:37.276668+0000","last_clean":"2024-09-17T03:13:37.276668+0000","last_became_active":"2024-09-17T03:13:36.170436+0000","last_became_peered":"2024-09-17T03:13:36.170436+0000","last_unstale":"2024-09-17T03:13:37.276668+0000","last_undegraded":"2024-09-17T03:13:37.276668+0000","last_fullsized":"2024-09-17T03:13:37.276668+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:49.909546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275655+0000","last_change":"2024-09-17T03:13:36.171144+0000","last_active":"2024-09-17T03:13:37.275655+0000","last_peered":"2024-09-17T03:13:37.275655+0000","last_clean":"2024-09-17T03:13:37.275655+0000","last_became_active":"2024-09-17T03:13:36.170849+0000","last_became_peered":"2024-09-17T03:13:36.170849+0000","last_unstale":"2024-09-17T03:13:37.275655+0000","last_undegraded":"2024-09-17T03:13:37.275655+0000","last_fullsized":"2024-09-17T03:13:37.275655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:43.498970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275265+0000","last_change":"2024-09-17T03:13:36.161513+0000","last_active":"2024-09-17T03:13:37.275265+0000","last_peered":"2024-09-17T03:13:37.275265+0000","last_clean":"2024-09-17T03:13:37.275265+0000","last_became_active":"2024-09-17T03:13:36.161196+0000","last_became_peered":"2024-09-17T03:13:36.161196+0000","last_unstale":"2024-09-17T03:13:37.275265+0000","last_undegraded":"2024-09-17T03:13:37.275265+0000","last_fullsized":"2024-09-17T03:13:37.275265+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:11.223567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166647+0000","last_change":"2024-09-17T03:13:36.159093+0000","last_active":"2024-09-17T03:13:37.166647+0000","last_peered":"2024-09-17T03:13:37.166647+0000","last_clean":"2024-09-17T03:13:37.166647+0000","last_became_active":"2024-09-17T03:13:36.158546+0000","last_became_peered":"2024-09-17T03:13:36.158546+0000","last_unstale":"2024-09-17T03:13:37.166647+0000","last_undegraded":"2024-09-17T03:13:37.166647+0000","last_fullsized":"2024-09-17T03:13:37.166647+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:54.875053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.167291+0000","last_change":"2024-09-17T03:13:36.172719+0000","last_active":"2024-09-17T03:13:37.167291+0000","last_peered":"2024-09-17T03:13:37.167291+0000","last_clean":"2024-09-17T03:13:37.167291+0000","last_became_active":"2024-09-17T03:13:36.172362+0000","last_became_peered":"2024-09-17T03:13:36.172362+0000","last_unstale":"2024-09-17T03:13:37.167291+0000","last_undegraded":"2024-09-17T03:13:37.167291+0000","last_fullsized":"2024-09-17T03:13:37.167291+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:04.660596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.276089+0000","last_change":"2024-09-17T03:13:36.170457+0000","last_active":"2024-09-17T03:13:37.276089+0000","last_peered":"2024-09-17T03:13:37.276089+0000","last_clean":"2024-09-17T03:13:37.276089+0000","last_became_active":"2024-09-17T03:13:36.170155+0000","last_became_peered":"2024-09-17T03:13:36.170155+0000","last_unstale":"2024-09-17T03:13:37.276089+0000","last_undegraded":"2024-09-17T03:13:37.276089+0000","last_fullsized":"2024-09-17T03:13:37.276089+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:28.937846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166805+0000","last_change":"2024-09-17T03:13:36.167306+0000","last_active":"2024-09-17T03:13:37.166805+0000","last_peered":"2024-09-17T03:13:37.166805+0000","last_clean":"2024-09-17T03:13:37.166805+0000","last_became_active":"2024-09-17T03:13:36.167004+0000","last_became_peered":"2024-09-17T03:13:36.167004+0000","last_unstale":"2024-09-17T03:13:37.166805+0000","last_undegraded":"2024-09-17T03:13:37.166805+0000","last_fullsized":"2024-09-17T03:13:37.166805+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:37.058517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.276324+0000","last_change":"2024-09-17T03:13:36.164087+0000","last_active":"2024-09-17T03:13:37.276324+0000","last_peered":"2024-09-17T03:13:37.276324+0000","last_clean":"2024-09-17T03:13:37.276324+0000","last_became_active":"2024-09-17T03:13:36.163793+0000","last_became_peered":"2024-09-17T03:13:36.163793+0000","last_unstale":"2024-09-17T03:13:37.276324+0000","last_undegraded":"2024-09-17T03:13:37.276324+0000","last_fullsized":"2024-09-17T03:13:37.276324+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:51.218337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.276224+0000","last_change":"2024-09-17T03:13:36.170832+0000","last_active":"2024-09-17T03:13:37.276224+0000","last_peered":"2024-09-17T03:13:37.276224+0000","last_clean":"2024-09-17T03:13:37.276224+0000","last_became_active":"2024-09-17T03:13:36.170477+0000","last_became_peered":"2024-09-17T03:13:36.170477+0000","last_unstale":"2024-09-17T03:13:37.276224+0000","last_undegraded":"2024-09-17T03:13:37.276224+0000","last_fullsized":"2024-09-17T03:13:37.276224+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:13:07.728675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.170623+0000","last_change":"2024-09-17T03:13:36.166922+0000","last_active":"2024-09-17T03:13:37.170623+0000","last_peered":"2024-09-17T03:13:37.170623+0000","last_clean":"2024-09-17T03:13:37.170623+0000","last_became_active":"2024-09-17T03:13:36.166609+0000","last_became_peered":"2024-09-17T03:13:36.166609+0000","last_unstale":"2024-09-17T03:13:37.170623+0000","last_undegraded":"2024-09-17T03:13:37.170623+0000","last_fullsized":"2024-09-17T03:13:37.170623+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:02.047529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.167422+0000","last_change":"2024-09-17T03:13:36.164280+0000","last_active":"2024-09-17T03:13:37.167422+0000","last_peered":"2024-09-17T03:13:37.167422+0000","last_clean":"2024-09-17T03:13:37.167422+0000","last_became_active":"2024-09-17T03:13:36.163689+0000","last_became_peered":"2024-09-17T03:13:36.163689+0000","last_unstale":"2024-09-17T03:13:37.167422+0000","last_undegraded":"2024-09-17T03:13:37.167422+0000","last_fullsized":"2024-09-17T03:13:37.167422+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:48.258842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275322+0000","last_change":"2024-09-17T03:13:36.166970+0000","last_active":"2024-09-17T03:13:37.275322+0000","last_peered":"2024-09-17T03:13:37.275322+0000","last_clean":"2024-09-17T03:13:37.275322+0000","last_became_active":"2024-09-17T03:13:36.166665+0000","last_became_peered":"2024-09-17T03:13:36.166665+0000","last_unstale":"2024-09-17T03:13:37.275322+0000","last_undegraded":"2024-09-17T03:13:37.275322+0000","last_fullsized":"2024-09-17T03:13:37.275322+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:29:12.476804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.170633+0000","last_change":"2024-09-17T03:13:36.156703+0000","last_active":"2024-09-17T03:13:37.170633+0000","last_peered":"2024-09-17T03:13:37.170633+0000","last_clean":"2024-09-17T03:13:37.170633+0000","last_became_active":"2024-09-17T03:13:36.156367+0000","last_became_peered":"2024-09-17T03:13:36.156367+0000","last_unstale":"2024-09-17T03:13:37.170633+0000","last_undegraded":"2024-09-17T03:13:37.170633+0000","last_fullsized":"2024-09-17T03:13:37.170633+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:27:56.754785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.276659+0000","last_change":"2024-09-17T03:13:36.166639+0000","last_active":"2024-09-17T03:13:37.276659+0000","last_peered":"2024-09-17T03:13:37.276659+0000","last_clean":"2024-09-17T03:13:37.276659+0000","last_became_active":"2024-09-17T03:13:36.166289+0000","last_became_peered":"2024-09-17T03:13:36.166289+0000","last_unstale":"2024-09-17T03:13:37.276659+0000","last_undegraded":"2024-09-17T03:13:37.276659+0000","last_fullsized":"2024-09-17T03:13:37.276659+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:20.879154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.167102+0000","last_change":"2024-09-17T03:13:36.173311+0000","last_active":"2024-09-17T03:13:37.167102+0000","last_peered":"2024-09-17T03:13:37.167102+0000","last_clean":"2024-09-17T03:13:37.167102+0000","last_became_active":"2024-09-17T03:13:36.172541+0000","last_became_peered":"2024-09-17T03:13:36.172541+0000","last_unstale":"2024-09-17T03:13:37.167102+0000","last_undegraded":"2024-09-17T03:13:37.167102+0000","last_fullsized":"2024-09-17T03:13:37.167102+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:57.043310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.168163+0000","last_change":"2024-09-17T03:13:36.164574+0000","last_active":"2024-09-17T03:13:37.168163+0000","last_peered":"2024-09-17T03:13:37.168163+0000","last_clean":"2024-09-17T03:13:37.168163+0000","last_became_active":"2024-09-17T03:13:36.164233+0000","last_became_peered":"2024-09-17T03:13:36.164233+0000","last_unstale":"2024-09-17T03:13:37.168163+0000","last_undegraded":"2024-09-17T03:13:37.168163+0000","last_fullsized":"2024-09-17T03:13:37.168163+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:22:11.658395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.170598+0000","last_change":"2024-09-17T03:13:36.159680+0000","last_active":"2024-09-17T03:13:37.170598+0000","last_peered":"2024-09-17T03:13:37.170598+0000","last_clean":"2024-09-17T03:13:37.170598+0000","last_became_active":"2024-09-17T03:13:36.159385+0000","last_became_peered":"2024-09-17T03:13:36.159385+0000","last_unstale":"2024-09-17T03:13:37.170598+0000","last_undegraded":"2024-09-17T03:13:37.170598+0000","last_fullsized":"2024-09-17T03:13:37.170598+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:27.875193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.170697+0000","last_change":"2024-09-17T03:13:36.174241+0000","last_active":"2024-09-17T03:13:37.170697+0000","last_peered":"2024-09-17T03:13:37.170697+0000","last_clean":"2024-09-17T03:13:37.170697+0000","last_became_active":"2024-09-17T03:13:36.173940+0000","last_became_peered":"2024-09-17T03:13:36.173940+0000","last_unstale":"2024-09-17T03:13:37.170697+0000","last_undegraded":"2024-09-17T03:13:37.170697+0000","last_fullsized":"2024-09-17T03:13:37.170697+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:49:02.796978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166454+0000","last_change":"2024-09-17T03:13:36.168808+0000","last_active":"2024-09-17T03:13:37.166454+0000","last_peered":"2024-09-17T03:13:37.166454+0000","last_clean":"2024-09-17T03:13:37.166454+0000","last_became_active":"2024-09-17T03:13:36.167241+0000","last_became_peered":"2024-09-17T03:13:36.167241+0000","last_unstale":"2024-09-17T03:13:37.166454+0000","last_undegraded":"2024-09-17T03:13:37.166454+0000","last_fullsized":"2024-09-17T03:13:37.166454+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:18.976321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166264+0000","last_change":"2024-09-17T03:13:36.167980+0000","last_active":"2024-09-17T03:13:37.166264+0000","last_peered":"2024-09-17T03:13:37.166264+0000","last_clean":"2024-09-17T03:13:37.166264+0000","last_became_active":"2024-09-17T03:13:36.167284+0000","last_became_peered":"2024-09-17T03:13:36.167284+0000","last_unstale":"2024-09-17T03:13:37.166264+0000","last_undegraded":"2024-09-17T03:13:37.166264+0000","last_fullsized":"2024-09-17T03:13:37.166264+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:01.362788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.168560+0000","last_change":"2024-09-17T03:13:36.173114+0000","last_active":"2024-09-17T03:13:37.168560+0000","last_peered":"2024-09-17T03:13:37.168560+0000","last_clean":"2024-09-17T03:13:37.168560+0000","last_became_active":"2024-09-17T03:13:36.172653+0000","last_became_peered":"2024-09-17T03:13:36.172653+0000","last_unstale":"2024-09-17T03:13:37.168560+0000","last_undegraded":"2024-09-17T03:13:37.168560+0000","last_fullsized":"2024-09-17T03:13:37.168560+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:17:03.088723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"81'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166786+0000","last_change":"2024-09-17T03:13:35.147001+0000","last_active":"2024-09-17T03:13:37.166786+0000","last_peered":"2024-09-17T03:13:37.166786+0000","last_clean":"2024-09-17T03:13:37.166786+0000","last_became_active":"2024-09-17T03:13:35.146658+0000","last_became_peered":"2024-09-17T03:13:35.146658+0000","last_unstale":"2024-09-17T03:13:37.166786+0000","last_undegraded":"2024-09-17T03:13:37.166786+0000","last_fullsized":"2024-09-17T03:13:37.166786+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:06.031844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166599+0000","last_change":"2024-09-17T03:13:36.168877+0000","last_active":"2024-09-17T03:13:37.166599+0000","last_peered":"2024-09-17T03:13:37.166599+0000","last_clean":"2024-09-17T03:13:37.166599+0000","last_became_active":"2024-09-17T03:13:36.168545+0000","last_became_peered":"2024-09-17T03:13:36.168545+0000","last_unstale":"2024-09-17T03:13:37.166599+0000","last_undegraded":"2024-09-17T03:13:37.166599+0000","last_fullsized":"2024-09-17T03:13:37.166599+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:39.666354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"81'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.168732+0000","last_change":"2024-09-17T03:13:35.151241+0000","last_active":"2024-09-17T03:13:37.168732+0000","last_peered":"2024-09-17T03:13:37.168732+0000","last_clean":"2024-09-17T03:13:37.168732+0000","last_became_active":"2024-09-17T03:13:35.150775+0000","last_became_peered":"2024-09-17T03:13:35.150775+0000","last_unstale":"2024-09-17T03:13:37.168732+0000","last_undegraded":"2024-09-17T03:13:37.168732+0000","last_fullsized":"2024-09-17T03:13:37.168732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:48.739118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.168441+0000","last_change":"2024-09-17T03:13:36.156147+0000","last_active":"2024-09-17T03:13:37.168441+0000","last_peered":"2024-09-17T03:13:37.168441+0000","last_clean":"2024-09-17T03:13:37.168441+0000","last_became_active":"2024-09-17T03:13:36.155807+0000","last_became_peered":"2024-09-17T03:13:36.155807+0000","last_unstale":"2024-09-17T03:13:37.168441+0000","last_undegraded":"2024-09-17T03:13:37.168441+0000","last_fullsized":"2024-09-17T03:13:37.168441+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:14.506734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"81'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166931+0000","last_change":"2024-09-17T03:13:35.147739+0000","last_active":"2024-09-17T03:13:37.166931+0000","last_peered":"2024-09-17T03:13:37.166931+0000","last_clean":"2024-09-17T03:13:37.166931+0000","last_became_active":"2024-09-17T03:13:35.147321+0000","last_became_peered":"2024-09-17T03:13:35.147321+0000","last_unstale":"2024-09-17T03:13:37.166931+0000","last_undegraded":"2024-09-17T03:13:37.166931+0000","last_fullsized":"2024-09-17T03:13:37.166931+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:54:33.977477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.276649+0000","last_change":"2024-09-17T03:13:36.168055+0000","last_active":"2024-09-17T03:13:37.276649+0000","last_peered":"2024-09-17T03:13:37.276649+0000","last_clean":"2024-09-17T03:13:37.276649+0000","last_became_active":"2024-09-17T03:13:36.167764+0000","last_became_peered":"2024-09-17T03:13:36.167764+0000","last_unstale":"2024-09-17T03:13:37.276649+0000","last_undegraded":"2024-09-17T03:13:37.276649+0000","last_fullsized":"2024-09-17T03:13:37.276649+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:50.020505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"81'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166757+0000","last_change":"2024-09-17T03:13:35.148688+0000","last_active":"2024-09-17T03:13:37.166757+0000","last_peered":"2024-09-17T03:13:37.166757+0000","last_clean":"2024-09-17T03:13:37.166757+0000","last_became_active":"2024-09-17T03:13:35.148412+0000","last_became_peered":"2024-09-17T03:13:35.148412+0000","last_unstale":"2024-09-17T03:13:37.166757+0000","last_undegraded":"2024-09-17T03:13:37.166757+0000","last_fullsized":"2024-09-17T03:13:37.166757+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:05:20.696636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.170928+0000","last_change":"2024-09-17T03:13:36.173304+0000","last_active":"2024-09-17T03:13:37.170928+0000","last_peered":"2024-09-17T03:13:37.170928+0000","last_clean":"2024-09-17T03:13:37.170928+0000","last_became_active":"2024-09-17T03:13:36.172846+0000","last_became_peered":"2024-09-17T03:13:36.172846+0000","last_unstale":"2024-09-17T03:13:37.170928+0000","last_undegraded":"2024-09-17T03:13:37.170928+0000","last_fullsized":"2024-09-17T03:13:37.170928+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:43.582267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"81'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.168309+0000","last_change":"2024-09-17T03:13:35.141265+0000","last_active":"2024-09-17T03:13:37.168309+0000","last_peered":"2024-09-17T03:13:37.168309+0000","last_clean":"2024-09-17T03:13:37.168309+0000","last_became_active":"2024-09-17T03:13:35.140530+0000","last_became_peered":"2024-09-17T03:13:35.140530+0000","last_unstale":"2024-09-17T03:13:37.168309+0000","last_undegraded":"2024-09-17T03:13:37.168309+0000","last_fullsized":"2024-09-17T03:13:37.168309+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:50.135257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.168087+0000","last_change":"2024-09-17T03:13:36.174281+0000","last_active":"2024-09-17T03:13:37.168087+0000","last_peered":"2024-09-17T03:13:37.168087+0000","last_clean":"2024-09-17T03:13:37.168087+0000","last_became_active":"2024-09-17T03:13:36.173946+0000","last_became_peered":"2024-09-17T03:13:36.173946+0000","last_unstale":"2024-09-17T03:13:37.168087+0000","last_undegraded":"2024-09-17T03:13:37.168087+0000","last_fullsized":"2024-09-17T03:13:37.168087+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:15.268158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"81'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166387+0000","last_change":"2024-09-17T03:13:35.151157+0000","last_active":"2024-09-17T03:13:37.166387+0000","last_peered":"2024-09-17T03:13:37.166387+0000","last_clean":"2024-09-17T03:13:37.166387+0000","last_became_active":"2024-09-17T03:13:35.150743+0000","last_became_peered":"2024-09-17T03:13:35.150743+0000","last_unstale":"2024-09-17T03:13:37.166387+0000","last_undegraded":"2024-09-17T03:13:37.166387+0000","last_fullsized":"2024-09-17T03:13:37.166387+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:29.000215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.276405+0000","last_change":"2024-09-17T03:13:36.164002+0000","last_active":"2024-09-17T03:13:37.276405+0000","last_peered":"2024-09-17T03:13:37.276405+0000","last_clean":"2024-09-17T03:13:37.276405+0000","last_became_active":"2024-09-17T03:13:36.163678+0000","last_became_peered":"2024-09-17T03:13:36.163678+0000","last_unstale":"2024-09-17T03:13:37.276405+0000","last_undegraded":"2024-09-17T03:13:37.276405+0000","last_fullsized":"2024-09-17T03:13:37.276405+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:24.177943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166667+0000","last_change":"2024-09-17T03:13:35.148352+0000","last_active":"2024-09-17T03:13:37.166667+0000","last_peered":"2024-09-17T03:13:37.166667+0000","last_clean":"2024-09-17T03:13:37.166667+0000","last_became_active":"2024-09-17T03:13:35.148059+0000","last_became_peered":"2024-09-17T03:13:35.148059+0000","last_unstale":"2024-09-17T03:13:37.166667+0000","last_undegraded":"2024-09-17T03:13:37.166667+0000","last_fullsized":"2024-09-17T03:13:37.166667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:56.223035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275525+0000","last_change":"2024-09-17T03:13:36.159112+0000","last_active":"2024-09-17T03:13:37.275525+0000","last_peered":"2024-09-17T03:13:37.275525+0000","last_clean":"2024-09-17T03:13:37.275525+0000","last_became_active":"2024-09-17T03:13:36.158801+0000","last_became_peered":"2024-09-17T03:13:36.158801+0000","last_unstale":"2024-09-17T03:13:37.275525+0000","last_undegraded":"2024-09-17T03:13:37.275525+0000","last_fullsized":"2024-09-17T03:13:37.275525+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:51.179243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.170503+0000","last_change":"2024-09-17T03:13:35.136863+0000","last_active":"2024-09-17T03:13:37.170503+0000","last_peered":"2024-09-17T03:13:37.170503+0000","last_clean":"2024-09-17T03:13:37.170503+0000","last_became_active":"2024-09-17T03:13:35.136521+0000","last_became_peered":"2024-09-17T03:13:35.136521+0000","last_unstale":"2024-09-17T03:13:37.170503+0000","last_undegraded":"2024-09-17T03:13:37.170503+0000","last_fullsized":"2024-09-17T03:13:37.170503+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:26.163857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275914+0000","last_change":"2024-09-17T03:13:36.166439+0000","last_active":"2024-09-17T03:13:37.275914+0000","last_peered":"2024-09-17T03:13:37.275914+0000","last_clean":"2024-09-17T03:13:37.275914+0000","last_became_active":"2024-09-17T03:13:36.166100+0000","last_became_peered":"2024-09-17T03:13:36.166100+0000","last_unstale":"2024-09-17T03:13:37.275914+0000","last_undegraded":"2024-09-17T03:13:37.275914+0000","last_fullsized":"2024-09-17T03:13:37.275914+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:47.088092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166935+0000","last_change":"2024-09-17T03:13:35.150085+0000","last_active":"2024-09-17T03:13:37.166935+0000","last_peered":"2024-09-17T03:13:37.166935+0000","last_clean":"2024-09-17T03:13:37.166935+0000","last_became_active":"2024-09-17T03:13:35.149724+0000","last_became_peered":"2024-09-17T03:13:35.149724+0000","last_unstale":"2024-09-17T03:13:37.166935+0000","last_undegraded":"2024-09-17T03:13:37.166935+0000","last_fullsized":"2024-09-17T03:13:37.166935+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:43.977125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275873+0000","last_change":"2024-09-17T03:13:36.170595+0000","last_active":"2024-09-17T03:13:37.275873+0000","last_peered":"2024-09-17T03:13:37.275873+0000","last_clean":"2024-09-17T03:13:37.275873+0000","last_became_active":"2024-09-17T03:13:36.170264+0000","last_became_peered":"2024-09-17T03:13:36.170264+0000","last_unstale":"2024-09-17T03:13:37.275873+0000","last_undegraded":"2024-09-17T03:13:37.275873+0000","last_fullsized":"2024-09-17T03:13:37.275873+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:25.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166492+0000","last_change":"2024-09-17T03:13:35.144777+0000","last_active":"2024-09-17T03:13:37.166492+0000","last_peered":"2024-09-17T03:13:37.166492+0000","last_clean":"2024-09-17T03:13:37.166492+0000","last_became_active":"2024-09-17T03:13:35.144435+0000","last_became_peered":"2024-09-17T03:13:35.144435+0000","last_unstale":"2024-09-17T03:13:37.166492+0000","last_undegraded":"2024-09-17T03:13:37.166492+0000","last_fullsized":"2024-09-17T03:13:37.166492+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:34:03.012283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166724+0000","last_change":"2024-09-17T03:13:36.177367+0000","last_active":"2024-09-17T03:13:37.166724+0000","last_peered":"2024-09-17T03:13:37.166724+0000","last_clean":"2024-09-17T03:13:37.166724+0000","last_became_active":"2024-09-17T03:13:36.177087+0000","last_became_peered":"2024-09-17T03:13:36.177087+0000","last_unstale":"2024-09-17T03:13:37.166724+0000","last_undegraded":"2024-09-17T03:13:37.166724+0000","last_fullsized":"2024-09-17T03:13:37.166724+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:54:24.376208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"81'3","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.168146+0000","last_change":"2024-09-17T03:13:35.140368+0000","last_active":"2024-09-17T03:13:37.168146+0000","last_peered":"2024-09-17T03:13:37.168146+0000","last_clean":"2024-09-17T03:13:37.168146+0000","last_became_active":"2024-09-17T03:13:35.139934+0000","last_became_peered":"2024-09-17T03:13:35.139934+0000","last_unstale":"2024-09-17T03:13:37.168146+0000","last_undegraded":"2024-09-17T03:13:37.168146+0000","last_fullsized":"2024-09-17T03:13:37.168146+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:31.279064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.167205+0000","last_change":"2024-09-17T03:13:36.180109+0000","last_active":"2024-09-17T03:13:37.167205+0000","last_peered":"2024-09-17T03:13:37.167205+0000","last_clean":"2024-09-17T03:13:37.167205+0000","last_became_active":"2024-09-17T03:13:36.179730+0000","last_became_peered":"2024-09-17T03:13:36.179730+0000","last_unstale":"2024-09-17T03:13:37.167205+0000","last_undegraded":"2024-09-17T03:13:37.167205+0000","last_fullsized":"2024-09-17T03:13:37.167205+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:05.685914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"81'6","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275873+0000","last_change":"2024-09-17T03:13:35.148650+0000","last_active":"2024-09-17T03:13:37.275873+0000","last_peered":"2024-09-17T03:13:37.275873+0000","last_clean":"2024-09-17T03:13:37.275873+0000","last_became_active":"2024-09-17T03:13:35.148261+0000","last_became_peered":"2024-09-17T03:13:35.148261+0000","last_unstale":"2024-09-17T03:13:37.275873+0000","last_undegraded":"2024-09-17T03:13:37.275873+0000","last_fullsized":"2024-09-17T03:13:37.275873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:34.187583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166619+0000","last_change":"2024-09-17T03:13:36.178253+0000","last_active":"2024-09-17T03:13:37.166619+0000","last_peered":"2024-09-17T03:13:37.166619+0000","last_clean":"2024-09-17T03:13:37.166619+0000","last_became_active":"2024-09-17T03:13:36.177950+0000","last_became_peered":"2024-09-17T03:13:36.177950+0000","last_unstale":"2024-09-17T03:13:37.166619+0000","last_undegraded":"2024-09-17T03:13:37.166619+0000","last_fullsized":"2024-09-17T03:13:37.166619+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:50.020505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"81'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.170824+0000","last_change":"2024-09-17T03:13:35.147131+0000","last_active":"2024-09-17T03:13:37.170824+0000","last_peered":"2024-09-17T03:13:37.170824+0000","last_clean":"2024-09-17T03:13:37.170824+0000","last_became_active":"2024-09-17T03:13:35.146813+0000","last_became_peered":"2024-09-17T03:13:35.146813+0000","last_unstale":"2024-09-17T03:13:37.170824+0000","last_undegraded":"2024-09-17T03:13:37.170824+0000","last_fullsized":"2024-09-17T03:13:37.170824+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:33:34.868836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.276763+0000","last_change":"2024-09-17T03:13:36.167033+0000","last_active":"2024-09-17T03:13:37.276763+0000","last_peered":"2024-09-17T03:13:37.276763+0000","last_clean":"2024-09-17T03:13:37.276763+0000","last_became_active":"2024-09-17T03:13:36.166686+0000","last_became_peered":"2024-09-17T03:13:36.166686+0000","last_unstale":"2024-09-17T03:13:37.276763+0000","last_undegraded":"2024-09-17T03:13:37.276763+0000","last_fullsized":"2024-09-17T03:13:37.276763+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:20.910302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275342+0000","last_change":"2024-09-17T03:13:35.148416+0000","last_active":"2024-09-17T03:13:37.275342+0000","last_peered":"2024-09-17T03:13:37.275342+0000","last_clean":"2024-09-17T03:13:37.275342+0000","last_became_active":"2024-09-17T03:13:35.147902+0000","last_became_peered":"2024-09-17T03:13:35.147902+0000","last_unstale":"2024-09-17T03:13:37.275342+0000","last_undegraded":"2024-09-17T03:13:37.275342+0000","last_fullsized":"2024-09-17T03:13:37.275342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:03:53.553162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.170490+0000","last_change":"2024-09-17T03:13:36.172337+0000","last_active":"2024-09-17T03:13:37.170490+0000","last_peered":"2024-09-17T03:13:37.170490+0000","last_clean":"2024-09-17T03:13:37.170490+0000","last_became_active":"2024-09-17T03:13:36.172033+0000","last_became_peered":"2024-09-17T03:13:36.172033+0000","last_unstale":"2024-09-17T03:13:37.170490+0000","last_undegraded":"2024-09-17T03:13:37.170490+0000","last_fullsized":"2024-09-17T03:13:37.170490+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:59:04.710334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275640+0000","last_change":"2024-09-17T03:13:35.145883+0000","last_active":"2024-09-17T03:13:37.275640+0000","last_peered":"2024-09-17T03:13:37.275640+0000","last_clean":"2024-09-17T03:13:37.275640+0000","last_became_active":"2024-09-17T03:13:35.145485+0000","last_became_peered":"2024-09-17T03:13:35.145485+0000","last_unstale":"2024-09-17T03:13:37.275640+0000","last_undegraded":"2024-09-17T03:13:37.275640+0000","last_fullsized":"2024-09-17T03:13:37.275640+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:33.828573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.170444+0000","last_change":"2024-09-17T03:13:36.162558+0000","last_active":"2024-09-17T03:13:37.170444+0000","last_peered":"2024-09-17T03:13:37.170444+0000","last_clean":"2024-09-17T03:13:37.170444+0000","last_became_active":"2024-09-17T03:13:36.162263+0000","last_became_peered":"2024-09-17T03:13:36.162263+0000","last_unstale":"2024-09-17T03:13:37.170444+0000","last_undegraded":"2024-09-17T03:13:37.170444+0000","last_fullsized":"2024-09-17T03:13:37.170444+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:34:11.781392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"81'8","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166461+0000","last_change":"2024-09-17T03:13:35.147811+0000","last_active":"2024-09-17T03:13:37.166461+0000","last_peered":"2024-09-17T03:13:37.166461+0000","last_clean":"2024-09-17T03:13:37.166461+0000","last_became_active":"2024-09-17T03:13:35.147540+0000","last_became_peered":"2024-09-17T03:13:35.147540+0000","last_unstale":"2024-09-17T03:13:37.166461+0000","last_undegraded":"2024-09-17T03:13:37.166461+0000","last_fullsized":"2024-09-17T03:13:37.166461+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:34:21.660023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.276649+0000","last_change":"2024-09-17T03:13:36.160764+0000","last_active":"2024-09-17T03:13:37.276649+0000","last_peered":"2024-09-17T03:13:37.276649+0000","last_clean":"2024-09-17T03:13:37.276649+0000","last_became_active":"2024-09-17T03:13:36.160458+0000","last_became_peered":"2024-09-17T03:13:36.160458+0000","last_unstale":"2024-09-17T03:13:37.276649+0000","last_undegraded":"2024-09-17T03:13:37.276649+0000","last_fullsized":"2024-09-17T03:13:37.276649+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:44.679394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"81'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.167054+0000","last_change":"2024-09-17T03:13:35.146348+0000","last_active":"2024-09-17T03:13:37.167054+0000","last_peered":"2024-09-17T03:13:37.167054+0000","last_clean":"2024-09-17T03:13:37.167054+0000","last_became_active":"2024-09-17T03:13:35.145718+0000","last_became_peered":"2024-09-17T03:13:35.145718+0000","last_unstale":"2024-09-17T03:13:37.167054+0000","last_undegraded":"2024-09-17T03:13:37.167054+0000","last_fullsized":"2024-09-17T03:13:37.167054+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:39.536551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166783+0000","last_change":"2024-09-17T03:13:36.158379+0000","last_active":"2024-09-17T03:13:37.166783+0000","last_peered":"2024-09-17T03:13:37.166783+0000","last_clean":"2024-09-17T03:13:37.166783+0000","last_became_active":"2024-09-17T03:13:36.157894+0000","last_became_peered":"2024-09-17T03:13:36.157894+0000","last_unstale":"2024-09-17T03:13:37.166783+0000","last_undegraded":"2024-09-17T03:13:37.166783+0000","last_fullsized":"2024-09-17T03:13:37.166783+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:49.798484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"81'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166855+0000","last_change":"2024-09-17T03:13:35.148036+0000","last_active":"2024-09-17T03:13:37.166855+0000","last_peered":"2024-09-17T03:13:37.166855+0000","last_clean":"2024-09-17T03:13:37.166855+0000","last_became_active":"2024-09-17T03:13:35.147436+0000","last_became_peered":"2024-09-17T03:13:35.147436+0000","last_unstale":"2024-09-17T03:13:37.166855+0000","last_undegraded":"2024-09-17T03:13:37.166855+0000","last_fullsized":"2024-09-17T03:13:37.166855+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:27:37.475359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.167363+0000","last_change":"2024-09-17T03:13:36.167162+0000","last_active":"2024-09-17T03:13:37.167363+0000","last_peered":"2024-09-17T03:13:37.167363+0000","last_clean":"2024-09-17T03:13:37.167363+0000","last_became_active":"2024-09-17T03:13:36.166834+0000","last_became_peered":"2024-09-17T03:13:36.166834+0000","last_unstale":"2024-09-17T03:13:37.167363+0000","last_undegraded":"2024-09-17T03:13:37.167363+0000","last_fullsized":"2024-09-17T03:13:37.167363+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:39:07.609432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166876+0000","last_change":"2024-09-17T03:13:35.150447+0000","last_active":"2024-09-17T03:13:37.166876+0000","last_peered":"2024-09-17T03:13:37.166876+0000","last_clean":"2024-09-17T03:13:37.166876+0000","last_became_active":"2024-09-17T03:13:35.150117+0000","last_became_peered":"2024-09-17T03:13:35.150117+0000","last_unstale":"2024-09-17T03:13:37.166876+0000","last_undegraded":"2024-09-17T03:13:37.166876+0000","last_fullsized":"2024-09-17T03:13:37.166876+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:03.128187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275655+0000","last_change":"2024-09-17T03:13:36.169959+0000","last_active":"2024-09-17T03:13:37.275655+0000","last_peered":"2024-09-17T03:13:37.275655+0000","last_clean":"2024-09-17T03:13:37.275655+0000","last_became_active":"2024-09-17T03:13:36.169633+0000","last_became_peered":"2024-09-17T03:13:36.169633+0000","last_unstale":"2024-09-17T03:13:37.275655+0000","last_undegraded":"2024-09-17T03:13:37.275655+0000","last_fullsized":"2024-09-17T03:13:37.275655+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:15:20.231911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"81'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275792+0000","last_change":"2024-09-17T03:13:35.150519+0000","last_active":"2024-09-17T03:13:37.275792+0000","last_peered":"2024-09-17T03:13:37.275792+0000","last_clean":"2024-09-17T03:13:37.275792+0000","last_became_active":"2024-09-17T03:13:35.150226+0000","last_became_peered":"2024-09-17T03:13:35.150226+0000","last_unstale":"2024-09-17T03:13:37.275792+0000","last_undegraded":"2024-09-17T03:13:37.275792+0000","last_fullsized":"2024-09-17T03:13:37.275792+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:26.002514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275928+0000","last_change":"2024-09-17T03:13:36.158573+0000","last_active":"2024-09-17T03:13:37.275928+0000","last_peered":"2024-09-17T03:13:37.275928+0000","last_clean":"2024-09-17T03:13:37.275928+0000","last_became_active":"2024-09-17T03:13:36.158208+0000","last_became_peered":"2024-09-17T03:13:36.158208+0000","last_unstale":"2024-09-17T03:13:37.275928+0000","last_undegraded":"2024-09-17T03:13:37.275928+0000","last_fullsized":"2024-09-17T03:13:37.275928+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:32.691348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275830+0000","last_change":"2024-09-17T03:13:35.148924+0000","last_active":"2024-09-17T03:13:37.275830+0000","last_peered":"2024-09-17T03:13:37.275830+0000","last_clean":"2024-09-17T03:13:37.275830+0000","last_became_active":"2024-09-17T03:13:35.148637+0000","last_became_peered":"2024-09-17T03:13:35.148637+0000","last_unstale":"2024-09-17T03:13:37.275830+0000","last_undegraded":"2024-09-17T03:13:37.275830+0000","last_fullsized":"2024-09-17T03:13:37.275830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:35.581909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275331+0000","last_change":"2024-09-17T03:13:36.162958+0000","last_active":"2024-09-17T03:13:37.275331+0000","last_peered":"2024-09-17T03:13:37.275331+0000","last_clean":"2024-09-17T03:13:37.275331+0000","last_became_active":"2024-09-17T03:13:36.162656+0000","last_became_peered":"2024-09-17T03:13:36.162656+0000","last_unstale":"2024-09-17T03:13:37.275331+0000","last_undegraded":"2024-09-17T03:13:37.275331+0000","last_fullsized":"2024-09-17T03:13:37.275331+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:17.148227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275574+0000","last_change":"2024-09-17T03:13:35.142641+0000","last_active":"2024-09-17T03:13:37.275574+0000","last_peered":"2024-09-17T03:13:37.275574+0000","last_clean":"2024-09-17T03:13:37.275574+0000","last_became_active":"2024-09-17T03:13:35.142331+0000","last_became_peered":"2024-09-17T03:13:35.142331+0000","last_unstale":"2024-09-17T03:13:37.275574+0000","last_undegraded":"2024-09-17T03:13:37.275574+0000","last_fullsized":"2024-09-17T03:13:37.275574+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:06.927325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275646+0000","last_change":"2024-09-17T03:13:36.167894+0000","last_active":"2024-09-17T03:13:37.275646+0000","last_peered":"2024-09-17T03:13:37.275646+0000","last_clean":"2024-09-17T03:13:37.275646+0000","last_became_active":"2024-09-17T03:13:36.167509+0000","last_became_peered":"2024-09-17T03:13:36.167509+0000","last_unstale":"2024-09-17T03:13:37.275646+0000","last_undegraded":"2024-09-17T03:13:37.275646+0000","last_fullsized":"2024-09-17T03:13:37.275646+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:57.043310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275150+0000","last_change":"2024-09-17T03:13:35.150284+0000","last_active":"2024-09-17T03:13:37.275150+0000","last_peered":"2024-09-17T03:13:37.275150+0000","last_clean":"2024-09-17T03:13:37.275150+0000","last_became_active":"2024-09-17T03:13:35.149842+0000","last_became_peered":"2024-09-17T03:13:35.149842+0000","last_unstale":"2024-09-17T03:13:37.275150+0000","last_undegraded":"2024-09-17T03:13:37.275150+0000","last_fullsized":"2024-09-17T03:13:37.275150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:04.403550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.168712+0000","last_change":"2024-09-17T03:13:36.169746+0000","last_active":"2024-09-17T03:13:37.168712+0000","last_peered":"2024-09-17T03:13:37.168712+0000","last_clean":"2024-09-17T03:13:37.168712+0000","last_became_active":"2024-09-17T03:13:36.169430+0000","last_became_peered":"2024-09-17T03:13:36.169430+0000","last_unstale":"2024-09-17T03:13:37.168712+0000","last_undegraded":"2024-09-17T03:13:37.168712+0000","last_fullsized":"2024-09-17T03:13:37.168712+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:24.177943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"81'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.170797+0000","last_change":"2024-09-17T03:13:35.145283+0000","last_active":"2024-09-17T03:13:37.170797+0000","last_peered":"2024-09-17T03:13:37.170797+0000","last_clean":"2024-09-17T03:13:37.170797+0000","last_became_active":"2024-09-17T03:13:35.144986+0000","last_became_peered":"2024-09-17T03:13:35.144986+0000","last_unstale":"2024-09-17T03:13:37.170797+0000","last_undegraded":"2024-09-17T03:13:37.170797+0000","last_fullsized":"2024-09-17T03:13:37.170797+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:50.213189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.276834+0000","last_change":"2024-09-17T03:13:36.164579+0000","last_active":"2024-09-17T03:13:37.276834+0000","last_peered":"2024-09-17T03:13:37.276834+0000","last_clean":"2024-09-17T03:13:37.276834+0000","last_became_active":"2024-09-17T03:13:36.164264+0000","last_became_peered":"2024-09-17T03:13:36.164264+0000","last_unstale":"2024-09-17T03:13:37.276834+0000","last_undegraded":"2024-09-17T03:13:37.276834+0000","last_fullsized":"2024-09-17T03:13:37.276834+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:38:33.438712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"82'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.170879+0000","last_change":"2024-09-17T03:13:35.148815+0000","last_active":"2024-09-17T03:13:37.170879+0000","last_peered":"2024-09-17T03:13:37.170879+0000","last_clean":"2024-09-17T03:13:37.170879+0000","last_became_active":"2024-09-17T03:13:35.148507+0000","last_became_peered":"2024-09-17T03:13:35.148507+0000","last_unstale":"2024-09-17T03:13:37.170879+0000","last_undegraded":"2024-09-17T03:13:37.170879+0000","last_fullsized":"2024-09-17T03:13:37.170879+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:12.011558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.168445+0000","last_change":"2024-09-17T03:13:36.161389+0000","last_active":"2024-09-17T03:13:37.168445+0000","last_peered":"2024-09-17T03:13:37.168445+0000","last_clean":"2024-09-17T03:13:37.168445+0000","last_became_active":"2024-09-17T03:13:36.161086+0000","last_became_peered":"2024-09-17T03:13:36.161086+0000","last_unstale":"2024-09-17T03:13:37.168445+0000","last_undegraded":"2024-09-17T03:13:37.168445+0000","last_fullsized":"2024-09-17T03:13:37.168445+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:13.420082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.168200+0000","last_change":"2024-09-17T03:13:35.146844+0000","last_active":"2024-09-17T03:13:37.168200+0000","last_peered":"2024-09-17T03:13:37.168200+0000","last_clean":"2024-09-17T03:13:37.168200+0000","last_became_active":"2024-09-17T03:13:35.146239+0000","last_became_peered":"2024-09-17T03:13:35.146239+0000","last_unstale":"2024-09-17T03:13:37.168200+0000","last_undegraded":"2024-09-17T03:13:37.168200+0000","last_fullsized":"2024-09-17T03:13:37.168200+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:16.862049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.167453+0000","last_change":"2024-09-17T03:13:36.169810+0000","last_active":"2024-09-17T03:13:37.167453+0000","last_peered":"2024-09-17T03:13:37.167453+0000","last_clean":"2024-09-17T03:13:37.167453+0000","last_became_active":"2024-09-17T03:13:36.169472+0000","last_became_peered":"2024-09-17T03:13:36.169472+0000","last_unstale":"2024-09-17T03:13:37.167453+0000","last_undegraded":"2024-09-17T03:13:37.167453+0000","last_fullsized":"2024-09-17T03:13:37.167453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:25.556599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.168653+0000","last_change":"2024-09-17T03:13:35.149436+0000","last_active":"2024-09-17T03:13:37.168653+0000","last_peered":"2024-09-17T03:13:37.168653+0000","last_clean":"2024-09-17T03:13:37.168653+0000","last_became_active":"2024-09-17T03:13:35.147481+0000","last_became_peered":"2024-09-17T03:13:35.147481+0000","last_unstale":"2024-09-17T03:13:37.168653+0000","last_undegraded":"2024-09-17T03:13:37.168653+0000","last_fullsized":"2024-09-17T03:13:37.168653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:09.546632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.275733+0000","last_change":"2024-09-17T03:13:36.158743+0000","last_active":"2024-09-17T03:13:37.275733+0000","last_peered":"2024-09-17T03:13:37.275733+0000","last_clean":"2024-09-17T03:13:37.275733+0000","last_became_active":"2024-09-17T03:13:36.158441+0000","last_became_peered":"2024-09-17T03:13:36.158441+0000","last_unstale":"2024-09-17T03:13:37.275733+0000","last_undegraded":"2024-09-17T03:13:37.275733+0000","last_fullsized":"2024-09-17T03:13:37.275733+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:04.660596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.167087+0000","last_change":"2024-09-17T03:13:35.145764+0000","last_active":"2024-09-17T03:13:37.167087+0000","last_peered":"2024-09-17T03:13:37.167087+0000","last_clean":"2024-09-17T03:13:37.167087+0000","last_became_active":"2024-09-17T03:13:35.145453+0000","last_became_peered":"2024-09-17T03:13:35.145453+0000","last_unstale":"2024-09-17T03:13:37.167087+0000","last_undegraded":"2024-09-17T03:13:37.167087+0000","last_fullsized":"2024-09-17T03:13:37.167087+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:04.680766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166919+0000","last_change":"2024-09-17T03:13:36.178343+0000","last_active":"2024-09-17T03:13:37.166919+0000","last_peered":"2024-09-17T03:13:37.166919+0000","last_clean":"2024-09-17T03:13:37.166919+0000","last_became_active":"2024-09-17T03:13:36.178044+0000","last_became_peered":"2024-09-17T03:13:36.178044+0000","last_unstale":"2024-09-17T03:13:37.166919+0000","last_undegraded":"2024-09-17T03:13:37.166919+0000","last_fullsized":"2024-09-17T03:13:37.166919+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:28:44.679394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166859+0000","last_change":"2024-09-17T03:13:35.149928+0000","last_active":"2024-09-17T03:13:37.166859+0000","last_peered":"2024-09-17T03:13:37.166859+0000","last_clean":"2024-09-17T03:13:37.166859+0000","last_became_active":"2024-09-17T03:13:35.149571+0000","last_became_peered":"2024-09-17T03:13:35.149571+0000","last_unstale":"2024-09-17T03:13:37.166859+0000","last_undegraded":"2024-09-17T03:13:37.166859+0000","last_fullsized":"2024-09-17T03:13:37.166859+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:32.720660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.276435+0000","last_change":"2024-09-17T03:13:36.166632+0000","last_active":"2024-09-17T03:13:37.276435+0000","last_peered":"2024-09-17T03:13:37.276435+0000","last_clean":"2024-09-17T03:13:37.276435+0000","last_became_active":"2024-09-17T03:13:36.166308+0000","last_became_peered":"2024-09-17T03:13:36.166308+0000","last_unstale":"2024-09-17T03:13:37.276435+0000","last_undegraded":"2024-09-17T03:13:37.276435+0000","last_fullsized":"2024-09-17T03:13:37.276435+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:31.622764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.167908+0000","last_change":"2024-09-17T03:13:35.148824+0000","last_active":"2024-09-17T03:13:37.167908+0000","last_peered":"2024-09-17T03:13:37.167908+0000","last_clean":"2024-09-17T03:13:37.167908+0000","last_became_active":"2024-09-17T03:13:35.148417+0000","last_became_peered":"2024-09-17T03:13:35.148417+0000","last_unstale":"2024-09-17T03:13:37.167908+0000","last_undegraded":"2024-09-17T03:13:37.167908+0000","last_fullsized":"2024-09-17T03:13:37.167908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:58.224149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.167693+0000","last_change":"2024-09-17T03:13:36.163897+0000","last_active":"2024-09-17T03:13:37.167693+0000","last_peered":"2024-09-17T03:13:37.167693+0000","last_clean":"2024-09-17T03:13:37.167693+0000","last_became_active":"2024-09-17T03:13:36.163275+0000","last_became_peered":"2024-09-17T03:13:36.163275+0000","last_unstale":"2024-09-17T03:13:37.167693+0000","last_undegraded":"2024-09-17T03:13:37.167693+0000","last_fullsized":"2024-09-17T03:13:37.167693+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:00:11.560445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.166685+0000","last_change":"2024-09-17T03:13:35.142421+0000","last_active":"2024-09-17T03:13:37.166685+0000","last_peered":"2024-09-17T03:13:37.166685+0000","last_clean":"2024-09-17T03:13:37.166685+0000","last_became_active":"2024-09-17T03:13:35.142113+0000","last_became_peered":"2024-09-17T03:13:35.142113+0000","last_unstale":"2024-09-17T03:13:37.166685+0000","last_undegraded":"2024-09-17T03:13:37.166685+0000","last_fullsized":"2024-09-17T03:13:37.166685+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:12.371249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.171129+0000","last_change":"2024-09-17T03:13:36.166539+0000","last_active":"2024-09-17T03:13:37.171129+0000","last_peered":"2024-09-17T03:13:37.171129+0000","last_clean":"2024-09-17T03:13:37.171129+0000","last_became_active":"2024-09-17T03:13:36.166189+0000","last_became_peered":"2024-09-17T03:13:36.166189+0000","last_unstale":"2024-09-17T03:13:37.171129+0000","last_undegraded":"2024-09-17T03:13:37.171129+0000","last_fullsized":"2024-09-17T03:13:37.171129+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:35.124535+0000","last_clean_scrub_stamp":"2024-09-17T03:13:35.124535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:51.140405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"81'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.276878+0000","last_change":"2024-09-17T03:13:35.148171+0000","last_active":"2024-09-17T03:13:37.276878+0000","last_peered":"2024-09-17T03:13:37.276878+0000","last_clean":"2024-09-17T03:13:37.276878+0000","last_became_active":"2024-09-17T03:13:35.147822+0000","last_became_peered":"2024-09-17T03:13:35.147822+0000","last_unstale":"2024-09-17T03:13:37.276878+0000","last_undegraded":"2024-09-17T03:13:37.276878+0000","last_fullsized":"2024-09-17T03:13:37.276878+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:13:34.119387+0000","last_clean_scrub_stamp":"2024-09-17T03:13:34.119387+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:49:17.971173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":218,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-17T03:13:37.276684+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:13:37.276684+0000","last_peered":"2024-09-17T03:13:37.276684+0000","last_clean":"2024-09-17T03:13:37.276684+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:13:37.276684+0000","last_undegraded":"2024-09-17T03:13:37.276684+0000","last_fullsized":"2024-09-17T03:13:37.276684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509509,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28588,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343252,"statfs":{"total":96636764160,"available":96607490048,"internally_reserved":0,"allocated":1597440,"data_stored":1016829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509509,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1011712,"data_stored":427085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509508,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1015808,"data_stored":428025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509509,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":999424,"data_stored":426391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509510,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1003520,"data_stored":426973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509509,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1011712,"data_stored":426585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509509,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32756,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339084,"statfs":{"total":96636764160,"available":96603222016,"internally_reserved":0,"allocated":1597440,"data_stored":1016793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1011712,"data_stored":428003,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:13:43.952 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:13:43.952 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:13:44.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.110+0000 7f8d356de640 1 -- 172.21.15.78:0/233207330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c004800 msgr2=0x7f8d1c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:44.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.110+0000 7f8d356de640 1 --2- 172.21.15.78:0/233207330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c004800 0x7f8d1c004c10 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f8d180016c0 tx=0x7f8d1c005830 comp rx=0 tx=0).stop 2024-09-17T03:13:44.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.110+0000 7f8d356de640 1 -- 172.21.15.78:0/233207330 shutdown_connections 2024-09-17T03:13:44.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.110+0000 7f8d356de640 1 --2- 172.21.15.78:0/233207330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c004800 0x7f8d1c004c10 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:44.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.111+0000 7f8d356de640 1 -- 172.21.15.78:0/233207330 >> 172.21.15.78:0/233207330 conn(0x7f8d3009d830 msgr2=0x7f8d300d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:44.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.111+0000 7f8d356de640 1 -- 172.21.15.78:0/233207330 shutdown_connections 2024-09-17T03:13:44.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.111+0000 7f8d356de640 1 -- 172.21.15.78:0/233207330 wait complete. 2024-09-17T03:13:44.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.112+0000 7f8d356de640 1 Processor -- start 2024-09-17T03:13:44.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.113+0000 7f8d356de640 1 -- start start 2024-09-17T03:13:44.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.114+0000 7f8d356de640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c004800 0x7f8d300ba8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:44.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.114+0000 7f8d356de640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8d3015fc30 0x7f8d300b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:44.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.114+0000 7f8d356de640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d300a1330 0x7f8d300a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:44.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.114+0000 7f8d356de640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8d300d3360 con 0x7f8d1c004800 2024-09-17T03:13:44.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.114+0000 7f8d356de640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8d300d31e0 con 0x7f8d300a1330 2024-09-17T03:13:44.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.114+0000 7f8d356de640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8d300d34e0 con 0x7f8d3015fc30 2024-09-17T03:13:44.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.114+0000 7f8d2effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c004800 0x7f8d300ba8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:44.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.114+0000 7f8d2effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c004800 0x7f8d300ba8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39582/0 (socket says 172.21.15.78:39582) 2024-09-17T03:13:44.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.114+0000 7f8d2effd640 1 -- 172.21.15.78:0/2505770293 learned_addr learned my addr 172.21.15.78:0/2505770293 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:44.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.114+0000 7f8d2effd640 1 -- 172.21.15.78:0/2505770293 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8d3015fc30 msgr2=0x7f8d300b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:44.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.114+0000 7f8d2effd640 1 --2- 172.21.15.78:0/2505770293 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8d3015fc30 0x7f8d300b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:44.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.114+0000 7f8d2effd640 1 -- 172.21.15.78:0/2505770293 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d300a1330 msgr2=0x7f8d300a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.114+0000 7f8d2effd640 1 --2- 172.21.15.78:0/2505770293 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d300a1330 0x7f8d300a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.114+0000 7f8d2effd640 1 -- 172.21.15.78:0/2505770293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d300a1c80 con 0x7f8d1c004800 2024-09-17T03:13:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.114+0000 7f8d2effd640 1 --2- 172.21.15.78:0/2505770293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c004800 0x7f8d300ba8d0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f8d200119b0 tx=0x7f8d20011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.114+0000 7f8d27fff640 1 -- 172.21.15.78:0/2505770293 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2001f070 con 0x7f8d1c004800 2024-09-17T03:13:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.114+0000 7f8d27fff640 1 -- 172.21.15.78:0/2505770293 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d2000fde0 con 0x7f8d1c004800 2024-09-17T03:13:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.114+0000 7f8d356de640 1 -- 172.21.15.78:0/2505770293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d301f6a60 con 0x7f8d1c004800 2024-09-17T03:13:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.115+0000 7f8d27fff640 1 -- 172.21.15.78:0/2505770293 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d200126b0 con 0x7f8d1c004800 2024-09-17T03:13:44.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.115+0000 7f8d356de640 1 -- 172.21.15.78:0/2505770293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d301f6440 con 0x7f8d1c004800 2024-09-17T03:13:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.115+0000 7f8d356de640 1 -- 172.21.15.78:0/2505770293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d300b6490 con 0x7f8d1c004800 2024-09-17T03:13:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.116+0000 7f8d27fff640 1 -- 172.21.15.78:0/2505770293 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8d20022070 con 0x7f8d1c004800 2024-09-17T03:13:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.117+0000 7f8d27fff640 1 --2- 172.21.15.78:0/2505770293 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8d10078b90 0x7f8d1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.117+0000 7f8d27fff640 1 -- 172.21.15.78:0/2505770293 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f8d2009b7d0 con 0x7f8d1c004800 2024-09-17T03:13:44.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.117+0000 7f8d267fc640 1 --2- 172.21.15.78:0/2505770293 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8d10078b90 0x7f8d1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:44.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.118+0000 7f8d267fc640 1 --2- 172.21.15.78:0/2505770293 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8d10078b90 0x7f8d1007b0a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8d18032000 tx=0x7f8d18001120 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:44.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.121+0000 7f8d27fff640 1 -- 172.21.15.78:0/2505770293 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8d300a1c80 con 0x7f8d1c004800 2024-09-17T03:13:44.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.372+0000 7f8d356de640 1 -- 172.21.15.78:0/2505770293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f8d30076150 con 0x7f8d1c004800 2024-09-17T03:13:44.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.377+0000 7f8d27fff640 1 -- 172.21.15.78:0/2505770293 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f8d200636e0 con 0x7f8d1c004800 2024-09-17T03:13:44.375 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2024-09-17T03:13:44.375 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBv8uhmn+c/IxAALXG+Qkwye7zc6PjcLBsk1g== 2024-09-17T03:13:44.376 INFO:teuthology.orchestra.run.smithi078.stdout: caps mds = "allow" 2024-09-17T03:13:44.376 INFO:teuthology.orchestra.run.smithi078.stdout: caps mon = "allow r" 2024-09-17T03:13:44.376 INFO:teuthology.orchestra.run.smithi078.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:13:44.376 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2024-09-17T03:13:44.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.379+0000 7f8d356de640 1 -- 172.21.15.78:0/2505770293 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8d10078b90 msgr2=0x7f8d1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:44.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.379+0000 7f8d356de640 1 --2- 172.21.15.78:0/2505770293 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8d10078b90 0x7f8d1007b0a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f8d18032000 tx=0x7f8d18001120 comp rx=0 tx=0).stop 2024-09-17T03:13:44.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.379+0000 7f8d356de640 1 -- 172.21.15.78:0/2505770293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c004800 msgr2=0x7f8d300ba8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:44.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.379+0000 7f8d356de640 1 --2- 172.21.15.78:0/2505770293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c004800 0x7f8d300ba8d0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f8d200119b0 tx=0x7f8d20011e70 comp rx=0 tx=0).stop 2024-09-17T03:13:44.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.379+0000 7f8d356de640 1 -- 172.21.15.78:0/2505770293 shutdown_connections 2024-09-17T03:13:44.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.379+0000 7f8d356de640 1 --2- 172.21.15.78:0/2505770293 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8d10078b90 0x7f8d1007b0a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:44.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.379+0000 7f8d356de640 1 --2- 172.21.15.78:0/2505770293 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8d300a1330 0x7f8d300a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:44.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.379+0000 7f8d356de640 1 --2- 172.21.15.78:0/2505770293 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8d3015fc30 0x7f8d300b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:44.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.379+0000 7f8d356de640 1 --2- 172.21.15.78:0/2505770293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d1c004800 0x7f8d300ba8d0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:44.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.379+0000 7f8d356de640 1 -- 172.21.15.78:0/2505770293 >> 172.21.15.78:0/2505770293 conn(0x7f8d3009d830 msgr2=0x7f8d3006e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:44.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.379+0000 7f8d356de640 1 -- 172.21.15.78:0/2505770293 shutdown_connections 2024-09-17T03:13:44.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.379+0000 7f8d356de640 1 -- 172.21.15.78:0/2505770293 wait complete. 2024-09-17T03:13:44.389 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:13:44.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.503+0000 7f8b585e6640 1 -- 172.21.15.78:0/2703042579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b3c004d40 msgr2=0x7f8b3c0051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:44.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.503+0000 7f8b585e6640 1 --2- 172.21.15.78:0/2703042579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b3c004d40 0x7f8b3c0051f0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f8b500cb830 tx=0x7f8b3c005830 comp rx=0 tx=0).stop 2024-09-17T03:13:44.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.503+0000 7f8b56b83640 1 -- 172.21.15.78:0/2703042579 reap_dead start 2024-09-17T03:13:44.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.503+0000 7f8b585e6640 1 -- 172.21.15.78:0/2703042579 shutdown_connections 2024-09-17T03:13:44.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.503+0000 7f8b585e6640 1 -- 172.21.15.78:0/2703042579 >> 172.21.15.78:0/2703042579 conn(0x7f8b500cdcb0 msgr2=0x7f8b500ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:44.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.503+0000 7f8b585e6640 1 -- 172.21.15.78:0/2703042579 shutdown_connections 2024-09-17T03:13:44.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.503+0000 7f8b585e6640 1 -- 172.21.15.78:0/2703042579 wait complete. 2024-09-17T03:13:44.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.505+0000 7f8b585e6640 1 Processor -- start 2024-09-17T03:13:44.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.505+0000 7f8b585e6640 1 -- start start 2024-09-17T03:13:44.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.506+0000 7f8b585e6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b3c004d40 0x7f8b501f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:44.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.506+0000 7f8b585e6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b50152b00 0x7f8b5006cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:44.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.506+0000 7f8b585e6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5006d500 0x7f8b5009d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:44.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.506+0000 7f8b585e6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8b500adfa0 con 0x7f8b5006d500 2024-09-17T03:13:44.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.506+0000 7f8b585e6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8b500cf3c0 con 0x7f8b3c004d40 2024-09-17T03:13:44.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.506+0000 7f8b585e6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8b500ae120 con 0x7f8b50152b00 2024-09-17T03:13:44.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.506+0000 7f8b56b83640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5006d500 0x7f8b5009d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:44.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.506+0000 7f8b56b83640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5006d500 0x7f8b5009d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39596/0 (socket says 172.21.15.78:39596) 2024-09-17T03:13:44.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.506+0000 7f8b56b83640 1 -- 172.21.15.78:0/2649380742 learned_addr learned my addr 172.21.15.78:0/2649380742 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:44.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.506+0000 7f8b56382640 1 --2- 172.21.15.78:0/2649380742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b3c004d40 0x7f8b501f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:44.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.506+0000 7f8b55b81640 1 --2- 172.21.15.78:0/2649380742 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b50152b00 0x7f8b5006cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:44.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.506+0000 7f8b56b83640 1 -- 172.21.15.78:0/2649380742 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b50152b00 msgr2=0x7f8b5006cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:44.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.506+0000 7f8b56b83640 1 --2- 172.21.15.78:0/2649380742 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b50152b00 0x7f8b5006cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:44.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.506+0000 7f8b56b83640 1 -- 172.21.15.78:0/2649380742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b3c004d40 msgr2=0x7f8b501f6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:44.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.506+0000 7f8b56b83640 1 --2- 172.21.15.78:0/2649380742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b3c004d40 0x7f8b501f6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:44.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.506+0000 7f8b56b83640 1 -- 172.21.15.78:0/2649380742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b501f7610 con 0x7f8b5006d500 2024-09-17T03:13:44.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.506+0000 7f8b56b83640 1 --2- 172.21.15.78:0/2649380742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5006d500 0x7f8b5009d330 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800c6d0 tx=0x7f8b48003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:44.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.507+0000 7f8b46ffd640 1 -- 172.21.15.78:0/2649380742 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b48039070 con 0x7f8b5006d500 2024-09-17T03:13:44.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.507+0000 7f8b46ffd640 1 -- 172.21.15.78:0/2649380742 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b4802ba50 con 0x7f8b5006d500 2024-09-17T03:13:44.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.507+0000 7f8b46ffd640 1 -- 172.21.15.78:0/2649380742 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b48034680 con 0x7f8b5006d500 2024-09-17T03:13:44.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.507+0000 7f8b585e6640 1 -- 172.21.15.78:0/2649380742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b501f78f0 con 0x7f8b5006d500 2024-09-17T03:13:44.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.507+0000 7f8b585e6640 1 -- 172.21.15.78:0/2649380742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b5014d5d0 con 0x7f8b5006d500 2024-09-17T03:13:44.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.508+0000 7f8b585e6640 1 -- 172.21.15.78:0/2649380742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b5014d830 con 0x7f8b5006d500 2024-09-17T03:13:44.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.508+0000 7f8b46ffd640 1 -- 172.21.15.78:0/2649380742 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8b48034820 con 0x7f8b5006d500 2024-09-17T03:13:44.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.509+0000 7f8b46ffd640 1 --2- 172.21.15.78:0/2649380742 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b34078b90 0x7f8b3407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:44.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.509+0000 7f8b46ffd640 1 -- 172.21.15.78:0/2649380742 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f8b480bb010 con 0x7f8b5006d500 2024-09-17T03:13:44.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.509+0000 7f8b56382640 1 --2- 172.21.15.78:0/2649380742 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b34078b90 0x7f8b3407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:44.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.510+0000 7f8b56382640 1 --2- 172.21.15.78:0/2649380742 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b34078b90 0x7f8b3407b0a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c009c50 tx=0x7f8b4c005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:44.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.513+0000 7f8b46ffd640 1 -- 172.21.15.78:0/2649380742 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8b48082ec0 con 0x7f8b5006d500 2024-09-17T03:13:44.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.721+0000 7f8b585e6640 1 -- 172.21.15.78:0/2649380742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b501f73a0 con 0x7f8b5006d500 2024-09-17T03:13:44.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.722+0000 7f8b46ffd640 1 -- 172.21.15.78:0/2649380742 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5231 (secure 0 0 0) 0x7f8b480878f0 con 0x7f8b5006d500 2024-09-17T03:13:44.721 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:44.721 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":76,"btime":"2024-09-17T03:13:38:163162+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/1005450673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1005450673},{"type":"v1","addr":"172.21.15.193:6837","nonce":1005450673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7425,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/4018023271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4018023271},{"type":"v1","addr":"172.21.15.78:6835","nonce":4018023271}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:35.489582+0000","modified":"2024-09-17T03:13:37.510616+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7428},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7428":{"gid":7428,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6832/3357123265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":3357123265},{"type":"v1","addr":"172.21.15.78:6832","nonce":3357123265}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7428,"qdb_cluster":[7428]},"id":6}]} 2024-09-17T03:13:44.721 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 76 2024-09-17T03:13:44.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.724+0000 7f8b585e6640 1 -- 172.21.15.78:0/2649380742 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b34078b90 msgr2=0x7f8b3407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:44.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.724+0000 7f8b585e6640 1 --2- 172.21.15.78:0/2649380742 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b34078b90 0x7f8b3407b0a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c009c50 tx=0x7f8b4c005f90 comp rx=0 tx=0).stop 2024-09-17T03:13:44.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.724+0000 7f8b585e6640 1 -- 172.21.15.78:0/2649380742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5006d500 msgr2=0x7f8b5009d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:44.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.724+0000 7f8b585e6640 1 --2- 172.21.15.78:0/2649380742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5006d500 0x7f8b5009d330 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800c6d0 tx=0x7f8b48003ba0 comp rx=0 tx=0).stop 2024-09-17T03:13:44.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.724+0000 7f8b585e6640 1 -- 172.21.15.78:0/2649380742 shutdown_connections 2024-09-17T03:13:44.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.724+0000 7f8b585e6640 1 --2- 172.21.15.78:0/2649380742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8b5006d500 0x7f8b5009d330 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:44.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.724+0000 7f8b585e6640 1 --2- 172.21.15.78:0/2649380742 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8b50152b00 0x7f8b5006cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:44.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.724+0000 7f8b585e6640 1 --2- 172.21.15.78:0/2649380742 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8b34078b90 0x7f8b3407b0a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:44.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.724+0000 7f8b585e6640 1 --2- 172.21.15.78:0/2649380742 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8b3c004d40 0x7f8b501f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:44.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.724+0000 7f8b585e6640 1 -- 172.21.15.78:0/2649380742 >> 172.21.15.78:0/2649380742 conn(0x7f8b500cdcb0 msgr2=0x7f8b500b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:44.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.724+0000 7f8b585e6640 1 -- 172.21.15.78:0/2649380742 shutdown_connections 2024-09-17T03:13:44.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:44.724+0000 7f8b585e6640 1 -- 172.21.15.78:0/2649380742 wait complete. 2024-09-17T03:13:45.138 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:13:35.489582+0000', 'modified': '2024-09-17T03:13:37.510616+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7428}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7428': {'gid': 7428, 'name': 'a', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6832/3357123265', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6833', 'nonce': 3357123265}, {'type': 'v1', 'addr': '172.21.15.78:6832', 'nonce': 3357123265}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7428, 'qdb_cluster': [7428]} 2024-09-17T03:13:45.138 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:13:45.138 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:13:45.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.255+0000 7f3eaba5c640 1 -- 172.21.15.78:0/875662793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea406e3c0 msgr2=0x7f3ea406f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:45.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.255+0000 7f3eaba5c640 1 --2- 172.21.15.78:0/875662793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea406e3c0 0x7f3ea406f7a0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40b70a0 tx=0x7f3e9402a530 comp rx=0 tx=0).stop 2024-09-17T03:13:45.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.255+0000 7f3eaba5c640 1 -- 172.21.15.78:0/875662793 shutdown_connections 2024-09-17T03:13:45.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.255+0000 7f3eaba5c640 1 --2- 172.21.15.78:0/875662793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea406e3c0 0x7f3ea406f7a0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.255+0000 7f3eaba5c640 1 --2- 172.21.15.78:0/875662793 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3ea40b3a60 0x7f3ea40cfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.255+0000 7f3eaba5c640 1 -- 172.21.15.78:0/875662793 >> 172.21.15.78:0/875662793 conn(0x7f3ea408bfc0 msgr2=0x7f3ea409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:45.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.255+0000 7f3eaba5c640 1 -- 172.21.15.78:0/875662793 shutdown_connections 2024-09-17T03:13:45.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.256+0000 7f3eaba5c640 1 -- 172.21.15.78:0/875662793 wait complete. 2024-09-17T03:13:45.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.257+0000 7f3eaba5c640 1 Processor -- start 2024-09-17T03:13:45.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.257+0000 7f3eaba5c640 1 -- start start 2024-09-17T03:13:45.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.259+0000 7f3eaba5c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ea406e3c0 0x7f3ea4155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.259+0000 7f3eaba5c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea40b3a60 0x7f3ea40ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.259+0000 7f3eaba5c640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3ea40d0e10 0x7f3ea40ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.259+0000 7f3eaba5c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea40d2d20 con 0x7f3ea40b3a60 2024-09-17T03:13:45.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.259+0000 7f3eaba5c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea40d2ba0 con 0x7f3ea406e3c0 2024-09-17T03:13:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.259+0000 7f3eaba5c640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3ea40d2ea0 con 0x7f3ea40d0e10 2024-09-17T03:13:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.259+0000 7f3ea8ff7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea40b3a60 0x7f3ea40ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.259+0000 7f3ea8ff7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea40b3a60 0x7f3ea40ca1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39626/0 (socket says 172.21.15.78:39626) 2024-09-17T03:13:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.259+0000 7f3ea8ff7640 1 -- 172.21.15.78:0/2278353625 learned_addr learned my addr 172.21.15.78:0/2278353625 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.259+0000 7f3ea9ff9640 1 --2- 172.21.15.78:0/2278353625 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3ea40d0e10 0x7f3ea40ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.259+0000 7f3ea97f8640 1 --2- 172.21.15.78:0/2278353625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ea406e3c0 0x7f3ea4155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.259+0000 7f3ea8ff7640 1 -- 172.21.15.78:0/2278353625 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3ea40d0e10 msgr2=0x7f3ea40ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.259+0000 7f3ea8ff7640 1 --2- 172.21.15.78:0/2278353625 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3ea40d0e10 0x7f3ea40ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.259+0000 7f3ea8ff7640 1 -- 172.21.15.78:0/2278353625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ea406e3c0 msgr2=0x7f3ea4155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.259+0000 7f3ea8ff7640 1 --2- 172.21.15.78:0/2278353625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ea406e3c0 0x7f3ea4155920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.259+0000 7f3ea8ff7640 1 -- 172.21.15.78:0/2278353625 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ea4155e60 con 0x7f3ea40b3a60 2024-09-17T03:13:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.259+0000 7f3ea8ff7640 1 --2- 172.21.15.78:0/2278353625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea40b3a60 0x7f3ea40ca1d0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f3e94000c00 tx=0x7f3e94003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.263+0000 7f3e99ffb640 1 -- 172.21.15.78:0/2278353625 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9403e030 con 0x7f3ea40b3a60 2024-09-17T03:13:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.263+0000 7f3e99ffb640 1 -- 172.21.15.78:0/2278353625 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e94003e00 con 0x7f3ea40b3a60 2024-09-17T03:13:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.263+0000 7f3eaba5c640 1 -- 172.21.15.78:0/2278353625 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ea415dc70 con 0x7f3ea40b3a60 2024-09-17T03:13:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.263+0000 7f3e99ffb640 1 -- 172.21.15.78:0/2278353625 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94035040 con 0x7f3ea40b3a60 2024-09-17T03:13:45.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.263+0000 7f3eaba5c640 1 -- 172.21.15.78:0/2278353625 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ea40b43e0 con 0x7f3ea40b3a60 2024-09-17T03:13:45.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.265+0000 7f3e99ffb640 1 -- 172.21.15.78:0/2278353625 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3e94041030 con 0x7f3ea40b3a60 2024-09-17T03:13:45.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.266+0000 7f3e99ffb640 1 --2- 172.21.15.78:0/2278353625 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3e88078bc0 0x7f3e8807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.266+0000 7f3e99ffb640 1 -- 172.21.15.78:0/2278353625 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f3e940bb690 con 0x7f3ea40b3a60 2024-09-17T03:13:45.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.266+0000 7f3ea97f8640 1 --2- 172.21.15.78:0/2278353625 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3e88078bc0 0x7f3e8807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:45.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.267+0000 7f3eb29ca740 1 Processor -- start 2024-09-17T03:13:45.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.267+0000 7f3eb29ca740 1 -- start start 2024-09-17T03:13:45.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.267+0000 7f3ea97f8640 1 --2- 172.21.15.78:0/2278353625 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3e88078bc0 0x7f3e8807b0d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3ea000bb50 tx=0x7f3ea000b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:45.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.268+0000 7f3eb29ca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559c9298270 0x5559c9669fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.268+0000 7f3eb29ca740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c926f3b0 0x5559c966a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.268+0000 7f3eb29ca740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5559c9277590 0x5559c96873e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.268+0000 7f3eb29ca740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5559c95b2820 con 0x5559c926f3b0 2024-09-17T03:13:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.268+0000 7f3eb29ca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5559c95a1c50 con 0x5559c9298270 2024-09-17T03:13:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.268+0000 7f3eb29ca740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5559c95a5a60 con 0x5559c9277590 2024-09-17T03:13:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.268+0000 7f3ea8ff7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c926f3b0 0x5559c966a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.268+0000 7f3ea8ff7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c926f3b0 0x5559c966a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39632/0 (socket says 172.21.15.78:39632) 2024-09-17T03:13:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.268+0000 7f3ea8ff7640 1 -- 172.21.15.78:0/106541729 learned_addr learned my addr 172.21.15.78:0/106541729 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.268+0000 7f3ea9ff9640 1 --2- 172.21.15.78:0/106541729 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5559c9277590 0x5559c96873e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.268+0000 7f3ea97f8640 1 --2- 172.21.15.78:0/106541729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559c9298270 0x5559c9669fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.268+0000 7f3ea8ff7640 1 -- 172.21.15.78:0/106541729 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5559c9277590 msgr2=0x5559c96873e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.268+0000 7f3ea8ff7640 1 --2- 172.21.15.78:0/106541729 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5559c9277590 0x5559c96873e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.268+0000 7f3ea8ff7640 1 -- 172.21.15.78:0/106541729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559c9298270 msgr2=0x5559c9669fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:45.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.268+0000 7f3ea8ff7640 1 --2- 172.21.15.78:0/106541729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559c9298270 0x5559c9669fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.268+0000 7f3ea8ff7640 1 -- 172.21.15.78:0/106541729 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559c9303850 con 0x5559c926f3b0 2024-09-17T03:13:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.269+0000 7f3ea8ff7640 1 --2- 172.21.15.78:0/106541729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c926f3b0 0x5559c966a4e0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f3e940b9c70 tx=0x7f3e940833f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b58c277d32e0994 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.269+0000 7f3e8effd640 1 -- 172.21.15.78:0/106541729 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94048040 con 0x5559c926f3b0 2024-09-17T03:13:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.269+0000 7f3e8effd640 1 -- 172.21.15.78:0/106541729 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e940835a0 con 0x5559c926f3b0 2024-09-17T03:13:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.269+0000 7f3e8effd640 1 -- 172.21.15.78:0/106541729 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94083a00 con 0x5559c926f3b0 2024-09-17T03:13:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.269+0000 7f3eb29ca740 1 -- 172.21.15.78:0/106541729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c926f3b0 msgr2=0x5559c966a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.269+0000 7f3eb29ca740 1 --2- 172.21.15.78:0/106541729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c926f3b0 0x5559c966a4e0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f3e940b9c70 tx=0x7f3e940833f0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.270+0000 7f3eb29ca740 1 -- 172.21.15.78:0/106541729 shutdown_connections 2024-09-17T03:13:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.270+0000 7f3eb29ca740 1 --2- 172.21.15.78:0/106541729 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5559c9277590 0x5559c96873e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.270+0000 7f3eb29ca740 1 --2- 172.21.15.78:0/106541729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c926f3b0 0x5559c966a4e0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.270+0000 7f3eb29ca740 1 --2- 172.21.15.78:0/106541729 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559c9298270 0x5559c9669fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.270+0000 7f3eb29ca740 1 -- 172.21.15.78:0/106541729 >> 172.21.15.78:0/106541729 conn(0x5559c928c3c0 msgr2=0x5559c9640260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:45.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.270+0000 7f3eb29ca740 1 -- 172.21.15.78:0/106541729 shutdown_connections 2024-09-17T03:13:45.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.270+0000 7f3eb29ca740 1 -- 172.21.15.78:0/106541729 wait complete. 2024-09-17T03:13:45.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.270+0000 7f3eb29ca740 1 -- start start 2024-09-17T03:13:45.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.271+0000 7f3eb29ca740 1 Processor -- start 2024-09-17T03:13:45.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.272+0000 7f3eb29ca740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5559c926f3b0 0x5559c96392a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.272+0000 7f3eb29ca740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9277590 0x5559c963f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.272+0000 7f3eb29ca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559c9298270 0x5559c963f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.272+0000 7f3eb29ca740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5559c9312620 con 0x5559c9277590 2024-09-17T03:13:45.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.272+0000 7f3eb29ca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5559c95475f0 con 0x5559c9298270 2024-09-17T03:13:45.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.272+0000 7f3eb29ca740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5559c9639930 con 0x5559c926f3b0 2024-09-17T03:13:45.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.272+0000 7f3eb29ca740 10 client.0 _ll_register_callbacks cb 0x5559c954b0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:45.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.272+0000 7f3ea8ff7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9277590 0x5559c963f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:45.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.272+0000 7f3ea8ff7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9277590 0x5559c963f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39638/0 (socket says 172.21.15.78:39638) 2024-09-17T03:13:45.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.272+0000 7f3ea8ff7640 1 -- 172.21.15.78:0/364438015 learned_addr learned my addr 172.21.15.78:0/364438015 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:45.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.272+0000 7f3ea97f8640 1 --2- 172.21.15.78:0/364438015 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5559c926f3b0 0x5559c96392a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:45.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.272+0000 7f3ea9ff9640 1 --2- 172.21.15.78:0/364438015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559c9298270 0x5559c963f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:45.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.272+0000 7f3ea8ff7640 1 -- 172.21.15.78:0/364438015 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5559c926f3b0 msgr2=0x5559c96392a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:45.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.272+0000 7f3ea8ff7640 1 --2- 172.21.15.78:0/364438015 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5559c926f3b0 0x5559c96392a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.272+0000 7f3ea8ff7640 1 -- 172.21.15.78:0/364438015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559c9298270 msgr2=0x5559c963f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:45.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.272+0000 7f3ea8ff7640 1 --2- 172.21.15.78:0/364438015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559c9298270 0x5559c963f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.272+0000 7f3ea8ff7640 1 -- 172.21.15.78:0/364438015 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559c937a6b0 con 0x5559c9277590 2024-09-17T03:13:45.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.272+0000 7f3ea8ff7640 1 --2- 172.21.15.78:0/364438015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9277590 0x5559c963f2a0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f3e940bb9b0 tx=0x7f3e94083a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd669a06c080c34 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:45.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.273+0000 7f3e83fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:45.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.273+0000 7f3e83fff640 1 -- 172.21.15.78:0/364438015 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94048070 con 0x5559c9277590 2024-09-17T03:13:45.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.273+0000 7f3e83fff640 1 -- 172.21.15.78:0/364438015 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f3e9408cc00 con 0x5559c9277590 2024-09-17T03:13:45.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.273+0000 7f3eb29ca740 1 -- 172.21.15.78:0/364438015 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e940835a0 con 0x5559c9277590 2024-09-17T03:13:45.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.273+0000 7f3e83fff640 1 -- 172.21.15.78:0/364438015 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f3e940a4050 con 0x5559c9277590 2024-09-17T03:13:45.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.273+0000 7f3eb29ca740 10 client.7593 fetch_fsmap learned FSMap version 76 2024-09-17T03:13:45.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.273+0000 7f3eb29ca740 1 -- 172.21.15.78:0/364438015 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x5559c9647fc0 con 0x5559c9277590 2024-09-17T03:13:45.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.273+0000 7f3e83fff640 1 -- 172.21.15.78:0/364438015 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e940835a0 con 0x5559c9277590 2024-09-17T03:13:45.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.273+0000 7f3e83fff640 1 -- 172.21.15.78:0/364438015 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 76) ==== 3502+0+0 (secure 0 0 0) 0x7f3e94082800 con 0x5559c9277590 2024-09-17T03:13:45.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.273+0000 7f3eb29ca740 10 client.7593 fetch_fsmap finished waiting for FSMap version 76 2024-09-17T03:13:45.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.273+0000 7f3eb29ca740 10 client.7593 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:13:45.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.273+0000 7f3eb29ca740 20 client.7593 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:45.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.273+0000 7f3eb29ca740 1 --2- 172.21.15.78:0/364438015 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x5559c9256e40 0x5559c9696c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.273+0000 7f3eb29ca740 4 client.7593 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:13:45.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.273+0000 7f3eb29ca740 1 -- 172.21.15.78:0/364438015 --> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5559c95b4770 con 0x5559c9256e40 2024-09-17T03:13:45.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.273+0000 7f3ea97f8640 1 --2- 172.21.15.78:0/364438015 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x5559c9256e40 0x5559c9696c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:45.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.274+0000 7f3e83fff640 10 client.7593 ms_handle_connect on v2:172.21.15.78:6833/3357123265 2024-09-17T03:13:45.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.274+0000 7f3ea97f8640 1 --2- 172.21.15.78:0/364438015 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x5559c9256e40 0x5559c9696c30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f291719e8b34cb8 server_cookie=d86a94bd98ef65c1 in_seq=0 out_seq=0 2024-09-17T03:13:45.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.274+0000 7f3e83fff640 1 -- 172.21.15.78:0/364438015 <== mds.0 v2:172.21.15.78:6833/3357123265 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5559c95b4770 con 0x5559c9256e40 2024-09-17T03:13:45.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.274+0000 7f3e83fff640 10 client.7593 handle_command_reply: tid=0 2024-09-17T03:13:45.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.274+0000 7f3eb29ca740 1 client.7593 shutdown 2024-09-17T03:13:45.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.274+0000 7f3eb29ca740 1 -- 172.21.15.78:0/364438015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9277590 msgr2=0x5559c963f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:45.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.274+0000 7f3eb29ca740 1 --2- 172.21.15.78:0/364438015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9277590 0x5559c963f2a0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f3e940bb9b0 tx=0x7f3e94083a30 comp rx=0 tx=0).stop 2024-09-17T03:13:45.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.275+0000 7f3eb29ca740 1 -- 172.21.15.78:0/364438015 shutdown_connections 2024-09-17T03:13:45.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.275+0000 7f3eb29ca740 1 --2- 172.21.15.78:0/364438015 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x5559c9256e40 0x5559c9696c30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.275+0000 7f3eb29ca740 1 --2- 172.21.15.78:0/364438015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559c9298270 0x5559c963f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.275+0000 7f3eb29ca740 1 --2- 172.21.15.78:0/364438015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9277590 0x5559c963f2a0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.275+0000 7f3eb29ca740 1 --2- 172.21.15.78:0/364438015 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5559c926f3b0 0x5559c96392a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.275+0000 7f3e83fff640 0 client.7593 ms_handle_reset on v2:172.21.15.78:6833/3357123265 2024-09-17T03:13:45.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.275+0000 7f3eb29ca740 1 -- 172.21.15.78:0/364438015 >> 172.21.15.78:0/364438015 conn(0x5559c928c3c0 msgr2=0x5559c9658960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:45.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.275+0000 7f3eb29ca740 1 -- 172.21.15.78:0/364438015 shutdown_connections 2024-09-17T03:13:45.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.275+0000 7f3eb29ca740 1 -- 172.21.15.78:0/364438015 wait complete. 2024-09-17T03:13:45.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.275+0000 7f3eb29ca740 20 client.7593 trim_cache size 0 max 16384 2024-09-17T03:13:45.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.293+0000 7f3eb29ca740 1 Processor -- start 2024-09-17T03:13:45.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.293+0000 7f3eb29ca740 1 -- start start 2024-09-17T03:13:45.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.294+0000 7f3eb29ca740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5559c926f3b0 0x5559c9692c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.294+0000 7f3eb29ca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559c9277590 0x5559c96573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.294+0000 7f3eb29ca740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9298270 0x5559c9657920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.294+0000 7f3eb29ca740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea4201440 con 0x5559c9298270 2024-09-17T03:13:45.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.294+0000 7f3eb29ca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3ea41f9340 con 0x5559c9277590 2024-09-17T03:13:45.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.294+0000 7f3eb29ca740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3ea41f9990 con 0x5559c926f3b0 2024-09-17T03:13:45.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.294+0000 7f3ea9ff9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9298270 0x5559c9657920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:45.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.294+0000 7f3ea9ff9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9298270 0x5559c9657920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39648/0 (socket says 172.21.15.78:39648) 2024-09-17T03:13:45.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.294+0000 7f3ea9ff9640 1 -- 172.21.15.78:0/2430634341 learned_addr learned my addr 172.21.15.78:0/2430634341 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:45.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.295+0000 7f3ea9ff9640 1 -- 172.21.15.78:0/2430634341 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5559c926f3b0 msgr2=0x5559c9692c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:45.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.295+0000 7f3ea9ff9640 1 --2- 172.21.15.78:0/2430634341 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5559c926f3b0 0x5559c9692c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.295+0000 7f3ea9ff9640 1 -- 172.21.15.78:0/2430634341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559c9277590 msgr2=0x5559c96573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:45.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.295+0000 7f3ea9ff9640 1 --2- 172.21.15.78:0/2430634341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559c9277590 0x5559c96573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.295+0000 7f3ea9ff9640 1 -- 172.21.15.78:0/2430634341 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5559c9685f80 con 0x5559c9298270 2024-09-17T03:13:45.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.295+0000 7f3ea9ff9640 1 --2- 172.21.15.78:0/2430634341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9298270 0x5559c9657920 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00b450 tx=0x7f3e9c009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d7cca82a1b7691 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:45.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.295+0000 7f3e8e7fc640 1 -- 172.21.15.78:0/2430634341 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c01b070 con 0x5559c9298270 2024-09-17T03:13:45.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.295+0000 7f3e8e7fc640 1 -- 172.21.15.78:0/2430634341 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e9c017820 con 0x5559c9298270 2024-09-17T03:13:45.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.295+0000 7f3e8e7fc640 1 -- 172.21.15.78:0/2430634341 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c017c50 con 0x5559c9298270 2024-09-17T03:13:45.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.296+0000 7f3eb29ca740 1 -- 172.21.15.78:0/2430634341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9298270 msgr2=0x5559c9657920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:45.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.296+0000 7f3eb29ca740 1 --2- 172.21.15.78:0/2430634341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9298270 0x5559c9657920 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c00b450 tx=0x7f3e9c009630 comp rx=0 tx=0).stop 2024-09-17T03:13:45.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.296+0000 7f3eb29ca740 1 -- 172.21.15.78:0/2430634341 shutdown_connections 2024-09-17T03:13:45.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.296+0000 7f3eb29ca740 1 --2- 172.21.15.78:0/2430634341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9298270 0x5559c9657920 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.296+0000 7f3eb29ca740 1 --2- 172.21.15.78:0/2430634341 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559c9277590 0x5559c96573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.296+0000 7f3eb29ca740 1 --2- 172.21.15.78:0/2430634341 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5559c926f3b0 0x5559c9692c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.296+0000 7f3eb29ca740 1 -- 172.21.15.78:0/2430634341 >> 172.21.15.78:0/2430634341 conn(0x5559c928c3c0 msgr2=0x5559c96400f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:45.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.296+0000 7f3eb29ca740 1 -- 172.21.15.78:0/2430634341 shutdown_connections 2024-09-17T03:13:45.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.296+0000 7f3eb29ca740 1 -- 172.21.15.78:0/2430634341 wait complete. 2024-09-17T03:13:45.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.297+0000 7f3eb29ca740 1 -- start start 2024-09-17T03:13:45.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.297+0000 7f3eb29ca740 1 Processor -- start 2024-09-17T03:13:45.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.298+0000 7f3eb29ca740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559c926f3b0 0x5559c9703880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.298+0000 7f3eb29ca740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9277590 0x5559c9696190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.298+0000 7f3eb29ca740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5559c9298270 0x5559c97049c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.298+0000 7f3eb29ca740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5559c9312620 con 0x5559c9277590 2024-09-17T03:13:45.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.298+0000 7f3eb29ca740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5559c95475f0 con 0x5559c926f3b0 2024-09-17T03:13:45.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.298+0000 7f3eb29ca740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5559c964af60 con 0x5559c9298270 2024-09-17T03:13:45.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.298+0000 7f3eb29ca740 10 client.0 _ll_register_callbacks cb 0x7f3e9c009990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:45.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.298+0000 7f3ea8ff7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9277590 0x5559c9696190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:45.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.298+0000 7f3ea8ff7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9277590 0x5559c9696190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39656/0 (socket says 172.21.15.78:39656) 2024-09-17T03:13:45.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.298+0000 7f3ea8ff7640 1 -- 172.21.15.78:0/2758115949 learned_addr learned my addr 172.21.15.78:0/2758115949 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:45.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3ea8ff7640 1 -- 172.21.15.78:0/2758115949 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5559c9298270 msgr2=0x5559c97049c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:45.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3ea97f8640 1 --2- 172.21.15.78:0/2758115949 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559c926f3b0 0x5559c9703880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:45.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3ea9ff9640 1 --2- 172.21.15.78:0/2758115949 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5559c9298270 0x5559c97049c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:45.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3ea8ff7640 1 --2- 172.21.15.78:0/2758115949 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5559c9298270 0x5559c97049c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3ea8ff7640 1 -- 172.21.15.78:0/2758115949 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559c926f3b0 msgr2=0x5559c9703880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:45.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3ea8ff7640 1 --2- 172.21.15.78:0/2758115949 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559c926f3b0 0x5559c9703880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3ea8ff7640 1 -- 172.21.15.78:0/2758115949 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559c9703dc0 con 0x5559c9277590 2024-09-17T03:13:45.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3ea8ff7640 1 --2- 172.21.15.78:0/2758115949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9277590 0x5559c9696190 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f3e94080810 tx=0x7f3e940880f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89157dc71f9588ae server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:45.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3e83fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:45.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3e83fff640 1 -- 172.21.15.78:0/2758115949 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e94048070 con 0x5559c9277590 2024-09-17T03:13:45.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3e83fff640 1 -- 172.21.15.78:0/2758115949 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f3e9408a3f0 con 0x5559c9277590 2024-09-17T03:13:45.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3eb29ca740 1 -- 172.21.15.78:0/2758115949 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e9c017820 con 0x5559c9277590 2024-09-17T03:13:45.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3e83fff640 1 -- 172.21.15.78:0/2758115949 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f3e9408f020 con 0x5559c9277590 2024-09-17T03:13:45.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3eb29ca740 10 client.7599 fetch_fsmap learned FSMap version 76 2024-09-17T03:13:45.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3eb29ca740 1 -- 172.21.15.78:0/2758115949 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x5559c9703dc0 con 0x5559c9277590 2024-09-17T03:13:45.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3e83fff640 1 -- 172.21.15.78:0/2758115949 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e9c017820 con 0x5559c9277590 2024-09-17T03:13:45.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3e83fff640 1 -- 172.21.15.78:0/2758115949 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 76) ==== 3502+0+0 (secure 0 0 0) 0x7f3e9407eef0 con 0x5559c9277590 2024-09-17T03:13:45.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3eb29ca740 10 client.7599 fetch_fsmap finished waiting for FSMap version 76 2024-09-17T03:13:45.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3eb29ca740 10 client.7599 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:13:45.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3eb29ca740 20 client.7599 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:45.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3eb29ca740 1 --2- 172.21.15.78:0/2758115949 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x5559c96554d0 0x5559c9669a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3eb29ca740 4 client.7599 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:13:45.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3eb29ca740 1 -- 172.21.15.78:0/2758115949 --> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] -- command(tid 0: {"prefix": "status"}) -- 0x5559c967b220 con 0x5559c96554d0 2024-09-17T03:13:45.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.299+0000 7f3ea97f8640 1 --2- 172.21.15.78:0/2758115949 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x5559c96554d0 0x5559c9669a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:45.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.300+0000 7f3e83fff640 10 client.7599 ms_handle_connect on v2:172.21.15.78:6833/3357123265 2024-09-17T03:13:45.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.300+0000 7f3ea97f8640 1 --2- 172.21.15.78:0/2758115949 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x5559c96554d0 0x5559c9669a90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74c075febc0558b7 server_cookie=38dac30ee10dccf4 in_seq=0 out_seq=0 2024-09-17T03:13:45.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.300+0000 7f3e83fff640 1 -- 172.21.15.78:0/2758115949 <== mds.0 v2:172.21.15.78:6833/3357123265 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x5559c967b220 con 0x5559c96554d0 2024-09-17T03:13:45.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.300+0000 7f3e83fff640 10 client.7599 handle_command_reply: tid=0 2024-09-17T03:13:45.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.300+0000 7f3eb29ca740 1 client.7599 shutdown 2024-09-17T03:13:45.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.300+0000 7f3eb29ca740 1 -- 172.21.15.78:0/2758115949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9277590 msgr2=0x5559c9696190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:45.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.300+0000 7f3eb29ca740 1 --2- 172.21.15.78:0/2758115949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9277590 0x5559c9696190 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f3e94080810 tx=0x7f3e940880f0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.300+0000 7f3eb29ca740 1 -- 172.21.15.78:0/2758115949 shutdown_connections 2024-09-17T03:13:45.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.300+0000 7f3eb29ca740 1 --2- 172.21.15.78:0/2758115949 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x5559c96554d0 0x5559c9669a90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.300+0000 7f3eb29ca740 1 --2- 172.21.15.78:0/2758115949 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5559c9298270 0x5559c97049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.300+0000 7f3e83fff640 0 client.7599 ms_handle_reset on v2:172.21.15.78:6833/3357123265 2024-09-17T03:13:45.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.300+0000 7f3eb29ca740 1 --2- 172.21.15.78:0/2758115949 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5559c9277590 0x5559c9696190 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.300+0000 7f3eb29ca740 1 --2- 172.21.15.78:0/2758115949 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5559c926f3b0 0x5559c9703880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.300+0000 7f3eb29ca740 1 -- 172.21.15.78:0/2758115949 >> 172.21.15.78:0/2758115949 conn(0x5559c928c3c0 msgr2=0x5559c967dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:45.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.300+0000 7f3eb29ca740 1 -- 172.21.15.78:0/2758115949 shutdown_connections 2024-09-17T03:13:45.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.300+0000 7f3eb29ca740 1 -- 172.21.15.78:0/2758115949 wait complete. 2024-09-17T03:13:45.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.301+0000 7f3eb29ca740 20 client.7599 trim_cache size 0 max 16384 2024-09-17T03:13:45.305 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:13:45.305 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:13:45.305 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-09-17T03:13:45.305 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 7428, 2024-09-17T03:13:45.305 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:13:45.306 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:13:45.306 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:13:45.306 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 9.1416019970000004, 2024-09-17T03:13:45.306 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 76, 2024-09-17T03:13:45.306 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 82, 2024-09-17T03:13:45.306 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 82, 2024-09-17T03:13:45.306 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 13.848298645 2024-09-17T03:13:45.306 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:13:45.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.301+0000 7f3eaba5c640 1 -- 172.21.15.78:0/2278353625 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3e88078bc0 msgr2=0x7f3e8807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:45.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.301+0000 7f3eaba5c640 1 --2- 172.21.15.78:0/2278353625 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3e88078bc0 0x7f3e8807b0d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3ea000bb50 tx=0x7f3ea000b2e0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.301+0000 7f3eaba5c640 1 -- 172.21.15.78:0/2278353625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea40b3a60 msgr2=0x7f3ea40ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:45.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.301+0000 7f3eaba5c640 1 --2- 172.21.15.78:0/2278353625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea40b3a60 0x7f3ea40ca1d0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f3e94000c00 tx=0x7f3e94003910 comp rx=0 tx=0).stop 2024-09-17T03:13:45.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.301+0000 7f3eaba5c640 1 -- 172.21.15.78:0/2278353625 shutdown_connections 2024-09-17T03:13:45.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.301+0000 7f3eaba5c640 1 --2- 172.21.15.78:0/2278353625 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3ea40d0e10 0x7f3ea40ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.301+0000 7f3eaba5c640 1 --2- 172.21.15.78:0/2278353625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea40b3a60 0x7f3ea40ca1d0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.301+0000 7f3eaba5c640 1 --2- 172.21.15.78:0/2278353625 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3e88078bc0 0x7f3e8807b0d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.301+0000 7f3eaba5c640 1 --2- 172.21.15.78:0/2278353625 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ea406e3c0 0x7f3ea4155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.301+0000 7f3eaba5c640 1 -- 172.21.15.78:0/2278353625 >> 172.21.15.78:0/2278353625 conn(0x7f3ea408bfc0 msgr2=0x7f3ea40b9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:45.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.301+0000 7f3eaba5c640 1 -- 172.21.15.78:0/2278353625 shutdown_connections 2024-09-17T03:13:45.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.301+0000 7f3eaba5c640 1 -- 172.21.15.78:0/2278353625 wait complete. 2024-09-17T03:13:45.311 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:13:45.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.425+0000 7f28b5971640 1 -- 172.21.15.78:0/1855880784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28b015c6f0 msgr2=0x7f28b00ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:45.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.425+0000 7f28b5971640 1 --2- 172.21.15.78:0/1855880784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28b015c6f0 0x7f28b00ceb50 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f2898005fd0 tx=0x7f289802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.425+0000 7f28b5971640 1 -- 172.21.15.78:0/1855880784 shutdown_connections 2024-09-17T03:13:45.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.425+0000 7f28b5971640 1 --2- 172.21.15.78:0/1855880784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28b015c6f0 0x7f28b00ceb50 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.425+0000 7f28b5971640 1 --2- 172.21.15.78:0/1855880784 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f28b00d1d40 0x7f28b00b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.425+0000 7f28b5971640 1 -- 172.21.15.78:0/1855880784 >> 172.21.15.78:0/1855880784 conn(0x7f28b00b3f10 msgr2=0x7f28b00b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:45.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.425+0000 7f28b5971640 1 -- 172.21.15.78:0/1855880784 shutdown_connections 2024-09-17T03:13:45.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.425+0000 7f28b5971640 1 -- 172.21.15.78:0/1855880784 wait complete. 2024-09-17T03:13:45.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.426+0000 7f28b5971640 1 Processor -- start 2024-09-17T03:13:45.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.427+0000 7f28b5971640 1 -- start start 2024-09-17T03:13:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.428+0000 7f28b5971640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f28b00ccba0 0x7f28b0150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.428+0000 7f28b5971640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28b00d1d40 0x7f28b0151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.428+0000 7f28b5971640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28b015c6f0 0x7f28b01f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.428+0000 7f28b5971640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f28b00d12d0 con 0x7f28b015c6f0 2024-09-17T03:13:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.428+0000 7f28b5971640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f28b00d1150 con 0x7f28b00d1d40 2024-09-17T03:13:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.428+0000 7f28b5971640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f28b00d1450 con 0x7f28b00ccba0 2024-09-17T03:13:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.428+0000 7f28af7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28b015c6f0 0x7f28b01f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.428+0000 7f28af7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28b015c6f0 0x7f28b01f6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39674/0 (socket says 172.21.15.78:39674) 2024-09-17T03:13:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.428+0000 7f28af7fe640 1 -- 172.21.15.78:0/464412538 learned_addr learned my addr 172.21.15.78:0/464412538 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.428+0000 7f28aeffd640 1 --2- 172.21.15.78:0/464412538 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f28b00ccba0 0x7f28b0150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:45.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.428+0000 7f28af7fe640 1 -- 172.21.15.78:0/464412538 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f28b00ccba0 msgr2=0x7f28b0150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:45.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.428+0000 7f28a67fc640 1 --2- 172.21.15.78:0/464412538 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28b00d1d40 0x7f28b0151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:45.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.428+0000 7f28af7fe640 1 --2- 172.21.15.78:0/464412538 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f28b00ccba0 0x7f28b0150ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.428+0000 7f28af7fe640 1 -- 172.21.15.78:0/464412538 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28b00d1d40 msgr2=0x7f28b0151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:45.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.428+0000 7f28af7fe640 1 --2- 172.21.15.78:0/464412538 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28b00d1d40 0x7f28b0151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.428+0000 7f28af7fe640 1 -- 172.21.15.78:0/464412538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28b00cb270 con 0x7f28b015c6f0 2024-09-17T03:13:45.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.428+0000 7f28af7fe640 1 --2- 172.21.15.78:0/464412538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28b015c6f0 0x7f28b01f6080 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f28a8002230 tx=0x7f28a800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:45.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.429+0000 7f28acff9640 1 -- 172.21.15.78:0/464412538 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a8003b70 con 0x7f28b015c6f0 2024-09-17T03:13:45.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.429+0000 7f28acff9640 1 -- 172.21.15.78:0/464412538 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28a8003d10 con 0x7f28b015c6f0 2024-09-17T03:13:45.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.429+0000 7f28b5971640 1 -- 172.21.15.78:0/464412538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28b00cb550 con 0x7f28b015c6f0 2024-09-17T03:13:45.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.429+0000 7f28acff9640 1 -- 172.21.15.78:0/464412538 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28a8005330 con 0x7f28b015c6f0 2024-09-17T03:13:45.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.429+0000 7f28b5971640 1 -- 172.21.15.78:0/464412538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28b00cbb10 con 0x7f28b015c6f0 2024-09-17T03:13:45.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.430+0000 7f28b5971640 1 -- 172.21.15.78:0/464412538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28b00cafe0 con 0x7f28b015c6f0 2024-09-17T03:13:45.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.430+0000 7f28acff9640 1 -- 172.21.15.78:0/464412538 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f28a80056e0 con 0x7f28b015c6f0 2024-09-17T03:13:45.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.431+0000 7f28acff9640 1 --2- 172.21.15.78:0/464412538 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2890078b90 0x7f289007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:45.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.431+0000 7f28acff9640 1 -- 172.21.15.78:0/464412538 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f28a809ad30 con 0x7f28b015c6f0 2024-09-17T03:13:45.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.431+0000 7f28aeffd640 1 --2- 172.21.15.78:0/464412538 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2890078b90 0x7f289007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:45.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.432+0000 7f28aeffd640 1 --2- 172.21.15.78:0/464412538 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2890078b90 0x7f289007b0a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009a00 tx=0x7f28a0005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:45.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.435+0000 7f28acff9640 1 -- 172.21.15.78:0/464412538 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f28a8063170 con 0x7f28b015c6f0 2024-09-17T03:13:45.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.645+0000 7f28b5971640 1 -- 172.21.15.78:0/464412538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f28b00d1970 con 0x7f28b015c6f0 2024-09-17T03:13:45.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.645+0000 7f28acff9640 1 -- 172.21.15.78:0/464412538 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) ==== 53+0+73 (secure 0 0 0) 0x7f28a8062a70 con 0x7f28b015c6f0 2024-09-17T03:13:45.644 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:13:45.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.647+0000 7f28b5971640 1 -- 172.21.15.78:0/464412538 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2890078b90 msgr2=0x7f289007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.647+0000 7f28b5971640 1 --2- 172.21.15.78:0/464412538 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2890078b90 0x7f289007b0a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f28a0009a00 tx=0x7f28a0005f90 comp rx=0 tx=0).stop 2024-09-17T03:13:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.647+0000 7f28b5971640 1 -- 172.21.15.78:0/464412538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28b015c6f0 msgr2=0x7f28b01f6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.647+0000 7f28b5971640 1 --2- 172.21.15.78:0/464412538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28b015c6f0 0x7f28b01f6080 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f28a8002230 tx=0x7f28a800cb90 comp rx=0 tx=0).stop 2024-09-17T03:13:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.647+0000 7f28b5971640 1 -- 172.21.15.78:0/464412538 shutdown_connections 2024-09-17T03:13:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.647+0000 7f28b5971640 1 --2- 172.21.15.78:0/464412538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28b015c6f0 0x7f28b01f6080 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.647+0000 7f28b5971640 1 --2- 172.21.15.78:0/464412538 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2890078b90 0x7f289007b0a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.647+0000 7f28b5971640 1 --2- 172.21.15.78:0/464412538 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28b00d1d40 0x7f28b0151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.647+0000 7f28b5971640 1 --2- 172.21.15.78:0/464412538 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f28b00ccba0 0x7f28b0150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.647+0000 7f28b5971640 1 -- 172.21.15.78:0/464412538 >> 172.21.15.78:0/464412538 conn(0x7f28b00b3f10 msgr2=0x7f28b00b6230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.648+0000 7f28b5971640 1 -- 172.21.15.78:0/464412538 shutdown_connections 2024-09-17T03:13:45.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45.648+0000 7f28b5971640 1 -- 172.21.15.78:0/464412538 wait complete. 2024-09-17T03:13:45.657 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:13:45.658 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:13:45.658 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2024-09-17T03:13:45.658 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:13:45.658 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:13:45.658 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:13:45.658 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:13:45.658 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:13:45.658 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:13:45.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:45.658 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2024-09-17T03:13:45.674 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:13:45.674 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:13:45.674 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:13:45.674 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:13:45.674 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2024-09-17T03:13:45.674 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:13:45.674 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:13:45.674 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:13:45.675 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2024-09-17T03:13:45.675 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:13:45.675 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:13:45.675 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2024-09-17T03:13:45.675 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:13:45.675 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:13:45.675 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:13:45.675 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:13:45.675 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:13:45.675 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42439sec preferred_lft 42439sec 2024-09-17T03:13:45.675 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link noprefixroute 2024-09-17T03:13:45.675 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:13:45.675 INFO:teuthology.orchestra.run.smithi078.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:13:45.675 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0e:9b:80:f7:8b:c2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:13:45.675 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:13:45.676 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:13:45.676 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::58a0:47ff:fe97:6de8/64 scope link 2024-09-17T03:13:45.676 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:13:45.676 INFO:teuthology.orchestra.run.smithi078.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:13:45.676 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether e6:fb:78:d9:ba:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:13:45.676 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::e4fb:78ff:fed9:ba75/64 scope link 2024-09-17T03:13:45.676 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:13:45.676 INFO:teuthology.orchestra.run.smithi078.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:13:45.676 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0e:9b:80:f7:8b:c2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:13:45.676 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::c9b:80ff:fef7:8bc2/64 scope link 2024-09-17T03:13:45.676 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:13:45.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:45.677 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:13:45.737 INFO:teuthology.orchestra.run.smithi078.stdout:1 2024-09-17T03:13:45.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:45.739 DEBUG:teuthology.orchestra.run.smithi078:> route 2024-09-17T03:13:45.796 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2024-09-17T03:13:45.796 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:13:45.796 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:13:45.796 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:13:45.796 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:13:45.797 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:13:45.797 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-17T03:13:45.797 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:13:45.797 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:13:45.797 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:13:45.797 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-17T03:13:45.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:13:45.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:13:45.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:45.922 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-17T03:13:45.937 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:13:45.938 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:13:45.938 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:13:45.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:45.938 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2024-09-17T03:13:46.002 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:13:46.002 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:13:46.058 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:13:46.058 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:13:46.058 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:13:46.113 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:13:46.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:46.114 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:13:46.208 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:13:46.208 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:13:46.208 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:13:46.220 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:13:46.220 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:13:46.220 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:13:46.220 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-09-17T03:13:46.220 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:13:46.229 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:13:46.229 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:13:46.229 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:13:46.229 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-09-17T03:13:46.229 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:13:46.229 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:6789,172.21.15.193:6789,172.21.15.193:6790" 2024-09-17T03:13:46.229 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.78:6789,172.21.15.193:6789,172.21.15.193:6790:/ 2024-09-17T03:13:46.229 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f3c59ba9-dab4-4ee6-8989-d80d11d430b6" will pass to kernel 2024-09-17T03:13:46.229 INFO:teuthology.orchestra.run.smithi078.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:13:46.229 INFO:teuthology.orchestra.run.smithi078.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:13:46.230 INFO:teuthology.orchestra.run.smithi078.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:13:46.230 INFO:teuthology.orchestra.run.smithi078.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:13:46.230 INFO:teuthology.orchestra.run.smithi078.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:13:46.231 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:13:46.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:46.231 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:13:46.256 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:13:46.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:13:46.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:13:46.356 INFO:teuthology.orchestra.run.smithi078.stdout:client6278 2024-09-17T03:13:46.356 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:13:46.357 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:13:46.372 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-17T03:13:46.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.529+0000 7f74a8f4a640 1 -- 172.21.15.78:0/3738900264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7490004800 msgr2=0x7f7490004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:46.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.529+0000 7f74a8f4a640 1 --2- 172.21.15.78:0/3738900264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7490004800 0x7f7490004c10 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f74a4072de0 tx=0x7f7490005830 comp rx=0 tx=0).stop 2024-09-17T03:13:46.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.529+0000 7f74a8f4a640 1 -- 172.21.15.78:0/3738900264 shutdown_connections 2024-09-17T03:13:46.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.529+0000 7f74a8f4a640 1 --2- 172.21.15.78:0/3738900264 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7490004800 0x7f7490004c10 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:46.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.529+0000 7f74a8f4a640 1 -- 172.21.15.78:0/3738900264 >> 172.21.15.78:0/3738900264 conn(0x7f74a40b1cb0 msgr2=0x7f74a40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:46.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.529+0000 7f74a8f4a640 1 -- 172.21.15.78:0/3738900264 shutdown_connections 2024-09-17T03:13:46.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.529+0000 7f74a8f4a640 1 -- 172.21.15.78:0/3738900264 wait complete. 2024-09-17T03:13:46.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.531+0000 7f74a8f4a640 1 Processor -- start 2024-09-17T03:13:46.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.531+0000 7f74a8f4a640 1 -- start start 2024-09-17T03:13:46.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.532+0000 7f74a8f4a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7490004800 0x7f74a414b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:46.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.532+0000 7f74a8f4a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74a4072d30 0x7f74a4169040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:46.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.532+0000 7f74a8f4a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a4150420 0x7f74a4150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:46.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.532+0000 7f74a8f4a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f74a415bf20 con 0x7f74a4150420 2024-09-17T03:13:46.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.532+0000 7f74a8f4a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f74a40cf780 con 0x7f7490004800 2024-09-17T03:13:46.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.532+0000 7f74a8f4a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f74a415c0a0 con 0x7f74a4072d30 2024-09-17T03:13:46.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.532+0000 7f74a2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a4150420 0x7f74a4150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:46.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.532+0000 7f74a2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a4150420 0x7f74a4150830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40848/0 (socket says 172.21.15.78:40848) 2024-09-17T03:13:46.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.532+0000 7f74a2d9d640 1 -- 172.21.15.78:0/3414439343 learned_addr learned my addr 172.21.15.78:0/3414439343 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:46.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.533+0000 7f74a259c640 1 --2- 172.21.15.78:0/3414439343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7490004800 0x7f74a414b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.533+0000 7f7499d9b640 1 --2- 172.21.15.78:0/3414439343 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74a4072d30 0x7f74a4169040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.533+0000 7f74a2d9d640 1 -- 172.21.15.78:0/3414439343 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74a4072d30 msgr2=0x7f74a4169040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.533+0000 7f74a2d9d640 1 --2- 172.21.15.78:0/3414439343 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74a4072d30 0x7f74a4169040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.533+0000 7f74a2d9d640 1 -- 172.21.15.78:0/3414439343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7490004800 msgr2=0x7f74a414b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.533+0000 7f74a2d9d640 1 --2- 172.21.15.78:0/3414439343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7490004800 0x7f74a414b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.533+0000 7f74a2d9d640 1 -- 172.21.15.78:0/3414439343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a4150d70 con 0x7f74a4150420 2024-09-17T03:13:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.533+0000 7f74a259c640 1 --2- 172.21.15.78:0/3414439343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7490004800 0x7f74a414b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.533+0000 7f74a2d9d640 1 --2- 172.21.15.78:0/3414439343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a4150420 0x7f74a4150830 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f749c0020e0 tx=0x7f749c00eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.533+0000 7f749b7fe640 1 -- 172.21.15.78:0/3414439343 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c015070 con 0x7f74a4150420 2024-09-17T03:13:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.533+0000 7f749b7fe640 1 -- 172.21.15.78:0/3414439343 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f749c00cb20 con 0x7f74a4150420 2024-09-17T03:13:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.533+0000 7f74a8f4a640 1 -- 172.21.15.78:0/3414439343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74a414b7b0 con 0x7f74a4150420 2024-09-17T03:13:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.533+0000 7f749b7fe640 1 -- 172.21.15.78:0/3414439343 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749c011460 con 0x7f74a4150420 2024-09-17T03:13:46.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.533+0000 7f74a8f4a640 1 -- 172.21.15.78:0/3414439343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74a4169850 con 0x7f74a4150420 2024-09-17T03:13:46.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.534+0000 7f74a8f4a640 1 -- 172.21.15.78:0/3414439343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74a40ccba0 con 0x7f74a4150420 2024-09-17T03:13:46.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.535+0000 7f749b7fe640 1 -- 172.21.15.78:0/3414439343 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f749c018070 con 0x7f74a4150420 2024-09-17T03:13:46.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.535+0000 7f749b7fe640 1 --2- 172.21.15.78:0/3414439343 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7484078b90 0x7f748407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:46.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.535+0000 7f749b7fe640 1 -- 172.21.15.78:0/3414439343 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f749c09b180 con 0x7f74a4150420 2024-09-17T03:13:46.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.536+0000 7f74a259c640 1 --2- 172.21.15.78:0/3414439343 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7484078b90 0x7f748407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:46.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.536+0000 7f74a259c640 1 --2- 172.21.15.78:0/3414439343 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7484078b90 0x7f748407b0a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f74940058c0 tx=0x7f7494005850 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:46.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.540+0000 7f749b7fe640 1 -- 172.21.15.78:0/3414439343 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f74a4150d70 con 0x7f74a4150420 2024-09-17T03:13:46.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:46.747+0000 7f74a8f4a640 1 -- 172.21.15.78:0/3414439343 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f74a40aed90 con 0x7f74a4150420 2024-09-17T03:13:47.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.386+0000 7f749b7fe640 1 -- 172.21.15.78:0/3414439343 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v77) ==== 105+0+0 (secure 0 0 0) 0x7f749c0636e0 con 0x7f74a4150420 2024-09-17T03:13:47.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.389+0000 7f74a8f4a640 1 -- 172.21.15.78:0/3414439343 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7484078b90 msgr2=0x7f748407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:47.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.389+0000 7f74a8f4a640 1 --2- 172.21.15.78:0/3414439343 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7484078b90 0x7f748407b0a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f74940058c0 tx=0x7f7494005850 comp rx=0 tx=0).stop 2024-09-17T03:13:47.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.389+0000 7f74a8f4a640 1 -- 172.21.15.78:0/3414439343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a4150420 msgr2=0x7f74a4150830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:47.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.389+0000 7f74a8f4a640 1 --2- 172.21.15.78:0/3414439343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a4150420 0x7f74a4150830 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f749c0020e0 tx=0x7f749c00eb00 comp rx=0 tx=0).stop 2024-09-17T03:13:47.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.389+0000 7f74a8f4a640 1 -- 172.21.15.78:0/3414439343 shutdown_connections 2024-09-17T03:13:47.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.389+0000 7f74a8f4a640 1 --2- 172.21.15.78:0/3414439343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a4150420 0x7f74a4150830 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.389+0000 7f74a8f4a640 1 --2- 172.21.15.78:0/3414439343 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f74a4072d30 0x7f74a4169040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.389+0000 7f74a8f4a640 1 --2- 172.21.15.78:0/3414439343 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7484078b90 0x7f748407b0a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.389+0000 7f74a8f4a640 1 --2- 172.21.15.78:0/3414439343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7490004800 0x7f74a414b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.389+0000 7f74a8f4a640 1 -- 172.21.15.78:0/3414439343 >> 172.21.15.78:0/3414439343 conn(0x7f74a40b1cb0 msgr2=0x7f74a40b5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:47.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.389+0000 7f74a8f4a640 1 -- 172.21.15.78:0/3414439343 shutdown_connections 2024-09-17T03:13:47.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.389+0000 7f74a8f4a640 1 -- 172.21.15.78:0/3414439343 wait complete. 2024-09-17T03:13:47.406 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:13:47.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.520+0000 7fbf0032b640 1 -- 172.21.15.78:0/1295199948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbef815f7e0 msgr2=0x7fbef80ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:47.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.520+0000 7fbf0032b640 1 --2- 172.21.15.78:0/1295199948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbef815f7e0 0x7fbef80ce680 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fbef80cbe10 tx=0x7fbef002a530 comp rx=0 tx=0).stop 2024-09-17T03:13:47.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.520+0000 7fbf0032b640 1 -- 172.21.15.78:0/1295199948 shutdown_connections 2024-09-17T03:13:47.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.520+0000 7fbf0032b640 1 --2- 172.21.15.78:0/1295199948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbef815f7e0 0x7fbef80ce680 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.520+0000 7fbf0032b640 1 --2- 172.21.15.78:0/1295199948 >> v2:172.21.15.193:3300/0 conn(0x7fbef8070e40 0x7fbef815f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.520+0000 7fbf0032b640 1 -- 172.21.15.78:0/1295199948 >> 172.21.15.78:0/1295199948 conn(0x7fbef80cd530 msgr2=0x7fbef80cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:47.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.520+0000 7fbf0032b640 1 -- 172.21.15.78:0/1295199948 shutdown_connections 2024-09-17T03:13:47.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.520+0000 7fbf0032b640 1 -- 172.21.15.78:0/1295199948 wait complete. 2024-09-17T03:13:47.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.522+0000 7fbf0032b640 1 Processor -- start 2024-09-17T03:13:47.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.522+0000 7fbf0032b640 1 -- start start 2024-09-17T03:13:47.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.523+0000 7fbf0032b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbef8070e40 0x7fbef81f6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:47.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.523+0000 7fbf0032b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbef8075fa0 0x7fbef81f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:47.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.523+0000 7fbf0032b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbef815f7e0 0x7fbef80b1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:47.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.523+0000 7fbf0032b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbef80cef50 con 0x7fbef8075fa0 2024-09-17T03:13:47.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.523+0000 7fbf0032b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbef80cedd0 con 0x7fbef8070e40 2024-09-17T03:13:47.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.523+0000 7fbf0032b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fbef80cf0d0 con 0x7fbef815f7e0 2024-09-17T03:13:47.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.523+0000 7fbefd8c6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbef8075fa0 0x7fbef81f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:47.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.523+0000 7fbefd8c6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbef8075fa0 0x7fbef81f4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40862/0 (socket says 172.21.15.78:40862) 2024-09-17T03:13:47.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.523+0000 7fbefd8c6640 1 -- 172.21.15.78:0/1511553055 learned_addr learned my addr 172.21.15.78:0/1511553055 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:47.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.523+0000 7fbefe8c8640 1 --2- 172.21.15.78:0/1511553055 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbef815f7e0 0x7fbef80b1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:47.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.523+0000 7fbefe0c7640 1 --2- 172.21.15.78:0/1511553055 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbef8070e40 0x7fbef81f6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:47.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.523+0000 7fbefd8c6640 1 -- 172.21.15.78:0/1511553055 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbef815f7e0 msgr2=0x7fbef80b1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:47.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.523+0000 7fbefd8c6640 1 --2- 172.21.15.78:0/1511553055 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbef815f7e0 0x7fbef80b1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.523+0000 7fbefd8c6640 1 -- 172.21.15.78:0/1511553055 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbef8070e40 msgr2=0x7fbef81f6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:47.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.523+0000 7fbefd8c6640 1 --2- 172.21.15.78:0/1511553055 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbef8070e40 0x7fbef81f6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.523+0000 7fbefd8c6640 1 -- 172.21.15.78:0/1511553055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef81f21d0 con 0x7fbef8075fa0 2024-09-17T03:13:47.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.523+0000 7fbefe8c8640 1 --2- 172.21.15.78:0/1511553055 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbef815f7e0 0x7fbef80b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:47.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.523+0000 7fbefe0c7640 1 --2- 172.21.15.78:0/1511553055 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbef8070e40 0x7fbef81f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:47.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.524+0000 7fbefd8c6640 1 --2- 172.21.15.78:0/1511553055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbef8075fa0 0x7fbef81f4f10 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fbeec00d770 tx=0x7fbeec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:47.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.524+0000 7fbef6ffd640 1 -- 172.21.15.78:0/1511553055 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeec016070 con 0x7fbef8075fa0 2024-09-17T03:13:47.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.524+0000 7fbef6ffd640 1 -- 172.21.15.78:0/1511553055 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbeec009d20 con 0x7fbef8075fa0 2024-09-17T03:13:47.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.524+0000 7fbf0032b640 1 -- 172.21.15.78:0/1511553055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef81f2440 con 0x7fbef8075fa0 2024-09-17T03:13:47.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.524+0000 7fbef6ffd640 1 -- 172.21.15.78:0/1511553055 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeec0107c0 con 0x7fbef8075fa0 2024-09-17T03:13:47.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.524+0000 7fbf0032b640 1 -- 172.21.15.78:0/1511553055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef81f2a00 con 0x7fbef8075fa0 2024-09-17T03:13:47.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.525+0000 7fbf0032b640 1 -- 172.21.15.78:0/1511553055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbef81f3120 con 0x7fbef8075fa0 2024-09-17T03:13:47.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.526+0000 7fbef6ffd640 1 -- 172.21.15.78:0/1511553055 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbeec010960 con 0x7fbef8075fa0 2024-09-17T03:13:47.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.526+0000 7fbef6ffd640 1 --2- 172.21.15.78:0/1511553055 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbee4078bc0 0x7fbee407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:47.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.526+0000 7fbef6ffd640 1 -- 172.21.15.78:0/1511553055 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fbeec09cd00 con 0x7fbef8075fa0 2024-09-17T03:13:47.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.527+0000 7fbefe0c7640 1 --2- 172.21.15.78:0/1511553055 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbee4078bc0 0x7fbee407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:47.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.527+0000 7fbefe0c7640 1 --2- 172.21.15.78:0/1511553055 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbee4078bc0 0x7fbee407b0d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbee8007fd0 tx=0x7fbee8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:47.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.531+0000 7fbef6ffd640 1 -- 172.21.15.78:0/1511553055 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbeec0651d0 con 0x7fbef8075fa0 2024-09-17T03:13:47.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.738+0000 7fbf0032b640 1 -- 172.21.15.78:0/1511553055 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbef80cf640 con 0x7fbef8075fa0 2024-09-17T03:13:47.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.738+0000 7fbef6ffd640 1 -- 172.21.15.78:0/1511553055 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) ==== 94+0+5247 (secure 0 0 0) 0x7fbeec064ad0 con 0x7fbef8075fa0 2024-09-17T03:13:47.739 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:47.739 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":78,"btime":"2024-09-17T03:13:47:390643+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6640,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/1005450673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1005450673},{"type":"v1","addr":"172.21.15.193:6837","nonce":1005450673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:35.489582+0000","modified":"2024-09-17T03:13:47.390626+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":7428,"mds_1":7425},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7425":{"gid":7425,"name":"c","rank":1,"incarnation":78,"state":"up:creating","state_seq":1,"addr":"172.21.15.78:6835/4018023271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4018023271},{"type":"v1","addr":"172.21.15.78:6835","nonce":4018023271}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6832/3357123265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":3357123265},{"type":"v1","addr":"172.21.15.78:6832","nonce":3357123265}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7428,"qdb_cluster":[7428]},"id":6}]} 2024-09-17T03:13:47.739 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 78 2024-09-17T03:13:47.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.740+0000 7fbf0032b640 1 -- 172.21.15.78:0/1511553055 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbee4078bc0 msgr2=0x7fbee407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:47.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.740+0000 7fbf0032b640 1 --2- 172.21.15.78:0/1511553055 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbee4078bc0 0x7fbee407b0d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbee8007fd0 tx=0x7fbee8009040 comp rx=0 tx=0).stop 2024-09-17T03:13:47.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.740+0000 7fbf0032b640 1 -- 172.21.15.78:0/1511553055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbef8075fa0 msgr2=0x7fbef81f4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:47.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.740+0000 7fbf0032b640 1 --2- 172.21.15.78:0/1511553055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbef8075fa0 0x7fbef81f4f10 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fbeec00d770 tx=0x7fbeec00dc30 comp rx=0 tx=0).stop 2024-09-17T03:13:47.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.740+0000 7fbf0032b640 1 -- 172.21.15.78:0/1511553055 shutdown_connections 2024-09-17T03:13:47.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.740+0000 7fbf0032b640 1 --2- 172.21.15.78:0/1511553055 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbef815f7e0 0x7fbef80b1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.740+0000 7fbf0032b640 1 --2- 172.21.15.78:0/1511553055 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbef8075fa0 0x7fbef81f4f10 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.740+0000 7fbf0032b640 1 --2- 172.21.15.78:0/1511553055 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbee4078bc0 0x7fbee407b0d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.740+0000 7fbf0032b640 1 --2- 172.21.15.78:0/1511553055 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbef8070e40 0x7fbef81f6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:47.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.740+0000 7fbf0032b640 1 -- 172.21.15.78:0/1511553055 >> 172.21.15.78:0/1511553055 conn(0x7fbef80cd530 msgr2=0x7fbef806e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:47.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.740+0000 7fbf0032b640 1 -- 172.21.15.78:0/1511553055 shutdown_connections 2024-09-17T03:13:47.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:47.740+0000 7fbf0032b640 1 -- 172.21.15.78:0/1511553055 wait complete. 2024-09-17T03:13:48.154 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:13:35.489582+0000', 'modified': '2024-09-17T03:13:47.390626+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 7428, 'mds_1': 7425}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7425': {'gid': 7425, 'name': 'c', 'rank': 1, 'incarnation': 78, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.78:6835/4018023271', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6834', 'nonce': 4018023271}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 4018023271}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_7428': {'gid': 7428, 'name': 'a', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6832/3357123265', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6833', 'nonce': 3357123265}, {'type': 'v1', 'addr': '172.21.15.78:6832', 'nonce': 3357123265}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7428, 'qdb_cluster': [7428]} 2024-09-17T03:13:48.154 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7425:up:creating 2024-09-17T03:13:49.156 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:13:49.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.283+0000 7f609ea71640 1 -- 172.21.15.78:0/178073898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6098070e40 msgr2=0x7f609815f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:49.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.283+0000 7f609ea71640 1 --2- 172.21.15.78:0/178073898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6098070e40 0x7f609815f2a0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f6088009830 tx=0x7f608802a510 comp rx=0 tx=0).stop 2024-09-17T03:13:49.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.283+0000 7f609ea71640 1 -- 172.21.15.78:0/178073898 shutdown_connections 2024-09-17T03:13:49.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.283+0000 7f609ea71640 1 --2- 172.21.15.78:0/178073898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6098070e40 0x7f609815f2a0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:49.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.283+0000 7f609ea71640 1 -- 172.21.15.78:0/178073898 >> 172.21.15.78:0/178073898 conn(0x7f60980cd530 msgr2=0x7f60980cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:49.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.283+0000 7f609ea71640 1 -- 172.21.15.78:0/178073898 shutdown_connections 2024-09-17T03:13:49.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.283+0000 7f609ea71640 1 -- 172.21.15.78:0/178073898 wait complete. 2024-09-17T03:13:49.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.285+0000 7f609ea71640 1 Processor -- start 2024-09-17T03:13:49.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.285+0000 7f609ea71640 1 -- start start 2024-09-17T03:13:49.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.286+0000 7f609ea71640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6098070e40 0x7f60981e6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:49.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.286+0000 7f609ea71640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6098075fa0 0x7f609814f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:49.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.286+0000 7f609ea71640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f609815f7e0 0x7f609814e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:49.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.286+0000 7f609ea71640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f60980cf1a0 con 0x7f609815f7e0 2024-09-17T03:13:49.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.286+0000 7f609ea71640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f60980cf020 con 0x7f6098070e40 2024-09-17T03:13:49.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.286+0000 7f609ea71640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f60980cf320 con 0x7f6098075fa0 2024-09-17T03:13:49.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.286+0000 7f609d00e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f609815f7e0 0x7f609814e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:49.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.286+0000 7f609d00e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f609815f7e0 0x7f609814e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40872/0 (socket says 172.21.15.78:40872) 2024-09-17T03:13:49.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.286+0000 7f609d00e640 1 -- 172.21.15.78:0/1346777047 learned_addr learned my addr 172.21.15.78:0/1346777047 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:49.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.286+0000 7f608ffff640 1 --2- 172.21.15.78:0/1346777047 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6098075fa0 0x7f609814f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.286+0000 7f609c80d640 1 --2- 172.21.15.78:0/1346777047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6098070e40 0x7f60981e6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.286+0000 7f609d00e640 1 -- 172.21.15.78:0/1346777047 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6098075fa0 msgr2=0x7f609814f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.287+0000 7f609d00e640 1 --2- 172.21.15.78:0/1346777047 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6098075fa0 0x7f609814f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.287+0000 7f609d00e640 1 -- 172.21.15.78:0/1346777047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6098070e40 msgr2=0x7f60981e6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.287+0000 7f609d00e640 1 --2- 172.21.15.78:0/1346777047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6098070e40 0x7f60981e6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.287+0000 7f609d00e640 1 -- 172.21.15.78:0/1346777047 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f609814f000 con 0x7f609815f7e0 2024-09-17T03:13:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.287+0000 7f609d00e640 1 --2- 172.21.15.78:0/1346777047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f609815f7e0 0x7f609814e080 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f609000cae0 tx=0x7f609000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.287+0000 7f608d7fa640 1 -- 172.21.15.78:0/1346777047 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090016020 con 0x7f609815f7e0 2024-09-17T03:13:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.287+0000 7f608d7fa640 1 -- 172.21.15.78:0/1346777047 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f609000ad30 con 0x7f609815f7e0 2024-09-17T03:13:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.287+0000 7f609ea71640 1 -- 172.21.15.78:0/1346777047 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f609814ed20 con 0x7f609815f7e0 2024-09-17T03:13:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.287+0000 7f608d7fa640 1 -- 172.21.15.78:0/1346777047 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6090012680 con 0x7f609815f7e0 2024-09-17T03:13:49.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.287+0000 7f609ea71640 1 -- 172.21.15.78:0/1346777047 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60981e5800 con 0x7f609815f7e0 2024-09-17T03:13:49.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.288+0000 7f609ea71640 1 -- 172.21.15.78:0/1346777047 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60980cf8f0 con 0x7f609815f7e0 2024-09-17T03:13:49.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.289+0000 7f608d7fa640 1 -- 172.21.15.78:0/1346777047 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6090019020 con 0x7f609815f7e0 2024-09-17T03:13:49.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.289+0000 7f608d7fa640 1 --2- 172.21.15.78:0/1346777047 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6084078b90 0x7f608407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:49.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.289+0000 7f608d7fa640 1 -- 172.21.15.78:0/1346777047 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f609009b350 con 0x7f609815f7e0 2024-09-17T03:13:49.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.289+0000 7f609c80d640 1 --2- 172.21.15.78:0/1346777047 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6084078b90 0x7f608407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:49.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.290+0000 7f609c80d640 1 --2- 172.21.15.78:0/1346777047 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6084078b90 0x7f608407b0a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6094006fd0 tx=0x7f6094008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:49.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.294+0000 7f608d7fa640 1 -- 172.21.15.78:0/1346777047 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6090020020 con 0x7f609815f7e0 2024-09-17T03:13:49.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.506+0000 7f609ea71640 1 -- 172.21.15.78:0/1346777047 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6098155b90 con 0x7f609815f7e0 2024-09-17T03:13:49.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.507+0000 7f608d7fa640 1 -- 172.21.15.78:0/1346777047 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5269 (secure 0 0 0) 0x7f6090063790 con 0x7f609815f7e0 2024-09-17T03:13:49.509 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:49.510 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":81,"btime":"2024-09-17T03:13:49:398833+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:35.489582+0000","modified":"2024-09-17T03:13:49.398825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7428,"mds_1":7425,"mds_2":6640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"d","rank":2,"incarnation":80,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6837/1005450673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1005450673},{"type":"v1","addr":"172.21.15.193:6837","nonce":1005450673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7425":{"gid":7425,"name":"c","rank":1,"incarnation":78,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6835/4018023271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4018023271},{"type":"v1","addr":"172.21.15.78:6835","nonce":4018023271}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6832/3357123265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":3357123265},{"type":"v1","addr":"172.21.15.78:6832","nonce":3357123265}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7428,"qdb_cluster":[6640,7425,7428]},"id":6}]} 2024-09-17T03:13:49.510 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 81 2024-09-17T03:13:49.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.509+0000 7f609ea71640 1 -- 172.21.15.78:0/1346777047 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6084078b90 msgr2=0x7f608407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:49.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.509+0000 7f609ea71640 1 --2- 172.21.15.78:0/1346777047 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6084078b90 0x7f608407b0a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6094006fd0 tx=0x7f6094008040 comp rx=0 tx=0).stop 2024-09-17T03:13:49.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.509+0000 7f609ea71640 1 -- 172.21.15.78:0/1346777047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f609815f7e0 msgr2=0x7f609814e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:49.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.509+0000 7f609ea71640 1 --2- 172.21.15.78:0/1346777047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f609815f7e0 0x7f609814e080 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f609000cae0 tx=0x7f609000a060 comp rx=0 tx=0).stop 2024-09-17T03:13:49.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.509+0000 7f609ea71640 1 -- 172.21.15.78:0/1346777047 shutdown_connections 2024-09-17T03:13:49.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.509+0000 7f609ea71640 1 --2- 172.21.15.78:0/1346777047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f609815f7e0 0x7f609814e080 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:49.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.509+0000 7f609ea71640 1 --2- 172.21.15.78:0/1346777047 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6098075fa0 0x7f609814f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:49.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.509+0000 7f609ea71640 1 --2- 172.21.15.78:0/1346777047 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6084078b90 0x7f608407b0a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:49.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.509+0000 7f609ea71640 1 --2- 172.21.15.78:0/1346777047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6098070e40 0x7f60981e6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:49.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.509+0000 7f609ea71640 1 -- 172.21.15.78:0/1346777047 >> 172.21.15.78:0/1346777047 conn(0x7f60980cd530 msgr2=0x7f60980702e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:49.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.509+0000 7f609ea71640 1 -- 172.21.15.78:0/1346777047 shutdown_connections 2024-09-17T03:13:49.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:49.509+0000 7f609ea71640 1 -- 172.21.15.78:0/1346777047 wait complete. 2024-09-17T03:13:49.923 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 81, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:13:35.489582+0000', 'modified': '2024-09-17T03:13:49.398825+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 7428, 'mds_1': 7425, 'mds_2': 6640}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6640': {'gid': 6640, 'name': 'd', 'rank': 2, 'incarnation': 80, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.193:6837/1005450673', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6835', 'nonce': 1005450673}, {'type': 'v1', 'addr': '172.21.15.193:6837', 'nonce': 1005450673}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_7425': {'gid': 7425, 'name': 'c', 'rank': 1, 'incarnation': 78, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.78:6835/4018023271', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6834', 'nonce': 4018023271}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 4018023271}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_7428': {'gid': 7428, 'name': 'a', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6832/3357123265', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6833', 'nonce': 3357123265}, {'type': 'v1', 'addr': '172.21.15.78:6832', 'nonce': 3357123265}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7428, 'qdb_cluster': [6640, 7425, 7428]} 2024-09-17T03:13:49.923 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-17T03:13:49.923 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T03:13:50.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.040+0000 7f5f1f625640 1 -- 172.21.15.78:0/1249791163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f18075fa0 msgr2=0x7f5f18070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.040+0000 7f5f1f625640 1 --2- 172.21.15.78:0/1249791163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f18075fa0 0x7f5f18070e40 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f5f180cbe10 tx=0x7f5f1402a580 comp rx=0 tx=0).stop 2024-09-17T03:13:50.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.040+0000 7f5f1f625640 1 -- 172.21.15.78:0/1249791163 shutdown_connections 2024-09-17T03:13:50.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.040+0000 7f5f1f625640 1 --2- 172.21.15.78:0/1249791163 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f1815f7e0 0x7f5f1815bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.040+0000 7f5f1f625640 1 --2- 172.21.15.78:0/1249791163 >> v2:172.21.15.193:3300/0 conn(0x7f5f1806e100 0x7f5f1815f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.040+0000 7f5f1f625640 1 --2- 172.21.15.78:0/1249791163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f18075fa0 0x7f5f18070e40 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.040+0000 7f5f1f625640 1 -- 172.21.15.78:0/1249791163 >> 172.21.15.78:0/1249791163 conn(0x7f5f180cd530 msgr2=0x7f5f180cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.040+0000 7f5f1f625640 1 -- 172.21.15.78:0/1249791163 shutdown_connections 2024-09-17T03:13:50.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.040+0000 7f5f1f625640 1 -- 172.21.15.78:0/1249791163 wait complete. 2024-09-17T03:13:50.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.042+0000 7f5f1f625640 1 Processor -- start 2024-09-17T03:13:50.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.042+0000 7f5f1f625640 1 -- start start 2024-09-17T03:13:50.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.043+0000 7f5f1f625640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f1806e100 0x7f5f18148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.043+0000 7f5f1f625640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f18075fa0 0x7f5f1814a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.043+0000 7f5f1f625640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f1815f7e0 0x7f5f1806cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.043+0000 7f5f1f625640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1815c400 con 0x7f5f1815f7e0 2024-09-17T03:13:50.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.043+0000 7f5f1f625640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5f180cc520 con 0x7f5f18075fa0 2024-09-17T03:13:50.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.043+0000 7f5f1f625640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5f1815c580 con 0x7f5f1806e100 2024-09-17T03:13:50.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.043+0000 7f5f1dbc2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f1815f7e0 0x7f5f1806cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.043+0000 7f5f1dbc2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f1815f7e0 0x7f5f1806cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40896/0 (socket says 172.21.15.78:40896) 2024-09-17T03:13:50.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.043+0000 7f5f1dbc2640 1 -- 172.21.15.78:0/1228899889 learned_addr learned my addr 172.21.15.78:0/1228899889 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:50.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.043+0000 7f5f1d3c1640 1 --2- 172.21.15.78:0/1228899889 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f1806e100 0x7f5f18148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.043+0000 7f5f1cbc0640 1 --2- 172.21.15.78:0/1228899889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f18075fa0 0x7f5f1814a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.043+0000 7f5f1dbc2640 1 -- 172.21.15.78:0/1228899889 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f1806e100 msgr2=0x7f5f18148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.043+0000 7f5f1dbc2640 1 --2- 172.21.15.78:0/1228899889 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f1806e100 0x7f5f18148070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.043+0000 7f5f1dbc2640 1 -- 172.21.15.78:0/1228899889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f18075fa0 msgr2=0x7f5f1814a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.043+0000 7f5f1dbc2640 1 --2- 172.21.15.78:0/1228899889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f18075fa0 0x7f5f1814a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.043+0000 7f5f1dbc2640 1 -- 172.21.15.78:0/1228899889 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1814b670 con 0x7f5f1815f7e0 2024-09-17T03:13:50.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.043+0000 7f5f1cbc0640 1 --2- 172.21.15.78:0/1228899889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f18075fa0 0x7f5f1814a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:50.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.043+0000 7f5f1dbc2640 1 --2- 172.21.15.78:0/1228899889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f1815f7e0 0x7f5f1806cde0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000cae0 tx=0x7f5f10007220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.044+0000 7f5f0dffb640 1 -- 172.21.15.78:0/1228899889 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f10007da0 con 0x7f5f1815f7e0 2024-09-17T03:13:50.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.044+0000 7f5f0dffb640 1 -- 172.21.15.78:0/1228899889 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f10004c30 con 0x7f5f1815f7e0 2024-09-17T03:13:50.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.044+0000 7f5f1f625640 1 -- 172.21.15.78:0/1228899889 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f181487c0 con 0x7f5f1815f7e0 2024-09-17T03:13:50.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.044+0000 7f5f0dffb640 1 -- 172.21.15.78:0/1228899889 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f10005280 con 0x7f5f1815f7e0 2024-09-17T03:13:50.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.044+0000 7f5f1f625640 1 -- 172.21.15.78:0/1228899889 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f18148d80 con 0x7f5f1815f7e0 2024-09-17T03:13:50.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.045+0000 7f5f0dffb640 1 -- 172.21.15.78:0/1228899889 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5f10005420 con 0x7f5f1815f7e0 2024-09-17T03:13:50.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.046+0000 7f5f0dffb640 1 --2- 172.21.15.78:0/1228899889 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5efc078b90 0x7f5efc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.046+0000 7f5f0dffb640 1 -- 172.21.15.78:0/1228899889 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f5f1009b6e0 con 0x7f5f1815f7e0 2024-09-17T03:13:50.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.046+0000 7f5f1d3c1640 1 --2- 172.21.15.78:0/1228899889 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5efc078b90 0x7f5efc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.047+0000 7f5f1d3c1640 1 --2- 172.21.15.78:0/1228899889 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5efc078b90 0x7f5efc07b0a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5f14033000 tx=0x7f5f14004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.047+0000 7f5f26673740 1 Processor -- start 2024-09-17T03:13:50.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.047+0000 7f5f26673740 1 -- start start 2024-09-17T03:13:50.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.048+0000 7f5f26673740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff585e5270 0x55ff589b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.048+0000 7f5f26673740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff585bc3b0 0x55ff589b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.048+0000 7f5f26673740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 0x55ff589d43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.048+0000 7f5f26673740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ff588ff820 con 0x55ff585c4590 2024-09-17T03:13:50.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.048+0000 7f5f26673740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ff588eec50 con 0x55ff585bc3b0 2024-09-17T03:13:50.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.048+0000 7f5f26673740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ff588f2a60 con 0x55ff585e5270 2024-09-17T03:13:50.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.048+0000 7f5f1dbc2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 0x55ff589d43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.048+0000 7f5f1dbc2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 0x55ff589d43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40912/0 (socket says 172.21.15.78:40912) 2024-09-17T03:13:50.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.048+0000 7f5f1dbc2640 1 -- 172.21.15.78:0/920836326 learned_addr learned my addr 172.21.15.78:0/920836326 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:50.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.048+0000 7f5f1cbc0640 1 --2- 172.21.15.78:0/920836326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff585bc3b0 0x55ff589b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.048+0000 7f5f1d3c1640 1 --2- 172.21.15.78:0/920836326 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff585e5270 0x55ff589b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.049+0000 7f5f1dbc2640 1 -- 172.21.15.78:0/920836326 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff585e5270 msgr2=0x55ff589b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.049+0000 7f5f1dbc2640 1 --2- 172.21.15.78:0/920836326 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff585e5270 0x55ff589b6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.049+0000 7f5f1dbc2640 1 -- 172.21.15.78:0/920836326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff585bc3b0 msgr2=0x55ff589b74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.049+0000 7f5f1dbc2640 1 --2- 172.21.15.78:0/920836326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff585bc3b0 0x55ff589b74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.049+0000 7f5f1dbc2640 1 -- 172.21.15.78:0/920836326 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff58650850 con 0x55ff585c4590 2024-09-17T03:13:50.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.049+0000 7f5f1dbc2640 1 --2- 172.21.15.78:0/920836326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 0x55ff589d43e0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f5f10099c30 tx=0x7f5f10062fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c9c0dae2043164 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.049+0000 7f5f02ffd640 1 -- 172.21.15.78:0/920836326 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1001d040 con 0x55ff585c4590 2024-09-17T03:13:50.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.049+0000 7f5f02ffd640 1 -- 172.21.15.78:0/920836326 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f10067f90 con 0x55ff585c4590 2024-09-17T03:13:50.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.049+0000 7f5f02ffd640 1 -- 172.21.15.78:0/920836326 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1006ce40 con 0x55ff585c4590 2024-09-17T03:13:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.050+0000 7f5f26673740 1 -- 172.21.15.78:0/920836326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 msgr2=0x55ff589d43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.050+0000 7f5f26673740 1 --2- 172.21.15.78:0/920836326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 0x55ff589d43e0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f5f10099c30 tx=0x7f5f10062fc0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.050+0000 7f5f26673740 1 -- 172.21.15.78:0/920836326 shutdown_connections 2024-09-17T03:13:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.050+0000 7f5f26673740 1 --2- 172.21.15.78:0/920836326 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 0x55ff589d43e0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.050+0000 7f5f26673740 1 --2- 172.21.15.78:0/920836326 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff585bc3b0 0x55ff589b74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.050+0000 7f5f26673740 1 --2- 172.21.15.78:0/920836326 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff585e5270 0x55ff589b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.050+0000 7f5f26673740 1 -- 172.21.15.78:0/920836326 >> 172.21.15.78:0/920836326 conn(0x55ff585d93c0 msgr2=0x55ff5898d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.050+0000 7f5f26673740 1 -- 172.21.15.78:0/920836326 shutdown_connections 2024-09-17T03:13:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.050+0000 7f5f26673740 1 -- 172.21.15.78:0/920836326 wait complete. 2024-09-17T03:13:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.051+0000 7f5f26673740 1 -- start start 2024-09-17T03:13:50.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.051+0000 7f5f26673740 1 Processor -- start 2024-09-17T03:13:50.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.052+0000 7f5f26673740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff585bc3b0 0x55ff589e4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.052+0000 7f5f26673740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 0x55ff589a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.052+0000 7f5f26673740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff585e5270 0x55ff589cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.052+0000 7f5f26673740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ff5865f620 con 0x55ff585c4590 2024-09-17T03:13:50.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.052+0000 7f5f26673740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ff588945f0 con 0x55ff585e5270 2024-09-17T03:13:50.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.052+0000 7f5f26673740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ff589b7a20 con 0x55ff585bc3b0 2024-09-17T03:13:50.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.052+0000 7f5f26673740 10 client.0 _ll_register_callbacks cb 0x55ff588980a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:50.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.052+0000 7f5f1cbc0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 0x55ff589a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.052+0000 7f5f1cbc0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 0x55ff589a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40916/0 (socket says 172.21.15.78:40916) 2024-09-17T03:13:50.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.052+0000 7f5f1cbc0640 1 -- 172.21.15.78:0/87006011 learned_addr learned my addr 172.21.15.78:0/87006011 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:50.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.052+0000 7f5f1d3c1640 1 --2- 172.21.15.78:0/87006011 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff585bc3b0 0x55ff589e4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.052+0000 7f5f1dbc2640 1 --2- 172.21.15.78:0/87006011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff585e5270 0x55ff589cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5f1cbc0640 1 -- 172.21.15.78:0/87006011 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff585bc3b0 msgr2=0x55ff589e4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5f1cbc0640 1 --2- 172.21.15.78:0/87006011 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff585bc3b0 0x55ff589e4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5f1cbc0640 1 -- 172.21.15.78:0/87006011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff585e5270 msgr2=0x55ff589cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5f1cbc0640 1 --2- 172.21.15.78:0/87006011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff585e5270 0x55ff589cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5f1cbc0640 1 -- 172.21.15.78:0/87006011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff586c76b0 con 0x55ff585c4590 2024-09-17T03:13:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5f1cbc0640 1 --2- 172.21.15.78:0/87006011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 0x55ff589a51b0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f5f08011860 tx=0x7f5f08011d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8ab915f2d126db server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5ef7fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5ef7fff640 1 -- 172.21.15.78:0/87006011 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800fdf0 con 0x55ff585c4590 2024-09-17T03:13:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5ef7fff640 1 -- 172.21.15.78:0/87006011 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f5f08004020 con 0x55ff585c4590 2024-09-17T03:13:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5f26673740 1 -- 172.21.15.78:0/87006011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f10067f90 con 0x55ff585c4590 2024-09-17T03:13:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5ef7fff640 1 -- 172.21.15.78:0/87006011 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f5f08022050 con 0x55ff585c4590 2024-09-17T03:13:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5f26673740 10 client.7641 fetch_fsmap learned FSMap version 81 2024-09-17T03:13:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5f26673740 1 -- 172.21.15.78:0/87006011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x55ff589c8b90 con 0x55ff585c4590 2024-09-17T03:13:50.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5ef7fff640 1 -- 172.21.15.78:0/87006011 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f10067f90 con 0x55ff585c4590 2024-09-17T03:13:50.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5ef7fff640 1 -- 172.21.15.78:0/87006011 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 81) ==== 3542+0+0 (secure 0 0 0) 0x7f5f08025020 con 0x55ff585c4590 2024-09-17T03:13:50.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5f26673740 10 client.7641 fetch_fsmap finished waiting for FSMap version 81 2024-09-17T03:13:50.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5f26673740 10 client.7641 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:13:50.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5f26673740 20 client.7641 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:50.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5f26673740 1 --2- 172.21.15.78:0/87006011 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x55ff585a3e40 0x55ff589cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5f26673740 4 client.7641 mds_command: new command op to 6640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:13:50.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.053+0000 7f5f26673740 1 -- 172.21.15.78:0/87006011 --> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff58901770 con 0x55ff585a3e40 2024-09-17T03:13:50.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.054+0000 7f5f1d3c1640 1 --2- 172.21.15.78:0/87006011 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x55ff585a3e40 0x55ff589cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.054+0000 7f5ef7fff640 10 client.7641 ms_handle_connect on v2:172.21.15.193:6835/1005450673 2024-09-17T03:13:50.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.054+0000 7f5f1d3c1640 1 --2- 172.21.15.78:0/87006011 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x55ff585a3e40 0x55ff589cc370 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b9cc024a1a2794cf server_cookie=d3ea1cbc0e63ec34 in_seq=0 out_seq=0 2024-09-17T03:13:50.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.055+0000 7f5ef7fff640 1 -- 172.21.15.78:0/87006011 <== mds.2 v2:172.21.15.193:6835/1005450673 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ff58901770 con 0x55ff585a3e40 2024-09-17T03:13:50.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.055+0000 7f5ef7fff640 10 client.7641 handle_command_reply: tid=0 2024-09-17T03:13:50.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.055+0000 7f5f26673740 1 client.7641 shutdown 2024-09-17T03:13:50.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.055+0000 7f5f26673740 1 -- 172.21.15.78:0/87006011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 msgr2=0x55ff589a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.055+0000 7f5f26673740 1 --2- 172.21.15.78:0/87006011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 0x55ff589a51b0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f5f08011860 tx=0x7f5f08011d20 comp rx=0 tx=0).stop 2024-09-17T03:13:50.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.055+0000 7f5f26673740 1 -- 172.21.15.78:0/87006011 shutdown_connections 2024-09-17T03:13:50.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.055+0000 7f5f26673740 1 --2- 172.21.15.78:0/87006011 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x55ff585a3e40 0x55ff589cc370 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.055+0000 7f5f26673740 1 --2- 172.21.15.78:0/87006011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff585e5270 0x55ff589cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.055+0000 7f5ef7fff640 0 client.7641 ms_handle_reset on v2:172.21.15.193:6835/1005450673 2024-09-17T03:13:50.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.055+0000 7f5f26673740 1 --2- 172.21.15.78:0/87006011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 0x55ff589a51b0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.055+0000 7f5f26673740 1 --2- 172.21.15.78:0/87006011 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff585bc3b0 0x55ff589e4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.055+0000 7f5f26673740 1 -- 172.21.15.78:0/87006011 >> 172.21.15.78:0/87006011 conn(0x55ff585d93c0 msgr2=0x55ff5898d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.055+0000 7f5f26673740 1 -- 172.21.15.78:0/87006011 shutdown_connections 2024-09-17T03:13:50.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.055+0000 7f5f26673740 1 -- 172.21.15.78:0/87006011 wait complete. 2024-09-17T03:13:50.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.056+0000 7f5f26673740 20 client.7641 trim_cache size 0 max 16384 2024-09-17T03:13:50.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.073+0000 7f5f26673740 1 Processor -- start 2024-09-17T03:13:50.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.073+0000 7f5f26673740 1 -- start start 2024-09-17T03:13:50.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.075+0000 7f5f26673740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585a3e40 0x55ff589d3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.075+0000 7f5f26673740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff585bc3b0 0x55ff589d3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.075+0000 7f5f26673740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff585c4590 0x55ff58986200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.075+0000 7f5f26673740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5f182014d0 con 0x55ff585a3e40 2024-09-17T03:13:50.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.075+0000 7f5f26673740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5f18201ba0 con 0x55ff585c4590 2024-09-17T03:13:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.075+0000 7f5f26673740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5f18149e90 con 0x55ff585bc3b0 2024-09-17T03:13:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.075+0000 7f5f1d3c1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585a3e40 0x55ff589d3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.075+0000 7f5f1d3c1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585a3e40 0x55ff589d3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40920/0 (socket says 172.21.15.78:40920) 2024-09-17T03:13:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.075+0000 7f5f1d3c1640 1 -- 172.21.15.78:0/2261704723 learned_addr learned my addr 172.21.15.78:0/2261704723 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.075+0000 7f5f1d3c1640 1 -- 172.21.15.78:0/2261704723 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff585bc3b0 msgr2=0x55ff589d3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.075+0000 7f5f1d3c1640 1 --2- 172.21.15.78:0/2261704723 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff585bc3b0 0x55ff589d3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.075+0000 7f5f1d3c1640 1 -- 172.21.15.78:0/2261704723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff585c4590 msgr2=0x55ff58986200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.075+0000 7f5f1d3c1640 1 --2- 172.21.15.78:0/2261704723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff585c4590 0x55ff58986200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.075+0000 7f5f1d3c1640 1 -- 172.21.15.78:0/2261704723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff589ca470 con 0x55ff585a3e40 2024-09-17T03:13:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.075+0000 7f5f1d3c1640 1 --2- 172.21.15.78:0/2261704723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585a3e40 0x55ff589d3a80 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f5f1402ab70 tx=0x7f5f1403c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adde39f1f9e6557d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.075+0000 7f5f027fc640 1 -- 172.21.15.78:0/2261704723 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f14035040 con 0x55ff585a3e40 2024-09-17T03:13:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.075+0000 7f5f027fc640 1 -- 172.21.15.78:0/2261704723 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f14042040 con 0x55ff585a3e40 2024-09-17T03:13:50.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.075+0000 7f5f027fc640 1 -- 172.21.15.78:0/2261704723 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f140049e0 con 0x55ff585a3e40 2024-09-17T03:13:50.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.076+0000 7f5f26673740 1 -- 172.21.15.78:0/2261704723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585a3e40 msgr2=0x55ff589d3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.076+0000 7f5f26673740 1 --2- 172.21.15.78:0/2261704723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585a3e40 0x55ff589d3a80 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f5f1402ab70 tx=0x7f5f1403c000 comp rx=0 tx=0).stop 2024-09-17T03:13:50.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.076+0000 7f5f26673740 1 -- 172.21.15.78:0/2261704723 shutdown_connections 2024-09-17T03:13:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.076+0000 7f5f26673740 1 --2- 172.21.15.78:0/2261704723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff585c4590 0x55ff58986200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.076+0000 7f5f26673740 1 --2- 172.21.15.78:0/2261704723 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff585bc3b0 0x55ff589d3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.076+0000 7f5f26673740 1 --2- 172.21.15.78:0/2261704723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585a3e40 0x55ff589d3a80 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.076+0000 7f5f26673740 1 -- 172.21.15.78:0/2261704723 >> 172.21.15.78:0/2261704723 conn(0x55ff585d93c0 msgr2=0x55ff589c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.076+0000 7f5f26673740 1 -- 172.21.15.78:0/2261704723 shutdown_connections 2024-09-17T03:13:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.076+0000 7f5f26673740 1 -- 172.21.15.78:0/2261704723 wait complete. 2024-09-17T03:13:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.077+0000 7f5f26673740 1 -- start start 2024-09-17T03:13:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.077+0000 7f5f26673740 1 Processor -- start 2024-09-17T03:13:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.078+0000 7f5f26673740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff585a3e40 0x55ff58a47f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.078+0000 7f5f26673740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff585bc3b0 0x55ff58a54a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.078+0000 7f5f26673740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 0x55ff58a54fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.078+0000 7f5f26673740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ff589e0d00 con 0x55ff585c4590 2024-09-17T03:13:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.078+0000 7f5f26673740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ff589a56f0 con 0x55ff585bc3b0 2024-09-17T03:13:50.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.078+0000 7f5f26673740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ff589cdde0 con 0x55ff585a3e40 2024-09-17T03:13:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.078+0000 7f5f26673740 10 client.0 _ll_register_callbacks cb 0x7f5f08011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5f1dbc2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 0x55ff58a54fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5f1dbc2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 0x55ff58a54fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40936/0 (socket says 172.21.15.78:40936) 2024-09-17T03:13:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5f1dbc2640 1 -- 172.21.15.78:0/3576907637 learned_addr learned my addr 172.21.15.78:0/3576907637 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5f1cbc0640 1 --2- 172.21.15.78:0/3576907637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff585bc3b0 0x55ff58a54a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5f1d3c1640 1 --2- 172.21.15.78:0/3576907637 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff585a3e40 0x55ff58a47f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5f1dbc2640 1 -- 172.21.15.78:0/3576907637 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff585a3e40 msgr2=0x55ff58a47f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5f1dbc2640 1 --2- 172.21.15.78:0/3576907637 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff585a3e40 0x55ff58a47f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5f1dbc2640 1 -- 172.21.15.78:0/3576907637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff585bc3b0 msgr2=0x55ff58a54a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5f1dbc2640 1 --2- 172.21.15.78:0/3576907637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff585bc3b0 0x55ff58a54a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5f1dbc2640 1 -- 172.21.15.78:0/3576907637 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff589e6e30 con 0x55ff585c4590 2024-09-17T03:13:50.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5f1cbc0640 1 --2- 172.21.15.78:0/3576907637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff585bc3b0 0x55ff58a54a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5f1d3c1640 1 --2- 172.21.15.78:0/3576907637 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff585a3e40 0x55ff58a47f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5f1dbc2640 1 --2- 172.21.15.78:0/3576907637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 0x55ff58a54fc0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f5f10060720 tx=0x7f5f10007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7725c22ec384aa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5ef7fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5ef7fff640 1 -- 172.21.15.78:0/3576907637 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1001d040 con 0x55ff585c4590 2024-09-17T03:13:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5ef7fff640 1 -- 172.21.15.78:0/3576907637 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f5f1006cbc0 con 0x55ff585c4590 2024-09-17T03:13:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5f26673740 1 -- 172.21.15.78:0/3576907637 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f14042040 con 0x55ff585c4590 2024-09-17T03:13:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5ef7fff640 1 -- 172.21.15.78:0/3576907637 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f5f1006ce40 con 0x55ff585c4590 2024-09-17T03:13:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5f26673740 10 client.7647 fetch_fsmap learned FSMap version 81 2024-09-17T03:13:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5f26673740 1 -- 172.21.15.78:0/3576907637 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x55ff58a55920 con 0x55ff585c4590 2024-09-17T03:13:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.079+0000 7f5ef7fff640 1 -- 172.21.15.78:0/3576907637 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f14042040 con 0x55ff585c4590 2024-09-17T03:13:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.080+0000 7f5ef7fff640 1 -- 172.21.15.78:0/3576907637 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 81) ==== 3542+0+0 (secure 0 0 0) 0x7f5f10005800 con 0x55ff585c4590 2024-09-17T03:13:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.080+0000 7f5f26673740 10 client.7647 fetch_fsmap finished waiting for FSMap version 81 2024-09-17T03:13:50.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.080+0000 7f5f26673740 10 client.7647 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:13:50.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.080+0000 7f5f26673740 20 client.7647 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:50.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.080+0000 7f5f26673740 1 --2- 172.21.15.78:0/3576907637 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x55ff58579280 0x55ff589f3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.080+0000 7f5f26673740 4 client.7647 mds_command: new command op to 6640 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:13:50.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.080+0000 7f5f26673740 1 -- 172.21.15.78:0/3576907637 --> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] -- command(tid 0: {"prefix": "status"}) -- 0x55ff588fd220 con 0x55ff58579280 2024-09-17T03:13:50.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.080+0000 7f5f1d3c1640 1 --2- 172.21.15.78:0/3576907637 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x55ff58579280 0x55ff589f3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.080+0000 7f5ef7fff640 10 client.7647 ms_handle_connect on v2:172.21.15.193:6835/1005450673 2024-09-17T03:13:50.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.080+0000 7f5f1d3c1640 1 --2- 172.21.15.78:0/3576907637 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x55ff58579280 0x55ff589f3e60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e28a9378e58904d7 server_cookie=ed483fb10f7dc1b1 in_seq=0 out_seq=0 2024-09-17T03:13:50.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.080+0000 7f5ef7fff640 1 -- 172.21.15.78:0/3576907637 <== mds.2 v2:172.21.15.193:6835/1005450673 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55ff588fd220 con 0x55ff58579280 2024-09-17T03:13:50.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.080+0000 7f5ef7fff640 10 client.7647 handle_command_reply: tid=0 2024-09-17T03:13:50.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.080+0000 7f5f26673740 1 client.7647 shutdown 2024-09-17T03:13:50.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f26673740 1 -- 172.21.15.78:0/3576907637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 msgr2=0x55ff58a54fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f26673740 1 --2- 172.21.15.78:0/3576907637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 0x55ff58a54fc0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f5f10060720 tx=0x7f5f10007f40 comp rx=0 tx=0).stop 2024-09-17T03:13:50.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f26673740 1 -- 172.21.15.78:0/3576907637 shutdown_connections 2024-09-17T03:13:50.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f26673740 1 --2- 172.21.15.78:0/3576907637 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x55ff58579280 0x55ff589f3e60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f26673740 1 --2- 172.21.15.78:0/3576907637 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff585c4590 0x55ff58a54fc0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5ef7fff640 0 client.7647 ms_handle_reset on v2:172.21.15.193:6835/1005450673 2024-09-17T03:13:50.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f26673740 1 --2- 172.21.15.78:0/3576907637 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff585bc3b0 0x55ff58a54a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f26673740 1 --2- 172.21.15.78:0/3576907637 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff585a3e40 0x55ff58a47f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f26673740 1 -- 172.21.15.78:0/3576907637 >> 172.21.15.78:0/3576907637 conn(0x55ff585d93c0 msgr2=0x55ff589d3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f26673740 1 -- 172.21.15.78:0/3576907637 shutdown_connections 2024-09-17T03:13:50.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f26673740 1 -- 172.21.15.78:0/3576907637 wait complete. 2024-09-17T03:13:50.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f26673740 20 client.7647 trim_cache size 0 max 16384 2024-09-17T03:13:50.087 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:13:50.087 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:13:50.087 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 2, 2024-09-17T03:13:50.087 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 6640, 2024-09-17T03:13:50.087 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:13:50.087 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:13:50.087 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:13:50.087 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 1.683082872, 2024-09-17T03:13:50.087 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 81, 2024-09-17T03:13:50.087 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 82, 2024-09-17T03:13:50.087 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 82, 2024-09-17T03:13:50.088 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 18.618399116999999 2024-09-17T03:13:50.088 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:13:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f1f625640 1 -- 172.21.15.78:0/1228899889 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5efc078b90 msgr2=0x7f5efc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f1f625640 1 --2- 172.21.15.78:0/1228899889 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5efc078b90 0x7f5efc07b0a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5f14033000 tx=0x7f5f14004730 comp rx=0 tx=0).stop 2024-09-17T03:13:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f1f625640 1 -- 172.21.15.78:0/1228899889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f1815f7e0 msgr2=0x7f5f1806cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f1f625640 1 --2- 172.21.15.78:0/1228899889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f1815f7e0 0x7f5f1806cde0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000cae0 tx=0x7f5f10007220 comp rx=0 tx=0).stop 2024-09-17T03:13:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f1f625640 1 -- 172.21.15.78:0/1228899889 shutdown_connections 2024-09-17T03:13:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f1f625640 1 --2- 172.21.15.78:0/1228899889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f1815f7e0 0x7f5f1806cde0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f1f625640 1 --2- 172.21.15.78:0/1228899889 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5efc078b90 0x7f5efc07b0a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f1f625640 1 --2- 172.21.15.78:0/1228899889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f18075fa0 0x7f5f1814a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f1f625640 1 --2- 172.21.15.78:0/1228899889 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f1806e100 0x7f5f18148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.081+0000 7f5f1f625640 1 -- 172.21.15.78:0/1228899889 >> 172.21.15.78:0/1228899889 conn(0x7f5f180cd530 msgr2=0x7f5f180b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.082+0000 7f5f1f625640 1 -- 172.21.15.78:0/1228899889 shutdown_connections 2024-09-17T03:13:50.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.082+0000 7f5f1f625640 1 -- 172.21.15.78:0/1228899889 wait complete. 2024-09-17T03:13:50.092 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:13:50.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.206+0000 7f6827da8640 1 -- 172.21.15.78:0/2249108492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682006e170 msgr2=0x7f68200b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.206+0000 7f6827da8640 1 --2- 172.21.15.78:0/2249108492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682006e170 0x7f68200b3540 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f682008d9b0 tx=0x7f681002a870 comp rx=0 tx=0).stop 2024-09-17T03:13:50.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.206+0000 7f6827da8640 1 -- 172.21.15.78:0/2249108492 shutdown_connections 2024-09-17T03:13:50.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.206+0000 7f6827da8640 1 --2- 172.21.15.78:0/2249108492 >> v2:172.21.15.193:3300/0 conn(0x7f682006f4b0 0x7f68200d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.206+0000 7f6827da8640 1 --2- 172.21.15.78:0/2249108492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682006e170 0x7f68200b3540 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.206+0000 7f6827da8640 1 -- 172.21.15.78:0/2249108492 >> 172.21.15.78:0/2249108492 conn(0x7f682008bfc0 msgr2=0x7f682009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.206+0000 7f6827da8640 1 -- 172.21.15.78:0/2249108492 shutdown_connections 2024-09-17T03:13:50.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.206+0000 7f6827da8640 1 -- 172.21.15.78:0/2249108492 wait complete. 2024-09-17T03:13:50.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.208+0000 7f6827da8640 1 Processor -- start 2024-09-17T03:13:50.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.208+0000 7f6827da8640 1 -- start start 2024-09-17T03:13:50.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.209+0000 7f6827da8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f682006f4b0 0x7f68201f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.209+0000 7f6827da8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68200d3870 0x7f682015fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.209+0000 7f6827da8640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f68200b8900 0x7f68200cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.209+0000 7f6827da8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f68200d0ce0 con 0x7f68200d3870 2024-09-17T03:13:50.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.209+0000 7f6827da8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f68200cf460 con 0x7f682006f4b0 2024-09-17T03:13:50.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.209+0000 7f6827da8640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f68200d0e60 con 0x7f68200b8900 2024-09-17T03:13:50.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.210+0000 7f6825343640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68200d3870 0x7f682015fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.210+0000 7f6825343640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68200d3870 0x7f682015fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40948/0 (socket says 172.21.15.78:40948) 2024-09-17T03:13:50.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.210+0000 7f6825343640 1 -- 172.21.15.78:0/2610509867 learned_addr learned my addr 172.21.15.78:0/2610509867 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:50.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.210+0000 7f6825b44640 1 --2- 172.21.15.78:0/2610509867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f682006f4b0 0x7f68201f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.210+0000 7f6825343640 1 -- 172.21.15.78:0/2610509867 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f68200b8900 msgr2=0x7f68200cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.210+0000 7f6826345640 1 --2- 172.21.15.78:0/2610509867 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f68200b8900 0x7f68200cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.210+0000 7f6825343640 1 --2- 172.21.15.78:0/2610509867 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f68200b8900 0x7f68200cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.210+0000 7f6825343640 1 -- 172.21.15.78:0/2610509867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f682006f4b0 msgr2=0x7f68201f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.210+0000 7f6825343640 1 --2- 172.21.15.78:0/2610509867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f682006f4b0 0x7f68201f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.210+0000 7f6825343640 1 -- 172.21.15.78:0/2610509867 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68200cb810 con 0x7f68200d3870 2024-09-17T03:13:50.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.210+0000 7f6825b44640 1 --2- 172.21.15.78:0/2610509867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f682006f4b0 0x7f68201f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:13:50.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.210+0000 7f6826345640 1 --2- 172.21.15.78:0/2610509867 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f68200b8900 0x7f68200cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:50.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.210+0000 7f6825343640 1 --2- 172.21.15.78:0/2610509867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68200d3870 0x7f682015fab0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f681400d6d0 tx=0x7f681400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.210+0000 7f681e7fc640 1 -- 172.21.15.78:0/2610509867 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6814017070 con 0x7f68200d3870 2024-09-17T03:13:50.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.210+0000 7f681e7fc640 1 -- 172.21.15.78:0/2610509867 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6814009b10 con 0x7f68200d3870 2024-09-17T03:13:50.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.210+0000 7f6827da8640 1 -- 172.21.15.78:0/2610509867 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68200cc8b0 con 0x7f68200d3870 2024-09-17T03:13:50.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.210+0000 7f681e7fc640 1 -- 172.21.15.78:0/2610509867 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6814010460 con 0x7f68200d3870 2024-09-17T03:13:50.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.210+0000 7f6827da8640 1 -- 172.21.15.78:0/2610509867 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68200cbdd0 con 0x7f68200d3870 2024-09-17T03:13:50.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.212+0000 7f681e7fc640 1 -- 172.21.15.78:0/2610509867 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f681401a070 con 0x7f68200d3870 2024-09-17T03:13:50.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.213+0000 7f681e7fc640 1 --2- 172.21.15.78:0/2610509867 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f680c078b90 0x7f680c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.213+0000 7f681e7fc640 1 -- 172.21.15.78:0/2610509867 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f681409aed0 con 0x7f68200d3870 2024-09-17T03:13:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.213+0000 7f6825b44640 1 --2- 172.21.15.78:0/2610509867 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f680c078b90 0x7f680c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.214+0000 7f6825b44640 1 --2- 172.21.15.78:0/2610509867 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f680c078b90 0x7f680c07b0a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6810034000 tx=0x7f6810004ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.214+0000 7f682edef740 1 Processor -- start 2024-09-17T03:13:50.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.214+0000 7f682edef740 1 -- start start 2024-09-17T03:13:50.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.215+0000 7f682edef740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6162b4270 0x55d616685fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.215+0000 7f682edef740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d61628b3b0 0x55d6166864e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.215+0000 7f682edef740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d616293590 0x55d6166a33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.215+0000 7f682edef740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55d6165ce820 con 0x55d6162b4270 2024-09-17T03:13:50.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.215+0000 7f682edef740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d6165bdc50 con 0x55d616293590 2024-09-17T03:13:50.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.215+0000 7f682edef740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55d6165c1a60 con 0x55d61628b3b0 2024-09-17T03:13:50.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.215+0000 7f6825b44640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6162b4270 0x55d616685fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.215+0000 7f6825b44640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6162b4270 0x55d616685fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40956/0 (socket says 172.21.15.78:40956) 2024-09-17T03:13:50.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.215+0000 7f6825b44640 1 -- 172.21.15.78:0/998204112 learned_addr learned my addr 172.21.15.78:0/998204112 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:50.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.216+0000 7f6825343640 1 --2- 172.21.15.78:0/998204112 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d61628b3b0 0x55d6166864e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.216+0000 7f6826345640 1 --2- 172.21.15.78:0/998204112 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d616293590 0x55d6166a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.216+0000 7f6825b44640 1 -- 172.21.15.78:0/998204112 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d61628b3b0 msgr2=0x55d6166864e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.216+0000 7f6825b44640 1 --2- 172.21.15.78:0/998204112 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d61628b3b0 0x55d6166864e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.216+0000 7f6825b44640 1 -- 172.21.15.78:0/998204112 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d616293590 msgr2=0x55d6166a33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.216+0000 7f6825b44640 1 --2- 172.21.15.78:0/998204112 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d616293590 0x55d6166a33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.216+0000 7f6825b44640 1 -- 172.21.15.78:0/998204112 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d61631f850 con 0x55d6162b4270 2024-09-17T03:13:50.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.216+0000 7f6825b44640 1 --2- 172.21.15.78:0/998204112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6162b4270 0x55d616685fa0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f6810000f80 tx=0x7f681003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc31536a241c6bb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.216+0000 7f68077fe640 1 -- 172.21.15.78:0/998204112 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6810043070 con 0x55d6162b4270 2024-09-17T03:13:50.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.216+0000 7f68077fe640 1 -- 172.21.15.78:0/998204112 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f681004f070 con 0x55d6162b4270 2024-09-17T03:13:50.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.216+0000 7f68077fe640 1 -- 172.21.15.78:0/998204112 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6810037040 con 0x55d6162b4270 2024-09-17T03:13:50.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.217+0000 7f682edef740 1 -- 172.21.15.78:0/998204112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6162b4270 msgr2=0x55d616685fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.217+0000 7f682edef740 1 --2- 172.21.15.78:0/998204112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6162b4270 0x55d616685fa0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f6810000f80 tx=0x7f681003d000 comp rx=0 tx=0).stop 2024-09-17T03:13:50.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.217+0000 7f682edef740 1 -- 172.21.15.78:0/998204112 shutdown_connections 2024-09-17T03:13:50.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.217+0000 7f682edef740 1 --2- 172.21.15.78:0/998204112 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d616293590 0x55d6166a33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.217+0000 7f682edef740 1 --2- 172.21.15.78:0/998204112 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d61628b3b0 0x55d6166864e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.217+0000 7f682edef740 1 --2- 172.21.15.78:0/998204112 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d6162b4270 0x55d616685fa0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.217+0000 7f682edef740 1 -- 172.21.15.78:0/998204112 >> 172.21.15.78:0/998204112 conn(0x55d6162a83c0 msgr2=0x55d61665c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.217+0000 7f682edef740 1 -- 172.21.15.78:0/998204112 shutdown_connections 2024-09-17T03:13:50.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.217+0000 7f682edef740 1 -- 172.21.15.78:0/998204112 wait complete. 2024-09-17T03:13:50.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.218+0000 7f682edef740 1 -- start start 2024-09-17T03:13:50.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.218+0000 7f682edef740 1 Processor -- start 2024-09-17T03:13:50.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.219+0000 7f682edef740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d61628b3b0 0x55d6166a4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.219+0000 7f682edef740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d616293590 0x55d6166717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.219+0000 7f682edef740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d6162b4270 0x55d6166552a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.219+0000 7f682edef740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55d61632e620 con 0x55d616293590 2024-09-17T03:13:50.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.219+0000 7f682edef740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d6165635f0 con 0x55d61628b3b0 2024-09-17T03:13:50.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.219+0000 7f682edef740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55d616686a20 con 0x55d6162b4270 2024-09-17T03:13:50.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.219+0000 7f682edef740 10 client.0 _ll_register_callbacks cb 0x55d6165670a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:50.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.219+0000 7f6825343640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d616293590 0x55d6166717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.219+0000 7f6825343640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d616293590 0x55d6166717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40968/0 (socket says 172.21.15.78:40968) 2024-09-17T03:13:50.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.219+0000 7f6825343640 1 -- 172.21.15.78:0/2856340527 learned_addr learned my addr 172.21.15.78:0/2856340527 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:50.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f6826345640 1 --2- 172.21.15.78:0/2856340527 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d6162b4270 0x55d6166552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f6825b44640 1 --2- 172.21.15.78:0/2856340527 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d61628b3b0 0x55d6166a4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f6825343640 1 -- 172.21.15.78:0/2856340527 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d6162b4270 msgr2=0x55d6166552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f6825343640 1 --2- 172.21.15.78:0/2856340527 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d6162b4270 0x55d6166552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f6825343640 1 -- 172.21.15.78:0/2856340527 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d61628b3b0 msgr2=0x55d6166a4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f6825343640 1 --2- 172.21.15.78:0/2856340527 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d61628b3b0 0x55d6166a4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f6825343640 1 -- 172.21.15.78:0/2856340527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6163966b0 con 0x55d616293590 2024-09-17T03:13:50.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f6825343640 1 --2- 172.21.15.78:0/2856340527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d616293590 0x55d6166717e0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f681400d6a0 tx=0x7f6814062840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb6eae547146a7b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f6804ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:50.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f6804ff9640 1 -- 172.21.15.78:0/2856340527 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6814021030 con 0x55d616293590 2024-09-17T03:13:50.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f6804ff9640 1 -- 172.21.15.78:0/2856340527 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f681404bbf0 con 0x55d616293590 2024-09-17T03:13:50.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f682edef740 1 -- 172.21.15.78:0/2856340527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f681004f070 con 0x55d616293590 2024-09-17T03:13:50.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f6804ff9640 1 -- 172.21.15.78:0/2856340527 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f68140676e0 con 0x55d616293590 2024-09-17T03:13:50.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f682edef740 10 client.7662 fetch_fsmap learned FSMap version 81 2024-09-17T03:13:50.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f682edef740 1 -- 172.21.15.78:0/2856340527 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x55d6166a4e60 con 0x55d616293590 2024-09-17T03:13:50.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f6804ff9640 1 -- 172.21.15.78:0/2856340527 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f681004f070 con 0x55d616293590 2024-09-17T03:13:50.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f6804ff9640 1 -- 172.21.15.78:0/2856340527 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 81) ==== 3542+0+0 (secure 0 0 0) 0x7f681405e550 con 0x55d616293590 2024-09-17T03:13:50.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f682edef740 10 client.7662 fetch_fsmap finished waiting for FSMap version 81 2024-09-17T03:13:50.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f682edef740 10 client.7662 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:13:50.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f682edef740 20 client.7662 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:50.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f682edef740 1 --2- 172.21.15.78:0/2856340527 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x55d616272e40 0x55d6166b3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f682edef740 4 client.7662 mds_command: new command op to 7425 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:13:50.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.220+0000 7f682edef740 1 -- 172.21.15.78:0/2856340527 --> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6165d0770 con 0x55d616272e40 2024-09-17T03:13:50.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.221+0000 7f6825b44640 1 --2- 172.21.15.78:0/2856340527 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x55d616272e40 0x55d6166b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.221+0000 7f6804ff9640 10 client.7662 ms_handle_connect on v2:172.21.15.78:6834/4018023271 2024-09-17T03:13:50.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.221+0000 7f6825b44640 1 --2- 172.21.15.78:0/2856340527 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x55d616272e40 0x55d6166b3770 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f04052bc5cf22890 server_cookie=7dea66d8d8648f21 in_seq=0 out_seq=0 2024-09-17T03:13:50.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.222+0000 7f6804ff9640 1 -- 172.21.15.78:0/2856340527 <== mds.1 v2:172.21.15.78:6834/4018023271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d6165d0770 con 0x55d616272e40 2024-09-17T03:13:50.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.222+0000 7f6804ff9640 10 client.7662 handle_command_reply: tid=0 2024-09-17T03:13:50.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.222+0000 7f682edef740 1 client.7662 shutdown 2024-09-17T03:13:50.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.222+0000 7f682edef740 1 -- 172.21.15.78:0/2856340527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d616293590 msgr2=0x55d6166717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.222+0000 7f682edef740 1 --2- 172.21.15.78:0/2856340527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d616293590 0x55d6166717e0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f681400d6a0 tx=0x7f6814062840 comp rx=0 tx=0).stop 2024-09-17T03:13:50.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.222+0000 7f682edef740 1 -- 172.21.15.78:0/2856340527 shutdown_connections 2024-09-17T03:13:50.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.222+0000 7f682edef740 1 --2- 172.21.15.78:0/2856340527 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x55d616272e40 0x55d6166b3770 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.222+0000 7f682edef740 1 --2- 172.21.15.78:0/2856340527 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d6162b4270 0x55d6166552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.222+0000 7f682edef740 1 --2- 172.21.15.78:0/2856340527 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d616293590 0x55d6166717e0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.222+0000 7f6804ff9640 0 client.7662 ms_handle_reset on v2:172.21.15.78:6834/4018023271 2024-09-17T03:13:50.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.222+0000 7f682edef740 1 --2- 172.21.15.78:0/2856340527 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d61628b3b0 0x55d6166a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.222+0000 7f682edef740 1 -- 172.21.15.78:0/2856340527 >> 172.21.15.78:0/2856340527 conn(0x55d6162a83c0 msgr2=0x55d6166a29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.222+0000 7f682edef740 1 -- 172.21.15.78:0/2856340527 shutdown_connections 2024-09-17T03:13:50.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.222+0000 7f682edef740 1 -- 172.21.15.78:0/2856340527 wait complete. 2024-09-17T03:13:50.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.222+0000 7f682edef740 20 client.7662 trim_cache size 0 max 16384 2024-09-17T03:13:50.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.241+0000 7f682edef740 1 Processor -- start 2024-09-17T03:13:50.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.241+0000 7f682edef740 1 -- start start 2024-09-17T03:13:50.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.242+0000 7f682edef740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61628b3b0 0x55d6166862b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.242+0000 7f682edef740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d616293590 0x55d616697b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.242+0000 7f682edef740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d6162b4270 0x55d6166980d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.242+0000 7f682edef740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6820201480 con 0x55d61628b3b0 2024-09-17T03:13:50.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.242+0000 7f682edef740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6820201b50 con 0x55d616293590 2024-09-17T03:13:50.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.242+0000 7f682edef740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f68201f9190 con 0x55d6162b4270 2024-09-17T03:13:50.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.242+0000 7f6825b44640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61628b3b0 0x55d6166862b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.242+0000 7f6825b44640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61628b3b0 0x55d6166862b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40974/0 (socket says 172.21.15.78:40974) 2024-09-17T03:13:50.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.242+0000 7f6825b44640 1 -- 172.21.15.78:0/4012543515 learned_addr learned my addr 172.21.15.78:0/4012543515 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:50.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.242+0000 7f6825b44640 1 -- 172.21.15.78:0/4012543515 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d6162b4270 msgr2=0x55d6166980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.242+0000 7f6825b44640 1 --2- 172.21.15.78:0/4012543515 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d6162b4270 0x55d6166980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.242+0000 7f6825b44640 1 -- 172.21.15.78:0/4012543515 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d616293590 msgr2=0x55d616697b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.242+0000 7f6825b44640 1 --2- 172.21.15.78:0/4012543515 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d616293590 0x55d616697b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.242+0000 7f6825b44640 1 -- 172.21.15.78:0/4012543515 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d61665ccb0 con 0x55d61628b3b0 2024-09-17T03:13:50.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.243+0000 7f6825b44640 1 --2- 172.21.15.78:0/4012543515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61628b3b0 0x55d6166862b0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f681002ae60 tx=0x7f681003f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e0cb4edb06971e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.243+0000 7f6806ffd640 1 -- 172.21.15.78:0/4012543515 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6810037040 con 0x55d61628b3b0 2024-09-17T03:13:50.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.243+0000 7f6806ffd640 1 -- 172.21.15.78:0/4012543515 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6810058070 con 0x55d61628b3b0 2024-09-17T03:13:50.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.243+0000 7f6806ffd640 1 -- 172.21.15.78:0/4012543515 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6810043040 con 0x55d61628b3b0 2024-09-17T03:13:50.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.243+0000 7f682edef740 1 -- 172.21.15.78:0/4012543515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61628b3b0 msgr2=0x55d6166862b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.243+0000 7f682edef740 1 --2- 172.21.15.78:0/4012543515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61628b3b0 0x55d6166862b0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f681002ae60 tx=0x7f681003f040 comp rx=0 tx=0).stop 2024-09-17T03:13:50.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.243+0000 7f682edef740 1 -- 172.21.15.78:0/4012543515 shutdown_connections 2024-09-17T03:13:50.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.243+0000 7f682edef740 1 --2- 172.21.15.78:0/4012543515 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d6162b4270 0x55d6166980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.243+0000 7f682edef740 1 --2- 172.21.15.78:0/4012543515 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d616293590 0x55d616697b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.243+0000 7f682edef740 1 --2- 172.21.15.78:0/4012543515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d61628b3b0 0x55d6166862b0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.243+0000 7f682edef740 1 -- 172.21.15.78:0/4012543515 >> 172.21.15.78:0/4012543515 conn(0x55d6162a83c0 msgr2=0x55d616696eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.244+0000 7f682edef740 1 -- 172.21.15.78:0/4012543515 shutdown_connections 2024-09-17T03:13:50.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.244+0000 7f682edef740 1 -- 172.21.15.78:0/4012543515 wait complete. 2024-09-17T03:13:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.244+0000 7f682edef740 1 -- start start 2024-09-17T03:13:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.244+0000 7f682edef740 1 Processor -- start 2024-09-17T03:13:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.246+0000 7f682edef740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d61628b3b0 0x55d6167212c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.246+0000 7f682edef740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d616293590 0x55d616697b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.246+0000 7f682edef740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d6162b4270 0x55d6166980d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.246+0000 7f682edef740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55d6166713c0 con 0x55d616293590 2024-09-17T03:13:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.246+0000 7f682edef740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d616671d20 con 0x55d61628b3b0 2024-09-17T03:13:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.246+0000 7f682edef740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55d6166a34f0 con 0x55d6162b4270 2024-09-17T03:13:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.246+0000 7f682edef740 10 client.0 _ll_register_callbacks cb 0x7f6814062400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.246+0000 7f6825343640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d616293590 0x55d616697b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.246+0000 7f6825343640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d616293590 0x55d616697b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40982/0 (socket says 172.21.15.78:40982) 2024-09-17T03:13:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.246+0000 7f6825343640 1 -- 172.21.15.78:0/823519159 learned_addr learned my addr 172.21.15.78:0/823519159 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.246+0000 7f6825343640 1 -- 172.21.15.78:0/823519159 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d6162b4270 msgr2=0x55d6166980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.246+0000 7f6825343640 1 --2- 172.21.15.78:0/823519159 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d6162b4270 0x55d6166980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.246+0000 7f6825343640 1 -- 172.21.15.78:0/823519159 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d61628b3b0 msgr2=0x55d6167212c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.246+0000 7f6825343640 1 --2- 172.21.15.78:0/823519159 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d61628b3b0 0x55d6167212c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.246+0000 7f6825343640 1 -- 172.21.15.78:0/823519159 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d616651f60 con 0x55d616293590 2024-09-17T03:13:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.246+0000 7f6825343640 1 --2- 172.21.15.78:0/823519159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d616293590 0x55d616697b90 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f6814009610 tx=0x7f6814062390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9265986c4e91332 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.246+0000 7f6804ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.247+0000 7f6804ff9640 1 -- 172.21.15.78:0/823519159 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6814021020 con 0x55d616293590 2024-09-17T03:13:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.247+0000 7f6804ff9640 1 -- 172.21.15.78:0/823519159 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f681406bad0 con 0x55d616293590 2024-09-17T03:13:50.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.247+0000 7f682edef740 1 -- 172.21.15.78:0/823519159 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6810058070 con 0x55d616293590 2024-09-17T03:13:50.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.247+0000 7f6804ff9640 1 -- 172.21.15.78:0/823519159 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f681406c590 con 0x55d616293590 2024-09-17T03:13:50.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.247+0000 7f682edef740 10 client.7668 fetch_fsmap learned FSMap version 81 2024-09-17T03:13:50.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.247+0000 7f682edef740 1 -- 172.21.15.78:0/823519159 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x55d616721800 con 0x55d616293590 2024-09-17T03:13:50.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.247+0000 7f6804ff9640 1 -- 172.21.15.78:0/823519159 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6810058070 con 0x55d616293590 2024-09-17T03:13:50.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.247+0000 7f6804ff9640 1 -- 172.21.15.78:0/823519159 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 81) ==== 3542+0+0 (secure 0 0 0) 0x7f681406bcd0 con 0x55d616293590 2024-09-17T03:13:50.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.247+0000 7f682edef740 10 client.7668 fetch_fsmap finished waiting for FSMap version 81 2024-09-17T03:13:50.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.247+0000 7f682edef740 10 client.7668 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:13:50.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.247+0000 7f682edef740 20 client.7668 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:50.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.247+0000 7f682edef740 1 --2- 172.21.15.78:0/823519159 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x55d6166c3590 0x55d616723e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.247+0000 7f682edef740 4 client.7668 mds_command: new command op to 7425 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:13:50.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.247+0000 7f682edef740 1 -- 172.21.15.78:0/823519159 --> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] -- command(tid 0: {"prefix": "status"}) -- 0x55d6165cc220 con 0x55d6166c3590 2024-09-17T03:13:50.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.247+0000 7f6825b44640 1 --2- 172.21.15.78:0/823519159 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x55d6166c3590 0x55d616723e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.247+0000 7f6804ff9640 10 client.7668 ms_handle_connect on v2:172.21.15.78:6834/4018023271 2024-09-17T03:13:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.248+0000 7f6825b44640 1 --2- 172.21.15.78:0/823519159 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x55d6166c3590 0x55d616723e40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=72235c53967927f5 server_cookie=eed9a654eb0b5ab5 in_seq=0 out_seq=0 2024-09-17T03:13:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.248+0000 7f6804ff9640 1 -- 172.21.15.78:0/823519159 <== mds.1 v2:172.21.15.78:6834/4018023271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55d6165cc220 con 0x55d6166c3590 2024-09-17T03:13:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.248+0000 7f6804ff9640 10 client.7668 handle_command_reply: tid=0 2024-09-17T03:13:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.248+0000 7f682edef740 1 client.7668 shutdown 2024-09-17T03:13:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.248+0000 7f682edef740 1 -- 172.21.15.78:0/823519159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d616293590 msgr2=0x55d616697b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.248+0000 7f682edef740 1 --2- 172.21.15.78:0/823519159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d616293590 0x55d616697b90 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f6814009610 tx=0x7f6814062390 comp rx=0 tx=0).stop 2024-09-17T03:13:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.248+0000 7f682edef740 1 -- 172.21.15.78:0/823519159 shutdown_connections 2024-09-17T03:13:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.248+0000 7f682edef740 1 --2- 172.21.15.78:0/823519159 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x55d6166c3590 0x55d616723e40 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.248+0000 7f682edef740 1 --2- 172.21.15.78:0/823519159 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d6162b4270 0x55d6166980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.248+0000 7f6804ff9640 0 client.7668 ms_handle_reset on v2:172.21.15.78:6834/4018023271 2024-09-17T03:13:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.248+0000 7f682edef740 1 --2- 172.21.15.78:0/823519159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d616293590 0x55d616697b90 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.248+0000 7f682edef740 1 --2- 172.21.15.78:0/823519159 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d61628b3b0 0x55d6167212c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.248+0000 7f682edef740 1 -- 172.21.15.78:0/823519159 >> 172.21.15.78:0/823519159 conn(0x55d6162a83c0 msgr2=0x55d616696eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.248+0000 7f682edef740 1 -- 172.21.15.78:0/823519159 shutdown_connections 2024-09-17T03:13:50.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.248+0000 7f682edef740 1 -- 172.21.15.78:0/823519159 wait complete. 2024-09-17T03:13:50.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.248+0000 7f682edef740 20 client.7668 trim_cache size 0 max 16384 2024-09-17T03:13:50.254 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:13:50.254 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:13:50.254 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 1, 2024-09-17T03:13:50.254 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 7425, 2024-09-17T03:13:50.254 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:13:50.254 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:13:50.254 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:13:50.255 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 2.8573707430000002, 2024-09-17T03:13:50.255 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 81, 2024-09-17T03:13:50.255 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 82, 2024-09-17T03:13:50.255 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 82, 2024-09-17T03:13:50.255 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 18.79696079 2024-09-17T03:13:50.255 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:13:50.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.249+0000 7f6827da8640 1 -- 172.21.15.78:0/2610509867 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f680c078b90 msgr2=0x7f680c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.249+0000 7f6827da8640 1 --2- 172.21.15.78:0/2610509867 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f680c078b90 0x7f680c07b0a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6810034000 tx=0x7f6810004ab0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.249+0000 7f6827da8640 1 -- 172.21.15.78:0/2610509867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68200d3870 msgr2=0x7f682015fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.249+0000 7f6827da8640 1 --2- 172.21.15.78:0/2610509867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68200d3870 0x7f682015fab0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f681400d6d0 tx=0x7f681400db90 comp rx=0 tx=0).stop 2024-09-17T03:13:50.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.249+0000 7f6827da8640 1 -- 172.21.15.78:0/2610509867 shutdown_connections 2024-09-17T03:13:50.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.249+0000 7f6827da8640 1 --2- 172.21.15.78:0/2610509867 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f68200b8900 0x7f68200cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.249+0000 7f6827da8640 1 --2- 172.21.15.78:0/2610509867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f68200d3870 0x7f682015fab0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.249+0000 7f6827da8640 1 --2- 172.21.15.78:0/2610509867 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f680c078b90 0x7f680c07b0a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.249+0000 7f6827da8640 1 --2- 172.21.15.78:0/2610509867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f682006f4b0 0x7f68201f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.249+0000 7f6827da8640 1 -- 172.21.15.78:0/2610509867 >> 172.21.15.78:0/2610509867 conn(0x7f682008bfc0 msgr2=0x7f68200cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.249+0000 7f6827da8640 1 -- 172.21.15.78:0/2610509867 shutdown_connections 2024-09-17T03:13:50.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.249+0000 7f6827da8640 1 -- 172.21.15.78:0/2610509867 wait complete. 2024-09-17T03:13:50.259 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:13:50.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.373+0000 7f05c8b5f640 1 -- 172.21.15.78:0/2982864767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c41600b0 msgr2=0x7f05c40ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.373+0000 7f05c8b5f640 1 --2- 172.21.15.78:0/2982864767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c41600b0 0x7f05c40ccbc0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f05c40b7c50 tx=0x7f05b402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.373+0000 7f05c8b5f640 1 -- 172.21.15.78:0/2982864767 shutdown_connections 2024-09-17T03:13:50.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.373+0000 7f05c8b5f640 1 --2- 172.21.15.78:0/2982864767 >> v2:172.21.15.193:3300/0 conn(0x7f05c40cf320 0x7f05c40d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.373+0000 7f05c8b5f640 1 --2- 172.21.15.78:0/2982864767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c41600b0 0x7f05c40ccbc0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.373+0000 7f05c8b5f640 1 -- 172.21.15.78:0/2982864767 >> 172.21.15.78:0/2982864767 conn(0x7f05c406d4f0 msgr2=0x7f05c4071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.373+0000 7f05c8b5f640 1 -- 172.21.15.78:0/2982864767 shutdown_connections 2024-09-17T03:13:50.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.373+0000 7f05c8b5f640 1 -- 172.21.15.78:0/2982864767 wait complete. 2024-09-17T03:13:50.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.375+0000 7f05c8b5f640 1 Processor -- start 2024-09-17T03:13:50.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.375+0000 7f05c8b5f640 1 -- start start 2024-09-17T03:13:50.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.376+0000 7f05c8b5f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c40b7cc0 0x7f05c414adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.376+0000 7f05c8b5f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05c40cf320 0x7f05c414c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.376+0000 7f05c8b5f640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f05c41600b0 0x7f05c414c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.376+0000 7f05c8b5f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f05c40d13c0 con 0x7f05c40b7cc0 2024-09-17T03:13:50.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.376+0000 7f05c8b5f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f05c40d1240 con 0x7f05c40cf320 2024-09-17T03:13:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.376+0000 7f05c8b5f640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f05c40d1540 con 0x7f05c41600b0 2024-09-17T03:13:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.376+0000 7f05c259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c40b7cc0 0x7f05c414adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.376+0000 7f05c259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c40b7cc0 0x7f05c414adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40998/0 (socket says 172.21.15.78:40998) 2024-09-17T03:13:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.376+0000 7f05c259c640 1 -- 172.21.15.78:0/3864645479 learned_addr learned my addr 172.21.15.78:0/3864645479 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.376+0000 7f05c259c640 1 -- 172.21.15.78:0/3864645479 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f05c41600b0 msgr2=0x7f05c414c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.376+0000 7f05c259c640 1 --2- 172.21.15.78:0/3864645479 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f05c41600b0 0x7f05c414c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.376+0000 7f05c259c640 1 -- 172.21.15.78:0/3864645479 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05c40cf320 msgr2=0x7f05c414c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.376+0000 7f05c259c640 1 --2- 172.21.15.78:0/3864645479 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05c40cf320 0x7f05c414c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.376+0000 7f05c259c640 1 -- 172.21.15.78:0/3864645479 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c40cb8e0 con 0x7f05c40b7cc0 2024-09-17T03:13:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.377+0000 7f05c259c640 1 --2- 172.21.15.78:0/3864645479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c40b7cc0 0x7f05c414adb0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f05b4009ca0 tx=0x7f05b4003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.377+0000 7f05b2ffd640 1 -- 172.21.15.78:0/3864645479 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b4031da0 con 0x7f05c40b7cc0 2024-09-17T03:13:50.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.377+0000 7f05b2ffd640 1 -- 172.21.15.78:0/3864645479 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05b4003e10 con 0x7f05c40b7cc0 2024-09-17T03:13:50.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.377+0000 7f05c8b5f640 1 -- 172.21.15.78:0/3864645479 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c40cbbc0 con 0x7f05c40b7cc0 2024-09-17T03:13:50.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.377+0000 7f05b2ffd640 1 -- 172.21.15.78:0/3864645479 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b40332b0 con 0x7f05c40b7cc0 2024-09-17T03:13:50.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.377+0000 7f05c8b5f640 1 -- 172.21.15.78:0/3864645479 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c414bc50 con 0x7f05c40b7cc0 2024-09-17T03:13:50.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.379+0000 7f05b2ffd640 1 -- 172.21.15.78:0/3864645479 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f05b4033450 con 0x7f05c40b7cc0 2024-09-17T03:13:50.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.379+0000 7f05b2ffd640 1 --2- 172.21.15.78:0/3864645479 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f05a4078bc0 0x7f05a407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.379+0000 7f05b2ffd640 1 -- 172.21.15.78:0/3864645479 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f05b40bc4a0 con 0x7f05c40b7cc0 2024-09-17T03:13:50.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.380+0000 7f05c1d9b640 1 --2- 172.21.15.78:0/3864645479 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f05a4078bc0 0x7f05a407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.380+0000 7f05c1d9b640 1 --2- 172.21.15.78:0/3864645479 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f05a4078bc0 0x7f05a407b0d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f05c40cbfa0 tx=0x7f05b8007930 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.380+0000 7f05cfac8740 1 Processor -- start 2024-09-17T03:13:50.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.380+0000 7f05cfac8740 1 -- start start 2024-09-17T03:13:50.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.382+0000 7f05cfac8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529d7270 0x562852da8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.382+0000 7f05cfac8740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529ae3b0 0x562852da94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.382+0000 7f05cfac8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628529b6590 0x562852dc63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.382+0000 7f05cfac8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x562852cf1820 con 0x5628529d7270 2024-09-17T03:13:50.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.382+0000 7f05cfac8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562852ce0c50 con 0x5628529b6590 2024-09-17T03:13:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.382+0000 7f05cfac8740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x562852ce4a60 con 0x5628529ae3b0 2024-09-17T03:13:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.382+0000 7f05c259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529d7270 0x562852da8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.382+0000 7f05c259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529d7270 0x562852da8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41012/0 (socket says 172.21.15.78:41012) 2024-09-17T03:13:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.382+0000 7f05c259c640 1 -- 172.21.15.78:0/2270044870 learned_addr learned my addr 172.21.15.78:0/2270044870 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.382+0000 7f05c1d9b640 1 --2- 172.21.15.78:0/2270044870 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529ae3b0 0x562852da94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.382+0000 7f05c2d9d640 1 --2- 172.21.15.78:0/2270044870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628529b6590 0x562852dc63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.382+0000 7f05c259c640 1 -- 172.21.15.78:0/2270044870 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529ae3b0 msgr2=0x562852da94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.382+0000 7f05c259c640 1 --2- 172.21.15.78:0/2270044870 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529ae3b0 0x562852da94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.382+0000 7f05c259c640 1 -- 172.21.15.78:0/2270044870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628529b6590 msgr2=0x562852dc63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.382+0000 7f05c259c640 1 --2- 172.21.15.78:0/2270044870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628529b6590 0x562852dc63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.382+0000 7f05c259c640 1 -- 172.21.15.78:0/2270044870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562852a42850 con 0x5628529d7270 2024-09-17T03:13:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.382+0000 7f05c259c640 1 --2- 172.21.15.78:0/2270044870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529d7270 0x562852da8fa0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f05b4009b30 tx=0x7f05b4083970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c215d7b147dd53 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.382+0000 7f05a3fff640 1 -- 172.21.15.78:0/2270044870 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b4084140 con 0x5628529d7270 2024-09-17T03:13:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.382+0000 7f05a3fff640 1 -- 172.21.15.78:0/2270044870 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05b4088c20 con 0x5628529d7270 2024-09-17T03:13:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.382+0000 7f05a3fff640 1 -- 172.21.15.78:0/2270044870 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b408db60 con 0x5628529d7270 2024-09-17T03:13:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.383+0000 7f05cfac8740 1 -- 172.21.15.78:0/2270044870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529d7270 msgr2=0x562852da8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.383+0000 7f05cfac8740 1 --2- 172.21.15.78:0/2270044870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529d7270 0x562852da8fa0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f05b4009b30 tx=0x7f05b4083970 comp rx=0 tx=0).stop 2024-09-17T03:13:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.383+0000 7f05cfac8740 1 -- 172.21.15.78:0/2270044870 shutdown_connections 2024-09-17T03:13:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.383+0000 7f05cfac8740 1 --2- 172.21.15.78:0/2270044870 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628529b6590 0x562852dc63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.383+0000 7f05cfac8740 1 --2- 172.21.15.78:0/2270044870 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529ae3b0 0x562852da94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.383+0000 7f05cfac8740 1 --2- 172.21.15.78:0/2270044870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529d7270 0x562852da8fa0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.383+0000 7f05cfac8740 1 -- 172.21.15.78:0/2270044870 >> 172.21.15.78:0/2270044870 conn(0x5628529cb3c0 msgr2=0x562852d7f260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.383+0000 7f05cfac8740 1 -- 172.21.15.78:0/2270044870 shutdown_connections 2024-09-17T03:13:50.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.383+0000 7f05cfac8740 1 -- 172.21.15.78:0/2270044870 wait complete. 2024-09-17T03:13:50.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.384+0000 7f05cfac8740 1 -- start start 2024-09-17T03:13:50.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.384+0000 7f05cfac8740 1 Processor -- start 2024-09-17T03:13:50.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05cfac8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 0x562852dbab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05cfac8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628529b6590 0x562852da6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05cfac8740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529d7270 0x562852d7d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05cfac8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x562852a51620 con 0x5628529ae3b0 2024-09-17T03:13:50.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05cfac8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562852c865f0 con 0x5628529b6590 2024-09-17T03:13:50.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05cfac8740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x562852cf1820 con 0x5628529d7270 2024-09-17T03:13:50.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05cfac8740 10 client.0 _ll_register_callbacks cb 0x562852c8a0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:50.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05c259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 0x562852dbab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05c259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 0x562852dbab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41026/0 (socket says 172.21.15.78:41026) 2024-09-17T03:13:50.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05c259c640 1 -- 172.21.15.78:0/4284151261 learned_addr learned my addr 172.21.15.78:0/4284151261 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:50.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05c1d9b640 1 --2- 172.21.15.78:0/4284151261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628529b6590 0x562852da6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05c2d9d640 1 --2- 172.21.15.78:0/4284151261 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529d7270 0x562852d7d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05c259c640 1 -- 172.21.15.78:0/4284151261 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529d7270 msgr2=0x562852d7d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05c259c640 1 --2- 172.21.15.78:0/4284151261 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529d7270 0x562852d7d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05c259c640 1 -- 172.21.15.78:0/4284151261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628529b6590 msgr2=0x562852da6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05c259c640 1 --2- 172.21.15.78:0/4284151261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628529b6590 0x562852da6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05c259c640 1 -- 172.21.15.78:0/4284151261 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562852ab96b0 con 0x5628529ae3b0 2024-09-17T03:13:50.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05c2d9d640 1 --2- 172.21.15.78:0/4284151261 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529d7270 0x562852d7d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:50.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05c259c640 1 --2- 172.21.15.78:0/4284151261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 0x562852dbab90 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f05b40ba980 tx=0x7f05b408dc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8c92e903cfee68a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:50.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05a17fa640 1 -- 172.21.15.78:0/4284151261 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b40845a0 con 0x5628529ae3b0 2024-09-17T03:13:50.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05a17fa640 1 -- 172.21.15.78:0/4284151261 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f05b408d6d0 con 0x5628529ae3b0 2024-09-17T03:13:50.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05cfac8740 1 -- 172.21.15.78:0/4284151261 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05b4088c20 con 0x5628529ae3b0 2024-09-17T03:13:50.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05a17fa640 1 -- 172.21.15.78:0/4284151261 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f05b408d8d0 con 0x5628529ae3b0 2024-09-17T03:13:50.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05cfac8740 10 client.7683 fetch_fsmap learned FSMap version 81 2024-09-17T03:13:50.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.386+0000 7f05cfac8740 1 -- 172.21.15.78:0/4284151261 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x562852dbd8b0 con 0x5628529ae3b0 2024-09-17T03:13:50.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.387+0000 7f05a17fa640 1 -- 172.21.15.78:0/4284151261 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05b4088c20 con 0x5628529ae3b0 2024-09-17T03:13:50.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.387+0000 7f05a17fa640 1 -- 172.21.15.78:0/4284151261 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 81) ==== 3542+0+0 (secure 0 0 0) 0x7f05b409b070 con 0x5628529ae3b0 2024-09-17T03:13:50.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.387+0000 7f05cfac8740 10 client.7683 fetch_fsmap finished waiting for FSMap version 81 2024-09-17T03:13:50.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.387+0000 7f05cfac8740 10 client.7683 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:13:50.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.387+0000 7f05cfac8740 20 client.7683 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:50.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.387+0000 7f05cfac8740 1 --2- 172.21.15.78:0/4284151261 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x562852995e40 0x562852dd69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.387+0000 7f05cfac8740 4 client.7683 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:13:50.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.387+0000 7f05cfac8740 1 -- 172.21.15.78:0/4284151261 --> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562852cf3770 con 0x562852995e40 2024-09-17T03:13:50.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.387+0000 7f05c1d9b640 1 --2- 172.21.15.78:0/4284151261 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x562852995e40 0x562852dd69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.387+0000 7f05a17fa640 10 client.7683 ms_handle_connect on v2:172.21.15.78:6833/3357123265 2024-09-17T03:13:50.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.387+0000 7f05c1d9b640 1 --2- 172.21.15.78:0/4284151261 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x562852995e40 0x562852dd69a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a992c69920106e5b server_cookie=6e19eef418c7a7b6 in_seq=0 out_seq=0 2024-09-17T03:13:50.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.388+0000 7f05a17fa640 1 -- 172.21.15.78:0/4284151261 <== mds.0 v2:172.21.15.78:6833/3357123265 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562852cf3770 con 0x562852995e40 2024-09-17T03:13:50.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.388+0000 7f05a17fa640 10 client.7683 handle_command_reply: tid=0 2024-09-17T03:13:50.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.388+0000 7f05cfac8740 1 client.7683 shutdown 2024-09-17T03:13:50.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.388+0000 7f05cfac8740 1 -- 172.21.15.78:0/4284151261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 msgr2=0x562852dbab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.388+0000 7f05cfac8740 1 --2- 172.21.15.78:0/4284151261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 0x562852dbab90 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f05b40ba980 tx=0x7f05b408dc50 comp rx=0 tx=0).stop 2024-09-17T03:13:50.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.388+0000 7f05cfac8740 1 -- 172.21.15.78:0/4284151261 shutdown_connections 2024-09-17T03:13:50.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.388+0000 7f05cfac8740 1 --2- 172.21.15.78:0/4284151261 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x562852995e40 0x562852dd69a0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.388+0000 7f05cfac8740 1 --2- 172.21.15.78:0/4284151261 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529d7270 0x562852d7d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.388+0000 7f05cfac8740 1 --2- 172.21.15.78:0/4284151261 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628529b6590 0x562852da6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.388+0000 7f05cfac8740 1 --2- 172.21.15.78:0/4284151261 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 0x562852dbab90 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.388+0000 7f05a17fa640 0 client.7683 ms_handle_reset on v2:172.21.15.78:6833/3357123265 2024-09-17T03:13:50.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.388+0000 7f05cfac8740 1 -- 172.21.15.78:0/4284151261 >> 172.21.15.78:0/4284151261 conn(0x5628529cb3c0 msgr2=0x562852d80180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.388+0000 7f05cfac8740 1 -- 172.21.15.78:0/4284151261 shutdown_connections 2024-09-17T03:13:50.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.388+0000 7f05cfac8740 1 -- 172.21.15.78:0/4284151261 wait complete. 2024-09-17T03:13:50.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.388+0000 7f05cfac8740 20 client.7683 trim_cache size 0 max 16384 2024-09-17T03:13:50.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.407+0000 7f05cfac8740 1 Processor -- start 2024-09-17T03:13:50.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.407+0000 7f05cfac8740 1 -- start start 2024-09-17T03:13:50.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.408+0000 7f05cfac8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 0x562852dbab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.408+0000 7f05cfac8740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529b6590 0x562852d80180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.408+0000 7f05cfac8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628529d7270 0x562852d7d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.408+0000 7f05cfac8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f05c41ff0f0 con 0x5628529ae3b0 2024-09-17T03:13:50.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.408+0000 7f05cfac8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f05c41ff7a0 con 0x5628529d7270 2024-09-17T03:13:50.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.408+0000 7f05cfac8740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f05c41fe1b0 con 0x5628529b6590 2024-09-17T03:13:50.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.408+0000 7f05c259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 0x562852dbab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.408+0000 7f05c259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 0x562852dbab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41032/0 (socket says 172.21.15.78:41032) 2024-09-17T03:13:50.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.408+0000 7f05c259c640 1 -- 172.21.15.78:0/1820555454 learned_addr learned my addr 172.21.15.78:0/1820555454 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.409+0000 7f05c2d9d640 1 --2- 172.21.15.78:0/1820555454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628529d7270 0x562852d7d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.409+0000 7f05c1d9b640 1 --2- 172.21.15.78:0/1820555454 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529b6590 0x562852d80180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.409+0000 7f05c259c640 1 -- 172.21.15.78:0/1820555454 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529b6590 msgr2=0x562852d80180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.409+0000 7f05c259c640 1 --2- 172.21.15.78:0/1820555454 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529b6590 0x562852d80180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.409+0000 7f05c259c640 1 -- 172.21.15.78:0/1820555454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628529d7270 msgr2=0x562852d7d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.409+0000 7f05c259c640 1 --2- 172.21.15.78:0/1820555454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628529d7270 0x562852d7d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.409+0000 7f05c259c640 1 -- 172.21.15.78:0/1820555454 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562852dba220 con 0x5628529ae3b0 2024-09-17T03:13:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.409+0000 7f05c2d9d640 1 --2- 172.21.15.78:0/1820555454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628529d7270 0x562852d7d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.409+0000 7f05c1d9b640 1 --2- 172.21.15.78:0/1820555454 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529b6590 0x562852d80180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:13:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.409+0000 7f05c259c640 1 --2- 172.21.15.78:0/1820555454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 0x562852dbab90 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f05b40ba950 tx=0x7f05b40bc320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93512d491fa5d4c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.409+0000 7f05a37fe640 1 -- 172.21.15.78:0/1820555454 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b4083a90 con 0x5628529ae3b0 2024-09-17T03:13:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.409+0000 7f05a37fe640 1 -- 172.21.15.78:0/1820555454 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05b4084140 con 0x5628529ae3b0 2024-09-17T03:13:50.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.409+0000 7f05a37fe640 1 -- 172.21.15.78:0/1820555454 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b4084600 con 0x5628529ae3b0 2024-09-17T03:13:50.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.410+0000 7f05cfac8740 1 -- 172.21.15.78:0/1820555454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 msgr2=0x562852dbab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.410+0000 7f05cfac8740 1 --2- 172.21.15.78:0/1820555454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 0x562852dbab90 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f05b40ba950 tx=0x7f05b40bc320 comp rx=0 tx=0).stop 2024-09-17T03:13:50.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.410+0000 7f05cfac8740 1 -- 172.21.15.78:0/1820555454 shutdown_connections 2024-09-17T03:13:50.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.410+0000 7f05cfac8740 1 --2- 172.21.15.78:0/1820555454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628529d7270 0x562852d7d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.410+0000 7f05cfac8740 1 --2- 172.21.15.78:0/1820555454 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529b6590 0x562852d80180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.410+0000 7f05cfac8740 1 --2- 172.21.15.78:0/1820555454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 0x562852dbab90 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.410+0000 7f05cfac8740 1 -- 172.21.15.78:0/1820555454 >> 172.21.15.78:0/1820555454 conn(0x5628529cb3c0 msgr2=0x562852d7f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.410+0000 7f05cfac8740 1 -- 172.21.15.78:0/1820555454 shutdown_connections 2024-09-17T03:13:50.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.410+0000 7f05cfac8740 1 -- 172.21.15.78:0/1820555454 wait complete. 2024-09-17T03:13:50.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.411+0000 7f05cfac8740 1 -- start start 2024-09-17T03:13:50.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.411+0000 7f05cfac8740 1 Processor -- start 2024-09-17T03:13:50.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.412+0000 7f05cfac8740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 0x562852e3be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.412+0000 7f05cfac8740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529b6590 0x562852d7d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.412+0000 7f05cfac8740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628529d7270 0x562852d7d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.412+0000 7f05cfac8740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x562852a51620 con 0x5628529ae3b0 2024-09-17T03:13:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.412+0000 7f05cfac8740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562852cf1820 con 0x5628529d7270 2024-09-17T03:13:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.412+0000 7f05cfac8740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x562852c865f0 con 0x5628529b6590 2024-09-17T03:13:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.412+0000 7f05cfac8740 10 client.0 _ll_register_callbacks cb 0x7f05b40aa070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:13:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.412+0000 7f05c259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 0x562852e3be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.413+0000 7f05c259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 0x562852e3be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41036/0 (socket says 172.21.15.78:41036) 2024-09-17T03:13:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.413+0000 7f05c259c640 1 -- 172.21.15.78:0/224106546 learned_addr learned my addr 172.21.15.78:0/224106546 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.413+0000 7f05c259c640 1 -- 172.21.15.78:0/224106546 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529b6590 msgr2=0x562852d7d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.413+0000 7f05c259c640 1 --2- 172.21.15.78:0/224106546 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529b6590 0x562852d7d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.413+0000 7f05c259c640 1 -- 172.21.15.78:0/224106546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628529d7270 msgr2=0x562852d7d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:13:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.413+0000 7f05c259c640 1 --2- 172.21.15.78:0/224106546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628529d7270 0x562852d7d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.413+0000 7f05c259c640 1 -- 172.21.15.78:0/224106546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562852dc5350 con 0x5628529ae3b0 2024-09-17T03:13:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.413+0000 7f05c259c640 1 --2- 172.21.15.78:0/224106546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 0x562852e3be50 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f05b40ba980 tx=0x7f05b408db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=860b2e42f7e9fd68 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.413+0000 7f05a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:13:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.413+0000 7f05a17fa640 1 -- 172.21.15.78:0/224106546 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b4088c20 con 0x5628529ae3b0 2024-09-17T03:13:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.413+0000 7f05a17fa640 1 -- 172.21.15.78:0/224106546 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f05b407fa90 con 0x5628529ae3b0 2024-09-17T03:13:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.413+0000 7f05cfac8740 1 -- 172.21.15.78:0/224106546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05b4084140 con 0x5628529ae3b0 2024-09-17T03:13:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.413+0000 7f05a17fa640 1 -- 172.21.15.78:0/224106546 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f05b407fc90 con 0x5628529ae3b0 2024-09-17T03:13:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.413+0000 7f05cfac8740 10 client.7689 fetch_fsmap learned FSMap version 81 2024-09-17T03:13:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.413+0000 7f05cfac8740 1 -- 172.21.15.78:0/224106546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) -- 0x562852dc5350 con 0x5628529ae3b0 2024-09-17T03:13:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.413+0000 7f05a17fa640 1 -- 172.21.15.78:0/224106546 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05b4084140 con 0x5628529ae3b0 2024-09-17T03:13:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.413+0000 7f05a17fa640 1 -- 172.21.15.78:0/224106546 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 81) ==== 3542+0+0 (secure 0 0 0) 0x7f05b409b040 con 0x5628529ae3b0 2024-09-17T03:13:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.413+0000 7f05cfac8740 10 client.7689 fetch_fsmap finished waiting for FSMap version 81 2024-09-17T03:13:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.413+0000 7f05cfac8740 10 client.7689 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:13:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.413+0000 7f05cfac8740 20 client.7689 populate_metadata read hostname 'smithi078' 2024-09-17T03:13:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.414+0000 7f05cfac8740 1 --2- 172.21.15.78:0/224106546 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x562852e45880 0x562852e45c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.414+0000 7f05cfac8740 4 client.7689 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:13:50.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.414+0000 7f05cfac8740 1 -- 172.21.15.78:0/224106546 --> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] -- command(tid 0: {"prefix": "status"}) -- 0x562852cef220 con 0x562852e45880 2024-09-17T03:13:50.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.414+0000 7f05c1d9b640 1 --2- 172.21.15.78:0/224106546 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x562852e45880 0x562852e45c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.414+0000 7f05a17fa640 10 client.7689 ms_handle_connect on v2:172.21.15.78:6833/3357123265 2024-09-17T03:13:50.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.414+0000 7f05c1d9b640 1 --2- 172.21.15.78:0/224106546 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x562852e45880 0x562852e45c90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=753840dcab75975e server_cookie=24d499656ff3f0eb in_seq=0 out_seq=0 2024-09-17T03:13:50.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.414+0000 7f05a17fa640 1 -- 172.21.15.78:0/224106546 <== mds.0 v2:172.21.15.78:6833/3357123265 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x562852cef220 con 0x562852e45880 2024-09-17T03:13:50.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.414+0000 7f05a17fa640 10 client.7689 handle_command_reply: tid=0 2024-09-17T03:13:50.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.414+0000 7f05cfac8740 1 client.7689 shutdown 2024-09-17T03:13:50.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.414+0000 7f05cfac8740 1 -- 172.21.15.78:0/224106546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 msgr2=0x562852e3be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.414+0000 7f05cfac8740 1 --2- 172.21.15.78:0/224106546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 0x562852e3be50 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f05b40ba980 tx=0x7f05b408db60 comp rx=0 tx=0).stop 2024-09-17T03:13:50.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05cfac8740 1 -- 172.21.15.78:0/224106546 shutdown_connections 2024-09-17T03:13:50.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05cfac8740 1 --2- 172.21.15.78:0/224106546 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x562852e45880 0x562852e45c90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05cfac8740 1 --2- 172.21.15.78:0/224106546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5628529d7270 0x562852d7d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05cfac8740 1 --2- 172.21.15.78:0/224106546 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5628529b6590 0x562852d7d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05a17fa640 0 client.7689 ms_handle_reset on v2:172.21.15.78:6833/3357123265 2024-09-17T03:13:50.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05cfac8740 1 --2- 172.21.15.78:0/224106546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5628529ae3b0 0x562852e3be50 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05cfac8740 1 -- 172.21.15.78:0/224106546 >> 172.21.15.78:0/224106546 conn(0x5628529cb3c0 msgr2=0x562852d7aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05cfac8740 1 -- 172.21.15.78:0/224106546 shutdown_connections 2024-09-17T03:13:50.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05cfac8740 1 -- 172.21.15.78:0/224106546 wait complete. 2024-09-17T03:13:50.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05cfac8740 20 client.7689 trim_cache size 0 max 16384 2024-09-17T03:13:50.420 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:13:50.420 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:13:50.420 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-09-17T03:13:50.420 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 7428, 2024-09-17T03:13:50.421 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:13:50.421 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:13:50.421 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:13:50.421 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 14.256781118999999, 2024-09-17T03:13:50.421 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 81, 2024-09-17T03:13:50.421 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 82, 2024-09-17T03:13:50.421 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 82, 2024-09-17T03:13:50.421 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 18.963478607999999 2024-09-17T03:13:50.421 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:13:50.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05c8b5f640 1 -- 172.21.15.78:0/3864645479 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f05a4078bc0 msgr2=0x7f05a407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05c8b5f640 1 --2- 172.21.15.78:0/3864645479 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f05a4078bc0 0x7f05a407b0d0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f05c40cbfa0 tx=0x7f05b8007930 comp rx=0 tx=0).stop 2024-09-17T03:13:50.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05c8b5f640 1 -- 172.21.15.78:0/3864645479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c40b7cc0 msgr2=0x7f05c414adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05c8b5f640 1 --2- 172.21.15.78:0/3864645479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c40b7cc0 0x7f05c414adb0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f05b4009ca0 tx=0x7f05b4003c20 comp rx=0 tx=0).stop 2024-09-17T03:13:50.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05c8b5f640 1 -- 172.21.15.78:0/3864645479 shutdown_connections 2024-09-17T03:13:50.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05c8b5f640 1 --2- 172.21.15.78:0/3864645479 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f05c41600b0 0x7f05c414c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05c8b5f640 1 --2- 172.21.15.78:0/3864645479 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f05a4078bc0 0x7f05a407b0d0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05c8b5f640 1 --2- 172.21.15.78:0/3864645479 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05c40cf320 0x7f05c414c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05c8b5f640 1 --2- 172.21.15.78:0/3864645479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05c40b7cc0 0x7f05c414adb0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05c8b5f640 1 -- 172.21.15.78:0/3864645479 >> 172.21.15.78:0/3864645479 conn(0x7f05c406d4f0 msgr2=0x7f05c40b5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05c8b5f640 1 -- 172.21.15.78:0/3864645479 shutdown_connections 2024-09-17T03:13:50.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.415+0000 7f05c8b5f640 1 -- 172.21.15.78:0/3864645479 wait complete. 2024-09-17T03:13:50.426 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:13:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.537+0000 7f2dc2ecc640 1 -- 172.21.15.78:0/742845974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dbc0ccb50 msgr2=0x7f2dbc0ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.537+0000 7f2dc2ecc640 1 --2- 172.21.15.78:0/742845974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dbc0ccb50 0x7f2dbc0ccf60 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f2db4005fd0 tx=0x7f2db402aa90 comp rx=0 tx=0).stop 2024-09-17T03:13:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.537+0000 7f2dc2ecc640 1 -- 172.21.15.78:0/742845974 shutdown_connections 2024-09-17T03:13:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.537+0000 7f2dc2ecc640 1 --2- 172.21.15.78:0/742845974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dbc0ccb50 0x7f2dbc0ccf60 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.537+0000 7f2dc2ecc640 1 --2- 172.21.15.78:0/742845974 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2dbc0cc1e0 0x7f2dbc0af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.537+0000 7f2dc2ecc640 1 -- 172.21.15.78:0/742845974 >> 172.21.15.78:0/742845974 conn(0x7f2dbc06d7d0 msgr2=0x7f2dbc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.537+0000 7f2dc2ecc640 1 -- 172.21.15.78:0/742845974 shutdown_connections 2024-09-17T03:13:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.537+0000 7f2dc2ecc640 1 -- 172.21.15.78:0/742845974 wait complete. 2024-09-17T03:13:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.538+0000 7f2dc2ecc640 1 Processor -- start 2024-09-17T03:13:50.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.539+0000 7f2dc2ecc640 1 -- start start 2024-09-17T03:13:50.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.540+0000 7f2dc2ecc640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2dbc0cc1e0 0x7f2dbc1f3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.540+0000 7f2dc2ecc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dbc0ccb50 0x7f2dbc151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.540+0000 7f2dc2ecc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dbc15d8a0 0x7f2dbc09c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.540+0000 7f2dc2ecc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2dbc153520 con 0x7f2dbc0ccb50 2024-09-17T03:13:50.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.540+0000 7f2dc2ecc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2dbc1533a0 con 0x7f2dbc15d8a0 2024-09-17T03:13:50.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.540+0000 7f2dc2ecc640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f2dbc1536a0 con 0x7f2dbc0cc1e0 2024-09-17T03:13:50.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.540+0000 7f2db3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dbc0ccb50 0x7f2dbc151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.540+0000 7f2db3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dbc0ccb50 0x7f2dbc151b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41056/0 (socket says 172.21.15.78:41056) 2024-09-17T03:13:50.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.540+0000 7f2db3fff640 1 -- 172.21.15.78:0/2130134868 learned_addr learned my addr 172.21.15.78:0/2130134868 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:13:50.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.540+0000 7f2dc0c68640 1 --2- 172.21.15.78:0/2130134868 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2dbc0cc1e0 0x7f2dbc1f3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.540+0000 7f2dc1469640 1 --2- 172.21.15.78:0/2130134868 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dbc15d8a0 0x7f2dbc09c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.540+0000 7f2db3fff640 1 -- 172.21.15.78:0/2130134868 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2dbc0cc1e0 msgr2=0x7f2dbc1f3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.540+0000 7f2db3fff640 1 --2- 172.21.15.78:0/2130134868 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2dbc0cc1e0 0x7f2dbc1f3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.540+0000 7f2db3fff640 1 -- 172.21.15.78:0/2130134868 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dbc15d8a0 msgr2=0x7f2dbc09c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.540+0000 7f2db3fff640 1 --2- 172.21.15.78:0/2130134868 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dbc15d8a0 0x7f2dbc09c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.540+0000 7f2db3fff640 1 -- 172.21.15.78:0/2130134868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dbc156500 con 0x7f2dbc0ccb50 2024-09-17T03:13:50.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.541+0000 7f2db3fff640 1 --2- 172.21.15.78:0/2130134868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dbc0ccb50 0x7f2dbc151b70 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f2dac00c3a0 tx=0x7f2dac00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.541+0000 7f2db17fa640 1 -- 172.21.15.78:0/2130134868 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac017070 con 0x7f2dbc0ccb50 2024-09-17T03:13:50.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.541+0000 7f2db17fa640 1 -- 172.21.15.78:0/2130134868 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2dac0053c0 con 0x7f2dbc0ccb50 2024-09-17T03:13:50.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.541+0000 7f2db17fa640 1 -- 172.21.15.78:0/2130134868 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac003850 con 0x7f2dbc0ccb50 2024-09-17T03:13:50.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.541+0000 7f2dc2ecc640 1 -- 172.21.15.78:0/2130134868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dbc1567e0 con 0x7f2dbc0ccb50 2024-09-17T03:13:50.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.541+0000 7f2dc2ecc640 1 -- 172.21.15.78:0/2130134868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dbc153d60 con 0x7f2dbc0ccb50 2024-09-17T03:13:50.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.542+0000 7f2dc2ecc640 1 -- 172.21.15.78:0/2130134868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dbc156270 con 0x7f2dbc0ccb50 2024-09-17T03:13:50.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.543+0000 7f2db17fa640 1 -- 172.21.15.78:0/2130134868 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2dac01a070 con 0x7f2dbc0ccb50 2024-09-17T03:13:50.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.543+0000 7f2db17fa640 1 --2- 172.21.15.78:0/2130134868 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2da8078b90 0x7f2da807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:13:50.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.543+0000 7f2db17fa640 1 -- 172.21.15.78:0/2130134868 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f2dac09a170 con 0x7f2dbc0ccb50 2024-09-17T03:13:50.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.543+0000 7f2dc0c68640 1 --2- 172.21.15.78:0/2130134868 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2da8078b90 0x7f2da807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:13:50.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.544+0000 7f2dc0c68640 1 --2- 172.21.15.78:0/2130134868 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2da8078b90 0x7f2da807b0a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2db8005fd0 tx=0x7f2db8005850 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:13:50.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.548+0000 7f2db17fa640 1 -- 172.21.15.78:0/2130134868 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2dbc0cd4a0 con 0x7f2dbc0ccb50 2024-09-17T03:13:50.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.757+0000 7f2dc2ecc640 1 -- 172.21.15.78:0/2130134868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2dbc071740 con 0x7f2dbc0ccb50 2024-09-17T03:13:50.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.757+0000 7f2db17fa640 1 -- 172.21.15.78:0/2130134868 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) ==== 94+0+5269 (secure 0 0 0) 0x7f2dbc071740 con 0x7f2dbc0ccb50 2024-09-17T03:13:50.757 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:13:50.757 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":81,"btime":"2024-09-17T03:13:49:398833+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:35.489582+0000","modified":"2024-09-17T03:13:49.398825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7428,"mds_1":7425,"mds_2":6640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"d","rank":2,"incarnation":80,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6837/1005450673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1005450673},{"type":"v1","addr":"172.21.15.193:6837","nonce":1005450673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7425":{"gid":7425,"name":"c","rank":1,"incarnation":78,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6835/4018023271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4018023271},{"type":"v1","addr":"172.21.15.78:6835","nonce":4018023271}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6832/3357123265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":3357123265},{"type":"v1","addr":"172.21.15.78:6832","nonce":3357123265}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7428,"qdb_cluster":[6640,7425,7428]},"id":6}]} 2024-09-17T03:13:50.758 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 81 2024-09-17T03:13:50.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.759+0000 7f2dc2ecc640 1 -- 172.21.15.78:0/2130134868 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2da8078b90 msgr2=0x7f2da807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.759+0000 7f2dc2ecc640 1 --2- 172.21.15.78:0/2130134868 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2da8078b90 0x7f2da807b0a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2db8005fd0 tx=0x7f2db8005850 comp rx=0 tx=0).stop 2024-09-17T03:13:50.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.759+0000 7f2dc2ecc640 1 -- 172.21.15.78:0/2130134868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dbc0ccb50 msgr2=0x7f2dbc151b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:13:50.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.759+0000 7f2dc2ecc640 1 --2- 172.21.15.78:0/2130134868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dbc0ccb50 0x7f2dbc151b70 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f2dac00c3a0 tx=0x7f2dac00c860 comp rx=0 tx=0).stop 2024-09-17T03:13:50.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.760+0000 7f2dc2ecc640 1 -- 172.21.15.78:0/2130134868 shutdown_connections 2024-09-17T03:13:50.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.760+0000 7f2dc2ecc640 1 --2- 172.21.15.78:0/2130134868 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2da8078b90 0x7f2da807b0a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.760+0000 7f2dc2ecc640 1 --2- 172.21.15.78:0/2130134868 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dbc15d8a0 0x7f2dbc09c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.760+0000 7f2dc2ecc640 1 --2- 172.21.15.78:0/2130134868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dbc0ccb50 0x7f2dbc151b70 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.760+0000 7f2dc2ecc640 1 --2- 172.21.15.78:0/2130134868 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2dbc0cc1e0 0x7f2dbc1f3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:13:50.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.760+0000 7f2dc2ecc640 1 -- 172.21.15.78:0/2130134868 >> 172.21.15.78:0/2130134868 conn(0x7f2dbc06d7d0 msgr2=0x7f2dbc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:13:50.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.760+0000 7f2dc2ecc640 1 -- 172.21.15.78:0/2130134868 shutdown_connections 2024-09-17T03:13:50.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:13:50.760+0000 7f2dc2ecc640 1 -- 172.21.15.78:0/2130134868 wait complete. 2024-09-17T03:13:50.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:50.771 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-17T03:13:50.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:50.795 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-17T03:13:50.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:50.856 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2024-09-17T03:13:50.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:50.913 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2024-09-17T03:13:50.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:13:50.969 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2024-09-17T03:13:51.024 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:13:51.190 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:13:51.190 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:13:51.190 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:13:53.192 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:13:53.335 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:13:53.335 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:13:53.336 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:13:55.337 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:13:55.474 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:13:55.475 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:13:55.475 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:13:56.075 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:13:56.078 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:13:57.476 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:13:57.615 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2024-09-17T03:13:57.616 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-17T03:13:57.616 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:13:57.617 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:13:57.739 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-17T03:13:57.740 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:13:57.740 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:13:59.742 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:13:59.881 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-17T03:13:59.881 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:13:59.882 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:14:01.883 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:14:02.016 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-17T03:14:02.017 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:14:02.017 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:14:04.018 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:14:04.151 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2024-09-17T03:14:04.152 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-17T03:14:04.152 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:14:04.153 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-17T03:14:04.288 INFO:teuthology.orchestra.run.smithi193.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-17T03:14:04.289 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:14:04.289 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:14:04.290 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 flush journal 2024-09-17T03:14:04.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.407+0000 7fb5fd44d640 1 -- 172.21.15.78:0/3910838428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5dc003fd0 msgr2=0x7fb5dc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.407+0000 7fb5fd44d640 1 --2- 172.21.15.78:0/3910838428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5dc003fd0 0x7fb5dc004800 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fb5f808ee10 tx=0x7fb5dc005830 comp rx=0 tx=0).stop 2024-09-17T03:14:04.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.407+0000 7fb5f77fe640 1 -- 172.21.15.78:0/3910838428 reap_dead start 2024-09-17T03:14:04.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.407+0000 7fb5fd44d640 1 -- 172.21.15.78:0/3910838428 shutdown_connections 2024-09-17T03:14:04.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.407+0000 7fb5fd44d640 1 -- 172.21.15.78:0/3910838428 >> 172.21.15.78:0/3910838428 conn(0x7fb5f809d8f0 msgr2=0x7fb5f80d45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:04.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.407+0000 7fb5fd44d640 1 -- 172.21.15.78:0/3910838428 shutdown_connections 2024-09-17T03:14:04.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.407+0000 7fb5fd44d640 1 -- 172.21.15.78:0/3910838428 wait complete. 2024-09-17T03:14:04.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.409+0000 7fb5fd44d640 1 Processor -- start 2024-09-17T03:14:04.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.409+0000 7fb5fd44d640 1 -- start start 2024-09-17T03:14:04.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.410+0000 7fb5fd44d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5dc003fd0 0x7fb5f815ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.410+0000 7fb5fd44d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb5f80b6a20 0x7fb5f815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.410+0000 7fb5fd44d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5f80c9780 0x7fb5f80c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.410+0000 7fb5fd44d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f81630d0 con 0x7fb5dc003fd0 2024-09-17T03:14:04.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.410+0000 7fb5fd44d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f8162f50 con 0x7fb5f80c9780 2024-09-17T03:14:04.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.410+0000 7fb5fd44d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f8163250 con 0x7fb5f80b6a20 2024-09-17T03:14:04.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.411+0000 7fb5f6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5dc003fd0 0x7fb5f815ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.411+0000 7fb5f6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5dc003fd0 0x7fb5f815ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60850/0 (socket says 172.21.15.78:60850) 2024-09-17T03:14:04.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.411+0000 7fb5f6ffd640 1 -- 172.21.15.78:0/852153042 learned_addr learned my addr 172.21.15.78:0/852153042 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:04.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.411+0000 7fb5f67fc640 1 --2- 172.21.15.78:0/852153042 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb5f80b6a20 0x7fb5f815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.411+0000 7fb5f77fe640 1 --2- 172.21.15.78:0/852153042 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5f80c9780 0x7fb5f80c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.411+0000 7fb5f6ffd640 1 -- 172.21.15.78:0/852153042 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb5f80b6a20 msgr2=0x7fb5f815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.411+0000 7fb5f6ffd640 1 --2- 172.21.15.78:0/852153042 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb5f80b6a20 0x7fb5f815ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.411+0000 7fb5f6ffd640 1 -- 172.21.15.78:0/852153042 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5f80c9780 msgr2=0x7fb5f80c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.411+0000 7fb5f6ffd640 1 --2- 172.21.15.78:0/852153042 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5f80c9780 0x7fb5f80c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.411+0000 7fb5f6ffd640 1 -- 172.21.15.78:0/852153042 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5f80ca0d0 con 0x7fb5dc003fd0 2024-09-17T03:14:04.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.411+0000 7fb5f77fe640 1 --2- 172.21.15.78:0/852153042 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5f80c9780 0x7fb5f80c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:04.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.411+0000 7fb5f6ffd640 1 --2- 172.21.15.78:0/852153042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5dc003fd0 0x7fb5f815ff80 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8011ab0 tx=0x7fb5e8011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:04.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.411+0000 7fb5ef7fe640 1 -- 172.21.15.78:0/852153042 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e801e070 con 0x7fb5dc003fd0 2024-09-17T03:14:04.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.411+0000 7fb5ef7fe640 1 -- 172.21.15.78:0/852153042 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5e800fc70 con 0x7fb5dc003fd0 2024-09-17T03:14:04.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.411+0000 7fb5fd44d640 1 -- 172.21.15.78:0/852153042 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5f81f65c0 con 0x7fb5dc003fd0 2024-09-17T03:14:04.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.411+0000 7fb5ef7fe640 1 -- 172.21.15.78:0/852153042 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8019670 con 0x7fb5dc003fd0 2024-09-17T03:14:04.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.411+0000 7fb5fd44d640 1 -- 172.21.15.78:0/852153042 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5f81f6000 con 0x7fb5dc003fd0 2024-09-17T03:14:04.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.413+0000 7fb5ef7fe640 1 -- 172.21.15.78:0/852153042 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb5e8021070 con 0x7fb5dc003fd0 2024-09-17T03:14:04.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.414+0000 7fb5ef7fe640 1 --2- 172.21.15.78:0/852153042 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb5e0078bc0 0x7fb5e007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.414+0000 7fb5ef7fe640 1 -- 172.21.15.78:0/852153042 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fb5e809b600 con 0x7fb5dc003fd0 2024-09-17T03:14:04.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.414+0000 7fb5f67fc640 1 --2- 172.21.15.78:0/852153042 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb5e0078bc0 0x7fb5e007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.414+0000 7fb5f67fc640 1 --2- 172.21.15.78:0/852153042 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb5e0078bc0 0x7fb5e007b0d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4035000 tx=0x7fb5e40046c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:04.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.415+0000 7fb6043be740 1 Processor -- start 2024-09-17T03:14:04.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.415+0000 7fb6043be740 1 -- start start 2024-09-17T03:14:04.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.416+0000 7fb6043be740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb8613d390 0x55eb8650e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.416+0000 7fb6043be740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb861144d0 0x55eb8650ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.416+0000 7fb6043be740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8611c6b0 0x55eb8652bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.416+0000 7fb6043be740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55eb86457a60 con 0x55eb861144d0 2024-09-17T03:14:04.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.416+0000 7fb6043be740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55eb86446e90 con 0x55eb8613d390 2024-09-17T03:14:04.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.416+0000 7fb6043be740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55eb8644aca0 con 0x55eb8611c6b0 2024-09-17T03:14:04.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.416+0000 7fb5f67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb861144d0 0x55eb8650ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.416+0000 7fb5f67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb861144d0 0x55eb8650ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60862/0 (socket says 172.21.15.78:60862) 2024-09-17T03:14:04.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.416+0000 7fb5f67fc640 1 -- 172.21.15.78:0/117316405 learned_addr learned my addr 172.21.15.78:0/117316405 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:04.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.416+0000 7fb5f6ffd640 1 --2- 172.21.15.78:0/117316405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb8613d390 0x55eb8650e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.416+0000 7fb5f77fe640 1 --2- 172.21.15.78:0/117316405 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8611c6b0 0x55eb8652bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.416+0000 7fb5f67fc640 1 -- 172.21.15.78:0/117316405 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8611c6b0 msgr2=0x55eb8652bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.416+0000 7fb5f67fc640 1 --2- 172.21.15.78:0/117316405 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8611c6b0 0x55eb8652bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.416+0000 7fb5f67fc640 1 -- 172.21.15.78:0/117316405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb8613d390 msgr2=0x55eb8650e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.416+0000 7fb5f67fc640 1 --2- 172.21.15.78:0/117316405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb8613d390 0x55eb8650e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.416+0000 7fb5f67fc640 1 -- 172.21.15.78:0/117316405 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb8621f7d0 con 0x55eb861144d0 2024-09-17T03:14:04.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.416+0000 7fb5f77fe640 1 --2- 172.21.15.78:0/117316405 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8611c6b0 0x55eb8652bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:04.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.416+0000 7fb5f6ffd640 1 --2- 172.21.15.78:0/117316405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb8613d390 0x55eb8650e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:14:04.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.417+0000 7fb5f67fc640 1 --2- 172.21.15.78:0/117316405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb861144d0 0x55eb8650ec80 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4000c00 tx=0x7fb5e403b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95842fa5dc9d726 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:04.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.417+0000 7fb5ecff9640 1 -- 172.21.15.78:0/117316405 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4038040 con 0x55eb861144d0 2024-09-17T03:14:04.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.417+0000 7fb5ecff9640 1 -- 172.21.15.78:0/117316405 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5e404d070 con 0x55eb861144d0 2024-09-17T03:14:04.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.417+0000 7fb5ecff9640 1 -- 172.21.15.78:0/117316405 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e403da90 con 0x55eb861144d0 2024-09-17T03:14:04.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.418+0000 7fb6043be740 1 -- 172.21.15.78:0/117316405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb861144d0 msgr2=0x55eb8650ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.418+0000 7fb6043be740 1 --2- 172.21.15.78:0/117316405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb861144d0 0x55eb8650ec80 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4000c00 tx=0x7fb5e403b000 comp rx=0 tx=0).stop 2024-09-17T03:14:04.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.418+0000 7fb6043be740 1 -- 172.21.15.78:0/117316405 shutdown_connections 2024-09-17T03:14:04.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.418+0000 7fb6043be740 1 --2- 172.21.15.78:0/117316405 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8611c6b0 0x55eb8652bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.418+0000 7fb6043be740 1 --2- 172.21.15.78:0/117316405 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb861144d0 0x55eb8650ec80 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.418+0000 7fb6043be740 1 --2- 172.21.15.78:0/117316405 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb8613d390 0x55eb8650e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.418+0000 7fb6043be740 1 -- 172.21.15.78:0/117316405 >> 172.21.15.78:0/117316405 conn(0x55eb861314e0 msgr2=0x55eb864e4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:04.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.418+0000 7fb6043be740 1 -- 172.21.15.78:0/117316405 shutdown_connections 2024-09-17T03:14:04.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.418+0000 7fb6043be740 1 -- 172.21.15.78:0/117316405 wait complete. 2024-09-17T03:14:04.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.419+0000 7fb6043be740 1 -- start start 2024-09-17T03:14:04.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.419+0000 7fb6043be740 1 Processor -- start 2024-09-17T03:14:04.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.420+0000 7fb6043be740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb861144d0 0x55eb864fbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.420+0000 7fb6043be740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb8611c6b0 0x55eb865204e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.420+0000 7fb6043be740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8613d390 0x55eb8652b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.420+0000 7fb6043be740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55eb861b7740 con 0x55eb8611c6b0 2024-09-17T03:14:04.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.420+0000 7fb6043be740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55eb863ec970 con 0x55eb861144d0 2024-09-17T03:14:04.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.420+0000 7fb6043be740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55eb8650f1c0 con 0x55eb8613d390 2024-09-17T03:14:04.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.420+0000 7fb6043be740 10 client.0 _ll_register_callbacks cb 0x55eb863efbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:04.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.420+0000 7fb5f67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb8611c6b0 0x55eb865204e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.420+0000 7fb5f67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb8611c6b0 0x55eb865204e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60878/0 (socket says 172.21.15.78:60878) 2024-09-17T03:14:04.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.420+0000 7fb5f67fc640 1 -- 172.21.15.78:0/3194548070 learned_addr learned my addr 172.21.15.78:0/3194548070 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:04.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.420+0000 7fb5f6ffd640 1 --2- 172.21.15.78:0/3194548070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb861144d0 0x55eb864fbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.420+0000 7fb5f67fc640 1 -- 172.21.15.78:0/3194548070 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8613d390 msgr2=0x55eb8652b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.420+0000 7fb5f77fe640 1 --2- 172.21.15.78:0/3194548070 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8613d390 0x55eb8652b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.420+0000 7fb5f67fc640 1 --2- 172.21.15.78:0/3194548070 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8613d390 0x55eb8652b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.420+0000 7fb5f67fc640 1 -- 172.21.15.78:0/3194548070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb861144d0 msgr2=0x55eb864fbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.420+0000 7fb5f67fc640 1 --2- 172.21.15.78:0/3194548070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb861144d0 0x55eb864fbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.420+0000 7fb5f67fc640 1 -- 172.21.15.78:0/3194548070 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb861a8970 con 0x55eb8611c6b0 2024-09-17T03:14:04.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.420+0000 7fb5f6ffd640 1 --2- 172.21.15.78:0/3194548070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb861144d0 0x55eb864fbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:04.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.420+0000 7fb5f77fe640 1 --2- 172.21.15.78:0/3194548070 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8613d390 0x55eb8652b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:04.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.421+0000 7fb5f67fc640 1 --2- 172.21.15.78:0/3194548070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb8611c6b0 0x55eb865204e0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fb5e404a040 tx=0x7fb5e403dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22cc4dac1ace1eb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:04.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.421+0000 7fb5d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:04.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.421+0000 7fb5d9ffb640 1 -- 172.21.15.78:0/3194548070 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4055070 con 0x55eb8611c6b0 2024-09-17T03:14:04.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.421+0000 7fb5d9ffb640 1 -- 172.21.15.78:0/3194548070 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fb5e405a460 con 0x55eb8611c6b0 2024-09-17T03:14:04.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.421+0000 7fb6043be740 1 -- 172.21.15.78:0/3194548070 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5e404d070 con 0x55eb8611c6b0 2024-09-17T03:14:04.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.421+0000 7fb5d9ffb640 1 -- 172.21.15.78:0/3194548070 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fb5e4062050 con 0x55eb8611c6b0 2024-09-17T03:14:04.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.421+0000 7fb6043be740 10 client.7707 fetch_fsmap learned FSMap version 83 2024-09-17T03:14:04.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.421+0000 7fb6043be740 1 -- 172.21.15.78:0/3194548070 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x55eb861866a0 con 0x55eb8611c6b0 2024-09-17T03:14:04.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.421+0000 7fb5d9ffb640 1 -- 172.21.15.78:0/3194548070 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5e404d070 con 0x55eb8611c6b0 2024-09-17T03:14:04.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.421+0000 7fb5d9ffb640 1 -- 172.21.15.78:0/3194548070 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 83) ==== 3554+0+0 (secure 0 0 0) 0x7fb5e4065020 con 0x55eb8611c6b0 2024-09-17T03:14:04.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.421+0000 7fb6043be740 10 client.7707 fetch_fsmap finished waiting for FSMap version 83 2024-09-17T03:14:04.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.421+0000 7fb6043be740 10 client.7707 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T03:14:04.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.421+0000 7fb6043be740 20 client.7707 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:04.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.421+0000 7fb6043be740 1 --2- 172.21.15.78:0/3194548070 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55eb860fbf60 0x55eb8653bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.421+0000 7fb6043be740 4 client.7707 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:14:04.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.421+0000 7fb6043be740 1 -- 172.21.15.78:0/3194548070 --> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb864599b0 con 0x55eb860fbf60 2024-09-17T03:14:04.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.421+0000 7fb5f6ffd640 1 --2- 172.21.15.78:0/3194548070 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55eb860fbf60 0x55eb8653bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.422+0000 7fb5d9ffb640 10 client.7707 ms_handle_connect on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:04.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.422+0000 7fb5f6ffd640 1 --2- 172.21.15.78:0/3194548070 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55eb860fbf60 0x55eb8653bb20 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ec1bd8287fc38aa server_cookie=17dbeb3aeef18a2e in_seq=0 out_seq=0 2024-09-17T03:14:04.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.422+0000 7fb5d9ffb640 1 -- 172.21.15.78:0/3194548070 <== mds.0 v2:172.21.15.78:6833/3357123265 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55eb864599b0 con 0x55eb860fbf60 2024-09-17T03:14:04.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.422+0000 7fb5d9ffb640 10 client.7707 handle_command_reply: tid=0 2024-09-17T03:14:04.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.422+0000 7fb6043be740 1 client.7707 shutdown 2024-09-17T03:14:04.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.422+0000 7fb6043be740 1 -- 172.21.15.78:0/3194548070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb8611c6b0 msgr2=0x55eb865204e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.422+0000 7fb6043be740 1 --2- 172.21.15.78:0/3194548070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb8611c6b0 0x55eb865204e0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fb5e404a040 tx=0x7fb5e403dc90 comp rx=0 tx=0).stop 2024-09-17T03:14:04.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.422+0000 7fb6043be740 1 -- 172.21.15.78:0/3194548070 shutdown_connections 2024-09-17T03:14:04.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.422+0000 7fb6043be740 1 --2- 172.21.15.78:0/3194548070 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55eb860fbf60 0x55eb8653bb20 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.422+0000 7fb6043be740 1 --2- 172.21.15.78:0/3194548070 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8613d390 0x55eb8652b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.422+0000 7fb5d9ffb640 0 client.7707 ms_handle_reset on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:04.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.422+0000 7fb6043be740 1 --2- 172.21.15.78:0/3194548070 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb8611c6b0 0x55eb865204e0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.422+0000 7fb6043be740 1 --2- 172.21.15.78:0/3194548070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb861144d0 0x55eb864fbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.422+0000 7fb6043be740 1 -- 172.21.15.78:0/3194548070 >> 172.21.15.78:0/3194548070 conn(0x55eb861314e0 msgr2=0x55eb864df2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:04.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.423+0000 7fb6043be740 1 -- 172.21.15.78:0/3194548070 shutdown_connections 2024-09-17T03:14:04.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.423+0000 7fb6043be740 1 -- 172.21.15.78:0/3194548070 wait complete. 2024-09-17T03:14:04.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.423+0000 7fb6043be740 20 client.7707 trim_cache size 0 max 16384 2024-09-17T03:14:04.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.437+0000 7fb6043be740 1 Processor -- start 2024-09-17T03:14:04.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.437+0000 7fb6043be740 1 -- start start 2024-09-17T03:14:04.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.438+0000 7fb6043be740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb861144d0 0x55eb8652aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.438+0000 7fb6043be740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb8611c6b0 0x55eb864fc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.438+0000 7fb6043be740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8613d390 0x55eb864ddcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.439+0000 7fb6043be740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f8202810 con 0x55eb861144d0 2024-09-17T03:14:04.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.439+0000 7fb6043be740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f82019e0 con 0x55eb8611c6b0 2024-09-17T03:14:04.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.439+0000 7fb6043be740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb5f82020e0 con 0x55eb8613d390 2024-09-17T03:14:04.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.439+0000 7fb5f6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb861144d0 0x55eb8652aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.439+0000 7fb5f6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb861144d0 0x55eb8652aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60892/0 (socket says 172.21.15.78:60892) 2024-09-17T03:14:04.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.439+0000 7fb5f6ffd640 1 -- 172.21.15.78:0/2456331177 learned_addr learned my addr 172.21.15.78:0/2456331177 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:04.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.439+0000 7fb5f6ffd640 1 -- 172.21.15.78:0/2456331177 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8613d390 msgr2=0x55eb864ddcf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-17T03:14:04.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.439+0000 7fb5f6ffd640 1 --2- 172.21.15.78:0/2456331177 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8613d390 0x55eb864ddcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.439+0000 7fb5f6ffd640 1 -- 172.21.15.78:0/2456331177 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb8611c6b0 msgr2=0x55eb864fc500 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-17T03:14:04.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.439+0000 7fb5f6ffd640 1 --2- 172.21.15.78:0/2456331177 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb8611c6b0 0x55eb864fc500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.439+0000 7fb5f6ffd640 1 -- 172.21.15.78:0/2456331177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb8653b5c0 con 0x55eb861144d0 2024-09-17T03:14:04.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.439+0000 7fb5f6ffd640 1 --2- 172.21.15.78:0/2456331177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb861144d0 0x55eb8652aeb0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8060660 tx=0x7fb5e8025040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49cc6612ed8a743 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:04.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.439+0000 7fb5dbfff640 1 -- 172.21.15.78:0/2456331177 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8067e20 con 0x55eb861144d0 2024-09-17T03:14:04.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.439+0000 7fb5dbfff640 1 -- 172.21.15.78:0/2456331177 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5e805f660 con 0x55eb861144d0 2024-09-17T03:14:04.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.439+0000 7fb5dbfff640 1 -- 172.21.15.78:0/2456331177 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e8085da0 con 0x55eb861144d0 2024-09-17T03:14:04.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.440+0000 7fb6043be740 1 -- 172.21.15.78:0/2456331177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb861144d0 msgr2=0x55eb8652aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.440+0000 7fb6043be740 1 --2- 172.21.15.78:0/2456331177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb861144d0 0x55eb8652aeb0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8060660 tx=0x7fb5e8025040 comp rx=0 tx=0).stop 2024-09-17T03:14:04.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.440+0000 7fb6043be740 1 -- 172.21.15.78:0/2456331177 shutdown_connections 2024-09-17T03:14:04.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.440+0000 7fb6043be740 1 --2- 172.21.15.78:0/2456331177 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8613d390 0x55eb864ddcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.440+0000 7fb6043be740 1 --2- 172.21.15.78:0/2456331177 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb8611c6b0 0x55eb864fc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.440+0000 7fb6043be740 1 --2- 172.21.15.78:0/2456331177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb861144d0 0x55eb8652aeb0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.440+0000 7fb6043be740 1 -- 172.21.15.78:0/2456331177 >> 172.21.15.78:0/2456331177 conn(0x55eb861314e0 msgr2=0x55eb864df590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:04.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.440+0000 7fb6043be740 1 -- 172.21.15.78:0/2456331177 shutdown_connections 2024-09-17T03:14:04.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.440+0000 7fb6043be740 1 -- 172.21.15.78:0/2456331177 wait complete. 2024-09-17T03:14:04.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.441+0000 7fb6043be740 1 -- start start 2024-09-17T03:14:04.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.441+0000 7fb6043be740 1 Processor -- start 2024-09-17T03:14:04.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.442+0000 7fb6043be740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb861144d0 0x55eb86536b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.442+0000 7fb6043be740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb8611c6b0 0x55eb86537060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.442+0000 7fb6043be740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8613d390 0x55eb8654afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.442+0000 7fb6043be740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55eb8652ac60 con 0x55eb8611c6b0 2024-09-17T03:14:04.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.442+0000 7fb6043be740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb5f81f9920 con 0x55eb861144d0 2024-09-17T03:14:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.442+0000 7fb6043be740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55eb864df740 con 0x55eb8613d390 2024-09-17T03:14:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.442+0000 7fb6043be740 10 client.0 _ll_register_callbacks cb 0x7fb5e8099f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.442+0000 7fb5f67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb8611c6b0 0x55eb86537060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.442+0000 7fb5f67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb8611c6b0 0x55eb86537060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60908/0 (socket says 172.21.15.78:60908) 2024-09-17T03:14:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.442+0000 7fb5f67fc640 1 -- 172.21.15.78:0/1940422313 learned_addr learned my addr 172.21.15.78:0/1940422313 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.442+0000 7fb5f77fe640 1 --2- 172.21.15.78:0/1940422313 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8613d390 0x55eb8654afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.442+0000 7fb5f6ffd640 1 --2- 172.21.15.78:0/1940422313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb861144d0 0x55eb86536b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.443+0000 7fb5f67fc640 1 -- 172.21.15.78:0/1940422313 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8613d390 msgr2=0x55eb8654afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.443+0000 7fb5f67fc640 1 --2- 172.21.15.78:0/1940422313 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8613d390 0x55eb8654afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.443+0000 7fb5f67fc640 1 -- 172.21.15.78:0/1940422313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb861144d0 msgr2=0x55eb86536b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.443+0000 7fb5f67fc640 1 --2- 172.21.15.78:0/1940422313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb861144d0 0x55eb86536b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.443+0000 7fb5f67fc640 1 -- 172.21.15.78:0/1940422313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb864e6100 con 0x55eb8611c6b0 2024-09-17T03:14:04.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.443+0000 7fb5f67fc640 1 --2- 172.21.15.78:0/1940422313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb8611c6b0 0x55eb86537060 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009890 tx=0x7fb5e405a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6e8f2e493cf015 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:04.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.443+0000 7fb5d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:04.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.443+0000 7fb5d9ffb640 1 -- 172.21.15.78:0/1940422313 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5e406a020 con 0x55eb8611c6b0 2024-09-17T03:14:04.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.443+0000 7fb5d9ffb640 1 -- 172.21.15.78:0/1940422313 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fb5e4005020 con 0x55eb8611c6b0 2024-09-17T03:14:04.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.443+0000 7fb6043be740 1 -- 172.21.15.78:0/1940422313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5e805f660 con 0x55eb8611c6b0 2024-09-17T03:14:04.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.445+0000 7fb5d9ffb640 1 -- 172.21.15.78:0/1940422313 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fb5e4071050 con 0x55eb8611c6b0 2024-09-17T03:14:04.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.445+0000 7fb6043be740 10 client.7713 fetch_fsmap learned FSMap version 83 2024-09-17T03:14:04.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.445+0000 7fb6043be740 1 -- 172.21.15.78:0/1940422313 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x55eb86537a20 con 0x55eb8611c6b0 2024-09-17T03:14:04.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.446+0000 7fb5d9ffb640 1 -- 172.21.15.78:0/1940422313 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5e805f660 con 0x55eb8611c6b0 2024-09-17T03:14:04.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.446+0000 7fb5d9ffb640 1 -- 172.21.15.78:0/1940422313 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 83) ==== 3554+0+0 (secure 0 0 0) 0x7fb5e4074020 con 0x55eb8611c6b0 2024-09-17T03:14:04.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.446+0000 7fb6043be740 10 client.7713 fetch_fsmap finished waiting for FSMap version 83 2024-09-17T03:14:04.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.446+0000 7fb6043be740 10 client.7713 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T03:14:04.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.446+0000 7fb6043be740 20 client.7713 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:04.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.446+0000 7fb6043be740 1 --2- 172.21.15.78:0/1940422313 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55eb8652b9a0 0x55eb8654b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.446+0000 7fb6043be740 4 client.7713 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T03:14:04.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.446+0000 7fb6043be740 1 -- 172.21.15.78:0/1940422313 --> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eb86455460 con 0x55eb8652b9a0 2024-09-17T03:14:04.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.446+0000 7fb5f6ffd640 1 --2- 172.21.15.78:0/1940422313 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55eb8652b9a0 0x55eb8654b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.446+0000 7fb5d9ffb640 10 client.7713 ms_handle_connect on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:04.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.447+0000 7fb5f6ffd640 1 --2- 172.21.15.78:0/1940422313 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55eb8652b9a0 0x55eb8654b510 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=321d36edef8e6180 server_cookie=c5060c780c245d46 in_seq=0 out_seq=0 2024-09-17T03:14:04.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.462+0000 7fb5d9ffb640 1 -- 172.21.15.78:0/1940422313 <== mds.0 v2:172.21.15.78:6833/3357123265 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eb86455460 con 0x55eb8652b9a0 2024-09-17T03:14:04.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.462+0000 7fb5d9ffb640 10 client.7713 handle_command_reply: tid=0 2024-09-17T03:14:04.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.462+0000 7fb6043be740 1 client.7713 shutdown 2024-09-17T03:14:04.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.462+0000 7fb6043be740 1 -- 172.21.15.78:0/1940422313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb8611c6b0 msgr2=0x55eb86537060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.462+0000 7fb6043be740 1 --2- 172.21.15.78:0/1940422313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb8611c6b0 0x55eb86537060 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4009890 tx=0x7fb5e405a7a0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.462+0000 7fb6043be740 1 -- 172.21.15.78:0/1940422313 shutdown_connections 2024-09-17T03:14:04.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.462+0000 7fb6043be740 1 --2- 172.21.15.78:0/1940422313 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55eb8652b9a0 0x55eb8654b510 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.462+0000 7fb6043be740 1 --2- 172.21.15.78:0/1940422313 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55eb8613d390 0x55eb8654afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.462+0000 7fb5d9ffb640 0 client.7713 ms_handle_reset on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:04.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.462+0000 7fb6043be740 1 --2- 172.21.15.78:0/1940422313 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55eb8611c6b0 0x55eb86537060 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.462+0000 7fb6043be740 1 --2- 172.21.15.78:0/1940422313 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55eb861144d0 0x55eb86536b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.462+0000 7fb6043be740 1 -- 172.21.15.78:0/1940422313 >> 172.21.15.78:0/1940422313 conn(0x55eb861314e0 msgr2=0x55eb86521eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:04.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.462+0000 7fb6043be740 1 -- 172.21.15.78:0/1940422313 shutdown_connections 2024-09-17T03:14:04.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.462+0000 7fb6043be740 1 -- 172.21.15.78:0/1940422313 wait complete. 2024-09-17T03:14:04.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.462+0000 7fb6043be740 20 client.7713 trim_cache size 0 max 16384 2024-09-17T03:14:04.462 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:14:04.462 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:14:04.463 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:14:04.463 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:14:04.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.463+0000 7fb5fd44d640 1 -- 172.21.15.78:0/852153042 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb5e0078bc0 msgr2=0x7fb5e007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.463+0000 7fb5fd44d640 1 --2- 172.21.15.78:0/852153042 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb5e0078bc0 0x7fb5e007b0d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4035000 tx=0x7fb5e40046c0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.463+0000 7fb5fd44d640 1 -- 172.21.15.78:0/852153042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5dc003fd0 msgr2=0x7fb5f815ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.463+0000 7fb5fd44d640 1 --2- 172.21.15.78:0/852153042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5dc003fd0 0x7fb5f815ff80 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fb5e8011ab0 tx=0x7fb5e8011f70 comp rx=0 tx=0).stop 2024-09-17T03:14:04.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.463+0000 7fb5fd44d640 1 -- 172.21.15.78:0/852153042 shutdown_connections 2024-09-17T03:14:04.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.463+0000 7fb5fd44d640 1 --2- 172.21.15.78:0/852153042 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb5e0078bc0 0x7fb5e007b0d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.463+0000 7fb5fd44d640 1 --2- 172.21.15.78:0/852153042 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5f80c9780 0x7fb5f80c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.463+0000 7fb5fd44d640 1 --2- 172.21.15.78:0/852153042 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb5f80b6a20 0x7fb5f815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.463+0000 7fb5fd44d640 1 --2- 172.21.15.78:0/852153042 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5dc003fd0 0x7fb5f815ff80 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.463+0000 7fb5fd44d640 1 -- 172.21.15.78:0/852153042 >> 172.21.15.78:0/852153042 conn(0x7fb5f809d8f0 msgr2=0x7fb5f80b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:04.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.463+0000 7fb5fd44d640 1 -- 172.21.15.78:0/852153042 shutdown_connections 2024-09-17T03:14:04.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.463+0000 7fb5fd44d640 1 -- 172.21.15.78:0/852153042 wait complete. 2024-09-17T03:14:04.473 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:1 flush journal 2024-09-17T03:14:04.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.588+0000 7f5c25b89640 1 -- 172.21.15.78:0/1288112709 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c200cf3f0 msgr2=0x7f5c200cff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.588+0000 7f5c25b89640 1 --2- 172.21.15.78:0/1288112709 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c200cf3f0 0x7f5c200cff40 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5c18005fd0 tx=0x7f5c1802a940 comp rx=0 tx=0).stop 2024-09-17T03:14:04.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.589+0000 7f5c25b89640 1 -- 172.21.15.78:0/1288112709 shutdown_connections 2024-09-17T03:14:04.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.589+0000 7f5c25b89640 1 --2- 172.21.15.78:0/1288112709 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c200cf3f0 0x7f5c200cff40 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.589+0000 7f5c25b89640 1 --2- 172.21.15.78:0/1288112709 >> v2:172.21.15.193:3300/0 conn(0x7f5c200d16f0 0x7f5c2015d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.589+0000 7f5c25b89640 1 -- 172.21.15.78:0/1288112709 >> 172.21.15.78:0/1288112709 conn(0x7f5c2006d5d0 msgr2=0x7f5c20071110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:04.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.589+0000 7f5c25b89640 1 -- 172.21.15.78:0/1288112709 shutdown_connections 2024-09-17T03:14:04.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.589+0000 7f5c25b89640 1 -- 172.21.15.78:0/1288112709 wait complete. 2024-09-17T03:14:04.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.590+0000 7f5c25b89640 1 Processor -- start 2024-09-17T03:14:04.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.591+0000 7f5c25b89640 1 -- start start 2024-09-17T03:14:04.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.592+0000 7f5c25b89640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c200cf3f0 0x7f5c201522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.592+0000 7f5c25b89640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c200d16f0 0x7f5c200cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.592+0000 7f5c25b89640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c20160550 0x7f5c2015ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.592+0000 7f5c25b89640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5c200d0480 con 0x7f5c200cf3f0 2024-09-17T03:14:04.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.592+0000 7f5c25b89640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5c20160bf0 con 0x7f5c20160550 2024-09-17T03:14:04.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.592+0000 7f5c25b89640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5c200d0600 con 0x7f5c200d16f0 2024-09-17T03:14:04.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.592+0000 7f5c1f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c200cf3f0 0x7f5c201522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.592+0000 7f5c1f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c200cf3f0 0x7f5c201522f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60924/0 (socket says 172.21.15.78:60924) 2024-09-17T03:14:04.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.592+0000 7f5c1f7fe640 1 -- 172.21.15.78:0/3553076781 learned_addr learned my addr 172.21.15.78:0/3553076781 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:04.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.592+0000 7f5c1ffff640 1 --2- 172.21.15.78:0/3553076781 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c20160550 0x7f5c2015ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.592+0000 7f5c1effd640 1 --2- 172.21.15.78:0/3553076781 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c200d16f0 0x7f5c200cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.592+0000 7f5c1f7fe640 1 -- 172.21.15.78:0/3553076781 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c200d16f0 msgr2=0x7f5c200cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.592+0000 7f5c1f7fe640 1 --2- 172.21.15.78:0/3553076781 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c200d16f0 0x7f5c200cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.592+0000 7f5c1f7fe640 1 -- 172.21.15.78:0/3553076781 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c20160550 msgr2=0x7f5c2015ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.592+0000 7f5c1f7fe640 1 --2- 172.21.15.78:0/3553076781 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c20160550 0x7f5c2015ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.592+0000 7f5c1f7fe640 1 -- 172.21.15.78:0/3553076781 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c201f4340 con 0x7f5c200cf3f0 2024-09-17T03:14:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.592+0000 7f5c1f7fe640 1 --2- 172.21.15.78:0/3553076781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c200cf3f0 0x7f5c201522f0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f5c1000e9f0 tx=0x7f5c1000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.592+0000 7f5c07fff640 1 -- 172.21.15.78:0/3553076781 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1000cd80 con 0x7f5c200cf3f0 2024-09-17T03:14:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.593+0000 7f5c07fff640 1 -- 172.21.15.78:0/3553076781 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c10004020 con 0x7f5c200cf3f0 2024-09-17T03:14:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.593+0000 7f5c25b89640 1 -- 172.21.15.78:0/3553076781 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c201f4620 con 0x7f5c200cf3f0 2024-09-17T03:14:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.593+0000 7f5c07fff640 1 -- 172.21.15.78:0/3553076781 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c10004470 con 0x7f5c200cf3f0 2024-09-17T03:14:04.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.593+0000 7f5c25b89640 1 -- 172.21.15.78:0/3553076781 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c201f4be0 con 0x7f5c200cf3f0 2024-09-17T03:14:04.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.594+0000 7f5c07fff640 1 -- 172.21.15.78:0/3553076781 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5c100035f0 con 0x7f5c200cf3f0 2024-09-17T03:14:04.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.595+0000 7f5c07fff640 1 --2- 172.21.15.78:0/3553076781 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5c0c078b90 0x7f5c0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.595+0000 7f5c07fff640 1 -- 172.21.15.78:0/3553076781 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f5c1009b7e0 con 0x7f5c200cf3f0 2024-09-17T03:14:04.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.595+0000 7f5c1effd640 1 --2- 172.21.15.78:0/3553076781 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5c0c078b90 0x7f5c0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.596+0000 7f5c1effd640 1 --2- 172.21.15.78:0/3553076781 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5c0c078b90 0x7f5c0c07b0a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5c20154bb0 tx=0x7f5c14007e90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:04.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.596+0000 7f5c2cbd0740 1 Processor -- start 2024-09-17T03:14:04.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.596+0000 7f5c2cbd0740 1 -- start start 2024-09-17T03:14:04.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.598+0000 7f5c2cbd0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be50390 0x56418c23ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.598+0000 7f5c2cbd0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be274d0 0x56418c211860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.598+0000 7f5c2cbd0740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be2f6b0 0x56418c211da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.598+0000 7f5c2cbd0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56418c16aa60 con 0x56418be50390 2024-09-17T03:14:04.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.598+0000 7f5c2cbd0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56418c159e90 con 0x56418be274d0 2024-09-17T03:14:04.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.598+0000 7f5c2cbd0740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x56418c15dca0 con 0x56418be2f6b0 2024-09-17T03:14:04.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.598+0000 7f5c1f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be50390 0x56418c23ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.598+0000 7f5c1f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be50390 0x56418c23ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60940/0 (socket says 172.21.15.78:60940) 2024-09-17T03:14:04.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.598+0000 7f5c1f7fe640 1 -- 172.21.15.78:0/537179083 learned_addr learned my addr 172.21.15.78:0/537179083 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:04.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.598+0000 7f5c1effd640 1 --2- 172.21.15.78:0/537179083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be274d0 0x56418c211860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.598+0000 7f5c1ffff640 1 --2- 172.21.15.78:0/537179083 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be2f6b0 0x56418c211da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.598+0000 7f5c1f7fe640 1 -- 172.21.15.78:0/537179083 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be2f6b0 msgr2=0x56418c211da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.598+0000 7f5c1f7fe640 1 --2- 172.21.15.78:0/537179083 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be2f6b0 0x56418c211da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.598+0000 7f5c1f7fe640 1 -- 172.21.15.78:0/537179083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be274d0 msgr2=0x56418c211860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.598+0000 7f5c1f7fe640 1 --2- 172.21.15.78:0/537179083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be274d0 0x56418c211860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.598+0000 7f5c1f7fe640 1 -- 172.21.15.78:0/537179083 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56418bf327d0 con 0x56418be50390 2024-09-17T03:14:04.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.598+0000 7f5c1f7fe640 1 --2- 172.21.15.78:0/537179083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be50390 0x56418c23ca10 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f5c100634c0 tx=0x7f5c10063430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0dbe2104473a56 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:04.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.598+0000 7f5c057fa640 1 -- 172.21.15.78:0/537179083 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c10063530 con 0x56418be50390 2024-09-17T03:14:04.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.598+0000 7f5c057fa640 1 -- 172.21.15.78:0/537179083 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c10067f60 con 0x56418be50390 2024-09-17T03:14:04.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.598+0000 7f5c057fa640 1 -- 172.21.15.78:0/537179083 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c100629b0 con 0x56418be50390 2024-09-17T03:14:04.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.599+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/537179083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be50390 msgr2=0x56418c23ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.599+0000 7f5c2cbd0740 1 --2- 172.21.15.78:0/537179083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be50390 0x56418c23ca10 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f5c100634c0 tx=0x7f5c10063430 comp rx=0 tx=0).stop 2024-09-17T03:14:04.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.599+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/537179083 shutdown_connections 2024-09-17T03:14:04.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.599+0000 7f5c2cbd0740 1 --2- 172.21.15.78:0/537179083 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be2f6b0 0x56418c211da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.599+0000 7f5c2cbd0740 1 --2- 172.21.15.78:0/537179083 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be274d0 0x56418c211860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.599+0000 7f5c2cbd0740 1 --2- 172.21.15.78:0/537179083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be50390 0x56418c23ca10 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.599+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/537179083 >> 172.21.15.78:0/537179083 conn(0x56418be444e0 msgr2=0x56418c1f7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:04.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.599+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/537179083 shutdown_connections 2024-09-17T03:14:04.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.599+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/537179083 wait complete. 2024-09-17T03:14:04.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.600+0000 7f5c2cbd0740 1 -- start start 2024-09-17T03:14:04.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.600+0000 7f5c2cbd0740 1 Processor -- start 2024-09-17T03:14:04.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c2cbd0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be274d0 0x56418c24ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c2cbd0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be2f6b0 0x56418c24f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c2cbd0740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be50390 0x56418c220fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c2cbd0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56418beca740 con 0x56418be274d0 2024-09-17T03:14:04.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c2cbd0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56418c0ff970 con 0x56418be2f6b0 2024-09-17T03:14:04.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c2cbd0740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x56418c2396c0 con 0x56418be50390 2024-09-17T03:14:04.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c2cbd0740 10 client.0 _ll_register_callbacks cb 0x56418c10e780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:04.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c1f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be274d0 0x56418c24ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c1f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be274d0 0x56418c24ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60956/0 (socket says 172.21.15.78:60956) 2024-09-17T03:14:04.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c1f7fe640 1 -- 172.21.15.78:0/2713943256 learned_addr learned my addr 172.21.15.78:0/2713943256 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:04.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c1effd640 1 --2- 172.21.15.78:0/2713943256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be2f6b0 0x56418c24f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c1ffff640 1 --2- 172.21.15.78:0/2713943256 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be50390 0x56418c220fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c1f7fe640 1 -- 172.21.15.78:0/2713943256 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be50390 msgr2=0x56418c220fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c1f7fe640 1 --2- 172.21.15.78:0/2713943256 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be50390 0x56418c220fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c1f7fe640 1 -- 172.21.15.78:0/2713943256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be2f6b0 msgr2=0x56418c24f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c1f7fe640 1 --2- 172.21.15.78:0/2713943256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be2f6b0 0x56418c24f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c1f7fe640 1 -- 172.21.15.78:0/2713943256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56418bebb970 con 0x56418be274d0 2024-09-17T03:14:04.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c1f7fe640 1 --2- 172.21.15.78:0/2713943256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be274d0 0x56418c24ed60 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f5c10099d40 tx=0x7f5c10063120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83ad8aebde6a7b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:04.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5bfe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:04.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5bfe7fc640 1 -- 172.21.15.78:0/2713943256 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c10063530 con 0x56418be274d0 2024-09-17T03:14:04.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5bfe7fc640 1 -- 172.21.15.78:0/2713943256 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f5c1005ee80 con 0x56418be274d0 2024-09-17T03:14:04.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/2713943256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c10067f60 con 0x56418be274d0 2024-09-17T03:14:04.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5bfe7fc640 1 -- 172.21.15.78:0/2713943256 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f5c10074050 con 0x56418be274d0 2024-09-17T03:14:04.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c2cbd0740 10 client.7722 fetch_fsmap learned FSMap version 83 2024-09-17T03:14:04.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.602+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/2713943256 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x56418be996a0 con 0x56418be274d0 2024-09-17T03:14:04.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.603+0000 7f5bfe7fc640 1 -- 172.21.15.78:0/2713943256 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c1006f020 con 0x56418be274d0 2024-09-17T03:14:04.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.603+0000 7f5bfe7fc640 1 -- 172.21.15.78:0/2713943256 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 83) ==== 3554+0+0 (secure 0 0 0) 0x7f5c10077020 con 0x56418be274d0 2024-09-17T03:14:04.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.603+0000 7f5c2cbd0740 10 client.7722 fetch_fsmap finished waiting for FSMap version 83 2024-09-17T03:14:04.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.603+0000 7f5c2cbd0740 10 client.7722 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.c 2024-09-17T03:14:04.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.603+0000 7f5c2cbd0740 20 client.7722 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:04.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.603+0000 7f5c2cbd0740 1 --2- 172.21.15.78:0/2713943256 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x56418be0ef60 0x56418c238380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.603+0000 7f5c2cbd0740 4 client.7722 mds_command: new command op to 7425 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:14:04.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.603+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/2713943256 --> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56418c16c9b0 con 0x56418be0ef60 2024-09-17T03:14:04.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.603+0000 7f5c1effd640 1 --2- 172.21.15.78:0/2713943256 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x56418be0ef60 0x56418c238380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.603+0000 7f5c1effd640 1 --2- 172.21.15.78:0/2713943256 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x56418be0ef60 0x56418c238380 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ae25c7002bc345d2 server_cookie=16e4b30da5bd0a3 in_seq=0 out_seq=0 2024-09-17T03:14:04.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.603+0000 7f5bfe7fc640 10 client.7722 ms_handle_connect on v2:172.21.15.78:6834/4018023271 2024-09-17T03:14:04.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.604+0000 7f5bfe7fc640 1 -- 172.21.15.78:0/2713943256 <== mds.1 v2:172.21.15.78:6834/4018023271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56418c16c9b0 con 0x56418be0ef60 2024-09-17T03:14:04.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.604+0000 7f5bfe7fc640 10 client.7722 handle_command_reply: tid=0 2024-09-17T03:14:04.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.604+0000 7f5c2cbd0740 1 client.7722 shutdown 2024-09-17T03:14:04.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.604+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/2713943256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be274d0 msgr2=0x56418c24ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.604+0000 7f5c2cbd0740 1 --2- 172.21.15.78:0/2713943256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be274d0 0x56418c24ed60 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f5c10099d40 tx=0x7f5c10063120 comp rx=0 tx=0).stop 2024-09-17T03:14:04.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.604+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/2713943256 shutdown_connections 2024-09-17T03:14:04.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.604+0000 7f5c2cbd0740 1 --2- 172.21.15.78:0/2713943256 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x56418be0ef60 0x56418c238380 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.604+0000 7f5c2cbd0740 1 --2- 172.21.15.78:0/2713943256 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be50390 0x56418c220fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.604+0000 7f5bfe7fc640 0 client.7722 ms_handle_reset on v2:172.21.15.78:6834/4018023271 2024-09-17T03:14:04.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.604+0000 7f5c2cbd0740 1 --2- 172.21.15.78:0/2713943256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be2f6b0 0x56418c24f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.604+0000 7f5c2cbd0740 1 --2- 172.21.15.78:0/2713943256 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be274d0 0x56418c24ed60 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.604+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/2713943256 >> 172.21.15.78:0/2713943256 conn(0x56418be444e0 msgr2=0x56418c23ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:04.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.604+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/2713943256 shutdown_connections 2024-09-17T03:14:04.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.604+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/2713943256 wait complete. 2024-09-17T03:14:04.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.604+0000 7f5c2cbd0740 20 client.7722 trim_cache size 0 max 16384 2024-09-17T03:14:04.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.619+0000 7f5c2cbd0740 1 Processor -- start 2024-09-17T03:14:04.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.619+0000 7f5c2cbd0740 1 -- start start 2024-09-17T03:14:04.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.620+0000 7f5c2cbd0740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be274d0 0x56418c25e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.620+0000 7f5c2cbd0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be2f6b0 0x56418c24e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.620+0000 7f5c2cbd0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be50390 0x56418c24ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.620+0000 7f5c2cbd0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5c202000f0 con 0x56418be2f6b0 2024-09-17T03:14:04.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.620+0000 7f5c2cbd0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5c201f7f40 con 0x56418be50390 2024-09-17T03:14:04.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.620+0000 7f5c2cbd0740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5c201ff9c0 con 0x56418be274d0 2024-09-17T03:14:04.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.621+0000 7f5c1effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be2f6b0 0x56418c24e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.621+0000 7f5c1effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be2f6b0 0x56418c24e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60958/0 (socket says 172.21.15.78:60958) 2024-09-17T03:14:04.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.621+0000 7f5c1effd640 1 -- 172.21.15.78:0/565082175 learned_addr learned my addr 172.21.15.78:0/565082175 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:04.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.621+0000 7f5c1f7fe640 1 --2- 172.21.15.78:0/565082175 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be274d0 0x56418c25e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.621+0000 7f5c1ffff640 1 --2- 172.21.15.78:0/565082175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be50390 0x56418c24ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.621+0000 7f5c1effd640 1 -- 172.21.15.78:0/565082175 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be274d0 msgr2=0x56418c25e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.621+0000 7f5c1effd640 1 --2- 172.21.15.78:0/565082175 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be274d0 0x56418c25e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.621+0000 7f5c1effd640 1 -- 172.21.15.78:0/565082175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be50390 msgr2=0x56418c24ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.621+0000 7f5c1effd640 1 --2- 172.21.15.78:0/565082175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be50390 0x56418c24ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.621+0000 7f5c1effd640 1 -- 172.21.15.78:0/565082175 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56418c1f4860 con 0x56418be2f6b0 2024-09-17T03:14:04.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.621+0000 7f5c1ffff640 1 --2- 172.21.15.78:0/565082175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be50390 0x56418c24ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:04.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.621+0000 7f5c1f7fe640 1 --2- 172.21.15.78:0/565082175 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be274d0 0x56418c25e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:04.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.621+0000 7f5c1effd640 1 --2- 172.21.15.78:0/565082175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be2f6b0 0x56418c24e8e0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f5c14007c80 tx=0x7f5c14014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24798d6abebbc28 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:04.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.621+0000 7f5c04ff9640 1 -- 172.21.15.78:0/565082175 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c1401b040 con 0x56418be2f6b0 2024-09-17T03:14:04.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.621+0000 7f5c04ff9640 1 -- 172.21.15.78:0/565082175 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c1401c040 con 0x56418be2f6b0 2024-09-17T03:14:04.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.621+0000 7f5c04ff9640 1 -- 172.21.15.78:0/565082175 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c14014db0 con 0x56418be2f6b0 2024-09-17T03:14:04.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.622+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/565082175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be2f6b0 msgr2=0x56418c24e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.622+0000 7f5c2cbd0740 1 --2- 172.21.15.78:0/565082175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be2f6b0 0x56418c24e8e0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f5c14007c80 tx=0x7f5c14014000 comp rx=0 tx=0).stop 2024-09-17T03:14:04.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.622+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/565082175 shutdown_connections 2024-09-17T03:14:04.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.622+0000 7f5c2cbd0740 1 --2- 172.21.15.78:0/565082175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be50390 0x56418c24ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.622+0000 7f5c2cbd0740 1 --2- 172.21.15.78:0/565082175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be2f6b0 0x56418c24e8e0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.622+0000 7f5c2cbd0740 1 --2- 172.21.15.78:0/565082175 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be274d0 0x56418c25e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.622+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/565082175 >> 172.21.15.78:0/565082175 conn(0x56418be444e0 msgr2=0x56418c21e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:04.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.622+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/565082175 shutdown_connections 2024-09-17T03:14:04.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.622+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/565082175 wait complete. 2024-09-17T03:14:04.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.623+0000 7f5c2cbd0740 1 -- start start 2024-09-17T03:14:04.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.623+0000 7f5c2cbd0740 1 Processor -- start 2024-09-17T03:14:04.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.624+0000 7f5c2cbd0740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be274d0 0x56418c2bcd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.624+0000 7f5c2cbd0740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be2f6b0 0x56418c1f0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.624+0000 7f5c2cbd0740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be50390 0x56418c24e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.624+0000 7f5c2cbd0740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5c20153de0 con 0x56418be274d0 2024-09-17T03:14:04.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.624+0000 7f5c2cbd0740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56418c236410 con 0x56418be50390 2024-09-17T03:14:04.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.624+0000 7f5c2cbd0740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x56418c1f1ad0 con 0x56418be2f6b0 2024-09-17T03:14:04.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.624+0000 7f5c2cbd0740 10 client.0 _ll_register_callbacks cb 0x7f5c140013e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:04.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.624+0000 7f5c1f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be274d0 0x56418c2bcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.625+0000 7f5c1f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be274d0 0x56418c2bcd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60960/0 (socket says 172.21.15.78:60960) 2024-09-17T03:14:04.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.625+0000 7f5c1f7fe640 1 -- 172.21.15.78:0/845888362 learned_addr learned my addr 172.21.15.78:0/845888362 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:04.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.625+0000 7f5c1f7fe640 1 -- 172.21.15.78:0/845888362 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be2f6b0 msgr2=0x56418c1f0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.625+0000 7f5c1effd640 1 --2- 172.21.15.78:0/845888362 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be2f6b0 0x56418c1f0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.625+0000 7f5c1f7fe640 1 --2- 172.21.15.78:0/845888362 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be2f6b0 0x56418c1f0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.625+0000 7f5c1ffff640 1 --2- 172.21.15.78:0/845888362 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be50390 0x56418c24e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.625+0000 7f5c1f7fe640 1 -- 172.21.15.78:0/845888362 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be50390 msgr2=0x56418c24e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.625+0000 7f5c1f7fe640 1 --2- 172.21.15.78:0/845888362 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be50390 0x56418c24e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.625+0000 7f5c1f7fe640 1 -- 172.21.15.78:0/845888362 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56418c2bd270 con 0x56418be274d0 2024-09-17T03:14:04.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.625+0000 7f5c1f7fe640 1 --2- 172.21.15.78:0/845888362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be274d0 0x56418c2bcd30 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f5c1006d060 tx=0x7f5c1005f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce2579bec42e8d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:04.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.625+0000 7f5bfe7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:04.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.625+0000 7f5bfe7fc640 1 -- 172.21.15.78:0/845888362 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c10062ca0 con 0x56418be274d0 2024-09-17T03:14:04.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.625+0000 7f5bfe7fc640 1 -- 172.21.15.78:0/845888362 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f5c10062400 con 0x56418be274d0 2024-09-17T03:14:04.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.625+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/845888362 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c1401c040 con 0x56418be274d0 2024-09-17T03:14:04.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.625+0000 7f5bfe7fc640 1 -- 172.21.15.78:0/845888362 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f5c10063530 con 0x56418be274d0 2024-09-17T03:14:04.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.625+0000 7f5c2cbd0740 10 client.7728 fetch_fsmap learned FSMap version 83 2024-09-17T03:14:04.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.625+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/845888362 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x56418c2c37f0 con 0x56418be274d0 2024-09-17T03:14:04.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.625+0000 7f5bfe7fc640 1 -- 172.21.15.78:0/845888362 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c1401c040 con 0x56418be274d0 2024-09-17T03:14:04.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.625+0000 7f5bfe7fc640 1 -- 172.21.15.78:0/845888362 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 83) ==== 3554+0+0 (secure 0 0 0) 0x7f5c10077040 con 0x56418be274d0 2024-09-17T03:14:04.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.626+0000 7f5c2cbd0740 10 client.7728 fetch_fsmap finished waiting for FSMap version 83 2024-09-17T03:14:04.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.626+0000 7f5c2cbd0740 10 client.7728 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.c 2024-09-17T03:14:04.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.626+0000 7f5c2cbd0740 20 client.7728 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:04.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.626+0000 7f5c2cbd0740 1 --2- 172.21.15.78:0/845888362 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x56418c24ee20 0x56418c2bf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.626+0000 7f5c2cbd0740 4 client.7728 mds_command: new command op to 7425 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T03:14:04.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.626+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/845888362 --> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56418c168460 con 0x56418c24ee20 2024-09-17T03:14:04.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.626+0000 7f5c1effd640 1 --2- 172.21.15.78:0/845888362 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x56418c24ee20 0x56418c2bf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.626+0000 7f5bfe7fc640 10 client.7728 ms_handle_connect on v2:172.21.15.78:6834/4018023271 2024-09-17T03:14:04.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.626+0000 7f5c1effd640 1 --2- 172.21.15.78:0/845888362 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x56418c24ee20 0x56418c2bf8c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=92e4e1f215ca882c server_cookie=321e6e8a8f5d8a3e in_seq=0 out_seq=0 2024-09-17T03:14:04.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.633+0000 7f5bfe7fc640 1 -- 172.21.15.78:0/845888362 <== mds.1 v2:172.21.15.78:6834/4018023271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56418c168460 con 0x56418c24ee20 2024-09-17T03:14:04.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.633+0000 7f5bfe7fc640 10 client.7728 handle_command_reply: tid=0 2024-09-17T03:14:04.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.633+0000 7f5c2cbd0740 1 client.7728 shutdown 2024-09-17T03:14:04.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.634+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/845888362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be274d0 msgr2=0x56418c2bcd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.634+0000 7f5c2cbd0740 1 --2- 172.21.15.78:0/845888362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be274d0 0x56418c2bcd30 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f5c1006d060 tx=0x7f5c1005f0f0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.634+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/845888362 shutdown_connections 2024-09-17T03:14:04.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.634+0000 7f5c2cbd0740 1 --2- 172.21.15.78:0/845888362 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x56418c24ee20 0x56418c2bf8c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.634+0000 7f5c2cbd0740 1 --2- 172.21.15.78:0/845888362 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56418be50390 0x56418c24e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.634+0000 7f5bfe7fc640 0 client.7728 ms_handle_reset on v2:172.21.15.78:6834/4018023271 2024-09-17T03:14:04.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.634+0000 7f5c2cbd0740 1 --2- 172.21.15.78:0/845888362 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56418be2f6b0 0x56418c1f0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.634+0000 7f5c2cbd0740 1 --2- 172.21.15.78:0/845888362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56418be274d0 0x56418c2bcd30 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.634+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/845888362 >> 172.21.15.78:0/845888362 conn(0x56418be444e0 msgr2=0x56418c21f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:04.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.634+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/845888362 shutdown_connections 2024-09-17T03:14:04.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.634+0000 7f5c2cbd0740 1 -- 172.21.15.78:0/845888362 wait complete. 2024-09-17T03:14:04.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.634+0000 7f5c2cbd0740 20 client.7728 trim_cache size 0 max 16384 2024-09-17T03:14:04.647 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:14:04.648 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:14:04.648 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:14:04.648 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:14:04.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.635+0000 7f5c25b89640 1 -- 172.21.15.78:0/3553076781 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5c0c078b90 msgr2=0x7f5c0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.635+0000 7f5c25b89640 1 --2- 172.21.15.78:0/3553076781 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5c0c078b90 0x7f5c0c07b0a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5c20154bb0 tx=0x7f5c14007e90 comp rx=0 tx=0).stop 2024-09-17T03:14:04.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.635+0000 7f5c25b89640 1 -- 172.21.15.78:0/3553076781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c200cf3f0 msgr2=0x7f5c201522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.635+0000 7f5c25b89640 1 --2- 172.21.15.78:0/3553076781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c200cf3f0 0x7f5c201522f0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f5c1000e9f0 tx=0x7f5c1000eeb0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.635+0000 7f5c25b89640 1 -- 172.21.15.78:0/3553076781 shutdown_connections 2024-09-17T03:14:04.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.635+0000 7f5c25b89640 1 --2- 172.21.15.78:0/3553076781 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5c0c078b90 0x7f5c0c07b0a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.635+0000 7f5c25b89640 1 --2- 172.21.15.78:0/3553076781 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c20160550 0x7f5c2015ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.635+0000 7f5c25b89640 1 --2- 172.21.15.78:0/3553076781 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c200d16f0 0x7f5c200cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.635+0000 7f5c25b89640 1 --2- 172.21.15.78:0/3553076781 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c200cf3f0 0x7f5c201522f0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.635+0000 7f5c25b89640 1 -- 172.21.15.78:0/3553076781 >> 172.21.15.78:0/3553076781 conn(0x7f5c2006d5d0 msgr2=0x7f5c200d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:04.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.635+0000 7f5c25b89640 1 -- 172.21.15.78:0/3553076781 shutdown_connections 2024-09-17T03:14:04.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.635+0000 7f5c25b89640 1 -- 172.21.15.78:0/3553076781 wait complete. 2024-09-17T03:14:04.652 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:2 flush journal 2024-09-17T03:14:04.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.767+0000 7ffb2d007640 1 -- 172.21.15.78:0/1847636683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb2806e170 msgr2=0x7ffb280b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.767+0000 7ffb2d007640 1 --2- 172.21.15.78:0/1847636683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb2806e170 0x7ffb280b3540 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7ffb280ba570 tx=0x7ffb1802a4f0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.767+0000 7ffb2d007640 1 -- 172.21.15.78:0/1847636683 shutdown_connections 2024-09-17T03:14:04.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.767+0000 7ffb2d007640 1 --2- 172.21.15.78:0/1847636683 >> v2:172.21.15.193:3300/0 conn(0x7ffb2806f4b0 0x7ffb280d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.767+0000 7ffb2d007640 1 --2- 172.21.15.78:0/1847636683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb2806e170 0x7ffb280b3540 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.767+0000 7ffb2d007640 1 -- 172.21.15.78:0/1847636683 >> 172.21.15.78:0/1847636683 conn(0x7ffb2808bfc0 msgr2=0x7ffb2809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:04.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.767+0000 7ffb2d007640 1 -- 172.21.15.78:0/1847636683 shutdown_connections 2024-09-17T03:14:04.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.767+0000 7ffb2d007640 1 -- 172.21.15.78:0/1847636683 wait complete. 2024-09-17T03:14:04.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.769+0000 7ffb2d007640 1 Processor -- start 2024-09-17T03:14:04.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.769+0000 7ffb2d007640 1 -- start start 2024-09-17T03:14:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.771+0000 7ffb2d007640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffb2806f4b0 0x7ffb280cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.771+0000 7ffb2d007640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb280d3870 0x7ffb280ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.771+0000 7ffb2d007640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb2815e850 0x7ffb281ea780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.771+0000 7ffb2d007640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ffb280d0ce0 con 0x7ffb2815e850 2024-09-17T03:14:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.771+0000 7ffb2d007640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffb280cf4e0 con 0x7ffb280d3870 2024-09-17T03:14:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.771+0000 7ffb2d007640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ffb280d0e60 con 0x7ffb2806f4b0 2024-09-17T03:14:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.771+0000 7ffb2759e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb2815e850 0x7ffb281ea780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.771+0000 7ffb1e59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb280d3870 0x7ffb280ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.771+0000 7ffb2759e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb2815e850 0x7ffb281ea780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60990/0 (socket says 172.21.15.78:60990) 2024-09-17T03:14:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.771+0000 7ffb2759e640 1 -- 172.21.15.78:0/1291763503 learned_addr learned my addr 172.21.15.78:0/1291763503 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:04.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.771+0000 7ffb26d9d640 1 --2- 172.21.15.78:0/1291763503 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffb2806f4b0 0x7ffb280cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.771+0000 7ffb2759e640 1 -- 172.21.15.78:0/1291763503 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffb2806f4b0 msgr2=0x7ffb280cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.771+0000 7ffb2759e640 1 --2- 172.21.15.78:0/1291763503 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffb2806f4b0 0x7ffb280cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.771+0000 7ffb2759e640 1 -- 172.21.15.78:0/1291763503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb280d3870 msgr2=0x7ffb280ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.771+0000 7ffb2759e640 1 --2- 172.21.15.78:0/1291763503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb280d3870 0x7ffb280ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.771+0000 7ffb2759e640 1 -- 172.21.15.78:0/1291763503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb280cac50 con 0x7ffb2815e850 2024-09-17T03:14:04.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.771+0000 7ffb2759e640 1 --2- 172.21.15.78:0/1291763503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb2815e850 0x7ffb281ea780 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000b9e0 tx=0x7ffb2000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:04.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.771+0000 7ffb1ffff640 1 -- 172.21.15.78:0/1291763503 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20003b70 con 0x7ffb2815e850 2024-09-17T03:14:04.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.771+0000 7ffb1ffff640 1 -- 172.21.15.78:0/1291763503 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb20003e00 con 0x7ffb2815e850 2024-09-17T03:14:04.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.771+0000 7ffb1ffff640 1 -- 172.21.15.78:0/1291763503 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2000cb80 con 0x7ffb2815e850 2024-09-17T03:14:04.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.772+0000 7ffb2d007640 1 -- 172.21.15.78:0/1291763503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb280cbcc0 con 0x7ffb2815e850 2024-09-17T03:14:04.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.772+0000 7ffb2d007640 1 -- 172.21.15.78:0/1291763503 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb280c8510 con 0x7ffb2815e850 2024-09-17T03:14:04.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.773+0000 7ffb1ffff640 1 -- 172.21.15.78:0/1291763503 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffb20004000 con 0x7ffb2815e850 2024-09-17T03:14:04.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.774+0000 7ffb1ffff640 1 --2- 172.21.15.78:0/1291763503 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ffb08078b90 0x7ffb0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.774+0000 7ffb1ffff640 1 -- 172.21.15.78:0/1291763503 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7ffb2009aa30 con 0x7ffb2815e850 2024-09-17T03:14:04.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.774+0000 7ffb26d9d640 1 --2- 172.21.15.78:0/1291763503 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ffb08078b90 0x7ffb0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.775+0000 7ffb3404e740 1 Processor -- start 2024-09-17T03:14:04.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.775+0000 7ffb26d9d640 1 --2- 172.21.15.78:0/1291763503 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ffb08078b90 0x7ffb0807b0a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ffb18033000 tx=0x7ffb18004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:04.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.775+0000 7ffb3404e740 1 -- start start 2024-09-17T03:14:04.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.776+0000 7ffb3404e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7fb390 0x5584cebe7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.776+0000 7ffb3404e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7d24d0 0x5584cebbc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.776+0000 7ffb3404e740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7da6b0 0x5584cebbcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.776+0000 7ffb3404e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5584ceb15a60 con 0x5584ce7d24d0 2024-09-17T03:14:04.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.776+0000 7ffb3404e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5584ceb04e90 con 0x5584ce7fb390 2024-09-17T03:14:04.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.776+0000 7ffb3404e740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5584ceb08ca0 con 0x5584ce7da6b0 2024-09-17T03:14:04.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.776+0000 7ffb1e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7d24d0 0x5584cebbc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.776+0000 7ffb1e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7d24d0 0x5584cebbc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60996/0 (socket says 172.21.15.78:60996) 2024-09-17T03:14:04.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.776+0000 7ffb1e59c640 1 -- 172.21.15.78:0/2376412829 learned_addr learned my addr 172.21.15.78:0/2376412829 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:04.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.776+0000 7ffb26d9d640 1 --2- 172.21.15.78:0/2376412829 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7fb390 0x5584cebe7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.776+0000 7ffb2759e640 1 --2- 172.21.15.78:0/2376412829 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7da6b0 0x5584cebbcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.776+0000 7ffb1e59c640 1 -- 172.21.15.78:0/2376412829 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7da6b0 msgr2=0x5584cebbcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.776+0000 7ffb1e59c640 1 --2- 172.21.15.78:0/2376412829 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7da6b0 0x5584cebbcda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.776+0000 7ffb1e59c640 1 -- 172.21.15.78:0/2376412829 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7fb390 msgr2=0x5584cebe7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.776+0000 7ffb1e59c640 1 --2- 172.21.15.78:0/2376412829 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7fb390 0x5584cebe7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.776+0000 7ffb1e59c640 1 -- 172.21.15.78:0/2376412829 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584ce8dd7d0 con 0x5584ce7d24d0 2024-09-17T03:14:04.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.777+0000 7ffb1e59c640 1 --2- 172.21.15.78:0/2376412829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7d24d0 0x5584cebbc860 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000ab50 tx=0x7ffb1000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f3e466f4637d79 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:04.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.777+0000 7ffb1cd99640 1 -- 172.21.15.78:0/2376412829 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10005220 con 0x5584ce7d24d0 2024-09-17T03:14:04.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.777+0000 7ffb1cd99640 1 -- 172.21.15.78:0/2376412829 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb1000ae50 con 0x5584ce7d24d0 2024-09-17T03:14:04.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.777+0000 7ffb1cd99640 1 -- 172.21.15.78:0/2376412829 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb100047a0 con 0x5584ce7d24d0 2024-09-17T03:14:04.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.778+0000 7ffb3404e740 1 -- 172.21.15.78:0/2376412829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7d24d0 msgr2=0x5584cebbc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.778+0000 7ffb3404e740 1 --2- 172.21.15.78:0/2376412829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7d24d0 0x5584cebbc860 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000ab50 tx=0x7ffb1000f790 comp rx=0 tx=0).stop 2024-09-17T03:14:04.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.778+0000 7ffb3404e740 1 -- 172.21.15.78:0/2376412829 shutdown_connections 2024-09-17T03:14:04.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.778+0000 7ffb3404e740 1 --2- 172.21.15.78:0/2376412829 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7da6b0 0x5584cebbcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.778+0000 7ffb3404e740 1 --2- 172.21.15.78:0/2376412829 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7d24d0 0x5584cebbc860 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.778+0000 7ffb3404e740 1 --2- 172.21.15.78:0/2376412829 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7fb390 0x5584cebe7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.778+0000 7ffb3404e740 1 -- 172.21.15.78:0/2376412829 >> 172.21.15.78:0/2376412829 conn(0x5584ce7ef4e0 msgr2=0x5584ceba2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:04.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.778+0000 7ffb3404e740 1 -- 172.21.15.78:0/2376412829 shutdown_connections 2024-09-17T03:14:04.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.778+0000 7ffb3404e740 1 -- 172.21.15.78:0/2376412829 wait complete. 2024-09-17T03:14:04.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.779+0000 7ffb3404e740 1 -- start start 2024-09-17T03:14:04.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.779+0000 7ffb3404e740 1 Processor -- start 2024-09-17T03:14:04.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.780+0000 7ffb3404e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7d24d0 0x5584cebcb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.780+0000 7ffb3404e740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7da6b0 0x5584cebbb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.780+0000 7ffb3404e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7fb390 0x5584cebde990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.780+0000 7ffb3404e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5584ce875740 con 0x5584ce7d24d0 2024-09-17T03:14:04.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.780+0000 7ffb3404e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5584ceaaa970 con 0x5584ce7fb390 2024-09-17T03:14:04.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.780+0000 7ffb3404e740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5584cebe97b0 con 0x5584ce7da6b0 2024-09-17T03:14:04.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.780+0000 7ffb3404e740 10 client.0 _ll_register_callbacks cb 0x5584ceab9780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:04.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.780+0000 7ffb26d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7d24d0 0x5584cebcb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.780+0000 7ffb26d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7d24d0 0x5584cebcb280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32778/0 (socket says 172.21.15.78:32778) 2024-09-17T03:14:04.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.780+0000 7ffb26d9d640 1 -- 172.21.15.78:0/1418550983 learned_addr learned my addr 172.21.15.78:0/1418550983 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:04.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.780+0000 7ffb1e59c640 1 --2- 172.21.15.78:0/1418550983 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7da6b0 0x5584cebbb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.780+0000 7ffb2759e640 1 --2- 172.21.15.78:0/1418550983 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7fb390 0x5584cebde990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.780+0000 7ffb26d9d640 1 -- 172.21.15.78:0/1418550983 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7da6b0 msgr2=0x5584cebbb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.780+0000 7ffb26d9d640 1 --2- 172.21.15.78:0/1418550983 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7da6b0 0x5584cebbb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.780+0000 7ffb26d9d640 1 -- 172.21.15.78:0/1418550983 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7fb390 msgr2=0x5584cebde990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.780+0000 7ffb26d9d640 1 --2- 172.21.15.78:0/1418550983 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7fb390 0x5584cebde990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.780+0000 7ffb26d9d640 1 -- 172.21.15.78:0/1418550983 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584ce866970 con 0x5584ce7d24d0 2024-09-17T03:14:04.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.781+0000 7ffb26d9d640 1 --2- 172.21.15.78:0/1418550983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7d24d0 0x5584cebcb280 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009230 tx=0x7ffb18009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c349bb7731a11f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:04.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.781+0000 7ffb05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:04.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.781+0000 7ffb05ffb640 1 -- 172.21.15.78:0/1418550983 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1804d020 con 0x5584ce7d24d0 2024-09-17T03:14:04.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.781+0000 7ffb05ffb640 1 -- 172.21.15.78:0/1418550983 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7ffb180047a0 con 0x5584ce7d24d0 2024-09-17T03:14:04.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.781+0000 7ffb3404e740 1 -- 172.21.15.78:0/1418550983 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb1000ae50 con 0x5584ce7d24d0 2024-09-17T03:14:04.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.781+0000 7ffb05ffb640 1 -- 172.21.15.78:0/1418550983 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7ffb18057050 con 0x5584ce7d24d0 2024-09-17T03:14:04.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.781+0000 7ffb3404e740 10 client.7740 fetch_fsmap learned FSMap version 83 2024-09-17T03:14:04.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.781+0000 7ffb3404e740 1 -- 172.21.15.78:0/1418550983 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x5584ce8446a0 con 0x5584ce7d24d0 2024-09-17T03:14:04.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.781+0000 7ffb05ffb640 1 -- 172.21.15.78:0/1418550983 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb1000ae50 con 0x5584ce7d24d0 2024-09-17T03:14:04.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.781+0000 7ffb05ffb640 1 -- 172.21.15.78:0/1418550983 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 83) ==== 3554+0+0 (secure 0 0 0) 0x7ffb1805a020 con 0x5584ce7d24d0 2024-09-17T03:14:04.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.781+0000 7ffb3404e740 10 client.7740 fetch_fsmap finished waiting for FSMap version 83 2024-09-17T03:14:04.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.781+0000 7ffb3404e740 10 client.7740 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2024-09-17T03:14:04.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.781+0000 7ffb3404e740 20 client.7740 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:04.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.781+0000 7ffb3404e740 1 --2- 172.21.15.78:0/1418550983 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x5584ce7b9f60 0x5584cebe0a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.781+0000 7ffb3404e740 4 client.7740 mds_command: new command op to 6640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:14:04.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.781+0000 7ffb3404e740 1 -- 172.21.15.78:0/1418550983 --> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584ceb179b0 con 0x5584ce7b9f60 2024-09-17T03:14:04.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.781+0000 7ffb1e59c640 1 --2- 172.21.15.78:0/1418550983 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x5584ce7b9f60 0x5584cebe0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.782+0000 7ffb1e59c640 1 --2- 172.21.15.78:0/1418550983 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x5584ce7b9f60 0x5584cebe0a30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4a6659a5e1772ee6 server_cookie=4eeeb27676539151 in_seq=0 out_seq=0 2024-09-17T03:14:04.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.782+0000 7ffb05ffb640 10 client.7740 ms_handle_connect on v2:172.21.15.193:6835/1005450673 2024-09-17T03:14:04.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.783+0000 7ffb05ffb640 1 -- 172.21.15.78:0/1418550983 <== mds.2 v2:172.21.15.193:6835/1005450673 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5584ceb179b0 con 0x5584ce7b9f60 2024-09-17T03:14:04.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.783+0000 7ffb05ffb640 10 client.7740 handle_command_reply: tid=0 2024-09-17T03:14:04.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.783+0000 7ffb3404e740 1 client.7740 shutdown 2024-09-17T03:14:04.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.783+0000 7ffb3404e740 1 -- 172.21.15.78:0/1418550983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7d24d0 msgr2=0x5584cebcb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.783+0000 7ffb3404e740 1 --2- 172.21.15.78:0/1418550983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7d24d0 0x5584cebcb280 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009230 tx=0x7ffb18009260 comp rx=0 tx=0).stop 2024-09-17T03:14:04.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.783+0000 7ffb3404e740 1 -- 172.21.15.78:0/1418550983 shutdown_connections 2024-09-17T03:14:04.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.783+0000 7ffb3404e740 1 --2- 172.21.15.78:0/1418550983 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x5584ce7b9f60 0x5584cebe0a30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.783+0000 7ffb3404e740 1 --2- 172.21.15.78:0/1418550983 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7fb390 0x5584cebde990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.783+0000 7ffb3404e740 1 --2- 172.21.15.78:0/1418550983 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7da6b0 0x5584cebbb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.783+0000 7ffb05ffb640 0 client.7740 ms_handle_reset on v2:172.21.15.193:6835/1005450673 2024-09-17T03:14:04.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.783+0000 7ffb3404e740 1 --2- 172.21.15.78:0/1418550983 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7d24d0 0x5584cebcb280 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.783+0000 7ffb3404e740 1 -- 172.21.15.78:0/1418550983 >> 172.21.15.78:0/1418550983 conn(0x5584ce7ef4e0 msgr2=0x5584ceb9da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:04.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.783+0000 7ffb3404e740 1 -- 172.21.15.78:0/1418550983 shutdown_connections 2024-09-17T03:14:04.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.783+0000 7ffb3404e740 1 -- 172.21.15.78:0/1418550983 wait complete. 2024-09-17T03:14:04.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.783+0000 7ffb3404e740 20 client.7740 trim_cache size 0 max 16384 2024-09-17T03:14:04.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.798+0000 7ffb3404e740 1 Processor -- start 2024-09-17T03:14:04.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.798+0000 7ffb3404e740 1 -- start start 2024-09-17T03:14:04.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.799+0000 7ffb3404e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7b9f60 0x5584cebe1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.799+0000 7ffb3404e740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7d24d0 0x5584cebe2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.799+0000 7ffb3404e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7da6b0 0x5584cebe3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.799+0000 7ffb3404e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ffb282023b0 con 0x5584ce7da6b0 2024-09-17T03:14:04.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.799+0000 7ffb3404e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28201580 con 0x5584ce7b9f60 2024-09-17T03:14:04.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.799+0000 7ffb3404e740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ffb28201c80 con 0x5584ce7d24d0 2024-09-17T03:14:04.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.799+0000 7ffb2759e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7da6b0 0x5584cebe3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.799+0000 7ffb2759e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7da6b0 0x5584cebe3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32786/0 (socket says 172.21.15.78:32786) 2024-09-17T03:14:04.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.799+0000 7ffb2759e640 1 -- 172.21.15.78:0/2680355005 learned_addr learned my addr 172.21.15.78:0/2680355005 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:04.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.799+0000 7ffb26d9d640 1 --2- 172.21.15.78:0/2680355005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7b9f60 0x5584cebe1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.799+0000 7ffb1e59c640 1 --2- 172.21.15.78:0/2680355005 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7d24d0 0x5584cebe2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.799+0000 7ffb2759e640 1 -- 172.21.15.78:0/2680355005 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7d24d0 msgr2=0x5584cebe2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.799+0000 7ffb2759e640 1 --2- 172.21.15.78:0/2680355005 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7d24d0 0x5584cebe2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.799+0000 7ffb2759e640 1 -- 172.21.15.78:0/2680355005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7b9f60 msgr2=0x5584cebe1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.799+0000 7ffb2759e640 1 --2- 172.21.15.78:0/2680355005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7b9f60 0x5584cebe1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.799+0000 7ffb2759e640 1 -- 172.21.15.78:0/2680355005 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584cebbc170 con 0x5584ce7da6b0 2024-09-17T03:14:04.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.799+0000 7ffb26d9d640 1 --2- 172.21.15.78:0/2680355005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7b9f60 0x5584cebe1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:04.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.799+0000 7ffb1e59c640 1 --2- 172.21.15.78:0/2680355005 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7d24d0 0x5584cebe2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:04.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.800+0000 7ffb2759e640 1 --2- 172.21.15.78:0/2680355005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7da6b0 0x5584cebe3b80 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7ffb200626b0 tx=0x7ffb2005f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639a9c4568aa295b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:04.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.800+0000 7ffb07fff640 1 -- 172.21.15.78:0/2680355005 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20088070 con 0x5584ce7da6b0 2024-09-17T03:14:04.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.800+0000 7ffb07fff640 1 -- 172.21.15.78:0/2680355005 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb200673e0 con 0x5584ce7da6b0 2024-09-17T03:14:04.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.800+0000 7ffb07fff640 1 -- 172.21.15.78:0/2680355005 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2006c220 con 0x5584ce7da6b0 2024-09-17T03:14:04.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.800+0000 7ffb3404e740 1 -- 172.21.15.78:0/2680355005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7da6b0 msgr2=0x5584cebe3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.800+0000 7ffb3404e740 1 --2- 172.21.15.78:0/2680355005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7da6b0 0x5584cebe3b80 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7ffb200626b0 tx=0x7ffb2005f100 comp rx=0 tx=0).stop 2024-09-17T03:14:04.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.800+0000 7ffb3404e740 1 -- 172.21.15.78:0/2680355005 shutdown_connections 2024-09-17T03:14:04.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.800+0000 7ffb3404e740 1 --2- 172.21.15.78:0/2680355005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7da6b0 0x5584cebe3b80 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.800+0000 7ffb3404e740 1 --2- 172.21.15.78:0/2680355005 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7d24d0 0x5584cebe2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.800+0000 7ffb3404e740 1 --2- 172.21.15.78:0/2680355005 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7b9f60 0x5584cebe1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.800+0000 7ffb3404e740 1 -- 172.21.15.78:0/2680355005 >> 172.21.15.78:0/2680355005 conn(0x5584ce7ef4e0 msgr2=0x5584cebf95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:04.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.800+0000 7ffb3404e740 1 -- 172.21.15.78:0/2680355005 shutdown_connections 2024-09-17T03:14:04.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.800+0000 7ffb3404e740 1 -- 172.21.15.78:0/2680355005 wait complete. 2024-09-17T03:14:04.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.801+0000 7ffb3404e740 1 -- start start 2024-09-17T03:14:04.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.801+0000 7ffb3404e740 1 Processor -- start 2024-09-17T03:14:04.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb3404e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7b9f60 0x5584cec60990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb3404e740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7d24d0 0x5584cec092d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb3404e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7da6b0 0x5584cec09810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb3404e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ffb280b16b0 con 0x5584ce7da6b0 2024-09-17T03:14:04.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb3404e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5584cebe7f20 con 0x5584ce7b9f60 2024-09-17T03:14:04.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb3404e740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5584cebb8820 con 0x5584ce7d24d0 2024-09-17T03:14:04.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb3404e740 10 client.0 _ll_register_callbacks cb 0x7ffb180056a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:04.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb2759e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7da6b0 0x5584cec09810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb26d9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7b9f60 0x5584cec60990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb2759e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7da6b0 0x5584cec09810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32788/0 (socket says 172.21.15.78:32788) 2024-09-17T03:14:04.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb2759e640 1 -- 172.21.15.78:0/2414164143 learned_addr learned my addr 172.21.15.78:0/2414164143 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:04.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb1e59c640 1 --2- 172.21.15.78:0/2414164143 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7d24d0 0x5584cec092d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb2759e640 1 -- 172.21.15.78:0/2414164143 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7d24d0 msgr2=0x5584cec092d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb2759e640 1 --2- 172.21.15.78:0/2414164143 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7d24d0 0x5584cec092d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb2759e640 1 -- 172.21.15.78:0/2414164143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7b9f60 msgr2=0x5584cec60990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:04.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb2759e640 1 --2- 172.21.15.78:0/2414164143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7b9f60 0x5584cec60990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb2759e640 1 -- 172.21.15.78:0/2414164143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584cebdd980 con 0x5584ce7da6b0 2024-09-17T03:14:04.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb26d9d640 1 --2- 172.21.15.78:0/2414164143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7b9f60 0x5584cec60990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:14:04.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb2759e640 1 --2- 172.21.15.78:0/2414164143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7da6b0 0x5584cec09810 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7ffb20013000 tx=0x7ffb2005f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57597e3b0b780e40 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:04.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:04.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb05ffb640 1 -- 172.21.15.78:0/2414164143 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20081060 con 0x5584ce7da6b0 2024-09-17T03:14:04.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb05ffb640 1 -- 172.21.15.78:0/2414164143 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7ffb2006bd90 con 0x5584ce7da6b0 2024-09-17T03:14:04.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb3404e740 1 -- 172.21.15.78:0/2414164143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb200673e0 con 0x5584ce7da6b0 2024-09-17T03:14:04.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.803+0000 7ffb05ffb640 1 -- 172.21.15.78:0/2414164143 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7ffb20088070 con 0x5584ce7da6b0 2024-09-17T03:14:04.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.804+0000 7ffb3404e740 10 client.7746 fetch_fsmap learned FSMap version 83 2024-09-17T03:14:04.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.804+0000 7ffb3404e740 1 -- 172.21.15.78:0/2414164143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x5584cec0a540 con 0x5584ce7da6b0 2024-09-17T03:14:04.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.804+0000 7ffb05ffb640 1 -- 172.21.15.78:0/2414164143 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb200673e0 con 0x5584ce7da6b0 2024-09-17T03:14:04.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.804+0000 7ffb05ffb640 1 -- 172.21.15.78:0/2414164143 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 83) ==== 3554+0+0 (secure 0 0 0) 0x7ffb20061c10 con 0x5584ce7da6b0 2024-09-17T03:14:04.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.804+0000 7ffb3404e740 10 client.7746 fetch_fsmap finished waiting for FSMap version 83 2024-09-17T03:14:04.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.804+0000 7ffb3404e740 10 client.7746 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2024-09-17T03:14:04.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.804+0000 7ffb3404e740 20 client.7746 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:04.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.804+0000 7ffb3404e740 1 --2- 172.21.15.78:0/2414164143 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x5584ce78f3a0 0x5584cec69f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:04.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.804+0000 7ffb3404e740 4 client.7746 mds_command: new command op to 6640 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T03:14:04.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.804+0000 7ffb3404e740 1 -- 172.21.15.78:0/2414164143 --> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5584ceb13460 con 0x5584ce78f3a0 2024-09-17T03:14:04.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.804+0000 7ffb26d9d640 1 --2- 172.21.15.78:0/2414164143 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x5584ce78f3a0 0x5584cec69f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:04.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.804+0000 7ffb05ffb640 10 client.7746 ms_handle_connect on v2:172.21.15.193:6835/1005450673 2024-09-17T03:14:04.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.804+0000 7ffb26d9d640 1 --2- 172.21.15.78:0/2414164143 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x5584ce78f3a0 0x5584cec69f30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a65d00692e1a9130 server_cookie=880607d467c257ff in_seq=0 out_seq=0 2024-09-17T03:14:04.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.813+0000 7ffb05ffb640 1 -- 172.21.15.78:0/2414164143 <== mds.2 v2:172.21.15.193:6835/1005450673 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5584ceb13460 con 0x5584ce78f3a0 2024-09-17T03:14:04.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.813+0000 7ffb05ffb640 10 client.7746 handle_command_reply: tid=0 2024-09-17T03:14:04.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.813+0000 7ffb3404e740 1 client.7746 shutdown 2024-09-17T03:14:04.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.813+0000 7ffb3404e740 1 -- 172.21.15.78:0/2414164143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7da6b0 msgr2=0x5584cec09810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.813+0000 7ffb3404e740 1 --2- 172.21.15.78:0/2414164143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7da6b0 0x5584cec09810 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7ffb20013000 tx=0x7ffb2005f000 comp rx=0 tx=0).stop 2024-09-17T03:14:04.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.813+0000 7ffb3404e740 1 -- 172.21.15.78:0/2414164143 shutdown_connections 2024-09-17T03:14:04.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.813+0000 7ffb3404e740 1 --2- 172.21.15.78:0/2414164143 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x5584ce78f3a0 0x5584cec69f30 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.813+0000 7ffb3404e740 1 --2- 172.21.15.78:0/2414164143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5584ce7da6b0 0x5584cec09810 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.813+0000 7ffb3404e740 1 --2- 172.21.15.78:0/2414164143 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5584ce7d24d0 0x5584cec092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.813+0000 7ffb05ffb640 0 client.7746 ms_handle_reset on v2:172.21.15.193:6835/1005450673 2024-09-17T03:14:04.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.813+0000 7ffb3404e740 1 --2- 172.21.15.78:0/2414164143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5584ce7b9f60 0x5584cec60990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.813+0000 7ffb3404e740 1 -- 172.21.15.78:0/2414164143 >> 172.21.15.78:0/2414164143 conn(0x5584ce7ef4e0 msgr2=0x5584cebbb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:04.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.813+0000 7ffb3404e740 1 -- 172.21.15.78:0/2414164143 shutdown_connections 2024-09-17T03:14:04.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.813+0000 7ffb3404e740 1 -- 172.21.15.78:0/2414164143 wait complete. 2024-09-17T03:14:04.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.814+0000 7ffb3404e740 20 client.7746 trim_cache size 0 max 16384 2024-09-17T03:14:04.814 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:14:04.814 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:14:04.814 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:14:04.814 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:14:04.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.814+0000 7ffb2d007640 1 -- 172.21.15.78:0/1291763503 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ffb08078b90 msgr2=0x7ffb0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.814+0000 7ffb2d007640 1 --2- 172.21.15.78:0/1291763503 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ffb08078b90 0x7ffb0807b0a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ffb18033000 tx=0x7ffb18004730 comp rx=0 tx=0).stop 2024-09-17T03:14:04.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.814+0000 7ffb2d007640 1 -- 172.21.15.78:0/1291763503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb2815e850 msgr2=0x7ffb281ea780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:04.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.814+0000 7ffb2d007640 1 --2- 172.21.15.78:0/1291763503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb2815e850 0x7ffb281ea780 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000b9e0 tx=0x7ffb2000bea0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.814+0000 7ffb2d007640 1 -- 172.21.15.78:0/1291763503 shutdown_connections 2024-09-17T03:14:04.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.814+0000 7ffb2d007640 1 --2- 172.21.15.78:0/1291763503 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb2815e850 0x7ffb281ea780 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.814+0000 7ffb2d007640 1 --2- 172.21.15.78:0/1291763503 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ffb08078b90 0x7ffb0807b0a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.814+0000 7ffb2d007640 1 --2- 172.21.15.78:0/1291763503 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb280d3870 0x7ffb280ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.814+0000 7ffb2d007640 1 --2- 172.21.15.78:0/1291763503 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffb2806f4b0 0x7ffb280cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:04.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.814+0000 7ffb2d007640 1 -- 172.21.15.78:0/1291763503 >> 172.21.15.78:0/1291763503 conn(0x7ffb2808bfc0 msgr2=0x7ffb280cf660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:04.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.814+0000 7ffb2d007640 1 -- 172.21.15.78:0/1291763503 shutdown_connections 2024-09-17T03:14:04.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04.814+0000 7ffb2d007640 1 -- 172.21.15.78:0/1291763503 wait complete. 2024-09-17T03:14:04.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:04.824 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2024-09-17T03:14:04.846 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/ 2024-09-17T03:14:04.846 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4 2024-09-17T03:14:04.846 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4/d5 2024-09-17T03:14:04.846 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4/d5/d6 2024-09-17T03:14:04.847 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4/d5/d6/d7 2024-09-17T03:14:04.847 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2024-09-17T03:14:04.847 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:14:04.847 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:14:04.847 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:14:04.847 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:14:04.847 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2024-09-17T03:14:04.847 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:14:04.951 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627778 2024-09-17T03:14:04.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:04.961 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:14:04.961 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:14:04.961 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:14:04.961 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:14:04.961 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2024-09-17T03:14:04.961 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:14:05.065 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627779 2024-09-17T03:14:05.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:05.074 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:14:05.074 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:14:05.074 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:14:05.074 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:14:05.074 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2024-09-17T03:14:05.075 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:14:05.179 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627780 2024-09-17T03:14:05.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:05.188 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:14:05.188 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:14:05.188 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:14:05.188 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:14:05.188 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2024-09-17T03:14:05.188 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:14:05.292 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627781 2024-09-17T03:14:05.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:05.301 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:14:05.301 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:14:05.301 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:14:05.301 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:14:05.301 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2024-09-17T03:14:05.301 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:14:05.405 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627782 2024-09-17T03:14:05.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:05.415 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:14:05.415 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:14:05.415 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:14:05.415 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:14:05.415 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2024-09-17T03:14:05.415 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:14:05.519 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627783 2024-09-17T03:14:05.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:05.527 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000002.00000000 parent 2024-09-17T03:14:05.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.624+0000 7f3faef5cf40 1 Processor -- start 2024-09-17T03:14:05.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.624+0000 7f3faef5cf40 1 -- start start 2024-09-17T03:14:05.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3faef5cf40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f940030f0 0x56278c410af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3faef5cf40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56278c39e900 0x56278c39ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3faef5cf40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56278c35cf80 0x56278c35d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3faef5cf40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56278c2acd60 con 0x7f3f940030f0 2024-09-17T03:14:05.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3faef5cf40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56278c30b430 con 0x56278c35cf80 2024-09-17T03:14:05.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3faef5cf40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x56278c39e190 con 0x56278c39e900 2024-09-17T03:14:05.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3fa8a16640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f940030f0 0x56278c410af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3fa8a16640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f940030f0 0x56278c410af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32816/0 (socket says 172.21.15.78:32816) 2024-09-17T03:14:05.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3fa8a16640 1 -- 172.21.15.78:0/3984496648 learned_addr learned my addr 172.21.15.78:0/3984496648 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:05.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3fa0215640 1 --2- 172.21.15.78:0/3984496648 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56278c39e900 0x56278c39ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3fa9217640 1 --2- 172.21.15.78:0/3984496648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56278c35cf80 0x56278c35d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3fa8a16640 1 -- 172.21.15.78:0/3984496648 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56278c39e900 msgr2=0x56278c39ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3fa8a16640 1 --2- 172.21.15.78:0/3984496648 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56278c39e900 0x56278c39ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3fa8a16640 1 -- 172.21.15.78:0/3984496648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56278c35cf80 msgr2=0x56278c35d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3fa8a16640 1 --2- 172.21.15.78:0/3984496648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56278c35cf80 0x56278c35d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3fa8a16640 1 -- 172.21.15.78:0/3984496648 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56278c3a4580 con 0x7f3f940030f0 2024-09-17T03:14:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3fa9217640 1 --2- 172.21.15.78:0/3984496648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56278c35cf80 0x56278c35d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3fa8a16640 1 --2- 172.21.15.78:0/3984496648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f940030f0 0x56278c410af0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800c7f0 tx=0x7f3f98004890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a77c4c0d04eb420 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3fa37fe640 1 -- 172.21.15.78:0/3984496648 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9800a850 con 0x7f3f940030f0 2024-09-17T03:14:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3fa37fe640 1 -- 172.21.15.78:0/3984496648 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f9800a9f0 con 0x7f3f940030f0 2024-09-17T03:14:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.626+0000 7f3fa37fe640 1 -- 172.21.15.78:0/3984496648 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9800adc0 con 0x7f3f940030f0 2024-09-17T03:14:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.627+0000 7f3faef5cf40 1 -- 172.21.15.78:0/3984496648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f940030f0 msgr2=0x56278c410af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.627+0000 7f3faef5cf40 1 --2- 172.21.15.78:0/3984496648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f940030f0 0x56278c410af0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800c7f0 tx=0x7f3f98004890 comp rx=0 tx=0).stop 2024-09-17T03:14:05.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.627+0000 7f3faef5cf40 1 -- 172.21.15.78:0/3984496648 shutdown_connections 2024-09-17T03:14:05.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.627+0000 7f3faef5cf40 1 --2- 172.21.15.78:0/3984496648 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56278c35cf80 0x56278c35d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.627+0000 7f3faef5cf40 1 --2- 172.21.15.78:0/3984496648 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x56278c39e900 0x56278c39ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.627+0000 7f3faef5cf40 1 --2- 172.21.15.78:0/3984496648 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3f940030f0 0x56278c410af0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.627+0000 7f3faef5cf40 1 -- 172.21.15.78:0/3984496648 >> 172.21.15.78:0/3984496648 conn(0x56278c27dac0 msgr2=0x56278c3a2430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:05.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.627+0000 7f3faef5cf40 1 -- 172.21.15.78:0/3984496648 shutdown_connections 2024-09-17T03:14:05.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.627+0000 7f3faef5cf40 1 -- 172.21.15.78:0/3984496648 wait complete. 2024-09-17T03:14:05.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.628+0000 7f3faef5cf40 1 Processor -- start 2024-09-17T03:14:05.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.628+0000 7f3faef5cf40 1 -- start start 2024-09-17T03:14:05.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.629+0000 7f3faef5cf40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56278c35cf80 0x56278c35dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.629+0000 7f3faef5cf40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56278c39e900 0x56278c40c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.629+0000 7f3faef5cf40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3f940030f0 0x56278c40fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.629+0000 7f3faef5cf40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x56278c3a8010 con 0x56278c39e900 2024-09-17T03:14:05.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.629+0000 7f3faef5cf40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56278c416f30 con 0x56278c35cf80 2024-09-17T03:14:05.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.629+0000 7f3faef5cf40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x56278c4130d0 con 0x7f3f940030f0 2024-09-17T03:14:05.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.629+0000 7f3fa0215640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56278c39e900 0x56278c40c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.629+0000 7f3fa0215640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56278c39e900 0x56278c40c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32824/0 (socket says 172.21.15.78:32824) 2024-09-17T03:14:05.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.629+0000 7f3fa0215640 1 -- 172.21.15.78:0/1019300132 learned_addr learned my addr 172.21.15.78:0/1019300132 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:05.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.629+0000 7f3fa8a16640 1 --2- 172.21.15.78:0/1019300132 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56278c35cf80 0x56278c35dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.629+0000 7f3fa9217640 1 --2- 172.21.15.78:0/1019300132 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3f940030f0 0x56278c40fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.630+0000 7f3fa0215640 1 -- 172.21.15.78:0/1019300132 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3f940030f0 msgr2=0x56278c40fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.630+0000 7f3fa0215640 1 --2- 172.21.15.78:0/1019300132 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3f940030f0 0x56278c40fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.630+0000 7f3fa0215640 1 -- 172.21.15.78:0/1019300132 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56278c35cf80 msgr2=0x56278c35dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.630+0000 7f3fa0215640 1 --2- 172.21.15.78:0/1019300132 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56278c35cf80 0x56278c35dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.630+0000 7f3fa0215640 1 -- 172.21.15.78:0/1019300132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56278c411890 con 0x56278c39e900 2024-09-17T03:14:05.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.630+0000 7f3fa0215640 1 --2- 172.21.15.78:0/1019300132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56278c39e900 0x56278c40c6f0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400a480 tx=0x7f3f90009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.630+0000 7f3fa27fc640 1 -- 172.21.15.78:0/1019300132 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f90009790 con 0x56278c39e900 2024-09-17T03:14:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.630+0000 7f3fa27fc640 1 -- 172.21.15.78:0/1019300132 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f9004da70 con 0x56278c39e900 2024-09-17T03:14:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.630+0000 7f3faef5cf40 1 -- 172.21.15.78:0/1019300132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56278c35e020 con 0x56278c39e900 2024-09-17T03:14:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.630+0000 7f3fa27fc640 1 -- 172.21.15.78:0/1019300132 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f90060410 con 0x56278c39e900 2024-09-17T03:14:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.630+0000 7f3faef5cf40 1 -- 172.21.15.78:0/1019300132 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56278c3a5690 con 0x56278c39e900 2024-09-17T03:14:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.632+0000 7f3fa27fc640 1 -- 172.21.15.78:0/1019300132 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3f90053030 con 0x56278c39e900 2024-09-17T03:14:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.632+0000 7f3fa27fc640 1 --2- 172.21.15.78:0/1019300132 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f88077570 0x7f3f88079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.632+0000 7f3fa27fc640 1 -- 172.21.15.78:0/1019300132 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f3f900dd790 con 0x56278c39e900 2024-09-17T03:14:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.632+0000 7f3faef5cf40 1 --2- 172.21.15.78:0/1019300132 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x56278c4122a0 0x56278c4126b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.632+0000 7f3faef5cf40 1 -- 172.21.15.78:0/1019300132 --> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] -- osd_op(unknown.0.0:1 12.12 12:4bec3886:::10000000002.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82) -- 0x56278c4d8530 con 0x56278c4122a0 2024-09-17T03:14:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.633+0000 7f3fa9217640 1 --2- 172.21.15.78:0/1019300132 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x56278c4122a0 0x56278c4126b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.633+0000 7f3fa8a16640 1 --2- 172.21.15.78:0/1019300132 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f88077570 0x7f3f88079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.633+0000 7f3fa9217640 1 --2- 172.21.15.78:0/1019300132 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x56278c4122a0 0x56278c4126b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.633+0000 7f3fa8a16640 1 --2- 172.21.15.78:0/1019300132 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f88077570 0x7f3f88079a80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3f98000c00 tx=0x7f3f98003020 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.634+0000 7f3fa9217640 1 -- 172.21.15.78:0/1019300132 <== osd.3 v2:172.21.15.78:6800/2433795738 1 ==== osd_op_reply(1 10000000002.00000000 [rmxattr] v82'8 uv8 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f3fa400b040 con 0x56278c4122a0 2024-09-17T03:14:05.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.634+0000 7f3faef5cf40 1 -- 172.21.15.78:0/1019300132 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x56278c4122a0 msgr2=0x56278c4126b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.634+0000 7f3faef5cf40 1 --2- 172.21.15.78:0/1019300132 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x56278c4122a0 0x56278c4126b0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.634+0000 7f3faef5cf40 1 -- 172.21.15.78:0/1019300132 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f88077570 msgr2=0x7f3f88079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.634+0000 7f3faef5cf40 1 --2- 172.21.15.78:0/1019300132 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3f88077570 0x7f3f88079a80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3f98000c00 tx=0x7f3f98003020 comp rx=0 tx=0).stop 2024-09-17T03:14:05.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.634+0000 7f3faef5cf40 1 -- 172.21.15.78:0/1019300132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56278c39e900 msgr2=0x56278c40c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.634+0000 7f3faef5cf40 1 --2- 172.21.15.78:0/1019300132 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56278c39e900 0x56278c40c6f0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400a480 tx=0x7f3f90009310 comp rx=0 tx=0).stop 2024-09-17T03:14:05.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.634+0000 7f3fa9217640 1 -- 172.21.15.78:0/1019300132 reap_dead start 2024-09-17T03:14:05.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.634+0000 7f3faef5cf40 1 -- 172.21.15.78:0/1019300132 shutdown_connections 2024-09-17T03:14:05.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.634+0000 7f3faef5cf40 1 -- 172.21.15.78:0/1019300132 >> 172.21.15.78:0/1019300132 conn(0x56278c27dac0 msgr2=0x56278c417af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:05.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.634+0000 7f3faef5cf40 1 -- 172.21.15.78:0/1019300132 shutdown_connections 2024-09-17T03:14:05.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.634+0000 7f3faef5cf40 1 -- 172.21.15.78:0/1019300132 wait complete. 2024-09-17T03:14:05.637 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000003.00000000 parent 2024-09-17T03:14:05.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.694+0000 7fb3f7c8ff40 1 Processor -- start 2024-09-17T03:14:05.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.694+0000 7fb3f7c8ff40 1 -- start start 2024-09-17T03:14:05.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3f7c8ff40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555c6af3de60 0x555c6afdbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3f7c8ff40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555c6af58840 0x555c6afe8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3f7c8ff40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c6afddfc0 0x555c6afe9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3f7c8ff40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x555c6af3fc80 con 0x555c6af3de60 2024-09-17T03:14:05.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3f7c8ff40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555c6ae5fd60 con 0x555c6afddfc0 2024-09-17T03:14:05.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3f7c8ff40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x555c6af57de0 con 0x555c6af58840 2024-09-17T03:14:05.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3f1749640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555c6af3de60 0x555c6afdbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3f1749640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555c6af3de60 0x555c6afdbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32846/0 (socket says 172.21.15.78:32846) 2024-09-17T03:14:05.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3f1749640 1 -- 172.21.15.78:0/3849661415 learned_addr learned my addr 172.21.15.78:0/3849661415 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:05.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3e8f48640 1 --2- 172.21.15.78:0/3849661415 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555c6af58840 0x555c6afe8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3f1f4a640 1 --2- 172.21.15.78:0/3849661415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c6afddfc0 0x555c6afe9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3f1749640 1 -- 172.21.15.78:0/3849661415 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555c6af58840 msgr2=0x555c6afe8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:05.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3f1749640 1 --2- 172.21.15.78:0/3849661415 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555c6af58840 0x555c6afe8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3f1749640 1 -- 172.21.15.78:0/3849661415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c6afddfc0 msgr2=0x555c6afe9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:05.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3f1749640 1 --2- 172.21.15.78:0/3849661415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c6afddfc0 0x555c6afe9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3f1749640 1 -- 172.21.15.78:0/3849661415 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c6aeff970 con 0x555c6af3de60 2024-09-17T03:14:05.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3e8f48640 1 --2- 172.21.15.78:0/3849661415 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555c6af58840 0x555c6afe8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:05.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3f1f4a640 1 --2- 172.21.15.78:0/3849661415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c6afddfc0 0x555c6afe9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:05.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3f1749640 1 --2- 172.21.15.78:0/3849661415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555c6af3de60 0x555c6afdbdf0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400b600 tx=0x7fb3e400bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b87fe3aec67fb89 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3ebfff640 1 -- 172.21.15.78:0/3849661415 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e400a8f0 con 0x555c6af3de60 2024-09-17T03:14:05.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.695+0000 7fb3ebfff640 1 -- 172.21.15.78:0/3849661415 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3e400aa90 con 0x555c6af3de60 2024-09-17T03:14:05.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.696+0000 7fb3ebfff640 1 -- 172.21.15.78:0/3849661415 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4008450 con 0x555c6af3de60 2024-09-17T03:14:05.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.696+0000 7fb3f7c8ff40 1 -- 172.21.15.78:0/3849661415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555c6af3de60 msgr2=0x555c6afdbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.696+0000 7fb3f7c8ff40 1 --2- 172.21.15.78:0/3849661415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555c6af3de60 0x555c6afdbdf0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400b600 tx=0x7fb3e400bac0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.696+0000 7fb3f7c8ff40 1 -- 172.21.15.78:0/3849661415 shutdown_connections 2024-09-17T03:14:05.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.696+0000 7fb3f7c8ff40 1 --2- 172.21.15.78:0/3849661415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c6afddfc0 0x555c6afe9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.696+0000 7fb3f7c8ff40 1 --2- 172.21.15.78:0/3849661415 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555c6af58840 0x555c6afe8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.696+0000 7fb3f7c8ff40 1 --2- 172.21.15.78:0/3849661415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555c6af3de60 0x555c6afdbdf0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.696+0000 7fb3f7c8ff40 1 -- 172.21.15.78:0/3849661415 >> 172.21.15.78:0/3849661415 conn(0x555c6ae30ac0 msgr2=0x555c6afe6d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:05.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.696+0000 7fb3f7c8ff40 1 -- 172.21.15.78:0/3849661415 shutdown_connections 2024-09-17T03:14:05.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.696+0000 7fb3f7c8ff40 1 -- 172.21.15.78:0/3849661415 wait complete. 2024-09-17T03:14:05.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.697+0000 7fb3f7c8ff40 1 Processor -- start 2024-09-17T03:14:05.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.697+0000 7fb3f7c8ff40 1 -- start start 2024-09-17T03:14:05.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.698+0000 7fb3f7c8ff40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555c6af3de60 0x555c6afdf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.698+0000 7fb3f7c8ff40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c6af58840 0x555c6afdfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.698+0000 7fb3f7c8ff40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555c6afddfc0 0x555c6af3a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.698+0000 7fb3f7c8ff40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x555c6af3d190 con 0x555c6af3de60 2024-09-17T03:14:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.698+0000 7fb3f7c8ff40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555c6af3b550 con 0x555c6af58840 2024-09-17T03:14:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.698+0000 7fb3f7c8ff40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x555c6afd9070 con 0x555c6afddfc0 2024-09-17T03:14:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.698+0000 7fb3f1749640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555c6af3de60 0x555c6afdf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.698+0000 7fb3f1749640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555c6af3de60 0x555c6afdf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32848/0 (socket says 172.21.15.78:32848) 2024-09-17T03:14:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.698+0000 7fb3f1749640 1 -- 172.21.15.78:0/1670785105 learned_addr learned my addr 172.21.15.78:0/1670785105 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.699+0000 7fb3f1749640 1 -- 172.21.15.78:0/1670785105 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555c6afddfc0 msgr2=0x555c6af3a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.699+0000 7fb3f1749640 1 --2- 172.21.15.78:0/1670785105 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555c6afddfc0 0x555c6af3a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.699+0000 7fb3f1749640 1 -- 172.21.15.78:0/1670785105 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c6af58840 msgr2=0x555c6afdfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.699+0000 7fb3f1749640 1 --2- 172.21.15.78:0/1670785105 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555c6af58840 0x555c6afdfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.699+0000 7fb3f1749640 1 -- 172.21.15.78:0/1670785105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c6afe8470 con 0x555c6af3de60 2024-09-17T03:14:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.699+0000 7fb3f1749640 1 --2- 172.21.15.78:0/1670785105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555c6af3de60 0x555c6afdf6a0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4016650 tx=0x7fb3e4016680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.699+0000 7fb3eaffd640 1 -- 172.21.15.78:0/1670785105 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4016ab0 con 0x555c6af3de60 2024-09-17T03:14:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.699+0000 7fb3eaffd640 1 -- 172.21.15.78:0/1670785105 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3e4016c70 con 0x555c6af3de60 2024-09-17T03:14:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.699+0000 7fb3f7c8ff40 1 -- 172.21.15.78:0/1670785105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555c6afe8750 con 0x555c6af3de60 2024-09-17T03:14:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.699+0000 7fb3eaffd640 1 -- 172.21.15.78:0/1670785105 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4021420 con 0x555c6af3de60 2024-09-17T03:14:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.699+0000 7fb3f7c8ff40 1 -- 172.21.15.78:0/1670785105 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c6afe8d10 con 0x555c6af3de60 2024-09-17T03:14:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.701+0000 7fb3eaffd640 1 -- 172.21.15.78:0/1670785105 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb3e4008450 con 0x555c6af3de60 2024-09-17T03:14:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.701+0000 7fb3eaffd640 1 --2- 172.21.15.78:0/1670785105 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb3d4077570 0x7fb3d4079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.701+0000 7fb3eaffd640 1 -- 172.21.15.78:0/1670785105 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fb3e409b630 con 0x555c6af3de60 2024-09-17T03:14:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.702+0000 7fb3e8f48640 1 --2- 172.21.15.78:0/1670785105 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb3d4077570 0x7fb3d4079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.702+0000 7fb3f7c8ff40 1 --2- 172.21.15.78:0/1670785105 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x555c6af11cc0 0x555c6b08aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.702+0000 7fb3f7c8ff40 1 -- 172.21.15.78:0/1670785105 --> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] -- osd_op(unknown.0.0:1 12.12 12:4def72d4:::10000000003.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82) -- 0x555c6b08b430 con 0x555c6af11cc0 2024-09-17T03:14:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.702+0000 7fb3f1f4a640 1 --2- 172.21.15.78:0/1670785105 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x555c6af11cc0 0x555c6b08aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.702+0000 7fb3e8f48640 1 --2- 172.21.15.78:0/1670785105 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb3d4077570 0x7fb3d4079a80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x555c6af3fa60 tx=0x7fb3dc004bc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.702+0000 7fb3f1f4a640 1 --2- 172.21.15.78:0/1670785105 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x555c6af11cc0 0x555c6b08aef0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.703+0000 7fb3f1f4a640 1 -- 172.21.15.78:0/1670785105 <== osd.3 v2:172.21.15.78:6800/2433795738 1 ==== osd_op_reply(1 10000000003.00000000 [rmxattr] v82'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb3ec00b040 con 0x555c6af11cc0 2024-09-17T03:14:05.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.703+0000 7fb3f7c8ff40 1 -- 172.21.15.78:0/1670785105 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x555c6af11cc0 msgr2=0x555c6b08aef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.703+0000 7fb3f7c8ff40 1 --2- 172.21.15.78:0/1670785105 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x555c6af11cc0 0x555c6b08aef0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.703+0000 7fb3f7c8ff40 1 -- 172.21.15.78:0/1670785105 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb3d4077570 msgr2=0x7fb3d4079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.703+0000 7fb3f7c8ff40 1 --2- 172.21.15.78:0/1670785105 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb3d4077570 0x7fb3d4079a80 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x555c6af3fa60 tx=0x7fb3dc004bc0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.703+0000 7fb3f7c8ff40 1 -- 172.21.15.78:0/1670785105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555c6af3de60 msgr2=0x555c6afdf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.703+0000 7fb3f7c8ff40 1 --2- 172.21.15.78:0/1670785105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555c6af3de60 0x555c6afdf6a0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4016650 tx=0x7fb3e4016680 comp rx=0 tx=0).stop 2024-09-17T03:14:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.703+0000 7fb3f1f4a640 1 -- 172.21.15.78:0/1670785105 reap_dead start 2024-09-17T03:14:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.703+0000 7fb3f7c8ff40 1 -- 172.21.15.78:0/1670785105 shutdown_connections 2024-09-17T03:14:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.703+0000 7fb3f7c8ff40 1 -- 172.21.15.78:0/1670785105 >> 172.21.15.78:0/1670785105 conn(0x555c6ae30ac0 msgr2=0x555c6afdce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.703+0000 7fb3f7c8ff40 1 -- 172.21.15.78:0/1670785105 shutdown_connections 2024-09-17T03:14:05.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.704+0000 7fb3f7c8ff40 1 -- 172.21.15.78:0/1670785105 wait complete. 2024-09-17T03:14:05.707 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000004.00000000 parent 2024-09-17T03:14:05.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.763+0000 7f728132cf40 1 Processor -- start 2024-09-17T03:14:05.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.763+0000 7f728132cf40 1 -- start start 2024-09-17T03:14:05.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.765+0000 7f728132cf40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f72680030f0 0x55da9a0cca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.765+0000 7f728132cf40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da9a0c7af0 0x55da9a0cf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.765+0000 7f728132cf40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da9a0cf740 0x55da9a139750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.765+0000 7f728132cf40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55da9a034430 con 0x55da9a0c7af0 2024-09-17T03:14:05.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.765+0000 7f728132cf40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55da9a0411f0 con 0x55da9a0cf740 2024-09-17T03:14:05.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.765+0000 7f728132cf40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55da99fd5d60 con 0x7f72680030f0 2024-09-17T03:14:05.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.765+0000 7f7271b80640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da9a0c7af0 0x55da9a0cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.765+0000 7f7271b80640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da9a0c7af0 0x55da9a0cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32874/0 (socket says 172.21.15.78:32874) 2024-09-17T03:14:05.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.765+0000 7f7271b80640 1 -- 172.21.15.78:0/2446529229 learned_addr learned my addr 172.21.15.78:0/2446529229 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:05.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.765+0000 7f727a381640 1 --2- 172.21.15.78:0/2446529229 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f72680030f0 0x55da9a0cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.765+0000 7f727ab82640 1 --2- 172.21.15.78:0/2446529229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da9a0cf740 0x55da9a139750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.765+0000 7f7271b80640 1 -- 172.21.15.78:0/2446529229 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f72680030f0 msgr2=0x55da9a0cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:05.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.765+0000 7f7271b80640 1 --2- 172.21.15.78:0/2446529229 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f72680030f0 0x55da9a0cca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.765+0000 7f7271b80640 1 -- 172.21.15.78:0/2446529229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da9a0cf740 msgr2=0x55da9a139750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:05.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.765+0000 7f7271b80640 1 --2- 172.21.15.78:0/2446529229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da9a0cf740 0x55da9a139750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.765+0000 7f7271b80640 1 -- 172.21.15.78:0/2446529229 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da9a15ac70 con 0x55da9a0c7af0 2024-09-17T03:14:05.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.765+0000 7f7271b80640 1 --2- 172.21.15.78:0/2446529229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da9a0c7af0 0x55da9a0cf200 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f72640467c0 tx=0x7f7264000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89983be4ace0fa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.765+0000 7f727937f640 1 -- 172.21.15.78:0/2446529229 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72640017b0 con 0x55da9a0c7af0 2024-09-17T03:14:05.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.765+0000 7f727937f640 1 -- 172.21.15.78:0/2446529229 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7264064070 con 0x55da9a0c7af0 2024-09-17T03:14:05.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.765+0000 7f727937f640 1 -- 172.21.15.78:0/2446529229 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726404dcd0 con 0x55da9a0c7af0 2024-09-17T03:14:05.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.766+0000 7f728132cf40 1 -- 172.21.15.78:0/2446529229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da9a0c7af0 msgr2=0x55da9a0cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.766+0000 7f728132cf40 1 --2- 172.21.15.78:0/2446529229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da9a0c7af0 0x55da9a0cf200 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f72640467c0 tx=0x7f7264000fe0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.766+0000 7f728132cf40 1 -- 172.21.15.78:0/2446529229 shutdown_connections 2024-09-17T03:14:05.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.766+0000 7f728132cf40 1 --2- 172.21.15.78:0/2446529229 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da9a0cf740 0x55da9a139750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.766+0000 7f728132cf40 1 --2- 172.21.15.78:0/2446529229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da9a0c7af0 0x55da9a0cf200 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.766+0000 7f728132cf40 1 --2- 172.21.15.78:0/2446529229 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f72680030f0 0x55da9a0cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.766+0000 7f728132cf40 1 -- 172.21.15.78:0/2446529229 >> 172.21.15.78:0/2446529229 conn(0x55da99fa6ac0 msgr2=0x55da9a159100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:05.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.766+0000 7f728132cf40 1 -- 172.21.15.78:0/2446529229 shutdown_connections 2024-09-17T03:14:05.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.766+0000 7f728132cf40 1 -- 172.21.15.78:0/2446529229 wait complete. 2024-09-17T03:14:05.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.767+0000 7f728132cf40 1 Processor -- start 2024-09-17T03:14:05.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.767+0000 7f728132cf40 1 -- start start 2024-09-17T03:14:05.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.768+0000 7f728132cf40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da9a0c7af0 0x55da9a13d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.768+0000 7f728132cf40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da9a0cf740 0x55da9a139d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.768+0000 7f728132cf40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f72680030f0 0x55da9a159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.768+0000 7f728132cf40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55da9a140230 con 0x55da9a0c7af0 2024-09-17T03:14:05.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.768+0000 7f728132cf40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55da9a13ff50 con 0x55da9a0cf740 2024-09-17T03:14:05.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.768+0000 7f728132cf40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55da9a0cc260 con 0x7f72680030f0 2024-09-17T03:14:05.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.768+0000 7f727a381640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da9a0c7af0 0x55da9a13d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.768+0000 7f727a381640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da9a0c7af0 0x55da9a13d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32882/0 (socket says 172.21.15.78:32882) 2024-09-17T03:14:05.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.768+0000 7f727a381640 1 -- 172.21.15.78:0/153105411 learned_addr learned my addr 172.21.15.78:0/153105411 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:05.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.768+0000 7f7271b80640 1 --2- 172.21.15.78:0/153105411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da9a0cf740 0x55da9a139d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.768+0000 7f727ab82640 1 --2- 172.21.15.78:0/153105411 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f72680030f0 0x55da9a159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.768+0000 7f727a381640 1 -- 172.21.15.78:0/153105411 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f72680030f0 msgr2=0x55da9a159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.768+0000 7f727a381640 1 --2- 172.21.15.78:0/153105411 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f72680030f0 0x55da9a159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.768+0000 7f727a381640 1 -- 172.21.15.78:0/153105411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da9a0cf740 msgr2=0x55da9a139d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.768+0000 7f727a381640 1 --2- 172.21.15.78:0/153105411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55da9a0cf740 0x55da9a139d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.768+0000 7f727a381640 1 -- 172.21.15.78:0/153105411 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da9a138380 con 0x55da9a0c7af0 2024-09-17T03:14:05.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.769+0000 7f727a381640 1 --2- 172.21.15.78:0/153105411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da9a0c7af0 0x55da9a13d1e0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f726c00a7a0 tx=0x7f726c00ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.769+0000 7f7273fff640 1 -- 172.21.15.78:0/153105411 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c0099a0 con 0x55da9a0c7af0 2024-09-17T03:14:05.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.769+0000 7f7273fff640 1 -- 172.21.15.78:0/153105411 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f726c009b40 con 0x55da9a0c7af0 2024-09-17T03:14:05.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.769+0000 7f728132cf40 1 -- 172.21.15.78:0/153105411 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da9a137800 con 0x55da9a0c7af0 2024-09-17T03:14:05.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.769+0000 7f7273fff640 1 -- 172.21.15.78:0/153105411 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c008470 con 0x55da9a0c7af0 2024-09-17T03:14:05.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.769+0000 7f728132cf40 1 -- 172.21.15.78:0/153105411 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da9a137dc0 con 0x55da9a0c7af0 2024-09-17T03:14:05.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.771+0000 7f7273fff640 1 -- 172.21.15.78:0/153105411 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f726c008610 con 0x55da9a0c7af0 2024-09-17T03:14:05.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.771+0000 7f7273fff640 1 --2- 172.21.15.78:0/153105411 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f725c0775a0 0x7f725c079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.771+0000 7f7273fff640 1 -- 172.21.15.78:0/153105411 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f726c09acc0 con 0x55da9a0c7af0 2024-09-17T03:14:05.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.771+0000 7f7271b80640 1 --2- 172.21.15.78:0/153105411 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f725c0775a0 0x7f725c079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.771+0000 7f728132cf40 1 --2- 172.21.15.78:0/153105411 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x55da9a13b6c0 0x55da9a13bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.771+0000 7f728132cf40 1 -- 172.21.15.78:0/153105411 --> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] -- osd_op(unknown.0.0:1 12.5 12:a367a3e8:::10000000004.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82) -- 0x55da9a13c010 con 0x55da9a13b6c0 2024-09-17T03:14:05.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.772+0000 7f727ab82640 1 --2- 172.21.15.78:0/153105411 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x55da9a13b6c0 0x55da9a13bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.772+0000 7f7271b80640 1 --2- 172.21.15.78:0/153105411 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f725c0775a0 0x7f725c079ab0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7264063000 tx=0x7f72640092a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.772+0000 7f727ab82640 1 --2- 172.21.15.78:0/153105411 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x55da9a13b6c0 0x55da9a13bad0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.774+0000 7f727ab82640 1 -- 172.21.15.78:0/153105411 <== osd.6 v2:172.21.15.193:6818/2885678262 1 ==== osd_op_reply(1 10000000004.00000000 [rmxattr] v82'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7274008880 con 0x55da9a13b6c0 2024-09-17T03:14:05.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.774+0000 7f728132cf40 1 -- 172.21.15.78:0/153105411 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x55da9a13b6c0 msgr2=0x55da9a13bad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.774+0000 7f728132cf40 1 --2- 172.21.15.78:0/153105411 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x55da9a13b6c0 0x55da9a13bad0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.774+0000 7f728132cf40 1 -- 172.21.15.78:0/153105411 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f725c0775a0 msgr2=0x7f725c079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.774+0000 7f728132cf40 1 --2- 172.21.15.78:0/153105411 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f725c0775a0 0x7f725c079ab0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7264063000 tx=0x7f72640092a0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.774+0000 7f728132cf40 1 -- 172.21.15.78:0/153105411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da9a0c7af0 msgr2=0x55da9a13d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.774+0000 7f728132cf40 1 --2- 172.21.15.78:0/153105411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55da9a0c7af0 0x55da9a13d1e0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f726c00a7a0 tx=0x7f726c00ac60 comp rx=0 tx=0).stop 2024-09-17T03:14:05.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.774+0000 7f727ab82640 1 -- 172.21.15.78:0/153105411 reap_dead start 2024-09-17T03:14:05.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.774+0000 7f728132cf40 1 -- 172.21.15.78:0/153105411 shutdown_connections 2024-09-17T03:14:05.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.774+0000 7f728132cf40 1 -- 172.21.15.78:0/153105411 >> 172.21.15.78:0/153105411 conn(0x55da99fa6ac0 msgr2=0x55da9a0cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:05.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.774+0000 7f728132cf40 1 -- 172.21.15.78:0/153105411 shutdown_connections 2024-09-17T03:14:05.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.774+0000 7f728132cf40 1 -- 172.21.15.78:0/153105411 wait complete. 2024-09-17T03:14:05.776 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000005.00000000 parent 2024-09-17T03:14:05.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.832+0000 7fdf7b5eef40 1 Processor -- start 2024-09-17T03:14:05.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.832+0000 7fdf7b5eef40 1 -- start start 2024-09-17T03:14:05.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.833+0000 7fdf7b5eef40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e5d16662c0 0x55e5d17072b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.833+0000 7fdf7b5eef40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5d170b300 0x55e5d17077f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.833+0000 7fdf7b5eef40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5d170bc50 0x55e5d1705760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.833+0000 7fdf7b5eef40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55e5d15e5430 con 0x55e5d170b300 2024-09-17T03:14:05.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.833+0000 7fdf7b5eef40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e5d15f21f0 con 0x55e5d170bc50 2024-09-17T03:14:05.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.833+0000 7fdf7b5eef40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55e5d1586d60 con 0x55e5d16662c0 2024-09-17T03:14:05.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.833+0000 7fdf6c8a7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5d170b300 0x55e5d17077f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.833+0000 7fdf6c8a7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5d170b300 0x55e5d17077f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32906/0 (socket says 172.21.15.78:32906) 2024-09-17T03:14:05.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.833+0000 7fdf6c8a7640 1 -- 172.21.15.78:0/3351963509 learned_addr learned my addr 172.21.15.78:0/3351963509 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:05.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.834+0000 7fdf750a8640 1 --2- 172.21.15.78:0/3351963509 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e5d16662c0 0x55e5d17072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.834+0000 7fdf758a9640 1 --2- 172.21.15.78:0/3351963509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5d170bc50 0x55e5d1705760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.834+0000 7fdf6c8a7640 1 -- 172.21.15.78:0/3351963509 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e5d16662c0 msgr2=0x55e5d17072b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:05.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.834+0000 7fdf6c8a7640 1 --2- 172.21.15.78:0/3351963509 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e5d16662c0 0x55e5d17072b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.834+0000 7fdf6c8a7640 1 -- 172.21.15.78:0/3351963509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5d170bc50 msgr2=0x55e5d1705760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:05.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.834+0000 7fdf6c8a7640 1 --2- 172.21.15.78:0/3351963509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5d170bc50 0x55e5d1705760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.834+0000 7fdf6c8a7640 1 -- 172.21.15.78:0/3351963509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5d1715b10 con 0x55e5d170b300 2024-09-17T03:14:05.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.834+0000 7fdf6c8a7640 1 --2- 172.21.15.78:0/3351963509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5d170b300 0x55e5d17077f0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fdf60000c00 tx=0x7fdf60002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455e9270724733c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.834+0000 7fdf6ffff640 1 -- 172.21.15.78:0/3351963509 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf60064070 con 0x55e5d170b300 2024-09-17T03:14:05.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.834+0000 7fdf6ffff640 1 -- 172.21.15.78:0/3351963509 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf60060470 con 0x55e5d170b300 2024-09-17T03:14:05.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.834+0000 7fdf6ffff640 1 -- 172.21.15.78:0/3351963509 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf600608c0 con 0x55e5d170b300 2024-09-17T03:14:05.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.835+0000 7fdf7b5eef40 1 -- 172.21.15.78:0/3351963509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5d170b300 msgr2=0x55e5d17077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.835+0000 7fdf7b5eef40 1 --2- 172.21.15.78:0/3351963509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5d170b300 0x55e5d17077f0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fdf60000c00 tx=0x7fdf60002fb0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.835+0000 7fdf7b5eef40 1 -- 172.21.15.78:0/3351963509 shutdown_connections 2024-09-17T03:14:05.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.835+0000 7fdf7b5eef40 1 --2- 172.21.15.78:0/3351963509 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5d170bc50 0x55e5d1705760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.835+0000 7fdf7b5eef40 1 --2- 172.21.15.78:0/3351963509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5d170b300 0x55e5d17077f0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.835+0000 7fdf7b5eef40 1 --2- 172.21.15.78:0/3351963509 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e5d16662c0 0x55e5d17072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.835+0000 7fdf7b5eef40 1 -- 172.21.15.78:0/3351963509 >> 172.21.15.78:0/3351963509 conn(0x55e5d1557ac0 msgr2=0x55e5d1704d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:05.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.835+0000 7fdf7b5eef40 1 -- 172.21.15.78:0/3351963509 shutdown_connections 2024-09-17T03:14:05.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.835+0000 7fdf7b5eef40 1 -- 172.21.15.78:0/3351963509 wait complete. 2024-09-17T03:14:05.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.836+0000 7fdf7b5eef40 1 Processor -- start 2024-09-17T03:14:05.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.836+0000 7fdf7b5eef40 1 -- start start 2024-09-17T03:14:05.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.837+0000 7fdf7b5eef40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5d16662c0 0x55e5d16f91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.837+0000 7fdf7b5eef40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5d170b300 0x55e5d167cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.837+0000 7fdf7b5eef40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e5d170bc50 0x55e5d167d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.837+0000 7fdf7b5eef40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55e5d17080a0 con 0x55e5d170b300 2024-09-17T03:14:05.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.837+0000 7fdf7b5eef40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55e5d1708380 con 0x55e5d16662c0 2024-09-17T03:14:05.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.837+0000 7fdf7b5eef40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55e5d1638300 con 0x55e5d170bc50 2024-09-17T03:14:05.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.837+0000 7fdf6c8a7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5d170b300 0x55e5d167cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.837+0000 7fdf6c8a7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5d170b300 0x55e5d167cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32914/0 (socket says 172.21.15.78:32914) 2024-09-17T03:14:05.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.837+0000 7fdf6c8a7640 1 -- 172.21.15.78:0/295471200 learned_addr learned my addr 172.21.15.78:0/295471200 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:05.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.837+0000 7fdf758a9640 1 --2- 172.21.15.78:0/295471200 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e5d170bc50 0x55e5d167d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.837+0000 7fdf750a8640 1 --2- 172.21.15.78:0/295471200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5d16662c0 0x55e5d16f91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.837+0000 7fdf6c8a7640 1 -- 172.21.15.78:0/295471200 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e5d170bc50 msgr2=0x55e5d167d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.837+0000 7fdf6c8a7640 1 --2- 172.21.15.78:0/295471200 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e5d170bc50 0x55e5d167d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.837+0000 7fdf6c8a7640 1 -- 172.21.15.78:0/295471200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5d16662c0 msgr2=0x55e5d16f91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.837+0000 7fdf6c8a7640 1 --2- 172.21.15.78:0/295471200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55e5d16662c0 0x55e5d16f91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.837+0000 7fdf6c8a7640 1 -- 172.21.15.78:0/295471200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5d167b710 con 0x55e5d170b300 2024-09-17T03:14:05.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.837+0000 7fdf758a9640 1 --2- 172.21.15.78:0/295471200 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55e5d170bc50 0x55e5d167d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:05.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.837+0000 7fdf6c8a7640 1 --2- 172.21.15.78:0/295471200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5d170b300 0x55e5d167cda0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fdf60004230 tx=0x7fdf60057b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.838+0000 7fdf6effd640 1 -- 172.21.15.78:0/295471200 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf60070070 con 0x55e5d170b300 2024-09-17T03:14:05.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.838+0000 7fdf6effd640 1 -- 172.21.15.78:0/295471200 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf60060560 con 0x55e5d170b300 2024-09-17T03:14:05.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.838+0000 7fdf7b5eef40 1 -- 172.21.15.78:0/295471200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5d167b9f0 con 0x55e5d170b300 2024-09-17T03:14:05.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.838+0000 7fdf6effd640 1 -- 172.21.15.78:0/295471200 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf60064070 con 0x55e5d170b300 2024-09-17T03:14:05.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.838+0000 7fdf7b5eef40 1 -- 172.21.15.78:0/295471200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5d167da20 con 0x55e5d170b300 2024-09-17T03:14:05.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.839+0000 7fdf6effd640 1 -- 172.21.15.78:0/295471200 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdf60073070 con 0x55e5d170b300 2024-09-17T03:14:05.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.840+0000 7fdf6effd640 1 --2- 172.21.15.78:0/295471200 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdf58077570 0x7fdf58079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.840+0000 7fdf6effd640 1 -- 172.21.15.78:0/295471200 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fdf600df0f0 con 0x55e5d170b300 2024-09-17T03:14:05.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.840+0000 7fdf750a8640 1 --2- 172.21.15.78:0/295471200 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdf58077570 0x7fdf58079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.840+0000 7fdf7b5eef40 1 --2- 172.21.15.78:0/295471200 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x55e5d16f9c80 0x55e5d17b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.840+0000 7fdf7b5eef40 1 -- 172.21.15.78:0/295471200 --> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] -- osd_op(unknown.0.0:1 12.9 12:9258b67d:::10000000005.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82) -- 0x55e5d17b1870 con 0x55e5d16f9c80 2024-09-17T03:14:05.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.840+0000 7fdf758a9640 1 --2- 172.21.15.78:0/295471200 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x55e5d16f9c80 0x55e5d17b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.840+0000 7fdf758a9640 1 --2- 172.21.15.78:0/295471200 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x55e5d16f9c80 0x55e5d17b1330 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.840+0000 7fdf750a8640 1 --2- 172.21.15.78:0/295471200 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdf58077570 0x7fdf58079a80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fdf680104f0 tx=0x7fdf68003810 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.842+0000 7fdf758a9640 1 -- 172.21.15.78:0/295471200 <== osd.2 v2:172.21.15.78:6824/3281582072 1 ==== osd_op_reply(1 10000000005.00000000 [rmxattr] v82'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fdf70001580 con 0x55e5d16f9c80 2024-09-17T03:14:05.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.842+0000 7fdf7b5eef40 1 -- 172.21.15.78:0/295471200 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x55e5d16f9c80 msgr2=0x55e5d17b1330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.842+0000 7fdf7b5eef40 1 --2- 172.21.15.78:0/295471200 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x55e5d16f9c80 0x55e5d17b1330 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.842+0000 7fdf7b5eef40 1 -- 172.21.15.78:0/295471200 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdf58077570 msgr2=0x7fdf58079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.842+0000 7fdf7b5eef40 1 --2- 172.21.15.78:0/295471200 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdf58077570 0x7fdf58079a80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fdf680104f0 tx=0x7fdf68003810 comp rx=0 tx=0).stop 2024-09-17T03:14:05.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.842+0000 7fdf7b5eef40 1 -- 172.21.15.78:0/295471200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5d170b300 msgr2=0x55e5d167cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.842+0000 7fdf7b5eef40 1 --2- 172.21.15.78:0/295471200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55e5d170b300 0x55e5d167cda0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7fdf60004230 tx=0x7fdf60057b10 comp rx=0 tx=0).stop 2024-09-17T03:14:05.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.842+0000 7fdf758a9640 1 -- 172.21.15.78:0/295471200 reap_dead start 2024-09-17T03:14:05.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.842+0000 7fdf7b5eef40 1 -- 172.21.15.78:0/295471200 shutdown_connections 2024-09-17T03:14:05.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.842+0000 7fdf7b5eef40 1 -- 172.21.15.78:0/295471200 >> 172.21.15.78:0/295471200 conn(0x55e5d1557ac0 msgr2=0x55e5d17072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:05.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.842+0000 7fdf7b5eef40 1 -- 172.21.15.78:0/295471200 shutdown_connections 2024-09-17T03:14:05.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.842+0000 7fdf7b5eef40 1 -- 172.21.15.78:0/295471200 wait complete. 2024-09-17T03:14:05.845 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000006.00000000 parent 2024-09-17T03:14:05.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.901+0000 7ff48f3f8f40 1 Processor -- start 2024-09-17T03:14:05.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.901+0000 7ff48f3f8f40 1 -- start start 2024-09-17T03:14:05.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.902+0000 7ff48f3f8f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390177fd90 0x563901848870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.902+0000 7ff48f3f8f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563901856e00 0x563901852ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.902+0000 7ff48f3f8f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563901858080 0x5639018533e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.902+0000 7ff48f3f8f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5639016d0d60 con 0x56390177fd90 2024-09-17T03:14:05.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.902+0000 7ff48f3f8f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56390172f430 con 0x563901856e00 2024-09-17T03:14:05.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.902+0000 7ff48f3f8f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x563901857210 con 0x563901858080 2024-09-17T03:14:05.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.902+0000 7ff488eb4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390177fd90 0x563901848870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.902+0000 7ff488eb4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390177fd90 0x563901848870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32930/0 (socket says 172.21.15.78:32930) 2024-09-17T03:14:05.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.902+0000 7ff488eb4640 1 -- 172.21.15.78:0/3612779935 learned_addr learned my addr 172.21.15.78:0/3612779935 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:05.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.902+0000 7ff4806b3640 1 --2- 172.21.15.78:0/3612779935 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563901856e00 0x563901852ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.902+0000 7ff4896b5640 1 --2- 172.21.15.78:0/3612779935 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563901858080 0x5639018533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.902+0000 7ff488eb4640 1 -- 172.21.15.78:0/3612779935 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563901858080 msgr2=0x5639018533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:05.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.902+0000 7ff488eb4640 1 --2- 172.21.15.78:0/3612779935 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563901858080 0x5639018533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.902+0000 7ff488eb4640 1 -- 172.21.15.78:0/3612779935 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563901856e00 msgr2=0x563901852ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:05.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.902+0000 7ff488eb4640 1 --2- 172.21.15.78:0/3612779935 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563901856e00 0x563901852ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.902+0000 7ff488eb4640 1 -- 172.21.15.78:0/3612779935 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56390184c180 con 0x56390177fd90 2024-09-17T03:14:05.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.902+0000 7ff4896b5640 1 --2- 172.21.15.78:0/3612779935 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563901858080 0x5639018533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:05.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.903+0000 7ff488eb4640 1 --2- 172.21.15.78:0/3612779935 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390177fd90 0x563901848870 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7ff478001d80 tx=0x7ff478001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3773d3524cd39b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.903+0000 7ff4837fe640 1 -- 172.21.15.78:0/3612779935 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47800bd70 con 0x56390177fd90 2024-09-17T03:14:05.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.903+0000 7ff4837fe640 1 -- 172.21.15.78:0/3612779935 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff47800f400 con 0x56390177fd90 2024-09-17T03:14:05.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.903+0000 7ff4837fe640 1 -- 172.21.15.78:0/3612779935 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47800f850 con 0x56390177fd90 2024-09-17T03:14:05.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.903+0000 7ff48f3f8f40 1 -- 172.21.15.78:0/3612779935 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390177fd90 msgr2=0x563901848870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.903+0000 7ff48f3f8f40 1 --2- 172.21.15.78:0/3612779935 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390177fd90 0x563901848870 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7ff478001d80 tx=0x7ff478001e70 comp rx=0 tx=0).stop 2024-09-17T03:14:05.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.903+0000 7ff48f3f8f40 1 -- 172.21.15.78:0/3612779935 shutdown_connections 2024-09-17T03:14:05.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.903+0000 7ff48f3f8f40 1 --2- 172.21.15.78:0/3612779935 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563901858080 0x5639018533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.903+0000 7ff48f3f8f40 1 --2- 172.21.15.78:0/3612779935 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563901856e00 0x563901852ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.903+0000 7ff48f3f8f40 1 --2- 172.21.15.78:0/3612779935 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x56390177fd90 0x563901848870 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.903+0000 7ff48f3f8f40 1 -- 172.21.15.78:0/3612779935 >> 172.21.15.78:0/3612779935 conn(0x5639016a1ac0 msgr2=0x5639017c91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:05.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.903+0000 7ff48f3f8f40 1 -- 172.21.15.78:0/3612779935 shutdown_connections 2024-09-17T03:14:05.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.903+0000 7ff48f3f8f40 1 -- 172.21.15.78:0/3612779935 wait complete. 2024-09-17T03:14:05.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.904+0000 7ff48f3f8f40 1 Processor -- start 2024-09-17T03:14:05.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.904+0000 7ff48f3f8f40 1 -- start start 2024-09-17T03:14:05.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff48f3f8f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56390177fd90 0x56390184b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff48f3f8f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563901856e00 0x563901859bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff48f3f8f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563901858080 0x5639017c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff48f3f8f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x563901855b40 con 0x563901856e00 2024-09-17T03:14:05.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff48f3f8f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x56390183dcd0 con 0x56390177fd90 2024-09-17T03:14:05.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff48f3f8f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x56390183e130 con 0x563901858080 2024-09-17T03:14:05.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff4806b3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563901856e00 0x563901859bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff4806b3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563901856e00 0x563901859bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32938/0 (socket says 172.21.15.78:32938) 2024-09-17T03:14:05.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff4806b3640 1 -- 172.21.15.78:0/3255990971 learned_addr learned my addr 172.21.15.78:0/3255990971 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:05.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff488eb4640 1 --2- 172.21.15.78:0/3255990971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56390177fd90 0x56390184b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff4896b5640 1 --2- 172.21.15.78:0/3255990971 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563901858080 0x5639017c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff4806b3640 1 -- 172.21.15.78:0/3255990971 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563901858080 msgr2=0x5639017c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff4806b3640 1 --2- 172.21.15.78:0/3255990971 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563901858080 0x5639017c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff4806b3640 1 -- 172.21.15.78:0/3255990971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56390177fd90 msgr2=0x56390184b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff4806b3640 1 --2- 172.21.15.78:0/3255990971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x56390177fd90 0x56390184b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff4806b3640 1 -- 172.21.15.78:0/3255990971 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563901847d30 con 0x563901856e00 2024-09-17T03:14:05.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff4806b3640 1 --2- 172.21.15.78:0/3255990971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563901856e00 0x563901859bc0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7ff470008720 tx=0x7ff470008810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff4827fc640 1 -- 172.21.15.78:0/3255990971 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47000a850 con 0x563901856e00 2024-09-17T03:14:05.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff4827fc640 1 -- 172.21.15.78:0/3255990971 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff47000a9f0 con 0x563901856e00 2024-09-17T03:14:05.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff48f3f8f40 1 -- 172.21.15.78:0/3255990971 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563901848010 con 0x563901856e00 2024-09-17T03:14:05.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff4827fc640 1 -- 172.21.15.78:0/3255990971 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47000ae40 con 0x563901856e00 2024-09-17T03:14:05.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.906+0000 7ff48f3f8f40 1 -- 172.21.15.78:0/3255990971 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56390183de70 con 0x563901856e00 2024-09-17T03:14:05.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.908+0000 7ff4827fc640 1 -- 172.21.15.78:0/3255990971 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff470016430 con 0x563901856e00 2024-09-17T03:14:05.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.908+0000 7ff4827fc640 1 --2- 172.21.15.78:0/3255990971 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff4680775a0 0x7ff468079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.908+0000 7ff4827fc640 1 -- 172.21.15.78:0/3255990971 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7ff47009a110 con 0x563901856e00 2024-09-17T03:14:05.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.909+0000 7ff488eb4640 1 --2- 172.21.15.78:0/3255990971 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff4680775a0 0x7ff468079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.909+0000 7ff48f3f8f40 1 --2- 172.21.15.78:0/3255990971 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x56390185a100 0x56390183f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.909+0000 7ff48f3f8f40 1 -- 172.21.15.78:0/3255990971 --> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] -- osd_op(unknown.0.0:1 12.5 12:a5feb6f3:::10000000006.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82) -- 0x56390183fd20 con 0x56390185a100 2024-09-17T03:14:05.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.909+0000 7ff4896b5640 1 --2- 172.21.15.78:0/3255990971 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x56390185a100 0x56390183f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.909+0000 7ff488eb4640 1 --2- 172.21.15.78:0/3255990971 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff4680775a0 0x7ff468079ab0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff478003040 tx=0x7ff478000ed0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.909+0000 7ff4896b5640 1 --2- 172.21.15.78:0/3255990971 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x56390185a100 0x56390183f7e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.911+0000 7ff4896b5640 1 -- 172.21.15.78:0/3255990971 <== osd.6 v2:172.21.15.193:6818/2885678262 1 ==== osd_op_reply(1 10000000006.00000000 [rmxattr] v82'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ff48400b040 con 0x56390185a100 2024-09-17T03:14:05.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.911+0000 7ff48f3f8f40 1 -- 172.21.15.78:0/3255990971 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x56390185a100 msgr2=0x56390183f7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.911+0000 7ff48f3f8f40 1 --2- 172.21.15.78:0/3255990971 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x56390185a100 0x56390183f7e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.911+0000 7ff48f3f8f40 1 -- 172.21.15.78:0/3255990971 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff4680775a0 msgr2=0x7ff468079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.911+0000 7ff48f3f8f40 1 --2- 172.21.15.78:0/3255990971 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff4680775a0 0x7ff468079ab0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff478003040 tx=0x7ff478000ed0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.911+0000 7ff48f3f8f40 1 -- 172.21.15.78:0/3255990971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563901856e00 msgr2=0x563901859bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.911+0000 7ff48f3f8f40 1 --2- 172.21.15.78:0/3255990971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563901856e00 0x563901859bc0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7ff470008720 tx=0x7ff470008810 comp rx=0 tx=0).stop 2024-09-17T03:14:05.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.911+0000 7ff4896b5640 1 -- 172.21.15.78:0/3255990971 reap_dead start 2024-09-17T03:14:05.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.911+0000 7ff48f3f8f40 1 -- 172.21.15.78:0/3255990971 shutdown_connections 2024-09-17T03:14:05.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.911+0000 7ff48f3f8f40 1 -- 172.21.15.78:0/3255990971 >> 172.21.15.78:0/3255990971 conn(0x5639016a1ac0 msgr2=0x56390184f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:05.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.911+0000 7ff48f3f8f40 1 -- 172.21.15.78:0/3255990971 shutdown_connections 2024-09-17T03:14:05.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.911+0000 7ff48f3f8f40 1 -- 172.21.15.78:0/3255990971 wait complete. 2024-09-17T03:14:05.914 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000007.00000000 parent 2024-09-17T03:14:05.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.970+0000 7fcd4e5dff40 1 Processor -- start 2024-09-17T03:14:05.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.971+0000 7fcd4e5dff40 1 -- start start 2024-09-17T03:14:05.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.972+0000 7fcd4e5dff40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a946ce900 0x555a9470fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.972+0000 7fcd4e5dff40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a94782d10 0x555a947121c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.972+0000 7fcd4e5dff40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a947a0c40 0x555a947a2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.972+0000 7fcd4e5dff40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x555a94679430 con 0x555a94782d10 2024-09-17T03:14:05.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.972+0000 7fcd4e5dff40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555a946861f0 con 0x555a946ce900 2024-09-17T03:14:05.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.972+0000 7fcd4e5dff40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x555a9461ad60 con 0x555a947a0c40 2024-09-17T03:14:05.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.972+0000 7fcd3ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a94782d10 0x555a947121c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.972+0000 7fcd3ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a94782d10 0x555a947121c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32958/0 (socket says 172.21.15.78:32958) 2024-09-17T03:14:05.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.972+0000 7fcd3ffff640 1 -- 172.21.15.78:0/3002484917 learned_addr learned my addr 172.21.15.78:0/3002484917 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:05.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.972+0000 7fcd4889a640 1 --2- 172.21.15.78:0/3002484917 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a947a0c40 0x555a947a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.972+0000 7fcd48099640 1 --2- 172.21.15.78:0/3002484917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a946ce900 0x555a9470fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.972+0000 7fcd3ffff640 1 -- 172.21.15.78:0/3002484917 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a947a0c40 msgr2=0x555a947a2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:05.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.972+0000 7fcd3ffff640 1 --2- 172.21.15.78:0/3002484917 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a947a0c40 0x555a947a2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.972+0000 7fcd3ffff640 1 -- 172.21.15.78:0/3002484917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a946ce900 msgr2=0x555a9470fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:05.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.972+0000 7fcd3ffff640 1 --2- 172.21.15.78:0/3002484917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a946ce900 0x555a9470fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.972+0000 7fcd3ffff640 1 -- 172.21.15.78:0/3002484917 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a947967b0 con 0x555a94782d10 2024-09-17T03:14:05.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.972+0000 7fcd3ffff640 1 --2- 172.21.15.78:0/3002484917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a94782d10 0x555a947121c0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fcd30001d90 tx=0x7fcd3000b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c837c07867b1629 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.972+0000 7fcd47097640 1 -- 172.21.15.78:0/3002484917 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd30016070 con 0x555a94782d10 2024-09-17T03:14:05.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.972+0000 7fcd47097640 1 -- 172.21.15.78:0/3002484917 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd3000f690 con 0x555a94782d10 2024-09-17T03:14:05.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.972+0000 7fcd47097640 1 -- 172.21.15.78:0/3002484917 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3000fb20 con 0x555a94782d10 2024-09-17T03:14:05.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.973+0000 7fcd4e5dff40 1 -- 172.21.15.78:0/3002484917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a94782d10 msgr2=0x555a947121c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.973+0000 7fcd4e5dff40 1 --2- 172.21.15.78:0/3002484917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a94782d10 0x555a947121c0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fcd30001d90 tx=0x7fcd3000b590 comp rx=0 tx=0).stop 2024-09-17T03:14:05.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.973+0000 7fcd4e5dff40 1 -- 172.21.15.78:0/3002484917 shutdown_connections 2024-09-17T03:14:05.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.973+0000 7fcd4e5dff40 1 --2- 172.21.15.78:0/3002484917 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a947a0c40 0x555a947a2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.973+0000 7fcd4e5dff40 1 --2- 172.21.15.78:0/3002484917 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a94782d10 0x555a947121c0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.973+0000 7fcd4e5dff40 1 --2- 172.21.15.78:0/3002484917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a946ce900 0x555a9470fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.973+0000 7fcd4e5dff40 1 -- 172.21.15.78:0/3002484917 >> 172.21.15.78:0/3002484917 conn(0x555a945ebac0 msgr2=0x555a9477ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:05.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.973+0000 7fcd4e5dff40 1 -- 172.21.15.78:0/3002484917 shutdown_connections 2024-09-17T03:14:05.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.973+0000 7fcd4e5dff40 1 -- 172.21.15.78:0/3002484917 wait complete. 2024-09-17T03:14:05.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.974+0000 7fcd4e5dff40 1 Processor -- start 2024-09-17T03:14:05.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.974+0000 7fcd4e5dff40 1 -- start start 2024-09-17T03:14:05.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.975+0000 7fcd4e5dff40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a946ce900 0x555a94715a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.975+0000 7fcd4e5dff40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a94782d10 0x555a947796e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.975+0000 7fcd4e5dff40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a947a0c40 0x555a94779c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.975+0000 7fcd4e5dff40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x555a9470e490 con 0x555a946ce900 2024-09-17T03:14:05.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.975+0000 7fcd4e5dff40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555a9470dd20 con 0x555a94782d10 2024-09-17T03:14:05.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.975+0000 7fcd4e5dff40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x555a94796a50 con 0x555a947a0c40 2024-09-17T03:14:05.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.975+0000 7fcd48099640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a946ce900 0x555a94715a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.975+0000 7fcd48099640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a946ce900 0x555a94715a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32962/0 (socket says 172.21.15.78:32962) 2024-09-17T03:14:05.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.975+0000 7fcd48099640 1 -- 172.21.15.78:0/3354113194 learned_addr learned my addr 172.21.15.78:0/3354113194 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:05.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.975+0000 7fcd4889a640 1 --2- 172.21.15.78:0/3354113194 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a947a0c40 0x555a94779c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.975+0000 7fcd3ffff640 1 --2- 172.21.15.78:0/3354113194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a94782d10 0x555a947796e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.976+0000 7fcd48099640 1 -- 172.21.15.78:0/3354113194 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a947a0c40 msgr2=0x555a94779c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.976+0000 7fcd48099640 1 --2- 172.21.15.78:0/3354113194 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a947a0c40 0x555a94779c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.976+0000 7fcd48099640 1 -- 172.21.15.78:0/3354113194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a94782d10 msgr2=0x555a947796e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.976+0000 7fcd48099640 1 --2- 172.21.15.78:0/3354113194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a94782d10 0x555a947796e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.976+0000 7fcd48099640 1 -- 172.21.15.78:0/3354113194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a94712240 con 0x555a946ce900 2024-09-17T03:14:05.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.976+0000 7fcd4889a640 1 --2- 172.21.15.78:0/3354113194 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555a947a0c40 0x555a94779c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:05.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.976+0000 7fcd3ffff640 1 --2- 172.21.15.78:0/3354113194 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555a94782d10 0x555a947796e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:05.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.976+0000 7fcd48099640 1 --2- 172.21.15.78:0/3354113194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a946ce900 0x555a94715a30 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fcd380260a0 tx=0x7fcd38056bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.976+0000 7fcd46095640 1 -- 172.21.15.78:0/3354113194 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd38004640 con 0x555a946ce900 2024-09-17T03:14:05.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.976+0000 7fcd46095640 1 -- 172.21.15.78:0/3354113194 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd38056db0 con 0x555a946ce900 2024-09-17T03:14:05.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.976+0000 7fcd4e5dff40 1 -- 172.21.15.78:0/3354113194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a947124b0 con 0x555a946ce900 2024-09-17T03:14:05.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.976+0000 7fcd46095640 1 -- 172.21.15.78:0/3354113194 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd38063480 con 0x555a946ce900 2024-09-17T03:14:05.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.976+0000 7fcd4e5dff40 1 -- 172.21.15.78:0/3354113194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a94799510 con 0x555a946ce900 2024-09-17T03:14:05.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.978+0000 7fcd46095640 1 -- 172.21.15.78:0/3354113194 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcd38063620 con 0x555a946ce900 2024-09-17T03:14:05.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.978+0000 7fcd46095640 1 --2- 172.21.15.78:0/3354113194 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcd280775a0 0x7fcd28079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.978+0000 7fcd46095640 1 -- 172.21.15.78:0/3354113194 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fcd380ddd60 con 0x555a946ce900 2024-09-17T03:14:05.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.978+0000 7fcd4e5dff40 1 --2- 172.21.15.78:0/3354113194 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x555a9477d810 0x555a9483b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:05.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.978+0000 7fcd3ffff640 1 --2- 172.21.15.78:0/3354113194 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcd280775a0 0x7fcd28079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.978+0000 7fcd4e5dff40 1 -- 172.21.15.78:0/3354113194 --> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] -- osd_op(unknown.0.0:1 12.1d 12:bbf5850a:::10000000007.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82) -- 0x555a94715f70 con 0x555a9477d810 2024-09-17T03:14:05.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.979+0000 7fcd4889a640 1 --2- 172.21.15.78:0/3354113194 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x555a9477d810 0x555a9483b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:05.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.979+0000 7fcd4889a640 1 --2- 172.21.15.78:0/3354113194 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x555a9477d810 0x555a9483b1c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.979+0000 7fcd3ffff640 1 --2- 172.21.15.78:0/3354113194 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcd280775a0 0x7fcd28079ab0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcd30001d90 tx=0x7fcd3000e000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:05.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.980+0000 7fcd4889a640 1 -- 172.21.15.78:0/3354113194 <== osd.0 v2:172.21.15.78:6816/3825297687 1 ==== osd_op_reply(1 10000000007.00000000 [rmxattr] v82'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fcd400015e0 con 0x555a9477d810 2024-09-17T03:14:05.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.980+0000 7fcd4e5dff40 1 -- 172.21.15.78:0/3354113194 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x555a9477d810 msgr2=0x555a9483b1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.980+0000 7fcd4e5dff40 1 --2- 172.21.15.78:0/3354113194 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x555a9477d810 0x555a9483b1c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.980+0000 7fcd4e5dff40 1 -- 172.21.15.78:0/3354113194 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcd280775a0 msgr2=0x7fcd28079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.980+0000 7fcd4e5dff40 1 --2- 172.21.15.78:0/3354113194 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcd280775a0 0x7fcd28079ab0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcd30001d90 tx=0x7fcd3000e000 comp rx=0 tx=0).stop 2024-09-17T03:14:05.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.980+0000 7fcd4e5dff40 1 -- 172.21.15.78:0/3354113194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a946ce900 msgr2=0x555a94715a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:05.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.980+0000 7fcd4e5dff40 1 --2- 172.21.15.78:0/3354113194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555a946ce900 0x555a94715a30 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fcd380260a0 tx=0x7fcd38056bc0 comp rx=0 tx=0).stop 2024-09-17T03:14:05.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.980+0000 7fcd4889a640 1 -- 172.21.15.78:0/3354113194 reap_dead start 2024-09-17T03:14:05.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.980+0000 7fcd4e5dff40 1 -- 172.21.15.78:0/3354113194 shutdown_connections 2024-09-17T03:14:05.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.980+0000 7fcd4e5dff40 1 -- 172.21.15.78:0/3354113194 >> 172.21.15.78:0/3354113194 conn(0x555a945ebac0 msgr2=0x555a9477e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:05.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.980+0000 7fcd4e5dff40 1 -- 172.21.15.78:0/3354113194 shutdown_connections 2024-09-17T03:14:05.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:05.980+0000 7fcd4e5dff40 1 -- 172.21.15.78:0/3354113194 wait complete. 2024-09-17T03:14:05.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:05.983 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /d1/d2/d3 recursive,force 2024-09-17T03:14:06.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.101+0000 7fca8078b640 1 -- 172.21.15.78:0/3905912379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca780b7a00 msgr2=0x7fca780d0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.101+0000 7fca8078b640 1 --2- 172.21.15.78:0/3905912379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca780b7a00 0x7fca780d0950 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fca78074c40 tx=0x7fca7402a540 comp rx=0 tx=0).stop 2024-09-17T03:14:06.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.101+0000 7fca8078b640 1 -- 172.21.15.78:0/3905912379 shutdown_connections 2024-09-17T03:14:06.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.101+0000 7fca8078b640 1 --2- 172.21.15.78:0/3905912379 >> v2:172.21.15.193:3300/0 conn(0x7fca780b20a0 0x7fca780b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.101+0000 7fca8078b640 1 --2- 172.21.15.78:0/3905912379 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fca780d0e90 0x7fca780b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.101+0000 7fca8078b640 1 --2- 172.21.15.78:0/3905912379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca780b7a00 0x7fca780d0950 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.101+0000 7fca8078b640 1 -- 172.21.15.78:0/3905912379 >> 172.21.15.78:0/3905912379 conn(0x7fca780ced80 msgr2=0x7fca780cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.101+0000 7fca8078b640 1 -- 172.21.15.78:0/3905912379 shutdown_connections 2024-09-17T03:14:06.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.101+0000 7fca8078b640 1 -- 172.21.15.78:0/3905912379 wait complete. 2024-09-17T03:14:06.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.102+0000 7fca8078b640 1 Processor -- start 2024-09-17T03:14:06.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.102+0000 7fca8078b640 1 -- start start 2024-09-17T03:14:06.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.104+0000 7fca8078b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca780b20a0 0x7fca781e7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.104+0000 7fca8078b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca780b7a00 0x7fca7809cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.104+0000 7fca8078b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fca780d0e90 0x7fca7815b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.104+0000 7fca8078b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fca780b18b0 con 0x7fca780b7a00 2024-09-17T03:14:06.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.104+0000 7fca8078b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fca780b1730 con 0x7fca780b20a0 2024-09-17T03:14:06.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.104+0000 7fca8078b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fca781608c0 con 0x7fca780d0e90 2024-09-17T03:14:06.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.104+0000 7fca7dd26640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca780b7a00 0x7fca7809cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.104+0000 7fca7dd26640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca780b7a00 0x7fca7809cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32980/0 (socket says 172.21.15.78:32980) 2024-09-17T03:14:06.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.104+0000 7fca7dd26640 1 -- 172.21.15.78:0/190381074 learned_addr learned my addr 172.21.15.78:0/190381074 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.104+0000 7fca7e527640 1 --2- 172.21.15.78:0/190381074 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca780b20a0 0x7fca781e7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.104+0000 7fca7ed28640 1 --2- 172.21.15.78:0/190381074 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fca780d0e90 0x7fca7815b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.104+0000 7fca7dd26640 1 -- 172.21.15.78:0/190381074 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fca780d0e90 msgr2=0x7fca7815b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.104+0000 7fca7dd26640 1 --2- 172.21.15.78:0/190381074 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fca780d0e90 0x7fca7815b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.104+0000 7fca7dd26640 1 -- 172.21.15.78:0/190381074 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca780b20a0 msgr2=0x7fca781e7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.104+0000 7fca7dd26640 1 --2- 172.21.15.78:0/190381074 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca780b20a0 0x7fca781e7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.104+0000 7fca7dd26640 1 -- 172.21.15.78:0/190381074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca7809f5a0 con 0x7fca780b7a00 2024-09-17T03:14:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.104+0000 7fca7dd26640 1 --2- 172.21.15.78:0/190381074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca780b7a00 0x7fca7809cc80 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fca6800c7a0 tx=0x7fca6800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.104+0000 7fca6effd640 1 -- 172.21.15.78:0/190381074 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca68007b50 con 0x7fca780b7a00 2024-09-17T03:14:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.104+0000 7fca6effd640 1 -- 172.21.15.78:0/190381074 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca68007e00 con 0x7fca780b7a00 2024-09-17T03:14:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.105+0000 7fca8078b640 1 -- 172.21.15.78:0/190381074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca7809f880 con 0x7fca780b7a00 2024-09-17T03:14:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.105+0000 7fca6effd640 1 -- 172.21.15.78:0/190381074 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca68005280 con 0x7fca780b7a00 2024-09-17T03:14:06.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.105+0000 7fca8078b640 1 -- 172.21.15.78:0/190381074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca7809fe40 con 0x7fca780b7a00 2024-09-17T03:14:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.106+0000 7fca6effd640 1 -- 172.21.15.78:0/190381074 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fca68005420 con 0x7fca780b7a00 2024-09-17T03:14:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.107+0000 7fca6effd640 1 --2- 172.21.15.78:0/190381074 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fca5c078b90 0x7fca5c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.107+0000 7fca6effd640 1 -- 172.21.15.78:0/190381074 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fca6809b180 con 0x7fca780b7a00 2024-09-17T03:14:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.107+0000 7fca7e527640 1 --2- 172.21.15.78:0/190381074 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fca5c078b90 0x7fca5c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.108+0000 7fca7e527640 1 --2- 172.21.15.78:0/190381074 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fca5c078b90 0x7fca5c07b0a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fca74034000 tx=0x7fca74004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.108+0000 7fca877d6740 1 Processor -- start 2024-09-17T03:14:06.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.108+0000 7fca877d6740 1 -- start start 2024-09-17T03:14:06.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.109+0000 7fca877d6740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 0x5630f1665540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.109+0000 7fca877d6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 0x5630f1648210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.109+0000 7fca877d6740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f12559a0 0x5630f1648750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.109+0000 7fca877d6740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5630f15910b0 con 0x5630f1276680 2024-09-17T03:14:06.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.109+0000 7fca877d6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5630f15804e0 con 0x5630f124d7c0 2024-09-17T03:14:06.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.109+0000 7fca877d6740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5630f15842f0 con 0x5630f12559a0 2024-09-17T03:14:06.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.109+0000 7fca7e527640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 0x5630f1665540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.109+0000 7fca7e527640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 0x5630f1665540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32986/0 (socket says 172.21.15.78:32986) 2024-09-17T03:14:06.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.109+0000 7fca7e527640 1 -- 172.21.15.78:0/338321213 learned_addr learned my addr 172.21.15.78:0/338321213 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.109+0000 7fca7dd26640 1 --2- 172.21.15.78:0/338321213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 0x5630f1648210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.110+0000 7fca7ed28640 1 --2- 172.21.15.78:0/338321213 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f12559a0 0x5630f1648750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.110+0000 7fca7e527640 1 -- 172.21.15.78:0/338321213 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f12559a0 msgr2=0x5630f1648750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.110+0000 7fca7e527640 1 --2- 172.21.15.78:0/338321213 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f12559a0 0x5630f1648750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.110+0000 7fca7e527640 1 -- 172.21.15.78:0/338321213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 msgr2=0x5630f1648210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.110+0000 7fca7e527640 1 --2- 172.21.15.78:0/338321213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 0x5630f1648210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.110+0000 7fca7e527640 1 -- 172.21.15.78:0/338321213 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630f1356a50 con 0x5630f1276680 2024-09-17T03:14:06.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.110+0000 7fca7e527640 1 --2- 172.21.15.78:0/338321213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 0x5630f1665540 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fca740099d0 tx=0x7fca7403e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cda0d574bdcb593 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.110+0000 7fca5bfff640 1 -- 172.21.15.78:0/338321213 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca74004ca0 con 0x5630f1276680 2024-09-17T03:14:06.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.110+0000 7fca5bfff640 1 -- 172.21.15.78:0/338321213 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca7404b030 con 0x5630f1276680 2024-09-17T03:14:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.110+0000 7fca5bfff640 1 -- 172.21.15.78:0/338321213 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca740042b0 con 0x5630f1276680 2024-09-17T03:14:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.111+0000 7fca877d6740 1 -- 172.21.15.78:0/338321213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 msgr2=0x5630f1665540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.111+0000 7fca877d6740 1 --2- 172.21.15.78:0/338321213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 0x5630f1665540 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fca740099d0 tx=0x7fca7403e040 comp rx=0 tx=0).stop 2024-09-17T03:14:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.111+0000 7fca877d6740 1 -- 172.21.15.78:0/338321213 shutdown_connections 2024-09-17T03:14:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.111+0000 7fca877d6740 1 --2- 172.21.15.78:0/338321213 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f12559a0 0x5630f1648750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.111+0000 7fca877d6740 1 --2- 172.21.15.78:0/338321213 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 0x5630f1648210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.111+0000 7fca877d6740 1 --2- 172.21.15.78:0/338321213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 0x5630f1665540 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.111+0000 7fca877d6740 1 -- 172.21.15.78:0/338321213 >> 172.21.15.78:0/338321213 conn(0x5630f126a7d0 msgr2=0x5630f161e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.111+0000 7fca877d6740 1 -- 172.21.15.78:0/338321213 shutdown_connections 2024-09-17T03:14:06.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.111+0000 7fca877d6740 1 -- 172.21.15.78:0/338321213 wait complete. 2024-09-17T03:14:06.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.112+0000 7fca877d6740 1 -- start start 2024-09-17T03:14:06.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.112+0000 7fca877d6740 1 Processor -- start 2024-09-17T03:14:06.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.113+0000 7fca877d6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 0x5630f165def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.113+0000 7fca877d6740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f12559a0 0x5630f1636450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.113+0000 7fca877d6740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f1276680 0x5630f161d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.113+0000 7fca877d6740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5630f12f0a30 con 0x5630f12559a0 2024-09-17T03:14:06.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.113+0000 7fca877d6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5630f15069d0 con 0x5630f124d7c0 2024-09-17T03:14:06.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.113+0000 7fca877d6740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5630f165b980 con 0x5630f1276680 2024-09-17T03:14:06.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.114+0000 7fca877d6740 10 client.0 _ll_register_callbacks cb 0x5630f157aac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:06.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.114+0000 7fca7dd26640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f12559a0 0x5630f1636450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.114+0000 7fca7dd26640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f12559a0 0x5630f1636450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32994/0 (socket says 172.21.15.78:32994) 2024-09-17T03:14:06.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.114+0000 7fca7dd26640 1 -- 172.21.15.78:0/3608356001 learned_addr learned my addr 172.21.15.78:0/3608356001 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.114+0000 7fca7e527640 1 --2- 172.21.15.78:0/3608356001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 0x5630f165def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.114+0000 7fca7ed28640 1 --2- 172.21.15.78:0/3608356001 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f1276680 0x5630f161d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.114+0000 7fca7dd26640 1 -- 172.21.15.78:0/3608356001 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f1276680 msgr2=0x5630f161d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.114+0000 7fca7dd26640 1 --2- 172.21.15.78:0/3608356001 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f1276680 0x5630f161d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.114+0000 7fca7dd26640 1 -- 172.21.15.78:0/3608356001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 msgr2=0x5630f165def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.114+0000 7fca7dd26640 1 --2- 172.21.15.78:0/3608356001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 0x5630f165def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.114+0000 7fca7dd26640 1 -- 172.21.15.78:0/3608356001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630f12bf990 con 0x5630f12559a0 2024-09-17T03:14:06.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.114+0000 7fca7dd26640 1 --2- 172.21.15.78:0/3608356001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f12559a0 0x5630f1636450 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fca68062c60 tx=0x7fca68063500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eafcb3153cb3463e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.114+0000 7fca597fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:06.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.114+0000 7fca597fa640 1 -- 172.21.15.78:0/3608356001 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6801d040 con 0x5630f12559a0 2024-09-17T03:14:06.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.114+0000 7fca597fa640 1 -- 172.21.15.78:0/3608356001 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fca6804e1c0 con 0x5630f12559a0 2024-09-17T03:14:06.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.114+0000 7fca877d6740 1 -- 172.21.15.78:0/3608356001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca7404b030 con 0x5630f12559a0 2024-09-17T03:14:06.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.114+0000 7fca597fa640 1 -- 172.21.15.78:0/3608356001 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fca68062f60 con 0x5630f12559a0 2024-09-17T03:14:06.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.114+0000 7fca877d6740 10 client.7818 fetch_fsmap learned FSMap version 83 2024-09-17T03:14:06.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.114+0000 7fca877d6740 1 -- 172.21.15.78:0/3608356001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x5630f13b71e0 con 0x5630f12559a0 2024-09-17T03:14:06.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.114+0000 7fca597fa640 1 -- 172.21.15.78:0/3608356001 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca7404b030 con 0x5630f12559a0 2024-09-17T03:14:06.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.115+0000 7fca597fa640 1 -- 172.21.15.78:0/3608356001 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 83) ==== 3554+0+0 (secure 0 0 0) 0x7fca68068b20 con 0x5630f12559a0 2024-09-17T03:14:06.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.115+0000 7fca877d6740 10 client.7818 fetch_fsmap finished waiting for FSMap version 83 2024-09-17T03:14:06.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.115+0000 7fca877d6740 10 client.7818 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T03:14:06.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.115+0000 7fca877d6740 20 client.7818 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:06.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.115+0000 7fca877d6740 1 --2- 172.21.15.78:0/3608356001 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x5630f1235250 0x5630f165a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.115+0000 7fca877d6740 4 client.7818 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:14:06.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.115+0000 7fca877d6740 1 -- 172.21.15.78:0/3608356001 --> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630f1593000 con 0x5630f1235250 2024-09-17T03:14:06.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.115+0000 7fca7e527640 1 --2- 172.21.15.78:0/3608356001 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x5630f1235250 0x5630f165a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.115+0000 7fca597fa640 10 client.7818 ms_handle_connect on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:06.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.115+0000 7fca7e527640 1 --2- 172.21.15.78:0/3608356001 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x5630f1235250 0x5630f165a480 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16a20806f4f23fe4 server_cookie=a0e46fdfe74a6754 in_seq=0 out_seq=0 2024-09-17T03:14:06.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.116+0000 7fca597fa640 1 -- 172.21.15.78:0/3608356001 <== mds.0 v2:172.21.15.78:6833/3357123265 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5630f1593000 con 0x5630f1235250 2024-09-17T03:14:06.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.116+0000 7fca597fa640 10 client.7818 handle_command_reply: tid=0 2024-09-17T03:14:06.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.116+0000 7fca877d6740 1 client.7818 shutdown 2024-09-17T03:14:06.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.116+0000 7fca877d6740 1 -- 172.21.15.78:0/3608356001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f12559a0 msgr2=0x5630f1636450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.116+0000 7fca877d6740 1 --2- 172.21.15.78:0/3608356001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f12559a0 0x5630f1636450 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fca68062c60 tx=0x7fca68063500 comp rx=0 tx=0).stop 2024-09-17T03:14:06.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.116+0000 7fca877d6740 1 -- 172.21.15.78:0/3608356001 shutdown_connections 2024-09-17T03:14:06.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.116+0000 7fca877d6740 1 --2- 172.21.15.78:0/3608356001 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x5630f1235250 0x5630f165a480 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.116+0000 7fca877d6740 1 --2- 172.21.15.78:0/3608356001 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f1276680 0x5630f161d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.116+0000 7fca597fa640 0 client.7818 ms_handle_reset on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:06.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.116+0000 7fca877d6740 1 --2- 172.21.15.78:0/3608356001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f12559a0 0x5630f1636450 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.116+0000 7fca877d6740 1 --2- 172.21.15.78:0/3608356001 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 0x5630f165def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.116+0000 7fca877d6740 1 -- 172.21.15.78:0/3608356001 >> 172.21.15.78:0/3608356001 conn(0x5630f126a7d0 msgr2=0x5630f1617740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.116+0000 7fca877d6740 1 -- 172.21.15.78:0/3608356001 shutdown_connections 2024-09-17T03:14:06.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.116+0000 7fca877d6740 1 -- 172.21.15.78:0/3608356001 wait complete. 2024-09-17T03:14:06.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.116+0000 7fca877d6740 20 client.7818 trim_cache size 0 max 16384 2024-09-17T03:14:06.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.134+0000 7fca877d6740 1 Processor -- start 2024-09-17T03:14:06.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.134+0000 7fca877d6740 1 -- start start 2024-09-17T03:14:06.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.135+0000 7fca877d6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 0x5630f165a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.135+0000 7fca877d6740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f12559a0 0x5630f165bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.135+0000 7fca877d6740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 0x5630f165c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.135+0000 7fca877d6740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fca781fff10 con 0x5630f1276680 2024-09-17T03:14:06.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.135+0000 7fca877d6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fca781ff160 con 0x5630f124d7c0 2024-09-17T03:14:06.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.135+0000 7fca877d6740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fca781ff7e0 con 0x5630f12559a0 2024-09-17T03:14:06.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.135+0000 7fca7ed28640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 0x5630f165c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.135+0000 7fca7ed28640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 0x5630f165c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33006/0 (socket says 172.21.15.78:33006) 2024-09-17T03:14:06.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.135+0000 7fca7ed28640 1 -- 172.21.15.78:0/1471335675 learned_addr learned my addr 172.21.15.78:0/1471335675 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.135+0000 7fca7dd26640 1 --2- 172.21.15.78:0/1471335675 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f12559a0 0x5630f165bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.135+0000 7fca7ed28640 1 -- 172.21.15.78:0/1471335675 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f12559a0 msgr2=0x5630f165bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.135+0000 7fca7ed28640 1 --2- 172.21.15.78:0/1471335675 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f12559a0 0x5630f165bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.135+0000 7fca7e527640 1 --2- 172.21.15.78:0/1471335675 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 0x5630f165a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.135+0000 7fca7ed28640 1 -- 172.21.15.78:0/1471335675 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 msgr2=0x5630f165a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.135+0000 7fca7ed28640 1 --2- 172.21.15.78:0/1471335675 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 0x5630f165a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.135+0000 7fca7ed28640 1 -- 172.21.15.78:0/1471335675 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630f165ff60 con 0x5630f1276680 2024-09-17T03:14:06.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.135+0000 7fca7dd26640 1 --2- 172.21.15.78:0/1471335675 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f12559a0 0x5630f165bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:06.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.135+0000 7fca7e527640 1 --2- 172.21.15.78:0/1471335675 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 0x5630f165a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:06.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.136+0000 7fca7ed28640 1 --2- 172.21.15.78:0/1471335675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 0x5630f165c050 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fca7000ade0 tx=0x7fca70012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3431f6c6a94d03 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.136+0000 7fca5b7fe640 1 -- 172.21.15.78:0/1471335675 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca70004b20 con 0x5630f1276680 2024-09-17T03:14:06.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.136+0000 7fca5b7fe640 1 -- 172.21.15.78:0/1471335675 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca70004cc0 con 0x5630f1276680 2024-09-17T03:14:06.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.136+0000 7fca5b7fe640 1 -- 172.21.15.78:0/1471335675 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7000f950 con 0x5630f1276680 2024-09-17T03:14:06.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.136+0000 7fca877d6740 1 -- 172.21.15.78:0/1471335675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 msgr2=0x5630f165c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.136+0000 7fca877d6740 1 --2- 172.21.15.78:0/1471335675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 0x5630f165c050 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fca7000ade0 tx=0x7fca70012820 comp rx=0 tx=0).stop 2024-09-17T03:14:06.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.136+0000 7fca877d6740 1 -- 172.21.15.78:0/1471335675 shutdown_connections 2024-09-17T03:14:06.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.136+0000 7fca877d6740 1 --2- 172.21.15.78:0/1471335675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 0x5630f165c050 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.136+0000 7fca877d6740 1 --2- 172.21.15.78:0/1471335675 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f12559a0 0x5630f165bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.136+0000 7fca877d6740 1 --2- 172.21.15.78:0/1471335675 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 0x5630f165a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.136+0000 7fca877d6740 1 -- 172.21.15.78:0/1471335675 >> 172.21.15.78:0/1471335675 conn(0x5630f126a7d0 msgr2=0x5630f16591e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.137+0000 7fca877d6740 1 -- 172.21.15.78:0/1471335675 shutdown_connections 2024-09-17T03:14:06.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.137+0000 7fca877d6740 1 -- 172.21.15.78:0/1471335675 wait complete. 2024-09-17T03:14:06.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.137+0000 7fca877d6740 1 -- start start 2024-09-17T03:14:06.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.137+0000 7fca877d6740 1 Processor -- start 2024-09-17T03:14:06.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.139+0000 7fca877d6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 0x5630f16e7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.139+0000 7fca877d6740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f12559a0 0x5630f161d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.139+0000 7fca877d6740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 0x5630f161c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.139+0000 7fca877d6740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5630f165b270 con 0x5630f1276680 2024-09-17T03:14:06.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.139+0000 7fca877d6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fca781e5cb0 con 0x5630f124d7c0 2024-09-17T03:14:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.139+0000 7fca877d6740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5630f161a380 con 0x5630f12559a0 2024-09-17T03:14:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.139+0000 7fca877d6740 10 client.0 _ll_register_callbacks cb 0x7fca6805eef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.139+0000 7fca7ed28640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 0x5630f161c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.139+0000 7fca7ed28640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 0x5630f161c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33012/0 (socket says 172.21.15.78:33012) 2024-09-17T03:14:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.139+0000 7fca7ed28640 1 -- 172.21.15.78:0/449615381 learned_addr learned my addr 172.21.15.78:0/449615381 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.139+0000 7fca7e527640 1 --2- 172.21.15.78:0/449615381 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 0x5630f16e7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.139+0000 7fca7dd26640 1 --2- 172.21.15.78:0/449615381 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f12559a0 0x5630f161d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.139+0000 7fca7ed28640 1 -- 172.21.15.78:0/449615381 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f12559a0 msgr2=0x5630f161d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.139+0000 7fca7ed28640 1 --2- 172.21.15.78:0/449615381 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f12559a0 0x5630f161d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.139+0000 7fca7ed28640 1 -- 172.21.15.78:0/449615381 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 msgr2=0x5630f16e7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.139+0000 7fca7ed28640 1 --2- 172.21.15.78:0/449615381 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 0x5630f16e7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.139+0000 7fca7ed28640 1 -- 172.21.15.78:0/449615381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630f1354d50 con 0x5630f1276680 2024-09-17T03:14:06.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.139+0000 7fca7ed28640 1 --2- 172.21.15.78:0/449615381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 0x5630f161c150 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fca7001d040 tx=0x7fca7000fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c314588a4d338e7b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.139+0000 7fca597fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.140+0000 7fca597fa640 1 -- 172.21.15.78:0/449615381 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca7002a020 con 0x5630f1276680 2024-09-17T03:14:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.140+0000 7fca597fa640 1 -- 172.21.15.78:0/449615381 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fca70026470 con 0x5630f1276680 2024-09-17T03:14:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.140+0000 7fca877d6740 1 -- 172.21.15.78:0/449615381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca70004cc0 con 0x5630f1276680 2024-09-17T03:14:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.140+0000 7fca597fa640 1 -- 172.21.15.78:0/449615381 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fca70004b20 con 0x5630f1276680 2024-09-17T03:14:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.140+0000 7fca877d6740 10 client.7824 fetch_fsmap learned FSMap version 83 2024-09-17T03:14:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.140+0000 7fca877d6740 1 -- 172.21.15.78:0/449615381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x5630f16e3cc0 con 0x5630f1276680 2024-09-17T03:14:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.140+0000 7fca597fa640 1 -- 172.21.15.78:0/449615381 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca70004cc0 con 0x5630f1276680 2024-09-17T03:14:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.140+0000 7fca597fa640 1 -- 172.21.15.78:0/449615381 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 83) ==== 3554+0+0 (secure 0 0 0) 0x7fca700266b0 con 0x5630f1276680 2024-09-17T03:14:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.140+0000 7fca877d6740 10 client.7824 fetch_fsmap finished waiting for FSMap version 83 2024-09-17T03:14:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.140+0000 7fca877d6740 10 client.7824 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T03:14:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.140+0000 7fca877d6740 20 client.7824 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.140+0000 7fca877d6740 1 --2- 172.21.15.78:0/449615381 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x5630f16e41e0 0x5630f165a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.140+0000 7fca877d6740 4 client.7824 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}] 2024-09-17T03:14:06.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.140+0000 7fca877d6740 1 -- 172.21.15.78:0/449615381 --> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}) -- 0x5630f158eab0 con 0x5630f16e41e0 2024-09-17T03:14:06.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.140+0000 7fca7e527640 1 --2- 172.21.15.78:0/449615381 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x5630f16e41e0 0x5630f165a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.141+0000 7fca597fa640 10 client.7824 ms_handle_connect on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:06.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.141+0000 7fca7e527640 1 --2- 172.21.15.78:0/449615381 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x5630f16e41e0 0x5630f165a650 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf61034416ba22dd server_cookie=6202659b8eb19e3a in_seq=0 out_seq=0 2024-09-17T03:14:06.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.141+0000 7fca597fa640 1 -- 172.21.15.78:0/449615381 <== mds.0 v2:172.21.15.78:6833/3357123265 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5630f158eab0 con 0x5630f16e41e0 2024-09-17T03:14:06.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.141+0000 7fca597fa640 10 client.7824 handle_command_reply: tid=0 2024-09-17T03:14:06.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.141+0000 7fca877d6740 1 client.7824 shutdown 2024-09-17T03:14:06.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.141+0000 7fca877d6740 1 -- 172.21.15.78:0/449615381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 msgr2=0x5630f161c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.141+0000 7fca877d6740 1 --2- 172.21.15.78:0/449615381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 0x5630f161c150 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fca7001d040 tx=0x7fca7000fe40 comp rx=0 tx=0).stop 2024-09-17T03:14:06.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.142+0000 7fca877d6740 1 -- 172.21.15.78:0/449615381 shutdown_connections 2024-09-17T03:14:06.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.142+0000 7fca877d6740 1 --2- 172.21.15.78:0/449615381 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x5630f16e41e0 0x5630f165a650 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.142+0000 7fca877d6740 1 --2- 172.21.15.78:0/449615381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5630f1276680 0x5630f161c150 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.142+0000 7fca877d6740 1 --2- 172.21.15.78:0/449615381 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5630f12559a0 0x5630f161d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.142+0000 7fca877d6740 1 --2- 172.21.15.78:0/449615381 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5630f124d7c0 0x5630f16e7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.142+0000 7fca597fa640 0 client.7824 ms_handle_reset on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:06.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.142+0000 7fca877d6740 1 -- 172.21.15.78:0/449615381 >> 172.21.15.78:0/449615381 conn(0x5630f126a7d0 msgr2=0x5630f16484b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.146 INFO:tasks.ceph.mds.a.smithi078.stderr:2024-09-17T03:14:06.142+0000 7f4bc4720640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-17T03:13:50.792924+0000 1=0+1) n(v3 rc2024-09-17T03:13:51.023920+0000 6=0+6) (inest mix dirty) (ifile excl) caps={6278=pAsLsXsFsx/pAsLsXsFsxcral@4},l=6278 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55684b109080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:13:50.792924+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:13:51.023920+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-17T03:13:50.792924+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-17T03:13:51.023920+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-17T03:14:06.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.142+0000 7fca877d6740 1 -- 172.21.15.78:0/449615381 shutdown_connections 2024-09-17T03:14:06.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.142+0000 7fca877d6740 1 -- 172.21.15.78:0/449615381 wait complete. 2024-09-17T03:14:06.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.142+0000 7fca877d6740 20 client.7824 trim_cache size 0 max 16384 2024-09-17T03:14:06.147 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:14:06.147 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-17T03:14:06.147 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "06dff376-fc02-4326-a75b-2bb8deb474f9", 2024-09-17T03:14:06.147 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-17T03:14:06.147 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:14:06.148 INFO:tasks.ceph.mds.c.smithi078.stderr:2024-09-17T03:14:06.142+0000 7fc46837a640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-17T03:13:50.793924+0000 1=0+1) n(v2 rc2024-09-17T03:13:51.023920+0000 4=0+4) (inest lock) (ifile excl) caps={6278=pAsLsXsFsx/pAsLsXsFsxcral@4},l=6278 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x55f481a8e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:13:50.793924+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:13:51.023920+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-17T03:13:50.793924+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-17T03:13:51.023920+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-17T03:14:06.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.142+0000 7fca8078b640 1 -- 172.21.15.78:0/190381074 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fca5c078b90 msgr2=0x7fca5c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.142+0000 7fca8078b640 1 --2- 172.21.15.78:0/190381074 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fca5c078b90 0x7fca5c07b0a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fca74034000 tx=0x7fca74004730 comp rx=0 tx=0).stop 2024-09-17T03:14:06.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.142+0000 7fca8078b640 1 -- 172.21.15.78:0/190381074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca780b7a00 msgr2=0x7fca7809cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.142+0000 7fca8078b640 1 --2- 172.21.15.78:0/190381074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca780b7a00 0x7fca7809cc80 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fca6800c7a0 tx=0x7fca6800cc60 comp rx=0 tx=0).stop 2024-09-17T03:14:06.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.143+0000 7fca8078b640 1 -- 172.21.15.78:0/190381074 shutdown_connections 2024-09-17T03:14:06.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.143+0000 7fca8078b640 1 --2- 172.21.15.78:0/190381074 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fca780d0e90 0x7fca7815b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.143+0000 7fca8078b640 1 --2- 172.21.15.78:0/190381074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca780b7a00 0x7fca7809cc80 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.143+0000 7fca8078b640 1 --2- 172.21.15.78:0/190381074 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fca5c078b90 0x7fca5c07b0a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.143+0000 7fca8078b640 1 --2- 172.21.15.78:0/190381074 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fca780b20a0 0x7fca781e7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.143+0000 7fca8078b640 1 -- 172.21.15.78:0/190381074 >> 172.21.15.78:0/190381074 conn(0x7fca780ced80 msgr2=0x7fca780b0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.143+0000 7fca8078b640 1 -- 172.21.15.78:0/190381074 shutdown_connections 2024-09-17T03:14:06.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.143+0000 7fca8078b640 1 -- 172.21.15.78:0/190381074 wait complete. 2024-09-17T03:14:06.150 INFO:tasks.ceph.mds.a.smithi078.stderr:2024-09-17T03:14:06.143+0000 7f4bcaf2d640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-17T03:13:50.792924+0000 1=0+1) n(v4 rc2024-09-17T03:13:51.023920+0000 5=0+5) (inest sync->mix g=1,2) caps={6278=pAsLsXsFs/pAsLsXsFsxcral@8} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55684b109600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:13:50.792924+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:13:51.023920+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-17T03:13:50.792924+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-17T03:13:51.023920+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-17T03:14:06.150 INFO:tasks.ceph.mds.c.smithi078.stderr:2024-09-17T03:14:06.144+0000 7fc46eb87640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-17T03:13:50.793924+0000 1=0+1) n(v1 rc2024-09-17T03:13:51.023920+0000 3=0+3) (inest sync->mix g=0,2 scatter_wanted) caps={6278=pAsLsXsFs/pAsLsXsFsxcral@7} | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x55f481a8ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:13:50.793924+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:13:50.794924+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-17T03:13:50.793924+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-17T03:13:51.023920+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-17T03:14:06.150 INFO:tasks.ceph.mds.d.smithi193.stderr:2024-09-17T03:14:06.142+0000 7f049b974640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-17T03:13:50.794924+0000 1=0+1) n(v0 rc2024-09-17T03:13:50.794924+0000 2=0+2) (inest lock) (ifile excl) caps={6278=pAsLsXsFsx/pAsLsXsFsxcral@4},l=6278 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5613af572680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:13:50.794924+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:13:50.794924+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-17T03:13:50.794924+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-17T03:13:50.794924+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-17T03:14:06.151 INFO:tasks.ceph.mds.d.smithi193.stderr:2024-09-17T03:14:06.142+0000 7f049b974640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) caps={6278=pAsLsXsFsx/AsLsXsFsx@2},l=6278 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5613af573700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-17T03:14:06.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:06.153 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub pause 2024-09-17T03:14:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.268+0000 7febef84d640 1 -- 172.21.15.78:0/680694584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febe80b5210 msgr2=0x7febe80ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.268+0000 7febef84d640 1 --2- 172.21.15.78:0/680694584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febe80b5210 0x7febe80ceb50 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7febdc009830 tx=0x7febdc02a510 comp rx=0 tx=0).stop 2024-09-17T03:14:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.268+0000 7febef84d640 1 -- 172.21.15.78:0/680694584 shutdown_connections 2024-09-17T03:14:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.268+0000 7febef84d640 1 --2- 172.21.15.78:0/680694584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febe80b5210 0x7febe80ceb50 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.268+0000 7febef84d640 1 --2- 172.21.15.78:0/680694584 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7febe80ccba0 0x7febe80ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.268+0000 7febef84d640 1 -- 172.21.15.78:0/680694584 >> 172.21.15.78:0/680694584 conn(0x7febe80b3f10 msgr2=0x7febe80b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.268+0000 7febef84d640 1 -- 172.21.15.78:0/680694584 shutdown_connections 2024-09-17T03:14:06.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.268+0000 7febef84d640 1 -- 172.21.15.78:0/680694584 wait complete. 2024-09-17T03:14:06.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.270+0000 7febef84d640 1 Processor -- start 2024-09-17T03:14:06.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.270+0000 7febef84d640 1 -- start start 2024-09-17T03:14:06.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.271+0000 7febef84d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7febe80b5210 0x7febe8147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.271+0000 7febef84d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7febe80ccba0 0x7febe8152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.271+0000 7febef84d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febe80d1d40 0x7febe815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.271+0000 7febef84d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7febe80d11f0 con 0x7febe80d1d40 2024-09-17T03:14:06.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.271+0000 7febef84d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7febe80d1070 con 0x7febe80b5210 2024-09-17T03:14:06.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.271+0000 7febef84d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7febe80d1370 con 0x7febe80ccba0 2024-09-17T03:14:06.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.271+0000 7febeddea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febe80d1d40 0x7febe815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.271+0000 7febeddea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febe80d1d40 0x7febe815efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33026/0 (socket says 172.21.15.78:33026) 2024-09-17T03:14:06.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.271+0000 7febeddea640 1 -- 172.21.15.78:0/1463955707 learned_addr learned my addr 172.21.15.78:0/1463955707 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.271+0000 7febed5e9640 1 --2- 172.21.15.78:0/1463955707 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7febe80b5210 0x7febe8147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.271+0000 7febecde8640 1 --2- 172.21.15.78:0/1463955707 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7febe80ccba0 0x7febe8152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.271+0000 7febeddea640 1 -- 172.21.15.78:0/1463955707 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7febe80ccba0 msgr2=0x7febe8152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.271+0000 7febeddea640 1 --2- 172.21.15.78:0/1463955707 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7febe80ccba0 0x7febe8152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.271+0000 7febeddea640 1 -- 172.21.15.78:0/1463955707 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7febe80b5210 msgr2=0x7febe8147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.271+0000 7febeddea640 1 --2- 172.21.15.78:0/1463955707 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7febe80b5210 0x7febe8147830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.271+0000 7febeddea640 1 -- 172.21.15.78:0/1463955707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febe815df00 con 0x7febe80d1d40 2024-09-17T03:14:06.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.271+0000 7febed5e9640 1 --2- 172.21.15.78:0/1463955707 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7febe80b5210 0x7febe8147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:06.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.272+0000 7febeddea640 1 --2- 172.21.15.78:0/1463955707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febe80d1d40 0x7febe815efa0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7febe000e9c0 tx=0x7febe000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.272+0000 7febe5ffb640 1 -- 172.21.15.78:0/1463955707 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe0004d20 con 0x7febe80d1d40 2024-09-17T03:14:06.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.272+0000 7febe5ffb640 1 -- 172.21.15.78:0/1463955707 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febe000cb20 con 0x7febe80d1d40 2024-09-17T03:14:06.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.272+0000 7febef84d640 1 -- 172.21.15.78:0/1463955707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febe815e1e0 con 0x7febe80d1d40 2024-09-17T03:14:06.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.272+0000 7febe5ffb640 1 -- 172.21.15.78:0/1463955707 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe0005020 con 0x7febe80d1d40 2024-09-17T03:14:06.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.272+0000 7febef84d640 1 -- 172.21.15.78:0/1463955707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febe815e7a0 con 0x7febe80d1d40 2024-09-17T03:14:06.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.274+0000 7febe5ffb640 1 -- 172.21.15.78:0/1463955707 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7febe00051c0 con 0x7febe80d1d40 2024-09-17T03:14:06.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.274+0000 7febe5ffb640 1 --2- 172.21.15.78:0/1463955707 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7febd4078b90 0x7febd407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.275+0000 7febe5ffb640 1 -- 172.21.15.78:0/1463955707 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7febe009b620 con 0x7febe80d1d40 2024-09-17T03:14:06.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.275+0000 7febed5e9640 1 --2- 172.21.15.78:0/1463955707 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7febd4078b90 0x7febd407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.275+0000 7febf67c7740 1 Processor -- start 2024-09-17T03:14:06.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.275+0000 7febf67c7740 1 -- start start 2024-09-17T03:14:06.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.275+0000 7febed5e9640 1 --2- 172.21.15.78:0/1463955707 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7febd4078b90 0x7febd407b0a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7febd8000f60 tx=0x7febd8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.277+0000 7febf67c7740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f04c948390 0x55f04cd37310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.277+0000 7febf67c7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04cd19fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.277+0000 7febf67c7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f04c9276b0 0x55f04cd1a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.277+0000 7febf67c7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f04cc62bd0 con 0x55f04c91f4d0 2024-09-17T03:14:06.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.277+0000 7febf67c7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f04cc52000 con 0x55f04c9276b0 2024-09-17T03:14:06.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.277+0000 7febf67c7740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f04cc55e10 con 0x55f04c948390 2024-09-17T03:14:06.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.277+0000 7febecde8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04cd19fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.277+0000 7febecde8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04cd19fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33034/0 (socket says 172.21.15.78:33034) 2024-09-17T03:14:06.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.277+0000 7febecde8640 1 -- 172.21.15.78:0/1342401857 learned_addr learned my addr 172.21.15.78:0/1342401857 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.277+0000 7febeddea640 1 --2- 172.21.15.78:0/1342401857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f04c9276b0 0x55f04cd1a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.277+0000 7febed5e9640 1 --2- 172.21.15.78:0/1342401857 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f04c948390 0x55f04cd37310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.277+0000 7febecde8640 1 -- 172.21.15.78:0/1342401857 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f04c948390 msgr2=0x55f04cd37310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.277+0000 7febecde8640 1 --2- 172.21.15.78:0/1342401857 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f04c948390 0x55f04cd37310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.277+0000 7febecde8640 1 -- 172.21.15.78:0/1342401857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f04c9276b0 msgr2=0x55f04cd1a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.277+0000 7febecde8640 1 --2- 172.21.15.78:0/1342401857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f04c9276b0 0x55f04cd1a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.277+0000 7febecde8640 1 -- 172.21.15.78:0/1342401857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f04ca2a7d0 con 0x55f04c91f4d0 2024-09-17T03:14:06.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.277+0000 7febecde8640 1 --2- 172.21.15.78:0/1342401857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04cd19fe0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7febdc02ab00 tx=0x7febdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31910b850cd31996 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.277+0000 7febceffd640 1 -- 172.21.15.78:0/1342401857 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc005020 con 0x55f04c91f4d0 2024-09-17T03:14:06.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.277+0000 7febceffd640 1 -- 172.21.15.78:0/1342401857 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febdc040070 con 0x55f04c91f4d0 2024-09-17T03:14:06.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.277+0000 7febceffd640 1 -- 172.21.15.78:0/1342401857 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febdc005530 con 0x55f04c91f4d0 2024-09-17T03:14:06.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.278+0000 7febf67c7740 1 -- 172.21.15.78:0/1342401857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 msgr2=0x55f04cd19fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.278+0000 7febf67c7740 1 --2- 172.21.15.78:0/1342401857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04cd19fe0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7febdc02ab00 tx=0x7febdc0046c0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.278+0000 7febf67c7740 1 -- 172.21.15.78:0/1342401857 shutdown_connections 2024-09-17T03:14:06.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.278+0000 7febf67c7740 1 --2- 172.21.15.78:0/1342401857 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f04c9276b0 0x55f04cd1a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.278+0000 7febf67c7740 1 --2- 172.21.15.78:0/1342401857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04cd19fe0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.278+0000 7febf67c7740 1 --2- 172.21.15.78:0/1342401857 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f04c948390 0x55f04cd37310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.278+0000 7febf67c7740 1 -- 172.21.15.78:0/1342401857 >> 172.21.15.78:0/1342401857 conn(0x55f04c93c4e0 msgr2=0x55f04ccf0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.278+0000 7febf67c7740 1 -- 172.21.15.78:0/1342401857 shutdown_connections 2024-09-17T03:14:06.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.278+0000 7febf67c7740 1 -- 172.21.15.78:0/1342401857 wait complete. 2024-09-17T03:14:06.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.279+0000 7febf67c7740 1 -- start start 2024-09-17T03:14:06.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.279+0000 7febf67c7740 1 Processor -- start 2024-09-17T03:14:06.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febf67c7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04cd47ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febf67c7740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f04c9276b0 0x55f04cd16760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febf67c7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f04c948390 0x55f04cd13650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febf67c7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f04c9c2740 con 0x55f04c91f4d0 2024-09-17T03:14:06.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febf67c7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f04cbf7540 con 0x55f04c948390 2024-09-17T03:14:06.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febf67c7740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f04cd48400 con 0x55f04c9276b0 2024-09-17T03:14:06.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febf67c7740 10 client.0 _ll_register_callbacks cb 0x55f04cbf60e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:06.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febed5e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04cd47ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febed5e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04cd47ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33036/0 (socket says 172.21.15.78:33036) 2024-09-17T03:14:06.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febed5e9640 1 -- 172.21.15.78:0/300785136 learned_addr learned my addr 172.21.15.78:0/300785136 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febecde8640 1 --2- 172.21.15.78:0/300785136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f04c9276b0 0x55f04cd16760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febeddea640 1 --2- 172.21.15.78:0/300785136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f04c948390 0x55f04cd13650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febed5e9640 1 -- 172.21.15.78:0/300785136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f04c9276b0 msgr2=0x55f04cd16760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febed5e9640 1 --2- 172.21.15.78:0/300785136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f04c9276b0 0x55f04cd16760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febed5e9640 1 -- 172.21.15.78:0/300785136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f04c948390 msgr2=0x55f04cd13650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febed5e9640 1 --2- 172.21.15.78:0/300785136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f04c948390 0x55f04cd13650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febed5e9640 1 -- 172.21.15.78:0/300785136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f04c9916a0 con 0x55f04c91f4d0 2024-09-17T03:14:06.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febed5e9640 1 --2- 172.21.15.78:0/300785136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04cd47ec0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7febd800eac0 tx=0x7febd8001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23b61c9c8371458 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febc7fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:06.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febc7fff640 1 -- 172.21.15.78:0/300785136 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd8027060 con 0x55f04c91f4d0 2024-09-17T03:14:06.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febc7fff640 1 -- 172.21.15.78:0/300785136 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7febd8010040 con 0x55f04c91f4d0 2024-09-17T03:14:06.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.281+0000 7febf67c7740 1 -- 172.21.15.78:0/300785136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7febdc040070 con 0x55f04c91f4d0 2024-09-17T03:14:06.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.282+0000 7febc7fff640 1 -- 172.21.15.78:0/300785136 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7febd8003d80 con 0x55f04c91f4d0 2024-09-17T03:14:06.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.282+0000 7febf67c7740 10 client.7839 fetch_fsmap learned FSMap version 83 2024-09-17T03:14:06.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.282+0000 7febf67c7740 1 -- 172.21.15.78:0/300785136 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x55f04ca8af60 con 0x55f04c91f4d0 2024-09-17T03:14:06.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.282+0000 7febc7fff640 1 -- 172.21.15.78:0/300785136 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febdc040070 con 0x55f04c91f4d0 2024-09-17T03:14:06.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.282+0000 7febc7fff640 1 -- 172.21.15.78:0/300785136 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 83) ==== 3554+0+0 (secure 0 0 0) 0x7febd8013420 con 0x55f04c91f4d0 2024-09-17T03:14:06.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.282+0000 7febf67c7740 10 client.7839 fetch_fsmap finished waiting for FSMap version 83 2024-09-17T03:14:06.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.282+0000 7febf67c7740 10 client.7839 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T03:14:06.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.282+0000 7febf67c7740 20 client.7839 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:06.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.282+0000 7febf67c7740 1 --2- 172.21.15.78:0/300785136 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55f04c906f60 0x55f04cd2d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.282+0000 7febf67c7740 4 client.7839 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:14:06.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.282+0000 7febf67c7740 1 -- 172.21.15.78:0/300785136 --> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f04cc64b20 con 0x55f04c906f60 2024-09-17T03:14:06.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.282+0000 7febecde8640 1 --2- 172.21.15.78:0/300785136 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55f04c906f60 0x55f04cd2d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.282+0000 7febc7fff640 10 client.7839 ms_handle_connect on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:06.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.282+0000 7febecde8640 1 --2- 172.21.15.78:0/300785136 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55f04c906f60 0x55f04cd2d610 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=351f7eb8f8f40644 server_cookie=de4ebae48c68a9b8 in_seq=0 out_seq=0 2024-09-17T03:14:06.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.283+0000 7febc7fff640 1 -- 172.21.15.78:0/300785136 <== mds.0 v2:172.21.15.78:6833/3357123265 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f04cc64b20 con 0x55f04c906f60 2024-09-17T03:14:06.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.283+0000 7febc7fff640 10 client.7839 handle_command_reply: tid=0 2024-09-17T03:14:06.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.283+0000 7febf67c7740 1 client.7839 shutdown 2024-09-17T03:14:06.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.283+0000 7febf67c7740 1 -- 172.21.15.78:0/300785136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 msgr2=0x55f04cd47ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.283+0000 7febf67c7740 1 --2- 172.21.15.78:0/300785136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04cd47ec0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7febd800eac0 tx=0x7febd8001080 comp rx=0 tx=0).stop 2024-09-17T03:14:06.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.283+0000 7febf67c7740 1 -- 172.21.15.78:0/300785136 shutdown_connections 2024-09-17T03:14:06.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.283+0000 7febf67c7740 1 --2- 172.21.15.78:0/300785136 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55f04c906f60 0x55f04cd2d610 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.283+0000 7febf67c7740 1 --2- 172.21.15.78:0/300785136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f04c948390 0x55f04cd13650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.283+0000 7febc7fff640 0 client.7839 ms_handle_reset on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:06.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.283+0000 7febf67c7740 1 --2- 172.21.15.78:0/300785136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f04c9276b0 0x55f04cd16760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.283+0000 7febf67c7740 1 --2- 172.21.15.78:0/300785136 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04cd47ec0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.283+0000 7febf67c7740 1 -- 172.21.15.78:0/300785136 >> 172.21.15.78:0/300785136 conn(0x55f04c93c4e0 msgr2=0x55f04cd35950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.283+0000 7febf67c7740 1 -- 172.21.15.78:0/300785136 shutdown_connections 2024-09-17T03:14:06.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.283+0000 7febf67c7740 1 -- 172.21.15.78:0/300785136 wait complete. 2024-09-17T03:14:06.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.284+0000 7febf67c7740 20 client.7839 trim_cache size 0 max 16384 2024-09-17T03:14:06.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.301+0000 7febf67c7740 1 Processor -- start 2024-09-17T03:14:06.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.301+0000 7febf67c7740 1 -- start start 2024-09-17T03:14:06.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.302+0000 7febf67c7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04ccf0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.302+0000 7febf67c7740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f04c9276b0 0x55f04ccf1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.302+0000 7febf67c7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f04c948390 0x55f04cd2e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.302+0000 7febf67c7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7febe8202290 con 0x55f04c91f4d0 2024-09-17T03:14:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.302+0000 7febf67c7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7febe8201460 con 0x55f04c948390 2024-09-17T03:14:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.302+0000 7febf67c7740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7febe8201b60 con 0x55f04c9276b0 2024-09-17T03:14:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.302+0000 7febed5e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04ccf0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.302+0000 7febed5e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04ccf0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33052/0 (socket says 172.21.15.78:33052) 2024-09-17T03:14:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.302+0000 7febed5e9640 1 -- 172.21.15.78:0/43556087 learned_addr learned my addr 172.21.15.78:0/43556087 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.302+0000 7febecde8640 1 --2- 172.21.15.78:0/43556087 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f04c9276b0 0x55f04ccf1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.303+0000 7febed5e9640 1 -- 172.21.15.78:0/43556087 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f04c9276b0 msgr2=0x55f04ccf1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.303+0000 7febed5e9640 1 --2- 172.21.15.78:0/43556087 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f04c9276b0 0x55f04ccf1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.303+0000 7febeddea640 1 --2- 172.21.15.78:0/43556087 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f04c948390 0x55f04cd2e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.303+0000 7febed5e9640 1 -- 172.21.15.78:0/43556087 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f04c948390 msgr2=0x55f04cd2e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.303+0000 7febed5e9640 1 --2- 172.21.15.78:0/43556087 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f04c948390 0x55f04cd2e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.303+0000 7febed5e9640 1 -- 172.21.15.78:0/43556087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f04ca28ad0 con 0x55f04c91f4d0 2024-09-17T03:14:06.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.303+0000 7febecde8640 1 --2- 172.21.15.78:0/43556087 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f04c9276b0 0x55f04ccf1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:06.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.303+0000 7febeddea640 1 --2- 172.21.15.78:0/43556087 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f04c948390 0x55f04cd2e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:06.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.303+0000 7febed5e9640 1 --2- 172.21.15.78:0/43556087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04ccf0ee0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7febd800ea90 tx=0x7febd8008f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4150f400ce44133d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.303+0000 7febce7fc640 1 -- 172.21.15.78:0/43556087 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd80039c0 con 0x55f04c91f4d0 2024-09-17T03:14:06.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.303+0000 7febce7fc640 1 -- 172.21.15.78:0/43556087 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febd8013420 con 0x55f04c91f4d0 2024-09-17T03:14:06.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.303+0000 7febce7fc640 1 -- 172.21.15.78:0/43556087 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd8013970 con 0x55f04c91f4d0 2024-09-17T03:14:06.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.304+0000 7febf67c7740 1 -- 172.21.15.78:0/43556087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 msgr2=0x55f04ccf0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.304+0000 7febf67c7740 1 --2- 172.21.15.78:0/43556087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04ccf0ee0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7febd800ea90 tx=0x7febd8008f20 comp rx=0 tx=0).stop 2024-09-17T03:14:06.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.304+0000 7febf67c7740 1 -- 172.21.15.78:0/43556087 shutdown_connections 2024-09-17T03:14:06.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.304+0000 7febf67c7740 1 --2- 172.21.15.78:0/43556087 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f04c948390 0x55f04cd2e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.304+0000 7febf67c7740 1 --2- 172.21.15.78:0/43556087 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f04c9276b0 0x55f04ccf1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.304+0000 7febf67c7740 1 --2- 172.21.15.78:0/43556087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04ccf0ee0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.304+0000 7febf67c7740 1 -- 172.21.15.78:0/43556087 >> 172.21.15.78:0/43556087 conn(0x55f04c93c4e0 msgr2=0x55f04cd13430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.304+0000 7febf67c7740 1 -- 172.21.15.78:0/43556087 shutdown_connections 2024-09-17T03:14:06.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.304+0000 7febf67c7740 1 -- 172.21.15.78:0/43556087 wait complete. 2024-09-17T03:14:06.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.304+0000 7febf67c7740 1 -- start start 2024-09-17T03:14:06.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.305+0000 7febf67c7740 1 Processor -- start 2024-09-17T03:14:06.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.306+0000 7febf67c7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04cdb0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.306+0000 7febf67c7740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f04c9276b0 0x55f04cd10d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.306+0000 7febf67c7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f04c948390 0x55f04cd112d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.306+0000 7febf67c7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7febe806e800 con 0x55f04c91f4d0 2024-09-17T03:14:06.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.306+0000 7febf67c7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f04cd1ac20 con 0x55f04c948390 2024-09-17T03:14:06.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.306+0000 7febf67c7740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f04cd1a960 con 0x55f04c9276b0 2024-09-17T03:14:06.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.306+0000 7febf67c7740 10 client.0 _ll_register_callbacks cb 0x7febd8001d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:06.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.306+0000 7febed5e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04cdb0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.306+0000 7febed5e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04cdb0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33054/0 (socket says 172.21.15.78:33054) 2024-09-17T03:14:06.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.306+0000 7febed5e9640 1 -- 172.21.15.78:0/3377380587 learned_addr learned my addr 172.21.15.78:0/3377380587 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.306+0000 7febed5e9640 1 -- 172.21.15.78:0/3377380587 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f04c9276b0 msgr2=0x55f04cd10d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.306+0000 7febed5e9640 1 --2- 172.21.15.78:0/3377380587 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f04c9276b0 0x55f04cd10d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.306+0000 7febed5e9640 1 -- 172.21.15.78:0/3377380587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f04c948390 msgr2=0x55f04cd112d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.306+0000 7febed5e9640 1 --2- 172.21.15.78:0/3377380587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f04c948390 0x55f04cd112d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.306+0000 7febed5e9640 1 -- 172.21.15.78:0/3377380587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f04cd138c0 con 0x55f04c91f4d0 2024-09-17T03:14:06.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.307+0000 7febed5e9640 1 --2- 172.21.15.78:0/3377380587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04cdb0d70 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7febd80054b0 tx=0x7febd8013650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61506382c42a3749 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.307+0000 7febc7fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:06.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.307+0000 7febc7fff640 1 -- 172.21.15.78:0/3377380587 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febd8038670 con 0x55f04c91f4d0 2024-09-17T03:14:06.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.307+0000 7febc7fff640 1 -- 172.21.15.78:0/3377380587 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7febd8036460 con 0x55f04c91f4d0 2024-09-17T03:14:06.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.307+0000 7febf67c7740 1 -- 172.21.15.78:0/3377380587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f04cd45090 con 0x55f04c91f4d0 2024-09-17T03:14:06.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.307+0000 7febc7fff640 1 -- 172.21.15.78:0/3377380587 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7febd80039c0 con 0x55f04c91f4d0 2024-09-17T03:14:06.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.307+0000 7febf67c7740 10 client.7845 fetch_fsmap learned FSMap version 83 2024-09-17T03:14:06.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.307+0000 7febf67c7740 1 -- 172.21.15.78:0/3377380587 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x55f04cdb3dd0 con 0x55f04c91f4d0 2024-09-17T03:14:06.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.307+0000 7febc7fff640 1 -- 172.21.15.78:0/3377380587 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x55f04cd45090 con 0x55f04c91f4d0 2024-09-17T03:14:06.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.307+0000 7febc7fff640 1 -- 172.21.15.78:0/3377380587 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 83) ==== 3554+0+0 (secure 0 0 0) 0x7febd8038810 con 0x55f04c91f4d0 2024-09-17T03:14:06.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.307+0000 7febf67c7740 10 client.7845 fetch_fsmap finished waiting for FSMap version 83 2024-09-17T03:14:06.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.307+0000 7febf67c7740 10 client.7845 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T03:14:06.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.307+0000 7febf67c7740 20 client.7845 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:06.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.307+0000 7febf67c7740 1 --2- 172.21.15.78:0/3377380587 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55f04cd572c0 0x55f04cd576d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.307+0000 7febf67c7740 4 client.7845 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-17T03:14:06.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.307+0000 7febf67c7740 1 -- 172.21.15.78:0/3377380587 --> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55f04ccef520 con 0x55f04cd572c0 2024-09-17T03:14:06.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.307+0000 7febecde8640 1 --2- 172.21.15.78:0/3377380587 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55f04cd572c0 0x55f04cd576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.308+0000 7febc7fff640 10 client.7845 ms_handle_connect on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:06.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.308+0000 7febecde8640 1 --2- 172.21.15.78:0/3377380587 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55f04cd572c0 0x55f04cd576d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37cadfe4f138aa6 server_cookie=9b91b54807e4a9ee in_seq=0 out_seq=0 2024-09-17T03:14:06.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.308+0000 7febc7fff640 1 -- 172.21.15.78:0/3377380587 <== mds.0 v2:172.21.15.78:6833/3357123265 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f04ccef520 con 0x55f04cd572c0 2024-09-17T03:14:06.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.308+0000 7febc7fff640 10 client.7845 handle_command_reply: tid=0 2024-09-17T03:14:06.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.308+0000 7febf67c7740 1 client.7845 shutdown 2024-09-17T03:14:06.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.308+0000 7febf67c7740 1 -- 172.21.15.78:0/3377380587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 msgr2=0x55f04cdb0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.308+0000 7febf67c7740 1 --2- 172.21.15.78:0/3377380587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04cdb0d70 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7febd80054b0 tx=0x7febd8013650 comp rx=0 tx=0).stop 2024-09-17T03:14:06.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.308+0000 7febf67c7740 1 -- 172.21.15.78:0/3377380587 shutdown_connections 2024-09-17T03:14:06.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.308+0000 7febf67c7740 1 --2- 172.21.15.78:0/3377380587 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55f04cd572c0 0x55f04cd576d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.308+0000 7febf67c7740 1 --2- 172.21.15.78:0/3377380587 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f04c948390 0x55f04cd112d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.308+0000 7febf67c7740 1 --2- 172.21.15.78:0/3377380587 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f04c9276b0 0x55f04cd10d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.308+0000 7febc7fff640 0 client.7845 ms_handle_reset on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:06.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.308+0000 7febf67c7740 1 --2- 172.21.15.78:0/3377380587 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f04c91f4d0 0x55f04cdb0d70 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.308+0000 7febf67c7740 1 -- 172.21.15.78:0/3377380587 >> 172.21.15.78:0/3377380587 conn(0x55f04c93c4e0 msgr2=0x55f04cd09930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.308+0000 7febf67c7740 1 -- 172.21.15.78:0/3377380587 shutdown_connections 2024-09-17T03:14:06.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.308+0000 7febf67c7740 1 -- 172.21.15.78:0/3377380587 wait complete. 2024-09-17T03:14:06.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.309+0000 7febf67c7740 20 client.7845 trim_cache size 0 max 16384 2024-09-17T03:14:06.313 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:14:06.313 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:14:06.314 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:14:06.314 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:14:06.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.309+0000 7febef84d640 1 -- 172.21.15.78:0/1463955707 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7febd4078b90 msgr2=0x7febd407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.309+0000 7febef84d640 1 --2- 172.21.15.78:0/1463955707 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7febd4078b90 0x7febd407b0a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7febd8000f60 tx=0x7febd8009040 comp rx=0 tx=0).stop 2024-09-17T03:14:06.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.309+0000 7febef84d640 1 -- 172.21.15.78:0/1463955707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febe80d1d40 msgr2=0x7febe815efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.309+0000 7febef84d640 1 --2- 172.21.15.78:0/1463955707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febe80d1d40 0x7febe815efa0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7febe000e9c0 tx=0x7febe000ee80 comp rx=0 tx=0).stop 2024-09-17T03:14:06.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.309+0000 7febef84d640 1 -- 172.21.15.78:0/1463955707 shutdown_connections 2024-09-17T03:14:06.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.309+0000 7febef84d640 1 --2- 172.21.15.78:0/1463955707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febe80d1d40 0x7febe815efa0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.309+0000 7febef84d640 1 --2- 172.21.15.78:0/1463955707 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7febe80ccba0 0x7febe8152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.309+0000 7febef84d640 1 --2- 172.21.15.78:0/1463955707 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7febd4078b90 0x7febd407b0a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.309+0000 7febef84d640 1 --2- 172.21.15.78:0/1463955707 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7febe80b5210 0x7febe8147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.309+0000 7febef84d640 1 -- 172.21.15.78:0/1463955707 >> 172.21.15.78:0/1463955707 conn(0x7febe80b3f10 msgr2=0x7febe80b6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.309+0000 7febef84d640 1 -- 172.21.15.78:0/1463955707 shutdown_connections 2024-09-17T03:14:06.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.309+0000 7febef84d640 1 -- 172.21.15.78:0/1463955707 wait complete. 2024-09-17T03:14:06.319 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:14:06.319 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.6:1 scrub status 2024-09-17T03:14:06.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.434+0000 7fe15d6f9640 1 -- 172.21.15.78:0/995332337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1580b51b0 msgr2=0x7fe1580b55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.434+0000 7fe15d6f9640 1 --2- 172.21.15.78:0/995332337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1580b51b0 0x7fe1580b55c0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fe140005fd0 tx=0x7fe14002a5c0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.434+0000 7fe15d6f9640 1 -- 172.21.15.78:0/995332337 shutdown_connections 2024-09-17T03:14:06.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.434+0000 7fe15d6f9640 1 --2- 172.21.15.78:0/995332337 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe1580b5b00 0x7fe158166db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.434+0000 7fe15d6f9640 1 --2- 172.21.15.78:0/995332337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1580b51b0 0x7fe1580b55c0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.434+0000 7fe15d6f9640 1 -- 172.21.15.78:0/995332337 >> 172.21.15.78:0/995332337 conn(0x7fe1580cede0 msgr2=0x7fe1580cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.434+0000 7fe15d6f9640 1 -- 172.21.15.78:0/995332337 shutdown_connections 2024-09-17T03:14:06.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.434+0000 7fe15d6f9640 1 -- 172.21.15.78:0/995332337 wait complete. 2024-09-17T03:14:06.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.436+0000 7fe15d6f9640 1 Processor -- start 2024-09-17T03:14:06.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.436+0000 7fe15d6f9640 1 -- start start 2024-09-17T03:14:06.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.437+0000 7fe15d6f9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1580b51b0 0x7fe1581fa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.437+0000 7fe15d6f9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe1580b5b00 0x7fe158159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.437+0000 7fe15d6f9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1580d1b10 0x7fe1581f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.437+0000 7fe15d6f9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe1580d1f20 con 0x7fe1580d1b10 2024-09-17T03:14:06.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.437+0000 7fe15d6f9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe1580d1480 con 0x7fe1580b51b0 2024-09-17T03:14:06.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.437+0000 7fe15d6f9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe1580d20a0 con 0x7fe1580b5b00 2024-09-17T03:14:06.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.438+0000 7fe1577fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1580d1b10 0x7fe1581f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.438+0000 7fe1577fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1580d1b10 0x7fe1581f5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42018/0 (socket says 172.21.15.78:42018) 2024-09-17T03:14:06.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.438+0000 7fe1577fe640 1 -- 172.21.15.78:0/1934417069 learned_addr learned my addr 172.21.15.78:0/1934417069 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.438+0000 7fe156ffd640 1 --2- 172.21.15.78:0/1934417069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1580b51b0 0x7fe1581fa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.438+0000 7fe1567fc640 1 --2- 172.21.15.78:0/1934417069 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe1580b5b00 0x7fe158159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.438+0000 7fe1577fe640 1 -- 172.21.15.78:0/1934417069 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe1580b5b00 msgr2=0x7fe158159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.438+0000 7fe1577fe640 1 --2- 172.21.15.78:0/1934417069 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe1580b5b00 0x7fe158159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.438+0000 7fe1577fe640 1 -- 172.21.15.78:0/1934417069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1580b51b0 msgr2=0x7fe1581fa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.438+0000 7fe1577fe640 1 --2- 172.21.15.78:0/1934417069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1580b51b0 0x7fe1581fa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.438+0000 7fe1577fe640 1 -- 172.21.15.78:0/1934417069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1581f6f00 con 0x7fe1580d1b10 2024-09-17T03:14:06.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.438+0000 7fe1577fe640 1 --2- 172.21.15.78:0/1934417069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1580d1b10 0x7fe1581f5fb0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fe14800c8f0 tx=0x7fe14800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.438+0000 7fe14f7fe640 1 -- 172.21.15.78:0/1934417069 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148007b50 con 0x7fe1580d1b10 2024-09-17T03:14:06.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.438+0000 7fe14f7fe640 1 -- 172.21.15.78:0/1934417069 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe148007de0 con 0x7fe1580d1b10 2024-09-17T03:14:06.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.438+0000 7fe15d6f9640 1 -- 172.21.15.78:0/1934417069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1581f6c20 con 0x7fe1580d1b10 2024-09-17T03:14:06.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.438+0000 7fe14f7fe640 1 -- 172.21.15.78:0/1934417069 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148005280 con 0x7fe1580d1b10 2024-09-17T03:14:06.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.438+0000 7fe15d6f9640 1 -- 172.21.15.78:0/1934417069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1581f9920 con 0x7fe1580d1b10 2024-09-17T03:14:06.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.441+0000 7fe14f7fe640 1 -- 172.21.15.78:0/1934417069 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe148005420 con 0x7fe1580d1b10 2024-09-17T03:14:06.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.441+0000 7fe14f7fe640 1 --2- 172.21.15.78:0/1934417069 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe138078b90 0x7fe13807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.441+0000 7fe14f7fe640 1 -- 172.21.15.78:0/1934417069 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fe14809b090 con 0x7fe1580d1b10 2024-09-17T03:14:06.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.441+0000 7fe156ffd640 1 --2- 172.21.15.78:0/1934417069 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe138078b90 0x7fe13807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.442+0000 7fe164666740 1 Processor -- start 2024-09-17T03:14:06.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.442+0000 7fe156ffd640 1 --2- 172.21.15.78:0/1934417069 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe138078b90 0x7fe13807b0a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe15000b450 tx=0x7fe15000d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.442+0000 7fe164666740 1 -- start start 2024-09-17T03:14:06.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.443+0000 7fe164666740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b5e0f0390 0x561b5e4dca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.443+0000 7fe164666740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0c74d0 0x561b5e4b1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.443+0000 7fe164666740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 0x561b5e4b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.443+0000 7fe164666740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x561b5e40aa60 con 0x561b5e0cf6b0 2024-09-17T03:14:06.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.443+0000 7fe164666740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561b5e3f9e90 con 0x561b5e0f0390 2024-09-17T03:14:06.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.443+0000 7fe164666740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x561b5e3fdca0 con 0x561b5e0c74d0 2024-09-17T03:14:06.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.443+0000 7fe1577fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 0x561b5e4b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.443+0000 7fe1577fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 0x561b5e4b1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42022/0 (socket says 172.21.15.78:42022) 2024-09-17T03:14:06.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.443+0000 7fe1577fe640 1 -- 172.21.15.78:0/3801622686 learned_addr learned my addr 172.21.15.78:0/3801622686 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.443+0000 7fe156ffd640 1 --2- 172.21.15.78:0/3801622686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b5e0f0390 0x561b5e4dca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.443+0000 7fe1567fc640 1 --2- 172.21.15.78:0/3801622686 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0c74d0 0x561b5e4b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.444+0000 7fe1577fe640 1 -- 172.21.15.78:0/3801622686 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0c74d0 msgr2=0x561b5e4b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.444+0000 7fe1577fe640 1 --2- 172.21.15.78:0/3801622686 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0c74d0 0x561b5e4b1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.444+0000 7fe1577fe640 1 -- 172.21.15.78:0/3801622686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b5e0f0390 msgr2=0x561b5e4dca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.444+0000 7fe1577fe640 1 --2- 172.21.15.78:0/3801622686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b5e0f0390 0x561b5e4dca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.444+0000 7fe1577fe640 1 -- 172.21.15.78:0/3801622686 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b5e1d27d0 con 0x561b5e0cf6b0 2024-09-17T03:14:06.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.444+0000 7fe1577fe640 1 --2- 172.21.15.78:0/3801622686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 0x561b5e4b1da0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fe148099560 tx=0x7fe148062670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad580cc3a9fe7a02 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.444+0000 7fe14cff9640 1 -- 172.21.15.78:0/3801622686 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14801d040 con 0x561b5e0cf6b0 2024-09-17T03:14:06.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.444+0000 7fe14cff9640 1 -- 172.21.15.78:0/3801622686 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe14806c770 con 0x561b5e0cf6b0 2024-09-17T03:14:06.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.444+0000 7fe14cff9640 1 -- 172.21.15.78:0/3801622686 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1480850d0 con 0x561b5e0cf6b0 2024-09-17T03:14:06.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.445+0000 7fe164666740 1 -- 172.21.15.78:0/3801622686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 msgr2=0x561b5e4b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.445+0000 7fe164666740 1 --2- 172.21.15.78:0/3801622686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 0x561b5e4b1da0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fe148099560 tx=0x7fe148062670 comp rx=0 tx=0).stop 2024-09-17T03:14:06.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.445+0000 7fe164666740 1 -- 172.21.15.78:0/3801622686 shutdown_connections 2024-09-17T03:14:06.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.445+0000 7fe164666740 1 --2- 172.21.15.78:0/3801622686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 0x561b5e4b1da0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.445+0000 7fe164666740 1 --2- 172.21.15.78:0/3801622686 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0c74d0 0x561b5e4b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.445+0000 7fe164666740 1 --2- 172.21.15.78:0/3801622686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b5e0f0390 0x561b5e4dca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.445+0000 7fe164666740 1 -- 172.21.15.78:0/3801622686 >> 172.21.15.78:0/3801622686 conn(0x561b5e0e44e0 msgr2=0x561b5e497d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.445+0000 7fe164666740 1 -- 172.21.15.78:0/3801622686 shutdown_connections 2024-09-17T03:14:06.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.445+0000 7fe164666740 1 -- 172.21.15.78:0/3801622686 wait complete. 2024-09-17T03:14:06.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.446+0000 7fe164666740 1 -- start start 2024-09-17T03:14:06.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.446+0000 7fe164666740 1 Processor -- start 2024-09-17T03:14:06.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.447+0000 7fe164666740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b5e0c74d0 0x561b5e4ec150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.447+0000 7fe164666740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0cf6b0 0x561b5e4971e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.447+0000 7fe164666740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0f0390 0x561b5e4d6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.447+0000 7fe164666740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x561b5e16a740 con 0x561b5e0f0390 2024-09-17T03:14:06.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.447+0000 7fe164666740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561b5e39f970 con 0x561b5e0c74d0 2024-09-17T03:14:06.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.447+0000 7fe164666740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x561b5e496aa0 con 0x561b5e0cf6b0 2024-09-17T03:14:06.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.447+0000 7fe164666740 10 client.0 _ll_register_callbacks cb 0x561b5e3ae780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:06.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.447+0000 7fe1577fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0f0390 0x561b5e4d6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.447+0000 7fe1577fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0f0390 0x561b5e4d6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42034/0 (socket says 172.21.15.78:42034) 2024-09-17T03:14:06.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.447+0000 7fe1577fe640 1 -- 172.21.15.78:0/3069382226 learned_addr learned my addr 172.21.15.78:0/3069382226 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.447+0000 7fe156ffd640 1 --2- 172.21.15.78:0/3069382226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b5e0c74d0 0x561b5e4ec150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.447+0000 7fe1567fc640 1 --2- 172.21.15.78:0/3069382226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0cf6b0 0x561b5e4971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.448+0000 7fe1577fe640 1 -- 172.21.15.78:0/3069382226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0cf6b0 msgr2=0x561b5e4971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.448+0000 7fe1577fe640 1 --2- 172.21.15.78:0/3069382226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0cf6b0 0x561b5e4971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.448+0000 7fe1577fe640 1 -- 172.21.15.78:0/3069382226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b5e0c74d0 msgr2=0x561b5e4ec150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.448+0000 7fe1577fe640 1 --2- 172.21.15.78:0/3069382226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b5e0c74d0 0x561b5e4ec150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.448+0000 7fe1577fe640 1 -- 172.21.15.78:0/3069382226 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b5e15b970 con 0x561b5e0f0390 2024-09-17T03:14:06.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.448+0000 7fe1577fe640 1 --2- 172.21.15.78:0/3069382226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0f0390 0x561b5e4d6f50 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fe148087040 tx=0x7fe148005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4d6a0feba7895e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.448+0000 7fe135ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:06.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.448+0000 7fe135ffb640 1 -- 172.21.15.78:0/3069382226 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14801d040 con 0x561b5e0f0390 2024-09-17T03:14:06.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.448+0000 7fe135ffb640 1 -- 172.21.15.78:0/3069382226 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fe14806adb0 con 0x561b5e0f0390 2024-09-17T03:14:06.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.448+0000 7fe164666740 1 -- 172.21.15.78:0/3069382226 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe14806c770 con 0x561b5e0f0390 2024-09-17T03:14:06.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.448+0000 7fe135ffb640 1 -- 172.21.15.78:0/3069382226 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fe1480852e0 con 0x561b5e0f0390 2024-09-17T03:14:06.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.448+0000 7fe164666740 10 client.7857 fetch_fsmap learned FSMap version 83 2024-09-17T03:14:06.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.448+0000 7fe164666740 1 -- 172.21.15.78:0/3069382226 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x561b5e1396a0 con 0x561b5e0f0390 2024-09-17T03:14:06.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.448+0000 7fe135ffb640 1 -- 172.21.15.78:0/3069382226 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe14806c770 con 0x561b5e0f0390 2024-09-17T03:14:06.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.448+0000 7fe135ffb640 1 -- 172.21.15.78:0/3069382226 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 83) ==== 3554+0+0 (secure 0 0 0) 0x7fe14807f030 con 0x561b5e0f0390 2024-09-17T03:14:06.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.448+0000 7fe164666740 10 client.7857 fetch_fsmap finished waiting for FSMap version 83 2024-09-17T03:14:06.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.448+0000 7fe164666740 10 client.7857 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.c 2024-09-17T03:14:06.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.448+0000 7fe164666740 20 client.7857 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:06.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.448+0000 7fe164666740 1 --2- 172.21.15.78:0/3069382226 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x561b5e0aef60 0x561b5e4d7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.449+0000 7fe164666740 4 client.7857 mds_command: new command op to 7425 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:14:06.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.449+0000 7fe164666740 1 -- 172.21.15.78:0/3069382226 --> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b5e40c9b0 con 0x561b5e0aef60 2024-09-17T03:14:06.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.449+0000 7fe156ffd640 1 --2- 172.21.15.78:0/3069382226 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x561b5e0aef60 0x561b5e4d7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.449+0000 7fe135ffb640 10 client.7857 ms_handle_connect on v2:172.21.15.78:6834/4018023271 2024-09-17T03:14:06.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.449+0000 7fe156ffd640 1 --2- 172.21.15.78:0/3069382226 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x561b5e0aef60 0x561b5e4d7490 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3e54f6e87ee91bf1 server_cookie=5e0fd91d4cb083d in_seq=0 out_seq=0 2024-09-17T03:14:06.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.450+0000 7fe135ffb640 1 -- 172.21.15.78:0/3069382226 <== mds.1 v2:172.21.15.78:6834/4018023271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561b5e40c9b0 con 0x561b5e0aef60 2024-09-17T03:14:06.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.450+0000 7fe135ffb640 10 client.7857 handle_command_reply: tid=0 2024-09-17T03:14:06.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.450+0000 7fe164666740 1 client.7857 shutdown 2024-09-17T03:14:06.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.450+0000 7fe164666740 1 -- 172.21.15.78:0/3069382226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0f0390 msgr2=0x561b5e4d6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.450+0000 7fe164666740 1 --2- 172.21.15.78:0/3069382226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0f0390 0x561b5e4d6f50 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fe148087040 tx=0x7fe148005710 comp rx=0 tx=0).stop 2024-09-17T03:14:06.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.450+0000 7fe164666740 1 -- 172.21.15.78:0/3069382226 shutdown_connections 2024-09-17T03:14:06.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.450+0000 7fe164666740 1 --2- 172.21.15.78:0/3069382226 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x561b5e0aef60 0x561b5e4d7490 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.450+0000 7fe164666740 1 --2- 172.21.15.78:0/3069382226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0f0390 0x561b5e4d6f50 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.450+0000 7fe164666740 1 --2- 172.21.15.78:0/3069382226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0cf6b0 0x561b5e4971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.450+0000 7fe164666740 1 --2- 172.21.15.78:0/3069382226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b5e0c74d0 0x561b5e4ec150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.450+0000 7fe135ffb640 0 client.7857 ms_handle_reset on v2:172.21.15.78:6834/4018023271 2024-09-17T03:14:06.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.450+0000 7fe164666740 1 -- 172.21.15.78:0/3069382226 >> 172.21.15.78:0/3069382226 conn(0x561b5e0e44e0 msgr2=0x561b5e4ad9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.450+0000 7fe164666740 1 -- 172.21.15.78:0/3069382226 shutdown_connections 2024-09-17T03:14:06.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.450+0000 7fe164666740 1 -- 172.21.15.78:0/3069382226 wait complete. 2024-09-17T03:14:06.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.450+0000 7fe164666740 20 client.7857 trim_cache size 0 max 16384 2024-09-17T03:14:06.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.468+0000 7fe164666740 1 Processor -- start 2024-09-17T03:14:06.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.468+0000 7fe164666740 1 -- start start 2024-09-17T03:14:06.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.469+0000 7fe164666740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b5e0c74d0 0x561b5e493710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.469+0000 7fe164666740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 0x561b5e493c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.469+0000 7fe164666740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0f0390 0x561b5e4aec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.469+0000 7fe164666740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe158202420 con 0x561b5e0cf6b0 2024-09-17T03:14:06.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.469+0000 7fe164666740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe1580c8330 con 0x561b5e0c74d0 2024-09-17T03:14:06.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.469+0000 7fe164666740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe158201cf0 con 0x561b5e0f0390 2024-09-17T03:14:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.469+0000 7fe1567fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 0x561b5e493c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.469+0000 7fe1567fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 0x561b5e493c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42046/0 (socket says 172.21.15.78:42046) 2024-09-17T03:14:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.469+0000 7fe1567fc640 1 -- 172.21.15.78:0/1180304971 learned_addr learned my addr 172.21.15.78:0/1180304971 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.470+0000 7fe156ffd640 1 --2- 172.21.15.78:0/1180304971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b5e0c74d0 0x561b5e493710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.470+0000 7fe1577fe640 1 --2- 172.21.15.78:0/1180304971 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0f0390 0x561b5e4aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.470+0000 7fe1567fc640 1 -- 172.21.15.78:0/1180304971 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0f0390 msgr2=0x561b5e4aec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.470+0000 7fe1567fc640 1 --2- 172.21.15.78:0/1180304971 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0f0390 0x561b5e4aec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.470+0000 7fe1567fc640 1 -- 172.21.15.78:0/1180304971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b5e0c74d0 msgr2=0x561b5e493710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.470+0000 7fe1567fc640 1 --2- 172.21.15.78:0/1180304971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b5e0c74d0 0x561b5e493710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.470+0000 7fe1567fc640 1 -- 172.21.15.78:0/1180304971 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b5e497fe0 con 0x561b5e0cf6b0 2024-09-17T03:14:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.470+0000 7fe1577fe640 1 --2- 172.21.15.78:0/1180304971 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0f0390 0x561b5e4aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.470+0000 7fe1567fc640 1 --2- 172.21.15.78:0/1180304971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 0x561b5e493c50 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fe140005f70 tx=0x7fe1400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8630c50dbef13397 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.470+0000 7fe137fff640 1 -- 172.21.15.78:0/1180304971 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe140035040 con 0x561b5e0cf6b0 2024-09-17T03:14:06.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.470+0000 7fe137fff640 1 -- 172.21.15.78:0/1180304971 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1400043f0 con 0x561b5e0cf6b0 2024-09-17T03:14:06.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.470+0000 7fe137fff640 1 -- 172.21.15.78:0/1180304971 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe140003810 con 0x561b5e0cf6b0 2024-09-17T03:14:06.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.471+0000 7fe164666740 1 -- 172.21.15.78:0/1180304971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 msgr2=0x561b5e493c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.471+0000 7fe164666740 1 --2- 172.21.15.78:0/1180304971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 0x561b5e493c50 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fe140005f70 tx=0x7fe1400046c0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.471+0000 7fe164666740 1 -- 172.21.15.78:0/1180304971 shutdown_connections 2024-09-17T03:14:06.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.471+0000 7fe164666740 1 --2- 172.21.15.78:0/1180304971 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0f0390 0x561b5e4aec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.471+0000 7fe164666740 1 --2- 172.21.15.78:0/1180304971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 0x561b5e493c50 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.471+0000 7fe164666740 1 --2- 172.21.15.78:0/1180304971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b5e0c74d0 0x561b5e493710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.471+0000 7fe164666740 1 -- 172.21.15.78:0/1180304971 >> 172.21.15.78:0/1180304971 conn(0x561b5e0e44e0 msgr2=0x561b5e492af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.471+0000 7fe164666740 1 -- 172.21.15.78:0/1180304971 shutdown_connections 2024-09-17T03:14:06.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.471+0000 7fe164666740 1 -- 172.21.15.78:0/1180304971 wait complete. 2024-09-17T03:14:06.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.472+0000 7fe164666740 1 -- start start 2024-09-17T03:14:06.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.472+0000 7fe164666740 1 Processor -- start 2024-09-17T03:14:06.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.473+0000 7fe164666740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b5e0c74d0 0x561b5e55afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.473+0000 7fe164666740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 0x561b5e4914a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.473+0000 7fe164666740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0f0390 0x561b5e4919e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.473+0000 7fe164666740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe15806f1a0 con 0x561b5e0cf6b0 2024-09-17T03:14:06.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.473+0000 7fe164666740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561b5e4becd0 con 0x561b5e0c74d0 2024-09-17T03:14:06.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.473+0000 7fe164666740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x561b5e55ba40 con 0x561b5e0f0390 2024-09-17T03:14:06.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.473+0000 7fe164666740 10 client.0 _ll_register_callbacks cb 0x7fe148065040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:06.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.473+0000 7fe1567fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 0x561b5e4914a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.473+0000 7fe1567fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 0x561b5e4914a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42062/0 (socket says 172.21.15.78:42062) 2024-09-17T03:14:06.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.473+0000 7fe1567fc640 1 -- 172.21.15.78:0/3817251877 learned_addr learned my addr 172.21.15.78:0/3817251877 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.473+0000 7fe156ffd640 1 --2- 172.21.15.78:0/3817251877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b5e0c74d0 0x561b5e55afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.473+0000 7fe1577fe640 1 --2- 172.21.15.78:0/3817251877 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0f0390 0x561b5e4919e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe1567fc640 1 -- 172.21.15.78:0/3817251877 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0f0390 msgr2=0x561b5e4919e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe1567fc640 1 --2- 172.21.15.78:0/3817251877 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0f0390 0x561b5e4919e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe1567fc640 1 -- 172.21.15.78:0/3817251877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b5e0c74d0 msgr2=0x561b5e55afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe1567fc640 1 --2- 172.21.15.78:0/3817251877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b5e0c74d0 0x561b5e55afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe1567fc640 1 -- 172.21.15.78:0/3817251877 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b5e4ff880 con 0x561b5e0cf6b0 2024-09-17T03:14:06.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe1567fc640 1 --2- 172.21.15.78:0/3817251877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 0x561b5e4914a0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fe140009230 tx=0x7fe140003800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b7329d05db232c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe135ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:06.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe135ffb640 1 -- 172.21.15.78:0/3817251877 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14004e020 con 0x561b5e0cf6b0 2024-09-17T03:14:06.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe135ffb640 1 -- 172.21.15.78:0/3817251877 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fe140003c00 con 0x561b5e0cf6b0 2024-09-17T03:14:06.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe164666740 1 -- 172.21.15.78:0/3817251877 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1400043f0 con 0x561b5e0cf6b0 2024-09-17T03:14:06.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe135ffb640 1 -- 172.21.15.78:0/3817251877 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fe140058050 con 0x561b5e0cf6b0 2024-09-17T03:14:06.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe164666740 10 client.7863 fetch_fsmap learned FSMap version 83 2024-09-17T03:14:06.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe164666740 1 -- 172.21.15.78:0/3817251877 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x561b5e492e40 con 0x561b5e0cf6b0 2024-09-17T03:14:06.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe135ffb640 1 -- 172.21.15.78:0/3817251877 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1400043f0 con 0x561b5e0cf6b0 2024-09-17T03:14:06.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe135ffb640 1 -- 172.21.15.78:0/3817251877 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 83) ==== 3554+0+0 (secure 0 0 0) 0x7fe14005b020 con 0x561b5e0cf6b0 2024-09-17T03:14:06.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe164666740 10 client.7863 fetch_fsmap finished waiting for FSMap version 83 2024-09-17T03:14:06.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe164666740 10 client.7863 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.c 2024-09-17T03:14:06.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe164666740 20 client.7863 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:06.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe164666740 1 --2- 172.21.15.78:0/3817251877 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x561b5e55b510 0x561b5e4ab810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe164666740 4 client.7863 mds_command: new command op to 7425 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:14:06.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe164666740 1 -- 172.21.15.78:0/3817251877 --> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561b5e408460 con 0x561b5e55b510 2024-09-17T03:14:06.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.474+0000 7fe156ffd640 1 --2- 172.21.15.78:0/3817251877 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x561b5e55b510 0x561b5e4ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.475+0000 7fe135ffb640 10 client.7863 ms_handle_connect on v2:172.21.15.78:6834/4018023271 2024-09-17T03:14:06.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.475+0000 7fe156ffd640 1 --2- 172.21.15.78:0/3817251877 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x561b5e55b510 0x561b5e4ab810 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f2b4ff10c6dbfe0 server_cookie=ade436850be09101 in_seq=0 out_seq=0 2024-09-17T03:14:06.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.475+0000 7fe135ffb640 1 -- 172.21.15.78:0/3817251877 <== mds.1 v2:172.21.15.78:6834/4018023271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x561b5e408460 con 0x561b5e55b510 2024-09-17T03:14:06.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.475+0000 7fe135ffb640 10 client.7863 handle_command_reply: tid=0 2024-09-17T03:14:06.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.475+0000 7fe164666740 1 client.7863 shutdown 2024-09-17T03:14:06.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.475+0000 7fe164666740 1 -- 172.21.15.78:0/3817251877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 msgr2=0x561b5e4914a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.475+0000 7fe164666740 1 --2- 172.21.15.78:0/3817251877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 0x561b5e4914a0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fe140009230 tx=0x7fe140003800 comp rx=0 tx=0).stop 2024-09-17T03:14:06.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.475+0000 7fe164666740 1 -- 172.21.15.78:0/3817251877 shutdown_connections 2024-09-17T03:14:06.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.475+0000 7fe164666740 1 --2- 172.21.15.78:0/3817251877 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x561b5e55b510 0x561b5e4ab810 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.475+0000 7fe164666740 1 --2- 172.21.15.78:0/3817251877 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561b5e0f0390 0x561b5e4919e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.475+0000 7fe164666740 1 --2- 172.21.15.78:0/3817251877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561b5e0cf6b0 0x561b5e4914a0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.475+0000 7fe135ffb640 0 client.7863 ms_handle_reset on v2:172.21.15.78:6834/4018023271 2024-09-17T03:14:06.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.475+0000 7fe164666740 1 --2- 172.21.15.78:0/3817251877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561b5e0c74d0 0x561b5e55afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.475+0000 7fe164666740 1 -- 172.21.15.78:0/3817251877 >> 172.21.15.78:0/3817251877 conn(0x561b5e0e44e0 msgr2=0x561b5e492730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.475+0000 7fe164666740 1 -- 172.21.15.78:0/3817251877 shutdown_connections 2024-09-17T03:14:06.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.475+0000 7fe164666740 1 -- 172.21.15.78:0/3817251877 wait complete. 2024-09-17T03:14:06.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.475+0000 7fe164666740 20 client.7863 trim_cache size 0 max 16384 2024-09-17T03:14:06.480 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:14:06.480 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-17T03:14:06.480 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:14:06.481 INFO:teuthology.orchestra.run.smithi078.stdout: "06dff376-fc02-4326-a75b-2bb8deb474f9": { 2024-09-17T03:14:06.481 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:14:06.481 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "06dff376-fc02-4326-a75b-2bb8deb474f9", 2024-09-17T03:14:06.481 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:14:06.481 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:06.481 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:06.481 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:14:06.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.476+0000 7fe15d6f9640 1 -- 172.21.15.78:0/1934417069 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe138078b90 msgr2=0x7fe13807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.476+0000 7fe15d6f9640 1 --2- 172.21.15.78:0/1934417069 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe138078b90 0x7fe13807b0a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe15000b450 tx=0x7fe15000d040 comp rx=0 tx=0).stop 2024-09-17T03:14:06.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.476+0000 7fe15d6f9640 1 -- 172.21.15.78:0/1934417069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1580d1b10 msgr2=0x7fe1581f5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.476+0000 7fe15d6f9640 1 --2- 172.21.15.78:0/1934417069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1580d1b10 0x7fe1581f5fb0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fe14800c8f0 tx=0x7fe14800cdb0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.476+0000 7fe15d6f9640 1 -- 172.21.15.78:0/1934417069 shutdown_connections 2024-09-17T03:14:06.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.476+0000 7fe15d6f9640 1 --2- 172.21.15.78:0/1934417069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1580d1b10 0x7fe1581f5fb0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.476+0000 7fe15d6f9640 1 --2- 172.21.15.78:0/1934417069 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe1580b5b00 0x7fe158159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.476+0000 7fe15d6f9640 1 --2- 172.21.15.78:0/1934417069 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe138078b90 0x7fe13807b0a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.476+0000 7fe15d6f9640 1 --2- 172.21.15.78:0/1934417069 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1580b51b0 0x7fe1581fa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.476+0000 7fe15d6f9640 1 -- 172.21.15.78:0/1934417069 >> 172.21.15.78:0/1934417069 conn(0x7fe1580cede0 msgr2=0x7fe1580b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.476+0000 7fe15d6f9640 1 -- 172.21.15.78:0/1934417069 shutdown_connections 2024-09-17T03:14:06.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.476+0000 7fe15d6f9640 1 -- 172.21.15.78:0/1934417069 wait complete. 2024-09-17T03:14:06.486 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:14:06.486 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:14:06.486 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.6:2 scrub status 2024-09-17T03:14:06.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.601+0000 7f84e38de640 1 -- 172.21.15.78:0/4144806645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84dc0d1a80 msgr2=0x7f84dc0cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.601+0000 7f84e38de640 1 --2- 172.21.15.78:0/4144806645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84dc0d1a80 0x7f84dc0cf090 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f84dc0d32e0 tx=0x7f84cc02a530 comp rx=0 tx=0).stop 2024-09-17T03:14:06.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.601+0000 7f84e38de640 1 -- 172.21.15.78:0/4144806645 shutdown_connections 2024-09-17T03:14:06.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.601+0000 7f84e38de640 1 --2- 172.21.15.78:0/4144806645 >> v2:172.21.15.193:3300/0 conn(0x7f84dc0cf5d0 0x7f84dc0cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.601+0000 7f84e38de640 1 --2- 172.21.15.78:0/4144806645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84dc0d1a80 0x7f84dc0cf090 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.601+0000 7f84e38de640 1 -- 172.21.15.78:0/4144806645 >> 172.21.15.78:0/4144806645 conn(0x7f84dc08bfc0 msgr2=0x7f84dc09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.601+0000 7f84e38de640 1 -- 172.21.15.78:0/4144806645 shutdown_connections 2024-09-17T03:14:06.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.601+0000 7f84e38de640 1 -- 172.21.15.78:0/4144806645 wait complete. 2024-09-17T03:14:06.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.603+0000 7f84e38de640 1 Processor -- start 2024-09-17T03:14:06.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.603+0000 7f84e38de640 1 -- start start 2024-09-17T03:14:06.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.604+0000 7f84e38de640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f84dc0cf5d0 0x7f84dc0c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.604+0000 7f84e38de640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84dc0d1a80 0x7f84dc1511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.604+0000 7f84e38de640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84dc0d2ed0 0x7f84dc0b8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.604+0000 7f84e38de640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc162bb0 con 0x7f84dc0d2ed0 2024-09-17T03:14:06.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.605+0000 7f84e38de640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc162a30 con 0x7f84dc0d1a80 2024-09-17T03:14:06.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.605+0000 7f84e38de640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f84dc162d30 con 0x7f84dc0cf5d0 2024-09-17T03:14:06.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.605+0000 7f84e1e7b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84dc0d2ed0 0x7f84dc0b8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.605+0000 7f84e1e7b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84dc0d2ed0 0x7f84dc0b8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42080/0 (socket says 172.21.15.78:42080) 2024-09-17T03:14:06.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.605+0000 7f84e1e7b640 1 -- 172.21.15.78:0/3978997723 learned_addr learned my addr 172.21.15.78:0/3978997723 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.605+0000 7f84e0e79640 1 --2- 172.21.15.78:0/3978997723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84dc0d1a80 0x7f84dc1511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.605+0000 7f84e1e7b640 1 -- 172.21.15.78:0/3978997723 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f84dc0cf5d0 msgr2=0x7f84dc0c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.605+0000 7f84e1e7b640 1 --2- 172.21.15.78:0/3978997723 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f84dc0cf5d0 0x7f84dc0c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.605+0000 7f84e1e7b640 1 -- 172.21.15.78:0/3978997723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84dc0d1a80 msgr2=0x7f84dc1511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.605+0000 7f84e1e7b640 1 --2- 172.21.15.78:0/3978997723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84dc0d1a80 0x7f84dc1511f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.605+0000 7f84e1e7b640 1 -- 172.21.15.78:0/3978997723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84dc0c9040 con 0x7f84dc0d2ed0 2024-09-17T03:14:06.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.605+0000 7f84e1e7b640 1 --2- 172.21.15.78:0/3978997723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84dc0d2ed0 0x7f84dc0b8c70 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f84d400e960 tx=0x7f84d400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.605+0000 7f84d1ffb640 1 -- 172.21.15.78:0/3978997723 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4004d20 con 0x7f84dc0d2ed0 2024-09-17T03:14:06.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.605+0000 7f84d1ffb640 1 -- 172.21.15.78:0/3978997723 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84d400cac0 con 0x7f84dc0d2ed0 2024-09-17T03:14:06.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.605+0000 7f84d1ffb640 1 -- 172.21.15.78:0/3978997723 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84d4005020 con 0x7f84dc0d2ed0 2024-09-17T03:14:06.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.605+0000 7f84e38de640 1 -- 172.21.15.78:0/3978997723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84dc151c90 con 0x7f84dc0d2ed0 2024-09-17T03:14:06.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.605+0000 7f84e38de640 1 -- 172.21.15.78:0/3978997723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84dc0c8300 con 0x7f84dc0d2ed0 2024-09-17T03:14:06.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.607+0000 7f84d1ffb640 1 -- 172.21.15.78:0/3978997723 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f84d40051c0 con 0x7f84dc0d2ed0 2024-09-17T03:14:06.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.608+0000 7f84d1ffb640 1 --2- 172.21.15.78:0/3978997723 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f84c0078bc0 0x7f84c007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.608+0000 7f84d1ffb640 1 -- 172.21.15.78:0/3978997723 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f84d409b580 con 0x7f84dc0d2ed0 2024-09-17T03:14:06.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.608+0000 7f84e167a640 1 --2- 172.21.15.78:0/3978997723 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f84c0078bc0 0x7f84c007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.609+0000 7f84e167a640 1 --2- 172.21.15.78:0/3978997723 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f84c0078bc0 0x7f84c007b0d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f84d80014f0 tx=0x7f84d8007950 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.609+0000 7f84ea84c740 1 Processor -- start 2024-09-17T03:14:06.608 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.609+0000 7f84ea84c740 1 -- start start 2024-09-17T03:14:06.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.610+0000 7f84ea84c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a6a390 0x562cb7e3b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.610+0000 7f84ea84c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a414d0 0x562cb7e3bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.610+0000 7f84ea84c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a496b0 0x562cb7e58b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.610+0000 7f84ea84c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x562cb7d84a60 con 0x562cb7a414d0 2024-09-17T03:14:06.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.610+0000 7f84ea84c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562cb7d73e90 con 0x562cb7a496b0 2024-09-17T03:14:06.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.610+0000 7f84ea84c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x562cb7d77ca0 con 0x562cb7a6a390 2024-09-17T03:14:06.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.610+0000 7f84e0e79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a414d0 0x562cb7e3bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.610+0000 7f84e0e79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a414d0 0x562cb7e3bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42088/0 (socket says 172.21.15.78:42088) 2024-09-17T03:14:06.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.610+0000 7f84e0e79640 1 -- 172.21.15.78:0/1573095749 learned_addr learned my addr 172.21.15.78:0/1573095749 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.610+0000 7f84e1e7b640 1 --2- 172.21.15.78:0/1573095749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a496b0 0x562cb7e58b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.610+0000 7f84e167a640 1 --2- 172.21.15.78:0/1573095749 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a6a390 0x562cb7e3b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.610+0000 7f84e0e79640 1 -- 172.21.15.78:0/1573095749 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a6a390 msgr2=0x562cb7e3b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.610+0000 7f84e0e79640 1 --2- 172.21.15.78:0/1573095749 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a6a390 0x562cb7e3b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.610+0000 7f84e0e79640 1 -- 172.21.15.78:0/1573095749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a496b0 msgr2=0x562cb7e58b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.610+0000 7f84e0e79640 1 --2- 172.21.15.78:0/1573095749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a496b0 0x562cb7e58b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.610+0000 7f84e0e79640 1 -- 172.21.15.78:0/1573095749 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cb7b4c7d0 con 0x562cb7a414d0 2024-09-17T03:14:06.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.610+0000 7f84e167a640 1 --2- 172.21.15.78:0/1573095749 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a6a390 0x562cb7e3b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:06.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.611+0000 7f84e0e79640 1 --2- 172.21.15.78:0/1573095749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a414d0 0x562cb7e3bc80 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f84cc009920 tx=0x7f84cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d575ccd8fca9a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.611+0000 7f84beffd640 1 -- 172.21.15.78:0/1573095749 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc0035f0 con 0x562cb7a414d0 2024-09-17T03:14:06.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.611+0000 7f84beffd640 1 -- 172.21.15.78:0/1573095749 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84cc003790 con 0x562cb7a414d0 2024-09-17T03:14:06.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.611+0000 7f84beffd640 1 -- 172.21.15.78:0/1573095749 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc003ba0 con 0x562cb7a414d0 2024-09-17T03:14:06.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.612+0000 7f84ea84c740 1 -- 172.21.15.78:0/1573095749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a414d0 msgr2=0x562cb7e3bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.612+0000 7f84ea84c740 1 --2- 172.21.15.78:0/1573095749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a414d0 0x562cb7e3bc80 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f84cc009920 tx=0x7f84cc0046c0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.612+0000 7f84ea84c740 1 -- 172.21.15.78:0/1573095749 shutdown_connections 2024-09-17T03:14:06.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.612+0000 7f84ea84c740 1 --2- 172.21.15.78:0/1573095749 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a496b0 0x562cb7e58b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.612+0000 7f84ea84c740 1 --2- 172.21.15.78:0/1573095749 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a414d0 0x562cb7e3bc80 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.612+0000 7f84ea84c740 1 --2- 172.21.15.78:0/1573095749 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a6a390 0x562cb7e3b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.612+0000 7f84ea84c740 1 -- 172.21.15.78:0/1573095749 >> 172.21.15.78:0/1573095749 conn(0x562cb7a5e4e0 msgr2=0x562cb7e11a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.612+0000 7f84ea84c740 1 -- 172.21.15.78:0/1573095749 shutdown_connections 2024-09-17T03:14:06.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.612+0000 7f84ea84c740 1 -- 172.21.15.78:0/1573095749 wait complete. 2024-09-17T03:14:06.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.612+0000 7f84ea84c740 1 -- start start 2024-09-17T03:14:06.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.613+0000 7f84ea84c740 1 Processor -- start 2024-09-17T03:14:06.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.614+0000 7f84ea84c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a414d0 0x562cb7e69d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.614+0000 7f84ea84c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 0x562cb7e516d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.614+0000 7f84ea84c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a6a390 0x562cb7e27e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.614+0000 7f84ea84c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x562cb7ae4740 con 0x562cb7a496b0 2024-09-17T03:14:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.614+0000 7f84ea84c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562cb7d19970 con 0x562cb7a414d0 2024-09-17T03:14:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.614+0000 7f84ea84c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x562cb7e3c1c0 con 0x562cb7a6a390 2024-09-17T03:14:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.614+0000 7f84ea84c740 10 client.0 _ll_register_callbacks cb 0x562cb7d1cbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.614+0000 7f84e0e79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 0x562cb7e516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.614+0000 7f84e0e79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 0x562cb7e516d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42094/0 (socket says 172.21.15.78:42094) 2024-09-17T03:14:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.614+0000 7f84e0e79640 1 -- 172.21.15.78:0/1574428037 learned_addr learned my addr 172.21.15.78:0/1574428037 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.614+0000 7f84e167a640 1 --2- 172.21.15.78:0/1574428037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a414d0 0x562cb7e69d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.614+0000 7f84e1e7b640 1 --2- 172.21.15.78:0/1574428037 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a6a390 0x562cb7e27e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.614+0000 7f84e0e79640 1 -- 172.21.15.78:0/1574428037 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a6a390 msgr2=0x562cb7e27e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.614+0000 7f84e0e79640 1 --2- 172.21.15.78:0/1574428037 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a6a390 0x562cb7e27e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.614+0000 7f84e0e79640 1 -- 172.21.15.78:0/1574428037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a414d0 msgr2=0x562cb7e69d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.614+0000 7f84e0e79640 1 --2- 172.21.15.78:0/1574428037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a414d0 0x562cb7e69d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.614+0000 7f84e0e79640 1 -- 172.21.15.78:0/1574428037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cb7ad5970 con 0x562cb7a496b0 2024-09-17T03:14:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.615+0000 7f84e0e79640 1 --2- 172.21.15.78:0/1574428037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 0x562cb7e516d0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x562cb7e135d0 tx=0x7f84cc003b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada8ad99839a7a31 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.615+0000 7f84b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.615+0000 7f84b7fff640 1 -- 172.21.15.78:0/1574428037 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc04c060 con 0x562cb7a496b0 2024-09-17T03:14:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.615+0000 7f84ea84c740 1 -- 172.21.15.78:0/1574428037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84cc003790 con 0x562cb7a496b0 2024-09-17T03:14:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.615+0000 7f84b7fff640 1 -- 172.21.15.78:0/1574428037 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f84cc03c620 con 0x562cb7a496b0 2024-09-17T03:14:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.615+0000 7f84b7fff640 1 -- 172.21.15.78:0/1574428037 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f84cc052050 con 0x562cb7a496b0 2024-09-17T03:14:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.615+0000 7f84ea84c740 10 client.7878 fetch_fsmap learned FSMap version 83 2024-09-17T03:14:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.615+0000 7f84ea84c740 1 -- 172.21.15.78:0/1574428037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x562cb7ab36a0 con 0x562cb7a496b0 2024-09-17T03:14:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.615+0000 7f84b7fff640 1 -- 172.21.15.78:0/1574428037 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84cc003790 con 0x562cb7a496b0 2024-09-17T03:14:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.615+0000 7f84b7fff640 1 -- 172.21.15.78:0/1574428037 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 83) ==== 3554+0+0 (secure 0 0 0) 0x7f84cc03c820 con 0x562cb7a496b0 2024-09-17T03:14:06.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.615+0000 7f84ea84c740 10 client.7878 fetch_fsmap finished waiting for FSMap version 83 2024-09-17T03:14:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.615+0000 7f84ea84c740 10 client.7878 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2024-09-17T03:14:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.615+0000 7f84ea84c740 20 client.7878 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.615+0000 7f84ea84c740 1 --2- 172.21.15.78:0/1574428037 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x562cb7a28f60 0x562cb7e4e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.615+0000 7f84ea84c740 4 client.7878 mds_command: new command op to 6640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:14:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.615+0000 7f84ea84c740 1 -- 172.21.15.78:0/1574428037 --> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cb7d869b0 con 0x562cb7a28f60 2024-09-17T03:14:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.615+0000 7f84e167a640 1 --2- 172.21.15.78:0/1574428037 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x562cb7a28f60 0x562cb7e4e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.616+0000 7f84e167a640 1 --2- 172.21.15.78:0/1574428037 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x562cb7a28f60 0x562cb7e4e9a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4dbcff882f65cba6 server_cookie=1c917c47b4a723c5 in_seq=0 out_seq=0 2024-09-17T03:14:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.616+0000 7f84b7fff640 10 client.7878 ms_handle_connect on v2:172.21.15.193:6835/1005450673 2024-09-17T03:14:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.616+0000 7f84b7fff640 1 -- 172.21.15.78:0/1574428037 <== mds.2 v2:172.21.15.193:6835/1005450673 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562cb7d869b0 con 0x562cb7a28f60 2024-09-17T03:14:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.616+0000 7f84b7fff640 10 client.7878 handle_command_reply: tid=0 2024-09-17T03:14:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.617+0000 7f84ea84c740 1 client.7878 shutdown 2024-09-17T03:14:06.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.617+0000 7f84ea84c740 1 -- 172.21.15.78:0/1574428037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 msgr2=0x562cb7e516d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.617+0000 7f84ea84c740 1 --2- 172.21.15.78:0/1574428037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 0x562cb7e516d0 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x562cb7e135d0 tx=0x7f84cc003b50 comp rx=0 tx=0).stop 2024-09-17T03:14:06.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.617+0000 7f84ea84c740 1 -- 172.21.15.78:0/1574428037 shutdown_connections 2024-09-17T03:14:06.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.617+0000 7f84ea84c740 1 --2- 172.21.15.78:0/1574428037 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x562cb7a28f60 0x562cb7e4e9a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.617+0000 7f84ea84c740 1 --2- 172.21.15.78:0/1574428037 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a6a390 0x562cb7e27e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.617+0000 7f84ea84c740 1 --2- 172.21.15.78:0/1574428037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 0x562cb7e516d0 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.617+0000 7f84b7fff640 0 client.7878 ms_handle_reset on v2:172.21.15.193:6835/1005450673 2024-09-17T03:14:06.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.617+0000 7f84ea84c740 1 --2- 172.21.15.78:0/1574428037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a414d0 0x562cb7e69d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.617+0000 7f84ea84c740 1 -- 172.21.15.78:0/1574428037 >> 172.21.15.78:0/1574428037 conn(0x562cb7a5e4e0 msgr2=0x562cb7e118b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.617+0000 7f84ea84c740 1 -- 172.21.15.78:0/1574428037 shutdown_connections 2024-09-17T03:14:06.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.617+0000 7f84ea84c740 1 -- 172.21.15.78:0/1574428037 wait complete. 2024-09-17T03:14:06.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.617+0000 7f84ea84c740 20 client.7878 trim_cache size 0 max 16384 2024-09-17T03:14:06.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.634+0000 7f84ea84c740 1 Processor -- start 2024-09-17T03:14:06.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.634+0000 7f84ea84c740 1 -- start start 2024-09-17T03:14:06.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84ea84c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a414d0 0x562cb7e0aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84ea84c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 0x562cb7e0b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84ea84c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a6a390 0x562cb7e55150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84ea84c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc1f9f80 con 0x562cb7a496b0 2024-09-17T03:14:06.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84ea84c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc0ca460 con 0x562cb7a6a390 2024-09-17T03:14:06.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84ea84c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f84dc1f9850 con 0x562cb7a414d0 2024-09-17T03:14:06.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84e0e79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 0x562cb7e0b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84e0e79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 0x562cb7e0b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42110/0 (socket says 172.21.15.78:42110) 2024-09-17T03:14:06.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84e0e79640 1 -- 172.21.15.78:0/4087655098 learned_addr learned my addr 172.21.15.78:0/4087655098 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84e167a640 1 --2- 172.21.15.78:0/4087655098 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a414d0 0x562cb7e0aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84e1e7b640 1 --2- 172.21.15.78:0/4087655098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a6a390 0x562cb7e55150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84e0e79640 1 -- 172.21.15.78:0/4087655098 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a414d0 msgr2=0x562cb7e0aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84e0e79640 1 --2- 172.21.15.78:0/4087655098 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a414d0 0x562cb7e0aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84e0e79640 1 -- 172.21.15.78:0/4087655098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a6a390 msgr2=0x562cb7e55150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84e0e79640 1 --2- 172.21.15.78:0/4087655098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a6a390 0x562cb7e55150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84e0e79640 1 -- 172.21.15.78:0/4087655098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cb7e21670 con 0x562cb7a496b0 2024-09-17T03:14:06.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84e167a640 1 --2- 172.21.15.78:0/4087655098 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a414d0 0x562cb7e0aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:06.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84e1e7b640 1 --2- 172.21.15.78:0/4087655098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a6a390 0x562cb7e55150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:06.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84e0e79640 1 --2- 172.21.15.78:0/4087655098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 0x562cb7e0b420 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f84cc02ab20 tx=0x7f84cc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c156f4bb6261c5dc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84be7fc640 1 -- 172.21.15.78:0/4087655098 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc003f50 con 0x562cb7a496b0 2024-09-17T03:14:06.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84be7fc640 1 -- 172.21.15.78:0/4087655098 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84cc003790 con 0x562cb7a496b0 2024-09-17T03:14:06.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.636+0000 7f84be7fc640 1 -- 172.21.15.78:0/4087655098 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc02abb0 con 0x562cb7a496b0 2024-09-17T03:14:06.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.637+0000 7f84ea84c740 1 -- 172.21.15.78:0/4087655098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 msgr2=0x562cb7e0b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.637+0000 7f84ea84c740 1 --2- 172.21.15.78:0/4087655098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 0x562cb7e0b420 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f84cc02ab20 tx=0x7f84cc005740 comp rx=0 tx=0).stop 2024-09-17T03:14:06.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.637+0000 7f84ea84c740 1 -- 172.21.15.78:0/4087655098 shutdown_connections 2024-09-17T03:14:06.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.637+0000 7f84ea84c740 1 --2- 172.21.15.78:0/4087655098 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a6a390 0x562cb7e55150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.637+0000 7f84ea84c740 1 --2- 172.21.15.78:0/4087655098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 0x562cb7e0b420 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.637+0000 7f84ea84c740 1 --2- 172.21.15.78:0/4087655098 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a414d0 0x562cb7e0aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.637+0000 7f84ea84c740 1 -- 172.21.15.78:0/4087655098 >> 172.21.15.78:0/4087655098 conn(0x562cb7a5e4e0 msgr2=0x562cb7e2a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.637+0000 7f84ea84c740 1 -- 172.21.15.78:0/4087655098 shutdown_connections 2024-09-17T03:14:06.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.637+0000 7f84ea84c740 1 -- 172.21.15.78:0/4087655098 wait complete. 2024-09-17T03:14:06.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.638+0000 7f84ea84c740 1 -- start start 2024-09-17T03:14:06.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.638+0000 7f84ea84c740 1 Processor -- start 2024-09-17T03:14:06.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.639+0000 7f84ea84c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a414d0 0x562cb7e78fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.639+0000 7f84ea84c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 0x562cb7ed53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.639+0000 7f84ea84c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a6a390 0x562cb7e6d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.639+0000 7f84ea84c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc0ccbe0 con 0x562cb7a496b0 2024-09-17T03:14:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.639+0000 7f84ea84c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562cb7e561f0 con 0x562cb7a6a390 2024-09-17T03:14:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.639+0000 7f84ea84c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x562cb7e6dde0 con 0x562cb7a414d0 2024-09-17T03:14:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.639+0000 7f84ea84c740 10 client.0 _ll_register_callbacks cb 0x7f84d405f9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.640+0000 7f84e0e79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 0x562cb7ed53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.640+0000 7f84e0e79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 0x562cb7ed53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42118/0 (socket says 172.21.15.78:42118) 2024-09-17T03:14:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.640+0000 7f84e0e79640 1 -- 172.21.15.78:0/551420050 learned_addr learned my addr 172.21.15.78:0/551420050 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.640+0000 7f84e1e7b640 1 --2- 172.21.15.78:0/551420050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a6a390 0x562cb7e6d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.640+0000 7f84e167a640 1 --2- 172.21.15.78:0/551420050 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a414d0 0x562cb7e78fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.640+0000 7f84e0e79640 1 -- 172.21.15.78:0/551420050 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a414d0 msgr2=0x562cb7e78fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.640+0000 7f84e0e79640 1 --2- 172.21.15.78:0/551420050 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a414d0 0x562cb7e78fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.640+0000 7f84e0e79640 1 -- 172.21.15.78:0/551420050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a6a390 msgr2=0x562cb7e6d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.640+0000 7f84e0e79640 1 --2- 172.21.15.78:0/551420050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a6a390 0x562cb7e6d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.640+0000 7f84e0e79640 1 -- 172.21.15.78:0/551420050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cb7e6fc20 con 0x562cb7a496b0 2024-09-17T03:14:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.640+0000 7f84e1e7b640 1 --2- 172.21.15.78:0/551420050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a6a390 0x562cb7e6d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.640+0000 7f84e0e79640 1 --2- 172.21.15.78:0/551420050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 0x562cb7ed53d0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f84cc0095f0 tx=0x7f84cc005920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3016105f329cfa server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.640+0000 7f84b7fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.640+0000 7f84b7fff640 1 -- 172.21.15.78:0/551420050 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84cc03c420 con 0x562cb7a496b0 2024-09-17T03:14:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.640+0000 7f84b7fff640 1 -- 172.21.15.78:0/551420050 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f84cc03c920 con 0x562cb7a496b0 2024-09-17T03:14:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.640+0000 7f84ea84c740 1 -- 172.21.15.78:0/551420050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84cc003790 con 0x562cb7a496b0 2024-09-17T03:14:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.640+0000 7f84b7fff640 1 -- 172.21.15.78:0/551420050 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f84cc068050 con 0x562cb7a496b0 2024-09-17T03:14:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.640+0000 7f84ea84c740 10 client.7884 fetch_fsmap learned FSMap version 83 2024-09-17T03:14:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.640+0000 7f84ea84c740 1 -- 172.21.15.78:0/551420050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x562cb7e0e440 con 0x562cb7a496b0 2024-09-17T03:14:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.640+0000 7f84b7fff640 1 -- 172.21.15.78:0/551420050 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84cc003790 con 0x562cb7a496b0 2024-09-17T03:14:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.641+0000 7f84b7fff640 1 -- 172.21.15.78:0/551420050 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 83) ==== 3554+0+0 (secure 0 0 0) 0x7f84cc06b020 con 0x562cb7a496b0 2024-09-17T03:14:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.641+0000 7f84ea84c740 10 client.7884 fetch_fsmap finished waiting for FSMap version 83 2024-09-17T03:14:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.641+0000 7f84ea84c740 10 client.7884 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2024-09-17T03:14:06.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.641+0000 7f84ea84c740 20 client.7884 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:06.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.641+0000 7f84ea84c740 1 --2- 172.21.15.78:0/551420050 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x562cb7e70040 0x562cb7e58a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.641+0000 7f84ea84c740 4 client.7884 mds_command: new command op to 6640 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:14:06.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.641+0000 7f84ea84c740 1 -- 172.21.15.78:0/551420050 --> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562cb7d82460 con 0x562cb7e70040 2024-09-17T03:14:06.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.641+0000 7f84e167a640 1 --2- 172.21.15.78:0/551420050 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x562cb7e70040 0x562cb7e58a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.641+0000 7f84b7fff640 10 client.7884 ms_handle_connect on v2:172.21.15.193:6835/1005450673 2024-09-17T03:14:06.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.641+0000 7f84e167a640 1 --2- 172.21.15.78:0/551420050 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x562cb7e70040 0x562cb7e58a90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=748a0d0c54976e4 server_cookie=143cab3de52a9055 in_seq=0 out_seq=0 2024-09-17T03:14:06.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.641+0000 7f84b7fff640 1 -- 172.21.15.78:0/551420050 <== mds.2 v2:172.21.15.193:6835/1005450673 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x562cb7d82460 con 0x562cb7e70040 2024-09-17T03:14:06.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.641+0000 7f84b7fff640 10 client.7884 handle_command_reply: tid=0 2024-09-17T03:14:06.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.641+0000 7f84ea84c740 1 client.7884 shutdown 2024-09-17T03:14:06.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.641+0000 7f84ea84c740 1 -- 172.21.15.78:0/551420050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 msgr2=0x562cb7ed53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.641+0000 7f84ea84c740 1 --2- 172.21.15.78:0/551420050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 0x562cb7ed53d0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f84cc0095f0 tx=0x7f84cc005920 comp rx=0 tx=0).stop 2024-09-17T03:14:06.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.641+0000 7f84ea84c740 1 -- 172.21.15.78:0/551420050 shutdown_connections 2024-09-17T03:14:06.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.641+0000 7f84ea84c740 1 --2- 172.21.15.78:0/551420050 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x562cb7e70040 0x562cb7e58a90 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.642+0000 7f84ea84c740 1 --2- 172.21.15.78:0/551420050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562cb7a6a390 0x562cb7e6d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.642+0000 7f84ea84c740 1 --2- 172.21.15.78:0/551420050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562cb7a496b0 0x562cb7ed53d0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.642+0000 7f84b7fff640 0 client.7884 ms_handle_reset on v2:172.21.15.193:6835/1005450673 2024-09-17T03:14:06.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.642+0000 7f84ea84c740 1 --2- 172.21.15.78:0/551420050 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562cb7a414d0 0x562cb7e78fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.642+0000 7f84ea84c740 1 -- 172.21.15.78:0/551420050 >> 172.21.15.78:0/551420050 conn(0x562cb7a5e4e0 msgr2=0x562cb7e51610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.642+0000 7f84ea84c740 1 -- 172.21.15.78:0/551420050 shutdown_connections 2024-09-17T03:14:06.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.642+0000 7f84ea84c740 1 -- 172.21.15.78:0/551420050 wait complete. 2024-09-17T03:14:06.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.642+0000 7f84ea84c740 20 client.7884 trim_cache size 0 max 16384 2024-09-17T03:14:06.648 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:14:06.648 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-17T03:14:06.648 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:14:06.648 INFO:teuthology.orchestra.run.smithi078.stdout: "06dff376-fc02-4326-a75b-2bb8deb474f9": { 2024-09-17T03:14:06.648 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:14:06.649 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "06dff376-fc02-4326-a75b-2bb8deb474f9", 2024-09-17T03:14:06.649 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:14:06.649 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:06.649 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:06.649 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:14:06.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.642+0000 7f84e38de640 1 -- 172.21.15.78:0/3978997723 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f84c0078bc0 msgr2=0x7f84c007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.642+0000 7f84e38de640 1 --2- 172.21.15.78:0/3978997723 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f84c0078bc0 0x7f84c007b0d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f84d80014f0 tx=0x7f84d8007950 comp rx=0 tx=0).stop 2024-09-17T03:14:06.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.642+0000 7f84e38de640 1 -- 172.21.15.78:0/3978997723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84dc0d2ed0 msgr2=0x7f84dc0b8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.642+0000 7f84e38de640 1 --2- 172.21.15.78:0/3978997723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84dc0d2ed0 0x7f84dc0b8c70 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f84d400e960 tx=0x7f84d400ee20 comp rx=0 tx=0).stop 2024-09-17T03:14:06.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.642+0000 7f84e38de640 1 -- 172.21.15.78:0/3978997723 shutdown_connections 2024-09-17T03:14:06.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.642+0000 7f84e38de640 1 --2- 172.21.15.78:0/3978997723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84dc0d2ed0 0x7f84dc0b8c70 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.642+0000 7f84e38de640 1 --2- 172.21.15.78:0/3978997723 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f84c0078bc0 0x7f84c007b0d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.642+0000 7f84e38de640 1 --2- 172.21.15.78:0/3978997723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84dc0d1a80 0x7f84dc1511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.642+0000 7f84e38de640 1 --2- 172.21.15.78:0/3978997723 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f84dc0cf5d0 0x7f84dc0c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.642+0000 7f84e38de640 1 -- 172.21.15.78:0/3978997723 >> 172.21.15.78:0/3978997723 conn(0x7f84dc08bfc0 msgr2=0x7f84dc0b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.642+0000 7f84e38de640 1 -- 172.21.15.78:0/3978997723 shutdown_connections 2024-09-17T03:14:06.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.642+0000 7f84e38de640 1 -- 172.21.15.78:0/3978997723 wait complete. 2024-09-17T03:14:06.652 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:14:06.652 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:14:06.652 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.6:0 scrub status 2024-09-17T03:14:06.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.768+0000 7fc6ddfa1640 1 -- 172.21.15.78:0/215763500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d80cf440 msgr2=0x7fc6d80d0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.768+0000 7fc6ddfa1640 1 --2- 172.21.15.78:0/215763500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d80cf440 0x7fc6d80d0190 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fc6d80747a0 tx=0x7fc6d002a820 comp rx=0 tx=0).stop 2024-09-17T03:14:06.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.768+0000 7fc6ddfa1640 1 -- 172.21.15.78:0/215763500 shutdown_connections 2024-09-17T03:14:06.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.768+0000 7fc6ddfa1640 1 --2- 172.21.15.78:0/215763500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d80cf440 0x7fc6d80d0190 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.768+0000 7fc6ddfa1640 1 --2- 172.21.15.78:0/215763500 >> v2:172.21.15.193:3300/0 conn(0x7fc6d80cd360 0x7fc6d815c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.768+0000 7fc6ddfa1640 1 -- 172.21.15.78:0/215763500 >> 172.21.15.78:0/215763500 conn(0x7fc6d80710b0 msgr2=0x7fc6d80714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.768+0000 7fc6ddfa1640 1 -- 172.21.15.78:0/215763500 shutdown_connections 2024-09-17T03:14:06.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.768+0000 7fc6ddfa1640 1 -- 172.21.15.78:0/215763500 wait complete. 2024-09-17T03:14:06.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.770+0000 7fc6ddfa1640 1 Processor -- start 2024-09-17T03:14:06.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.770+0000 7fc6ddfa1640 1 -- start start 2024-09-17T03:14:06.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.771+0000 7fc6ddfa1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6d80b7fe0 0x7fc6d81f6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.771+0000 7fc6ddfa1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d80cd360 0x7fc6d81f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.771+0000 7fc6ddfa1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc6d8148240 0x7fc6d81f7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.771+0000 7fc6ddfa1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d80d0b10 con 0x7fc6d80cd360 2024-09-17T03:14:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.771+0000 7fc6ddfa1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d80d0990 con 0x7fc6d80b7fe0 2024-09-17T03:14:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.771+0000 7fc6ddfa1640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc6d80d0c90 con 0x7fc6d8148240 2024-09-17T03:14:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.772+0000 7fc6d6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d80cd360 0x7fc6d81f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.772+0000 7fc6d6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d80cd360 0x7fc6d81f6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42136/0 (socket says 172.21.15.78:42136) 2024-09-17T03:14:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.772+0000 7fc6d6ffd640 1 -- 172.21.15.78:0/3058483598 learned_addr learned my addr 172.21.15.78:0/3058483598 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.772+0000 7fc6d77fe640 1 --2- 172.21.15.78:0/3058483598 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6d80b7fe0 0x7fc6d81f6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.772+0000 7fc6d6ffd640 1 -- 172.21.15.78:0/3058483598 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc6d8148240 msgr2=0x7fc6d81f7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.772+0000 7fc6d6ffd640 1 --2- 172.21.15.78:0/3058483598 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc6d8148240 0x7fc6d81f7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.772+0000 7fc6d6ffd640 1 -- 172.21.15.78:0/3058483598 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6d80b7fe0 msgr2=0x7fc6d81f6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.772+0000 7fc6d6ffd640 1 --2- 172.21.15.78:0/3058483598 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6d80b7fe0 0x7fc6d81f6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.772+0000 7fc6d6ffd640 1 -- 172.21.15.78:0/3058483598 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d815d0a0 con 0x7fc6d80cd360 2024-09-17T03:14:06.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.772+0000 7fc6d6ffd640 1 --2- 172.21.15.78:0/3058483598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d80cd360 0x7fc6d81f6cc0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00c3f0 tx=0x7fc6cc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.772+0000 7fc6bffff640 1 -- 172.21.15.78:0/3058483598 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc017070 con 0x7fc6d80cd360 2024-09-17T03:14:06.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.772+0000 7fc6bffff640 1 -- 172.21.15.78:0/3058483598 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6cc0035f0 con 0x7fc6d80cd360 2024-09-17T03:14:06.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.772+0000 7fc6ddfa1640 1 -- 172.21.15.78:0/3058483598 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d815f4f0 con 0x7fc6d80cd360 2024-09-17T03:14:06.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.772+0000 7fc6bffff640 1 -- 172.21.15.78:0/3058483598 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc003a40 con 0x7fc6d80cd360 2024-09-17T03:14:06.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.772+0000 7fc6ddfa1640 1 -- 172.21.15.78:0/3058483598 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d815fab0 con 0x7fc6d80cd360 2024-09-17T03:14:06.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.774+0000 7fc6bffff640 1 -- 172.21.15.78:0/3058483598 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc6cc01a070 con 0x7fc6d80cd360 2024-09-17T03:14:06.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.774+0000 7fc6bffff640 1 --2- 172.21.15.78:0/3058483598 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc6c4078bc0 0x7fc6c407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.774+0000 7fc6bffff640 1 -- 172.21.15.78:0/3058483598 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fc6cc099f20 con 0x7fc6d80cd360 2024-09-17T03:14:06.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.775+0000 7fc6d77fe640 1 --2- 172.21.15.78:0/3058483598 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc6c4078bc0 0x7fc6c407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.775+0000 7fc6d77fe640 1 --2- 172.21.15.78:0/3058483598 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc6c4078bc0 0x7fc6c407b0d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009a00 tx=0x7fc6c8005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.775+0000 7fc6e4fec740 1 Processor -- start 2024-09-17T03:14:06.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.775+0000 7fc6e4fec740 1 -- start start 2024-09-17T03:14:06.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.777+0000 7fc6e4fec740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fcadf45390 0x55fcae316740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.777+0000 7fc6e4fec740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf1c4d0 0x55fcae316c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.777+0000 7fc6e4fec740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf246b0 0x55fcae333b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.777+0000 7fc6e4fec740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55fcae25fa60 con 0x55fcadf1c4d0 2024-09-17T03:14:06.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.777+0000 7fc6e4fec740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55fcae24ee90 con 0x55fcadf246b0 2024-09-17T03:14:06.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.777+0000 7fc6e4fec740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55fcae252ca0 con 0x55fcadf45390 2024-09-17T03:14:06.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.777+0000 7fc6d6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf1c4d0 0x55fcae316c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.777+0000 7fc6d6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf1c4d0 0x55fcae316c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42142/0 (socket says 172.21.15.78:42142) 2024-09-17T03:14:06.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.777+0000 7fc6d6ffd640 1 -- 172.21.15.78:0/2994421761 learned_addr learned my addr 172.21.15.78:0/2994421761 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.777+0000 7fc6d77fe640 1 --2- 172.21.15.78:0/2994421761 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fcadf45390 0x55fcae316740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.777+0000 7fc6d7fff640 1 --2- 172.21.15.78:0/2994421761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf246b0 0x55fcae333b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.777+0000 7fc6d6ffd640 1 -- 172.21.15.78:0/2994421761 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fcadf45390 msgr2=0x55fcae316740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.777+0000 7fc6d6ffd640 1 --2- 172.21.15.78:0/2994421761 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fcadf45390 0x55fcae316740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.777+0000 7fc6d6ffd640 1 -- 172.21.15.78:0/2994421761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf246b0 msgr2=0x55fcae333b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.777+0000 7fc6d6ffd640 1 --2- 172.21.15.78:0/2994421761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf246b0 0x55fcae333b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.777+0000 7fc6d6ffd640 1 -- 172.21.15.78:0/2994421761 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcae0277d0 con 0x55fcadf1c4d0 2024-09-17T03:14:06.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.777+0000 7fc6d6ffd640 1 --2- 172.21.15.78:0/2994421761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf1c4d0 0x55fcae316c80 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc098470 tx=0x7fc6cc0618c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bc675aef5bc91b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.778+0000 7fc6bd7fa640 1 -- 172.21.15.78:0/2994421761 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc088070 con 0x55fcadf1c4d0 2024-09-17T03:14:06.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.778+0000 7fc6bd7fa640 1 -- 172.21.15.78:0/2994421761 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6cc061db0 con 0x55fcadf1c4d0 2024-09-17T03:14:06.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.778+0000 7fc6bd7fa640 1 -- 172.21.15.78:0/2994421761 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc06b510 con 0x55fcadf1c4d0 2024-09-17T03:14:06.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.778+0000 7fc6e4fec740 1 -- 172.21.15.78:0/2994421761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf1c4d0 msgr2=0x55fcae316c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.778+0000 7fc6e4fec740 1 --2- 172.21.15.78:0/2994421761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf1c4d0 0x55fcae316c80 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc098470 tx=0x7fc6cc0618c0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.779+0000 7fc6e4fec740 1 -- 172.21.15.78:0/2994421761 shutdown_connections 2024-09-17T03:14:06.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.779+0000 7fc6e4fec740 1 --2- 172.21.15.78:0/2994421761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf246b0 0x55fcae333b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.779+0000 7fc6e4fec740 1 --2- 172.21.15.78:0/2994421761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf1c4d0 0x55fcae316c80 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.779+0000 7fc6e4fec740 1 --2- 172.21.15.78:0/2994421761 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fcadf45390 0x55fcae316740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.779+0000 7fc6e4fec740 1 -- 172.21.15.78:0/2994421761 >> 172.21.15.78:0/2994421761 conn(0x55fcadf394e0 msgr2=0x55fcae2eca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.779+0000 7fc6e4fec740 1 -- 172.21.15.78:0/2994421761 shutdown_connections 2024-09-17T03:14:06.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.779+0000 7fc6e4fec740 1 -- 172.21.15.78:0/2994421761 wait complete. 2024-09-17T03:14:06.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.779+0000 7fc6e4fec740 1 -- start start 2024-09-17T03:14:06.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.780+0000 7fc6e4fec740 1 Processor -- start 2024-09-17T03:14:06.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6e4fec740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf1c4d0 0x55fcae304950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6e4fec740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf246b0 0x55fcae2eb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6e4fec740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fcadf45390 0x55fcae2eb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6e4fec740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55fcadfbf740 con 0x55fcadf246b0 2024-09-17T03:14:06.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6e4fec740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55fcae1f4970 con 0x55fcadf1c4d0 2024-09-17T03:14:06.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6e4fec740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55fcae32b1f0 con 0x55fcadf45390 2024-09-17T03:14:06.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6e4fec740 10 client.0 _ll_register_callbacks cb 0x55fcae1f7be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:06.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6d6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf246b0 0x55fcae2eb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6d6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf246b0 0x55fcae2eb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42146/0 (socket says 172.21.15.78:42146) 2024-09-17T03:14:06.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6d6ffd640 1 -- 172.21.15.78:0/518419340 learned_addr learned my addr 172.21.15.78:0/518419340 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6d77fe640 1 --2- 172.21.15.78:0/518419340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf1c4d0 0x55fcae304950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6d6ffd640 1 -- 172.21.15.78:0/518419340 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fcadf45390 msgr2=0x55fcae2eb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6d6ffd640 1 --2- 172.21.15.78:0/518419340 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fcadf45390 0x55fcae2eb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6d6ffd640 1 -- 172.21.15.78:0/518419340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf1c4d0 msgr2=0x55fcae304950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6d6ffd640 1 --2- 172.21.15.78:0/518419340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf1c4d0 0x55fcae304950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6d6ffd640 1 -- 172.21.15.78:0/518419340 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcadfb0970 con 0x55fcadf246b0 2024-09-17T03:14:06.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6d77fe640 1 --2- 172.21.15.78:0/518419340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf1c4d0 0x55fcae304950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:06.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6d6ffd640 1 --2- 172.21.15.78:0/518419340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf246b0 0x55fcae2eb1a0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00cdb0 tx=0x7fc6cc0612c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235ec3fb37aebf22 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:06.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6b67fc640 1 -- 172.21.15.78:0/518419340 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc088040 con 0x55fcadf246b0 2024-09-17T03:14:06.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6b67fc640 1 -- 172.21.15.78:0/518419340 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fc6cc05d910 con 0x55fcadf246b0 2024-09-17T03:14:06.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.781+0000 7fc6e4fec740 1 -- 172.21.15.78:0/518419340 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6cc061db0 con 0x55fcadf246b0 2024-09-17T03:14:06.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.782+0000 7fc6b67fc640 1 -- 172.21.15.78:0/518419340 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fc6cc066890 con 0x55fcadf246b0 2024-09-17T03:14:06.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.782+0000 7fc6e4fec740 10 client.7899 fetch_fsmap learned FSMap version 83 2024-09-17T03:14:06.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.782+0000 7fc6e4fec740 1 -- 172.21.15.78:0/518419340 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x55fcadf8e6a0 con 0x55fcadf246b0 2024-09-17T03:14:06.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.782+0000 7fc6b67fc640 1 -- 172.21.15.78:0/518419340 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6cc061db0 con 0x55fcadf246b0 2024-09-17T03:14:06.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.782+0000 7fc6b67fc640 1 -- 172.21.15.78:0/518419340 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 83) ==== 3554+0+0 (secure 0 0 0) 0x7fc6cc069b80 con 0x55fcadf246b0 2024-09-17T03:14:06.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.782+0000 7fc6e4fec740 10 client.7899 fetch_fsmap finished waiting for FSMap version 83 2024-09-17T03:14:06.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.782+0000 7fc6e4fec740 10 client.7899 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T03:14:06.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.782+0000 7fc6e4fec740 20 client.7899 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:06.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.782+0000 7fc6e4fec740 1 --2- 172.21.15.78:0/518419340 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55fcadf03f60 0x55fcae328330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.782+0000 7fc6e4fec740 4 client.7899 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:14:06.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.782+0000 7fc6e4fec740 1 -- 172.21.15.78:0/518419340 --> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcae2619b0 con 0x55fcadf03f60 2024-09-17T03:14:06.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.782+0000 7fc6d77fe640 1 --2- 172.21.15.78:0/518419340 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55fcadf03f60 0x55fcae328330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.782+0000 7fc6b67fc640 10 client.7899 ms_handle_connect on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:06.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.782+0000 7fc6d77fe640 1 --2- 172.21.15.78:0/518419340 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55fcadf03f60 0x55fcae328330 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcd7dfdb8df7187e server_cookie=62d66b5acaec0549 in_seq=0 out_seq=0 2024-09-17T03:14:06.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.783+0000 7fc6b67fc640 1 -- 172.21.15.78:0/518419340 <== mds.0 v2:172.21.15.78:6833/3357123265 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fcae2619b0 con 0x55fcadf03f60 2024-09-17T03:14:06.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.783+0000 7fc6b67fc640 10 client.7899 handle_command_reply: tid=0 2024-09-17T03:14:06.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.783+0000 7fc6e4fec740 1 client.7899 shutdown 2024-09-17T03:14:06.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.783+0000 7fc6e4fec740 1 -- 172.21.15.78:0/518419340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf246b0 msgr2=0x55fcae2eb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.783+0000 7fc6e4fec740 1 --2- 172.21.15.78:0/518419340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf246b0 0x55fcae2eb1a0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00cdb0 tx=0x7fc6cc0612c0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.783+0000 7fc6e4fec740 1 -- 172.21.15.78:0/518419340 shutdown_connections 2024-09-17T03:14:06.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.783+0000 7fc6e4fec740 1 --2- 172.21.15.78:0/518419340 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55fcadf03f60 0x55fcae328330 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.783+0000 7fc6e4fec740 1 --2- 172.21.15.78:0/518419340 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fcadf45390 0x55fcae2eb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.783+0000 7fc6e4fec740 1 --2- 172.21.15.78:0/518419340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf246b0 0x55fcae2eb1a0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.783+0000 7fc6b67fc640 0 client.7899 ms_handle_reset on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:06.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.783+0000 7fc6e4fec740 1 --2- 172.21.15.78:0/518419340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf1c4d0 0x55fcae304950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.783+0000 7fc6e4fec740 1 -- 172.21.15.78:0/518419340 >> 172.21.15.78:0/518419340 conn(0x55fcadf394e0 msgr2=0x55fcae2ecab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.783+0000 7fc6e4fec740 1 -- 172.21.15.78:0/518419340 shutdown_connections 2024-09-17T03:14:06.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.783+0000 7fc6e4fec740 1 -- 172.21.15.78:0/518419340 wait complete. 2024-09-17T03:14:06.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.783+0000 7fc6e4fec740 20 client.7899 trim_cache size 0 max 16384 2024-09-17T03:14:06.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.801+0000 7fc6e4fec740 1 Processor -- start 2024-09-17T03:14:06.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.801+0000 7fc6e4fec740 1 -- start start 2024-09-17T03:14:06.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.802+0000 7fc6e4fec740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf1c4d0 0x55fcae340b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.802+0000 7fc6e4fec740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf246b0 0x55fcae316740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.802+0000 7fc6e4fec740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fcadf45390 0x55fcae316c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.802+0000 7fc6e4fec740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d81ffde0 con 0x55fcadf1c4d0 2024-09-17T03:14:06.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.802+0000 7fc6e4fec740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d81fefb0 con 0x55fcadf246b0 2024-09-17T03:14:06.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.802+0000 7fc6e4fec740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc6d81ff6b0 con 0x55fcadf45390 2024-09-17T03:14:06.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.802+0000 7fc6d77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf1c4d0 0x55fcae340b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.802+0000 7fc6d77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf1c4d0 0x55fcae340b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42148/0 (socket says 172.21.15.78:42148) 2024-09-17T03:14:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.803+0000 7fc6d77fe640 1 -- 172.21.15.78:0/1406193492 learned_addr learned my addr 172.21.15.78:0/1406193492 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.803+0000 7fc6d6ffd640 1 --2- 172.21.15.78:0/1406193492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf246b0 0x55fcae316740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.803+0000 7fc6d77fe640 1 -- 172.21.15.78:0/1406193492 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fcadf45390 msgr2=0x55fcae316c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.803+0000 7fc6d77fe640 1 --2- 172.21.15.78:0/1406193492 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fcadf45390 0x55fcae316c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.803+0000 7fc6d77fe640 1 -- 172.21.15.78:0/1406193492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf246b0 msgr2=0x55fcae316740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.803+0000 7fc6d77fe640 1 --2- 172.21.15.78:0/1406193492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf246b0 0x55fcae316740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.803+0000 7fc6d77fe640 1 -- 172.21.15.78:0/1406193492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcae2e9310 con 0x55fcadf1c4d0 2024-09-17T03:14:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.803+0000 7fc6d6ffd640 1 --2- 172.21.15.78:0/1406193492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf246b0 0x55fcae316740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.803+0000 7fc6d77fe640 1 --2- 172.21.15.78:0/1406193492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf1c4d0 0x55fcae340b30 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8012560 tx=0x7fc6c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6870836fc3c9c01a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.803+0000 7fc6bcff9640 1 -- 172.21.15.78:0/1406193492 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8005220 con 0x55fcadf1c4d0 2024-09-17T03:14:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.803+0000 7fc6bcff9640 1 -- 172.21.15.78:0/1406193492 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6c802d030 con 0x55fcadf1c4d0 2024-09-17T03:14:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.803+0000 7fc6bcff9640 1 -- 172.21.15.78:0/1406193492 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c80047a0 con 0x55fcadf1c4d0 2024-09-17T03:14:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.804+0000 7fc6e4fec740 1 -- 172.21.15.78:0/1406193492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf1c4d0 msgr2=0x55fcae340b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.804+0000 7fc6e4fec740 1 --2- 172.21.15.78:0/1406193492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf1c4d0 0x55fcae340b30 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8012560 tx=0x7fc6c8017000 comp rx=0 tx=0).stop 2024-09-17T03:14:06.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.804+0000 7fc6e4fec740 1 -- 172.21.15.78:0/1406193492 shutdown_connections 2024-09-17T03:14:06.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.804+0000 7fc6e4fec740 1 --2- 172.21.15.78:0/1406193492 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fcadf45390 0x55fcae316c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.804+0000 7fc6e4fec740 1 --2- 172.21.15.78:0/1406193492 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf246b0 0x55fcae316740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.804+0000 7fc6e4fec740 1 --2- 172.21.15.78:0/1406193492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf1c4d0 0x55fcae340b30 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.804+0000 7fc6e4fec740 1 -- 172.21.15.78:0/1406193492 >> 172.21.15.78:0/1406193492 conn(0x55fcadf394e0 msgr2=0x55fcae2e2500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.804+0000 7fc6e4fec740 1 -- 172.21.15.78:0/1406193492 shutdown_connections 2024-09-17T03:14:06.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.804+0000 7fc6e4fec740 1 -- 172.21.15.78:0/1406193492 wait complete. 2024-09-17T03:14:06.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.805+0000 7fc6e4fec740 1 -- start start 2024-09-17T03:14:06.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.805+0000 7fc6e4fec740 1 Processor -- start 2024-09-17T03:14:06.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.806+0000 7fc6e4fec740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf1c4d0 0x55fcae3aa400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.806+0000 7fc6e4fec740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf246b0 0x55fcae316740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.806+0000 7fc6e4fec740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fcadf45390 0x55fcae316c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.806+0000 7fc6e4fec740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d80c7f00 con 0x55fcadf246b0 2024-09-17T03:14:06.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.806+0000 7fc6e4fec740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55fcae316080 con 0x55fcadf1c4d0 2024-09-17T03:14:06.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.806+0000 7fc6e4fec740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55fcae3b15f0 con 0x55fcadf45390 2024-09-17T03:14:06.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.806+0000 7fc6e4fec740 10 client.0 _ll_register_callbacks cb 0x7fc6d0035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:06.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.806+0000 7fc6d6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf246b0 0x55fcae316740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.806+0000 7fc6d6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf246b0 0x55fcae316740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42150/0 (socket says 172.21.15.78:42150) 2024-09-17T03:14:06.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.806+0000 7fc6d6ffd640 1 -- 172.21.15.78:0/3797502046 learned_addr learned my addr 172.21.15.78:0/3797502046 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.806+0000 7fc6d77fe640 1 --2- 172.21.15.78:0/3797502046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf1c4d0 0x55fcae3aa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.806+0000 7fc6d7fff640 1 --2- 172.21.15.78:0/3797502046 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fcadf45390 0x55fcae316c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.806+0000 7fc6d6ffd640 1 -- 172.21.15.78:0/3797502046 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fcadf45390 msgr2=0x55fcae316c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6d6ffd640 1 --2- 172.21.15.78:0/3797502046 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fcadf45390 0x55fcae316c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6d6ffd640 1 -- 172.21.15.78:0/3797502046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf1c4d0 msgr2=0x55fcae3aa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:06.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6d6ffd640 1 --2- 172.21.15.78:0/3797502046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf1c4d0 0x55fcae3aa400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6d6ffd640 1 -- 172.21.15.78:0/3797502046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcae332640 con 0x55fcadf246b0 2024-09-17T03:14:06.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6d77fe640 1 --2- 172.21.15.78:0/3797502046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf1c4d0 0x55fcae3aa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:06.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6d7fff640 1 --2- 172.21.15.78:0/3797502046 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fcadf45390 0x55fcae316c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:06.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6d6ffd640 1 --2- 172.21.15.78:0/3797502046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf246b0 0x55fcae316740 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc003fd0 tx=0x7fc6cc06b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5945fd6aa1c331 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:06.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6b67fc640 1 -- 172.21.15.78:0/3797502046 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc061db0 con 0x55fcadf246b0 2024-09-17T03:14:06.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6b67fc640 1 -- 172.21.15.78:0/3797502046 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fc6cc084120 con 0x55fcadf246b0 2024-09-17T03:14:06.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6e4fec740 1 -- 172.21.15.78:0/3797502046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6c802d030 con 0x55fcadf246b0 2024-09-17T03:14:06.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6b67fc640 1 -- 172.21.15.78:0/3797502046 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fc6cc094050 con 0x55fcadf246b0 2024-09-17T03:14:06.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6e4fec740 10 client.7905 fetch_fsmap learned FSMap version 83 2024-09-17T03:14:06.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6e4fec740 1 -- 172.21.15.78:0/3797502046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) -- 0x55fcae332640 con 0x55fcadf246b0 2024-09-17T03:14:06.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6b67fc640 1 -- 172.21.15.78:0/3797502046 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc6c802d030 con 0x55fcadf246b0 2024-09-17T03:14:06.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6b67fc640 1 -- 172.21.15.78:0/3797502046 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 83) ==== 3554+0+0 (secure 0 0 0) 0x7fc6cc097020 con 0x55fcadf246b0 2024-09-17T03:14:06.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6e4fec740 10 client.7905 fetch_fsmap finished waiting for FSMap version 83 2024-09-17T03:14:06.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6e4fec740 10 client.7905 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T03:14:06.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6e4fec740 20 client.7905 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:06.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6e4fec740 1 --2- 172.21.15.78:0/3797502046 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55fcae353fb0 0x55fcae2e9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6e4fec740 4 client.7905 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:14:06.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6e4fec740 1 -- 172.21.15.78:0/3797502046 --> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fcae25d460 con 0x55fcae353fb0 2024-09-17T03:14:06.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.807+0000 7fc6d77fe640 1 --2- 172.21.15.78:0/3797502046 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55fcae353fb0 0x55fcae2e9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.808+0000 7fc6b67fc640 10 client.7905 ms_handle_connect on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:06.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.808+0000 7fc6d77fe640 1 --2- 172.21.15.78:0/3797502046 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55fcae353fb0 0x55fcae2e9d70 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a518441723de2a2f server_cookie=ed174d0475295622 in_seq=0 out_seq=0 2024-09-17T03:14:06.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.808+0000 7fc6b67fc640 1 -- 172.21.15.78:0/3797502046 <== mds.0 v2:172.21.15.78:6833/3357123265 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x55fcae25d460 con 0x55fcae353fb0 2024-09-17T03:14:06.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.808+0000 7fc6b67fc640 10 client.7905 handle_command_reply: tid=0 2024-09-17T03:14:06.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.808+0000 7fc6e4fec740 1 client.7905 shutdown 2024-09-17T03:14:06.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.808+0000 7fc6e4fec740 1 -- 172.21.15.78:0/3797502046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf246b0 msgr2=0x55fcae316740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.808+0000 7fc6e4fec740 1 --2- 172.21.15.78:0/3797502046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf246b0 0x55fcae316740 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc003fd0 tx=0x7fc6cc06b8a0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.808+0000 7fc6e4fec740 1 -- 172.21.15.78:0/3797502046 shutdown_connections 2024-09-17T03:14:06.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.808+0000 7fc6e4fec740 1 --2- 172.21.15.78:0/3797502046 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55fcae353fb0 0x55fcae2e9d70 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.808+0000 7fc6e4fec740 1 --2- 172.21.15.78:0/3797502046 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55fcadf45390 0x55fcae316c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.808+0000 7fc6b67fc640 0 client.7905 ms_handle_reset on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:06.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.808+0000 7fc6e4fec740 1 --2- 172.21.15.78:0/3797502046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55fcadf246b0 0x55fcae316740 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.808+0000 7fc6e4fec740 1 --2- 172.21.15.78:0/3797502046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55fcadf1c4d0 0x55fcae3aa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.808+0000 7fc6e4fec740 1 -- 172.21.15.78:0/3797502046 >> 172.21.15.78:0/3797502046 conn(0x55fcadf394e0 msgr2=0x55fcae2e2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.808+0000 7fc6e4fec740 1 -- 172.21.15.78:0/3797502046 shutdown_connections 2024-09-17T03:14:06.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.808+0000 7fc6e4fec740 1 -- 172.21.15.78:0/3797502046 wait complete. 2024-09-17T03:14:06.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.808+0000 7fc6e4fec740 20 client.7905 trim_cache size 0 max 16384 2024-09-17T03:14:06.813 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:14:06.813 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-17T03:14:06.814 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:14:06.814 INFO:teuthology.orchestra.run.smithi078.stdout: "06dff376-fc02-4326-a75b-2bb8deb474f9": { 2024-09-17T03:14:06.814 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:14:06.814 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "06dff376-fc02-4326-a75b-2bb8deb474f9", 2024-09-17T03:14:06.814 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:14:06.814 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:06.814 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:14:06.814 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-17T03:14:06.814 INFO:teuthology.orchestra.run.smithi078.stdout: "06dff376-fc02-4326-a75b-2bb8deb474f9": { 2024-09-17T03:14:06.814 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-17T03:14:06.141674+0000", 2024-09-17T03:14:06.814 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:14:06.814 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-17T03:14:06.814 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-17T03:14:06.815 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-17T03:14:06.815 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-17T03:14:06.815 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:06.815 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:06.815 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:14:06.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.809+0000 7fc6ddfa1640 1 -- 172.21.15.78:0/3058483598 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc6c4078bc0 msgr2=0x7fc6c407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.809+0000 7fc6ddfa1640 1 --2- 172.21.15.78:0/3058483598 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc6c4078bc0 0x7fc6c407b0d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009a00 tx=0x7fc6c8005f90 comp rx=0 tx=0).stop 2024-09-17T03:14:06.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.809+0000 7fc6ddfa1640 1 -- 172.21.15.78:0/3058483598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d80cd360 msgr2=0x7fc6d81f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.809+0000 7fc6ddfa1640 1 --2- 172.21.15.78:0/3058483598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d80cd360 0x7fc6d81f6cc0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00c3f0 tx=0x7fc6cc00c8b0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.809+0000 7fc6ddfa1640 1 -- 172.21.15.78:0/3058483598 shutdown_connections 2024-09-17T03:14:06.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.809+0000 7fc6ddfa1640 1 --2- 172.21.15.78:0/3058483598 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc6d8148240 0x7fc6d81f7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.809+0000 7fc6ddfa1640 1 --2- 172.21.15.78:0/3058483598 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc6d80cd360 0x7fc6d81f6cc0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.809+0000 7fc6ddfa1640 1 --2- 172.21.15.78:0/3058483598 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc6c4078bc0 0x7fc6c407b0d0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.809+0000 7fc6ddfa1640 1 --2- 172.21.15.78:0/3058483598 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc6d80b7fe0 0x7fc6d81f6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.809+0000 7fc6ddfa1640 1 -- 172.21.15.78:0/3058483598 >> 172.21.15.78:0/3058483598 conn(0x7fc6d80710b0 msgr2=0x7fc6d81e6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.809+0000 7fc6ddfa1640 1 -- 172.21.15.78:0/3058483598 shutdown_connections 2024-09-17T03:14:06.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.809+0000 7fc6ddfa1640 1 -- 172.21.15.78:0/3058483598 wait complete. 2024-09-17T03:14:06.818 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:14:06.819 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:06.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.932+0000 7f87972b4640 1 -- 172.21.15.78:0/2384981418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87900ca800 msgr2=0x7f87900cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.932+0000 7f87972b4640 1 --2- 172.21.15.78:0/2384981418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87900ca800 0x7f87900cba00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f878c009830 tx=0x7f878c02a540 comp rx=0 tx=0).stop 2024-09-17T03:14:06.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.932+0000 7f87972b4640 1 -- 172.21.15.78:0/2384981418 shutdown_connections 2024-09-17T03:14:06.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.932+0000 7f87972b4640 1 --2- 172.21.15.78:0/2384981418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87900ca800 0x7f87900cba00 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.932+0000 7f87972b4640 1 -- 172.21.15.78:0/2384981418 >> 172.21.15.78:0/2384981418 conn(0x7f87900b1cb0 msgr2=0x7f87900b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:06.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.932+0000 7f87972b4640 1 -- 172.21.15.78:0/2384981418 shutdown_connections 2024-09-17T03:14:06.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.932+0000 7f87972b4640 1 -- 172.21.15.78:0/2384981418 wait complete. 2024-09-17T03:14:06.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.934+0000 7f87972b4640 1 Processor -- start 2024-09-17T03:14:06.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.934+0000 7f87972b4640 1 -- start start 2024-09-17T03:14:06.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.935+0000 7f87972b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87900ca800 0x7f879009db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.935+0000 7f87972b4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f87900cad30 0x7f87901f8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.935+0000 7f87972b4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87901f8ba0 0x7f87901f8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.935+0000 7f87972b4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8790074130 con 0x7f87900ca800 2024-09-17T03:14:06.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.935+0000 7f87972b4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8790073fb0 con 0x7f87901f8ba0 2024-09-17T03:14:06.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.935+0000 7f87972b4640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f87900742b0 con 0x7f87900cad30 2024-09-17T03:14:06.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.935+0000 7f8795050640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87900ca800 0x7f879009db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.935+0000 7f8795050640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87900ca800 0x7f879009db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42160/0 (socket says 172.21.15.78:42160) 2024-09-17T03:14:06.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.935+0000 7f8795050640 1 -- 172.21.15.78:0/3243218402 learned_addr learned my addr 172.21.15.78:0/3243218402 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:06.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.936+0000 7f879484f640 1 --2- 172.21.15.78:0/3243218402 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f87900cad30 0x7f87901f8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.936+0000 7f8795050640 1 -- 172.21.15.78:0/3243218402 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f87900cad30 msgr2=0x7f87901f8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.936+0000 7f8795050640 1 --2- 172.21.15.78:0/3243218402 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f87900cad30 0x7f87901f8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.936+0000 7f8795050640 1 -- 172.21.15.78:0/3243218402 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87901f8ba0 msgr2=0x7f87901f8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:06.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.936+0000 7f8795851640 1 --2- 172.21.15.78:0/3243218402 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87901f8ba0 0x7f87901f8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.936+0000 7f8795050640 1 --2- 172.21.15.78:0/3243218402 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87901f8ba0 0x7f87901f8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:06.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.936+0000 7f8795050640 1 -- 172.21.15.78:0/3243218402 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87901f94f0 con 0x7f87900ca800 2024-09-17T03:14:06.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.936+0000 7f879484f640 1 --2- 172.21.15.78:0/3243218402 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f87900cad30 0x7f87901f8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:06.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.936+0000 7f8795050640 1 --2- 172.21.15.78:0/3243218402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87900ca800 0x7f879009db00 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f878c009950 tx=0x7f878c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.936+0000 7f8785ffb640 1 -- 172.21.15.78:0/3243218402 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c005c90 con 0x7f87900ca800 2024-09-17T03:14:06.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.936+0000 7f87972b4640 1 -- 172.21.15.78:0/3243218402 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f879015e580 con 0x7f87900ca800 2024-09-17T03:14:06.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.936+0000 7f8785ffb640 1 -- 172.21.15.78:0/3243218402 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f878c005020 con 0x7f87900ca800 2024-09-17T03:14:06.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.936+0000 7f8785ffb640 1 -- 172.21.15.78:0/3243218402 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c005450 con 0x7f87900ca800 2024-09-17T03:14:06.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.936+0000 7f87972b4640 1 -- 172.21.15.78:0/3243218402 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f879015bf80 con 0x7f87900ca800 2024-09-17T03:14:06.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.937+0000 7f87972b4640 1 -- 172.21.15.78:0/3243218402 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87900747d0 con 0x7f87900ca800 2024-09-17T03:14:06.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.938+0000 7f8785ffb640 1 -- 172.21.15.78:0/3243218402 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f878c0317c0 con 0x7f87900ca800 2024-09-17T03:14:06.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.939+0000 7f8785ffb640 1 --2- 172.21.15.78:0/3243218402 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8774078bc0 0x7f877407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:06.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.939+0000 7f8785ffb640 1 -- 172.21.15.78:0/3243218402 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f878c0bbe90 con 0x7f87900ca800 2024-09-17T03:14:06.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.939+0000 7f879484f640 1 --2- 172.21.15.78:0/3243218402 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8774078bc0 0x7f877407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:06.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.939+0000 7f879484f640 1 --2- 172.21.15.78:0/3243218402 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8774078bc0 0x7f877407b0d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f87800013c0 tx=0x7f8780009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:06.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:06.943+0000 7f8785ffb640 1 -- 172.21.15.78:0/3243218402 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f87901f94f0 con 0x7f87900ca800 2024-09-17T03:14:07.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.155+0000 7f87972b4640 1 -- 172.21.15.78:0/3243218402 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f879015bc70 con 0x7f87900ca800 2024-09-17T03:14:07.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.155+0000 7f8785ffb640 1 -- 172.21.15.78:0/3243218402 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) ==== 94+0+5273 (secure 0 0 0) 0x7f878c03f030 con 0x7f87900ca800 2024-09-17T03:14:07.154 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:07.154 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":83,"btime":"2024-09-17T03:14:02:429524+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:35.489582+0000","modified":"2024-09-17T03:14:01.456401+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7428,"mds_1":7425,"mds_2":6640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"d","rank":2,"incarnation":80,"state":"up:active","state_seq":6,"addr":"172.21.15.193:6837/1005450673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1005450673},{"type":"v1","addr":"172.21.15.193:6837","nonce":1005450673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7425":{"gid":7425,"name":"c","rank":1,"incarnation":78,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6835/4018023271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4018023271},{"type":"v1","addr":"172.21.15.78:6835","nonce":4018023271}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6832/3357123265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":3357123265},{"type":"v1","addr":"172.21.15.78:6832","nonce":3357123265}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7428,"qdb_cluster":[6640,7425,7428]},"id":6}]} 2024-09-17T03:14:07.154 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 83 2024-09-17T03:14:07.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.157+0000 7f87972b4640 1 -- 172.21.15.78:0/3243218402 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8774078bc0 msgr2=0x7f877407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:07.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.158+0000 7f87972b4640 1 --2- 172.21.15.78:0/3243218402 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8774078bc0 0x7f877407b0d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f87800013c0 tx=0x7f8780009040 comp rx=0 tx=0).stop 2024-09-17T03:14:07.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.158+0000 7f87972b4640 1 -- 172.21.15.78:0/3243218402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87900ca800 msgr2=0x7f879009db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:07.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.158+0000 7f87972b4640 1 --2- 172.21.15.78:0/3243218402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87900ca800 0x7f879009db00 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f878c009950 tx=0x7f878c003c10 comp rx=0 tx=0).stop 2024-09-17T03:14:07.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.158+0000 7f87972b4640 1 -- 172.21.15.78:0/3243218402 shutdown_connections 2024-09-17T03:14:07.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.158+0000 7f87972b4640 1 --2- 172.21.15.78:0/3243218402 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8774078bc0 0x7f877407b0d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:07.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.158+0000 7f87972b4640 1 --2- 172.21.15.78:0/3243218402 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f87901f8ba0 0x7f87901f8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:07.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.158+0000 7f87972b4640 1 --2- 172.21.15.78:0/3243218402 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f87900cad30 0x7f87901f8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:07.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.158+0000 7f87972b4640 1 --2- 172.21.15.78:0/3243218402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87900ca800 0x7f879009db00 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:07.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.158+0000 7f87972b4640 1 -- 172.21.15.78:0/3243218402 >> 172.21.15.78:0/3243218402 conn(0x7f87900b1cb0 msgr2=0x7f87900b0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:07.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.158+0000 7f87972b4640 1 -- 172.21.15.78:0/3243218402 shutdown_connections 2024-09-17T03:14:07.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.158+0000 7f87972b4640 1 -- 172.21.15.78:0/3243218402 wait complete. 2024-09-17T03:14:07.167 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-17T03:14:07.168 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:14:07.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.281+0000 7f52f601d640 1 -- 172.21.15.78:0/3401291643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f0073170 msgr2=0x7f52f015c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:07.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.281+0000 7f52f601d640 1 --2- 172.21.15.78:0/3401291643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f0073170 0x7f52f015c780 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f52e0009830 tx=0x7f52e002a4a0 comp rx=0 tx=0).stop 2024-09-17T03:14:07.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.281+0000 7f52f601d640 1 -- 172.21.15.78:0/3401291643 shutdown_connections 2024-09-17T03:14:07.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.281+0000 7f52f601d640 1 --2- 172.21.15.78:0/3401291643 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52f0070030 0x7f52f0074640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:07.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.281+0000 7f52f601d640 1 --2- 172.21.15.78:0/3401291643 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f0073170 0x7f52f015c780 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:07.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.281+0000 7f52f601d640 1 -- 172.21.15.78:0/3401291643 >> 172.21.15.78:0/3401291643 conn(0x7f52f00b1cb0 msgr2=0x7f52f00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:07.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.281+0000 7f52f601d640 1 -- 172.21.15.78:0/3401291643 shutdown_connections 2024-09-17T03:14:07.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.281+0000 7f52f601d640 1 -- 172.21.15.78:0/3401291643 wait complete. 2024-09-17T03:14:07.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.282+0000 7f52f601d640 1 Processor -- start 2024-09-17T03:14:07.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.283+0000 7f52f601d640 1 -- start start 2024-09-17T03:14:07.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.284+0000 7f52f601d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52f0070030 0x7f52f01f71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:07.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.284+0000 7f52f601d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52f0070440 0x7f52f014b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:07.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.284+0000 7f52f601d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f0073170 0x7f52f009d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:07.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.284+0000 7f52f601d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f52f006f5a0 con 0x7f52f0073170 2024-09-17T03:14:07.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.284+0000 7f52f601d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f52f0074f80 con 0x7f52f0070440 2024-09-17T03:14:07.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.284+0000 7f52f601d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f52f006f720 con 0x7f52f0070030 2024-09-17T03:14:07.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.284+0000 7f52effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f0073170 0x7f52f009d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:07.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.284+0000 7f52effff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f0073170 0x7f52f009d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42188/0 (socket says 172.21.15.78:42188) 2024-09-17T03:14:07.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.284+0000 7f52effff640 1 -- 172.21.15.78:0/3792171901 learned_addr learned my addr 172.21.15.78:0/3792171901 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:07.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.284+0000 7f52eeffd640 1 --2- 172.21.15.78:0/3792171901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52f0070440 0x7f52f014b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:07.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.284+0000 7f52ef7fe640 1 --2- 172.21.15.78:0/3792171901 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52f0070030 0x7f52f01f71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:07.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.284+0000 7f52effff640 1 -- 172.21.15.78:0/3792171901 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52f0070030 msgr2=0x7f52f01f71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:07.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.284+0000 7f52effff640 1 --2- 172.21.15.78:0/3792171901 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52f0070030 0x7f52f01f71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:07.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.284+0000 7f52effff640 1 -- 172.21.15.78:0/3792171901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52f0070440 msgr2=0x7f52f014b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:07.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.284+0000 7f52effff640 1 --2- 172.21.15.78:0/3792171901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52f0070440 0x7f52f014b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:07.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.284+0000 7f52effff640 1 -- 172.21.15.78:0/3792171901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f009aa30 con 0x7f52f0073170 2024-09-17T03:14:07.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.284+0000 7f52ef7fe640 1 --2- 172.21.15.78:0/3792171901 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52f0070030 0x7f52f01f71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:07.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.285+0000 7f52effff640 1 --2- 172.21.15.78:0/3792171901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f0073170 0x7f52f009d0a0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f52e800c730 tx=0x7f52e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:07.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.285+0000 7f52d7fff640 1 -- 172.21.15.78:0/3792171901 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e8017070 con 0x7f52f0073170 2024-09-17T03:14:07.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.285+0000 7f52d7fff640 1 -- 172.21.15.78:0/3792171901 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52e8003c60 con 0x7f52f0073170 2024-09-17T03:14:07.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.285+0000 7f52f601d640 1 -- 172.21.15.78:0/3792171901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f01e50b0 con 0x7f52f0073170 2024-09-17T03:14:07.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.285+0000 7f52d7fff640 1 -- 172.21.15.78:0/3792171901 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e80052d0 con 0x7f52f0073170 2024-09-17T03:14:07.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.285+0000 7f52f601d640 1 -- 172.21.15.78:0/3792171901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f01f7ce0 con 0x7f52f0073170 2024-09-17T03:14:07.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.286+0000 7f52f601d640 1 -- 172.21.15.78:0/3792171901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f0076820 con 0x7f52f0073170 2024-09-17T03:14:07.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.287+0000 7f52d7fff640 1 -- 172.21.15.78:0/3792171901 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f52e801a070 con 0x7f52f0073170 2024-09-17T03:14:07.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.287+0000 7f52d7fff640 1 --2- 172.21.15.78:0/3792171901 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f52dc078b90 0x7f52dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:07.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.287+0000 7f52d7fff640 1 -- 172.21.15.78:0/3792171901 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f52e809a3b0 con 0x7f52f0073170 2024-09-17T03:14:07.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.287+0000 7f52ef7fe640 1 --2- 172.21.15.78:0/3792171901 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f52dc078b90 0x7f52dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:07.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.288+0000 7f52ef7fe640 1 --2- 172.21.15.78:0/3792171901 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f52dc078b90 0x7f52dc07b0a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f52e0034000 tx=0x7f52e0004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:07.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.292+0000 7f52d7fff640 1 -- 172.21.15.78:0/3792171901 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f52e80627f0 con 0x7f52f0073170 2024-09-17T03:14:07.444 INFO:tasks.ceph.mon.a.smithi078.stderr:2024-09-17T03:14:07.446+0000 7f192d77d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-17T03:14:07.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.538+0000 7f52f601d640 1 -- 172.21.15.78:0/3792171901 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f52f00c3860 con 0x7f52f0073170 2024-09-17T03:14:07.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.539+0000 7f52d7fff640 1 -- 172.21.15.78:0/3792171901 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1757 (secure 0 0 0) 0x7f52e80620f0 con 0x7f52f0073170 2024-09-17T03:14:07.537 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:07.538 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":364,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":82,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":68,"data_bytes":700179,"bytes_used":256471040,"bytes_avail":772837642240,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":10151,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":84,"btime":"2024-09-17T03:14:07:446803+0000","id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6640},{"filesystem_id":6,"rank":1,"name":"c","status":"up:active","gid":7425},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7428}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-17T03:12:31.185413+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:14:07.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.541+0000 7f52f601d640 1 -- 172.21.15.78:0/3792171901 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f52dc078b90 msgr2=0x7f52dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:07.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.541+0000 7f52f601d640 1 --2- 172.21.15.78:0/3792171901 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f52dc078b90 0x7f52dc07b0a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f52e0034000 tx=0x7f52e0004730 comp rx=0 tx=0).stop 2024-09-17T03:14:07.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.541+0000 7f52f601d640 1 -- 172.21.15.78:0/3792171901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f0073170 msgr2=0x7f52f009d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:07.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.541+0000 7f52f601d640 1 --2- 172.21.15.78:0/3792171901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f0073170 0x7f52f009d0a0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f52e800c730 tx=0x7f52e800cbf0 comp rx=0 tx=0).stop 2024-09-17T03:14:07.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.541+0000 7f52f601d640 1 -- 172.21.15.78:0/3792171901 shutdown_connections 2024-09-17T03:14:07.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.541+0000 7f52f601d640 1 --2- 172.21.15.78:0/3792171901 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52f0073170 0x7f52f009d0a0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:07.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.541+0000 7f52f601d640 1 --2- 172.21.15.78:0/3792171901 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f52dc078b90 0x7f52dc07b0a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:07.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.541+0000 7f52f601d640 1 --2- 172.21.15.78:0/3792171901 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52f0070440 0x7f52f014b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:07.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.541+0000 7f52f601d640 1 --2- 172.21.15.78:0/3792171901 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52f0070030 0x7f52f01f71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:07.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.541+0000 7f52f601d640 1 -- 172.21.15.78:0/3792171901 >> 172.21.15.78:0/3792171901 conn(0x7f52f00b1cb0 msgr2=0x7f52f00adb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:07.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.541+0000 7f52f601d640 1 -- 172.21.15.78:0/3792171901 shutdown_connections 2024-09-17T03:14:07.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:07.541+0000 7f52f601d640 1 -- 172.21.15.78:0/3792171901 wait complete. 2024-09-17T03:14:07.551 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T03:14:08.552 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:08.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.670+0000 7fa580769640 1 -- 172.21.15.78:0/1080432104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa560003a00 msgr2=0x7fa560003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:08.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.670+0000 7fa580769640 1 --2- 172.21.15.78:0/1080432104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa560003a00 0x7fa560003e70 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fa568009b40 tx=0x7fa560005830 comp rx=0 tx=0).stop 2024-09-17T03:14:08.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.670+0000 7fa57ed06640 1 -- 172.21.15.78:0/1080432104 reap_dead start 2024-09-17T03:14:08.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.671+0000 7fa580769640 1 -- 172.21.15.78:0/1080432104 shutdown_connections 2024-09-17T03:14:08.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.671+0000 7fa580769640 1 -- 172.21.15.78:0/1080432104 >> 172.21.15.78:0/1080432104 conn(0x7fa57808bfc0 msgr2=0x7fa57809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:08.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.671+0000 7fa580769640 1 -- 172.21.15.78:0/1080432104 shutdown_connections 2024-09-17T03:14:08.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.671+0000 7fa580769640 1 -- 172.21.15.78:0/1080432104 wait complete. 2024-09-17T03:14:08.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.672+0000 7fa580769640 1 Processor -- start 2024-09-17T03:14:08.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.672+0000 7fa580769640 1 -- start start 2024-09-17T03:14:08.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa580769640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa560003a00 0x7fa5780cded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:08.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa580769640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa5781f62b0 0x7fa5780ca800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:08.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa580769640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5781f66c0 0x7fa57815deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:08.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa580769640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa5780d1c00 con 0x7fa5781f66c0 2024-09-17T03:14:08.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa580769640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa5780d1a80 con 0x7fa560003a00 2024-09-17T03:14:08.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa580769640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa5780d1d80 con 0x7fa5781f62b0 2024-09-17T03:14:08.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa57ed06640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5781f66c0 0x7fa57815deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:08.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa57ed06640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5781f66c0 0x7fa57815deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42194/0 (socket says 172.21.15.78:42194) 2024-09-17T03:14:08.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa57ed06640 1 -- 172.21.15.78:0/3310489938 learned_addr learned my addr 172.21.15.78:0/3310489938 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:08.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa57e505640 1 --2- 172.21.15.78:0/3310489938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa560003a00 0x7fa5780cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:08.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa57dd04640 1 --2- 172.21.15.78:0/3310489938 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa5781f62b0 0x7fa5780ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:08.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa57ed06640 1 -- 172.21.15.78:0/3310489938 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa5781f62b0 msgr2=0x7fa5780ca800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:08.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa57ed06640 1 --2- 172.21.15.78:0/3310489938 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa5781f62b0 0x7fa5780ca800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:08.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa57ed06640 1 -- 172.21.15.78:0/3310489938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa560003a00 msgr2=0x7fa5780cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:08.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa57ed06640 1 --2- 172.21.15.78:0/3310489938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa560003a00 0x7fa5780cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:08.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa57ed06640 1 -- 172.21.15.78:0/3310489938 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5780cd110 con 0x7fa5781f66c0 2024-09-17T03:14:08.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa57ed06640 1 --2- 172.21.15.78:0/3310489938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5781f66c0 0x7fa57815deb0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fa5780b3c10 tx=0x7fa570010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:08.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa576ffd640 1 -- 172.21.15.78:0/3310489938 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57000ee70 con 0x7fa5781f66c0 2024-09-17T03:14:08.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa576ffd640 1 -- 172.21.15.78:0/3310489938 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa570015070 con 0x7fa5781f66c0 2024-09-17T03:14:08.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa580769640 1 -- 172.21.15.78:0/3310489938 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5780cd3f0 con 0x7fa5781f66c0 2024-09-17T03:14:08.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa576ffd640 1 -- 172.21.15.78:0/3310489938 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa570003d00 con 0x7fa5781f66c0 2024-09-17T03:14:08.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.674+0000 7fa580769640 1 -- 172.21.15.78:0/3310489938 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5780cd9b0 con 0x7fa5781f66c0 2024-09-17T03:14:08.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.675+0000 7fa580769640 1 -- 172.21.15.78:0/3310489938 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5781626e0 con 0x7fa5781f66c0 2024-09-17T03:14:08.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.676+0000 7fa576ffd640 1 -- 172.21.15.78:0/3310489938 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa570004030 con 0x7fa5781f66c0 2024-09-17T03:14:08.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.676+0000 7fa576ffd640 1 --2- 172.21.15.78:0/3310489938 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa564078bc0 0x7fa56407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:08.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.677+0000 7fa576ffd640 1 -- 172.21.15.78:0/3310489938 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fa57009ba10 con 0x7fa5781f66c0 2024-09-17T03:14:08.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.677+0000 7fa57e505640 1 --2- 172.21.15.78:0/3310489938 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa564078bc0 0x7fa56407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:08.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.677+0000 7fa57e505640 1 --2- 172.21.15.78:0/3310489938 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa564078bc0 0x7fa56407b0d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa568009b40 tx=0x7fa5680046c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:08.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.681+0000 7fa576ffd640 1 -- 172.21.15.78:0/3310489938 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa570063800 con 0x7fa5781f66c0 2024-09-17T03:14:08.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.889+0000 7fa580769640 1 -- 172.21.15.78:0/3310489938 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5780cb7a0 con 0x7fa5781f66c0 2024-09-17T03:14:08.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.889+0000 7fa576ffd640 1 -- 172.21.15.78:0/3310489938 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5278 (secure 0 0 0) 0x7fa570068230 con 0x7fa5781f66c0 2024-09-17T03:14:08.888 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:08.889 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:35.489582+0000","modified":"2024-09-17T03:14:08.415660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7428,"mds_1":7425,"mds_2":6640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"d","rank":2,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/1005450673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1005450673},{"type":"v1","addr":"172.21.15.193:6837","nonce":1005450673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7425":{"gid":7425,"name":"c","rank":1,"incarnation":78,"state":"up:active","state_seq":10,"addr":"172.21.15.78:6835/4018023271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4018023271},{"type":"v1","addr":"172.21.15.78:6835","nonce":4018023271}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6832/3357123265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":3357123265},{"type":"v1","addr":"172.21.15.78:6832","nonce":3357123265}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7428,"qdb_cluster":[6640,7425,7428]},"id":6}]} 2024-09-17T03:14:08.889 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 85 2024-09-17T03:14:08.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.892+0000 7fa580769640 1 -- 172.21.15.78:0/3310489938 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa564078bc0 msgr2=0x7fa56407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:08.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.892+0000 7fa580769640 1 --2- 172.21.15.78:0/3310489938 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa564078bc0 0x7fa56407b0d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa568009b40 tx=0x7fa5680046c0 comp rx=0 tx=0).stop 2024-09-17T03:14:08.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.892+0000 7fa580769640 1 -- 172.21.15.78:0/3310489938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5781f66c0 msgr2=0x7fa57815deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:08.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.892+0000 7fa580769640 1 --2- 172.21.15.78:0/3310489938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5781f66c0 0x7fa57815deb0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fa5780b3c10 tx=0x7fa570010e80 comp rx=0 tx=0).stop 2024-09-17T03:14:08.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.892+0000 7fa580769640 1 -- 172.21.15.78:0/3310489938 shutdown_connections 2024-09-17T03:14:08.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.892+0000 7fa580769640 1 --2- 172.21.15.78:0/3310489938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5781f66c0 0x7fa57815deb0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:08.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.892+0000 7fa580769640 1 --2- 172.21.15.78:0/3310489938 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa5781f62b0 0x7fa5780ca800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:08.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.892+0000 7fa580769640 1 --2- 172.21.15.78:0/3310489938 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa564078bc0 0x7fa56407b0d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:08.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.892+0000 7fa580769640 1 --2- 172.21.15.78:0/3310489938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa560003a00 0x7fa5780cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:08.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.892+0000 7fa580769640 1 -- 172.21.15.78:0/3310489938 >> 172.21.15.78:0/3310489938 conn(0x7fa57808bfc0 msgr2=0x7fa5780d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:08.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.892+0000 7fa580769640 1 -- 172.21.15.78:0/3310489938 shutdown_connections 2024-09-17T03:14:08.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:08.892+0000 7fa580769640 1 -- 172.21.15.78:0/3310489938 wait complete. 2024-09-17T03:14:08.902 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-17T03:14:08.902 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:14:09.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.014+0000 7f190369b640 1 -- 172.21.15.78:0/3676519844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18fc0706c0 msgr2=0x7f18fc072ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:09.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.014+0000 7f190369b640 1 --2- 172.21.15.78:0/3676519844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18fc0706c0 0x7f18fc072ff0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f18f4005fd0 tx=0x7f18f402aa10 comp rx=0 tx=0).stop 2024-09-17T03:14:09.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.014+0000 7f190369b640 1 -- 172.21.15.78:0/3676519844 shutdown_connections 2024-09-17T03:14:09.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.014+0000 7f190369b640 1 --2- 172.21.15.78:0/3676519844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18fc0706c0 0x7f18fc072ff0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:09.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.014+0000 7f190369b640 1 --2- 172.21.15.78:0/3676519844 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f18fc0cd3e0 0x7f18fc070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:09.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.014+0000 7f190369b640 1 -- 172.21.15.78:0/3676519844 >> 172.21.15.78:0/3676519844 conn(0x7f18fc06d7d0 msgr2=0x7f18fc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:09.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.014+0000 7f190369b640 1 -- 172.21.15.78:0/3676519844 shutdown_connections 2024-09-17T03:14:09.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.014+0000 7f190369b640 1 -- 172.21.15.78:0/3676519844 wait complete. 2024-09-17T03:14:09.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.016+0000 7f190369b640 1 Processor -- start 2024-09-17T03:14:09.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.016+0000 7f190369b640 1 -- start start 2024-09-17T03:14:09.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.017+0000 7f190369b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18fc0706c0 0x7f18fc149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:09.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.017+0000 7f190369b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f18fc0af780 0x7f18fc09ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:09.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.017+0000 7f190369b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18fc0cd3e0 0x7f18fc06ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:09.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.017+0000 7f190369b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f18fc073b70 con 0x7f18fc0706c0 2024-09-17T03:14:09.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.017+0000 7f190369b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f18fc0739f0 con 0x7f18fc0cd3e0 2024-09-17T03:14:09.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.017+0000 7f190369b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f18fc073cf0 con 0x7f18fc0af780 2024-09-17T03:14:09.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.017+0000 7f1901437640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18fc0706c0 0x7f18fc149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:09.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.017+0000 7f1901437640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18fc0706c0 0x7f18fc149530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42218/0 (socket says 172.21.15.78:42218) 2024-09-17T03:14:09.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.017+0000 7f1901437640 1 -- 172.21.15.78:0/398771608 learned_addr learned my addr 172.21.15.78:0/398771608 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:09.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.017+0000 7f1901c38640 1 --2- 172.21.15.78:0/398771608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18fc0cd3e0 0x7f18fc06ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:09.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.017+0000 7f1900c36640 1 --2- 172.21.15.78:0/398771608 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f18fc0af780 0x7f18fc09ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:09.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.018+0000 7f1901437640 1 -- 172.21.15.78:0/398771608 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f18fc0af780 msgr2=0x7f18fc09ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:09.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.018+0000 7f1901437640 1 --2- 172.21.15.78:0/398771608 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f18fc0af780 0x7f18fc09ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:09.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.018+0000 7f1901437640 1 -- 172.21.15.78:0/398771608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18fc0cd3e0 msgr2=0x7f18fc06ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:09.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.018+0000 7f1901437640 1 --2- 172.21.15.78:0/398771608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18fc0cd3e0 0x7f18fc06ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:09.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.018+0000 7f1901437640 1 -- 172.21.15.78:0/398771608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18fc149a70 con 0x7f18fc0706c0 2024-09-17T03:14:09.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.018+0000 7f1901c38640 1 --2- 172.21.15.78:0/398771608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18fc0cd3e0 0x7f18fc06ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:09.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.018+0000 7f1900c36640 1 --2- 172.21.15.78:0/398771608 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f18fc0af780 0x7f18fc09ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:09.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.018+0000 7f1901437640 1 --2- 172.21.15.78:0/398771608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18fc0706c0 0x7f18fc149530 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f18f800c3d0 tx=0x7f18f800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:09.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.018+0000 7f18f1ffb640 1 -- 172.21.15.78:0/398771608 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8017070 con 0x7f18fc0706c0 2024-09-17T03:14:09.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.018+0000 7f18f1ffb640 1 -- 172.21.15.78:0/398771608 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18f80053c0 con 0x7f18fc0706c0 2024-09-17T03:14:09.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.018+0000 7f190369b640 1 -- 172.21.15.78:0/398771608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18fc1f55a0 con 0x7f18fc0706c0 2024-09-17T03:14:09.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.018+0000 7f18f1ffb640 1 -- 172.21.15.78:0/398771608 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8003850 con 0x7f18fc0706c0 2024-09-17T03:14:09.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.018+0000 7f190369b640 1 -- 172.21.15.78:0/398771608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18fc1f5b60 con 0x7f18fc0706c0 2024-09-17T03:14:09.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.019+0000 7f190369b640 1 -- 172.21.15.78:0/398771608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18fc072ff0 con 0x7f18fc0706c0 2024-09-17T03:14:09.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.020+0000 7f18f1ffb640 1 -- 172.21.15.78:0/398771608 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f18f801a070 con 0x7f18fc0706c0 2024-09-17T03:14:09.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.020+0000 7f18f1ffb640 1 --2- 172.21.15.78:0/398771608 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f18e0078bc0 0x7f18e007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:09.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.020+0000 7f18f1ffb640 1 -- 172.21.15.78:0/398771608 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f18f809a140 con 0x7f18fc0706c0 2024-09-17T03:14:09.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.021+0000 7f1900c36640 1 --2- 172.21.15.78:0/398771608 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f18e0078bc0 0x7f18e007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:09.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.021+0000 7f1900c36640 1 --2- 172.21.15.78:0/398771608 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f18e0078bc0 0x7f18e007b0d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f18ec005fd0 tx=0x7f18ec00f360 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:09.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.025+0000 7f18f1ffb640 1 -- 172.21.15.78:0/398771608 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f18fc149a70 con 0x7f18fc0706c0 2024-09-17T03:14:09.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.266+0000 7f190369b640 1 -- 172.21.15.78:0/398771608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f18fc0aee90 con 0x7f18fc0706c0 2024-09-17T03:14:09.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.266+0000 7f18f1ffb640 1 -- 172.21.15.78:0/398771608 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1757 (secure 0 0 0) 0x7f18f8062500 con 0x7f18fc0706c0 2024-09-17T03:14:09.265 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:09.265 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":366,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":82,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":68,"data_bytes":700179,"bytes_used":256471040,"bytes_avail":772837642240,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":10151,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6640},{"filesystem_id":6,"rank":1,"name":"c","status":"up:active","gid":7425},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7428}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2024-09-17T03:12:31.185413+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:14:09.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.269+0000 7f190369b640 1 -- 172.21.15.78:0/398771608 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f18e0078bc0 msgr2=0x7f18e007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:09.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.269+0000 7f190369b640 1 --2- 172.21.15.78:0/398771608 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f18e0078bc0 0x7f18e007b0d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f18ec005fd0 tx=0x7f18ec00f360 comp rx=0 tx=0).stop 2024-09-17T03:14:09.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.269+0000 7f190369b640 1 -- 172.21.15.78:0/398771608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18fc0706c0 msgr2=0x7f18fc149530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:09.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.269+0000 7f190369b640 1 --2- 172.21.15.78:0/398771608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18fc0706c0 0x7f18fc149530 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f18f800c3d0 tx=0x7f18f800c890 comp rx=0 tx=0).stop 2024-09-17T03:14:09.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.269+0000 7f190369b640 1 -- 172.21.15.78:0/398771608 shutdown_connections 2024-09-17T03:14:09.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.269+0000 7f190369b640 1 --2- 172.21.15.78:0/398771608 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f18e0078bc0 0x7f18e007b0d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:09.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.269+0000 7f190369b640 1 --2- 172.21.15.78:0/398771608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f18fc0cd3e0 0x7f18fc06ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:09.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.269+0000 7f190369b640 1 --2- 172.21.15.78:0/398771608 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f18fc0af780 0x7f18fc09ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:09.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.269+0000 7f190369b640 1 --2- 172.21.15.78:0/398771608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f18fc0706c0 0x7f18fc149530 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:09.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.269+0000 7f190369b640 1 -- 172.21.15.78:0/398771608 >> 172.21.15.78:0/398771608 conn(0x7f18fc06d7d0 msgr2=0x7f18fc0afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:09.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.269+0000 7f190369b640 1 -- 172.21.15.78:0/398771608 shutdown_connections 2024-09-17T03:14:09.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:09.269+0000 7f190369b640 1 -- 172.21.15.78:0/398771608 wait complete. 2024-09-17T03:14:09.279 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T03:14:10.280 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:10.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.399+0000 7f478c1c3640 1 -- 172.21.15.78:0/344561373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47840cd370 msgr2=0x7f478415d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:10.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.399+0000 7f478c1c3640 1 --2- 172.21.15.78:0/344561373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47840cd370 0x7f478415d7d0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f4774005fd0 tx=0x7f477402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:14:10.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.400+0000 7f478c1c3640 1 -- 172.21.15.78:0/344561373 shutdown_connections 2024-09-17T03:14:10.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.400+0000 7f478c1c3640 1 --2- 172.21.15.78:0/344561373 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f478415c8b0 0x7f478415dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:10.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.400+0000 7f478c1c3640 1 --2- 172.21.15.78:0/344561373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47840cd370 0x7f478415d7d0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:10.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.400+0000 7f478c1c3640 1 -- 172.21.15.78:0/344561373 >> 172.21.15.78:0/344561373 conn(0x7f478406d230 msgr2=0x7f478406d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:10.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.400+0000 7f478c1c3640 1 -- 172.21.15.78:0/344561373 shutdown_connections 2024-09-17T03:14:10.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.400+0000 7f478c1c3640 1 -- 172.21.15.78:0/344561373 wait complete. 2024-09-17T03:14:10.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.401+0000 7f478c1c3640 1 Processor -- start 2024-09-17T03:14:10.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.401+0000 7f478c1c3640 1 -- start start 2024-09-17T03:14:10.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.403+0000 7f478c1c3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f47840cff40 0x7f478415a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:10.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.403+0000 7f478c1c3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f478415c8b0 0x7f478415a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:10.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.403+0000 7f478c1c3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4784151610 0x7f47840b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:10.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.403+0000 7f478c1c3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f478415eb10 con 0x7f478415c8b0 2024-09-17T03:14:10.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.403+0000 7f478c1c3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f478415e990 con 0x7f4784151610 2024-09-17T03:14:10.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.403+0000 7f478c1c3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f478415ec90 con 0x7f47840cff40 2024-09-17T03:14:10.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.403+0000 7f478975e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f478415c8b0 0x7f478415a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:10.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.403+0000 7f478975e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f478415c8b0 0x7f478415a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42234/0 (socket says 172.21.15.78:42234) 2024-09-17T03:14:10.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.403+0000 7f478975e640 1 -- 172.21.15.78:0/1611509051 learned_addr learned my addr 172.21.15.78:0/1611509051 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:10.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.403+0000 7f478a760640 1 --2- 172.21.15.78:0/1611509051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4784151610 0x7f47840b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:10.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.403+0000 7f4789f5f640 1 --2- 172.21.15.78:0/1611509051 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f47840cff40 0x7f478415a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:10.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.403+0000 7f478975e640 1 -- 172.21.15.78:0/1611509051 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f47840cff40 msgr2=0x7f478415a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:10.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.403+0000 7f478975e640 1 --2- 172.21.15.78:0/1611509051 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f47840cff40 0x7f478415a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:10.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.403+0000 7f478975e640 1 -- 172.21.15.78:0/1611509051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4784151610 msgr2=0x7f47840b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:10.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.403+0000 7f478975e640 1 --2- 172.21.15.78:0/1611509051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4784151610 0x7f47840b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:10.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.403+0000 7f478975e640 1 -- 172.21.15.78:0/1611509051 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4784151e20 con 0x7f478415c8b0 2024-09-17T03:14:10.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.403+0000 7f478975e640 1 --2- 172.21.15.78:0/1611509051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f478415c8b0 0x7f478415a570 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f4774034040 tx=0x7f47740038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:10.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.403+0000 7f477a7fc640 1 -- 172.21.15.78:0/1611509051 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477403e030 con 0x7f478415c8b0 2024-09-17T03:14:10.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.403+0000 7f477a7fc640 1 -- 172.21.15.78:0/1611509051 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4774003ca0 con 0x7f478415c8b0 2024-09-17T03:14:10.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.403+0000 7f477a7fc640 1 -- 172.21.15.78:0/1611509051 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774035040 con 0x7f478415c8b0 2024-09-17T03:14:10.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.404+0000 7f478c1c3640 1 -- 172.21.15.78:0/1611509051 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47840b3ea0 con 0x7f478415c8b0 2024-09-17T03:14:10.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.404+0000 7f478c1c3640 1 -- 172.21.15.78:0/1611509051 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47840b5240 con 0x7f478415c8b0 2024-09-17T03:14:10.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.404+0000 7f478c1c3640 1 -- 172.21.15.78:0/1611509051 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f478415f220 con 0x7f478415c8b0 2024-09-17T03:14:10.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.405+0000 7f477a7fc640 1 -- 172.21.15.78:0/1611509051 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4774041030 con 0x7f478415c8b0 2024-09-17T03:14:10.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.406+0000 7f477a7fc640 1 --2- 172.21.15.78:0/1611509051 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4768078b90 0x7f476807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:10.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.406+0000 7f477a7fc640 1 -- 172.21.15.78:0/1611509051 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5767+0+0 (secure 0 0 0) 0x7f47740bb310 con 0x7f478415c8b0 2024-09-17T03:14:10.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.406+0000 7f4789f5f640 1 --2- 172.21.15.78:0/1611509051 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4768078b90 0x7f476807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:10.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.407+0000 7f4789f5f640 1 --2- 172.21.15.78:0/1611509051 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4768078b90 0x7f476807b0a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f47840cfe60 tx=0x7f4780009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:10.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.410+0000 7f477a7fc640 1 -- 172.21.15.78:0/1611509051 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f47740837a0 con 0x7f478415c8b0 2024-09-17T03:14:10.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.626+0000 7f478c1c3640 1 -- 172.21.15.78:0/1611509051 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47840c8b50 con 0x7f478415c8b0 2024-09-17T03:14:10.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.626+0000 7f477a7fc640 1 -- 172.21.15.78:0/1611509051 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5278 (secure 0 0 0) 0x7f47740830a0 con 0x7f478415c8b0 2024-09-17T03:14:10.625 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:10.625 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:35.489582+0000","modified":"2024-09-17T03:14:08.415660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7428,"mds_1":7425,"mds_2":6640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"d","rank":2,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/1005450673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1005450673},{"type":"v1","addr":"172.21.15.193:6837","nonce":1005450673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7425":{"gid":7425,"name":"c","rank":1,"incarnation":78,"state":"up:active","state_seq":10,"addr":"172.21.15.78:6835/4018023271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4018023271},{"type":"v1","addr":"172.21.15.78:6835","nonce":4018023271}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6832/3357123265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":3357123265},{"type":"v1","addr":"172.21.15.78:6832","nonce":3357123265}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7428,"qdb_cluster":[6640,7425,7428]},"id":6}]} 2024-09-17T03:14:10.626 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 85 2024-09-17T03:14:10.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.629+0000 7f478c1c3640 1 -- 172.21.15.78:0/1611509051 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4768078b90 msgr2=0x7f476807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:10.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.629+0000 7f478c1c3640 1 --2- 172.21.15.78:0/1611509051 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4768078b90 0x7f476807b0a0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f47840cfe60 tx=0x7f4780009040 comp rx=0 tx=0).stop 2024-09-17T03:14:10.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.629+0000 7f478c1c3640 1 -- 172.21.15.78:0/1611509051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f478415c8b0 msgr2=0x7f478415a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:10.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.629+0000 7f478c1c3640 1 --2- 172.21.15.78:0/1611509051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f478415c8b0 0x7f478415a570 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f4774034040 tx=0x7f47740038a0 comp rx=0 tx=0).stop 2024-09-17T03:14:10.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.629+0000 7f478c1c3640 1 -- 172.21.15.78:0/1611509051 shutdown_connections 2024-09-17T03:14:10.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.629+0000 7f478c1c3640 1 --2- 172.21.15.78:0/1611509051 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4768078b90 0x7f476807b0a0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:10.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.629+0000 7f478c1c3640 1 --2- 172.21.15.78:0/1611509051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4784151610 0x7f47840b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:10.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.629+0000 7f478c1c3640 1 --2- 172.21.15.78:0/1611509051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f478415c8b0 0x7f478415a570 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:10.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.629+0000 7f478c1c3640 1 --2- 172.21.15.78:0/1611509051 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f47840cff40 0x7f478415a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:10.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.629+0000 7f478c1c3640 1 -- 172.21.15.78:0/1611509051 >> 172.21.15.78:0/1611509051 conn(0x7f478406d230 msgr2=0x7f47840c93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:10.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.629+0000 7f478c1c3640 1 -- 172.21.15.78:0/1611509051 shutdown_connections 2024-09-17T03:14:10.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.629+0000 7f478c1c3640 1 -- 172.21.15.78:0/1611509051 wait complete. 2024-09-17T03:14:10.639 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-17T03:14:10.639 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:14:10.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.751+0000 7f11cb598640 1 -- 172.21.15.78:0/3921401355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11c40ceb40 msgr2=0x7f11c40cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:10.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.751+0000 7f11cb598640 1 --2- 172.21.15.78:0/3921401355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11c40ceb40 0x7f11c40cef50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f11bc005fd0 tx=0x7f11bc02a970 comp rx=0 tx=0).stop 2024-09-17T03:14:10.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.751+0000 7f11cb598640 1 -- 172.21.15.78:0/3921401355 shutdown_connections 2024-09-17T03:14:10.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.751+0000 7f11cb598640 1 --2- 172.21.15.78:0/3921401355 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11c40ceb40 0x7f11c40cef50 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:10.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.751+0000 7f11cb598640 1 --2- 172.21.15.78:0/3921401355 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f11c406e170 0x7f11c40b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:10.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.751+0000 7f11cb598640 1 -- 172.21.15.78:0/3921401355 >> 172.21.15.78:0/3921401355 conn(0x7f11c408bfc0 msgr2=0x7f11c409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:10.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.751+0000 7f11cb598640 1 -- 172.21.15.78:0/3921401355 shutdown_connections 2024-09-17T03:14:10.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.751+0000 7f11cb598640 1 -- 172.21.15.78:0/3921401355 wait complete. 2024-09-17T03:14:10.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.753+0000 7f11cb598640 1 Processor -- start 2024-09-17T03:14:10.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.753+0000 7f11cb598640 1 -- start start 2024-09-17T03:14:10.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.754+0000 7f11cb598640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f11c406f4b0 0x7f11c41f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:10.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.754+0000 7f11cb598640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11c40ceb40 0x7f11c40ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:10.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.754+0000 7f11cb598640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11c41f5620 0x7f11c41f5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:10.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.754+0000 7f11cb598640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f11c40d0e60 con 0x7f11c41f5620 2024-09-17T03:14:10.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.754+0000 7f11cb598640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f11c40d0ce0 con 0x7f11c40ceb40 2024-09-17T03:14:10.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.754+0000 7f11cb598640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f11c40d0fe0 con 0x7f11c406f4b0 2024-09-17T03:14:10.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.754+0000 7f11c9b35640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11c41f5620 0x7f11c41f5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:10.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.755+0000 7f11c9b35640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11c41f5620 0x7f11c41f5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42252/0 (socket says 172.21.15.78:42252) 2024-09-17T03:14:10.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.755+0000 7f11c9b35640 1 -- 172.21.15.78:0/2745329316 learned_addr learned my addr 172.21.15.78:0/2745329316 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:10.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.755+0000 7f11c8b33640 1 --2- 172.21.15.78:0/2745329316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11c40ceb40 0x7f11c40ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:10.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.755+0000 7f11c9334640 1 --2- 172.21.15.78:0/2745329316 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f11c406f4b0 0x7f11c41f8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:10.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.755+0000 7f11c9b35640 1 -- 172.21.15.78:0/2745329316 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f11c406f4b0 msgr2=0x7f11c41f8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:10.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.755+0000 7f11c9b35640 1 --2- 172.21.15.78:0/2745329316 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f11c406f4b0 0x7f11c41f8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:10.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.755+0000 7f11c9b35640 1 -- 172.21.15.78:0/2745329316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11c40ceb40 msgr2=0x7f11c40ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:10.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.755+0000 7f11c9b35640 1 --2- 172.21.15.78:0/2745329316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11c40ceb40 0x7f11c40ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:10.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.755+0000 7f11c9b35640 1 -- 172.21.15.78:0/2745329316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c41f95b0 con 0x7f11c41f5620 2024-09-17T03:14:10.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.755+0000 7f11c9334640 1 --2- 172.21.15.78:0/2745329316 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f11c406f4b0 0x7f11c41f8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:10.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.755+0000 7f11c9b35640 1 --2- 172.21.15.78:0/2745329316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11c41f5620 0x7f11c41f5a30 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f11bc02af30 tx=0x7f11bc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:10.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.755+0000 7f11b9ffb640 1 -- 172.21.15.78:0/2745329316 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc034050 con 0x7f11c41f5620 2024-09-17T03:14:10.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.755+0000 7f11b9ffb640 1 -- 172.21.15.78:0/2745329316 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11bc004640 con 0x7f11c41f5620 2024-09-17T03:14:10.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.755+0000 7f11cb598640 1 -- 172.21.15.78:0/2745329316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11c41f9890 con 0x7f11c41f5620 2024-09-17T03:14:10.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.755+0000 7f11b9ffb640 1 -- 172.21.15.78:0/2745329316 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11bc0436a0 con 0x7f11c41f5620 2024-09-17T03:14:10.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.755+0000 7f11cb598640 1 -- 172.21.15.78:0/2745329316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11c40cca20 con 0x7f11c41f5620 2024-09-17T03:14:10.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.756+0000 7f11cb598640 1 -- 172.21.15.78:0/2745329316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11c41f9320 con 0x7f11c41f5620 2024-09-17T03:14:10.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.757+0000 7f11b9ffb640 1 -- 172.21.15.78:0/2745329316 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f11bc037020 con 0x7f11c41f5620 2024-09-17T03:14:10.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.758+0000 7f11b9ffb640 1 --2- 172.21.15.78:0/2745329316 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f11a8078b90 0x7f11a807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:10.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.758+0000 7f11b9ffb640 1 -- 172.21.15.78:0/2745329316 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f11bc0bc120 con 0x7f11c41f5620 2024-09-17T03:14:10.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.758+0000 7f11c9334640 1 --2- 172.21.15.78:0/2745329316 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f11a8078b90 0x7f11a807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:10.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.758+0000 7f11c9334640 1 --2- 172.21.15.78:0/2745329316 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f11a8078b90 0x7f11a807b0a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f11c000ab40 tx=0x7f11c000a520 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:10.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:10.762+0000 7f11b9ffb640 1 -- 172.21.15.78:0/2745329316 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f11bc084640 con 0x7f11c41f5620 2024-09-17T03:14:11.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:11.009+0000 7f11cb598640 1 -- 172.21.15.78:0/2745329316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f11c40d15a0 con 0x7f11c41f5620 2024-09-17T03:14:11.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:11.010+0000 7f11b9ffb640 1 -- 172.21.15.78:0/2745329316 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1973 (secure 0 0 0) 0x7f11bc083f40 con 0x7f11c41f5620 2024-09-17T03:14:11.009 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:11.009 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":368,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":84,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700179,"bytes_used":256491520,"bytes_avail":772837621760,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9725,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6640},{"filesystem_id":6,"rank":1,"name":"c","status":"up:active","gid":7425},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7428}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-17T03:14:09.212067+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-17T03:14:11.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:11.012+0000 7f11cb598640 1 -- 172.21.15.78:0/2745329316 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f11a8078b90 msgr2=0x7f11a807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:11.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:11.012+0000 7f11cb598640 1 --2- 172.21.15.78:0/2745329316 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f11a8078b90 0x7f11a807b0a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f11c000ab40 tx=0x7f11c000a520 comp rx=0 tx=0).stop 2024-09-17T03:14:11.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:11.012+0000 7f11cb598640 1 -- 172.21.15.78:0/2745329316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11c41f5620 msgr2=0x7f11c41f5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:11.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:11.012+0000 7f11cb598640 1 --2- 172.21.15.78:0/2745329316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11c41f5620 0x7f11c41f5a30 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f11bc02af30 tx=0x7f11bc004040 comp rx=0 tx=0).stop 2024-09-17T03:14:11.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:11.012+0000 7f11cb598640 1 -- 172.21.15.78:0/2745329316 shutdown_connections 2024-09-17T03:14:11.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:11.012+0000 7f11cb598640 1 --2- 172.21.15.78:0/2745329316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11c41f5620 0x7f11c41f5a30 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:11.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:11.012+0000 7f11cb598640 1 --2- 172.21.15.78:0/2745329316 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f11a8078b90 0x7f11a807b0a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:11.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:11.012+0000 7f11cb598640 1 --2- 172.21.15.78:0/2745329316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11c40ceb40 0x7f11c40ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:11.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:11.012+0000 7f11cb598640 1 --2- 172.21.15.78:0/2745329316 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f11c406f4b0 0x7f11c41f8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:11.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:11.012+0000 7f11cb598640 1 -- 172.21.15.78:0/2745329316 >> 172.21.15.78:0/2745329316 conn(0x7f11c408bfc0 msgr2=0x7f11c40b2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:11.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:11.012+0000 7f11cb598640 1 -- 172.21.15.78:0/2745329316 shutdown_connections 2024-09-17T03:14:11.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:11.012+0000 7f11cb598640 1 -- 172.21.15.78:0/2745329316 wait complete. 2024-09-17T03:14:11.022 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'idle+waiting paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-17T03:14:12.022 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:12.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.148+0000 7fa6369ed640 1 -- 172.21.15.78:0/389351115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6300d1d40 msgr2=0x7fa6300b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:12.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.148+0000 7fa6369ed640 1 --2- 172.21.15.78:0/389351115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6300d1d40 0x7fa6300b5210 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fa630074550 tx=0x7fa62002a530 comp rx=0 tx=0).stop 2024-09-17T03:14:12.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.148+0000 7fa6369ed640 1 -- 172.21.15.78:0/389351115 shutdown_connections 2024-09-17T03:14:12.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.148+0000 7fa6369ed640 1 --2- 172.21.15.78:0/389351115 >> v2:172.21.15.193:3300/0 conn(0x7fa63015c6f0 0x7fa6300ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:12.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.148+0000 7fa6369ed640 1 --2- 172.21.15.78:0/389351115 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6300d1d40 0x7fa6300b5210 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:12.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.148+0000 7fa6369ed640 1 -- 172.21.15.78:0/389351115 >> 172.21.15.78:0/389351115 conn(0x7fa6300b3f10 msgr2=0x7fa6300b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:12.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.148+0000 7fa6369ed640 1 -- 172.21.15.78:0/389351115 shutdown_connections 2024-09-17T03:14:12.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.148+0000 7fa6369ed640 1 -- 172.21.15.78:0/389351115 wait complete. 2024-09-17T03:14:12.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.150+0000 7fa6369ed640 1 Processor -- start 2024-09-17T03:14:12.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.150+0000 7fa6369ed640 1 -- start start 2024-09-17T03:14:12.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.151+0000 7fa6369ed640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa6300ccba0 0x7fa6300b5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:12.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.151+0000 7fa6369ed640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6300d1d40 0x7fa6300b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:12.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.151+0000 7fa6369ed640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa63015c6f0 0x7fa6300ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:12.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.151+0000 7fa6369ed640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa6300d11f0 con 0x7fa63015c6f0 2024-09-17T03:14:12.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.151+0000 7fa6369ed640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa6300d1070 con 0x7fa6300ccba0 2024-09-17T03:14:12.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.151+0000 7fa6369ed640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa6300d1370 con 0x7fa6300d1d40 2024-09-17T03:14:12.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.151+0000 7fa634f8a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa63015c6f0 0x7fa6300ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:12.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.151+0000 7fa634f8a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa63015c6f0 0x7fa6300ca5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42264/0 (socket says 172.21.15.78:42264) 2024-09-17T03:14:12.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.152+0000 7fa634f8a640 1 -- 172.21.15.78:0/994620969 learned_addr learned my addr 172.21.15.78:0/994620969 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:12.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.152+0000 7fa62ffff640 1 --2- 172.21.15.78:0/994620969 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa6300ccba0 0x7fa6300b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:12.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.152+0000 7fa62f7fe640 1 --2- 172.21.15.78:0/994620969 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6300d1d40 0x7fa6300b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:12.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.152+0000 7fa634f8a640 1 -- 172.21.15.78:0/994620969 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6300d1d40 msgr2=0x7fa6300b5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:12.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.152+0000 7fa634f8a640 1 --2- 172.21.15.78:0/994620969 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6300d1d40 0x7fa6300b5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:12.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.152+0000 7fa634f8a640 1 -- 172.21.15.78:0/994620969 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa6300ccba0 msgr2=0x7fa6300b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:12.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.152+0000 7fa634f8a640 1 --2- 172.21.15.78:0/994620969 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa6300ccba0 0x7fa6300b5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:12.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.152+0000 7fa634f8a640 1 -- 172.21.15.78:0/994620969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6301f7090 con 0x7fa63015c6f0 2024-09-17T03:14:12.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.152+0000 7fa62f7fe640 1 --2- 172.21.15.78:0/994620969 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6300d1d40 0x7fa6300b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:12.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.152+0000 7fa634f8a640 1 --2- 172.21.15.78:0/994620969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa63015c6f0 0x7fa6300ca5e0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fa62800c730 tx=0x7fa62800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:12.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.152+0000 7fa62cff9640 1 -- 172.21.15.78:0/994620969 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa628003b70 con 0x7fa63015c6f0 2024-09-17T03:14:12.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.152+0000 7fa62cff9640 1 -- 172.21.15.78:0/994620969 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa628003d10 con 0x7fa63015c6f0 2024-09-17T03:14:12.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.152+0000 7fa6369ed640 1 -- 172.21.15.78:0/994620969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6301f7370 con 0x7fa63015c6f0 2024-09-17T03:14:12.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.152+0000 7fa62cff9640 1 -- 172.21.15.78:0/994620969 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6280052d0 con 0x7fa63015c6f0 2024-09-17T03:14:12.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.152+0000 7fa6369ed640 1 -- 172.21.15.78:0/994620969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6301f7930 con 0x7fa63015c6f0 2024-09-17T03:14:12.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.153+0000 7fa6369ed640 1 -- 172.21.15.78:0/994620969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6301f7d10 con 0x7fa63015c6f0 2024-09-17T03:14:12.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.154+0000 7fa62cff9640 1 -- 172.21.15.78:0/994620969 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa628005470 con 0x7fa63015c6f0 2024-09-17T03:14:12.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.154+0000 7fa62cff9640 1 --2- 172.21.15.78:0/994620969 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa61c078b90 0x7fa61c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:12.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.154+0000 7fa62cff9640 1 -- 172.21.15.78:0/994620969 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7fa62809a9c0 con 0x7fa63015c6f0 2024-09-17T03:14:12.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.155+0000 7fa62ffff640 1 --2- 172.21.15.78:0/994620969 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa61c078b90 0x7fa61c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:12.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.155+0000 7fa62ffff640 1 --2- 172.21.15.78:0/994620969 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa61c078b90 0x7fa61c07b0a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa620034000 tx=0x7fa620004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:12.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.159+0000 7fa62cff9640 1 -- 172.21.15.78:0/994620969 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa6301f7d10 con 0x7fa63015c6f0 2024-09-17T03:14:12.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.371+0000 7fa6369ed640 1 -- 172.21.15.78:0/994620969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa63015fcc0 con 0x7fa63015c6f0 2024-09-17T03:14:12.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.372+0000 7fa62cff9640 1 -- 172.21.15.78:0/994620969 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5278 (secure 0 0 0) 0x7fa62809ce20 con 0x7fa63015c6f0 2024-09-17T03:14:12.371 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:12.371 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:35.489582+0000","modified":"2024-09-17T03:14:08.415660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7428,"mds_1":7425,"mds_2":6640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"d","rank":2,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/1005450673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1005450673},{"type":"v1","addr":"172.21.15.193:6837","nonce":1005450673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7425":{"gid":7425,"name":"c","rank":1,"incarnation":78,"state":"up:active","state_seq":10,"addr":"172.21.15.78:6835/4018023271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4018023271},{"type":"v1","addr":"172.21.15.78:6835","nonce":4018023271}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6832/3357123265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":3357123265},{"type":"v1","addr":"172.21.15.78:6832","nonce":3357123265}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7428,"qdb_cluster":[6640,7425,7428]},"id":6}]} 2024-09-17T03:14:12.371 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 85 2024-09-17T03:14:12.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.374+0000 7fa6369ed640 1 -- 172.21.15.78:0/994620969 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa61c078b90 msgr2=0x7fa61c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:12.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.374+0000 7fa6369ed640 1 --2- 172.21.15.78:0/994620969 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa61c078b90 0x7fa61c07b0a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa620034000 tx=0x7fa620004730 comp rx=0 tx=0).stop 2024-09-17T03:14:12.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.374+0000 7fa6369ed640 1 -- 172.21.15.78:0/994620969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa63015c6f0 msgr2=0x7fa6300ca5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:12.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.374+0000 7fa6369ed640 1 --2- 172.21.15.78:0/994620969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa63015c6f0 0x7fa6300ca5e0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fa62800c730 tx=0x7fa62800cb30 comp rx=0 tx=0).stop 2024-09-17T03:14:12.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.374+0000 7fa6369ed640 1 -- 172.21.15.78:0/994620969 shutdown_connections 2024-09-17T03:14:12.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.374+0000 7fa6369ed640 1 --2- 172.21.15.78:0/994620969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa63015c6f0 0x7fa6300ca5e0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:12.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.374+0000 7fa6369ed640 1 --2- 172.21.15.78:0/994620969 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6300d1d40 0x7fa6300b5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:12.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.374+0000 7fa6369ed640 1 --2- 172.21.15.78:0/994620969 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa61c078b90 0x7fa61c07b0a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:12.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.374+0000 7fa6369ed640 1 --2- 172.21.15.78:0/994620969 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa6300ccba0 0x7fa6300b5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:12.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.374+0000 7fa6369ed640 1 -- 172.21.15.78:0/994620969 >> 172.21.15.78:0/994620969 conn(0x7fa6300b3f10 msgr2=0x7fa630068ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:12.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.375+0000 7fa6369ed640 1 -- 172.21.15.78:0/994620969 shutdown_connections 2024-09-17T03:14:12.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.375+0000 7fa6369ed640 1 -- 172.21.15.78:0/994620969 wait complete. 2024-09-17T03:14:12.385 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-17T03:14:12.385 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:14:12.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.498+0000 7f2b75f32640 1 -- 172.21.15.78:0/2799574606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700b64e0 msgr2=0x7f2b700d25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:12.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.498+0000 7f2b75f32640 1 --2- 172.21.15.78:0/2799574606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700b64e0 0x7f2b700d25b0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f2b7008ccf0 tx=0x7f2b6802a8f0 comp rx=0 tx=0).stop 2024-09-17T03:14:12.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.498+0000 7f2b75f32640 1 -- 172.21.15.78:0/2799574606 shutdown_connections 2024-09-17T03:14:12.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.498+0000 7f2b75f32640 1 --2- 172.21.15.78:0/2799574606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700b64e0 0x7f2b700d25b0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:12.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.498+0000 7f2b75f32640 1 --2- 172.21.15.78:0/2799574606 >> v2:172.21.15.193:3300/0 conn(0x7f2b700cf540 0x7f2b700b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:12.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.498+0000 7f2b75f32640 1 --2- 172.21.15.78:0/2799574606 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2b700b9b60 0x7f2b700d4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:12.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.498+0000 7f2b75f32640 1 -- 172.21.15.78:0/2799574606 >> 172.21.15.78:0/2799574606 conn(0x7f2b7009d7f0 msgr2=0x7f2b700d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:12.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.498+0000 7f2b75f32640 1 -- 172.21.15.78:0/2799574606 shutdown_connections 2024-09-17T03:14:12.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.498+0000 7f2b75f32640 1 -- 172.21.15.78:0/2799574606 wait complete. 2024-09-17T03:14:12.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.500+0000 7f2b75f32640 1 Processor -- start 2024-09-17T03:14:12.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.500+0000 7f2b75f32640 1 -- start start 2024-09-17T03:14:12.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.501+0000 7f2b75f32640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b700b64e0 0x7f2b701605a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:12.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.501+0000 7f2b75f32640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2b700b9b60 0x7f2b7009e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:12.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.501+0000 7f2b75f32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700cf540 0x7f2b700ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:12.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.501+0000 7f2b75f32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2b700d2f90 con 0x7f2b700cf540 2024-09-17T03:14:12.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.501+0000 7f2b75f32640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2b700d2e10 con 0x7f2b700b64e0 2024-09-17T03:14:12.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.501+0000 7f2b75f32640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f2b700d3110 con 0x7f2b700b9b60 2024-09-17T03:14:12.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.502+0000 7f2b6ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700cf540 0x7f2b700ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:12.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.502+0000 7f2b6ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700cf540 0x7f2b700ca220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42278/0 (socket says 172.21.15.78:42278) 2024-09-17T03:14:12.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.502+0000 7f2b6ffff640 1 -- 172.21.15.78:0/1330602309 learned_addr learned my addr 172.21.15.78:0/1330602309 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.502+0000 7f2b6f7fe640 1 --2- 172.21.15.78:0/1330602309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b700b64e0 0x7f2b701605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.502+0000 7f2b67fff640 1 --2- 172.21.15.78:0/1330602309 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2b700b9b60 0x7f2b7009e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.502+0000 7f2b6ffff640 1 -- 172.21.15.78:0/1330602309 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2b700b9b60 msgr2=0x7f2b7009e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.502+0000 7f2b6ffff640 1 --2- 172.21.15.78:0/1330602309 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2b700b9b60 0x7f2b7009e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.502+0000 7f2b6ffff640 1 -- 172.21.15.78:0/1330602309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b700b64e0 msgr2=0x7f2b701605a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.502+0000 7f2b6ffff640 1 --2- 172.21.15.78:0/1330602309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b700b64e0 0x7f2b701605a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.502+0000 7f2b6ffff640 1 -- 172.21.15.78:0/1330602309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b7009f1c0 con 0x7f2b700cf540 2024-09-17T03:14:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.502+0000 7f2b6ffff640 1 --2- 172.21.15.78:0/1330602309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700cf540 0x7f2b700ca220 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009d60 tx=0x7f2b68003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.502+0000 7f2b6cff9640 1 -- 172.21.15.78:0/1330602309 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b68004240 con 0x7f2b700cf540 2024-09-17T03:14:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.502+0000 7f2b6cff9640 1 -- 172.21.15.78:0/1330602309 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b6802d070 con 0x7f2b700cf540 2024-09-17T03:14:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.502+0000 7f2b75f32640 1 -- 172.21.15.78:0/1330602309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b700cb800 con 0x7f2b700cf540 2024-09-17T03:14:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.502+0000 7f2b6cff9640 1 -- 172.21.15.78:0/1330602309 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b680046a0 con 0x7f2b700cf540 2024-09-17T03:14:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.502+0000 7f2b75f32640 1 -- 172.21.15.78:0/1330602309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b700cbdc0 con 0x7f2b700cf540 2024-09-17T03:14:12.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.503+0000 7f2b75f32640 1 -- 172.21.15.78:0/1330602309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b700d4d80 con 0x7f2b700cf540 2024-09-17T03:14:12.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.504+0000 7f2b6cff9640 1 -- 172.21.15.78:0/1330602309 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2b68031480 con 0x7f2b700cf540 2024-09-17T03:14:12.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.504+0000 7f2b6cff9640 1 --2- 172.21.15.78:0/1330602309 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2b50078bc0 0x7f2b5007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:12.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.504+0000 7f2b6cff9640 1 -- 172.21.15.78:0/1330602309 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f2b680bc520 con 0x7f2b700cf540 2024-09-17T03:14:12.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.505+0000 7f2b6f7fe640 1 --2- 172.21.15.78:0/1330602309 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2b50078bc0 0x7f2b5007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:12.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.505+0000 7f2b6f7fe640 1 --2- 172.21.15.78:0/1330602309 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2b50078bc0 0x7f2b5007b0d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2b60009970 tx=0x7f2b60005f30 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:12.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.509+0000 7f2b6cff9640 1 -- 172.21.15.78:0/1330602309 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2b680849b0 con 0x7f2b700cf540 2024-09-17T03:14:12.641 INFO:tasks.ceph.mon.a.smithi078.stderr:2024-09-17T03:14:12.638+0000 7f192d77d640 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-17T03:14:12.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.751+0000 7f2b75f32640 1 -- 172.21.15.78:0/1330602309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f2b700d3fb0 con 0x7f2b700cf540 2024-09-17T03:14:12.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.751+0000 7f2b6cff9640 1 -- 172.21.15.78:0/1330602309 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1974 (secure 0 0 0) 0x7f2b680842b0 con 0x7f2b700cf540 2024-09-17T03:14:12.751 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:12.751 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":369,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":84,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700753,"bytes_used":256647168,"bytes_avail":772837466112,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9725,"read_op_per_sec":0,"write_op_per_sec":10},"fsmap":{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6640},{"filesystem_id":6,"rank":1,"name":"c","status":"up:active","gid":7425},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7428}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2024-09-17T03:14:09.212067+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-17T03:14:12.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.754+0000 7f2b75f32640 1 -- 172.21.15.78:0/1330602309 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2b50078bc0 msgr2=0x7f2b5007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:12.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.754+0000 7f2b75f32640 1 --2- 172.21.15.78:0/1330602309 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2b50078bc0 0x7f2b5007b0d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f2b60009970 tx=0x7f2b60005f30 comp rx=0 tx=0).stop 2024-09-17T03:14:12.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.754+0000 7f2b75f32640 1 -- 172.21.15.78:0/1330602309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700cf540 msgr2=0x7f2b700ca220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:12.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.754+0000 7f2b75f32640 1 --2- 172.21.15.78:0/1330602309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700cf540 0x7f2b700ca220 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009d60 tx=0x7f2b68003c20 comp rx=0 tx=0).stop 2024-09-17T03:14:12.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.754+0000 7f2b75f32640 1 -- 172.21.15.78:0/1330602309 shutdown_connections 2024-09-17T03:14:12.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.754+0000 7f2b75f32640 1 --2- 172.21.15.78:0/1330602309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700cf540 0x7f2b700ca220 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:12.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.754+0000 7f2b75f32640 1 --2- 172.21.15.78:0/1330602309 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2b700b9b60 0x7f2b7009e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:12.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.754+0000 7f2b75f32640 1 --2- 172.21.15.78:0/1330602309 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2b50078bc0 0x7f2b5007b0d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:12.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.754+0000 7f2b75f32640 1 --2- 172.21.15.78:0/1330602309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b700b64e0 0x7f2b701605a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:12.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.754+0000 7f2b75f32640 1 -- 172.21.15.78:0/1330602309 >> 172.21.15.78:0/1330602309 conn(0x7f2b7009d7f0 msgr2=0x7f2b70161b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:12.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.754+0000 7f2b75f32640 1 -- 172.21.15.78:0/1330602309 shutdown_connections 2024-09-17T03:14:12.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:12.754+0000 7f2b75f32640 1 -- 172.21.15.78:0/1330602309 wait complete. 2024-09-17T03:14:12.764 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'idle+waiting paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-17T03:14:13.765 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:13.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.891+0000 7fb8264ce640 1 -- 172.21.15.78:0/4006030213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8200b51c0 msgr2=0x7fb82015c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:13.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.891+0000 7fb8264ce640 1 --2- 172.21.15.78:0/4006030213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8200b51c0 0x7fb82015c6e0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fb8200ce170 tx=0x7fb81002a560 comp rx=0 tx=0).stop 2024-09-17T03:14:13.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.891+0000 7fb8264ce640 1 -- 172.21.15.78:0/4006030213 shutdown_connections 2024-09-17T03:14:13.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.891+0000 7fb8264ce640 1 --2- 172.21.15.78:0/4006030213 >> v2:172.21.15.193:3300/0 conn(0x7fb8200d12c0 0x7fb8200d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:13.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.891+0000 7fb8264ce640 1 --2- 172.21.15.78:0/4006030213 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb8200ccbd0 0x7fb8200d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:13.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.891+0000 7fb8264ce640 1 --2- 172.21.15.78:0/4006030213 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8200b51c0 0x7fb82015c6e0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:13.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.891+0000 7fb8264ce640 1 -- 172.21.15.78:0/4006030213 >> 172.21.15.78:0/4006030213 conn(0x7fb820072ae0 msgr2=0x7fb820072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:13.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.891+0000 7fb8264ce640 1 -- 172.21.15.78:0/4006030213 shutdown_connections 2024-09-17T03:14:13.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.891+0000 7fb8264ce640 1 -- 172.21.15.78:0/4006030213 wait complete. 2024-09-17T03:14:13.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.892+0000 7fb8264ce640 1 Processor -- start 2024-09-17T03:14:13.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.893+0000 7fb8264ce640 1 -- start start 2024-09-17T03:14:13.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.894+0000 7fb8264ce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8200b51c0 0x7fb8200b6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:13.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.894+0000 7fb8264ce640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb8200ccbd0 0x7fb8201f5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:13.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.894+0000 7fb8264ce640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8200d12c0 0x7fb8200cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:13.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.894+0000 7fb8264ce640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb8201607f0 con 0x7fb8200b51c0 2024-09-17T03:14:13.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.894+0000 7fb8264ce640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb820160670 con 0x7fb8200d12c0 2024-09-17T03:14:13.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.894+0000 7fb8264ce640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb820160970 con 0x7fb8200ccbd0 2024-09-17T03:14:13.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.894+0000 7fb81ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8200b51c0 0x7fb8200b6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:13.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.894+0000 7fb81ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8200b51c0 0x7fb8200b6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42308/0 (socket says 172.21.15.78:42308) 2024-09-17T03:14:13.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.894+0000 7fb81ffff640 1 -- 172.21.15.78:0/1561687544 learned_addr learned my addr 172.21.15.78:0/1561687544 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:13.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.894+0000 7fb824a6b640 1 --2- 172.21.15.78:0/1561687544 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8200d12c0 0x7fb8200cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:13.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.894+0000 7fb81f7fe640 1 --2- 172.21.15.78:0/1561687544 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb8200ccbd0 0x7fb8201f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:13.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.894+0000 7fb81ffff640 1 -- 172.21.15.78:0/1561687544 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb8200ccbd0 msgr2=0x7fb8201f5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:13.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.894+0000 7fb81ffff640 1 --2- 172.21.15.78:0/1561687544 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb8200ccbd0 0x7fb8201f5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:13.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.894+0000 7fb81ffff640 1 -- 172.21.15.78:0/1561687544 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8200d12c0 msgr2=0x7fb8200cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:13.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.894+0000 7fb81ffff640 1 --2- 172.21.15.78:0/1561687544 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8200d12c0 0x7fb8200cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:13.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.895+0000 7fb81ffff640 1 -- 172.21.15.78:0/1561687544 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82006eeb0 con 0x7fb8200b51c0 2024-09-17T03:14:13.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.895+0000 7fb81ffff640 1 --2- 172.21.15.78:0/1561687544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8200b51c0 0x7fb8200b6f60 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fb810034040 tx=0x7fb8100039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:13.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.895+0000 7fb81cff9640 1 -- 172.21.15.78:0/1561687544 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81003e030 con 0x7fb8200b51c0 2024-09-17T03:14:13.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.895+0000 7fb81cff9640 1 -- 172.21.15.78:0/1561687544 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8100047a0 con 0x7fb8200b51c0 2024-09-17T03:14:13.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.895+0000 7fb8264ce640 1 -- 172.21.15.78:0/1561687544 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb82006f190 con 0x7fb8200b51c0 2024-09-17T03:14:13.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.895+0000 7fb81cff9640 1 -- 172.21.15.78:0/1561687544 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb810035040 con 0x7fb8200b51c0 2024-09-17T03:14:13.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.895+0000 7fb8264ce640 1 -- 172.21.15.78:0/1561687544 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb82006f750 con 0x7fb8200b51c0 2024-09-17T03:14:13.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.896+0000 7fb8264ce640 1 -- 172.21.15.78:0/1561687544 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8200d16d0 con 0x7fb8200b51c0 2024-09-17T03:14:13.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.897+0000 7fb81cff9640 1 -- 172.21.15.78:0/1561687544 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb810041030 con 0x7fb8200b51c0 2024-09-17T03:14:13.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.897+0000 7fb81cff9640 1 --2- 172.21.15.78:0/1561687544 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb80c078bc0 0x7fb80c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:13.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.897+0000 7fb81cff9640 1 -- 172.21.15.78:0/1561687544 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7fb8100bb580 con 0x7fb8200b51c0 2024-09-17T03:14:13.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.897+0000 7fb81f7fe640 1 --2- 172.21.15.78:0/1561687544 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb80c078bc0 0x7fb80c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:13.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.898+0000 7fb81f7fe640 1 --2- 172.21.15.78:0/1561687544 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb80c078bc0 0x7fb80c07b0d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb820151430 tx=0x7fb814005d70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:13.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:13.902+0000 7fb81cff9640 1 -- 172.21.15.78:0/1561687544 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb810083900 con 0x7fb8200b51c0 2024-09-17T03:14:14.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.110+0000 7fb8264ce640 1 -- 172.21.15.78:0/1561687544 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb820069120 con 0x7fb8200b51c0 2024-09-17T03:14:14.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.110+0000 7fb81cff9640 1 -- 172.21.15.78:0/1561687544 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5278 (secure 0 0 0) 0x7fb810083200 con 0x7fb8200b51c0 2024-09-17T03:14:14.109 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:14.109 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:35.489582+0000","modified":"2024-09-17T03:14:08.415660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7428,"mds_1":7425,"mds_2":6640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"d","rank":2,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/1005450673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1005450673},{"type":"v1","addr":"172.21.15.193:6837","nonce":1005450673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7425":{"gid":7425,"name":"c","rank":1,"incarnation":78,"state":"up:active","state_seq":10,"addr":"172.21.15.78:6835/4018023271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4018023271},{"type":"v1","addr":"172.21.15.78:6835","nonce":4018023271}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6832/3357123265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":3357123265},{"type":"v1","addr":"172.21.15.78:6832","nonce":3357123265}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7428,"qdb_cluster":[6640,7425,7428]},"id":6}]} 2024-09-17T03:14:14.110 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 85 2024-09-17T03:14:14.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.112+0000 7fb8264ce640 1 -- 172.21.15.78:0/1561687544 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb80c078bc0 msgr2=0x7fb80c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.112+0000 7fb8264ce640 1 --2- 172.21.15.78:0/1561687544 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb80c078bc0 0x7fb80c07b0d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb820151430 tx=0x7fb814005d70 comp rx=0 tx=0).stop 2024-09-17T03:14:14.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.112+0000 7fb8264ce640 1 -- 172.21.15.78:0/1561687544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8200b51c0 msgr2=0x7fb8200b6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.112+0000 7fb8264ce640 1 --2- 172.21.15.78:0/1561687544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8200b51c0 0x7fb8200b6f60 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fb810034040 tx=0x7fb8100039e0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.112+0000 7fb8264ce640 1 -- 172.21.15.78:0/1561687544 shutdown_connections 2024-09-17T03:14:14.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.112+0000 7fb8264ce640 1 --2- 172.21.15.78:0/1561687544 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb80c078bc0 0x7fb80c07b0d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.112+0000 7fb8264ce640 1 --2- 172.21.15.78:0/1561687544 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8200d12c0 0x7fb8200cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.112+0000 7fb8264ce640 1 --2- 172.21.15.78:0/1561687544 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb8200ccbd0 0x7fb8201f5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.112+0000 7fb8264ce640 1 --2- 172.21.15.78:0/1561687544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8200b51c0 0x7fb8200b6f60 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.112+0000 7fb8264ce640 1 -- 172.21.15.78:0/1561687544 >> 172.21.15.78:0/1561687544 conn(0x7fb820072ae0 msgr2=0x7fb82015ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.113+0000 7fb8264ce640 1 -- 172.21.15.78:0/1561687544 shutdown_connections 2024-09-17T03:14:14.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.113+0000 7fb8264ce640 1 -- 172.21.15.78:0/1561687544 wait complete. 2024-09-17T03:14:14.123 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-17T03:14:14.123 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:14:14.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.235+0000 7f1cab5b6640 1 -- 172.21.15.78:0/27441686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ca4142680 msgr2=0x7f1ca4074390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.235+0000 7f1cab5b6640 1 --2- 172.21.15.78:0/27441686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ca4142680 0x7f1ca4074390 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c005fd0 tx=0x7f1c9c02a8b0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.235+0000 7f1cab5b6640 1 -- 172.21.15.78:0/27441686 shutdown_connections 2024-09-17T03:14:14.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.235+0000 7f1cab5b6640 1 --2- 172.21.15.78:0/27441686 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ca4142680 0x7f1ca4074390 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.235+0000 7f1cab5b6640 1 --2- 172.21.15.78:0/27441686 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1ca4142270 0x7f1ca4073e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.235+0000 7f1cab5b6640 1 -- 172.21.15.78:0/27441686 >> 172.21.15.78:0/27441686 conn(0x7f1ca40d15f0 msgr2=0x7f1ca4073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.235+0000 7f1cab5b6640 1 -- 172.21.15.78:0/27441686 shutdown_connections 2024-09-17T03:14:14.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.235+0000 7f1cab5b6640 1 -- 172.21.15.78:0/27441686 wait complete. 2024-09-17T03:14:14.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.236+0000 7f1cab5b6640 1 Processor -- start 2024-09-17T03:14:14.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.237+0000 7f1cab5b6640 1 -- start start 2024-09-17T03:14:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.238+0000 7f1cab5b6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1ca4142270 0x7f1ca4070110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.238+0000 7f1cab5b6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ca4142680 0x7f1ca41f83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.238+0000 7f1cab5b6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ca4144270 0x7f1ca40b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.238+0000 7f1cab5b6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca40d01f0 con 0x7f1ca4142680 2024-09-17T03:14:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.238+0000 7f1cab5b6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca40d0070 con 0x7f1ca4144270 2024-09-17T03:14:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.238+0000 7f1cab5b6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca40d0370 con 0x7f1ca4142270 2024-09-17T03:14:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.238+0000 7f1ca8b51640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ca4142680 0x7f1ca41f83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.238+0000 7f1ca8b51640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ca4142680 0x7f1ca41f83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42320/0 (socket says 172.21.15.78:42320) 2024-09-17T03:14:14.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.238+0000 7f1ca8b51640 1 -- 172.21.15.78:0/506805311 learned_addr learned my addr 172.21.15.78:0/506805311 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.238+0000 7f1ca9352640 1 --2- 172.21.15.78:0/506805311 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1ca4142270 0x7f1ca4070110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.238+0000 7f1ca9b53640 1 --2- 172.21.15.78:0/506805311 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ca4144270 0x7f1ca40b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.238+0000 7f1ca8b51640 1 -- 172.21.15.78:0/506805311 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1ca4142270 msgr2=0x7f1ca4070110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.238+0000 7f1ca8b51640 1 --2- 172.21.15.78:0/506805311 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1ca4142270 0x7f1ca4070110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.238+0000 7f1ca8b51640 1 -- 172.21.15.78:0/506805311 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ca4144270 msgr2=0x7f1ca40b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.238+0000 7f1ca8b51640 1 --2- 172.21.15.78:0/506805311 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ca4144270 0x7f1ca40b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.238+0000 7f1ca8b51640 1 -- 172.21.15.78:0/506805311 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca40c9e80 con 0x7f1ca4142680 2024-09-17T03:14:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.238+0000 7f1ca8b51640 1 --2- 172.21.15.78:0/506805311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ca4142680 0x7f1ca41f83a0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400ea50 tx=0x7f1c9400ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.239+0000 7f1c99ffb640 1 -- 172.21.15.78:0/506805311 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9400cdc0 con 0x7f1ca4142680 2024-09-17T03:14:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.239+0000 7f1c99ffb640 1 -- 172.21.15.78:0/506805311 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1c94004020 con 0x7f1ca4142680 2024-09-17T03:14:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.239+0000 7f1cab5b6640 1 -- 172.21.15.78:0/506805311 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca40ca0f0 con 0x7f1ca4142680 2024-09-17T03:14:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.239+0000 7f1c99ffb640 1 -- 172.21.15.78:0/506805311 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c94004470 con 0x7f1ca4142680 2024-09-17T03:14:14.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.239+0000 7f1cab5b6640 1 -- 172.21.15.78:0/506805311 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca40ca6b0 con 0x7f1ca4142680 2024-09-17T03:14:14.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.240+0000 7f1cab5b6640 1 -- 172.21.15.78:0/506805311 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca40b5680 con 0x7f1ca4142680 2024-09-17T03:14:14.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.241+0000 7f1c99ffb640 1 -- 172.21.15.78:0/506805311 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1c940035f0 con 0x7f1ca4142680 2024-09-17T03:14:14.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.241+0000 7f1c99ffb640 1 --2- 172.21.15.78:0/506805311 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1c88078bc0 0x7f1c8807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.241+0000 7f1c99ffb640 1 -- 172.21.15.78:0/506805311 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f1c9409b4b0 con 0x7f1ca4142680 2024-09-17T03:14:14.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.241+0000 7f1ca9352640 1 --2- 172.21.15.78:0/506805311 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1c88078bc0 0x7f1c8807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.242+0000 7f1ca9352640 1 --2- 172.21.15.78:0/506805311 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1c88078bc0 0x7f1c8807b0d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0007fd0 tx=0x7f1ca0001370 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:14.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.246+0000 7f1c99ffb640 1 -- 172.21.15.78:0/506805311 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1c94063300 con 0x7f1ca4142680 2024-09-17T03:14:14.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.487+0000 7f1cab5b6640 1 -- 172.21.15.78:0/506805311 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f1ca4071f30 con 0x7f1ca4142680 2024-09-17T03:14:14.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.488+0000 7f1c99ffb640 1 -- 172.21.15.78:0/506805311 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2009 (secure 0 0 0) 0x7f1c94067d30 con 0x7f1ca4142680 2024-09-17T03:14:14.487 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:14.487 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":371,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":84,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700753,"bytes_used":256675840,"bytes_avail":772837437440,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9725,"read_op_per_sec":0,"write_op_per_sec":10},"fsmap":{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6640},{"filesystem_id":6,"rank":1,"name":"c","status":"up:active","gid":7425},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7428}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-17T03:14:13.213276+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-17T03:14:14.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.490+0000 7f1cab5b6640 1 -- 172.21.15.78:0/506805311 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1c88078bc0 msgr2=0x7f1c8807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.490+0000 7f1cab5b6640 1 --2- 172.21.15.78:0/506805311 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1c88078bc0 0x7f1c8807b0d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0007fd0 tx=0x7f1ca0001370 comp rx=0 tx=0).stop 2024-09-17T03:14:14.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.490+0000 7f1cab5b6640 1 -- 172.21.15.78:0/506805311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ca4142680 msgr2=0x7f1ca41f83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.490+0000 7f1cab5b6640 1 --2- 172.21.15.78:0/506805311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ca4142680 0x7f1ca41f83a0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400ea50 tx=0x7f1c9400ef10 comp rx=0 tx=0).stop 2024-09-17T03:14:14.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.490+0000 7f1cab5b6640 1 -- 172.21.15.78:0/506805311 shutdown_connections 2024-09-17T03:14:14.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.490+0000 7f1cab5b6640 1 --2- 172.21.15.78:0/506805311 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1c88078bc0 0x7f1c8807b0d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.490+0000 7f1cab5b6640 1 --2- 172.21.15.78:0/506805311 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ca4144270 0x7f1ca40b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.490+0000 7f1cab5b6640 1 --2- 172.21.15.78:0/506805311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1ca4142680 0x7f1ca41f83a0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.490+0000 7f1cab5b6640 1 --2- 172.21.15.78:0/506805311 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1ca4142270 0x7f1ca4070110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.490+0000 7f1cab5b6640 1 -- 172.21.15.78:0/506805311 >> 172.21.15.78:0/506805311 conn(0x7f1ca40d15f0 msgr2=0x7f1ca41433a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.490+0000 7f1cab5b6640 1 -- 172.21.15.78:0/506805311 shutdown_connections 2024-09-17T03:14:14.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.490+0000 7f1cab5b6640 1 -- 172.21.15.78:0/506805311 wait complete. 2024-09-17T03:14:14.501 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-17T03:14:14.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:14.501 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub resume 2024-09-17T03:14:14.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.616+0000 7f045bf21640 1 -- 172.21.15.78:0/1342620459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04540d12c0 msgr2=0x7f04540d16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.616+0000 7f045bf21640 1 --2- 172.21.15.78:0/1342620459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04540d12c0 0x7f04540d16d0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f04540724e0 tx=0x7f044c02aa30 comp rx=0 tx=0).stop 2024-09-17T03:14:14.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.616+0000 7f045bf21640 1 -- 172.21.15.78:0/1342620459 shutdown_connections 2024-09-17T03:14:14.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.616+0000 7f045bf21640 1 --2- 172.21.15.78:0/1342620459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04540d12c0 0x7f04540d16d0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.616+0000 7f045bf21640 1 --2- 172.21.15.78:0/1342620459 >> v2:172.21.15.193:3300/0 conn(0x7f04540ccbd0 0x7f04540d0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.616+0000 7f045bf21640 1 -- 172.21.15.78:0/1342620459 >> 172.21.15.78:0/1342620459 conn(0x7f0454072ae0 msgr2=0x7f0454072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.616+0000 7f045bf21640 1 -- 172.21.15.78:0/1342620459 shutdown_connections 2024-09-17T03:14:14.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.616+0000 7f045bf21640 1 -- 172.21.15.78:0/1342620459 wait complete. 2024-09-17T03:14:14.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.618+0000 7f045bf21640 1 Processor -- start 2024-09-17T03:14:14.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.618+0000 7f045bf21640 1 -- start start 2024-09-17T03:14:14.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.619+0000 7f045bf21640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f04540b51c0 0x7f0454151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.619+0000 7f045bf21640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04540ccbd0 0x7f045414e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.619+0000 7f045bf21640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04540d12c0 0x7f04541f8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.619+0000 7f045bf21640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f04540cf220 con 0x7f04540d12c0 2024-09-17T03:14:14.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.619+0000 7f045bf21640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f04540cf0a0 con 0x7f04540ccbd0 2024-09-17T03:14:14.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.619+0000 7f045bf21640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f04540cf3a0 con 0x7f04540b51c0 2024-09-17T03:14:14.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.619+0000 7f045a4be640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04540d12c0 0x7f04541f8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.619+0000 7f045a4be640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04540d12c0 0x7f04541f8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42340/0 (socket says 172.21.15.78:42340) 2024-09-17T03:14:14.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.619+0000 7f045a4be640 1 -- 172.21.15.78:0/3957403716 learned_addr learned my addr 172.21.15.78:0/3957403716 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:14.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.620+0000 7f04594bc640 1 --2- 172.21.15.78:0/3957403716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04540ccbd0 0x7f045414e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.620+0000 7f0459cbd640 1 --2- 172.21.15.78:0/3957403716 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f04540b51c0 0x7f0454151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.620+0000 7f045a4be640 1 -- 172.21.15.78:0/3957403716 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f04540b51c0 msgr2=0x7f0454151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.620+0000 7f045a4be640 1 --2- 172.21.15.78:0/3957403716 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f04540b51c0 0x7f0454151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.620+0000 7f045a4be640 1 -- 172.21.15.78:0/3957403716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04540ccbd0 msgr2=0x7f045414e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.620+0000 7f045a4be640 1 --2- 172.21.15.78:0/3957403716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04540ccbd0 0x7f045414e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.620+0000 7f045a4be640 1 -- 172.21.15.78:0/3957403716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045406e690 con 0x7f04540d12c0 2024-09-17T03:14:14.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.620+0000 7f04594bc640 1 --2- 172.21.15.78:0/3957403716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04540ccbd0 0x7f045414e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:14.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.620+0000 7f045a4be640 1 --2- 172.21.15.78:0/3957403716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04540d12c0 0x7f04541f8e20 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f044c02b020 tx=0x7f044c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:14.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.620+0000 7f044a7fc640 1 -- 172.21.15.78:0/3957403716 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c033050 con 0x7f04540d12c0 2024-09-17T03:14:14.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.620+0000 7f044a7fc640 1 -- 172.21.15.78:0/3957403716 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f044c004450 con 0x7f04540d12c0 2024-09-17T03:14:14.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.620+0000 7f045bf21640 1 -- 172.21.15.78:0/3957403716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f045406e970 con 0x7f04540d12c0 2024-09-17T03:14:14.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.620+0000 7f044a7fc640 1 -- 172.21.15.78:0/3957403716 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c004840 con 0x7f04540d12c0 2024-09-17T03:14:14.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.620+0000 7f045bf21640 1 -- 172.21.15.78:0/3957403716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f045406ef30 con 0x7f04540d12c0 2024-09-17T03:14:14.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.622+0000 7f044a7fc640 1 -- 172.21.15.78:0/3957403716 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f044c036070 con 0x7f04540d12c0 2024-09-17T03:14:14.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.622+0000 7f044a7fc640 1 --2- 172.21.15.78:0/3957403716 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0438078bc0 0x7f043807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.623+0000 7f044a7fc640 1 -- 172.21.15.78:0/3957403716 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f044c0bc1b0 con 0x7f04540d12c0 2024-09-17T03:14:14.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.623+0000 7f0459cbd640 1 --2- 172.21.15.78:0/3957403716 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0438078bc0 0x7f043807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.623+0000 7f0459cbd640 1 --2- 172.21.15.78:0/3957403716 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0438078bc0 0x7f043807b0d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0450006fd0 tx=0x7f0450008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:14.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.623+0000 7f0462e89740 1 Processor -- start 2024-09-17T03:14:14.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.624+0000 7f0462e89740 1 -- start start 2024-09-17T03:14:14.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.625+0000 7f0462e89740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a64390 0x55ea76e35740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.625+0000 7f0462e89740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a3b4d0 0x55ea76e35c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.625+0000 7f0462e89740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a436b0 0x55ea76e52b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.625+0000 7f0462e89740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ea76d7ea60 con 0x55ea76a436b0 2024-09-17T03:14:14.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.625+0000 7f0462e89740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ea76d6de90 con 0x55ea76a3b4d0 2024-09-17T03:14:14.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.625+0000 7f0462e89740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ea76d71ca0 con 0x55ea76a64390 2024-09-17T03:14:14.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.625+0000 7f045a4be640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a436b0 0x55ea76e52b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.625+0000 7f045a4be640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a436b0 0x55ea76e52b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42348/0 (socket says 172.21.15.78:42348) 2024-09-17T03:14:14.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.625+0000 7f045a4be640 1 -- 172.21.15.78:0/3782970543 learned_addr learned my addr 172.21.15.78:0/3782970543 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:14.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.625+0000 7f04594bc640 1 --2- 172.21.15.78:0/3782970543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a3b4d0 0x55ea76e35c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.625+0000 7f0459cbd640 1 --2- 172.21.15.78:0/3782970543 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a64390 0x55ea76e35740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.625+0000 7f045a4be640 1 -- 172.21.15.78:0/3782970543 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a64390 msgr2=0x55ea76e35740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.625+0000 7f045a4be640 1 --2- 172.21.15.78:0/3782970543 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a64390 0x55ea76e35740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.625+0000 7f045a4be640 1 -- 172.21.15.78:0/3782970543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a3b4d0 msgr2=0x55ea76e35c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.625+0000 7f045a4be640 1 --2- 172.21.15.78:0/3782970543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a3b4d0 0x55ea76e35c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.625+0000 7f045a4be640 1 -- 172.21.15.78:0/3782970543 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea76b467d0 con 0x55ea76a436b0 2024-09-17T03:14:14.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.625+0000 7f045a4be640 1 --2- 172.21.15.78:0/3782970543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a436b0 0x55ea76e52b80 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f044c083f60 tx=0x7f044c07fef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da47310186ac245 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:14.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.626+0000 7f04377fe640 1 -- 172.21.15.78:0/3782970543 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c083740 con 0x55ea76a436b0 2024-09-17T03:14:14.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.626+0000 7f04377fe640 1 -- 172.21.15.78:0/3782970543 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f044c083ae0 con 0x55ea76a436b0 2024-09-17T03:14:14.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.626+0000 7f04377fe640 1 -- 172.21.15.78:0/3782970543 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044c08d730 con 0x55ea76a436b0 2024-09-17T03:14:14.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.626+0000 7f0462e89740 1 -- 172.21.15.78:0/3782970543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a436b0 msgr2=0x55ea76e52b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.626+0000 7f0462e89740 1 --2- 172.21.15.78:0/3782970543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a436b0 0x55ea76e52b80 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f044c083f60 tx=0x7f044c07fef0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.626+0000 7f0462e89740 1 -- 172.21.15.78:0/3782970543 shutdown_connections 2024-09-17T03:14:14.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.626+0000 7f0462e89740 1 --2- 172.21.15.78:0/3782970543 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a436b0 0x55ea76e52b80 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.626+0000 7f0462e89740 1 --2- 172.21.15.78:0/3782970543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a3b4d0 0x55ea76e35c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.626+0000 7f0462e89740 1 --2- 172.21.15.78:0/3782970543 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a64390 0x55ea76e35740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.626+0000 7f0462e89740 1 -- 172.21.15.78:0/3782970543 >> 172.21.15.78:0/3782970543 conn(0x55ea76a584e0 msgr2=0x55ea76e0ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.627+0000 7f0462e89740 1 -- 172.21.15.78:0/3782970543 shutdown_connections 2024-09-17T03:14:14.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.627+0000 7f0462e89740 1 -- 172.21.15.78:0/3782970543 wait complete. 2024-09-17T03:14:14.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.627+0000 7f0462e89740 1 -- start start 2024-09-17T03:14:14.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.627+0000 7f0462e89740 1 Processor -- start 2024-09-17T03:14:14.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.629+0000 7f0462e89740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a3b4d0 0x55ea76e23da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.629+0000 7f0462e89740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a436b0 0x55ea76e50d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.629+0000 7f0462e89740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a64390 0x55ea76e497f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.629+0000 7f0462e89740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ea76ade740 con 0x55ea76a436b0 2024-09-17T03:14:14.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.629+0000 7f0462e89740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ea76d13970 con 0x55ea76a64390 2024-09-17T03:14:14.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.629+0000 7f0462e89740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ea76d7ea60 con 0x55ea76a3b4d0 2024-09-17T03:14:14.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.629+0000 7f0462e89740 10 client.0 _ll_register_callbacks cb 0x55ea76d16be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:14.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.629+0000 7f04594bc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a436b0 0x55ea76e50d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.629+0000 7f04594bc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a436b0 0x55ea76e50d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42354/0 (socket says 172.21.15.78:42354) 2024-09-17T03:14:14.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.629+0000 7f04594bc640 1 -- 172.21.15.78:0/2046535218 learned_addr learned my addr 172.21.15.78:0/2046535218 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:14.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.629+0000 7f045a4be640 1 --2- 172.21.15.78:0/2046535218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a64390 0x55ea76e497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.629+0000 7f0459cbd640 1 --2- 172.21.15.78:0/2046535218 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a3b4d0 0x55ea76e23da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.629+0000 7f04594bc640 1 -- 172.21.15.78:0/2046535218 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a3b4d0 msgr2=0x55ea76e23da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.629+0000 7f04594bc640 1 --2- 172.21.15.78:0/2046535218 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a3b4d0 0x55ea76e23da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.629+0000 7f04594bc640 1 -- 172.21.15.78:0/2046535218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a64390 msgr2=0x55ea76e497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.629+0000 7f04594bc640 1 --2- 172.21.15.78:0/2046535218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a64390 0x55ea76e497f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.629+0000 7f04594bc640 1 -- 172.21.15.78:0/2046535218 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea76acf970 con 0x55ea76a436b0 2024-09-17T03:14:14.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.630+0000 7f04594bc640 1 --2- 172.21.15.78:0/2046535218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a436b0 0x55ea76e50d00 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f044400dfb0 tx=0x7f04440128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613d835c9601fa3a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:14.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.630+0000 7f0434ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:14.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.630+0000 7f0434ff9640 1 -- 172.21.15.78:0/2046535218 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044401f060 con 0x55ea76a436b0 2024-09-17T03:14:14.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.630+0000 7f0434ff9640 1 -- 172.21.15.78:0/2046535218 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f0444010900 con 0x55ea76a436b0 2024-09-17T03:14:14.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.630+0000 7f0462e89740 1 -- 172.21.15.78:0/2046535218 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f044c083ae0 con 0x55ea76a436b0 2024-09-17T03:14:14.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.630+0000 7f0434ff9640 1 -- 172.21.15.78:0/2046535218 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f0444010b00 con 0x55ea76a436b0 2024-09-17T03:14:14.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.630+0000 7f0462e89740 10 client.7980 fetch_fsmap learned FSMap version 85 2024-09-17T03:14:14.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.630+0000 7f0462e89740 1 -- 172.21.15.78:0/2046535218 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x55ea76aad6a0 con 0x55ea76a436b0 2024-09-17T03:14:14.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.630+0000 7f0434ff9640 1 -- 172.21.15.78:0/2046535218 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f044c083ae0 con 0x55ea76a436b0 2024-09-17T03:14:14.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.630+0000 7f0434ff9640 1 -- 172.21.15.78:0/2046535218 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 85) ==== 3558+0+0 (secure 0 0 0) 0x7f0444028080 con 0x55ea76a436b0 2024-09-17T03:14:14.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.630+0000 7f0462e89740 10 client.7980 fetch_fsmap finished waiting for FSMap version 85 2024-09-17T03:14:14.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.630+0000 7f0462e89740 10 client.7980 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T03:14:14.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.630+0000 7f0462e89740 20 client.7980 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:14.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.630+0000 7f0462e89740 1 --2- 172.21.15.78:0/2046535218 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55ea76a22f60 0x55ea76e4b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.630+0000 7f0462e89740 4 client.7980 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:14:14.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.630+0000 7f0462e89740 1 -- 172.21.15.78:0/2046535218 --> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea76d809b0 con 0x55ea76a22f60 2024-09-17T03:14:14.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.630+0000 7f0459cbd640 1 --2- 172.21.15.78:0/2046535218 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55ea76a22f60 0x55ea76e4b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.631+0000 7f0434ff9640 10 client.7980 ms_handle_connect on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.631+0000 7f0459cbd640 1 --2- 172.21.15.78:0/2046535218 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55ea76a22f60 0x55ea76e4b010 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45c85afbb27a4d60 server_cookie=a5ceb6b735432d2a in_seq=0 out_seq=0 2024-09-17T03:14:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.631+0000 7f0434ff9640 1 -- 172.21.15.78:0/2046535218 <== mds.0 v2:172.21.15.78:6833/3357123265 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ea76d809b0 con 0x55ea76a22f60 2024-09-17T03:14:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.631+0000 7f0434ff9640 10 client.7980 handle_command_reply: tid=0 2024-09-17T03:14:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.631+0000 7f0462e89740 1 client.7980 shutdown 2024-09-17T03:14:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.632+0000 7f0462e89740 1 -- 172.21.15.78:0/2046535218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a436b0 msgr2=0x55ea76e50d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.632+0000 7f0462e89740 1 --2- 172.21.15.78:0/2046535218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a436b0 0x55ea76e50d00 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f044400dfb0 tx=0x7f04440128e0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.632+0000 7f0462e89740 1 -- 172.21.15.78:0/2046535218 shutdown_connections 2024-09-17T03:14:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.632+0000 7f0462e89740 1 --2- 172.21.15.78:0/2046535218 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55ea76a22f60 0x55ea76e4b010 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.632+0000 7f0462e89740 1 --2- 172.21.15.78:0/2046535218 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a64390 0x55ea76e497f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.632+0000 7f0462e89740 1 --2- 172.21.15.78:0/2046535218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a436b0 0x55ea76e50d00 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.632+0000 7f0434ff9640 0 client.7980 ms_handle_reset on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:14.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.632+0000 7f0462e89740 1 --2- 172.21.15.78:0/2046535218 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a3b4d0 0x55ea76e23da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.632+0000 7f0462e89740 1 -- 172.21.15.78:0/2046535218 >> 172.21.15.78:0/2046535218 conn(0x55ea76a584e0 msgr2=0x55ea76e04cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.632+0000 7f0462e89740 1 -- 172.21.15.78:0/2046535218 shutdown_connections 2024-09-17T03:14:14.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.632+0000 7f0462e89740 1 -- 172.21.15.78:0/2046535218 wait complete. 2024-09-17T03:14:14.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.632+0000 7f0462e89740 20 client.7980 trim_cache size 0 max 16384 2024-09-17T03:14:14.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.649+0000 7f0462e89740 1 Processor -- start 2024-09-17T03:14:14.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.649+0000 7f0462e89740 1 -- start start 2024-09-17T03:14:14.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f0462e89740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a22f60 0x55ea76e35d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f0462e89740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a3b4d0 0x55ea76e236b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f0462e89740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a436b0 0x55ea76e23bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f0462e89740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0454202290 con 0x55ea76a22f60 2024-09-17T03:14:14.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f0462e89740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0454201430 con 0x55ea76a436b0 2024-09-17T03:14:14.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f0462e89740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0454201b60 con 0x55ea76a3b4d0 2024-09-17T03:14:14.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f0459cbd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a22f60 0x55ea76e35d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f0459cbd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a22f60 0x55ea76e35d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42368/0 (socket says 172.21.15.78:42368) 2024-09-17T03:14:14.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f0459cbd640 1 -- 172.21.15.78:0/529871484 learned_addr learned my addr 172.21.15.78:0/529871484 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:14.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f045a4be640 1 --2- 172.21.15.78:0/529871484 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a436b0 0x55ea76e23bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f04594bc640 1 --2- 172.21.15.78:0/529871484 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a3b4d0 0x55ea76e236b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f0459cbd640 1 -- 172.21.15.78:0/529871484 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a3b4d0 msgr2=0x55ea76e236b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f0459cbd640 1 --2- 172.21.15.78:0/529871484 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a3b4d0 0x55ea76e236b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f0459cbd640 1 -- 172.21.15.78:0/529871484 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a436b0 msgr2=0x55ea76e23bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f0459cbd640 1 --2- 172.21.15.78:0/529871484 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a436b0 0x55ea76e23bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f0459cbd640 1 -- 172.21.15.78:0/529871484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea76e51a00 con 0x55ea76a22f60 2024-09-17T03:14:14.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f04594bc640 1 --2- 172.21.15.78:0/529871484 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a3b4d0 0x55ea76e236b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:14.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f0459cbd640 1 --2- 172.21.15.78:0/529871484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a22f60 0x55ea76e35d60 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f045000da20 tx=0x7f0450013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3b859bc8948744 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:14.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f0436ffd640 1 -- 172.21.15.78:0/529871484 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045000dde0 con 0x55ea76a22f60 2024-09-17T03:14:14.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f0436ffd640 1 -- 172.21.15.78:0/529871484 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0450004020 con 0x55ea76a22f60 2024-09-17T03:14:14.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.651+0000 7f0436ffd640 1 -- 172.21.15.78:0/529871484 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04500041d0 con 0x55ea76a22f60 2024-09-17T03:14:14.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.652+0000 7f0462e89740 1 -- 172.21.15.78:0/529871484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a22f60 msgr2=0x55ea76e35d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.652+0000 7f0462e89740 1 --2- 172.21.15.78:0/529871484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a22f60 0x55ea76e35d60 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f045000da20 tx=0x7f0450013000 comp rx=0 tx=0).stop 2024-09-17T03:14:14.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.652+0000 7f0462e89740 1 -- 172.21.15.78:0/529871484 shutdown_connections 2024-09-17T03:14:14.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.652+0000 7f0462e89740 1 --2- 172.21.15.78:0/529871484 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a436b0 0x55ea76e23bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.652+0000 7f0462e89740 1 --2- 172.21.15.78:0/529871484 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a3b4d0 0x55ea76e236b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.652+0000 7f0462e89740 1 --2- 172.21.15.78:0/529871484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a22f60 0x55ea76e35d60 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.652+0000 7f0462e89740 1 -- 172.21.15.78:0/529871484 >> 172.21.15.78:0/529871484 conn(0x55ea76a584e0 msgr2=0x55ea76e014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.652+0000 7f0462e89740 1 -- 172.21.15.78:0/529871484 shutdown_connections 2024-09-17T03:14:14.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.652+0000 7f0462e89740 1 -- 172.21.15.78:0/529871484 wait complete. 2024-09-17T03:14:14.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.653+0000 7f0462e89740 1 -- start start 2024-09-17T03:14:14.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.653+0000 7f0462e89740 1 Processor -- start 2024-09-17T03:14:14.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.654+0000 7f0462e89740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a22f60 0x55ea76ecec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.654+0000 7f0462e89740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a3b4d0 0x55ea76ecf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.654+0000 7f0462e89740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a436b0 0x55ea76e236b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.654+0000 7f0462e89740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f04540b6370 con 0x55ea76a3b4d0 2024-09-17T03:14:14.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.654+0000 7f0462e89740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ea76e06af0 con 0x55ea76a436b0 2024-09-17T03:14:14.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.654+0000 7f0462e89740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ea76ecf9f0 con 0x55ea76a22f60 2024-09-17T03:14:14.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.655+0000 7f0462e89740 10 client.0 _ll_register_callbacks cb 0x7f044400d860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:14.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.655+0000 7f04594bc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a3b4d0 0x55ea76ecf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.655+0000 7f04594bc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a3b4d0 0x55ea76ecf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42384/0 (socket says 172.21.15.78:42384) 2024-09-17T03:14:14.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.655+0000 7f04594bc640 1 -- 172.21.15.78:0/3889749766 learned_addr learned my addr 172.21.15.78:0/3889749766 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:14.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.655+0000 7f0459cbd640 1 --2- 172.21.15.78:0/3889749766 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a22f60 0x55ea76ecec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.655+0000 7f045a4be640 1 --2- 172.21.15.78:0/3889749766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a436b0 0x55ea76e236b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.655+0000 7f04594bc640 1 -- 172.21.15.78:0/3889749766 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a22f60 msgr2=0x55ea76ecec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.655+0000 7f04594bc640 1 --2- 172.21.15.78:0/3889749766 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a22f60 0x55ea76ecec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.655+0000 7f04594bc640 1 -- 172.21.15.78:0/3889749766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a436b0 msgr2=0x55ea76e236b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.655+0000 7f04594bc640 1 --2- 172.21.15.78:0/3889749766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a436b0 0x55ea76e236b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.655+0000 7f04594bc640 1 -- 172.21.15.78:0/3889749766 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea76e35640 con 0x55ea76a3b4d0 2024-09-17T03:14:14.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.655+0000 7f045a4be640 1 --2- 172.21.15.78:0/3889749766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a436b0 0x55ea76e236b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:14.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.655+0000 7f04594bc640 1 --2- 172.21.15.78:0/3889749766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a3b4d0 0x55ea76ecf1a0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f044400da80 tx=0x7f044400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7723204d69e8257 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.655+0000 7f0434ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.655+0000 7f0434ff9640 1 -- 172.21.15.78:0/3889749766 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f044401f070 con 0x55ea76a3b4d0 2024-09-17T03:14:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.655+0000 7f0434ff9640 1 -- 172.21.15.78:0/3889749766 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f044401aa30 con 0x55ea76a3b4d0 2024-09-17T03:14:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.655+0000 7f0462e89740 1 -- 172.21.15.78:0/3889749766 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0450004020 con 0x55ea76a3b4d0 2024-09-17T03:14:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.655+0000 7f0434ff9640 1 -- 172.21.15.78:0/3889749766 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f0444035050 con 0x55ea76a3b4d0 2024-09-17T03:14:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.655+0000 7f0462e89740 10 client.7986 fetch_fsmap learned FSMap version 85 2024-09-17T03:14:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.655+0000 7f0462e89740 1 -- 172.21.15.78:0/3889749766 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x55ea76ecf7f0 con 0x55ea76a3b4d0 2024-09-17T03:14:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.656+0000 7f0434ff9640 1 -- 172.21.15.78:0/3889749766 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0450004020 con 0x55ea76a3b4d0 2024-09-17T03:14:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.656+0000 7f0434ff9640 1 -- 172.21.15.78:0/3889749766 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 85) ==== 3558+0+0 (secure 0 0 0) 0x7f0444038020 con 0x55ea76a3b4d0 2024-09-17T03:14:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.656+0000 7f0462e89740 10 client.7986 fetch_fsmap finished waiting for FSMap version 85 2024-09-17T03:14:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.656+0000 7f0462e89740 10 client.7986 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T03:14:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.656+0000 7f0462e89740 20 client.7986 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:14.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.656+0000 7f0462e89740 1 --2- 172.21.15.78:0/3889749766 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55ea769f83a0 0x55ea76e23bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.656+0000 7f0462e89740 4 client.7986 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-17T03:14:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.656+0000 7f0462e89740 1 -- 172.21.15.78:0/3889749766 --> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x55ea76d7c460 con 0x55ea769f83a0 2024-09-17T03:14:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.656+0000 7f0459cbd640 1 --2- 172.21.15.78:0/3889749766 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55ea769f83a0 0x55ea76e23bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.656+0000 7f0434ff9640 10 client.7986 ms_handle_connect on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.656+0000 7f0459cbd640 1 --2- 172.21.15.78:0/3889749766 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55ea769f83a0 0x55ea76e23bf0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32c0c1b74edd75b server_cookie=ebf47ef8d1a9e325 in_seq=0 out_seq=0 2024-09-17T03:14:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f0434ff9640 1 -- 172.21.15.78:0/3889749766 <== mds.0 v2:172.21.15.78:6833/3357123265 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55ea76d7c460 con 0x55ea769f83a0 2024-09-17T03:14:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f0434ff9640 10 client.7986 handle_command_reply: tid=0 2024-09-17T03:14:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f0462e89740 1 client.7986 shutdown 2024-09-17T03:14:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f0462e89740 1 -- 172.21.15.78:0/3889749766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a3b4d0 msgr2=0x55ea76ecf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f0462e89740 1 --2- 172.21.15.78:0/3889749766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a3b4d0 0x55ea76ecf1a0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f044400da80 tx=0x7f044400dab0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f0462e89740 1 -- 172.21.15.78:0/3889749766 shutdown_connections 2024-09-17T03:14:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f0462e89740 1 --2- 172.21.15.78:0/3889749766 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55ea769f83a0 0x55ea76e23bf0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f0462e89740 1 --2- 172.21.15.78:0/3889749766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ea76a436b0 0x55ea76e236b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f0434ff9640 0 client.7986 ms_handle_reset on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:14.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f0462e89740 1 --2- 172.21.15.78:0/3889749766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ea76a3b4d0 0x55ea76ecf1a0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f0462e89740 1 --2- 172.21.15.78:0/3889749766 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ea76a22f60 0x55ea76ecec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f0462e89740 1 -- 172.21.15.78:0/3889749766 >> 172.21.15.78:0/3889749766 conn(0x55ea76a584e0 msgr2=0x55ea76e4c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f0462e89740 1 -- 172.21.15.78:0/3889749766 shutdown_connections 2024-09-17T03:14:14.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f0462e89740 1 -- 172.21.15.78:0/3889749766 wait complete. 2024-09-17T03:14:14.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f0462e89740 20 client.7986 trim_cache size 0 max 16384 2024-09-17T03:14:14.661 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:14:14.661 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:14:14.661 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:14:14.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f045bf21640 1 -- 172.21.15.78:0/3957403716 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0438078bc0 msgr2=0x7f043807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f045bf21640 1 --2- 172.21.15.78:0/3957403716 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0438078bc0 0x7f043807b0d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0450006fd0 tx=0x7f0450008040 comp rx=0 tx=0).stop 2024-09-17T03:14:14.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f045bf21640 1 -- 172.21.15.78:0/3957403716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04540d12c0 msgr2=0x7f04541f8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f045bf21640 1 --2- 172.21.15.78:0/3957403716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04540d12c0 0x7f04541f8e20 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f044c02b020 tx=0x7f044c003f10 comp rx=0 tx=0).stop 2024-09-17T03:14:14.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f045bf21640 1 -- 172.21.15.78:0/3957403716 shutdown_connections 2024-09-17T03:14:14.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f045bf21640 1 --2- 172.21.15.78:0/3957403716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04540d12c0 0x7f04541f8e20 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f045bf21640 1 --2- 172.21.15.78:0/3957403716 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0438078bc0 0x7f043807b0d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.657+0000 7f045bf21640 1 --2- 172.21.15.78:0/3957403716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04540ccbd0 0x7f045414e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.658+0000 7f045bf21640 1 --2- 172.21.15.78:0/3957403716 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f04540b51c0 0x7f0454151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.658+0000 7f045bf21640 1 -- 172.21.15.78:0/3957403716 >> 172.21.15.78:0/3957403716 conn(0x7f0454072ae0 msgr2=0x7f045415e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.658+0000 7f045bf21640 1 -- 172.21.15.78:0/3957403716 shutdown_connections 2024-09-17T03:14:14.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.658+0000 7f045bf21640 1 -- 172.21.15.78:0/3957403716 wait complete. 2024-09-17T03:14:14.667 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:14:14.667 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.6:1 scrub status 2024-09-17T03:14:14.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.782+0000 7f26a118b640 1 -- 172.21.15.78:0/97781679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f269c15d670 msgr2=0x7f269c0b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.782+0000 7f26a118b640 1 --2- 172.21.15.78:0/97781679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f269c15d670 0x7f269c0b7490 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f269c071d80 tx=0x7f269402a8b0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.782+0000 7f26a118b640 1 -- 172.21.15.78:0/97781679 shutdown_connections 2024-09-17T03:14:14.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.782+0000 7f26a118b640 1 --2- 172.21.15.78:0/97781679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f269c15d670 0x7f269c0b7490 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.782+0000 7f26a118b640 1 --2- 172.21.15.78:0/97781679 >> v2:172.21.15.193:3300/0 conn(0x7f269c0d2630 0x7f269c15d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.782+0000 7f26a118b640 1 -- 172.21.15.78:0/97781679 >> 172.21.15.78:0/97781679 conn(0x7f269c06d550 msgr2=0x7f269c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.782+0000 7f26a118b640 1 -- 172.21.15.78:0/97781679 shutdown_connections 2024-09-17T03:14:14.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.782+0000 7f26a118b640 1 -- 172.21.15.78:0/97781679 wait complete. 2024-09-17T03:14:14.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.784+0000 7f26a118b640 1 Processor -- start 2024-09-17T03:14:14.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.784+0000 7f26a118b640 1 -- start start 2024-09-17T03:14:14.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.785+0000 7f26a118b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f269c1570e0 0x7f269c0c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.785+0000 7f26a118b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f269c15d670 0x7f269c1f5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.785+0000 7f26a118b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f269c1554b0 0x7f269c14a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.785+0000 7f26a118b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f269c0b7d60 con 0x7f269c15d670 2024-09-17T03:14:14.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.785+0000 7f26a118b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f269c0b7be0 con 0x7f269c1554b0 2024-09-17T03:14:14.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.785+0000 7f26a118b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f269c0b7ee0 con 0x7f269c1570e0 2024-09-17T03:14:14.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.786+0000 7f2693fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f269c15d670 0x7f269c1f5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.786+0000 7f2693fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f269c15d670 0x7f269c1f5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42406/0 (socket says 172.21.15.78:42406) 2024-09-17T03:14:14.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.786+0000 7f2693fff640 1 -- 172.21.15.78:0/3337953394 learned_addr learned my addr 172.21.15.78:0/3337953394 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:14.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.786+0000 7f269b59e640 1 --2- 172.21.15.78:0/3337953394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f269c1554b0 0x7f269c14a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.786+0000 7f269ad9d640 1 --2- 172.21.15.78:0/3337953394 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f269c1570e0 0x7f269c0c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.786+0000 7f2693fff640 1 -- 172.21.15.78:0/3337953394 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f269c1570e0 msgr2=0x7f269c0c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.786+0000 7f2693fff640 1 --2- 172.21.15.78:0/3337953394 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f269c1570e0 0x7f269c0c7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.786+0000 7f2693fff640 1 -- 172.21.15.78:0/3337953394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f269c1554b0 msgr2=0x7f269c14a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.786+0000 7f2693fff640 1 --2- 172.21.15.78:0/3337953394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f269c1554b0 0x7f269c14a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.786+0000 7f2693fff640 1 -- 172.21.15.78:0/3337953394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269c1f6520 con 0x7f269c15d670 2024-09-17T03:14:14.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.786+0000 7f269b59e640 1 --2- 172.21.15.78:0/3337953394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f269c1554b0 0x7f269c14a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:14.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.786+0000 7f2693fff640 1 --2- 172.21.15.78:0/3337953394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f269c15d670 0x7f269c1f5a80 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f268400b440 tx=0x7f268400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:14.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.786+0000 7f26937fe640 1 -- 172.21.15.78:0/3337953394 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2684015020 con 0x7f269c15d670 2024-09-17T03:14:14.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.786+0000 7f26937fe640 1 -- 172.21.15.78:0/3337953394 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2684011980 con 0x7f269c15d670 2024-09-17T03:14:14.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.786+0000 7f26a118b640 1 -- 172.21.15.78:0/3337953394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f269c1f6800 con 0x7f269c15d670 2024-09-17T03:14:14.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.786+0000 7f26937fe640 1 -- 172.21.15.78:0/3337953394 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2684011dd0 con 0x7f269c15d670 2024-09-17T03:14:14.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.786+0000 7f26a118b640 1 -- 172.21.15.78:0/3337953394 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f269c1f5fc0 con 0x7f269c15d670 2024-09-17T03:14:14.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.788+0000 7f26937fe640 1 -- 172.21.15.78:0/3337953394 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2684018020 con 0x7f269c15d670 2024-09-17T03:14:14.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.789+0000 7f26937fe640 1 --2- 172.21.15.78:0/3337953394 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f267c078b90 0x7f267c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.789+0000 7f26937fe640 1 -- 172.21.15.78:0/3337953394 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f268409afa0 con 0x7f269c15d670 2024-09-17T03:14:14.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.789+0000 7f269ad9d640 1 --2- 172.21.15.78:0/3337953394 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f267c078b90 0x7f267c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.789+0000 7f269ad9d640 1 --2- 172.21.15.78:0/3337953394 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f267c078b90 0x7f267c07b0a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f268c001540 tx=0x7f268c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:14.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.789+0000 7f26a81d5740 1 Processor -- start 2024-09-17T03:14:14.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.790+0000 7f26a81d5740 1 -- start start 2024-09-17T03:14:14.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.791+0000 7f26a81d5740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f336608390 0x55f3369d9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.791+0000 7f26a81d5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3365df4d0 0x55f3369d9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.791+0000 7f26a81d5740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f3365e76b0 0x55f3369f6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.791+0000 7f26a81d5740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f336922a60 con 0x55f336608390 2024-09-17T03:14:14.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.791+0000 7f26a81d5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f336911e90 con 0x55f3365df4d0 2024-09-17T03:14:14.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.791+0000 7f26a81d5740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f336915ca0 con 0x55f3365e76b0 2024-09-17T03:14:14.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.791+0000 7f269ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f336608390 0x55f3369d9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.791+0000 7f269ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f336608390 0x55f3369d9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42414/0 (socket says 172.21.15.78:42414) 2024-09-17T03:14:14.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.791+0000 7f269ad9d640 1 -- 172.21.15.78:0/2426876981 learned_addr learned my addr 172.21.15.78:0/2426876981 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:14.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.791+0000 7f2693fff640 1 --2- 172.21.15.78:0/2426876981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3365df4d0 0x55f3369d9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.791+0000 7f269b59e640 1 --2- 172.21.15.78:0/2426876981 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f3365e76b0 0x55f3369f6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.791+0000 7f269ad9d640 1 -- 172.21.15.78:0/2426876981 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f3365e76b0 msgr2=0x55f3369f6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.791+0000 7f269ad9d640 1 --2- 172.21.15.78:0/2426876981 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f3365e76b0 0x55f3369f6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.791+0000 7f269ad9d640 1 -- 172.21.15.78:0/2426876981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3365df4d0 msgr2=0x55f3369d9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.791+0000 7f269ad9d640 1 --2- 172.21.15.78:0/2426876981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3365df4d0 0x55f3369d9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.791+0000 7f269ad9d640 1 -- 172.21.15.78:0/2426876981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3366ea7d0 con 0x55f336608390 2024-09-17T03:14:14.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.791+0000 7f269ad9d640 1 --2- 172.21.15.78:0/2426876981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f336608390 0x55f3369d9740 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f268c014860 tx=0x7f268c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=617c62345436ab45 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:14.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.791+0000 7f2690ff9640 1 -- 172.21.15.78:0/2426876981 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268c024070 con 0x55f336608390 2024-09-17T03:14:14.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.792+0000 7f2690ff9640 1 -- 172.21.15.78:0/2426876981 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f268c012b50 con 0x55f336608390 2024-09-17T03:14:14.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.792+0000 7f2690ff9640 1 -- 172.21.15.78:0/2426876981 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268c01f400 con 0x55f336608390 2024-09-17T03:14:14.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.792+0000 7f26a81d5740 1 -- 172.21.15.78:0/2426876981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f336608390 msgr2=0x55f3369d9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.792+0000 7f26a81d5740 1 --2- 172.21.15.78:0/2426876981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f336608390 0x55f3369d9740 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f268c014860 tx=0x7f268c010000 comp rx=0 tx=0).stop 2024-09-17T03:14:14.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.792+0000 7f26a81d5740 1 -- 172.21.15.78:0/2426876981 shutdown_connections 2024-09-17T03:14:14.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.792+0000 7f26a81d5740 1 --2- 172.21.15.78:0/2426876981 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f3365e76b0 0x55f3369f6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.792+0000 7f26a81d5740 1 --2- 172.21.15.78:0/2426876981 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3365df4d0 0x55f3369d9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.792+0000 7f26a81d5740 1 --2- 172.21.15.78:0/2426876981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f336608390 0x55f3369d9740 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.792+0000 7f26a81d5740 1 -- 172.21.15.78:0/2426876981 >> 172.21.15.78:0/2426876981 conn(0x55f3365fc4e0 msgr2=0x55f3369afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.793+0000 7f26a81d5740 1 -- 172.21.15.78:0/2426876981 shutdown_connections 2024-09-17T03:14:14.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.793+0000 7f26a81d5740 1 -- 172.21.15.78:0/2426876981 wait complete. 2024-09-17T03:14:14.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.793+0000 7f26a81d5740 1 -- start start 2024-09-17T03:14:14.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.793+0000 7f26a81d5740 1 Processor -- start 2024-09-17T03:14:14.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.795+0000 7f26a81d5740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3365df4d0 0x55f3369c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.795+0000 7f26a81d5740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f3365e76b0 0x55f3369d89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.795+0000 7f26a81d5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f336608390 0x55f3369d8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.795+0000 7f26a81d5740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f336682740 con 0x55f3365df4d0 2024-09-17T03:14:14.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.795+0000 7f26a81d5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f3368b7970 con 0x55f336608390 2024-09-17T03:14:14.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.795+0000 7f26a81d5740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f3369da1c0 con 0x55f3365e76b0 2024-09-17T03:14:14.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.795+0000 7f26a81d5740 10 client.0 _ll_register_callbacks cb 0x55f3368babe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:14.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.795+0000 7f269ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3365df4d0 0x55f3369c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.795+0000 7f269ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3365df4d0 0x55f3369c6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42418/0 (socket says 172.21.15.78:42418) 2024-09-17T03:14:14.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.795+0000 7f269ad9d640 1 -- 172.21.15.78:0/3388170897 learned_addr learned my addr 172.21.15.78:0/3388170897 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:14.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.795+0000 7f269b59e640 1 --2- 172.21.15.78:0/3388170897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f336608390 0x55f3369d8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.795+0000 7f2693fff640 1 --2- 172.21.15.78:0/3388170897 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f3365e76b0 0x55f3369d89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.795+0000 7f269ad9d640 1 -- 172.21.15.78:0/3388170897 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f3365e76b0 msgr2=0x55f3369d89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.795+0000 7f269ad9d640 1 --2- 172.21.15.78:0/3388170897 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f3365e76b0 0x55f3369d89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.795+0000 7f269ad9d640 1 -- 172.21.15.78:0/3388170897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f336608390 msgr2=0x55f3369d8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.795+0000 7f269ad9d640 1 --2- 172.21.15.78:0/3388170897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f336608390 0x55f3369d8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.795+0000 7f269ad9d640 1 -- 172.21.15.78:0/3388170897 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f336673970 con 0x55f3365df4d0 2024-09-17T03:14:14.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.795+0000 7f269ad9d640 1 --2- 172.21.15.78:0/3388170897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3365df4d0 0x55f3369c6f30 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f268c022040 tx=0x7f268c012a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6e917fb66d0c71 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:14.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.795+0000 7f2679ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:14.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.796+0000 7f2679ffb640 1 -- 172.21.15.78:0/3388170897 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268c024050 con 0x55f3365df4d0 2024-09-17T03:14:14.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.796+0000 7f2679ffb640 1 -- 172.21.15.78:0/3388170897 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f268c006da0 con 0x55f3365df4d0 2024-09-17T03:14:14.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.796+0000 7f26a81d5740 1 -- 172.21.15.78:0/3388170897 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f268c012b50 con 0x55f3365df4d0 2024-09-17T03:14:14.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.796+0000 7f2679ffb640 1 -- 172.21.15.78:0/3388170897 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f268c038050 con 0x55f3365df4d0 2024-09-17T03:14:14.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.796+0000 7f26a81d5740 10 client.8001 fetch_fsmap learned FSMap version 85 2024-09-17T03:14:14.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.796+0000 7f26a81d5740 1 -- 172.21.15.78:0/3388170897 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x55f3366516a0 con 0x55f3365df4d0 2024-09-17T03:14:14.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.796+0000 7f2679ffb640 1 -- 172.21.15.78:0/3388170897 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f268c012b50 con 0x55f3365df4d0 2024-09-17T03:14:14.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.796+0000 7f2679ffb640 1 -- 172.21.15.78:0/3388170897 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 85) ==== 3558+0+0 (secure 0 0 0) 0x7f268c03b020 con 0x55f3365df4d0 2024-09-17T03:14:14.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.796+0000 7f26a81d5740 10 client.8001 fetch_fsmap finished waiting for FSMap version 85 2024-09-17T03:14:14.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.796+0000 7f26a81d5740 10 client.8001 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.c 2024-09-17T03:14:14.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.796+0000 7f26a81d5740 20 client.8001 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:14.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.796+0000 7f26a81d5740 1 --2- 172.21.15.78:0/3388170897 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x55f3365c6f60 0x55f336a04460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.796+0000 7f26a81d5740 4 client.8001 mds_command: new command op to 7425 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:14:14.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.796+0000 7f26a81d5740 1 -- 172.21.15.78:0/3388170897 --> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3369249b0 con 0x55f3365c6f60 2024-09-17T03:14:14.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.796+0000 7f2693fff640 1 --2- 172.21.15.78:0/3388170897 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x55f3365c6f60 0x55f336a04460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.796+0000 7f2679ffb640 10 client.8001 ms_handle_connect on v2:172.21.15.78:6834/4018023271 2024-09-17T03:14:14.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.797+0000 7f2693fff640 1 --2- 172.21.15.78:0/3388170897 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x55f3365c6f60 0x55f336a04460 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=223166b729d7fc45 server_cookie=9a69f61b5b93a062 in_seq=0 out_seq=0 2024-09-17T03:14:14.803 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.797+0000 7f2679ffb640 1 -- 172.21.15.78:0/3388170897 <== mds.1 v2:172.21.15.78:6834/4018023271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f3369249b0 con 0x55f3365c6f60 2024-09-17T03:14:14.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.797+0000 7f2679ffb640 10 client.8001 handle_command_reply: tid=0 2024-09-17T03:14:14.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.797+0000 7f26a81d5740 1 client.8001 shutdown 2024-09-17T03:14:14.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.797+0000 7f26a81d5740 1 -- 172.21.15.78:0/3388170897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3365df4d0 msgr2=0x55f3369c6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.797+0000 7f26a81d5740 1 --2- 172.21.15.78:0/3388170897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3365df4d0 0x55f3369c6f30 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f268c022040 tx=0x7f268c012a60 comp rx=0 tx=0).stop 2024-09-17T03:14:14.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.797+0000 7f26a81d5740 1 -- 172.21.15.78:0/3388170897 shutdown_connections 2024-09-17T03:14:14.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.797+0000 7f26a81d5740 1 --2- 172.21.15.78:0/3388170897 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x55f3365c6f60 0x55f336a04460 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.797+0000 7f26a81d5740 1 --2- 172.21.15.78:0/3388170897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f336608390 0x55f3369d8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.797+0000 7f2679ffb640 0 client.8001 ms_handle_reset on v2:172.21.15.78:6834/4018023271 2024-09-17T03:14:14.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.797+0000 7f26a81d5740 1 --2- 172.21.15.78:0/3388170897 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f3365e76b0 0x55f3369d89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.797+0000 7f26a81d5740 1 --2- 172.21.15.78:0/3388170897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3365df4d0 0x55f3369c6f30 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.804 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.797+0000 7f26a81d5740 1 -- 172.21.15.78:0/3388170897 >> 172.21.15.78:0/3388170897 conn(0x55f3365fc4e0 msgr2=0x55f3369f6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.797+0000 7f26a81d5740 1 -- 172.21.15.78:0/3388170897 shutdown_connections 2024-09-17T03:14:14.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.797+0000 7f26a81d5740 1 -- 172.21.15.78:0/3388170897 wait complete. 2024-09-17T03:14:14.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.798+0000 7f26a81d5740 20 client.8001 trim_cache size 0 max 16384 2024-09-17T03:14:14.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.815+0000 7f26a81d5740 1 Processor -- start 2024-09-17T03:14:14.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.815+0000 7f26a81d5740 1 -- start start 2024-09-17T03:14:14.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.816+0000 7f26a81d5740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f3365df4d0 0x55f3369d74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.816+0000 7f26a81d5740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3365e76b0 0x55f3369d7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.816+0000 7f26a81d5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f336608390 0x55f3369c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.816+0000 7f26a81d5740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f269c202670 con 0x55f3365e76b0 2024-09-17T03:14:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.816+0000 7f26a81d5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f269c201810 con 0x55f336608390 2024-09-17T03:14:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.816+0000 7f26a81d5740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f269c201f40 con 0x55f3365df4d0 2024-09-17T03:14:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.816+0000 7f2693fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3365e76b0 0x55f3369d7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.816+0000 7f2693fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3365e76b0 0x55f3369d7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42422/0 (socket says 172.21.15.78:42422) 2024-09-17T03:14:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.816+0000 7f2693fff640 1 -- 172.21.15.78:0/27281156 learned_addr learned my addr 172.21.15.78:0/27281156 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.816+0000 7f2693fff640 1 -- 172.21.15.78:0/27281156 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f3365df4d0 msgr2=0x55f3369d74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.816+0000 7f2693fff640 1 --2- 172.21.15.78:0/27281156 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f3365df4d0 0x55f3369d74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.816+0000 7f269b59e640 1 --2- 172.21.15.78:0/27281156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f336608390 0x55f3369c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.816+0000 7f2693fff640 1 -- 172.21.15.78:0/27281156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f336608390 msgr2=0x55f3369c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.816+0000 7f2693fff640 1 --2- 172.21.15.78:0/27281156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f336608390 0x55f3369c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.817+0000 7f2693fff640 1 -- 172.21.15.78:0/27281156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3369abd80 con 0x55f3365e76b0 2024-09-17T03:14:14.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.817+0000 7f269b59e640 1 --2- 172.21.15.78:0/27281156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f336608390 0x55f3369c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.817+0000 7f2693fff640 1 --2- 172.21.15.78:0/27281156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3365e76b0 0x55f3369d7a20 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f268400be00 tx=0x7f2684011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17dd92f9c842c466 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.817+0000 7f267bfff640 1 -- 172.21.15.78:0/27281156 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268407e070 con 0x55f3365e76b0 2024-09-17T03:14:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.817+0000 7f267bfff640 1 -- 172.21.15.78:0/27281156 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f268406c640 con 0x55f3365e76b0 2024-09-17T03:14:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.817+0000 7f267bfff640 1 -- 172.21.15.78:0/27281156 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268405ef20 con 0x55f3365e76b0 2024-09-17T03:14:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.817+0000 7f26a81d5740 1 -- 172.21.15.78:0/27281156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3365e76b0 msgr2=0x55f3369d7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.817+0000 7f26a81d5740 1 --2- 172.21.15.78:0/27281156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3365e76b0 0x55f3369d7a20 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f268400be00 tx=0x7f2684011f90 comp rx=0 tx=0).stop 2024-09-17T03:14:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.817+0000 7f26a81d5740 1 -- 172.21.15.78:0/27281156 shutdown_connections 2024-09-17T03:14:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.817+0000 7f26a81d5740 1 --2- 172.21.15.78:0/27281156 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f336608390 0x55f3369c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.818+0000 7f26a81d5740 1 --2- 172.21.15.78:0/27281156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f3365e76b0 0x55f3369d7a20 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.818+0000 7f26a81d5740 1 --2- 172.21.15.78:0/27281156 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f3365df4d0 0x55f3369d74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.818+0000 7f26a81d5740 1 -- 172.21.15.78:0/27281156 >> 172.21.15.78:0/27281156 conn(0x55f3365fc4e0 msgr2=0x55f3369a53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.818+0000 7f26a81d5740 1 -- 172.21.15.78:0/27281156 shutdown_connections 2024-09-17T03:14:14.819 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.818+0000 7f26a81d5740 1 -- 172.21.15.78:0/27281156 wait complete. 2024-09-17T03:14:14.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.818+0000 7f26a81d5740 1 -- start start 2024-09-17T03:14:14.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.818+0000 7f26a81d5740 1 Processor -- start 2024-09-17T03:14:14.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f26a81d5740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3365df4d0 0x55f336a73720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f26a81d5740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f3365e76b0 0x55f3369c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f26a81d5740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f336608390 0x55f3369d60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f26a81d5740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f336a06a50 con 0x55f336608390 2024-09-17T03:14:14.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f26a81d5740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f269c1f94f0 con 0x55f3365df4d0 2024-09-17T03:14:14.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f26a81d5740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f336a16720 con 0x55f3365e76b0 2024-09-17T03:14:14.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f26a81d5740 10 client.0 _ll_register_callbacks cb 0x7f268c022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:14.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f269b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f336608390 0x55f3369d60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f269b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f336608390 0x55f3369d60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42436/0 (socket says 172.21.15.78:42436) 2024-09-17T03:14:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f269b59e640 1 -- 172.21.15.78:0/2342385951 learned_addr learned my addr 172.21.15.78:0/2342385951 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f2693fff640 1 --2- 172.21.15.78:0/2342385951 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f3365e76b0 0x55f3369c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f269ad9d640 1 --2- 172.21.15.78:0/2342385951 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3365df4d0 0x55f336a73720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f269b59e640 1 -- 172.21.15.78:0/2342385951 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f3365e76b0 msgr2=0x55f3369c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f269b59e640 1 --2- 172.21.15.78:0/2342385951 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f3365e76b0 0x55f3369c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f269b59e640 1 -- 172.21.15.78:0/2342385951 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3365df4d0 msgr2=0x55f336a73720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f269b59e640 1 --2- 172.21.15.78:0/2342385951 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3365df4d0 0x55f336a73720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f269b59e640 1 -- 172.21.15.78:0/2342385951 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3369d7a80 con 0x55f336608390 2024-09-17T03:14:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f2693fff640 1 --2- 172.21.15.78:0/2342385951 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f3365e76b0 0x55f3369c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f269b59e640 1 --2- 172.21.15.78:0/2342385951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f336608390 0x55f3369d60e0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f269402aea0 tx=0x7f26940041a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1633dc5cf4f9481 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:14.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f2679ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:14.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.820+0000 7f2679ffb640 1 -- 172.21.15.78:0/2342385951 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26940044a0 con 0x55f336608390 2024-09-17T03:14:14.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.821+0000 7f2679ffb640 1 -- 172.21.15.78:0/2342385951 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f2694004640 con 0x55f336608390 2024-09-17T03:14:14.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.821+0000 7f26a81d5740 1 -- 172.21.15.78:0/2342385951 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f268406c640 con 0x55f336608390 2024-09-17T03:14:14.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.821+0000 7f2679ffb640 1 -- 172.21.15.78:0/2342385951 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f2694004840 con 0x55f336608390 2024-09-17T03:14:14.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.821+0000 7f26a81d5740 10 client.8007 fetch_fsmap learned FSMap version 85 2024-09-17T03:14:14.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.821+0000 7f26a81d5740 1 -- 172.21.15.78:0/2342385951 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x55f336a16520 con 0x55f336608390 2024-09-17T03:14:14.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.821+0000 7f2679ffb640 1 -- 172.21.15.78:0/2342385951 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f268406c640 con 0x55f336608390 2024-09-17T03:14:14.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.821+0000 7f2679ffb640 1 -- 172.21.15.78:0/2342385951 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 85) ==== 3558+0+0 (secure 0 0 0) 0x7f269404f050 con 0x55f336608390 2024-09-17T03:14:14.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.821+0000 7f26a81d5740 10 client.8007 fetch_fsmap finished waiting for FSMap version 85 2024-09-17T03:14:14.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.821+0000 7f26a81d5740 10 client.8007 resolve_mds: resolved 6:1 to role '6:1' aka daemon mds.c 2024-09-17T03:14:14.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.821+0000 7f26a81d5740 20 client.8007 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:14.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.821+0000 7f26a81d5740 1 --2- 172.21.15.78:0/2342385951 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x55f336a15fb0 0x55f3369d6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.821+0000 7f26a81d5740 4 client.8007 mds_command: new command op to 7425 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:14:14.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.821+0000 7f26a81d5740 1 -- 172.21.15.78:0/2342385951 --> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f3369f5d00 con 0x55f336a15fb0 2024-09-17T03:14:14.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.821+0000 7f269ad9d640 1 --2- 172.21.15.78:0/2342385951 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x55f336a15fb0 0x55f3369d6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.821+0000 7f2679ffb640 10 client.8007 ms_handle_connect on v2:172.21.15.78:6834/4018023271 2024-09-17T03:14:14.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.821+0000 7f269ad9d640 1 --2- 172.21.15.78:0/2342385951 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x55f336a15fb0 0x55f3369d6620 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2489fde0accded2c server_cookie=9a0480dc53407ec4 in_seq=0 out_seq=0 2024-09-17T03:14:14.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f2679ffb640 1 -- 172.21.15.78:0/2342385951 <== mds.1 v2:172.21.15.78:6834/4018023271 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x55f3369f5d00 con 0x55f336a15fb0 2024-09-17T03:14:14.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f2679ffb640 10 client.8007 handle_command_reply: tid=0 2024-09-17T03:14:14.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a81d5740 1 client.8007 shutdown 2024-09-17T03:14:14.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a81d5740 1 -- 172.21.15.78:0/2342385951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f336608390 msgr2=0x55f3369d60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a81d5740 1 --2- 172.21.15.78:0/2342385951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f336608390 0x55f3369d60e0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f269402aea0 tx=0x7f26940041a0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a81d5740 1 -- 172.21.15.78:0/2342385951 shutdown_connections 2024-09-17T03:14:14.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a81d5740 1 --2- 172.21.15.78:0/2342385951 >> [v2:172.21.15.78:6834/4018023271,v1:172.21.15.78:6835/4018023271] conn(0x55f336a15fb0 0x55f3369d6620 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a81d5740 1 --2- 172.21.15.78:0/2342385951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f336608390 0x55f3369d60e0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a81d5740 1 --2- 172.21.15.78:0/2342385951 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f3365e76b0 0x55f3369c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f2679ffb640 0 client.8007 ms_handle_reset on v2:172.21.15.78:6834/4018023271 2024-09-17T03:14:14.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a81d5740 1 --2- 172.21.15.78:0/2342385951 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f3365df4d0 0x55f336a73720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a81d5740 1 -- 172.21.15.78:0/2342385951 >> 172.21.15.78:0/2342385951 conn(0x55f3365fc4e0 msgr2=0x55f3369a53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a81d5740 1 -- 172.21.15.78:0/2342385951 shutdown_connections 2024-09-17T03:14:14.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a81d5740 1 -- 172.21.15.78:0/2342385951 wait complete. 2024-09-17T03:14:14.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a81d5740 20 client.8007 trim_cache size 0 max 16384 2024-09-17T03:14:14.828 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:14:14.828 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T03:14:14.828 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:14:14.828 INFO:teuthology.orchestra.run.smithi078.stdout: "06dff376-fc02-4326-a75b-2bb8deb474f9": { 2024-09-17T03:14:14.829 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:14:14.829 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "06dff376-fc02-4326-a75b-2bb8deb474f9", 2024-09-17T03:14:14.829 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:14:14.829 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:14.829 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:14.829 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:14:14.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a118b640 1 -- 172.21.15.78:0/3337953394 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f267c078b90 msgr2=0x7f267c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a118b640 1 --2- 172.21.15.78:0/3337953394 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f267c078b90 0x7f267c07b0a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f268c001540 tx=0x7f268c009040 comp rx=0 tx=0).stop 2024-09-17T03:14:14.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a118b640 1 -- 172.21.15.78:0/3337953394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f269c15d670 msgr2=0x7f269c1f5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a118b640 1 --2- 172.21.15.78:0/3337953394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f269c15d670 0x7f269c1f5a80 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f268400b440 tx=0x7f268400b900 comp rx=0 tx=0).stop 2024-09-17T03:14:14.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a118b640 1 -- 172.21.15.78:0/3337953394 shutdown_connections 2024-09-17T03:14:14.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a118b640 1 --2- 172.21.15.78:0/3337953394 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f267c078b90 0x7f267c07b0a0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a118b640 1 --2- 172.21.15.78:0/3337953394 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f269c1554b0 0x7f269c14a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a118b640 1 --2- 172.21.15.78:0/3337953394 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f269c15d670 0x7f269c1f5a80 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.822+0000 7f26a118b640 1 --2- 172.21.15.78:0/3337953394 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f269c1570e0 0x7f269c0c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.823+0000 7f26a118b640 1 -- 172.21.15.78:0/3337953394 >> 172.21.15.78:0/3337953394 conn(0x7f269c06d550 msgr2=0x7f269c156760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.823+0000 7f26a118b640 1 -- 172.21.15.78:0/3337953394 shutdown_connections 2024-09-17T03:14:14.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.823+0000 7f26a118b640 1 -- 172.21.15.78:0/3337953394 wait complete. 2024-09-17T03:14:14.832 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:14:14.832 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:14:14.832 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.6:2 scrub status 2024-09-17T03:14:14.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.948+0000 7f940b24d640 1 -- 172.21.15.78:0/3678928668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f940415c6f0 msgr2=0x7f94040ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.948+0000 7f940b24d640 1 --2- 172.21.15.78:0/3678928668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f940415c6f0 0x7f94040ceb50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009830 tx=0x7f93f402a510 comp rx=0 tx=0).stop 2024-09-17T03:14:14.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.948+0000 7f940b24d640 1 -- 172.21.15.78:0/3678928668 shutdown_connections 2024-09-17T03:14:14.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.948+0000 7f940b24d640 1 --2- 172.21.15.78:0/3678928668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f940415c6f0 0x7f94040ceb50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.948+0000 7f940b24d640 1 --2- 172.21.15.78:0/3678928668 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f94040d1d40 0x7f94040b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.948+0000 7f940b24d640 1 -- 172.21.15.78:0/3678928668 >> 172.21.15.78:0/3678928668 conn(0x7f94040b3f10 msgr2=0x7f94040b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.948+0000 7f940b24d640 1 -- 172.21.15.78:0/3678928668 shutdown_connections 2024-09-17T03:14:14.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.948+0000 7f940b24d640 1 -- 172.21.15.78:0/3678928668 wait complete. 2024-09-17T03:14:14.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.950+0000 7f940b24d640 1 Processor -- start 2024-09-17T03:14:14.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.950+0000 7f940b24d640 1 -- start start 2024-09-17T03:14:14.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f940b24d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94040ccba0 0x7f94040cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f940b24d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f94040d1d40 0x7f94040b0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f940b24d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f940415c6f0 0x7f940414b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f940b24d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f94040d12d0 con 0x7f940415c6f0 2024-09-17T03:14:14.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f940b24d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f94040d1150 con 0x7f94040ccba0 2024-09-17T03:14:14.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f940b24d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f94040d1450 con 0x7f94040d1d40 2024-09-17T03:14:14.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f94097ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f940415c6f0 0x7f940414b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f94097ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f940415c6f0 0x7f940414b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42438/0 (socket says 172.21.15.78:42438) 2024-09-17T03:14:14.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f94097ea640 1 -- 172.21.15.78:0/536588434 learned_addr learned my addr 172.21.15.78:0/536588434 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:14.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f9408fe9640 1 --2- 172.21.15.78:0/536588434 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94040ccba0 0x7f94040cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f93fbfff640 1 --2- 172.21.15.78:0/536588434 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f94040d1d40 0x7f94040b0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f94097ea640 1 -- 172.21.15.78:0/536588434 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f94040d1d40 msgr2=0x7f94040b0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f94097ea640 1 --2- 172.21.15.78:0/536588434 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f94040d1d40 0x7f94040b0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f94097ea640 1 -- 172.21.15.78:0/536588434 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94040ccba0 msgr2=0x7f94040cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f94097ea640 1 --2- 172.21.15.78:0/536588434 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94040ccba0 0x7f94040cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f94097ea640 1 -- 172.21.15.78:0/536588434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94040ca7f0 con 0x7f940415c6f0 2024-09-17T03:14:14.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f94097ea640 1 --2- 172.21.15.78:0/536588434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f940415c6f0 0x7f940414b6b0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00cae0 tx=0x7f93fc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:14.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f93f97fa640 1 -- 172.21.15.78:0/536588434 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc016020 con 0x7f940415c6f0 2024-09-17T03:14:14.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f93f97fa640 1 -- 172.21.15.78:0/536588434 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93fc00acd0 con 0x7f940415c6f0 2024-09-17T03:14:14.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f940b24d640 1 -- 172.21.15.78:0/536588434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94040caad0 con 0x7f940415c6f0 2024-09-17T03:14:14.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f93f97fa640 1 -- 172.21.15.78:0/536588434 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc012680 con 0x7f940415c6f0 2024-09-17T03:14:14.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.952+0000 7f940b24d640 1 -- 172.21.15.78:0/536588434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94040cb090 con 0x7f940415c6f0 2024-09-17T03:14:14.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.954+0000 7f93f97fa640 1 -- 172.21.15.78:0/536588434 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f93fc019020 con 0x7f940415c6f0 2024-09-17T03:14:14.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.955+0000 7f93f97fa640 1 --2- 172.21.15.78:0/536588434 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f93f0078bc0 0x7f93f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.955+0000 7f93f97fa640 1 -- 172.21.15.78:0/536588434 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f93fc09ae50 con 0x7f940415c6f0 2024-09-17T03:14:14.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.955+0000 7f9408fe9640 1 --2- 172.21.15.78:0/536588434 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f93f0078bc0 0x7f93f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.956+0000 7f94121c7740 1 Processor -- start 2024-09-17T03:14:14.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.956+0000 7f9408fe9640 1 --2- 172.21.15.78:0/536588434 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f93f0078bc0 0x7f93f007b0d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f94000095f0 tx=0x7f9400005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:14.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.956+0000 7f94121c7740 1 -- start start 2024-09-17T03:14:14.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.957+0000 7f94121c7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb75390 0x55771ef61a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.957+0000 7f94121c7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb4c4d0 0x55771ef36860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.957+0000 7f94121c7740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55771eb546b0 0x55771ef36da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.957+0000 7f94121c7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55771ee8fa60 con 0x55771eb4c4d0 2024-09-17T03:14:14.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.957+0000 7f94121c7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55771ee7ee90 con 0x55771eb75390 2024-09-17T03:14:14.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.957+0000 7f94121c7740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55771ee82ca0 con 0x55771eb546b0 2024-09-17T03:14:14.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.957+0000 7f93fbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb4c4d0 0x55771ef36860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.957+0000 7f93fbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb4c4d0 0x55771ef36860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42454/0 (socket says 172.21.15.78:42454) 2024-09-17T03:14:14.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.957+0000 7f93fbfff640 1 -- 172.21.15.78:0/2221466883 learned_addr learned my addr 172.21.15.78:0/2221466883 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:14.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.957+0000 7f9408fe9640 1 --2- 172.21.15.78:0/2221466883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb75390 0x55771ef61a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.957+0000 7f94097ea640 1 --2- 172.21.15.78:0/2221466883 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55771eb546b0 0x55771ef36da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.957+0000 7f93fbfff640 1 -- 172.21.15.78:0/2221466883 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55771eb546b0 msgr2=0x55771ef36da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.957+0000 7f93fbfff640 1 --2- 172.21.15.78:0/2221466883 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55771eb546b0 0x55771ef36da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.957+0000 7f93fbfff640 1 -- 172.21.15.78:0/2221466883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb75390 msgr2=0x55771ef61a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.957+0000 7f93fbfff640 1 --2- 172.21.15.78:0/2221466883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb75390 0x55771ef61a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.957+0000 7f93fbfff640 1 -- 172.21.15.78:0/2221466883 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55771ec577d0 con 0x55771eb4c4d0 2024-09-17T03:14:14.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.957+0000 7f93fbfff640 1 --2- 172.21.15.78:0/2221466883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb4c4d0 0x55771ef36860 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f93f402ab00 tx=0x7f93f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e60a047f9f3f018 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:14.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.957+0000 7f93ea7fc640 1 -- 172.21.15.78:0/2221466883 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4004340 con 0x55771eb4c4d0 2024-09-17T03:14:14.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.958+0000 7f93ea7fc640 1 -- 172.21.15.78:0/2221466883 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93f4005020 con 0x55771eb4c4d0 2024-09-17T03:14:14.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.958+0000 7f93ea7fc640 1 -- 172.21.15.78:0/2221466883 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f40053f0 con 0x55771eb4c4d0 2024-09-17T03:14:14.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.958+0000 7f94121c7740 1 -- 172.21.15.78:0/2221466883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb4c4d0 msgr2=0x55771ef36860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.958+0000 7f94121c7740 1 --2- 172.21.15.78:0/2221466883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb4c4d0 0x55771ef36860 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f93f402ab00 tx=0x7f93f40046c0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.958+0000 7f94121c7740 1 -- 172.21.15.78:0/2221466883 shutdown_connections 2024-09-17T03:14:14.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.958+0000 7f94121c7740 1 --2- 172.21.15.78:0/2221466883 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55771eb546b0 0x55771ef36da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.958+0000 7f94121c7740 1 --2- 172.21.15.78:0/2221466883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb4c4d0 0x55771ef36860 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.958+0000 7f94121c7740 1 --2- 172.21.15.78:0/2221466883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb75390 0x55771ef61a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.958+0000 7f94121c7740 1 -- 172.21.15.78:0/2221466883 >> 172.21.15.78:0/2221466883 conn(0x55771eb694e0 msgr2=0x55771ef1cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.958+0000 7f94121c7740 1 -- 172.21.15.78:0/2221466883 shutdown_connections 2024-09-17T03:14:14.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.958+0000 7f94121c7740 1 -- 172.21.15.78:0/2221466883 wait complete. 2024-09-17T03:14:14.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.959+0000 7f94121c7740 1 -- start start 2024-09-17T03:14:14.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.959+0000 7f94121c7740 1 Processor -- start 2024-09-17T03:14:14.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f94121c7740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55771eb4c4d0 0x55771ef73fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f94121c7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb546b0 0x55771ef353a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f94121c7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb75390 0x55771ef5e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f94121c7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55771ebef740 con 0x55771eb75390 2024-09-17T03:14:14.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f94121c7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55771ee24970 con 0x55771eb546b0 2024-09-17T03:14:14.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f94121c7740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55771ef5dd30 con 0x55771eb4c4d0 2024-09-17T03:14:14.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f94121c7740 10 client.0 _ll_register_callbacks cb 0x55771ee33780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:14.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f94097ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb75390 0x55771ef5e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f94097ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb75390 0x55771ef5e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42456/0 (socket says 172.21.15.78:42456) 2024-09-17T03:14:14.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f94097ea640 1 -- 172.21.15.78:0/3356844730 learned_addr learned my addr 172.21.15.78:0/3356844730 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:14.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f93fbfff640 1 --2- 172.21.15.78:0/3356844730 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb546b0 0x55771ef353a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f9408fe9640 1 --2- 172.21.15.78:0/3356844730 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55771eb4c4d0 0x55771ef73fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f94097ea640 1 -- 172.21.15.78:0/3356844730 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55771eb4c4d0 msgr2=0x55771ef73fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f94097ea640 1 --2- 172.21.15.78:0/3356844730 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55771eb4c4d0 0x55771ef73fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f94097ea640 1 -- 172.21.15.78:0/3356844730 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb546b0 msgr2=0x55771ef353a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f94097ea640 1 --2- 172.21.15.78:0/3356844730 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb546b0 0x55771ef353a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f94097ea640 1 -- 172.21.15.78:0/3356844730 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55771ebe0970 con 0x55771eb75390 2024-09-17T03:14:14.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f94097ea640 1 --2- 172.21.15.78:0/3356844730 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb75390 0x55771ef5e340 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0992b0 tx=0x7f93fc05f240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9275c30c990d657 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:14.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f93e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:14.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f93e37fe640 1 -- 172.21.15.78:0/3356844730 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc067750 con 0x55771eb75390 2024-09-17T03:14:14.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f93e37fe640 1 -- 172.21.15.78:0/3356844730 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f93fc061f80 con 0x55771eb75390 2024-09-17T03:14:14.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.961+0000 7f94121c7740 1 -- 172.21.15.78:0/3356844730 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93f4005020 con 0x55771eb75390 2024-09-17T03:14:14.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.962+0000 7f93e37fe640 1 -- 172.21.15.78:0/3356844730 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f93fc06c600 con 0x55771eb75390 2024-09-17T03:14:14.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.962+0000 7f94121c7740 10 client.8016 fetch_fsmap learned FSMap version 85 2024-09-17T03:14:14.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.962+0000 7f94121c7740 1 -- 172.21.15.78:0/3356844730 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x55771ebbe6a0 con 0x55771eb75390 2024-09-17T03:14:14.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.962+0000 7f93e37fe640 1 -- 172.21.15.78:0/3356844730 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93f4005020 con 0x55771eb75390 2024-09-17T03:14:14.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.962+0000 7f93e37fe640 1 -- 172.21.15.78:0/3356844730 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 85) ==== 3558+0+0 (secure 0 0 0) 0x7f93fc05e670 con 0x55771eb75390 2024-09-17T03:14:14.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.962+0000 7f94121c7740 10 client.8016 fetch_fsmap finished waiting for FSMap version 85 2024-09-17T03:14:14.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.962+0000 7f94121c7740 10 client.8016 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2024-09-17T03:14:14.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.962+0000 7f94121c7740 20 client.8016 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:14.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.962+0000 7f94121c7740 1 --2- 172.21.15.78:0/3356844730 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x55771eb33f60 0x55771ef44620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.962+0000 7f94121c7740 4 client.8016 mds_command: new command op to 6640 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:14:14.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.962+0000 7f94121c7740 1 -- 172.21.15.78:0/3356844730 --> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55771ee919b0 con 0x55771eb33f60 2024-09-17T03:14:14.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.962+0000 7f9408fe9640 1 --2- 172.21.15.78:0/3356844730 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x55771eb33f60 0x55771ef44620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.963+0000 7f9408fe9640 1 --2- 172.21.15.78:0/3356844730 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x55771eb33f60 0x55771ef44620 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cd34c47751cd5406 server_cookie=93733075911a8541 in_seq=0 out_seq=0 2024-09-17T03:14:14.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.963+0000 7f93e37fe640 10 client.8016 ms_handle_connect on v2:172.21.15.193:6835/1005450673 2024-09-17T03:14:14.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.963+0000 7f93e37fe640 1 -- 172.21.15.78:0/3356844730 <== mds.2 v2:172.21.15.193:6835/1005450673 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55771ee919b0 con 0x55771eb33f60 2024-09-17T03:14:14.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.963+0000 7f93e37fe640 10 client.8016 handle_command_reply: tid=0 2024-09-17T03:14:14.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.963+0000 7f94121c7740 1 client.8016 shutdown 2024-09-17T03:14:14.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.964+0000 7f94121c7740 1 -- 172.21.15.78:0/3356844730 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb75390 msgr2=0x55771ef5e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.964+0000 7f94121c7740 1 --2- 172.21.15.78:0/3356844730 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb75390 0x55771ef5e340 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f93fc0992b0 tx=0x7f93fc05f240 comp rx=0 tx=0).stop 2024-09-17T03:14:14.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.964+0000 7f94121c7740 1 -- 172.21.15.78:0/3356844730 shutdown_connections 2024-09-17T03:14:14.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.964+0000 7f94121c7740 1 --2- 172.21.15.78:0/3356844730 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x55771eb33f60 0x55771ef44620 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.964+0000 7f94121c7740 1 --2- 172.21.15.78:0/3356844730 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb75390 0x55771ef5e340 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.964+0000 7f94121c7740 1 --2- 172.21.15.78:0/3356844730 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb546b0 0x55771ef353a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.964+0000 7f94121c7740 1 --2- 172.21.15.78:0/3356844730 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55771eb4c4d0 0x55771ef73fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.964+0000 7f93e37fe640 0 client.8016 ms_handle_reset on v2:172.21.15.193:6835/1005450673 2024-09-17T03:14:14.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.964+0000 7f94121c7740 1 -- 172.21.15.78:0/3356844730 >> 172.21.15.78:0/3356844730 conn(0x55771eb694e0 msgr2=0x55771ef17a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.964+0000 7f94121c7740 1 -- 172.21.15.78:0/3356844730 shutdown_connections 2024-09-17T03:14:14.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.964+0000 7f94121c7740 1 -- 172.21.15.78:0/3356844730 wait complete. 2024-09-17T03:14:14.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.964+0000 7f94121c7740 20 client.8016 trim_cache size 0 max 16384 2024-09-17T03:14:14.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.981+0000 7f94121c7740 1 Processor -- start 2024-09-17T03:14:14.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.981+0000 7f94121c7740 1 -- start start 2024-09-17T03:14:14.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.982+0000 7f94121c7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb4c4d0 0x55771ef5e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.982+0000 7f94121c7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb546b0 0x55771ef5af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.982+0000 7f94121c7740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55771eb75390 0x55771ef5b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.982+0000 7f94121c7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55771ef1ce60 con 0x55771eb4c4d0 2024-09-17T03:14:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.982+0000 7f94121c7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f94041ffe50 con 0x55771eb546b0 2024-09-17T03:14:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.982+0000 7f94121c7740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f94041feff0 con 0x55771eb75390 2024-09-17T03:14:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.983+0000 7f9408fe9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb4c4d0 0x55771ef5e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.983+0000 7f9408fe9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb4c4d0 0x55771ef5e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42458/0 (socket says 172.21.15.78:42458) 2024-09-17T03:14:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.983+0000 7f9408fe9640 1 -- 172.21.15.78:0/3753646876 learned_addr learned my addr 172.21.15.78:0/3753646876 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.983+0000 7f9408fe9640 1 -- 172.21.15.78:0/3753646876 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55771eb75390 msgr2=0x55771ef5b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.983+0000 7f9408fe9640 1 --2- 172.21.15.78:0/3753646876 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55771eb75390 0x55771ef5b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.983+0000 7f9408fe9640 1 -- 172.21.15.78:0/3753646876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb546b0 msgr2=0x55771ef5af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.983+0000 7f93fbfff640 1 --2- 172.21.15.78:0/3753646876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb546b0 0x55771ef5af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.983+0000 7f9408fe9640 1 --2- 172.21.15.78:0/3753646876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb546b0 0x55771ef5af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.983+0000 7f9408fe9640 1 -- 172.21.15.78:0/3753646876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55771ef73940 con 0x55771eb4c4d0 2024-09-17T03:14:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.983+0000 7f93fbfff640 1 --2- 172.21.15.78:0/3753646876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb546b0 0x55771ef5af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.983+0000 7f9408fe9640 1 --2- 172.21.15.78:0/3753646876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb4c4d0 0x55771ef5e0c0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f9400009fd0 tx=0x7f9400014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26650e764f9d3aca server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.983+0000 7f93e9ffb640 1 -- 172.21.15.78:0/3753646876 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9400004050 con 0x55771eb4c4d0 2024-09-17T03:14:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.983+0000 7f93e9ffb640 1 -- 172.21.15.78:0/3753646876 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94000041f0 con 0x55771eb4c4d0 2024-09-17T03:14:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.983+0000 7f93e9ffb640 1 -- 172.21.15.78:0/3753646876 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94000035f0 con 0x55771eb4c4d0 2024-09-17T03:14:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.984+0000 7f94121c7740 1 -- 172.21.15.78:0/3753646876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb4c4d0 msgr2=0x55771ef5e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.984+0000 7f94121c7740 1 --2- 172.21.15.78:0/3753646876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb4c4d0 0x55771ef5e0c0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f9400009fd0 tx=0x7f9400014000 comp rx=0 tx=0).stop 2024-09-17T03:14:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.984+0000 7f94121c7740 1 -- 172.21.15.78:0/3753646876 shutdown_connections 2024-09-17T03:14:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.984+0000 7f94121c7740 1 --2- 172.21.15.78:0/3753646876 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55771eb75390 0x55771ef5b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.984+0000 7f94121c7740 1 --2- 172.21.15.78:0/3753646876 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb546b0 0x55771ef5af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.984+0000 7f94121c7740 1 --2- 172.21.15.78:0/3753646876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb4c4d0 0x55771ef5e0c0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.984+0000 7f94121c7740 1 -- 172.21.15.78:0/3753646876 >> 172.21.15.78:0/3753646876 conn(0x55771eb694e0 msgr2=0x55771ef124f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.984+0000 7f94121c7740 1 -- 172.21.15.78:0/3753646876 shutdown_connections 2024-09-17T03:14:14.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.984+0000 7f94121c7740 1 -- 172.21.15.78:0/3753646876 wait complete. 2024-09-17T03:14:14.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.985+0000 7f94121c7740 1 -- start start 2024-09-17T03:14:14.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.985+0000 7f94121c7740 1 Processor -- start 2024-09-17T03:14:14.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.986+0000 7f94121c7740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb4c4d0 0x55771efdb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.986+0000 7f94121c7740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb546b0 0x55771efe8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.986+0000 7f94121c7740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55771eb75390 0x55771ef36a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.986+0000 7f94121c7740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f94041f6e40 con 0x55771eb546b0 2024-09-17T03:14:14.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.986+0000 7f94121c7740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f94041ff720 con 0x55771eb4c4d0 2024-09-17T03:14:14.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.986+0000 7f94121c7740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55771efe8e10 con 0x55771eb75390 2024-09-17T03:14:14.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.986+0000 7f94121c7740 10 client.0 _ll_register_callbacks cb 0x7f93fc001b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:14.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.986+0000 7f93fbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb546b0 0x55771efe8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.986+0000 7f93fbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb546b0 0x55771efe8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42460/0 (socket says 172.21.15.78:42460) 2024-09-17T03:14:14.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.986+0000 7f93fbfff640 1 -- 172.21.15.78:0/362138802 learned_addr learned my addr 172.21.15.78:0/362138802 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:14.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.986+0000 7f9408fe9640 1 --2- 172.21.15.78:0/362138802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb4c4d0 0x55771efdb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.986+0000 7f94097ea640 1 --2- 172.21.15.78:0/362138802 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55771eb75390 0x55771ef36a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f93fbfff640 1 -- 172.21.15.78:0/362138802 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55771eb75390 msgr2=0x55771ef36a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f93fbfff640 1 --2- 172.21.15.78:0/362138802 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55771eb75390 0x55771ef36a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f93fbfff640 1 -- 172.21.15.78:0/362138802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb4c4d0 msgr2=0x55771efdb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:14.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f93fbfff640 1 --2- 172.21.15.78:0/362138802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb4c4d0 0x55771efdb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f93fbfff640 1 -- 172.21.15.78:0/362138802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55771ef837e0 con 0x55771eb546b0 2024-09-17T03:14:14.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f9408fe9640 1 --2- 172.21.15.78:0/362138802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb4c4d0 0x55771efdb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:14.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f93fbfff640 1 --2- 172.21.15.78:0/362138802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb546b0 0x55771efe8400 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009830 tx=0x7f93f40039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a661c83fa1bf18b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:14.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f93e37fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:14.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f93e37fe640 1 -- 172.21.15.78:0/362138802 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4003d40 con 0x55771eb546b0 2024-09-17T03:14:14.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f93e37fe640 1 -- 172.21.15.78:0/362138802 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f93f4005020 con 0x55771eb546b0 2024-09-17T03:14:14.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f94121c7740 1 -- 172.21.15.78:0/362138802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94000041f0 con 0x55771eb546b0 2024-09-17T03:14:14.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f93e37fe640 1 -- 172.21.15.78:0/362138802 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f93f4005220 con 0x55771eb546b0 2024-09-17T03:14:14.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f94121c7740 10 client.8022 fetch_fsmap learned FSMap version 85 2024-09-17T03:14:14.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f94121c7740 1 -- 172.21.15.78:0/362138802 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x55771efe8b50 con 0x55771eb546b0 2024-09-17T03:14:14.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f93e37fe640 1 -- 172.21.15.78:0/362138802 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94000041f0 con 0x55771eb546b0 2024-09-17T03:14:14.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f93e37fe640 1 -- 172.21.15.78:0/362138802 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 85) ==== 3558+0+0 (secure 0 0 0) 0x7f93f4043030 con 0x55771eb546b0 2024-09-17T03:14:14.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f94121c7740 10 client.8022 fetch_fsmap finished waiting for FSMap version 85 2024-09-17T03:14:14.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f94121c7740 10 client.8022 resolve_mds: resolved 6:2 to role '6:2' aka daemon mds.d 2024-09-17T03:14:14.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f94121c7740 20 client.8022 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:14.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f94121c7740 1 --2- 172.21.15.78:0/362138802 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x55771ef124f0 0x55771ef44980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:14.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f94121c7740 4 client.8022 mds_command: new command op to 6640 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:14:14.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.987+0000 7f94121c7740 1 -- 172.21.15.78:0/362138802 --> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55771ee8d460 con 0x55771ef124f0 2024-09-17T03:14:14.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.988+0000 7f9408fe9640 1 --2- 172.21.15.78:0/362138802 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x55771ef124f0 0x55771ef44980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:14.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.988+0000 7f93e37fe640 10 client.8022 ms_handle_connect on v2:172.21.15.193:6835/1005450673 2024-09-17T03:14:14.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.988+0000 7f9408fe9640 1 --2- 172.21.15.78:0/362138802 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x55771ef124f0 0x55771ef44980 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=45751a09802db117 server_cookie=571e5cb5b8394e92 in_seq=0 out_seq=0 2024-09-17T03:14:14.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.988+0000 7f93e37fe640 1 -- 172.21.15.78:0/362138802 <== mds.2 v2:172.21.15.193:6835/1005450673 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x55771ee8d460 con 0x55771ef124f0 2024-09-17T03:14:14.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.988+0000 7f93e37fe640 10 client.8022 handle_command_reply: tid=0 2024-09-17T03:14:14.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.988+0000 7f94121c7740 1 client.8022 shutdown 2024-09-17T03:14:14.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.988+0000 7f94121c7740 1 -- 172.21.15.78:0/362138802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb546b0 msgr2=0x55771efe8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.988+0000 7f94121c7740 1 --2- 172.21.15.78:0/362138802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb546b0 0x55771efe8400 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009830 tx=0x7f93f40039c0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.988+0000 7f94121c7740 1 -- 172.21.15.78:0/362138802 shutdown_connections 2024-09-17T03:14:14.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.988+0000 7f94121c7740 1 --2- 172.21.15.78:0/362138802 >> [v2:172.21.15.193:6835/1005450673,v1:172.21.15.193:6837/1005450673] conn(0x55771ef124f0 0x55771ef44980 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.988+0000 7f94121c7740 1 --2- 172.21.15.78:0/362138802 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55771eb75390 0x55771ef36a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.988+0000 7f93e37fe640 0 client.8022 ms_handle_reset on v2:172.21.15.193:6835/1005450673 2024-09-17T03:14:14.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.988+0000 7f94121c7740 1 --2- 172.21.15.78:0/362138802 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55771eb546b0 0x55771efe8400 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.988+0000 7f94121c7740 1 --2- 172.21.15.78:0/362138802 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55771eb4c4d0 0x55771efdb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.988+0000 7f94121c7740 1 -- 172.21.15.78:0/362138802 >> 172.21.15.78:0/362138802 conn(0x55771eb694e0 msgr2=0x55771ef64720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.989+0000 7f94121c7740 1 -- 172.21.15.78:0/362138802 shutdown_connections 2024-09-17T03:14:14.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.989+0000 7f94121c7740 1 -- 172.21.15.78:0/362138802 wait complete. 2024-09-17T03:14:14.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.989+0000 7f94121c7740 20 client.8022 trim_cache size 0 max 16384 2024-09-17T03:14:14.993 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:14:14.993 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T03:14:14.993 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:14:14.993 INFO:teuthology.orchestra.run.smithi078.stdout: "06dff376-fc02-4326-a75b-2bb8deb474f9": { 2024-09-17T03:14:14.993 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:14:14.993 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "06dff376-fc02-4326-a75b-2bb8deb474f9", 2024-09-17T03:14:14.993 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:14:14.993 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:14.993 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:14.993 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:14:14.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.989+0000 7f940b24d640 1 -- 172.21.15.78:0/536588434 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f93f0078bc0 msgr2=0x7f93f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.989+0000 7f940b24d640 1 --2- 172.21.15.78:0/536588434 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f93f0078bc0 0x7f93f007b0d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f94000095f0 tx=0x7f9400005f90 comp rx=0 tx=0).stop 2024-09-17T03:14:14.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.989+0000 7f940b24d640 1 -- 172.21.15.78:0/536588434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f940415c6f0 msgr2=0x7f940414b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:14.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.989+0000 7f940b24d640 1 --2- 172.21.15.78:0/536588434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f940415c6f0 0x7f940414b6b0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00cae0 tx=0x7f93fc00a060 comp rx=0 tx=0).stop 2024-09-17T03:14:14.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.989+0000 7f940b24d640 1 -- 172.21.15.78:0/536588434 shutdown_connections 2024-09-17T03:14:14.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.989+0000 7f940b24d640 1 --2- 172.21.15.78:0/536588434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f940415c6f0 0x7f940414b6b0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.989+0000 7f940b24d640 1 --2- 172.21.15.78:0/536588434 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f94040d1d40 0x7f94040b0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.989+0000 7f940b24d640 1 --2- 172.21.15.78:0/536588434 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f93f0078bc0 0x7f93f007b0d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.989+0000 7f940b24d640 1 --2- 172.21.15.78:0/536588434 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f94040ccba0 0x7f94040cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:14.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.989+0000 7f940b24d640 1 -- 172.21.15.78:0/536588434 >> 172.21.15.78:0/536588434 conn(0x7f94040b3f10 msgr2=0x7f940415bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:14.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.989+0000 7f940b24d640 1 -- 172.21.15.78:0/536588434 shutdown_connections 2024-09-17T03:14:14.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:14.989+0000 7f940b24d640 1 -- 172.21.15.78:0/536588434 wait complete. 2024-09-17T03:14:14.999 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:14:14.999 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:14:14.999 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.6:0 scrub status 2024-09-17T03:14:15.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.115+0000 7f5f734f9640 1 -- 172.21.15.78:0/3460879898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f58003a00 msgr2=0x7f5f58003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.115+0000 7f5f734f9640 1 --2- 172.21.15.78:0/3460879898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f58003a00 0x7f5f58003e70 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009b50 tx=0x7f5f58005830 comp rx=0 tx=0).stop 2024-09-17T03:14:15.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.115+0000 7f5f71a96640 1 -- 172.21.15.78:0/3460879898 reap_dead start 2024-09-17T03:14:15.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.115+0000 7f5f734f9640 1 -- 172.21.15.78:0/3460879898 shutdown_connections 2024-09-17T03:14:15.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.115+0000 7f5f734f9640 1 -- 172.21.15.78:0/3460879898 >> 172.21.15.78:0/3460879898 conn(0x7f5f6c0cdcc0 msgr2=0x7f5f6c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:15.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.116+0000 7f5f734f9640 1 -- 172.21.15.78:0/3460879898 shutdown_connections 2024-09-17T03:14:15.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.116+0000 7f5f734f9640 1 -- 172.21.15.78:0/3460879898 wait complete. 2024-09-17T03:14:15.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.117+0000 7f5f734f9640 1 Processor -- start 2024-09-17T03:14:15.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.117+0000 7f5f734f9640 1 -- start start 2024-09-17T03:14:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f734f9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f58003a00 0x7f5f6c1578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f734f9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f6c152860 0x7f5f6c151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f734f9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f6c1f2840 0x7f5f6c1f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f734f9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6c0b38e0 con 0x7f5f6c152860 2024-09-17T03:14:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f734f9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6c0b3760 con 0x7f5f6c1f2840 2024-09-17T03:14:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f734f9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5f6c1f3380 con 0x7f5f58003a00 2024-09-17T03:14:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f70a94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f6c152860 0x7f5f6c151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f70a94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f6c152860 0x7f5f6c151fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42466/0 (socket says 172.21.15.78:42466) 2024-09-17T03:14:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f70a94640 1 -- 172.21.15.78:0/2972509168 learned_addr learned my addr 172.21.15.78:0/2972509168 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f71295640 1 --2- 172.21.15.78:0/2972509168 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f58003a00 0x7f5f6c1578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f71a96640 1 --2- 172.21.15.78:0/2972509168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f6c1f2840 0x7f5f6c1f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f70a94640 1 -- 172.21.15.78:0/2972509168 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f58003a00 msgr2=0x7f5f6c1578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f70a94640 1 --2- 172.21.15.78:0/2972509168 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f58003a00 0x7f5f6c1578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f70a94640 1 -- 172.21.15.78:0/2972509168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f6c1f2840 msgr2=0x7f5f6c1f2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f70a94640 1 --2- 172.21.15.78:0/2972509168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f6c1f2840 0x7f5f6c1f2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f70a94640 1 -- 172.21.15.78:0/2972509168 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f6c1f3190 con 0x7f5f6c152860 2024-09-17T03:14:15.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f70a94640 1 --2- 172.21.15.78:0/2972509168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f6c152860 0x7f5f6c151fb0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c00e710 tx=0x7f5f5c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:15.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f61ffb640 1 -- 172.21.15.78:0/2972509168 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c01c070 con 0x7f5f6c152860 2024-09-17T03:14:15.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f61ffb640 1 -- 172.21.15.78:0/2972509168 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f5c00ee20 con 0x7f5f6c152860 2024-09-17T03:14:15.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f734f9640 1 -- 172.21.15.78:0/2972509168 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f6c156850 con 0x7f5f6c152860 2024-09-17T03:14:15.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.119+0000 7f5f61ffb640 1 -- 172.21.15.78:0/2972509168 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c00abd0 con 0x7f5f6c152860 2024-09-17T03:14:15.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.120+0000 7f5f734f9640 1 -- 172.21.15.78:0/2972509168 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f6c156e10 con 0x7f5f6c152860 2024-09-17T03:14:15.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.121+0000 7f5f61ffb640 1 -- 172.21.15.78:0/2972509168 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5f5c01f070 con 0x7f5f6c152860 2024-09-17T03:14:15.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.122+0000 7f5f61ffb640 1 --2- 172.21.15.78:0/2972509168 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5f50078b90 0x7f5f5007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.122+0000 7f5f61ffb640 1 -- 172.21.15.78:0/2972509168 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f5f5c09c430 con 0x7f5f6c152860 2024-09-17T03:14:15.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.122+0000 7f5f71295640 1 --2- 172.21.15.78:0/2972509168 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5f50078b90 0x7f5f5007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.123+0000 7f5f71295640 1 --2- 172.21.15.78:0/2972509168 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5f50078b90 0x7f5f5007b0a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009b50 tx=0x7f5f6802d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:15.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.123+0000 7f5f7a46d740 1 Processor -- start 2024-09-17T03:14:15.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.123+0000 7f5f7a46d740 1 -- start start 2024-09-17T03:14:15.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.124+0000 7f5f7a46d740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55dfca3fb390 0x55dfca7e7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.124+0000 7f5f7a46d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3d24d0 0x55dfca7bc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.124+0000 7f5f7a46d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7bcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.124+0000 7f5f7a46d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55dfca715a60 con 0x55dfca3da6b0 2024-09-17T03:14:15.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.124+0000 7f5f7a46d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55dfca704e90 con 0x55dfca3d24d0 2024-09-17T03:14:15.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.124+0000 7f5f7a46d740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55dfca708ca0 con 0x55dfca3fb390 2024-09-17T03:14:15.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.124+0000 7f5f71a96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7bcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.124+0000 7f5f71a96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7bcda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42480/0 (socket says 172.21.15.78:42480) 2024-09-17T03:14:15.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.124+0000 7f5f71a96640 1 -- 172.21.15.78:0/255376905 learned_addr learned my addr 172.21.15.78:0/255376905 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:15.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.125+0000 7f5f71295640 1 --2- 172.21.15.78:0/255376905 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55dfca3fb390 0x55dfca7e7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.125+0000 7f5f70a94640 1 --2- 172.21.15.78:0/255376905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3d24d0 0x55dfca7bc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.125+0000 7f5f71a96640 1 -- 172.21.15.78:0/255376905 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55dfca3fb390 msgr2=0x55dfca7e7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:15.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.125+0000 7f5f71a96640 1 --2- 172.21.15.78:0/255376905 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55dfca3fb390 0x55dfca7e7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.125+0000 7f5f71a96640 1 -- 172.21.15.78:0/255376905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3d24d0 msgr2=0x55dfca7bc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:15.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.125+0000 7f5f71a96640 1 --2- 172.21.15.78:0/255376905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3d24d0 0x55dfca7bc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.125+0000 7f5f71a96640 1 -- 172.21.15.78:0/255376905 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfca4dd7d0 con 0x55dfca3da6b0 2024-09-17T03:14:15.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.125+0000 7f5f70a94640 1 --2- 172.21.15.78:0/255376905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3d24d0 0x55dfca7bc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:15.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.125+0000 7f5f71a96640 1 --2- 172.21.15.78:0/255376905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7bcda0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c073ce0 tx=0x7f5f64003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8686cee5ded9112 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:15.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.125+0000 7f5f56ffd640 1 -- 172.21.15.78:0/255376905 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f64004770 con 0x55dfca3da6b0 2024-09-17T03:14:15.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.125+0000 7f5f56ffd640 1 -- 172.21.15.78:0/255376905 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f64003e70 con 0x55dfca3da6b0 2024-09-17T03:14:15.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.125+0000 7f5f56ffd640 1 -- 172.21.15.78:0/255376905 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f64011660 con 0x55dfca3da6b0 2024-09-17T03:14:15.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.126+0000 7f5f7a46d740 1 -- 172.21.15.78:0/255376905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 msgr2=0x55dfca7bcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.126+0000 7f5f7a46d740 1 --2- 172.21.15.78:0/255376905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7bcda0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c073ce0 tx=0x7f5f64003d40 comp rx=0 tx=0).stop 2024-09-17T03:14:15.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.126+0000 7f5f7a46d740 1 -- 172.21.15.78:0/255376905 shutdown_connections 2024-09-17T03:14:15.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.126+0000 7f5f7a46d740 1 --2- 172.21.15.78:0/255376905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7bcda0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.126+0000 7f5f7a46d740 1 --2- 172.21.15.78:0/255376905 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3d24d0 0x55dfca7bc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.126+0000 7f5f7a46d740 1 --2- 172.21.15.78:0/255376905 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55dfca3fb390 0x55dfca7e7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.126+0000 7f5f7a46d740 1 -- 172.21.15.78:0/255376905 >> 172.21.15.78:0/255376905 conn(0x55dfca3ef4e0 msgr2=0x55dfca7a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:15.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.126+0000 7f5f7a46d740 1 -- 172.21.15.78:0/255376905 shutdown_connections 2024-09-17T03:14:15.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.126+0000 7f5f7a46d740 1 -- 172.21.15.78:0/255376905 wait complete. 2024-09-17T03:14:15.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.127+0000 7f5f7a46d740 1 -- start start 2024-09-17T03:14:15.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.127+0000 7f5f7a46d740 1 Processor -- start 2024-09-17T03:14:15.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.128+0000 7f5f7a46d740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55dfca3d24d0 0x55dfca7fab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.128+0000 7f5f7a46d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.128+0000 7f5f7a46d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3fb390 0x55dfca7e3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.128+0000 7f5f7a46d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55dfca475740 con 0x55dfca3da6b0 2024-09-17T03:14:15.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.128+0000 7f5f7a46d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55dfca6aa970 con 0x55dfca3fb390 2024-09-17T03:14:15.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.128+0000 7f5f7a46d740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55dfca7cb960 con 0x55dfca3d24d0 2024-09-17T03:14:15.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.128+0000 7f5f7a46d740 10 client.0 _ll_register_callbacks cb 0x55dfca6b9780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:15.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.128+0000 7f5f70a94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.128+0000 7f5f70a94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7ccf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42488/0 (socket says 172.21.15.78:42488) 2024-09-17T03:14:15.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.128+0000 7f5f70a94640 1 -- 172.21.15.78:0/2254994122 learned_addr learned my addr 172.21.15.78:0/2254994122 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:15.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f71a96640 1 --2- 172.21.15.78:0/2254994122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3fb390 0x55dfca7e3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f70a94640 1 -- 172.21.15.78:0/2254994122 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55dfca3d24d0 msgr2=0x55dfca7fab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:15.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f71295640 1 --2- 172.21.15.78:0/2254994122 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55dfca3d24d0 0x55dfca7fab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f70a94640 1 --2- 172.21.15.78:0/2254994122 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55dfca3d24d0 0x55dfca7fab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f70a94640 1 -- 172.21.15.78:0/2254994122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3fb390 msgr2=0x55dfca7e3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:15.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f70a94640 1 --2- 172.21.15.78:0/2254994122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3fb390 0x55dfca7e3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f70a94640 1 -- 172.21.15.78:0/2254994122 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfca466970 con 0x55dfca3da6b0 2024-09-17T03:14:15.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f71a96640 1 --2- 172.21.15.78:0/2254994122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3fb390 0x55dfca7e3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:15.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f70a94640 1 --2- 172.21.15.78:0/2254994122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7ccf60 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0640d0 tx=0x7f5f5c063d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d18931e7c95835 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:15.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:15.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f4bfff640 1 -- 172.21.15.78:0/2254994122 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c08a410 con 0x55dfca3da6b0 2024-09-17T03:14:15.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f4bfff640 1 -- 172.21.15.78:0/2254994122 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f5f5c0633a0 con 0x55dfca3da6b0 2024-09-17T03:14:15.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f7a46d740 1 -- 172.21.15.78:0/2254994122 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f64003e70 con 0x55dfca3da6b0 2024-09-17T03:14:15.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f4bfff640 1 -- 172.21.15.78:0/2254994122 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f5f5c06dab0 con 0x55dfca3da6b0 2024-09-17T03:14:15.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f7a46d740 10 client.8034 fetch_fsmap learned FSMap version 85 2024-09-17T03:14:15.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f7a46d740 1 -- 172.21.15.78:0/2254994122 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x55dfca4446a0 con 0x55dfca3da6b0 2024-09-17T03:14:15.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f4bfff640 1 -- 172.21.15.78:0/2254994122 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f64003e70 con 0x55dfca3da6b0 2024-09-17T03:14:15.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f4bfff640 1 -- 172.21.15.78:0/2254994122 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 85) ==== 3558+0+0 (secure 0 0 0) 0x7f5f5c09ace0 con 0x55dfca3da6b0 2024-09-17T03:14:15.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f7a46d740 10 client.8034 fetch_fsmap finished waiting for FSMap version 85 2024-09-17T03:14:15.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f7a46d740 10 client.8034 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T03:14:15.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f7a46d740 20 client.8034 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:15.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f7a46d740 1 --2- 172.21.15.78:0/2254994122 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55dfca3b9f60 0x55dfca7de990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f7a46d740 4 client.8034 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:14:15.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.129+0000 7f5f7a46d740 1 -- 172.21.15.78:0/2254994122 --> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfca7179b0 con 0x55dfca3b9f60 2024-09-17T03:14:15.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.130+0000 7f5f71295640 1 --2- 172.21.15.78:0/2254994122 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55dfca3b9f60 0x55dfca7de990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.130+0000 7f5f4bfff640 10 client.8034 ms_handle_connect on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:15.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.130+0000 7f5f71295640 1 --2- 172.21.15.78:0/2254994122 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55dfca3b9f60 0x55dfca7de990 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4091b1efb82c468f server_cookie=3f5c741320204c6e in_seq=0 out_seq=0 2024-09-17T03:14:15.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.131+0000 7f5f4bfff640 1 -- 172.21.15.78:0/2254994122 <== mds.0 v2:172.21.15.78:6833/3357123265 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dfca7179b0 con 0x55dfca3b9f60 2024-09-17T03:14:15.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.131+0000 7f5f4bfff640 10 client.8034 handle_command_reply: tid=0 2024-09-17T03:14:15.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.131+0000 7f5f7a46d740 1 client.8034 shutdown 2024-09-17T03:14:15.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.131+0000 7f5f7a46d740 1 -- 172.21.15.78:0/2254994122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 msgr2=0x55dfca7ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.131+0000 7f5f7a46d740 1 --2- 172.21.15.78:0/2254994122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7ccf60 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0640d0 tx=0x7f5f5c063d10 comp rx=0 tx=0).stop 2024-09-17T03:14:15.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.131+0000 7f5f7a46d740 1 -- 172.21.15.78:0/2254994122 shutdown_connections 2024-09-17T03:14:15.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.131+0000 7f5f7a46d740 1 --2- 172.21.15.78:0/2254994122 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55dfca3b9f60 0x55dfca7de990 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.131+0000 7f5f7a46d740 1 --2- 172.21.15.78:0/2254994122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3fb390 0x55dfca7e3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.131+0000 7f5f7a46d740 1 --2- 172.21.15.78:0/2254994122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7ccf60 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.131+0000 7f5f4bfff640 0 client.8034 ms_handle_reset on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:15.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.131+0000 7f5f7a46d740 1 --2- 172.21.15.78:0/2254994122 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55dfca3d24d0 0x55dfca7fab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.131+0000 7f5f7a46d740 1 -- 172.21.15.78:0/2254994122 >> 172.21.15.78:0/2254994122 conn(0x55dfca3ef4e0 msgr2=0x55dfca7bc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:15.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.131+0000 7f5f7a46d740 1 -- 172.21.15.78:0/2254994122 shutdown_connections 2024-09-17T03:14:15.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.131+0000 7f5f7a46d740 1 -- 172.21.15.78:0/2254994122 wait complete. 2024-09-17T03:14:15.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.131+0000 7f5f7a46d740 20 client.8034 trim_cache size 0 max 16384 2024-09-17T03:14:15.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.150+0000 7f5f7a46d740 1 Processor -- start 2024-09-17T03:14:15.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.150+0000 7f5f7a46d740 1 -- start start 2024-09-17T03:14:15.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.151+0000 7f5f7a46d740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55dfca3d24d0 0x55dfca80ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.151+0000 7f5f7a46d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7e3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.151+0000 7f5f7a46d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3fb390 0x55dfca7e3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.151+0000 7f5f7a46d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6c1fe2d0 con 0x55dfca3da6b0 2024-09-17T03:14:15.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.151+0000 7f5f7a46d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6c06d360 con 0x55dfca3fb390 2024-09-17T03:14:15.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.151+0000 7f5f7a46d740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5f6c06da90 con 0x55dfca3d24d0 2024-09-17T03:14:15.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.151+0000 7f5f70a94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7e3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.151+0000 7f5f70a94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7e3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42502/0 (socket says 172.21.15.78:42502) 2024-09-17T03:14:15.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.151+0000 7f5f70a94640 1 -- 172.21.15.78:0/2173319840 learned_addr learned my addr 172.21.15.78:0/2173319840 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:15.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.152+0000 7f5f71295640 1 --2- 172.21.15.78:0/2173319840 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55dfca3d24d0 0x55dfca80ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.152+0000 7f5f71a96640 1 --2- 172.21.15.78:0/2173319840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3fb390 0x55dfca7e3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.152+0000 7f5f70a94640 1 -- 172.21.15.78:0/2173319840 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55dfca3d24d0 msgr2=0x55dfca80ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:15.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.152+0000 7f5f70a94640 1 --2- 172.21.15.78:0/2173319840 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55dfca3d24d0 0x55dfca80ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.152+0000 7f5f70a94640 1 -- 172.21.15.78:0/2173319840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3fb390 msgr2=0x55dfca7e3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:15.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.152+0000 7f5f70a94640 1 --2- 172.21.15.78:0/2173319840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3fb390 0x55dfca7e3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.152+0000 7f5f70a94640 1 -- 172.21.15.78:0/2173319840 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfca79f860 con 0x55dfca3da6b0 2024-09-17T03:14:15.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.152+0000 7f5f70a94640 1 --2- 172.21.15.78:0/2173319840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7e3740 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c001240 tx=0x7f5f5c064040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93230983f601aea0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:15.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.152+0000 7f5f567fc640 1 -- 172.21.15.78:0/2173319840 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c063170 con 0x55dfca3da6b0 2024-09-17T03:14:15.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.152+0000 7f5f567fc640 1 -- 172.21.15.78:0/2173319840 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f5c0635f0 con 0x55dfca3da6b0 2024-09-17T03:14:15.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.152+0000 7f5f567fc640 1 -- 172.21.15.78:0/2173319840 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c086400 con 0x55dfca3da6b0 2024-09-17T03:14:15.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.153+0000 7f5f7a46d740 1 -- 172.21.15.78:0/2173319840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 msgr2=0x55dfca7e3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.153+0000 7f5f7a46d740 1 --2- 172.21.15.78:0/2173319840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7e3740 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c001240 tx=0x7f5f5c064040 comp rx=0 tx=0).stop 2024-09-17T03:14:15.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.153+0000 7f5f7a46d740 1 -- 172.21.15.78:0/2173319840 shutdown_connections 2024-09-17T03:14:15.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.153+0000 7f5f7a46d740 1 --2- 172.21.15.78:0/2173319840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3fb390 0x55dfca7e3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.153+0000 7f5f7a46d740 1 --2- 172.21.15.78:0/2173319840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7e3740 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.153+0000 7f5f7a46d740 1 --2- 172.21.15.78:0/2173319840 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55dfca3d24d0 0x55dfca80ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.153+0000 7f5f7a46d740 1 -- 172.21.15.78:0/2173319840 >> 172.21.15.78:0/2173319840 conn(0x55dfca3ef4e0 msgr2=0x55dfca7a2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:15.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.153+0000 7f5f7a46d740 1 -- 172.21.15.78:0/2173319840 shutdown_connections 2024-09-17T03:14:15.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.153+0000 7f5f7a46d740 1 -- 172.21.15.78:0/2173319840 wait complete. 2024-09-17T03:14:15.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.154+0000 7f5f7a46d740 1 -- start start 2024-09-17T03:14:15.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.154+0000 7f5f7a46d740 1 Processor -- start 2024-09-17T03:14:15.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.155+0000 7f5f7a46d740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55dfca3d24d0 0x55dfca7cb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.155+0000 7f5f7a46d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7e3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.155+0000 7f5f7a46d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3fb390 0x55dfca7e3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.155+0000 7f5f7a46d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5f6c15a560 con 0x55dfca3da6b0 2024-09-17T03:14:15.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.155+0000 7f5f7a46d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55dfca7179b0 con 0x55dfca3fb390 2024-09-17T03:14:15.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.155+0000 7f5f7a46d740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55dfca8676a0 con 0x55dfca3d24d0 2024-09-17T03:14:15.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.155+0000 7f5f7a46d740 10 client.0 _ll_register_callbacks cb 0x7f5f5c05ffe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:15.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.155+0000 7f5f70a94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7e3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.155+0000 7f5f70a94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7e3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42506/0 (socket says 172.21.15.78:42506) 2024-09-17T03:14:15.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.155+0000 7f5f70a94640 1 -- 172.21.15.78:0/1340887756 learned_addr learned my addr 172.21.15.78:0/1340887756 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:15.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.155+0000 7f5f71295640 1 --2- 172.21.15.78:0/1340887756 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55dfca3d24d0 0x55dfca7cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.155+0000 7f5f71a96640 1 --2- 172.21.15.78:0/1340887756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3fb390 0x55dfca7e3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f70a94640 1 -- 172.21.15.78:0/1340887756 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55dfca3d24d0 msgr2=0x55dfca7cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:15.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f70a94640 1 --2- 172.21.15.78:0/1340887756 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55dfca3d24d0 0x55dfca7cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f70a94640 1 -- 172.21.15.78:0/1340887756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3fb390 msgr2=0x55dfca7e3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:15.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f70a94640 1 --2- 172.21.15.78:0/1340887756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3fb390 0x55dfca7e3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f70a94640 1 -- 172.21.15.78:0/1340887756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfca869ec0 con 0x55dfca3da6b0 2024-09-17T03:14:15.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f70a94640 1 --2- 172.21.15.78:0/1340887756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7e3740 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0613b0 tx=0x7f5f5c0638b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9eccc2e4af14ac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:15.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f4bfff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:15.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f4bfff640 1 -- 172.21.15.78:0/1340887756 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c08a210 con 0x55dfca3da6b0 2024-09-17T03:14:15.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f4bfff640 1 -- 172.21.15.78:0/1340887756 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f5f5c08a3b0 con 0x55dfca3da6b0 2024-09-17T03:14:15.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f7a46d740 1 -- 172.21.15.78:0/1340887756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f5c0635f0 con 0x55dfca3da6b0 2024-09-17T03:14:15.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f4bfff640 1 -- 172.21.15.78:0/1340887756 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) ==== 24+0+0 (secure 0 0 0) 0x7f5f5c07e080 con 0x55dfca3da6b0 2024-09-17T03:14:15.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f7a46d740 10 client.8040 fetch_fsmap learned FSMap version 85 2024-09-17T03:14:15.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f7a46d740 1 -- 172.21.15.78:0/1340887756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) -- 0x55dfca869ec0 con 0x55dfca3da6b0 2024-09-17T03:14:15.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f4bfff640 1 -- 172.21.15.78:0/1340887756 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f5c0635f0 con 0x55dfca3da6b0 2024-09-17T03:14:15.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f4bfff640 1 -- 172.21.15.78:0/1340887756 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 85) ==== 3558+0+0 (secure 0 0 0) 0x7f5f5c07e220 con 0x55dfca3da6b0 2024-09-17T03:14:15.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f7a46d740 10 client.8040 fetch_fsmap finished waiting for FSMap version 85 2024-09-17T03:14:15.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f7a46d740 10 client.8040 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-09-17T03:14:15.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f7a46d740 20 client.8040 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:15.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f7a46d740 1 --2- 172.21.15.78:0/1340887756 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55dfca80ae00 0x55dfca79bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f7a46d740 4 client.8040 mds_command: new command op to 7428 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:14:15.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.156+0000 7f5f7a46d740 1 -- 172.21.15.78:0/1340887756 --> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dfca713460 con 0x55dfca80ae00 2024-09-17T03:14:15.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.157+0000 7f5f71295640 1 --2- 172.21.15.78:0/1340887756 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55dfca80ae00 0x55dfca79bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.157+0000 7f5f4bfff640 10 client.8040 ms_handle_connect on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:15.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.157+0000 7f5f71295640 1 --2- 172.21.15.78:0/1340887756 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55dfca80ae00 0x55dfca79bdd0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2726ffc9462a768f server_cookie=ede3ee2666c450c8 in_seq=0 out_seq=0 2024-09-17T03:14:15.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.157+0000 7f5f4bfff640 1 -- 172.21.15.78:0/1340887756 <== mds.0 v2:172.21.15.78:6833/3357123265 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x55dfca713460 con 0x55dfca80ae00 2024-09-17T03:14:15.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.157+0000 7f5f4bfff640 10 client.8040 handle_command_reply: tid=0 2024-09-17T03:14:15.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.157+0000 7f5f7a46d740 1 client.8040 shutdown 2024-09-17T03:14:15.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.157+0000 7f5f7a46d740 1 -- 172.21.15.78:0/1340887756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 msgr2=0x55dfca7e3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.157+0000 7f5f7a46d740 1 --2- 172.21.15.78:0/1340887756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7e3740 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c0613b0 tx=0x7f5f5c0638b0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.157+0000 7f5f7a46d740 1 -- 172.21.15.78:0/1340887756 shutdown_connections 2024-09-17T03:14:15.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.157+0000 7f5f7a46d740 1 --2- 172.21.15.78:0/1340887756 >> [v2:172.21.15.78:6833/3357123265,v1:172.21.15.78:6832/3357123265] conn(0x55dfca80ae00 0x55dfca79bdd0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.157+0000 7f5f7a46d740 1 --2- 172.21.15.78:0/1340887756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55dfca3fb390 0x55dfca7e3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.157+0000 7f5f7a46d740 1 --2- 172.21.15.78:0/1340887756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55dfca3da6b0 0x55dfca7e3740 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.157+0000 7f5f7a46d740 1 --2- 172.21.15.78:0/1340887756 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55dfca3d24d0 0x55dfca7cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.157+0000 7f5f4bfff640 0 client.8040 ms_handle_reset on v2:172.21.15.78:6833/3357123265 2024-09-17T03:14:15.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.157+0000 7f5f7a46d740 1 -- 172.21.15.78:0/1340887756 >> 172.21.15.78:0/1340887756 conn(0x55dfca3ef4e0 msgr2=0x55dfca7fab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:15.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.157+0000 7f5f7a46d740 1 -- 172.21.15.78:0/1340887756 shutdown_connections 2024-09-17T03:14:15.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.158+0000 7f5f7a46d740 1 -- 172.21.15.78:0/1340887756 wait complete. 2024-09-17T03:14:15.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.158+0000 7f5f7a46d740 20 client.8040 trim_cache size 0 max 16384 2024-09-17T03:14:15.161 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:14:15.162 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T03:14:15.162 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:14:15.162 INFO:teuthology.orchestra.run.smithi078.stdout: "06dff376-fc02-4326-a75b-2bb8deb474f9": { 2024-09-17T03:14:15.162 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:14:15.162 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "06dff376-fc02-4326-a75b-2bb8deb474f9", 2024-09-17T03:14:15.162 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:14:15.162 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:15.162 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:14:15.162 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-17T03:14:15.162 INFO:teuthology.orchestra.run.smithi078.stdout: "06dff376-fc02-4326-a75b-2bb8deb474f9": { 2024-09-17T03:14:15.162 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-17T03:14:06.141674+0000", 2024-09-17T03:14:15.162 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:14:15.162 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-17T03:14:15.162 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-17T03:14:15.163 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-17T03:14:15.163 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-17T03:14:15.163 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:15.163 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:15.163 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:14:15.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.158+0000 7f5f734f9640 1 -- 172.21.15.78:0/2972509168 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5f50078b90 msgr2=0x7f5f5007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.158+0000 7f5f734f9640 1 --2- 172.21.15.78:0/2972509168 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5f50078b90 0x7f5f5007b0a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009b50 tx=0x7f5f6802d040 comp rx=0 tx=0).stop 2024-09-17T03:14:15.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.158+0000 7f5f734f9640 1 -- 172.21.15.78:0/2972509168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f6c152860 msgr2=0x7f5f6c151fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.158+0000 7f5f734f9640 1 --2- 172.21.15.78:0/2972509168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f6c152860 0x7f5f6c151fb0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c00e710 tx=0x7f5f5c00ebd0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.158+0000 7f5f734f9640 1 -- 172.21.15.78:0/2972509168 shutdown_connections 2024-09-17T03:14:15.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.158+0000 7f5f734f9640 1 --2- 172.21.15.78:0/2972509168 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5f50078b90 0x7f5f5007b0a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.158+0000 7f5f734f9640 1 --2- 172.21.15.78:0/2972509168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f6c1f2840 0x7f5f6c1f2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.158+0000 7f5f734f9640 1 --2- 172.21.15.78:0/2972509168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f6c152860 0x7f5f6c151fb0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.158+0000 7f5f734f9640 1 --2- 172.21.15.78:0/2972509168 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f58003a00 0x7f5f6c1578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.158+0000 7f5f734f9640 1 -- 172.21.15.78:0/2972509168 >> 172.21.15.78:0/2972509168 conn(0x7f5f6c0cdcc0 msgr2=0x7f5f6c155820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:15.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.158+0000 7f5f734f9640 1 -- 172.21.15.78:0/2972509168 shutdown_connections 2024-09-17T03:14:15.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.158+0000 7f5f734f9640 1 -- 172.21.15.78:0/2972509168 wait complete. 2024-09-17T03:14:15.168 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:14:15.168 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:15.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.281+0000 7fc29c3f1640 1 -- 172.21.15.78:0/2668674609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc280004d40 msgr2=0x7fc2800051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.281+0000 7fc29c3f1640 1 --2- 172.21.15.78:0/2668674609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc280004d40 0x7fc2800051f0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fc28c005fd0 tx=0x7fc280005830 comp rx=0 tx=0).stop 2024-09-17T03:14:15.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.281+0000 7fc29a98e640 1 -- 172.21.15.78:0/2668674609 reap_dead start 2024-09-17T03:14:15.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.281+0000 7fc29c3f1640 1 -- 172.21.15.78:0/2668674609 shutdown_connections 2024-09-17T03:14:15.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.281+0000 7fc29c3f1640 1 -- 172.21.15.78:0/2668674609 >> 172.21.15.78:0/2668674609 conn(0x7fc29406d4f0 msgr2=0x7fc294071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:15.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.281+0000 7fc29c3f1640 1 -- 172.21.15.78:0/2668674609 shutdown_connections 2024-09-17T03:14:15.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.281+0000 7fc29c3f1640 1 -- 172.21.15.78:0/2668674609 wait complete. 2024-09-17T03:14:15.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.283+0000 7fc29c3f1640 1 Processor -- start 2024-09-17T03:14:15.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.283+0000 7fc29c3f1640 1 -- start start 2024-09-17T03:14:15.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.285+0000 7fc29c3f1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc280004d40 0x7fc2940b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.285+0000 7fc29c3f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2940b3790 0x7fc2940a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.285+0000 7fc29c3f1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2940a99e0 0x7fc29414b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.285+0000 7fc29c3f1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc2940d1090 con 0x7fc2940b3790 2024-09-17T03:14:15.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.285+0000 7fc29c3f1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc2940cd0d0 con 0x7fc2940a99e0 2024-09-17T03:14:15.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.285+0000 7fc29c3f1640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc2940d1210 con 0x7fc280004d40 2024-09-17T03:14:15.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.285+0000 7fc29998c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2940b3790 0x7fc2940a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.285+0000 7fc29998c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2940b3790 0x7fc2940a94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42528/0 (socket says 172.21.15.78:42528) 2024-09-17T03:14:15.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.285+0000 7fc29998c640 1 -- 172.21.15.78:0/930009654 learned_addr learned my addr 172.21.15.78:0/930009654 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:15.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.285+0000 7fc29a18d640 1 --2- 172.21.15.78:0/930009654 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc280004d40 0x7fc2940b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.285+0000 7fc29a98e640 1 --2- 172.21.15.78:0/930009654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2940a99e0 0x7fc29414b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.285+0000 7fc29998c640 1 -- 172.21.15.78:0/930009654 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc280004d40 msgr2=0x7fc2940b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.285+0000 7fc29998c640 1 --2- 172.21.15.78:0/930009654 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc280004d40 0x7fc2940b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.285+0000 7fc29998c640 1 -- 172.21.15.78:0/930009654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2940a99e0 msgr2=0x7fc29414b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.285+0000 7fc29998c640 1 --2- 172.21.15.78:0/930009654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2940a99e0 0x7fc29414b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.285+0000 7fc29998c640 1 -- 172.21.15.78:0/930009654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2940a9df0 con 0x7fc2940b3790 2024-09-17T03:14:15.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.285+0000 7fc29998c640 1 --2- 172.21.15.78:0/930009654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2940b3790 0x7fc2940a94a0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fc284004ed0 tx=0x7fc284001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:15.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.285+0000 7fc28affd640 1 -- 172.21.15.78:0/930009654 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc284015020 con 0x7fc2940b3790 2024-09-17T03:14:15.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.285+0000 7fc28affd640 1 -- 172.21.15.78:0/930009654 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc284011960 con 0x7fc2940b3790 2024-09-17T03:14:15.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.286+0000 7fc29c3f1640 1 -- 172.21.15.78:0/930009654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2940b41c0 con 0x7fc2940b3790 2024-09-17T03:14:15.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.286+0000 7fc28affd640 1 -- 172.21.15.78:0/930009654 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc284011d90 con 0x7fc2940b3790 2024-09-17T03:14:15.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.286+0000 7fc29c3f1640 1 -- 172.21.15.78:0/930009654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2941492c0 con 0x7fc2940b3790 2024-09-17T03:14:15.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.286+0000 7fc29c3f1640 1 -- 172.21.15.78:0/930009654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc29415d530 con 0x7fc2940b3790 2024-09-17T03:14:15.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.287+0000 7fc28affd640 1 -- 172.21.15.78:0/930009654 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc284018020 con 0x7fc2940b3790 2024-09-17T03:14:15.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.288+0000 7fc28affd640 1 --2- 172.21.15.78:0/930009654 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc278078b90 0x7fc27807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.288+0000 7fc28affd640 1 -- 172.21.15.78:0/930009654 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7fc28409b6d0 con 0x7fc2940b3790 2024-09-17T03:14:15.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.288+0000 7fc29a18d640 1 --2- 172.21.15.78:0/930009654 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc278078b90 0x7fc27807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.289+0000 7fc29a18d640 1 --2- 172.21.15.78:0/930009654 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc278078b90 0x7fc27807b0a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc290001eb0 tx=0x7fc290001cb0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:15.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.292+0000 7fc28affd640 1 -- 172.21.15.78:0/930009654 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc29415d530 con 0x7fc2940b3790 2024-09-17T03:14:15.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.502+0000 7fc29c3f1640 1 -- 172.21.15.78:0/930009654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2940d1770 con 0x7fc2940b3790 2024-09-17T03:14:15.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.503+0000 7fc28affd640 1 -- 172.21.15.78:0/930009654 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5278 (secure 0 0 0) 0x7fc28401f020 con 0x7fc2940b3790 2024-09-17T03:14:15.502 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:15.502 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:35.489582+0000","modified":"2024-09-17T03:14:08.415660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7428,"mds_1":7425,"mds_2":6640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"d","rank":2,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/1005450673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1005450673},{"type":"v1","addr":"172.21.15.193:6837","nonce":1005450673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7425":{"gid":7425,"name":"c","rank":1,"incarnation":78,"state":"up:active","state_seq":10,"addr":"172.21.15.78:6835/4018023271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4018023271},{"type":"v1","addr":"172.21.15.78:6835","nonce":4018023271}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6832/3357123265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":3357123265},{"type":"v1","addr":"172.21.15.78:6832","nonce":3357123265}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7428,"qdb_cluster":[6640,7425,7428]},"id":6}]} 2024-09-17T03:14:15.502 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 85 2024-09-17T03:14:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.505+0000 7fc29c3f1640 1 -- 172.21.15.78:0/930009654 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc278078b90 msgr2=0x7fc27807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.505+0000 7fc29c3f1640 1 --2- 172.21.15.78:0/930009654 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc278078b90 0x7fc27807b0a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc290001eb0 tx=0x7fc290001cb0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.505+0000 7fc29c3f1640 1 -- 172.21.15.78:0/930009654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2940b3790 msgr2=0x7fc2940a94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.505+0000 7fc29c3f1640 1 --2- 172.21.15.78:0/930009654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2940b3790 0x7fc2940a94a0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fc284004ed0 tx=0x7fc284001630 comp rx=0 tx=0).stop 2024-09-17T03:14:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.505+0000 7fc29c3f1640 1 -- 172.21.15.78:0/930009654 shutdown_connections 2024-09-17T03:14:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.505+0000 7fc29c3f1640 1 --2- 172.21.15.78:0/930009654 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc278078b90 0x7fc27807b0a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.505+0000 7fc29c3f1640 1 --2- 172.21.15.78:0/930009654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2940a99e0 0x7fc29414b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.505+0000 7fc29c3f1640 1 --2- 172.21.15.78:0/930009654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2940b3790 0x7fc2940a94a0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.505+0000 7fc29c3f1640 1 --2- 172.21.15.78:0/930009654 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc280004d40 0x7fc2940b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.505+0000 7fc29c3f1640 1 -- 172.21.15.78:0/930009654 >> 172.21.15.78:0/930009654 conn(0x7fc29406d4f0 msgr2=0x7fc294071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.505+0000 7fc29c3f1640 1 -- 172.21.15.78:0/930009654 shutdown_connections 2024-09-17T03:14:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.505+0000 7fc29c3f1640 1 -- 172.21.15.78:0/930009654 wait complete. 2024-09-17T03:14:15.515 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-17T03:14:15.515 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:14:15.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.629+0000 7fc099169640 1 -- 172.21.15.78:0/1797524922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0940cf130 msgr2=0x7fc094071650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.629+0000 7fc099169640 1 --2- 172.21.15.78:0/1797524922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0940cf130 0x7fc094071650 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fc0940b6230 tx=0x7fc07c02a5f0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.629+0000 7fc099169640 1 -- 172.21.15.78:0/1797524922 shutdown_connections 2024-09-17T03:14:15.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.629+0000 7fc099169640 1 --2- 172.21.15.78:0/1797524922 >> v2:172.21.15.193:3300/0 conn(0x7fc0940b2cb0 0x7fc0940b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.629+0000 7fc099169640 1 --2- 172.21.15.78:0/1797524922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0940cf130 0x7fc094071650 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.629+0000 7fc099169640 1 -- 172.21.15.78:0/1797524922 >> 172.21.15.78:0/1797524922 conn(0x7fc0940cdcb0 msgr2=0x7fc0940ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:15.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.629+0000 7fc099169640 1 -- 172.21.15.78:0/1797524922 shutdown_connections 2024-09-17T03:14:15.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.629+0000 7fc099169640 1 -- 172.21.15.78:0/1797524922 wait complete. 2024-09-17T03:14:15.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.631+0000 7fc099169640 1 Processor -- start 2024-09-17T03:14:15.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.631+0000 7fc099169640 1 -- start start 2024-09-17T03:14:15.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.632+0000 7fc099169640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc0940b2cb0 0x7fc094155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.632+0000 7fc099169640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc0940cf130 0x7fc0941508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.632+0000 7fc099169640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc09415b8f0 0x7fc09406ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.632+0000 7fc099169640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc0940ae120 con 0x7fc09415b8f0 2024-09-17T03:14:15.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.632+0000 7fc099169640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc0940adfa0 con 0x7fc0940cf130 2024-09-17T03:14:15.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.632+0000 7fc099169640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc0940ae2a0 con 0x7fc0940b2cb0 2024-09-17T03:14:15.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.632+0000 7fc09359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc09415b8f0 0x7fc09406ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.632+0000 7fc09359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc09415b8f0 0x7fc09406ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42548/0 (socket says 172.21.15.78:42548) 2024-09-17T03:14:15.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.632+0000 7fc09359e640 1 -- 172.21.15.78:0/2712137546 learned_addr learned my addr 172.21.15.78:0/2712137546 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:15.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.633+0000 7fc09359e640 1 -- 172.21.15.78:0/2712137546 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc0940b2cb0 msgr2=0x7fc094155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.633+0000 7fc09359e640 1 --2- 172.21.15.78:0/2712137546 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc0940b2cb0 0x7fc094155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.633+0000 7fc09359e640 1 -- 172.21.15.78:0/2712137546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc0940cf130 msgr2=0x7fc0941508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.633+0000 7fc08a59c640 1 --2- 172.21.15.78:0/2712137546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc0940cf130 0x7fc0941508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.633+0000 7fc09359e640 1 --2- 172.21.15.78:0/2712137546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc0940cf130 0x7fc0941508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.633+0000 7fc09359e640 1 -- 172.21.15.78:0/2712137546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc094155760 con 0x7fc09415b8f0 2024-09-17T03:14:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.633+0000 7fc09359e640 1 --2- 172.21.15.78:0/2712137546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc09415b8f0 0x7fc09406ce10 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00b9a0 tx=0x7fc08c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.633+0000 7fc08bfff640 1 -- 172.21.15.78:0/2712137546 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08c019070 con 0x7fc09415b8f0 2024-09-17T03:14:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.633+0000 7fc08bfff640 1 -- 172.21.15.78:0/2712137546 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc08c00ccb0 con 0x7fc09415b8f0 2024-09-17T03:14:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.633+0000 7fc08bfff640 1 -- 172.21.15.78:0/2712137546 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc08c0146a0 con 0x7fc09415b8f0 2024-09-17T03:14:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.633+0000 7fc099169640 1 -- 172.21.15.78:0/2712137546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc094157940 con 0x7fc09415b8f0 2024-09-17T03:14:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.633+0000 7fc099169640 1 -- 172.21.15.78:0/2712137546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc094158150 con 0x7fc09415b8f0 2024-09-17T03:14:15.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.634+0000 7fc099169640 1 -- 172.21.15.78:0/2712137546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc094157be0 con 0x7fc09415b8f0 2024-09-17T03:14:15.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.635+0000 7fc08bfff640 1 -- 172.21.15.78:0/2712137546 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc08c01c070 con 0x7fc09415b8f0 2024-09-17T03:14:15.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.635+0000 7fc08bfff640 1 --2- 172.21.15.78:0/2712137546 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc074078b90 0x7fc07407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:15.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.635+0000 7fc08bfff640 1 -- 172.21.15.78:0/2712137546 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7fc08c09aae0 con 0x7fc09415b8f0 2024-09-17T03:14:15.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.636+0000 7fc092d9d640 1 --2- 172.21.15.78:0/2712137546 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc074078b90 0x7fc07407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:15.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.636+0000 7fc092d9d640 1 --2- 172.21.15.78:0/2712137546 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc074078b90 0x7fc07407b0a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc084000f60 tx=0x7fc0840079d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:15.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.640+0000 7fc08bfff640 1 -- 172.21.15.78:0/2712137546 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc08c062f70 con 0x7fc09415b8f0 2024-09-17T03:14:15.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.882+0000 7fc099169640 1 -- 172.21.15.78:0/2712137546 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fc0940ae830 con 0x7fc09415b8f0 2024-09-17T03:14:15.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.882+0000 7fc08bfff640 1 -- 172.21.15.78:0/2712137546 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1988 (secure 0 0 0) 0x7fc08c062870 con 0x7fc09415b8f0 2024-09-17T03:14:15.881 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:15.881 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":373,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":84,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700753,"bytes_used":256675840,"bytes_avail":772837437440,"bytes_total":773094113280,"write_bytes_sec":511,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6640},{"filesystem_id":6,"rank":1,"name":"c","status":"up:active","gid":7425},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7428}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2024-09-17T03:14:13.213276+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-17T03:14:15.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.884+0000 7fc099169640 1 -- 172.21.15.78:0/2712137546 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc074078b90 msgr2=0x7fc07407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.884+0000 7fc099169640 1 --2- 172.21.15.78:0/2712137546 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc074078b90 0x7fc07407b0a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc084000f60 tx=0x7fc0840079d0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.884+0000 7fc099169640 1 -- 172.21.15.78:0/2712137546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc09415b8f0 msgr2=0x7fc09406ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:15.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.884+0000 7fc099169640 1 --2- 172.21.15.78:0/2712137546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc09415b8f0 0x7fc09406ce10 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00b9a0 tx=0x7fc08c00be60 comp rx=0 tx=0).stop 2024-09-17T03:14:15.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.884+0000 7fc099169640 1 -- 172.21.15.78:0/2712137546 shutdown_connections 2024-09-17T03:14:15.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.884+0000 7fc099169640 1 --2- 172.21.15.78:0/2712137546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc09415b8f0 0x7fc09406ce10 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.884+0000 7fc099169640 1 --2- 172.21.15.78:0/2712137546 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc074078b90 0x7fc07407b0a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.884+0000 7fc099169640 1 --2- 172.21.15.78:0/2712137546 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc0940cf130 0x7fc0941508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.884+0000 7fc099169640 1 --2- 172.21.15.78:0/2712137546 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc0940b2cb0 0x7fc094155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:15.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.884+0000 7fc099169640 1 -- 172.21.15.78:0/2712137546 >> 172.21.15.78:0/2712137546 conn(0x7fc0940cdcb0 msgr2=0x7fc0940b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:15.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.884+0000 7fc099169640 1 -- 172.21.15.78:0/2712137546 shutdown_connections 2024-09-17T03:14:15.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:15.884+0000 7fc099169640 1 -- 172.21.15.78:0/2712137546 wait complete. 2024-09-17T03:14:15.894 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-17T03:14:16.895 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:17.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.018+0000 7f8526362640 1 -- 172.21.15.78:0/1090323610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85200ca800 msgr2=0x7f85200cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.018+0000 7f8526362640 1 --2- 172.21.15.78:0/1090323610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85200ca800 0x7f85200cba00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8510005fd0 tx=0x7f851002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.018+0000 7f8526362640 1 -- 172.21.15.78:0/1090323610 shutdown_connections 2024-09-17T03:14:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.018+0000 7f8526362640 1 --2- 172.21.15.78:0/1090323610 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f85200cad30 0x7f852006ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.018+0000 7f8526362640 1 --2- 172.21.15.78:0/1090323610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85200ca800 0x7f85200cba00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.018+0000 7f8526362640 1 -- 172.21.15.78:0/1090323610 >> 172.21.15.78:0/1090323610 conn(0x7f85200b1cb0 msgr2=0x7f85200b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.018+0000 7f8526362640 1 -- 172.21.15.78:0/1090323610 shutdown_connections 2024-09-17T03:14:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.018+0000 7f8526362640 1 -- 172.21.15.78:0/1090323610 wait complete. 2024-09-17T03:14:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.020+0000 7f8526362640 1 Processor -- start 2024-09-17T03:14:17.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.020+0000 7f8526362640 1 -- start start 2024-09-17T03:14:17.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f8526362640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85200704e0 0x7f85200c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:17.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f8526362640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f85200ca800 0x7f85200c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:17.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f8526362640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85200cad30 0x7f85200b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:17.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f8526362640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f85200ccf40 con 0x7f85200cad30 2024-09-17T03:14:17.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f8526362640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f85200747d0 con 0x7f85200704e0 2024-09-17T03:14:17.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f8526362640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f85200cd0c0 con 0x7f85200ca800 2024-09-17T03:14:17.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f85248ff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85200cad30 0x7f85200b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:17.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f85248ff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85200cad30 0x7f85200b0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52438/0 (socket says 172.21.15.78:52438) 2024-09-17T03:14:17.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f85248ff640 1 -- 172.21.15.78:0/637420232 learned_addr learned my addr 172.21.15.78:0/637420232 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:17.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f851ffff640 1 --2- 172.21.15.78:0/637420232 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85200704e0 0x7f85200c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:17.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f851f7fe640 1 --2- 172.21.15.78:0/637420232 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f85200ca800 0x7f85200c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:17.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f85248ff640 1 -- 172.21.15.78:0/637420232 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f85200ca800 msgr2=0x7f85200c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:17.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f85248ff640 1 --2- 172.21.15.78:0/637420232 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f85200ca800 0x7f85200c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f85248ff640 1 -- 172.21.15.78:0/637420232 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85200704e0 msgr2=0x7f85200c3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:17.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f85248ff640 1 --2- 172.21.15.78:0/637420232 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85200704e0 0x7f85200c3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f85248ff640 1 -- 172.21.15.78:0/637420232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85201f5bb0 con 0x7f85200cad30 2024-09-17T03:14:17.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f85248ff640 1 --2- 172.21.15.78:0/637420232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85200cad30 0x7f85200b0c10 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f8518001770 tx=0x7f851800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:17.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f851cff9640 1 -- 172.21.15.78:0/637420232 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518003b70 con 0x7f85200cad30 2024-09-17T03:14:17.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f851cff9640 1 -- 172.21.15.78:0/637420232 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8518003d30 con 0x7f85200cad30 2024-09-17T03:14:17.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f8526362640 1 -- 172.21.15.78:0/637420232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85201f5e90 con 0x7f85200cad30 2024-09-17T03:14:17.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.022+0000 7f851cff9640 1 -- 172.21.15.78:0/637420232 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518005330 con 0x7f85200cad30 2024-09-17T03:14:17.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.023+0000 7f8526362640 1 -- 172.21.15.78:0/637420232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85200c5d20 con 0x7f85200cad30 2024-09-17T03:14:17.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.023+0000 7f8526362640 1 -- 172.21.15.78:0/637420232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85200c5f80 con 0x7f85200cad30 2024-09-17T03:14:17.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.024+0000 7f851cff9640 1 -- 172.21.15.78:0/637420232 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f85180056e0 con 0x7f85200cad30 2024-09-17T03:14:17.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.025+0000 7f851cff9640 1 --2- 172.21.15.78:0/637420232 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f850c078bc0 0x7f850c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:17.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.025+0000 7f851cff9640 1 -- 172.21.15.78:0/637420232 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f851809acf0 con 0x7f85200cad30 2024-09-17T03:14:17.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.025+0000 7f851ffff640 1 --2- 172.21.15.78:0/637420232 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f850c078bc0 0x7f850c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:17.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.026+0000 7f851ffff640 1 --2- 172.21.15.78:0/637420232 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f850c078bc0 0x7f850c07b0d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8510033000 tx=0x7f8510004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:17.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.029+0000 7f851cff9640 1 -- 172.21.15.78:0/637420232 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f851809f070 con 0x7f85200cad30 2024-09-17T03:14:17.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.238+0000 7f8526362640 1 -- 172.21.15.78:0/637420232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85201f5940 con 0x7f85200cad30 2024-09-17T03:14:17.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.239+0000 7f851cff9640 1 -- 172.21.15.78:0/637420232 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5278 (secure 0 0 0) 0x7f85200708f0 con 0x7f85200cad30 2024-09-17T03:14:17.238 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:17.238 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:35.489582+0000","modified":"2024-09-17T03:14:08.415660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7428,"mds_1":7425,"mds_2":6640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"d","rank":2,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/1005450673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1005450673},{"type":"v1","addr":"172.21.15.193:6837","nonce":1005450673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7425":{"gid":7425,"name":"c","rank":1,"incarnation":78,"state":"up:active","state_seq":10,"addr":"172.21.15.78:6835/4018023271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4018023271},{"type":"v1","addr":"172.21.15.78:6835","nonce":4018023271}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6832/3357123265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":3357123265},{"type":"v1","addr":"172.21.15.78:6832","nonce":3357123265}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7428,"qdb_cluster":[6640,7425,7428]},"id":6}]} 2024-09-17T03:14:17.238 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 85 2024-09-17T03:14:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.241+0000 7f8526362640 1 -- 172.21.15.78:0/637420232 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f850c078bc0 msgr2=0x7f850c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.241+0000 7f8526362640 1 --2- 172.21.15.78:0/637420232 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f850c078bc0 0x7f850c07b0d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8510033000 tx=0x7f8510004730 comp rx=0 tx=0).stop 2024-09-17T03:14:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.241+0000 7f8526362640 1 -- 172.21.15.78:0/637420232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85200cad30 msgr2=0x7f85200b0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.241+0000 7f8526362640 1 --2- 172.21.15.78:0/637420232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85200cad30 0x7f85200b0c10 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f8518001770 tx=0x7f851800cb90 comp rx=0 tx=0).stop 2024-09-17T03:14:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.241+0000 7f8526362640 1 -- 172.21.15.78:0/637420232 shutdown_connections 2024-09-17T03:14:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.241+0000 7f8526362640 1 --2- 172.21.15.78:0/637420232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85200cad30 0x7f85200b0c10 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.241+0000 7f8526362640 1 --2- 172.21.15.78:0/637420232 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f85200ca800 0x7f85200c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.241+0000 7f8526362640 1 --2- 172.21.15.78:0/637420232 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f850c078bc0 0x7f850c07b0d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.241+0000 7f8526362640 1 --2- 172.21.15.78:0/637420232 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f85200704e0 0x7f85200c3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.241+0000 7f8526362640 1 -- 172.21.15.78:0/637420232 >> 172.21.15.78:0/637420232 conn(0x7f85200b1cb0 msgr2=0x7f85200c9190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.241+0000 7f8526362640 1 -- 172.21.15.78:0/637420232 shutdown_connections 2024-09-17T03:14:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.241+0000 7f8526362640 1 -- 172.21.15.78:0/637420232 wait complete. 2024-09-17T03:14:17.251 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-17T03:14:17.251 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:14:17.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.363+0000 7f541ff94640 1 -- 172.21.15.78:0/3012706938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54180cd3e0 msgr2=0x7f5418070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:17.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.363+0000 7f541ff94640 1 --2- 172.21.15.78:0/3012706938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54180cd3e0 0x7f5418070180 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f5408009830 tx=0x7f540802a480 comp rx=0 tx=0).stop 2024-09-17T03:14:17.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.363+0000 7f541ff94640 1 -- 172.21.15.78:0/3012706938 shutdown_connections 2024-09-17T03:14:17.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.363+0000 7f541ff94640 1 --2- 172.21.15.78:0/3012706938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54180cd3e0 0x7f5418070180 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.363+0000 7f541ff94640 1 -- 172.21.15.78:0/3012706938 >> 172.21.15.78:0/3012706938 conn(0x7f541806d7d0 msgr2=0x7f54180b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:17.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.364+0000 7f541ff94640 1 -- 172.21.15.78:0/3012706938 shutdown_connections 2024-09-17T03:14:17.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.364+0000 7f541ff94640 1 -- 172.21.15.78:0/3012706938 wait complete. 2024-09-17T03:14:17.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.365+0000 7f541ff94640 1 Processor -- start 2024-09-17T03:14:17.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.365+0000 7f541ff94640 1 -- start start 2024-09-17T03:14:17.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f541ff94640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f54180706c0 0x7f5418154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f541ff94640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54180af780 0x7f541806f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f541ff94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54180cd3e0 0x7f5418151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f541ff94640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5418166bf0 con 0x7f54180cd3e0 2024-09-17T03:14:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f541ff94640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5418073bc0 con 0x7f54180af780 2024-09-17T03:14:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f541ff94640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5418166d70 con 0x7f54180706c0 2024-09-17T03:14:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f541e531640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54180cd3e0 0x7f5418151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f541e531640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54180cd3e0 0x7f5418151e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52442/0 (socket says 172.21.15.78:52442) 2024-09-17T03:14:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f541e531640 1 -- 172.21.15.78:0/2266650425 learned_addr learned my addr 172.21.15.78:0/2266650425 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f541d52f640 1 --2- 172.21.15.78:0/2266650425 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54180af780 0x7f541806f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f541dd30640 1 --2- 172.21.15.78:0/2266650425 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f54180706c0 0x7f5418154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f541e531640 1 -- 172.21.15.78:0/2266650425 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f54180706c0 msgr2=0x7f5418154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f541e531640 1 --2- 172.21.15.78:0/2266650425 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f54180706c0 0x7f5418154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f541e531640 1 -- 172.21.15.78:0/2266650425 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54180af780 msgr2=0x7f541806f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f541e531640 1 --2- 172.21.15.78:0/2266650425 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54180af780 0x7f541806f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f541e531640 1 -- 172.21.15.78:0/2266650425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5418154d30 con 0x7f54180cd3e0 2024-09-17T03:14:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f541e531640 1 --2- 172.21.15.78:0/2266650425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54180cd3e0 0x7f5418151e90 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f541000b9e0 tx=0x7f541000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f540e7fc640 1 -- 172.21.15.78:0/2266650425 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5410003b70 con 0x7f54180cd3e0 2024-09-17T03:14:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f540e7fc640 1 -- 172.21.15.78:0/2266650425 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5410003e00 con 0x7f54180cd3e0 2024-09-17T03:14:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f541ff94640 1 -- 172.21.15.78:0/2266650425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f541806ee90 con 0x7f54180cd3e0 2024-09-17T03:14:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f540e7fc640 1 -- 172.21.15.78:0/2266650425 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f541000cb80 con 0x7f54180cd3e0 2024-09-17T03:14:17.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.367+0000 7f541ff94640 1 -- 172.21.15.78:0/2266650425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f541809c7c0 con 0x7f54180cd3e0 2024-09-17T03:14:17.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.368+0000 7f541ff94640 1 -- 172.21.15.78:0/2266650425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5418070180 con 0x7f54180cd3e0 2024-09-17T03:14:17.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.369+0000 7f540e7fc640 1 -- 172.21.15.78:0/2266650425 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5410004000 con 0x7f54180cd3e0 2024-09-17T03:14:17.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.370+0000 7f540e7fc640 1 --2- 172.21.15.78:0/2266650425 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f53fc078b90 0x7f53fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:17.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.370+0000 7f540e7fc640 1 -- 172.21.15.78:0/2266650425 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f541009aca0 con 0x7f54180cd3e0 2024-09-17T03:14:17.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.370+0000 7f541dd30640 1 --2- 172.21.15.78:0/2266650425 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f53fc078b90 0x7f53fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:17.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.371+0000 7f541dd30640 1 --2- 172.21.15.78:0/2266650425 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f53fc078b90 0x7f53fc07b0a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5414007fd0 tx=0x7f5414009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:17.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.374+0000 7f540e7fc640 1 -- 172.21.15.78:0/2266650425 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5410063080 con 0x7f54180cd3e0 2024-09-17T03:14:17.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.619+0000 7f541ff94640 1 -- 172.21.15.78:0/2266650425 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f54181588a0 con 0x7f54180cd3e0 2024-09-17T03:14:17.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.620+0000 7f540e7fc640 1 -- 172.21.15.78:0/2266650425 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1995 (secure 0 0 0) 0x7f5410062980 con 0x7f54180cd3e0 2024-09-17T03:14:17.619 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:17.619 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":374,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":84,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":706268,"bytes_used":256737280,"bytes_avail":772837376000,"bytes_total":773094113280,"write_bytes_sec":1151,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6640},{"filesystem_id":6,"rank":1,"name":"c","status":"up:active","gid":7425},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7428}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-17T03:14:17.214493+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-17T03:14:17.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.622+0000 7f541ff94640 1 -- 172.21.15.78:0/2266650425 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f53fc078b90 msgr2=0x7f53fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:17.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.622+0000 7f541ff94640 1 --2- 172.21.15.78:0/2266650425 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f53fc078b90 0x7f53fc07b0a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5414007fd0 tx=0x7f5414009040 comp rx=0 tx=0).stop 2024-09-17T03:14:17.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.622+0000 7f541ff94640 1 -- 172.21.15.78:0/2266650425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54180cd3e0 msgr2=0x7f5418151e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:17.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.622+0000 7f541ff94640 1 --2- 172.21.15.78:0/2266650425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54180cd3e0 0x7f5418151e90 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f541000b9e0 tx=0x7f541000bea0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.622+0000 7f541ff94640 1 -- 172.21.15.78:0/2266650425 shutdown_connections 2024-09-17T03:14:17.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.622+0000 7f541ff94640 1 --2- 172.21.15.78:0/2266650425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54180cd3e0 0x7f5418151e90 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.622+0000 7f541ff94640 1 --2- 172.21.15.78:0/2266650425 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f53fc078b90 0x7f53fc07b0a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.622+0000 7f541ff94640 1 --2- 172.21.15.78:0/2266650425 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54180af780 0x7f541806f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.622+0000 7f541ff94640 1 --2- 172.21.15.78:0/2266650425 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f54180706c0 0x7f5418154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:17.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.622+0000 7f541ff94640 1 -- 172.21.15.78:0/2266650425 >> 172.21.15.78:0/2266650425 conn(0x7f541806d7d0 msgr2=0x7f5418157b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:17.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.622+0000 7f541ff94640 1 -- 172.21.15.78:0/2266650425 shutdown_connections 2024-09-17T03:14:17.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:17.622+0000 7f541ff94640 1 -- 172.21.15.78:0/2266650425 wait complete. 2024-09-17T03:14:17.632 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-17T03:14:18.633 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:18.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.758+0000 7f7980af9640 1 -- 172.21.15.78:0/3003559400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f797c0af3c0 msgr2=0x7f797c0b40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:18.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.758+0000 7f7980af9640 1 --2- 172.21.15.78:0/3003559400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f797c0af3c0 0x7f797c0b40b0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f7964009830 tx=0x7f796402a510 comp rx=0 tx=0).stop 2024-09-17T03:14:18.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.758+0000 7f7980af9640 1 -- 172.21.15.78:0/3003559400 shutdown_connections 2024-09-17T03:14:18.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.758+0000 7f7980af9640 1 --2- 172.21.15.78:0/3003559400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f797c0af3c0 0x7f797c0b40b0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.758+0000 7f7980af9640 1 --2- 172.21.15.78:0/3003559400 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f797c0ccb50 0x7f797c0ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.758+0000 7f7980af9640 1 -- 172.21.15.78:0/3003559400 >> 172.21.15.78:0/3003559400 conn(0x7f797c06d7d0 msgr2=0x7f797c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:18.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.758+0000 7f7980af9640 1 -- 172.21.15.78:0/3003559400 shutdown_connections 2024-09-17T03:14:18.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.758+0000 7f7980af9640 1 -- 172.21.15.78:0/3003559400 wait complete. 2024-09-17T03:14:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.760+0000 7f7980af9640 1 Processor -- start 2024-09-17T03:14:18.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.760+0000 7f7980af9640 1 -- start start 2024-09-17T03:14:18.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.762+0000 7f7980af9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f797c0af3c0 0x7f797c152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:18.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.762+0000 7f7980af9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f797c0cc1e0 0x7f797c1f37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:18.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.762+0000 7f7980af9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f797c0ccb50 0x7f797c15eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:18.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.762+0000 7f7980af9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f797c153520 con 0x7f797c0af3c0 2024-09-17T03:14:18.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.762+0000 7f7980af9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f797c1533a0 con 0x7f797c0cc1e0 2024-09-17T03:14:18.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.762+0000 7f7980af9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f797c1536a0 con 0x7f797c0ccb50 2024-09-17T03:14:18.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.762+0000 7f797a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f797c0af3c0 0x7f797c152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:18.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.762+0000 7f797a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f797c0af3c0 0x7f797c152000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52454/0 (socket says 172.21.15.78:52454) 2024-09-17T03:14:18.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.762+0000 7f797a59c640 1 -- 172.21.15.78:0/455227616 learned_addr learned my addr 172.21.15.78:0/455227616 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:18.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.762+0000 7f797ad9d640 1 --2- 172.21.15.78:0/455227616 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f797c0ccb50 0x7f797c15eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:18.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.762+0000 7f797a59c640 1 -- 172.21.15.78:0/455227616 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f797c0ccb50 msgr2=0x7f797c15eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:18.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.762+0000 7f797a59c640 1 --2- 172.21.15.78:0/455227616 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f797c0ccb50 0x7f797c15eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.762+0000 7f797a59c640 1 -- 172.21.15.78:0/455227616 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f797c0cc1e0 msgr2=0x7f797c1f37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:18.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.762+0000 7f797a59c640 1 --2- 172.21.15.78:0/455227616 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f797c0cc1e0 0x7f797c1f37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.762+0000 7f797a59c640 1 -- 172.21.15.78:0/455227616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797c09b4f0 con 0x7f797c0af3c0 2024-09-17T03:14:18.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.762+0000 7f797ad9d640 1 --2- 172.21.15.78:0/455227616 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f797c0ccb50 0x7f797c15eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:18.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.762+0000 7f797a59c640 1 --2- 172.21.15.78:0/455227616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f797c0af3c0 0x7f797c152000 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f796c00c3a0 tx=0x7f796c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:18.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.763+0000 7f79737fe640 1 -- 172.21.15.78:0/455227616 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c011790 con 0x7f797c0af3c0 2024-09-17T03:14:18.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.763+0000 7f79737fe640 1 -- 172.21.15.78:0/455227616 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f796c017070 con 0x7f797c0af3c0 2024-09-17T03:14:18.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.763+0000 7f7980af9640 1 -- 172.21.15.78:0/455227616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797c1f3d20 con 0x7f797c0af3c0 2024-09-17T03:14:18.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.763+0000 7f79737fe640 1 -- 172.21.15.78:0/455227616 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796c011cc0 con 0x7f797c0af3c0 2024-09-17T03:14:18.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.763+0000 7f7980af9640 1 -- 172.21.15.78:0/455227616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f797c09b790 con 0x7f797c0af3c0 2024-09-17T03:14:18.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.764+0000 7f7980af9640 1 -- 172.21.15.78:0/455227616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f797c153b50 con 0x7f797c0af3c0 2024-09-17T03:14:18.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.764+0000 7f79737fe640 1 -- 172.21.15.78:0/455227616 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f796c01c460 con 0x7f797c0af3c0 2024-09-17T03:14:18.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.765+0000 7f79737fe640 1 --2- 172.21.15.78:0/455227616 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7960078bc0 0x7f796007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:18.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.765+0000 7f79737fe640 1 -- 172.21.15.78:0/455227616 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f796c09aa90 con 0x7f797c0af3c0 2024-09-17T03:14:18.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.765+0000 7f7971d9b640 1 --2- 172.21.15.78:0/455227616 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7960078bc0 0x7f796007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:18.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.766+0000 7f7971d9b640 1 --2- 172.21.15.78:0/455227616 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7960078bc0 0x7f796007b0d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7964034000 tx=0x7f79640046c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:18.768 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.770+0000 7f79737fe640 1 -- 172.21.15.78:0/455227616 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f797c0cd4a0 con 0x7f797c0af3c0 2024-09-17T03:14:18.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.978+0000 7f7980af9640 1 -- 172.21.15.78:0/455227616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f797c0b07b0 con 0x7f797c0af3c0 2024-09-17T03:14:18.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.979+0000 7f79737fe640 1 -- 172.21.15.78:0/455227616 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5278 (secure 0 0 0) 0x7f796c062fb0 con 0x7f797c0af3c0 2024-09-17T03:14:18.979 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:18.979 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:35.489582+0000","modified":"2024-09-17T03:14:08.415660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7428,"mds_1":7425,"mds_2":6640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"d","rank":2,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/1005450673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1005450673},{"type":"v1","addr":"172.21.15.193:6837","nonce":1005450673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7425":{"gid":7425,"name":"c","rank":1,"incarnation":78,"state":"up:active","state_seq":10,"addr":"172.21.15.78:6835/4018023271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4018023271},{"type":"v1","addr":"172.21.15.78:6835","nonce":4018023271}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6832/3357123265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":3357123265},{"type":"v1","addr":"172.21.15.78:6832","nonce":3357123265}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7428,"qdb_cluster":[6640,7425,7428]},"id":6}]} 2024-09-17T03:14:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 85 2024-09-17T03:14:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.981+0000 7f7980af9640 1 -- 172.21.15.78:0/455227616 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7960078bc0 msgr2=0x7f796007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:18.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.981+0000 7f7980af9640 1 --2- 172.21.15.78:0/455227616 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7960078bc0 0x7f796007b0d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7964034000 tx=0x7f79640046c0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.981+0000 7f7980af9640 1 -- 172.21.15.78:0/455227616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f797c0af3c0 msgr2=0x7f797c152000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.981+0000 7f7980af9640 1 --2- 172.21.15.78:0/455227616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f797c0af3c0 0x7f797c152000 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f796c00c3a0 tx=0x7f796c00c860 comp rx=0 tx=0).stop 2024-09-17T03:14:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.981+0000 7f7980af9640 1 -- 172.21.15.78:0/455227616 shutdown_connections 2024-09-17T03:14:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.981+0000 7f7980af9640 1 --2- 172.21.15.78:0/455227616 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f797c0ccb50 0x7f797c15eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.981+0000 7f7980af9640 1 --2- 172.21.15.78:0/455227616 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7960078bc0 0x7f796007b0d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.981+0000 7f7980af9640 1 --2- 172.21.15.78:0/455227616 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f797c0cc1e0 0x7f797c1f37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.981+0000 7f7980af9640 1 --2- 172.21.15.78:0/455227616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f797c0af3c0 0x7f797c152000 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:18.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.981+0000 7f7980af9640 1 -- 172.21.15.78:0/455227616 >> 172.21.15.78:0/455227616 conn(0x7f797c06d7d0 msgr2=0x7f797c0ce790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:18.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.981+0000 7f7980af9640 1 -- 172.21.15.78:0/455227616 shutdown_connections 2024-09-17T03:14:18.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:18.981+0000 7f7980af9640 1 -- 172.21.15.78:0/455227616 wait complete. 2024-09-17T03:14:18.992 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-17T03:14:18.992 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:14:19.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.105+0000 7f83db3df640 1 -- 172.21.15.78:0/2670726322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d40ccba0 msgr2=0x7f83d40ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:19.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.105+0000 7f83db3df640 1 --2- 172.21.15.78:0/2670726322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d40ccba0 0x7f83d40ccfb0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f83d4070810 tx=0x7f83cc02aac0 comp rx=0 tx=0).stop 2024-09-17T03:14:19.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.105+0000 7f83db3df640 1 -- 172.21.15.78:0/2670726322 shutdown_connections 2024-09-17T03:14:19.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.105+0000 7f83db3df640 1 --2- 172.21.15.78:0/2670726322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d40ccba0 0x7f83d40ccfb0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:19.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.105+0000 7f83db3df640 1 --2- 172.21.15.78:0/2670726322 >> v2:172.21.15.193:3300/0 conn(0x7f83d40d1d40 0x7f83d40b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:19.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.105+0000 7f83db3df640 1 -- 172.21.15.78:0/2670726322 >> 172.21.15.78:0/2670726322 conn(0x7f83d40b3f10 msgr2=0x7f83d40b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:19.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.105+0000 7f83db3df640 1 -- 172.21.15.78:0/2670726322 shutdown_connections 2024-09-17T03:14:19.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.105+0000 7f83db3df640 1 -- 172.21.15.78:0/2670726322 wait complete. 2024-09-17T03:14:19.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.107+0000 7f83db3df640 1 Processor -- start 2024-09-17T03:14:19.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.107+0000 7f83db3df640 1 -- start start 2024-09-17T03:14:19.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.108+0000 7f83db3df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d40ccba0 0x7f83d4152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:19.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.108+0000 7f83db3df640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83d40d1d40 0x7f83d4155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:19.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.108+0000 7f83db3df640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83d415c6f0 0x7f83d4155960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:19.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.108+0000 7f83db3df640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f83d40d11f0 con 0x7f83d40ccba0 2024-09-17T03:14:19.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.108+0000 7f83db3df640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f83d40d1070 con 0x7f83d415c6f0 2024-09-17T03:14:19.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.108+0000 7f83db3df640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f83d40d1370 con 0x7f83d40d1d40 2024-09-17T03:14:19.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.109+0000 7f83d917b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d40ccba0 0x7f83d4152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:19.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.109+0000 7f83d917b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d40ccba0 0x7f83d4152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52466/0 (socket says 172.21.15.78:52466) 2024-09-17T03:14:19.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.109+0000 7f83d917b640 1 -- 172.21.15.78:0/1637993350 learned_addr learned my addr 172.21.15.78:0/1637993350 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:19.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.109+0000 7f83d997c640 1 --2- 172.21.15.78:0/1637993350 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83d415c6f0 0x7f83d4155960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:19.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.109+0000 7f83d897a640 1 --2- 172.21.15.78:0/1637993350 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83d40d1d40 0x7f83d4155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:19.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.109+0000 7f83d917b640 1 -- 172.21.15.78:0/1637993350 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83d40d1d40 msgr2=0x7f83d4155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:19.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.109+0000 7f83d917b640 1 --2- 172.21.15.78:0/1637993350 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83d40d1d40 0x7f83d4155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:19.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.109+0000 7f83d917b640 1 -- 172.21.15.78:0/1637993350 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83d415c6f0 msgr2=0x7f83d4155960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:19.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.109+0000 7f83d917b640 1 --2- 172.21.15.78:0/1637993350 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83d415c6f0 0x7f83d4155960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:19.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.109+0000 7f83d917b640 1 -- 172.21.15.78:0/1637993350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d4153250 con 0x7f83d40ccba0 2024-09-17T03:14:19.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.109+0000 7f83d917b640 1 --2- 172.21.15.78:0/1637993350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d40ccba0 0x7f83d4152d10 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f83d000d740 tx=0x7f83d000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:19.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.109+0000 7f83c9ffb640 1 -- 172.21.15.78:0/1637993350 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d0017070 con 0x7f83d40ccba0 2024-09-17T03:14:19.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.109+0000 7f83c9ffb640 1 -- 172.21.15.78:0/1637993350 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83d0009d20 con 0x7f83d40ccba0 2024-09-17T03:14:19.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.109+0000 7f83db3df640 1 -- 172.21.15.78:0/1637993350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d40b0af0 con 0x7f83d40ccba0 2024-09-17T03:14:19.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.109+0000 7f83c9ffb640 1 -- 172.21.15.78:0/1637993350 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d00106c0 con 0x7f83d40ccba0 2024-09-17T03:14:19.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.109+0000 7f83db3df640 1 -- 172.21.15.78:0/1637993350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d4157630 con 0x7f83d40ccba0 2024-09-17T03:14:19.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.110+0000 7f83db3df640 1 -- 172.21.15.78:0/1637993350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83d40d18c0 con 0x7f83d40ccba0 2024-09-17T03:14:19.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.111+0000 7f83c9ffb640 1 -- 172.21.15.78:0/1637993350 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f83d001a070 con 0x7f83d40ccba0 2024-09-17T03:14:19.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.112+0000 7f83c9ffb640 1 --2- 172.21.15.78:0/1637993350 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f83b8078b90 0x7f83b807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:19.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.112+0000 7f83c9ffb640 1 -- 172.21.15.78:0/1637993350 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f83d009aec0 con 0x7f83d40ccba0 2024-09-17T03:14:19.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.112+0000 7f83d897a640 1 --2- 172.21.15.78:0/1637993350 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f83b8078b90 0x7f83b807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:19.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.112+0000 7f83d897a640 1 --2- 172.21.15.78:0/1637993350 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f83b8078b90 0x7f83b807b0a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f83d40ccb70 tx=0x7f83c4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:19.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.116+0000 7f83c9ffb640 1 -- 172.21.15.78:0/1637993350 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f83d0063350 con 0x7f83d40ccba0 2024-09-17T03:14:19.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.357+0000 7f83db3df640 1 -- 172.21.15.78:0/1637993350 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f83d40b5ae0 con 0x7f83d40ccba0 2024-09-17T03:14:19.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.357+0000 7f83c9ffb640 1 -- 172.21.15.78:0/1637993350 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1995 (secure 0 0 0) 0x7f83d0062c50 con 0x7f83d40ccba0 2024-09-17T03:14:19.357 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:19.357 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":376,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":84,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":706268,"bytes_used":256737280,"bytes_avail":772837376000,"bytes_total":773094113280,"write_bytes_sec":1151,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6640},{"filesystem_id":6,"rank":1,"name":"c","status":"up:active","gid":7425},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7428}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":25,"modified":"2024-09-17T03:14:17.214493+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-17T03:14:19.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.360+0000 7f83db3df640 1 -- 172.21.15.78:0/1637993350 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f83b8078b90 msgr2=0x7f83b807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:19.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.360+0000 7f83db3df640 1 --2- 172.21.15.78:0/1637993350 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f83b8078b90 0x7f83b807b0a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f83d40ccb70 tx=0x7f83c4009040 comp rx=0 tx=0).stop 2024-09-17T03:14:19.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.360+0000 7f83db3df640 1 -- 172.21.15.78:0/1637993350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d40ccba0 msgr2=0x7f83d4152d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:19.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.360+0000 7f83db3df640 1 --2- 172.21.15.78:0/1637993350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d40ccba0 0x7f83d4152d10 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f83d000d740 tx=0x7f83d000dc00 comp rx=0 tx=0).stop 2024-09-17T03:14:19.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.360+0000 7f83db3df640 1 -- 172.21.15.78:0/1637993350 shutdown_connections 2024-09-17T03:14:19.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.360+0000 7f83db3df640 1 --2- 172.21.15.78:0/1637993350 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f83b8078b90 0x7f83b807b0a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:19.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.360+0000 7f83db3df640 1 --2- 172.21.15.78:0/1637993350 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83d415c6f0 0x7f83d4155960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:19.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.360+0000 7f83db3df640 1 --2- 172.21.15.78:0/1637993350 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83d40d1d40 0x7f83d4155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:19.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.360+0000 7f83db3df640 1 --2- 172.21.15.78:0/1637993350 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83d40ccba0 0x7f83d4152d10 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:19.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.360+0000 7f83db3df640 1 -- 172.21.15.78:0/1637993350 >> 172.21.15.78:0/1637993350 conn(0x7f83d40b3f10 msgr2=0x7f83d40d22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:19.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.360+0000 7f83db3df640 1 -- 172.21.15.78:0/1637993350 shutdown_connections 2024-09-17T03:14:19.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:19.360+0000 7f83db3df640 1 -- 172.21.15.78:0/1637993350 wait complete. 2024-09-17T03:14:19.370 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-17T03:14:20.370 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:20.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.497+0000 7fb78147e640 1 -- 172.21.15.78:0/4016135496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb77c0cf5d0 msgr2=0x7fb77c0cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:20.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.497+0000 7fb78147e640 1 --2- 172.21.15.78:0/4016135496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb77c0cf5d0 0x7fb77c0cf9e0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fb774005fd0 tx=0x7fb77402a530 comp rx=0 tx=0).stop 2024-09-17T03:14:20.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.497+0000 7fb78147e640 1 -- 172.21.15.78:0/4016135496 shutdown_connections 2024-09-17T03:14:20.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.497+0000 7fb78147e640 1 --2- 172.21.15.78:0/4016135496 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb77c0cf5d0 0x7fb77c0cf9e0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.497+0000 7fb78147e640 1 --2- 172.21.15.78:0/4016135496 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb77c0d1a80 0x7fb77c0cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.497+0000 7fb78147e640 1 -- 172.21.15.78:0/4016135496 >> 172.21.15.78:0/4016135496 conn(0x7fb77c08bfc0 msgr2=0x7fb77c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.497+0000 7fb78147e640 1 -- 172.21.15.78:0/4016135496 shutdown_connections 2024-09-17T03:14:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.497+0000 7fb78147e640 1 -- 172.21.15.78:0/4016135496 wait complete. 2024-09-17T03:14:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.499+0000 7fb78147e640 1 Processor -- start 2024-09-17T03:14:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.499+0000 7fb78147e640 1 -- start start 2024-09-17T03:14:20.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.500+0000 7fb78147e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb77c0cf5d0 0x7fb77c0ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:20.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.500+0000 7fb78147e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb77c0d1a80 0x7fb77c14ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:20.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.500+0000 7fb78147e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb77c0d2ed0 0x7fb77c14f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:20.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.500+0000 7fb78147e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c162cb0 con 0x7fb77c0d2ed0 2024-09-17T03:14:20.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.500+0000 7fb78147e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c162b30 con 0x7fb77c0d1a80 2024-09-17T03:14:20.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.500+0000 7fb78147e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb77c162e30 con 0x7fb77c0cf5d0 2024-09-17T03:14:20.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.500+0000 7fb77b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb77c0d2ed0 0x7fb77c14f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:20.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.500+0000 7fb77b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb77c0d2ed0 0x7fb77c14f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52484/0 (socket says 172.21.15.78:52484) 2024-09-17T03:14:20.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.500+0000 7fb77b7fe640 1 -- 172.21.15.78:0/2362038199 learned_addr learned my addr 172.21.15.78:0/2362038199 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:20.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.500+0000 7fb77affd640 1 --2- 172.21.15.78:0/2362038199 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb77c0cf5d0 0x7fb77c0ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:20.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.500+0000 7fb77a7fc640 1 --2- 172.21.15.78:0/2362038199 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb77c0d1a80 0x7fb77c14ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:20.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.501+0000 7fb77b7fe640 1 -- 172.21.15.78:0/2362038199 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb77c0cf5d0 msgr2=0x7fb77c0ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:20.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.501+0000 7fb77b7fe640 1 --2- 172.21.15.78:0/2362038199 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb77c0cf5d0 0x7fb77c0ca7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.501+0000 7fb77b7fe640 1 -- 172.21.15.78:0/2362038199 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb77c0d1a80 msgr2=0x7fb77c14ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:20.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.501+0000 7fb77b7fe640 1 --2- 172.21.15.78:0/2362038199 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb77c0d1a80 0x7fb77c14ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.501+0000 7fb77b7fe640 1 -- 172.21.15.78:0/2362038199 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77c14cbd0 con 0x7fb77c0d2ed0 2024-09-17T03:14:20.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.501+0000 7fb77b7fe640 1 --2- 172.21.15.78:0/2362038199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb77c0d2ed0 0x7fb77c14f4b0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fb774006010 tx=0x7fb774003890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:20.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.501+0000 7fb7737fe640 1 -- 172.21.15.78:0/2362038199 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb77403e030 con 0x7fb77c0d2ed0 2024-09-17T03:14:20.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.501+0000 7fb7737fe640 1 -- 172.21.15.78:0/2362038199 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb774003d80 con 0x7fb77c0d2ed0 2024-09-17T03:14:20.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.501+0000 7fb7737fe640 1 -- 172.21.15.78:0/2362038199 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774035040 con 0x7fb77c0d2ed0 2024-09-17T03:14:20.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.501+0000 7fb78147e640 1 -- 172.21.15.78:0/2362038199 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb77c0c92a0 con 0x7fb77c0d2ed0 2024-09-17T03:14:20.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.501+0000 7fb78147e640 1 -- 172.21.15.78:0/2362038199 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb77c0c9860 con 0x7fb77c0d2ed0 2024-09-17T03:14:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.502+0000 7fb78147e640 1 -- 172.21.15.78:0/2362038199 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb77c163400 con 0x7fb77c0d2ed0 2024-09-17T03:14:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.503+0000 7fb7737fe640 1 -- 172.21.15.78:0/2362038199 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb774041030 con 0x7fb77c0d2ed0 2024-09-17T03:14:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.503+0000 7fb7737fe640 1 --2- 172.21.15.78:0/2362038199 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb75c078b90 0x7fb75c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.504+0000 7fb7737fe640 1 -- 172.21.15.78:0/2362038199 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7fb7740bb870 con 0x7fb77c0d2ed0 2024-09-17T03:14:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.504+0000 7fb77affd640 1 --2- 172.21.15.78:0/2362038199 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb75c078b90 0x7fb75c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:20.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.504+0000 7fb77affd640 1 --2- 172.21.15.78:0/2362038199 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb75c078b90 0x7fb75c07b0a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00b450 tx=0x7fb76c00d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:20.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.508+0000 7fb7737fe640 1 -- 172.21.15.78:0/2362038199 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb774083620 con 0x7fb77c0d2ed0 2024-09-17T03:14:20.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.718+0000 7fb78147e640 1 -- 172.21.15.78:0/2362038199 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb77c0b4020 con 0x7fb77c0d2ed0 2024-09-17T03:14:20.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.718+0000 7fb7737fe640 1 -- 172.21.15.78:0/2362038199 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5278 (secure 0 0 0) 0x7fb774088050 con 0x7fb77c0d2ed0 2024-09-17T03:14:20.717 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:20.718 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:35.489582+0000","modified":"2024-09-17T03:14:08.415660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7428,"mds_1":7425,"mds_2":6640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"d","rank":2,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/1005450673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1005450673},{"type":"v1","addr":"172.21.15.193:6837","nonce":1005450673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7425":{"gid":7425,"name":"c","rank":1,"incarnation":78,"state":"up:active","state_seq":10,"addr":"172.21.15.78:6835/4018023271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4018023271},{"type":"v1","addr":"172.21.15.78:6835","nonce":4018023271}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6832/3357123265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":3357123265},{"type":"v1","addr":"172.21.15.78:6832","nonce":3357123265}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7428,"qdb_cluster":[6640,7425,7428]},"id":6}]} 2024-09-17T03:14:20.718 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 85 2024-09-17T03:14:20.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.721+0000 7fb78147e640 1 -- 172.21.15.78:0/2362038199 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb75c078b90 msgr2=0x7fb75c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:20.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.721+0000 7fb78147e640 1 --2- 172.21.15.78:0/2362038199 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb75c078b90 0x7fb75c07b0a0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00b450 tx=0x7fb76c00d040 comp rx=0 tx=0).stop 2024-09-17T03:14:20.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.721+0000 7fb78147e640 1 -- 172.21.15.78:0/2362038199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb77c0d2ed0 msgr2=0x7fb77c14f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:20.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.721+0000 7fb78147e640 1 --2- 172.21.15.78:0/2362038199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb77c0d2ed0 0x7fb77c14f4b0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fb774006010 tx=0x7fb774003890 comp rx=0 tx=0).stop 2024-09-17T03:14:20.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.721+0000 7fb78147e640 1 -- 172.21.15.78:0/2362038199 shutdown_connections 2024-09-17T03:14:20.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.721+0000 7fb78147e640 1 --2- 172.21.15.78:0/2362038199 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb77c0d2ed0 0x7fb77c14f4b0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.721+0000 7fb78147e640 1 --2- 172.21.15.78:0/2362038199 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb75c078b90 0x7fb75c07b0a0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.721+0000 7fb78147e640 1 --2- 172.21.15.78:0/2362038199 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb77c0d1a80 0x7fb77c14ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.721+0000 7fb78147e640 1 --2- 172.21.15.78:0/2362038199 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb77c0cf5d0 0x7fb77c0ca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.721+0000 7fb78147e640 1 -- 172.21.15.78:0/2362038199 >> 172.21.15.78:0/2362038199 conn(0x7fb77c08bfc0 msgr2=0x7fb77c06e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:20.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.721+0000 7fb78147e640 1 -- 172.21.15.78:0/2362038199 shutdown_connections 2024-09-17T03:14:20.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.721+0000 7fb78147e640 1 -- 172.21.15.78:0/2362038199 wait complete. 2024-09-17T03:14:20.731 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-17T03:14:20.731 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:14:20.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.843+0000 7fb2b735f640 1 -- 172.21.15.78:0/2195586541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2b00b7cc0 msgr2=0x7fb2b00d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:20.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.843+0000 7fb2b735f640 1 --2- 172.21.15.78:0/2195586541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2b00b7cc0 0x7fb2b00d0980 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00ce1b0 tx=0x7fb2a802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.843+0000 7fb2b735f640 1 -- 172.21.15.78:0/2195586541 shutdown_connections 2024-09-17T03:14:20.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.843+0000 7fb2b735f640 1 --2- 172.21.15.78:0/2195586541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2b00b7cc0 0x7fb2b00d0980 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.843+0000 7fb2b735f640 1 --2- 172.21.15.78:0/2195586541 >> v2:172.21.15.193:3300/0 conn(0x7fb2b00cf320 0x7fb2b00ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.843+0000 7fb2b735f640 1 -- 172.21.15.78:0/2195586541 >> 172.21.15.78:0/2195586541 conn(0x7fb2b006d4f0 msgr2=0x7fb2b0071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.843+0000 7fb2b735f640 1 -- 172.21.15.78:0/2195586541 shutdown_connections 2024-09-17T03:14:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.843+0000 7fb2b735f640 1 -- 172.21.15.78:0/2195586541 wait complete. 2024-09-17T03:14:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.845+0000 7fb2b735f640 1 Processor -- start 2024-09-17T03:14:20.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.845+0000 7fb2b735f640 1 -- start start 2024-09-17T03:14:20.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.846+0000 7fb2b735f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2b00b7cc0 0x7fb2b0153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:20.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.846+0000 7fb2b735f640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb2b00cf320 0x7fb2b015ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:20.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.846+0000 7fb2b735f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2b01600b0 0x7fb2b015f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:20.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.846+0000 7fb2b735f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b00d13c0 con 0x7fb2b01600b0 2024-09-17T03:14:20.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.846+0000 7fb2b735f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b00d1240 con 0x7fb2b00b7cc0 2024-09-17T03:14:20.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.846+0000 7fb2b735f640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb2b00d1540 con 0x7fb2b00cf320 2024-09-17T03:14:20.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.846+0000 7fb2b58fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2b01600b0 0x7fb2b015f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:20.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.846+0000 7fb2b58fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2b01600b0 0x7fb2b015f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52506/0 (socket says 172.21.15.78:52506) 2024-09-17T03:14:20.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.846+0000 7fb2b58fc640 1 -- 172.21.15.78:0/2546382168 learned_addr learned my addr 172.21.15.78:0/2546382168 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:20.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.846+0000 7fb2b50fb640 1 --2- 172.21.15.78:0/2546382168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2b00b7cc0 0x7fb2b0153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:20.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.846+0000 7fb2b48fa640 1 --2- 172.21.15.78:0/2546382168 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb2b00cf320 0x7fb2b015ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:20.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.846+0000 7fb2b58fc640 1 -- 172.21.15.78:0/2546382168 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb2b00cf320 msgr2=0x7fb2b015ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:20.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.846+0000 7fb2b58fc640 1 --2- 172.21.15.78:0/2546382168 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb2b00cf320 0x7fb2b015ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.846+0000 7fb2b58fc640 1 -- 172.21.15.78:0/2546382168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2b00b7cc0 msgr2=0x7fb2b0153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:20.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.846+0000 7fb2b58fc640 1 --2- 172.21.15.78:0/2546382168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2b00b7cc0 0x7fb2b0153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:20.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.846+0000 7fb2b58fc640 1 -- 172.21.15.78:0/2546382168 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b0153ec0 con 0x7fb2b01600b0 2024-09-17T03:14:20.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.846+0000 7fb2b50fb640 1 --2- 172.21.15.78:0/2546382168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2b00b7cc0 0x7fb2b0153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:20.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.847+0000 7fb2b58fc640 1 --2- 172.21.15.78:0/2546382168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2b01600b0 0x7fb2b015f480 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fb2a802aea0 tx=0x7fb2a8003990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:20.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.847+0000 7fb2a5ffb640 1 -- 172.21.15.78:0/2546382168 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8031990 con 0x7fb2b01600b0 2024-09-17T03:14:20.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.847+0000 7fb2a5ffb640 1 -- 172.21.15.78:0/2546382168 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2a8031c20 con 0x7fb2b01600b0 2024-09-17T03:14:20.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.847+0000 7fb2b735f640 1 -- 172.21.15.78:0/2546382168 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b00cb4e0 con 0x7fb2b01600b0 2024-09-17T03:14:20.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.847+0000 7fb2a5ffb640 1 -- 172.21.15.78:0/2546382168 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8033070 con 0x7fb2b01600b0 2024-09-17T03:14:20.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.847+0000 7fb2b735f640 1 -- 172.21.15.78:0/2546382168 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b00cbaa0 con 0x7fb2b01600b0 2024-09-17T03:14:20.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.848+0000 7fb2b735f640 1 -- 172.21.15.78:0/2546382168 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2b00d1a60 con 0x7fb2b01600b0 2024-09-17T03:14:20.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.849+0000 7fb2a5ffb640 1 -- 172.21.15.78:0/2546382168 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb2a8033230 con 0x7fb2b01600b0 2024-09-17T03:14:20.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.849+0000 7fb2a5ffb640 1 --2- 172.21.15.78:0/2546382168 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb294078bc0 0x7fb29407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:20.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.849+0000 7fb2a5ffb640 1 -- 172.21.15.78:0/2546382168 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7fb2a80bc320 con 0x7fb2b01600b0 2024-09-17T03:14:20.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.850+0000 7fb2b50fb640 1 --2- 172.21.15.78:0/2546382168 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb294078bc0 0x7fb29407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:20.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.850+0000 7fb2b50fb640 1 --2- 172.21.15.78:0/2546382168 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb294078bc0 0x7fb29407b0d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac0016a0 tx=0x7fb2ac009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:20.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:20.854+0000 7fb2a5ffb640 1 -- 172.21.15.78:0/2546382168 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb2b0153ec0 con 0x7fb2b01600b0 2024-09-17T03:14:21.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:21.095+0000 7fb2b735f640 1 -- 172.21.15.78:0/2546382168 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb2b00716c0 con 0x7fb2b01600b0 2024-09-17T03:14:21.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:21.095+0000 7fb2a5ffb640 1 -- 172.21.15.78:0/2546382168 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2006 (secure 0 0 0) 0x7fb2a803f030 con 0x7fb2b01600b0 2024-09-17T03:14:21.094 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:21.094 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":378,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":84,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":706268,"bytes_used":256737280,"bytes_avail":772837376000,"bytes_total":773094113280,"write_bytes_sec":945,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6640},{"filesystem_id":6,"rank":1,"name":"c","status":"up:active","gid":7425},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7428}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-17T03:14:19.215080+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-17T03:14:21.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:21.097+0000 7fb2b735f640 1 -- 172.21.15.78:0/2546382168 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb294078bc0 msgr2=0x7fb29407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:21.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:21.097+0000 7fb2b735f640 1 --2- 172.21.15.78:0/2546382168 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb294078bc0 0x7fb29407b0d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac0016a0 tx=0x7fb2ac009040 comp rx=0 tx=0).stop 2024-09-17T03:14:21.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:21.097+0000 7fb2b735f640 1 -- 172.21.15.78:0/2546382168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2b01600b0 msgr2=0x7fb2b015f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:21.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:21.097+0000 7fb2b735f640 1 --2- 172.21.15.78:0/2546382168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2b01600b0 0x7fb2b015f480 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fb2a802aea0 tx=0x7fb2a8003990 comp rx=0 tx=0).stop 2024-09-17T03:14:21.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:21.097+0000 7fb2b735f640 1 -- 172.21.15.78:0/2546382168 shutdown_connections 2024-09-17T03:14:21.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:21.097+0000 7fb2b735f640 1 --2- 172.21.15.78:0/2546382168 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2b01600b0 0x7fb2b015f480 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:21.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:21.097+0000 7fb2b735f640 1 --2- 172.21.15.78:0/2546382168 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb2b00cf320 0x7fb2b015ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:21.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:21.097+0000 7fb2b735f640 1 --2- 172.21.15.78:0/2546382168 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb294078bc0 0x7fb29407b0d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:21.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:21.097+0000 7fb2b735f640 1 --2- 172.21.15.78:0/2546382168 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2b00b7cc0 0x7fb2b0153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:21.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:21.097+0000 7fb2b735f640 1 -- 172.21.15.78:0/2546382168 >> 172.21.15.78:0/2546382168 conn(0x7fb2b006d4f0 msgr2=0x7fb2b00b7330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:21.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:21.097+0000 7fb2b735f640 1 -- 172.21.15.78:0/2546382168 shutdown_connections 2024-09-17T03:14:21.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:21.097+0000 7fb2b735f640 1 -- 172.21.15.78:0/2546382168 wait complete. 2024-09-17T03:14:21.107 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'idle+waiting paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]', 'd': 'idle+waiting paths [/d1/d2/d3]'} 2024-09-17T03:14:22.108 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:22.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.229+0000 7f7dcd919640 1 -- 172.21.15.78:0/198260876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db0004800 msgr2=0x7f7db0004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:22.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.229+0000 7f7dcd919640 1 --2- 172.21.15.78:0/198260876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db0004800 0x7f7db0004c10 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f7dc80d1c00 tx=0x7f7db0005830 comp rx=0 tx=0).stop 2024-09-17T03:14:22.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.229+0000 7f7dcd919640 1 -- 172.21.15.78:0/198260876 shutdown_connections 2024-09-17T03:14:22.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.229+0000 7f7dcd919640 1 --2- 172.21.15.78:0/198260876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7db0004800 0x7f7db0004c10 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.229+0000 7f7dcd919640 1 -- 172.21.15.78:0/198260876 >> 172.21.15.78:0/198260876 conn(0x7f7dc808bfc0 msgr2=0x7f7dc809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:22.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.229+0000 7f7dcd919640 1 -- 172.21.15.78:0/198260876 shutdown_connections 2024-09-17T03:14:22.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.229+0000 7f7dcd919640 1 -- 172.21.15.78:0/198260876 wait complete. 2024-09-17T03:14:22.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.231+0000 7f7dcd919640 1 Processor -- start 2024-09-17T03:14:22.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.231+0000 7f7dcd919640 1 -- start start 2024-09-17T03:14:22.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7dcd919640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7db0004800 0x7f7dc8150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:22.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7dcd919640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dc815f4a0 0x7f7dc80b2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:22.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7dcd919640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7dc80b2ab0 0x7f7dc80b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:22.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7dcd919640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc80d34b0 con 0x7f7dc815f4a0 2024-09-17T03:14:22.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7dcd919640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc80d3330 con 0x7f7dc80b2ab0 2024-09-17T03:14:22.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7dcd919640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7dc80d3630 con 0x7f7db0004800 2024-09-17T03:14:22.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7dc67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dc815f4a0 0x7f7dc80b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:22.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7dc67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dc815f4a0 0x7f7dc80b2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52538/0 (socket says 172.21.15.78:52538) 2024-09-17T03:14:22.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7dc67fc640 1 -- 172.21.15.78:0/3387524222 learned_addr learned my addr 172.21.15.78:0/3387524222 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:22.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7dc77fe640 1 --2- 172.21.15.78:0/3387524222 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7dc80b2ab0 0x7f7dc80b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:22.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7dc6ffd640 1 --2- 172.21.15.78:0/3387524222 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7db0004800 0x7f7dc8150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:22.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7dc67fc640 1 -- 172.21.15.78:0/3387524222 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7db0004800 msgr2=0x7f7dc8150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:22.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7dc67fc640 1 --2- 172.21.15.78:0/3387524222 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7db0004800 0x7f7dc8150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7dc67fc640 1 -- 172.21.15.78:0/3387524222 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7dc80b2ab0 msgr2=0x7f7dc80b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:22.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7dc67fc640 1 --2- 172.21.15.78:0/3387524222 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7dc80b2ab0 0x7f7dc80b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7dc67fc640 1 -- 172.21.15.78:0/3387524222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc80b2ec0 con 0x7f7dc815f4a0 2024-09-17T03:14:22.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7dc77fe640 1 --2- 172.21.15.78:0/3387524222 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7dc80b2ab0 0x7f7dc80b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:22.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7dc67fc640 1 --2- 172.21.15.78:0/3387524222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dc815f4a0 0x7f7dc80b2570 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f7db802b000 tx=0x7f7db8003e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:22.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7daffff640 1 -- 172.21.15.78:0/3387524222 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db8005020 con 0x7f7dc815f4a0 2024-09-17T03:14:22.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7daffff640 1 -- 172.21.15.78:0/3387524222 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7db80052b0 con 0x7f7dc815f4a0 2024-09-17T03:14:22.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7dcd919640 1 -- 172.21.15.78:0/3387524222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc80cde20 con 0x7f7dc815f4a0 2024-09-17T03:14:22.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7daffff640 1 -- 172.21.15.78:0/3387524222 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db80047a0 con 0x7f7dc815f4a0 2024-09-17T03:14:22.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.233+0000 7f7dcd919640 1 -- 172.21.15.78:0/3387524222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc80ce3e0 con 0x7f7dc815f4a0 2024-09-17T03:14:22.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.235+0000 7f7dcd919640 1 -- 172.21.15.78:0/3387524222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dc806f830 con 0x7f7dc815f4a0 2024-09-17T03:14:22.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.235+0000 7f7daffff640 1 -- 172.21.15.78:0/3387524222 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7db8004940 con 0x7f7dc815f4a0 2024-09-17T03:14:22.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.235+0000 7f7daffff640 1 --2- 172.21.15.78:0/3387524222 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7db4078b90 0x7f7db407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:22.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.236+0000 7f7daffff640 1 -- 172.21.15.78:0/3387524222 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f7db80bc530 con 0x7f7dc815f4a0 2024-09-17T03:14:22.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.236+0000 7f7dc6ffd640 1 --2- 172.21.15.78:0/3387524222 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7db4078b90 0x7f7db407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:22.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.236+0000 7f7dc6ffd640 1 --2- 172.21.15.78:0/3387524222 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7db4078b90 0x7f7db407b0a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc001f80 tx=0x7f7dbc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:22.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.240+0000 7f7daffff640 1 -- 172.21.15.78:0/3387524222 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7dc80b2ec0 con 0x7f7dc815f4a0 2024-09-17T03:14:22.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.447+0000 7f7dcd919640 1 -- 172.21.15.78:0/3387524222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7dc80b7fc0 con 0x7f7dc815f4a0 2024-09-17T03:14:22.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.448+0000 7f7daffff640 1 -- 172.21.15.78:0/3387524222 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5278 (secure 0 0 0) 0x7f7db803f030 con 0x7f7dc815f4a0 2024-09-17T03:14:22.447 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:22.447 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:35.489582+0000","modified":"2024-09-17T03:14:08.415660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7428,"mds_1":7425,"mds_2":6640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"d","rank":2,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/1005450673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1005450673},{"type":"v1","addr":"172.21.15.193:6837","nonce":1005450673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7425":{"gid":7425,"name":"c","rank":1,"incarnation":78,"state":"up:active","state_seq":10,"addr":"172.21.15.78:6835/4018023271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4018023271},{"type":"v1","addr":"172.21.15.78:6835","nonce":4018023271}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6832/3357123265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":3357123265},{"type":"v1","addr":"172.21.15.78:6832","nonce":3357123265}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7428,"qdb_cluster":[6640,7425,7428]},"id":6}]} 2024-09-17T03:14:22.447 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 85 2024-09-17T03:14:22.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.450+0000 7f7dcd919640 1 -- 172.21.15.78:0/3387524222 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7db4078b90 msgr2=0x7f7db407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:22.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.450+0000 7f7dcd919640 1 --2- 172.21.15.78:0/3387524222 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7db4078b90 0x7f7db407b0a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc001f80 tx=0x7f7dbc009040 comp rx=0 tx=0).stop 2024-09-17T03:14:22.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.450+0000 7f7dcd919640 1 -- 172.21.15.78:0/3387524222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dc815f4a0 msgr2=0x7f7dc80b2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:22.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.450+0000 7f7dcd919640 1 --2- 172.21.15.78:0/3387524222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dc815f4a0 0x7f7dc80b2570 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f7db802b000 tx=0x7f7db8003e40 comp rx=0 tx=0).stop 2024-09-17T03:14:22.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.450+0000 7f7dcd919640 1 -- 172.21.15.78:0/3387524222 shutdown_connections 2024-09-17T03:14:22.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.450+0000 7f7dcd919640 1 --2- 172.21.15.78:0/3387524222 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7db4078b90 0x7f7db407b0a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.450+0000 7f7dcd919640 1 --2- 172.21.15.78:0/3387524222 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7dc80b2ab0 0x7f7dc80b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.450+0000 7f7dcd919640 1 --2- 172.21.15.78:0/3387524222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dc815f4a0 0x7f7dc80b2570 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.450+0000 7f7dcd919640 1 --2- 172.21.15.78:0/3387524222 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7db0004800 0x7f7dc8150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.450+0000 7f7dcd919640 1 -- 172.21.15.78:0/3387524222 >> 172.21.15.78:0/3387524222 conn(0x7f7dc808bfc0 msgr2=0x7f7dc80b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:22.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.450+0000 7f7dcd919640 1 -- 172.21.15.78:0/3387524222 shutdown_connections 2024-09-17T03:14:22.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.450+0000 7f7dcd919640 1 -- 172.21.15.78:0/3387524222 wait complete. 2024-09-17T03:14:22.460 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-17T03:14:22.460 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:14:22.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.573+0000 7f46e496a640 1 -- 172.21.15.78:0/890716187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e00b7cc0 msgr2=0x7f46e00cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:22.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.573+0000 7f46e496a640 1 --2- 172.21.15.78:0/890716187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e00b7cc0 0x7f46e00cec10 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f46e0074af0 tx=0x7f46c802a530 comp rx=0 tx=0).stop 2024-09-17T03:14:22.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.573+0000 7f46e496a640 1 -- 172.21.15.78:0/890716187 shutdown_connections 2024-09-17T03:14:22.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.573+0000 7f46e496a640 1 --2- 172.21.15.78:0/890716187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e00b7cc0 0x7f46e00cec10 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.573+0000 7f46e496a640 1 --2- 172.21.15.78:0/890716187 >> v2:172.21.15.193:3300/0 conn(0x7f46e01600b0 0x7f46e00ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.573+0000 7f46e496a640 1 -- 172.21.15.78:0/890716187 >> 172.21.15.78:0/890716187 conn(0x7f46e006d4f0 msgr2=0x7f46e0071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:22.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.573+0000 7f46e496a640 1 -- 172.21.15.78:0/890716187 shutdown_connections 2024-09-17T03:14:22.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.573+0000 7f46e496a640 1 -- 172.21.15.78:0/890716187 wait complete. 2024-09-17T03:14:22.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.575+0000 7f46e496a640 1 Processor -- start 2024-09-17T03:14:22.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.575+0000 7f46e496a640 1 -- start start 2024-09-17T03:14:22.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.576+0000 7f46e496a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f46e00b7cc0 0x7f46e01f7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:22.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.576+0000 7f46e496a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46e00cf150 0x7f46e01f4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:22.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.576+0000 7f46e496a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e01600b0 0x7f46e00cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:22.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.576+0000 7f46e496a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f46e00b4460 con 0x7f46e01600b0 2024-09-17T03:14:22.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.576+0000 7f46e496a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f46e00d1ba0 con 0x7f46e00cf150 2024-09-17T03:14:22.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.576+0000 7f46e496a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f46e00b45e0 con 0x7f46e00b7cc0 2024-09-17T03:14:22.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.577+0000 7f46ded9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e01600b0 0x7f46e00cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:22.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.577+0000 7f46ded9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e01600b0 0x7f46e00cc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52548/0 (socket says 172.21.15.78:52548) 2024-09-17T03:14:22.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.577+0000 7f46ded9d640 1 -- 172.21.15.78:0/4142140634 learned_addr learned my addr 172.21.15.78:0/4142140634 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:22.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.577+0000 7f46de59c640 1 --2- 172.21.15.78:0/4142140634 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f46e00b7cc0 0x7f46e01f7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:22.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.577+0000 7f46ddd9b640 1 --2- 172.21.15.78:0/4142140634 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46e00cf150 0x7f46e01f4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:22.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.577+0000 7f46ded9d640 1 -- 172.21.15.78:0/4142140634 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f46e00b7cc0 msgr2=0x7f46e01f7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:22.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.577+0000 7f46ded9d640 1 --2- 172.21.15.78:0/4142140634 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f46e00b7cc0 0x7f46e01f7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.577+0000 7f46ded9d640 1 -- 172.21.15.78:0/4142140634 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46e00cf150 msgr2=0x7f46e01f4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:22.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.577+0000 7f46ded9d640 1 --2- 172.21.15.78:0/4142140634 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46e00cf150 0x7f46e01f4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.577+0000 7f46ded9d640 1 -- 172.21.15.78:0/4142140634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e01f4d70 con 0x7f46e01600b0 2024-09-17T03:14:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.577+0000 7f46ded9d640 1 --2- 172.21.15.78:0/4142140634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e01600b0 0x7f46e00cc7b0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f46d000cae0 tx=0x7f46d000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.577+0000 7f46d6ffd640 1 -- 172.21.15.78:0/4142140634 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d0016020 con 0x7f46e01600b0 2024-09-17T03:14:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.577+0000 7f46d6ffd640 1 -- 172.21.15.78:0/4142140634 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f46d000ad30 con 0x7f46e01600b0 2024-09-17T03:14:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.577+0000 7f46e496a640 1 -- 172.21.15.78:0/4142140634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e01f7d80 con 0x7f46e01600b0 2024-09-17T03:14:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.577+0000 7f46d6ffd640 1 -- 172.21.15.78:0/4142140634 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d0012680 con 0x7f46e01600b0 2024-09-17T03:14:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.577+0000 7f46e496a640 1 -- 172.21.15.78:0/4142140634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e01f4030 con 0x7f46e01600b0 2024-09-17T03:14:22.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.578+0000 7f46e496a640 1 -- 172.21.15.78:0/4142140634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46e015f930 con 0x7f46e01600b0 2024-09-17T03:14:22.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.579+0000 7f46d6ffd640 1 -- 172.21.15.78:0/4142140634 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f46d0019020 con 0x7f46e01600b0 2024-09-17T03:14:22.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.579+0000 7f46d6ffd640 1 --2- 172.21.15.78:0/4142140634 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f46c0078b90 0x7f46c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:22.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.580+0000 7f46d6ffd640 1 -- 172.21.15.78:0/4142140634 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f46d009b3e0 con 0x7f46e01600b0 2024-09-17T03:14:22.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.580+0000 7f46de59c640 1 --2- 172.21.15.78:0/4142140634 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f46c0078b90 0x7f46c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:22.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.580+0000 7f46de59c640 1 --2- 172.21.15.78:0/4142140634 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f46c0078b90 0x7f46c007b0a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f46d800b810 tx=0x7f46d8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:22.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.584+0000 7f46d6ffd640 1 -- 172.21.15.78:0/4142140634 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f46e015f930 con 0x7f46e01600b0 2024-09-17T03:14:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.826+0000 7f46e496a640 1 -- 172.21.15.78:0/4142140634 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f46e01f7b10 con 0x7f46e01600b0 2024-09-17T03:14:22.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.827+0000 7f46d6ffd640 1 -- 172.21.15.78:0/4142140634 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2006 (secure 0 0 0) 0x7f46d0020020 con 0x7f46e01600b0 2024-09-17T03:14:22.826 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:22.826 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":380,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":84,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":706268,"bytes_used":256737280,"bytes_avail":772837376000,"bytes_total":773094113280,"write_bytes_sec":857,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6640},{"filesystem_id":6,"rank":1,"name":"c","status":"up:active","gid":7425},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7428}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2024-09-17T03:14:19.215080+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-17T03:14:22.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.829+0000 7f46e496a640 1 -- 172.21.15.78:0/4142140634 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f46c0078b90 msgr2=0x7f46c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:22.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.829+0000 7f46e496a640 1 --2- 172.21.15.78:0/4142140634 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f46c0078b90 0x7f46c007b0a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f46d800b810 tx=0x7f46d8008040 comp rx=0 tx=0).stop 2024-09-17T03:14:22.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.829+0000 7f46e496a640 1 -- 172.21.15.78:0/4142140634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e01600b0 msgr2=0x7f46e00cc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:22.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.829+0000 7f46e496a640 1 --2- 172.21.15.78:0/4142140634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e01600b0 0x7f46e00cc7b0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f46d000cae0 tx=0x7f46d000a060 comp rx=0 tx=0).stop 2024-09-17T03:14:22.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.829+0000 7f46e496a640 1 -- 172.21.15.78:0/4142140634 shutdown_connections 2024-09-17T03:14:22.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.829+0000 7f46e496a640 1 --2- 172.21.15.78:0/4142140634 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f46e01600b0 0x7f46e00cc7b0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.829+0000 7f46e496a640 1 --2- 172.21.15.78:0/4142140634 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f46c0078b90 0x7f46c007b0a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.829+0000 7f46e496a640 1 --2- 172.21.15.78:0/4142140634 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46e00cf150 0x7f46e01f4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.829+0000 7f46e496a640 1 --2- 172.21.15.78:0/4142140634 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f46e00b7cc0 0x7f46e01f7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:22.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.829+0000 7f46e496a640 1 -- 172.21.15.78:0/4142140634 >> 172.21.15.78:0/4142140634 conn(0x7f46e006d4f0 msgr2=0x7f46e00d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:22.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.829+0000 7f46e496a640 1 -- 172.21.15.78:0/4142140634 shutdown_connections 2024-09-17T03:14:22.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:22.829+0000 7f46e496a640 1 -- 172.21.15.78:0/4142140634 wait complete. 2024-09-17T03:14:22.839 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'idle+waiting paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]', 'd': 'idle+waiting paths [/d1/d2/d3]'} 2024-09-17T03:14:23.840 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:23.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.971+0000 7f0f8e37b640 1 -- 172.21.15.78:0/1367566945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f8806f4b0 msgr2=0x7f0f880d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:23.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.971+0000 7f0f8e37b640 1 --2- 172.21.15.78:0/1367566945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f8806f4b0 0x7f0f880d3330 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c009900 tx=0x7f0f7c02a580 comp rx=0 tx=0).stop 2024-09-17T03:14:23.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.971+0000 7f0f8e37b640 1 -- 172.21.15.78:0/1367566945 shutdown_connections 2024-09-17T03:14:23.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.971+0000 7f0f8e37b640 1 --2- 172.21.15.78:0/1367566945 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f8806f4b0 0x7f0f880d3330 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.971+0000 7f0f8e37b640 1 --2- 172.21.15.78:0/1367566945 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f8806e170 0x7f0f880b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.971+0000 7f0f8e37b640 1 -- 172.21.15.78:0/1367566945 >> 172.21.15.78:0/1367566945 conn(0x7f0f8808bfc0 msgr2=0x7f0f8809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:23.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.971+0000 7f0f8e37b640 1 -- 172.21.15.78:0/1367566945 shutdown_connections 2024-09-17T03:14:23.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.972+0000 7f0f8e37b640 1 -- 172.21.15.78:0/1367566945 wait complete. 2024-09-17T03:14:23.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.973+0000 7f0f8e37b640 1 Processor -- start 2024-09-17T03:14:23.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.973+0000 7f0f8e37b640 1 -- start start 2024-09-17T03:14:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.975+0000 7f0f8e37b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f8806f4b0 0x7f0f880ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.975+0000 7f0f8e37b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f880d3870 0x7f0f881e8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.975+0000 7f0f8e37b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f881e8bb0 0x7f0f881f8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.975+0000 7f0f8e37b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0f880d0e60 con 0x7f0f881e8bb0 2024-09-17T03:14:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.975+0000 7f0f8e37b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0f880d0ce0 con 0x7f0f8806f4b0 2024-09-17T03:14:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.975+0000 7f0f8e37b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0f880d0fe0 con 0x7f0f880d3870 2024-09-17T03:14:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.975+0000 7f0f8c918640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f881e8bb0 0x7f0f881f8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.975+0000 7f0f8c918640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f881e8bb0 0x7f0f881f8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52580/0 (socket says 172.21.15.78:52580) 2024-09-17T03:14:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.975+0000 7f0f8c918640 1 -- 172.21.15.78:0/1692955294 learned_addr learned my addr 172.21.15.78:0/1692955294 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.975+0000 7f0f877fe640 1 --2- 172.21.15.78:0/1692955294 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f880d3870 0x7f0f881e8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.975+0000 7f0f87fff640 1 --2- 172.21.15.78:0/1692955294 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f8806f4b0 0x7f0f880ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.975+0000 7f0f8c918640 1 -- 172.21.15.78:0/1692955294 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f880d3870 msgr2=0x7f0f881e8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.975+0000 7f0f8c918640 1 --2- 172.21.15.78:0/1692955294 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f880d3870 0x7f0f881e8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.975+0000 7f0f8c918640 1 -- 172.21.15.78:0/1692955294 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f8806f4b0 msgr2=0x7f0f880ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.975+0000 7f0f8c918640 1 --2- 172.21.15.78:0/1692955294 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f8806f4b0 0x7f0f880ce3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.975+0000 7f0f8c918640 1 -- 172.21.15.78:0/1692955294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f880c9740 con 0x7f0f881e8bb0 2024-09-17T03:14:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.975+0000 7f0f8c918640 1 --2- 172.21.15.78:0/1692955294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f881e8bb0 0x7f0f881f8a50 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000c6f0 tx=0x7f0f8000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.975+0000 7f0f84ff9640 1 -- 172.21.15.78:0/1692955294 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f80003970 con 0x7f0f881e8bb0 2024-09-17T03:14:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.976+0000 7f0f84ff9640 1 -- 172.21.15.78:0/1692955294 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f80003b10 con 0x7f0f881e8bb0 2024-09-17T03:14:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.976+0000 7f0f8e37b640 1 -- 172.21.15.78:0/1692955294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f881e93c0 con 0x7f0f881e8bb0 2024-09-17T03:14:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.976+0000 7f0f84ff9640 1 -- 172.21.15.78:0/1692955294 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8000a850 con 0x7f0f881e8bb0 2024-09-17T03:14:23.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.976+0000 7f0f8e37b640 1 -- 172.21.15.78:0/1692955294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f881e9980 con 0x7f0f881e8bb0 2024-09-17T03:14:23.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.977+0000 7f0f8e37b640 1 -- 172.21.15.78:0/1692955294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f880d1500 con 0x7f0f881e8bb0 2024-09-17T03:14:23.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.977+0000 7f0f84ff9640 1 -- 172.21.15.78:0/1692955294 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0f8000a9f0 con 0x7f0f881e8bb0 2024-09-17T03:14:23.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.978+0000 7f0f84ff9640 1 --2- 172.21.15.78:0/1692955294 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0f74078b90 0x7f0f7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:23.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.978+0000 7f0f84ff9640 1 -- 172.21.15.78:0/1692955294 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f0f8009aa00 con 0x7f0f881e8bb0 2024-09-17T03:14:23.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.978+0000 7f0f87fff640 1 --2- 172.21.15.78:0/1692955294 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0f74078b90 0x7f0f7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:23.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.979+0000 7f0f87fff640 1 --2- 172.21.15.78:0/1692955294 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0f74078b90 0x7f0f7407b0a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0f78004630 tx=0x7f0f7800b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:23.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:23.982+0000 7f0f84ff9640 1 -- 172.21.15.78:0/1692955294 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0f880c9740 con 0x7f0f881e8bb0 2024-09-17T03:14:24.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.198+0000 7f0f8e37b640 1 -- 172.21.15.78:0/1692955294 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f880b90e0 con 0x7f0f881e8bb0 2024-09-17T03:14:24.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.199+0000 7f0f84ff9640 1 -- 172.21.15.78:0/1692955294 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5278 (secure 0 0 0) 0x7f0f800627b0 con 0x7f0f881e8bb0 2024-09-17T03:14:24.198 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:24.198 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:35.489582+0000","modified":"2024-09-17T03:14:08.415660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7428,"mds_1":7425,"mds_2":6640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"d","rank":2,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/1005450673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1005450673},{"type":"v1","addr":"172.21.15.193:6837","nonce":1005450673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7425":{"gid":7425,"name":"c","rank":1,"incarnation":78,"state":"up:active","state_seq":10,"addr":"172.21.15.78:6835/4018023271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4018023271},{"type":"v1","addr":"172.21.15.78:6835","nonce":4018023271}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6832/3357123265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":3357123265},{"type":"v1","addr":"172.21.15.78:6832","nonce":3357123265}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7428,"qdb_cluster":[6640,7425,7428]},"id":6}]} 2024-09-17T03:14:24.198 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 85 2024-09-17T03:14:24.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.201+0000 7f0f8e37b640 1 -- 172.21.15.78:0/1692955294 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0f74078b90 msgr2=0x7f0f7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:24.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.201+0000 7f0f8e37b640 1 --2- 172.21.15.78:0/1692955294 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0f74078b90 0x7f0f7407b0a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f0f78004630 tx=0x7f0f7800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.201+0000 7f0f8e37b640 1 -- 172.21.15.78:0/1692955294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f881e8bb0 msgr2=0x7f0f881f8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:24.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.201+0000 7f0f8e37b640 1 --2- 172.21.15.78:0/1692955294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f881e8bb0 0x7f0f881f8a50 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000c6f0 tx=0x7f0f8000cbb0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.201+0000 7f0f8e37b640 1 -- 172.21.15.78:0/1692955294 shutdown_connections 2024-09-17T03:14:24.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.201+0000 7f0f8e37b640 1 --2- 172.21.15.78:0/1692955294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0f881e8bb0 0x7f0f881f8a50 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.201+0000 7f0f8e37b640 1 --2- 172.21.15.78:0/1692955294 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f880d3870 0x7f0f881e8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.201+0000 7f0f8e37b640 1 --2- 172.21.15.78:0/1692955294 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0f74078b90 0x7f0f7407b0a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.201+0000 7f0f8e37b640 1 --2- 172.21.15.78:0/1692955294 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f8806f4b0 0x7f0f880ce3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.201+0000 7f0f8e37b640 1 -- 172.21.15.78:0/1692955294 >> 172.21.15.78:0/1692955294 conn(0x7f0f8808bfc0 msgr2=0x7f0f880b6060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:24.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.201+0000 7f0f8e37b640 1 -- 172.21.15.78:0/1692955294 shutdown_connections 2024-09-17T03:14:24.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.201+0000 7f0f8e37b640 1 -- 172.21.15.78:0/1692955294 wait complete. 2024-09-17T03:14:24.211 DEBUG:tasks.cephfs.test_multimds_misc:current active=['a', 'c', 'd'] 2024-09-17T03:14:24.211 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:14:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.324+0000 7fcca0c4a640 1 -- 172.21.15.78:0/3285910510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc9c1570e0 msgr2=0x7fcc9c0d1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.324+0000 7fcca0c4a640 1 --2- 172.21.15.78:0/3285910510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc9c1570e0 0x7fcc9c0d1f20 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c071d80 tx=0x7fcc8c02aac0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.324+0000 7fcca0c4a640 1 -- 172.21.15.78:0/3285910510 shutdown_connections 2024-09-17T03:14:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.324+0000 7fcca0c4a640 1 --2- 172.21.15.78:0/3285910510 >> v2:172.21.15.193:3300/0 conn(0x7fcc9c0d2460 0x7fcc9c15d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.324+0000 7fcca0c4a640 1 --2- 172.21.15.78:0/3285910510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc9c1570e0 0x7fcc9c0d1f20 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.324+0000 7fcca0c4a640 1 -- 172.21.15.78:0/3285910510 >> 172.21.15.78:0/3285910510 conn(0x7fcc9c06d550 msgr2=0x7fcc9c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.324+0000 7fcca0c4a640 1 -- 172.21.15.78:0/3285910510 shutdown_connections 2024-09-17T03:14:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.324+0000 7fcca0c4a640 1 -- 172.21.15.78:0/3285910510 wait complete. 2024-09-17T03:14:24.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.326+0000 7fcca0c4a640 1 Processor -- start 2024-09-17T03:14:24.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.326+0000 7fcca0c4a640 1 -- start start 2024-09-17T03:14:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.327+0000 7fcca0c4a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc9c0d2460 0x7fcc9c1f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.327+0000 7fcca0c4a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcc9c1570e0 0x7fcc9c1f34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.327+0000 7fcca0c4a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcc9c15d670 0x7fcc9c0c7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.327+0000 7fcca0c4a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9c0b7d20 con 0x7fcc9c0d2460 2024-09-17T03:14:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.327+0000 7fcca0c4a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9c0b7ba0 con 0x7fcc9c1570e0 2024-09-17T03:14:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.327+0000 7fcca0c4a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fcc9c0b7ea0 con 0x7fcc9c15d670 2024-09-17T03:14:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.327+0000 7fcc9a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc9c0d2460 0x7fcc9c1f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.327+0000 7fcc9a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc9c0d2460 0x7fcc9c1f4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52608/0 (socket says 172.21.15.78:52608) 2024-09-17T03:14:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.327+0000 7fcc9a59c640 1 -- 172.21.15.78:0/4157254406 learned_addr learned my addr 172.21.15.78:0/4157254406 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.327+0000 7fcc99d9b640 1 --2- 172.21.15.78:0/4157254406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcc9c1570e0 0x7fcc9c1f34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.327+0000 7fcc9ad9d640 1 --2- 172.21.15.78:0/4157254406 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcc9c15d670 0x7fcc9c0c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.328+0000 7fcc9a59c640 1 -- 172.21.15.78:0/4157254406 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcc9c15d670 msgr2=0x7fcc9c0c7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.328+0000 7fcc9a59c640 1 --2- 172.21.15.78:0/4157254406 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcc9c15d670 0x7fcc9c0c7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.328+0000 7fcc9a59c640 1 -- 172.21.15.78:0/4157254406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcc9c1570e0 msgr2=0x7fcc9c1f34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.328+0000 7fcc9a59c640 1 --2- 172.21.15.78:0/4157254406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcc9c1570e0 0x7fcc9c1f34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.328+0000 7fcc9a59c640 1 -- 172.21.15.78:0/4157254406 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc9c148910 con 0x7fcc9c0d2460 2024-09-17T03:14:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.328+0000 7fcc9a59c640 1 --2- 172.21.15.78:0/4157254406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc9c0d2460 0x7fcc9c1f4870 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c009d60 tx=0x7fcc8c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.328+0000 7fcc8affd640 1 -- 172.21.15.78:0/4157254406 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c004250 con 0x7fcc9c0d2460 2024-09-17T03:14:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.328+0000 7fcc8affd640 1 -- 172.21.15.78:0/4157254406 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc8c004410 con 0x7fcc9c0d2460 2024-09-17T03:14:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.328+0000 7fcca0c4a640 1 -- 172.21.15.78:0/4157254406 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc9c148bf0 con 0x7fcc9c0d2460 2024-09-17T03:14:24.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.328+0000 7fcc8affd640 1 -- 172.21.15.78:0/4157254406 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c004860 con 0x7fcc9c0d2460 2024-09-17T03:14:24.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.328+0000 7fcca0c4a640 1 -- 172.21.15.78:0/4157254406 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc9c1491b0 con 0x7fcc9c0d2460 2024-09-17T03:14:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.329+0000 7fcca0c4a640 1 -- 172.21.15.78:0/4157254406 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc9c0b6890 con 0x7fcc9c0d2460 2024-09-17T03:14:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.330+0000 7fcc8affd640 1 -- 172.21.15.78:0/4157254406 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcc8c049430 con 0x7fcc9c0d2460 2024-09-17T03:14:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.330+0000 7fcc8affd640 1 --2- 172.21.15.78:0/4157254406 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcc7c078b90 0x7fcc7c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.331+0000 7fcc8affd640 1 -- 172.21.15.78:0/4157254406 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7fcc8c0bbb70 con 0x7fcc9c0d2460 2024-09-17T03:14:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.331+0000 7fcc99d9b640 1 --2- 172.21.15.78:0/4157254406 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcc7c078b90 0x7fcc7c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.331+0000 7fcc99d9b640 1 --2- 172.21.15.78:0/4157254406 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcc7c078b90 0x7fcc7c07b0a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0694b0 tx=0x7fcc9000b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:24.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.335+0000 7fcc8affd640 1 -- 172.21.15.78:0/4157254406 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcc9c0b6890 con 0x7fcc9c0d2460 2024-09-17T03:14:24.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.582+0000 7fcca0c4a640 1 -- 172.21.15.78:0/4157254406 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fcc9c15d130 con 0x7fcc9c0d2460 2024-09-17T03:14:24.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.582+0000 7fcc8affd640 1 -- 172.21.15.78:0/4157254406 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1865 (secure 0 0 0) 0x7fcc8c032030 con 0x7fcc9c0d2460 2024-09-17T03:14:24.581 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:24.581 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":381,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":84,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":706268,"bytes_used":256741376,"bytes_avail":772837371904,"bytes_total":773094113280,"write_bytes_sec":682,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","id":6,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":6,"rank":2,"name":"d","status":"up:active","gid":6640},{"filesystem_id":6,"rank":1,"name":"c","status":"up:active","gid":7425},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7428}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-09-17T03:14:23.216544+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:14:24.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.584+0000 7fcca0c4a640 1 -- 172.21.15.78:0/4157254406 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcc7c078b90 msgr2=0x7fcc7c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:24.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.584+0000 7fcca0c4a640 1 --2- 172.21.15.78:0/4157254406 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcc7c078b90 0x7fcc7c07b0a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0694b0 tx=0x7fcc9000b2e0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.584+0000 7fcca0c4a640 1 -- 172.21.15.78:0/4157254406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc9c0d2460 msgr2=0x7fcc9c1f4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:24.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.584+0000 7fcca0c4a640 1 --2- 172.21.15.78:0/4157254406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc9c0d2460 0x7fcc9c1f4870 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c009d60 tx=0x7fcc8c003f10 comp rx=0 tx=0).stop 2024-09-17T03:14:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.584+0000 7fcca0c4a640 1 -- 172.21.15.78:0/4157254406 shutdown_connections 2024-09-17T03:14:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.584+0000 7fcca0c4a640 1 --2- 172.21.15.78:0/4157254406 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcc9c15d670 0x7fcc9c0c7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.584+0000 7fcca0c4a640 1 --2- 172.21.15.78:0/4157254406 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcc7c078b90 0x7fcc7c07b0a0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.584+0000 7fcca0c4a640 1 --2- 172.21.15.78:0/4157254406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcc9c1570e0 0x7fcc9c1f34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.584+0000 7fcca0c4a640 1 --2- 172.21.15.78:0/4157254406 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc9c0d2460 0x7fcc9c1f4870 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.584+0000 7fcca0c4a640 1 -- 172.21.15.78:0/4157254406 >> 172.21.15.78:0/4157254406 conn(0x7fcc9c06d550 msgr2=0x7fcc9c0b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.584+0000 7fcca0c4a640 1 -- 172.21.15.78:0/4157254406 shutdown_connections 2024-09-17T03:14:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.584+0000 7fcca0c4a640 1 -- 172.21.15.78:0/4157254406 wait complete. 2024-09-17T03:14:24.594 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T03:14:24.594 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:14:24.595 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:14:24.630 DEBUG:teuthology.orchestra.run.smithi193:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:14:24.672 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:14:24.673 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:14:24.673 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:14:24.673 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:24.688 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:14:24.689 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:24.744 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:14:24.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.898+0000 7fce41a7e640 1 -- 172.21.15.78:0/955044590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce3c15f9b0 msgr2=0x7fce3c0ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:24.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.898+0000 7fce41a7e640 1 --2- 172.21.15.78:0/955044590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce3c15f9b0 0x7fce3c0ce680 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0717d0 tx=0x7fce3402aac0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.898+0000 7fce41a7e640 1 -- 172.21.15.78:0/955044590 shutdown_connections 2024-09-17T03:14:24.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.898+0000 7fce41a7e640 1 --2- 172.21.15.78:0/955044590 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce3c15f9b0 0x7fce3c0ce680 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.898+0000 7fce41a7e640 1 --2- 172.21.15.78:0/955044590 >> v2:172.21.15.193:3300/0 conn(0x7fce3c075fa0 0x7fce3c070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.898+0000 7fce41a7e640 1 -- 172.21.15.78:0/955044590 >> 172.21.15.78:0/955044590 conn(0x7fce3c0cd530 msgr2=0x7fce3c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:24.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.898+0000 7fce41a7e640 1 -- 172.21.15.78:0/955044590 shutdown_connections 2024-09-17T03:14:24.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.898+0000 7fce41a7e640 1 -- 172.21.15.78:0/955044590 wait complete. 2024-09-17T03:14:24.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.899+0000 7fce41a7e640 1 Processor -- start 2024-09-17T03:14:24.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.900+0000 7fce41a7e640 1 -- start start 2024-09-17T03:14:24.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.901+0000 7fce41a7e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce3c06e100 0x7fce3c14a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:24.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.901+0000 7fce41a7e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fce3c075fa0 0x7fce3c15ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:24.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.901+0000 7fce41a7e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce3c15b070 0x7fce3c06f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:24.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.901+0000 7fce41a7e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c0cf060 con 0x7fce3c06e100 2024-09-17T03:14:24.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.901+0000 7fce41a7e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fce3c0ceee0 con 0x7fce3c15b070 2024-09-17T03:14:24.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.901+0000 7fce41a7e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fce3c0cf1e0 con 0x7fce3c075fa0 2024-09-17T03:14:24.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.901+0000 7fce3b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce3c06e100 0x7fce3c14a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:24.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.901+0000 7fce3b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce3c06e100 0x7fce3c14a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52616/0 (socket says 172.21.15.78:52616) 2024-09-17T03:14:24.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.901+0000 7fce3b7fe640 1 -- 172.21.15.78:0/723971522 learned_addr learned my addr 172.21.15.78:0/723971522 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:24.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.901+0000 7fce3bfff640 1 --2- 172.21.15.78:0/723971522 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce3c15b070 0x7fce3c06f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:24.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.901+0000 7fce3affd640 1 --2- 172.21.15.78:0/723971522 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fce3c075fa0 0x7fce3c15ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:24.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.901+0000 7fce3b7fe640 1 -- 172.21.15.78:0/723971522 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fce3c075fa0 msgr2=0x7fce3c15ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:24.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.901+0000 7fce3b7fe640 1 --2- 172.21.15.78:0/723971522 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fce3c075fa0 0x7fce3c15ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.901+0000 7fce3b7fe640 1 -- 172.21.15.78:0/723971522 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce3c15b070 msgr2=0x7fce3c06f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:24.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.901+0000 7fce3b7fe640 1 --2- 172.21.15.78:0/723971522 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce3c15b070 0x7fce3c06f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:24.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.901+0000 7fce3b7fe640 1 -- 172.21.15.78:0/723971522 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce3c0ca460 con 0x7fce3c06e100 2024-09-17T03:14:24.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.901+0000 7fce3bfff640 1 --2- 172.21.15.78:0/723971522 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce3c15b070 0x7fce3c06f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:24.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.901+0000 7fce3affd640 1 --2- 172.21.15.78:0/723971522 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fce3c075fa0 0x7fce3c15ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:24.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.902+0000 7fce3b7fe640 1 --2- 172.21.15.78:0/723971522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce3c06e100 0x7fce3c14a4e0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00d700 tx=0x7fce2c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:24.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.902+0000 7fce23fff640 1 -- 172.21.15.78:0/723971522 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c017070 con 0x7fce3c06e100 2024-09-17T03:14:24.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.902+0000 7fce23fff640 1 -- 172.21.15.78:0/723971522 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce2c005310 con 0x7fce3c06e100 2024-09-17T03:14:24.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.902+0000 7fce41a7e640 1 -- 172.21.15.78:0/723971522 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce3c0ca740 con 0x7fce3c06e100 2024-09-17T03:14:24.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.902+0000 7fce23fff640 1 -- 172.21.15.78:0/723971522 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce2c009820 con 0x7fce3c06e100 2024-09-17T03:14:24.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.902+0000 7fce41a7e640 1 -- 172.21.15.78:0/723971522 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3c0cad00 con 0x7fce3c06e100 2024-09-17T03:14:24.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.903+0000 7fce41a7e640 1 -- 172.21.15.78:0/723971522 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce3c0cb980 con 0x7fce3c06e100 2024-09-17T03:14:24.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.904+0000 7fce23fff640 1 -- 172.21.15.78:0/723971522 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fce2c0099c0 con 0x7fce3c06e100 2024-09-17T03:14:24.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.904+0000 7fce23fff640 1 --2- 172.21.15.78:0/723971522 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fce28078b90 0x7fce2807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:24.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.904+0000 7fce23fff640 1 -- 172.21.15.78:0/723971522 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7fce2c09ae10 con 0x7fce3c06e100 2024-09-17T03:14:24.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.904+0000 7fce3affd640 1 --2- 172.21.15.78:0/723971522 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fce28078b90 0x7fce2807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:24.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.905+0000 7fce3affd640 1 --2- 172.21.15.78:0/723971522 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fce28078b90 0x7fce2807b0a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fce3c071300 tx=0x7fce30009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:24.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:24.909+0000 7fce23fff640 1 -- 172.21.15.78:0/723971522 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fce2c0632a0 con 0x7fce3c06e100 2024-09-17T03:14:25.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.093+0000 7fce41a7e640 1 -- 172.21.15.78:0/723971522 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fce3c0cf6b0 con 0x7fce3c06e100 2024-09-17T03:14:25.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.094+0000 7fce23fff640 1 -- 172.21.15.78:0/723971522 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v84) ==== 80+0+0 (secure 0 0 0) 0x7fce2c062ba0 con 0x7fce3c06e100 2024-09-17T03:14:25.093 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-09-17T03:14:25.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.096+0000 7fce41a7e640 1 -- 172.21.15.78:0/723971522 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fce28078b90 msgr2=0x7fce2807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.096+0000 7fce41a7e640 1 --2- 172.21.15.78:0/723971522 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fce28078b90 0x7fce2807b0a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fce3c071300 tx=0x7fce30009040 comp rx=0 tx=0).stop 2024-09-17T03:14:25.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.096+0000 7fce41a7e640 1 -- 172.21.15.78:0/723971522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce3c06e100 msgr2=0x7fce3c14a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.096+0000 7fce41a7e640 1 --2- 172.21.15.78:0/723971522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce3c06e100 0x7fce3c14a4e0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fce2c00d700 tx=0x7fce2c00dbc0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.096+0000 7fce41a7e640 1 -- 172.21.15.78:0/723971522 shutdown_connections 2024-09-17T03:14:25.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.096+0000 7fce41a7e640 1 --2- 172.21.15.78:0/723971522 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fce28078b90 0x7fce2807b0a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.096+0000 7fce41a7e640 1 --2- 172.21.15.78:0/723971522 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fce3c15b070 0x7fce3c06f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.096+0000 7fce41a7e640 1 --2- 172.21.15.78:0/723971522 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fce3c075fa0 0x7fce3c15ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.096+0000 7fce41a7e640 1 --2- 172.21.15.78:0/723971522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fce3c06e100 0x7fce3c14a4e0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.096+0000 7fce41a7e640 1 -- 172.21.15.78:0/723971522 >> 172.21.15.78:0/723971522 conn(0x7fce3c0cd530 msgr2=0x7fce3c074100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:25.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.096+0000 7fce41a7e640 1 -- 172.21.15.78:0/723971522 shutdown_connections 2024-09-17T03:14:25.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.096+0000 7fce41a7e640 1 -- 172.21.15.78:0/723971522 wait complete. 2024-09-17T03:14:25.106 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:14:25.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:25.106 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:14:25.137 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T03:14:25.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:25.137 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:14:25.193 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:14:25.193 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:14:25.193 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:25.213 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:14:25.213 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:14:25.213 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:14:25.213 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:25.249 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056010,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1013 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:14:25.249 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:14:25.250 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:14:25.250 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:25.272 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:14:25.272 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:25.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.404+0000 7f119efa1640 1 -- 172.21.15.78:0/209753279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11980b9b70 msgr2=0x7f11980cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.404+0000 7f119efa1640 1 --2- 172.21.15.78:0/209753279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11980b9b70 0x7f11980cf090 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f1184005fd0 tx=0x7f118402a530 comp rx=0 tx=0).stop 2024-09-17T03:14:25.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.404+0000 7f119efa1640 1 -- 172.21.15.78:0/209753279 shutdown_connections 2024-09-17T03:14:25.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.404+0000 7f119efa1640 1 --2- 172.21.15.78:0/209753279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11980b9b70 0x7f11980cf090 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.404+0000 7f119efa1640 1 --2- 172.21.15.78:0/209753279 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f11980d2ed0 0x7f11980d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.404+0000 7f119efa1640 1 -- 172.21.15.78:0/209753279 >> 172.21.15.78:0/209753279 conn(0x7f119808bfc0 msgr2=0x7f119809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:25.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.404+0000 7f119efa1640 1 -- 172.21.15.78:0/209753279 shutdown_connections 2024-09-17T03:14:25.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.404+0000 7f119efa1640 1 -- 172.21.15.78:0/209753279 wait complete. 2024-09-17T03:14:25.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.405+0000 7f119efa1640 1 Processor -- start 2024-09-17T03:14:25.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.405+0000 7f119efa1640 1 -- start start 2024-09-17T03:14:25.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.407+0000 7f119efa1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f11980b9b70 0x7f11981587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:25.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.407+0000 7f119efa1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11980cf5d0 0x7f119815e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:25.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.407+0000 7f119efa1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11980d2ed0 0x7f119815bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:25.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.407+0000 7f119efa1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f11980d4940 con 0x7f11980d2ed0 2024-09-17T03:14:25.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.407+0000 7f119efa1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f11980cfde0 con 0x7f11980cf5d0 2024-09-17T03:14:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.407+0000 7f119efa1640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f11980d4ac0 con 0x7f11980b9b70 2024-09-17T03:14:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.407+0000 7f119d53e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11980d2ed0 0x7f119815bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.407+0000 7f119d53e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11980d2ed0 0x7f119815bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52634/0 (socket says 172.21.15.78:52634) 2024-09-17T03:14:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.407+0000 7f119d53e640 1 -- 172.21.15.78:0/2490676875 learned_addr learned my addr 172.21.15.78:0/2490676875 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.407+0000 7f1197fff640 1 --2- 172.21.15.78:0/2490676875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11980cf5d0 0x7f119815e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.407+0000 7f119cd3d640 1 --2- 172.21.15.78:0/2490676875 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f11980b9b70 0x7f11981587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.407+0000 7f119d53e640 1 -- 172.21.15.78:0/2490676875 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f11980b9b70 msgr2=0x7f11981587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.407+0000 7f119d53e640 1 --2- 172.21.15.78:0/2490676875 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f11980b9b70 0x7f11981587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.407+0000 7f119d53e640 1 -- 172.21.15.78:0/2490676875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11980cf5d0 msgr2=0x7f119815e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.407+0000 7f119d53e640 1 --2- 172.21.15.78:0/2490676875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11980cf5d0 0x7f119815e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.407+0000 7f119d53e640 1 -- 172.21.15.78:0/2490676875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1198159060 con 0x7f11980d2ed0 2024-09-17T03:14:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.407+0000 7f119cd3d640 1 --2- 172.21.15.78:0/2490676875 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f11980b9b70 0x7f11981587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.407+0000 7f1197fff640 1 --2- 172.21.15.78:0/2490676875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11980cf5d0 0x7f119815e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.407+0000 7f119d53e640 1 --2- 172.21.15.78:0/2490676875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11980d2ed0 0x7f119815bf20 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f119000ba10 tx=0x7f119000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.408+0000 7f11957fa640 1 -- 172.21.15.78:0/2490676875 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1190019070 con 0x7f11980d2ed0 2024-09-17T03:14:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.408+0000 7f11957fa640 1 -- 172.21.15.78:0/2490676875 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f119000cc30 con 0x7f11980d2ed0 2024-09-17T03:14:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.408+0000 7f119efa1640 1 -- 172.21.15.78:0/2490676875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11980c8190 con 0x7f11980d2ed0 2024-09-17T03:14:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.408+0000 7f11957fa640 1 -- 172.21.15.78:0/2490676875 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119000ce60 con 0x7f11980d2ed0 2024-09-17T03:14:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.408+0000 7f119efa1640 1 -- 172.21.15.78:0/2490676875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11980c8750 con 0x7f11980d2ed0 2024-09-17T03:14:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.409+0000 7f119efa1640 1 -- 172.21.15.78:0/2490676875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f119808e590 con 0x7f11980d2ed0 2024-09-17T03:14:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.410+0000 7f11957fa640 1 -- 172.21.15.78:0/2490676875 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f119001c070 con 0x7f11980d2ed0 2024-09-17T03:14:25.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.410+0000 7f11957fa640 1 --2- 172.21.15.78:0/2490676875 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f117c078bc0 0x7f117c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:25.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.410+0000 7f11957fa640 1 -- 172.21.15.78:0/2490676875 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f119009a8e0 con 0x7f11980d2ed0 2024-09-17T03:14:25.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.411+0000 7f119cd3d640 1 --2- 172.21.15.78:0/2490676875 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f117c078bc0 0x7f117c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:25.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.411+0000 7f119cd3d640 1 --2- 172.21.15.78:0/2490676875 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f117c078bc0 0x7f117c07b0d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f118c005860 tx=0x7f118c005e10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:25.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.415+0000 7f11957fa640 1 -- 172.21.15.78:0/2490676875 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f119808e590 con 0x7f11980d2ed0 2024-09-17T03:14:25.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.626+0000 7f119efa1640 1 -- 172.21.15.78:0/2490676875 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f119815ea40 con 0x7f11980d2ed0 2024-09-17T03:14:25.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.626+0000 7f11957fa640 1 -- 172.21.15.78:0/2490676875 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5278 (secure 0 0 0) 0x7f1190062ce0 con 0x7f11980d2ed0 2024-09-17T03:14:25.625 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:25.625 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:35.489582+0000","modified":"2024-09-17T03:14:08.415660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7428,"mds_1":7425,"mds_2":6640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"d","rank":2,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/1005450673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1005450673},{"type":"v1","addr":"172.21.15.193:6837","nonce":1005450673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7425":{"gid":7425,"name":"c","rank":1,"incarnation":78,"state":"up:active","state_seq":10,"addr":"172.21.15.78:6835/4018023271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4018023271},{"type":"v1","addr":"172.21.15.78:6835","nonce":4018023271}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6832/3357123265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":3357123265},{"type":"v1","addr":"172.21.15.78:6832","nonce":3357123265}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7428,"qdb_cluster":[6640,7425,7428]},"id":6}]} 2024-09-17T03:14:25.626 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 85 2024-09-17T03:14:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.628+0000 7f119efa1640 1 -- 172.21.15.78:0/2490676875 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f117c078bc0 msgr2=0x7f117c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.628+0000 7f119efa1640 1 --2- 172.21.15.78:0/2490676875 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f117c078bc0 0x7f117c07b0d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f118c005860 tx=0x7f118c005e10 comp rx=0 tx=0).stop 2024-09-17T03:14:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.628+0000 7f119efa1640 1 -- 172.21.15.78:0/2490676875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11980d2ed0 msgr2=0x7f119815bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.628+0000 7f119efa1640 1 --2- 172.21.15.78:0/2490676875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11980d2ed0 0x7f119815bf20 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f119000ba10 tx=0x7f119000bed0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.628+0000 7f119efa1640 1 -- 172.21.15.78:0/2490676875 shutdown_connections 2024-09-17T03:14:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.628+0000 7f119efa1640 1 --2- 172.21.15.78:0/2490676875 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11980d2ed0 0x7f119815bf20 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.628+0000 7f119efa1640 1 --2- 172.21.15.78:0/2490676875 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f117c078bc0 0x7f117c07b0d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.628+0000 7f119efa1640 1 --2- 172.21.15.78:0/2490676875 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11980cf5d0 0x7f119815e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.628+0000 7f119efa1640 1 --2- 172.21.15.78:0/2490676875 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f11980b9b70 0x7f11981587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.628+0000 7f119efa1640 1 -- 172.21.15.78:0/2490676875 >> 172.21.15.78:0/2490676875 conn(0x7f119808bfc0 msgr2=0x7f119806e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.628+0000 7f119efa1640 1 -- 172.21.15.78:0/2490676875 shutdown_connections 2024-09-17T03:14:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.628+0000 7f119efa1640 1 -- 172.21.15.78:0/2490676875 wait complete. 2024-09-17T03:14:25.639 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:25.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.752+0000 7fc7daa0a640 1 -- 172.21.15.78:0/1238398252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d406e170 msgr2=0x7fc7d40b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.752+0000 7fc7daa0a640 1 --2- 172.21.15.78:0/1238398252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d406e170 0x7fc7d40b3540 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fc7d40ba090 tx=0x7fc7c402a4d0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.752+0000 7fc7daa0a640 1 -- 172.21.15.78:0/1238398252 shutdown_connections 2024-09-17T03:14:25.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.752+0000 7fc7daa0a640 1 --2- 172.21.15.78:0/1238398252 >> v2:172.21.15.193:3300/0 conn(0x7fc7d40ceb40 0x7fc7d40cef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.752+0000 7fc7daa0a640 1 --2- 172.21.15.78:0/1238398252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d406e170 0x7fc7d40b3540 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.752+0000 7fc7daa0a640 1 -- 172.21.15.78:0/1238398252 >> 172.21.15.78:0/1238398252 conn(0x7fc7d408bfc0 msgr2=0x7fc7d409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:25.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.752+0000 7fc7daa0a640 1 -- 172.21.15.78:0/1238398252 shutdown_connections 2024-09-17T03:14:25.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.752+0000 7fc7daa0a640 1 -- 172.21.15.78:0/1238398252 wait complete. 2024-09-17T03:14:25.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.754+0000 7fc7daa0a640 1 Processor -- start 2024-09-17T03:14:25.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.754+0000 7fc7daa0a640 1 -- start start 2024-09-17T03:14:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.755+0000 7fc7daa0a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc7d406f4b0 0x7fc7d41f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.755+0000 7fc7daa0a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7d40ceb40 0x7fc7d4156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.755+0000 7fc7daa0a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d41f8930 0x7fc7d41f8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:25.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7daa0a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d40d0e60 con 0x7fc7d41f8930 2024-09-17T03:14:25.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7daa0a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d40d0ce0 con 0x7fc7d40ceb40 2024-09-17T03:14:25.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7daa0a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d40d0fe0 con 0x7fc7d406f4b0 2024-09-17T03:14:25.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7d8fa7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d41f8930 0x7fc7d41f8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:25.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7d8fa7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d41f8930 0x7fc7d41f8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52648/0 (socket says 172.21.15.78:52648) 2024-09-17T03:14:25.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7d8fa7640 1 -- 172.21.15.78:0/4157093814 learned_addr learned my addr 172.21.15.78:0/4157093814 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:25.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7d37fe640 1 --2- 172.21.15.78:0/4157093814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7d40ceb40 0x7fc7d4156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:25.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7d3fff640 1 --2- 172.21.15.78:0/4157093814 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc7d406f4b0 0x7fc7d41f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:25.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7d8fa7640 1 -- 172.21.15.78:0/4157093814 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc7d406f4b0 msgr2=0x7fc7d41f5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7d8fa7640 1 --2- 172.21.15.78:0/4157093814 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc7d406f4b0 0x7fc7d41f5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7d8fa7640 1 -- 172.21.15.78:0/4157093814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7d40ceb40 msgr2=0x7fc7d4156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7d8fa7640 1 --2- 172.21.15.78:0/4157093814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7d40ceb40 0x7fc7d4156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7d8fa7640 1 -- 172.21.15.78:0/4157093814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d41f9890 con 0x7fc7d41f8930 2024-09-17T03:14:25.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7d3fff640 1 --2- 172.21.15.78:0/4157093814 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc7d406f4b0 0x7fc7d41f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:25.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7d37fe640 1 --2- 172.21.15.78:0/4157093814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7d40ceb40 0x7fc7d4156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:25.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7d8fa7640 1 --2- 172.21.15.78:0/4157093814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d41f8930 0x7fc7d41f8d40 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00ba10 tx=0x7fc7cc00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:25.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7d0ff9640 1 -- 172.21.15.78:0/4157093814 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc019070 con 0x7fc7d41f8930 2024-09-17T03:14:25.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7d0ff9640 1 -- 172.21.15.78:0/4157093814 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc7cc00cc50 con 0x7fc7d41f8930 2024-09-17T03:14:25.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7daa0a640 1 -- 172.21.15.78:0/4157093814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d41f95b0 con 0x7fc7d41f8930 2024-09-17T03:14:25.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7d0ff9640 1 -- 172.21.15.78:0/4157093814 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0146a0 con 0x7fc7d41f8930 2024-09-17T03:14:25.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.756+0000 7fc7daa0a640 1 -- 172.21.15.78:0/4157093814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d41f57a0 con 0x7fc7d41f8930 2024-09-17T03:14:25.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.757+0000 7fc7daa0a640 1 -- 172.21.15.78:0/4157093814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7d40d1590 con 0x7fc7d41f8930 2024-09-17T03:14:25.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.758+0000 7fc7d0ff9640 1 -- 172.21.15.78:0/4157093814 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc7cc01c070 con 0x7fc7d41f8930 2024-09-17T03:14:25.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.758+0000 7fc7d0ff9640 1 --2- 172.21.15.78:0/4157093814 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc7c0078b90 0x7fc7c007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:25.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.759+0000 7fc7d0ff9640 1 -- 172.21.15.78:0/4157093814 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7fc7cc09aaf0 con 0x7fc7d41f8930 2024-09-17T03:14:25.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.759+0000 7fc7d3fff640 1 --2- 172.21.15.78:0/4157093814 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc7c0078b90 0x7fc7c007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:25.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.759+0000 7fc7d3fff640 1 --2- 172.21.15.78:0/4157093814 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc7c0078b90 0x7fc7c007b0a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4034000 tx=0x7fc7c4004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:25.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.763+0000 7fc7d0ff9640 1 -- 172.21.15.78:0/4157093814 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc7cc062ef0 con 0x7fc7d41f8930 2024-09-17T03:14:25.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.970+0000 7fc7daa0a640 1 -- 172.21.15.78:0/4157093814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7d41f9340 con 0x7fc7d41f8930 2024-09-17T03:14:25.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.970+0000 7fc7d0ff9640 1 -- 172.21.15.78:0/4157093814 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5278 (secure 0 0 0) 0x7fc7cc0627f0 con 0x7fc7d41f8930 2024-09-17T03:14:25.969 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:25.969 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:35.489582+0000","modified":"2024-09-17T03:14:08.415660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7428,"mds_1":7425,"mds_2":6640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"d","rank":2,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/1005450673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1005450673},{"type":"v1","addr":"172.21.15.193:6837","nonce":1005450673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7425":{"gid":7425,"name":"c","rank":1,"incarnation":78,"state":"up:active","state_seq":10,"addr":"172.21.15.78:6835/4018023271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4018023271},{"type":"v1","addr":"172.21.15.78:6835","nonce":4018023271}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6832/3357123265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":3357123265},{"type":"v1","addr":"172.21.15.78:6832","nonce":3357123265}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7428,"qdb_cluster":[6640,7425,7428]},"id":6}]} 2024-09-17T03:14:25.970 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 85 2024-09-17T03:14:25.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.972+0000 7fc7daa0a640 1 -- 172.21.15.78:0/4157093814 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc7c0078b90 msgr2=0x7fc7c007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.972+0000 7fc7daa0a640 1 --2- 172.21.15.78:0/4157093814 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc7c0078b90 0x7fc7c007b0a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4034000 tx=0x7fc7c4004730 comp rx=0 tx=0).stop 2024-09-17T03:14:25.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.972+0000 7fc7daa0a640 1 -- 172.21.15.78:0/4157093814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d41f8930 msgr2=0x7fc7d41f8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:25.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.972+0000 7fc7daa0a640 1 --2- 172.21.15.78:0/4157093814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d41f8930 0x7fc7d41f8d40 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00ba10 tx=0x7fc7cc00bed0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.972+0000 7fc7daa0a640 1 -- 172.21.15.78:0/4157093814 shutdown_connections 2024-09-17T03:14:25.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.972+0000 7fc7daa0a640 1 --2- 172.21.15.78:0/4157093814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d41f8930 0x7fc7d41f8d40 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.972+0000 7fc7daa0a640 1 --2- 172.21.15.78:0/4157093814 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc7c0078b90 0x7fc7c007b0a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.973+0000 7fc7daa0a640 1 --2- 172.21.15.78:0/4157093814 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc7d40ceb40 0x7fc7d4156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.973+0000 7fc7daa0a640 1 --2- 172.21.15.78:0/4157093814 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc7d406f4b0 0x7fc7d41f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:25.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.973+0000 7fc7daa0a640 1 -- 172.21.15.78:0/4157093814 >> 172.21.15.78:0/4157093814 conn(0x7fc7d408bfc0 msgr2=0x7fc7d4068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:25.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.973+0000 7fc7daa0a640 1 -- 172.21.15.78:0/4157093814 shutdown_connections 2024-09-17T03:14:25.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:25.973+0000 7fc7daa0a640 1 -- 172.21.15.78:0/4157093814 wait complete. 2024-09-17T03:14:25.983 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:14:26.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.096+0000 7f0348ade640 1 -- 172.21.15.78:0/4158177559 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03440cf320 msgr2=0x7f03440ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:26.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.096+0000 7f0348ade640 1 --2- 172.21.15.78:0/4158177559 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03440cf320 0x7f03440ccbc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0338009830 tx=0x7f033802a510 comp rx=0 tx=0).stop 2024-09-17T03:14:26.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.096+0000 7f0348ade640 1 -- 172.21.15.78:0/4158177559 shutdown_connections 2024-09-17T03:14:26.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.096+0000 7f0348ade640 1 --2- 172.21.15.78:0/4158177559 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f03440b7cc0 0x7f03440d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.096+0000 7f0348ade640 1 --2- 172.21.15.78:0/4158177559 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03440cf320 0x7f03440ccbc0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.096+0000 7f0348ade640 1 -- 172.21.15.78:0/4158177559 >> 172.21.15.78:0/4158177559 conn(0x7f034406d4f0 msgr2=0x7f0344071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:26.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.096+0000 7f0348ade640 1 -- 172.21.15.78:0/4158177559 shutdown_connections 2024-09-17T03:14:26.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.096+0000 7f0348ade640 1 -- 172.21.15.78:0/4158177559 wait complete. 2024-09-17T03:14:26.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.098+0000 7f0348ade640 1 Processor -- start 2024-09-17T03:14:26.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.098+0000 7f0348ade640 1 -- start start 2024-09-17T03:14:26.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.099+0000 7f0348ade640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f03440b7cc0 0x7f03440c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:26.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.099+0000 7f0348ade640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03440cf320 0x7f034414f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:26.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.099+0000 7f0348ade640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03441600b0 0x7f03440b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:26.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.099+0000 7f0348ade640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f03440d1410 con 0x7f03440cf320 2024-09-17T03:14:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.099+0000 7f0348ade640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f03440d1290 con 0x7f03441600b0 2024-09-17T03:14:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.099+0000 7f0348ade640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f03440d1590 con 0x7f03440b7cc0 2024-09-17T03:14:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.099+0000 7f0341d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03440cf320 0x7f034414f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.100+0000 7f0341d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03440cf320 0x7f034414f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52652/0 (socket says 172.21.15.78:52652) 2024-09-17T03:14:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.100+0000 7f0341d9b640 1 -- 172.21.15.78:0/4081707672 learned_addr learned my addr 172.21.15.78:0/4081707672 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.100+0000 7f034259c640 1 --2- 172.21.15.78:0/4081707672 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f03440b7cc0 0x7f03440c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.100+0000 7f0342d9d640 1 --2- 172.21.15.78:0/4081707672 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03441600b0 0x7f03440b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.100+0000 7f0341d9b640 1 -- 172.21.15.78:0/4081707672 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f03440b7cc0 msgr2=0x7f03440c9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.100+0000 7f0341d9b640 1 --2- 172.21.15.78:0/4081707672 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f03440b7cc0 0x7f03440c9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.100+0000 7f0341d9b640 1 -- 172.21.15.78:0/4081707672 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03441600b0 msgr2=0x7f03440b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.100+0000 7f0341d9b640 1 --2- 172.21.15.78:0/4081707672 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03441600b0 0x7f03440b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.100+0000 7f0341d9b640 1 -- 172.21.15.78:0/4081707672 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03440a9fc0 con 0x7f03440cf320 2024-09-17T03:14:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.100+0000 7f0341d9b640 1 --2- 172.21.15.78:0/4081707672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03440cf320 0x7f034414f510 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f0338009950 tx=0x7f0338033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:26.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.100+0000 7f0332ffd640 1 -- 172.21.15.78:0/4081707672 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0338005c90 con 0x7f03440cf320 2024-09-17T03:14:26.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.100+0000 7f0332ffd640 1 -- 172.21.15.78:0/4081707672 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0338031e50 con 0x7f03440cf320 2024-09-17T03:14:26.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.100+0000 7f0332ffd640 1 -- 172.21.15.78:0/4081707672 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0338005260 con 0x7f03440cf320 2024-09-17T03:14:26.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.100+0000 7f0348ade640 1 -- 172.21.15.78:0/4081707672 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03440aa2a0 con 0x7f03440cf320 2024-09-17T03:14:26.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.100+0000 7f0348ade640 1 -- 172.21.15.78:0/4081707672 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03440cb390 con 0x7f03440cf320 2024-09-17T03:14:26.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.101+0000 7f0348ade640 1 -- 172.21.15.78:0/4081707672 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03440caea0 con 0x7f03440cf320 2024-09-17T03:14:26.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.102+0000 7f0332ffd640 1 -- 172.21.15.78:0/4081707672 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0338005400 con 0x7f03440cf320 2024-09-17T03:14:26.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.103+0000 7f0332ffd640 1 --2- 172.21.15.78:0/4081707672 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0324078bc0 0x7f032407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:26.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.103+0000 7f0332ffd640 1 -- 172.21.15.78:0/4081707672 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f03380bbc40 con 0x7f03440cf320 2024-09-17T03:14:26.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.103+0000 7f034259c640 1 --2- 172.21.15.78:0/4081707672 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0324078bc0 0x7f032407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:26.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.103+0000 7f034259c640 1 --2- 172.21.15.78:0/4081707672 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0324078bc0 0x7f032407b0d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0334007fd0 tx=0x7f0334000fe0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:26.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.107+0000 7f0332ffd640 1 -- 172.21.15.78:0/4081707672 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f033803f030 con 0x7f03440cf320 2024-09-17T03:14:26.139 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:14:26.142 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:14:26.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.287+0000 7f0348ade640 1 -- 172.21.15.78:0/4081707672 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03440d1b20 con 0x7f03440cf320 2024-09-17T03:14:26.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.288+0000 7f0332ffd640 1 -- 172.21.15.78:0/4081707672 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+16794 (secure 0 0 0) 0x7f0338083a80 con 0x7f03440cf320 2024-09-17T03:14:26.288 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:26.288 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":84,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:14:10.468787+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:13:33.178329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T03:13:34.460993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.16","mappings":[{"from":1,"to":5}]},{"pgid":"13.27","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:14:26.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.290+0000 7f0348ade640 1 -- 172.21.15.78:0/4081707672 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0324078bc0 msgr2=0x7f032407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:26.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.290+0000 7f0348ade640 1 --2- 172.21.15.78:0/4081707672 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0324078bc0 0x7f032407b0d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0334007fd0 tx=0x7f0334000fe0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.290+0000 7f0348ade640 1 -- 172.21.15.78:0/4081707672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03440cf320 msgr2=0x7f034414f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:26.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.290+0000 7f0348ade640 1 --2- 172.21.15.78:0/4081707672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03440cf320 0x7f034414f510 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f0338009950 tx=0x7f0338033c20 comp rx=0 tx=0).stop 2024-09-17T03:14:26.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.290+0000 7f0348ade640 1 -- 172.21.15.78:0/4081707672 shutdown_connections 2024-09-17T03:14:26.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.290+0000 7f0348ade640 1 --2- 172.21.15.78:0/4081707672 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0324078bc0 0x7f032407b0d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.290+0000 7f0348ade640 1 --2- 172.21.15.78:0/4081707672 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f03441600b0 0x7f03440b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.290+0000 7f0348ade640 1 --2- 172.21.15.78:0/4081707672 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f03440cf320 0x7f034414f510 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.290+0000 7f0348ade640 1 --2- 172.21.15.78:0/4081707672 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f03440b7cc0 0x7f03440c9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.290+0000 7f0348ade640 1 -- 172.21.15.78:0/4081707672 >> 172.21.15.78:0/4081707672 conn(0x7f034406d4f0 msgr2=0x7f034415a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:26.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.290+0000 7f0348ade640 1 -- 172.21.15.78:0/4081707672 shutdown_connections 2024-09-17T03:14:26.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.290+0000 7f0348ade640 1 -- 172.21.15.78:0/4081707672 wait complete. 2024-09-17T03:14:26.301 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:14:26.301 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:26.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.414+0000 7f2ff1e7e640 1 -- 172.21.15.78:0/2608370314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fec15d670 msgr2=0x7f2fec0b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:26.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.414+0000 7f2ff1e7e640 1 --2- 172.21.15.78:0/2608370314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fec15d670 0x7f2fec0b7490 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f2fec074b10 tx=0x7f2fe402aa30 comp rx=0 tx=0).stop 2024-09-17T03:14:26.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.414+0000 7f2ff1e7e640 1 -- 172.21.15.78:0/2608370314 shutdown_connections 2024-09-17T03:14:26.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.414+0000 7f2ff1e7e640 1 --2- 172.21.15.78:0/2608370314 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fec15d670 0x7f2fec0b7490 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.414+0000 7f2ff1e7e640 1 --2- 172.21.15.78:0/2608370314 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2fec0d2460 0x7f2fec15d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.414+0000 7f2ff1e7e640 1 --2- 172.21.15.78:0/2608370314 >> v2:172.21.15.193:3300/0 conn(0x7f2fec1570e0 0x7f2fec0d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.414+0000 7f2ff1e7e640 1 -- 172.21.15.78:0/2608370314 >> 172.21.15.78:0/2608370314 conn(0x7f2fec06d550 msgr2=0x7f2fec071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:26.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.414+0000 7f2ff1e7e640 1 -- 172.21.15.78:0/2608370314 shutdown_connections 2024-09-17T03:14:26.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.414+0000 7f2ff1e7e640 1 -- 172.21.15.78:0/2608370314 wait complete. 2024-09-17T03:14:26.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.416+0000 7f2ff1e7e640 1 Processor -- start 2024-09-17T03:14:26.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.416+0000 7f2ff1e7e640 1 -- start start 2024-09-17T03:14:26.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.417+0000 7f2ff1e7e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fec0d2460 0x7f2fec154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:26.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.417+0000 7f2ff1e7e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2fec1570e0 0x7f2fec0ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:26.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.417+0000 7f2ff1e7e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fec15d670 0x7f2fec0ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:26.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.417+0000 7f2ff1e7e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f2fec0b7b50 con 0x7f2fec15d670 2024-09-17T03:14:26.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.417+0000 7f2ff1e7e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2fec0b79d0 con 0x7f2fec0d2460 2024-09-17T03:14:26.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.417+0000 7f2ff1e7e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f2fec0b7cd0 con 0x7f2fec1570e0 2024-09-17T03:14:26.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.417+0000 7f2febfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fec15d670 0x7f2fec0ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:26.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.417+0000 7f2febfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fec15d670 0x7f2fec0ca810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60600/0 (socket says 172.21.15.78:60600) 2024-09-17T03:14:26.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.417+0000 7f2febfff640 1 -- 172.21.15.78:0/2450469878 learned_addr learned my addr 172.21.15.78:0/2450469878 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:26.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.418+0000 7f2feb7fe640 1 --2- 172.21.15.78:0/2450469878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fec0d2460 0x7f2fec154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:26.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.418+0000 7f2feaffd640 1 --2- 172.21.15.78:0/2450469878 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2fec1570e0 0x7f2fec0ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:26.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.418+0000 7f2febfff640 1 -- 172.21.15.78:0/2450469878 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2fec1570e0 msgr2=0x7f2fec0ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:26.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.418+0000 7f2febfff640 1 --2- 172.21.15.78:0/2450469878 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2fec1570e0 0x7f2fec0ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.418+0000 7f2febfff640 1 -- 172.21.15.78:0/2450469878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fec0d2460 msgr2=0x7f2fec154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:26.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.418+0000 7f2febfff640 1 --2- 172.21.15.78:0/2450469878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fec0d2460 0x7f2fec154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.418+0000 7f2febfff640 1 -- 172.21.15.78:0/2450469878 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fec0c7d90 con 0x7f2fec15d670 2024-09-17T03:14:26.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.418+0000 7f2febfff640 1 --2- 172.21.15.78:0/2450469878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fec15d670 0x7f2fec0ca810 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f2fe402b020 tx=0x7f2fe4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:26.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.418+0000 7f2fd3fff640 1 -- 172.21.15.78:0/2450469878 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4033050 con 0x7f2fec15d670 2024-09-17T03:14:26.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.418+0000 7f2fd3fff640 1 -- 172.21.15.78:0/2450469878 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2fe4004450 con 0x7f2fec15d670 2024-09-17T03:14:26.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.418+0000 7f2ff1e7e640 1 -- 172.21.15.78:0/2450469878 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fec0c8070 con 0x7f2fec15d670 2024-09-17T03:14:26.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.418+0000 7f2fd3fff640 1 -- 172.21.15.78:0/2450469878 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4004840 con 0x7f2fec15d670 2024-09-17T03:14:26.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.418+0000 7f2ff1e7e640 1 -- 172.21.15.78:0/2450469878 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fec0c8630 con 0x7f2fec15d670 2024-09-17T03:14:26.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.419+0000 7f2ff1e7e640 1 -- 172.21.15.78:0/2450469878 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fec1581c0 con 0x7f2fec15d670 2024-09-17T03:14:26.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.420+0000 7f2fd3fff640 1 -- 172.21.15.78:0/2450469878 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2fe4036070 con 0x7f2fec15d670 2024-09-17T03:14:26.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.420+0000 7f2fd3fff640 1 --2- 172.21.15.78:0/2450469878 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2fd8078bc0 0x7f2fd807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:26.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.421+0000 7f2fd3fff640 1 -- 172.21.15.78:0/2450469878 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f2fe40bc230 con 0x7f2fec15d670 2024-09-17T03:14:26.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.421+0000 7f2feb7fe640 1 --2- 172.21.15.78:0/2450469878 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2fd8078bc0 0x7f2fd807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:26.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.421+0000 7f2feb7fe640 1 --2- 172.21.15.78:0/2450469878 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2fd8078bc0 0x7f2fd807b0d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00bb50 tx=0x7f2fdc00b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:26.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.425+0000 7f2fd3fff640 1 -- 172.21.15.78:0/2450469878 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2fe4083f60 con 0x7f2fec15d670 2024-09-17T03:14:26.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.634+0000 7f2ff1e7e640 1 -- 172.21.15.78:0/2450469878 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2fec0b7710 con 0x7f2fec15d670 2024-09-17T03:14:26.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.635+0000 7f2fd3fff640 1 -- 172.21.15.78:0/2450469878 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5278 (secure 0 0 0) 0x7f2fec0b7710 con 0x7f2fec15d670 2024-09-17T03:14:26.634 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:26.634 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:35.489582+0000","modified":"2024-09-17T03:14:08.415660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7428,"mds_1":7425,"mds_2":6640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"d","rank":2,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/1005450673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1005450673},{"type":"v1","addr":"172.21.15.193:6837","nonce":1005450673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7425":{"gid":7425,"name":"c","rank":1,"incarnation":78,"state":"up:active","state_seq":10,"addr":"172.21.15.78:6835/4018023271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4018023271},{"type":"v1","addr":"172.21.15.78:6835","nonce":4018023271}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6832/3357123265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":3357123265},{"type":"v1","addr":"172.21.15.78:6832","nonce":3357123265}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7428,"qdb_cluster":[6640,7425,7428]},"id":6}]} 2024-09-17T03:14:26.634 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 85 2024-09-17T03:14:26.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.637+0000 7f2ff1e7e640 1 -- 172.21.15.78:0/2450469878 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2fd8078bc0 msgr2=0x7f2fd807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:26.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.637+0000 7f2ff1e7e640 1 --2- 172.21.15.78:0/2450469878 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2fd8078bc0 0x7f2fd807b0d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00bb50 tx=0x7f2fdc00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.637+0000 7f2ff1e7e640 1 -- 172.21.15.78:0/2450469878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fec15d670 msgr2=0x7f2fec0ca810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:26.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.637+0000 7f2ff1e7e640 1 --2- 172.21.15.78:0/2450469878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fec15d670 0x7f2fec0ca810 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f2fe402b020 tx=0x7f2fe4003f10 comp rx=0 tx=0).stop 2024-09-17T03:14:26.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.637+0000 7f2ff1e7e640 1 -- 172.21.15.78:0/2450469878 shutdown_connections 2024-09-17T03:14:26.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.637+0000 7f2ff1e7e640 1 --2- 172.21.15.78:0/2450469878 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2fec15d670 0x7f2fec0ca810 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.637+0000 7f2ff1e7e640 1 --2- 172.21.15.78:0/2450469878 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2fec1570e0 0x7f2fec0ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.637+0000 7f2ff1e7e640 1 --2- 172.21.15.78:0/2450469878 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2fd8078bc0 0x7f2fd807b0d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.637+0000 7f2ff1e7e640 1 --2- 172.21.15.78:0/2450469878 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fec0d2460 0x7f2fec154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.637+0000 7f2ff1e7e640 1 -- 172.21.15.78:0/2450469878 >> 172.21.15.78:0/2450469878 conn(0x7f2fec06d550 msgr2=0x7f2fec15e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:26.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.638+0000 7f2ff1e7e640 1 -- 172.21.15.78:0/2450469878 shutdown_connections 2024-09-17T03:14:26.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.638+0000 7f2ff1e7e640 1 -- 172.21.15.78:0/2450469878 wait complete. 2024-09-17T03:14:26.648 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:26.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.760+0000 7f160016e640 1 -- 172.21.15.78:0/1169022050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f806e0a0 msgr2=0x7f15f80b97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:26.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.760+0000 7f160016e640 1 --2- 172.21.15.78:0/1169022050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f806e0a0 0x7f15f80b97e0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009820 tx=0x7f15f402a3f0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.760+0000 7f160016e640 1 -- 172.21.15.78:0/1169022050 shutdown_connections 2024-09-17T03:14:26.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.760+0000 7f160016e640 1 --2- 172.21.15.78:0/1169022050 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15f806f6e0 0x7f15f806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.760+0000 7f160016e640 1 --2- 172.21.15.78:0/1169022050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f806e0a0 0x7f15f80b97e0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.760+0000 7f160016e640 1 -- 172.21.15.78:0/1169022050 >> 172.21.15.78:0/1169022050 conn(0x7f15f809d840 msgr2=0x7f15f808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:26.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.760+0000 7f160016e640 1 -- 172.21.15.78:0/1169022050 shutdown_connections 2024-09-17T03:14:26.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.760+0000 7f160016e640 1 -- 172.21.15.78:0/1169022050 wait complete. 2024-09-17T03:14:26.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.762+0000 7f160016e640 1 Processor -- start 2024-09-17T03:14:26.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.762+0000 7f160016e640 1 -- start start 2024-09-17T03:14:26.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.763+0000 7f160016e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f806e0a0 0x7f15f81f6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:26.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.763+0000 7f160016e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15f806f6e0 0x7f15f815ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:26.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.763+0000 7f160016e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15f80d0e50 0x7f15f80cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:26.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.763+0000 7f160016e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f15f80cfcd0 con 0x7f15f806e0a0 2024-09-17T03:14:26.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.763+0000 7f160016e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f15f80cfb50 con 0x7f15f806f6e0 2024-09-17T03:14:26.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.763+0000 7f160016e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f15f80cfe50 con 0x7f15f80d0e50 2024-09-17T03:14:26.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.763+0000 7f15fdf0a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f806e0a0 0x7f15f81f6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:26.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.763+0000 7f15fdf0a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f806e0a0 0x7f15f81f6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60618/0 (socket says 172.21.15.78:60618) 2024-09-17T03:14:26.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.763+0000 7f15fdf0a640 1 -- 172.21.15.78:0/2073012429 learned_addr learned my addr 172.21.15.78:0/2073012429 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:26.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.764+0000 7f15fe70b640 1 --2- 172.21.15.78:0/2073012429 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15f80d0e50 0x7f15f80cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:26.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.764+0000 7f15fd709640 1 --2- 172.21.15.78:0/2073012429 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15f806f6e0 0x7f15f815ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:26.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.764+0000 7f15fdf0a640 1 -- 172.21.15.78:0/2073012429 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15f80d0e50 msgr2=0x7f15f80cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:26.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.764+0000 7f15fdf0a640 1 --2- 172.21.15.78:0/2073012429 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15f80d0e50 0x7f15f80cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.764+0000 7f15fdf0a640 1 -- 172.21.15.78:0/2073012429 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15f806f6e0 msgr2=0x7f15f815ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:26.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.764+0000 7f15fdf0a640 1 --2- 172.21.15.78:0/2073012429 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15f806f6e0 0x7f15f815ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.764+0000 7f15fdf0a640 1 -- 172.21.15.78:0/2073012429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f81f6890 con 0x7f15f806e0a0 2024-09-17T03:14:26.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.764+0000 7f15fe70b640 1 --2- 172.21.15.78:0/2073012429 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15f80d0e50 0x7f15f80cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:26.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.764+0000 7f15fd709640 1 --2- 172.21.15.78:0/2073012429 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15f806f6e0 0x7f15f815ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:26.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.764+0000 7f15fdf0a640 1 --2- 172.21.15.78:0/2073012429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f806e0a0 0x7f15f81f6350 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f15f402a9e0 tx=0x7f15f4004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:26.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.764+0000 7f15ee7fc640 1 -- 172.21.15.78:0/2073012429 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f403f070 con 0x7f15f806e0a0 2024-09-17T03:14:26.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.764+0000 7f15ee7fc640 1 -- 172.21.15.78:0/2073012429 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15f4004e50 con 0x7f15f806e0a0 2024-09-17T03:14:26.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.764+0000 7f15ee7fc640 1 -- 172.21.15.78:0/2073012429 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f4031950 con 0x7f15f806e0a0 2024-09-17T03:14:26.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.764+0000 7f160016e640 1 -- 172.21.15.78:0/2073012429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15f80cdb60 con 0x7f15f806e0a0 2024-09-17T03:14:26.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.764+0000 7f160016e640 1 -- 172.21.15.78:0/2073012429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15f80ce120 con 0x7f15f806e0a0 2024-09-17T03:14:26.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.765+0000 7f160016e640 1 -- 172.21.15.78:0/2073012429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15f80d0240 con 0x7f15f806e0a0 2024-09-17T03:14:26.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.766+0000 7f15ee7fc640 1 -- 172.21.15.78:0/2073012429 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f15f4042070 con 0x7f15f806e0a0 2024-09-17T03:14:26.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.766+0000 7f15ee7fc640 1 --2- 172.21.15.78:0/2073012429 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f15dc078b90 0x7f15dc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:26.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.766+0000 7f15ee7fc640 1 -- 172.21.15.78:0/2073012429 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f15f40bbe20 con 0x7f15f806e0a0 2024-09-17T03:14:26.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.767+0000 7f15fd709640 1 --2- 172.21.15.78:0/2073012429 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f15dc078b90 0x7f15dc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:26.767 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.767+0000 7f15fd709640 1 --2- 172.21.15.78:0/2073012429 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f15dc078b90 0x7f15dc07b0a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f15f80b43c0 tx=0x7f15e8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:26.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.771+0000 7f15ee7fc640 1 -- 172.21.15.78:0/2073012429 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f15f81f6890 con 0x7f15f806e0a0 2024-09-17T03:14:26.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.984+0000 7f160016e640 1 -- 172.21.15.78:0/2073012429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15f80cf760 con 0x7f15f806e0a0 2024-09-17T03:14:26.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.984+0000 7f15ee7fc640 1 -- 172.21.15.78:0/2073012429 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5278 (secure 0 0 0) 0x7f15f4031770 con 0x7f15f806e0a0 2024-09-17T03:14:26.983 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:26.983 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":85,"btime":"2024-09-17T03:14:08:454509+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:13:35.489582+0000","modified":"2024-09-17T03:14:08.415660+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":7428,"mds_1":7425,"mds_2":6640},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6640":{"gid":6640,"name":"d","rank":2,"incarnation":80,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/1005450673","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1005450673},{"type":"v1","addr":"172.21.15.193:6837","nonce":1005450673}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7425":{"gid":7425,"name":"c","rank":1,"incarnation":78,"state":"up:active","state_seq":10,"addr":"172.21.15.78:6835/4018023271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4018023271},{"type":"v1","addr":"172.21.15.78:6835","nonce":4018023271}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_7428":{"gid":7428,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6832/3357123265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":3357123265},{"type":"v1","addr":"172.21.15.78:6832","nonce":3357123265}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7428,"qdb_cluster":[6640,7425,7428]},"id":6}]} 2024-09-17T03:14:26.984 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 85 2024-09-17T03:14:26.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.987+0000 7f160016e640 1 -- 172.21.15.78:0/2073012429 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f15dc078b90 msgr2=0x7f15dc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:26.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.987+0000 7f160016e640 1 --2- 172.21.15.78:0/2073012429 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f15dc078b90 0x7f15dc07b0a0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f15f80b43c0 tx=0x7f15e8008040 comp rx=0 tx=0).stop 2024-09-17T03:14:26.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.987+0000 7f160016e640 1 -- 172.21.15.78:0/2073012429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f806e0a0 msgr2=0x7f15f81f6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:26.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.987+0000 7f160016e640 1 --2- 172.21.15.78:0/2073012429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f806e0a0 0x7f15f81f6350 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f15f402a9e0 tx=0x7f15f4004a50 comp rx=0 tx=0).stop 2024-09-17T03:14:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.987+0000 7f160016e640 1 -- 172.21.15.78:0/2073012429 shutdown_connections 2024-09-17T03:14:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.987+0000 7f160016e640 1 --2- 172.21.15.78:0/2073012429 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15f80d0e50 0x7f15f80cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.987+0000 7f160016e640 1 --2- 172.21.15.78:0/2073012429 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f15dc078b90 0x7f15dc07b0a0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.987+0000 7f160016e640 1 --2- 172.21.15.78:0/2073012429 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15f806f6e0 0x7f15f815ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.987+0000 7f160016e640 1 --2- 172.21.15.78:0/2073012429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15f806e0a0 0x7f15f81f6350 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.987+0000 7f160016e640 1 -- 172.21.15.78:0/2073012429 >> 172.21.15.78:0/2073012429 conn(0x7f15f809d840 msgr2=0x7f15f8161c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.987+0000 7f160016e640 1 -- 172.21.15.78:0/2073012429 shutdown_connections 2024-09-17T03:14:26.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:26.987+0000 7f160016e640 1 -- 172.21.15.78:0/2073012429 wait complete. 2024-09-17T03:14:26.997 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:14:27.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.110+0000 7f6cb1484640 1 -- 172.21.15.78:0/1016679689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cac0b7fe0 msgr2=0x7f6cac0d0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:27.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.110+0000 7f6cb1484640 1 --2- 172.21.15.78:0/1016679689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cac0b7fe0 0x7f6cac0d0190 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4005fd0 tx=0x7f6ca402a970 comp rx=0 tx=0).stop 2024-09-17T03:14:27.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.110+0000 7f6cb1484640 1 -- 172.21.15.78:0/1016679689 shutdown_connections 2024-09-17T03:14:27.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.110+0000 7f6cb1484640 1 --2- 172.21.15.78:0/1016679689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cac0b7fe0 0x7f6cac0d0190 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.110+0000 7f6cb1484640 1 --2- 172.21.15.78:0/1016679689 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6cac0cf440 0x7f6cac15c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.110+0000 7f6cb1484640 1 -- 172.21.15.78:0/1016679689 >> 172.21.15.78:0/1016679689 conn(0x7f6cac0710b0 msgr2=0x7f6cac0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:27.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.110+0000 7f6cb1484640 1 -- 172.21.15.78:0/1016679689 shutdown_connections 2024-09-17T03:14:27.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.110+0000 7f6cb1484640 1 -- 172.21.15.78:0/1016679689 wait complete. 2024-09-17T03:14:27.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.112+0000 7f6cb1484640 1 Processor -- start 2024-09-17T03:14:27.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.112+0000 7f6cb1484640 1 -- start start 2024-09-17T03:14:27.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.113+0000 7f6cb1484640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6cac0b7fe0 0x7f6cac0cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:27.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.113+0000 7f6cb1484640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6cac0cd360 0x7f6cac0c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:27.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.113+0000 7f6cb1484640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cac1574c0 0x7f6cac0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:27.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.113+0000 7f6cb1484640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac0d0b70 con 0x7f6cac1574c0 2024-09-17T03:14:27.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.113+0000 7f6cb1484640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6cac0d09f0 con 0x7f6cac0b7fe0 2024-09-17T03:14:27.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.113+0000 7f6cb1484640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f6cac0d0cf0 con 0x7f6cac0cd360 2024-09-17T03:14:27.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.113+0000 7f6cab7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cac1574c0 0x7f6cac0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:27.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.114+0000 7f6cab7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cac1574c0 0x7f6cac0c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60630/0 (socket says 172.21.15.78:60630) 2024-09-17T03:14:27.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.114+0000 7f6cab7fe640 1 -- 172.21.15.78:0/1474792831 learned_addr learned my addr 172.21.15.78:0/1474792831 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:27.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.114+0000 7f6ca27fc640 1 --2- 172.21.15.78:0/1474792831 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6cac0cd360 0x7f6cac0c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.114+0000 7f6caaffd640 1 --2- 172.21.15.78:0/1474792831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6cac0b7fe0 0x7f6cac0cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.114+0000 7f6cab7fe640 1 -- 172.21.15.78:0/1474792831 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6cac0cd360 msgr2=0x7f6cac0c71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.114+0000 7f6cab7fe640 1 --2- 172.21.15.78:0/1474792831 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6cac0cd360 0x7f6cac0c71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.114+0000 7f6cab7fe640 1 -- 172.21.15.78:0/1474792831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6cac0b7fe0 msgr2=0x7f6cac0cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.114+0000 7f6cab7fe640 1 --2- 172.21.15.78:0/1474792831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6cac0b7fe0 0x7f6cac0cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.114+0000 7f6cab7fe640 1 -- 172.21.15.78:0/1474792831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cac0cbb90 con 0x7f6cac1574c0 2024-09-17T03:14:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.114+0000 7f6cab7fe640 1 --2- 172.21.15.78:0/1474792831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cac1574c0 0x7f6cac0c7710 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4006010 tx=0x7f6ca4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.114+0000 7f6ca3fff640 1 -- 172.21.15.78:0/1474792831 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4034070 con 0x7f6cac1574c0 2024-09-17T03:14:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.114+0000 7f6ca3fff640 1 -- 172.21.15.78:0/1474792831 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ca4004640 con 0x7f6cac1574c0 2024-09-17T03:14:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.114+0000 7f6cb1484640 1 -- 172.21.15.78:0/1474792831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cac159d00 con 0x7f6cac1574c0 2024-09-17T03:14:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.114+0000 7f6ca3fff640 1 -- 172.21.15.78:0/1474792831 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca40436a0 con 0x7f6cac1574c0 2024-09-17T03:14:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.114+0000 7f6cb1484640 1 -- 172.21.15.78:0/1474792831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cac15a280 con 0x7f6cac1574c0 2024-09-17T03:14:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.115+0000 7f6cb1484640 1 -- 172.21.15.78:0/1474792831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cac0d1250 con 0x7f6cac1574c0 2024-09-17T03:14:27.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.116+0000 7f6ca3fff640 1 -- 172.21.15.78:0/1474792831 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ca4037020 con 0x7f6cac1574c0 2024-09-17T03:14:27.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.116+0000 7f6ca3fff640 1 --2- 172.21.15.78:0/1474792831 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6c8c078b90 0x7f6c8c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:27.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.117+0000 7f6ca3fff640 1 -- 172.21.15.78:0/1474792831 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f6ca40bc2d0 con 0x7f6cac1574c0 2024-09-17T03:14:27.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.117+0000 7f6caaffd640 1 --2- 172.21.15.78:0/1474792831 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6c8c078b90 0x7f6c8c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:27.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.117+0000 7f6caaffd640 1 --2- 172.21.15.78:0/1474792831 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6c8c078b90 0x7f6c8c07b0a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c006fd0 tx=0x7f6c9c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:27.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.121+0000 7f6ca3fff640 1 -- 172.21.15.78:0/1474792831 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6cac0cbb90 con 0x7f6cac1574c0 2024-09-17T03:14:27.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.296+0000 7f6cb1484640 1 -- 172.21.15.78:0/1474792831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6cac0b16f0 con 0x7f6cac1574c0 2024-09-17T03:14:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.297+0000 7f6ca3fff640 1 -- 172.21.15.78:0/1474792831 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+16794 (secure 0 0 0) 0x7f6ca40846d0 con 0x7f6cac1574c0 2024-09-17T03:14:27.296 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:27.297 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":84,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:14:10.468787+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:13:33.178329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T03:13:34.460993+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.16","mappings":[{"from":1,"to":5}]},{"pgid":"13.27","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:14:27.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.299+0000 7f6cb1484640 1 -- 172.21.15.78:0/1474792831 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6c8c078b90 msgr2=0x7f6c8c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.299+0000 7f6cb1484640 1 --2- 172.21.15.78:0/1474792831 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6c8c078b90 0x7f6c8c07b0a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c006fd0 tx=0x7f6c9c008040 comp rx=0 tx=0).stop 2024-09-17T03:14:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.299+0000 7f6cb1484640 1 -- 172.21.15.78:0/1474792831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cac1574c0 msgr2=0x7f6cac0c7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.299+0000 7f6cb1484640 1 --2- 172.21.15.78:0/1474792831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cac1574c0 0x7f6cac0c7710 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4006010 tx=0x7f6ca4004040 comp rx=0 tx=0).stop 2024-09-17T03:14:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.299+0000 7f6cb1484640 1 -- 172.21.15.78:0/1474792831 shutdown_connections 2024-09-17T03:14:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.299+0000 7f6cb1484640 1 --2- 172.21.15.78:0/1474792831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6cac1574c0 0x7f6cac0c7710 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.299+0000 7f6cb1484640 1 --2- 172.21.15.78:0/1474792831 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6cac0cd360 0x7f6cac0c71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.299+0000 7f6cb1484640 1 --2- 172.21.15.78:0/1474792831 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6c8c078b90 0x7f6c8c07b0a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.299+0000 7f6cb1484640 1 --2- 172.21.15.78:0/1474792831 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6cac0b7fe0 0x7f6cac0cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.300+0000 7f6cb1484640 1 -- 172.21.15.78:0/1474792831 >> 172.21.15.78:0/1474792831 conn(0x7f6cac0710b0 msgr2=0x7f6cac0b26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.300+0000 7f6cb1484640 1 -- 172.21.15.78:0/1474792831 shutdown_connections 2024-09-17T03:14:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.300+0000 7f6cb1484640 1 -- 172.21.15.78:0/1474792831 wait complete. 2024-09-17T03:14:27.310 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:14:27.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.424+0000 7f56fd2fa640 1 -- 172.21.15.78:0/3208646639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56f80cd360 msgr2=0x7f56f815c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:27.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.424+0000 7f56fd2fa640 1 --2- 172.21.15.78:0/3208646639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56f80cd360 0x7f56f815c6a0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f56e8005fd0 tx=0x7f56e802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.424+0000 7f56fd2fa640 1 -- 172.21.15.78:0/3208646639 shutdown_connections 2024-09-17T03:14:27.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.424+0000 7f56fd2fa640 1 --2- 172.21.15.78:0/3208646639 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f56f80b7fe0 0x7f56f80ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.424+0000 7f56fd2fa640 1 --2- 172.21.15.78:0/3208646639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56f80cd360 0x7f56f815c6a0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.424+0000 7f56fd2fa640 1 -- 172.21.15.78:0/3208646639 >> 172.21.15.78:0/3208646639 conn(0x7f56f80710b0 msgr2=0x7f56f80714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:27.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.424+0000 7f56fd2fa640 1 -- 172.21.15.78:0/3208646639 shutdown_connections 2024-09-17T03:14:27.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.424+0000 7f56fd2fa640 1 -- 172.21.15.78:0/3208646639 wait complete. 2024-09-17T03:14:27.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.426+0000 7f56fd2fa640 1 Processor -- start 2024-09-17T03:14:27.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.426+0000 7f56fd2fa640 1 -- start start 2024-09-17T03:14:27.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.427+0000 7f56fd2fa640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f56f80b7fe0 0x7f56f81f83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:27.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.427+0000 7f56fd2fa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56f80cd360 0x7f56f81f8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:27.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.427+0000 7f56fd2fa640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f56f80cf270 0x7f56f80ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:27.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.427+0000 7f56fd2fa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f56f8072f60 con 0x7f56f80cd360 2024-09-17T03:14:27.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.427+0000 7f56fd2fa640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f56f80d13b0 con 0x7f56f80b7fe0 2024-09-17T03:14:27.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.427+0000 7f56fd2fa640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f56f80730e0 con 0x7f56f80cf270 2024-09-17T03:14:27.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.428+0000 7f56f67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56f80cd360 0x7f56f81f8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:27.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.428+0000 7f56f67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56f80cd360 0x7f56f81f8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60652/0 (socket says 172.21.15.78:60652) 2024-09-17T03:14:27.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.428+0000 7f56f67fc640 1 -- 172.21.15.78:0/2014282827 learned_addr learned my addr 172.21.15.78:0/2014282827 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:27.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.428+0000 7f56f6ffd640 1 --2- 172.21.15.78:0/2014282827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f56f80b7fe0 0x7f56f81f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:27.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.428+0000 7f56f77fe640 1 --2- 172.21.15.78:0/2014282827 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f56f80cf270 0x7f56f80ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:27.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.428+0000 7f56f67fc640 1 -- 172.21.15.78:0/2014282827 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f56f80cf270 msgr2=0x7f56f80ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:27.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.428+0000 7f56f67fc640 1 --2- 172.21.15.78:0/2014282827 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f56f80cf270 0x7f56f80ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.428+0000 7f56f67fc640 1 -- 172.21.15.78:0/2014282827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f56f80b7fe0 msgr2=0x7f56f81f83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:27.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.428+0000 7f56f67fc640 1 --2- 172.21.15.78:0/2014282827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f56f80b7fe0 0x7f56f81f83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.428+0000 7f56f67fc640 1 -- 172.21.15.78:0/2014282827 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f8153ca0 con 0x7f56f80cd360 2024-09-17T03:14:27.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.428+0000 7f56f67fc640 1 --2- 172.21.15.78:0/2014282827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56f80cd360 0x7f56f81f8920 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00c970 tx=0x7f56ec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:27.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.428+0000 7f56df7fe640 1 -- 172.21.15.78:0/2014282827 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec007bb0 con 0x7f56f80cd360 2024-09-17T03:14:27.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.428+0000 7f56df7fe640 1 -- 172.21.15.78:0/2014282827 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56ec007e40 con 0x7f56f80cd360 2024-09-17T03:14:27.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.428+0000 7f56df7fe640 1 -- 172.21.15.78:0/2014282827 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56ec00f690 con 0x7f56f80cd360 2024-09-17T03:14:27.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.428+0000 7f56fd2fa640 1 -- 172.21.15.78:0/2014282827 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f81f8e60 con 0x7f56f80cd360 2024-09-17T03:14:27.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.428+0000 7f56fd2fa640 1 -- 172.21.15.78:0/2014282827 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f806e9e0 con 0x7f56f80cd360 2024-09-17T03:14:27.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.429+0000 7f56fd2fa640 1 -- 172.21.15.78:0/2014282827 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f806e470 con 0x7f56f80cd360 2024-09-17T03:14:27.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.430+0000 7f56df7fe640 1 -- 172.21.15.78:0/2014282827 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f56ec00f830 con 0x7f56f80cd360 2024-09-17T03:14:27.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.431+0000 7f56df7fe640 1 --2- 172.21.15.78:0/2014282827 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f56e4078bc0 0x7f56e407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:27.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.431+0000 7f56df7fe640 1 -- 172.21.15.78:0/2014282827 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 5767+0+0 (secure 0 0 0) 0x7f56ec09b3d0 con 0x7f56f80cd360 2024-09-17T03:14:27.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.431+0000 7f56f6ffd640 1 --2- 172.21.15.78:0/2014282827 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f56e4078bc0 0x7f56e407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:27.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.431+0000 7f56f6ffd640 1 --2- 172.21.15.78:0/2014282827 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f56e4078bc0 0x7f56e407b0d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f56e8033000 tx=0x7f56e8004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:27.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.435+0000 7f56df7fe640 1 -- 172.21.15.78:0/2014282827 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f56ec014030 con 0x7f56f80cd360 2024-09-17T03:14:27.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.644+0000 7f56fd2fa640 1 -- 172.21.15.78:0/2014282827 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f56f80735b0 con 0x7f56f80cd360 2024-09-17T03:14:27.643 INFO:tasks.ceph.mon.a.smithi078.stderr:2024-09-17T03:14:27.645+0000 7f192af78640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:14:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.646+0000 7f56df7fe640 1 -- 172.21.15.78:0/2014282827 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v86) ==== 161+0+0 (secure 0 0 0) 0x7f56ec063200 con 0x7f56f80cd360 2024-09-17T03:14:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:14:27.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.649+0000 7f56fd2fa640 1 -- 172.21.15.78:0/2014282827 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f56e4078bc0 msgr2=0x7f56e407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:27.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.649+0000 7f56fd2fa640 1 --2- 172.21.15.78:0/2014282827 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f56e4078bc0 0x7f56e407b0d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f56e8033000 tx=0x7f56e8004730 comp rx=0 tx=0).stop 2024-09-17T03:14:27.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.649+0000 7f56fd2fa640 1 -- 172.21.15.78:0/2014282827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56f80cd360 msgr2=0x7f56f81f8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:27.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.650+0000 7f56fd2fa640 1 --2- 172.21.15.78:0/2014282827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56f80cd360 0x7f56f81f8920 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f56ec00c970 tx=0x7f56ec00ce30 comp rx=0 tx=0).stop 2024-09-17T03:14:27.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.650+0000 7f56fd2fa640 1 -- 172.21.15.78:0/2014282827 shutdown_connections 2024-09-17T03:14:27.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.650+0000 7f56fd2fa640 1 --2- 172.21.15.78:0/2014282827 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f56f80cf270 0x7f56f80ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.650+0000 7f56fd2fa640 1 --2- 172.21.15.78:0/2014282827 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56f80cd360 0x7f56f81f8920 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.650+0000 7f56fd2fa640 1 --2- 172.21.15.78:0/2014282827 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f56e4078bc0 0x7f56e407b0d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.650+0000 7f56fd2fa640 1 --2- 172.21.15.78:0/2014282827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f56f80b7fe0 0x7f56f81f83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.650+0000 7f56fd2fa640 1 -- 172.21.15.78:0/2014282827 >> 172.21.15.78:0/2014282827 conn(0x7f56f80710b0 msgr2=0x7f56f80b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:27.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.650+0000 7f56fd2fa640 1 -- 172.21.15.78:0/2014282827 shutdown_connections 2024-09-17T03:14:27.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.650+0000 7f56fd2fa640 1 -- 172.21.15.78:0/2014282827 wait complete. 2024-09-17T03:14:27.650 INFO:tasks.ceph.mds.c.smithi078.stderr: -5366> 2024-09-17T03:13:31.451+0000 7fc47238e640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-17T03:14:27.650 INFO:tasks.ceph.mds.c.smithi078.stderr: -5365> 2024-09-17T03:13:31.451+0000 7fc47238e640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6833/0: (98) Address already in use 2024-09-17T03:14:27.654 INFO:tasks.ceph.mds.d.smithi193.stderr: -1192> 2024-09-17T03:14:06.142+0000 7f049b974640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-17T03:13:50.794924+0000 1=0+1) n(v0 rc2024-09-17T03:13:50.794924+0000 2=0+2) (inest lock) (ifile excl) caps={6278=pAsLsXsFsx/pAsLsXsFsxcral@4},l=6278 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5613af572680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:13:50.794924+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:13:50.794924+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-17T03:13:50.794924+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-17T03:13:50.794924+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-17T03:14:27.654 INFO:tasks.ceph.mds.d.smithi193.stderr: -1177> 2024-09-17T03:14:06.142+0000 7f049b974640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) caps={6278=pAsLsXsFsx/AsLsXsFsx@2},l=6278 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x5613af573700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-17T03:14:27.657 INFO:tasks.ceph.mds.c.smithi078.stderr: -1332> 2024-09-17T03:14:06.142+0000 7fc46837a640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-17T03:13:50.793924+0000 1=0+1) n(v2 rc2024-09-17T03:13:51.023920+0000 4=0+4) (inest lock) (ifile excl) caps={6278=pAsLsXsFsx/pAsLsXsFsxcral@4},l=6278 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x55f481a8e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:13:50.793924+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:13:51.023920+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-17T03:13:50.793924+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-17T03:13:51.023920+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-17T03:14:27.657 INFO:tasks.ceph.mds.a.smithi078.stderr: -2744> 2024-09-17T03:14:06.142+0000 7f4bc4720640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-17T03:13:50.792924+0000 1=0+1) n(v3 rc2024-09-17T03:13:51.023920+0000 6=0+6) (inest mix dirty) (ifile excl) caps={6278=pAsLsXsFsx/pAsLsXsFsxcral@4},l=6278 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55684b109080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:13:50.792924+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:13:51.023920+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-17T03:13:50.792924+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-17T03:13:51.023920+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-17T03:14:27.658 INFO:tasks.ceph.mds.c.smithi078.stderr: -1182> 2024-09-17T03:14:06.144+0000 7fc46eb87640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-17T03:13:50.793924+0000 1=0+1) n(v1 rc2024-09-17T03:13:51.023920+0000 3=0+3) (inest sync->mix g=0,2 scatter_wanted) caps={6278=pAsLsXsFs/pAsLsXsFsxcral@7} | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x55f481a8ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:13:50.793924+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:13:50.794924+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-17T03:13:50.793924+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-17T03:13:51.023920+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-17T03:14:27.658 INFO:tasks.ceph.mds.a.smithi078.stderr: -2611> 2024-09-17T03:14:06.143+0000 7f4bcaf2d640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-17T03:13:50.792924+0000 1=0+1) n(v4 rc2024-09-17T03:13:51.023920+0000 5=0+5) (inest sync->mix g=1,2) caps={6278=pAsLsXsFs/pAsLsXsFsxcral@8} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55684b109600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:13:50.792924+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:13:51.023920+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-17T03:13:50.792924+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-17T03:13:51.023920+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-17T03:14:27.663 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:14:27.707 INFO:tasks.ceph.mds.d.smithi193.stdout:starting mds.d at 2024-09-17T03:14:27.710 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2024-09-17T03:14:27.710 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-09-17T03:14:27.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.784+0000 7fbaaf721640 1 -- 172.21.15.78:0/3456569105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbaa80cad30 msgr2=0x7fbaa80735b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:27.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.784+0000 7fbaaf721640 1 --2- 172.21.15.78:0/3456569105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbaa80cad30 0x7fbaa80735b0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fbaa0005fd0 tx=0x7fbaa002aa90 comp rx=0 tx=0).stop 2024-09-17T03:14:27.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.784+0000 7fbaaf721640 1 -- 172.21.15.78:0/3456569105 shutdown_connections 2024-09-17T03:14:27.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.784+0000 7fbaaf721640 1 --2- 172.21.15.78:0/3456569105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbaa80cad30 0x7fbaa80735b0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.784+0000 7fbaaf721640 1 --2- 172.21.15.78:0/3456569105 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbaa80706b0 0x7fbaa80cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.784+0000 7fbaaf721640 1 -- 172.21.15.78:0/3456569105 >> 172.21.15.78:0/3456569105 conn(0x7fbaa80b1cb0 msgr2=0x7fbaa80b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:27.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.784+0000 7fbaaf721640 1 -- 172.21.15.78:0/3456569105 shutdown_connections 2024-09-17T03:14:27.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.784+0000 7fbaaf721640 1 -- 172.21.15.78:0/3456569105 wait complete. 2024-09-17T03:14:27.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.786+0000 7fbaaf721640 1 Processor -- start 2024-09-17T03:14:27.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.786+0000 7fbaaf721640 1 -- start start 2024-09-17T03:14:27.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.787+0000 7fbaaf721640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbaa80ca800 0x7fbaa814f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:27.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.787+0000 7fbaaf721640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbaa80cad30 0x7fbaa80ae0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:27.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.787+0000 7fbaaf721640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaa815cfa0 0x7fbaa80ae610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:27.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.787+0000 7fbaaf721640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa8073e80 con 0x7fbaa80cad30 2024-09-17T03:14:27.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.787+0000 7fbaaf721640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa8073d00 con 0x7fbaa815cfa0 2024-09-17T03:14:27.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.787+0000 7fbaaf721640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa8074000 con 0x7fbaa80ca800 2024-09-17T03:14:27.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.787+0000 7fbaaccbc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbaa80cad30 0x7fbaa80ae0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:27.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.787+0000 7fbaaccbc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbaa80cad30 0x7fbaa80ae0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60708/0 (socket says 172.21.15.78:60708) 2024-09-17T03:14:27.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.787+0000 7fbaaccbc640 1 -- 172.21.15.78:0/2400895473 learned_addr learned my addr 172.21.15.78:0/2400895473 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:27.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.787+0000 7fbaadcbe640 1 --2- 172.21.15.78:0/2400895473 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaa815cfa0 0x7fbaa80ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:27.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.787+0000 7fbaad4bd640 1 --2- 172.21.15.78:0/2400895473 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbaa80ca800 0x7fbaa814f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:27.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.787+0000 7fbaaccbc640 1 -- 172.21.15.78:0/2400895473 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbaa80ca800 msgr2=0x7fbaa814f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:27.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.787+0000 7fbaaccbc640 1 --2- 172.21.15.78:0/2400895473 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbaa80ca800 0x7fbaa814f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.787+0000 7fbaaccbc640 1 -- 172.21.15.78:0/2400895473 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaa815cfa0 msgr2=0x7fbaa80ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:27.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.787+0000 7fbaaccbc640 1 --2- 172.21.15.78:0/2400895473 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaa815cfa0 0x7fbaa80ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:27.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.787+0000 7fbaaccbc640 1 -- 172.21.15.78:0/2400895473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa80af260 con 0x7fbaa80cad30 2024-09-17T03:14:27.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.787+0000 7fbaadcbe640 1 --2- 172.21.15.78:0/2400895473 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaa815cfa0 0x7fbaa80ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:27.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.788+0000 7fbaaccbc640 1 --2- 172.21.15.78:0/2400895473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbaa80cad30 0x7fbaa80ae0d0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00c970 tx=0x7fba9c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:27.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.788+0000 7fba99ffb640 1 -- 172.21.15.78:0/2400895473 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c007b50 con 0x7fbaa80cad30 2024-09-17T03:14:27.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.788+0000 7fba99ffb640 1 -- 172.21.15.78:0/2400895473 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba9c007de0 con 0x7fbaa80cad30 2024-09-17T03:14:27.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.788+0000 7fba99ffb640 1 -- 172.21.15.78:0/2400895473 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c005280 con 0x7fbaa80cad30 2024-09-17T03:14:27.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.788+0000 7fbaaf721640 1 -- 172.21.15.78:0/2400895473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa80af540 con 0x7fbaa80cad30 2024-09-17T03:14:27.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.788+0000 7fbaaf721640 1 -- 172.21.15.78:0/2400895473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa809bd30 con 0x7fbaa80cad30 2024-09-17T03:14:27.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.789+0000 7fbaaf721640 1 -- 172.21.15.78:0/2400895473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa80ad9a0 con 0x7fbaa80cad30 2024-09-17T03:14:27.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.790+0000 7fba99ffb640 1 -- 172.21.15.78:0/2400895473 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fba9c005420 con 0x7fbaa80cad30 2024-09-17T03:14:27.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.790+0000 7fba99ffb640 1 --2- 172.21.15.78:0/2400895473 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fba8c078bc0 0x7fba8c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:27.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.790+0000 7fba99ffb640 1 -- 172.21.15.78:0/2400895473 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6025+0+0 (secure 0 0 0) 0x7fba9c09b2d0 con 0x7fbaa80cad30 2024-09-17T03:14:27.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.790+0000 7fbaad4bd640 1 --2- 172.21.15.78:0/2400895473 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fba8c078bc0 0x7fba8c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:27.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.791+0000 7fbaad4bd640 1 --2- 172.21.15.78:0/2400895473 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fba8c078bc0 0x7fba8c07b0d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4000f60 tx=0x7fbaa4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:27.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:27.795+0000 7fba99ffb640 1 -- 172.21.15.78:0/2400895473 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fba9c014030 con 0x7fbaa80cad30 2024-09-17T03:14:28.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.004+0000 7fbaaf721640 1 -- 172.21.15.78:0/2400895473 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fbaa8074590 con 0x7fbaa80cad30 2024-09-17T03:14:28.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.647+0000 7fba99ffb640 1 -- 172.21.15.78:0/2400895473 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v87) ==== 104+0+0 (secure 0 0 0) 0x7fba9c063690 con 0x7fbaa80cad30 2024-09-17T03:14:28.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.650+0000 7fbaaf721640 1 -- 172.21.15.78:0/2400895473 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fba8c078bc0 msgr2=0x7fba8c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:28.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.650+0000 7fbaaf721640 1 --2- 172.21.15.78:0/2400895473 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fba8c078bc0 0x7fba8c07b0d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4000f60 tx=0x7fbaa4009040 comp rx=0 tx=0).stop 2024-09-17T03:14:28.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.650+0000 7fbaaf721640 1 -- 172.21.15.78:0/2400895473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbaa80cad30 msgr2=0x7fbaa80ae0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:28.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.650+0000 7fbaaf721640 1 --2- 172.21.15.78:0/2400895473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbaa80cad30 0x7fbaa80ae0d0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fba9c00c970 tx=0x7fba9c00ce30 comp rx=0 tx=0).stop 2024-09-17T03:14:28.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.650+0000 7fbaaf721640 1 -- 172.21.15.78:0/2400895473 shutdown_connections 2024-09-17T03:14:28.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.650+0000 7fbaaf721640 1 --2- 172.21.15.78:0/2400895473 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fba8c078bc0 0x7fba8c07b0d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:28.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.650+0000 7fbaaf721640 1 --2- 172.21.15.78:0/2400895473 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbaa815cfa0 0x7fbaa80ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:28.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.650+0000 7fbaaf721640 1 --2- 172.21.15.78:0/2400895473 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbaa80cad30 0x7fbaa80ae0d0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:28.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.650+0000 7fbaaf721640 1 --2- 172.21.15.78:0/2400895473 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbaa80ca800 0x7fbaa814f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:28.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.650+0000 7fbaaf721640 1 -- 172.21.15.78:0/2400895473 >> 172.21.15.78:0/2400895473 conn(0x7fbaa80b1cb0 msgr2=0x7fbaa80ce020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:28.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.650+0000 7fbaaf721640 1 -- 172.21.15.78:0/2400895473 shutdown_connections 2024-09-17T03:14:28.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.650+0000 7fbaaf721640 1 -- 172.21.15.78:0/2400895473 wait complete. 2024-09-17T03:14:28.662 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:14:28.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.782+0000 7f42d1f39640 1 -- 172.21.15.78:0/2751820700 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42cc0b7a00 msgr2=0x7f42cc0d0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:28.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.782+0000 7f42d1f39640 1 --2- 172.21.15.78:0/2751820700 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42cc0b7a00 0x7f42cc0d0950 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009820 tx=0x7f42bc02a510 comp rx=0 tx=0).stop 2024-09-17T03:14:28.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.782+0000 7f42d1f39640 1 -- 172.21.15.78:0/2751820700 shutdown_connections 2024-09-17T03:14:28.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.782+0000 7f42d1f39640 1 --2- 172.21.15.78:0/2751820700 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42cc0b2270 0x7f42cc0ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:28.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.782+0000 7f42d1f39640 1 --2- 172.21.15.78:0/2751820700 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42cc0b7a00 0x7f42cc0d0950 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:28.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.782+0000 7f42d1f39640 1 -- 172.21.15.78:0/2751820700 >> 172.21.15.78:0/2751820700 conn(0x7f42cc0ced80 msgr2=0x7f42cc0cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:28.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.782+0000 7f42d1f39640 1 -- 172.21.15.78:0/2751820700 shutdown_connections 2024-09-17T03:14:28.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.782+0000 7f42d1f39640 1 -- 172.21.15.78:0/2751820700 wait complete. 2024-09-17T03:14:28.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.783+0000 7f42d1f39640 1 Processor -- start 2024-09-17T03:14:28.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.784+0000 7f42d1f39640 1 -- start start 2024-09-17T03:14:28.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.785+0000 7f42d1f39640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42cc0b2270 0x7f42cc1e8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:28.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.785+0000 7f42d1f39640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42cc0b7a00 0x7f42cc1e73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:28.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.785+0000 7f42d1f39640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42cc0d0e90 0x7f42cc1e78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:28.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.785+0000 7f42d1f39640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc0b18b0 con 0x7f42cc0b2270 2024-09-17T03:14:28.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.785+0000 7f42d1f39640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc0b1730 con 0x7f42cc0b7a00 2024-09-17T03:14:28.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.785+0000 7f42d1f39640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f42cc0b2680 con 0x7f42cc0d0e90 2024-09-17T03:14:28.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.785+0000 7f42cb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42cc0b2270 0x7f42cc1e8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:28.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.785+0000 7f42cb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42cc0b2270 0x7f42cc1e8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60712/0 (socket says 172.21.15.78:60712) 2024-09-17T03:14:28.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.785+0000 7f42cb7fe640 1 -- 172.21.15.78:0/2866468320 learned_addr learned my addr 172.21.15.78:0/2866468320 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:28.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.785+0000 7f42cbfff640 1 --2- 172.21.15.78:0/2866468320 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42cc0d0e90 0x7f42cc1e78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:28.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.785+0000 7f42caffd640 1 --2- 172.21.15.78:0/2866468320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42cc0b7a00 0x7f42cc1e73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:28.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.785+0000 7f42cb7fe640 1 -- 172.21.15.78:0/2866468320 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42cc0d0e90 msgr2=0x7f42cc1e78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:28.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.785+0000 7f42cb7fe640 1 --2- 172.21.15.78:0/2866468320 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42cc0d0e90 0x7f42cc1e78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:28.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.785+0000 7f42cb7fe640 1 -- 172.21.15.78:0/2866468320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42cc0b7a00 msgr2=0x7f42cc1e73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:28.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.785+0000 7f42cb7fe640 1 --2- 172.21.15.78:0/2866468320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42cc0b7a00 0x7f42cc1e73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:28.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.785+0000 7f42cb7fe640 1 -- 172.21.15.78:0/2866468320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42cc15ede0 con 0x7f42cc0b2270 2024-09-17T03:14:28.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.786+0000 7f42cb7fe640 1 --2- 172.21.15.78:0/2866468320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42cc0b2270 0x7f42cc1e8c90 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f42bc02ab00 tx=0x7f42bc0049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:28.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.786+0000 7f42c3fff640 1 -- 172.21.15.78:0/2866468320 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc031d60 con 0x7f42cc0b2270 2024-09-17T03:14:28.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.786+0000 7f42c3fff640 1 -- 172.21.15.78:0/2866468320 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42bc0330d0 con 0x7f42cc0b2270 2024-09-17T03:14:28.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.786+0000 7f42d1f39640 1 -- 172.21.15.78:0/2866468320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42cc15f0c0 con 0x7f42cc0b2270 2024-09-17T03:14:28.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.786+0000 7f42c3fff640 1 -- 172.21.15.78:0/2866468320 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc033500 con 0x7f42cc0b2270 2024-09-17T03:14:28.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.786+0000 7f42d1f39640 1 -- 172.21.15.78:0/2866468320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42cc1e6e90 con 0x7f42cc0b2270 2024-09-17T03:14:28.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.787+0000 7f42d1f39640 1 -- 172.21.15.78:0/2866468320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42cc15f300 con 0x7f42cc0b2270 2024-09-17T03:14:28.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.787+0000 7f42c3fff640 1 -- 172.21.15.78:0/2866468320 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f42bc03b410 con 0x7f42cc0b2270 2024-09-17T03:14:28.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.788+0000 7f42c3fff640 1 --2- 172.21.15.78:0/2866468320 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42ac078bc0 0x7f42ac07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:28.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.788+0000 7f42c3fff640 1 -- 172.21.15.78:0/2866468320 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 6025+0+0 (secure 0 0 0) 0x7f42bc0bc0a0 con 0x7f42cc0b2270 2024-09-17T03:14:28.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.788+0000 7f42caffd640 1 --2- 172.21.15.78:0/2866468320 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42ac078bc0 0x7f42ac07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:28.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.789+0000 7f42caffd640 1 --2- 172.21.15.78:0/2866468320 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42ac078bc0 0x7f42ac07b0d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f42cc156f50 tx=0x7f42b4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:28.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.792+0000 7f42c3fff640 1 -- 172.21.15.78:0/2866468320 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f42cc15f300 con 0x7f42cc0b2270 2024-09-17T03:14:28.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:28.967+0000 7f42d1f39640 1 -- 172.21.15.78:0/2866468320 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f42cc1e69c0 con 0x7f42cc0b2270 2024-09-17T03:14:29.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.654+0000 7f42c3fff640 1 -- 172.21.15.78:0/2866468320 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) ==== 181+0+0 (secure 0 0 0) 0x7f42bc03f030 con 0x7f42cc0b2270 2024-09-17T03:14:29.653 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:14:29.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.658+0000 7f42d1f39640 1 -- 172.21.15.78:0/2866468320 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42ac078bc0 msgr2=0x7f42ac07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:29.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.658+0000 7f42d1f39640 1 --2- 172.21.15.78:0/2866468320 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42ac078bc0 0x7f42ac07b0d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f42cc156f50 tx=0x7f42b4009040 comp rx=0 tx=0).stop 2024-09-17T03:14:29.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.658+0000 7f42d1f39640 1 -- 172.21.15.78:0/2866468320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42cc0b2270 msgr2=0x7f42cc1e8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:29.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.658+0000 7f42d1f39640 1 --2- 172.21.15.78:0/2866468320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42cc0b2270 0x7f42cc1e8c90 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f42bc02ab00 tx=0x7f42bc0049d0 comp rx=0 tx=0).stop 2024-09-17T03:14:29.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.658+0000 7f42d1f39640 1 -- 172.21.15.78:0/2866468320 shutdown_connections 2024-09-17T03:14:29.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.658+0000 7f42d1f39640 1 --2- 172.21.15.78:0/2866468320 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42cc0d0e90 0x7f42cc1e78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:29.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.658+0000 7f42d1f39640 1 --2- 172.21.15.78:0/2866468320 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f42ac078bc0 0x7f42ac07b0d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:29.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.658+0000 7f42d1f39640 1 --2- 172.21.15.78:0/2866468320 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42cc0b7a00 0x7f42cc1e73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:29.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.658+0000 7f42d1f39640 1 --2- 172.21.15.78:0/2866468320 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f42cc0b2270 0x7f42cc1e8c90 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:29.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.658+0000 7f42d1f39640 1 -- 172.21.15.78:0/2866468320 >> 172.21.15.78:0/2866468320 conn(0x7f42cc0ced80 msgr2=0x7f42cc072450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:29.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.658+0000 7f42d1f39640 1 -- 172.21.15.78:0/2866468320 shutdown_connections 2024-09-17T03:14:29.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.658+0000 7f42d1f39640 1 -- 172.21.15.78:0/2866468320 wait complete. 2024-09-17T03:14:29.671 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:14:29.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.792+0000 7f795a238640 1 -- 172.21.15.78:0/795716280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795415af70 msgr2=0x7f79540cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:29.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.792+0000 7f795a238640 1 --2- 172.21.15.78:0/795716280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795415af70 0x7f79540cb160 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f7954074ec0 tx=0x7f794402a560 comp rx=0 tx=0).stop 2024-09-17T03:14:29.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.792+0000 7f795a238640 1 -- 172.21.15.78:0/795716280 shutdown_connections 2024-09-17T03:14:29.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.792+0000 7f795a238640 1 --2- 172.21.15.78:0/795716280 >> v2:172.21.15.193:3300/0 conn(0x7f795406fd50 0x7f79540ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:29.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.792+0000 7f795a238640 1 --2- 172.21.15.78:0/795716280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795415af70 0x7f79540cb160 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:29.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.792+0000 7f795a238640 1 -- 172.21.15.78:0/795716280 >> 172.21.15.78:0/795716280 conn(0x7f79540d0130 msgr2=0x7f79540d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:29.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.792+0000 7f795a238640 1 -- 172.21.15.78:0/795716280 shutdown_connections 2024-09-17T03:14:29.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.792+0000 7f795a238640 1 -- 172.21.15.78:0/795716280 wait complete. 2024-09-17T03:14:29.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.794+0000 7f795a238640 1 Processor -- start 2024-09-17T03:14:29.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.794+0000 7f795a238640 1 -- start start 2024-09-17T03:14:29.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.795+0000 7f795a238640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79540706f0 0x7f79540b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:29.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.795+0000 7f795a238640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f795415af70 0x7f79541f2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:29.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.796+0000 7f795a238640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795414b0c0 0x7f795414b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:29.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.796+0000 7f795a238640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f79540cef70 con 0x7f795414b0c0 2024-09-17T03:14:29.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.796+0000 7f795a238640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f79540cedf0 con 0x7f795415af70 2024-09-17T03:14:29.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.796+0000 7f795a238640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f79540cf0f0 con 0x7f79540706f0 2024-09-17T03:14:29.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.796+0000 7f7953fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795414b0c0 0x7f795414b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:29.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.796+0000 7f7953fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795414b0c0 0x7f795414b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60734/0 (socket says 172.21.15.78:60734) 2024-09-17T03:14:29.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.796+0000 7f7953fff640 1 -- 172.21.15.78:0/2844954937 learned_addr learned my addr 172.21.15.78:0/2844954937 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:29.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.796+0000 7f7952ffd640 1 --2- 172.21.15.78:0/2844954937 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f795415af70 0x7f79541f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:29.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.796+0000 7f79537fe640 1 --2- 172.21.15.78:0/2844954937 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79540706f0 0x7f79540b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:29.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.796+0000 7f7953fff640 1 -- 172.21.15.78:0/2844954937 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79540706f0 msgr2=0x7f79540b4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:29.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.796+0000 7f7953fff640 1 --2- 172.21.15.78:0/2844954937 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79540706f0 0x7f79540b4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:29.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.796+0000 7f7953fff640 1 -- 172.21.15.78:0/2844954937 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f795415af70 msgr2=0x7f79541f2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:29.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.796+0000 7f7953fff640 1 --2- 172.21.15.78:0/2844954937 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f795415af70 0x7f79541f2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:29.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.796+0000 7f7953fff640 1 -- 172.21.15.78:0/2844954937 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79540b3890 con 0x7f795414b0c0 2024-09-17T03:14:29.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.796+0000 7f7953fff640 1 --2- 172.21.15.78:0/2844954937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795414b0c0 0x7f795414b4d0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f794c00cae0 tx=0x7f794c007220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:29.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.796+0000 7f793bfff640 1 -- 172.21.15.78:0/2844954937 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f794c007da0 con 0x7f795414b0c0 2024-09-17T03:14:29.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.796+0000 7f793bfff640 1 -- 172.21.15.78:0/2844954937 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f794c004c30 con 0x7f795414b0c0 2024-09-17T03:14:29.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.796+0000 7f793bfff640 1 -- 172.21.15.78:0/2844954937 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f794c005280 con 0x7f795414b0c0 2024-09-17T03:14:29.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.796+0000 7f795a238640 1 -- 172.21.15.78:0/2844954937 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79540b3b70 con 0x7f795414b0c0 2024-09-17T03:14:29.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.796+0000 7f795a238640 1 -- 172.21.15.78:0/2844954937 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79540b4130 con 0x7f795414b0c0 2024-09-17T03:14:29.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.797+0000 7f795a238640 1 -- 172.21.15.78:0/2844954937 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79540b4e70 con 0x7f795414b0c0 2024-09-17T03:14:29.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.798+0000 7f793bfff640 1 -- 172.21.15.78:0/2844954937 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f794c005420 con 0x7f795414b0c0 2024-09-17T03:14:29.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.799+0000 7f793bfff640 1 --2- 172.21.15.78:0/2844954937 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7940078b90 0x7f794007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:29.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.799+0000 7f793bfff640 1 -- 172.21.15.78:0/2844954937 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 5587+0+0 (secure 0 0 0) 0x7f794c09b6b0 con 0x7f795414b0c0 2024-09-17T03:14:29.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.799+0000 7f79537fe640 1 --2- 172.21.15.78:0/2844954937 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7940078b90 0x7f794007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:29.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.800+0000 7f79537fe640 1 --2- 172.21.15.78:0/2844954937 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7940078b90 0x7f794007b0a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7944033000 tx=0x7f7944004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:29.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.803+0000 7f793bfff640 1 -- 172.21.15.78:0/2844954937 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f794c014070 con 0x7f795414b0c0 2024-09-17T03:14:29.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:29.979+0000 7f795a238640 1 -- 172.21.15.78:0/2844954937 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f79540cf5a0 con 0x7f795414b0c0 2024-09-17T03:14:30.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.661+0000 7f793bfff640 1 -- 172.21.15.78:0/2844954937 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) ==== 169+0+0 (secure 0 0 0) 0x7f794c0635a0 con 0x7f795414b0c0 2024-09-17T03:14:30.660 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2024-09-17T03:14:30.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.665+0000 7f795a238640 1 -- 172.21.15.78:0/2844954937 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7940078b90 msgr2=0x7f794007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:30.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.665+0000 7f795a238640 1 --2- 172.21.15.78:0/2844954937 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7940078b90 0x7f794007b0a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f7944033000 tx=0x7f7944004730 comp rx=0 tx=0).stop 2024-09-17T03:14:30.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.665+0000 7f795a238640 1 -- 172.21.15.78:0/2844954937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795414b0c0 msgr2=0x7f795414b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:30.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.665+0000 7f795a238640 1 --2- 172.21.15.78:0/2844954937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795414b0c0 0x7f795414b4d0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f794c00cae0 tx=0x7f794c007220 comp rx=0 tx=0).stop 2024-09-17T03:14:30.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.666+0000 7f795a238640 1 -- 172.21.15.78:0/2844954937 shutdown_connections 2024-09-17T03:14:30.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.666+0000 7f795a238640 1 --2- 172.21.15.78:0/2844954937 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f795414b0c0 0x7f795414b4d0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:30.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.666+0000 7f795a238640 1 --2- 172.21.15.78:0/2844954937 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7940078b90 0x7f794007b0a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:30.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.666+0000 7f795a238640 1 --2- 172.21.15.78:0/2844954937 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f795415af70 0x7f79541f2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:30.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.666+0000 7f795a238640 1 --2- 172.21.15.78:0/2844954937 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79540706f0 0x7f79540b4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:30.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.666+0000 7f795a238640 1 -- 172.21.15.78:0/2844954937 >> 172.21.15.78:0/2844954937 conn(0x7f79540d0130 msgr2=0x7f79540afdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:30.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.666+0000 7f795a238640 1 -- 172.21.15.78:0/2844954937 shutdown_connections 2024-09-17T03:14:30.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.666+0000 7f795a238640 1 -- 172.21.15.78:0/2844954937 wait complete. 2024-09-17T03:14:30.680 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:14:30.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.800+0000 7f4b2c030640 1 -- 172.21.15.78:0/1632155043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b10003a30 msgr2=0x7f4b10003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:30.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.800+0000 7f4b2c030640 1 --2- 172.21.15.78:0/1632155043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b10003a30 0x7f4b10003ea0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000c260 tx=0x7f4b10005830 comp rx=0 tx=0).stop 2024-09-17T03:14:30.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.800+0000 7f4b2a5cd640 1 -- 172.21.15.78:0/1632155043 reap_dead start 2024-09-17T03:14:30.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.800+0000 7f4b2c030640 1 -- 172.21.15.78:0/1632155043 shutdown_connections 2024-09-17T03:14:30.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.800+0000 7f4b2c030640 1 -- 172.21.15.78:0/1632155043 >> 172.21.15.78:0/1632155043 conn(0x7f4b2408bfc0 msgr2=0x7f4b2409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:30.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.800+0000 7f4b2c030640 1 -- 172.21.15.78:0/1632155043 shutdown_connections 2024-09-17T03:14:30.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.800+0000 7f4b2c030640 1 -- 172.21.15.78:0/1632155043 wait complete. 2024-09-17T03:14:30.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.802+0000 7f4b2c030640 1 Processor -- start 2024-09-17T03:14:30.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.802+0000 7f4b2c030640 1 -- start start 2024-09-17T03:14:30.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.803+0000 7f4b2c030640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b10003a30 0x7f4b24151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:30.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.803+0000 7f4b2c030640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b2415f9a0 0x7f4b241f8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:30.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.803+0000 7f4b2c030640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4b241f9120 0x7f4b241f9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:30.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.803+0000 7f4b2c030640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4b240d36c0 con 0x7f4b10003a30 2024-09-17T03:14:30.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.803+0000 7f4b2c030640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4b240d3540 con 0x7f4b2415f9a0 2024-09-17T03:14:30.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.803+0000 7f4b2c030640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4b240cf500 con 0x7f4b241f9120 2024-09-17T03:14:30.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.804+0000 7f4b29dcc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b10003a30 0x7f4b24151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:30.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.804+0000 7f4b29dcc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b10003a30 0x7f4b24151250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60754/0 (socket says 172.21.15.78:60754) 2024-09-17T03:14:30.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.804+0000 7f4b29dcc640 1 -- 172.21.15.78:0/3494069002 learned_addr learned my addr 172.21.15.78:0/3494069002 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:30.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.804+0000 7f4b295cb640 1 --2- 172.21.15.78:0/3494069002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b2415f9a0 0x7f4b241f8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:30.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.804+0000 7f4b2a5cd640 1 --2- 172.21.15.78:0/3494069002 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4b241f9120 0x7f4b241f9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:30.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.804+0000 7f4b29dcc640 1 -- 172.21.15.78:0/3494069002 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4b241f9120 msgr2=0x7f4b241f9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:30.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.804+0000 7f4b29dcc640 1 --2- 172.21.15.78:0/3494069002 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4b241f9120 0x7f4b241f9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.804+0000 7f4b29dcc640 1 -- 172.21.15.78:0/3494069002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b2415f9a0 msgr2=0x7f4b241f8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.804+0000 7f4b29dcc640 1 --2- 172.21.15.78:0/3494069002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b2415f9a0 0x7f4b241f8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.804+0000 7f4b29dcc640 1 -- 172.21.15.78:0/3494069002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b240b4b00 con 0x7f4b10003a30 2024-09-17T03:14:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.804+0000 7f4b2a5cd640 1 --2- 172.21.15.78:0/3494069002 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4b241f9120 0x7f4b241f9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.804+0000 7f4b295cb640 1 --2- 172.21.15.78:0/3494069002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b2415f9a0 0x7f4b241f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.804+0000 7f4b29dcc640 1 --2- 172.21.15.78:0/3494069002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b10003a30 0x7f4b24151250 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000c380 tx=0x7f4b200011a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.804+0000 7f4b1a7fc640 1 -- 172.21.15.78:0/3494069002 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b20031040 con 0x7f4b10003a30 2024-09-17T03:14:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.804+0000 7f4b1a7fc640 1 -- 172.21.15.78:0/3494069002 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b20003610 con 0x7f4b10003a30 2024-09-17T03:14:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.804+0000 7f4b1a7fc640 1 -- 172.21.15.78:0/3494069002 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b20003a40 con 0x7f4b10003a30 2024-09-17T03:14:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.804+0000 7f4b2c030640 1 -- 172.21.15.78:0/3494069002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b240b4de0 con 0x7f4b10003a30 2024-09-17T03:14:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.804+0000 7f4b2c030640 1 -- 172.21.15.78:0/3494069002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b240b53a0 con 0x7f4b10003a30 2024-09-17T03:14:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.805+0000 7f4b2c030640 1 -- 172.21.15.78:0/3494069002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b240b7a50 con 0x7f4b10003a30 2024-09-17T03:14:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.806+0000 7f4b1a7fc640 1 -- 172.21.15.78:0/3494069002 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4b20034070 con 0x7f4b10003a30 2024-09-17T03:14:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.806+0000 7f4b1a7fc640 1 --2- 172.21.15.78:0/3494069002 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4b08078b90 0x7f4b0807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:30.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.806+0000 7f4b1a7fc640 1 -- 172.21.15.78:0/3494069002 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5115+0+0 (secure 0 0 0) 0x7f4b200bad50 con 0x7f4b10003a30 2024-09-17T03:14:30.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.807+0000 7f4b295cb640 1 --2- 172.21.15.78:0/3494069002 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4b08078b90 0x7f4b0807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:30.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.807+0000 7f4b295cb640 1 --2- 172.21.15.78:0/3494069002 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4b08078b90 0x7f4b0807b0a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4b240cec60 tx=0x7f4b14005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:30.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.811+0000 7f4b1a7fc640 1 -- 172.21.15.78:0/3494069002 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4b240b7a50 con 0x7f4b10003a30 2024-09-17T03:14:30.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.987+0000 7f4b2c030640 1 -- 172.21.15.78:0/3494069002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7f4b2406e170 con 0x7f4b10003a30 2024-09-17T03:14:30.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.991+0000 7f4b1a7fc640 1 -- 172.21.15.78:0/3494069002 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v41) ==== 71+0+0 (secure 0 0 0) 0x7f4b20083550 con 0x7f4b10003a30 2024-09-17T03:14:30.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.993+0000 7f4b2c030640 1 -- 172.21.15.78:0/3494069002 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4b08078b90 msgr2=0x7f4b0807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:30.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.993+0000 7f4b2c030640 1 --2- 172.21.15.78:0/3494069002 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4b08078b90 0x7f4b0807b0a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f4b240cec60 tx=0x7f4b14005f90 comp rx=0 tx=0).stop 2024-09-17T03:14:30.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.993+0000 7f4b2c030640 1 -- 172.21.15.78:0/3494069002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b10003a30 msgr2=0x7f4b24151250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:30.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.993+0000 7f4b2c030640 1 --2- 172.21.15.78:0/3494069002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b10003a30 0x7f4b24151250 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f4b2000c380 tx=0x7f4b200011a0 comp rx=0 tx=0).stop 2024-09-17T03:14:30.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.993+0000 7f4b2c030640 1 -- 172.21.15.78:0/3494069002 shutdown_connections 2024-09-17T03:14:30.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.993+0000 7f4b2c030640 1 --2- 172.21.15.78:0/3494069002 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4b241f9120 0x7f4b241f9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:30.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.993+0000 7f4b2c030640 1 --2- 172.21.15.78:0/3494069002 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4b08078b90 0x7f4b0807b0a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:30.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.993+0000 7f4b2c030640 1 --2- 172.21.15.78:0/3494069002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b2415f9a0 0x7f4b241f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:30.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.993+0000 7f4b2c030640 1 --2- 172.21.15.78:0/3494069002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b10003a30 0x7f4b24151250 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:30.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.993+0000 7f4b2c030640 1 -- 172.21.15.78:0/3494069002 >> 172.21.15.78:0/3494069002 conn(0x7f4b2408bfc0 msgr2=0x7f4b240b7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:30.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.993+0000 7f4b2c030640 1 -- 172.21.15.78:0/3494069002 shutdown_connections 2024-09-17T03:14:30.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:30.993+0000 7f4b2c030640 1 -- 172.21.15.78:0/3494069002 wait complete. 2024-09-17T03:14:31.003 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0' 2024-09-17T03:14:31.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.117+0000 7f5434c8b640 1 -- 172.21.15.78:0/2661689425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f543015c580 msgr2=0x7f5430070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:31.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.117+0000 7f5434c8b640 1 --2- 172.21.15.78:0/2661689425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f543015c580 0x7f5430070370 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f543006eeb0 tx=0x7f542402a560 comp rx=0 tx=0).stop 2024-09-17T03:14:31.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.117+0000 7f5434c8b640 1 -- 172.21.15.78:0/2661689425 shutdown_connections 2024-09-17T03:14:31.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.117+0000 7f5434c8b640 1 --2- 172.21.15.78:0/2661689425 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f543015c580 0x7f5430070370 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.117+0000 7f5434c8b640 1 --2- 172.21.15.78:0/2661689425 >> v2:172.21.15.193:3300/0 conn(0x7f5430074420 0x7f543006fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.117+0000 7f5434c8b640 1 -- 172.21.15.78:0/2661689425 >> 172.21.15.78:0/2661689425 conn(0x7f543006def0 msgr2=0x7f543006e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:31.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.117+0000 7f5434c8b640 1 -- 172.21.15.78:0/2661689425 shutdown_connections 2024-09-17T03:14:31.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.117+0000 7f5434c8b640 1 -- 172.21.15.78:0/2661689425 wait complete. 2024-09-17T03:14:31.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.119+0000 7f5434c8b640 1 Processor -- start 2024-09-17T03:14:31.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.119+0000 7f5434c8b640 1 -- start start 2024-09-17T03:14:31.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f5434c8b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5430074420 0x7f54300cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:31.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f5434c8b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5430155ce0 0x7f54301f8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:31.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f5434c8b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54301f92a0 0x7f543006cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:31.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f5434c8b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f543015f850 con 0x7f5430074420 2024-09-17T03:14:31.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f5434c8b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5430070b80 con 0x7f54301f92a0 2024-09-17T03:14:31.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f5434c8b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f543015f9d0 con 0x7f5430155ce0 2024-09-17T03:14:31.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f542e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5430074420 0x7f54300cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:31.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f542e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5430074420 0x7f54300cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60780/0 (socket says 172.21.15.78:60780) 2024-09-17T03:14:31.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f542e59c640 1 -- 172.21.15.78:0/165494799 learned_addr learned my addr 172.21.15.78:0/165494799 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:31.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f542dd9b640 1 --2- 172.21.15.78:0/165494799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5430155ce0 0x7f54301f8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:31.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f542ed9d640 1 --2- 172.21.15.78:0/165494799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54301f92a0 0x7f543006cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:31.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f542e59c640 1 -- 172.21.15.78:0/165494799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5430155ce0 msgr2=0x7f54301f8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:31.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f542e59c640 1 --2- 172.21.15.78:0/165494799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5430155ce0 0x7f54301f8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f542e59c640 1 -- 172.21.15.78:0/165494799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54301f92a0 msgr2=0x7f543006cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:31.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f542e59c640 1 --2- 172.21.15.78:0/165494799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54301f92a0 0x7f543006cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f542e59c640 1 -- 172.21.15.78:0/165494799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54301419c0 con 0x7f5430074420 2024-09-17T03:14:31.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f542dd9b640 1 --2- 172.21.15.78:0/165494799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5430155ce0 0x7f54301f8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:31.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f542e59c640 1 --2- 172.21.15.78:0/165494799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5430074420 0x7f54300cc9c0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f542000d6d0 tx=0x7f542000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:31.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f541effd640 1 -- 172.21.15.78:0/165494799 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5420017070 con 0x7f5430074420 2024-09-17T03:14:31.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f541effd640 1 -- 172.21.15.78:0/165494799 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5420005330 con 0x7f5430074420 2024-09-17T03:14:31.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f5434c8b640 1 -- 172.21.15.78:0/165494799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5430141c30 con 0x7f5430074420 2024-09-17T03:14:31.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.121+0000 7f541effd640 1 -- 172.21.15.78:0/165494799 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5420009820 con 0x7f5430074420 2024-09-17T03:14:31.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.122+0000 7f5434c8b640 1 -- 172.21.15.78:0/165494799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54301421f0 con 0x7f5430074420 2024-09-17T03:14:31.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.122+0000 7f5434c8b640 1 -- 172.21.15.78:0/165494799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f543015c580 con 0x7f5430074420 2024-09-17T03:14:31.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.123+0000 7f541effd640 1 -- 172.21.15.78:0/165494799 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5420009bd0 con 0x7f5430074420 2024-09-17T03:14:31.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.124+0000 7f541effd640 1 --2- 172.21.15.78:0/165494799 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5410078bc0 0x7f541007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:31.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.124+0000 7f541effd640 1 -- 172.21.15.78:0/165494799 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5115+0+0 (secure 0 0 0) 0x7f542009acb0 con 0x7f5430074420 2024-09-17T03:14:31.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.124+0000 7f542dd9b640 1 --2- 172.21.15.78:0/165494799 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5410078bc0 0x7f541007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:31.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.125+0000 7f542dd9b640 1 --2- 172.21.15.78:0/165494799 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5410078bc0 0x7f541007b0d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5424033000 tx=0x7f5424004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:31.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.129+0000 7f541effd640 1 -- 172.21.15.78:0/165494799 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5420062d80 con 0x7f5430074420 2024-09-17T03:14:31.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.370+0000 7f5434c8b640 1 -- 172.21.15.78:0/165494799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0"]} v 0) -- 0x7f5430155020 con 0x7f5430074420 2024-09-17T03:14:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.662+0000 7f541effd640 1 -- 172.21.15.78:0/165494799 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_mds0"]}]=0 v312) ==== 154+0+0 (secure 0 0 0) 0x7f54200677b0 con 0x7f5430074420 2024-09-17T03:14:31.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.665+0000 7f5434c8b640 1 -- 172.21.15.78:0/165494799 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5410078bc0 msgr2=0x7f541007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:31.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.665+0000 7f5434c8b640 1 --2- 172.21.15.78:0/165494799 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5410078bc0 0x7f541007b0d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5424033000 tx=0x7f5424004730 comp rx=0 tx=0).stop 2024-09-17T03:14:31.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.665+0000 7f5434c8b640 1 -- 172.21.15.78:0/165494799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5430074420 msgr2=0x7f54300cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:31.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.665+0000 7f5434c8b640 1 --2- 172.21.15.78:0/165494799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5430074420 0x7f54300cc9c0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f542000d6d0 tx=0x7f542000db90 comp rx=0 tx=0).stop 2024-09-17T03:14:31.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.665+0000 7f5434c8b640 1 -- 172.21.15.78:0/165494799 shutdown_connections 2024-09-17T03:14:31.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.665+0000 7f5434c8b640 1 --2- 172.21.15.78:0/165494799 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5410078bc0 0x7f541007b0d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.665+0000 7f5434c8b640 1 --2- 172.21.15.78:0/165494799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f54301f92a0 0x7f543006cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.665+0000 7f5434c8b640 1 --2- 172.21.15.78:0/165494799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5430155ce0 0x7f54301f8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.665+0000 7f5434c8b640 1 --2- 172.21.15.78:0/165494799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5430074420 0x7f54300cc9c0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.665+0000 7f5434c8b640 1 -- 172.21.15.78:0/165494799 >> 172.21.15.78:0/165494799 conn(0x7f543006def0 msgr2=0x7f5430070040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:31.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.665+0000 7f5434c8b640 1 -- 172.21.15.78:0/165494799 shutdown_connections 2024-09-17T03:14:31.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.665+0000 7f5434c8b640 1 -- 172.21.15.78:0/165494799 wait complete. 2024-09-17T03:14:31.676 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2024-09-17T03:14:31.676 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) 2024-09-17T03:14:31.677 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:14:31.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.792+0000 7f53350cc640 1 -- 172.21.15.78:0/3054416546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53300b7cc0 msgr2=0x7f53300cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:31.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.792+0000 7f53350cc640 1 --2- 172.21.15.78:0/3054416546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53300b7cc0 0x7f53300cec10 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f5330074fd0 tx=0x7f532402a560 comp rx=0 tx=0).stop 2024-09-17T03:14:31.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.792+0000 7f53350cc640 1 -- 172.21.15.78:0/3054416546 shutdown_connections 2024-09-17T03:14:31.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.792+0000 7f53350cc640 1 --2- 172.21.15.78:0/3054416546 >> v2:172.21.15.193:3300/0 conn(0x7f53300cf150 0x7f53300b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.792+0000 7f53350cc640 1 --2- 172.21.15.78:0/3054416546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53300b7cc0 0x7f53300cec10 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.792+0000 7f53350cc640 1 --2- 172.21.15.78:0/3054416546 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f53301600b0 0x7f53300ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.792+0000 7f53350cc640 1 -- 172.21.15.78:0/3054416546 >> 172.21.15.78:0/3054416546 conn(0x7f533006d4f0 msgr2=0x7f5330071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:31.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.792+0000 7f53350cc640 1 -- 172.21.15.78:0/3054416546 shutdown_connections 2024-09-17T03:14:31.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.792+0000 7f53350cc640 1 -- 172.21.15.78:0/3054416546 wait complete. 2024-09-17T03:14:31.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.794+0000 7f53350cc640 1 Processor -- start 2024-09-17T03:14:31.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.794+0000 7f53350cc640 1 -- start start 2024-09-17T03:14:31.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.795+0000 7f53350cc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53300b7cc0 0x7f53300b7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:31.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.795+0000 7f53350cc640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f53300cf150 0x7f53300cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:31.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.795+0000 7f53350cc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53301600b0 0x7f533015def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:31.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.795+0000 7f53350cc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f53300b4620 con 0x7f53300b7cc0 2024-09-17T03:14:31.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.795+0000 7f53350cc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f53300b44a0 con 0x7f53301600b0 2024-09-17T03:14:31.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.795+0000 7f53350cc640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f53300b47a0 con 0x7f53300cf150 2024-09-17T03:14:31.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.795+0000 7f532ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53300b7cc0 0x7f53300b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:31.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.795+0000 7f532ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53300b7cc0 0x7f53300b7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60798/0 (socket says 172.21.15.78:60798) 2024-09-17T03:14:31.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.795+0000 7f532ed9d640 1 -- 172.21.15.78:0/2772200960 learned_addr learned my addr 172.21.15.78:0/2772200960 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:31.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.796+0000 7f532e59c640 1 --2- 172.21.15.78:0/2772200960 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f53300cf150 0x7f53300cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:31.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.796+0000 7f532f59e640 1 --2- 172.21.15.78:0/2772200960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53301600b0 0x7f533015def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:31.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.796+0000 7f532ed9d640 1 -- 172.21.15.78:0/2772200960 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f53300cf150 msgr2=0x7f53300cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:31.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.796+0000 7f532ed9d640 1 --2- 172.21.15.78:0/2772200960 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f53300cf150 0x7f53300cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.796+0000 7f532ed9d640 1 -- 172.21.15.78:0/2772200960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53301600b0 msgr2=0x7f533015def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:31.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.796+0000 7f532ed9d640 1 --2- 172.21.15.78:0/2772200960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53301600b0 0x7f533015def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.796+0000 7f532ed9d640 1 -- 172.21.15.78:0/2772200960 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53301f4af0 con 0x7f53300b7cc0 2024-09-17T03:14:31.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.796+0000 7f532ed9d640 1 --2- 172.21.15.78:0/2772200960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53300b7cc0 0x7f53300b7450 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f532000d700 tx=0x7f532000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:31.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.796+0000 7f53177fe640 1 -- 172.21.15.78:0/2772200960 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5320017070 con 0x7f53300b7cc0 2024-09-17T03:14:31.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.796+0000 7f53177fe640 1 -- 172.21.15.78:0/2772200960 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5320005310 con 0x7f53300b7cc0 2024-09-17T03:14:31.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.796+0000 7f53350cc640 1 -- 172.21.15.78:0/2772200960 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53300b5900 con 0x7f53300b7cc0 2024-09-17T03:14:31.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.796+0000 7f53177fe640 1 -- 172.21.15.78:0/2772200960 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53200097c0 con 0x7f53300b7cc0 2024-09-17T03:14:31.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.796+0000 7f53350cc640 1 -- 172.21.15.78:0/2772200960 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53300b5ec0 con 0x7f53300b7cc0 2024-09-17T03:14:31.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.797+0000 7f53350cc640 1 -- 172.21.15.78:0/2772200960 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53300b3d50 con 0x7f53300b7cc0 2024-09-17T03:14:31.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.798+0000 7f53177fe640 1 -- 172.21.15.78:0/2772200960 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5320009960 con 0x7f53300b7cc0 2024-09-17T03:14:31.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.798+0000 7f53177fe640 1 --2- 172.21.15.78:0/2772200960 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f531c078bc0 0x7f531c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:31.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.799+0000 7f53177fe640 1 -- 172.21.15.78:0/2772200960 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5115+0+0 (secure 0 0 0) 0x7f532009abc0 con 0x7f53300b7cc0 2024-09-17T03:14:31.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.799+0000 7f532e59c640 1 --2- 172.21.15.78:0/2772200960 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f531c078bc0 0x7f531c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:31.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.799+0000 7f532e59c640 1 --2- 172.21.15.78:0/2772200960 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f531c078bc0 0x7f531c07b0d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5324033000 tx=0x7f5324004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:31.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.803+0000 7f53177fe640 1 -- 172.21.15.78:0/2772200960 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5320063260 con 0x7f53300b7cc0 2024-09-17T03:14:31.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.979+0000 7f53350cc640 1 -- 172.21.15.78:0/2772200960 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f533015bf70 con 0x7f53300b7cc0 2024-09-17T03:14:31.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.979+0000 7f53177fe640 1 -- 172.21.15.78:0/2772200960 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+13271 (secure 0 0 0) 0x7f5320062b60 con 0x7f53300b7cc0 2024-09-17T03:14:31.978 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:31.978 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":87,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:14:30.655929+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6833/3357123265":"2024-09-18T03:14:27.645822+0000","172.21.15.78:6832/3357123265":"2024-09-18T03:14:27.645822+0000","172.21.15.193:6837/1005450673":"2024-09-18T03:14:27.645802+0000","172.21.15.193:6835/1005450673":"2024-09-18T03:14:27.645802+0000","172.21.15.78:6835/4018023271":"2024-09-18T03:14:27.645816+0000","172.21.15.78:6834/4018023271":"2024-09-18T03:14:27.645816+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:14:31.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.981+0000 7f53350cc640 1 -- 172.21.15.78:0/2772200960 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f531c078bc0 msgr2=0x7f531c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:31.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.981+0000 7f53350cc640 1 --2- 172.21.15.78:0/2772200960 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f531c078bc0 0x7f531c07b0d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f5324033000 tx=0x7f5324004730 comp rx=0 tx=0).stop 2024-09-17T03:14:31.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.981+0000 7f53350cc640 1 -- 172.21.15.78:0/2772200960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53300b7cc0 msgr2=0x7f53300b7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:31.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.981+0000 7f53350cc640 1 --2- 172.21.15.78:0/2772200960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53300b7cc0 0x7f53300b7450 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f532000d700 tx=0x7f532000dbc0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.981+0000 7f53350cc640 1 -- 172.21.15.78:0/2772200960 shutdown_connections 2024-09-17T03:14:31.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.981+0000 7f53350cc640 1 --2- 172.21.15.78:0/2772200960 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f531c078bc0 0x7f531c07b0d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.981+0000 7f53350cc640 1 --2- 172.21.15.78:0/2772200960 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f53301600b0 0x7f533015def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.981+0000 7f53350cc640 1 --2- 172.21.15.78:0/2772200960 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f53300cf150 0x7f53300cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.982+0000 7f53350cc640 1 --2- 172.21.15.78:0/2772200960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53300b7cc0 0x7f53300b7450 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:31.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.982+0000 7f53350cc640 1 -- 172.21.15.78:0/2772200960 >> 172.21.15.78:0/2772200960 conn(0x7f533006d4f0 msgr2=0x7f53300d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:31.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.982+0000 7f53350cc640 1 -- 172.21.15.78:0/2772200960 shutdown_connections 2024-09-17T03:14:31.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:31.982+0000 7f53350cc640 1 -- 172.21.15.78:0/2772200960 wait complete. 2024-09-17T03:14:31.992 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T03:08:17.135915+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T03:14:31.992 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T03:14:32.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.113+0000 7f81a0728640 1 -- 172.21.15.78:0/2909576752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8198075170 msgr2=0x7f81980b51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:32.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.113+0000 7f81a0728640 1 --2- 172.21.15.78:0/2909576752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8198075170 0x7f81980b51d0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f819809f260 tx=0x7f818802a4a0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.113+0000 7f81a0728640 1 -- 172.21.15.78:0/2909576752 shutdown_connections 2024-09-17T03:14:32.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.113+0000 7f81a0728640 1 --2- 172.21.15.78:0/2909576752 >> v2:172.21.15.193:3300/0 conn(0x7f8198070af0 0x7f8198070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.113+0000 7f81a0728640 1 --2- 172.21.15.78:0/2909576752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8198075170 0x7f81980b51d0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.113+0000 7f81a0728640 1 -- 172.21.15.78:0/2909576752 >> 172.21.15.78:0/2909576752 conn(0x7f81980cdcc0 msgr2=0x7f81980ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:32.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.113+0000 7f81a0728640 1 -- 172.21.15.78:0/2909576752 shutdown_connections 2024-09-17T03:14:32.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.113+0000 7f81a0728640 1 -- 172.21.15.78:0/2909576752 wait complete. 2024-09-17T03:14:32.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.115+0000 7f81a0728640 1 Processor -- start 2024-09-17T03:14:32.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.115+0000 7f81a0728640 1 -- start start 2024-09-17T03:14:32.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.116+0000 7f81a0728640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8198070af0 0x7f819813f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:32.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.116+0000 7f81a0728640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81980b5710 0x7f8198165ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:32.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.116+0000 7f81a0728640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8198141250 0x7f8198153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:32.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.116+0000 7f81a0728640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8198071880 con 0x7f81980b5710 2024-09-17T03:14:32.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.116+0000 7f81a0728640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8198071700 con 0x7f8198070af0 2024-09-17T03:14:32.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.116+0000 7f81a0728640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8198071a00 con 0x7f8198141250 2024-09-17T03:14:32.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.116+0000 7f819dcc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81980b5710 0x7f8198165ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:32.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.116+0000 7f819dcc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81980b5710 0x7f8198165ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60820/0 (socket says 172.21.15.78:60820) 2024-09-17T03:14:32.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.116+0000 7f819dcc3640 1 -- 172.21.15.78:0/1840180956 learned_addr learned my addr 172.21.15.78:0/1840180956 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:32.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.116+0000 7f819e4c4640 1 --2- 172.21.15.78:0/1840180956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8198070af0 0x7f819813f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:32.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.116+0000 7f819ecc5640 1 --2- 172.21.15.78:0/1840180956 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8198141250 0x7f8198153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:32.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.116+0000 7f819dcc3640 1 -- 172.21.15.78:0/1840180956 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8198141250 msgr2=0x7f8198153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:32.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.116+0000 7f819dcc3640 1 --2- 172.21.15.78:0/1840180956 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8198141250 0x7f8198153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.116+0000 7f819dcc3640 1 -- 172.21.15.78:0/1840180956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8198070af0 msgr2=0x7f819813f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.116+0000 7f819dcc3640 1 --2- 172.21.15.78:0/1840180956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8198070af0 0x7f819813f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.116+0000 7f819dcc3640 1 -- 172.21.15.78:0/1840180956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8198141d20 con 0x7f81980b5710 2024-09-17T03:14:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.117+0000 7f819dcc3640 1 --2- 172.21.15.78:0/1840180956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81980b5710 0x7f8198165ab0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f818c00c3f0 tx=0x7f818c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.117+0000 7f8196ffd640 1 -- 172.21.15.78:0/1840180956 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c017070 con 0x7f81980b5710 2024-09-17T03:14:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.117+0000 7f8196ffd640 1 -- 172.21.15.78:0/1840180956 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f818c0035f0 con 0x7f81980b5710 2024-09-17T03:14:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.117+0000 7f8196ffd640 1 -- 172.21.15.78:0/1840180956 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f818c003a40 con 0x7f81980b5710 2024-09-17T03:14:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.117+0000 7f81a0728640 1 -- 172.21.15.78:0/1840180956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8198142000 con 0x7f81980b5710 2024-09-17T03:14:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.117+0000 7f81a0728640 1 -- 172.21.15.78:0/1840180956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8198154af0 con 0x7f81980b5710 2024-09-17T03:14:32.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.118+0000 7f81a0728640 1 -- 172.21.15.78:0/1840180956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8198153300 con 0x7f81980b5710 2024-09-17T03:14:32.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.119+0000 7f8196ffd640 1 -- 172.21.15.78:0/1840180956 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f818c01a070 con 0x7f81980b5710 2024-09-17T03:14:32.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.119+0000 7f8196ffd640 1 --2- 172.21.15.78:0/1840180956 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8184078b90 0x7f818407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:32.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.119+0000 7f8196ffd640 1 -- 172.21.15.78:0/1840180956 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5115+0+0 (secure 0 0 0) 0x7f818c099d40 con 0x7f81980b5710 2024-09-17T03:14:32.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.119+0000 7f819e4c4640 1 --2- 172.21.15.78:0/1840180956 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8184078b90 0x7f818407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:32.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.120+0000 7f819e4c4640 1 --2- 172.21.15.78:0/1840180956 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8184078b90 0x7f818407b0a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8188034000 tx=0x7f8188004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:32.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.124+0000 7f8196ffd640 1 -- 172.21.15.78:0/1840180956 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f818c0624f0 con 0x7f81980b5710 2024-09-17T03:14:32.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.300+0000 7f81a0728640 1 -- 172.21.15.78:0/1840180956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8198075170 con 0x7f81980b5710 2024-09-17T03:14:32.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.300+0000 7f8196ffd640 1 -- 172.21.15.78:0/1840180956 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) ==== 93+0+10 (secure 0 0 0) 0x7f818c061df0 con 0x7f81980b5710 2024-09-17T03:14:32.299 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2024-09-17T03:14:32.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.303+0000 7f81a0728640 1 -- 172.21.15.78:0/1840180956 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8184078b90 msgr2=0x7f818407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:32.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.303+0000 7f81a0728640 1 --2- 172.21.15.78:0/1840180956 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8184078b90 0x7f818407b0a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8188034000 tx=0x7f8188004730 comp rx=0 tx=0).stop 2024-09-17T03:14:32.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.303+0000 7f81a0728640 1 -- 172.21.15.78:0/1840180956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81980b5710 msgr2=0x7f8198165ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:32.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.303+0000 7f81a0728640 1 --2- 172.21.15.78:0/1840180956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81980b5710 0x7f8198165ab0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f818c00c3f0 tx=0x7f818c00c8b0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.303+0000 7f81a0728640 1 -- 172.21.15.78:0/1840180956 shutdown_connections 2024-09-17T03:14:32.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.303+0000 7f81a0728640 1 --2- 172.21.15.78:0/1840180956 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8198141250 0x7f8198153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.303+0000 7f81a0728640 1 --2- 172.21.15.78:0/1840180956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81980b5710 0x7f8198165ab0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.303+0000 7f81a0728640 1 --2- 172.21.15.78:0/1840180956 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8184078b90 0x7f818407b0a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.303+0000 7f81a0728640 1 --2- 172.21.15.78:0/1840180956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8198070af0 0x7f819813f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.303+0000 7f81a0728640 1 -- 172.21.15.78:0/1840180956 >> 172.21.15.78:0/1840180956 conn(0x7f81980cdcc0 msgr2=0x7f81980b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:32.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.303+0000 7f81a0728640 1 -- 172.21.15.78:0/1840180956 shutdown_connections 2024-09-17T03:14:32.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.303+0000 7f81a0728640 1 -- 172.21.15.78:0/1840180956 wait complete. 2024-09-17T03:14:32.312 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0' 2024-09-17T03:14:32.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.426+0000 7fe88dbf1640 1 -- 172.21.15.78:0/4192232849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe888144270 msgr2=0x7fe8880b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:32.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.426+0000 7fe88dbf1640 1 --2- 172.21.15.78:0/4192232849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe888144270 0x7fe8880b5680 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fe8880b60f0 tx=0x7fe87802aac0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.426+0000 7fe88dbf1640 1 -- 172.21.15.78:0/4192232849 shutdown_connections 2024-09-17T03:14:32.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.426+0000 7fe88dbf1640 1 --2- 172.21.15.78:0/4192232849 >> v2:172.21.15.193:3300/0 conn(0x7fe888142270 0x7fe888073e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.426+0000 7fe88dbf1640 1 --2- 172.21.15.78:0/4192232849 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe888144270 0x7fe8880b5680 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.426+0000 7fe88dbf1640 1 -- 172.21.15.78:0/4192232849 >> 172.21.15.78:0/4192232849 conn(0x7fe8880d15f0 msgr2=0x7fe888073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:32.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.426+0000 7fe88dbf1640 1 -- 172.21.15.78:0/4192232849 shutdown_connections 2024-09-17T03:14:32.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.426+0000 7fe88dbf1640 1 -- 172.21.15.78:0/4192232849 wait complete. 2024-09-17T03:14:32.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.428+0000 7fe88dbf1640 1 Processor -- start 2024-09-17T03:14:32.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.428+0000 7fe88dbf1640 1 -- start start 2024-09-17T03:14:32.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.429+0000 7fe88dbf1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe888142270 0x7fe8880cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:32.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.429+0000 7fe88dbf1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe888142680 0x7fe88813e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:32.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.429+0000 7fe88dbf1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe888144270 0x7fe888141180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:32.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.429+0000 7fe88dbf1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe8880d0570 con 0x7fe888144270 2024-09-17T03:14:32.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.429+0000 7fe88dbf1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe8880b5dd0 con 0x7fe888142270 2024-09-17T03:14:32.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.429+0000 7fe88dbf1640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe8880d06f0 con 0x7fe888142680 2024-09-17T03:14:32.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.429+0000 7fe887fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe888144270 0x7fe888141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:32.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.429+0000 7fe887fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe888144270 0x7fe888141180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60838/0 (socket says 172.21.15.78:60838) 2024-09-17T03:14:32.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.429+0000 7fe887fff640 1 -- 172.21.15.78:0/1208659193 learned_addr learned my addr 172.21.15.78:0/1208659193 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:32.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.429+0000 7fe887fff640 1 -- 172.21.15.78:0/1208659193 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe888142680 msgr2=0x7fe88813e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:32.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.429+0000 7fe887fff640 1 --2- 172.21.15.78:0/1208659193 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe888142680 0x7fe88813e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.429+0000 7fe8877fe640 1 --2- 172.21.15.78:0/1208659193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe888142270 0x7fe8880cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:32.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.429+0000 7fe887fff640 1 -- 172.21.15.78:0/1208659193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe888142270 msgr2=0x7fe8880cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:32.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.429+0000 7fe887fff640 1 --2- 172.21.15.78:0/1208659193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe888142270 0x7fe8880cce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:32.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.429+0000 7fe887fff640 1 -- 172.21.15.78:0/1208659193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8881416c0 con 0x7fe888144270 2024-09-17T03:14:32.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.430+0000 7fe887fff640 1 --2- 172.21.15.78:0/1208659193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe888144270 0x7fe888141180 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fe88000c3f0 tx=0x7fe88000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:32.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.430+0000 7fe86ffff640 1 -- 172.21.15.78:0/1208659193 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe880017070 con 0x7fe888144270 2024-09-17T03:14:32.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.430+0000 7fe86ffff640 1 -- 172.21.15.78:0/1208659193 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe8800035f0 con 0x7fe888144270 2024-09-17T03:14:32.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.430+0000 7fe88dbf1640 1 -- 172.21.15.78:0/1208659193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe888141990 con 0x7fe888144270 2024-09-17T03:14:32.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.430+0000 7fe86ffff640 1 -- 172.21.15.78:0/1208659193 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe880003a40 con 0x7fe888144270 2024-09-17T03:14:32.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.430+0000 7fe88dbf1640 1 -- 172.21.15.78:0/1208659193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe88813f860 con 0x7fe888144270 2024-09-17T03:14:32.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.431+0000 7fe88dbf1640 1 -- 172.21.15.78:0/1208659193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe888074520 con 0x7fe888144270 2024-09-17T03:14:32.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.432+0000 7fe86ffff640 1 -- 172.21.15.78:0/1208659193 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe88001a070 con 0x7fe888144270 2024-09-17T03:14:32.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.432+0000 7fe86ffff640 1 --2- 172.21.15.78:0/1208659193 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe874078b90 0x7fe87407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:32.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.432+0000 7fe86ffff640 1 -- 172.21.15.78:0/1208659193 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5115+0+0 (secure 0 0 0) 0x7fe880099d00 con 0x7fe888144270 2024-09-17T03:14:32.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.432+0000 7fe8877fe640 1 --2- 172.21.15.78:0/1208659193 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe874078b90 0x7fe87407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:32.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.433+0000 7fe8877fe640 1 --2- 172.21.15.78:0/1208659193 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe874078b90 0x7fe87407b0a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe878035000 tx=0x7fe878004ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:32.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.436+0000 7fe86ffff640 1 -- 172.21.15.78:0/1208659193 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe880062450 con 0x7fe888144270 2024-09-17T03:14:32.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:32.676+0000 7fe88dbf1640 1 -- 172.21.15.78:0/1208659193 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0"]} v 0) -- 0x7fe888071b20 con 0x7fe888144270 2024-09-17T03:14:33.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.668+0000 7fe86ffff640 1 -- 172.21.15.78:0/1208659193 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0"]}]=0 v314) ==== 168+0+0 (secure 0 0 0) 0x7fe880061d50 con 0x7fe888144270 2024-09-17T03:14:33.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.671+0000 7fe88dbf1640 1 -- 172.21.15.78:0/1208659193 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe874078b90 msgr2=0x7fe87407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:33.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.671+0000 7fe88dbf1640 1 --2- 172.21.15.78:0/1208659193 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe874078b90 0x7fe87407b0a0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe878035000 tx=0x7fe878004ab0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.671+0000 7fe88dbf1640 1 -- 172.21.15.78:0/1208659193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe888144270 msgr2=0x7fe888141180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:33.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.671+0000 7fe88dbf1640 1 --2- 172.21.15.78:0/1208659193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe888144270 0x7fe888141180 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fe88000c3f0 tx=0x7fe88000c8b0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.671+0000 7fe88dbf1640 1 -- 172.21.15.78:0/1208659193 shutdown_connections 2024-09-17T03:14:33.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.671+0000 7fe88dbf1640 1 --2- 172.21.15.78:0/1208659193 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe888144270 0x7fe888141180 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.671+0000 7fe88dbf1640 1 --2- 172.21.15.78:0/1208659193 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe888142680 0x7fe88813e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.671+0000 7fe88dbf1640 1 --2- 172.21.15.78:0/1208659193 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe874078b90 0x7fe87407b0a0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.671+0000 7fe88dbf1640 1 --2- 172.21.15.78:0/1208659193 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe888142270 0x7fe8880cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.671+0000 7fe88dbf1640 1 -- 172.21.15.78:0/1208659193 >> 172.21.15.78:0/1208659193 conn(0x7fe8880d15f0 msgr2=0x7fe88815dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:33.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.671+0000 7fe88dbf1640 1 -- 172.21.15.78:0/1208659193 shutdown_connections 2024-09-17T03:14:33.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.671+0000 7fe88dbf1640 1 -- 172.21.15.78:0/1208659193 wait complete. 2024-09-17T03:14:33.705 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T03:14:33.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.823+0000 7f7e7b9da640 1 -- 172.21.15.78:0/3710934085 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e60004d40 msgr2=0x7f7e600051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:33.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.823+0000 7f7e7b9da640 1 --2- 172.21.15.78:0/3710934085 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e60004d40 0x7f7e600051f0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009ed0 tx=0x7f7e60005830 comp rx=0 tx=0).stop 2024-09-17T03:14:33.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.823+0000 7f7e79f77640 1 -- 172.21.15.78:0/3710934085 reap_dead start 2024-09-17T03:14:33.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.823+0000 7f7e7b9da640 1 -- 172.21.15.78:0/3710934085 shutdown_connections 2024-09-17T03:14:33.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.823+0000 7f7e7b9da640 1 -- 172.21.15.78:0/3710934085 >> 172.21.15.78:0/3710934085 conn(0x7f7e7406def0 msgr2=0x7f7e7406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:33.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.823+0000 7f7e7b9da640 1 -- 172.21.15.78:0/3710934085 shutdown_connections 2024-09-17T03:14:33.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.823+0000 7f7e7b9da640 1 -- 172.21.15.78:0/3710934085 wait complete. 2024-09-17T03:14:33.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.825+0000 7f7e7b9da640 1 Processor -- start 2024-09-17T03:14:33.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.825+0000 7f7e7b9da640 1 -- start start 2024-09-17T03:14:33.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.826+0000 7f7e7b9da640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7e60004d40 0x7f7e74153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:33.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.826+0000 7f7e7b9da640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e740b3780 0x7f7e740b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:33.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.826+0000 7f7e7b9da640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e740b12c0 0x7f7e740b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:33.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.826+0000 7f7e7b9da640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7e74164640 con 0x7f7e740b3780 2024-09-17T03:14:33.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.826+0000 7f7e7b9da640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7e741644c0 con 0x7f7e740b12c0 2024-09-17T03:14:33.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.826+0000 7f7e7b9da640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7e741647c0 con 0x7f7e60004d40 2024-09-17T03:14:33.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.826+0000 7f7e78f75640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e740b3780 0x7f7e740b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:33.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.826+0000 7f7e78f75640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e740b3780 0x7f7e740b0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60852/0 (socket says 172.21.15.78:60852) 2024-09-17T03:14:33.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.826+0000 7f7e78f75640 1 -- 172.21.15.78:0/4023722838 learned_addr learned my addr 172.21.15.78:0/4023722838 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:33.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.826+0000 7f7e79f77640 1 --2- 172.21.15.78:0/4023722838 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e740b12c0 0x7f7e740b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:33.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.826+0000 7f7e79776640 1 --2- 172.21.15.78:0/4023722838 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7e60004d40 0x7f7e74153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:33.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.826+0000 7f7e78f75640 1 -- 172.21.15.78:0/4023722838 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7e60004d40 msgr2=0x7f7e74153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:33.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.826+0000 7f7e78f75640 1 --2- 172.21.15.78:0/4023722838 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7e60004d40 0x7f7e74153120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.826+0000 7f7e78f75640 1 -- 172.21.15.78:0/4023722838 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e740b12c0 msgr2=0x7f7e740b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:33.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.826+0000 7f7e78f75640 1 --2- 172.21.15.78:0/4023722838 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e740b12c0 0x7f7e740b16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:33.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.826+0000 7f7e78f75640 1 -- 172.21.15.78:0/4023722838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e741460c0 con 0x7f7e740b3780 2024-09-17T03:14:33.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.827+0000 7f7e78f75640 1 --2- 172.21.15.78:0/4023722838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e740b3780 0x7f7e740b0d80 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f7e64000fb0 tx=0x7f7e6400eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:33.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.827+0000 7f7e69ffb640 1 -- 172.21.15.78:0/4023722838 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6401c070 con 0x7f7e740b3780 2024-09-17T03:14:33.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.827+0000 7f7e69ffb640 1 -- 172.21.15.78:0/4023722838 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e6400a760 con 0x7f7e740b3780 2024-09-17T03:14:33.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.827+0000 7f7e69ffb640 1 -- 172.21.15.78:0/4023722838 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6400ab70 con 0x7f7e740b3780 2024-09-17T03:14:33.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.827+0000 7f7e7b9da640 1 -- 172.21.15.78:0/4023722838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e74147ab0 con 0x7f7e740b3780 2024-09-17T03:14:33.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.827+0000 7f7e7b9da640 1 -- 172.21.15.78:0/4023722838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e74148070 con 0x7f7e740b3780 2024-09-17T03:14:33.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.828+0000 7f7e7b9da640 1 -- 172.21.15.78:0/4023722838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e7415fd30 con 0x7f7e740b3780 2024-09-17T03:14:33.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.829+0000 7f7e69ffb640 1 -- 172.21.15.78:0/4023722838 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7e6401f070 con 0x7f7e740b3780 2024-09-17T03:14:33.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.829+0000 7f7e69ffb640 1 --2- 172.21.15.78:0/4023722838 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7e58078b90 0x7f7e5807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:33.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.829+0000 7f7e69ffb640 1 -- 172.21.15.78:0/4023722838 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5115+0+0 (secure 0 0 0) 0x7f7e6409c090 con 0x7f7e740b3780 2024-09-17T03:14:33.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.829+0000 7f7e79776640 1 --2- 172.21.15.78:0/4023722838 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7e58078b90 0x7f7e5807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:33.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.830+0000 7f7e79776640 1 --2- 172.21.15.78:0/4023722838 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7e58078b90 0x7f7e5807b0a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7e70000c00 tx=0x7f7e70006ba0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:33.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:33.834+0000 7f7e69ffb640 1 -- 172.21.15.78:0/4023722838 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7e64064160 con 0x7f7e740b3780 2024-09-17T03:14:34.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.007+0000 7f7e7b9da640 1 -- 172.21.15.78:0/4023722838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f7e740b3bb0 con 0x7f7e740b3780 2024-09-17T03:14:34.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.007+0000 7f7e69ffb640 1 -- 172.21.15.78:0/4023722838 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v41) ==== 59+0+2294 (secure 0 0 0) 0x7f7e64068b90 con 0x7f7e740b3780 2024-09-17T03:14:34.006 INFO:teuthology.orchestra.run.smithi078.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T03:14:34.006 INFO:teuthology.orchestra.run.smithi078.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T03:14:34.006 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced client_mount_timeout 30 2024-09-17T03:14:34.006 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_client 20/20 2024-09-17T03:14:34.007 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_mgr 20/20 2024-09-17T03:14:34.007 INFO:teuthology.orchestra.run.smithi078.stdout:mgr advanced debug_ms 1/1 2024-09-17T03:14:34.007 INFO:teuthology.orchestra.run.smithi078.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-17T03:14:34.007 INFO:teuthology.orchestra.run.smithi078.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T03:14:34.007 INFO:teuthology.orchestra.run.smithi078.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4994.035848 2024-09-17T03:14:34.007 INFO:teuthology.orchestra.run.smithi078.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5277.317911 2024-09-17T03:14:34.007 INFO:teuthology.orchestra.run.smithi078.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4833.009828 2024-09-17T03:14:34.007 INFO:teuthology.orchestra.run.smithi078.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7208.562209 2024-09-17T03:14:34.007 INFO:teuthology.orchestra.run.smithi078.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4511.051809 2024-09-17T03:14:34.007 INFO:teuthology.orchestra.run.smithi078.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4237.642218 2024-09-17T03:14:34.007 INFO:teuthology.orchestra.run.smithi078.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 6005.051341 2024-09-17T03:14:34.007 INFO:teuthology.orchestra.run.smithi078.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 4677.613119 2024-09-17T03:14:34.007 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_mds 20/20 2024-09-17T03:14:34.007 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T03:14:34.008 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced debug_ms 2/2 2024-09-17T03:14:34.008 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_debug_frag true 2024-09-17T03:14:34.008 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_debug_scatterstat true 2024-09-17T03:14:34.008 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T03:14:34.008 INFO:teuthology.orchestra.run.smithi078.stdout:mds dev mds_verify_scatter true 2024-09-17T03:14:34.008 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T03:14:34.008 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T03:14:34.008 INFO:teuthology.orchestra.run.smithi078.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T03:14:34.008 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced client_mount_timeout 600 2024-09-17T03:14:34.008 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced debug_client 20/20 2024-09-17T03:14:34.008 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced debug_ms 1/1 2024-09-17T03:14:34.008 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T03:14:34.008 INFO:teuthology.orchestra.run.smithi078.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T03:14:34.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.009+0000 7f7e7b9da640 1 -- 172.21.15.78:0/4023722838 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7e58078b90 msgr2=0x7f7e5807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.009+0000 7f7e7b9da640 1 --2- 172.21.15.78:0/4023722838 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7e58078b90 0x7f7e5807b0a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7e70000c00 tx=0x7f7e70006ba0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.009+0000 7f7e7b9da640 1 -- 172.21.15.78:0/4023722838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e740b3780 msgr2=0x7f7e740b0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.009+0000 7f7e7b9da640 1 --2- 172.21.15.78:0/4023722838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e740b3780 0x7f7e740b0d80 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f7e64000fb0 tx=0x7f7e6400eb30 comp rx=0 tx=0).stop 2024-09-17T03:14:34.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.009+0000 7f7e7b9da640 1 -- 172.21.15.78:0/4023722838 shutdown_connections 2024-09-17T03:14:34.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.009+0000 7f7e7b9da640 1 --2- 172.21.15.78:0/4023722838 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7e58078b90 0x7f7e5807b0a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.009+0000 7f7e7b9da640 1 --2- 172.21.15.78:0/4023722838 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e740b12c0 0x7f7e740b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.009+0000 7f7e7b9da640 1 --2- 172.21.15.78:0/4023722838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e740b3780 0x7f7e740b0d80 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.009+0000 7f7e7b9da640 1 --2- 172.21.15.78:0/4023722838 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7e60004d40 0x7f7e74153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.009+0000 7f7e7b9da640 1 -- 172.21.15.78:0/4023722838 >> 172.21.15.78:0/4023722838 conn(0x7f7e7406def0 msgr2=0x7f7e7406fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:34.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.009+0000 7f7e7b9da640 1 -- 172.21.15.78:0/4023722838 shutdown_connections 2024-09-17T03:14:34.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.009+0000 7f7e7b9da640 1 -- 172.21.15.78:0/4023722838 wait complete. 2024-09-17T03:14:34.019 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T03:14:34.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.135+0000 7f20c90d3640 1 -- 172.21.15.78:0/45799428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20c40cc930 msgr2=0x7f20c41587f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.135+0000 7f20c90d3640 1 --2- 172.21.15.78:0/45799428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20c40cc930 0x7f20c41587f0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f20c4073210 tx=0x7f20b402b850 comp rx=0 tx=0).stop 2024-09-17T03:14:34.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.135+0000 7f20c90d3640 1 -- 172.21.15.78:0/45799428 shutdown_connections 2024-09-17T03:14:34.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.135+0000 7f20c90d3640 1 --2- 172.21.15.78:0/45799428 >> v2:172.21.15.193:3300/0 conn(0x7f20c4074220 0x7f20c415b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.135+0000 7f20c90d3640 1 --2- 172.21.15.78:0/45799428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20c40cc930 0x7f20c41587f0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.135+0000 7f20c90d3640 1 -- 172.21.15.78:0/45799428 >> 172.21.15.78:0/45799428 conn(0x7f20c40d0530 msgr2=0x7f20c40d0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:34.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.135+0000 7f20c90d3640 1 -- 172.21.15.78:0/45799428 shutdown_connections 2024-09-17T03:14:34.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.135+0000 7f20c90d3640 1 -- 172.21.15.78:0/45799428 wait complete. 2024-09-17T03:14:34.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.137+0000 7f20c90d3640 1 Processor -- start 2024-09-17T03:14:34.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.137+0000 7f20c90d3640 1 -- start start 2024-09-17T03:14:34.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.139+0000 7f20c90d3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20c40cc930 0x7f20c40702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:34.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.139+0000 7f20c90d3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20c415b310 0x7f20c414df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:34.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.139+0000 7f20c90d3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f20c40ca2e0 0x7f20c40b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:34.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.139+0000 7f20c90d3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f20c4073650 con 0x7f20c415b310 2024-09-17T03:14:34.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.139+0000 7f20c90d3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f20c40734d0 con 0x7f20c40cc930 2024-09-17T03:14:34.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.139+0000 7f20c90d3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f20c40737d0 con 0x7f20c40ca2e0 2024-09-17T03:14:34.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.139+0000 7f20ba59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20c415b310 0x7f20c414df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:34.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.139+0000 7f20ba59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20c415b310 0x7f20c414df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60866/0 (socket says 172.21.15.78:60866) 2024-09-17T03:14:34.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.139+0000 7f20ba59c640 1 -- 172.21.15.78:0/2135103415 learned_addr learned my addr 172.21.15.78:0/2135103415 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:34.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.139+0000 7f20c2d9d640 1 --2- 172.21.15.78:0/2135103415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20c40cc930 0x7f20c40702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:34.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.139+0000 7f20c359e640 1 --2- 172.21.15.78:0/2135103415 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f20c40ca2e0 0x7f20c40b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:34.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.139+0000 7f20ba59c640 1 -- 172.21.15.78:0/2135103415 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f20c40ca2e0 msgr2=0x7f20c40b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.139+0000 7f20ba59c640 1 --2- 172.21.15.78:0/2135103415 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f20c40ca2e0 0x7f20c40b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.139+0000 7f20ba59c640 1 -- 172.21.15.78:0/2135103415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20c40cc930 msgr2=0x7f20c40702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.139+0000 7f20ba59c640 1 --2- 172.21.15.78:0/2135103415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20c40cc930 0x7f20c40702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.139+0000 7f20ba59c640 1 -- 172.21.15.78:0/2135103415 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c4070bd0 con 0x7f20c415b310 2024-09-17T03:14:34.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.139+0000 7f20ba59c640 1 --2- 172.21.15.78:0/2135103415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20c415b310 0x7f20c414df10 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00c3e0 tx=0x7f20ac00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:34.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.140+0000 7f20bbfff640 1 -- 172.21.15.78:0/2135103415 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac011790 con 0x7f20c415b310 2024-09-17T03:14:34.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.140+0000 7f20bbfff640 1 -- 172.21.15.78:0/2135103415 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20ac017070 con 0x7f20c415b310 2024-09-17T03:14:34.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.140+0000 7f20c90d3640 1 -- 172.21.15.78:0/2135103415 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c40c9800 con 0x7f20c415b310 2024-09-17T03:14:34.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.140+0000 7f20bbfff640 1 -- 172.21.15.78:0/2135103415 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20ac011ce0 con 0x7f20c415b310 2024-09-17T03:14:34.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.140+0000 7f20c90d3640 1 -- 172.21.15.78:0/2135103415 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c40c9dc0 con 0x7f20c415b310 2024-09-17T03:14:34.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.141+0000 7f20c90d3640 1 -- 172.21.15.78:0/2135103415 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20c415b720 con 0x7f20c415b310 2024-09-17T03:14:34.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.141+0000 7f20bbfff640 1 -- 172.21.15.78:0/2135103415 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f20ac01c460 con 0x7f20c415b310 2024-09-17T03:14:34.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.142+0000 7f20bbfff640 1 --2- 172.21.15.78:0/2135103415 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f20a4078b90 0x7f20a407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:34.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.142+0000 7f20bbfff640 1 -- 172.21.15.78:0/2135103415 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5115+0+0 (secure 0 0 0) 0x7f20ac09a660 con 0x7f20c415b310 2024-09-17T03:14:34.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.142+0000 7f20c2d9d640 1 --2- 172.21.15.78:0/2135103415 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f20a4078b90 0x7f20a407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:34.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.143+0000 7f20c2d9d640 1 --2- 172.21.15.78:0/2135103415 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f20a4078b90 0x7f20a407b0a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f20b4036000 tx=0x7f20b4004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:34.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.146+0000 7f20bbfff640 1 -- 172.21.15.78:0/2135103415 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f20ac062880 con 0x7f20c415b310 2024-09-17T03:14:34.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.323+0000 7f20c90d3640 1 -- 172.21.15.78:0/2135103415 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f20c40698f0 con 0x7f20c415b310 2024-09-17T03:14:34.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.327+0000 7f20bbfff640 1 -- 172.21.15.78:0/2135103415 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7f20ac0672b0 con 0x7f20c415b310 2024-09-17T03:14:34.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.329+0000 7f20c90d3640 1 -- 172.21.15.78:0/2135103415 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f20a4078b90 msgr2=0x7f20a407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.329+0000 7f20c90d3640 1 --2- 172.21.15.78:0/2135103415 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f20a4078b90 0x7f20a407b0a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f20b4036000 tx=0x7f20b4004730 comp rx=0 tx=0).stop 2024-09-17T03:14:34.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.329+0000 7f20c90d3640 1 -- 172.21.15.78:0/2135103415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20c415b310 msgr2=0x7f20c414df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.329+0000 7f20c90d3640 1 --2- 172.21.15.78:0/2135103415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20c415b310 0x7f20c414df10 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f20ac00c3e0 tx=0x7f20ac00c8a0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.329+0000 7f20c90d3640 1 -- 172.21.15.78:0/2135103415 shutdown_connections 2024-09-17T03:14:34.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.329+0000 7f20c90d3640 1 --2- 172.21.15.78:0/2135103415 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f20c40ca2e0 0x7f20c40b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.329+0000 7f20c90d3640 1 --2- 172.21.15.78:0/2135103415 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20c415b310 0x7f20c414df10 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.329+0000 7f20c90d3640 1 --2- 172.21.15.78:0/2135103415 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f20a4078b90 0x7f20a407b0a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.329+0000 7f20c90d3640 1 --2- 172.21.15.78:0/2135103415 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20c40cc930 0x7f20c40702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.329+0000 7f20c90d3640 1 -- 172.21.15.78:0/2135103415 >> 172.21.15.78:0/2135103415 conn(0x7f20c40d0530 msgr2=0x7f20c415a870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:34.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.330+0000 7f20c90d3640 1 -- 172.21.15.78:0/2135103415 shutdown_connections 2024-09-17T03:14:34.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.330+0000 7f20c90d3640 1 -- 172.21.15.78:0/2135103415 wait complete. 2024-09-17T03:14:34.339 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:14:34.340 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:14:34.377 DEBUG:teuthology.orchestra.run.smithi193:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:14:34.442 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:14:34.442 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:14:34.442 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:34.458 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056010,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1013 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:14:34.459 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:14:34.459 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:34.477 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:14:34.478 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:14:34.478 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:34.515 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056010,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1013 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:14:34.515 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:14:34.515 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:34.535 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:14:34.535 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T03:14:34.535 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:34.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.669+0000 7f49ff42e640 1 -- 172.21.15.78:0/3032232862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49e4004d40 msgr2=0x7f49e4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.669+0000 7f49ff42e640 1 --2- 172.21.15.78:0/3032232862 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49e4004d40 0x7f49e4005190 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f49f806dc80 tx=0x7f49e4005830 comp rx=0 tx=0).stop 2024-09-17T03:14:34.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.669+0000 7f49fd9cb640 1 -- 172.21.15.78:0/3032232862 reap_dead start 2024-09-17T03:14:34.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.669+0000 7f49ff42e640 1 -- 172.21.15.78:0/3032232862 shutdown_connections 2024-09-17T03:14:34.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.669+0000 7f49ff42e640 1 -- 172.21.15.78:0/3032232862 >> 172.21.15.78:0/3032232862 conn(0x7f49f80cdcc0 msgr2=0x7f49f80ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:34.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.670+0000 7f49ff42e640 1 -- 172.21.15.78:0/3032232862 shutdown_connections 2024-09-17T03:14:34.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.670+0000 7f49ff42e640 1 -- 172.21.15.78:0/3032232862 wait complete. 2024-09-17T03:14:34.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.671+0000 7f49ff42e640 1 Processor -- start 2024-09-17T03:14:34.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.671+0000 7f49ff42e640 1 -- start start 2024-09-17T03:14:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.673+0000 7f49ff42e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49f80c6f70 0x7f49f815c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.673+0000 7f49ff42e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f49f815ca70 0x7f49f80af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.673+0000 7f49ff42e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49f80afb20 0x7f49f815d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.673+0000 7f49ff42e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f49f80b4100 con 0x7f49f80c6f70 2024-09-17T03:14:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.673+0000 7f49ff42e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f49f80b4280 con 0x7f49f80afb20 2024-09-17T03:14:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.673+0000 7f49ff42e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f49f8162a10 con 0x7f49f815ca70 2024-09-17T03:14:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.673+0000 7f49fd1ca640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49f80c6f70 0x7f49f815c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.673+0000 7f49fd1ca640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49f80c6f70 0x7f49f815c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60880/0 (socket says 172.21.15.78:60880) 2024-09-17T03:14:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.673+0000 7f49fd1ca640 1 -- 172.21.15.78:0/2614981694 learned_addr learned my addr 172.21.15.78:0/2614981694 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.673+0000 7f49fc9c9640 1 --2- 172.21.15.78:0/2614981694 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f49f815ca70 0x7f49f80af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:34.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.673+0000 7f49fd9cb640 1 --2- 172.21.15.78:0/2614981694 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49f80afb20 0x7f49f815d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:34.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.673+0000 7f49fd1ca640 1 -- 172.21.15.78:0/2614981694 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f49f815ca70 msgr2=0x7f49f80af5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.673+0000 7f49fd1ca640 1 --2- 172.21.15.78:0/2614981694 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f49f815ca70 0x7f49f80af5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.673+0000 7f49fd1ca640 1 -- 172.21.15.78:0/2614981694 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49f80afb20 msgr2=0x7f49f815d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.673+0000 7f49fd1ca640 1 --2- 172.21.15.78:0/2614981694 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49f80afb20 0x7f49f815d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.673+0000 7f49fd1ca640 1 -- 172.21.15.78:0/2614981694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f8157e40 con 0x7f49f80c6f70 2024-09-17T03:14:34.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.673+0000 7f49fd1ca640 1 --2- 172.21.15.78:0/2614981694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49f80c6f70 0x7f49f815c530 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f49f4006680 tx=0x7f49f40066b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:34.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.673+0000 7f49edffb640 1 -- 172.21.15.78:0/2614981694 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f4015070 con 0x7f49f80c6f70 2024-09-17T03:14:34.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.673+0000 7f49edffb640 1 -- 172.21.15.78:0/2614981694 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49f400fa40 con 0x7f49f80c6f70 2024-09-17T03:14:34.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.674+0000 7f49ff42e640 1 -- 172.21.15.78:0/2614981694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f80ae540 con 0x7f49f80c6f70 2024-09-17T03:14:34.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.674+0000 7f49edffb640 1 -- 172.21.15.78:0/2614981694 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f400fe90 con 0x7f49f80c6f70 2024-09-17T03:14:34.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.674+0000 7f49ff42e640 1 -- 172.21.15.78:0/2614981694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f80aeb00 con 0x7f49f80c6f70 2024-09-17T03:14:34.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.675+0000 7f49ff42e640 1 -- 172.21.15.78:0/2614981694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49f8162040 con 0x7f49f80c6f70 2024-09-17T03:14:34.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.675+0000 7f49edffb640 1 -- 172.21.15.78:0/2614981694 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f49f4011430 con 0x7f49f80c6f70 2024-09-17T03:14:34.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.676+0000 7f49edffb640 1 --2- 172.21.15.78:0/2614981694 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f49dc078d30 0x7f49dc07b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:34.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.676+0000 7f49edffb640 1 -- 172.21.15.78:0/2614981694 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5115+0+0 (secure 0 0 0) 0x7f49f409b710 con 0x7f49f80c6f70 2024-09-17T03:14:34.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.676+0000 7f49fc9c9640 1 --2- 172.21.15.78:0/2614981694 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f49dc078d30 0x7f49dc07b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:34.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.676+0000 7f49fc9c9640 1 --2- 172.21.15.78:0/2614981694 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f49dc078d30 0x7f49dc07b240 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f49f81f8e20 tx=0x7f49e800b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:34.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.680+0000 7f49edffb640 1 -- 172.21.15.78:0/2614981694 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f49f40637f0 con 0x7f49f80c6f70 2024-09-17T03:14:34.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.889+0000 7f49ff42e640 1 -- 172.21.15.78:0/2614981694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f49f80cea20 con 0x7f49f80c6f70 2024-09-17T03:14:34.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.889+0000 7f49edffb640 1 -- 172.21.15.78:0/2614981694 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+3914 (secure 0 0 0) 0x7f49f4068220 con 0x7f49f80c6f70 2024-09-17T03:14:34.888 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:34.888 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":87,"btime":"2024-09-17T03:14:28:647372+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/2155038492","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":2155038492},{"type":"v1","addr":"172.21.15.193:6836","nonce":2155038492}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6605,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/2211774817","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":2211774817},{"type":"v1","addr":"172.21.15.78:6835","nonce":2211774817}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":7126,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/2274284241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2274284241},{"type":"v1","addr":"172.21.15.193:6837","nonce":2274284241}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":8196,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/790524585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":790524585},{"type":"v1","addr":"172.21.15.78:6833","nonce":790524585}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87}],"filesystems":[]} 2024-09-17T03:14:34.889 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 87 2024-09-17T03:14:34.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.891+0000 7f49ff42e640 1 -- 172.21.15.78:0/2614981694 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f49dc078d30 msgr2=0x7f49dc07b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.891+0000 7f49ff42e640 1 --2- 172.21.15.78:0/2614981694 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f49dc078d30 0x7f49dc07b240 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f49f81f8e20 tx=0x7f49e800b2e0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.891+0000 7f49ff42e640 1 -- 172.21.15.78:0/2614981694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49f80c6f70 msgr2=0x7f49f815c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:34.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.891+0000 7f49ff42e640 1 --2- 172.21.15.78:0/2614981694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49f80c6f70 0x7f49f815c530 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f49f4006680 tx=0x7f49f40066b0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.891+0000 7f49ff42e640 1 -- 172.21.15.78:0/2614981694 shutdown_connections 2024-09-17T03:14:34.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.891+0000 7f49ff42e640 1 --2- 172.21.15.78:0/2614981694 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f49dc078d30 0x7f49dc07b240 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.891+0000 7f49ff42e640 1 --2- 172.21.15.78:0/2614981694 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49f80afb20 0x7f49f815d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.891+0000 7f49ff42e640 1 --2- 172.21.15.78:0/2614981694 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f49f815ca70 0x7f49f80af5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.891+0000 7f49ff42e640 1 --2- 172.21.15.78:0/2614981694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f49f80c6f70 0x7f49f815c530 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:34.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.891+0000 7f49ff42e640 1 -- 172.21.15.78:0/2614981694 >> 172.21.15.78:0/2614981694 conn(0x7f49f80cdcc0 msgr2=0x7f49f806cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:34.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.891+0000 7f49ff42e640 1 -- 172.21.15.78:0/2614981694 shutdown_connections 2024-09-17T03:14:34.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:34.891+0000 7f49ff42e640 1 -- 172.21.15.78:0/2614981694 wait complete. 2024-09-17T03:14:34.901 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T03:14:34.902 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T03:14:34.902 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:14:34.902 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:14:34.902 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T03:14:34.902 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T03:14:34.902 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:14:34.903 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:14:34.903 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T03:14:34.903 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T03:14:34.903 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:14:34.903 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:14:34.903 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T03:14:34.903 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T03:14:34.904 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:14:34.904 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:14:34.916 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:14:34.916 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T03:14:34.919 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:14:34.920 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T03:14:34.921 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:14:34.921 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T03:14:34.922 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:14:34.923 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T03:14:34.961 INFO:tasks.ceph.mds.a:Started 2024-09-17T03:14:34.961 DEBUG:teuthology.parallel:result is None 2024-09-17T03:14:34.962 INFO:tasks.ceph.mds.b:Started 2024-09-17T03:14:34.962 INFO:tasks.ceph.mds.c:Started 2024-09-17T03:14:34.963 DEBUG:teuthology.parallel:result is None 2024-09-17T03:14:34.963 DEBUG:teuthology.parallel:result is None 2024-09-17T03:14:34.964 INFO:tasks.ceph.mds.d:Started 2024-09-17T03:14:34.964 DEBUG:teuthology.parallel:result is None 2024-09-17T03:14:34.964 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T03:14:35.047 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-09-17T03:14:35.047 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2024-09-17T03:14:35.058 INFO:tasks.ceph.mds.b.smithi193.stdout:starting mds.b at 2024-09-17T03:14:35.058 INFO:tasks.ceph.mds.d.smithi193.stdout:starting mds.d at 2024-09-17T03:14:35.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.086+0000 7f0e39190640 1 -- 172.21.15.78:0/1897910626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e1c004800 msgr2=0x7f0e1c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:35.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.086+0000 7f0e39190640 1 --2- 172.21.15.78:0/1897910626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e1c004800 0x7f0e1c004c10 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f0e340ba1b0 tx=0x7f0e1c005830 comp rx=0 tx=0).stop 2024-09-17T03:14:35.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.086+0000 7f0e39190640 1 -- 172.21.15.78:0/1897910626 shutdown_connections 2024-09-17T03:14:35.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.086+0000 7f0e39190640 1 --2- 172.21.15.78:0/1897910626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e1c004800 0x7f0e1c004c10 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.086+0000 7f0e39190640 1 -- 172.21.15.78:0/1897910626 >> 172.21.15.78:0/1897910626 conn(0x7f0e3408bfc0 msgr2=0x7f0e3409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:35.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.086+0000 7f0e39190640 1 -- 172.21.15.78:0/1897910626 shutdown_connections 2024-09-17T03:14:35.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.086+0000 7f0e39190640 1 -- 172.21.15.78:0/1897910626 wait complete. 2024-09-17T03:14:35.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.088+0000 7f0e39190640 1 Processor -- start 2024-09-17T03:14:35.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.088+0000 7f0e39190640 1 -- start start 2024-09-17T03:14:35.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e39190640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0e1c004800 0x7f0e340c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:35.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e39190640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e340ca8d0 0x7f0e34156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:35.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e39190640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e3415b4f0 0x7f0e340cd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:35.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e39190640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0e340cef50 con 0x7f0e340ca8d0 2024-09-17T03:14:35.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e39190640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3406e3d0 con 0x7f0e3415b4f0 2024-09-17T03:14:35.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e3259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e340ca8d0 0x7f0e34156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:35.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e39190640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0e340cf0d0 con 0x7f0e1c004800 2024-09-17T03:14:35.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e3259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e340ca8d0 0x7f0e34156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60942/0 (socket says 172.21.15.78:60942) 2024-09-17T03:14:35.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e3259c640 1 -- 172.21.15.78:0/1073857769 learned_addr learned my addr 172.21.15.78:0/1073857769 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e32d9d640 1 --2- 172.21.15.78:0/1073857769 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0e1c004800 0x7f0e340c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e3359e640 1 --2- 172.21.15.78:0/1073857769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e3415b4f0 0x7f0e340cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e3259c640 1 -- 172.21.15.78:0/1073857769 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0e1c004800 msgr2=0x7f0e340c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e3259c640 1 --2- 172.21.15.78:0/1073857769 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0e1c004800 0x7f0e340c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e3259c640 1 -- 172.21.15.78:0/1073857769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e3415b4f0 msgr2=0x7f0e340cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e3259c640 1 --2- 172.21.15.78:0/1073857769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e3415b4f0 0x7f0e340cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e3259c640 1 -- 172.21.15.78:0/1073857769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e340c8560 con 0x7f0e340ca8d0 2024-09-17T03:14:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e32d9d640 1 --2- 172.21.15.78:0/1073857769 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0e1c004800 0x7f0e340c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:14:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e3259c640 1 --2- 172.21.15.78:0/1073857769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e340ca8d0 0x7f0e34156b40 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f0e28001260 tx=0x7f0e28006cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e1b7fe640 1 -- 172.21.15.78:0/1073857769 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e28003810 con 0x7f0e340ca8d0 2024-09-17T03:14:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e1b7fe640 1 -- 172.21.15.78:0/1073857769 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e28003ac0 con 0x7f0e340ca8d0 2024-09-17T03:14:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.090+0000 7f0e39190640 1 -- 172.21.15.78:0/1073857769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e340cc540 con 0x7f0e340ca8d0 2024-09-17T03:14:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.091+0000 7f0e1b7fe640 1 -- 172.21.15.78:0/1073857769 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e28037450 con 0x7f0e340ca8d0 2024-09-17T03:14:35.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.091+0000 7f0e39190640 1 -- 172.21.15.78:0/1073857769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e3415aa10 con 0x7f0e340ca8d0 2024-09-17T03:14:35.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.092+0000 7f0e39190640 1 -- 172.21.15.78:0/1073857769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e340cc2b0 con 0x7f0e340ca8d0 2024-09-17T03:14:35.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.092+0000 7f0e1b7fe640 1 -- 172.21.15.78:0/1073857769 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0e28035020 con 0x7f0e340ca8d0 2024-09-17T03:14:35.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.093+0000 7f0e1b7fe640 1 --2- 172.21.15.78:0/1073857769 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0e20078b90 0x7f0e2007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:35.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.093+0000 7f0e1b7fe640 1 -- 172.21.15.78:0/1073857769 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5115+0+0 (secure 0 0 0) 0x7f0e280bb4d0 con 0x7f0e340ca8d0 2024-09-17T03:14:35.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.093+0000 7f0e32d9d640 1 --2- 172.21.15.78:0/1073857769 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0e20078b90 0x7f0e2007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:35.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.093+0000 7f0e32d9d640 1 --2- 172.21.15.78:0/1073857769 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0e20078b90 0x7f0e2007b0a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0e240066b0 tx=0x7f0e24006b70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:35.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.097+0000 7f0e1b7fe640 1 -- 172.21.15.78:0/1073857769 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0e28047060 con 0x7f0e340ca8d0 2024-09-17T03:14:35.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.283+0000 7f0e39190640 1 -- 172.21.15.78:0/1073857769 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f0e3406f670 con 0x7f0e340ca8d0 2024-09-17T03:14:35.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.681+0000 7f0e1b7fe640 1 -- 172.21.15.78:0/1073857769 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v89) ==== 97+0+0 (secure 0 0 0) 0x7f0e28083bf0 con 0x7f0e340ca8d0 2024-09-17T03:14:35.680 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2024-09-17T03:14:35.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.684+0000 7f0e39190640 1 -- 172.21.15.78:0/1073857769 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0e20078b90 msgr2=0x7f0e2007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:35.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.684+0000 7f0e39190640 1 --2- 172.21.15.78:0/1073857769 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0e20078b90 0x7f0e2007b0a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f0e240066b0 tx=0x7f0e24006b70 comp rx=0 tx=0).stop 2024-09-17T03:14:35.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.684+0000 7f0e39190640 1 -- 172.21.15.78:0/1073857769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e340ca8d0 msgr2=0x7f0e34156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:35.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.684+0000 7f0e39190640 1 --2- 172.21.15.78:0/1073857769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e340ca8d0 0x7f0e34156b40 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f0e28001260 tx=0x7f0e28006cd0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.684+0000 7f0e39190640 1 -- 172.21.15.78:0/1073857769 shutdown_connections 2024-09-17T03:14:35.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.684+0000 7f0e39190640 1 --2- 172.21.15.78:0/1073857769 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0e20078b90 0x7f0e2007b0a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.684+0000 7f0e39190640 1 --2- 172.21.15.78:0/1073857769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e3415b4f0 0x7f0e340cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.684+0000 7f0e39190640 1 --2- 172.21.15.78:0/1073857769 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e340ca8d0 0x7f0e34156b40 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.684+0000 7f0e39190640 1 --2- 172.21.15.78:0/1073857769 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0e1c004800 0x7f0e340c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.684+0000 7f0e39190640 1 -- 172.21.15.78:0/1073857769 >> 172.21.15.78:0/1073857769 conn(0x7f0e3408bfc0 msgr2=0x7f0e340b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:35.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.684+0000 7f0e39190640 1 -- 172.21.15.78:0/1073857769 shutdown_connections 2024-09-17T03:14:35.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.684+0000 7f0e39190640 1 -- 172.21.15.78:0/1073857769 wait complete. 2024-09-17T03:14:35.696 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T03:14:35.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.810+0000 7f633ede4640 1 -- 172.21.15.78:0/3428362446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63380ce750 msgr2=0x7f6338165db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:35.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.810+0000 7f633ede4640 1 --2- 172.21.15.78:0/3428362446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63380ce750 0x7f6338165db0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6330005fd0 tx=0x7f633002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.810+0000 7f633ede4640 1 -- 172.21.15.78:0/3428362446 shutdown_connections 2024-09-17T03:14:35.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.810+0000 7f633ede4640 1 --2- 172.21.15.78:0/3428362446 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f63380ce750 0x7f6338165db0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.810+0000 7f633ede4640 1 -- 172.21.15.78:0/3428362446 >> 172.21.15.78:0/3428362446 conn(0x7f633806d7d0 msgr2=0x7f63380b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:35.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.810+0000 7f633ede4640 1 -- 172.21.15.78:0/3428362446 shutdown_connections 2024-09-17T03:14:35.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.810+0000 7f633ede4640 1 -- 172.21.15.78:0/3428362446 wait complete. 2024-09-17T03:14:35.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.812+0000 7f633ede4640 1 Processor -- start 2024-09-17T03:14:35.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.812+0000 7f633ede4640 1 -- start start 2024-09-17T03:14:35.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f633ede4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f633806f2a0 0x7f633814ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:35.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f633ede4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63380b4bf0 0x7f633814e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:35.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f633ede4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f63380ce750 0x7f633814e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:35.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f633ede4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f6338166530 con 0x7f63380b4bf0 2024-09-17T03:14:35.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f633ede4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6338070850 con 0x7f633806f2a0 2024-09-17T03:14:35.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f633ede4640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f63381666b0 con 0x7f63380ce750 2024-09-17T03:14:35.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f6337fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63380b4bf0 0x7f633814e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:35.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f6337fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63380b4bf0 0x7f633814e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60950/0 (socket says 172.21.15.78:60950) 2024-09-17T03:14:35.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f6337fff640 1 -- 172.21.15.78:0/739520873 learned_addr learned my addr 172.21.15.78:0/739520873 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:35.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f633d381640 1 --2- 172.21.15.78:0/739520873 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f63380ce750 0x7f633814e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:35.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f633cb80640 1 --2- 172.21.15.78:0/739520873 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f633806f2a0 0x7f633814ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:35.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f6337fff640 1 -- 172.21.15.78:0/739520873 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f63380ce750 msgr2=0x7f633814e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:35.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f6337fff640 1 --2- 172.21.15.78:0/739520873 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f63380ce750 0x7f633814e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f6337fff640 1 -- 172.21.15.78:0/739520873 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f633806f2a0 msgr2=0x7f633814ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:35.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f6337fff640 1 --2- 172.21.15.78:0/739520873 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f633806f2a0 0x7f633814ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:35.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f6337fff640 1 -- 172.21.15.78:0/739520873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f633814c900 con 0x7f63380b4bf0 2024-09-17T03:14:35.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f6337fff640 1 --2- 172.21.15.78:0/739520873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63380b4bf0 0x7f633814e420 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f632400c370 tx=0x7f632400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:35.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f63357fa640 1 -- 172.21.15.78:0/739520873 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324017070 con 0x7f63380b4bf0 2024-09-17T03:14:35.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f633ede4640 1 -- 172.21.15.78:0/739520873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f633814b360 con 0x7f63380b4bf0 2024-09-17T03:14:35.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f63357fa640 1 -- 172.21.15.78:0/739520873 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63240053c0 con 0x7f63380b4bf0 2024-09-17T03:14:35.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.814+0000 7f63357fa640 1 -- 172.21.15.78:0/739520873 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324003850 con 0x7f63380b4bf0 2024-09-17T03:14:35.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.815+0000 7f633ede4640 1 -- 172.21.15.78:0/739520873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f633814c340 con 0x7f63380b4bf0 2024-09-17T03:14:35.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.815+0000 7f633ede4640 1 -- 172.21.15.78:0/739520873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f633814cad0 con 0x7f63380b4bf0 2024-09-17T03:14:35.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.816+0000 7f63357fa640 1 -- 172.21.15.78:0/739520873 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f632401a070 con 0x7f63380b4bf0 2024-09-17T03:14:35.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.817+0000 7f63357fa640 1 --2- 172.21.15.78:0/739520873 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f631c078b90 0x7f631c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:35.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.817+0000 7f63357fa640 1 -- 172.21.15.78:0/739520873 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 4857+0+0 (secure 0 0 0) 0x7f6324099dc0 con 0x7f63380b4bf0 2024-09-17T03:14:35.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.817+0000 7f633cb80640 1 --2- 172.21.15.78:0/739520873 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f631c078b90 0x7f631c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:35.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.817+0000 7f633cb80640 1 --2- 172.21.15.78:0/739520873 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f631c078b90 0x7f631c07b0a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f632c0046b0 tx=0x7f632c007e90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:35.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:35.821+0000 7f63357fa640 1 -- 172.21.15.78:0/739520873 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f6324061e80 con 0x7f63380b4bf0 2024-09-17T03:14:36.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.060+0000 7f633ede4640 1 -- 172.21.15.78:0/739520873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f63380ce040 con 0x7f63380b4bf0 2024-09-17T03:14:36.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.061+0000 7f63357fa640 1 -- 172.21.15.78:0/739520873 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7f63240668b0 con 0x7f63380b4bf0 2024-09-17T03:14:36.060 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:36.060 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:14:36.060 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2024-09-17T03:14:36.060 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:14:36.060 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2024-09-17T03:14:36.061 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmF3icCRAAZEAXi3RiY/e4JSSr1nd2sQ==", 2024-09-17T03:14:36.061 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:14:36.061 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:14:36.061 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:14:36.061 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:14:36.061 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:14:36.061 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.061 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:14:36.061 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:14:36.061 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2024-09-17T03:14:36.061 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmzFPWFhAAptFKHxH9Xy3l9q0gxLARBQ==", 2024-09-17T03:14:36.061 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:14:36.062 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:14:36.062 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:14:36.062 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:14:36.062 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:14:36.062 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.062 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:14:36.062 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:14:36.062 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2024-09-17T03:14:36.062 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmFoc7ERAAlPpal3pKHjPKFotpPiJ9dA==", 2024-09-17T03:14:36.062 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:14:36.062 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:14:36.062 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:14:36.063 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:14:36.063 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:14:36.063 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.063 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:14:36.063 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:14:36.063 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2024-09-17T03:14:36.063 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmYJ2aHhAAhG6Sw6iZDy6s0qpiSLc//A==", 2024-09-17T03:14:36.063 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:14:36.063 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:14:36.063 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:14:36.063 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:14:36.063 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:14:36.063 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.064 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:14:36.064 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:14:36.064 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2024-09-17T03:14:36.064 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBy8uhmiaXeOhAAbhD0AqPz5JYg9CvycMk6cQ==", 2024-09-17T03:14:36.064 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:14:36.064 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:14:36.064 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:14:36.064 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:14:36.064 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.064 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:14:36.064 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:14:36.064 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2024-09-17T03:14:36.065 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB28uhmWT32HxAAATHdxAa6QOLYGnpPCx72iA==", 2024-09-17T03:14:36.065 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:14:36.065 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:14:36.065 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:14:36.065 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:14:36.065 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.065 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:14:36.065 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:14:36.065 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2024-09-17T03:14:36.065 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB58uhmTOOMMBAA4YSlpqeuxlIXypxCpxDJ+Q==", 2024-09-17T03:14:36.065 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:14:36.065 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:14:36.065 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:14:36.066 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:14:36.066 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.066 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:14:36.066 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:14:36.066 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2024-09-17T03:14:36.066 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQB88uhmSgx6MxAAKHGCbjfVZTyeb0nX2xKkSQ==", 2024-09-17T03:14:36.066 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:14:36.066 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:14:36.066 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:14:36.066 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:14:36.066 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.066 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:14:36.066 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:14:36.067 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2024-09-17T03:14:36.067 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCD8uhmNKZkBBAAZwn1Xf+fd3GNeP4etvNePg==", 2024-09-17T03:14:36.067 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:14:36.067 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:14:36.067 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:14:36.067 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:14:36.067 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.067 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:14:36.067 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:14:36.067 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2024-09-17T03:14:36.067 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCG8uhmDTyzBhAAzeipRWM5M2fjCQt7xDGBwA==", 2024-09-17T03:14:36.067 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:14:36.068 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:14:36.068 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:14:36.068 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:14:36.068 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.068 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:14:36.068 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:14:36.068 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2024-09-17T03:14:36.068 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCJ8uhmDsZLGBAAB3VNeHQoty+fQwvYpRkltw==", 2024-09-17T03:14:36.068 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:14:36.068 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:14:36.068 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:14:36.069 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:14:36.069 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.069 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:14:36.069 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:14:36.069 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2024-09-17T03:14:36.069 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQCM8uhm3PkQKRAAjJV2xFyyoACLkA3f/lFhWw==", 2024-09-17T03:14:36.069 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:14:36.069 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2024-09-17T03:14:36.069 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2024-09-17T03:14:36.069 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:14:36.069 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.069 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:14:36.069 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:14:36.070 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2024-09-17T03:14:36.070 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmn+c/IxAALXG+Qkwye7zc6PjcLBsk1g==", 2024-09-17T03:14:36.070 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:14:36.070 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:14:36.070 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow r", 2024-09-17T03:14:36.070 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T03:14:36.070 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.070 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:14:36.070 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:14:36.070 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2024-09-17T03:14:36.070 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmbzjQKhAAr/DB8TDsiWPsLHnsvUaTiw==", 2024-09-17T03:14:36.070 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:14:36.070 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:14:36.071 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2024-09-17T03:14:36.071 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2024-09-17T03:14:36.071 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2024-09-17T03:14:36.071 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.071 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:14:36.071 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:14:36.071 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.2", 2024-09-17T03:14:36.071 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmB9ABJxAATgS37nY3a3bX8wK1H3S/8A==", 2024-09-17T03:14:36.071 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:14:36.071 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:14:36.071 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2024-09-17T03:14:36.071 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2024-09-17T03:14:36.072 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2024-09-17T03:14:36.072 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.072 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:14:36.072 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:14:36.072 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.3", 2024-09-17T03:14:36.072 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmyhGmLhAAIfkcz3KW+qZ1qDOqQdPS5g==", 2024-09-17T03:14:36.072 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:14:36.072 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2024-09-17T03:14:36.072 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2024-09-17T03:14:36.072 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2024-09-17T03:14:36.072 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2024-09-17T03:14:36.072 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.072 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:14:36.073 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:14:36.073 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2024-09-17T03:14:36.073 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBu8uhmBgTvJxAAP2vhORVoAAnDSVpnLukIaA==", 2024-09-17T03:14:36.073 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:14:36.073 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2024-09-17T03:14:36.073 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2024-09-17T03:14:36.073 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2024-09-17T03:14:36.073 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:14:36.073 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.073 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:14:36.073 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:14:36.073 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2024-09-17T03:14:36.074 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhmcpvVBRAA2JTbv0LrIc7seMyOmOIBmA==", 2024-09-17T03:14:36.074 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:14:36.074 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2024-09-17T03:14:36.074 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2024-09-17T03:14:36.074 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:14:36.074 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.074 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:14:36.074 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:14:36.074 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2024-09-17T03:14:36.074 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQBv8uhm1SeKARAA2hyytqNjqToQ0K+RgQ8Tbg==", 2024-09-17T03:14:36.074 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2024-09-17T03:14:36.074 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2024-09-17T03:14:36.074 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2024-09-17T03:14:36.074 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2024-09-17T03:14:36.075 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.075 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.075 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2024-09-17T03:14:36.075 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:14:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.063+0000 7f633ede4640 1 -- 172.21.15.78:0/739520873 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f631c078b90 msgr2=0x7f631c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.063+0000 7f633ede4640 1 --2- 172.21.15.78:0/739520873 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f631c078b90 0x7f631c07b0a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f632c0046b0 tx=0x7f632c007e90 comp rx=0 tx=0).stop 2024-09-17T03:14:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.063+0000 7f633ede4640 1 -- 172.21.15.78:0/739520873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63380b4bf0 msgr2=0x7f633814e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.063+0000 7f633ede4640 1 --2- 172.21.15.78:0/739520873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63380b4bf0 0x7f633814e420 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f632400c370 tx=0x7f632400c830 comp rx=0 tx=0).stop 2024-09-17T03:14:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.063+0000 7f633ede4640 1 -- 172.21.15.78:0/739520873 shutdown_connections 2024-09-17T03:14:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.063+0000 7f633ede4640 1 --2- 172.21.15.78:0/739520873 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f63380ce750 0x7f633814e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.063+0000 7f633ede4640 1 --2- 172.21.15.78:0/739520873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63380b4bf0 0x7f633814e420 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.063+0000 7f633ede4640 1 --2- 172.21.15.78:0/739520873 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f631c078b90 0x7f631c07b0a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.063+0000 7f633ede4640 1 --2- 172.21.15.78:0/739520873 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f633806f2a0 0x7f633814ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.063+0000 7f633ede4640 1 -- 172.21.15.78:0/739520873 >> 172.21.15.78:0/739520873 conn(0x7f633806d7d0 msgr2=0x7f63380cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.063+0000 7f633ede4640 1 -- 172.21.15.78:0/739520873 shutdown_connections 2024-09-17T03:14:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.063+0000 7f633ede4640 1 -- 172.21.15.78:0/739520873 wait complete. 2024-09-17T03:14:36.078 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T03:14:36.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.191+0000 7f1ce0357640 1 -- 172.21.15.78:0/987133233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cd80af780 msgr2=0x7f1cd80b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:36.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.191+0000 7f1ce0357640 1 --2- 172.21.15.78:0/987133233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cd80af780 0x7f1cd80b39c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009830 tx=0x7f1cd402a5c0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.191+0000 7f1ce0357640 1 -- 172.21.15.78:0/987133233 shutdown_connections 2024-09-17T03:14:36.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.191+0000 7f1ce0357640 1 --2- 172.21.15.78:0/987133233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cd80af780 0x7f1cd80b39c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.191+0000 7f1ce0357640 1 -- 172.21.15.78:0/987133233 >> 172.21.15.78:0/987133233 conn(0x7f1cd806d7d0 msgr2=0x7f1cd80b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:36.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.191+0000 7f1ce0357640 1 -- 172.21.15.78:0/987133233 shutdown_connections 2024-09-17T03:14:36.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.191+0000 7f1ce0357640 1 -- 172.21.15.78:0/987133233 wait complete. 2024-09-17T03:14:36.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.193+0000 7f1ce0357640 1 Processor -- start 2024-09-17T03:14:36.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.193+0000 7f1ce0357640 1 -- start start 2024-09-17T03:14:36.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.194+0000 7f1ce0357640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd8072ff0 0x7f1cd814fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:36.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.194+0000 7f1ce0357640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1cd80af780 0x7f1cd80cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:36.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.194+0000 7f1ce0357640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cd80cd3e0 0x7f1cd81529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:36.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.194+0000 7f1ce0357640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd8166bf0 con 0x7f1cd8072ff0 2024-09-17T03:14:36.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.194+0000 7f1ce0357640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd80cda00 con 0x7f1cd80cd3e0 2024-09-17T03:14:36.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.194+0000 7f1ce0357640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f1cd8166d70 con 0x7f1cd80af780 2024-09-17T03:14:36.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.194+0000 7f1cde0f3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd8072ff0 0x7f1cd814fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.194+0000 7f1cde0f3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd8072ff0 0x7f1cd814fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60962/0 (socket says 172.21.15.78:60962) 2024-09-17T03:14:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.194+0000 7f1cde0f3640 1 -- 172.21.15.78:0/3800482558 learned_addr learned my addr 172.21.15.78:0/3800482558 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.194+0000 7f1cdd8f2640 1 --2- 172.21.15.78:0/3800482558 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1cd80af780 0x7f1cd80cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.194+0000 7f1cde8f4640 1 --2- 172.21.15.78:0/3800482558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cd80cd3e0 0x7f1cd81529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.194+0000 7f1cde0f3640 1 -- 172.21.15.78:0/3800482558 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1cd80af780 msgr2=0x7f1cd80cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.194+0000 7f1cde0f3640 1 --2- 172.21.15.78:0/3800482558 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1cd80af780 0x7f1cd80cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.194+0000 7f1cde0f3640 1 -- 172.21.15.78:0/3800482558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cd80cd3e0 msgr2=0x7f1cd81529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.194+0000 7f1cde0f3640 1 --2- 172.21.15.78:0/3800482558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cd80cd3e0 0x7f1cd81529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.194+0000 7f1cde0f3640 1 -- 172.21.15.78:0/3800482558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd809b6e0 con 0x7f1cd8072ff0 2024-09-17T03:14:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.195+0000 7f1cde0f3640 1 --2- 172.21.15.78:0/3800482558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd8072ff0 0x7f1cd814fb30 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f1cd402abb0 tx=0x7f1cd4033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.195+0000 7f1cceffd640 1 -- 172.21.15.78:0/3800482558 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4031b50 con 0x7f1cd8072ff0 2024-09-17T03:14:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.195+0000 7f1cceffd640 1 -- 172.21.15.78:0/3800482558 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cd4031de0 con 0x7f1cd8072ff0 2024-09-17T03:14:36.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.195+0000 7f1cceffd640 1 -- 172.21.15.78:0/3800482558 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4005280 con 0x7f1cd8072ff0 2024-09-17T03:14:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.195+0000 7f1ce0357640 1 -- 172.21.15.78:0/3800482558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cd8150070 con 0x7f1cd8072ff0 2024-09-17T03:14:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.195+0000 7f1ce0357640 1 -- 172.21.15.78:0/3800482558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cd8158db0 con 0x7f1cd8072ff0 2024-09-17T03:14:36.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.196+0000 7f1ce0357640 1 -- 172.21.15.78:0/3800482558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cd80b39c0 con 0x7f1cd8072ff0 2024-09-17T03:14:36.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.197+0000 7f1cceffd640 1 -- 172.21.15.78:0/3800482558 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1cd4005420 con 0x7f1cd8072ff0 2024-09-17T03:14:36.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.197+0000 7f1cceffd640 1 --2- 172.21.15.78:0/3800482558 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1cbc078bc0 0x7f1cbc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:36.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.197+0000 7f1cceffd640 1 -- 172.21.15.78:0/3800482558 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 4857+0+0 (secure 0 0 0) 0x7f1cd40bbb00 con 0x7f1cd8072ff0 2024-09-17T03:14:36.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.197+0000 7f1cdd8f2640 1 --2- 172.21.15.78:0/3800482558 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1cbc078bc0 0x7f1cbc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:36.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.198+0000 7f1cdd8f2640 1 --2- 172.21.15.78:0/3800482558 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1cbc078bc0 0x7f1cbc07b0d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8153810 tx=0x7f1cc8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.202+0000 7f1cceffd640 1 -- 172.21.15.78:0/3800482558 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1cd809b6e0 con 0x7f1cd8072ff0 2024-09-17T03:14:36.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.382+0000 7f1ce0357640 1 -- 172.21.15.78:0/3800482558 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f1cd80afca0 con 0x7f1cd8072ff0 2024-09-17T03:14:36.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.382+0000 7f1cceffd640 1 -- 172.21.15.78:0/3800482558 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v91) ==== 84+0+65 (secure 0 0 0) 0x7f1cd403f030 con 0x7f1cd8072ff0 2024-09-17T03:14:36.381 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:36.381 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2024-09-17T03:14:36.382 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-17T03:14:36.382 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2024-09-17T03:14:36.382 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2024-09-17T03:14:36.382 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:14:36.382 INFO:teuthology.orchestra.run.smithi078.stdout:] 2024-09-17T03:14:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.385+0000 7f1ce0357640 1 -- 172.21.15.78:0/3800482558 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1cbc078bc0 msgr2=0x7f1cbc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.385+0000 7f1ce0357640 1 --2- 172.21.15.78:0/3800482558 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1cbc078bc0 0x7f1cbc07b0d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8153810 tx=0x7f1cc8009040 comp rx=0 tx=0).stop 2024-09-17T03:14:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.385+0000 7f1ce0357640 1 -- 172.21.15.78:0/3800482558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd8072ff0 msgr2=0x7f1cd814fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.385+0000 7f1ce0357640 1 --2- 172.21.15.78:0/3800482558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd8072ff0 0x7f1cd814fb30 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f1cd402abb0 tx=0x7f1cd4033ba0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.385+0000 7f1ce0357640 1 -- 172.21.15.78:0/3800482558 shutdown_connections 2024-09-17T03:14:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.385+0000 7f1ce0357640 1 --2- 172.21.15.78:0/3800482558 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1cbc078bc0 0x7f1cbc07b0d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.385+0000 7f1ce0357640 1 --2- 172.21.15.78:0/3800482558 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cd80cd3e0 0x7f1cd81529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.385+0000 7f1ce0357640 1 --2- 172.21.15.78:0/3800482558 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1cd80af780 0x7f1cd80cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.385+0000 7f1ce0357640 1 --2- 172.21.15.78:0/3800482558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cd8072ff0 0x7f1cd814fb30 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.385+0000 7f1ce0357640 1 -- 172.21.15.78:0/3800482558 >> 172.21.15.78:0/3800482558 conn(0x7f1cd806d7d0 msgr2=0x7f1cd80b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:36.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.385+0000 7f1ce0357640 1 -- 172.21.15.78:0/3800482558 shutdown_connections 2024-09-17T03:14:36.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.385+0000 7f1ce0357640 1 -- 172.21.15.78:0/3800482558 wait complete. 2024-09-17T03:14:36.395 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T03:14:36.395 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T03:14:36.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.512+0000 7f513404d640 1 -- 172.21.15.78:0/4141539871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f512c0ccd30 msgr2=0x7f512c073e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:36.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.512+0000 7f513404d640 1 --2- 172.21.15.78:0/4141539871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f512c0ccd30 0x7f512c073e70 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f512c074a30 tx=0x7f512002a560 comp rx=0 tx=0).stop 2024-09-17T03:14:36.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.512+0000 7f513404d640 1 -- 172.21.15.78:0/4141539871 shutdown_connections 2024-09-17T03:14:36.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.512+0000 7f513404d640 1 --2- 172.21.15.78:0/4141539871 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f512c0ccd30 0x7f512c073e70 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.512+0000 7f513404d640 1 --2- 172.21.15.78:0/4141539871 >> v2:172.21.15.193:3300/0 conn(0x7f512c0b55c0 0x7f512c15b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.512+0000 7f513404d640 1 -- 172.21.15.78:0/4141539871 >> 172.21.15.78:0/4141539871 conn(0x7f512c0d1370 msgr2=0x7f512c073760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:36.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.512+0000 7f513404d640 1 -- 172.21.15.78:0/4141539871 shutdown_connections 2024-09-17T03:14:36.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.512+0000 7f513404d640 1 -- 172.21.15.78:0/4141539871 wait complete. 2024-09-17T03:14:36.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.514+0000 7f513404d640 1 Processor -- start 2024-09-17T03:14:36.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.514+0000 7f513404d640 1 -- start start 2024-09-17T03:14:36.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.515+0000 7f513404d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f512c0743b0 0x7f512c134940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:36.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.515+0000 7f513404d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f512c0b55c0 0x7f512c137dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:36.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.515+0000 7f513404d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f512c0ccd30 0x7f512c138310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:36.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.515+0000 7f513404d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f512c15f7f0 con 0x7f512c0ccd30 2024-09-17T03:14:36.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.515+0000 7f513404d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f512c0cfe80 con 0x7f512c0743b0 2024-09-17T03:14:36.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.515+0000 7f513404d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f512c15f970 con 0x7f512c0b55c0 2024-09-17T03:14:36.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.515+0000 7f51325ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f512c0ccd30 0x7f512c138310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:36.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.516+0000 7f51325ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f512c0ccd30 0x7f512c138310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58674/0 (socket says 172.21.15.78:58674) 2024-09-17T03:14:36.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.516+0000 7f51325ea640 1 -- 172.21.15.78:0/2837457468 learned_addr learned my addr 172.21.15.78:0/2837457468 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:36.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.516+0000 7f51315e8640 1 --2- 172.21.15.78:0/2837457468 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f512c0b55c0 0x7f512c137dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:36.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.516+0000 7f5131de9640 1 --2- 172.21.15.78:0/2837457468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f512c0743b0 0x7f512c134940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:36.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.516+0000 7f51325ea640 1 -- 172.21.15.78:0/2837457468 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f512c0b55c0 msgr2=0x7f512c137dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:36.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.516+0000 7f51325ea640 1 --2- 172.21.15.78:0/2837457468 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f512c0b55c0 0x7f512c137dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.516+0000 7f51325ea640 1 -- 172.21.15.78:0/2837457468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f512c0743b0 msgr2=0x7f512c134940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:36.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.516+0000 7f51325ea640 1 --2- 172.21.15.78:0/2837457468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f512c0743b0 0x7f512c134940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:36.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.516+0000 7f51325ea640 1 -- 172.21.15.78:0/2837457468 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f512c136d30 con 0x7f512c0ccd30 2024-09-17T03:14:36.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.516+0000 7f5131de9640 1 --2- 172.21.15.78:0/2837457468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f512c0743b0 0x7f512c134940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:36.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.516+0000 7f51325ea640 1 --2- 172.21.15.78:0/2837457468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f512c0ccd30 0x7f512c138310 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f512400c3c0 tx=0x7f512400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:36.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.516+0000 7f512a7fc640 1 -- 172.21.15.78:0/2837457468 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5124017070 con 0x7f512c0ccd30 2024-09-17T03:14:36.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.516+0000 7f512a7fc640 1 -- 172.21.15.78:0/2837457468 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51240053c0 con 0x7f512c0ccd30 2024-09-17T03:14:36.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.516+0000 7f513404d640 1 -- 172.21.15.78:0/2837457468 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f512c137010 con 0x7f512c0ccd30 2024-09-17T03:14:36.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.516+0000 7f512a7fc640 1 -- 172.21.15.78:0/2837457468 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5124003830 con 0x7f512c0ccd30 2024-09-17T03:14:36.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.516+0000 7f513404d640 1 -- 172.21.15.78:0/2837457468 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f512c1375d0 con 0x7f512c0ccd30 2024-09-17T03:14:36.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.517+0000 7f513404d640 1 -- 172.21.15.78:0/2837457468 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f512c15fe90 con 0x7f512c0ccd30 2024-09-17T03:14:36.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.518+0000 7f512a7fc640 1 -- 172.21.15.78:0/2837457468 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f512401a070 con 0x7f512c0ccd30 2024-09-17T03:14:36.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.519+0000 7f512a7fc640 1 --2- 172.21.15.78:0/2837457468 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5118078bc0 0x7f511807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:36.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.519+0000 7f512a7fc640 1 -- 172.21.15.78:0/2837457468 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 4857+0+0 (secure 0 0 0) 0x7f5124099c70 con 0x7f512c0ccd30 2024-09-17T03:14:36.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.519+0000 7f5131de9640 1 --2- 172.21.15.78:0/2837457468 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5118078bc0 0x7f511807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:36.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.520+0000 7f5131de9640 1 --2- 172.21.15.78:0/2837457468 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5118078bc0 0x7f511807b0d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f511c005fd0 tx=0x7f511c009480 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:36.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.523+0000 7f512a7fc640 1 -- 172.21.15.78:0/2837457468 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f512c0747c0 con 0x7f512c0ccd30 2024-09-17T03:14:36.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:36.697+0000 7f513404d640 1 -- 172.21.15.78:0/2837457468 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f512c139e80 con 0x7f512c0ccd30 2024-09-17T03:14:37.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.691+0000 7f512a7fc640 1 -- 172.21.15.78:0/2837457468 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v92) ==== 138+0+0 (secure 0 0 0) 0x7f5124061d30 con 0x7f512c0ccd30 2024-09-17T03:14:37.690 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2024-09-17T03:14:37.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.694+0000 7f513404d640 1 -- 172.21.15.78:0/2837457468 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5118078bc0 msgr2=0x7f511807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:37.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.694+0000 7f513404d640 1 --2- 172.21.15.78:0/2837457468 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5118078bc0 0x7f511807b0d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f511c005fd0 tx=0x7f511c009480 comp rx=0 tx=0).stop 2024-09-17T03:14:37.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.694+0000 7f513404d640 1 -- 172.21.15.78:0/2837457468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f512c0ccd30 msgr2=0x7f512c138310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:37.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.694+0000 7f513404d640 1 --2- 172.21.15.78:0/2837457468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f512c0ccd30 0x7f512c138310 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f512400c3c0 tx=0x7f512400c880 comp rx=0 tx=0).stop 2024-09-17T03:14:37.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.694+0000 7f513404d640 1 -- 172.21.15.78:0/2837457468 shutdown_connections 2024-09-17T03:14:37.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.694+0000 7f513404d640 1 --2- 172.21.15.78:0/2837457468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f512c0ccd30 0x7f512c138310 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:37.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.695+0000 7f513404d640 1 --2- 172.21.15.78:0/2837457468 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f512c0b55c0 0x7f512c137dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:37.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.695+0000 7f513404d640 1 --2- 172.21.15.78:0/2837457468 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5118078bc0 0x7f511807b0d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:37.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.695+0000 7f513404d640 1 --2- 172.21.15.78:0/2837457468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f512c0743b0 0x7f512c134940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:37.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.695+0000 7f513404d640 1 -- 172.21.15.78:0/2837457468 >> 172.21.15.78:0/2837457468 conn(0x7f512c0d1370 msgr2=0x7f512c073760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:37.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.695+0000 7f513404d640 1 -- 172.21.15.78:0/2837457468 shutdown_connections 2024-09-17T03:14:37.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.695+0000 7f513404d640 1 -- 172.21.15.78:0/2837457468 wait complete. 2024-09-17T03:14:37.712 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T03:14:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.840+0000 7f7e02cc5640 1 -- 172.21.15.78:0/850317815 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7dfc0d1d50 msgr2=0x7f7dfc15c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.840+0000 7f7e02cc5640 1 --2- 172.21.15.78:0/850317815 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7dfc0d1d50 0x7f7dfc15c750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7df8005fd0 tx=0x7f7df802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:14:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.840+0000 7f7e02cc5640 1 -- 172.21.15.78:0/850317815 shutdown_connections 2024-09-17T03:14:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.840+0000 7f7e02cc5640 1 --2- 172.21.15.78:0/850317815 >> v2:172.21.15.193:3300/0 conn(0x7f7dfc0b15b0 0x7f7dfc0d22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.840+0000 7f7e02cc5640 1 --2- 172.21.15.78:0/850317815 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7dfc0d1d50 0x7f7dfc15c750 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.840+0000 7f7e02cc5640 1 -- 172.21.15.78:0/850317815 >> 172.21.15.78:0/850317815 conn(0x7f7dfc06d230 msgr2=0x7f7dfc06d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.840+0000 7f7e02cc5640 1 -- 172.21.15.78:0/850317815 shutdown_connections 2024-09-17T03:14:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.840+0000 7f7e02cc5640 1 -- 172.21.15.78:0/850317815 wait complete. 2024-09-17T03:14:37.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.841+0000 7f7e02cc5640 1 Processor -- start 2024-09-17T03:14:37.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.841+0000 7f7e02cc5640 1 -- start start 2024-09-17T03:14:37.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.843+0000 7f7e02cc5640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7dfc0b15b0 0x7f7dfc14a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:37.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.843+0000 7f7e02cc5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7dfc0d1d50 0x7f7dfc1f3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:37.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.843+0000 7f7e02cc5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dfc0d2800 0x7f7dfc1f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:37.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.843+0000 7f7e02cc5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc0b4640 con 0x7f7dfc0d2800 2024-09-17T03:14:37.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.843+0000 7f7e02cc5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7dfc0b44c0 con 0x7f7dfc0d1d50 2024-09-17T03:14:37.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.843+0000 7f7e02cc5640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7dfc0b47c0 con 0x7f7dfc0b15b0 2024-09-17T03:14:37.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.843+0000 7f7e01262640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dfc0d2800 0x7f7dfc1f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:37.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.843+0000 7f7e01262640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dfc0d2800 0x7f7dfc1f3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58680/0 (socket says 172.21.15.78:58680) 2024-09-17T03:14:37.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.843+0000 7f7e01262640 1 -- 172.21.15.78:0/2276420748 learned_addr learned my addr 172.21.15.78:0/2276420748 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:37.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.843+0000 7f7df3fff640 1 --2- 172.21.15.78:0/2276420748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7dfc0d1d50 0x7f7dfc1f3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:37.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.843+0000 7f7e00a61640 1 --2- 172.21.15.78:0/2276420748 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7dfc0b15b0 0x7f7dfc14a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:37.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.843+0000 7f7e01262640 1 -- 172.21.15.78:0/2276420748 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7dfc0b15b0 msgr2=0x7f7dfc14a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:37.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.843+0000 7f7e01262640 1 --2- 172.21.15.78:0/2276420748 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7dfc0b15b0 0x7f7dfc14a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:37.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.843+0000 7f7e01262640 1 -- 172.21.15.78:0/2276420748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7dfc0d1d50 msgr2=0x7f7dfc1f3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:37.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.843+0000 7f7e01262640 1 --2- 172.21.15.78:0/2276420748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7dfc0d1d50 0x7f7dfc1f3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:37.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.843+0000 7f7e01262640 1 -- 172.21.15.78:0/2276420748 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dfc1f4550 con 0x7f7dfc0d2800 2024-09-17T03:14:37.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.844+0000 7f7e01262640 1 --2- 172.21.15.78:0/2276420748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dfc0d2800 0x7f7dfc1f3c60 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f7df400c7b0 tx=0x7f7df400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:37.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.844+0000 7f7df17fa640 1 -- 172.21.15.78:0/2276420748 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4003970 con 0x7f7dfc0d2800 2024-09-17T03:14:37.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.844+0000 7f7df17fa640 1 -- 172.21.15.78:0/2276420748 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7df4003b30 con 0x7f7dfc0d2800 2024-09-17T03:14:37.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.844+0000 7f7e02cc5640 1 -- 172.21.15.78:0/2276420748 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dfc0b53b0 con 0x7f7dfc0d2800 2024-09-17T03:14:37.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.844+0000 7f7df17fa640 1 -- 172.21.15.78:0/2276420748 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df400a850 con 0x7f7dfc0d2800 2024-09-17T03:14:37.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.844+0000 7f7e02cc5640 1 -- 172.21.15.78:0/2276420748 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dfc15caf0 con 0x7f7dfc0d2800 2024-09-17T03:14:37.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.845+0000 7f7e02cc5640 1 -- 172.21.15.78:0/2276420748 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dfc1f42c0 con 0x7f7dfc0d2800 2024-09-17T03:14:37.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.845+0000 7f7df17fa640 1 -- 172.21.15.78:0/2276420748 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7df400a9f0 con 0x7f7dfc0d2800 2024-09-17T03:14:37.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.846+0000 7f7df17fa640 1 --2- 172.21.15.78:0/2276420748 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7de8078bc0 0x7f7de807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:37.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.846+0000 7f7df17fa640 1 -- 172.21.15.78:0/2276420748 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5227+0+0 (secure 0 0 0) 0x7f7df409a8b0 con 0x7f7dfc0d2800 2024-09-17T03:14:37.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.846+0000 7f7e00a61640 1 --2- 172.21.15.78:0/2276420748 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7de8078bc0 0x7f7de807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:37.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.847+0000 7f7e00a61640 1 --2- 172.21.15.78:0/2276420748 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7de8078bc0 0x7f7de807b0d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7df8033000 tx=0x7f7df8004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:37.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:37.851+0000 7f7df17fa640 1 -- 172.21.15.78:0/2276420748 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7dfc0d2c10 con 0x7f7dfc0d2800 2024-09-17T03:14:38.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.026+0000 7f7e02cc5640 1 -- 172.21.15.78:0/2276420748 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7dfc15cd50 con 0x7f7dfc0d2800 2024-09-17T03:14:38.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.693+0000 7f7df17fa640 1 -- 172.21.15.78:0/2276420748 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v93) ==== 170+0+0 (secure 0 0 0) 0x7f7df4062f60 con 0x7f7dfc0d2800 2024-09-17T03:14:38.692 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2024-09-17T03:14:38.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.696+0000 7f7e02cc5640 1 -- 172.21.15.78:0/2276420748 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7de8078bc0 msgr2=0x7f7de807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:38.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.696+0000 7f7e02cc5640 1 --2- 172.21.15.78:0/2276420748 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7de8078bc0 0x7f7de807b0d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7df8033000 tx=0x7f7df8004730 comp rx=0 tx=0).stop 2024-09-17T03:14:38.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.696+0000 7f7e02cc5640 1 -- 172.21.15.78:0/2276420748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dfc0d2800 msgr2=0x7f7dfc1f3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:38.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.696+0000 7f7e02cc5640 1 --2- 172.21.15.78:0/2276420748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dfc0d2800 0x7f7dfc1f3c60 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f7df400c7b0 tx=0x7f7df400cbb0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.696+0000 7f7e02cc5640 1 -- 172.21.15.78:0/2276420748 shutdown_connections 2024-09-17T03:14:38.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.696+0000 7f7e02cc5640 1 --2- 172.21.15.78:0/2276420748 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7dfc0d2800 0x7f7dfc1f3c60 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.696+0000 7f7e02cc5640 1 --2- 172.21.15.78:0/2276420748 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7de8078bc0 0x7f7de807b0d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.696+0000 7f7e02cc5640 1 --2- 172.21.15.78:0/2276420748 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7dfc0d1d50 0x7f7dfc1f3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.696+0000 7f7e02cc5640 1 --2- 172.21.15.78:0/2276420748 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7dfc0b15b0 0x7f7dfc14a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.696+0000 7f7e02cc5640 1 -- 172.21.15.78:0/2276420748 >> 172.21.15.78:0/2276420748 conn(0x7f7dfc06d230 msgr2=0x7f7dfc0cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:38.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.696+0000 7f7e02cc5640 1 -- 172.21.15.78:0/2276420748 shutdown_connections 2024-09-17T03:14:38.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.696+0000 7f7e02cc5640 1 -- 172.21.15.78:0/2276420748 wait complete. 2024-09-17T03:14:38.723 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T03:14:38.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.843+0000 7f13ba5df640 1 -- 172.21.15.78:0/42817558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13b40ca800 msgr2=0x7f13b40cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:38.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.843+0000 7f13ba5df640 1 --2- 172.21.15.78:0/42817558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13b40ca800 0x7f13b40cba00 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f13b40c71a0 tx=0x7f13a402a510 comp rx=0 tx=0).stop 2024-09-17T03:14:38.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.843+0000 7f13ba5df640 1 -- 172.21.15.78:0/42817558 shutdown_connections 2024-09-17T03:14:38.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.843+0000 7f13ba5df640 1 --2- 172.21.15.78:0/42817558 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f13b40706b0 0x7f13b40735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.843+0000 7f13ba5df640 1 --2- 172.21.15.78:0/42817558 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13b40ca800 0x7f13b40cba00 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.843+0000 7f13ba5df640 1 -- 172.21.15.78:0/42817558 >> 172.21.15.78:0/42817558 conn(0x7f13b40b1cb0 msgr2=0x7f13b40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:38.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.843+0000 7f13ba5df640 1 -- 172.21.15.78:0/42817558 shutdown_connections 2024-09-17T03:14:38.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.843+0000 7f13ba5df640 1 -- 172.21.15.78:0/42817558 wait complete. 2024-09-17T03:14:38.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.845+0000 7f13ba5df640 1 Processor -- start 2024-09-17T03:14:38.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.845+0000 7f13ba5df640 1 -- start start 2024-09-17T03:14:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.846+0000 7f13ba5df640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f13b40ca800 0x7f13b40d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.846+0000 7f13ba5df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13b40cad30 0x7f13b415d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.846+0000 7f13ba5df640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13b4159a50 0x7f13b409ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.846+0000 7f13ba5df640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f13b4073f00 con 0x7f13b40cad30 2024-09-17T03:14:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.846+0000 7f13ba5df640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f13b4073d80 con 0x7f13b4159a50 2024-09-17T03:14:38.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.846+0000 7f13ba5df640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f13b4074080 con 0x7f13b40ca800 2024-09-17T03:14:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.846+0000 7f13b37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13b40cad30 0x7f13b415d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.846+0000 7f13b37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13b40cad30 0x7f13b415d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58702/0 (socket says 172.21.15.78:58702) 2024-09-17T03:14:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.846+0000 7f13b37fe640 1 -- 172.21.15.78:0/1901221679 learned_addr learned my addr 172.21.15.78:0/1901221679 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.846+0000 7f13b3fff640 1 --2- 172.21.15.78:0/1901221679 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f13b40ca800 0x7f13b40d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.846+0000 7f13b8b7c640 1 --2- 172.21.15.78:0/1901221679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13b4159a50 0x7f13b409ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.846+0000 7f13b37fe640 1 -- 172.21.15.78:0/1901221679 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f13b40ca800 msgr2=0x7f13b40d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.846+0000 7f13b37fe640 1 --2- 172.21.15.78:0/1901221679 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f13b40ca800 0x7f13b40d05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.846+0000 7f13b37fe640 1 -- 172.21.15.78:0/1901221679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13b4159a50 msgr2=0x7f13b409ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.846+0000 7f13b37fe640 1 --2- 172.21.15.78:0/1901221679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13b4159a50 0x7f13b409ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.847+0000 7f13b37fe640 1 -- 172.21.15.78:0/1901221679 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b41589b0 con 0x7f13b40cad30 2024-09-17T03:14:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.847+0000 7f13b37fe640 1 --2- 172.21.15.78:0/1901221679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13b40cad30 0x7f13b415d300 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f13a800c390 tx=0x7f13a800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.847+0000 7f13b0ff9640 1 -- 172.21.15.78:0/1901221679 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a8011790 con 0x7f13b40cad30 2024-09-17T03:14:38.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.847+0000 7f13b0ff9640 1 -- 172.21.15.78:0/1901221679 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13a8017070 con 0x7f13b40cad30 2024-09-17T03:14:38.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.847+0000 7f13ba5df640 1 -- 172.21.15.78:0/1901221679 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13b4158c90 con 0x7f13b40cad30 2024-09-17T03:14:38.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.847+0000 7f13b0ff9640 1 -- 172.21.15.78:0/1901221679 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a8011cc0 con 0x7f13b40cad30 2024-09-17T03:14:38.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.847+0000 7f13ba5df640 1 -- 172.21.15.78:0/1901221679 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13b4159250 con 0x7f13b40cad30 2024-09-17T03:14:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.848+0000 7f13ba5df640 1 -- 172.21.15.78:0/1901221679 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13b40745e0 con 0x7f13b40cad30 2024-09-17T03:14:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.849+0000 7f13b0ff9640 1 -- 172.21.15.78:0/1901221679 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f13a801c460 con 0x7f13b40cad30 2024-09-17T03:14:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.849+0000 7f13b0ff9640 1 --2- 172.21.15.78:0/1901221679 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f13a0078b90 0x7f13a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.849+0000 7f13b0ff9640 1 -- 172.21.15.78:0/1901221679 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5609+0+0 (secure 0 0 0) 0x7f13a809a9a0 con 0x7f13b40cad30 2024-09-17T03:14:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.850+0000 7f13b3fff640 1 --2- 172.21.15.78:0/1901221679 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f13a0078b90 0x7f13a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:38.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.850+0000 7f13b3fff640 1 --2- 172.21.15.78:0/1901221679 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f13a0078b90 0x7f13a007b0a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f13a4033000 tx=0x7f13a4004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:38.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:38.854+0000 7f13b0ff9640 1 -- 172.21.15.78:0/1901221679 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f13a80627f0 con 0x7f13b40cad30 2024-09-17T03:14:39.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.063+0000 7f13ba5df640 1 -- 172.21.15.78:0/1901221679 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f13b40736a0 con 0x7f13b40cad30 2024-09-17T03:14:39.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.726+0000 7f13b0ff9640 1 -- 172.21.15.78:0/1901221679 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v90) ==== 174+0+0 (secure 0 0 0) 0x7f13a8067220 con 0x7f13b40cad30 2024-09-17T03:14:39.725 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 14 and data pool 15 2024-09-17T03:14:39.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.731+0000 7f13ba5df640 1 -- 172.21.15.78:0/1901221679 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f13a0078b90 msgr2=0x7f13a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:39.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.731+0000 7f13ba5df640 1 --2- 172.21.15.78:0/1901221679 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f13a0078b90 0x7f13a007b0a0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f13a4033000 tx=0x7f13a4004730 comp rx=0 tx=0).stop 2024-09-17T03:14:39.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.731+0000 7f13ba5df640 1 -- 172.21.15.78:0/1901221679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13b40cad30 msgr2=0x7f13b415d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:39.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.731+0000 7f13ba5df640 1 --2- 172.21.15.78:0/1901221679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13b40cad30 0x7f13b415d300 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f13a800c390 tx=0x7f13a800c850 comp rx=0 tx=0).stop 2024-09-17T03:14:39.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.739+0000 7f13ba5df640 1 -- 172.21.15.78:0/1901221679 shutdown_connections 2024-09-17T03:14:39.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.739+0000 7f13ba5df640 1 --2- 172.21.15.78:0/1901221679 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f13a0078b90 0x7f13a007b0a0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:39.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.739+0000 7f13ba5df640 1 --2- 172.21.15.78:0/1901221679 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13b4159a50 0x7f13b409ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:39.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.739+0000 7f13ba5df640 1 --2- 172.21.15.78:0/1901221679 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f13b40cad30 0x7f13b415d300 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:39.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.739+0000 7f13ba5df640 1 --2- 172.21.15.78:0/1901221679 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f13b40ca800 0x7f13b40d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:39.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.739+0000 7f13ba5df640 1 -- 172.21.15.78:0/1901221679 >> 172.21.15.78:0/1901221679 conn(0x7f13b40b1cb0 msgr2=0x7f13b40aefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:39.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.740+0000 7f13ba5df640 1 -- 172.21.15.78:0/1901221679 shutdown_connections 2024-09-17T03:14:39.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.740+0000 7f13ba5df640 1 -- 172.21.15.78:0/1901221679 wait complete. 2024-09-17T03:14:39.758 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:14:39.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.874+0000 7f7c63db0640 1 -- 172.21.15.78:0/2484597116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c44004800 msgr2=0x7f7c44004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:39.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.874+0000 7f7c63db0640 1 --2- 172.21.15.78:0/2484597116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c44004800 0x7f7c44004c10 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f7c50006fc0 tx=0x7f7c44005830 comp rx=0 tx=0).stop 2024-09-17T03:14:39.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.874+0000 7f7c6234d640 1 -- 172.21.15.78:0/2484597116 reap_dead start 2024-09-17T03:14:39.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.874+0000 7f7c63db0640 1 -- 172.21.15.78:0/2484597116 shutdown_connections 2024-09-17T03:14:39.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.874+0000 7f7c63db0640 1 -- 172.21.15.78:0/2484597116 >> 172.21.15.78:0/2484597116 conn(0x7f7c5c0d12a0 msgr2=0x7f7c5c0d16b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:39.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.874+0000 7f7c63db0640 1 -- 172.21.15.78:0/2484597116 shutdown_connections 2024-09-17T03:14:39.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.874+0000 7f7c63db0640 1 -- 172.21.15.78:0/2484597116 wait complete. 2024-09-17T03:14:39.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.876+0000 7f7c63db0640 1 Processor -- start 2024-09-17T03:14:39.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.876+0000 7f7c63db0640 1 -- start start 2024-09-17T03:14:39.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.877+0000 7f7c63db0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c44004800 0x7f7c5c0c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:39.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.877+0000 7f7c63db0640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7c5c1f5440 0x7f7c5c1f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:39.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.877+0000 7f7c63db0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c5c09bac0 0x7f7c5c0af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:39.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.877+0000 7f7c63db0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c0b0f60 con 0x7f7c5c09bac0 2024-09-17T03:14:39.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.877+0000 7f7c63db0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c0b0de0 con 0x7f7c44004800 2024-09-17T03:14:39.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.877+0000 7f7c63db0640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7c5c0b10e0 con 0x7f7c5c1f5440 2024-09-17T03:14:39.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.877+0000 7f7c6234d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c5c09bac0 0x7f7c5c0af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:39.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.877+0000 7f7c6234d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c5c09bac0 0x7f7c5c0af260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58728/0 (socket says 172.21.15.78:58728) 2024-09-17T03:14:39.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.877+0000 7f7c6234d640 1 -- 172.21.15.78:0/1774677092 learned_addr learned my addr 172.21.15.78:0/1774677092 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:39.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.877+0000 7f7c6134b640 1 --2- 172.21.15.78:0/1774677092 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7c5c1f5440 0x7f7c5c1f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:39.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.877+0000 7f7c6234d640 1 -- 172.21.15.78:0/1774677092 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7c5c1f5440 msgr2=0x7f7c5c1f26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:39.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.877+0000 7f7c6234d640 1 --2- 172.21.15.78:0/1774677092 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7c5c1f5440 0x7f7c5c1f26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:39.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.877+0000 7f7c6234d640 1 -- 172.21.15.78:0/1774677092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c44004800 msgr2=0x7f7c5c0c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:39.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.877+0000 7f7c61b4c640 1 --2- 172.21.15.78:0/1774677092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c44004800 0x7f7c5c0c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:39.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.877+0000 7f7c6234d640 1 --2- 172.21.15.78:0/1774677092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c44004800 0x7f7c5c0c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:39.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.877+0000 7f7c6234d640 1 -- 172.21.15.78:0/1774677092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c5c1f5c20 con 0x7f7c5c09bac0 2024-09-17T03:14:39.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.877+0000 7f7c61b4c640 1 --2- 172.21.15.78:0/1774677092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c44004800 0x7f7c5c0c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:39.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.878+0000 7f7c6234d640 1 --2- 172.21.15.78:0/1774677092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c5c09bac0 0x7f7c5c0af260 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0b1e10 tx=0x7f7c54001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:39.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.878+0000 7f7c5a7fc640 1 -- 172.21.15.78:0/1774677092 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c540107d0 con 0x7f7c5c09bac0 2024-09-17T03:14:39.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.878+0000 7f7c5a7fc640 1 -- 172.21.15.78:0/1774677092 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c54016070 con 0x7f7c5c09bac0 2024-09-17T03:14:39.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.878+0000 7f7c63db0640 1 -- 172.21.15.78:0/1774677092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c5c1f5f00 con 0x7f7c5c09bac0 2024-09-17T03:14:39.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.878+0000 7f7c5a7fc640 1 -- 172.21.15.78:0/1774677092 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c54010d00 con 0x7f7c5c09bac0 2024-09-17T03:14:39.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.878+0000 7f7c63db0640 1 -- 172.21.15.78:0/1774677092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c5c1f2180 con 0x7f7c5c09bac0 2024-09-17T03:14:39.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.879+0000 7f7c63db0640 1 -- 172.21.15.78:0/1774677092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c5c1f5990 con 0x7f7c5c09bac0 2024-09-17T03:14:39.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.880+0000 7f7c5a7fc640 1 -- 172.21.15.78:0/1774677092 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7c5401b460 con 0x7f7c5c09bac0 2024-09-17T03:14:39.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.880+0000 7f7c5a7fc640 1 --2- 172.21.15.78:0/1774677092 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7c48078bc0 0x7f7c4807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:39.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.880+0000 7f7c5a7fc640 1 -- 172.21.15.78:0/1774677092 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5709+0+0 (secure 0 0 0) 0x7f7c5409b580 con 0x7f7c5c09bac0 2024-09-17T03:14:39.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.880+0000 7f7c61b4c640 1 --2- 172.21.15.78:0/1774677092 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7c48078bc0 0x7f7c4807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:39.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.881+0000 7f7c61b4c640 1 --2- 172.21.15.78:0/1774677092 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7c48078bc0 0x7f7c4807b0d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c005fd0 tx=0x7f7c4c0094a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:39.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:39.884+0000 7f7c5a7fc640 1 -- 172.21.15.78:0/1774677092 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7c540639c0 con 0x7f7c5c09bac0 2024-09-17T03:14:40.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.061+0000 7f7c63db0640 1 -- 172.21.15.78:0/1774677092 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c5c0b12f0 con 0x7f7c5c09bac0 2024-09-17T03:14:40.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.062+0000 7f7c5a7fc640 1 -- 172.21.15.78:0/1774677092 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+16657 (secure 0 0 0) 0x7f7c540632c0 con 0x7f7c5c09bac0 2024-09-17T03:14:40.061 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:40.061 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":94,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:14:39.064243+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:14:36.702637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T03:14:38.031363+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:14:40.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.064+0000 7f7c63db0640 1 -- 172.21.15.78:0/1774677092 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7c48078bc0 msgr2=0x7f7c4807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:40.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.064+0000 7f7c63db0640 1 --2- 172.21.15.78:0/1774677092 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7c48078bc0 0x7f7c4807b0d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c005fd0 tx=0x7f7c4c0094a0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.064+0000 7f7c63db0640 1 -- 172.21.15.78:0/1774677092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c5c09bac0 msgr2=0x7f7c5c0af260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:40.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.064+0000 7f7c63db0640 1 --2- 172.21.15.78:0/1774677092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c5c09bac0 0x7f7c5c0af260 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0b1e10 tx=0x7f7c54001630 comp rx=0 tx=0).stop 2024-09-17T03:14:40.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.064+0000 7f7c63db0640 1 -- 172.21.15.78:0/1774677092 shutdown_connections 2024-09-17T03:14:40.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.064+0000 7f7c63db0640 1 --2- 172.21.15.78:0/1774677092 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c5c09bac0 0x7f7c5c0af260 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.064+0000 7f7c63db0640 1 --2- 172.21.15.78:0/1774677092 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7c5c1f5440 0x7f7c5c1f26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.064+0000 7f7c63db0640 1 --2- 172.21.15.78:0/1774677092 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7c48078bc0 0x7f7c4807b0d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.064+0000 7f7c63db0640 1 --2- 172.21.15.78:0/1774677092 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7c44004800 0x7f7c5c0c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.064+0000 7f7c63db0640 1 -- 172.21.15.78:0/1774677092 >> 172.21.15.78:0/1774677092 conn(0x7f7c5c0d12a0 msgr2=0x7f7c5c0b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:40.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.064+0000 7f7c63db0640 1 -- 172.21.15.78:0/1774677092 shutdown_connections 2024-09-17T03:14:40.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.064+0000 7f7c63db0640 1 -- 172.21.15.78:0/1774677092 wait complete. 2024-09-17T03:14:40.075 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:14:40.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.188+0000 7f4684c9b640 1 -- 172.21.15.78:0/2223733456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4680074560 msgr2=0x7f46800cfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:40.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.188+0000 7f4684c9b640 1 --2- 172.21.15.78:0/2223733456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4680074560 0x7f46800cfe60 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f46800749e0 tx=0x7f467802aa30 comp rx=0 tx=0).stop 2024-09-17T03:14:40.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.188+0000 7f4684c9b640 1 -- 172.21.15.78:0/2223733456 shutdown_connections 2024-09-17T03:14:40.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.188+0000 7f4684c9b640 1 --2- 172.21.15.78:0/2223733456 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4680074560 0x7f46800cfe60 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.188+0000 7f4684c9b640 1 --2- 172.21.15.78:0/2223733456 >> v2:172.21.15.193:3300/0 conn(0x7f4680144270 0x7f46800b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.188+0000 7f4684c9b640 1 -- 172.21.15.78:0/2223733456 >> 172.21.15.78:0/2223733456 conn(0x7f46800d15f0 msgr2=0x7f4680073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:40.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.188+0000 7f4684c9b640 1 -- 172.21.15.78:0/2223733456 shutdown_connections 2024-09-17T03:14:40.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.188+0000 7f4684c9b640 1 -- 172.21.15.78:0/2223733456 wait complete. 2024-09-17T03:14:40.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.190+0000 7f4684c9b640 1 Processor -- start 2024-09-17T03:14:40.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.190+0000 7f4684c9b640 1 -- start start 2024-09-17T03:14:40.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.191+0000 7f4684c9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4680142270 0x7f4680159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:40.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.191+0000 7f4684c9b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4680144270 0x7f46801f3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:40.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.191+0000 7f4684c9b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46800c59d0 0x7f4680141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:40.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.191+0000 7f4684c9b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4680142800 con 0x7f4680142270 2024-09-17T03:14:40.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.191+0000 7f4684c9b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4680142680 con 0x7f46800c59d0 2024-09-17T03:14:40.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.191+0000 7f4684c9b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4680142980 con 0x7f4680144270 2024-09-17T03:14:40.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.191+0000 7f467e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4680142270 0x7f4680159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:40.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.191+0000 7f467e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4680142270 0x7f4680159e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58750/0 (socket says 172.21.15.78:58750) 2024-09-17T03:14:40.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.191+0000 7f467e59c640 1 -- 172.21.15.78:0/2544974716 learned_addr learned my addr 172.21.15.78:0/2544974716 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:40.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.192+0000 7f467ed9d640 1 --2- 172.21.15.78:0/2544974716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46800c59d0 0x7f4680141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:40.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.191+0000 7f4675d9b640 1 --2- 172.21.15.78:0/2544974716 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4680144270 0x7f46801f3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:40.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.192+0000 7f467e59c640 1 -- 172.21.15.78:0/2544974716 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4680144270 msgr2=0x7f46801f3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:40.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.192+0000 7f467e59c640 1 --2- 172.21.15.78:0/2544974716 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4680144270 0x7f46801f3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.192+0000 7f467e59c640 1 -- 172.21.15.78:0/2544974716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46800c59d0 msgr2=0x7f4680141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:40.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.192+0000 7f467e59c640 1 --2- 172.21.15.78:0/2544974716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46800c59d0 0x7f4680141020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.192+0000 7f467e59c640 1 -- 172.21.15.78:0/2544974716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46801f3fe0 con 0x7f4680142270 2024-09-17T03:14:40.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.192+0000 7f467ed9d640 1 --2- 172.21.15.78:0/2544974716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46800c59d0 0x7f4680141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:40.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.192+0000 7f4675d9b640 1 --2- 172.21.15.78:0/2544974716 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4680144270 0x7f46801f3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:40.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.192+0000 7f467e59c640 1 --2- 172.21.15.78:0/2544974716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4680142270 0x7f4680159e90 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f467000b440 tx=0x7f467000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:40.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.192+0000 7f46777fe640 1 -- 172.21.15.78:0/2544974716 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4670015020 con 0x7f4680142270 2024-09-17T03:14:40.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.192+0000 7f46777fe640 1 -- 172.21.15.78:0/2544974716 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4670011980 con 0x7f4680142270 2024-09-17T03:14:40.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.192+0000 7f4684c9b640 1 -- 172.21.15.78:0/2544974716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46800ccbf0 con 0x7f4680142270 2024-09-17T03:14:40.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.192+0000 7f46777fe640 1 -- 172.21.15.78:0/2544974716 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4670011dd0 con 0x7f4680142270 2024-09-17T03:14:40.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.192+0000 7f4684c9b640 1 -- 172.21.15.78:0/2544974716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f468013f0a0 con 0x7f4680142270 2024-09-17T03:14:40.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.193+0000 7f4684c9b640 1 -- 172.21.15.78:0/2544974716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46800c5e40 con 0x7f4680142270 2024-09-17T03:14:40.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.194+0000 7f46777fe640 1 -- 172.21.15.78:0/2544974716 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4670018020 con 0x7f4680142270 2024-09-17T03:14:40.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.194+0000 7f46777fe640 1 --2- 172.21.15.78:0/2544974716 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4660078b90 0x7f466007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:40.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.195+0000 7f46777fe640 1 -- 172.21.15.78:0/2544974716 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5709+0+0 (secure 0 0 0) 0x7f467009adb0 con 0x7f4680142270 2024-09-17T03:14:40.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.195+0000 7f4675d9b640 1 --2- 172.21.15.78:0/2544974716 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4660078b90 0x7f466007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:40.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.195+0000 7f4675d9b640 1 --2- 172.21.15.78:0/2544974716 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4660078b90 0x7f466007b0a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4668006fd0 tx=0x7f4668008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:40.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.199+0000 7f46777fe640 1 -- 172.21.15.78:0/2544974716 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f467001f020 con 0x7f4680142270 2024-09-17T03:14:40.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.377+0000 7f4684c9b640 1 -- 172.21.15.78:0/2544974716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46800d06e0 con 0x7f4680142270 2024-09-17T03:14:40.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.378+0000 7f46777fe640 1 -- 172.21.15.78:0/2544974716 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+16657 (secure 0 0 0) 0x7f46801f3fe0 con 0x7f4680142270 2024-09-17T03:14:40.377 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:40.377 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":94,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:14:39.064243+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:14:36.702637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T03:14:38.031363+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:14:40.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.380+0000 7f4684c9b640 1 -- 172.21.15.78:0/2544974716 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4660078b90 msgr2=0x7f466007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:40.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.380+0000 7f4684c9b640 1 --2- 172.21.15.78:0/2544974716 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4660078b90 0x7f466007b0a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4668006fd0 tx=0x7f4668008040 comp rx=0 tx=0).stop 2024-09-17T03:14:40.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.380+0000 7f4684c9b640 1 -- 172.21.15.78:0/2544974716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4680142270 msgr2=0x7f4680159e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:40.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.380+0000 7f4684c9b640 1 --2- 172.21.15.78:0/2544974716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4680142270 0x7f4680159e90 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f467000b440 tx=0x7f467000b900 comp rx=0 tx=0).stop 2024-09-17T03:14:40.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.380+0000 7f4684c9b640 1 -- 172.21.15.78:0/2544974716 shutdown_connections 2024-09-17T03:14:40.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.380+0000 7f4684c9b640 1 --2- 172.21.15.78:0/2544974716 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4660078b90 0x7f466007b0a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.380+0000 7f4684c9b640 1 --2- 172.21.15.78:0/2544974716 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f46800c59d0 0x7f4680141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.380+0000 7f4684c9b640 1 --2- 172.21.15.78:0/2544974716 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4680144270 0x7f46801f3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.380+0000 7f4684c9b640 1 --2- 172.21.15.78:0/2544974716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4680142270 0x7f4680159e90 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.380+0000 7f4684c9b640 1 -- 172.21.15.78:0/2544974716 >> 172.21.15.78:0/2544974716 conn(0x7f46800d15f0 msgr2=0x7f468013e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:40.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.380+0000 7f4684c9b640 1 -- 172.21.15.78:0/2544974716 shutdown_connections 2024-09-17T03:14:40.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.380+0000 7f4684c9b640 1 -- 172.21.15.78:0/2544974716 wait complete. 2024-09-17T03:14:40.391 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T03:14:40.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.507+0000 7f238b67e640 1 -- 172.21.15.78:0/3896015442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2384155ce0 msgr2=0x7f23840b45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.507+0000 7f238b67e640 1 --2- 172.21.15.78:0/3896015442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2384155ce0 0x7f23840b45a0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f237c005fd0 tx=0x7f237c02aa90 comp rx=0 tx=0).stop 2024-09-17T03:14:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.507+0000 7f238b67e640 1 -- 172.21.15.78:0/3896015442 shutdown_connections 2024-09-17T03:14:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.507+0000 7f238b67e640 1 --2- 172.21.15.78:0/3896015442 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2384155ce0 0x7f23840b45a0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.507+0000 7f238b67e640 1 --2- 172.21.15.78:0/3896015442 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2384074420 0x7f238406fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.507+0000 7f238b67e640 1 -- 172.21.15.78:0/3896015442 >> 172.21.15.78:0/3896015442 conn(0x7f238406def0 msgr2=0x7f238406e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.508+0000 7f238b67e640 1 -- 172.21.15.78:0/3896015442 shutdown_connections 2024-09-17T03:14:40.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.508+0000 7f238b67e640 1 -- 172.21.15.78:0/3896015442 wait complete. 2024-09-17T03:14:40.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.509+0000 7f238b67e640 1 Processor -- start 2024-09-17T03:14:40.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.509+0000 7f238b67e640 1 -- start start 2024-09-17T03:14:40.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.511+0000 7f238b67e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2384074420 0x7f238413e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:40.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.511+0000 7f238b67e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2384155ce0 0x7f23841e75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:40.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.511+0000 7f238b67e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23841441b0 0x7f23841e7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:40.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.511+0000 7f238b67e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f23840b50b0 con 0x7f23841441b0 2024-09-17T03:14:40.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.511+0000 7f238b67e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f23840b4f30 con 0x7f2384155ce0 2024-09-17T03:14:40.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.511+0000 7f238b67e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f23840b5230 con 0x7f2384074420 2024-09-17T03:14:40.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.511+0000 7f2389c1b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23841441b0 0x7f23841e7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:40.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.511+0000 7f2389c1b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23841441b0 0x7f23841e7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58760/0 (socket says 172.21.15.78:58760) 2024-09-17T03:14:40.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.511+0000 7f2389c1b640 1 -- 172.21.15.78:0/514428931 learned_addr learned my addr 172.21.15.78:0/514428931 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:40.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.511+0000 7f238941a640 1 --2- 172.21.15.78:0/514428931 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2384074420 0x7f238413e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:40.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.511+0000 7f2388c19640 1 --2- 172.21.15.78:0/514428931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2384155ce0 0x7f23841e75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:40.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.511+0000 7f2389c1b640 1 -- 172.21.15.78:0/514428931 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2384074420 msgr2=0x7f238413e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:40.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.511+0000 7f2389c1b640 1 --2- 172.21.15.78:0/514428931 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2384074420 0x7f238413e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.511+0000 7f2389c1b640 1 -- 172.21.15.78:0/514428931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2384155ce0 msgr2=0x7f23841e75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:40.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.511+0000 7f2389c1b640 1 --2- 172.21.15.78:0/514428931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2384155ce0 0x7f23841e75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:40.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.511+0000 7f2389c1b640 1 -- 172.21.15.78:0/514428931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23841e6570 con 0x7f23841441b0 2024-09-17T03:14:40.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.511+0000 7f2389c1b640 1 --2- 172.21.15.78:0/514428931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23841441b0 0x7f23841e7b30 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f237c006010 tx=0x7f237c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:40.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.511+0000 7f2379ffb640 1 -- 172.21.15.78:0/514428931 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c044070 con 0x7f23841441b0 2024-09-17T03:14:40.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.512+0000 7f2379ffb640 1 -- 172.21.15.78:0/514428931 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f237c02e7f0 con 0x7f23841441b0 2024-09-17T03:14:40.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.512+0000 7f238b67e640 1 -- 172.21.15.78:0/514428931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23841e6830 con 0x7f23841441b0 2024-09-17T03:14:40.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.512+0000 7f2379ffb640 1 -- 172.21.15.78:0/514428931 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f237c0044b0 con 0x7f23841441b0 2024-09-17T03:14:40.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.512+0000 7f238b67e640 1 -- 172.21.15.78:0/514428931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23841e6df0 con 0x7f23841441b0 2024-09-17T03:14:40.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.513+0000 7f238b67e640 1 -- 172.21.15.78:0/514428931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2384141020 con 0x7f23841441b0 2024-09-17T03:14:40.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.514+0000 7f2379ffb640 1 -- 172.21.15.78:0/514428931 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f237c047070 con 0x7f23841441b0 2024-09-17T03:14:40.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.514+0000 7f2379ffb640 1 --2- 172.21.15.78:0/514428931 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2368078b90 0x7f236807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:40.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.514+0000 7f2379ffb640 1 -- 172.21.15.78:0/514428931 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5709+0+0 (secure 0 0 0) 0x7f237c0bbbc0 con 0x7f23841441b0 2024-09-17T03:14:40.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.514+0000 7f238941a640 1 --2- 172.21.15.78:0/514428931 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2368078b90 0x7f236807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:40.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.515+0000 7f238941a640 1 --2- 172.21.15.78:0/514428931 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2368078b90 0x7f236807b0a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2380004630 tx=0x7f238000b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:40.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.519+0000 7f2379ffb640 1 -- 172.21.15.78:0/514428931 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f237c032030 con 0x7f23841441b0 2024-09-17T03:14:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:40.730+0000 7f238b67e640 1 -- 172.21.15.78:0/514428931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2384075180 con 0x7f23841441b0 2024-09-17T03:14:41.683 INFO:tasks.ceph.mds.c.smithi078.stderr:2024-09-17T03:14:41.684+0000 7f4bfa177640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T03:14:41.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.734+0000 7f2379ffb640 1 -- 172.21.15.78:0/514428931 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v93) ==== 118+0+0 (secure 0 0 0) 0x7f2384075180 con 0x7f23841441b0 2024-09-17T03:14:41.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.737+0000 7f238b67e640 1 -- 172.21.15.78:0/514428931 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2368078b90 msgr2=0x7f236807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:41.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.737+0000 7f238b67e640 1 --2- 172.21.15.78:0/514428931 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2368078b90 0x7f236807b0a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2380004630 tx=0x7f238000b2e0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.737+0000 7f238b67e640 1 -- 172.21.15.78:0/514428931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23841441b0 msgr2=0x7f23841e7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:41.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.737+0000 7f238b67e640 1 --2- 172.21.15.78:0/514428931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23841441b0 0x7f23841e7b30 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f237c006010 tx=0x7f237c003f10 comp rx=0 tx=0).stop 2024-09-17T03:14:41.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.737+0000 7f238b67e640 1 -- 172.21.15.78:0/514428931 shutdown_connections 2024-09-17T03:14:41.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.737+0000 7f238b67e640 1 --2- 172.21.15.78:0/514428931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23841441b0 0x7f23841e7b30 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.737+0000 7f238b67e640 1 --2- 172.21.15.78:0/514428931 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2368078b90 0x7f236807b0a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.737+0000 7f238b67e640 1 --2- 172.21.15.78:0/514428931 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2384155ce0 0x7f23841e75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.737+0000 7f238b67e640 1 --2- 172.21.15.78:0/514428931 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2384074420 0x7f238413e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.737+0000 7f238b67e640 1 -- 172.21.15.78:0/514428931 >> 172.21.15.78:0/514428931 conn(0x7f238406def0 msgr2=0x7f2384151820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:41.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.737+0000 7f238b67e640 1 -- 172.21.15.78:0/514428931 shutdown_connections 2024-09-17T03:14:41.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.737+0000 7f238b67e640 1 -- 172.21.15.78:0/514428931 wait complete. 2024-09-17T03:14:41.750 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T03:14:41.750 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T03:14:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.875+0000 7fa3b8f62640 1 -- 172.21.15.78:0/492969515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3a0003a30 msgr2=0x7fa3a0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.875+0000 7fa3b8f62640 1 --2- 172.21.15.78:0/492969515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3a0003a30 0x7fa3a0003ea0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40016c0 tx=0x7fa3a0005830 comp rx=0 tx=0).stop 2024-09-17T03:14:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.875+0000 7fa3b2d9d640 1 -- 172.21.15.78:0/492969515 reap_dead start 2024-09-17T03:14:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.875+0000 7fa3b8f62640 1 -- 172.21.15.78:0/492969515 shutdown_connections 2024-09-17T03:14:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.875+0000 7fa3b8f62640 1 -- 172.21.15.78:0/492969515 >> 172.21.15.78:0/492969515 conn(0x7fa3b4072ae0 msgr2=0x7fa3b4072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.875+0000 7fa3b8f62640 1 -- 172.21.15.78:0/492969515 shutdown_connections 2024-09-17T03:14:41.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.875+0000 7fa3b8f62640 1 -- 172.21.15.78:0/492969515 wait complete. 2024-09-17T03:14:41.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.877+0000 7fa3b8f62640 1 Processor -- start 2024-09-17T03:14:41.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.877+0000 7fa3b8f62640 1 -- start start 2024-09-17T03:14:41.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.878+0000 7fa3b8f62640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa3a0003a30 0x7fa3b4144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:41.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.878+0000 7fa3b8f62640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3b4157300 0x7fa3b4144f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:41.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.878+0000 7fa3b8f62640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3b4145490 0x7fa3b4159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:41.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.878+0000 7fa3b8f62640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b40d1a60 con 0x7fa3b4145490 2024-09-17T03:14:41.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.878+0000 7fa3b8f62640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b40d18e0 con 0x7fa3b4157300 2024-09-17T03:14:41.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.878+0000 7fa3b8f62640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b40cf300 con 0x7fa3a0003a30 2024-09-17T03:14:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.878+0000 7fa3b2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3b4145490 0x7fa3b4159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.878+0000 7fa3b2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3b4145490 0x7fa3b4159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58780/0 (socket says 172.21.15.78:58780) 2024-09-17T03:14:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.878+0000 7fa3b2d9d640 1 -- 172.21.15.78:0/2612130804 learned_addr learned my addr 172.21.15.78:0/2612130804 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.879+0000 7fa3b259c640 1 --2- 172.21.15.78:0/2612130804 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa3a0003a30 0x7fa3b4144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.879+0000 7fa3abfff640 1 --2- 172.21.15.78:0/2612130804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3b4157300 0x7fa3b4144f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.879+0000 7fa3b2d9d640 1 -- 172.21.15.78:0/2612130804 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa3a0003a30 msgr2=0x7fa3b4144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.879+0000 7fa3b2d9d640 1 --2- 172.21.15.78:0/2612130804 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa3a0003a30 0x7fa3b4144a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.879+0000 7fa3b2d9d640 1 -- 172.21.15.78:0/2612130804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3b4157300 msgr2=0x7fa3b4144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.879+0000 7fa3b2d9d640 1 --2- 172.21.15.78:0/2612130804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3b4157300 0x7fa3b4144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.879+0000 7fa3b2d9d640 1 -- 172.21.15.78:0/2612130804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b41458a0 con 0x7fa3b4145490 2024-09-17T03:14:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.879+0000 7fa3b259c640 1 --2- 172.21.15.78:0/2612130804 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa3a0003a30 0x7fa3b4144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.879+0000 7fa3abfff640 1 --2- 172.21.15.78:0/2612130804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3b4157300 0x7fa3b4144f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.879+0000 7fa3b2d9d640 1 --2- 172.21.15.78:0/2612130804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3b4145490 0x7fa3b4159890 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40ce450 tx=0x7fa3ac00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:41.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.879+0000 7fa3aaffd640 1 -- 172.21.15.78:0/2612130804 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac001ab0 con 0x7fa3b4145490 2024-09-17T03:14:41.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.879+0000 7fa3aaffd640 1 -- 172.21.15.78:0/2612130804 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3ac017070 con 0x7fa3b4145490 2024-09-17T03:14:41.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.879+0000 7fa3b8f62640 1 -- 172.21.15.78:0/2612130804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b415ab80 con 0x7fa3b4145490 2024-09-17T03:14:41.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.879+0000 7fa3aaffd640 1 -- 172.21.15.78:0/2612130804 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac011460 con 0x7fa3b4145490 2024-09-17T03:14:41.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.879+0000 7fa3b8f62640 1 -- 172.21.15.78:0/2612130804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b415b140 con 0x7fa3b4145490 2024-09-17T03:14:41.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.880+0000 7fa3b8f62640 1 -- 172.21.15.78:0/2612130804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b40cf890 con 0x7fa3b4145490 2024-09-17T03:14:41.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.881+0000 7fa3aaffd640 1 -- 172.21.15.78:0/2612130804 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa3ac011600 con 0x7fa3b4145490 2024-09-17T03:14:41.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.881+0000 7fa3aaffd640 1 --2- 172.21.15.78:0/2612130804 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa394078b90 0x7fa39407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:41.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.881+0000 7fa3aaffd640 1 -- 172.21.15.78:0/2612130804 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fa3ac09b270 con 0x7fa3b4145490 2024-09-17T03:14:41.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.881+0000 7fa3b259c640 1 --2- 172.21.15.78:0/2612130804 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa394078b90 0x7fa39407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:41.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.882+0000 7fa3b259c640 1 --2- 172.21.15.78:0/2612130804 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa394078b90 0x7fa39407b0a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4032000 tx=0x7fa3a4001190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:41.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:41.886+0000 7fa3aaffd640 1 -- 172.21.15.78:0/2612130804 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa3ac063740 con 0x7fa3b4145490 2024-09-17T03:14:42.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.095+0000 7fa3b8f62640 1 -- 172.21.15.78:0/2612130804 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa3b4070100 con 0x7fa3b4145490 2024-09-17T03:14:42.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.742+0000 7fa3aaffd640 1 -- 172.21.15.78:0/2612130804 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v94) ==== 122+0+0 (secure 0 0 0) 0x7fa3ac063040 con 0x7fa3b4145490 2024-09-17T03:14:42.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.745+0000 7fa3b8f62640 1 -- 172.21.15.78:0/2612130804 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa394078b90 msgr2=0x7fa39407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:42.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.745+0000 7fa3b8f62640 1 --2- 172.21.15.78:0/2612130804 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa394078b90 0x7fa39407b0a0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4032000 tx=0x7fa3a4001190 comp rx=0 tx=0).stop 2024-09-17T03:14:42.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.745+0000 7fa3b8f62640 1 -- 172.21.15.78:0/2612130804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3b4145490 msgr2=0x7fa3b4159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:42.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.745+0000 7fa3b8f62640 1 --2- 172.21.15.78:0/2612130804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3b4145490 0x7fa3b4159890 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40ce450 tx=0x7fa3ac00ed90 comp rx=0 tx=0).stop 2024-09-17T03:14:42.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.745+0000 7fa3b8f62640 1 -- 172.21.15.78:0/2612130804 shutdown_connections 2024-09-17T03:14:42.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.745+0000 7fa3b8f62640 1 --2- 172.21.15.78:0/2612130804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3b4145490 0x7fa3b4159890 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.745+0000 7fa3b8f62640 1 --2- 172.21.15.78:0/2612130804 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa394078b90 0x7fa39407b0a0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.745+0000 7fa3b8f62640 1 --2- 172.21.15.78:0/2612130804 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa3b4157300 0x7fa3b4144f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.745+0000 7fa3b8f62640 1 --2- 172.21.15.78:0/2612130804 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa3a0003a30 0x7fa3b4144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.745+0000 7fa3b8f62640 1 -- 172.21.15.78:0/2612130804 >> 172.21.15.78:0/2612130804 conn(0x7fa3b4072ae0 msgr2=0x7fa3b40b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:42.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.745+0000 7fa3b8f62640 1 -- 172.21.15.78:0/2612130804 shutdown_connections 2024-09-17T03:14:42.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.745+0000 7fa3b8f62640 1 -- 172.21.15.78:0/2612130804 wait complete. 2024-09-17T03:14:42.758 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T03:14:42.759 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:42.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.879+0000 7f787c270640 1 -- 172.21.15.78:0/21419026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78740b3540 msgr2=0x7f78740d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:42.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.879+0000 7f787c270640 1 --2- 172.21.15.78:0/21419026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78740b3540 0x7f78740d3330 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f7864009860 tx=0x7f786402a4b0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.879+0000 7f787c270640 1 -- 172.21.15.78:0/21419026 shutdown_connections 2024-09-17T03:14:42.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.879+0000 7f787c270640 1 --2- 172.21.15.78:0/21419026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78740b3540 0x7f78740d3330 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.879+0000 7f787c270640 1 --2- 172.21.15.78:0/21419026 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78740d3870 0x7f78740ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.879+0000 7f787c270640 1 -- 172.21.15.78:0/21419026 >> 172.21.15.78:0/21419026 conn(0x7f787408bfc0 msgr2=0x7f787409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:42.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.880+0000 7f787c270640 1 -- 172.21.15.78:0/21419026 shutdown_connections 2024-09-17T03:14:42.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.880+0000 7f787c270640 1 -- 172.21.15.78:0/21419026 wait complete. 2024-09-17T03:14:42.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.881+0000 7f787c270640 1 Processor -- start 2024-09-17T03:14:42.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.881+0000 7f787c270640 1 -- start start 2024-09-17T03:14:42.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f787c270640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78740b3540 0x7f78741483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:42.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f787c270640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78740d3870 0x7f78740b6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:42.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f787c270640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78740cb7a0 0x7f78740cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:42.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f787c270640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f78740d0e60 con 0x7f78740d3870 2024-09-17T03:14:42.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f787c270640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f78740d0ce0 con 0x7f78740b3540 2024-09-17T03:14:42.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f787c270640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f78740d0fe0 con 0x7f78740cb7a0 2024-09-17T03:14:42.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f787980b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78740d3870 0x7f78740b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:42.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f787980b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78740d3870 0x7f78740b6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58792/0 (socket says 172.21.15.78:58792) 2024-09-17T03:14:42.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f787980b640 1 -- 172.21.15.78:0/470222914 learned_addr learned my addr 172.21.15.78:0/470222914 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:42.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f787a80d640 1 --2- 172.21.15.78:0/470222914 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78740cb7a0 0x7f78740cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:42.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f787a00c640 1 --2- 172.21.15.78:0/470222914 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78740b3540 0x7f78741483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:42.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f787980b640 1 -- 172.21.15.78:0/470222914 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78740cb7a0 msgr2=0x7f78740cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:42.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f787980b640 1 --2- 172.21.15.78:0/470222914 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78740cb7a0 0x7f78740cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f787980b640 1 -- 172.21.15.78:0/470222914 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78740b3540 msgr2=0x7f78741483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:42.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f787980b640 1 --2- 172.21.15.78:0/470222914 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78740b3540 0x7f78741483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:42.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f787980b640 1 -- 172.21.15.78:0/470222914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787414b390 con 0x7f78740d3870 2024-09-17T03:14:42.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f787a00c640 1 --2- 172.21.15.78:0/470222914 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78740b3540 0x7f78741483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:42.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f787980b640 1 --2- 172.21.15.78:0/470222914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78740d3870 0x7f78740b6010 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f7864009980 tx=0x7f7864033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:42.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f786affd640 1 -- 172.21.15.78:0/470222914 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7864031d60 con 0x7f78740d3870 2024-09-17T03:14:42.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f786affd640 1 -- 172.21.15.78:0/470222914 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7864033e10 con 0x7f78740d3870 2024-09-17T03:14:42.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f787c270640 1 -- 172.21.15.78:0/470222914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787414a810 con 0x7f78740d3870 2024-09-17T03:14:42.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f786affd640 1 -- 172.21.15.78:0/470222914 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7864005260 con 0x7f78740d3870 2024-09-17T03:14:42.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.883+0000 7f787c270640 1 -- 172.21.15.78:0/470222914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f787414add0 con 0x7f78740d3870 2024-09-17T03:14:42.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.885+0000 7f787c270640 1 -- 172.21.15.78:0/470222914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f787414a580 con 0x7f78740d3870 2024-09-17T03:14:42.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.885+0000 7f786affd640 1 -- 172.21.15.78:0/470222914 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7864005400 con 0x7f78740d3870 2024-09-17T03:14:42.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.886+0000 7f786affd640 1 --2- 172.21.15.78:0/470222914 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7858078b90 0x7f785807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:42.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.886+0000 7f786affd640 1 -- 172.21.15.78:0/470222914 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f78640bbef0 con 0x7f78740d3870 2024-09-17T03:14:42.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.886+0000 7f787a00c640 1 --2- 172.21.15.78:0/470222914 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7858078b90 0x7f785807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:42.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.887+0000 7f787a00c640 1 --2- 172.21.15.78:0/470222914 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7858078b90 0x7f785807b0a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f78700046b0 tx=0x7f7870009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:42.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:42.891+0000 7f786affd640 1 -- 172.21.15.78:0/470222914 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f786403f030 con 0x7f78740d3870 2024-09-17T03:14:43.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.100+0000 7f787c270640 1 -- 172.21.15.78:0/470222914 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78740d1500 con 0x7f78740d3870 2024-09-17T03:14:43.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.100+0000 7f786affd640 1 -- 172.21.15.78:0/470222914 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5231 (secure 0 0 0) 0x7f7864083d70 con 0x7f78740d3870 2024-09-17T03:14:43.099 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:43.099 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":94,"btime":"2024-09-17T03:14:42:735208+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7213,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8283,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:14:42.096594+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8286},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[8286]},"id":7}]} 2024-09-17T03:14:43.099 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 94 2024-09-17T03:14:43.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.102+0000 7f787c270640 1 -- 172.21.15.78:0/470222914 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7858078b90 msgr2=0x7f785807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.102+0000 7f787c270640 1 --2- 172.21.15.78:0/470222914 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7858078b90 0x7f785807b0a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f78700046b0 tx=0x7f7870009040 comp rx=0 tx=0).stop 2024-09-17T03:14:43.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.102+0000 7f787c270640 1 -- 172.21.15.78:0/470222914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78740d3870 msgr2=0x7f78740b6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.102+0000 7f787c270640 1 --2- 172.21.15.78:0/470222914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78740d3870 0x7f78740b6010 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f7864009980 tx=0x7f7864033c20 comp rx=0 tx=0).stop 2024-09-17T03:14:43.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.102+0000 7f787c270640 1 -- 172.21.15.78:0/470222914 shutdown_connections 2024-09-17T03:14:43.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.102+0000 7f787c270640 1 --2- 172.21.15.78:0/470222914 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78740cb7a0 0x7f78740cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.102+0000 7f787c270640 1 --2- 172.21.15.78:0/470222914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78740d3870 0x7f78740b6010 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.102+0000 7f787c270640 1 --2- 172.21.15.78:0/470222914 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7858078b90 0x7f785807b0a0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.102+0000 7f787c270640 1 --2- 172.21.15.78:0/470222914 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f78740b3540 0x7f78741483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.102+0000 7f787c270640 1 -- 172.21.15.78:0/470222914 >> 172.21.15.78:0/470222914 conn(0x7f787408bfc0 msgr2=0x7f787406f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:43.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.102+0000 7f787c270640 1 -- 172.21.15.78:0/470222914 shutdown_connections 2024-09-17T03:14:43.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.102+0000 7f787c270640 1 -- 172.21.15.78:0/470222914 wait complete. 2024-09-17T03:14:43.113 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:14:43.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.226+0000 7f20fda4d640 1 -- 172.21.15.78:0/624670536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f815f7d0 msgr2=0x7f20f8071d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.226+0000 7f20fda4d640 1 --2- 172.21.15.78:0/624670536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f815f7d0 0x7f20f8071d10 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f20f8160170 tx=0x7f20f002a800 comp rx=0 tx=0).stop 2024-09-17T03:14:43.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.227+0000 7f20fda4d640 1 -- 172.21.15.78:0/624670536 shutdown_connections 2024-09-17T03:14:43.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.227+0000 7f20fda4d640 1 --2- 172.21.15.78:0/624670536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f815f7d0 0x7f20f8071d10 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.227+0000 7f20fda4d640 1 -- 172.21.15.78:0/624670536 >> 172.21.15.78:0/624670536 conn(0x7f20f80b2fe0 msgr2=0x7f20f8073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:43.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.227+0000 7f20fda4d640 1 -- 172.21.15.78:0/624670536 shutdown_connections 2024-09-17T03:14:43.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.227+0000 7f20fda4d640 1 -- 172.21.15.78:0/624670536 wait complete. 2024-09-17T03:14:43.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.228+0000 7f20fda4d640 1 Processor -- start 2024-09-17T03:14:43.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.228+0000 7f20fda4d640 1 -- start start 2024-09-17T03:14:43.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.230+0000 7f20fda4d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f20f815c750 0x7f20f813e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:43.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.230+0000 7f20fda4d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20f815f7d0 0x7f20f814c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:43.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.230+0000 7f20fda4d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f8149850 0x7f20f814c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:43.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.230+0000 7f20fda4d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f20f8070150 con 0x7f20f8149850 2024-09-17T03:14:43.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.230+0000 7f20fda4d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f20f806ffd0 con 0x7f20f815f7d0 2024-09-17T03:14:43.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.230+0000 7f20fda4d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f20f80702d0 con 0x7f20f815c750 2024-09-17T03:14:43.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.230+0000 7f20f77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f8149850 0x7f20f814c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:43.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.230+0000 7f20f77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f8149850 0x7f20f814c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58804/0 (socket says 172.21.15.78:58804) 2024-09-17T03:14:43.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.230+0000 7f20f77fe640 1 -- 172.21.15.78:0/3955659501 learned_addr learned my addr 172.21.15.78:0/3955659501 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:43.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.230+0000 7f20f6ffd640 1 --2- 172.21.15.78:0/3955659501 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f20f815c750 0x7f20f813e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:43.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.230+0000 7f20effff640 1 --2- 172.21.15.78:0/3955659501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20f815f7d0 0x7f20f814c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:43.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.230+0000 7f20f77fe640 1 -- 172.21.15.78:0/3955659501 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f20f815c750 msgr2=0x7f20f813e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.230+0000 7f20f77fe640 1 --2- 172.21.15.78:0/3955659501 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f20f815c750 0x7f20f813e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.230+0000 7f20f77fe640 1 -- 172.21.15.78:0/3955659501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20f815f7d0 msgr2=0x7f20f814c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.230+0000 7f20f77fe640 1 --2- 172.21.15.78:0/3955659501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20f815f7d0 0x7f20f814c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.230+0000 7f20f77fe640 1 -- 172.21.15.78:0/3955659501 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f8153af0 con 0x7f20f8149850 2024-09-17T03:14:43.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.230+0000 7f20effff640 1 --2- 172.21.15.78:0/3955659501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20f815f7d0 0x7f20f814c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:43.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.231+0000 7f20f77fe640 1 --2- 172.21.15.78:0/3955659501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f8149850 0x7f20f814c640 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009ca0 tx=0x7f20f0033b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:43.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.231+0000 7f20f4ff9640 1 -- 172.21.15.78:0/3955659501 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f0047070 con 0x7f20f8149850 2024-09-17T03:14:43.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.231+0000 7f20f4ff9640 1 -- 172.21.15.78:0/3955659501 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f20f0003e20 con 0x7f20f8149850 2024-09-17T03:14:43.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.231+0000 7f20fda4d640 1 -- 172.21.15.78:0/3955659501 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f8153dd0 con 0x7f20f8149850 2024-09-17T03:14:43.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.231+0000 7f20f4ff9640 1 -- 172.21.15.78:0/3955659501 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f00042a0 con 0x7f20f8149850 2024-09-17T03:14:43.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.231+0000 7f20fda4d640 1 -- 172.21.15.78:0/3955659501 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f8154390 con 0x7f20f8149850 2024-09-17T03:14:43.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.232+0000 7f20fda4d640 1 -- 172.21.15.78:0/3955659501 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f8071d10 con 0x7f20f8149850 2024-09-17T03:14:43.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.233+0000 7f20f4ff9640 1 -- 172.21.15.78:0/3955659501 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f20f004a070 con 0x7f20f8149850 2024-09-17T03:14:43.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.233+0000 7f20f4ff9640 1 --2- 172.21.15.78:0/3955659501 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f20d8078bc0 0x7f20d807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:43.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.233+0000 7f20f4ff9640 1 -- 172.21.15.78:0/3955659501 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f20f00bcfd0 con 0x7f20f8149850 2024-09-17T03:14:43.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.233+0000 7f20f6ffd640 1 --2- 172.21.15.78:0/3955659501 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f20d8078bc0 0x7f20d807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:43.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.234+0000 7f20f6ffd640 1 --2- 172.21.15.78:0/3955659501 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f20d8078bc0 0x7f20d807b0d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f20e8000f60 tx=0x7f20e8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:43.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.238+0000 7f20f4ff9640 1 -- 172.21.15.78:0/3955659501 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f20f002f070 con 0x7f20f8149850 2024-09-17T03:14:43.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.412+0000 7f20fda4d640 1 -- 172.21.15.78:0/3955659501 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20f80742c0 con 0x7f20f8149850 2024-09-17T03:14:43.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.413+0000 7f20f4ff9640 1 -- 172.21.15.78:0/3955659501 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+16644 (secure 0 0 0) 0x7f20f0084dd0 con 0x7f20f8149850 2024-09-17T03:14:43.412 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:43.412 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":95,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:14:40.724293+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:14:36.702637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T03:14:38.031363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:14:43.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.415+0000 7f20fda4d640 1 -- 172.21.15.78:0/3955659501 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f20d8078bc0 msgr2=0x7f20d807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.415+0000 7f20fda4d640 1 --2- 172.21.15.78:0/3955659501 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f20d8078bc0 0x7f20d807b0d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f20e8000f60 tx=0x7f20e8009040 comp rx=0 tx=0).stop 2024-09-17T03:14:43.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.415+0000 7f20fda4d640 1 -- 172.21.15.78:0/3955659501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f8149850 msgr2=0x7f20f814c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.415+0000 7f20fda4d640 1 --2- 172.21.15.78:0/3955659501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f8149850 0x7f20f814c640 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f20f0009ca0 tx=0x7f20f0033b10 comp rx=0 tx=0).stop 2024-09-17T03:14:43.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.415+0000 7f20fda4d640 1 -- 172.21.15.78:0/3955659501 shutdown_connections 2024-09-17T03:14:43.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.415+0000 7f20fda4d640 1 --2- 172.21.15.78:0/3955659501 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20f8149850 0x7f20f814c640 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.415+0000 7f20fda4d640 1 --2- 172.21.15.78:0/3955659501 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f20d8078bc0 0x7f20d807b0d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.415+0000 7f20fda4d640 1 --2- 172.21.15.78:0/3955659501 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f20f815f7d0 0x7f20f814c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.415+0000 7f20fda4d640 1 --2- 172.21.15.78:0/3955659501 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f20f815c750 0x7f20f813e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.415+0000 7f20fda4d640 1 -- 172.21.15.78:0/3955659501 >> 172.21.15.78:0/3955659501 conn(0x7f20f80b2fe0 msgr2=0x7f20f8155a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:43.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.415+0000 7f20fda4d640 1 -- 172.21.15.78:0/3955659501 shutdown_connections 2024-09-17T03:14:43.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.415+0000 7f20fda4d640 1 -- 172.21.15.78:0/3955659501 wait complete. 2024-09-17T03:14:43.426 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:14:43.427 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:14:43.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.539+0000 7f147b5ad640 1 -- 172.21.15.78:0/1792989939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1474153970 msgr2=0x7f147415d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.539+0000 7f147b5ad640 1 --2- 172.21.15.78:0/1792989939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1474153970 0x7f147415d810 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f14740b6100 tx=0x7f147002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.539+0000 7f147b5ad640 1 -- 172.21.15.78:0/1792989939 shutdown_connections 2024-09-17T03:14:43.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.539+0000 7f147b5ad640 1 --2- 172.21.15.78:0/1792989939 >> v2:172.21.15.193:3300/0 conn(0x7f1474073e50 0x7f1474074260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.539+0000 7f147b5ad640 1 --2- 172.21.15.78:0/1792989939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1474153970 0x7f147415d810 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.539+0000 7f147b5ad640 1 -- 172.21.15.78:0/1792989939 >> 172.21.15.78:0/1792989939 conn(0x7f14740d15f0 msgr2=0x7f1474073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:43.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.539+0000 7f147b5ad640 1 -- 172.21.15.78:0/1792989939 shutdown_connections 2024-09-17T03:14:43.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.539+0000 7f147b5ad640 1 -- 172.21.15.78:0/1792989939 wait complete. 2024-09-17T03:14:43.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.541+0000 7f147b5ad640 1 Processor -- start 2024-09-17T03:14:43.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.541+0000 7f147b5ad640 1 -- start start 2024-09-17T03:14:43.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.542+0000 7f147b5ad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1474073e50 0x7f1474153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:43.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.542+0000 7f147b5ad640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14740cfc00 0x7f14741f09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:43.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.542+0000 7f147b5ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1474153970 0x7f14741561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:43.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.542+0000 7f147b5ad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f147415e2e0 con 0x7f1474153970 2024-09-17T03:14:43.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.542+0000 7f147b5ad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f147415e160 con 0x7f1474073e50 2024-09-17T03:14:43.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.542+0000 7f147b5ad640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f147415e460 con 0x7f14740cfc00 2024-09-17T03:14:43.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.542+0000 7f1479b4a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1474153970 0x7f14741561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:43.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.542+0000 7f1479b4a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1474153970 0x7f14741561a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58834/0 (socket says 172.21.15.78:58834) 2024-09-17T03:14:43.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.542+0000 7f1479b4a640 1 -- 172.21.15.78:0/2536546346 learned_addr learned my addr 172.21.15.78:0/2536546346 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:43.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.543+0000 7f1479349640 1 --2- 172.21.15.78:0/2536546346 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1474073e50 0x7f1474153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:43.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.543+0000 7f1478b48640 1 --2- 172.21.15.78:0/2536546346 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14740cfc00 0x7f14741f09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:43.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.543+0000 7f1479b4a640 1 -- 172.21.15.78:0/2536546346 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14740cfc00 msgr2=0x7f14741f09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.543+0000 7f1479b4a640 1 --2- 172.21.15.78:0/2536546346 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14740cfc00 0x7f14741f09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.543+0000 7f1479b4a640 1 -- 172.21.15.78:0/2536546346 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1474073e50 msgr2=0x7f1474153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.543+0000 7f1479b4a640 1 --2- 172.21.15.78:0/2536546346 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1474073e50 0x7f1474153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.543+0000 7f1479b4a640 1 -- 172.21.15.78:0/2536546346 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14741f0f00 con 0x7f1474153970 2024-09-17T03:14:43.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.543+0000 7f1478b48640 1 --2- 172.21.15.78:0/2536546346 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14740cfc00 0x7f14741f09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:43.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.543+0000 7f1479b4a640 1 --2- 172.21.15.78:0/2536546346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1474153970 0x7f14741561a0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f146c00e990 tx=0x7f146c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:43.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.543+0000 7f1469ffb640 1 -- 172.21.15.78:0/2536546346 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c004d20 con 0x7f1474153970 2024-09-17T03:14:43.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.543+0000 7f1469ffb640 1 -- 172.21.15.78:0/2536546346 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f146c00cb00 con 0x7f1474153970 2024-09-17T03:14:43.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.543+0000 7f147b5ad640 1 -- 172.21.15.78:0/2536546346 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14741f4080 con 0x7f1474153970 2024-09-17T03:14:43.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.543+0000 7f1469ffb640 1 -- 172.21.15.78:0/2536546346 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146c005020 con 0x7f1474153970 2024-09-17T03:14:43.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.543+0000 7f147b5ad640 1 -- 172.21.15.78:0/2536546346 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1474150ff0 con 0x7f1474153970 2024-09-17T03:14:43.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.544+0000 7f147b5ad640 1 -- 172.21.15.78:0/2536546346 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f147415e9c0 con 0x7f1474153970 2024-09-17T03:14:43.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.545+0000 7f1469ffb640 1 -- 172.21.15.78:0/2536546346 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f146c0051c0 con 0x7f1474153970 2024-09-17T03:14:43.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.545+0000 7f1469ffb640 1 --2- 172.21.15.78:0/2536546346 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1458078bc0 0x7f145807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:43.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.546+0000 7f1469ffb640 1 -- 172.21.15.78:0/2536546346 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f146c09b5e0 con 0x7f1474153970 2024-09-17T03:14:43.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.546+0000 7f1479349640 1 --2- 172.21.15.78:0/2536546346 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1458078bc0 0x7f145807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:43.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.546+0000 7f1479349640 1 --2- 172.21.15.78:0/2536546346 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1458078bc0 0x7f145807b0d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1470033000 tx=0x7f1470004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:43.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.550+0000 7f1469ffb640 1 -- 172.21.15.78:0/2536546346 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f146c016030 con 0x7f1474153970 2024-09-17T03:14:43.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.720+0000 7f147b5ad640 1 -- 172.21.15.78:0/2536546346 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1474161200 con 0x7f1458078bc0 2024-09-17T03:14:43.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.724+0000 7f1469ffb640 1 -- 172.21.15.78:0/2536546346 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252072 (secure 0 0 0) 0x7f1474161200 con 0x7f1458078bc0 2024-09-17T03:14:43.726 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:43.728 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:14:43.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.728+0000 7f147b5ad640 1 -- 172.21.15.78:0/2536546346 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1458078bc0 msgr2=0x7f145807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.728+0000 7f147b5ad640 1 --2- 172.21.15.78:0/2536546346 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1458078bc0 0x7f145807b0d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1470033000 tx=0x7f1470004730 comp rx=0 tx=0).stop 2024-09-17T03:14:43.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.728+0000 7f147b5ad640 1 -- 172.21.15.78:0/2536546346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1474153970 msgr2=0x7f14741561a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.728+0000 7f147b5ad640 1 --2- 172.21.15.78:0/2536546346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1474153970 0x7f14741561a0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f146c00e990 tx=0x7f146c00ee50 comp rx=0 tx=0).stop 2024-09-17T03:14:43.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.728+0000 7f147b5ad640 1 -- 172.21.15.78:0/2536546346 shutdown_connections 2024-09-17T03:14:43.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.728+0000 7f147b5ad640 1 --2- 172.21.15.78:0/2536546346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1474153970 0x7f14741561a0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.728+0000 7f147b5ad640 1 --2- 172.21.15.78:0/2536546346 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14740cfc00 0x7f14741f09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.728+0000 7f147b5ad640 1 --2- 172.21.15.78:0/2536546346 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1458078bc0 0x7f145807b0d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.728+0000 7f147b5ad640 1 --2- 172.21.15.78:0/2536546346 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1474073e50 0x7f1474153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.728+0000 7f147b5ad640 1 -- 172.21.15.78:0/2536546346 >> 172.21.15.78:0/2536546346 conn(0x7f14740d15f0 msgr2=0x7f14740ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:43.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.728+0000 7f147b5ad640 1 -- 172.21.15.78:0/2536546346 shutdown_connections 2024-09-17T03:14:43.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.728+0000 7f147b5ad640 1 -- 172.21.15.78:0/2536546346 wait complete. 2024-09-17T03:14:43.738 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-09-17T03:14:43.222089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255652,"kb_used_data":10296,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754719068,"statfs":{"total":773094113280,"available":772832325632,"internally_reserved":0,"allocated":10543104,"data_stored":5182284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.526083"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.742964+0000","last_change":"2024-09-17T03:14:39.735674+0000","last_active":"2024-09-17T03:14:39.742964+0000","last_peered":"2024-09-17T03:14:39.742964+0000","last_clean":"2024-09-17T03:14:39.742964+0000","last_became_active":"2024-09-17T03:14:39.735316+0000","last_became_peered":"2024-09-17T03:14:39.735316+0000","last_unstale":"2024-09-17T03:14:39.742964+0000","last_undegraded":"2024-09-17T03:14:39.742964+0000","last_fullsized":"2024-09-17T03:14:39.742964+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.477071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.735051+0000","last_change":"2024-09-17T03:14:39.736289+0000","last_active":"2024-09-17T03:14:40.735051+0000","last_peered":"2024-09-17T03:14:40.735051+0000","last_clean":"2024-09-17T03:14:40.735051+0000","last_became_active":"2024-09-17T03:14:39.735933+0000","last_became_peered":"2024-09-17T03:14:39.735933+0000","last_unstale":"2024-09-17T03:14:40.735051+0000","last_undegraded":"2024-09-17T03:14:40.735051+0000","last_fullsized":"2024-09-17T03:14:40.735051+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:35.503897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.743021+0000","last_change":"2024-09-17T03:14:39.735967+0000","last_active":"2024-09-17T03:14:39.743021+0000","last_peered":"2024-09-17T03:14:39.743021+0000","last_clean":"2024-09-17T03:14:39.743021+0000","last_became_active":"2024-09-17T03:14:39.735341+0000","last_became_peered":"2024-09-17T03:14:39.735341+0000","last_unstale":"2024-09-17T03:14:39.743021+0000","last_undegraded":"2024-09-17T03:14:39.743021+0000","last_fullsized":"2024-09-17T03:14:39.743021+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:16.883117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.148059+0000","last_change":"2024-09-17T03:14:39.742065+0000","last_active":"2024-09-17T03:14:41.148059+0000","last_peered":"2024-09-17T03:14:41.148059+0000","last_clean":"2024-09-17T03:14:41.148059+0000","last_became_active":"2024-09-17T03:14:39.741749+0000","last_became_peered":"2024-09-17T03:14:39.741749+0000","last_unstale":"2024-09-17T03:14:41.148059+0000","last_undegraded":"2024-09-17T03:14:41.148059+0000","last_fullsized":"2024-09-17T03:14:41.148059+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:29.588876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733491+0000","last_change":"2024-09-17T03:14:39.728967+0000","last_active":"2024-09-17T03:14:40.733491+0000","last_peered":"2024-09-17T03:14:40.733491+0000","last_clean":"2024-09-17T03:14:40.733491+0000","last_became_active":"2024-09-17T03:14:39.728649+0000","last_became_peered":"2024-09-17T03:14:39.728649+0000","last_unstale":"2024-09-17T03:14:40.733491+0000","last_undegraded":"2024-09-17T03:14:40.733491+0000","last_fullsized":"2024-09-17T03:14:40.733491+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:33.691708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.737222+0000","last_change":"2024-09-17T03:14:39.734791+0000","last_active":"2024-09-17T03:14:39.737222+0000","last_peered":"2024-09-17T03:14:39.737222+0000","last_clean":"2024-09-17T03:14:39.737222+0000","last_became_active":"2024-09-17T03:14:39.734455+0000","last_became_peered":"2024-09-17T03:14:39.734455+0000","last_unstale":"2024-09-17T03:14:39.737222+0000","last_undegraded":"2024-09-17T03:14:39.737222+0000","last_fullsized":"2024-09-17T03:14:39.737222+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:23.959342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.737251+0000","last_change":"2024-09-17T03:14:39.734751+0000","last_active":"2024-09-17T03:14:39.737251+0000","last_peered":"2024-09-17T03:14:39.737251+0000","last_clean":"2024-09-17T03:14:39.737251+0000","last_became_active":"2024-09-17T03:14:39.734421+0000","last_became_peered":"2024-09-17T03:14:39.734421+0000","last_unstale":"2024-09-17T03:14:39.737251+0000","last_undegraded":"2024-09-17T03:14:39.737251+0000","last_fullsized":"2024-09-17T03:14:39.737251+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:31.672886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734591+0000","last_change":"2024-09-17T03:14:39.734271+0000","last_active":"2024-09-17T03:14:40.734591+0000","last_peered":"2024-09-17T03:14:40.734591+0000","last_clean":"2024-09-17T03:14:40.734591+0000","last_became_active":"2024-09-17T03:14:39.733939+0000","last_became_peered":"2024-09-17T03:14:39.733939+0000","last_unstale":"2024-09-17T03:14:40.734591+0000","last_undegraded":"2024-09-17T03:14:40.734591+0000","last_fullsized":"2024-09-17T03:14:40.734591+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:08.861415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733631+0000","last_change":"2024-09-17T03:14:39.734027+0000","last_active":"2024-09-17T03:14:40.733631+0000","last_peered":"2024-09-17T03:14:40.733631+0000","last_clean":"2024-09-17T03:14:40.733631+0000","last_became_active":"2024-09-17T03:14:39.733242+0000","last_became_peered":"2024-09-17T03:14:39.733242+0000","last_unstale":"2024-09-17T03:14:40.733631+0000","last_undegraded":"2024-09-17T03:14:40.733631+0000","last_fullsized":"2024-09-17T03:14:40.733631+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:55.165531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732964+0000","last_change":"2024-09-17T03:14:39.735409+0000","last_active":"2024-09-17T03:14:40.732964+0000","last_peered":"2024-09-17T03:14:40.732964+0000","last_clean":"2024-09-17T03:14:40.732964+0000","last_became_active":"2024-09-17T03:14:39.735057+0000","last_became_peered":"2024-09-17T03:14:39.735057+0000","last_unstale":"2024-09-17T03:14:40.732964+0000","last_undegraded":"2024-09-17T03:14:40.732964+0000","last_fullsized":"2024-09-17T03:14:40.732964+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:10.239971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.740242+0000","last_change":"2024-09-17T03:14:39.736837+0000","last_active":"2024-09-17T03:14:39.740242+0000","last_peered":"2024-09-17T03:14:39.740242+0000","last_clean":"2024-09-17T03:14:39.740242+0000","last_became_active":"2024-09-17T03:14:39.736492+0000","last_became_peered":"2024-09-17T03:14:39.736492+0000","last_unstale":"2024-09-17T03:14:39.740242+0000","last_undegraded":"2024-09-17T03:14:39.740242+0000","last_fullsized":"2024-09-17T03:14:39.740242+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:12.160973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733518+0000","last_change":"2024-09-17T03:14:39.730615+0000","last_active":"2024-09-17T03:14:40.733518+0000","last_peered":"2024-09-17T03:14:40.733518+0000","last_clean":"2024-09-17T03:14:40.733518+0000","last_became_active":"2024-09-17T03:14:39.730226+0000","last_became_peered":"2024-09-17T03:14:39.730226+0000","last_unstale":"2024-09-17T03:14:40.733518+0000","last_undegraded":"2024-09-17T03:14:40.733518+0000","last_fullsized":"2024-09-17T03:14:40.733518+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:56.700908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.148011+0000","last_change":"2024-09-17T03:14:39.735367+0000","last_active":"2024-09-17T03:14:41.148011+0000","last_peered":"2024-09-17T03:14:41.148011+0000","last_clean":"2024-09-17T03:14:41.148011+0000","last_became_active":"2024-09-17T03:14:39.735040+0000","last_became_peered":"2024-09-17T03:14:39.735040+0000","last_unstale":"2024-09-17T03:14:41.148011+0000","last_undegraded":"2024-09-17T03:14:41.148011+0000","last_fullsized":"2024-09-17T03:14:41.148011+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:25.310577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731454+0000","last_change":"2024-09-17T03:14:39.746302+0000","last_active":"2024-09-17T03:14:40.731454+0000","last_peered":"2024-09-17T03:14:40.731454+0000","last_clean":"2024-09-17T03:14:40.731454+0000","last_became_active":"2024-09-17T03:14:39.744886+0000","last_became_peered":"2024-09-17T03:14:39.744886+0000","last_unstale":"2024-09-17T03:14:40.731454+0000","last_undegraded":"2024-09-17T03:14:40.731454+0000","last_fullsized":"2024-09-17T03:14:40.731454+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:38.581121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.148096+0000","last_change":"2024-09-17T03:14:39.734318+0000","last_active":"2024-09-17T03:14:41.148096+0000","last_peered":"2024-09-17T03:14:41.148096+0000","last_clean":"2024-09-17T03:14:41.148096+0000","last_became_active":"2024-09-17T03:14:39.732813+0000","last_became_peered":"2024-09-17T03:14:39.732813+0000","last_unstale":"2024-09-17T03:14:41.148096+0000","last_undegraded":"2024-09-17T03:14:41.148096+0000","last_fullsized":"2024-09-17T03:14:41.148096+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:15:34.352226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.741190+0000","last_change":"2024-09-17T03:14:39.738501+0000","last_active":"2024-09-17T03:14:39.741190+0000","last_peered":"2024-09-17T03:14:39.741190+0000","last_clean":"2024-09-17T03:14:39.741190+0000","last_became_active":"2024-09-17T03:14:39.738133+0000","last_became_peered":"2024-09-17T03:14:39.738133+0000","last_unstale":"2024-09-17T03:14:39.741190+0000","last_undegraded":"2024-09-17T03:14:39.741190+0000","last_fullsized":"2024-09-17T03:14:39.741190+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:23.938553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734934+0000","last_change":"2024-09-17T03:14:39.729506+0000","last_active":"2024-09-17T03:14:40.734934+0000","last_peered":"2024-09-17T03:14:40.734934+0000","last_clean":"2024-09-17T03:14:40.734934+0000","last_became_active":"2024-09-17T03:14:39.729204+0000","last_became_peered":"2024-09-17T03:14:39.729204+0000","last_unstale":"2024-09-17T03:14:40.734934+0000","last_undegraded":"2024-09-17T03:14:40.734934+0000","last_fullsized":"2024-09-17T03:14:40.734934+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:18.554241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.148279+0000","last_change":"2024-09-17T03:14:39.743113+0000","last_active":"2024-09-17T03:14:41.148279+0000","last_peered":"2024-09-17T03:14:41.148279+0000","last_clean":"2024-09-17T03:14:41.148279+0000","last_became_active":"2024-09-17T03:14:39.742790+0000","last_became_peered":"2024-09-17T03:14:39.742790+0000","last_unstale":"2024-09-17T03:14:41.148279+0000","last_undegraded":"2024-09-17T03:14:41.148279+0000","last_fullsized":"2024-09-17T03:14:41.148279+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:30.017809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732031+0000","last_change":"2024-09-17T03:14:39.742392+0000","last_active":"2024-09-17T03:14:40.732031+0000","last_peered":"2024-09-17T03:14:40.732031+0000","last_clean":"2024-09-17T03:14:40.732031+0000","last_became_active":"2024-09-17T03:14:39.741872+0000","last_became_peered":"2024-09-17T03:14:39.741872+0000","last_unstale":"2024-09-17T03:14:40.732031+0000","last_undegraded":"2024-09-17T03:14:40.732031+0000","last_fullsized":"2024-09-17T03:14:40.732031+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:29.124125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733731+0000","last_change":"2024-09-17T03:14:39.727613+0000","last_active":"2024-09-17T03:14:40.733731+0000","last_peered":"2024-09-17T03:14:40.733731+0000","last_clean":"2024-09-17T03:14:40.733731+0000","last_became_active":"2024-09-17T03:14:39.727304+0000","last_became_peered":"2024-09-17T03:14:39.727304+0000","last_unstale":"2024-09-17T03:14:40.733731+0000","last_undegraded":"2024-09-17T03:14:40.733731+0000","last_fullsized":"2024-09-17T03:14:40.733731+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:26:18.121319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731677+0000","last_change":"2024-09-17T03:14:39.744940+0000","last_active":"2024-09-17T03:14:40.731677+0000","last_peered":"2024-09-17T03:14:40.731677+0000","last_clean":"2024-09-17T03:14:40.731677+0000","last_became_active":"2024-09-17T03:14:39.744312+0000","last_became_peered":"2024-09-17T03:14:39.744312+0000","last_unstale":"2024-09-17T03:14:40.731677+0000","last_undegraded":"2024-09-17T03:14:40.731677+0000","last_fullsized":"2024-09-17T03:14:40.731677+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:22.543846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734602+0000","last_change":"2024-09-17T03:14:39.736104+0000","last_active":"2024-09-17T03:14:40.734602+0000","last_peered":"2024-09-17T03:14:40.734602+0000","last_clean":"2024-09-17T03:14:40.734602+0000","last_became_active":"2024-09-17T03:14:39.735788+0000","last_became_peered":"2024-09-17T03:14:39.735788+0000","last_unstale":"2024-09-17T03:14:40.734602+0000","last_undegraded":"2024-09-17T03:14:40.734602+0000","last_fullsized":"2024-09-17T03:14:40.734602+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:22.215207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734590+0000","last_change":"2024-09-17T03:14:39.735296+0000","last_active":"2024-09-17T03:14:40.734590+0000","last_peered":"2024-09-17T03:14:40.734590+0000","last_clean":"2024-09-17T03:14:40.734590+0000","last_became_active":"2024-09-17T03:14:39.735007+0000","last_became_peered":"2024-09-17T03:14:39.735007+0000","last_unstale":"2024-09-17T03:14:40.734590+0000","last_undegraded":"2024-09-17T03:14:40.734590+0000","last_fullsized":"2024-09-17T03:14:40.734590+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:49:21.612588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.747057+0000","last_change":"2024-09-17T03:14:39.745401+0000","last_active":"2024-09-17T03:14:39.747057+0000","last_peered":"2024-09-17T03:14:39.747057+0000","last_clean":"2024-09-17T03:14:39.747057+0000","last_became_active":"2024-09-17T03:14:39.745025+0000","last_became_peered":"2024-09-17T03:14:39.745025+0000","last_unstale":"2024-09-17T03:14:39.747057+0000","last_undegraded":"2024-09-17T03:14:39.747057+0000","last_fullsized":"2024-09-17T03:14:39.747057+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:44.027187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732914+0000","last_change":"2024-09-17T03:14:39.738337+0000","last_active":"2024-09-17T03:14:40.732914+0000","last_peered":"2024-09-17T03:14:40.732914+0000","last_clean":"2024-09-17T03:14:40.732914+0000","last_became_active":"2024-09-17T03:14:39.734323+0000","last_became_peered":"2024-09-17T03:14:39.734323+0000","last_unstale":"2024-09-17T03:14:40.732914+0000","last_undegraded":"2024-09-17T03:14:40.732914+0000","last_fullsized":"2024-09-17T03:14:40.732914+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:07.959838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.735055+0000","last_change":"2024-09-17T03:14:39.728305+0000","last_active":"2024-09-17T03:14:40.735055+0000","last_peered":"2024-09-17T03:14:40.735055+0000","last_clean":"2024-09-17T03:14:40.735055+0000","last_became_active":"2024-09-17T03:14:39.727967+0000","last_became_peered":"2024-09-17T03:14:39.727967+0000","last_unstale":"2024-09-17T03:14:40.735055+0000","last_undegraded":"2024-09-17T03:14:40.735055+0000","last_fullsized":"2024-09-17T03:14:40.735055+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:42.810255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.744769+0000","last_change":"2024-09-17T03:14:39.743673+0000","last_active":"2024-09-17T03:14:39.744769+0000","last_peered":"2024-09-17T03:14:39.744769+0000","last_clean":"2024-09-17T03:14:39.744769+0000","last_became_active":"2024-09-17T03:14:39.743335+0000","last_became_peered":"2024-09-17T03:14:39.743335+0000","last_unstale":"2024-09-17T03:14:39.744769+0000","last_undegraded":"2024-09-17T03:14:39.744769+0000","last_fullsized":"2024-09-17T03:14:39.744769+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:05.089943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733918+0000","last_change":"2024-09-17T03:14:39.728064+0000","last_active":"2024-09-17T03:14:40.733918+0000","last_peered":"2024-09-17T03:14:40.733918+0000","last_clean":"2024-09-17T03:14:40.733918+0000","last_became_active":"2024-09-17T03:14:39.727719+0000","last_became_peered":"2024-09-17T03:14:39.727719+0000","last_unstale":"2024-09-17T03:14:40.733918+0000","last_undegraded":"2024-09-17T03:14:40.733918+0000","last_fullsized":"2024-09-17T03:14:40.733918+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:17.060083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734811+0000","last_change":"2024-09-17T03:14:39.728215+0000","last_active":"2024-09-17T03:14:40.734811+0000","last_peered":"2024-09-17T03:14:40.734811+0000","last_clean":"2024-09-17T03:14:40.734811+0000","last_became_active":"2024-09-17T03:14:39.727901+0000","last_became_peered":"2024-09-17T03:14:39.727901+0000","last_unstale":"2024-09-17T03:14:40.734811+0000","last_undegraded":"2024-09-17T03:14:40.734811+0000","last_fullsized":"2024-09-17T03:14:40.734811+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:59.305964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731849+0000","last_change":"2024-09-17T03:14:39.745936+0000","last_active":"2024-09-17T03:14:40.731849+0000","last_peered":"2024-09-17T03:14:40.731849+0000","last_clean":"2024-09-17T03:14:40.731849+0000","last_became_active":"2024-09-17T03:14:39.745575+0000","last_became_peered":"2024-09-17T03:14:39.745575+0000","last_unstale":"2024-09-17T03:14:40.731849+0000","last_undegraded":"2024-09-17T03:14:40.731849+0000","last_fullsized":"2024-09-17T03:14:40.731849+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:58.442579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.148025+0000","last_change":"2024-09-17T03:14:39.736227+0000","last_active":"2024-09-17T03:14:41.148025+0000","last_peered":"2024-09-17T03:14:41.148025+0000","last_clean":"2024-09-17T03:14:41.148025+0000","last_became_active":"2024-09-17T03:14:39.735883+0000","last_became_peered":"2024-09-17T03:14:39.735883+0000","last_unstale":"2024-09-17T03:14:41.148025+0000","last_undegraded":"2024-09-17T03:14:41.148025+0000","last_fullsized":"2024-09-17T03:14:41.148025+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:37.255785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.730148+0000","last_change":"2024-09-17T03:14:39.728103+0000","last_active":"2024-09-17T03:14:39.730148+0000","last_peered":"2024-09-17T03:14:39.730148+0000","last_clean":"2024-09-17T03:14:39.730148+0000","last_became_active":"2024-09-17T03:14:39.727782+0000","last_became_peered":"2024-09-17T03:14:39.727782+0000","last_unstale":"2024-09-17T03:14:39.730148+0000","last_undegraded":"2024-09-17T03:14:39.730148+0000","last_fullsized":"2024-09-17T03:14:39.730148+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:44.195241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731840+0000","last_change":"2024-09-17T03:14:39.745074+0000","last_active":"2024-09-17T03:14:40.731840+0000","last_peered":"2024-09-17T03:14:40.731840+0000","last_clean":"2024-09-17T03:14:40.731840+0000","last_became_active":"2024-09-17T03:14:39.744149+0000","last_became_peered":"2024-09-17T03:14:39.744149+0000","last_unstale":"2024-09-17T03:14:40.731840+0000","last_undegraded":"2024-09-17T03:14:40.731840+0000","last_fullsized":"2024-09-17T03:14:40.731840+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:09.253440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"94'4","reported_seq":19,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734859+0000","last_change":"2024-09-17T03:14:38.707391+0000","last_active":"2024-09-17T03:14:40.734859+0000","last_peered":"2024-09-17T03:14:40.734859+0000","last_clean":"2024-09-17T03:14:40.734859+0000","last_became_active":"2024-09-17T03:14:38.706395+0000","last_became_peered":"2024-09-17T03:14:38.706395+0000","last_unstale":"2024-09-17T03:14:40.734859+0000","last_undegraded":"2024-09-17T03:14:40.734859+0000","last_fullsized":"2024-09-17T03:14:40.734859+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:33.185402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.148357+0000","last_change":"2024-09-17T03:14:39.739447+0000","last_active":"2024-09-17T03:14:41.148357+0000","last_peered":"2024-09-17T03:14:41.148357+0000","last_clean":"2024-09-17T03:14:41.148357+0000","last_became_active":"2024-09-17T03:14:39.739106+0000","last_became_peered":"2024-09-17T03:14:39.739106+0000","last_unstale":"2024-09-17T03:14:41.148357+0000","last_undegraded":"2024-09-17T03:14:41.148357+0000","last_fullsized":"2024-09-17T03:14:41.148357+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:33:55.010504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"94'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.751822+0000","last_change":"2024-09-17T03:14:38.722488+0000","last_active":"2024-09-17T03:14:39.751822+0000","last_peered":"2024-09-17T03:14:39.751822+0000","last_clean":"2024-09-17T03:14:39.751822+0000","last_became_active":"2024-09-17T03:14:38.722188+0000","last_became_peered":"2024-09-17T03:14:38.722188+0000","last_unstale":"2024-09-17T03:14:39.751822+0000","last_undegraded":"2024-09-17T03:14:39.751822+0000","last_fullsized":"2024-09-17T03:14:39.751822+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:56.787513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.743056+0000","last_change":"2024-09-17T03:14:39.734250+0000","last_active":"2024-09-17T03:14:39.743056+0000","last_peered":"2024-09-17T03:14:39.743056+0000","last_clean":"2024-09-17T03:14:39.743056+0000","last_became_active":"2024-09-17T03:14:39.733922+0000","last_became_peered":"2024-09-17T03:14:39.733922+0000","last_unstale":"2024-09-17T03:14:39.743056+0000","last_undegraded":"2024-09-17T03:14:39.743056+0000","last_fullsized":"2024-09-17T03:14:39.743056+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:24.446680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"94'2","reported_seq":17,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734798+0000","last_change":"2024-09-17T03:14:38.712875+0000","last_active":"2024-09-17T03:14:40.734798+0000","last_peered":"2024-09-17T03:14:40.734798+0000","last_clean":"2024-09-17T03:14:40.734798+0000","last_became_active":"2024-09-17T03:14:38.712536+0000","last_became_peered":"2024-09-17T03:14:38.712536+0000","last_unstale":"2024-09-17T03:14:40.734798+0000","last_undegraded":"2024-09-17T03:14:40.734798+0000","last_fullsized":"2024-09-17T03:14:40.734798+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:22.931117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733632+0000","last_change":"2024-09-17T03:14:39.734250+0000","last_active":"2024-09-17T03:14:40.733632+0000","last_peered":"2024-09-17T03:14:40.733632+0000","last_clean":"2024-09-17T03:14:40.733632+0000","last_became_active":"2024-09-17T03:14:39.732241+0000","last_became_peered":"2024-09-17T03:14:39.732241+0000","last_unstale":"2024-09-17T03:14:40.733632+0000","last_undegraded":"2024-09-17T03:14:40.733632+0000","last_fullsized":"2024-09-17T03:14:40.733632+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:12.160973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"94'2","reported_seq":17,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734680+0000","last_change":"2024-09-17T03:14:38.711933+0000","last_active":"2024-09-17T03:14:40.734680+0000","last_peered":"2024-09-17T03:14:40.734680+0000","last_clean":"2024-09-17T03:14:40.734680+0000","last_became_active":"2024-09-17T03:14:38.711190+0000","last_became_peered":"2024-09-17T03:14:38.711190+0000","last_unstale":"2024-09-17T03:14:40.734680+0000","last_undegraded":"2024-09-17T03:14:40.734680+0000","last_fullsized":"2024-09-17T03:14:40.734680+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:51.038436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.741740+0000","last_change":"2024-09-17T03:14:39.733975+0000","last_active":"2024-09-17T03:14:39.741740+0000","last_peered":"2024-09-17T03:14:39.741740+0000","last_clean":"2024-09-17T03:14:39.741740+0000","last_became_active":"2024-09-17T03:14:39.733543+0000","last_became_peered":"2024-09-17T03:14:39.733543+0000","last_unstale":"2024-09-17T03:14:39.741740+0000","last_undegraded":"2024-09-17T03:14:39.741740+0000","last_fullsized":"2024-09-17T03:14:39.741740+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:44.652406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"94'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.746097+0000","last_change":"2024-09-17T03:14:38.714844+0000","last_active":"2024-09-17T03:14:39.746097+0000","last_peered":"2024-09-17T03:14:39.746097+0000","last_clean":"2024-09-17T03:14:39.746097+0000","last_became_active":"2024-09-17T03:14:38.714522+0000","last_became_peered":"2024-09-17T03:14:38.714522+0000","last_unstale":"2024-09-17T03:14:39.746097+0000","last_undegraded":"2024-09-17T03:14:39.746097+0000","last_fullsized":"2024-09-17T03:14:39.746097+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:28.184905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.740920+0000","last_change":"2024-09-17T03:14:39.739885+0000","last_active":"2024-09-17T03:14:39.740920+0000","last_peered":"2024-09-17T03:14:39.740920+0000","last_clean":"2024-09-17T03:14:39.740920+0000","last_became_active":"2024-09-17T03:14:39.739500+0000","last_became_peered":"2024-09-17T03:14:39.739500+0000","last_unstale":"2024-09-17T03:14:39.740920+0000","last_undegraded":"2024-09-17T03:14:39.740920+0000","last_fullsized":"2024-09-17T03:14:39.740920+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:52.045872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"94'1","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734539+0000","last_change":"2024-09-17T03:14:38.721448+0000","last_active":"2024-09-17T03:14:40.734539+0000","last_peered":"2024-09-17T03:14:40.734539+0000","last_clean":"2024-09-17T03:14:40.734539+0000","last_became_active":"2024-09-17T03:14:38.720283+0000","last_became_peered":"2024-09-17T03:14:38.720283+0000","last_unstale":"2024-09-17T03:14:40.734539+0000","last_undegraded":"2024-09-17T03:14:40.734539+0000","last_fullsized":"2024-09-17T03:14:40.734539+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:22.951906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.148264+0000","last_change":"2024-09-17T03:14:39.732270+0000","last_active":"2024-09-17T03:14:41.148264+0000","last_peered":"2024-09-17T03:14:41.148264+0000","last_clean":"2024-09-17T03:14:41.148264+0000","last_became_active":"2024-09-17T03:14:39.731972+0000","last_became_peered":"2024-09-17T03:14:39.731972+0000","last_unstale":"2024-09-17T03:14:41.148264+0000","last_undegraded":"2024-09-17T03:14:41.148264+0000","last_fullsized":"2024-09-17T03:14:41.148264+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:25.993886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733311+0000","last_change":"2024-09-17T03:14:38.713223+0000","last_active":"2024-09-17T03:14:40.733311+0000","last_peered":"2024-09-17T03:14:40.733311+0000","last_clean":"2024-09-17T03:14:40.733311+0000","last_became_active":"2024-09-17T03:14:38.712318+0000","last_became_peered":"2024-09-17T03:14:38.712318+0000","last_unstale":"2024-09-17T03:14:40.733311+0000","last_undegraded":"2024-09-17T03:14:40.733311+0000","last_fullsized":"2024-09-17T03:14:40.733311+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:17.142652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732638+0000","last_change":"2024-09-17T03:14:39.733497+0000","last_active":"2024-09-17T03:14:40.732638+0000","last_peered":"2024-09-17T03:14:40.732638+0000","last_clean":"2024-09-17T03:14:40.732638+0000","last_became_active":"2024-09-17T03:14:39.732893+0000","last_became_peered":"2024-09-17T03:14:39.732893+0000","last_unstale":"2024-09-17T03:14:40.732638+0000","last_undegraded":"2024-09-17T03:14:40.732638+0000","last_fullsized":"2024-09-17T03:14:40.732638+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:56.109125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.722768+0000","last_change":"2024-09-17T03:14:38.720560+0000","last_active":"2024-09-17T03:14:39.722768+0000","last_peered":"2024-09-17T03:14:39.722768+0000","last_clean":"2024-09-17T03:14:39.722768+0000","last_became_active":"2024-09-17T03:14:38.720234+0000","last_became_peered":"2024-09-17T03:14:38.720234+0000","last_unstale":"2024-09-17T03:14:39.722768+0000","last_undegraded":"2024-09-17T03:14:39.722768+0000","last_fullsized":"2024-09-17T03:14:39.722768+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:34.960624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.735273+0000","last_change":"2024-09-17T03:14:39.734140+0000","last_active":"2024-09-17T03:14:40.735273+0000","last_peered":"2024-09-17T03:14:40.735273+0000","last_clean":"2024-09-17T03:14:40.735273+0000","last_became_active":"2024-09-17T03:14:39.733194+0000","last_became_peered":"2024-09-17T03:14:39.733194+0000","last_unstale":"2024-09-17T03:14:40.735273+0000","last_undegraded":"2024-09-17T03:14:40.735273+0000","last_fullsized":"2024-09-17T03:14:40.735273+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:28.079301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.723059+0000","last_change":"2024-09-17T03:14:38.717502+0000","last_active":"2024-09-17T03:14:39.723059+0000","last_peered":"2024-09-17T03:14:39.723059+0000","last_clean":"2024-09-17T03:14:39.723059+0000","last_became_active":"2024-09-17T03:14:38.717102+0000","last_became_peered":"2024-09-17T03:14:38.717102+0000","last_unstale":"2024-09-17T03:14:39.723059+0000","last_undegraded":"2024-09-17T03:14:39.723059+0000","last_fullsized":"2024-09-17T03:14:39.723059+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:14.321804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733817+0000","last_change":"2024-09-17T03:14:39.736754+0000","last_active":"2024-09-17T03:14:40.733817+0000","last_peered":"2024-09-17T03:14:40.733817+0000","last_clean":"2024-09-17T03:14:40.733817+0000","last_became_active":"2024-09-17T03:14:39.736265+0000","last_became_peered":"2024-09-17T03:14:39.736265+0000","last_unstale":"2024-09-17T03:14:40.733817+0000","last_undegraded":"2024-09-17T03:14:40.733817+0000","last_fullsized":"2024-09-17T03:14:40.733817+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:49.987554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.148206+0000","last_change":"2024-09-17T03:14:38.708558+0000","last_active":"2024-09-17T03:14:41.148206+0000","last_peered":"2024-09-17T03:14:41.148206+0000","last_clean":"2024-09-17T03:14:41.148206+0000","last_became_active":"2024-09-17T03:14:38.708246+0000","last_became_peered":"2024-09-17T03:14:38.708246+0000","last_unstale":"2024-09-17T03:14:41.148206+0000","last_undegraded":"2024-09-17T03:14:41.148206+0000","last_fullsized":"2024-09-17T03:14:41.148206+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:17.537060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734160+0000","last_change":"2024-09-17T03:14:39.723234+0000","last_active":"2024-09-17T03:14:40.734160+0000","last_peered":"2024-09-17T03:14:40.734160+0000","last_clean":"2024-09-17T03:14:40.734160+0000","last_became_active":"2024-09-17T03:14:39.722911+0000","last_became_peered":"2024-09-17T03:14:39.722911+0000","last_unstale":"2024-09-17T03:14:40.734160+0000","last_undegraded":"2024-09-17T03:14:40.734160+0000","last_fullsized":"2024-09-17T03:14:40.734160+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:30.411807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"94'3","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.747051+0000","last_change":"2024-09-17T03:14:38.713807+0000","last_active":"2024-09-17T03:14:39.747051+0000","last_peered":"2024-09-17T03:14:39.747051+0000","last_clean":"2024-09-17T03:14:39.747051+0000","last_became_active":"2024-09-17T03:14:38.713387+0000","last_became_peered":"2024-09-17T03:14:38.713387+0000","last_unstale":"2024-09-17T03:14:39.747051+0000","last_undegraded":"2024-09-17T03:14:39.747051+0000","last_fullsized":"2024-09-17T03:14:39.747051+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:39.115081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.740886+0000","last_change":"2024-09-17T03:14:39.739054+0000","last_active":"2024-09-17T03:14:39.740886+0000","last_peered":"2024-09-17T03:14:39.740886+0000","last_clean":"2024-09-17T03:14:39.740886+0000","last_became_active":"2024-09-17T03:14:39.738711+0000","last_became_peered":"2024-09-17T03:14:39.738711+0000","last_unstale":"2024-09-17T03:14:39.740886+0000","last_undegraded":"2024-09-17T03:14:39.740886+0000","last_fullsized":"2024-09-17T03:14:39.740886+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:34.192838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"94'6","reported_seq":21,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733854+0000","last_change":"2024-09-17T03:14:38.705326+0000","last_active":"2024-09-17T03:14:40.733854+0000","last_peered":"2024-09-17T03:14:40.733854+0000","last_clean":"2024-09-17T03:14:40.733854+0000","last_became_active":"2024-09-17T03:14:38.704905+0000","last_became_peered":"2024-09-17T03:14:38.704905+0000","last_unstale":"2024-09-17T03:14:40.733854+0000","last_undegraded":"2024-09-17T03:14:40.733854+0000","last_fullsized":"2024-09-17T03:14:40.733854+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:43.644970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.148102+0000","last_change":"2024-09-17T03:14:39.734060+0000","last_active":"2024-09-17T03:14:41.148102+0000","last_peered":"2024-09-17T03:14:41.148102+0000","last_clean":"2024-09-17T03:14:41.148102+0000","last_became_active":"2024-09-17T03:14:39.733714+0000","last_became_peered":"2024-09-17T03:14:39.733714+0000","last_unstale":"2024-09-17T03:14:41.148102+0000","last_undegraded":"2024-09-17T03:14:41.148102+0000","last_fullsized":"2024-09-17T03:14:41.148102+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:10.689353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"94'2","reported_seq":17,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731819+0000","last_change":"2024-09-17T03:14:38.716588+0000","last_active":"2024-09-17T03:14:40.731819+0000","last_peered":"2024-09-17T03:14:40.731819+0000","last_clean":"2024-09-17T03:14:40.731819+0000","last_became_active":"2024-09-17T03:14:38.716238+0000","last_became_peered":"2024-09-17T03:14:38.716238+0000","last_unstale":"2024-09-17T03:14:40.731819+0000","last_undegraded":"2024-09-17T03:14:40.731819+0000","last_fullsized":"2024-09-17T03:14:40.731819+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:30.435283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.751282+0000","last_change":"2024-09-17T03:14:39.745649+0000","last_active":"2024-09-17T03:14:39.751282+0000","last_peered":"2024-09-17T03:14:39.751282+0000","last_clean":"2024-09-17T03:14:39.751282+0000","last_became_active":"2024-09-17T03:14:39.745367+0000","last_became_peered":"2024-09-17T03:14:39.745367+0000","last_unstale":"2024-09-17T03:14:39.751282+0000","last_undegraded":"2024-09-17T03:14:39.751282+0000","last_fullsized":"2024-09-17T03:14:39.751282+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:26.342507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732095+0000","last_change":"2024-09-17T03:14:38.722910+0000","last_active":"2024-09-17T03:14:40.732095+0000","last_peered":"2024-09-17T03:14:40.732095+0000","last_clean":"2024-09-17T03:14:40.732095+0000","last_became_active":"2024-09-17T03:14:38.722381+0000","last_became_peered":"2024-09-17T03:14:38.722381+0000","last_unstale":"2024-09-17T03:14:40.732095+0000","last_undegraded":"2024-09-17T03:14:40.732095+0000","last_fullsized":"2024-09-17T03:14:40.732095+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:59.314874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732657+0000","last_change":"2024-09-17T03:14:39.740559+0000","last_active":"2024-09-17T03:14:40.732657+0000","last_peered":"2024-09-17T03:14:40.732657+0000","last_clean":"2024-09-17T03:14:40.732657+0000","last_became_active":"2024-09-17T03:14:39.740139+0000","last_became_peered":"2024-09-17T03:14:39.740139+0000","last_unstale":"2024-09-17T03:14:40.732657+0000","last_undegraded":"2024-09-17T03:14:40.732657+0000","last_fullsized":"2024-09-17T03:14:40.732657+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:04.311489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732838+0000","last_change":"2024-09-17T03:14:38.704032+0000","last_active":"2024-09-17T03:14:40.732838+0000","last_peered":"2024-09-17T03:14:40.732838+0000","last_clean":"2024-09-17T03:14:40.732838+0000","last_became_active":"2024-09-17T03:14:38.703699+0000","last_became_peered":"2024-09-17T03:14:38.703699+0000","last_unstale":"2024-09-17T03:14:40.732838+0000","last_undegraded":"2024-09-17T03:14:40.732838+0000","last_fullsized":"2024-09-17T03:14:40.732838+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:34.216584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731446+0000","last_change":"2024-09-17T03:14:39.741053+0000","last_active":"2024-09-17T03:14:40.731446+0000","last_peered":"2024-09-17T03:14:40.731446+0000","last_clean":"2024-09-17T03:14:40.731446+0000","last_became_active":"2024-09-17T03:14:39.740720+0000","last_became_peered":"2024-09-17T03:14:39.740720+0000","last_unstale":"2024-09-17T03:14:40.731446+0000","last_undegraded":"2024-09-17T03:14:40.731446+0000","last_fullsized":"2024-09-17T03:14:40.731446+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:27.948450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"94'8","reported_seq":21,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.751506+0000","last_change":"2024-09-17T03:14:38.720617+0000","last_active":"2024-09-17T03:14:39.751506+0000","last_peered":"2024-09-17T03:14:39.751506+0000","last_clean":"2024-09-17T03:14:39.751506+0000","last_became_active":"2024-09-17T03:14:38.720208+0000","last_became_peered":"2024-09-17T03:14:38.720208+0000","last_unstale":"2024-09-17T03:14:39.751506+0000","last_undegraded":"2024-09-17T03:14:39.751506+0000","last_fullsized":"2024-09-17T03:14:39.751506+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:37.677123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733602+0000","last_change":"2024-09-17T03:14:39.732728+0000","last_active":"2024-09-17T03:14:40.733602+0000","last_peered":"2024-09-17T03:14:40.733602+0000","last_clean":"2024-09-17T03:14:40.733602+0000","last_became_active":"2024-09-17T03:14:39.731291+0000","last_became_peered":"2024-09-17T03:14:39.731291+0000","last_unstale":"2024-09-17T03:14:40.733602+0000","last_undegraded":"2024-09-17T03:14:40.733602+0000","last_fullsized":"2024-09-17T03:14:40.733602+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:38.777956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"94'2","reported_seq":17,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733340+0000","last_change":"2024-09-17T03:14:38.715421+0000","last_active":"2024-09-17T03:14:40.733340+0000","last_peered":"2024-09-17T03:14:40.733340+0000","last_clean":"2024-09-17T03:14:40.733340+0000","last_became_active":"2024-09-17T03:14:38.714989+0000","last_became_peered":"2024-09-17T03:14:38.714989+0000","last_unstale":"2024-09-17T03:14:40.733340+0000","last_undegraded":"2024-09-17T03:14:40.733340+0000","last_fullsized":"2024-09-17T03:14:40.733340+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:03.733625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.744274+0000","last_change":"2024-09-17T03:14:39.741541+0000","last_active":"2024-09-17T03:14:39.744274+0000","last_peered":"2024-09-17T03:14:39.744274+0000","last_clean":"2024-09-17T03:14:39.744274+0000","last_became_active":"2024-09-17T03:14:39.740855+0000","last_became_peered":"2024-09-17T03:14:39.740855+0000","last_unstale":"2024-09-17T03:14:39.744274+0000","last_undegraded":"2024-09-17T03:14:39.744274+0000","last_fullsized":"2024-09-17T03:14:39.744274+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:04.741061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"94'1","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732983+0000","last_change":"2024-09-17T03:14:38.707749+0000","last_active":"2024-09-17T03:14:40.732983+0000","last_peered":"2024-09-17T03:14:40.732983+0000","last_clean":"2024-09-17T03:14:40.732983+0000","last_became_active":"2024-09-17T03:14:38.706360+0000","last_became_peered":"2024-09-17T03:14:38.706360+0000","last_unstale":"2024-09-17T03:14:40.732983+0000","last_undegraded":"2024-09-17T03:14:40.732983+0000","last_fullsized":"2024-09-17T03:14:40.732983+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:34.591324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.740215+0000","last_change":"2024-09-17T03:14:39.736771+0000","last_active":"2024-09-17T03:14:39.740215+0000","last_peered":"2024-09-17T03:14:39.740215+0000","last_clean":"2024-09-17T03:14:39.740215+0000","last_became_active":"2024-09-17T03:14:39.736429+0000","last_became_peered":"2024-09-17T03:14:39.736429+0000","last_unstale":"2024-09-17T03:14:39.740215+0000","last_undegraded":"2024-09-17T03:14:39.740215+0000","last_fullsized":"2024-09-17T03:14:39.740215+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:00.985338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734823+0000","last_change":"2024-09-17T03:14:38.712238+0000","last_active":"2024-09-17T03:14:40.734823+0000","last_peered":"2024-09-17T03:14:40.734823+0000","last_clean":"2024-09-17T03:14:40.734823+0000","last_became_active":"2024-09-17T03:14:38.711631+0000","last_became_peered":"2024-09-17T03:14:38.711631+0000","last_unstale":"2024-09-17T03:14:40.734823+0000","last_undegraded":"2024-09-17T03:14:40.734823+0000","last_fullsized":"2024-09-17T03:14:40.734823+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:04.082507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731989+0000","last_change":"2024-09-17T03:14:39.743745+0000","last_active":"2024-09-17T03:14:40.731989+0000","last_peered":"2024-09-17T03:14:40.731989+0000","last_clean":"2024-09-17T03:14:40.731989+0000","last_became_active":"2024-09-17T03:14:39.743114+0000","last_became_peered":"2024-09-17T03:14:39.743114+0000","last_unstale":"2024-09-17T03:14:40.731989+0000","last_undegraded":"2024-09-17T03:14:40.731989+0000","last_fullsized":"2024-09-17T03:14:40.731989+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:11.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"94'2","reported_seq":17,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734753+0000","last_change":"2024-09-17T03:14:38.718279+0000","last_active":"2024-09-17T03:14:40.734753+0000","last_peered":"2024-09-17T03:14:40.734753+0000","last_clean":"2024-09-17T03:14:40.734753+0000","last_became_active":"2024-09-17T03:14:38.717964+0000","last_became_peered":"2024-09-17T03:14:38.717964+0000","last_unstale":"2024-09-17T03:14:40.734753+0000","last_undegraded":"2024-09-17T03:14:40.734753+0000","last_fullsized":"2024-09-17T03:14:40.734753+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:59.977902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731633+0000","last_change":"2024-09-17T03:14:39.744608+0000","last_active":"2024-09-17T03:14:40.731633+0000","last_peered":"2024-09-17T03:14:40.731633+0000","last_clean":"2024-09-17T03:14:40.731633+0000","last_became_active":"2024-09-17T03:14:39.742779+0000","last_became_peered":"2024-09-17T03:14:39.742779+0000","last_unstale":"2024-09-17T03:14:40.731633+0000","last_undegraded":"2024-09-17T03:14:40.731633+0000","last_fullsized":"2024-09-17T03:14:40.731633+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:27.631444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.728326+0000","last_change":"2024-09-17T03:14:38.721990+0000","last_active":"2024-09-17T03:14:39.728326+0000","last_peered":"2024-09-17T03:14:39.728326+0000","last_clean":"2024-09-17T03:14:39.728326+0000","last_became_active":"2024-09-17T03:14:38.721643+0000","last_became_peered":"2024-09-17T03:14:38.721643+0000","last_unstale":"2024-09-17T03:14:39.728326+0000","last_undegraded":"2024-09-17T03:14:39.728326+0000","last_fullsized":"2024-09-17T03:14:39.728326+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:34.216584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731437+0000","last_change":"2024-09-17T03:14:39.746651+0000","last_active":"2024-09-17T03:14:40.731437+0000","last_peered":"2024-09-17T03:14:40.731437+0000","last_clean":"2024-09-17T03:14:40.731437+0000","last_became_active":"2024-09-17T03:14:39.745278+0000","last_became_peered":"2024-09-17T03:14:39.745278+0000","last_unstale":"2024-09-17T03:14:40.731437+0000","last_undegraded":"2024-09-17T03:14:40.731437+0000","last_fullsized":"2024-09-17T03:14:40.731437+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:55.141854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.728035+0000","last_change":"2024-09-17T03:14:38.711885+0000","last_active":"2024-09-17T03:14:39.728035+0000","last_peered":"2024-09-17T03:14:39.728035+0000","last_clean":"2024-09-17T03:14:39.728035+0000","last_became_active":"2024-09-17T03:14:38.711510+0000","last_became_peered":"2024-09-17T03:14:38.711510+0000","last_unstale":"2024-09-17T03:14:39.728035+0000","last_undegraded":"2024-09-17T03:14:39.728035+0000","last_fullsized":"2024-09-17T03:14:39.728035+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:08.890814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732985+0000","last_change":"2024-09-17T03:14:39.736817+0000","last_active":"2024-09-17T03:14:40.732985+0000","last_peered":"2024-09-17T03:14:40.732985+0000","last_clean":"2024-09-17T03:14:40.732985+0000","last_became_active":"2024-09-17T03:14:39.736409+0000","last_became_peered":"2024-09-17T03:14:39.736409+0000","last_unstale":"2024-09-17T03:14:40.732985+0000","last_undegraded":"2024-09-17T03:14:40.732985+0000","last_fullsized":"2024-09-17T03:14:40.732985+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:22.746628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734512+0000","last_change":"2024-09-17T03:14:38.722199+0000","last_active":"2024-09-17T03:14:40.734512+0000","last_peered":"2024-09-17T03:14:40.734512+0000","last_clean":"2024-09-17T03:14:40.734512+0000","last_became_active":"2024-09-17T03:14:38.721877+0000","last_became_peered":"2024-09-17T03:14:38.721877+0000","last_unstale":"2024-09-17T03:14:40.734512+0000","last_undegraded":"2024-09-17T03:14:40.734512+0000","last_fullsized":"2024-09-17T03:14:40.734512+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:30.665450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.735270+0000","last_change":"2024-09-17T03:14:39.734220+0000","last_active":"2024-09-17T03:14:40.735270+0000","last_peered":"2024-09-17T03:14:40.735270+0000","last_clean":"2024-09-17T03:14:40.735270+0000","last_became_active":"2024-09-17T03:14:39.733637+0000","last_became_peered":"2024-09-17T03:14:39.733637+0000","last_unstale":"2024-09-17T03:14:40.735270+0000","last_undegraded":"2024-09-17T03:14:40.735270+0000","last_fullsized":"2024-09-17T03:14:40.735270+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:27.921118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"94'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.745981+0000","last_change":"2024-09-17T03:14:38.707857+0000","last_active":"2024-09-17T03:14:39.745981+0000","last_peered":"2024-09-17T03:14:39.745981+0000","last_clean":"2024-09-17T03:14:39.745981+0000","last_became_active":"2024-09-17T03:14:38.707414+0000","last_became_peered":"2024-09-17T03:14:38.707414+0000","last_unstale":"2024-09-17T03:14:39.745981+0000","last_undegraded":"2024-09-17T03:14:39.745981+0000","last_fullsized":"2024-09-17T03:14:39.745981+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:02.712647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.751237+0000","last_change":"2024-09-17T03:14:39.744204+0000","last_active":"2024-09-17T03:14:39.751237+0000","last_peered":"2024-09-17T03:14:39.751237+0000","last_clean":"2024-09-17T03:14:39.751237+0000","last_became_active":"2024-09-17T03:14:39.743896+0000","last_became_peered":"2024-09-17T03:14:39.743896+0000","last_unstale":"2024-09-17T03:14:39.751237+0000","last_undegraded":"2024-09-17T03:14:39.751237+0000","last_fullsized":"2024-09-17T03:14:39.751237+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:07.997437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"95'1","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.736551+0000","last_change":"2024-09-17T03:14:38.718342+0000","last_active":"2024-09-17T03:14:40.736551+0000","last_peered":"2024-09-17T03:14:40.736551+0000","last_clean":"2024-09-17T03:14:40.736551+0000","last_became_active":"2024-09-17T03:14:38.718022+0000","last_became_peered":"2024-09-17T03:14:38.718022+0000","last_unstale":"2024-09-17T03:14:40.736551+0000","last_undegraded":"2024-09-17T03:14:40.736551+0000","last_fullsized":"2024-09-17T03:14:40.736551+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:27.057811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.746103+0000","last_change":"2024-09-17T03:14:39.739530+0000","last_active":"2024-09-17T03:14:39.746103+0000","last_peered":"2024-09-17T03:14:39.746103+0000","last_clean":"2024-09-17T03:14:39.746103+0000","last_became_active":"2024-09-17T03:14:39.739180+0000","last_became_peered":"2024-09-17T03:14:39.739180+0000","last_unstale":"2024-09-17T03:14:39.746103+0000","last_undegraded":"2024-09-17T03:14:39.746103+0000","last_fullsized":"2024-09-17T03:14:39.746103+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:24.477828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734873+0000","last_change":"2024-09-17T03:14:38.711340+0000","last_active":"2024-09-17T03:14:40.734873+0000","last_peered":"2024-09-17T03:14:40.734873+0000","last_clean":"2024-09-17T03:14:40.734873+0000","last_became_active":"2024-09-17T03:14:38.711043+0000","last_became_peered":"2024-09-17T03:14:38.711043+0000","last_unstale":"2024-09-17T03:14:40.734873+0000","last_undegraded":"2024-09-17T03:14:40.734873+0000","last_fullsized":"2024-09-17T03:14:40.734873+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:11.153538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732846+0000","last_change":"2024-09-17T03:14:39.728575+0000","last_active":"2024-09-17T03:14:40.732846+0000","last_peered":"2024-09-17T03:14:40.732846+0000","last_clean":"2024-09-17T03:14:40.732846+0000","last_became_active":"2024-09-17T03:14:39.728260+0000","last_became_peered":"2024-09-17T03:14:39.728260+0000","last_unstale":"2024-09-17T03:14:40.732846+0000","last_undegraded":"2024-09-17T03:14:40.732846+0000","last_fullsized":"2024-09-17T03:14:40.732846+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:35.839069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734261+0000","last_change":"2024-09-17T03:14:38.713767+0000","last_active":"2024-09-17T03:14:40.734261+0000","last_peered":"2024-09-17T03:14:40.734261+0000","last_clean":"2024-09-17T03:14:40.734261+0000","last_became_active":"2024-09-17T03:14:38.713392+0000","last_became_peered":"2024-09-17T03:14:38.713392+0000","last_unstale":"2024-09-17T03:14:40.734261+0000","last_undegraded":"2024-09-17T03:14:40.734261+0000","last_fullsized":"2024-09-17T03:14:40.734261+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:00.506023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732022+0000","last_change":"2024-09-17T03:14:39.743426+0000","last_active":"2024-09-17T03:14:40.732022+0000","last_peered":"2024-09-17T03:14:40.732022+0000","last_clean":"2024-09-17T03:14:40.732022+0000","last_became_active":"2024-09-17T03:14:39.741936+0000","last_became_peered":"2024-09-17T03:14:39.741936+0000","last_unstale":"2024-09-17T03:14:40.732022+0000","last_undegraded":"2024-09-17T03:14:40.732022+0000","last_fullsized":"2024-09-17T03:14:40.732022+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:38.550150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734925+0000","last_change":"2024-09-17T03:14:38.708426+0000","last_active":"2024-09-17T03:14:40.734925+0000","last_peered":"2024-09-17T03:14:40.734925+0000","last_clean":"2024-09-17T03:14:40.734925+0000","last_became_active":"2024-09-17T03:14:38.708114+0000","last_became_peered":"2024-09-17T03:14:38.708114+0000","last_unstale":"2024-09-17T03:14:40.734925+0000","last_undegraded":"2024-09-17T03:14:40.734925+0000","last_fullsized":"2024-09-17T03:14:40.734925+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:43.019751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734084+0000","last_change":"2024-09-17T03:14:39.732620+0000","last_active":"2024-09-17T03:14:40.734084+0000","last_peered":"2024-09-17T03:14:40.734084+0000","last_clean":"2024-09-17T03:14:40.734084+0000","last_became_active":"2024-09-17T03:14:39.732224+0000","last_became_peered":"2024-09-17T03:14:39.732224+0000","last_unstale":"2024-09-17T03:14:40.734084+0000","last_undegraded":"2024-09-17T03:14:40.734084+0000","last_fullsized":"2024-09-17T03:14:40.734084+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:10.860898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732633+0000","last_change":"2024-09-17T03:14:38.721900+0000","last_active":"2024-09-17T03:14:40.732633+0000","last_peered":"2024-09-17T03:14:40.732633+0000","last_clean":"2024-09-17T03:14:40.732633+0000","last_became_active":"2024-09-17T03:14:38.721548+0000","last_became_peered":"2024-09-17T03:14:38.721548+0000","last_unstale":"2024-09-17T03:14:40.732633+0000","last_undegraded":"2024-09-17T03:14:40.732633+0000","last_fullsized":"2024-09-17T03:14:40.732633+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:22.749287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731688+0000","last_change":"2024-09-17T03:14:39.742627+0000","last_active":"2024-09-17T03:14:40.731688+0000","last_peered":"2024-09-17T03:14:40.731688+0000","last_clean":"2024-09-17T03:14:40.731688+0000","last_became_active":"2024-09-17T03:14:39.742331+0000","last_became_peered":"2024-09-17T03:14:39.742331+0000","last_unstale":"2024-09-17T03:14:40.731688+0000","last_undegraded":"2024-09-17T03:14:40.731688+0000","last_fullsized":"2024-09-17T03:14:40.731688+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:00.610836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.148170+0000","last_change":"2024-09-17T03:14:38.720985+0000","last_active":"2024-09-17T03:14:41.148170+0000","last_peered":"2024-09-17T03:14:41.148170+0000","last_clean":"2024-09-17T03:14:41.148170+0000","last_became_active":"2024-09-17T03:14:38.720619+0000","last_became_peered":"2024-09-17T03:14:38.720619+0000","last_unstale":"2024-09-17T03:14:41.148170+0000","last_undegraded":"2024-09-17T03:14:41.148170+0000","last_fullsized":"2024-09-17T03:14:41.148170+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:52.989178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733148+0000","last_change":"2024-09-17T03:14:39.730119+0000","last_active":"2024-09-17T03:14:40.733148+0000","last_peered":"2024-09-17T03:14:40.733148+0000","last_clean":"2024-09-17T03:14:40.733148+0000","last_became_active":"2024-09-17T03:14:39.729716+0000","last_became_peered":"2024-09-17T03:14:39.729716+0000","last_unstale":"2024-09-17T03:14:40.733148+0000","last_undegraded":"2024-09-17T03:14:40.733148+0000","last_fullsized":"2024-09-17T03:14:40.733148+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:00.950525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731555+0000","last_change":"2024-09-17T03:14:38.715698+0000","last_active":"2024-09-17T03:14:40.731555+0000","last_peered":"2024-09-17T03:14:40.731555+0000","last_clean":"2024-09-17T03:14:40.731555+0000","last_became_active":"2024-09-17T03:14:38.715407+0000","last_became_peered":"2024-09-17T03:14:38.715407+0000","last_unstale":"2024-09-17T03:14:40.731555+0000","last_undegraded":"2024-09-17T03:14:40.731555+0000","last_fullsized":"2024-09-17T03:14:40.731555+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:02.357008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731915+0000","last_change":"2024-09-17T03:14:39.745519+0000","last_active":"2024-09-17T03:14:40.731915+0000","last_peered":"2024-09-17T03:14:40.731915+0000","last_clean":"2024-09-17T03:14:40.731915+0000","last_became_active":"2024-09-17T03:14:39.744688+0000","last_became_peered":"2024-09-17T03:14:39.744688+0000","last_unstale":"2024-09-17T03:14:40.731915+0000","last_undegraded":"2024-09-17T03:14:40.731915+0000","last_fullsized":"2024-09-17T03:14:40.731915+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:08.228121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"94'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.749656+0000","last_change":"2024-09-17T03:14:38.716420+0000","last_active":"2024-09-17T03:14:39.749656+0000","last_peered":"2024-09-17T03:14:39.749656+0000","last_clean":"2024-09-17T03:14:39.749656+0000","last_became_active":"2024-09-17T03:14:38.716045+0000","last_became_peered":"2024-09-17T03:14:38.716045+0000","last_unstale":"2024-09-17T03:14:39.749656+0000","last_undegraded":"2024-09-17T03:14:39.749656+0000","last_fullsized":"2024-09-17T03:14:39.749656+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:44.325262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":239,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.729426+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:14:39.729426+0000","last_peered":"2024-09-17T03:14:39.729426+0000","last_clean":"2024-09-17T03:14:39.729426+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:14:39.729426+0000","last_undegraded":"2024-09-17T03:14:39.729426+0000","last_fullsized":"2024-09-17T03:14:39.729426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509521,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1757184,"data_stored":1086921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509521,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1175552,"data_stored":503393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28160,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343680,"statfs":{"total":96636764160,"available":96607928320,"internally_reserved":0,"allocated":1159168,"data_stored":496511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509521,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32352,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339488,"statfs":{"total":96636764160,"available":96603635712,"internally_reserved":0,"allocated":1187840,"data_stored":504477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509522,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1159168,"data_stored":496475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509521,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1155072,"data_stored":496441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509521,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1765376,"data_stored":1093691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574929,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1183744,"data_stored":504375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:14:43.742 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:14:43.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.893+0000 7f7f311da640 1 -- 172.21.15.78:0/1782861617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f0c004800 msgr2=0x7f7f0c004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.893+0000 7f7f311da640 1 --2- 172.21.15.78:0/1782861617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f0c004800 0x7f7f0c004c10 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f7f140016c0 tx=0x7f7f0c005830 comp rx=0 tx=0).stop 2024-09-17T03:14:43.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.893+0000 7f7f311da640 1 -- 172.21.15.78:0/1782861617 shutdown_connections 2024-09-17T03:14:43.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.893+0000 7f7f311da640 1 --2- 172.21.15.78:0/1782861617 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f0c004800 0x7f7f0c004c10 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.893+0000 7f7f311da640 1 -- 172.21.15.78:0/1782861617 >> 172.21.15.78:0/1782861617 conn(0x7f7f2c08bfc0 msgr2=0x7f7f2c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:43.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.893+0000 7f7f311da640 1 -- 172.21.15.78:0/1782861617 shutdown_connections 2024-09-17T03:14:43.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.893+0000 7f7f311da640 1 -- 172.21.15.78:0/1782861617 wait complete. 2024-09-17T03:14:43.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.895+0000 7f7f311da640 1 Processor -- start 2024-09-17T03:14:43.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.895+0000 7f7f311da640 1 -- start start 2024-09-17T03:14:43.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.896+0000 7f7f311da640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7f0c004800 0x7f7f2c151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:43.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.896+0000 7f7f311da640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f2c15e4f0 0x7f7f2c0cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:43.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.896+0000 7f7f311da640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7f2c0ca3f0 0x7f7f2c1f9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:43.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.896+0000 7f7f311da640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2c0d1c00 con 0x7f7f2c15e4f0 2024-09-17T03:14:43.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.896+0000 7f7f311da640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2c0d1a80 con 0x7f7f0c004800 2024-09-17T03:14:43.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.896+0000 7f7f311da640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2c0d1d80 con 0x7f7f2c0ca3f0 2024-09-17T03:14:43.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.896+0000 7f7f1a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f2c15e4f0 0x7f7f2c0cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:43.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.896+0000 7f7f1a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f2c15e4f0 0x7f7f2c0cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58858/0 (socket says 172.21.15.78:58858) 2024-09-17T03:14:43.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.896+0000 7f7f1a59c640 1 -- 172.21.15.78:0/495605698 learned_addr learned my addr 172.21.15.78:0/495605698 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:43.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.896+0000 7f7f2b59e640 1 --2- 172.21.15.78:0/495605698 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7f2c0ca3f0 0x7f7f2c1f9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:43.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.897+0000 7f7f2ad9d640 1 --2- 172.21.15.78:0/495605698 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7f0c004800 0x7f7f2c151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:43.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.897+0000 7f7f1a59c640 1 -- 172.21.15.78:0/495605698 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7f2c0ca3f0 msgr2=0x7f7f2c1f9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.897+0000 7f7f1a59c640 1 --2- 172.21.15.78:0/495605698 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7f2c0ca3f0 0x7f7f2c1f9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.897+0000 7f7f1a59c640 1 -- 172.21.15.78:0/495605698 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7f0c004800 msgr2=0x7f7f2c151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:43.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.897+0000 7f7f1a59c640 1 --2- 172.21.15.78:0/495605698 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7f0c004800 0x7f7f2c151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:43.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.897+0000 7f7f1a59c640 1 -- 172.21.15.78:0/495605698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2c151eb0 con 0x7f7f2c15e4f0 2024-09-17T03:14:43.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.897+0000 7f7f1a59c640 1 --2- 172.21.15.78:0/495605698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f2c15e4f0 0x7f7f2c0cbde0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f7f1402a910 tx=0x7f7f14006360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:43.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.897+0000 7f7f23fff640 1 -- 172.21.15.78:0/495605698 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f14003a00 con 0x7f7f2c15e4f0 2024-09-17T03:14:43.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.897+0000 7f7f23fff640 1 -- 172.21.15.78:0/495605698 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f14039070 con 0x7f7f2c15e4f0 2024-09-17T03:14:43.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.897+0000 7f7f311da640 1 -- 172.21.15.78:0/495605698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f2c1521d0 con 0x7f7f2c15e4f0 2024-09-17T03:14:43.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.897+0000 7f7f23fff640 1 -- 172.21.15.78:0/495605698 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f14033420 con 0x7f7f2c15e4f0 2024-09-17T03:14:43.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.897+0000 7f7f311da640 1 -- 172.21.15.78:0/495605698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f2c0c9bf0 con 0x7f7f2c15e4f0 2024-09-17T03:14:43.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.898+0000 7f7f311da640 1 -- 172.21.15.78:0/495605698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f2c0cf310 con 0x7f7f2c15e4f0 2024-09-17T03:14:43.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.899+0000 7f7f23fff640 1 -- 172.21.15.78:0/495605698 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7f14044020 con 0x7f7f2c15e4f0 2024-09-17T03:14:43.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.899+0000 7f7f23fff640 1 --2- 172.21.15.78:0/495605698 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7f10078b90 0x7f7f1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:43.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.899+0000 7f7f23fff640 1 -- 172.21.15.78:0/495605698 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f7f140ba5a0 con 0x7f7f2c15e4f0 2024-09-17T03:14:43.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.899+0000 7f7f2ad9d640 1 --2- 172.21.15.78:0/495605698 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7f10078b90 0x7f7f1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:43.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.900+0000 7f7f2ad9d640 1 --2- 172.21.15.78:0/495605698 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7f10078b90 0x7f7f1007b0a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c005fd0 tx=0x7f7f1c004e50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:43.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:43.903+0000 7f7f23fff640 1 -- 172.21.15.78:0/495605698 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7f14082a70 con 0x7f7f2c15e4f0 2024-09-17T03:14:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.074+0000 7f7f311da640 1 -- 172.21.15.78:0/495605698 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7f2c15df30 con 0x7f7f10078b90 2024-09-17T03:14:44.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.079+0000 7f7f23fff640 1 -- 172.21.15.78:0/495605698 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252072 (secure 0 0 0) 0x7f7f1c0056c0 con 0x7f7f10078b90 2024-09-17T03:14:44.080 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:44.081 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:14:44.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.081+0000 7f7f311da640 1 -- 172.21.15.78:0/495605698 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7f10078b90 msgr2=0x7f7f1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:44.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.081+0000 7f7f311da640 1 --2- 172.21.15.78:0/495605698 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7f10078b90 0x7f7f1007b0a0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c005fd0 tx=0x7f7f1c004e50 comp rx=0 tx=0).stop 2024-09-17T03:14:44.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.081+0000 7f7f311da640 1 -- 172.21.15.78:0/495605698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f2c15e4f0 msgr2=0x7f7f2c0cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:44.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.081+0000 7f7f311da640 1 --2- 172.21.15.78:0/495605698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f2c15e4f0 0x7f7f2c0cbde0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f7f1402a910 tx=0x7f7f14006360 comp rx=0 tx=0).stop 2024-09-17T03:14:44.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.081+0000 7f7f311da640 1 -- 172.21.15.78:0/495605698 shutdown_connections 2024-09-17T03:14:44.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.081+0000 7f7f311da640 1 --2- 172.21.15.78:0/495605698 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7f2c0ca3f0 0x7f7f2c1f9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.081+0000 7f7f311da640 1 --2- 172.21.15.78:0/495605698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7f2c15e4f0 0x7f7f2c0cbde0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.081+0000 7f7f311da640 1 --2- 172.21.15.78:0/495605698 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7f10078b90 0x7f7f1007b0a0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.081+0000 7f7f311da640 1 --2- 172.21.15.78:0/495605698 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7f0c004800 0x7f7f2c151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.081+0000 7f7f311da640 1 -- 172.21.15.78:0/495605698 >> 172.21.15.78:0/495605698 conn(0x7f7f2c08bfc0 msgr2=0x7f7f2c06eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:44.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.082+0000 7f7f311da640 1 -- 172.21.15.78:0/495605698 shutdown_connections 2024-09-17T03:14:44.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.082+0000 7f7f311da640 1 -- 172.21.15.78:0/495605698 wait complete. 2024-09-17T03:14:44.092 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-09-17T03:14:43.222089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255652,"kb_used_data":10296,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754719068,"statfs":{"total":773094113280,"available":772832325632,"internally_reserved":0,"allocated":10543104,"data_stored":5182284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.526083"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.742964+0000","last_change":"2024-09-17T03:14:39.735674+0000","last_active":"2024-09-17T03:14:39.742964+0000","last_peered":"2024-09-17T03:14:39.742964+0000","last_clean":"2024-09-17T03:14:39.742964+0000","last_became_active":"2024-09-17T03:14:39.735316+0000","last_became_peered":"2024-09-17T03:14:39.735316+0000","last_unstale":"2024-09-17T03:14:39.742964+0000","last_undegraded":"2024-09-17T03:14:39.742964+0000","last_fullsized":"2024-09-17T03:14:39.742964+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:03:53.477071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.735051+0000","last_change":"2024-09-17T03:14:39.736289+0000","last_active":"2024-09-17T03:14:40.735051+0000","last_peered":"2024-09-17T03:14:40.735051+0000","last_clean":"2024-09-17T03:14:40.735051+0000","last_became_active":"2024-09-17T03:14:39.735933+0000","last_became_peered":"2024-09-17T03:14:39.735933+0000","last_unstale":"2024-09-17T03:14:40.735051+0000","last_undegraded":"2024-09-17T03:14:40.735051+0000","last_fullsized":"2024-09-17T03:14:40.735051+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:35.503897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.743021+0000","last_change":"2024-09-17T03:14:39.735967+0000","last_active":"2024-09-17T03:14:39.743021+0000","last_peered":"2024-09-17T03:14:39.743021+0000","last_clean":"2024-09-17T03:14:39.743021+0000","last_became_active":"2024-09-17T03:14:39.735341+0000","last_became_peered":"2024-09-17T03:14:39.735341+0000","last_unstale":"2024-09-17T03:14:39.743021+0000","last_undegraded":"2024-09-17T03:14:39.743021+0000","last_fullsized":"2024-09-17T03:14:39.743021+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:12:16.883117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.148059+0000","last_change":"2024-09-17T03:14:39.742065+0000","last_active":"2024-09-17T03:14:41.148059+0000","last_peered":"2024-09-17T03:14:41.148059+0000","last_clean":"2024-09-17T03:14:41.148059+0000","last_became_active":"2024-09-17T03:14:39.741749+0000","last_became_peered":"2024-09-17T03:14:39.741749+0000","last_unstale":"2024-09-17T03:14:41.148059+0000","last_undegraded":"2024-09-17T03:14:41.148059+0000","last_fullsized":"2024-09-17T03:14:41.148059+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:29.588876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733491+0000","last_change":"2024-09-17T03:14:39.728967+0000","last_active":"2024-09-17T03:14:40.733491+0000","last_peered":"2024-09-17T03:14:40.733491+0000","last_clean":"2024-09-17T03:14:40.733491+0000","last_became_active":"2024-09-17T03:14:39.728649+0000","last_became_peered":"2024-09-17T03:14:39.728649+0000","last_unstale":"2024-09-17T03:14:40.733491+0000","last_undegraded":"2024-09-17T03:14:40.733491+0000","last_fullsized":"2024-09-17T03:14:40.733491+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:33.691708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.737222+0000","last_change":"2024-09-17T03:14:39.734791+0000","last_active":"2024-09-17T03:14:39.737222+0000","last_peered":"2024-09-17T03:14:39.737222+0000","last_clean":"2024-09-17T03:14:39.737222+0000","last_became_active":"2024-09-17T03:14:39.734455+0000","last_became_peered":"2024-09-17T03:14:39.734455+0000","last_unstale":"2024-09-17T03:14:39.737222+0000","last_undegraded":"2024-09-17T03:14:39.737222+0000","last_fullsized":"2024-09-17T03:14:39.737222+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:23.959342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.737251+0000","last_change":"2024-09-17T03:14:39.734751+0000","last_active":"2024-09-17T03:14:39.737251+0000","last_peered":"2024-09-17T03:14:39.737251+0000","last_clean":"2024-09-17T03:14:39.737251+0000","last_became_active":"2024-09-17T03:14:39.734421+0000","last_became_peered":"2024-09-17T03:14:39.734421+0000","last_unstale":"2024-09-17T03:14:39.737251+0000","last_undegraded":"2024-09-17T03:14:39.737251+0000","last_fullsized":"2024-09-17T03:14:39.737251+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:31.672886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734591+0000","last_change":"2024-09-17T03:14:39.734271+0000","last_active":"2024-09-17T03:14:40.734591+0000","last_peered":"2024-09-17T03:14:40.734591+0000","last_clean":"2024-09-17T03:14:40.734591+0000","last_became_active":"2024-09-17T03:14:39.733939+0000","last_became_peered":"2024-09-17T03:14:39.733939+0000","last_unstale":"2024-09-17T03:14:40.734591+0000","last_undegraded":"2024-09-17T03:14:40.734591+0000","last_fullsized":"2024-09-17T03:14:40.734591+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:08.861415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733631+0000","last_change":"2024-09-17T03:14:39.734027+0000","last_active":"2024-09-17T03:14:40.733631+0000","last_peered":"2024-09-17T03:14:40.733631+0000","last_clean":"2024-09-17T03:14:40.733631+0000","last_became_active":"2024-09-17T03:14:39.733242+0000","last_became_peered":"2024-09-17T03:14:39.733242+0000","last_unstale":"2024-09-17T03:14:40.733631+0000","last_undegraded":"2024-09-17T03:14:40.733631+0000","last_fullsized":"2024-09-17T03:14:40.733631+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:55.165531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732964+0000","last_change":"2024-09-17T03:14:39.735409+0000","last_active":"2024-09-17T03:14:40.732964+0000","last_peered":"2024-09-17T03:14:40.732964+0000","last_clean":"2024-09-17T03:14:40.732964+0000","last_became_active":"2024-09-17T03:14:39.735057+0000","last_became_peered":"2024-09-17T03:14:39.735057+0000","last_unstale":"2024-09-17T03:14:40.732964+0000","last_undegraded":"2024-09-17T03:14:40.732964+0000","last_fullsized":"2024-09-17T03:14:40.732964+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:10.239971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.740242+0000","last_change":"2024-09-17T03:14:39.736837+0000","last_active":"2024-09-17T03:14:39.740242+0000","last_peered":"2024-09-17T03:14:39.740242+0000","last_clean":"2024-09-17T03:14:39.740242+0000","last_became_active":"2024-09-17T03:14:39.736492+0000","last_became_peered":"2024-09-17T03:14:39.736492+0000","last_unstale":"2024-09-17T03:14:39.740242+0000","last_undegraded":"2024-09-17T03:14:39.740242+0000","last_fullsized":"2024-09-17T03:14:39.740242+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:12.160973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733518+0000","last_change":"2024-09-17T03:14:39.730615+0000","last_active":"2024-09-17T03:14:40.733518+0000","last_peered":"2024-09-17T03:14:40.733518+0000","last_clean":"2024-09-17T03:14:40.733518+0000","last_became_active":"2024-09-17T03:14:39.730226+0000","last_became_peered":"2024-09-17T03:14:39.730226+0000","last_unstale":"2024-09-17T03:14:40.733518+0000","last_undegraded":"2024-09-17T03:14:40.733518+0000","last_fullsized":"2024-09-17T03:14:40.733518+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:56.700908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.148011+0000","last_change":"2024-09-17T03:14:39.735367+0000","last_active":"2024-09-17T03:14:41.148011+0000","last_peered":"2024-09-17T03:14:41.148011+0000","last_clean":"2024-09-17T03:14:41.148011+0000","last_became_active":"2024-09-17T03:14:39.735040+0000","last_became_peered":"2024-09-17T03:14:39.735040+0000","last_unstale":"2024-09-17T03:14:41.148011+0000","last_undegraded":"2024-09-17T03:14:41.148011+0000","last_fullsized":"2024-09-17T03:14:41.148011+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:57:25.310577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731454+0000","last_change":"2024-09-17T03:14:39.746302+0000","last_active":"2024-09-17T03:14:40.731454+0000","last_peered":"2024-09-17T03:14:40.731454+0000","last_clean":"2024-09-17T03:14:40.731454+0000","last_became_active":"2024-09-17T03:14:39.744886+0000","last_became_peered":"2024-09-17T03:14:39.744886+0000","last_unstale":"2024-09-17T03:14:40.731454+0000","last_undegraded":"2024-09-17T03:14:40.731454+0000","last_fullsized":"2024-09-17T03:14:40.731454+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:38.581121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.148096+0000","last_change":"2024-09-17T03:14:39.734318+0000","last_active":"2024-09-17T03:14:41.148096+0000","last_peered":"2024-09-17T03:14:41.148096+0000","last_clean":"2024-09-17T03:14:41.148096+0000","last_became_active":"2024-09-17T03:14:39.732813+0000","last_became_peered":"2024-09-17T03:14:39.732813+0000","last_unstale":"2024-09-17T03:14:41.148096+0000","last_undegraded":"2024-09-17T03:14:41.148096+0000","last_fullsized":"2024-09-17T03:14:41.148096+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:15:34.352226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.741190+0000","last_change":"2024-09-17T03:14:39.738501+0000","last_active":"2024-09-17T03:14:39.741190+0000","last_peered":"2024-09-17T03:14:39.741190+0000","last_clean":"2024-09-17T03:14:39.741190+0000","last_became_active":"2024-09-17T03:14:39.738133+0000","last_became_peered":"2024-09-17T03:14:39.738133+0000","last_unstale":"2024-09-17T03:14:39.741190+0000","last_undegraded":"2024-09-17T03:14:39.741190+0000","last_fullsized":"2024-09-17T03:14:39.741190+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:23.938553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734934+0000","last_change":"2024-09-17T03:14:39.729506+0000","last_active":"2024-09-17T03:14:40.734934+0000","last_peered":"2024-09-17T03:14:40.734934+0000","last_clean":"2024-09-17T03:14:40.734934+0000","last_became_active":"2024-09-17T03:14:39.729204+0000","last_became_peered":"2024-09-17T03:14:39.729204+0000","last_unstale":"2024-09-17T03:14:40.734934+0000","last_undegraded":"2024-09-17T03:14:40.734934+0000","last_fullsized":"2024-09-17T03:14:40.734934+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:26:18.554241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.148279+0000","last_change":"2024-09-17T03:14:39.743113+0000","last_active":"2024-09-17T03:14:41.148279+0000","last_peered":"2024-09-17T03:14:41.148279+0000","last_clean":"2024-09-17T03:14:41.148279+0000","last_became_active":"2024-09-17T03:14:39.742790+0000","last_became_peered":"2024-09-17T03:14:39.742790+0000","last_unstale":"2024-09-17T03:14:41.148279+0000","last_undegraded":"2024-09-17T03:14:41.148279+0000","last_fullsized":"2024-09-17T03:14:41.148279+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:04:30.017809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732031+0000","last_change":"2024-09-17T03:14:39.742392+0000","last_active":"2024-09-17T03:14:40.732031+0000","last_peered":"2024-09-17T03:14:40.732031+0000","last_clean":"2024-09-17T03:14:40.732031+0000","last_became_active":"2024-09-17T03:14:39.741872+0000","last_became_peered":"2024-09-17T03:14:39.741872+0000","last_unstale":"2024-09-17T03:14:40.732031+0000","last_undegraded":"2024-09-17T03:14:40.732031+0000","last_fullsized":"2024-09-17T03:14:40.732031+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:29.124125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733731+0000","last_change":"2024-09-17T03:14:39.727613+0000","last_active":"2024-09-17T03:14:40.733731+0000","last_peered":"2024-09-17T03:14:40.733731+0000","last_clean":"2024-09-17T03:14:40.733731+0000","last_became_active":"2024-09-17T03:14:39.727304+0000","last_became_peered":"2024-09-17T03:14:39.727304+0000","last_unstale":"2024-09-17T03:14:40.733731+0000","last_undegraded":"2024-09-17T03:14:40.733731+0000","last_fullsized":"2024-09-17T03:14:40.733731+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:26:18.121319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731677+0000","last_change":"2024-09-17T03:14:39.744940+0000","last_active":"2024-09-17T03:14:40.731677+0000","last_peered":"2024-09-17T03:14:40.731677+0000","last_clean":"2024-09-17T03:14:40.731677+0000","last_became_active":"2024-09-17T03:14:39.744312+0000","last_became_peered":"2024-09-17T03:14:39.744312+0000","last_unstale":"2024-09-17T03:14:40.731677+0000","last_undegraded":"2024-09-17T03:14:40.731677+0000","last_fullsized":"2024-09-17T03:14:40.731677+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:50:22.543846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734602+0000","last_change":"2024-09-17T03:14:39.736104+0000","last_active":"2024-09-17T03:14:40.734602+0000","last_peered":"2024-09-17T03:14:40.734602+0000","last_clean":"2024-09-17T03:14:40.734602+0000","last_became_active":"2024-09-17T03:14:39.735788+0000","last_became_peered":"2024-09-17T03:14:39.735788+0000","last_unstale":"2024-09-17T03:14:40.734602+0000","last_undegraded":"2024-09-17T03:14:40.734602+0000","last_fullsized":"2024-09-17T03:14:40.734602+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:22.215207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734590+0000","last_change":"2024-09-17T03:14:39.735296+0000","last_active":"2024-09-17T03:14:40.734590+0000","last_peered":"2024-09-17T03:14:40.734590+0000","last_clean":"2024-09-17T03:14:40.734590+0000","last_became_active":"2024-09-17T03:14:39.735007+0000","last_became_peered":"2024-09-17T03:14:39.735007+0000","last_unstale":"2024-09-17T03:14:40.734590+0000","last_undegraded":"2024-09-17T03:14:40.734590+0000","last_fullsized":"2024-09-17T03:14:40.734590+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:49:21.612588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.747057+0000","last_change":"2024-09-17T03:14:39.745401+0000","last_active":"2024-09-17T03:14:39.747057+0000","last_peered":"2024-09-17T03:14:39.747057+0000","last_clean":"2024-09-17T03:14:39.747057+0000","last_became_active":"2024-09-17T03:14:39.745025+0000","last_became_peered":"2024-09-17T03:14:39.745025+0000","last_unstale":"2024-09-17T03:14:39.747057+0000","last_undegraded":"2024-09-17T03:14:39.747057+0000","last_fullsized":"2024-09-17T03:14:39.747057+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:44.027187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732914+0000","last_change":"2024-09-17T03:14:39.738337+0000","last_active":"2024-09-17T03:14:40.732914+0000","last_peered":"2024-09-17T03:14:40.732914+0000","last_clean":"2024-09-17T03:14:40.732914+0000","last_became_active":"2024-09-17T03:14:39.734323+0000","last_became_peered":"2024-09-17T03:14:39.734323+0000","last_unstale":"2024-09-17T03:14:40.732914+0000","last_undegraded":"2024-09-17T03:14:40.732914+0000","last_fullsized":"2024-09-17T03:14:40.732914+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:07.959838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.735055+0000","last_change":"2024-09-17T03:14:39.728305+0000","last_active":"2024-09-17T03:14:40.735055+0000","last_peered":"2024-09-17T03:14:40.735055+0000","last_clean":"2024-09-17T03:14:40.735055+0000","last_became_active":"2024-09-17T03:14:39.727967+0000","last_became_peered":"2024-09-17T03:14:39.727967+0000","last_unstale":"2024-09-17T03:14:40.735055+0000","last_undegraded":"2024-09-17T03:14:40.735055+0000","last_fullsized":"2024-09-17T03:14:40.735055+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:53:42.810255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.744769+0000","last_change":"2024-09-17T03:14:39.743673+0000","last_active":"2024-09-17T03:14:39.744769+0000","last_peered":"2024-09-17T03:14:39.744769+0000","last_clean":"2024-09-17T03:14:39.744769+0000","last_became_active":"2024-09-17T03:14:39.743335+0000","last_became_peered":"2024-09-17T03:14:39.743335+0000","last_unstale":"2024-09-17T03:14:39.744769+0000","last_undegraded":"2024-09-17T03:14:39.744769+0000","last_fullsized":"2024-09-17T03:14:39.744769+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:05.089943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733918+0000","last_change":"2024-09-17T03:14:39.728064+0000","last_active":"2024-09-17T03:14:40.733918+0000","last_peered":"2024-09-17T03:14:40.733918+0000","last_clean":"2024-09-17T03:14:40.733918+0000","last_became_active":"2024-09-17T03:14:39.727719+0000","last_became_peered":"2024-09-17T03:14:39.727719+0000","last_unstale":"2024-09-17T03:14:40.733918+0000","last_undegraded":"2024-09-17T03:14:40.733918+0000","last_fullsized":"2024-09-17T03:14:40.733918+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:17.060083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734811+0000","last_change":"2024-09-17T03:14:39.728215+0000","last_active":"2024-09-17T03:14:40.734811+0000","last_peered":"2024-09-17T03:14:40.734811+0000","last_clean":"2024-09-17T03:14:40.734811+0000","last_became_active":"2024-09-17T03:14:39.727901+0000","last_became_peered":"2024-09-17T03:14:39.727901+0000","last_unstale":"2024-09-17T03:14:40.734811+0000","last_undegraded":"2024-09-17T03:14:40.734811+0000","last_fullsized":"2024-09-17T03:14:40.734811+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:59.305964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731849+0000","last_change":"2024-09-17T03:14:39.745936+0000","last_active":"2024-09-17T03:14:40.731849+0000","last_peered":"2024-09-17T03:14:40.731849+0000","last_clean":"2024-09-17T03:14:40.731849+0000","last_became_active":"2024-09-17T03:14:39.745575+0000","last_became_peered":"2024-09-17T03:14:39.745575+0000","last_unstale":"2024-09-17T03:14:40.731849+0000","last_undegraded":"2024-09-17T03:14:40.731849+0000","last_fullsized":"2024-09-17T03:14:40.731849+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:58.442579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.148025+0000","last_change":"2024-09-17T03:14:39.736227+0000","last_active":"2024-09-17T03:14:41.148025+0000","last_peered":"2024-09-17T03:14:41.148025+0000","last_clean":"2024-09-17T03:14:41.148025+0000","last_became_active":"2024-09-17T03:14:39.735883+0000","last_became_peered":"2024-09-17T03:14:39.735883+0000","last_unstale":"2024-09-17T03:14:41.148025+0000","last_undegraded":"2024-09-17T03:14:41.148025+0000","last_fullsized":"2024-09-17T03:14:41.148025+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:32:37.255785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.730148+0000","last_change":"2024-09-17T03:14:39.728103+0000","last_active":"2024-09-17T03:14:39.730148+0000","last_peered":"2024-09-17T03:14:39.730148+0000","last_clean":"2024-09-17T03:14:39.730148+0000","last_became_active":"2024-09-17T03:14:39.727782+0000","last_became_peered":"2024-09-17T03:14:39.727782+0000","last_unstale":"2024-09-17T03:14:39.730148+0000","last_undegraded":"2024-09-17T03:14:39.730148+0000","last_fullsized":"2024-09-17T03:14:39.730148+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:47:44.195241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731840+0000","last_change":"2024-09-17T03:14:39.745074+0000","last_active":"2024-09-17T03:14:40.731840+0000","last_peered":"2024-09-17T03:14:40.731840+0000","last_clean":"2024-09-17T03:14:40.731840+0000","last_became_active":"2024-09-17T03:14:39.744149+0000","last_became_peered":"2024-09-17T03:14:39.744149+0000","last_unstale":"2024-09-17T03:14:40.731840+0000","last_undegraded":"2024-09-17T03:14:40.731840+0000","last_fullsized":"2024-09-17T03:14:40.731840+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:09.253440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"94'4","reported_seq":19,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734859+0000","last_change":"2024-09-17T03:14:38.707391+0000","last_active":"2024-09-17T03:14:40.734859+0000","last_peered":"2024-09-17T03:14:40.734859+0000","last_clean":"2024-09-17T03:14:40.734859+0000","last_became_active":"2024-09-17T03:14:38.706395+0000","last_became_peered":"2024-09-17T03:14:38.706395+0000","last_unstale":"2024-09-17T03:14:40.734859+0000","last_undegraded":"2024-09-17T03:14:40.734859+0000","last_fullsized":"2024-09-17T03:14:40.734859+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:33.185402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.148357+0000","last_change":"2024-09-17T03:14:39.739447+0000","last_active":"2024-09-17T03:14:41.148357+0000","last_peered":"2024-09-17T03:14:41.148357+0000","last_clean":"2024-09-17T03:14:41.148357+0000","last_became_active":"2024-09-17T03:14:39.739106+0000","last_became_peered":"2024-09-17T03:14:39.739106+0000","last_unstale":"2024-09-17T03:14:41.148357+0000","last_undegraded":"2024-09-17T03:14:41.148357+0000","last_fullsized":"2024-09-17T03:14:41.148357+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:33:55.010504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"94'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.751822+0000","last_change":"2024-09-17T03:14:38.722488+0000","last_active":"2024-09-17T03:14:39.751822+0000","last_peered":"2024-09-17T03:14:39.751822+0000","last_clean":"2024-09-17T03:14:39.751822+0000","last_became_active":"2024-09-17T03:14:38.722188+0000","last_became_peered":"2024-09-17T03:14:38.722188+0000","last_unstale":"2024-09-17T03:14:39.751822+0000","last_undegraded":"2024-09-17T03:14:39.751822+0000","last_fullsized":"2024-09-17T03:14:39.751822+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:56.787513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.743056+0000","last_change":"2024-09-17T03:14:39.734250+0000","last_active":"2024-09-17T03:14:39.743056+0000","last_peered":"2024-09-17T03:14:39.743056+0000","last_clean":"2024-09-17T03:14:39.743056+0000","last_became_active":"2024-09-17T03:14:39.733922+0000","last_became_peered":"2024-09-17T03:14:39.733922+0000","last_unstale":"2024-09-17T03:14:39.743056+0000","last_undegraded":"2024-09-17T03:14:39.743056+0000","last_fullsized":"2024-09-17T03:14:39.743056+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:47:24.446680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"94'2","reported_seq":17,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734798+0000","last_change":"2024-09-17T03:14:38.712875+0000","last_active":"2024-09-17T03:14:40.734798+0000","last_peered":"2024-09-17T03:14:40.734798+0000","last_clean":"2024-09-17T03:14:40.734798+0000","last_became_active":"2024-09-17T03:14:38.712536+0000","last_became_peered":"2024-09-17T03:14:38.712536+0000","last_unstale":"2024-09-17T03:14:40.734798+0000","last_undegraded":"2024-09-17T03:14:40.734798+0000","last_fullsized":"2024-09-17T03:14:40.734798+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:22.931117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733632+0000","last_change":"2024-09-17T03:14:39.734250+0000","last_active":"2024-09-17T03:14:40.733632+0000","last_peered":"2024-09-17T03:14:40.733632+0000","last_clean":"2024-09-17T03:14:40.733632+0000","last_became_active":"2024-09-17T03:14:39.732241+0000","last_became_peered":"2024-09-17T03:14:39.732241+0000","last_unstale":"2024-09-17T03:14:40.733632+0000","last_undegraded":"2024-09-17T03:14:40.733632+0000","last_fullsized":"2024-09-17T03:14:40.733632+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:12.160973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"94'2","reported_seq":17,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734680+0000","last_change":"2024-09-17T03:14:38.711933+0000","last_active":"2024-09-17T03:14:40.734680+0000","last_peered":"2024-09-17T03:14:40.734680+0000","last_clean":"2024-09-17T03:14:40.734680+0000","last_became_active":"2024-09-17T03:14:38.711190+0000","last_became_peered":"2024-09-17T03:14:38.711190+0000","last_unstale":"2024-09-17T03:14:40.734680+0000","last_undegraded":"2024-09-17T03:14:40.734680+0000","last_fullsized":"2024-09-17T03:14:40.734680+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:51.038436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.741740+0000","last_change":"2024-09-17T03:14:39.733975+0000","last_active":"2024-09-17T03:14:39.741740+0000","last_peered":"2024-09-17T03:14:39.741740+0000","last_clean":"2024-09-17T03:14:39.741740+0000","last_became_active":"2024-09-17T03:14:39.733543+0000","last_became_peered":"2024-09-17T03:14:39.733543+0000","last_unstale":"2024-09-17T03:14:39.741740+0000","last_undegraded":"2024-09-17T03:14:39.741740+0000","last_fullsized":"2024-09-17T03:14:39.741740+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:44.652406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"94'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.746097+0000","last_change":"2024-09-17T03:14:38.714844+0000","last_active":"2024-09-17T03:14:39.746097+0000","last_peered":"2024-09-17T03:14:39.746097+0000","last_clean":"2024-09-17T03:14:39.746097+0000","last_became_active":"2024-09-17T03:14:38.714522+0000","last_became_peered":"2024-09-17T03:14:38.714522+0000","last_unstale":"2024-09-17T03:14:39.746097+0000","last_undegraded":"2024-09-17T03:14:39.746097+0000","last_fullsized":"2024-09-17T03:14:39.746097+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:28.184905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.740920+0000","last_change":"2024-09-17T03:14:39.739885+0000","last_active":"2024-09-17T03:14:39.740920+0000","last_peered":"2024-09-17T03:14:39.740920+0000","last_clean":"2024-09-17T03:14:39.740920+0000","last_became_active":"2024-09-17T03:14:39.739500+0000","last_became_peered":"2024-09-17T03:14:39.739500+0000","last_unstale":"2024-09-17T03:14:39.740920+0000","last_undegraded":"2024-09-17T03:14:39.740920+0000","last_fullsized":"2024-09-17T03:14:39.740920+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:52.045872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"94'1","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734539+0000","last_change":"2024-09-17T03:14:38.721448+0000","last_active":"2024-09-17T03:14:40.734539+0000","last_peered":"2024-09-17T03:14:40.734539+0000","last_clean":"2024-09-17T03:14:40.734539+0000","last_became_active":"2024-09-17T03:14:38.720283+0000","last_became_peered":"2024-09-17T03:14:38.720283+0000","last_unstale":"2024-09-17T03:14:40.734539+0000","last_undegraded":"2024-09-17T03:14:40.734539+0000","last_fullsized":"2024-09-17T03:14:40.734539+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:56:22.951906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.148264+0000","last_change":"2024-09-17T03:14:39.732270+0000","last_active":"2024-09-17T03:14:41.148264+0000","last_peered":"2024-09-17T03:14:41.148264+0000","last_clean":"2024-09-17T03:14:41.148264+0000","last_became_active":"2024-09-17T03:14:39.731972+0000","last_became_peered":"2024-09-17T03:14:39.731972+0000","last_unstale":"2024-09-17T03:14:41.148264+0000","last_undegraded":"2024-09-17T03:14:41.148264+0000","last_fullsized":"2024-09-17T03:14:41.148264+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:14:25.993886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733311+0000","last_change":"2024-09-17T03:14:38.713223+0000","last_active":"2024-09-17T03:14:40.733311+0000","last_peered":"2024-09-17T03:14:40.733311+0000","last_clean":"2024-09-17T03:14:40.733311+0000","last_became_active":"2024-09-17T03:14:38.712318+0000","last_became_peered":"2024-09-17T03:14:38.712318+0000","last_unstale":"2024-09-17T03:14:40.733311+0000","last_undegraded":"2024-09-17T03:14:40.733311+0000","last_fullsized":"2024-09-17T03:14:40.733311+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:17.142652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732638+0000","last_change":"2024-09-17T03:14:39.733497+0000","last_active":"2024-09-17T03:14:40.732638+0000","last_peered":"2024-09-17T03:14:40.732638+0000","last_clean":"2024-09-17T03:14:40.732638+0000","last_became_active":"2024-09-17T03:14:39.732893+0000","last_became_peered":"2024-09-17T03:14:39.732893+0000","last_unstale":"2024-09-17T03:14:40.732638+0000","last_undegraded":"2024-09-17T03:14:40.732638+0000","last_fullsized":"2024-09-17T03:14:40.732638+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:56.109125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.722768+0000","last_change":"2024-09-17T03:14:38.720560+0000","last_active":"2024-09-17T03:14:39.722768+0000","last_peered":"2024-09-17T03:14:39.722768+0000","last_clean":"2024-09-17T03:14:39.722768+0000","last_became_active":"2024-09-17T03:14:38.720234+0000","last_became_peered":"2024-09-17T03:14:38.720234+0000","last_unstale":"2024-09-17T03:14:39.722768+0000","last_undegraded":"2024-09-17T03:14:39.722768+0000","last_fullsized":"2024-09-17T03:14:39.722768+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:34.960624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.735273+0000","last_change":"2024-09-17T03:14:39.734140+0000","last_active":"2024-09-17T03:14:40.735273+0000","last_peered":"2024-09-17T03:14:40.735273+0000","last_clean":"2024-09-17T03:14:40.735273+0000","last_became_active":"2024-09-17T03:14:39.733194+0000","last_became_peered":"2024-09-17T03:14:39.733194+0000","last_unstale":"2024-09-17T03:14:40.735273+0000","last_undegraded":"2024-09-17T03:14:40.735273+0000","last_fullsized":"2024-09-17T03:14:40.735273+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:28.079301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.723059+0000","last_change":"2024-09-17T03:14:38.717502+0000","last_active":"2024-09-17T03:14:39.723059+0000","last_peered":"2024-09-17T03:14:39.723059+0000","last_clean":"2024-09-17T03:14:39.723059+0000","last_became_active":"2024-09-17T03:14:38.717102+0000","last_became_peered":"2024-09-17T03:14:38.717102+0000","last_unstale":"2024-09-17T03:14:39.723059+0000","last_undegraded":"2024-09-17T03:14:39.723059+0000","last_fullsized":"2024-09-17T03:14:39.723059+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:14.321804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733817+0000","last_change":"2024-09-17T03:14:39.736754+0000","last_active":"2024-09-17T03:14:40.733817+0000","last_peered":"2024-09-17T03:14:40.733817+0000","last_clean":"2024-09-17T03:14:40.733817+0000","last_became_active":"2024-09-17T03:14:39.736265+0000","last_became_peered":"2024-09-17T03:14:39.736265+0000","last_unstale":"2024-09-17T03:14:40.733817+0000","last_undegraded":"2024-09-17T03:14:40.733817+0000","last_fullsized":"2024-09-17T03:14:40.733817+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:49.987554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.148206+0000","last_change":"2024-09-17T03:14:38.708558+0000","last_active":"2024-09-17T03:14:41.148206+0000","last_peered":"2024-09-17T03:14:41.148206+0000","last_clean":"2024-09-17T03:14:41.148206+0000","last_became_active":"2024-09-17T03:14:38.708246+0000","last_became_peered":"2024-09-17T03:14:38.708246+0000","last_unstale":"2024-09-17T03:14:41.148206+0000","last_undegraded":"2024-09-17T03:14:41.148206+0000","last_fullsized":"2024-09-17T03:14:41.148206+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:17.537060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734160+0000","last_change":"2024-09-17T03:14:39.723234+0000","last_active":"2024-09-17T03:14:40.734160+0000","last_peered":"2024-09-17T03:14:40.734160+0000","last_clean":"2024-09-17T03:14:40.734160+0000","last_became_active":"2024-09-17T03:14:39.722911+0000","last_became_peered":"2024-09-17T03:14:39.722911+0000","last_unstale":"2024-09-17T03:14:40.734160+0000","last_undegraded":"2024-09-17T03:14:40.734160+0000","last_fullsized":"2024-09-17T03:14:40.734160+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:30.411807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"94'3","reported_seq":16,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.747051+0000","last_change":"2024-09-17T03:14:38.713807+0000","last_active":"2024-09-17T03:14:39.747051+0000","last_peered":"2024-09-17T03:14:39.747051+0000","last_clean":"2024-09-17T03:14:39.747051+0000","last_became_active":"2024-09-17T03:14:38.713387+0000","last_became_peered":"2024-09-17T03:14:38.713387+0000","last_unstale":"2024-09-17T03:14:39.747051+0000","last_undegraded":"2024-09-17T03:14:39.747051+0000","last_fullsized":"2024-09-17T03:14:39.747051+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:39.115081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.740886+0000","last_change":"2024-09-17T03:14:39.739054+0000","last_active":"2024-09-17T03:14:39.740886+0000","last_peered":"2024-09-17T03:14:39.740886+0000","last_clean":"2024-09-17T03:14:39.740886+0000","last_became_active":"2024-09-17T03:14:39.738711+0000","last_became_peered":"2024-09-17T03:14:39.738711+0000","last_unstale":"2024-09-17T03:14:39.740886+0000","last_undegraded":"2024-09-17T03:14:39.740886+0000","last_fullsized":"2024-09-17T03:14:39.740886+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:34.192838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"94'6","reported_seq":21,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733854+0000","last_change":"2024-09-17T03:14:38.705326+0000","last_active":"2024-09-17T03:14:40.733854+0000","last_peered":"2024-09-17T03:14:40.733854+0000","last_clean":"2024-09-17T03:14:40.733854+0000","last_became_active":"2024-09-17T03:14:38.704905+0000","last_became_peered":"2024-09-17T03:14:38.704905+0000","last_unstale":"2024-09-17T03:14:40.733854+0000","last_undegraded":"2024-09-17T03:14:40.733854+0000","last_fullsized":"2024-09-17T03:14:40.733854+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:00:43.644970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.148102+0000","last_change":"2024-09-17T03:14:39.734060+0000","last_active":"2024-09-17T03:14:41.148102+0000","last_peered":"2024-09-17T03:14:41.148102+0000","last_clean":"2024-09-17T03:14:41.148102+0000","last_became_active":"2024-09-17T03:14:39.733714+0000","last_became_peered":"2024-09-17T03:14:39.733714+0000","last_unstale":"2024-09-17T03:14:41.148102+0000","last_undegraded":"2024-09-17T03:14:41.148102+0000","last_fullsized":"2024-09-17T03:14:41.148102+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:02:10.689353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"94'2","reported_seq":17,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731819+0000","last_change":"2024-09-17T03:14:38.716588+0000","last_active":"2024-09-17T03:14:40.731819+0000","last_peered":"2024-09-17T03:14:40.731819+0000","last_clean":"2024-09-17T03:14:40.731819+0000","last_became_active":"2024-09-17T03:14:38.716238+0000","last_became_peered":"2024-09-17T03:14:38.716238+0000","last_unstale":"2024-09-17T03:14:40.731819+0000","last_undegraded":"2024-09-17T03:14:40.731819+0000","last_fullsized":"2024-09-17T03:14:40.731819+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:30.435283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.751282+0000","last_change":"2024-09-17T03:14:39.745649+0000","last_active":"2024-09-17T03:14:39.751282+0000","last_peered":"2024-09-17T03:14:39.751282+0000","last_clean":"2024-09-17T03:14:39.751282+0000","last_became_active":"2024-09-17T03:14:39.745367+0000","last_became_peered":"2024-09-17T03:14:39.745367+0000","last_unstale":"2024-09-17T03:14:39.751282+0000","last_undegraded":"2024-09-17T03:14:39.751282+0000","last_fullsized":"2024-09-17T03:14:39.751282+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:46:26.342507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732095+0000","last_change":"2024-09-17T03:14:38.722910+0000","last_active":"2024-09-17T03:14:40.732095+0000","last_peered":"2024-09-17T03:14:40.732095+0000","last_clean":"2024-09-17T03:14:40.732095+0000","last_became_active":"2024-09-17T03:14:38.722381+0000","last_became_peered":"2024-09-17T03:14:38.722381+0000","last_unstale":"2024-09-17T03:14:40.732095+0000","last_undegraded":"2024-09-17T03:14:40.732095+0000","last_fullsized":"2024-09-17T03:14:40.732095+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:28:59.314874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732657+0000","last_change":"2024-09-17T03:14:39.740559+0000","last_active":"2024-09-17T03:14:40.732657+0000","last_peered":"2024-09-17T03:14:40.732657+0000","last_clean":"2024-09-17T03:14:40.732657+0000","last_became_active":"2024-09-17T03:14:39.740139+0000","last_became_peered":"2024-09-17T03:14:39.740139+0000","last_unstale":"2024-09-17T03:14:40.732657+0000","last_undegraded":"2024-09-17T03:14:40.732657+0000","last_fullsized":"2024-09-17T03:14:40.732657+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:04.311489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732838+0000","last_change":"2024-09-17T03:14:38.704032+0000","last_active":"2024-09-17T03:14:40.732838+0000","last_peered":"2024-09-17T03:14:40.732838+0000","last_clean":"2024-09-17T03:14:40.732838+0000","last_became_active":"2024-09-17T03:14:38.703699+0000","last_became_peered":"2024-09-17T03:14:38.703699+0000","last_unstale":"2024-09-17T03:14:40.732838+0000","last_undegraded":"2024-09-17T03:14:40.732838+0000","last_fullsized":"2024-09-17T03:14:40.732838+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:34.216584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731446+0000","last_change":"2024-09-17T03:14:39.741053+0000","last_active":"2024-09-17T03:14:40.731446+0000","last_peered":"2024-09-17T03:14:40.731446+0000","last_clean":"2024-09-17T03:14:40.731446+0000","last_became_active":"2024-09-17T03:14:39.740720+0000","last_became_peered":"2024-09-17T03:14:39.740720+0000","last_unstale":"2024-09-17T03:14:40.731446+0000","last_undegraded":"2024-09-17T03:14:40.731446+0000","last_fullsized":"2024-09-17T03:14:40.731446+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:27.948450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"94'8","reported_seq":21,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.751506+0000","last_change":"2024-09-17T03:14:38.720617+0000","last_active":"2024-09-17T03:14:39.751506+0000","last_peered":"2024-09-17T03:14:39.751506+0000","last_clean":"2024-09-17T03:14:39.751506+0000","last_became_active":"2024-09-17T03:14:38.720208+0000","last_became_peered":"2024-09-17T03:14:38.720208+0000","last_unstale":"2024-09-17T03:14:39.751506+0000","last_undegraded":"2024-09-17T03:14:39.751506+0000","last_fullsized":"2024-09-17T03:14:39.751506+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:37.677123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733602+0000","last_change":"2024-09-17T03:14:39.732728+0000","last_active":"2024-09-17T03:14:40.733602+0000","last_peered":"2024-09-17T03:14:40.733602+0000","last_clean":"2024-09-17T03:14:40.733602+0000","last_became_active":"2024-09-17T03:14:39.731291+0000","last_became_peered":"2024-09-17T03:14:39.731291+0000","last_unstale":"2024-09-17T03:14:40.733602+0000","last_undegraded":"2024-09-17T03:14:40.733602+0000","last_fullsized":"2024-09-17T03:14:40.733602+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:38.777956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"94'2","reported_seq":17,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733340+0000","last_change":"2024-09-17T03:14:38.715421+0000","last_active":"2024-09-17T03:14:40.733340+0000","last_peered":"2024-09-17T03:14:40.733340+0000","last_clean":"2024-09-17T03:14:40.733340+0000","last_became_active":"2024-09-17T03:14:38.714989+0000","last_became_peered":"2024-09-17T03:14:38.714989+0000","last_unstale":"2024-09-17T03:14:40.733340+0000","last_undegraded":"2024-09-17T03:14:40.733340+0000","last_fullsized":"2024-09-17T03:14:40.733340+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:03.733625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.744274+0000","last_change":"2024-09-17T03:14:39.741541+0000","last_active":"2024-09-17T03:14:39.744274+0000","last_peered":"2024-09-17T03:14:39.744274+0000","last_clean":"2024-09-17T03:14:39.744274+0000","last_became_active":"2024-09-17T03:14:39.740855+0000","last_became_peered":"2024-09-17T03:14:39.740855+0000","last_unstale":"2024-09-17T03:14:39.744274+0000","last_undegraded":"2024-09-17T03:14:39.744274+0000","last_fullsized":"2024-09-17T03:14:39.744274+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:04.741061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"94'1","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732983+0000","last_change":"2024-09-17T03:14:38.707749+0000","last_active":"2024-09-17T03:14:40.732983+0000","last_peered":"2024-09-17T03:14:40.732983+0000","last_clean":"2024-09-17T03:14:40.732983+0000","last_became_active":"2024-09-17T03:14:38.706360+0000","last_became_peered":"2024-09-17T03:14:38.706360+0000","last_unstale":"2024-09-17T03:14:40.732983+0000","last_undegraded":"2024-09-17T03:14:40.732983+0000","last_fullsized":"2024-09-17T03:14:40.732983+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:04:34.591324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.740215+0000","last_change":"2024-09-17T03:14:39.736771+0000","last_active":"2024-09-17T03:14:39.740215+0000","last_peered":"2024-09-17T03:14:39.740215+0000","last_clean":"2024-09-17T03:14:39.740215+0000","last_became_active":"2024-09-17T03:14:39.736429+0000","last_became_peered":"2024-09-17T03:14:39.736429+0000","last_unstale":"2024-09-17T03:14:39.740215+0000","last_undegraded":"2024-09-17T03:14:39.740215+0000","last_fullsized":"2024-09-17T03:14:39.740215+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:43:00.985338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734823+0000","last_change":"2024-09-17T03:14:38.712238+0000","last_active":"2024-09-17T03:14:40.734823+0000","last_peered":"2024-09-17T03:14:40.734823+0000","last_clean":"2024-09-17T03:14:40.734823+0000","last_became_active":"2024-09-17T03:14:38.711631+0000","last_became_peered":"2024-09-17T03:14:38.711631+0000","last_unstale":"2024-09-17T03:14:40.734823+0000","last_undegraded":"2024-09-17T03:14:40.734823+0000","last_fullsized":"2024-09-17T03:14:40.734823+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T03:50:04.082507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731989+0000","last_change":"2024-09-17T03:14:39.743745+0000","last_active":"2024-09-17T03:14:40.731989+0000","last_peered":"2024-09-17T03:14:40.731989+0000","last_clean":"2024-09-17T03:14:40.731989+0000","last_became_active":"2024-09-17T03:14:39.743114+0000","last_became_peered":"2024-09-17T03:14:39.743114+0000","last_unstale":"2024-09-17T03:14:40.731989+0000","last_undegraded":"2024-09-17T03:14:40.731989+0000","last_fullsized":"2024-09-17T03:14:40.731989+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:40:11.176958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"94'2","reported_seq":17,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734753+0000","last_change":"2024-09-17T03:14:38.718279+0000","last_active":"2024-09-17T03:14:40.734753+0000","last_peered":"2024-09-17T03:14:40.734753+0000","last_clean":"2024-09-17T03:14:40.734753+0000","last_became_active":"2024-09-17T03:14:38.717964+0000","last_became_peered":"2024-09-17T03:14:38.717964+0000","last_unstale":"2024-09-17T03:14:40.734753+0000","last_undegraded":"2024-09-17T03:14:40.734753+0000","last_fullsized":"2024-09-17T03:14:40.734753+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:59.977902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731633+0000","last_change":"2024-09-17T03:14:39.744608+0000","last_active":"2024-09-17T03:14:40.731633+0000","last_peered":"2024-09-17T03:14:40.731633+0000","last_clean":"2024-09-17T03:14:40.731633+0000","last_became_active":"2024-09-17T03:14:39.742779+0000","last_became_peered":"2024-09-17T03:14:39.742779+0000","last_unstale":"2024-09-17T03:14:40.731633+0000","last_undegraded":"2024-09-17T03:14:40.731633+0000","last_fullsized":"2024-09-17T03:14:40.731633+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:27.631444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.728326+0000","last_change":"2024-09-17T03:14:38.721990+0000","last_active":"2024-09-17T03:14:39.728326+0000","last_peered":"2024-09-17T03:14:39.728326+0000","last_clean":"2024-09-17T03:14:39.728326+0000","last_became_active":"2024-09-17T03:14:38.721643+0000","last_became_peered":"2024-09-17T03:14:38.721643+0000","last_unstale":"2024-09-17T03:14:39.728326+0000","last_undegraded":"2024-09-17T03:14:39.728326+0000","last_fullsized":"2024-09-17T03:14:39.728326+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:34.216584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731437+0000","last_change":"2024-09-17T03:14:39.746651+0000","last_active":"2024-09-17T03:14:40.731437+0000","last_peered":"2024-09-17T03:14:40.731437+0000","last_clean":"2024-09-17T03:14:40.731437+0000","last_became_active":"2024-09-17T03:14:39.745278+0000","last_became_peered":"2024-09-17T03:14:39.745278+0000","last_unstale":"2024-09-17T03:14:40.731437+0000","last_undegraded":"2024-09-17T03:14:40.731437+0000","last_fullsized":"2024-09-17T03:14:40.731437+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:55.141854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":13,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.728035+0000","last_change":"2024-09-17T03:14:38.711885+0000","last_active":"2024-09-17T03:14:39.728035+0000","last_peered":"2024-09-17T03:14:39.728035+0000","last_clean":"2024-09-17T03:14:39.728035+0000","last_became_active":"2024-09-17T03:14:38.711510+0000","last_became_peered":"2024-09-17T03:14:38.711510+0000","last_unstale":"2024-09-17T03:14:39.728035+0000","last_undegraded":"2024-09-17T03:14:39.728035+0000","last_fullsized":"2024-09-17T03:14:39.728035+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:08.890814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732985+0000","last_change":"2024-09-17T03:14:39.736817+0000","last_active":"2024-09-17T03:14:40.732985+0000","last_peered":"2024-09-17T03:14:40.732985+0000","last_clean":"2024-09-17T03:14:40.732985+0000","last_became_active":"2024-09-17T03:14:39.736409+0000","last_became_peered":"2024-09-17T03:14:39.736409+0000","last_unstale":"2024-09-17T03:14:40.732985+0000","last_undegraded":"2024-09-17T03:14:40.732985+0000","last_fullsized":"2024-09-17T03:14:40.732985+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:22.746628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734512+0000","last_change":"2024-09-17T03:14:38.722199+0000","last_active":"2024-09-17T03:14:40.734512+0000","last_peered":"2024-09-17T03:14:40.734512+0000","last_clean":"2024-09-17T03:14:40.734512+0000","last_became_active":"2024-09-17T03:14:38.721877+0000","last_became_peered":"2024-09-17T03:14:38.721877+0000","last_unstale":"2024-09-17T03:14:40.734512+0000","last_undegraded":"2024-09-17T03:14:40.734512+0000","last_fullsized":"2024-09-17T03:14:40.734512+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:30.665450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.735270+0000","last_change":"2024-09-17T03:14:39.734220+0000","last_active":"2024-09-17T03:14:40.735270+0000","last_peered":"2024-09-17T03:14:40.735270+0000","last_clean":"2024-09-17T03:14:40.735270+0000","last_became_active":"2024-09-17T03:14:39.733637+0000","last_became_peered":"2024-09-17T03:14:39.733637+0000","last_unstale":"2024-09-17T03:14:40.735270+0000","last_undegraded":"2024-09-17T03:14:40.735270+0000","last_fullsized":"2024-09-17T03:14:40.735270+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:27.921118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"94'2","reported_seq":15,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.745981+0000","last_change":"2024-09-17T03:14:38.707857+0000","last_active":"2024-09-17T03:14:39.745981+0000","last_peered":"2024-09-17T03:14:39.745981+0000","last_clean":"2024-09-17T03:14:39.745981+0000","last_became_active":"2024-09-17T03:14:38.707414+0000","last_became_peered":"2024-09-17T03:14:38.707414+0000","last_unstale":"2024-09-17T03:14:39.745981+0000","last_undegraded":"2024-09-17T03:14:39.745981+0000","last_fullsized":"2024-09-17T03:14:39.745981+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:02.712647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.751237+0000","last_change":"2024-09-17T03:14:39.744204+0000","last_active":"2024-09-17T03:14:39.751237+0000","last_peered":"2024-09-17T03:14:39.751237+0000","last_clean":"2024-09-17T03:14:39.751237+0000","last_became_active":"2024-09-17T03:14:39.743896+0000","last_became_peered":"2024-09-17T03:14:39.743896+0000","last_unstale":"2024-09-17T03:14:39.751237+0000","last_undegraded":"2024-09-17T03:14:39.751237+0000","last_fullsized":"2024-09-17T03:14:39.751237+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:40:07.997437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"95'1","reported_seq":16,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.736551+0000","last_change":"2024-09-17T03:14:38.718342+0000","last_active":"2024-09-17T03:14:40.736551+0000","last_peered":"2024-09-17T03:14:40.736551+0000","last_clean":"2024-09-17T03:14:40.736551+0000","last_became_active":"2024-09-17T03:14:38.718022+0000","last_became_peered":"2024-09-17T03:14:38.718022+0000","last_unstale":"2024-09-17T03:14:40.736551+0000","last_undegraded":"2024-09-17T03:14:40.736551+0000","last_fullsized":"2024-09-17T03:14:40.736551+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:27.057811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.746103+0000","last_change":"2024-09-17T03:14:39.739530+0000","last_active":"2024-09-17T03:14:39.746103+0000","last_peered":"2024-09-17T03:14:39.746103+0000","last_clean":"2024-09-17T03:14:39.746103+0000","last_became_active":"2024-09-17T03:14:39.739180+0000","last_became_peered":"2024-09-17T03:14:39.739180+0000","last_unstale":"2024-09-17T03:14:39.746103+0000","last_undegraded":"2024-09-17T03:14:39.746103+0000","last_fullsized":"2024-09-17T03:14:39.746103+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:23:24.477828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734873+0000","last_change":"2024-09-17T03:14:38.711340+0000","last_active":"2024-09-17T03:14:40.734873+0000","last_peered":"2024-09-17T03:14:40.734873+0000","last_clean":"2024-09-17T03:14:40.734873+0000","last_became_active":"2024-09-17T03:14:38.711043+0000","last_became_peered":"2024-09-17T03:14:38.711043+0000","last_unstale":"2024-09-17T03:14:40.734873+0000","last_undegraded":"2024-09-17T03:14:40.734873+0000","last_fullsized":"2024-09-17T03:14:40.734873+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:40:11.153538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732846+0000","last_change":"2024-09-17T03:14:39.728575+0000","last_active":"2024-09-17T03:14:40.732846+0000","last_peered":"2024-09-17T03:14:40.732846+0000","last_clean":"2024-09-17T03:14:40.732846+0000","last_became_active":"2024-09-17T03:14:39.728260+0000","last_became_peered":"2024-09-17T03:14:39.728260+0000","last_unstale":"2024-09-17T03:14:40.732846+0000","last_undegraded":"2024-09-17T03:14:40.732846+0000","last_fullsized":"2024-09-17T03:14:40.732846+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:05:35.839069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734261+0000","last_change":"2024-09-17T03:14:38.713767+0000","last_active":"2024-09-17T03:14:40.734261+0000","last_peered":"2024-09-17T03:14:40.734261+0000","last_clean":"2024-09-17T03:14:40.734261+0000","last_became_active":"2024-09-17T03:14:38.713392+0000","last_became_peered":"2024-09-17T03:14:38.713392+0000","last_unstale":"2024-09-17T03:14:40.734261+0000","last_undegraded":"2024-09-17T03:14:40.734261+0000","last_fullsized":"2024-09-17T03:14:40.734261+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:41:00.506023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732022+0000","last_change":"2024-09-17T03:14:39.743426+0000","last_active":"2024-09-17T03:14:40.732022+0000","last_peered":"2024-09-17T03:14:40.732022+0000","last_clean":"2024-09-17T03:14:40.732022+0000","last_became_active":"2024-09-17T03:14:39.741936+0000","last_became_peered":"2024-09-17T03:14:39.741936+0000","last_unstale":"2024-09-17T03:14:40.732022+0000","last_undegraded":"2024-09-17T03:14:40.732022+0000","last_fullsized":"2024-09-17T03:14:40.732022+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:38.550150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734925+0000","last_change":"2024-09-17T03:14:38.708426+0000","last_active":"2024-09-17T03:14:40.734925+0000","last_peered":"2024-09-17T03:14:40.734925+0000","last_clean":"2024-09-17T03:14:40.734925+0000","last_became_active":"2024-09-17T03:14:38.708114+0000","last_became_peered":"2024-09-17T03:14:38.708114+0000","last_unstale":"2024-09-17T03:14:40.734925+0000","last_undegraded":"2024-09-17T03:14:40.734925+0000","last_fullsized":"2024-09-17T03:14:40.734925+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:08:43.019751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.734084+0000","last_change":"2024-09-17T03:14:39.732620+0000","last_active":"2024-09-17T03:14:40.734084+0000","last_peered":"2024-09-17T03:14:40.734084+0000","last_clean":"2024-09-17T03:14:40.734084+0000","last_became_active":"2024-09-17T03:14:39.732224+0000","last_became_peered":"2024-09-17T03:14:39.732224+0000","last_unstale":"2024-09-17T03:14:40.734084+0000","last_undegraded":"2024-09-17T03:14:40.734084+0000","last_fullsized":"2024-09-17T03:14:40.734084+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:10.860898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.732633+0000","last_change":"2024-09-17T03:14:38.721900+0000","last_active":"2024-09-17T03:14:40.732633+0000","last_peered":"2024-09-17T03:14:40.732633+0000","last_clean":"2024-09-17T03:14:40.732633+0000","last_became_active":"2024-09-17T03:14:38.721548+0000","last_became_peered":"2024-09-17T03:14:38.721548+0000","last_unstale":"2024-09-17T03:14:40.732633+0000","last_undegraded":"2024-09-17T03:14:40.732633+0000","last_fullsized":"2024-09-17T03:14:40.732633+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:22.749287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731688+0000","last_change":"2024-09-17T03:14:39.742627+0000","last_active":"2024-09-17T03:14:40.731688+0000","last_peered":"2024-09-17T03:14:40.731688+0000","last_clean":"2024-09-17T03:14:40.731688+0000","last_became_active":"2024-09-17T03:14:39.742331+0000","last_became_peered":"2024-09-17T03:14:39.742331+0000","last_unstale":"2024-09-17T03:14:40.731688+0000","last_undegraded":"2024-09-17T03:14:40.731688+0000","last_fullsized":"2024-09-17T03:14:40.731688+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:00.610836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.148170+0000","last_change":"2024-09-17T03:14:38.720985+0000","last_active":"2024-09-17T03:14:41.148170+0000","last_peered":"2024-09-17T03:14:41.148170+0000","last_clean":"2024-09-17T03:14:41.148170+0000","last_became_active":"2024-09-17T03:14:38.720619+0000","last_became_peered":"2024-09-17T03:14:38.720619+0000","last_unstale":"2024-09-17T03:14:41.148170+0000","last_undegraded":"2024-09-17T03:14:41.148170+0000","last_fullsized":"2024-09-17T03:14:41.148170+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:52.989178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.733148+0000","last_change":"2024-09-17T03:14:39.730119+0000","last_active":"2024-09-17T03:14:40.733148+0000","last_peered":"2024-09-17T03:14:40.733148+0000","last_clean":"2024-09-17T03:14:40.733148+0000","last_became_active":"2024-09-17T03:14:39.729716+0000","last_became_peered":"2024-09-17T03:14:39.729716+0000","last_unstale":"2024-09-17T03:14:40.733148+0000","last_undegraded":"2024-09-17T03:14:40.733148+0000","last_fullsized":"2024-09-17T03:14:40.733148+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:00.950525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":15,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731555+0000","last_change":"2024-09-17T03:14:38.715698+0000","last_active":"2024-09-17T03:14:40.731555+0000","last_peered":"2024-09-17T03:14:40.731555+0000","last_clean":"2024-09-17T03:14:40.731555+0000","last_became_active":"2024-09-17T03:14:38.715407+0000","last_became_peered":"2024-09-17T03:14:38.715407+0000","last_unstale":"2024-09-17T03:14:40.731555+0000","last_undegraded":"2024-09-17T03:14:40.731555+0000","last_fullsized":"2024-09-17T03:14:40.731555+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:02.357008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":13,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:40.731915+0000","last_change":"2024-09-17T03:14:39.745519+0000","last_active":"2024-09-17T03:14:40.731915+0000","last_peered":"2024-09-17T03:14:40.731915+0000","last_clean":"2024-09-17T03:14:40.731915+0000","last_became_active":"2024-09-17T03:14:39.744688+0000","last_became_peered":"2024-09-17T03:14:39.744688+0000","last_unstale":"2024-09-17T03:14:40.731915+0000","last_undegraded":"2024-09-17T03:14:40.731915+0000","last_fullsized":"2024-09-17T03:14:40.731915+0000","mapping_epoch":93,"log_start":"0'0","ondisk_log_start":"0'0","created":93,"last_epoch_clean":94,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:38.692061+0000","last_clean_scrub_stamp":"2024-09-17T03:14:38.692061+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T04:54:08.228121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"94'1","reported_seq":14,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.749656+0000","last_change":"2024-09-17T03:14:38.716420+0000","last_active":"2024-09-17T03:14:39.749656+0000","last_peered":"2024-09-17T03:14:39.749656+0000","last_clean":"2024-09-17T03:14:39.749656+0000","last_became_active":"2024-09-17T03:14:38.716045+0000","last_became_peered":"2024-09-17T03:14:38.716045+0000","last_unstale":"2024-09-17T03:14:39.749656+0000","last_undegraded":"2024-09-17T03:14:39.749656+0000","last_fullsized":"2024-09-17T03:14:39.749656+0000","mapping_epoch":92,"log_start":"0'0","ondisk_log_start":"0'0","created":92,"last_epoch_clean":93,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:14:37.684625+0000","last_clean_scrub_stamp":"2024-09-17T03:14:37.684625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:44.325262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":239,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-17T03:14:39.729426+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:14:39.729426+0000","last_peered":"2024-09-17T03:14:39.729426+0000","last_clean":"2024-09-17T03:14:39.729426+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:14:39.729426+0000","last_undegraded":"2024-09-17T03:14:39.729426+0000","last_fullsized":"2024-09-17T03:14:39.729426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509521,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1757184,"data_stored":1086921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509521,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1148,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1175552,"data_stored":503393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509520,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28160,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343680,"statfs":{"total":96636764160,"available":96607928320,"internally_reserved":0,"allocated":1159168,"data_stored":496511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509521,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32352,"kb_used_data":1160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339488,"statfs":{"total":96636764160,"available":96603635712,"internally_reserved":0,"allocated":1187840,"data_stored":504477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509522,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1159168,"data_stored":496475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509521,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1155072,"data_stored":496441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509521,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1765376,"data_stored":1093691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574929,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1156,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1183744,"data_stored":504375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:14:44.095 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:14:44.096 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T03:14:44.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.254+0000 7f824cda1640 1 -- 172.21.15.78:0/2477126365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82480cec50 msgr2=0x7f82480cf060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:44.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.254+0000 7f824cda1640 1 --2- 172.21.15.78:0/2477126365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82480cec50 0x7f82480cf060 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f8240005fd0 tx=0x7f824002a8b0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.254+0000 7f824cda1640 1 -- 172.21.15.78:0/2477126365 shutdown_connections 2024-09-17T03:14:44.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.254+0000 7f824cda1640 1 --2- 172.21.15.78:0/2477126365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82480cec50 0x7f82480cf060 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.254+0000 7f824cda1640 1 --2- 172.21.15.78:0/2477126365 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8248161020 0x7f82480ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.254+0000 7f824cda1640 1 -- 172.21.15.78:0/2477126365 >> 172.21.15.78:0/2477126365 conn(0x7f824806d4f0 msgr2=0x7f8248071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:44.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.254+0000 7f824cda1640 1 -- 172.21.15.78:0/2477126365 shutdown_connections 2024-09-17T03:14:44.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.254+0000 7f824cda1640 1 -- 172.21.15.78:0/2477126365 wait complete. 2024-09-17T03:14:44.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.256+0000 7f824cda1640 1 Processor -- start 2024-09-17T03:14:44.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.256+0000 7f824cda1640 1 -- start start 2024-09-17T03:14:44.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.257+0000 7f824cda1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82480cec50 0x7f82480b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:44.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.257+0000 7f824cda1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8248156f10 0x7f824814c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:44.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.257+0000 7f824cda1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8248161020 0x7f82480b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:44.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.257+0000 7f824cda1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f82480d08c0 con 0x7f82480cec50 2024-09-17T03:14:44.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.257+0000 7f824cda1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f82480d0740 con 0x7f8248161020 2024-09-17T03:14:44.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.257+0000 7f824cda1640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f82480d0a40 con 0x7f8248156f10 2024-09-17T03:14:44.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.257+0000 7f824659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82480cec50 0x7f82480b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:44.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.257+0000 7f824659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82480cec50 0x7f82480b2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58866/0 (socket says 172.21.15.78:58866) 2024-09-17T03:14:44.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.257+0000 7f824659c640 1 -- 172.21.15.78:0/1882957723 learned_addr learned my addr 172.21.15.78:0/1882957723 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:44.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.257+0000 7f8245d9b640 1 --2- 172.21.15.78:0/1882957723 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8248156f10 0x7f824814c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:44.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.257+0000 7f8246d9d640 1 --2- 172.21.15.78:0/1882957723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8248161020 0x7f82480b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:44.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.257+0000 7f824659c640 1 -- 172.21.15.78:0/1882957723 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8248156f10 msgr2=0x7f824814c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:44.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.257+0000 7f824659c640 1 --2- 172.21.15.78:0/1882957723 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8248156f10 0x7f824814c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.257+0000 7f824659c640 1 -- 172.21.15.78:0/1882957723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8248161020 msgr2=0x7f82480b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:44.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.257+0000 7f824659c640 1 --2- 172.21.15.78:0/1882957723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8248161020 0x7f82480b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.257+0000 7f824659c640 1 -- 172.21.15.78:0/1882957723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824814cc70 con 0x7f82480cec50 2024-09-17T03:14:44.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.258+0000 7f824659c640 1 --2- 172.21.15.78:0/1882957723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82480cec50 0x7f82480b2470 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f823800d770 tx=0x7f823800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:44.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.258+0000 7f8236ffd640 1 -- 172.21.15.78:0/1882957723 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8238017070 con 0x7f82480cec50 2024-09-17T03:14:44.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.258+0000 7f8236ffd640 1 -- 172.21.15.78:0/1882957723 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8238009d20 con 0x7f82480cec50 2024-09-17T03:14:44.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.258+0000 7f824cda1640 1 -- 172.21.15.78:0/1882957723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82480b7830 con 0x7f82480cec50 2024-09-17T03:14:44.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.258+0000 7f8236ffd640 1 -- 172.21.15.78:0/1882957723 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82380106c0 con 0x7f82480cec50 2024-09-17T03:14:44.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.258+0000 7f824cda1640 1 -- 172.21.15.78:0/1882957723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82480b1c70 con 0x7f82480cec50 2024-09-17T03:14:44.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.259+0000 7f824cda1640 1 -- 172.21.15.78:0/1882957723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82480d0f60 con 0x7f82480cec50 2024-09-17T03:14:44.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.260+0000 7f8236ffd640 1 -- 172.21.15.78:0/1882957723 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f823801a070 con 0x7f82480cec50 2024-09-17T03:14:44.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.260+0000 7f8236ffd640 1 --2- 172.21.15.78:0/1882957723 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8228078b90 0x7f822807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:44.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.260+0000 7f8236ffd640 1 -- 172.21.15.78:0/1882957723 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f823809ae00 con 0x7f82480cec50 2024-09-17T03:14:44.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.261+0000 7f8245d9b640 1 --2- 172.21.15.78:0/1882957723 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8228078b90 0x7f822807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:44.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.261+0000 7f8245d9b640 1 --2- 172.21.15.78:0/1882957723 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8228078b90 0x7f822807b0a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f82481567e0 tx=0x7f823c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:44.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.265+0000 7f8236ffd640 1 -- 172.21.15.78:0/1882957723 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8238062bf0 con 0x7f82480cec50 2024-09-17T03:14:44.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.506+0000 7f824cda1640 1 -- 172.21.15.78:0/1882957723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f82480cce90 con 0x7f82480cec50 2024-09-17T03:14:44.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.509+0000 7f8236ffd640 1 -- 172.21.15.78:0/1882957723 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7f8238067620 con 0x7f82480cec50 2024-09-17T03:14:44.508 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2024-09-17T03:14:44.508 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQBv8uhmn+c/IxAALXG+Qkwye7zc6PjcLBsk1g== 2024-09-17T03:14:44.508 INFO:teuthology.orchestra.run.smithi078.stdout: caps mds = "allow" 2024-09-17T03:14:44.508 INFO:teuthology.orchestra.run.smithi078.stdout: caps mon = "allow r" 2024-09-17T03:14:44.508 INFO:teuthology.orchestra.run.smithi078.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T03:14:44.508 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2024-09-17T03:14:44.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.511+0000 7f824cda1640 1 -- 172.21.15.78:0/1882957723 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8228078b90 msgr2=0x7f822807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.511+0000 7f824cda1640 1 --2- 172.21.15.78:0/1882957723 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8228078b90 0x7f822807b0a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f82481567e0 tx=0x7f823c009040 comp rx=0 tx=0).stop 2024-09-17T03:14:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.511+0000 7f824cda1640 1 -- 172.21.15.78:0/1882957723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82480cec50 msgr2=0x7f82480b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.511+0000 7f824cda1640 1 --2- 172.21.15.78:0/1882957723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82480cec50 0x7f82480b2470 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f823800d770 tx=0x7f823800dc30 comp rx=0 tx=0).stop 2024-09-17T03:14:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.511+0000 7f824cda1640 1 -- 172.21.15.78:0/1882957723 shutdown_connections 2024-09-17T03:14:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.511+0000 7f824cda1640 1 --2- 172.21.15.78:0/1882957723 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8228078b90 0x7f822807b0a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.511+0000 7f824cda1640 1 --2- 172.21.15.78:0/1882957723 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8248161020 0x7f82480b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.511+0000 7f824cda1640 1 --2- 172.21.15.78:0/1882957723 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8248156f10 0x7f824814c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.511+0000 7f824cda1640 1 --2- 172.21.15.78:0/1882957723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82480cec50 0x7f82480b2470 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.511+0000 7f824cda1640 1 -- 172.21.15.78:0/1882957723 >> 172.21.15.78:0/1882957723 conn(0x7f824806d4f0 msgr2=0x7f824815f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.511+0000 7f824cda1640 1 -- 172.21.15.78:0/1882957723 shutdown_connections 2024-09-17T03:14:44.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.511+0000 7f824cda1640 1 -- 172.21.15.78:0/1882957723 wait complete. 2024-09-17T03:14:44.522 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:44.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.636+0000 7f7b42670640 1 -- 172.21.15.78:0/33558125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b24003a00 msgr2=0x7f7b24003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:44.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.636+0000 7f7b42670640 1 --2- 172.21.15.78:0/33558125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b24003a00 0x7f7b24003e70 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c00bb10 tx=0x7f7b24005830 comp rx=0 tx=0).stop 2024-09-17T03:14:44.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.636+0000 7f7b40c0d640 1 -- 172.21.15.78:0/33558125 reap_dead start 2024-09-17T03:14:44.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.636+0000 7f7b42670640 1 -- 172.21.15.78:0/33558125 shutdown_connections 2024-09-17T03:14:44.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.636+0000 7f7b42670640 1 -- 172.21.15.78:0/33558125 >> 172.21.15.78:0/33558125 conn(0x7f7b3c08bfc0 msgr2=0x7f7b3c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:44.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.636+0000 7f7b42670640 1 -- 172.21.15.78:0/33558125 shutdown_connections 2024-09-17T03:14:44.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.636+0000 7f7b42670640 1 -- 172.21.15.78:0/33558125 wait complete. 2024-09-17T03:14:44.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.638+0000 7f7b42670640 1 Processor -- start 2024-09-17T03:14:44.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.638+0000 7f7b42670640 1 -- start start 2024-09-17T03:14:44.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.639+0000 7f7b42670640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7b24003a00 0x7f7b3c1f5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:44.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.639+0000 7f7b42670640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b3c1f8f10 0x7f7b3c1f9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:44.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.639+0000 7f7b42670640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b3c0cb4e0 0x7f7b3c0cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:44.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.639+0000 7f7b42670640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3c162860 con 0x7f7b3c0cb4e0 2024-09-17T03:14:44.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.639+0000 7f7b42670640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7b3c1626e0 con 0x7f7b3c1f8f10 2024-09-17T03:14:44.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.639+0000 7f7b42670640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7b3c1629e0 con 0x7f7b24003a00 2024-09-17T03:14:44.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.639+0000 7f7b40c0d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b3c0cb4e0 0x7f7b3c0cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:44.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.639+0000 7f7b40c0d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b3c0cb4e0 0x7f7b3c0cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58878/0 (socket says 172.21.15.78:58878) 2024-09-17T03:14:44.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.639+0000 7f7b40c0d640 1 -- 172.21.15.78:0/2833076965 learned_addr learned my addr 172.21.15.78:0/2833076965 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:44.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.639+0000 7f7b3b7fe640 1 --2- 172.21.15.78:0/2833076965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b3c1f8f10 0x7f7b3c1f9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:44.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.639+0000 7f7b3bfff640 1 --2- 172.21.15.78:0/2833076965 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7b24003a00 0x7f7b3c1f5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:44.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.639+0000 7f7b40c0d640 1 -- 172.21.15.78:0/2833076965 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7b24003a00 msgr2=0x7f7b3c1f5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:44.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.639+0000 7f7b40c0d640 1 --2- 172.21.15.78:0/2833076965 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7b24003a00 0x7f7b3c1f5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.639+0000 7f7b40c0d640 1 -- 172.21.15.78:0/2833076965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b3c1f8f10 msgr2=0x7f7b3c1f9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:44.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.639+0000 7f7b40c0d640 1 --2- 172.21.15.78:0/2833076965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b3c1f8f10 0x7f7b3c1f9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.639+0000 7f7b40c0d640 1 -- 172.21.15.78:0/2833076965 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b3c1f9860 con 0x7f7b3c0cb4e0 2024-09-17T03:14:44.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.640+0000 7f7b40c0d640 1 --2- 172.21.15.78:0/2833076965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b3c0cb4e0 0x7f7b3c0cb8f0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0d3300 tx=0x7f7b3400fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:44.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.640+0000 7f7b38ff9640 1 -- 172.21.15.78:0/2833076965 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b3401a070 con 0x7f7b3c0cb4e0 2024-09-17T03:14:44.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.640+0000 7f7b38ff9640 1 -- 172.21.15.78:0/2833076965 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b3400dd10 con 0x7f7b3c0cb4e0 2024-09-17T03:14:44.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.640+0000 7f7b42670640 1 -- 172.21.15.78:0/2833076965 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b3c0b8150 con 0x7f7b3c0cb4e0 2024-09-17T03:14:44.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.640+0000 7f7b38ff9640 1 -- 172.21.15.78:0/2833076965 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b34003bd0 con 0x7f7b3c0cb4e0 2024-09-17T03:14:44.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.640+0000 7f7b42670640 1 -- 172.21.15.78:0/2833076965 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b3c0b8710 con 0x7f7b3c0cb4e0 2024-09-17T03:14:44.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.641+0000 7f7b42670640 1 -- 172.21.15.78:0/2833076965 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b3c0d1a80 con 0x7f7b3c0cb4e0 2024-09-17T03:14:44.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.641+0000 7f7b38ff9640 1 -- 172.21.15.78:0/2833076965 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7b3401d070 con 0x7f7b3c0cb4e0 2024-09-17T03:14:44.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.642+0000 7f7b38ff9640 1 --2- 172.21.15.78:0/2833076965 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7b28078bc0 0x7f7b2807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:44.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.642+0000 7f7b38ff9640 1 -- 172.21.15.78:0/2833076965 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f7b3409aa20 con 0x7f7b3c0cb4e0 2024-09-17T03:14:44.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.642+0000 7f7b3bfff640 1 --2- 172.21.15.78:0/2833076965 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7b28078bc0 0x7f7b2807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:44.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.643+0000 7f7b3bfff640 1 --2- 172.21.15.78:0/2833076965 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7b28078bc0 0x7f7b2807b0d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c036000 tx=0x7f7b2c03c040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:44.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.646+0000 7f7b38ff9640 1 -- 172.21.15.78:0/2833076965 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7b3c1f9860 con 0x7f7b3c0cb4e0 2024-09-17T03:14:44.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.856+0000 7f7b42670640 1 -- 172.21.15.78:0/2833076965 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b3c0b51a0 con 0x7f7b3c0cb4e0 2024-09-17T03:14:44.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.856+0000 7f7b38ff9640 1 -- 172.21.15.78:0/2833076965 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) ==== 94+0+5231 (secure 0 0 0) 0x7f7b340628a0 con 0x7f7b3c0cb4e0 2024-09-17T03:14:44.855 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:44.856 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":94,"btime":"2024-09-17T03:14:42:735208+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7213,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8283,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":94,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:14:42.096594+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8286},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[8286]},"id":7}]} 2024-09-17T03:14:44.856 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 94 2024-09-17T03:14:44.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.858+0000 7f7b42670640 1 -- 172.21.15.78:0/2833076965 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7b28078bc0 msgr2=0x7f7b2807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:44.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.858+0000 7f7b42670640 1 --2- 172.21.15.78:0/2833076965 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7b28078bc0 0x7f7b2807b0d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c036000 tx=0x7f7b2c03c040 comp rx=0 tx=0).stop 2024-09-17T03:14:44.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.858+0000 7f7b42670640 1 -- 172.21.15.78:0/2833076965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b3c0cb4e0 msgr2=0x7f7b3c0cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:44.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.858+0000 7f7b42670640 1 --2- 172.21.15.78:0/2833076965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b3c0cb4e0 0x7f7b3c0cb8f0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0d3300 tx=0x7f7b3400fd90 comp rx=0 tx=0).stop 2024-09-17T03:14:44.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.858+0000 7f7b42670640 1 -- 172.21.15.78:0/2833076965 shutdown_connections 2024-09-17T03:14:44.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.858+0000 7f7b42670640 1 --2- 172.21.15.78:0/2833076965 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b3c0cb4e0 0x7f7b3c0cb8f0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.858+0000 7f7b42670640 1 --2- 172.21.15.78:0/2833076965 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7b28078bc0 0x7f7b2807b0d0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.858+0000 7f7b42670640 1 --2- 172.21.15.78:0/2833076965 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b3c1f8f10 0x7f7b3c1f9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.858+0000 7f7b42670640 1 --2- 172.21.15.78:0/2833076965 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7b24003a00 0x7f7b3c1f5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:44.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.858+0000 7f7b42670640 1 -- 172.21.15.78:0/2833076965 >> 172.21.15.78:0/2833076965 conn(0x7f7b3c08bfc0 msgr2=0x7f7b3c0ce3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:44.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.859+0000 7f7b42670640 1 -- 172.21.15.78:0/2833076965 shutdown_connections 2024-09-17T03:14:44.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:44.859+0000 7f7b42670640 1 -- 172.21.15.78:0/2833076965 wait complete. 2024-09-17T03:14:45.272 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 94, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:14:39.064178+0000', 'modified': '2024-09-17T03:14:42.096594+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8286}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8286': {'gid': 8286, 'name': 'c', 'rank': 0, 'incarnation': 90, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6835/1623349891', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6833', 'nonce': 1623349891}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 1623349891}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8286, 'qdb_cluster': [8286]} 2024-09-17T03:14:45.272 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T03:14:45.272 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:14:45.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.389+0000 7fda34ef9640 1 -- 172.21.15.78:0/2235707536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda30070440 msgr2=0x7fda300b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:45.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.389+0000 7fda34ef9640 1 --2- 172.21.15.78:0/2235707536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda30070440 0x7fda300b3090 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fda30070e70 tx=0x7fda2802a820 comp rx=0 tx=0).stop 2024-09-17T03:14:45.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.389+0000 7fda34ef9640 1 -- 172.21.15.78:0/2235707536 shutdown_connections 2024-09-17T03:14:45.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.389+0000 7fda34ef9640 1 --2- 172.21.15.78:0/2235707536 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda30070440 0x7fda300b3090 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.389+0000 7fda34ef9640 1 --2- 172.21.15.78:0/2235707536 >> v2:172.21.15.193:3300/0 conn(0x7fda30073170 0x7fda3015c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.389+0000 7fda34ef9640 1 -- 172.21.15.78:0/2235707536 >> 172.21.15.78:0/2235707536 conn(0x7fda300b1cb0 msgr2=0x7fda300b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:45.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.389+0000 7fda34ef9640 1 -- 172.21.15.78:0/2235707536 shutdown_connections 2024-09-17T03:14:45.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.389+0000 7fda34ef9640 1 -- 172.21.15.78:0/2235707536 wait complete. 2024-09-17T03:14:45.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.391+0000 7fda34ef9640 1 Processor -- start 2024-09-17T03:14:45.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.391+0000 7fda34ef9640 1 -- start start 2024-09-17T03:14:45.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.393+0000 7fda34ef9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda30070030 0x7fda30159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.393+0000 7fda34ef9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda30070440 0x7fda3015ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.393+0000 7fda34ef9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fda30073170 0x7fda3015b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.393+0000 7fda34ef9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fda300b3b00 con 0x7fda30070440 2024-09-17T03:14:45.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.393+0000 7fda34ef9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fda300b3980 con 0x7fda30070030 2024-09-17T03:14:45.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.393+0000 7fda34ef9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fda300b3c80 con 0x7fda30073170 2024-09-17T03:14:45.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.393+0000 7fda27fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda30070440 0x7fda3015ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:45.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.393+0000 7fda27fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda30070440 0x7fda3015ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58896/0 (socket says 172.21.15.78:58896) 2024-09-17T03:14:45.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.393+0000 7fda27fff640 1 -- 172.21.15.78:0/3306076667 learned_addr learned my addr 172.21.15.78:0/3306076667 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:45.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.393+0000 7fda2e59c640 1 --2- 172.21.15.78:0/3306076667 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda30070030 0x7fda30159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:45.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.393+0000 7fda2ed9d640 1 --2- 172.21.15.78:0/3306076667 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fda30073170 0x7fda3015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:45.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.393+0000 7fda27fff640 1 -- 172.21.15.78:0/3306076667 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fda30073170 msgr2=0x7fda3015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:45.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.393+0000 7fda27fff640 1 --2- 172.21.15.78:0/3306076667 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fda30073170 0x7fda3015b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.393+0000 7fda27fff640 1 -- 172.21.15.78:0/3306076667 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda30070030 msgr2=0x7fda30159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:45.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.393+0000 7fda27fff640 1 --2- 172.21.15.78:0/3306076667 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda30070030 0x7fda30159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.393+0000 7fda27fff640 1 -- 172.21.15.78:0/3306076667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda301f5910 con 0x7fda30070440 2024-09-17T03:14:45.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.393+0000 7fda27fff640 1 --2- 172.21.15.78:0/3306076667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda30070440 0x7fda3015ad20 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fda1800c3c0 tx=0x7fda1800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:45.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.393+0000 7fda26ffd640 1 -- 172.21.15.78:0/3306076667 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18017070 con 0x7fda30070440 2024-09-17T03:14:45.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.394+0000 7fda26ffd640 1 -- 172.21.15.78:0/3306076667 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda180035f0 con 0x7fda30070440 2024-09-17T03:14:45.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.394+0000 7fda34ef9640 1 -- 172.21.15.78:0/3306076667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda301f93e0 con 0x7fda30070440 2024-09-17T03:14:45.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.394+0000 7fda26ffd640 1 -- 172.21.15.78:0/3306076667 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18003a20 con 0x7fda30070440 2024-09-17T03:14:45.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.394+0000 7fda34ef9640 1 -- 172.21.15.78:0/3306076667 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda301f99a0 con 0x7fda30070440 2024-09-17T03:14:45.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.395+0000 7fda26ffd640 1 -- 172.21.15.78:0/3306076667 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fda1801a070 con 0x7fda30070440 2024-09-17T03:14:45.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.396+0000 7fda26ffd640 1 --2- 172.21.15.78:0/3306076667 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fda10078bc0 0x7fda1007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.396+0000 7fda26ffd640 1 -- 172.21.15.78:0/3306076667 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fda18099fa0 con 0x7fda30070440 2024-09-17T03:14:45.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.396+0000 7fda2e59c640 1 --2- 172.21.15.78:0/3306076667 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fda10078bc0 0x7fda1007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:45.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.397+0000 7fda3be6b740 1 Processor -- start 2024-09-17T03:14:45.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.397+0000 7fda2e59c640 1 --2- 172.21.15.78:0/3306076667 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fda10078bc0 0x7fda1007b0d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fda200058c0 tx=0x7fda2000c440 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:45.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.397+0000 7fda3be6b740 1 -- start start 2024-09-17T03:14:45.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.398+0000 7fda3be6b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 0x55f1779a6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.398+0000 7fda3be6b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1775ac3b0 0x55f1779a74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.398+0000 7fda3be6b740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775b4590 0x55f1779c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.398+0000 7fda3be6b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f1778ef820 con 0x55f1775d5270 2024-09-17T03:14:45.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.398+0000 7fda3be6b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f1778dec50 con 0x55f1775ac3b0 2024-09-17T03:14:45.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.398+0000 7fda3be6b740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f1778e2a60 con 0x55f1775b4590 2024-09-17T03:14:45.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.398+0000 7fda2e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 0x55f1779a6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:45.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.399+0000 7fda2e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 0x55f1779a6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58900/0 (socket says 172.21.15.78:58900) 2024-09-17T03:14:45.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.399+0000 7fda2e59c640 1 -- 172.21.15.78:0/3875413934 learned_addr learned my addr 172.21.15.78:0/3875413934 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:45.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.399+0000 7fda27fff640 1 --2- 172.21.15.78:0/3875413934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1775ac3b0 0x55f1779a74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:45.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.399+0000 7fda2ed9d640 1 --2- 172.21.15.78:0/3875413934 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775b4590 0x55f1779c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:45.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.399+0000 7fda2e59c640 1 -- 172.21.15.78:0/3875413934 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775b4590 msgr2=0x55f1779c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:45.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.399+0000 7fda2e59c640 1 --2- 172.21.15.78:0/3875413934 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775b4590 0x55f1779c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.399+0000 7fda2e59c640 1 -- 172.21.15.78:0/3875413934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1775ac3b0 msgr2=0x55f1779a74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:45.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.399+0000 7fda2e59c640 1 --2- 172.21.15.78:0/3875413934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1775ac3b0 0x55f1779a74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.399+0000 7fda2e59c640 1 -- 172.21.15.78:0/3875413934 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f177640850 con 0x55f1775d5270 2024-09-17T03:14:45.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.399+0000 7fda2e59c640 1 --2- 172.21.15.78:0/3875413934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 0x55f1779a6fa0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fda2000ede0 tx=0x7fda20011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c38f443ad7d25b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:45.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.399+0000 7fda0ffff640 1 -- 172.21.15.78:0/3875413934 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20021070 con 0x55f1775d5270 2024-09-17T03:14:45.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.399+0000 7fda0ffff640 1 -- 172.21.15.78:0/3875413934 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda2001d740 con 0x55f1775d5270 2024-09-17T03:14:45.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.399+0000 7fda0ffff640 1 -- 172.21.15.78:0/3875413934 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2001db30 con 0x55f1775d5270 2024-09-17T03:14:45.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.400+0000 7fda3be6b740 1 -- 172.21.15.78:0/3875413934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 msgr2=0x55f1779a6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:45.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.400+0000 7fda3be6b740 1 --2- 172.21.15.78:0/3875413934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 0x55f1779a6fa0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fda2000ede0 tx=0x7fda20011000 comp rx=0 tx=0).stop 2024-09-17T03:14:45.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.400+0000 7fda3be6b740 1 -- 172.21.15.78:0/3875413934 shutdown_connections 2024-09-17T03:14:45.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.400+0000 7fda3be6b740 1 --2- 172.21.15.78:0/3875413934 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775b4590 0x55f1779c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.400+0000 7fda3be6b740 1 --2- 172.21.15.78:0/3875413934 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1775ac3b0 0x55f1779a74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.400+0000 7fda3be6b740 1 --2- 172.21.15.78:0/3875413934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 0x55f1779a6fa0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.400+0000 7fda3be6b740 1 -- 172.21.15.78:0/3875413934 >> 172.21.15.78:0/3875413934 conn(0x55f1775c93c0 msgr2=0x55f17797d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:45.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.400+0000 7fda3be6b740 1 -- 172.21.15.78:0/3875413934 shutdown_connections 2024-09-17T03:14:45.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.400+0000 7fda3be6b740 1 -- 172.21.15.78:0/3875413934 wait complete. 2024-09-17T03:14:45.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.401+0000 7fda3be6b740 1 -- start start 2024-09-17T03:14:45.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.401+0000 7fda3be6b740 1 Processor -- start 2024-09-17T03:14:45.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda3be6b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1775ac3b0 0x55f1779d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda3be6b740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775b4590 0x55f1779ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda3be6b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 0x55f1779d5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda3be6b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f17764f620 con 0x55f1775d5270 2024-09-17T03:14:45.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda3be6b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f1778845f0 con 0x55f1775ac3b0 2024-09-17T03:14:45.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda3be6b740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f1779a7a20 con 0x55f1775b4590 2024-09-17T03:14:45.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda3be6b740 10 client.0 _ll_register_callbacks cb 0x55f1778880a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:45.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda2ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 0x55f1779d5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:45.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda2ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 0x55f1779d5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58916/0 (socket says 172.21.15.78:58916) 2024-09-17T03:14:45.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda2ed9d640 1 -- 172.21.15.78:0/4187494285 learned_addr learned my addr 172.21.15.78:0/4187494285 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:45.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda27fff640 1 --2- 172.21.15.78:0/4187494285 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775b4590 0x55f1779ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:45.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda2e59c640 1 --2- 172.21.15.78:0/4187494285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1775ac3b0 0x55f1779d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:45.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda2ed9d640 1 -- 172.21.15.78:0/4187494285 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775b4590 msgr2=0x55f1779ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:45.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda2ed9d640 1 --2- 172.21.15.78:0/4187494285 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775b4590 0x55f1779ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda2ed9d640 1 -- 172.21.15.78:0/4187494285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1775ac3b0 msgr2=0x55f1779d1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:45.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda2ed9d640 1 --2- 172.21.15.78:0/4187494285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1775ac3b0 0x55f1779d1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda2ed9d640 1 -- 172.21.15.78:0/4187494285 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1776b76b0 con 0x55f1775d5270 2024-09-17T03:14:45.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda27fff640 1 --2- 172.21.15.78:0/4187494285 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775b4590 0x55f1779ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:45.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda2ed9d640 1 --2- 172.21.15.78:0/4187494285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 0x55f1779d5260 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fda2802ae10 tx=0x7fda28003e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0ecc730ee9540b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:45.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:45.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda0d7fa640 1 -- 172.21.15.78:0/4187494285 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda28041070 con 0x55f1775d5270 2024-09-17T03:14:45.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda0d7fa640 1 -- 172.21.15.78:0/4187494285 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fda28004310 con 0x55f1775d5270 2024-09-17T03:14:45.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.403+0000 7fda3be6b740 1 -- 172.21.15.78:0/4187494285 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda2001d740 con 0x55f1775d5270 2024-09-17T03:14:45.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.404+0000 7fda0d7fa640 1 -- 172.21.15.78:0/4187494285 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7fda2804c050 con 0x55f1775d5270 2024-09-17T03:14:45.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.404+0000 7fda3be6b740 10 client.8418 fetch_fsmap learned FSMap version 94 2024-09-17T03:14:45.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.404+0000 7fda3be6b740 1 -- 172.21.15.78:0/4187494285 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x55f1779bb690 con 0x55f1775d5270 2024-09-17T03:14:45.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.404+0000 7fda0d7fa640 1 -- 172.21.15.78:0/4187494285 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda2001d740 con 0x55f1775d5270 2024-09-17T03:14:45.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.404+0000 7fda0d7fa640 1 -- 172.21.15.78:0/4187494285 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7fda2804f020 con 0x55f1775d5270 2024-09-17T03:14:45.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.404+0000 7fda3be6b740 10 client.8418 fetch_fsmap finished waiting for FSMap version 94 2024-09-17T03:14:45.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.404+0000 7fda3be6b740 10 client.8418 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:14:45.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.404+0000 7fda3be6b740 20 client.8418 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:45.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.404+0000 7fda3be6b740 1 --2- 172.21.15.78:0/4187494285 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f177593e40 0x55f1779b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.404+0000 7fda3be6b740 4 client.8418 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:14:45.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.404+0000 7fda3be6b740 1 -- 172.21.15.78:0/4187494285 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1778f1770 con 0x55f177593e40 2024-09-17T03:14:45.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.404+0000 7fda2e59c640 1 --2- 172.21.15.78:0/4187494285 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f177593e40 0x55f1779b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:45.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.404+0000 7fda0d7fa640 10 client.8418 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:14:45.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.404+0000 7fda2e59c640 1 --2- 172.21.15.78:0/4187494285 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f177593e40 0x55f1779b8b90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49fc66330b42f63b server_cookie=3238df609ebfaa35 in_seq=0 out_seq=0 2024-09-17T03:14:45.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.405+0000 7fda0d7fa640 1 -- 172.21.15.78:0/4187494285 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f1778f1770 con 0x55f177593e40 2024-09-17T03:14:45.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.405+0000 7fda0d7fa640 10 client.8418 handle_command_reply: tid=0 2024-09-17T03:14:45.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.405+0000 7fda3be6b740 1 client.8418 shutdown 2024-09-17T03:14:45.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.405+0000 7fda3be6b740 1 -- 172.21.15.78:0/4187494285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 msgr2=0x55f1779d5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:45.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.405+0000 7fda3be6b740 1 --2- 172.21.15.78:0/4187494285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 0x55f1779d5260 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7fda2802ae10 tx=0x7fda28003e20 comp rx=0 tx=0).stop 2024-09-17T03:14:45.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.405+0000 7fda3be6b740 1 -- 172.21.15.78:0/4187494285 shutdown_connections 2024-09-17T03:14:45.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.405+0000 7fda3be6b740 1 --2- 172.21.15.78:0/4187494285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 0x55f1779d5260 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.405+0000 7fda3be6b740 1 --2- 172.21.15.78:0/4187494285 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775b4590 0x55f1779ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.405+0000 7fda3be6b740 1 --2- 172.21.15.78:0/4187494285 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f177593e40 0x55f1779b8b90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.405+0000 7fda3be6b740 1 --2- 172.21.15.78:0/4187494285 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1775ac3b0 0x55f1779d1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.405+0000 7fda0d7fa640 0 client.8418 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:14:45.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.405+0000 7fda3be6b740 1 -- 172.21.15.78:0/4187494285 >> 172.21.15.78:0/4187494285 conn(0x55f1775c93c0 msgr2=0x55f1779c39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:45.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.405+0000 7fda3be6b740 1 -- 172.21.15.78:0/4187494285 shutdown_connections 2024-09-17T03:14:45.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.406+0000 7fda3be6b740 1 -- 172.21.15.78:0/4187494285 wait complete. 2024-09-17T03:14:45.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.406+0000 7fda3be6b740 20 client.8418 trim_cache size 0 max 16384 2024-09-17T03:14:45.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.424+0000 7fda3be6b740 1 Processor -- start 2024-09-17T03:14:45.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.424+0000 7fda3be6b740 1 -- start start 2024-09-17T03:14:45.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.425+0000 7fda3be6b740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775ac3b0 0x55f1779b9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.425+0000 7fda3be6b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1775b4590 0x55f1779ba160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.425+0000 7fda3be6b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 0x55f177976200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.425+0000 7fda3be6b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fda300c8cc0 con 0x55f1775d5270 2024-09-17T03:14:45.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.425+0000 7fda3be6b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fda300c8020 con 0x55f1775b4590 2024-09-17T03:14:45.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.425+0000 7fda3be6b740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fda300c8670 con 0x55f1775ac3b0 2024-09-17T03:14:45.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.425+0000 7fda2ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 0x55f177976200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:45.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.425+0000 7fda2ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 0x55f177976200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58924/0 (socket says 172.21.15.78:58924) 2024-09-17T03:14:45.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.425+0000 7fda2ed9d640 1 -- 172.21.15.78:0/301655594 learned_addr learned my addr 172.21.15.78:0/301655594 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:45.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.425+0000 7fda2ed9d640 1 -- 172.21.15.78:0/301655594 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775ac3b0 msgr2=0x55f1779b9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:45.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.425+0000 7fda2ed9d640 1 --2- 172.21.15.78:0/301655594 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775ac3b0 0x55f1779b9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.425+0000 7fda2ed9d640 1 -- 172.21.15.78:0/301655594 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1775b4590 msgr2=0x55f1779ba160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:45.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.425+0000 7fda2ed9d640 1 --2- 172.21.15.78:0/301655594 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1775b4590 0x55f1779ba160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.425+0000 7fda2ed9d640 1 -- 172.21.15.78:0/301655594 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1779d55d0 con 0x55f1775d5270 2024-09-17T03:14:45.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.425+0000 7fda2ed9d640 1 --2- 172.21.15.78:0/301655594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 0x55f177976200 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fda28004910 tx=0x7fda28003d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f409bff18823ea9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:45.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.426+0000 7fda0f7fe640 1 -- 172.21.15.78:0/301655594 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda28041040 con 0x55f1775d5270 2024-09-17T03:14:45.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.426+0000 7fda0f7fe640 1 -- 172.21.15.78:0/301655594 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda28004500 con 0x55f1775d5270 2024-09-17T03:14:45.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.426+0000 7fda0f7fe640 1 -- 172.21.15.78:0/301655594 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda28037040 con 0x55f1775d5270 2024-09-17T03:14:45.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.426+0000 7fda3be6b740 1 -- 172.21.15.78:0/301655594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 msgr2=0x55f177976200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:45.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.426+0000 7fda3be6b740 1 --2- 172.21.15.78:0/301655594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 0x55f177976200 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fda28004910 tx=0x7fda28003d10 comp rx=0 tx=0).stop 2024-09-17T03:14:45.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.426+0000 7fda3be6b740 1 -- 172.21.15.78:0/301655594 shutdown_connections 2024-09-17T03:14:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.426+0000 7fda3be6b740 1 --2- 172.21.15.78:0/301655594 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775d5270 0x55f177976200 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.426+0000 7fda3be6b740 1 --2- 172.21.15.78:0/301655594 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1775b4590 0x55f1779ba160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.426+0000 7fda3be6b740 1 --2- 172.21.15.78:0/301655594 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775ac3b0 0x55f1779b9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.426+0000 7fda3be6b740 1 -- 172.21.15.78:0/301655594 >> 172.21.15.78:0/301655594 conn(0x55f1775c93c0 msgr2=0x55f17797e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.426+0000 7fda3be6b740 1 -- 172.21.15.78:0/301655594 shutdown_connections 2024-09-17T03:14:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.426+0000 7fda3be6b740 1 -- 172.21.15.78:0/301655594 wait complete. 2024-09-17T03:14:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.427+0000 7fda3be6b740 1 -- start start 2024-09-17T03:14:45.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.427+0000 7fda3be6b740 1 Processor -- start 2024-09-17T03:14:45.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda3be6b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1775ac3b0 0x55f177a421f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda3be6b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775b4590 0x55f177a29760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda3be6b740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775d5270 0x55f1779b9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda3be6b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f1779bae10 con 0x55f1775b4590 2024-09-17T03:14:45.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda3be6b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f1779d58b0 con 0x55f1775ac3b0 2024-09-17T03:14:45.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda3be6b740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f1779bb400 con 0x55f1775d5270 2024-09-17T03:14:45.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda3be6b740 10 client.0 _ll_register_callbacks cb 0x7fda28035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:45.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda27fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775b4590 0x55f177a29760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:45.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda27fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775b4590 0x55f177a29760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58938/0 (socket says 172.21.15.78:58938) 2024-09-17T03:14:45.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda27fff640 1 -- 172.21.15.78:0/295567966 learned_addr learned my addr 172.21.15.78:0/295567966 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:45.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda2ed9d640 1 --2- 172.21.15.78:0/295567966 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775d5270 0x55f1779b9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:45.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda2e59c640 1 --2- 172.21.15.78:0/295567966 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1775ac3b0 0x55f177a421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:45.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda27fff640 1 -- 172.21.15.78:0/295567966 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775d5270 msgr2=0x55f1779b9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:45.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda27fff640 1 --2- 172.21.15.78:0/295567966 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775d5270 0x55f1779b9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda27fff640 1 -- 172.21.15.78:0/295567966 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1775ac3b0 msgr2=0x55f177a421f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:45.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda27fff640 1 --2- 172.21.15.78:0/295567966 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1775ac3b0 0x55f177a421f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda27fff640 1 -- 172.21.15.78:0/295567966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f177a36eb0 con 0x55f1775b4590 2024-09-17T03:14:45.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda2e59c640 1 --2- 172.21.15.78:0/295567966 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1775ac3b0 0x55f177a421f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:45.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda2ed9d640 1 --2- 172.21.15.78:0/295567966 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775d5270 0x55f1779b9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:45.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda27fff640 1 --2- 172.21.15.78:0/295567966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775b4590 0x55f177a29760 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fda18061c70 tx=0x7fda180614c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d69cfe5063142f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:45.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.429+0000 7fda0d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:45.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.430+0000 7fda0d7fa640 1 -- 172.21.15.78:0/295567966 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda180623e0 con 0x55f1775b4590 2024-09-17T03:14:45.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.430+0000 7fda0d7fa640 1 -- 172.21.15.78:0/295567966 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fda18060f40 con 0x55f1775b4590 2024-09-17T03:14:45.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.430+0000 7fda3be6b740 1 -- 172.21.15.78:0/295567966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda28004500 con 0x55f1775b4590 2024-09-17T03:14:45.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.430+0000 7fda0d7fa640 1 -- 172.21.15.78:0/295567966 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) ==== 24+0+0 (secure 0 0 0) 0x7fda18061ce0 con 0x55f1775b4590 2024-09-17T03:14:45.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.430+0000 7fda3be6b740 10 client.8424 fetch_fsmap learned FSMap version 94 2024-09-17T03:14:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.430+0000 7fda3be6b740 1 -- 172.21.15.78:0/295567966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=2+}) -- 0x55f1779c2970 con 0x55f1775b4590 2024-09-17T03:14:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.430+0000 7fda0d7fa640 1 -- 172.21.15.78:0/295567966 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda28004500 con 0x55f1775b4590 2024-09-17T03:14:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.430+0000 7fda0d7fa640 1 -- 172.21.15.78:0/295567966 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 94) ==== 3502+0+0 (secure 0 0 0) 0x7fda1805d630 con 0x55f1775b4590 2024-09-17T03:14:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.430+0000 7fda3be6b740 10 client.8424 fetch_fsmap finished waiting for FSMap version 94 2024-09-17T03:14:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.430+0000 7fda3be6b740 10 client.8424 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:14:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.430+0000 7fda3be6b740 20 client.8424 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.430+0000 7fda3be6b740 1 --2- 172.21.15.78:0/295567966 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f177977020 0x55f177994f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.430+0000 7fda3be6b740 4 client.8424 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:14:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.430+0000 7fda3be6b740 1 -- 172.21.15.78:0/295567966 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "status"}) -- 0x55f177972f80 con 0x55f177977020 2024-09-17T03:14:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.430+0000 7fda2e59c640 1 --2- 172.21.15.78:0/295567966 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f177977020 0x55f177994f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.431+0000 7fda0d7fa640 10 client.8424 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:14:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.431+0000 7fda2e59c640 1 --2- 172.21.15.78:0/295567966 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f177977020 0x55f177994f10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b368b6527193b091 server_cookie=2cf0144e57cabb96 in_seq=0 out_seq=0 2024-09-17T03:14:45.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.431+0000 7fda0d7fa640 1 -- 172.21.15.78:0/295567966 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55f177972f80 con 0x55f177977020 2024-09-17T03:14:45.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.431+0000 7fda0d7fa640 10 client.8424 handle_command_reply: tid=0 2024-09-17T03:14:45.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.431+0000 7fda3be6b740 1 client.8424 shutdown 2024-09-17T03:14:45.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.431+0000 7fda3be6b740 1 -- 172.21.15.78:0/295567966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775b4590 msgr2=0x55f177a29760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:45.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.431+0000 7fda3be6b740 1 --2- 172.21.15.78:0/295567966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775b4590 0x55f177a29760 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fda18061c70 tx=0x7fda180614c0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.431+0000 7fda3be6b740 1 -- 172.21.15.78:0/295567966 shutdown_connections 2024-09-17T03:14:45.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.431+0000 7fda3be6b740 1 --2- 172.21.15.78:0/295567966 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f1775d5270 0x55f1779b9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.431+0000 7fda3be6b740 1 --2- 172.21.15.78:0/295567966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f1775b4590 0x55f177a29760 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.431+0000 7fda3be6b740 1 --2- 172.21.15.78:0/295567966 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f177977020 0x55f177994f10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.431+0000 7fda3be6b740 1 --2- 172.21.15.78:0/295567966 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f1775ac3b0 0x55f177a421f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.431+0000 7fda3be6b740 1 -- 172.21.15.78:0/295567966 >> 172.21.15.78:0/295567966 conn(0x55f1775c93c0 msgr2=0x55f177a38430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:45.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.431+0000 7fda0d7fa640 0 client.8424 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:14:45.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.431+0000 7fda3be6b740 1 -- 172.21.15.78:0/295567966 shutdown_connections 2024-09-17T03:14:45.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.431+0000 7fda3be6b740 1 -- 172.21.15.78:0/295567966 wait complete. 2024-09-17T03:14:45.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.431+0000 7fda3be6b740 20 client.8424 trim_cache size 0 max 16384 2024-09-17T03:14:45.437 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:14:45.437 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:14:45.437 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-09-17T03:14:45.437 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 8286, 2024-09-17T03:14:45.437 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:14:45.437 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:14:45.437 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:14:45.437 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 5.7070625049999997, 2024-09-17T03:14:45.438 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 94, 2024-09-17T03:14:45.438 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 95, 2024-09-17T03:14:45.438 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 95, 2024-09-17T03:14:45.438 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 10.381051741 2024-09-17T03:14:45.438 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:14:45.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.432+0000 7fda34ef9640 1 -- 172.21.15.78:0/3306076667 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fda10078bc0 msgr2=0x7fda1007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:45.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.432+0000 7fda34ef9640 1 --2- 172.21.15.78:0/3306076667 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fda10078bc0 0x7fda1007b0d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fda200058c0 tx=0x7fda2000c440 comp rx=0 tx=0).stop 2024-09-17T03:14:45.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.432+0000 7fda34ef9640 1 -- 172.21.15.78:0/3306076667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda30070440 msgr2=0x7fda3015ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:45.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.432+0000 7fda34ef9640 1 --2- 172.21.15.78:0/3306076667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda30070440 0x7fda3015ad20 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fda1800c3c0 tx=0x7fda1800c880 comp rx=0 tx=0).stop 2024-09-17T03:14:45.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.432+0000 7fda34ef9640 1 -- 172.21.15.78:0/3306076667 shutdown_connections 2024-09-17T03:14:45.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.432+0000 7fda34ef9640 1 --2- 172.21.15.78:0/3306076667 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fda30073170 0x7fda3015b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.432+0000 7fda34ef9640 1 --2- 172.21.15.78:0/3306076667 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda30070440 0x7fda3015ad20 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.432+0000 7fda34ef9640 1 --2- 172.21.15.78:0/3306076667 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fda10078bc0 0x7fda1007b0d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.432+0000 7fda34ef9640 1 --2- 172.21.15.78:0/3306076667 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fda30070030 0x7fda30159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.432+0000 7fda34ef9640 1 -- 172.21.15.78:0/3306076667 >> 172.21.15.78:0/3306076667 conn(0x7fda300b1cb0 msgr2=0x7fda3015f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:45.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.432+0000 7fda34ef9640 1 -- 172.21.15.78:0/3306076667 shutdown_connections 2024-09-17T03:14:45.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.432+0000 7fda34ef9640 1 -- 172.21.15.78:0/3306076667 wait complete. 2024-09-17T03:14:45.442 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T03:14:45.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.556+0000 7f32c35c3640 1 -- 172.21.15.78:0/2504371152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32bc15d670 msgr2=0x7f32bc0b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:45.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.556+0000 7f32c35c3640 1 --2- 172.21.15.78:0/2504371152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32bc15d670 0x7f32bc0b7490 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f32bc071d80 tx=0x7f32b402aa30 comp rx=0 tx=0).stop 2024-09-17T03:14:45.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.556+0000 7f32c35c3640 1 -- 172.21.15.78:0/2504371152 shutdown_connections 2024-09-17T03:14:45.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.556+0000 7f32c35c3640 1 --2- 172.21.15.78:0/2504371152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32bc15d670 0x7f32bc0b7490 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.556+0000 7f32c35c3640 1 --2- 172.21.15.78:0/2504371152 >> v2:172.21.15.193:3300/0 conn(0x7f32bc0d2630 0x7f32bc15d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.556+0000 7f32c35c3640 1 -- 172.21.15.78:0/2504371152 >> 172.21.15.78:0/2504371152 conn(0x7f32bc06d550 msgr2=0x7f32bc071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:45.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.556+0000 7f32c35c3640 1 -- 172.21.15.78:0/2504371152 shutdown_connections 2024-09-17T03:14:45.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.556+0000 7f32c35c3640 1 -- 172.21.15.78:0/2504371152 wait complete. 2024-09-17T03:14:45.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.558+0000 7f32c35c3640 1 Processor -- start 2024-09-17T03:14:45.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.558+0000 7f32c35c3640 1 -- start start 2024-09-17T03:14:45.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.559+0000 7f32c35c3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32bc1570e0 0x7f32bc0cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.559+0000 7f32c35c3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32bc15d670 0x7f32bc14a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.559+0000 7f32c35c3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32bc155870 0x7f32bc1f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.559+0000 7f32c35c3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc0b7d60 con 0x7f32bc15d670 2024-09-17T03:14:45.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.559+0000 7f32c35c3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc0b7be0 con 0x7f32bc155870 2024-09-17T03:14:45.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.559+0000 7f32c35c3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f32bc0b7ee0 con 0x7f32bc1570e0 2024-09-17T03:14:45.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.559+0000 7f32c0b5e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32bc15d670 0x7f32bc14a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:45.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.559+0000 7f32c0b5e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32bc15d670 0x7f32bc14a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58944/0 (socket says 172.21.15.78:58944) 2024-09-17T03:14:45.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.559+0000 7f32c0b5e640 1 -- 172.21.15.78:0/1389106919 learned_addr learned my addr 172.21.15.78:0/1389106919 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:45.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.559+0000 7f32c135f640 1 --2- 172.21.15.78:0/1389106919 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32bc1570e0 0x7f32bc0cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:45.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.559+0000 7f32c1b60640 1 --2- 172.21.15.78:0/1389106919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32bc155870 0x7f32bc1f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:45.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.560+0000 7f32c0b5e640 1 -- 172.21.15.78:0/1389106919 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32bc1570e0 msgr2=0x7f32bc0cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:45.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.560+0000 7f32c0b5e640 1 --2- 172.21.15.78:0/1389106919 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32bc1570e0 0x7f32bc0cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.560+0000 7f32c0b5e640 1 -- 172.21.15.78:0/1389106919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32bc155870 msgr2=0x7f32bc1f74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:45.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.560+0000 7f32c0b5e640 1 --2- 172.21.15.78:0/1389106919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32bc155870 0x7f32bc1f74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.560+0000 7f32c0b5e640 1 -- 172.21.15.78:0/1389106919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32bc1f3fa0 con 0x7f32bc15d670 2024-09-17T03:14:45.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.560+0000 7f32c0b5e640 1 --2- 172.21.15.78:0/1389106919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32bc15d670 0x7f32bc14a820 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00c970 tx=0x7f32ac00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:45.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.560+0000 7f32b1ffb640 1 -- 172.21.15.78:0/1389106919 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac007bb0 con 0x7f32bc15d670 2024-09-17T03:14:45.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.560+0000 7f32b1ffb640 1 -- 172.21.15.78:0/1389106919 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32ac007e40 con 0x7f32bc15d670 2024-09-17T03:14:45.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.560+0000 7f32c35c3640 1 -- 172.21.15.78:0/1389106919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32bc1f4280 con 0x7f32bc15d670 2024-09-17T03:14:45.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.560+0000 7f32b1ffb640 1 -- 172.21.15.78:0/1389106919 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac00f690 con 0x7f32bc15d670 2024-09-17T03:14:45.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.560+0000 7f32c35c3640 1 -- 172.21.15.78:0/1389106919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32bc1f4840 con 0x7f32bc15d670 2024-09-17T03:14:45.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.561+0000 7f32c35c3640 1 -- 172.21.15.78:0/1389106919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32bc1f3d10 con 0x7f32bc15d670 2024-09-17T03:14:45.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.562+0000 7f32b1ffb640 1 -- 172.21.15.78:0/1389106919 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f32ac00f830 con 0x7f32bc15d670 2024-09-17T03:14:45.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.562+0000 7f32b1ffb640 1 --2- 172.21.15.78:0/1389106919 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f32a0078b90 0x7f32a007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:45.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.562+0000 7f32b1ffb640 1 -- 172.21.15.78:0/1389106919 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f32ac09b3f0 con 0x7f32bc15d670 2024-09-17T03:14:45.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.562+0000 7f32c135f640 1 --2- 172.21.15.78:0/1389106919 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f32a0078b90 0x7f32a007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:45.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.563+0000 7f32c135f640 1 --2- 172.21.15.78:0/1389106919 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f32a0078b90 0x7f32a007b0a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f32b8006fd0 tx=0x7f32b8009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:45.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.566+0000 7f32b1ffb640 1 -- 172.21.15.78:0/1389106919 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f32ac014030 con 0x7f32bc15d670 2024-09-17T03:14:45.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.778+0000 7f32c35c3640 1 -- 172.21.15.78:0/1389106919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f32bc15c900 con 0x7f32bc15d670 2024-09-17T03:14:45.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.779+0000 7f32b1ffb640 1 -- 172.21.15.78:0/1389106919 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v94) ==== 53+0+73 (secure 0 0 0) 0x7f32bc15c900 con 0x7f32bc15d670 2024-09-17T03:14:45.778 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T03:14:45.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.781+0000 7f32c35c3640 1 -- 172.21.15.78:0/1389106919 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f32a0078b90 msgr2=0x7f32a007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:45.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.781+0000 7f32c35c3640 1 --2- 172.21.15.78:0/1389106919 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f32a0078b90 0x7f32a007b0a0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f32b8006fd0 tx=0x7f32b8009060 comp rx=0 tx=0).stop 2024-09-17T03:14:45.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.781+0000 7f32c35c3640 1 -- 172.21.15.78:0/1389106919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32bc15d670 msgr2=0x7f32bc14a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:45.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.781+0000 7f32c35c3640 1 --2- 172.21.15.78:0/1389106919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32bc15d670 0x7f32bc14a820 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f32ac00c970 tx=0x7f32ac00ce30 comp rx=0 tx=0).stop 2024-09-17T03:14:45.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.781+0000 7f32c35c3640 1 -- 172.21.15.78:0/1389106919 shutdown_connections 2024-09-17T03:14:45.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.781+0000 7f32c35c3640 1 --2- 172.21.15.78:0/1389106919 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f32a0078b90 0x7f32a007b0a0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.781+0000 7f32c35c3640 1 --2- 172.21.15.78:0/1389106919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32bc155870 0x7f32bc1f74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.781+0000 7f32c35c3640 1 --2- 172.21.15.78:0/1389106919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32bc15d670 0x7f32bc14a820 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.781+0000 7f32c35c3640 1 --2- 172.21.15.78:0/1389106919 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32bc1570e0 0x7f32bc0cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:45.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.781+0000 7f32c35c3640 1 -- 172.21.15.78:0/1389106919 >> 172.21.15.78:0/1389106919 conn(0x7f32bc06d550 msgr2=0x7f32bc156660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:45.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.781+0000 7f32c35c3640 1 -- 172.21.15.78:0/1389106919 shutdown_connections 2024-09-17T03:14:45.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:45.781+0000 7f32c35c3640 1 -- 172.21.15.78:0/1389106919 wait complete. 2024-09-17T03:14:45.791 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-17T03:14:45.791 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T03:14:45.791 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2024-09-17T03:14:45.791 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T03:14:45.791 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T03:14:45.791 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-17T03:14:45.791 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-17T03:14:45.791 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T03:14:45.791 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:14:45.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:45.792 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2024-09-17T03:14:45.809 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T03:14:45.809 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T03:14:45.809 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T03:14:45.809 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:45.809 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2024-09-17T03:14:45.809 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:45.809 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:14:45.809 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:45.810 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2024-09-17T03:14:45.810 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:14:45.810 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:45.810 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2024-09-17T03:14:45.810 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T03:14:45.810 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:45.810 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T03:14:45.810 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:45.810 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T03:14:45.810 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42379sec preferred_lft 42379sec 2024-09-17T03:14:45.810 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link noprefixroute 2024-09-17T03:14:45.810 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:45.810 INFO:teuthology.orchestra.run.smithi078.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T03:14:45.810 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0e:9b:80:f7:8b:c2 brd ff:ff:ff:ff:ff:ff 2024-09-17T03:14:45.811 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T03:14:45.811 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:45.811 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::58a0:47ff:fe97:6de8/64 scope link 2024-09-17T03:14:45.811 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:45.811 INFO:teuthology.orchestra.run.smithi078.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:14:45.811 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether e6:fb:78:d9:ba:75 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:14:45.811 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::e4fb:78ff:fed9:ba75/64 scope link 2024-09-17T03:14:45.811 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:45.811 INFO:teuthology.orchestra.run.smithi078.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T03:14:45.811 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0e:9b:80:f7:8b:c2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:14:45.811 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::c9b:80ff:fef7:8bc2/64 scope link 2024-09-17T03:14:45.811 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2024-09-17T03:14:45.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:45.812 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T03:14:45.873 INFO:teuthology.orchestra.run.smithi078.stdout:1 2024-09-17T03:14:45.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:45.875 DEBUG:teuthology.orchestra.run.smithi078:> route 2024-09-17T03:14:45.931 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2024-09-17T03:14:45.931 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T03:14:45.931 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T03:14:45.931 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T03:14:45.931 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T03:14:45.932 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T03:14:45.932 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2024-09-17T03:14:45.932 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T03:14:45.932 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T03:14:45.932 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T03:14:45.932 DEBUG:teuthology.orchestra.run.smithi078:> ') 2024-09-17T03:14:46.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T03:14:46.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:46.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:46.058 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-17T03:14:46.073 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:14:46.074 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:14:46.074 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:14:46.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:46.074 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2024-09-17T03:14:46.138 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:14:46.139 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T03:14:46.194 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T03:14:46.194 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T03:14:46.194 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:14:46.249 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-17T03:14:46.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:46.250 DEBUG:teuthology.orchestra.run.smithi078:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:14:46.344 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:14:46.344 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:14:46.344 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:14:46.355 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:14:46.355 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:14:46.355 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:14:46.355 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-09-17T03:14:46.355 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:14:46.364 INFO:teuthology.orchestra.run.smithi078.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-17T03:14:46.364 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-17T03:14:46.364 INFO:teuthology.orchestra.run.smithi078.stdout:invalid new device string format 2024-09-17T03:14:46.364 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-09-17T03:14:46.364 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-17T03:14:46.364 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: resolved to: "172.21.15.78:6789,172.21.15.193:6789,172.21.15.193:6790" 2024-09-17T03:14:46.364 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.78:6789,172.21.15.193:6789,172.21.15.193:6790:/ 2024-09-17T03:14:46.365 INFO:teuthology.orchestra.run.smithi078.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f3c59ba9-dab4-4ee6-8989-d80d11d430b6" will pass to kernel 2024-09-17T03:14:46.365 INFO:teuthology.orchestra.run.smithi078.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-17T03:14:46.365 INFO:teuthology.orchestra.run.smithi078.stdout: You just mounted a file system that supports labels which does not 2024-09-17T03:14:46.365 INFO:teuthology.orchestra.run.smithi078.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-17T03:14:46.365 INFO:teuthology.orchestra.run.smithi078.stdout: applications will generate AVC messages and not be allowed access to 2024-09-17T03:14:46.365 INFO:teuthology.orchestra.run.smithi078.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-17T03:14:46.366 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-17T03:14:46.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:46.366 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T03:14:46.391 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-17T03:14:46.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T03:14:46.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:14:46.491 INFO:teuthology.orchestra.run.smithi078.stdout:client8433 2024-09-17T03:14:46.492 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:14:46.492 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:14:46.508 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-09-17T03:14:46.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.663+0000 7f277f220640 1 -- 172.21.15.78:0/1205528514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27780d2ed0 msgr2=0x7f27780d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:46.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.663+0000 7f277f220640 1 --2- 172.21.15.78:0/1205528514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27780d2ed0 0x7f27780d1a80 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f27680098e0 tx=0x7f276802a530 comp rx=0 tx=0).stop 2024-09-17T03:14:46.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.663+0000 7f277f220640 1 -- 172.21.15.78:0/1205528514 shutdown_connections 2024-09-17T03:14:46.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.663+0000 7f277f220640 1 --2- 172.21.15.78:0/1205528514 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f27780b9b70 0x7f27780cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:46.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.663+0000 7f277f220640 1 --2- 172.21.15.78:0/1205528514 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27780d2ed0 0x7f27780d1a80 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:46.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.663+0000 7f277f220640 1 -- 172.21.15.78:0/1205528514 >> 172.21.15.78:0/1205528514 conn(0x7f277808bfc0 msgr2=0x7f277809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:46.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.663+0000 7f277f220640 1 -- 172.21.15.78:0/1205528514 shutdown_connections 2024-09-17T03:14:46.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.663+0000 7f277f220640 1 -- 172.21.15.78:0/1205528514 wait complete. 2024-09-17T03:14:46.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.665+0000 7f277f220640 1 Processor -- start 2024-09-17T03:14:46.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.665+0000 7f277f220640 1 -- start start 2024-09-17T03:14:46.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.666+0000 7f277f220640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27780b9b70 0x7f27780cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:46.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.666+0000 7f277f220640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27780cf5d0 0x7f27780cce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:46.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f277f220640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f27780d2ed0 0x7f27780ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:46.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f277f220640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f27780d4940 con 0x7f27780cf5d0 2024-09-17T03:14:46.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f277f220640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f27780cfde0 con 0x7f27780b9b70 2024-09-17T03:14:46.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f277f220640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f27780d4ac0 con 0x7f27780d2ed0 2024-09-17T03:14:46.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f2777fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27780cf5d0 0x7f27780cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:46.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f2777fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27780cf5d0 0x7f27780cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60698/0 (socket says 172.21.15.78:60698) 2024-09-17T03:14:46.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f2777fff640 1 -- 172.21.15.78:0/635669991 learned_addr learned my addr 172.21.15.78:0/635669991 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:46.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f277cfbc640 1 --2- 172.21.15.78:0/635669991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27780b9b70 0x7f27780cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:46.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f277d7bd640 1 --2- 172.21.15.78:0/635669991 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f27780d2ed0 0x7f27780ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:46.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f2777fff640 1 -- 172.21.15.78:0/635669991 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f27780d2ed0 msgr2=0x7f27780ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:46.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f2777fff640 1 --2- 172.21.15.78:0/635669991 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f27780d2ed0 0x7f27780ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:46.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f2777fff640 1 -- 172.21.15.78:0/635669991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27780b9b70 msgr2=0x7f27780cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:46.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f2777fff640 1 --2- 172.21.15.78:0/635669991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27780b9b70 0x7f27780cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:46.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f2777fff640 1 -- 172.21.15.78:0/635669991 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27780cd5f0 con 0x7f27780cf5d0 2024-09-17T03:14:46.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f277cfbc640 1 --2- 172.21.15.78:0/635669991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27780b9b70 0x7f27780cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:46.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f2777fff640 1 --2- 172.21.15.78:0/635669991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27780cf5d0 0x7f27780cce60 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f276c00cce0 tx=0x7f276c007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:46.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f27757fa640 1 -- 172.21.15.78:0/635669991 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c00f450 con 0x7f27780cf5d0 2024-09-17T03:14:46.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f27757fa640 1 -- 172.21.15.78:0/635669991 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f276c00f6e0 con 0x7f27780cf5d0 2024-09-17T03:14:46.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f27757fa640 1 -- 172.21.15.78:0/635669991 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c00fb10 con 0x7f27780cf5d0 2024-09-17T03:14:46.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f277f220640 1 -- 172.21.15.78:0/635669991 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27780cd8d0 con 0x7f27780cf5d0 2024-09-17T03:14:46.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.667+0000 7f277f220640 1 -- 172.21.15.78:0/635669991 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27780cde90 con 0x7f27780cf5d0 2024-09-17T03:14:46.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.668+0000 7f277f220640 1 -- 172.21.15.78:0/635669991 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27780d5070 con 0x7f27780cf5d0 2024-09-17T03:14:46.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.669+0000 7f27757fa640 1 -- 172.21.15.78:0/635669991 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f276c00fcb0 con 0x7f27780cf5d0 2024-09-17T03:14:46.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.670+0000 7f27757fa640 1 --2- 172.21.15.78:0/635669991 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2764078bc0 0x7f276407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:46.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.670+0000 7f27757fa640 1 -- 172.21.15.78:0/635669991 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f276c09b800 con 0x7f27780cf5d0 2024-09-17T03:14:46.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.670+0000 7f277cfbc640 1 --2- 172.21.15.78:0/635669991 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2764078bc0 0x7f276407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:46.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.671+0000 7f277cfbc640 1 --2- 172.21.15.78:0/635669991 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2764078bc0 0x7f276407b0d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2768034000 tx=0x7f2768004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:46.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.674+0000 7f27757fa640 1 -- 172.21.15.78:0/635669991 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f276c014030 con 0x7f27780cf5d0 2024-09-17T03:14:46.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:46.888+0000 7f277f220640 1 -- 172.21.15.78:0/635669991 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f27780b51a0 con 0x7f27780cf5d0 2024-09-17T03:14:47.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.646+0000 7f27757fa640 1 -- 172.21.15.78:0/635669991 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v95) ==== 105+0+0 (secure 0 0 0) 0x7f276c063d90 con 0x7f27780cf5d0 2024-09-17T03:14:47.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.649+0000 7f277f220640 1 -- 172.21.15.78:0/635669991 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2764078bc0 msgr2=0x7f276407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:47.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.649+0000 7f277f220640 1 --2- 172.21.15.78:0/635669991 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2764078bc0 0x7f276407b0d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2768034000 tx=0x7f2768004730 comp rx=0 tx=0).stop 2024-09-17T03:14:47.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.649+0000 7f277f220640 1 -- 172.21.15.78:0/635669991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27780cf5d0 msgr2=0x7f27780cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:47.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.649+0000 7f277f220640 1 --2- 172.21.15.78:0/635669991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27780cf5d0 0x7f27780cce60 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f276c00cce0 tx=0x7f276c007610 comp rx=0 tx=0).stop 2024-09-17T03:14:47.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.649+0000 7f277f220640 1 -- 172.21.15.78:0/635669991 shutdown_connections 2024-09-17T03:14:47.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.649+0000 7f277f220640 1 --2- 172.21.15.78:0/635669991 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f27780d2ed0 0x7f27780ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:47.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.649+0000 7f277f220640 1 --2- 172.21.15.78:0/635669991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27780cf5d0 0x7f27780cce60 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:47.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.649+0000 7f277f220640 1 --2- 172.21.15.78:0/635669991 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2764078bc0 0x7f276407b0d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:47.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.649+0000 7f277f220640 1 --2- 172.21.15.78:0/635669991 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f27780b9b70 0x7f27780cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:47.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.649+0000 7f277f220640 1 -- 172.21.15.78:0/635669991 >> 172.21.15.78:0/635669991 conn(0x7f277808bfc0 msgr2=0x7f2778068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:47.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.649+0000 7f277f220640 1 -- 172.21.15.78:0/635669991 shutdown_connections 2024-09-17T03:14:47.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.650+0000 7f277f220640 1 -- 172.21.15.78:0/635669991 wait complete. 2024-09-17T03:14:47.668 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:47.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.791+0000 7f0e34030640 1 -- 172.21.15.78:0/2838872221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e18004800 msgr2=0x7f0e18004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:47.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.791+0000 7f0e34030640 1 --2- 172.21.15.78:0/2838872221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e18004800 0x7f0e18004c10 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0016c0 tx=0x7f0e18005830 comp rx=0 tx=0).stop 2024-09-17T03:14:47.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.791+0000 7f0e34030640 1 -- 172.21.15.78:0/2838872221 shutdown_connections 2024-09-17T03:14:47.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.791+0000 7f0e34030640 1 --2- 172.21.15.78:0/2838872221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e18004800 0x7f0e18004c10 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:47.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.791+0000 7f0e34030640 1 -- 172.21.15.78:0/2838872221 >> 172.21.15.78:0/2838872221 conn(0x7f0e2c08bfc0 msgr2=0x7f0e2c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:47.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.791+0000 7f0e34030640 1 -- 172.21.15.78:0/2838872221 shutdown_connections 2024-09-17T03:14:47.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.791+0000 7f0e34030640 1 -- 172.21.15.78:0/2838872221 wait complete. 2024-09-17T03:14:47.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.793+0000 7f0e34030640 1 Processor -- start 2024-09-17T03:14:47.792 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.793+0000 7f0e34030640 1 -- start start 2024-09-17T03:14:47.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.794+0000 7f0e34030640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0e18004800 0x7f0e2c14e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:47.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.794+0000 7f0e34030640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e2c0c9270 0x7f0e2c0c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:47.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.794+0000 7f0e34030640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e2c0c9bc0 0x7f0e2c150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:47.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.794+0000 7f0e34030640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c0cf420 con 0x7f0e2c0c9270 2024-09-17T03:14:47.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.794+0000 7f0e34030640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c0cf2a0 con 0x7f0e2c0c9bc0 2024-09-17T03:14:47.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.794+0000 7f0e34030640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0e2c0cf5a0 con 0x7f0e18004800 2024-09-17T03:14:47.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.794+0000 7f0e315cb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e2c0c9270 0x7f0e2c0c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:47.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.794+0000 7f0e315cb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e2c0c9270 0x7f0e2c0c9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60726/0 (socket says 172.21.15.78:60726) 2024-09-17T03:14:47.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.794+0000 7f0e315cb640 1 -- 172.21.15.78:0/3667953458 learned_addr learned my addr 172.21.15.78:0/3667953458 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:47.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.794+0000 7f0e31dcc640 1 --2- 172.21.15.78:0/3667953458 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0e18004800 0x7f0e2c14e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:47.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.794+0000 7f0e325cd640 1 --2- 172.21.15.78:0/3667953458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e2c0c9bc0 0x7f0e2c150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:47.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.794+0000 7f0e315cb640 1 -- 172.21.15.78:0/3667953458 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0e18004800 msgr2=0x7f0e2c14e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:47.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.794+0000 7f0e315cb640 1 --2- 172.21.15.78:0/3667953458 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0e18004800 0x7f0e2c14e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:47.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.794+0000 7f0e315cb640 1 -- 172.21.15.78:0/3667953458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e2c0c9bc0 msgr2=0x7f0e2c150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:47.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.794+0000 7f0e315cb640 1 --2- 172.21.15.78:0/3667953458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e2c0c9bc0 0x7f0e2c150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:47.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.794+0000 7f0e315cb640 1 -- 172.21.15.78:0/3667953458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e2c15d1c0 con 0x7f0e2c0c9270 2024-09-17T03:14:47.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.794+0000 7f0e325cd640 1 --2- 172.21.15.78:0/3667953458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e2c0c9bc0 0x7f0e2c150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:47.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.795+0000 7f0e315cb640 1 --2- 172.21.15.78:0/3667953458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e2c0c9270 0x7f0e2c0c9680 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0017e0 tx=0x7f0e1c0063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:47.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.795+0000 7f0e227fc640 1 -- 172.21.15.78:0/3667953458 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c042070 con 0x7f0e2c0c9270 2024-09-17T03:14:47.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.795+0000 7f0e227fc640 1 -- 172.21.15.78:0/3667953458 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e1c039070 con 0x7f0e2c0c9270 2024-09-17T03:14:47.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.795+0000 7f0e227fc640 1 -- 172.21.15.78:0/3667953458 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c003d70 con 0x7f0e2c0c9270 2024-09-17T03:14:47.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.795+0000 7f0e34030640 1 -- 172.21.15.78:0/3667953458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e2c15ff10 con 0x7f0e2c0c9270 2024-09-17T03:14:47.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.795+0000 7f0e34030640 1 -- 172.21.15.78:0/3667953458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e2c1604d0 con 0x7f0e2c0c9270 2024-09-17T03:14:47.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.796+0000 7f0e34030640 1 -- 172.21.15.78:0/3667953458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e2c0b9df0 con 0x7f0e2c0c9270 2024-09-17T03:14:47.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.797+0000 7f0e227fc640 1 -- 172.21.15.78:0/3667953458 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0e1c03b070 con 0x7f0e2c0c9270 2024-09-17T03:14:47.798 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.797+0000 7f0e227fc640 1 --2- 172.21.15.78:0/3667953458 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0e10078b90 0x7f0e1007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:47.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.797+0000 7f0e227fc640 1 -- 172.21.15.78:0/3667953458 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f0e1c0ba370 con 0x7f0e2c0c9270 2024-09-17T03:14:47.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.797+0000 7f0e31dcc640 1 --2- 172.21.15.78:0/3667953458 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0e10078b90 0x7f0e1007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:47.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.798+0000 7f0e31dcc640 1 --2- 172.21.15.78:0/3667953458 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0e10078b90 0x7f0e1007b0a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0e28001180 tx=0x7f0e280067c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:47.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:47.802+0000 7f0e227fc640 1 -- 172.21.15.78:0/3667953458 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0e2c15d1c0 con 0x7f0e2c0c9270 2024-09-17T03:14:48.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:48.013+0000 7f0e34030640 1 -- 172.21.15.78:0/3667953458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e2c0b4020 con 0x7f0e2c0c9270 2024-09-17T03:14:48.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:48.014+0000 7f0e227fc640 1 -- 172.21.15.78:0/3667953458 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+5247 (secure 0 0 0) 0x7f0e1c082160 con 0x7f0e2c0c9270 2024-09-17T03:14:48.014 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:48.014 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":95,"btime":"2024-09-17T03:14:47:646067+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":7213,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:14:47.646010+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":8286,"mds_1":8283},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8283":{"gid":8283,"name":"a","rank":1,"incarnation":95,"state":"up:creating","state_seq":1,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[8286]},"id":7}]} 2024-09-17T03:14:48.014 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 95 2024-09-17T03:14:48.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:48.016+0000 7f0e34030640 1 -- 172.21.15.78:0/3667953458 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0e10078b90 msgr2=0x7f0e1007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:48.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:48.016+0000 7f0e34030640 1 --2- 172.21.15.78:0/3667953458 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0e10078b90 0x7f0e1007b0a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f0e28001180 tx=0x7f0e280067c0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:48.016+0000 7f0e34030640 1 -- 172.21.15.78:0/3667953458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e2c0c9270 msgr2=0x7f0e2c0c9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:48.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:48.016+0000 7f0e34030640 1 --2- 172.21.15.78:0/3667953458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e2c0c9270 0x7f0e2c0c9680 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0017e0 tx=0x7f0e1c0063a0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:48.016+0000 7f0e34030640 1 -- 172.21.15.78:0/3667953458 shutdown_connections 2024-09-17T03:14:48.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:48.016+0000 7f0e34030640 1 --2- 172.21.15.78:0/3667953458 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0e10078b90 0x7f0e1007b0a0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:48.016+0000 7f0e34030640 1 --2- 172.21.15.78:0/3667953458 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0e2c0c9bc0 0x7f0e2c150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:48.016+0000 7f0e34030640 1 --2- 172.21.15.78:0/3667953458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e2c0c9270 0x7f0e2c0c9680 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:48.016+0000 7f0e34030640 1 --2- 172.21.15.78:0/3667953458 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0e18004800 0x7f0e2c14e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:48.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:48.016+0000 7f0e34030640 1 -- 172.21.15.78:0/3667953458 >> 172.21.15.78:0/3667953458 conn(0x7f0e2c08bfc0 msgr2=0x7f0e2c0b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:48.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:48.016+0000 7f0e34030640 1 -- 172.21.15.78:0/3667953458 shutdown_connections 2024-09-17T03:14:48.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:48.016+0000 7f0e34030640 1 -- 172.21.15.78:0/3667953458 wait complete. 2024-09-17T03:14:48.429 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 95, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:14:39.064178+0000', 'modified': '2024-09-17T03:14:47.646010+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1], 'up': {'mds_0': 8286, 'mds_1': 8283}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8283': {'gid': 8283, 'name': 'a', 'rank': 1, 'incarnation': 95, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.78:6834/1810198137', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6832', 'nonce': 1810198137}, {'type': 'v1', 'addr': '172.21.15.78:6834', 'nonce': 1810198137}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_8286': {'gid': 8286, 'name': 'c', 'rank': 0, 'incarnation': 90, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6835/1623349891', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6833', 'nonce': 1623349891}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 1623349891}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8286, 'qdb_cluster': [8286]} 2024-09-17T03:14:48.430 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8283:up:creating 2024-09-17T03:14:49.430 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:49.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.556+0000 7f05e0a4d640 1 -- 172.21.15.78:0/1315115116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05dc0ccb50 msgr2=0x7f05dc0ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:49.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.556+0000 7f05e0a4d640 1 --2- 172.21.15.78:0/1315115116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05dc0ccb50 0x7f05dc0ccf60 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f05d4005fd0 tx=0x7f05d402aa90 comp rx=0 tx=0).stop 2024-09-17T03:14:49.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.556+0000 7f05e0a4d640 1 -- 172.21.15.78:0/1315115116 shutdown_connections 2024-09-17T03:14:49.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.556+0000 7f05e0a4d640 1 --2- 172.21.15.78:0/1315115116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05dc0ccb50 0x7f05dc0ccf60 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.556+0000 7f05e0a4d640 1 --2- 172.21.15.78:0/1315115116 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f05dc0cc1e0 0x7f05dc0af3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.556+0000 7f05e0a4d640 1 -- 172.21.15.78:0/1315115116 >> 172.21.15.78:0/1315115116 conn(0x7f05dc06d7d0 msgr2=0x7f05dc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:49.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.556+0000 7f05e0a4d640 1 -- 172.21.15.78:0/1315115116 shutdown_connections 2024-09-17T03:14:49.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.556+0000 7f05e0a4d640 1 -- 172.21.15.78:0/1315115116 wait complete. 2024-09-17T03:14:49.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.558+0000 7f05e0a4d640 1 Processor -- start 2024-09-17T03:14:49.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.558+0000 7f05e0a4d640 1 -- start start 2024-09-17T03:14:49.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.560+0000 7f05e0a4d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f05dc0cc1e0 0x7f05dc1f9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.560+0000 7f05e0a4d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05dc0ccb50 0x7f05dc1e9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.560+0000 7f05e0a4d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05dc15d8a0 0x7f05dc1587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.560+0000 7f05e0a4d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc153520 con 0x7f05dc15d8a0 2024-09-17T03:14:49.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.560+0000 7f05e0a4d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f05dc1533a0 con 0x7f05dc0ccb50 2024-09-17T03:14:49.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.560+0000 7f05e0a4d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f05dc1536a0 con 0x7f05dc0cc1e0 2024-09-17T03:14:49.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.560+0000 7f05dad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05dc15d8a0 0x7f05dc1587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.560+0000 7f05dad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05dc15d8a0 0x7f05dc1587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60748/0 (socket says 172.21.15.78:60748) 2024-09-17T03:14:49.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.560+0000 7f05dad9d640 1 -- 172.21.15.78:0/2417785933 learned_addr learned my addr 172.21.15.78:0/2417785933 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:49.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.560+0000 7f05da59c640 1 --2- 172.21.15.78:0/2417785933 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f05dc0cc1e0 0x7f05dc1f9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.560+0000 7f05d1d9b640 1 --2- 172.21.15.78:0/2417785933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05dc0ccb50 0x7f05dc1e9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.560+0000 7f05dad9d640 1 -- 172.21.15.78:0/2417785933 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f05dc0cc1e0 msgr2=0x7f05dc1f9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:49.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.560+0000 7f05dad9d640 1 --2- 172.21.15.78:0/2417785933 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f05dc0cc1e0 0x7f05dc1f9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.560+0000 7f05dad9d640 1 -- 172.21.15.78:0/2417785933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05dc0ccb50 msgr2=0x7f05dc1e9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:49.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.560+0000 7f05dad9d640 1 --2- 172.21.15.78:0/2417785933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05dc0ccb50 0x7f05dc1e9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.560+0000 7f05dad9d640 1 -- 172.21.15.78:0/2417785933 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05dc15a5e0 con 0x7f05dc15d8a0 2024-09-17T03:14:49.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.560+0000 7f05dad9d640 1 --2- 172.21.15.78:0/2417785933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05dc15d8a0 0x7f05dc1587a0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f05d4006010 tx=0x7f05d4003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:49.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.560+0000 7f05d37fe640 1 -- 172.21.15.78:0/2417785933 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4044070 con 0x7f05dc15d8a0 2024-09-17T03:14:49.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.560+0000 7f05d37fe640 1 -- 172.21.15.78:0/2417785933 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05d4004040 con 0x7f05dc15d8a0 2024-09-17T03:14:49.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.561+0000 7f05d37fe640 1 -- 172.21.15.78:0/2417785933 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4004430 con 0x7f05dc15d8a0 2024-09-17T03:14:49.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.561+0000 7f05e0a4d640 1 -- 172.21.15.78:0/2417785933 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05dc159a50 con 0x7f05dc15d8a0 2024-09-17T03:14:49.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.561+0000 7f05e0a4d640 1 -- 172.21.15.78:0/2417785933 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05dc158120 con 0x7f05dc15d8a0 2024-09-17T03:14:49.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.562+0000 7f05e0a4d640 1 -- 172.21.15.78:0/2417785933 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05dc153b50 con 0x7f05dc15d8a0 2024-09-17T03:14:49.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.562+0000 7f05d37fe640 1 -- 172.21.15.78:0/2417785933 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f05d4047070 con 0x7f05dc15d8a0 2024-09-17T03:14:49.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.563+0000 7f05d37fe640 1 --2- 172.21.15.78:0/2417785933 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f05bc078bc0 0x7f05bc07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:49.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.563+0000 7f05d37fe640 1 -- 172.21.15.78:0/2417785933 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f05d40bbc60 con 0x7f05dc15d8a0 2024-09-17T03:14:49.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.563+0000 7f05da59c640 1 --2- 172.21.15.78:0/2417785933 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f05bc078bc0 0x7f05bc07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:49.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.564+0000 7f05da59c640 1 --2- 172.21.15.78:0/2417785933 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f05bc078bc0 0x7f05bc07b0d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f05cc009b30 tx=0x7f05cc005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:49.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.568+0000 7f05d37fe640 1 -- 172.21.15.78:0/2417785933 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f05d4032030 con 0x7f05dc15d8a0 2024-09-17T03:14:49.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.776+0000 7f05e0a4d640 1 -- 172.21.15.78:0/2417785933 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f05dc0b1dc0 con 0x7f05dc15d8a0 2024-09-17T03:14:49.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.777+0000 7f05d37fe640 1 -- 172.21.15.78:0/2417785933 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5269 (secure 0 0 0) 0x7f05d40839d0 con 0x7f05dc15d8a0 2024-09-17T03:14:49.777 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:49.777 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":98,"btime":"2024-09-17T03:14:49:656474+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:14:49.656466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8286,"mds_1":8283,"mds_2":7213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7213":{"gid":7213,"name":"d","rank":2,"incarnation":97,"state":"up:active","state_seq":5,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8283":{"gid":8283,"name":"a","rank":1,"incarnation":95,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[7213,8283,8286]},"id":7}]} 2024-09-17T03:14:49.777 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 98 2024-09-17T03:14:49.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.779+0000 7f05e0a4d640 1 -- 172.21.15.78:0/2417785933 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f05bc078bc0 msgr2=0x7f05bc07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:49.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.779+0000 7f05e0a4d640 1 --2- 172.21.15.78:0/2417785933 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f05bc078bc0 0x7f05bc07b0d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f05cc009b30 tx=0x7f05cc005f90 comp rx=0 tx=0).stop 2024-09-17T03:14:49.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.779+0000 7f05e0a4d640 1 -- 172.21.15.78:0/2417785933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05dc15d8a0 msgr2=0x7f05dc1587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:49.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.779+0000 7f05e0a4d640 1 --2- 172.21.15.78:0/2417785933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05dc15d8a0 0x7f05dc1587a0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f05d4006010 tx=0x7f05d4003ce0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.779+0000 7f05e0a4d640 1 -- 172.21.15.78:0/2417785933 shutdown_connections 2024-09-17T03:14:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.779+0000 7f05e0a4d640 1 --2- 172.21.15.78:0/2417785933 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05dc15d8a0 0x7f05dc1587a0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.779+0000 7f05e0a4d640 1 --2- 172.21.15.78:0/2417785933 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f05bc078bc0 0x7f05bc07b0d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.779+0000 7f05e0a4d640 1 --2- 172.21.15.78:0/2417785933 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f05dc0ccb50 0x7f05dc1e9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.779+0000 7f05e0a4d640 1 --2- 172.21.15.78:0/2417785933 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f05dc0cc1e0 0x7f05dc1f9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.779+0000 7f05e0a4d640 1 -- 172.21.15.78:0/2417785933 >> 172.21.15.78:0/2417785933 conn(0x7f05dc06d7d0 msgr2=0x7f05dc0acf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.779+0000 7f05e0a4d640 1 -- 172.21.15.78:0/2417785933 shutdown_connections 2024-09-17T03:14:49.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:49.779+0000 7f05e0a4d640 1 -- 172.21.15.78:0/2417785933 wait complete. 2024-09-17T03:14:50.194 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 98, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T03:14:39.064178+0000', 'modified': '2024-09-17T03:14:49.656466+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 8286, 'mds_1': 8283, 'mds_2': 7213}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7213': {'gid': 7213, 'name': 'd', 'rank': 2, 'incarnation': 97, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.193:6837/2983826871', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6835', 'nonce': 2983826871}, {'type': 'v1', 'addr': '172.21.15.193:6837', 'nonce': 2983826871}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_8283': {'gid': 8283, 'name': 'a', 'rank': 1, 'incarnation': 95, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.78:6834/1810198137', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6832', 'nonce': 1810198137}, {'type': 'v1', 'addr': '172.21.15.78:6834', 'nonce': 1810198137}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_8286': {'gid': 8286, 'name': 'c', 'rank': 0, 'incarnation': 90, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6835/1623349891', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6833', 'nonce': 1623349891}, {'type': 'v1', 'addr': '172.21.15.78:6835', 'nonce': 1623349891}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8286, 'qdb_cluster': [7213, 8283, 8286]} 2024-09-17T03:14:50.194 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-17T03:14:50.194 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T03:14:50.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.309+0000 7fd857c1d640 1 -- 172.21.15.78:0/91880859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd850074560 msgr2=0x7fd8500cfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.309+0000 7fd857c1d640 1 --2- 172.21.15.78:0/91880859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd850074560 0x7fd8500cfe60 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fd8500749e0 tx=0x7fd84002a530 comp rx=0 tx=0).stop 2024-09-17T03:14:50.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.309+0000 7fd857c1d640 1 -- 172.21.15.78:0/91880859 shutdown_connections 2024-09-17T03:14:50.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.309+0000 7fd857c1d640 1 --2- 172.21.15.78:0/91880859 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd850074560 0x7fd8500cfe60 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.309+0000 7fd857c1d640 1 --2- 172.21.15.78:0/91880859 >> v2:172.21.15.193:3300/0 conn(0x7fd850144270 0x7fd8500b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.309+0000 7fd857c1d640 1 -- 172.21.15.78:0/91880859 >> 172.21.15.78:0/91880859 conn(0x7fd8500d15f0 msgr2=0x7fd850073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:50.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.309+0000 7fd857c1d640 1 -- 172.21.15.78:0/91880859 shutdown_connections 2024-09-17T03:14:50.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.309+0000 7fd857c1d640 1 -- 172.21.15.78:0/91880859 wait complete. 2024-09-17T03:14:50.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.311+0000 7fd857c1d640 1 Processor -- start 2024-09-17T03:14:50.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.311+0000 7fd857c1d640 1 -- start start 2024-09-17T03:14:50.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.312+0000 7fd857c1d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd850142270 0x7fd8500c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.312+0000 7fd857c1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd850144270 0x7fd850158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.312+0000 7fd857c1d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd85013d010 0x7fd85013edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.312+0000 7fd857c1d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd850142800 con 0x7fd850144270 2024-09-17T03:14:50.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.312+0000 7fd857c1d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd850142680 con 0x7fd85013d010 2024-09-17T03:14:50.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.312+0000 7fd857c1d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd850142980 con 0x7fd850142270 2024-09-17T03:14:50.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.312+0000 7fd8551b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd850144270 0x7fd850158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.312+0000 7fd8551b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd850144270 0x7fd850158950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60756/0 (socket says 172.21.15.78:60756) 2024-09-17T03:14:50.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.312+0000 7fd8551b8640 1 -- 172.21.15.78:0/3295570252 learned_addr learned my addr 172.21.15.78:0/3295570252 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:50.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.313+0000 7fd8559b9640 1 --2- 172.21.15.78:0/3295570252 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd850142270 0x7fd8500c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.313+0000 7fd8561ba640 1 --2- 172.21.15.78:0/3295570252 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd85013d010 0x7fd85013edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.313+0000 7fd8551b8640 1 -- 172.21.15.78:0/3295570252 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd850142270 msgr2=0x7fd8500c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.313+0000 7fd8551b8640 1 --2- 172.21.15.78:0/3295570252 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd850142270 0x7fd8500c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.313+0000 7fd8551b8640 1 -- 172.21.15.78:0/3295570252 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd85013d010 msgr2=0x7fd85013edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.313+0000 7fd8551b8640 1 --2- 172.21.15.78:0/3295570252 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd85013d010 0x7fd85013edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.313+0000 7fd8551b8640 1 -- 172.21.15.78:0/3295570252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd850158e90 con 0x7fd850144270 2024-09-17T03:14:50.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.313+0000 7fd8559b9640 1 --2- 172.21.15.78:0/3295570252 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd850142270 0x7fd8500c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:50.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.313+0000 7fd8551b8640 1 --2- 172.21.15.78:0/3295570252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd850144270 0x7fd850158950 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fd84400c6f0 tx=0x7fd84400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:50.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.313+0000 7fd84e7fc640 1 -- 172.21.15.78:0/3295570252 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd844003ba0 con 0x7fd850144270 2024-09-17T03:14:50.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.313+0000 7fd84e7fc640 1 -- 172.21.15.78:0/3295570252 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd844003d40 con 0x7fd850144270 2024-09-17T03:14:50.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.313+0000 7fd84e7fc640 1 -- 172.21.15.78:0/3295570252 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8440052d0 con 0x7fd850144270 2024-09-17T03:14:50.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.313+0000 7fd857c1d640 1 -- 172.21.15.78:0/3295570252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8500cc920 con 0x7fd850144270 2024-09-17T03:14:50.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.313+0000 7fd857c1d640 1 -- 172.21.15.78:0/3295570252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8500c59d0 con 0x7fd850144270 2024-09-17T03:14:50.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.315+0000 7fd84e7fc640 1 -- 172.21.15.78:0/3295570252 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd844005470 con 0x7fd850144270 2024-09-17T03:14:50.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.316+0000 7fd84e7fc640 1 --2- 172.21.15.78:0/3295570252 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd83c078b90 0x7fd83c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.316+0000 7fd84e7fc640 1 -- 172.21.15.78:0/3295570252 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fd84409ac50 con 0x7fd850144270 2024-09-17T03:14:50.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.316+0000 7fd8559b9640 1 --2- 172.21.15.78:0/3295570252 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd83c078b90 0x7fd83c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.316+0000 7fd85ec64740 1 Processor -- start 2024-09-17T03:14:50.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.316+0000 7fd85ec64740 1 -- start start 2024-09-17T03:14:50.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.316+0000 7fd8559b9640 1 --2- 172.21.15.78:0/3295570252 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd83c078b90 0x7fd83c07b0a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd84800ab40 tx=0x7fd84800a520 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:50.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.317+0000 7fd85ec64740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 0x55bd36a743b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.318+0000 7fd85ec64740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 0x55bd36a748f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.318+0000 7fd85ec64740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd3667d590 0x55bd36a917f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.318+0000 7fd85ec64740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55bd369b8820 con 0x55bd3669e270 2024-09-17T03:14:50.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.318+0000 7fd85ec64740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55bd369a7c50 con 0x55bd366753b0 2024-09-17T03:14:50.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.318+0000 7fd85ec64740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55bd369aba60 con 0x55bd3667d590 2024-09-17T03:14:50.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.318+0000 7fd8559b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 0x55bd36a743b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.318+0000 7fd8559b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 0x55bd36a743b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60760/0 (socket says 172.21.15.78:60760) 2024-09-17T03:14:50.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.318+0000 7fd8559b9640 1 -- 172.21.15.78:0/2479516551 learned_addr learned my addr 172.21.15.78:0/2479516551 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:50.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.318+0000 7fd8561ba640 1 --2- 172.21.15.78:0/2479516551 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd3667d590 0x55bd36a917f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.318+0000 7fd8551b8640 1 --2- 172.21.15.78:0/2479516551 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 0x55bd36a748f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.318+0000 7fd8559b9640 1 -- 172.21.15.78:0/2479516551 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd3667d590 msgr2=0x55bd36a917f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.318+0000 7fd8559b9640 1 --2- 172.21.15.78:0/2479516551 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd3667d590 0x55bd36a917f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.318+0000 7fd8559b9640 1 -- 172.21.15.78:0/2479516551 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 msgr2=0x55bd36a748f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.318+0000 7fd8559b9640 1 --2- 172.21.15.78:0/2479516551 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 0x55bd36a748f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.318+0000 7fd8559b9640 1 -- 172.21.15.78:0/2479516551 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd36709850 con 0x55bd3669e270 2024-09-17T03:14:50.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.318+0000 7fd8551b8640 1 --2- 172.21.15.78:0/2479516551 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 0x55bd36a748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:50.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.318+0000 7fd8559b9640 1 --2- 172.21.15.78:0/2479516551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 0x55bd36a743b0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fd84800ee30 tx=0x7fd848011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85df4bdbf65fd675 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:50.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.318+0000 7fd8377fe640 1 -- 172.21.15.78:0/2479516551 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd848021070 con 0x55bd3669e270 2024-09-17T03:14:50.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.318+0000 7fd8377fe640 1 -- 172.21.15.78:0/2479516551 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd84801d950 con 0x55bd3669e270 2024-09-17T03:14:50.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.318+0000 7fd8377fe640 1 -- 172.21.15.78:0/2479516551 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84801dd00 con 0x55bd3669e270 2024-09-17T03:14:50.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.319+0000 7fd85ec64740 1 -- 172.21.15.78:0/2479516551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 msgr2=0x55bd36a743b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.319+0000 7fd85ec64740 1 --2- 172.21.15.78:0/2479516551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 0x55bd36a743b0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fd84800ee30 tx=0x7fd848011000 comp rx=0 tx=0).stop 2024-09-17T03:14:50.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.319+0000 7fd85ec64740 1 -- 172.21.15.78:0/2479516551 shutdown_connections 2024-09-17T03:14:50.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.319+0000 7fd85ec64740 1 --2- 172.21.15.78:0/2479516551 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd3667d590 0x55bd36a917f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.319+0000 7fd85ec64740 1 --2- 172.21.15.78:0/2479516551 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 0x55bd36a748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.319+0000 7fd85ec64740 1 --2- 172.21.15.78:0/2479516551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 0x55bd36a743b0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.319+0000 7fd85ec64740 1 -- 172.21.15.78:0/2479516551 >> 172.21.15.78:0/2479516551 conn(0x55bd366923c0 msgr2=0x55bd36a4a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:50.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.319+0000 7fd85ec64740 1 -- 172.21.15.78:0/2479516551 shutdown_connections 2024-09-17T03:14:50.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.319+0000 7fd85ec64740 1 -- 172.21.15.78:0/2479516551 wait complete. 2024-09-17T03:14:50.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.320+0000 7fd85ec64740 1 -- start start 2024-09-17T03:14:50.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.320+0000 7fd85ec64740 1 Processor -- start 2024-09-17T03:14:50.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd85ec64740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 0x55bd36a62cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd85ec64740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3667d590 0x55bd36a8a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd85ec64740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd3669e270 0x55bd36a91550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd85ec64740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55bd36718620 con 0x55bd3667d590 2024-09-17T03:14:50.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd85ec64740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55bd3694d5f0 con 0x55bd366753b0 2024-09-17T03:14:50.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd85ec64740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55bd36a74e30 con 0x55bd3669e270 2024-09-17T03:14:50.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd85ec64740 10 client.0 _ll_register_callbacks cb 0x55bd369510a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:50.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd8551b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3667d590 0x55bd36a8a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd8551b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3667d590 0x55bd36a8a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60770/0 (socket says 172.21.15.78:60770) 2024-09-17T03:14:50.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd8551b8640 1 -- 172.21.15.78:0/251331363 learned_addr learned my addr 172.21.15.78:0/251331363 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:50.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd8561ba640 1 --2- 172.21.15.78:0/251331363 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd3669e270 0x55bd36a91550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd8559b9640 1 --2- 172.21.15.78:0/251331363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 0x55bd36a62cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd8551b8640 1 -- 172.21.15.78:0/251331363 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd3669e270 msgr2=0x55bd36a91550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd8551b8640 1 --2- 172.21.15.78:0/251331363 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd3669e270 0x55bd36a91550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd8551b8640 1 -- 172.21.15.78:0/251331363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 msgr2=0x55bd36a62cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd8551b8640 1 --2- 172.21.15.78:0/251331363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 0x55bd36a62cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd8551b8640 1 -- 172.21.15.78:0/251331363 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd367806b0 con 0x55bd3667d590 2024-09-17T03:14:50.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd8559b9640 1 --2- 172.21.15.78:0/251331363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 0x55bd36a62cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:50.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd8551b8640 1 --2- 172.21.15.78:0/251331363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3667d590 0x55bd36a8a090 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fd8440629d0 tx=0x7fd8440621b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985753e83930a284 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:50.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd834ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:50.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd834ff9640 1 -- 172.21.15.78:0/251331363 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84406c120 con 0x55bd3667d590 2024-09-17T03:14:50.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd834ff9640 1 -- 172.21.15.78:0/251331363 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fd844078b40 con 0x55bd3667d590 2024-09-17T03:14:50.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd85ec64740 1 -- 172.21.15.78:0/251331363 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd84801d950 con 0x55bd3667d590 2024-09-17T03:14:50.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd834ff9640 1 -- 172.21.15.78:0/251331363 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7fd844083050 con 0x55bd3667d590 2024-09-17T03:14:50.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd85ec64740 10 client.8466 fetch_fsmap learned FSMap version 98 2024-09-17T03:14:50.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.322+0000 7fd85ec64740 1 -- 172.21.15.78:0/251331363 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x55bd36a88730 con 0x55bd3667d590 2024-09-17T03:14:50.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.323+0000 7fd834ff9640 1 -- 172.21.15.78:0/251331363 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd84801d950 con 0x55bd3667d590 2024-09-17T03:14:50.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.323+0000 7fd834ff9640 1 -- 172.21.15.78:0/251331363 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 98) ==== 3542+0+0 (secure 0 0 0) 0x7fd844061ca0 con 0x55bd3667d590 2024-09-17T03:14:50.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.323+0000 7fd85ec64740 10 client.8466 fetch_fsmap finished waiting for FSMap version 98 2024-09-17T03:14:50.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.323+0000 7fd85ec64740 10 client.8466 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:14:50.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.323+0000 7fd85ec64740 20 client.8466 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:50.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.323+0000 7fd85ec64740 1 --2- 172.21.15.78:0/251331363 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x55bd3665ce40 0x55bd36a92740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.323+0000 7fd85ec64740 4 client.8466 mds_command: new command op to 7213 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:14:50.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.323+0000 7fd85ec64740 1 -- 172.21.15.78:0/251331363 --> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd369ba770 con 0x55bd3665ce40 2024-09-17T03:14:50.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.323+0000 7fd8559b9640 1 --2- 172.21.15.78:0/251331363 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x55bd3665ce40 0x55bd36a92740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.323+0000 7fd8559b9640 1 --2- 172.21.15.78:0/251331363 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x55bd3665ce40 0x55bd36a92740 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=732d8d5e1a83b58f server_cookie=10e0b27edc4ae8ad in_seq=0 out_seq=0 2024-09-17T03:14:50.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.323+0000 7fd834ff9640 10 client.8466 ms_handle_connect on v2:172.21.15.193:6835/2983826871 2024-09-17T03:14:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.324+0000 7fd834ff9640 1 -- 172.21.15.78:0/251331363 <== mds.2 v2:172.21.15.193:6835/2983826871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bd369ba770 con 0x55bd3665ce40 2024-09-17T03:14:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.324+0000 7fd834ff9640 10 client.8466 handle_command_reply: tid=0 2024-09-17T03:14:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.324+0000 7fd85ec64740 1 client.8466 shutdown 2024-09-17T03:14:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.324+0000 7fd85ec64740 1 -- 172.21.15.78:0/251331363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3667d590 msgr2=0x55bd36a8a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.324+0000 7fd85ec64740 1 --2- 172.21.15.78:0/251331363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3667d590 0x55bd36a8a090 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fd8440629d0 tx=0x7fd8440621b0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.324+0000 7fd85ec64740 1 -- 172.21.15.78:0/251331363 shutdown_connections 2024-09-17T03:14:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.324+0000 7fd85ec64740 1 --2- 172.21.15.78:0/251331363 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x55bd3665ce40 0x55bd36a92740 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.324+0000 7fd85ec64740 1 --2- 172.21.15.78:0/251331363 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd3669e270 0x55bd36a91550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.324+0000 7fd85ec64740 1 --2- 172.21.15.78:0/251331363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3667d590 0x55bd36a8a090 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.324+0000 7fd834ff9640 0 client.8466 ms_handle_reset on v2:172.21.15.193:6835/2983826871 2024-09-17T03:14:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.324+0000 7fd85ec64740 1 --2- 172.21.15.78:0/251331363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 0x55bd36a62cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.324+0000 7fd85ec64740 1 -- 172.21.15.78:0/251331363 >> 172.21.15.78:0/251331363 conn(0x55bd366923c0 msgr2=0x55bd36a90dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:50.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.325+0000 7fd85ec64740 1 -- 172.21.15.78:0/251331363 shutdown_connections 2024-09-17T03:14:50.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.325+0000 7fd85ec64740 1 -- 172.21.15.78:0/251331363 wait complete. 2024-09-17T03:14:50.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.325+0000 7fd85ec64740 20 client.8466 trim_cache size 0 max 16384 2024-09-17T03:14:50.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.343+0000 7fd85ec64740 1 Processor -- start 2024-09-17T03:14:50.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.343+0000 7fd85ec64740 1 -- start start 2024-09-17T03:14:50.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.344+0000 7fd85ec64740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 0x55bd36a711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.344+0000 7fd85ec64740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd3667d590 0x55bd36a89780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.344+0000 7fd85ec64740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 0x55bd36a89cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.344+0000 7fd85ec64740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd8501fdb70 con 0x55bd3669e270 2024-09-17T03:14:50.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.344+0000 7fd85ec64740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd8500b4490 con 0x55bd366753b0 2024-09-17T03:14:50.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.344+0000 7fd85ec64740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd850157930 con 0x55bd3667d590 2024-09-17T03:14:50.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.345+0000 7fd8561ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 0x55bd36a89cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.345+0000 7fd8561ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 0x55bd36a89cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60782/0 (socket says 172.21.15.78:60782) 2024-09-17T03:14:50.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.345+0000 7fd8561ba640 1 -- 172.21.15.78:0/2064330150 learned_addr learned my addr 172.21.15.78:0/2064330150 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:50.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.345+0000 7fd8551b8640 1 --2- 172.21.15.78:0/2064330150 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd3667d590 0x55bd36a89780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.345+0000 7fd8559b9640 1 --2- 172.21.15.78:0/2064330150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 0x55bd36a711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.345+0000 7fd8561ba640 1 -- 172.21.15.78:0/2064330150 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd3667d590 msgr2=0x55bd36a89780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.345+0000 7fd8561ba640 1 --2- 172.21.15.78:0/2064330150 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd3667d590 0x55bd36a89780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.345+0000 7fd8561ba640 1 -- 172.21.15.78:0/2064330150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 msgr2=0x55bd36a711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.345+0000 7fd8561ba640 1 --2- 172.21.15.78:0/2064330150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 0x55bd36a711a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.345+0000 7fd8561ba640 1 -- 172.21.15.78:0/2064330150 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd36a46f80 con 0x55bd3669e270 2024-09-17T03:14:50.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.345+0000 7fd8559b9640 1 --2- 172.21.15.78:0/2064330150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 0x55bd36a711a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:50.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.345+0000 7fd8561ba640 1 --2- 172.21.15.78:0/2064330150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 0x55bd36a89cc0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fd840004310 tx=0x7fd8400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546516bf1fddad60 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:50.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.345+0000 7fd836ffd640 1 -- 172.21.15.78:0/2064330150 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840005220 con 0x55bd3669e270 2024-09-17T03:14:50.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.345+0000 7fd836ffd640 1 -- 172.21.15.78:0/2064330150 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8400053c0 con 0x55bd3669e270 2024-09-17T03:14:50.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.345+0000 7fd836ffd640 1 -- 172.21.15.78:0/2064330150 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8400044b0 con 0x55bd3669e270 2024-09-17T03:14:50.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.346+0000 7fd85ec64740 1 -- 172.21.15.78:0/2064330150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 msgr2=0x55bd36a89cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.346+0000 7fd85ec64740 1 --2- 172.21.15.78:0/2064330150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 0x55bd36a89cc0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fd840004310 tx=0x7fd8400046c0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.346+0000 7fd85ec64740 1 -- 172.21.15.78:0/2064330150 shutdown_connections 2024-09-17T03:14:50.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.346+0000 7fd85ec64740 1 --2- 172.21.15.78:0/2064330150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 0x55bd36a89cc0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.346+0000 7fd85ec64740 1 --2- 172.21.15.78:0/2064330150 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd3667d590 0x55bd36a89780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.346+0000 7fd85ec64740 1 --2- 172.21.15.78:0/2064330150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 0x55bd36a711a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.346+0000 7fd85ec64740 1 -- 172.21.15.78:0/2064330150 >> 172.21.15.78:0/2064330150 conn(0x55bd366923c0 msgr2=0x55bd36a88b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:50.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.346+0000 7fd85ec64740 1 -- 172.21.15.78:0/2064330150 shutdown_connections 2024-09-17T03:14:50.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.346+0000 7fd85ec64740 1 -- 172.21.15.78:0/2064330150 wait complete. 2024-09-17T03:14:50.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.347+0000 7fd85ec64740 1 -- start start 2024-09-17T03:14:50.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.347+0000 7fd85ec64740 1 Processor -- start 2024-09-17T03:14:50.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.348+0000 7fd85ec64740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 0x55bd36a91680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.348+0000 7fd85ec64740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd3667d590 0x55bd36a71540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.348+0000 7fd85ec64740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 0x55bd36a89780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.348+0000 7fd85ec64740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55bd36a91c70 con 0x55bd3669e270 2024-09-17T03:14:50.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.348+0000 7fd85ec64740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55bd36a631f0 con 0x55bd366753b0 2024-09-17T03:14:50.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.348+0000 7fd85ec64740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55bd36a87980 con 0x55bd3667d590 2024-09-17T03:14:50.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.348+0000 7fd85ec64740 10 client.0 _ll_register_callbacks cb 0x7fd8440017a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:50.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.348+0000 7fd8561ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 0x55bd36a89780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.349+0000 7fd8561ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 0x55bd36a89780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60792/0 (socket says 172.21.15.78:60792) 2024-09-17T03:14:50.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.349+0000 7fd8561ba640 1 -- 172.21.15.78:0/3853609002 learned_addr learned my addr 172.21.15.78:0/3853609002 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:50.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.349+0000 7fd8559b9640 1 --2- 172.21.15.78:0/3853609002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 0x55bd36a91680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.349+0000 7fd8551b8640 1 --2- 172.21.15.78:0/3853609002 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd3667d590 0x55bd36a71540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.349+0000 7fd8561ba640 1 -- 172.21.15.78:0/3853609002 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd3667d590 msgr2=0x55bd36a71540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.349+0000 7fd8561ba640 1 --2- 172.21.15.78:0/3853609002 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd3667d590 0x55bd36a71540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.349+0000 7fd8561ba640 1 -- 172.21.15.78:0/3853609002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 msgr2=0x55bd36a91680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.349+0000 7fd8561ba640 1 --2- 172.21.15.78:0/3853609002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 0x55bd36a91680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.349+0000 7fd8561ba640 1 -- 172.21.15.78:0/3853609002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd36a88960 con 0x55bd3669e270 2024-09-17T03:14:50.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.349+0000 7fd8561ba640 1 --2- 172.21.15.78:0/3853609002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 0x55bd36a89780 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fd840009920 tx=0x7fd840005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34094b37cc2e1edd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:50.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.349+0000 7fd834ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:50.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.349+0000 7fd834ff9640 1 -- 172.21.15.78:0/3853609002 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840054020 con 0x55bd3669e270 2024-09-17T03:14:50.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.349+0000 7fd834ff9640 1 -- 172.21.15.78:0/3853609002 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fd840004d30 con 0x55bd3669e270 2024-09-17T03:14:50.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.349+0000 7fd85ec64740 1 -- 172.21.15.78:0/3853609002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8400053c0 con 0x55bd3669e270 2024-09-17T03:14:50.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.349+0000 7fd834ff9640 1 -- 172.21.15.78:0/3853609002 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7fd84005e050 con 0x55bd3669e270 2024-09-17T03:14:50.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.349+0000 7fd85ec64740 10 client.8472 fetch_fsmap learned FSMap version 98 2024-09-17T03:14:50.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.349+0000 7fd85ec64740 1 -- 172.21.15.78:0/3853609002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x55bd36a4c070 con 0x55bd3669e270 2024-09-17T03:14:50.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.349+0000 7fd834ff9640 1 -- 172.21.15.78:0/3853609002 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8400053c0 con 0x55bd3669e270 2024-09-17T03:14:50.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.350+0000 7fd834ff9640 1 -- 172.21.15.78:0/3853609002 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 98) ==== 3542+0+0 (secure 0 0 0) 0x7fd840061020 con 0x55bd3669e270 2024-09-17T03:14:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.350+0000 7fd85ec64740 10 client.8472 fetch_fsmap finished waiting for FSMap version 98 2024-09-17T03:14:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.350+0000 7fd85ec64740 10 client.8472 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T03:14:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.350+0000 7fd85ec64740 20 client.8472 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.350+0000 7fd85ec64740 1 --2- 172.21.15.78:0/3853609002 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x55bd36b0eaf0 0x55bd36b0ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.350+0000 7fd85ec64740 4 client.8472 mds_command: new command op to 7213 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:14:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.350+0000 7fd85ec64740 1 -- 172.21.15.78:0/3853609002 --> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] -- command(tid 0: {"prefix": "status"}) -- 0x55bd369b6220 con 0x55bd36b0eaf0 2024-09-17T03:14:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.350+0000 7fd8559b9640 1 --2- 172.21.15.78:0/3853609002 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x55bd36b0eaf0 0x55bd36b0ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.350+0000 7fd834ff9640 10 client.8472 ms_handle_connect on v2:172.21.15.193:6835/2983826871 2024-09-17T03:14:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.350+0000 7fd8559b9640 1 --2- 172.21.15.78:0/3853609002 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x55bd36b0eaf0 0x55bd36b0ef00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f3e2f7aba45c2660 server_cookie=c31936434c1150fa in_seq=0 out_seq=0 2024-09-17T03:14:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd834ff9640 1 -- 172.21.15.78:0/3853609002 <== mds.2 v2:172.21.15.193:6835/2983826871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x55bd369b6220 con 0x55bd36b0eaf0 2024-09-17T03:14:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd834ff9640 10 client.8472 handle_command_reply: tid=0 2024-09-17T03:14:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd85ec64740 1 client.8472 shutdown 2024-09-17T03:14:50.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd85ec64740 1 -- 172.21.15.78:0/3853609002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 msgr2=0x55bd36a89780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd85ec64740 1 --2- 172.21.15.78:0/3853609002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 0x55bd36a89780 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fd840009920 tx=0x7fd840005780 comp rx=0 tx=0).stop 2024-09-17T03:14:50.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd85ec64740 1 -- 172.21.15.78:0/3853609002 shutdown_connections 2024-09-17T03:14:50.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd85ec64740 1 --2- 172.21.15.78:0/3853609002 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x55bd36b0eaf0 0x55bd36b0ef00 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd85ec64740 1 --2- 172.21.15.78:0/3853609002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bd3669e270 0x55bd36a89780 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd85ec64740 1 --2- 172.21.15.78:0/3853609002 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd3667d590 0x55bd36a71540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd834ff9640 0 client.8472 ms_handle_reset on v2:172.21.15.193:6835/2983826871 2024-09-17T03:14:50.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd85ec64740 1 --2- 172.21.15.78:0/3853609002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd366753b0 0x55bd36a91680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd85ec64740 1 -- 172.21.15.78:0/3853609002 >> 172.21.15.78:0/3853609002 conn(0x55bd366923c0 msgr2=0x55bd36a462f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:50.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd85ec64740 1 -- 172.21.15.78:0/3853609002 shutdown_connections 2024-09-17T03:14:50.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd85ec64740 1 -- 172.21.15.78:0/3853609002 wait complete. 2024-09-17T03:14:50.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd85ec64740 20 client.8472 trim_cache size 0 max 16384 2024-09-17T03:14:50.357 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:14:50.357 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:14:50.357 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 2, 2024-09-17T03:14:50.357 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 7213, 2024-09-17T03:14:50.357 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:14:50.357 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:14:50.357 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:14:50.357 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 1.695273818, 2024-09-17T03:14:50.357 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 98, 2024-09-17T03:14:50.357 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 95, 2024-09-17T03:14:50.357 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 95, 2024-09-17T03:14:50.357 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 15.290597111 2024-09-17T03:14:50.357 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:14:50.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd857c1d640 1 -- 172.21.15.78:0/3295570252 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd83c078b90 msgr2=0x7fd83c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd857c1d640 1 --2- 172.21.15.78:0/3295570252 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd83c078b90 0x7fd83c07b0a0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd84800ab40 tx=0x7fd84800a520 comp rx=0 tx=0).stop 2024-09-17T03:14:50.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd857c1d640 1 -- 172.21.15.78:0/3295570252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd850144270 msgr2=0x7fd850158950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd857c1d640 1 --2- 172.21.15.78:0/3295570252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd850144270 0x7fd850158950 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fd84400c6f0 tx=0x7fd84400cbb0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd857c1d640 1 -- 172.21.15.78:0/3295570252 shutdown_connections 2024-09-17T03:14:50.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd857c1d640 1 --2- 172.21.15.78:0/3295570252 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd83c078b90 0x7fd83c07b0a0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd857c1d640 1 --2- 172.21.15.78:0/3295570252 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd85013d010 0x7fd85013edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd857c1d640 1 --2- 172.21.15.78:0/3295570252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd850144270 0x7fd850158950 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd857c1d640 1 --2- 172.21.15.78:0/3295570252 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd850142270 0x7fd8500c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.351+0000 7fd857c1d640 1 -- 172.21.15.78:0/3295570252 >> 172.21.15.78:0/3295570252 conn(0x7fd8500d15f0 msgr2=0x7fd85013e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:50.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.352+0000 7fd857c1d640 1 -- 172.21.15.78:0/3295570252 shutdown_connections 2024-09-17T03:14:50.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.352+0000 7fd857c1d640 1 -- 172.21.15.78:0/3295570252 wait complete. 2024-09-17T03:14:50.362 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T03:14:50.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.475+0000 7ff1d0807640 1 -- 172.21.15.78:0/230211582 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff1cc0705d0 msgr2=0x7ff1cc0b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.475+0000 7ff1d0807640 1 --2- 172.21.15.78:0/230211582 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff1cc0705d0 0x7ff1cc0b3550 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff1b4005fd0 tx=0x7ff1b402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.475+0000 7ff1d0807640 1 -- 172.21.15.78:0/230211582 shutdown_connections 2024-09-17T03:14:50.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.475+0000 7ff1d0807640 1 --2- 172.21.15.78:0/230211582 >> v2:172.21.15.193:3300/0 conn(0x7ff1cc0cfeb0 0x7ff1cc0d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.475+0000 7ff1d0807640 1 --2- 172.21.15.78:0/230211582 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff1cc0705d0 0x7ff1cc0b3550 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.475+0000 7ff1d0807640 1 -- 172.21.15.78:0/230211582 >> 172.21.15.78:0/230211582 conn(0x7ff1cc0cdcc0 msgr2=0x7ff1cc0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:50.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.475+0000 7ff1d0807640 1 -- 172.21.15.78:0/230211582 shutdown_connections 2024-09-17T03:14:50.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.475+0000 7ff1d0807640 1 -- 172.21.15.78:0/230211582 wait complete. 2024-09-17T03:14:50.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.477+0000 7ff1d0807640 1 Processor -- start 2024-09-17T03:14:50.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.477+0000 7ff1d0807640 1 -- start start 2024-09-17T03:14:50.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1d0807640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1cc0b4090 0x7ff1cc0b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1d0807640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff1cc0cfeb0 0x7ff1cc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1d0807640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1cc06d530 0x7ff1cc1f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1d0807640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc0b4a30 con 0x7ff1cc06d530 2024-09-17T03:14:50.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1d0807640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc0b48b0 con 0x7ff1cc0b4090 2024-09-17T03:14:50.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1d0807640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff1cc0b4bb0 con 0x7ff1cc0cfeb0 2024-09-17T03:14:50.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1cad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1cc06d530 0x7ff1cc1f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1cad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1cc06d530 0x7ff1cc1f2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60802/0 (socket says 172.21.15.78:60802) 2024-09-17T03:14:50.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1cad9d640 1 -- 172.21.15.78:0/3214548074 learned_addr learned my addr 172.21.15.78:0/3214548074 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:50.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1c1d9b640 1 --2- 172.21.15.78:0/3214548074 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff1cc0cfeb0 0x7ff1cc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1ca59c640 1 --2- 172.21.15.78:0/3214548074 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1cc0b4090 0x7ff1cc0b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1cad9d640 1 -- 172.21.15.78:0/3214548074 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff1cc0cfeb0 msgr2=0x7ff1cc06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1cad9d640 1 --2- 172.21.15.78:0/3214548074 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff1cc0cfeb0 0x7ff1cc06cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1cad9d640 1 -- 172.21.15.78:0/3214548074 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1cc0b4090 msgr2=0x7ff1cc0b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1cad9d640 1 --2- 172.21.15.78:0/3214548074 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1cc0b4090 0x7ff1cc0b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1cad9d640 1 -- 172.21.15.78:0/3214548074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1cc1f6a00 con 0x7ff1cc06d530 2024-09-17T03:14:50.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1cad9d640 1 --2- 172.21.15.78:0/3214548074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1cc06d530 0x7ff1cc1f2510 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400ea80 tx=0x7ff1c400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:50.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1c37fe640 1 -- 172.21.15.78:0/3214548074 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4004b20 con 0x7ff1cc06d530 2024-09-17T03:14:50.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1c37fe640 1 -- 172.21.15.78:0/3214548074 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1c4004ce0 con 0x7ff1cc06d530 2024-09-17T03:14:50.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1c37fe640 1 -- 172.21.15.78:0/3214548074 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1c4005280 con 0x7ff1cc06d530 2024-09-17T03:14:50.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.479+0000 7ff1d0807640 1 -- 172.21.15.78:0/3214548074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1cc1f6ce0 con 0x7ff1cc06d530 2024-09-17T03:14:50.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.480+0000 7ff1d0807640 1 -- 172.21.15.78:0/3214548074 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1cc1f72a0 con 0x7ff1cc06d530 2024-09-17T03:14:50.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.481+0000 7ff1c37fe640 1 -- 172.21.15.78:0/3214548074 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff1c4005420 con 0x7ff1cc06d530 2024-09-17T03:14:50.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.482+0000 7ff1c37fe640 1 --2- 172.21.15.78:0/3214548074 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff1ac078b90 0x7ff1ac07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.482+0000 7ff1c37fe640 1 -- 172.21.15.78:0/3214548074 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7ff1c409b930 con 0x7ff1cc06d530 2024-09-17T03:14:50.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.482+0000 7ff1ca59c640 1 --2- 172.21.15.78:0/3214548074 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff1ac078b90 0x7ff1ac07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.482+0000 7ff1ca59c640 1 --2- 172.21.15.78:0/3214548074 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff1ac078b90 0x7ff1ac07b0a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc001720 tx=0x7ff1bc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:50.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.482+0000 7ff1d784c740 1 Processor -- start 2024-09-17T03:14:50.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.483+0000 7ff1d784c740 1 -- start start 2024-09-17T03:14:50.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.484+0000 7ff1d784c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b598a4270 0x560b59c75fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.484+0000 7ff1d784c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b5987b3b0 0x560b59c764e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.484+0000 7ff1d784c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b59883590 0x560b59c933e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.484+0000 7ff1d784c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x560b59bbe820 con 0x560b598a4270 2024-09-17T03:14:50.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.484+0000 7ff1d784c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560b59badc50 con 0x560b5987b3b0 2024-09-17T03:14:50.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.484+0000 7ff1d784c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x560b59bb1a60 con 0x560b59883590 2024-09-17T03:14:50.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.484+0000 7ff1ca59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b598a4270 0x560b59c75fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.484+0000 7ff1ca59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b598a4270 0x560b59c75fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60812/0 (socket says 172.21.15.78:60812) 2024-09-17T03:14:50.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.484+0000 7ff1ca59c640 1 -- 172.21.15.78:0/180417429 learned_addr learned my addr 172.21.15.78:0/180417429 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:50.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.484+0000 7ff1cad9d640 1 --2- 172.21.15.78:0/180417429 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b59883590 0x560b59c933e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.484+0000 7ff1c1d9b640 1 --2- 172.21.15.78:0/180417429 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b5987b3b0 0x560b59c764e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.484+0000 7ff1ca59c640 1 -- 172.21.15.78:0/180417429 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b59883590 msgr2=0x560b59c933e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.484+0000 7ff1ca59c640 1 --2- 172.21.15.78:0/180417429 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b59883590 0x560b59c933e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.484+0000 7ff1ca59c640 1 -- 172.21.15.78:0/180417429 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b5987b3b0 msgr2=0x560b59c764e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.484+0000 7ff1ca59c640 1 --2- 172.21.15.78:0/180417429 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b5987b3b0 0x560b59c764e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.484+0000 7ff1ca59c640 1 -- 172.21.15.78:0/180417429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b5990f850 con 0x560b598a4270 2024-09-17T03:14:50.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.484+0000 7ff1cad9d640 1 --2- 172.21.15.78:0/180417429 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b59883590 0x560b59c933e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:50.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.484+0000 7ff1c1d9b640 1 --2- 172.21.15.78:0/180417429 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b5987b3b0 0x560b59c764e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:50.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.484+0000 7ff1ca59c640 1 --2- 172.21.15.78:0/180417429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b598a4270 0x560b59c75fa0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00f940 tx=0x7ff1bc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ccda9b8d162001 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:50.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.485+0000 7ff1abfff640 1 -- 172.21.15.78:0/180417429 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc025070 con 0x560b598a4270 2024-09-17T03:14:50.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.485+0000 7ff1abfff640 1 -- 172.21.15.78:0/180417429 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1bc01b050 con 0x560b598a4270 2024-09-17T03:14:50.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.485+0000 7ff1abfff640 1 -- 172.21.15.78:0/180417429 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc014e40 con 0x560b598a4270 2024-09-17T03:14:50.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.485+0000 7ff1d784c740 1 -- 172.21.15.78:0/180417429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b598a4270 msgr2=0x560b59c75fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.485+0000 7ff1d784c740 1 --2- 172.21.15.78:0/180417429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b598a4270 0x560b59c75fa0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc00f940 tx=0x7ff1bc012000 comp rx=0 tx=0).stop 2024-09-17T03:14:50.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.486+0000 7ff1d784c740 1 -- 172.21.15.78:0/180417429 shutdown_connections 2024-09-17T03:14:50.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.486+0000 7ff1d784c740 1 --2- 172.21.15.78:0/180417429 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b59883590 0x560b59c933e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.486+0000 7ff1d784c740 1 --2- 172.21.15.78:0/180417429 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b5987b3b0 0x560b59c764e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.486+0000 7ff1d784c740 1 --2- 172.21.15.78:0/180417429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b598a4270 0x560b59c75fa0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.486+0000 7ff1d784c740 1 -- 172.21.15.78:0/180417429 >> 172.21.15.78:0/180417429 conn(0x560b598983c0 msgr2=0x560b59c4c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:50.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.486+0000 7ff1d784c740 1 -- 172.21.15.78:0/180417429 shutdown_connections 2024-09-17T03:14:50.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.486+0000 7ff1d784c740 1 -- 172.21.15.78:0/180417429 wait complete. 2024-09-17T03:14:50.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.486+0000 7ff1d784c740 1 -- start start 2024-09-17T03:14:50.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.487+0000 7ff1d784c740 1 Processor -- start 2024-09-17T03:14:50.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.488+0000 7ff1d784c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b5987b3b0 0x560b59ca4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.488+0000 7ff1d784c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b59883590 0x560b59c9d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.488+0000 7ff1d784c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b598a4270 0x560b59c75180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.488+0000 7ff1d784c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x560b5991e620 con 0x560b5987b3b0 2024-09-17T03:14:50.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.488+0000 7ff1d784c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560b59b535f0 con 0x560b598a4270 2024-09-17T03:14:50.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.488+0000 7ff1d784c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x560b59c76a20 con 0x560b59883590 2024-09-17T03:14:50.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.488+0000 7ff1d784c740 10 client.0 _ll_register_callbacks cb 0x560b59b570a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:50.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.488+0000 7ff1ca59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b5987b3b0 0x560b59ca4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.488+0000 7ff1ca59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b5987b3b0 0x560b59ca4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60828/0 (socket says 172.21.15.78:60828) 2024-09-17T03:14:50.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.488+0000 7ff1ca59c640 1 -- 172.21.15.78:0/2127447680 learned_addr learned my addr 172.21.15.78:0/2127447680 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:50.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.488+0000 7ff1c1d9b640 1 --2- 172.21.15.78:0/2127447680 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b59883590 0x560b59c9d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.488+0000 7ff1cad9d640 1 --2- 172.21.15.78:0/2127447680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b598a4270 0x560b59c75180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.488+0000 7ff1ca59c640 1 -- 172.21.15.78:0/2127447680 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b59883590 msgr2=0x560b59c9d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.488+0000 7ff1ca59c640 1 --2- 172.21.15.78:0/2127447680 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b59883590 0x560b59c9d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.488+0000 7ff1ca59c640 1 -- 172.21.15.78:0/2127447680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b598a4270 msgr2=0x560b59c75180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.488+0000 7ff1ca59c640 1 --2- 172.21.15.78:0/2127447680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b598a4270 0x560b59c75180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.488+0000 7ff1ca59c640 1 -- 172.21.15.78:0/2127447680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b599866b0 con 0x560b5987b3b0 2024-09-17T03:14:50.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.488+0000 7ff1cad9d640 1 --2- 172.21.15.78:0/2127447680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b598a4270 0x560b59c75180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:50.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.489+0000 7ff1ca59c640 1 --2- 172.21.15.78:0/2127447680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b5987b3b0 0x560b59ca4410 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc014820 tx=0x7ff1bc021630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563f36b1c7444485 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:50.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.489+0000 7ff1a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:50.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.489+0000 7ff1a97fa640 1 -- 172.21.15.78:0/2127447680 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1bc025040 con 0x560b5987b3b0 2024-09-17T03:14:50.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.489+0000 7ff1a97fa640 1 -- 172.21.15.78:0/2127447680 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7ff1bc021a50 con 0x560b5987b3b0 2024-09-17T03:14:50.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.489+0000 7ff1d784c740 1 -- 172.21.15.78:0/2127447680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1bc01b050 con 0x560b5987b3b0 2024-09-17T03:14:50.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.489+0000 7ff1a97fa640 1 -- 172.21.15.78:0/2127447680 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7ff1bc038050 con 0x560b5987b3b0 2024-09-17T03:14:50.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.489+0000 7ff1d784c740 10 client.8481 fetch_fsmap learned FSMap version 98 2024-09-17T03:14:50.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.489+0000 7ff1d784c740 1 -- 172.21.15.78:0/2127447680 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x560b59ca0ac0 con 0x560b5987b3b0 2024-09-17T03:14:50.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.489+0000 7ff1a97fa640 1 -- 172.21.15.78:0/2127447680 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1bc01b050 con 0x560b5987b3b0 2024-09-17T03:14:50.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.489+0000 7ff1a97fa640 1 -- 172.21.15.78:0/2127447680 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 98) ==== 3542+0+0 (secure 0 0 0) 0x7ff1bc03b020 con 0x560b5987b3b0 2024-09-17T03:14:50.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.489+0000 7ff1d784c740 10 client.8481 fetch_fsmap finished waiting for FSMap version 98 2024-09-17T03:14:50.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.489+0000 7ff1d784c740 10 client.8481 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:14:50.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.489+0000 7ff1d784c740 20 client.8481 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:50.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.489+0000 7ff1d784c740 1 --2- 172.21.15.78:0/2127447680 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x560b59862e40 0x560b59c87b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.489+0000 7ff1d784c740 4 client.8481 mds_command: new command op to 8283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:14:50.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.489+0000 7ff1d784c740 1 -- 172.21.15.78:0/2127447680 --> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b59bc0770 con 0x560b59862e40 2024-09-17T03:14:50.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.489+0000 7ff1c1d9b640 1 --2- 172.21.15.78:0/2127447680 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x560b59862e40 0x560b59c87b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.490+0000 7ff1a97fa640 10 client.8481 ms_handle_connect on v2:172.21.15.78:6832/1810198137 2024-09-17T03:14:50.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.490+0000 7ff1c1d9b640 1 --2- 172.21.15.78:0/2127447680 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x560b59862e40 0x560b59c87b90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7f02df5faf247c47 server_cookie=5bde7aafe718ebb5 in_seq=0 out_seq=0 2024-09-17T03:14:50.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.491+0000 7ff1a97fa640 1 -- 172.21.15.78:0/2127447680 <== mds.1 v2:172.21.15.78:6832/1810198137 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b59bc0770 con 0x560b59862e40 2024-09-17T03:14:50.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.491+0000 7ff1a97fa640 10 client.8481 handle_command_reply: tid=0 2024-09-17T03:14:50.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.491+0000 7ff1d784c740 1 client.8481 shutdown 2024-09-17T03:14:50.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.491+0000 7ff1d784c740 1 -- 172.21.15.78:0/2127447680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b5987b3b0 msgr2=0x560b59ca4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.491+0000 7ff1d784c740 1 --2- 172.21.15.78:0/2127447680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b5987b3b0 0x560b59ca4410 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc014820 tx=0x7ff1bc021630 comp rx=0 tx=0).stop 2024-09-17T03:14:50.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.491+0000 7ff1d784c740 1 -- 172.21.15.78:0/2127447680 shutdown_connections 2024-09-17T03:14:50.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.491+0000 7ff1d784c740 1 --2- 172.21.15.78:0/2127447680 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x560b59862e40 0x560b59c87b90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.491+0000 7ff1d784c740 1 --2- 172.21.15.78:0/2127447680 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b598a4270 0x560b59c75180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.491+0000 7ff1d784c740 1 --2- 172.21.15.78:0/2127447680 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b59883590 0x560b59c9d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.491+0000 7ff1d784c740 1 --2- 172.21.15.78:0/2127447680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b5987b3b0 0x560b59ca4410 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.491+0000 7ff1a97fa640 0 client.8481 ms_handle_reset on v2:172.21.15.78:6832/1810198137 2024-09-17T03:14:50.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.491+0000 7ff1d784c740 1 -- 172.21.15.78:0/2127447680 >> 172.21.15.78:0/2127447680 conn(0x560b598983c0 msgr2=0x560b59c929b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:50.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.491+0000 7ff1d784c740 1 -- 172.21.15.78:0/2127447680 shutdown_connections 2024-09-17T03:14:50.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.491+0000 7ff1d784c740 1 -- 172.21.15.78:0/2127447680 wait complete. 2024-09-17T03:14:50.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.491+0000 7ff1d784c740 20 client.8481 trim_cache size 0 max 16384 2024-09-17T03:14:50.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.509+0000 7ff1d784c740 1 Processor -- start 2024-09-17T03:14:50.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.509+0000 7ff1d784c740 1 -- start start 2024-09-17T03:14:50.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.510+0000 7ff1d784c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b5987b3b0 0x560b59ca9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.510+0000 7ff1d784c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b59883590 0x560b59caa500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.510+0000 7ff1d784c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b598a4270 0x560b59cb3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.510+0000 7ff1d784c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc159fb0 con 0x560b59883590 2024-09-17T03:14:50.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.510+0000 7ff1d784c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff1cc1ff9c0 con 0x560b598a4270 2024-09-17T03:14:50.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.510+0000 7ff1d784c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff1cc155950 con 0x560b5987b3b0 2024-09-17T03:14:50.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.511+0000 7ff1c1d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b59883590 0x560b59caa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.511+0000 7ff1c1d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b59883590 0x560b59caa500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60842/0 (socket says 172.21.15.78:60842) 2024-09-17T03:14:50.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.511+0000 7ff1c1d9b640 1 -- 172.21.15.78:0/756105373 learned_addr learned my addr 172.21.15.78:0/756105373 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:50.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.511+0000 7ff1ca59c640 1 --2- 172.21.15.78:0/756105373 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b5987b3b0 0x560b59ca9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.511+0000 7ff1cad9d640 1 --2- 172.21.15.78:0/756105373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b598a4270 0x560b59cb3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.511+0000 7ff1c1d9b640 1 -- 172.21.15.78:0/756105373 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b5987b3b0 msgr2=0x560b59ca9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.511+0000 7ff1c1d9b640 1 --2- 172.21.15.78:0/756105373 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b5987b3b0 0x560b59ca9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.511+0000 7ff1c1d9b640 1 -- 172.21.15.78:0/756105373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b598a4270 msgr2=0x560b59cb3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.511+0000 7ff1c1d9b640 1 --2- 172.21.15.78:0/756105373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b598a4270 0x560b59cb3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.511+0000 7ff1c1d9b640 1 -- 172.21.15.78:0/756105373 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b59c87770 con 0x560b59883590 2024-09-17T03:14:50.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.511+0000 7ff1ca59c640 1 --2- 172.21.15.78:0/756105373 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b5987b3b0 0x560b59ca9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:50.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.511+0000 7ff1cad9d640 1 --2- 172.21.15.78:0/756105373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b598a4270 0x560b59cb3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:50.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.511+0000 7ff1c1d9b640 1 --2- 172.21.15.78:0/756105373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b59883590 0x560b59caa500 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7ff1b402abc0 tx=0x7ff1b402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2fe0384393c9698 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:50.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.511+0000 7ff1ab7fe640 1 -- 172.21.15.78:0/756105373 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4049070 con 0x560b59883590 2024-09-17T03:14:50.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.511+0000 7ff1ab7fe640 1 -- 172.21.15.78:0/756105373 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1b4004a90 con 0x560b59883590 2024-09-17T03:14:50.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.511+0000 7ff1ab7fe640 1 -- 172.21.15.78:0/756105373 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4035040 con 0x560b59883590 2024-09-17T03:14:50.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.512+0000 7ff1d784c740 1 -- 172.21.15.78:0/756105373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b59883590 msgr2=0x560b59caa500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.512+0000 7ff1d784c740 1 --2- 172.21.15.78:0/756105373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b59883590 0x560b59caa500 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7ff1b402abc0 tx=0x7ff1b402a5d0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.512+0000 7ff1d784c740 1 -- 172.21.15.78:0/756105373 shutdown_connections 2024-09-17T03:14:50.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.512+0000 7ff1d784c740 1 --2- 172.21.15.78:0/756105373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b598a4270 0x560b59cb3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.512+0000 7ff1d784c740 1 --2- 172.21.15.78:0/756105373 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b59883590 0x560b59caa500 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.512+0000 7ff1d784c740 1 --2- 172.21.15.78:0/756105373 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b5987b3b0 0x560b59ca9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.512+0000 7ff1d784c740 1 -- 172.21.15.78:0/756105373 >> 172.21.15.78:0/756105373 conn(0x560b598983c0 msgr2=0x560b59c89330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:50.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.512+0000 7ff1d784c740 1 -- 172.21.15.78:0/756105373 shutdown_connections 2024-09-17T03:14:50.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.512+0000 7ff1d784c740 1 -- 172.21.15.78:0/756105373 wait complete. 2024-09-17T03:14:50.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.513+0000 7ff1d784c740 1 -- start start 2024-09-17T03:14:50.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.513+0000 7ff1d784c740 1 Processor -- start 2024-09-17T03:14:50.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.514+0000 7ff1d784c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b5987b3b0 0x560b59d17e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.514+0000 7ff1d784c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b59883590 0x560b59c75d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.514+0000 7ff1d784c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b598a4270 0x560b59c76250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.514+0000 7ff1d784c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x560b59c6f0b0 con 0x560b59883590 2024-09-17T03:14:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.514+0000 7ff1d784c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x560b59c9ddb0 con 0x560b598a4270 2024-09-17T03:14:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.514+0000 7ff1d784c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x560b59c89aa0 con 0x560b5987b3b0 2024-09-17T03:14:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.514+0000 7ff1d784c740 10 client.0 _ll_register_callbacks cb 0x7ff1bc023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.514+0000 7ff1c1d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b59883590 0x560b59c75d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.514+0000 7ff1c1d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b59883590 0x560b59c75d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60848/0 (socket says 172.21.15.78:60848) 2024-09-17T03:14:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.514+0000 7ff1c1d9b640 1 -- 172.21.15.78:0/1004700510 learned_addr learned my addr 172.21.15.78:0/1004700510 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.514+0000 7ff1ca59c640 1 --2- 172.21.15.78:0/1004700510 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b5987b3b0 0x560b59d17e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.514+0000 7ff1cad9d640 1 --2- 172.21.15.78:0/1004700510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b598a4270 0x560b59c76250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1c1d9b640 1 -- 172.21.15.78:0/1004700510 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b5987b3b0 msgr2=0x560b59d17e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1c1d9b640 1 --2- 172.21.15.78:0/1004700510 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b5987b3b0 0x560b59d17e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1c1d9b640 1 -- 172.21.15.78:0/1004700510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b598a4270 msgr2=0x560b59c76250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1c1d9b640 1 --2- 172.21.15.78:0/1004700510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b598a4270 0x560b59c76250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1c1d9b640 1 -- 172.21.15.78:0/1004700510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b59c8a300 con 0x560b59883590 2024-09-17T03:14:50.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1c1d9b640 1 --2- 172.21.15.78:0/1004700510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b59883590 0x560b59c75d10 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x560b59b63970 tx=0x7ff1b4004850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd92642335926fc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:50.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:50.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1a97fa640 1 -- 172.21.15.78:0/1004700510 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1b4051020 con 0x560b59883590 2024-09-17T03:14:50.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1a97fa640 1 -- 172.21.15.78:0/1004700510 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7ff1b4004e40 con 0x560b59883590 2024-09-17T03:14:50.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1d784c740 1 -- 172.21.15.78:0/1004700510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1b4004a90 con 0x560b59883590 2024-09-17T03:14:50.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1a97fa640 1 -- 172.21.15.78:0/1004700510 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7ff1b405b050 con 0x560b59883590 2024-09-17T03:14:50.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1d784c740 10 client.8487 fetch_fsmap learned FSMap version 98 2024-09-17T03:14:50.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1d784c740 1 -- 172.21.15.78:0/1004700510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x560b59ca0060 con 0x560b59883590 2024-09-17T03:14:50.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1a97fa640 1 -- 172.21.15.78:0/1004700510 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1b4004a90 con 0x560b59883590 2024-09-17T03:14:50.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1a97fa640 1 -- 172.21.15.78:0/1004700510 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 98) ==== 3542+0+0 (secure 0 0 0) 0x7ff1b405e020 con 0x560b59883590 2024-09-17T03:14:50.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1d784c740 10 client.8487 fetch_fsmap finished waiting for FSMap version 98 2024-09-17T03:14:50.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1d784c740 10 client.8487 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T03:14:50.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1d784c740 20 client.8487 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:50.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1d784c740 1 --2- 172.21.15.78:0/1004700510 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x560b59c9c980 0x560b59c656f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1d784c740 4 client.8487 mds_command: new command op to 8283 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:14:50.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.515+0000 7ff1d784c740 1 -- 172.21.15.78:0/1004700510 --> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] -- command(tid 0: {"prefix": "status"}) -- 0x560b59bbc220 con 0x560b59c9c980 2024-09-17T03:14:50.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.516+0000 7ff1ca59c640 1 --2- 172.21.15.78:0/1004700510 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x560b59c9c980 0x560b59c656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.516+0000 7ff1a97fa640 10 client.8487 ms_handle_connect on v2:172.21.15.78:6832/1810198137 2024-09-17T03:14:50.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.516+0000 7ff1ca59c640 1 --2- 172.21.15.78:0/1004700510 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x560b59c9c980 0x560b59c656f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c11276f242378e7c server_cookie=94ae4905a9c15024 in_seq=0 out_seq=0 2024-09-17T03:14:50.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.516+0000 7ff1a97fa640 1 -- 172.21.15.78:0/1004700510 <== mds.1 v2:172.21.15.78:6832/1810198137 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x560b59bbc220 con 0x560b59c9c980 2024-09-17T03:14:50.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.516+0000 7ff1a97fa640 10 client.8487 handle_command_reply: tid=0 2024-09-17T03:14:50.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.516+0000 7ff1d784c740 1 client.8487 shutdown 2024-09-17T03:14:50.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.516+0000 7ff1d784c740 1 -- 172.21.15.78:0/1004700510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b59883590 msgr2=0x560b59c75d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.516+0000 7ff1d784c740 1 --2- 172.21.15.78:0/1004700510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b59883590 0x560b59c75d10 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x560b59b63970 tx=0x7ff1b4004850 comp rx=0 tx=0).stop 2024-09-17T03:14:50.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.516+0000 7ff1d784c740 1 -- 172.21.15.78:0/1004700510 shutdown_connections 2024-09-17T03:14:50.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.516+0000 7ff1d784c740 1 --2- 172.21.15.78:0/1004700510 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x560b59c9c980 0x560b59c656f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.516+0000 7ff1d784c740 1 --2- 172.21.15.78:0/1004700510 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x560b598a4270 0x560b59c76250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.516+0000 7ff1d784c740 1 --2- 172.21.15.78:0/1004700510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560b59883590 0x560b59c75d10 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.516+0000 7ff1a97fa640 0 client.8487 ms_handle_reset on v2:172.21.15.78:6832/1810198137 2024-09-17T03:14:50.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.516+0000 7ff1d784c740 1 --2- 172.21.15.78:0/1004700510 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x560b5987b3b0 0x560b59d17e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.516+0000 7ff1d784c740 1 -- 172.21.15.78:0/1004700510 >> 172.21.15.78:0/1004700510 conn(0x560b598983c0 msgr2=0x560b59caa410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:50.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.516+0000 7ff1d784c740 1 -- 172.21.15.78:0/1004700510 shutdown_connections 2024-09-17T03:14:50.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.516+0000 7ff1d784c740 1 -- 172.21.15.78:0/1004700510 wait complete. 2024-09-17T03:14:50.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.517+0000 7ff1d784c740 20 client.8487 trim_cache size 0 max 16384 2024-09-17T03:14:50.522 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:14:50.523 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:14:50.523 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 1, 2024-09-17T03:14:50.523 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 8283, 2024-09-17T03:14:50.523 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:14:50.523 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:14:50.523 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:14:50.523 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 2.8698745190000001, 2024-09-17T03:14:50.523 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 98, 2024-09-17T03:14:50.523 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 95, 2024-09-17T03:14:50.523 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 95, 2024-09-17T03:14:50.523 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 15.467448512000001 2024-09-17T03:14:50.523 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:14:50.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.517+0000 7ff1d0807640 1 -- 172.21.15.78:0/3214548074 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff1ac078b90 msgr2=0x7ff1ac07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.517+0000 7ff1d0807640 1 --2- 172.21.15.78:0/3214548074 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff1ac078b90 0x7ff1ac07b0a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff1bc001720 tx=0x7ff1bc009040 comp rx=0 tx=0).stop 2024-09-17T03:14:50.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.517+0000 7ff1d0807640 1 -- 172.21.15.78:0/3214548074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1cc06d530 msgr2=0x7ff1cc1f2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.517+0000 7ff1d0807640 1 --2- 172.21.15.78:0/3214548074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1cc06d530 0x7ff1cc1f2510 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7ff1c400ea80 tx=0x7ff1c400ef40 comp rx=0 tx=0).stop 2024-09-17T03:14:50.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.517+0000 7ff1d0807640 1 -- 172.21.15.78:0/3214548074 shutdown_connections 2024-09-17T03:14:50.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.517+0000 7ff1d0807640 1 --2- 172.21.15.78:0/3214548074 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff1cc06d530 0x7ff1cc1f2510 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.517+0000 7ff1d0807640 1 --2- 172.21.15.78:0/3214548074 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff1cc0cfeb0 0x7ff1cc06cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.517+0000 7ff1d0807640 1 --2- 172.21.15.78:0/3214548074 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff1ac078b90 0x7ff1ac07b0a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.517+0000 7ff1d0807640 1 --2- 172.21.15.78:0/3214548074 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1cc0b4090 0x7ff1cc0b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.517+0000 7ff1d0807640 1 -- 172.21.15.78:0/3214548074 >> 172.21.15.78:0/3214548074 conn(0x7ff1cc0cdcc0 msgr2=0x7ff1cc0b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:50.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.517+0000 7ff1d0807640 1 -- 172.21.15.78:0/3214548074 shutdown_connections 2024-09-17T03:14:50.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.517+0000 7ff1d0807640 1 -- 172.21.15.78:0/3214548074 wait complete. 2024-09-17T03:14:50.528 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T03:14:50.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.642+0000 7f596f4bd640 1 -- 172.21.15.78:0/448271544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5968073170 msgr2=0x7f596815c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.642+0000 7f596f4bd640 1 --2- 172.21.15.78:0/448271544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5968073170 0x7f596815c780 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f5964009830 tx=0x7f596402a480 comp rx=0 tx=0).stop 2024-09-17T03:14:50.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.642+0000 7f596f4bd640 1 -- 172.21.15.78:0/448271544 shutdown_connections 2024-09-17T03:14:50.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.642+0000 7f596f4bd640 1 --2- 172.21.15.78:0/448271544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5968073170 0x7f596815c780 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.642+0000 7f596f4bd640 1 -- 172.21.15.78:0/448271544 >> 172.21.15.78:0/448271544 conn(0x7f59680b1cb0 msgr2=0x7f59680b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:50.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.642+0000 7f596f4bd640 1 -- 172.21.15.78:0/448271544 shutdown_connections 2024-09-17T03:14:50.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.642+0000 7f596f4bd640 1 -- 172.21.15.78:0/448271544 wait complete. 2024-09-17T03:14:50.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.644+0000 7f596f4bd640 1 Processor -- start 2024-09-17T03:14:50.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.644+0000 7f596f4bd640 1 -- start start 2024-09-17T03:14:50.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.645+0000 7f596f4bd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5968070030 0x7f5968148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.645+0000 7f596f4bd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5968070440 0x7f59681f9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.645+0000 7f596f4bd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5968073170 0x7f59681f9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.645+0000 7f596f4bd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f59680b3cd0 con 0x7f5968070030 2024-09-17T03:14:50.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.645+0000 7f596f4bd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f59680b3b50 con 0x7f5968070440 2024-09-17T03:14:50.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.645+0000 7f596f4bd640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f59680b3e50 con 0x7f5968073170 2024-09-17T03:14:50.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.645+0000 7f596d259640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5968070030 0x7f5968148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.645+0000 7f596d259640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5968070030 0x7f5968148060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60860/0 (socket says 172.21.15.78:60860) 2024-09-17T03:14:50.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.645+0000 7f596d259640 1 -- 172.21.15.78:0/1410807430 learned_addr learned my addr 172.21.15.78:0/1410807430 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:50.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.645+0000 7f596ca58640 1 --2- 172.21.15.78:0/1410807430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5968070440 0x7f59681f9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.645+0000 7f596da5a640 1 --2- 172.21.15.78:0/1410807430 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5968073170 0x7f59681f9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.645+0000 7f596d259640 1 -- 172.21.15.78:0/1410807430 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5968073170 msgr2=0x7f59681f9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.645+0000 7f596d259640 1 --2- 172.21.15.78:0/1410807430 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5968073170 0x7f59681f9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.645+0000 7f596d259640 1 -- 172.21.15.78:0/1410807430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5968070440 msgr2=0x7f59681f9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.645+0000 7f596d259640 1 --2- 172.21.15.78:0/1410807430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5968070440 0x7f59681f9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.645+0000 7f596d259640 1 -- 172.21.15.78:0/1410807430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59681f9df0 con 0x7f5968070030 2024-09-17T03:14:50.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.645+0000 7f596da5a640 1 --2- 172.21.15.78:0/1410807430 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5968073170 0x7f59681f9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:14:50.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.645+0000 7f596ca58640 1 --2- 172.21.15.78:0/1410807430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5968070440 0x7f59681f9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:50.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.645+0000 7f596d259640 1 --2- 172.21.15.78:0/1410807430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5968070030 0x7f5968148060 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f5964000c00 tx=0x7f5964033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:50.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.646+0000 7f595dffb640 1 -- 172.21.15.78:0/1410807430 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964031d60 con 0x7f5968070030 2024-09-17T03:14:50.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.646+0000 7f595dffb640 1 -- 172.21.15.78:0/1410807430 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5964033e10 con 0x7f5968070030 2024-09-17T03:14:50.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.646+0000 7f596f4bd640 1 -- 172.21.15.78:0/1410807430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f596814a840 con 0x7f5968070030 2024-09-17T03:14:50.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.646+0000 7f595dffb640 1 -- 172.21.15.78:0/1410807430 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59640332b0 con 0x7f5968070030 2024-09-17T03:14:50.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.646+0000 7f596f4bd640 1 -- 172.21.15.78:0/1410807430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f596814ae00 con 0x7f5968070030 2024-09-17T03:14:50.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.648+0000 7f595dffb640 1 -- 172.21.15.78:0/1410807430 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5964033450 con 0x7f5968070030 2024-09-17T03:14:50.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.649+0000 7f595dffb640 1 --2- 172.21.15.78:0/1410807430 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f594c078b90 0x7f594c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.649+0000 7f595dffb640 1 -- 172.21.15.78:0/1410807430 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f59640bc050 con 0x7f5968070030 2024-09-17T03:14:50.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.649+0000 7f596ca58640 1 --2- 172.21.15.78:0/1410807430 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f594c078b90 0x7f594c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.649+0000 7f597642b740 1 Processor -- start 2024-09-17T03:14:50.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.649+0000 7f597642b740 1 -- start start 2024-09-17T03:14:50.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.650+0000 7f596ca58640 1 --2- 172.21.15.78:0/1410807430 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f594c078b90 0x7f594c07b0a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f59680b3440 tx=0x7f5958009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:50.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.651+0000 7f597642b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827cf6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.651+0000 7f597642b740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f8278fc3b0 0x55f827cf7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.651+0000 7f597642b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f827904590 0x55f827d14400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.651+0000 7f597642b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f827c3f820 con 0x55f827925270 2024-09-17T03:14:50.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.651+0000 7f597642b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f827c2ec50 con 0x55f827904590 2024-09-17T03:14:50.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.651+0000 7f597642b740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f827c32a60 con 0x55f8278fc3b0 2024-09-17T03:14:50.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.651+0000 7f596d259640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827cf6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.651+0000 7f596d259640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827cf6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60864/0 (socket says 172.21.15.78:60864) 2024-09-17T03:14:50.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.651+0000 7f596d259640 1 -- 172.21.15.78:0/899767384 learned_addr learned my addr 172.21.15.78:0/899767384 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:50.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.651+0000 7f596ca58640 1 --2- 172.21.15.78:0/899767384 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f8278fc3b0 0x55f827cf7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.651+0000 7f596da5a640 1 --2- 172.21.15.78:0/899767384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f827904590 0x55f827d14400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.651+0000 7f596d259640 1 -- 172.21.15.78:0/899767384 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f8278fc3b0 msgr2=0x55f827cf7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.651+0000 7f596d259640 1 --2- 172.21.15.78:0/899767384 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f8278fc3b0 0x55f827cf7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.651+0000 7f596d259640 1 -- 172.21.15.78:0/899767384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f827904590 msgr2=0x55f827d14400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.651+0000 7f596d259640 1 --2- 172.21.15.78:0/899767384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f827904590 0x55f827d14400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.651+0000 7f596d259640 1 -- 172.21.15.78:0/899767384 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f827990850 con 0x55f827925270 2024-09-17T03:14:50.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.651+0000 7f596d259640 1 --2- 172.21.15.78:0/899767384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827cf6fc0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f5964009780 tx=0x7f59640837e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c843fcce2e07db75 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:50.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.651+0000 7f5952ffd640 1 -- 172.21.15.78:0/899767384 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59640839a0 con 0x55f827925270 2024-09-17T03:14:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.651+0000 7f5952ffd640 1 -- 172.21.15.78:0/899767384 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5964084520 con 0x55f827925270 2024-09-17T03:14:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.651+0000 7f5952ffd640 1 -- 172.21.15.78:0/899767384 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5964088900 con 0x55f827925270 2024-09-17T03:14:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.652+0000 7f597642b740 1 -- 172.21.15.78:0/899767384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 msgr2=0x55f827cf6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.652+0000 7f597642b740 1 --2- 172.21.15.78:0/899767384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827cf6fc0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f5964009780 tx=0x7f59640837e0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.652+0000 7f597642b740 1 -- 172.21.15.78:0/899767384 shutdown_connections 2024-09-17T03:14:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.652+0000 7f597642b740 1 --2- 172.21.15.78:0/899767384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f827904590 0x55f827d14400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.652+0000 7f597642b740 1 --2- 172.21.15.78:0/899767384 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f8278fc3b0 0x55f827cf7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.652+0000 7f597642b740 1 --2- 172.21.15.78:0/899767384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827cf6fc0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.652+0000 7f597642b740 1 -- 172.21.15.78:0/899767384 >> 172.21.15.78:0/899767384 conn(0x55f8279193c0 msgr2=0x55f827ccd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.652+0000 7f597642b740 1 -- 172.21.15.78:0/899767384 shutdown_connections 2024-09-17T03:14:50.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.652+0000 7f597642b740 1 -- 172.21.15.78:0/899767384 wait complete. 2024-09-17T03:14:50.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.653+0000 7f597642b740 1 -- start start 2024-09-17T03:14:50.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.653+0000 7f597642b740 1 Processor -- start 2024-09-17T03:14:50.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f597642b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8278fc3b0 0x55f827cf3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f597642b740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f827904590 0x55f827d24240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f597642b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827d24780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f597642b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f82799f620 con 0x55f827925270 2024-09-17T03:14:50.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f597642b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f827bd45f0 con 0x55f8278fc3b0 2024-09-17T03:14:50.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f597642b740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f827cefeb0 con 0x55f827904590 2024-09-17T03:14:50.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f597642b740 10 client.0 _ll_register_callbacks cb 0x55f827bd80a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:50.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f596da5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827d24780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f596da5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827d24780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60868/0 (socket says 172.21.15.78:60868) 2024-09-17T03:14:50.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f596da5a640 1 -- 172.21.15.78:0/3385919302 learned_addr learned my addr 172.21.15.78:0/3385919302 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:50.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f596d259640 1 --2- 172.21.15.78:0/3385919302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8278fc3b0 0x55f827cf3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f596ca58640 1 --2- 172.21.15.78:0/3385919302 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f827904590 0x55f827d24240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f596da5a640 1 -- 172.21.15.78:0/3385919302 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f827904590 msgr2=0x55f827d24240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f596da5a640 1 --2- 172.21.15.78:0/3385919302 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f827904590 0x55f827d24240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f596da5a640 1 -- 172.21.15.78:0/3385919302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8278fc3b0 msgr2=0x55f827cf3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f596da5a640 1 --2- 172.21.15.78:0/3385919302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8278fc3b0 0x55f827cf3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f596da5a640 1 -- 172.21.15.78:0/3385919302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f827a076b0 con 0x55f827925270 2024-09-17T03:14:50.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f596da5a640 1 --2- 172.21.15.78:0/3385919302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827d24780 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f596000ea40 tx=0x7f596000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c087d30ea846c3ab server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:50.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f5947fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:50.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f5947fff640 1 -- 172.21.15.78:0/3385919302 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596000cd90 con 0x55f827925270 2024-09-17T03:14:50.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f5947fff640 1 -- 172.21.15.78:0/3385919302 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f596001a410 con 0x55f827925270 2024-09-17T03:14:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f597642b740 1 -- 172.21.15.78:0/3385919302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5964084520 con 0x55f827925270 2024-09-17T03:14:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f5947fff640 1 -- 172.21.15.78:0/3385919302 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f596001a610 con 0x55f827925270 2024-09-17T03:14:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.655+0000 7f597642b740 10 client.8502 fetch_fsmap learned FSMap version 98 2024-09-17T03:14:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.656+0000 7f597642b740 1 -- 172.21.15.78:0/3385919302 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x55f827d0a0e0 con 0x55f827925270 2024-09-17T03:14:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.656+0000 7f5947fff640 1 -- 172.21.15.78:0/3385919302 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5964084520 con 0x55f827925270 2024-09-17T03:14:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.656+0000 7f5947fff640 1 -- 172.21.15.78:0/3385919302 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 98) ==== 3542+0+0 (secure 0 0 0) 0x7f5960025080 con 0x55f827925270 2024-09-17T03:14:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.656+0000 7f597642b740 10 client.8502 fetch_fsmap finished waiting for FSMap version 98 2024-09-17T03:14:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.656+0000 7f597642b740 10 client.8502 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:14:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.656+0000 7f597642b740 20 client.8502 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.656+0000 7f597642b740 1 --2- 172.21.15.78:0/3385919302 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f8278e3e40 0x55f827d21020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.656+0000 7f597642b740 4 client.8502 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:14:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.656+0000 7f597642b740 1 -- 172.21.15.78:0/3385919302 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f827c41770 con 0x55f8278e3e40 2024-09-17T03:14:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.656+0000 7f596d259640 1 --2- 172.21.15.78:0/3385919302 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f8278e3e40 0x55f827d21020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.656+0000 7f5947fff640 10 client.8502 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:14:50.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.656+0000 7f596d259640 1 --2- 172.21.15.78:0/3385919302 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f8278e3e40 0x55f827d21020 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c734cb9c99774d90 server_cookie=dbefac8438931de4 in_seq=0 out_seq=0 2024-09-17T03:14:50.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.657+0000 7f5947fff640 1 -- 172.21.15.78:0/3385919302 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f827c41770 con 0x55f8278e3e40 2024-09-17T03:14:50.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.657+0000 7f5947fff640 10 client.8502 handle_command_reply: tid=0 2024-09-17T03:14:50.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.657+0000 7f597642b740 1 client.8502 shutdown 2024-09-17T03:14:50.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.657+0000 7f597642b740 1 -- 172.21.15.78:0/3385919302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 msgr2=0x55f827d24780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.657+0000 7f597642b740 1 --2- 172.21.15.78:0/3385919302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827d24780 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f596000ea40 tx=0x7f596000ef00 comp rx=0 tx=0).stop 2024-09-17T03:14:50.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.657+0000 7f597642b740 1 -- 172.21.15.78:0/3385919302 shutdown_connections 2024-09-17T03:14:50.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.657+0000 7f597642b740 1 --2- 172.21.15.78:0/3385919302 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827d24780 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.657+0000 7f597642b740 1 --2- 172.21.15.78:0/3385919302 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f827904590 0x55f827d24240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.657+0000 7f597642b740 1 --2- 172.21.15.78:0/3385919302 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f8278e3e40 0x55f827d21020 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.657+0000 7f597642b740 1 --2- 172.21.15.78:0/3385919302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f8278fc3b0 0x55f827cf3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.657+0000 7f5947fff640 0 client.8502 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:14:50.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.657+0000 7f597642b740 1 -- 172.21.15.78:0/3385919302 >> 172.21.15.78:0/3385919302 conn(0x55f8279193c0 msgr2=0x55f827d139d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:50.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.657+0000 7f597642b740 1 -- 172.21.15.78:0/3385919302 shutdown_connections 2024-09-17T03:14:50.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.658+0000 7f597642b740 1 -- 172.21.15.78:0/3385919302 wait complete. 2024-09-17T03:14:50.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.658+0000 7f597642b740 20 client.8502 trim_cache size 0 max 16384 2024-09-17T03:14:50.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.677+0000 7f597642b740 1 Processor -- start 2024-09-17T03:14:50.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.677+0000 7f597642b740 1 -- start start 2024-09-17T03:14:50.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.678+0000 7f597642b740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f8278fc3b0 0x55f827cf72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.678+0000 7f597642b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f827904590 0x55f827cf4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.678+0000 7f597642b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827cf4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.678+0000 7f597642b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f59682014a0 con 0x55f827925270 2024-09-17T03:14:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.678+0000 7f597642b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5968201b70 con 0x55f827904590 2024-09-17T03:14:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.678+0000 7f597642b740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f59681f5d00 con 0x55f8278fc3b0 2024-09-17T03:14:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.678+0000 7f596da5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827cf4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.678+0000 7f596da5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827cf4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60870/0 (socket says 172.21.15.78:60870) 2024-09-17T03:14:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.678+0000 7f596da5a640 1 -- 172.21.15.78:0/1819511455 learned_addr learned my addr 172.21.15.78:0/1819511455 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.678+0000 7f596d259640 1 --2- 172.21.15.78:0/1819511455 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f8278fc3b0 0x55f827cf72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.678+0000 7f596ca58640 1 --2- 172.21.15.78:0/1819511455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f827904590 0x55f827cf4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.678+0000 7f596da5a640 1 -- 172.21.15.78:0/1819511455 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f8278fc3b0 msgr2=0x55f827cf72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.678+0000 7f596da5a640 1 --2- 172.21.15.78:0/1819511455 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f8278fc3b0 0x55f827cf72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.678+0000 7f596da5a640 1 -- 172.21.15.78:0/1819511455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f827904590 msgr2=0x55f827cf4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.678+0000 7f596da5a640 1 --2- 172.21.15.78:0/1819511455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f827904590 0x55f827cf4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.678+0000 7f596da5a640 1 -- 172.21.15.78:0/1819511455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f827d13020 con 0x55f827925270 2024-09-17T03:14:50.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.679+0000 7f596da5a640 1 --2- 172.21.15.78:0/1819511455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827cf4590 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f596000c7b0 tx=0x7f596000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527887d8045c27a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:50.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.679+0000 7f59527fc640 1 -- 172.21.15.78:0/1819511455 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596000cb90 con 0x55f827925270 2024-09-17T03:14:50.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.679+0000 7f59527fc640 1 -- 172.21.15.78:0/1819511455 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f596000ce20 con 0x55f827925270 2024-09-17T03:14:50.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.679+0000 7f59527fc640 1 -- 172.21.15.78:0/1819511455 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f596001abf0 con 0x55f827925270 2024-09-17T03:14:50.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.679+0000 7f597642b740 1 -- 172.21.15.78:0/1819511455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 msgr2=0x55f827cf4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.679+0000 7f597642b740 1 --2- 172.21.15.78:0/1819511455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827cf4590 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f596000c7b0 tx=0x7f596000c7e0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.679+0000 7f597642b740 1 -- 172.21.15.78:0/1819511455 shutdown_connections 2024-09-17T03:14:50.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.679+0000 7f597642b740 1 --2- 172.21.15.78:0/1819511455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827cf4590 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.679+0000 7f597642b740 1 --2- 172.21.15.78:0/1819511455 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f827904590 0x55f827cf4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.679+0000 7f597642b740 1 --2- 172.21.15.78:0/1819511455 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f8278fc3b0 0x55f827cf72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.680+0000 7f597642b740 1 -- 172.21.15.78:0/1819511455 >> 172.21.15.78:0/1819511455 conn(0x55f8279193c0 msgr2=0x55f827cee750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:50.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.680+0000 7f597642b740 1 -- 172.21.15.78:0/1819511455 shutdown_connections 2024-09-17T03:14:50.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.680+0000 7f597642b740 1 -- 172.21.15.78:0/1819511455 wait complete. 2024-09-17T03:14:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.680+0000 7f597642b740 1 -- start start 2024-09-17T03:14:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.680+0000 7f597642b740 1 Processor -- start 2024-09-17T03:14:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.682+0000 7f597642b740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f8278fc3b0 0x55f827cf05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.682+0000 7f597642b740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f827904590 0x55f827d8b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.682+0000 7f597642b740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827d21650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.682+0000 7f597642b740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f827d0a730 con 0x55f827925270 2024-09-17T03:14:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.682+0000 7f597642b740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f827d24f50 con 0x55f827904590 2024-09-17T03:14:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.682+0000 7f597642b740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f827d0ad50 con 0x55f8278fc3b0 2024-09-17T03:14:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.682+0000 7f597642b740 10 client.0 _ll_register_callbacks cb 0x7f59600076c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:14:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.682+0000 7f596da5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827d21650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.682+0000 7f596da5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827d21650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60874/0 (socket says 172.21.15.78:60874) 2024-09-17T03:14:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.682+0000 7f596da5a640 1 -- 172.21.15.78:0/3611247280 learned_addr learned my addr 172.21.15.78:0/3611247280 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.682+0000 7f596d259640 1 --2- 172.21.15.78:0/3611247280 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f8278fc3b0 0x55f827cf05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.682+0000 7f596ca58640 1 --2- 172.21.15.78:0/3611247280 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f827904590 0x55f827d8b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.682+0000 7f596da5a640 1 -- 172.21.15.78:0/3611247280 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f8278fc3b0 msgr2=0x55f827cf05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.682+0000 7f596da5a640 1 --2- 172.21.15.78:0/3611247280 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f8278fc3b0 0x55f827cf05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.682+0000 7f596da5a640 1 -- 172.21.15.78:0/3611247280 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f827904590 msgr2=0x55f827d8b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:14:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.682+0000 7f596da5a640 1 --2- 172.21.15.78:0/3611247280 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f827904590 0x55f827d8b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.682+0000 7f596da5a640 1 -- 172.21.15.78:0/3611247280 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f827ccd1b0 con 0x55f827925270 2024-09-17T03:14:50.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.682+0000 7f596da5a640 1 --2- 172.21.15.78:0/3611247280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827d21650 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f596000e910 tx=0x7f5960007930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab048e9f444f5392 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:50.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.682+0000 7f5947fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:14:50.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.683+0000 7f5947fff640 1 -- 172.21.15.78:0/3611247280 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5960014050 con 0x55f827925270 2024-09-17T03:14:50.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.683+0000 7f597642b740 1 -- 172.21.15.78:0/3611247280 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f596000ce20 con 0x55f827925270 2024-09-17T03:14:50.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.683+0000 7f5947fff640 1 -- 172.21.15.78:0/3611247280 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f596002c610 con 0x55f827925270 2024-09-17T03:14:50.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.683+0000 7f5947fff640 1 -- 172.21.15.78:0/3611247280 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f596003d050 con 0x55f827925270 2024-09-17T03:14:50.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.683+0000 7f597642b740 10 client.8508 fetch_fsmap learned FSMap version 98 2024-09-17T03:14:50.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.683+0000 7f597642b740 1 -- 172.21.15.78:0/3611247280 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) -- 0x55f827d35480 con 0x55f827925270 2024-09-17T03:14:50.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.683+0000 7f5947fff640 1 -- 172.21.15.78:0/3611247280 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f596000ce20 con 0x55f827925270 2024-09-17T03:14:50.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.683+0000 7f5947fff640 1 -- 172.21.15.78:0/3611247280 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 98) ==== 3542+0+0 (secure 0 0 0) 0x7f5960040020 con 0x55f827925270 2024-09-17T03:14:50.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.683+0000 7f597642b740 10 client.8508 fetch_fsmap finished waiting for FSMap version 98 2024-09-17T03:14:50.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.683+0000 7f597642b740 10 client.8508 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T03:14:50.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.683+0000 7f597642b740 20 client.8508 populate_metadata read hostname 'smithi078' 2024-09-17T03:14:50.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.683+0000 7f597642b740 1 --2- 172.21.15.78:0/3611247280 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f827cf41a0 0x55f827cf1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.683+0000 7f597642b740 4 client.8508 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T03:14:50.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.683+0000 7f597642b740 1 -- 172.21.15.78:0/3611247280 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "status"}) -- 0x55f827c3d220 con 0x55f827cf41a0 2024-09-17T03:14:50.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.683+0000 7f596d259640 1 --2- 172.21.15.78:0/3611247280 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f827cf41a0 0x55f827cf1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.684+0000 7f5947fff640 10 client.8508 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:14:50.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.684+0000 7f596d259640 1 --2- 172.21.15.78:0/3611247280 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f827cf41a0 0x55f827cf1c20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f20dd4a70bd4b7b2 server_cookie=28f7d9d2ac1eaa9 in_seq=0 out_seq=0 2024-09-17T03:14:50.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.684+0000 7f5947fff640 1 -- 172.21.15.78:0/3611247280 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55f827c3d220 con 0x55f827cf41a0 2024-09-17T03:14:50.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.684+0000 7f5947fff640 10 client.8508 handle_command_reply: tid=0 2024-09-17T03:14:50.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.684+0000 7f597642b740 1 client.8508 shutdown 2024-09-17T03:14:50.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.684+0000 7f597642b740 1 -- 172.21.15.78:0/3611247280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 msgr2=0x55f827d21650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.684+0000 7f597642b740 1 --2- 172.21.15.78:0/3611247280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827d21650 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f596000e910 tx=0x7f5960007930 comp rx=0 tx=0).stop 2024-09-17T03:14:50.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.684+0000 7f597642b740 1 -- 172.21.15.78:0/3611247280 shutdown_connections 2024-09-17T03:14:50.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.684+0000 7f597642b740 1 --2- 172.21.15.78:0/3611247280 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f827925270 0x55f827d21650 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.684+0000 7f597642b740 1 --2- 172.21.15.78:0/3611247280 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f827cf41a0 0x55f827cf1c20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.684+0000 7f597642b740 1 --2- 172.21.15.78:0/3611247280 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f827904590 0x55f827d8b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.684+0000 7f597642b740 1 --2- 172.21.15.78:0/3611247280 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f8278fc3b0 0x55f827cf05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.684+0000 7f597642b740 1 -- 172.21.15.78:0/3611247280 >> 172.21.15.78:0/3611247280 conn(0x55f8279193c0 msgr2=0x55f827cf72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:50.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.684+0000 7f5947fff640 0 client.8508 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:14:50.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.684+0000 7f597642b740 1 -- 172.21.15.78:0/3611247280 shutdown_connections 2024-09-17T03:14:50.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.684+0000 7f597642b740 1 -- 172.21.15.78:0/3611247280 wait complete. 2024-09-17T03:14:50.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.685+0000 7f597642b740 20 client.8508 trim_cache size 0 max 16384 2024-09-17T03:14:50.691 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:14:50.692 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "f3c59ba9-dab4-4ee6-8989-d80d11d430b6", 2024-09-17T03:14:50.692 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2024-09-17T03:14:50.692 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 8286, 2024-09-17T03:14:50.692 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2024-09-17T03:14:50.692 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2024-09-17T03:14:50.692 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2024-09-17T03:14:50.692 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 10.961190739999999, 2024-09-17T03:14:50.692 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 98, 2024-09-17T03:14:50.692 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 95, 2024-09-17T03:14:50.692 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 95, 2024-09-17T03:14:50.692 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 15.635180136000001 2024-09-17T03:14:50.692 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:14:50.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.685+0000 7f596f4bd640 1 -- 172.21.15.78:0/1410807430 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f594c078b90 msgr2=0x7f594c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.685+0000 7f596f4bd640 1 --2- 172.21.15.78:0/1410807430 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f594c078b90 0x7f594c07b0a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f59680b3440 tx=0x7f5958009040 comp rx=0 tx=0).stop 2024-09-17T03:14:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.685+0000 7f596f4bd640 1 -- 172.21.15.78:0/1410807430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5968070030 msgr2=0x7f5968148060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.685+0000 7f596f4bd640 1 --2- 172.21.15.78:0/1410807430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5968070030 0x7f5968148060 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f5964000c00 tx=0x7f5964033c20 comp rx=0 tx=0).stop 2024-09-17T03:14:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.685+0000 7f596f4bd640 1 -- 172.21.15.78:0/1410807430 shutdown_connections 2024-09-17T03:14:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.685+0000 7f596f4bd640 1 --2- 172.21.15.78:0/1410807430 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5968073170 0x7f59681f9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.685+0000 7f596f4bd640 1 --2- 172.21.15.78:0/1410807430 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f594c078b90 0x7f594c07b0a0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.685+0000 7f596f4bd640 1 --2- 172.21.15.78:0/1410807430 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5968070440 0x7f59681f9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.685+0000 7f596f4bd640 1 --2- 172.21.15.78:0/1410807430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5968070030 0x7f5968148060 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.685+0000 7f596f4bd640 1 -- 172.21.15.78:0/1410807430 >> 172.21.15.78:0/1410807430 conn(0x7f59680b1cb0 msgr2=0x7f596815f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.685+0000 7f596f4bd640 1 -- 172.21.15.78:0/1410807430 shutdown_connections 2024-09-17T03:14:50.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.685+0000 7f596f4bd640 1 -- 172.21.15.78:0/1410807430 wait complete. 2024-09-17T03:14:50.696 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:14:50.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.808+0000 7feecbbc6640 1 -- 172.21.15.78:0/852633847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feec4073170 msgr2=0x7feec415c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.808+0000 7feecbbc6640 1 --2- 172.21.15.78:0/852633847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feec4073170 0x7feec415c780 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7feec40710f0 tx=0x7feeb802a560 comp rx=0 tx=0).stop 2024-09-17T03:14:50.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.808+0000 7feecbbc6640 1 -- 172.21.15.78:0/852633847 shutdown_connections 2024-09-17T03:14:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.808+0000 7feecbbc6640 1 --2- 172.21.15.78:0/852633847 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feec4070440 0x7feec4074b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.808+0000 7feecbbc6640 1 --2- 172.21.15.78:0/852633847 >> v2:172.21.15.193:3300/0 conn(0x7feec4070030 0x7feec4074640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.808+0000 7feecbbc6640 1 --2- 172.21.15.78:0/852633847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feec4073170 0x7feec415c780 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.808+0000 7feecbbc6640 1 -- 172.21.15.78:0/852633847 >> 172.21.15.78:0/852633847 conn(0x7feec40b1cb0 msgr2=0x7feec40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.808+0000 7feecbbc6640 1 -- 172.21.15.78:0/852633847 shutdown_connections 2024-09-17T03:14:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.808+0000 7feecbbc6640 1 -- 172.21.15.78:0/852633847 wait complete. 2024-09-17T03:14:50.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.810+0000 7feecbbc6640 1 Processor -- start 2024-09-17T03:14:50.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.810+0000 7feecbbc6640 1 -- start start 2024-09-17T03:14:50.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.811+0000 7feecbbc6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feec4070030 0x7feec41f7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.811+0000 7feecbbc6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feec4070440 0x7feec414e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.811+0000 7feecbbc6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feec4073170 0x7feec41f44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.811+0000 7feecbbc6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feec406f630 con 0x7feec4070030 2024-09-17T03:14:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.811+0000 7feecbbc6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7feec406f4b0 con 0x7feec4070440 2024-09-17T03:14:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.811+0000 7feecbbc6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7feec406f7b0 con 0x7feec4073170 2024-09-17T03:14:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.811+0000 7feec9962640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feec4070030 0x7feec41f7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.811+0000 7feec9962640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feec4070030 0x7feec41f7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60898/0 (socket says 172.21.15.78:60898) 2024-09-17T03:14:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.811+0000 7feec9962640 1 -- 172.21.15.78:0/849104364 learned_addr learned my addr 172.21.15.78:0/849104364 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:14:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.812+0000 7feec9161640 1 --2- 172.21.15.78:0/849104364 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feec4070440 0x7feec414e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.812+0000 7feeca163640 1 --2- 172.21.15.78:0/849104364 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feec4073170 0x7feec41f44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.812+0000 7feec9962640 1 -- 172.21.15.78:0/849104364 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feec4073170 msgr2=0x7feec41f44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.812+0000 7feec9962640 1 --2- 172.21.15.78:0/849104364 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feec4073170 0x7feec41f44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.812+0000 7feec9962640 1 -- 172.21.15.78:0/849104364 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feec4070440 msgr2=0x7feec414e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:50.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.812+0000 7feec9962640 1 --2- 172.21.15.78:0/849104364 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feec4070440 0x7feec414e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.812+0000 7feec9962640 1 -- 172.21.15.78:0/849104364 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec414eae0 con 0x7feec4070030 2024-09-17T03:14:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.812+0000 7feeca163640 1 --2- 172.21.15.78:0/849104364 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feec4073170 0x7feec41f44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:14:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.812+0000 7feec9962640 1 --2- 172.21.15.78:0/849104364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feec4070030 0x7feec41f7b20 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7feeb80099c0 tx=0x7feeb80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.812+0000 7feeb67fc640 1 -- 172.21.15.78:0/849104364 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb803e030 con 0x7feec4070030 2024-09-17T03:14:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.812+0000 7feeb67fc640 1 -- 172.21.15.78:0/849104364 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feeb80047a0 con 0x7feec4070030 2024-09-17T03:14:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.812+0000 7feeb67fc640 1 -- 172.21.15.78:0/849104364 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb8035040 con 0x7feec4070030 2024-09-17T03:14:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.812+0000 7feecbbc6640 1 -- 172.21.15.78:0/849104364 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec40c4700 con 0x7feec4070030 2024-09-17T03:14:50.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.812+0000 7feecbbc6640 1 -- 172.21.15.78:0/849104364 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec40c4140 con 0x7feec4070030 2024-09-17T03:14:50.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.813+0000 7feecbbc6640 1 -- 172.21.15.78:0/849104364 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec415c780 con 0x7feec4070030 2024-09-17T03:14:50.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.814+0000 7feeb67fc640 1 -- 172.21.15.78:0/849104364 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feeb8041030 con 0x7feec4070030 2024-09-17T03:14:50.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.814+0000 7feeb67fc640 1 --2- 172.21.15.78:0/849104364 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feea8078bc0 0x7feea807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:14:50.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.815+0000 7feeb67fc640 1 -- 172.21.15.78:0/849104364 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7feeb80bb560 con 0x7feec4070030 2024-09-17T03:14:50.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.815+0000 7feec9161640 1 --2- 172.21.15.78:0/849104364 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feea8078bc0 0x7feea807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:14:50.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.815+0000 7feec9161640 1 --2- 172.21.15.78:0/849104364 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feea8078bc0 0x7feea807b0d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7feec000a490 tx=0x7feec000a420 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:14:50.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:50.819+0000 7feeb67fc640 1 -- 172.21.15.78:0/849104364 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7feec414eae0 con 0x7feec4070030 2024-09-17T03:14:51.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:51.027+0000 7feecbbc6640 1 -- 172.21.15.78:0/849104364 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feec415c030 con 0x7feec4070030 2024-09-17T03:14:51.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:51.027+0000 7feeb67fc640 1 -- 172.21.15.78:0/849104364 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) ==== 94+0+5269 (secure 0 0 0) 0x7feeb8083350 con 0x7feec4070030 2024-09-17T03:14:51.027 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:14:51.027 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":98,"btime":"2024-09-17T03:14:49:656474+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:14:49.656466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8286,"mds_1":8283,"mds_2":7213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7213":{"gid":7213,"name":"d","rank":2,"incarnation":97,"state":"up:active","state_seq":5,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8283":{"gid":8283,"name":"a","rank":1,"incarnation":95,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[7213,8283,8286]},"id":7}]} 2024-09-17T03:14:51.028 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 98 2024-09-17T03:14:51.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:51.029+0000 7feecbbc6640 1 -- 172.21.15.78:0/849104364 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feea8078bc0 msgr2=0x7feea807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:51.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:51.029+0000 7feecbbc6640 1 --2- 172.21.15.78:0/849104364 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feea8078bc0 0x7feea807b0d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7feec000a490 tx=0x7feec000a420 comp rx=0 tx=0).stop 2024-09-17T03:14:51.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:51.029+0000 7feecbbc6640 1 -- 172.21.15.78:0/849104364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feec4070030 msgr2=0x7feec41f7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:14:51.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:51.029+0000 7feecbbc6640 1 --2- 172.21.15.78:0/849104364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feec4070030 0x7feec41f7b20 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7feeb80099c0 tx=0x7feeb80039e0 comp rx=0 tx=0).stop 2024-09-17T03:14:51.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:51.029+0000 7feecbbc6640 1 -- 172.21.15.78:0/849104364 shutdown_connections 2024-09-17T03:14:51.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:51.029+0000 7feecbbc6640 1 --2- 172.21.15.78:0/849104364 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feec4073170 0x7feec41f44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:51.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:51.029+0000 7feecbbc6640 1 --2- 172.21.15.78:0/849104364 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feea8078bc0 0x7feea807b0d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:51.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:51.029+0000 7feecbbc6640 1 --2- 172.21.15.78:0/849104364 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feec4070440 0x7feec414e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:51.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:51.029+0000 7feecbbc6640 1 --2- 172.21.15.78:0/849104364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feec4070030 0x7feec41f7b20 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:14:51.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:51.029+0000 7feecbbc6640 1 -- 172.21.15.78:0/849104364 >> 172.21.15.78:0/849104364 conn(0x7feec40b1cb0 msgr2=0x7feec415f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:14:51.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:51.029+0000 7feecbbc6640 1 -- 172.21.15.78:0/849104364 shutdown_connections 2024-09-17T03:14:51.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:14:51.030+0000 7feecbbc6640 1 -- 172.21.15.78:0/849104364 wait complete. 2024-09-17T03:14:51.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:51.041 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-17T03:14:51.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:51.066 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec sync d1/d2/d3/d4/d5/d6/d7/d8) 2024-09-17T03:14:51.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:51.128 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 0 d1/d2) 2024-09-17T03:14:51.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:51.185 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 1 d1/d2/d3/d4) 2024-09-17T03:14:51.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:14:51.242 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.pin -v 2 d1/d2/d3/d4/d5/d6) 2024-09-17T03:14:51.298 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:14:51.460 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:14:51.460 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:14:51.460 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:14:53.461 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:14:53.606 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"5","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":1,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":1},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:14:53.607 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 1, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 1, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:14:53.607 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:14:55.608 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:14:55.755 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:14:55.756 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:14:55.756 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:14:56.361 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:14:56.364 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:14:57.757 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:14:57.892 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:14:57.893 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:14:57.893 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:14:59.894 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:15:00.038 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"7","version":"7","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":0,"dirty":1,"authpin":0},"nref":3}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}}] 2024-09-17T03:15:00.039 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 3, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 0, "subtree": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:15:00.039 INFO:tasks.cephfs.cephfs_test_case:[] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:15:02.041 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json get subtrees 2024-09-17T03:15:02.177 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"13","version":"13","committing_version":"1","committed_version":"1","is_rep":true,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds0","dirfrag":"0x100","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"0","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":true,"auth_first":0,"auth_second":-2,"export_pin":0,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":0,"dir":{"path":"/d1/d2","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"0","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"replicated":1,"dirty":1,"authpin":0},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":1,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":2}}] 2024-09-17T03:15:02.177 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x1", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 4, "path": "", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "13", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "0", "dirfrag": "0x100", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds0", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2", "pins": { "authpin": 0, "child": 1, "dirty": 1, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 0, "export_pin_target": 0, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "authpin": 0, "child": 1, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-17T03:15:02.178 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] =?= [('/d1/d2', 0), ('/d1/d2/d3/d4', 1)] 2024-09-17T03:15:02.178 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:15:02.300 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-17T03:15:02.300 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:15:02.300 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:15:04.302 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:15:04.438 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}}] 2024-09-17T03:15:04.439 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false } ] 2024-09-17T03:15:04.439 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:15:06.441 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json get subtrees 2024-09-17T03:15:06.574 INFO:teuthology.orchestra.run.smithi078.stdout:[{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds1","dirfrag":"0x101","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"1","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"14","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"0":1,"2":1}},"replica_state":{"authority":[1,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"child":0,"frozen":0,"subtree":1,"replicated":0,"dirty":0,"waiter":0,"authpin":0,"tempexporting":0},"nref":1}}] 2024-09-17T03:15:06.575 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "1", "dirfrag": "0x101", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds1", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "0": 1, "2": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "14", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 1, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "authpin": 0, "child": 0, "dirty": 0, "frozen": 0, "ptrwaiter": 0, "replicated": 0, "request": 0, "subtree": 1, "tempexporting": 0, "waiter": 0 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-17T03:15:06.575 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:15:06.575 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json get subtrees 2024-09-17T03:15:06.713 INFO:teuthology.orchestra.run.smithi193.stdout:[{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"~mds2","dirfrag":"0x102","snapid_first":2,"projected_version":"1","version":"1","committing_version":"1","committed_version":"1","is_rep":false,"dir_auth":"2","states":["auth","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1,"dirty":0,"authpin":0},"nref":2}},{"is_auth":false,"auth_first":0,"auth_second":-2,"export_pin":-1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":-1,"dir":{"path":"","dirfrag":"0x1","snapid_first":2,"projected_version":"0","version":"13","committing_version":"0","committed_version":"0","is_rep":true,"dir_auth":"0","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"subtree":1},"nref":2}},{"is_auth":true,"auth_first":2,"auth_second":-2,"export_pin":2,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":2,"dir":{"path":"/d1/d2/d3/d4/d5/d6","dirfrag":"0x10000000005","snapid_first":2,"projected_version":"6","version":"6","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"2","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{"1":1}},"replica_state":{"authority":[2,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"child":1,"frozen":0,"subtree":1,"importing":0,"replicated":1,"dirty":1},"nref":4}},{"is_auth":false,"auth_first":1,"auth_second":-2,"export_pin":1,"distributed_ephemeral_pin":false,"random_ephemeral_pin":false,"export_pin_target":1,"dir":{"path":"/d1/d2/d3/d4","dirfrag":"0x10000000003","snapid_first":2,"projected_version":"0","version":"14","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"1","states":[],"is_auth":false,"auth_state":{"replicas":{}},"replica_state":{"authority":[1,-2],"replica_nonce":1},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dnwaiter":0,"child":1,"subtree":1},"nref":2}}] 2024-09-17T03:15:06.714 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "1", "committing_version": "1", "dir_auth": "2", "dirfrag": "0x102", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "~mds2", "pins": { "authpin": 0, "child": 1, "dirty": 0, "subtree": 1 }, "projected_version": "1", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "complete" ], "version": "1" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 0, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "0", "dirfrag": "0x1", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": true, "nref": 2, "path": "", "pins": { "child": 1, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "13" }, "distributed_ephemeral_pin": false, "export_pin": -1, "export_pin_target": -1, "is_auth": false, "random_ephemeral_pin": false }, { "auth_first": 2, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": { "1": 1 } }, "committed_version": "0", "committing_version": "0", "dir_auth": "2", "dirfrag": "0x10000000005", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 4, "path": "/d1/d2/d3/d4/d5/d6", "pins": { "child": 1, "dirty": 1, "frozen": 0, "importing": 0, "ptrwaiter": 0, "replicated": 1, "subtree": 1 }, "projected_version": "6", "replica_state": { "authority": [ 2, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "6" }, "distributed_ephemeral_pin": false, "export_pin": 2, "export_pin_target": 2, "is_auth": true, "random_ephemeral_pin": false }, { "auth_first": 1, "auth_second": -2, "dir": { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dir_auth": "1", "dirfrag": "0x10000000003", "is_auth": false, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/d1/d2/d3/d4", "pins": { "child": 1, "dnwaiter": 0, "subtree": 1 }, "projected_version": "0", "replica_state": { "authority": [ 1, -2 ], "replica_nonce": 1 }, "snapid_first": 2, "states": [], "version": "14" }, "distributed_ephemeral_pin": false, "export_pin": 1, "export_pin_target": 1, "is_auth": false, "random_ephemeral_pin": false } ] 2024-09-17T03:15:06.714 INFO:tasks.cephfs.cephfs_test_case:[('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] =?= [('/d1/d2/d3/d4', 1), ('/d1/d2/d3/d4/d5/d6', 2)] 2024-09-17T03:15:06.714 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 flush journal 2024-09-17T03:15:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.831+0000 7fee776c5640 1 -- 172.21.15.78:0/1211096618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7015fb70 msgr2=0x7fee700b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.831+0000 7fee776c5640 1 --2- 172.21.15.78:0/1211096618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7015fb70 0x7fee700b3a60 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7fee68005fd0 tx=0x7fee6802a540 comp rx=0 tx=0).stop 2024-09-17T03:15:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.831+0000 7fee776c5640 1 -- 172.21.15.78:0/1211096618 shutdown_connections 2024-09-17T03:15:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.831+0000 7fee776c5640 1 --2- 172.21.15.78:0/1211096618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7015fb70 0x7fee700b3a60 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.831+0000 7fee776c5640 1 --2- 172.21.15.78:0/1211096618 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee7015e8b0 0x7fee7015f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.831+0000 7fee776c5640 1 -- 172.21.15.78:0/1211096618 >> 172.21.15.78:0/1211096618 conn(0x7fee700d15f0 msgr2=0x7fee70073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:06.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.831+0000 7fee776c5640 1 -- 172.21.15.78:0/1211096618 shutdown_connections 2024-09-17T03:15:06.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.831+0000 7fee776c5640 1 -- 172.21.15.78:0/1211096618 wait complete. 2024-09-17T03:15:06.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.832+0000 7fee776c5640 1 Processor -- start 2024-09-17T03:15:06.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.833+0000 7fee776c5640 1 -- start start 2024-09-17T03:15:06.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.834+0000 7fee776c5640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee700b4f80 0x7fee700adda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:06.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.834+0000 7fee776c5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7015e8b0 0x7fee7015d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:06.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.834+0000 7fee776c5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee7015fb70 0x7fee701e94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:06.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.834+0000 7fee776c5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fee70073e50 con 0x7fee7015e8b0 2024-09-17T03:15:06.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.834+0000 7fee776c5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fee700b4350 con 0x7fee7015fb70 2024-09-17T03:15:06.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.834+0000 7fee776c5640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fee70073fd0 con 0x7fee700b4f80 2024-09-17T03:15:06.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.834+0000 7fee74c60640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7015e8b0 0x7fee7015d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:06.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.834+0000 7fee74c60640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7015e8b0 0x7fee7015d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50470/0 (socket says 172.21.15.78:50470) 2024-09-17T03:15:06.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.834+0000 7fee74c60640 1 -- 172.21.15.78:0/1593420918 learned_addr learned my addr 172.21.15.78:0/1593420918 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:06.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.834+0000 7fee75461640 1 --2- 172.21.15.78:0/1593420918 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee700b4f80 0x7fee700adda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:06.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.834+0000 7fee75c62640 1 --2- 172.21.15.78:0/1593420918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee7015fb70 0x7fee701e94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:06.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.834+0000 7fee74c60640 1 -- 172.21.15.78:0/1593420918 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee700b4f80 msgr2=0x7fee700adda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:06.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.834+0000 7fee74c60640 1 --2- 172.21.15.78:0/1593420918 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee700b4f80 0x7fee700adda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.834+0000 7fee74c60640 1 -- 172.21.15.78:0/1593420918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee7015fb70 msgr2=0x7fee701e94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:06.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.834+0000 7fee74c60640 1 --2- 172.21.15.78:0/1593420918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee7015fb70 0x7fee701e94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.834+0000 7fee74c60640 1 -- 172.21.15.78:0/1593420918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee700aecd0 con 0x7fee7015e8b0 2024-09-17T03:15:06.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.834+0000 7fee75461640 1 --2- 172.21.15.78:0/1593420918 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee700b4f80 0x7fee700adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:06.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.834+0000 7fee74c60640 1 --2- 172.21.15.78:0/1593420918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7015e8b0 0x7fee7015d160 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fee6400d740 tx=0x7fee6400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:06.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.834+0000 7fee6dffb640 1 -- 172.21.15.78:0/1593420918 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64017070 con 0x7fee7015e8b0 2024-09-17T03:15:06.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.834+0000 7fee6dffb640 1 -- 172.21.15.78:0/1593420918 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee64009d20 con 0x7fee7015e8b0 2024-09-17T03:15:06.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.835+0000 7fee776c5640 1 -- 172.21.15.78:0/1593420918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee700ae710 con 0x7fee7015e8b0 2024-09-17T03:15:06.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.835+0000 7fee6dffb640 1 -- 172.21.15.78:0/1593420918 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee640106c0 con 0x7fee7015e8b0 2024-09-17T03:15:06.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.835+0000 7fee776c5640 1 -- 172.21.15.78:0/1593420918 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee701e75b0 con 0x7fee7015e8b0 2024-09-17T03:15:06.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.837+0000 7fee6dffb640 1 -- 172.21.15.78:0/1593420918 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fee6401a070 con 0x7fee7015e8b0 2024-09-17T03:15:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.837+0000 7fee6dffb640 1 --2- 172.21.15.78:0/1593420918 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fee5c078bc0 0x7fee5c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:06.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.837+0000 7fee6dffb640 1 -- 172.21.15.78:0/1593420918 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fee6409aeb0 con 0x7fee7015e8b0 2024-09-17T03:15:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.838+0000 7fee75461640 1 --2- 172.21.15.78:0/1593420918 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fee5c078bc0 0x7fee5c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.838+0000 7fee7e635740 1 Processor -- start 2024-09-17T03:15:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.838+0000 7fee7e635740 1 -- start start 2024-09-17T03:15:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.838+0000 7fee75461640 1 --2- 172.21.15.78:0/1593420918 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fee5c078bc0 0x7fee5c07b0d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fee60001d10 tx=0x7fee60009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.839+0000 7fee7e635740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561ff4374390 0x561ff4760a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.839+0000 7fee7e635740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ff434b4d0 0x561ff4735860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.839+0000 7fee7e635740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff43536b0 0x561ff4735da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.839+0000 7fee7e635740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x561ff468ea60 con 0x561ff43536b0 2024-09-17T03:15:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.839+0000 7fee7e635740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561ff467de90 con 0x561ff434b4d0 2024-09-17T03:15:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.839+0000 7fee7e635740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x561ff4681ca0 con 0x561ff4374390 2024-09-17T03:15:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.839+0000 7fee75c62640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff43536b0 0x561ff4735da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:06.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.839+0000 7fee75c62640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff43536b0 0x561ff4735da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50478/0 (socket says 172.21.15.78:50478) 2024-09-17T03:15:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.839+0000 7fee75c62640 1 -- 172.21.15.78:0/947216116 learned_addr learned my addr 172.21.15.78:0/947216116 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.839+0000 7fee74c60640 1 --2- 172.21.15.78:0/947216116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ff434b4d0 0x561ff4735860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.839+0000 7fee75461640 1 --2- 172.21.15.78:0/947216116 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561ff4374390 0x561ff4760a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.840+0000 7fee75c62640 1 -- 172.21.15.78:0/947216116 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561ff4374390 msgr2=0x561ff4760a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.840+0000 7fee75c62640 1 --2- 172.21.15.78:0/947216116 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561ff4374390 0x561ff4760a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.840+0000 7fee75c62640 1 -- 172.21.15.78:0/947216116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ff434b4d0 msgr2=0x561ff4735860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.840+0000 7fee75c62640 1 --2- 172.21.15.78:0/947216116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ff434b4d0 0x561ff4735860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.840+0000 7fee75c62640 1 -- 172.21.15.78:0/947216116 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ff44567d0 con 0x561ff43536b0 2024-09-17T03:15:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.840+0000 7fee75c62640 1 --2- 172.21.15.78:0/947216116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff43536b0 0x561ff4735da0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fee68009850 tx=0x7fee680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d521a409d2ee11 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.840+0000 7fee56ffd640 1 -- 172.21.15.78:0/947216116 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68035030 con 0x561ff43536b0 2024-09-17T03:15:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.840+0000 7fee56ffd640 1 -- 172.21.15.78:0/947216116 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee68004030 con 0x561ff43536b0 2024-09-17T03:15:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.840+0000 7fee56ffd640 1 -- 172.21.15.78:0/947216116 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee68004440 con 0x561ff43536b0 2024-09-17T03:15:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.841+0000 7fee7e635740 1 -- 172.21.15.78:0/947216116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff43536b0 msgr2=0x561ff4735da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:06.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.841+0000 7fee7e635740 1 --2- 172.21.15.78:0/947216116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff43536b0 0x561ff4735da0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fee68009850 tx=0x7fee680046c0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.841+0000 7fee7e635740 1 -- 172.21.15.78:0/947216116 shutdown_connections 2024-09-17T03:15:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.841+0000 7fee7e635740 1 --2- 172.21.15.78:0/947216116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff43536b0 0x561ff4735da0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.841+0000 7fee7e635740 1 --2- 172.21.15.78:0/947216116 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ff434b4d0 0x561ff4735860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.841+0000 7fee7e635740 1 --2- 172.21.15.78:0/947216116 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561ff4374390 0x561ff4760a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.841+0000 7fee7e635740 1 -- 172.21.15.78:0/947216116 >> 172.21.15.78:0/947216116 conn(0x561ff43684e0 msgr2=0x561ff471bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.841+0000 7fee7e635740 1 -- 172.21.15.78:0/947216116 shutdown_connections 2024-09-17T03:15:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.841+0000 7fee7e635740 1 -- 172.21.15.78:0/947216116 wait complete. 2024-09-17T03:15:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.842+0000 7fee7e635740 1 -- start start 2024-09-17T03:15:06.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.842+0000 7fee7e635740 1 Processor -- start 2024-09-17T03:15:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.843+0000 7fee7e635740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff434b4d0 0x561ff475a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.843+0000 7fee7e635740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561ff43536b0 0x561ff475c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.843+0000 7fee7e635740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ff4374390 0x561ff4772d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.843+0000 7fee7e635740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x561ff43ee740 con 0x561ff434b4d0 2024-09-17T03:15:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.843+0000 7fee7e635740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x561ff4623970 con 0x561ff4374390 2024-09-17T03:15:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.843+0000 7fee7e635740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x561ff475acf0 con 0x561ff43536b0 2024-09-17T03:15:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.843+0000 7fee7e635740 10 client.0 _ll_register_callbacks cb 0x561ff4632780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:06.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.843+0000 7fee75461640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff434b4d0 0x561ff475a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.843+0000 7fee75461640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff434b4d0 0x561ff475a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50490/0 (socket says 172.21.15.78:50490) 2024-09-17T03:15:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.843+0000 7fee75461640 1 -- 172.21.15.78:0/2066855834 learned_addr learned my addr 172.21.15.78:0/2066855834 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.843+0000 7fee74c60640 1 --2- 172.21.15.78:0/2066855834 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561ff43536b0 0x561ff475c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.844+0000 7fee75c62640 1 --2- 172.21.15.78:0/2066855834 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ff4374390 0x561ff4772d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.844+0000 7fee75461640 1 -- 172.21.15.78:0/2066855834 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561ff43536b0 msgr2=0x561ff475c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.844+0000 7fee75461640 1 --2- 172.21.15.78:0/2066855834 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561ff43536b0 0x561ff475c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.844+0000 7fee75461640 1 -- 172.21.15.78:0/2066855834 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ff4374390 msgr2=0x561ff4772d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.844+0000 7fee75461640 1 --2- 172.21.15.78:0/2066855834 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ff4374390 0x561ff4772d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.844+0000 7fee75461640 1 -- 172.21.15.78:0/2066855834 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ff43df970 con 0x561ff434b4d0 2024-09-17T03:15:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.844+0000 7fee75461640 1 --2- 172.21.15.78:0/2066855834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff434b4d0 0x561ff475a7b0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fee600146a0 tx=0x7fee60001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea300f3649b0c9f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.844+0000 7fee4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.844+0000 7fee4ffff640 1 -- 172.21.15.78:0/2066855834 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee60006d60 con 0x561ff434b4d0 2024-09-17T03:15:06.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.844+0000 7fee4ffff640 1 -- 172.21.15.78:0/2066855834 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fee60007050 con 0x561ff434b4d0 2024-09-17T03:15:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.844+0000 7fee7e635740 1 -- 172.21.15.78:0/2066855834 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee68004030 con 0x561ff434b4d0 2024-09-17T03:15:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.844+0000 7fee4ffff640 1 -- 172.21.15.78:0/2066855834 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7fee6002d050 con 0x561ff434b4d0 2024-09-17T03:15:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.844+0000 7fee7e635740 10 client.8526 fetch_fsmap learned FSMap version 100 2024-09-17T03:15:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.844+0000 7fee7e635740 1 -- 172.21.15.78:0/2066855834 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x561ff43bd6a0 con 0x561ff434b4d0 2024-09-17T03:15:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.844+0000 7fee4ffff640 1 -- 172.21.15.78:0/2066855834 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee68004030 con 0x561ff434b4d0 2024-09-17T03:15:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.845+0000 7fee4ffff640 1 -- 172.21.15.78:0/2066855834 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 100) ==== 3554+0+0 (secure 0 0 0) 0x7fee60030020 con 0x561ff434b4d0 2024-09-17T03:15:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.845+0000 7fee7e635740 10 client.8526 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T03:15:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.845+0000 7fee7e635740 10 client.8526 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T03:15:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.845+0000 7fee7e635740 20 client.8526 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.845+0000 7fee7e635740 1 --2- 172.21.15.78:0/2066855834 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x561ff4332f60 0x561ff476f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.845+0000 7fee7e635740 4 client.8526 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.845+0000 7fee7e635740 1 -- 172.21.15.78:0/2066855834 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ff46909b0 con 0x561ff4332f60 2024-09-17T03:15:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.845+0000 7fee74c60640 1 --2- 172.21.15.78:0/2066855834 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x561ff4332f60 0x561ff476f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:06.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.845+0000 7fee4ffff640 10 client.8526 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.845+0000 7fee74c60640 1 --2- 172.21.15.78:0/2066855834 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x561ff4332f60 0x561ff476f780 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ece0770156112e server_cookie=318d175105b7e68a in_seq=0 out_seq=0 2024-09-17T03:15:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.846+0000 7fee4ffff640 1 -- 172.21.15.78:0/2066855834 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561ff46909b0 con 0x561ff4332f60 2024-09-17T03:15:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.846+0000 7fee4ffff640 10 client.8526 handle_command_reply: tid=0 2024-09-17T03:15:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.846+0000 7fee7e635740 1 client.8526 shutdown 2024-09-17T03:15:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.846+0000 7fee7e635740 1 -- 172.21.15.78:0/2066855834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff434b4d0 msgr2=0x561ff475a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.846+0000 7fee7e635740 1 --2- 172.21.15.78:0/2066855834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff434b4d0 0x561ff475a7b0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fee600146a0 tx=0x7fee60001250 comp rx=0 tx=0).stop 2024-09-17T03:15:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.846+0000 7fee7e635740 1 -- 172.21.15.78:0/2066855834 shutdown_connections 2024-09-17T03:15:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.846+0000 7fee7e635740 1 --2- 172.21.15.78:0/2066855834 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x561ff4332f60 0x561ff476f780 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.846+0000 7fee7e635740 1 --2- 172.21.15.78:0/2066855834 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ff4374390 0x561ff4772d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.846+0000 7fee7e635740 1 --2- 172.21.15.78:0/2066855834 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561ff43536b0 0x561ff475c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.846+0000 7fee4ffff640 0 client.8526 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.846+0000 7fee7e635740 1 --2- 172.21.15.78:0/2066855834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff434b4d0 0x561ff475a7b0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.846+0000 7fee7e635740 1 -- 172.21.15.78:0/2066855834 >> 172.21.15.78:0/2066855834 conn(0x561ff43684e0 msgr2=0x561ff47357d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:06.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.846+0000 7fee7e635740 1 -- 172.21.15.78:0/2066855834 shutdown_connections 2024-09-17T03:15:06.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.846+0000 7fee7e635740 1 -- 172.21.15.78:0/2066855834 wait complete. 2024-09-17T03:15:06.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.846+0000 7fee7e635740 20 client.8526 trim_cache size 0 max 16384 2024-09-17T03:15:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.861+0000 7fee7e635740 1 Processor -- start 2024-09-17T03:15:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.861+0000 7fee7e635740 1 -- start start 2024-09-17T03:15:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.862+0000 7fee7e635740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff434b4d0 0x561ff4735620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.862+0000 7fee7e635740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561ff43536b0 0x561ff4760a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.862+0000 7fee7e635740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ff4374390 0x561ff4760f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.862+0000 7fee7e635740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x561ff47194e0 con 0x561ff434b4d0 2024-09-17T03:15:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.862+0000 7fee7e635740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fee70202270 con 0x561ff4374390 2024-09-17T03:15:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.862+0000 7fee7e635740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fee70201440 con 0x561ff43536b0 2024-09-17T03:15:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.862+0000 7fee75461640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff434b4d0 0x561ff4735620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.862+0000 7fee75461640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff434b4d0 0x561ff4735620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50492/0 (socket says 172.21.15.78:50492) 2024-09-17T03:15:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.862+0000 7fee75461640 1 -- 172.21.15.78:0/3463465052 learned_addr learned my addr 172.21.15.78:0/3463465052 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.863+0000 7fee75c62640 1 --2- 172.21.15.78:0/3463465052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ff4374390 0x561ff4760f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.863+0000 7fee74c60640 1 --2- 172.21.15.78:0/3463465052 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561ff43536b0 0x561ff4760a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.863+0000 7fee75461640 1 -- 172.21.15.78:0/3463465052 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561ff43536b0 msgr2=0x561ff4760a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.863+0000 7fee75461640 1 --2- 172.21.15.78:0/3463465052 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561ff43536b0 0x561ff4760a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.863+0000 7fee75461640 1 -- 172.21.15.78:0/3463465052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ff4374390 msgr2=0x561ff4760f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.863+0000 7fee75461640 1 --2- 172.21.15.78:0/3463465052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ff4374390 0x561ff4760f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.863+0000 7fee75461640 1 -- 172.21.15.78:0/3463465052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ff4718860 con 0x561ff434b4d0 2024-09-17T03:15:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.863+0000 7fee75461640 1 --2- 172.21.15.78:0/3463465052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff434b4d0 0x561ff4735620 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fee6000d620 tx=0x7fee6000d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f634467aeb311f3c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.863+0000 7fee567fc640 1 -- 172.21.15.78:0/3463465052 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee60035020 con 0x561ff434b4d0 2024-09-17T03:15:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.863+0000 7fee567fc640 1 -- 172.21.15.78:0/3463465052 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee60025070 con 0x561ff434b4d0 2024-09-17T03:15:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.863+0000 7fee567fc640 1 -- 172.21.15.78:0/3463465052 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee60007800 con 0x561ff434b4d0 2024-09-17T03:15:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.864+0000 7fee7e635740 1 -- 172.21.15.78:0/3463465052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff434b4d0 msgr2=0x561ff4735620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.864+0000 7fee7e635740 1 --2- 172.21.15.78:0/3463465052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff434b4d0 0x561ff4735620 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fee6000d620 tx=0x7fee6000d650 comp rx=0 tx=0).stop 2024-09-17T03:15:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.864+0000 7fee7e635740 1 -- 172.21.15.78:0/3463465052 shutdown_connections 2024-09-17T03:15:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.864+0000 7fee7e635740 1 --2- 172.21.15.78:0/3463465052 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ff4374390 0x561ff4760f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.864+0000 7fee7e635740 1 --2- 172.21.15.78:0/3463465052 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561ff43536b0 0x561ff4760a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.864+0000 7fee7e635740 1 --2- 172.21.15.78:0/3463465052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff434b4d0 0x561ff4735620 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.864+0000 7fee7e635740 1 -- 172.21.15.78:0/3463465052 >> 172.21.15.78:0/3463465052 conn(0x561ff43684e0 msgr2=0x561ff4716a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.864+0000 7fee7e635740 1 -- 172.21.15.78:0/3463465052 shutdown_connections 2024-09-17T03:15:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.864+0000 7fee7e635740 1 -- 172.21.15.78:0/3463465052 wait complete. 2024-09-17T03:15:06.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.865+0000 7fee7e635740 1 -- start start 2024-09-17T03:15:06.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.865+0000 7fee7e635740 1 Processor -- start 2024-09-17T03:15:06.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.866+0000 7fee7e635740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561ff434b4d0 0x561ff47764a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:06.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.866+0000 7fee7e635740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff43536b0 0x561ff4760c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:06.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.866+0000 7fee7e635740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ff4374390 0x561ff47c7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:06.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.866+0000 7fee7e635740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fee701f9120 con 0x561ff43536b0 2024-09-17T03:15:06.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.866+0000 7fee7e635740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fee70201b40 con 0x561ff4374390 2024-09-17T03:15:06.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.866+0000 7fee7e635740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x561ff4778360 con 0x561ff434b4d0 2024-09-17T03:15:06.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.866+0000 7fee7e635740 10 client.0 _ll_register_callbacks cb 0x7fee6000d920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:06.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.866+0000 7fee74c60640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff43536b0 0x561ff4760c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:06.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.866+0000 7fee74c60640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff43536b0 0x561ff4760c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50494/0 (socket says 172.21.15.78:50494) 2024-09-17T03:15:06.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.866+0000 7fee74c60640 1 -- 172.21.15.78:0/2932382732 learned_addr learned my addr 172.21.15.78:0/2932382732 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:06.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.866+0000 7fee75461640 1 --2- 172.21.15.78:0/2932382732 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561ff434b4d0 0x561ff47764a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:06.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.866+0000 7fee75c62640 1 --2- 172.21.15.78:0/2932382732 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ff4374390 0x561ff47c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:06.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee74c60640 1 -- 172.21.15.78:0/2932382732 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561ff434b4d0 msgr2=0x561ff47764a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:06.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee74c60640 1 --2- 172.21.15.78:0/2932382732 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561ff434b4d0 0x561ff47764a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee74c60640 1 -- 172.21.15.78:0/2932382732 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ff4374390 msgr2=0x561ff47c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:06.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee74c60640 1 --2- 172.21.15.78:0/2932382732 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ff4374390 0x561ff47c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee74c60640 1 -- 172.21.15.78:0/2932382732 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ff475c9b0 con 0x561ff43536b0 2024-09-17T03:15:06.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee74c60640 1 --2- 172.21.15.78:0/2932382732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff43536b0 0x561ff4760c00 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fee6405fed0 tx=0x7fee64099210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2631bf47ff43cd4a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:06.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee4ffff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:06.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee4ffff640 1 -- 172.21.15.78:0/2932382732 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee64021040 con 0x561ff43536b0 2024-09-17T03:15:06.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee4ffff640 1 -- 172.21.15.78:0/2932382732 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fee640620c0 con 0x561ff43536b0 2024-09-17T03:15:06.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee7e635740 1 -- 172.21.15.78:0/2932382732 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee60025070 con 0x561ff43536b0 2024-09-17T03:15:06.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee4ffff640 1 -- 172.21.15.78:0/2932382732 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7fee6404e1d0 con 0x561ff43536b0 2024-09-17T03:15:06.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee7e635740 10 client.8532 fetch_fsmap learned FSMap version 100 2024-09-17T03:15:06.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee7e635740 1 -- 172.21.15.78:0/2932382732 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x561ff4710a70 con 0x561ff43536b0 2024-09-17T03:15:06.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee4ffff640 1 -- 172.21.15.78:0/2932382732 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee60025070 con 0x561ff43536b0 2024-09-17T03:15:06.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee4ffff640 1 -- 172.21.15.78:0/2932382732 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 100) ==== 3554+0+0 (secure 0 0 0) 0x7fee6405e5b0 con 0x561ff43536b0 2024-09-17T03:15:06.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee7e635740 10 client.8532 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T03:15:06.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee7e635740 10 client.8532 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T03:15:06.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee7e635740 20 client.8532 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:06.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee7e635740 1 --2- 172.21.15.78:0/2932382732 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x561ff47c7e90 0x561ff47e2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:06.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee7e635740 4 client.8532 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T03:15:06.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.867+0000 7fee7e635740 1 -- 172.21.15.78:0/2932382732 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561ff468c460 con 0x561ff47c7e90 2024-09-17T03:15:06.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.868+0000 7fee75461640 1 --2- 172.21.15.78:0/2932382732 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x561ff47c7e90 0x561ff47e2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:06.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.868+0000 7fee4ffff640 10 client.8532 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:06.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.868+0000 7fee75461640 1 --2- 172.21.15.78:0/2932382732 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x561ff47c7e90 0x561ff47e2ee0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ac54b72d2a415c4 server_cookie=1d52c89fd6983dfb in_seq=0 out_seq=0 2024-09-17T03:15:06.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.878+0000 7fee4ffff640 1 -- 172.21.15.78:0/2932382732 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561ff468c460 con 0x561ff47c7e90 2024-09-17T03:15:06.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.878+0000 7fee4ffff640 10 client.8532 handle_command_reply: tid=0 2024-09-17T03:15:06.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.878+0000 7fee7e635740 1 client.8532 shutdown 2024-09-17T03:15:06.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.878+0000 7fee7e635740 1 -- 172.21.15.78:0/2932382732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff43536b0 msgr2=0x561ff4760c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:06.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.878+0000 7fee7e635740 1 --2- 172.21.15.78:0/2932382732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff43536b0 0x561ff4760c00 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fee6405fed0 tx=0x7fee64099210 comp rx=0 tx=0).stop 2024-09-17T03:15:06.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.879+0000 7fee7e635740 1 -- 172.21.15.78:0/2932382732 shutdown_connections 2024-09-17T03:15:06.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.879+0000 7fee7e635740 1 --2- 172.21.15.78:0/2932382732 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x561ff47c7e90 0x561ff47e2ee0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.879+0000 7fee7e635740 1 --2- 172.21.15.78:0/2932382732 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x561ff4374390 0x561ff47c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.879+0000 7fee4ffff640 0 client.8532 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:06.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.879+0000 7fee7e635740 1 --2- 172.21.15.78:0/2932382732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x561ff43536b0 0x561ff4760c00 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.879+0000 7fee7e635740 1 --2- 172.21.15.78:0/2932382732 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x561ff434b4d0 0x561ff47764a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.879+0000 7fee7e635740 1 -- 172.21.15.78:0/2932382732 >> 172.21.15.78:0/2932382732 conn(0x561ff43684e0 msgr2=0x561ff4735440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:06.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.879+0000 7fee7e635740 1 -- 172.21.15.78:0/2932382732 shutdown_connections 2024-09-17T03:15:06.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.879+0000 7fee7e635740 1 -- 172.21.15.78:0/2932382732 wait complete. 2024-09-17T03:15:06.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.879+0000 7fee7e635740 20 client.8532 trim_cache size 0 max 16384 2024-09-17T03:15:06.879 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:06.879 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:15:06.879 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:15:06.879 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:06.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.879+0000 7fee776c5640 1 -- 172.21.15.78:0/1593420918 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fee5c078bc0 msgr2=0x7fee5c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:06.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.879+0000 7fee776c5640 1 --2- 172.21.15.78:0/1593420918 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fee5c078bc0 0x7fee5c07b0d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fee60001d10 tx=0x7fee60009040 comp rx=0 tx=0).stop 2024-09-17T03:15:06.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.879+0000 7fee776c5640 1 -- 172.21.15.78:0/1593420918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7015e8b0 msgr2=0x7fee7015d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:06.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.879+0000 7fee776c5640 1 --2- 172.21.15.78:0/1593420918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7015e8b0 0x7fee7015d160 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7fee6400d740 tx=0x7fee6400dc00 comp rx=0 tx=0).stop 2024-09-17T03:15:06.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.879+0000 7fee776c5640 1 -- 172.21.15.78:0/1593420918 shutdown_connections 2024-09-17T03:15:06.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.879+0000 7fee776c5640 1 --2- 172.21.15.78:0/1593420918 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fee5c078bc0 0x7fee5c07b0d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.879+0000 7fee776c5640 1 --2- 172.21.15.78:0/1593420918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee7015fb70 0x7fee701e94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.879+0000 7fee776c5640 1 --2- 172.21.15.78:0/1593420918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee7015e8b0 0x7fee7015d160 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.879+0000 7fee776c5640 1 --2- 172.21.15.78:0/1593420918 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee700b4f80 0x7fee700adda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:06.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.879+0000 7fee776c5640 1 -- 172.21.15.78:0/1593420918 >> 172.21.15.78:0/1593420918 conn(0x7fee700d15f0 msgr2=0x7fee700b44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:06.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.880+0000 7fee776c5640 1 -- 172.21.15.78:0/1593420918 shutdown_connections 2024-09-17T03:15:06.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:06.880+0000 7fee776c5640 1 -- 172.21.15.78:0/1593420918 wait complete. 2024-09-17T03:15:06.889 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:1 flush journal 2024-09-17T03:15:07.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.005+0000 7f21fe72b640 1 -- 172.21.15.78:0/3744558217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21f80af780 msgr2=0x7f21f80b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:07.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.005+0000 7f21fe72b640 1 --2- 172.21.15.78:0/3744558217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21f80af780 0x7f21f80b39c0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f21e8005fd0 tx=0x7f21e802a5d0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.005+0000 7f21fe72b640 1 -- 172.21.15.78:0/3744558217 shutdown_connections 2024-09-17T03:15:07.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.005+0000 7f21fe72b640 1 --2- 172.21.15.78:0/3744558217 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f21f8072ff0 0x7f21f8073400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.005+0000 7f21fe72b640 1 --2- 172.21.15.78:0/3744558217 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21f80af780 0x7f21f80b39c0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.005+0000 7f21fe72b640 1 -- 172.21.15.78:0/3744558217 >> 172.21.15.78:0/3744558217 conn(0x7f21f806d7d0 msgr2=0x7f21f80b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:07.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.005+0000 7f21fe72b640 1 -- 172.21.15.78:0/3744558217 shutdown_connections 2024-09-17T03:15:07.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.005+0000 7f21fe72b640 1 -- 172.21.15.78:0/3744558217 wait complete. 2024-09-17T03:15:07.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.006+0000 7f21fe72b640 1 Processor -- start 2024-09-17T03:15:07.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.007+0000 7f21fe72b640 1 -- start start 2024-09-17T03:15:07.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.008+0000 7f21fe72b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f21f8072ff0 0x7f21f81e4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.008+0000 7f21fe72b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f21f80af780 0x7f21f814ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.008+0000 7f21fe72b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21f80cd3e0 0x7f21f809ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.008+0000 7f21fe72b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f21f8073d10 con 0x7f21f80cd3e0 2024-09-17T03:15:07.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.008+0000 7f21fe72b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f21f8073b90 con 0x7f21f80af780 2024-09-17T03:15:07.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.008+0000 7f21fe72b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f21f815f930 con 0x7f21f8072ff0 2024-09-17T03:15:07.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.008+0000 7f21fccc8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21f80cd3e0 0x7f21f809ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.008+0000 7f21fccc8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21f80cd3e0 0x7f21f809ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50514/0 (socket says 172.21.15.78:50514) 2024-09-17T03:15:07.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.008+0000 7f21fccc8640 1 -- 172.21.15.78:0/25604153 learned_addr learned my addr 172.21.15.78:0/25604153 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:07.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.008+0000 7f21f7fff640 1 --2- 172.21.15.78:0/25604153 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f21f8072ff0 0x7f21f81e4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.008+0000 7f21f77fe640 1 --2- 172.21.15.78:0/25604153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f21f80af780 0x7f21f814ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.008+0000 7f21fccc8640 1 -- 172.21.15.78:0/25604153 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f21f8072ff0 msgr2=0x7f21f81e4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:07.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.008+0000 7f21fccc8640 1 --2- 172.21.15.78:0/25604153 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f21f8072ff0 0x7f21f81e4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.008+0000 7f21fccc8640 1 -- 172.21.15.78:0/25604153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f21f80af780 msgr2=0x7f21f814ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:07.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.008+0000 7f21fccc8640 1 --2- 172.21.15.78:0/25604153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f21f80af780 0x7f21f814ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.008+0000 7f21fccc8640 1 -- 172.21.15.78:0/25604153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f815b590 con 0x7f21f80cd3e0 2024-09-17T03:15:07.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.008+0000 7f21f77fe640 1 --2- 172.21.15.78:0/25604153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f21f80af780 0x7f21f814ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:07.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.008+0000 7f21fccc8640 1 --2- 172.21.15.78:0/25604153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21f80cd3e0 0x7f21f809ca10 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f21f000dac0 tx=0x7f21f000df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:07.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.009+0000 7f21f4ff9640 1 -- 172.21.15.78:0/25604153 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0017070 con 0x7f21f80cd3e0 2024-09-17T03:15:07.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.009+0000 7f21f4ff9640 1 -- 172.21.15.78:0/25604153 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21f0003970 con 0x7f21f80cd3e0 2024-09-17T03:15:07.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.009+0000 7f21fe72b640 1 -- 172.21.15.78:0/25604153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21f815b870 con 0x7f21f80cd3e0 2024-09-17T03:15:07.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.009+0000 7f21f4ff9640 1 -- 172.21.15.78:0/25604153 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0003da0 con 0x7f21f80cd3e0 2024-09-17T03:15:07.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.009+0000 7f21fe72b640 1 -- 172.21.15.78:0/25604153 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21f815be30 con 0x7f21f80cd3e0 2024-09-17T03:15:07.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.011+0000 7f21f4ff9640 1 -- 172.21.15.78:0/25604153 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f21f0003f40 con 0x7f21f80cd3e0 2024-09-17T03:15:07.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.011+0000 7f21f4ff9640 1 --2- 172.21.15.78:0/25604153 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f21e4078b90 0x7f21e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.011+0000 7f21f4ff9640 1 -- 172.21.15.78:0/25604153 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f21f009adc0 con 0x7f21f80cd3e0 2024-09-17T03:15:07.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.011+0000 7f21f7fff640 1 --2- 172.21.15.78:0/25604153 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f21e4078b90 0x7f21e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.012+0000 7f21f7fff640 1 --2- 172.21.15.78:0/25604153 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f21e4078b90 0x7f21e407b0a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f21e8033000 tx=0x7f21e8004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:07.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.012+0000 7f2205698740 1 Processor -- start 2024-09-17T03:15:07.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.012+0000 7f2205698740 1 -- start start 2024-09-17T03:15:07.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.013+0000 7f2205698740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c1703b390 0x563c17427a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.013+0000 7f2205698740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c170124d0 0x563c173fc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.013+0000 7f2205698740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c1701a6b0 0x563c173fcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.013+0000 7f2205698740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x563c17355a60 con 0x563c170124d0 2024-09-17T03:15:07.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.013+0000 7f2205698740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563c17344e90 con 0x563c1703b390 2024-09-17T03:15:07.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.013+0000 7f2205698740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x563c17348ca0 con 0x563c1701a6b0 2024-09-17T03:15:07.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.013+0000 7f21f77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c170124d0 0x563c173fc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.013+0000 7f21f7fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c1703b390 0x563c17427a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.013+0000 7f21f77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c170124d0 0x563c173fc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50520/0 (socket says 172.21.15.78:50520) 2024-09-17T03:15:07.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.013+0000 7f21f77fe640 1 -- 172.21.15.78:0/2537301226 learned_addr learned my addr 172.21.15.78:0/2537301226 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:07.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.013+0000 7f21fccc8640 1 --2- 172.21.15.78:0/2537301226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c1701a6b0 0x563c173fcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.013+0000 7f21f77fe640 1 -- 172.21.15.78:0/2537301226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c1701a6b0 msgr2=0x563c173fcda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:07.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.013+0000 7f21f77fe640 1 --2- 172.21.15.78:0/2537301226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c1701a6b0 0x563c173fcda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.014+0000 7f21f77fe640 1 -- 172.21.15.78:0/2537301226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c1703b390 msgr2=0x563c17427a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:07.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.014+0000 7f21f77fe640 1 --2- 172.21.15.78:0/2537301226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c1703b390 0x563c17427a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.014+0000 7f21f77fe640 1 -- 172.21.15.78:0/2537301226 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c1711d7d0 con 0x563c170124d0 2024-09-17T03:15:07.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.014+0000 7f21f77fe640 1 --2- 172.21.15.78:0/2537301226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c170124d0 0x563c173fc860 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f21ec0015a0 tx=0x7f21ec001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535f098abb5c3f4c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.014+0000 7f21ddffb640 1 -- 172.21.15.78:0/2537301226 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec019070 con 0x563c170124d0 2024-09-17T03:15:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.014+0000 7f21ddffb640 1 -- 172.21.15.78:0/2537301226 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21ec0050d0 con 0x563c170124d0 2024-09-17T03:15:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.014+0000 7f21ddffb640 1 -- 172.21.15.78:0/2537301226 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec005480 con 0x563c170124d0 2024-09-17T03:15:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.015+0000 7f2205698740 1 -- 172.21.15.78:0/2537301226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c170124d0 msgr2=0x563c173fc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.015+0000 7f2205698740 1 --2- 172.21.15.78:0/2537301226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c170124d0 0x563c173fc860 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f21ec0015a0 tx=0x7f21ec001a60 comp rx=0 tx=0).stop 2024-09-17T03:15:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.015+0000 7f2205698740 1 -- 172.21.15.78:0/2537301226 shutdown_connections 2024-09-17T03:15:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.015+0000 7f2205698740 1 --2- 172.21.15.78:0/2537301226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c1701a6b0 0x563c173fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.015+0000 7f2205698740 1 --2- 172.21.15.78:0/2537301226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c170124d0 0x563c173fc860 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.015+0000 7f2205698740 1 --2- 172.21.15.78:0/2537301226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c1703b390 0x563c17427a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.015+0000 7f2205698740 1 -- 172.21.15.78:0/2537301226 >> 172.21.15.78:0/2537301226 conn(0x563c1702f4e0 msgr2=0x563c173e2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.015+0000 7f2205698740 1 -- 172.21.15.78:0/2537301226 shutdown_connections 2024-09-17T03:15:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.015+0000 7f2205698740 1 -- 172.21.15.78:0/2537301226 wait complete. 2024-09-17T03:15:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.016+0000 7f2205698740 1 -- start start 2024-09-17T03:15:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.016+0000 7f2205698740 1 Processor -- start 2024-09-17T03:15:07.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.017+0000 7f2205698740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c170124d0 0x563c173f99d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.017+0000 7f2205698740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c1701a6b0 0x563c1741e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.017+0000 7f2205698740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c1703b390 0x563c1741eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.017+0000 7f2205698740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x563c170b5740 con 0x563c170124d0 2024-09-17T03:15:07.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.017+0000 7f2205698740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563c172ea970 con 0x563c1701a6b0 2024-09-17T03:15:07.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.017+0000 7f2205698740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x563c173fab20 con 0x563c1703b390 2024-09-17T03:15:07.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.017+0000 7f2205698740 10 client.0 _ll_register_callbacks cb 0x563c172f9780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:07.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.017+0000 7f21f7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c170124d0 0x563c173f99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.017+0000 7f21f7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c170124d0 0x563c173f99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50522/0 (socket says 172.21.15.78:50522) 2024-09-17T03:15:07.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.017+0000 7f21f7fff640 1 -- 172.21.15.78:0/1716072033 learned_addr learned my addr 172.21.15.78:0/1716072033 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.017+0000 7f21f77fe640 1 --2- 172.21.15.78:0/1716072033 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c1701a6b0 0x563c1741e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.017+0000 7f21fccc8640 1 --2- 172.21.15.78:0/1716072033 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c1703b390 0x563c1741eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f21f7fff640 1 -- 172.21.15.78:0/1716072033 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c1703b390 msgr2=0x563c1741eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f21f7fff640 1 --2- 172.21.15.78:0/1716072033 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c1703b390 0x563c1741eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f21f7fff640 1 -- 172.21.15.78:0/1716072033 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c1701a6b0 msgr2=0x563c1741e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f21f7fff640 1 --2- 172.21.15.78:0/1716072033 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c1701a6b0 0x563c1741e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f21f7fff640 1 -- 172.21.15.78:0/1716072033 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c170a6970 con 0x563c170124d0 2024-09-17T03:15:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f21f7fff640 1 --2- 172.21.15.78:0/1716072033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c170124d0 0x563c173f99d0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f21e802abc0 tx=0x7f21e8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac60e9146b4b9b6f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f21d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f21d6ffd640 1 -- 172.21.15.78:0/1716072033 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e804d020 con 0x563c170124d0 2024-09-17T03:15:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f21d6ffd640 1 -- 172.21.15.78:0/1716072033 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f21e8003d50 con 0x563c170124d0 2024-09-17T03:15:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f2205698740 1 -- 172.21.15.78:0/1716072033 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21ec0050d0 con 0x563c170124d0 2024-09-17T03:15:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f21d6ffd640 1 -- 172.21.15.78:0/1716072033 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f21e8057050 con 0x563c170124d0 2024-09-17T03:15:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f2205698740 10 client.8544 fetch_fsmap learned FSMap version 100 2024-09-17T03:15:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f2205698740 1 -- 172.21.15.78:0/1716072033 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x563c170846a0 con 0x563c170124d0 2024-09-17T03:15:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f21d6ffd640 1 -- 172.21.15.78:0/1716072033 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21ec0050d0 con 0x563c170124d0 2024-09-17T03:15:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f21d6ffd640 1 -- 172.21.15.78:0/1716072033 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 100) ==== 3554+0+0 (secure 0 0 0) 0x7f21e805a020 con 0x563c170124d0 2024-09-17T03:15:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f2205698740 10 client.8544 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T03:15:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f2205698740 10 client.8544 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2024-09-17T03:15:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f2205698740 20 client.8544 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f2205698740 1 --2- 172.21.15.78:0/1716072033 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x563c16ff9f60 0x563c1740b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f2205698740 4 client.8544 mds_command: new command op to 8283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.018+0000 7f2205698740 1 -- 172.21.15.78:0/1716072033 --> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c173579b0 con 0x563c16ff9f60 2024-09-17T03:15:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.019+0000 7f21f77fe640 1 --2- 172.21.15.78:0/1716072033 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x563c16ff9f60 0x563c1740b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.019+0000 7f21d6ffd640 10 client.8544 ms_handle_connect on v2:172.21.15.78:6832/1810198137 2024-09-17T03:15:07.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.019+0000 7f21f77fe640 1 --2- 172.21.15.78:0/1716072033 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x563c16ff9f60 0x563c1740b640 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=715b77d712c565ab server_cookie=18193783deb4be2 in_seq=0 out_seq=0 2024-09-17T03:15:07.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.020+0000 7f21d6ffd640 1 -- 172.21.15.78:0/1716072033 <== mds.1 v2:172.21.15.78:6832/1810198137 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563c173579b0 con 0x563c16ff9f60 2024-09-17T03:15:07.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.020+0000 7f21d6ffd640 10 client.8544 handle_command_reply: tid=0 2024-09-17T03:15:07.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.020+0000 7f2205698740 1 client.8544 shutdown 2024-09-17T03:15:07.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.020+0000 7f2205698740 1 -- 172.21.15.78:0/1716072033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c170124d0 msgr2=0x563c173f99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:07.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.020+0000 7f2205698740 1 --2- 172.21.15.78:0/1716072033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c170124d0 0x563c173f99d0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f21e802abc0 tx=0x7f21e8009260 comp rx=0 tx=0).stop 2024-09-17T03:15:07.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.020+0000 7f2205698740 1 -- 172.21.15.78:0/1716072033 shutdown_connections 2024-09-17T03:15:07.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.020+0000 7f2205698740 1 --2- 172.21.15.78:0/1716072033 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x563c16ff9f60 0x563c1740b640 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.020+0000 7f2205698740 1 --2- 172.21.15.78:0/1716072033 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c1703b390 0x563c1741eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.020+0000 7f2205698740 1 --2- 172.21.15.78:0/1716072033 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c1701a6b0 0x563c1741e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.020+0000 7f21d6ffd640 0 client.8544 ms_handle_reset on v2:172.21.15.78:6832/1810198137 2024-09-17T03:15:07.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.020+0000 7f2205698740 1 --2- 172.21.15.78:0/1716072033 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c170124d0 0x563c173f99d0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.020+0000 7f2205698740 1 -- 172.21.15.78:0/1716072033 >> 172.21.15.78:0/1716072033 conn(0x563c1702f4e0 msgr2=0x563c173dda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:07.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.020+0000 7f2205698740 1 -- 172.21.15.78:0/1716072033 shutdown_connections 2024-09-17T03:15:07.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.020+0000 7f2205698740 1 -- 172.21.15.78:0/1716072033 wait complete. 2024-09-17T03:15:07.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.020+0000 7f2205698740 20 client.8544 trim_cache size 0 max 16384 2024-09-17T03:15:07.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.035+0000 7f2205698740 1 Processor -- start 2024-09-17T03:15:07.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.035+0000 7f2205698740 1 -- start start 2024-09-17T03:15:07.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.036+0000 7f2205698740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c170124d0 0x563c173ddb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.036+0000 7f2205698740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c1701a6b0 0x563c173f9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.036+0000 7f2205698740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c1703b390 0x563c1740ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.036+0000 7f2205698740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f21f8200210 con 0x563c1701a6b0 2024-09-17T03:15:07.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.036+0000 7f2205698740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f21f81ff3e0 con 0x563c1703b390 2024-09-17T03:15:07.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.036+0000 7f2205698740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f21f81ffae0 con 0x563c170124d0 2024-09-17T03:15:07.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.036+0000 7f21f77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c1701a6b0 0x563c173f9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.036+0000 7f21f77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c1701a6b0 0x563c173f9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50532/0 (socket says 172.21.15.78:50532) 2024-09-17T03:15:07.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.036+0000 7f21f77fe640 1 -- 172.21.15.78:0/1822778695 learned_addr learned my addr 172.21.15.78:0/1822778695 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:07.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.036+0000 7f21f77fe640 1 -- 172.21.15.78:0/1822778695 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c170124d0 msgr2=0x563c173ddb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:07.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.036+0000 7f21f77fe640 1 --2- 172.21.15.78:0/1822778695 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c170124d0 0x563c173ddb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.036+0000 7f21f77fe640 1 -- 172.21.15.78:0/1822778695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c1703b390 msgr2=0x563c1740ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:07.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.037+0000 7f21f77fe640 1 --2- 172.21.15.78:0/1822778695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c1703b390 0x563c1740ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.037+0000 7f21f77fe640 1 -- 172.21.15.78:0/1822778695 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c17424280 con 0x563c1701a6b0 2024-09-17T03:15:07.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.037+0000 7f21f77fe640 1 --2- 172.21.15.78:0/1822778695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c1701a6b0 0x563c173f9640 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f21ec017040 tx=0x7f21ec000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56fed2918b93fbd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:07.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.037+0000 7f21dd7fa640 1 -- 172.21.15.78:0/1822778695 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec019040 con 0x563c1701a6b0 2024-09-17T03:15:07.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.037+0000 7f21dd7fa640 1 -- 172.21.15.78:0/1822778695 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21ec00ebb0 con 0x563c1701a6b0 2024-09-17T03:15:07.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.037+0000 7f21dd7fa640 1 -- 172.21.15.78:0/1822778695 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec005190 con 0x563c1701a6b0 2024-09-17T03:15:07.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.038+0000 7f2205698740 1 -- 172.21.15.78:0/1822778695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c1701a6b0 msgr2=0x563c173f9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:07.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.038+0000 7f2205698740 1 --2- 172.21.15.78:0/1822778695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c1701a6b0 0x563c173f9640 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f21ec017040 tx=0x7f21ec000bc0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.038+0000 7f2205698740 1 -- 172.21.15.78:0/1822778695 shutdown_connections 2024-09-17T03:15:07.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.038+0000 7f2205698740 1 --2- 172.21.15.78:0/1822778695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c1703b390 0x563c1740ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.038+0000 7f2205698740 1 --2- 172.21.15.78:0/1822778695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c1701a6b0 0x563c173f9640 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.038+0000 7f2205698740 1 --2- 172.21.15.78:0/1822778695 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c170124d0 0x563c173ddb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.038+0000 7f2205698740 1 -- 172.21.15.78:0/1822778695 >> 172.21.15.78:0/1822778695 conn(0x563c1702f4e0 msgr2=0x563c173e2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:07.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.038+0000 7f2205698740 1 -- 172.21.15.78:0/1822778695 shutdown_connections 2024-09-17T03:15:07.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.038+0000 7f2205698740 1 -- 172.21.15.78:0/1822778695 wait complete. 2024-09-17T03:15:07.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.038+0000 7f2205698740 1 -- start start 2024-09-17T03:15:07.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.039+0000 7f2205698740 1 Processor -- start 2024-09-17T03:15:07.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.040+0000 7f2205698740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c170124d0 0x563c1743ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.040+0000 7f2205698740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c1701a6b0 0x563c174a6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.040+0000 7f2205698740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c1703b390 0x563c174a7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.040+0000 7f2205698740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x563c17424870 con 0x563c1701a6b0 2024-09-17T03:15:07.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.040+0000 7f2205698740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f21f8159f30 con 0x563c1703b390 2024-09-17T03:15:07.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.040+0000 7f2205698740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x563c174a6a90 con 0x563c170124d0 2024-09-17T03:15:07.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.040+0000 7f2205698740 10 client.0 _ll_register_callbacks cb 0x7f21e8009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:07.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.040+0000 7f21f77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c1701a6b0 0x563c174a6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.040+0000 7f21f77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c1701a6b0 0x563c174a6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50548/0 (socket says 172.21.15.78:50548) 2024-09-17T03:15:07.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.040+0000 7f21f77fe640 1 -- 172.21.15.78:0/1796327016 learned_addr learned my addr 172.21.15.78:0/1796327016 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:07.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.040+0000 7f21f7fff640 1 --2- 172.21.15.78:0/1796327016 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c170124d0 0x563c1743ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.040+0000 7f21fccc8640 1 --2- 172.21.15.78:0/1796327016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c1703b390 0x563c174a7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.040+0000 7f21f77fe640 1 -- 172.21.15.78:0/1796327016 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c170124d0 msgr2=0x563c1743ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:07.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.040+0000 7f21f77fe640 1 --2- 172.21.15.78:0/1796327016 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c170124d0 0x563c1743ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.040+0000 7f21f77fe640 1 -- 172.21.15.78:0/1796327016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c1703b390 msgr2=0x563c174a7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:07.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.040+0000 7f21f77fe640 1 --2- 172.21.15.78:0/1796327016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c1703b390 0x563c174a7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.040+0000 7f21f77fe640 1 -- 172.21.15.78:0/1796327016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c1740ba40 con 0x563c1701a6b0 2024-09-17T03:15:07.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.040+0000 7f21fccc8640 1 --2- 172.21.15.78:0/1796327016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c1703b390 0x563c174a7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:07.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.041+0000 7f21f77fe640 1 --2- 172.21.15.78:0/1796327016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c1701a6b0 0x563c174a6ff0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009010 tx=0x7f21ec005210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf42224e20d28cc server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:07.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.041+0000 7f21d6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:07.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.041+0000 7f21d6ffd640 1 -- 172.21.15.78:0/1796327016 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21ec019040 con 0x563c1701a6b0 2024-09-17T03:15:07.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.041+0000 7f21d6ffd640 1 -- 172.21.15.78:0/1796327016 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f21ec0069d0 con 0x563c1701a6b0 2024-09-17T03:15:07.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.041+0000 7f2205698740 1 -- 172.21.15.78:0/1796327016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21ec00ebb0 con 0x563c1701a6b0 2024-09-17T03:15:07.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.041+0000 7f21d6ffd640 1 -- 172.21.15.78:0/1796327016 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f21ec034050 con 0x563c1701a6b0 2024-09-17T03:15:07.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.041+0000 7f2205698740 10 client.8550 fetch_fsmap learned FSMap version 100 2024-09-17T03:15:07.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.041+0000 7f2205698740 1 -- 172.21.15.78:0/1796327016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x563c173dc380 con 0x563c1701a6b0 2024-09-17T03:15:07.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.041+0000 7f21d6ffd640 1 -- 172.21.15.78:0/1796327016 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21ec00ebb0 con 0x563c1701a6b0 2024-09-17T03:15:07.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.041+0000 7f21d6ffd640 1 -- 172.21.15.78:0/1796327016 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 100) ==== 3554+0+0 (secure 0 0 0) 0x7f21ec006bd0 con 0x563c1701a6b0 2024-09-17T03:15:07.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.041+0000 7f2205698740 10 client.8550 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T03:15:07.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.041+0000 7f2205698740 10 client.8550 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2024-09-17T03:15:07.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.041+0000 7f2205698740 20 client.8550 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:07.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.041+0000 7f2205698740 1 --2- 172.21.15.78:0/1796327016 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x563c174aa010 0x563c174aa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.041+0000 7f2205698740 4 client.8550 mds_command: new command op to 8283 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T03:15:07.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.041+0000 7f2205698740 1 -- 172.21.15.78:0/1796327016 --> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563c17353460 con 0x563c174aa010 2024-09-17T03:15:07.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.041+0000 7f21f7fff640 1 --2- 172.21.15.78:0/1796327016 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x563c174aa010 0x563c174aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.042+0000 7f21d6ffd640 10 client.8550 ms_handle_connect on v2:172.21.15.78:6832/1810198137 2024-09-17T03:15:07.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.042+0000 7f21f7fff640 1 --2- 172.21.15.78:0/1796327016 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x563c174aa010 0x563c174aa420 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=85366a715a34ebd9 server_cookie=7231cf04ff5723d3 in_seq=0 out_seq=0 2024-09-17T03:15:07.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.051+0000 7f21d6ffd640 1 -- 172.21.15.78:0/1796327016 <== mds.1 v2:172.21.15.78:6832/1810198137 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563c17353460 con 0x563c174aa010 2024-09-17T03:15:07.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.051+0000 7f21d6ffd640 10 client.8550 handle_command_reply: tid=0 2024-09-17T03:15:07.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.051+0000 7f2205698740 1 client.8550 shutdown 2024-09-17T03:15:07.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.051+0000 7f2205698740 1 -- 172.21.15.78:0/1796327016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c1701a6b0 msgr2=0x563c174a6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:07.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.051+0000 7f2205698740 1 --2- 172.21.15.78:0/1796327016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c1701a6b0 0x563c174a6ff0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f21ec009010 tx=0x7f21ec005210 comp rx=0 tx=0).stop 2024-09-17T03:15:07.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.051+0000 7f2205698740 1 -- 172.21.15.78:0/1796327016 shutdown_connections 2024-09-17T03:15:07.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.051+0000 7f2205698740 1 --2- 172.21.15.78:0/1796327016 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x563c174aa010 0x563c174aa420 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.051+0000 7f2205698740 1 --2- 172.21.15.78:0/1796327016 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563c1703b390 0x563c174a7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.051+0000 7f2205698740 1 --2- 172.21.15.78:0/1796327016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563c1701a6b0 0x563c174a6ff0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.051+0000 7f2205698740 1 --2- 172.21.15.78:0/1796327016 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563c170124d0 0x563c1743ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.051+0000 7f21d6ffd640 0 client.8550 ms_handle_reset on v2:172.21.15.78:6832/1810198137 2024-09-17T03:15:07.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.051+0000 7f2205698740 1 -- 172.21.15.78:0/1796327016 >> 172.21.15.78:0/1796327016 conn(0x563c1702f4e0 msgr2=0x563c1740c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:07.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.051+0000 7f2205698740 1 -- 172.21.15.78:0/1796327016 shutdown_connections 2024-09-17T03:15:07.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.051+0000 7f2205698740 1 -- 172.21.15.78:0/1796327016 wait complete. 2024-09-17T03:15:07.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.051+0000 7f2205698740 20 client.8550 trim_cache size 0 max 16384 2024-09-17T03:15:07.052 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:07.052 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:15:07.052 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:15:07.052 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:07.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.052+0000 7f21fe72b640 1 -- 172.21.15.78:0/25604153 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f21e4078b90 msgr2=0x7f21e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:07.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.052+0000 7f21fe72b640 1 --2- 172.21.15.78:0/25604153 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f21e4078b90 0x7f21e407b0a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f21e8033000 tx=0x7f21e8004730 comp rx=0 tx=0).stop 2024-09-17T03:15:07.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.052+0000 7f21fe72b640 1 -- 172.21.15.78:0/25604153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21f80cd3e0 msgr2=0x7f21f809ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:07.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.052+0000 7f21fe72b640 1 --2- 172.21.15.78:0/25604153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21f80cd3e0 0x7f21f809ca10 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f21f000dac0 tx=0x7f21f000df80 comp rx=0 tx=0).stop 2024-09-17T03:15:07.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.052+0000 7f21fe72b640 1 -- 172.21.15.78:0/25604153 shutdown_connections 2024-09-17T03:15:07.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.052+0000 7f21fe72b640 1 --2- 172.21.15.78:0/25604153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21f80cd3e0 0x7f21f809ca10 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.052+0000 7f21fe72b640 1 --2- 172.21.15.78:0/25604153 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f21e4078b90 0x7f21e407b0a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.052+0000 7f21fe72b640 1 --2- 172.21.15.78:0/25604153 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f21f80af780 0x7f21f814ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.052+0000 7f21fe72b640 1 --2- 172.21.15.78:0/25604153 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f21f8072ff0 0x7f21f81e4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.052+0000 7f21fe72b640 1 -- 172.21.15.78:0/25604153 >> 172.21.15.78:0/25604153 conn(0x7f21f806d7d0 msgr2=0x7f21f80b1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:07.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.052+0000 7f21fe72b640 1 -- 172.21.15.78:0/25604153 shutdown_connections 2024-09-17T03:15:07.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.052+0000 7f21fe72b640 1 -- 172.21.15.78:0/25604153 wait complete. 2024-09-17T03:15:07.062 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:2 flush journal 2024-09-17T03:15:07.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.177+0000 7fdd43a4d640 1 -- 172.21.15.78:0/2536674636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd3c0d2460 msgr2=0x7fdd3c15d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:07.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.177+0000 7fdd43a4d640 1 --2- 172.21.15.78:0/2536674636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd3c0d2460 0x7fdd3c15d130 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c074b10 tx=0x7fdd3002a560 comp rx=0 tx=0).stop 2024-09-17T03:15:07.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.177+0000 7fdd43a4d640 1 -- 172.21.15.78:0/2536674636 shutdown_connections 2024-09-17T03:15:07.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.177+0000 7fdd43a4d640 1 --2- 172.21.15.78:0/2536674636 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd3c0d2460 0x7fdd3c15d130 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.177+0000 7fdd43a4d640 1 --2- 172.21.15.78:0/2536674636 >> v2:172.21.15.193:3300/0 conn(0x7fdd3c1570e0 0x7fdd3c0d1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.177+0000 7fdd43a4d640 1 -- 172.21.15.78:0/2536674636 >> 172.21.15.78:0/2536674636 conn(0x7fdd3c06d550 msgr2=0x7fdd3c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:07.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.177+0000 7fdd43a4d640 1 -- 172.21.15.78:0/2536674636 shutdown_connections 2024-09-17T03:15:07.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.177+0000 7fdd43a4d640 1 -- 172.21.15.78:0/2536674636 wait complete. 2024-09-17T03:15:07.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.179+0000 7fdd43a4d640 1 Processor -- start 2024-09-17T03:15:07.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.179+0000 7fdd43a4d640 1 -- start start 2024-09-17T03:15:07.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.180+0000 7fdd43a4d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd3c0d2460 0x7fdd3c0ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.180+0000 7fdd43a4d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd3c1570e0 0x7fdd3c14e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.180+0000 7fdd43a4d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd3c15d670 0x7fdd3c0c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.180+0000 7fdd43a4d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c0b7d20 con 0x7fdd3c15d670 2024-09-17T03:15:07.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.180+0000 7fdd43a4d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c0b7ba0 con 0x7fdd3c1570e0 2024-09-17T03:15:07.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.180+0000 7fdd43a4d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fdd3c0b7ea0 con 0x7fdd3c0d2460 2024-09-17T03:15:07.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.180+0000 7fdd41fea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd3c15d670 0x7fdd3c0c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.181+0000 7fdd41fea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd3c15d670 0x7fdd3c0c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50564/0 (socket says 172.21.15.78:50564) 2024-09-17T03:15:07.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.181+0000 7fdd41fea640 1 -- 172.21.15.78:0/3948441861 learned_addr learned my addr 172.21.15.78:0/3948441861 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:07.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.181+0000 7fdd40fe8640 1 --2- 172.21.15.78:0/3948441861 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd3c1570e0 0x7fdd3c14e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.181+0000 7fdd417e9640 1 --2- 172.21.15.78:0/3948441861 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd3c0d2460 0x7fdd3c0ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.181+0000 7fdd41fea640 1 -- 172.21.15.78:0/3948441861 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd3c0d2460 msgr2=0x7fdd3c0ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:07.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.181+0000 7fdd41fea640 1 --2- 172.21.15.78:0/3948441861 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd3c0d2460 0x7fdd3c0ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.181+0000 7fdd41fea640 1 -- 172.21.15.78:0/3948441861 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd3c1570e0 msgr2=0x7fdd3c14e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:07.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.181+0000 7fdd41fea640 1 --2- 172.21.15.78:0/3948441861 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd3c1570e0 0x7fdd3c14e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.181+0000 7fdd41fea640 1 -- 172.21.15.78:0/3948441861 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3c0b4480 con 0x7fdd3c15d670 2024-09-17T03:15:07.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.181+0000 7fdd41fea640 1 --2- 172.21.15.78:0/3948441861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd3c15d670 0x7fdd3c0c93b0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400b410 tx=0x7fdd3400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:07.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.181+0000 7fdd39ffb640 1 -- 172.21.15.78:0/3948441861 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34015020 con 0x7fdd3c15d670 2024-09-17T03:15:07.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.181+0000 7fdd39ffb640 1 -- 172.21.15.78:0/3948441861 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd34011920 con 0x7fdd3c15d670 2024-09-17T03:15:07.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.181+0000 7fdd43a4d640 1 -- 172.21.15.78:0/3948441861 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd3c1f3fc0 con 0x7fdd3c15d670 2024-09-17T03:15:07.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.181+0000 7fdd39ffb640 1 -- 172.21.15.78:0/3948441861 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34011d70 con 0x7fdd3c15d670 2024-09-17T03:15:07.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.181+0000 7fdd43a4d640 1 -- 172.21.15.78:0/3948441861 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd3c0b2b10 con 0x7fdd3c15d670 2024-09-17T03:15:07.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.183+0000 7fdd39ffb640 1 -- 172.21.15.78:0/3948441861 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdd34018020 con 0x7fdd3c15d670 2024-09-17T03:15:07.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.184+0000 7fdd39ffb640 1 --2- 172.21.15.78:0/3948441861 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdd28078b90 0x7fdd2807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.184+0000 7fdd39ffb640 1 -- 172.21.15.78:0/3948441861 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fdd3409aaa0 con 0x7fdd3c15d670 2024-09-17T03:15:07.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.184+0000 7fdd417e9640 1 --2- 172.21.15.78:0/3948441861 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdd28078b90 0x7fdd2807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.185+0000 7fdd417e9640 1 --2- 172.21.15.78:0/3948441861 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdd28078b90 0x7fdd2807b0a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c005c40 tx=0x7fdd2c00a530 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:07.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.185+0000 7fdd4a5fd740 1 Processor -- start 2024-09-17T03:15:07.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.185+0000 7fdd4a5fd740 1 -- start start 2024-09-17T03:15:07.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.186+0000 7fdd4a5fd740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556c8f739390 0x556c8fb25a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.186+0000 7fdd4a5fd740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f7104d0 0x556c8fafa860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.186+0000 7fdd4a5fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c8f7186b0 0x556c8fafada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.186+0000 7fdd4a5fd740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x556c8fa53a60 con 0x556c8f7104d0 2024-09-17T03:15:07.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.186+0000 7fdd4a5fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556c8fa42e90 con 0x556c8f7186b0 2024-09-17T03:15:07.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.186+0000 7fdd4a5fd740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x556c8fa46ca0 con 0x556c8f739390 2024-09-17T03:15:07.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.186+0000 7fdd40fe8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f7104d0 0x556c8fafa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.186+0000 7fdd40fe8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f7104d0 0x556c8fafa860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50574/0 (socket says 172.21.15.78:50574) 2024-09-17T03:15:07.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.186+0000 7fdd40fe8640 1 -- 172.21.15.78:0/884955440 learned_addr learned my addr 172.21.15.78:0/884955440 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:07.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.186+0000 7fdd417e9640 1 --2- 172.21.15.78:0/884955440 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556c8f739390 0x556c8fb25a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.186+0000 7fdd41fea640 1 --2- 172.21.15.78:0/884955440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c8f7186b0 0x556c8fafada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.186+0000 7fdd40fe8640 1 -- 172.21.15.78:0/884955440 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556c8f739390 msgr2=0x556c8fb25a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:07.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.186+0000 7fdd40fe8640 1 --2- 172.21.15.78:0/884955440 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556c8f739390 0x556c8fb25a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.186+0000 7fdd40fe8640 1 -- 172.21.15.78:0/884955440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c8f7186b0 msgr2=0x556c8fafada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:07.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.186+0000 7fdd40fe8640 1 --2- 172.21.15.78:0/884955440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c8f7186b0 0x556c8fafada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.186+0000 7fdd40fe8640 1 -- 172.21.15.78:0/884955440 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c8f81b7d0 con 0x556c8f7104d0 2024-09-17T03:15:07.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.187+0000 7fdd40fe8640 1 --2- 172.21.15.78:0/884955440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f7104d0 0x556c8fafa860 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fdd300099c0 tx=0x7fdd300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1faf5f87e6949777 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:07.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.187+0000 7fdd22ffd640 1 -- 172.21.15.78:0/884955440 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30035040 con 0x556c8f7104d0 2024-09-17T03:15:07.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.187+0000 7fdd22ffd640 1 -- 172.21.15.78:0/884955440 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd30004330 con 0x556c8f7104d0 2024-09-17T03:15:07.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.187+0000 7fdd22ffd640 1 -- 172.21.15.78:0/884955440 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30003850 con 0x556c8f7104d0 2024-09-17T03:15:07.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.188+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/884955440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f7104d0 msgr2=0x556c8fafa860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:07.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.188+0000 7fdd4a5fd740 1 --2- 172.21.15.78:0/884955440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f7104d0 0x556c8fafa860 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fdd300099c0 tx=0x7fdd300046c0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.188+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/884955440 shutdown_connections 2024-09-17T03:15:07.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.188+0000 7fdd4a5fd740 1 --2- 172.21.15.78:0/884955440 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c8f7186b0 0x556c8fafada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.188+0000 7fdd4a5fd740 1 --2- 172.21.15.78:0/884955440 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f7104d0 0x556c8fafa860 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.188+0000 7fdd4a5fd740 1 --2- 172.21.15.78:0/884955440 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556c8f739390 0x556c8fb25a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.188+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/884955440 >> 172.21.15.78:0/884955440 conn(0x556c8f72d4e0 msgr2=0x556c8fae0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:07.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.188+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/884955440 shutdown_connections 2024-09-17T03:15:07.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.188+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/884955440 wait complete. 2024-09-17T03:15:07.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.188+0000 7fdd4a5fd740 1 -- start start 2024-09-17T03:15:07.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.189+0000 7fdd4a5fd740 1 Processor -- start 2024-09-17T03:15:07.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.190+0000 7fdd4a5fd740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556c8f7104d0 0x556c8fae90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.190+0000 7fdd4a5fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c8f7186b0 0x556c8fb34bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.190+0000 7fdd4a5fd740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f739390 0x556c8fb1f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.190+0000 7fdd4a5fd740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x556c8f7b3740 con 0x556c8f739390 2024-09-17T03:15:07.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.190+0000 7fdd4a5fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556c8f9e8970 con 0x556c8f7186b0 2024-09-17T03:15:07.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.190+0000 7fdd4a5fd740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x556c8fb1c060 con 0x556c8f7104d0 2024-09-17T03:15:07.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.190+0000 7fdd4a5fd740 10 client.0 _ll_register_callbacks cb 0x556c8f9f7780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:07.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.190+0000 7fdd41fea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f739390 0x556c8fb1f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.190+0000 7fdd41fea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f739390 0x556c8fb1f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50582/0 (socket says 172.21.15.78:50582) 2024-09-17T03:15:07.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.190+0000 7fdd41fea640 1 -- 172.21.15.78:0/3313415555 learned_addr learned my addr 172.21.15.78:0/3313415555 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:07.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.190+0000 7fdd417e9640 1 --2- 172.21.15.78:0/3313415555 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556c8f7104d0 0x556c8fae90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.190+0000 7fdd40fe8640 1 --2- 172.21.15.78:0/3313415555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c8f7186b0 0x556c8fb34bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.190+0000 7fdd41fea640 1 -- 172.21.15.78:0/3313415555 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556c8f7104d0 msgr2=0x556c8fae90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:07.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.190+0000 7fdd41fea640 1 --2- 172.21.15.78:0/3313415555 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556c8f7104d0 0x556c8fae90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.190+0000 7fdd41fea640 1 -- 172.21.15.78:0/3313415555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c8f7186b0 msgr2=0x556c8fb34bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:07.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.190+0000 7fdd41fea640 1 --2- 172.21.15.78:0/3313415555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c8f7186b0 0x556c8fb34bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.190+0000 7fdd41fea640 1 -- 172.21.15.78:0/3313415555 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c8f7a4970 con 0x556c8f739390 2024-09-17T03:15:07.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.191+0000 7fdd41fea640 1 --2- 172.21.15.78:0/3313415555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f739390 0x556c8fb1f100 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fdd34098ff0 tx=0x7fdd34062430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14301651f152c010 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:07.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.191+0000 7fdd1bfff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:07.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.191+0000 7fdd1bfff640 1 -- 172.21.15.78:0/3313415555 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd34088070 con 0x556c8f739390 2024-09-17T03:15:07.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.191+0000 7fdd1bfff640 1 -- 172.21.15.78:0/3313415555 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fdd34061b80 con 0x556c8f739390 2024-09-17T03:15:07.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.191+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/3313415555 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd30004330 con 0x556c8f739390 2024-09-17T03:15:07.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.191+0000 7fdd1bfff640 1 -- 172.21.15.78:0/3313415555 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7fdd34083050 con 0x556c8f739390 2024-09-17T03:15:07.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.191+0000 7fdd4a5fd740 10 client.8562 fetch_fsmap learned FSMap version 100 2024-09-17T03:15:07.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.191+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/3313415555 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x556c8f7826a0 con 0x556c8f739390 2024-09-17T03:15:07.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.191+0000 7fdd1bfff640 1 -- 172.21.15.78:0/3313415555 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd30004330 con 0x556c8f739390 2024-09-17T03:15:07.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.191+0000 7fdd1bfff640 1 -- 172.21.15.78:0/3313415555 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 100) ==== 3554+0+0 (secure 0 0 0) 0x7fdd3405e270 con 0x556c8f739390 2024-09-17T03:15:07.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.191+0000 7fdd4a5fd740 10 client.8562 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T03:15:07.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.191+0000 7fdd4a5fd740 10 client.8562 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.d 2024-09-17T03:15:07.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.191+0000 7fdd4a5fd740 20 client.8562 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:07.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.191+0000 7fdd4a5fd740 1 --2- 172.21.15.78:0/3313415555 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x556c8f6f7f60 0x556c8fb23290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.191+0000 7fdd4a5fd740 4 client.8562 mds_command: new command op to 7213 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:07.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.191+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/3313415555 --> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556c8fa559b0 con 0x556c8f6f7f60 2024-09-17T03:15:07.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.191+0000 7fdd417e9640 1 --2- 172.21.15.78:0/3313415555 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x556c8f6f7f60 0x556c8fb23290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.192+0000 7fdd1bfff640 10 client.8562 ms_handle_connect on v2:172.21.15.193:6835/2983826871 2024-09-17T03:15:07.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.192+0000 7fdd417e9640 1 --2- 172.21.15.78:0/3313415555 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x556c8f6f7f60 0x556c8fb23290 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=adbc9f15bdf0bc1d server_cookie=89471b2b9177756e in_seq=0 out_seq=0 2024-09-17T03:15:07.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.193+0000 7fdd1bfff640 1 -- 172.21.15.78:0/3313415555 <== mds.2 v2:172.21.15.193:6835/2983826871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556c8fa559b0 con 0x556c8f6f7f60 2024-09-17T03:15:07.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.193+0000 7fdd1bfff640 10 client.8562 handle_command_reply: tid=0 2024-09-17T03:15:07.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.193+0000 7fdd4a5fd740 1 client.8562 shutdown 2024-09-17T03:15:07.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.193+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/3313415555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f739390 msgr2=0x556c8fb1f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:07.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.193+0000 7fdd4a5fd740 1 --2- 172.21.15.78:0/3313415555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f739390 0x556c8fb1f100 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fdd34098ff0 tx=0x7fdd34062430 comp rx=0 tx=0).stop 2024-09-17T03:15:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.193+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/3313415555 shutdown_connections 2024-09-17T03:15:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.193+0000 7fdd4a5fd740 1 --2- 172.21.15.78:0/3313415555 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x556c8f6f7f60 0x556c8fb23290 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.193+0000 7fdd4a5fd740 1 --2- 172.21.15.78:0/3313415555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f739390 0x556c8fb1f100 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.193+0000 7fdd1bfff640 0 client.8562 ms_handle_reset on v2:172.21.15.193:6835/2983826871 2024-09-17T03:15:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.193+0000 7fdd4a5fd740 1 --2- 172.21.15.78:0/3313415555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c8f7186b0 0x556c8fb34bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.193+0000 7fdd4a5fd740 1 --2- 172.21.15.78:0/3313415555 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556c8f7104d0 0x556c8fae90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.193+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/3313415555 >> 172.21.15.78:0/3313415555 conn(0x556c8f72d4e0 msgr2=0x556c8fafacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.193+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/3313415555 shutdown_connections 2024-09-17T03:15:07.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.193+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/3313415555 wait complete. 2024-09-17T03:15:07.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.193+0000 7fdd4a5fd740 20 client.8562 trim_cache size 0 max 16384 2024-09-17T03:15:07.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.208+0000 7fdd4a5fd740 1 Processor -- start 2024-09-17T03:15:07.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.208+0000 7fdd4a5fd740 1 -- start start 2024-09-17T03:15:07.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.209+0000 7fdd4a5fd740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556c8f6f7f60 0x556c8fb48e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.209+0000 7fdd4a5fd740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f7104d0 0x556c8fb1e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.209+0000 7fdd4a5fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c8f7186b0 0x556c8fb1eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.209+0000 7fdd4a5fd740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c2000a0 con 0x556c8f7104d0 2024-09-17T03:15:07.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.209+0000 7fdd4a5fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c1f7f10 con 0x556c8f7186b0 2024-09-17T03:15:07.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.209+0000 7fdd4a5fd740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fdd3c1ff970 con 0x556c8f6f7f60 2024-09-17T03:15:07.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.209+0000 7fdd40fe8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f7104d0 0x556c8fb1e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.209+0000 7fdd40fe8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f7104d0 0x556c8fb1e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50588/0 (socket says 172.21.15.78:50588) 2024-09-17T03:15:07.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.209+0000 7fdd40fe8640 1 -- 172.21.15.78:0/3677721621 learned_addr learned my addr 172.21.15.78:0/3677721621 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:07.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.209+0000 7fdd41fea640 1 --2- 172.21.15.78:0/3677721621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c8f7186b0 0x556c8fb1eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.210+0000 7fdd417e9640 1 --2- 172.21.15.78:0/3677721621 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556c8f6f7f60 0x556c8fb48e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.210+0000 7fdd40fe8640 1 -- 172.21.15.78:0/3677721621 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556c8f6f7f60 msgr2=0x556c8fb48e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:07.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.210+0000 7fdd40fe8640 1 --2- 172.21.15.78:0/3677721621 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556c8f6f7f60 0x556c8fb48e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.210+0000 7fdd40fe8640 1 -- 172.21.15.78:0/3677721621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c8f7186b0 msgr2=0x556c8fb1eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:07.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.210+0000 7fdd40fe8640 1 --2- 172.21.15.78:0/3677721621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c8f7186b0 0x556c8fb1eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.210+0000 7fdd40fe8640 1 -- 172.21.15.78:0/3677721621 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556c8fb34f40 con 0x556c8f7104d0 2024-09-17T03:15:07.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.210+0000 7fdd40fe8640 1 --2- 172.21.15.78:0/3677721621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f7104d0 0x556c8fb1e9a0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fdd30000c00 tx=0x7fdd30009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133b7f880175cab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:07.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.210+0000 7fdd227fc640 1 -- 172.21.15.78:0/3677721621 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30035040 con 0x556c8f7104d0 2024-09-17T03:15:07.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.210+0000 7fdd227fc640 1 -- 172.21.15.78:0/3677721621 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd30004330 con 0x556c8f7104d0 2024-09-17T03:15:07.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.210+0000 7fdd227fc640 1 -- 172.21.15.78:0/3677721621 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd30004a00 con 0x556c8f7104d0 2024-09-17T03:15:07.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.211+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/3677721621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f7104d0 msgr2=0x556c8fb1e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:07.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.211+0000 7fdd4a5fd740 1 --2- 172.21.15.78:0/3677721621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f7104d0 0x556c8fb1e9a0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fdd30000c00 tx=0x7fdd30009260 comp rx=0 tx=0).stop 2024-09-17T03:15:07.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.211+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/3677721621 shutdown_connections 2024-09-17T03:15:07.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.211+0000 7fdd4a5fd740 1 --2- 172.21.15.78:0/3677721621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c8f7186b0 0x556c8fb1eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.211+0000 7fdd4a5fd740 1 --2- 172.21.15.78:0/3677721621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f7104d0 0x556c8fb1e9a0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.211+0000 7fdd4a5fd740 1 --2- 172.21.15.78:0/3677721621 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556c8f6f7f60 0x556c8fb48e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.211+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/3677721621 >> 172.21.15.78:0/3677721621 conn(0x556c8f72d4e0 msgr2=0x556c8fae8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:07.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.211+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/3677721621 shutdown_connections 2024-09-17T03:15:07.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.211+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/3677721621 wait complete. 2024-09-17T03:15:07.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.211+0000 7fdd4a5fd740 1 -- start start 2024-09-17T03:15:07.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.212+0000 7fdd4a5fd740 1 Processor -- start 2024-09-17T03:15:07.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.213+0000 7fdd4a5fd740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f6f7f60 0x556c8fba42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.213+0000 7fdd4a5fd740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556c8f7104d0 0x556c8fb25460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.213+0000 7fdd4a5fd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c8f7186b0 0x556c8fba8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.213+0000 7fdd4a5fd740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x556c8fb27560 con 0x556c8f6f7f60 2024-09-17T03:15:07.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.213+0000 7fdd4a5fd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c0b28a0 con 0x556c8f7186b0 2024-09-17T03:15:07.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.213+0000 7fdd4a5fd740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x556c8fb26af0 con 0x556c8f7104d0 2024-09-17T03:15:07.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.213+0000 7fdd4a5fd740 10 client.0 _ll_register_callbacks cb 0x7fdd34062090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:07.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.213+0000 7fdd417e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f6f7f60 0x556c8fba42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.213+0000 7fdd417e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f6f7f60 0x556c8fba42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50594/0 (socket says 172.21.15.78:50594) 2024-09-17T03:15:07.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.213+0000 7fdd417e9640 1 -- 172.21.15.78:0/2913971234 learned_addr learned my addr 172.21.15.78:0/2913971234 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:07.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.213+0000 7fdd41fea640 1 --2- 172.21.15.78:0/2913971234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c8f7186b0 0x556c8fba8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.213+0000 7fdd40fe8640 1 --2- 172.21.15.78:0/2913971234 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556c8f7104d0 0x556c8fb25460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.213+0000 7fdd417e9640 1 -- 172.21.15.78:0/2913971234 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556c8f7104d0 msgr2=0x556c8fb25460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:07.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.213+0000 7fdd417e9640 1 --2- 172.21.15.78:0/2913971234 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556c8f7104d0 0x556c8fb25460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.213+0000 7fdd417e9640 1 -- 172.21.15.78:0/2913971234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c8f7186b0 msgr2=0x556c8fba8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:07.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.213+0000 7fdd417e9640 1 --2- 172.21.15.78:0/2913971234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c8f7186b0 0x556c8fba8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.213+0000 7fdd417e9640 1 -- 172.21.15.78:0/2913971234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556c8fba8c60 con 0x556c8f6f7f60 2024-09-17T03:15:07.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.214+0000 7fdd417e9640 1 --2- 172.21.15.78:0/2913971234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f6f7f60 0x556c8fba42b0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00fc20 tx=0x7fdd2c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d723c13f7c606d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:07.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.214+0000 7fdd1bfff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:07.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.214+0000 7fdd1bfff640 1 -- 172.21.15.78:0/2913971234 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c016070 con 0x556c8f6f7f60 2024-09-17T03:15:07.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.214+0000 7fdd1bfff640 1 -- 172.21.15.78:0/2913971234 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fdd2c0203a0 con 0x556c8f6f7f60 2024-09-17T03:15:07.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.214+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/2913971234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd30004330 con 0x556c8f6f7f60 2024-09-17T03:15:07.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.214+0000 7fdd1bfff640 1 -- 172.21.15.78:0/2913971234 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7fdd2c037050 con 0x556c8f6f7f60 2024-09-17T03:15:07.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.214+0000 7fdd4a5fd740 10 client.8568 fetch_fsmap learned FSMap version 100 2024-09-17T03:15:07.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.214+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/2913971234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x556c8fb24e00 con 0x556c8f6f7f60 2024-09-17T03:15:07.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.214+0000 7fdd1bfff640 1 -- 172.21.15.78:0/2913971234 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdd30004330 con 0x556c8f6f7f60 2024-09-17T03:15:07.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.214+0000 7fdd1bfff640 1 -- 172.21.15.78:0/2913971234 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 100) ==== 3554+0+0 (secure 0 0 0) 0x7fdd2c03a020 con 0x556c8f6f7f60 2024-09-17T03:15:07.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.214+0000 7fdd4a5fd740 10 client.8568 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T03:15:07.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.214+0000 7fdd4a5fd740 10 client.8568 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.d 2024-09-17T03:15:07.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.214+0000 7fdd4a5fd740 20 client.8568 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:07.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.214+0000 7fdd4a5fd740 1 --2- 172.21.15.78:0/2913971234 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x556c8f6cd3a0 0x556c8fad9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:07.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.214+0000 7fdd4a5fd740 4 client.8568 mds_command: new command op to 7213 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-17T03:15:07.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.214+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/2913971234 --> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] -- command(tid 0: {"prefix": "flush journal"}) -- 0x556c8fa51460 con 0x556c8f6cd3a0 2024-09-17T03:15:07.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.214+0000 7fdd40fe8640 1 --2- 172.21.15.78:0/2913971234 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x556c8f6cd3a0 0x556c8fad9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:07.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.215+0000 7fdd1bfff640 10 client.8568 ms_handle_connect on v2:172.21.15.193:6835/2983826871 2024-09-17T03:15:07.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.215+0000 7fdd40fe8640 1 --2- 172.21.15.78:0/2913971234 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x556c8f6cd3a0 0x556c8fad9dd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=41c0eae8b9fa2ac0 server_cookie=59dcf04188d05a35 in_seq=0 out_seq=0 2024-09-17T03:15:07.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.221+0000 7fdd1bfff640 1 -- 172.21.15.78:0/2913971234 <== mds.2 v2:172.21.15.193:6835/2983826871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x556c8fa51460 con 0x556c8f6cd3a0 2024-09-17T03:15:07.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.221+0000 7fdd1bfff640 10 client.8568 handle_command_reply: tid=0 2024-09-17T03:15:07.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.221+0000 7fdd4a5fd740 1 client.8568 shutdown 2024-09-17T03:15:07.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.221+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/2913971234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f6f7f60 msgr2=0x556c8fba42b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:07.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.221+0000 7fdd4a5fd740 1 --2- 172.21.15.78:0/2913971234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f6f7f60 0x556c8fba42b0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00fc20 tx=0x7fdd2c004ab0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.221+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/2913971234 shutdown_connections 2024-09-17T03:15:07.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.221+0000 7fdd4a5fd740 1 --2- 172.21.15.78:0/2913971234 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x556c8f6cd3a0 0x556c8fad9dd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.221+0000 7fdd4a5fd740 1 --2- 172.21.15.78:0/2913971234 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x556c8f7186b0 0x556c8fba8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.221+0000 7fdd4a5fd740 1 --2- 172.21.15.78:0/2913971234 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x556c8f7104d0 0x556c8fb25460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.221+0000 7fdd4a5fd740 1 --2- 172.21.15.78:0/2913971234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x556c8f6f7f60 0x556c8fba42b0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.221+0000 7fdd1bfff640 0 client.8568 ms_handle_reset on v2:172.21.15.193:6835/2983826871 2024-09-17T03:15:07.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.221+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/2913971234 >> 172.21.15.78:0/2913971234 conn(0x556c8f72d4e0 msgr2=0x556c8fb0b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:07.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.221+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/2913971234 shutdown_connections 2024-09-17T03:15:07.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.221+0000 7fdd4a5fd740 1 -- 172.21.15.78:0/2913971234 wait complete. 2024-09-17T03:15:07.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.221+0000 7fdd4a5fd740 20 client.8568 trim_cache size 0 max 16384 2024-09-17T03:15:07.226 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:07.226 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:15:07.226 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:15:07.226 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:07.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.222+0000 7fdd43a4d640 1 -- 172.21.15.78:0/3948441861 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdd28078b90 msgr2=0x7fdd2807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:07.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.222+0000 7fdd43a4d640 1 --2- 172.21.15.78:0/3948441861 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdd28078b90 0x7fdd2807b0a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c005c40 tx=0x7fdd2c00a530 comp rx=0 tx=0).stop 2024-09-17T03:15:07.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.222+0000 7fdd43a4d640 1 -- 172.21.15.78:0/3948441861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd3c15d670 msgr2=0x7fdd3c0c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:07.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.222+0000 7fdd43a4d640 1 --2- 172.21.15.78:0/3948441861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd3c15d670 0x7fdd3c0c93b0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fdd3400b410 tx=0x7fdd3400b8d0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.222+0000 7fdd43a4d640 1 -- 172.21.15.78:0/3948441861 shutdown_connections 2024-09-17T03:15:07.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.222+0000 7fdd43a4d640 1 --2- 172.21.15.78:0/3948441861 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdd3c15d670 0x7fdd3c0c93b0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.222+0000 7fdd43a4d640 1 --2- 172.21.15.78:0/3948441861 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdd28078b90 0x7fdd2807b0a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.222+0000 7fdd43a4d640 1 --2- 172.21.15.78:0/3948441861 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdd3c1570e0 0x7fdd3c14e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.222+0000 7fdd43a4d640 1 --2- 172.21.15.78:0/3948441861 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd3c0d2460 0x7fdd3c0ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:07.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.222+0000 7fdd43a4d640 1 -- 172.21.15.78:0/3948441861 >> 172.21.15.78:0/3948441861 conn(0x7fdd3c06d550 msgr2=0x7fdd3c0b6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:07.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.222+0000 7fdd43a4d640 1 -- 172.21.15.78:0/3948441861 shutdown_connections 2024-09-17T03:15:07.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07.222+0000 7fdd43a4d640 1 -- 172.21.15.78:0/3948441861 wait complete. 2024-09-17T03:15:07.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:07.232 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec find d1/d2/d3/) 2024-09-17T03:15:07.255 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/ 2024-09-17T03:15:07.255 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4 2024-09-17T03:15:07.255 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4/d5 2024-09-17T03:15:07.255 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4/d5/d6 2024-09-17T03:15:07.255 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4/d5/d6/d7 2024-09-17T03:15:07.256 INFO:teuthology.orchestra.run.smithi078.stdout:d1/d2/d3/d4/d5/d6/d7/d8 2024-09-17T03:15:07.256 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:15:07.256 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:15:07.256 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:15:07.256 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:15:07.256 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/").st_ino) 2024-09-17T03:15:07.256 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:15:07.360 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627778 2024-09-17T03:15:07.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:15:07.369 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:15:07.369 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:15:07.369 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:15:07.370 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:15:07.370 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4").st_ino) 2024-09-17T03:15:07.370 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:15:07.474 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627779 2024-09-17T03:15:07.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:15:07.483 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:15:07.483 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:15:07.483 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:15:07.483 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:15:07.483 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5").st_ino) 2024-09-17T03:15:07.483 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:15:07.587 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627780 2024-09-17T03:15:07.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:15:07.595 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:15:07.595 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:15:07.595 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:15:07.595 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:15:07.595 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6").st_ino) 2024-09-17T03:15:07.596 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:15:07.701 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627781 2024-09-17T03:15:07.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:15:07.710 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:15:07.710 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:15:07.710 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:15:07.710 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:15:07.710 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7").st_ino) 2024-09-17T03:15:07.710 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:15:07.814 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627782 2024-09-17T03:15:07.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:15:07.822 DEBUG:teuthology.orchestra.run.smithi078:> stdin-killer -- python3 -c ' 2024-09-17T03:15:07.823 DEBUG:teuthology.orchestra.run.smithi078:> import os 2024-09-17T03:15:07.823 DEBUG:teuthology.orchestra.run.smithi078:> import stat 2024-09-17T03:15:07.823 DEBUG:teuthology.orchestra.run.smithi078:> 2024-09-17T03:15:07.823 DEBUG:teuthology.orchestra.run.smithi078:> print(os.stat("/home/ubuntu/cephtest/mnt.0/d1/d2/d3/d4/d5/d6/d7/d8").st_ino) 2024-09-17T03:15:07.823 DEBUG:teuthology.orchestra.run.smithi078:> ' 2024-09-17T03:15:07.926 INFO:teuthology.orchestra.run.smithi078.stdout:1099511627783 2024-09-17T03:15:07.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T03:15:07.935 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000002.00000000 parent 2024-09-17T03:15:08.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.032+0000 7f0cc0305f40 1 Processor -- start 2024-09-17T03:15:08.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.032+0000 7f0cc0305f40 1 -- start start 2024-09-17T03:15:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.033+0000 7f0cc0305f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595d0e69440 0x5595d0e6ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.033+0000 7f0cc0305f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595d0d9d930 0x5595d0e63c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.033+0000 7f0cc0305f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595d0e64180 0x5595d0e6cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.033+0000 7f0cc0305f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5595d0d4b430 con 0x5595d0d9d930 2024-09-17T03:15:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.033+0000 7f0cc0305f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5595d0d581f0 con 0x5595d0e69440 2024-09-17T03:15:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.033+0000 7f0cc0305f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5595d0cecd60 con 0x5595d0e64180 2024-09-17T03:15:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.033+0000 7f0cb15be640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595d0d9d930 0x5595d0e63c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.033+0000 7f0cb15be640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595d0d9d930 0x5595d0e63c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50602/0 (socket says 172.21.15.78:50602) 2024-09-17T03:15:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.033+0000 7f0cb15be640 1 -- 172.21.15.78:0/1602368726 learned_addr learned my addr 172.21.15.78:0/1602368726 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.033+0000 7f0cba5c0640 1 --2- 172.21.15.78:0/1602368726 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595d0e64180 0x5595d0e6cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.033+0000 7f0cb9dbf640 1 --2- 172.21.15.78:0/1602368726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595d0e69440 0x5595d0e6ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.033+0000 7f0cb15be640 1 -- 172.21.15.78:0/1602368726 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595d0e64180 msgr2=0x5595d0e6cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.033+0000 7f0cb15be640 1 --2- 172.21.15.78:0/1602368726 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595d0e64180 0x5595d0e6cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.033+0000 7f0cb15be640 1 -- 172.21.15.78:0/1602368726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595d0e69440 msgr2=0x5595d0e6ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.033+0000 7f0cb15be640 1 --2- 172.21.15.78:0/1602368726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595d0e69440 0x5595d0e6ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.033+0000 7f0cb15be640 1 -- 172.21.15.78:0/1602368726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d0de3c90 con 0x5595d0d9d930 2024-09-17T03:15:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.033+0000 7f0cb9dbf640 1 --2- 172.21.15.78:0/1602368726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595d0e69440 0x5595d0e6ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.034+0000 7f0cb15be640 1 --2- 172.21.15.78:0/1602368726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595d0d9d930 0x5595d0e63c40 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f0ca400d4b0 tx=0x7f0ca400d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a282d7f06e54ef42 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.034+0000 7f0cb8dbd640 1 -- 172.21.15.78:0/1602368726 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca400f4f0 con 0x5595d0d9d930 2024-09-17T03:15:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.034+0000 7f0cb8dbd640 1 -- 172.21.15.78:0/1602368726 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ca4014020 con 0x5595d0d9d930 2024-09-17T03:15:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.034+0000 7f0cb8dbd640 1 -- 172.21.15.78:0/1602368726 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca400f8d0 con 0x5595d0d9d930 2024-09-17T03:15:08.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.034+0000 7f0cc0305f40 1 -- 172.21.15.78:0/1602368726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595d0d9d930 msgr2=0x5595d0e63c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.034+0000 7f0cc0305f40 1 --2- 172.21.15.78:0/1602368726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595d0d9d930 0x5595d0e63c40 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f0ca400d4b0 tx=0x7f0ca400d970 comp rx=0 tx=0).stop 2024-09-17T03:15:08.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.034+0000 7f0cc0305f40 1 -- 172.21.15.78:0/1602368726 shutdown_connections 2024-09-17T03:15:08.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.034+0000 7f0cc0305f40 1 --2- 172.21.15.78:0/1602368726 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595d0e64180 0x5595d0e6cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.034+0000 7f0cc0305f40 1 --2- 172.21.15.78:0/1602368726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595d0d9d930 0x5595d0e63c40 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.034+0000 7f0cc0305f40 1 --2- 172.21.15.78:0/1602368726 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595d0e69440 0x5595d0e6ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.034+0000 7f0cc0305f40 1 -- 172.21.15.78:0/1602368726 >> 172.21.15.78:0/1602368726 conn(0x5595d0cbdac0 msgr2=0x5595d0e6af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.034+0000 7f0cc0305f40 1 -- 172.21.15.78:0/1602368726 shutdown_connections 2024-09-17T03:15:08.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.034+0000 7f0cc0305f40 1 -- 172.21.15.78:0/1602368726 wait complete. 2024-09-17T03:15:08.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.035+0000 7f0cc0305f40 1 Processor -- start 2024-09-17T03:15:08.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.035+0000 7f0cc0305f40 1 -- start start 2024-09-17T03:15:08.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cc0305f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595d0d9d930 0x5595d0e77d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cc0305f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595d0e64180 0x5595d0e5b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cc0305f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595d0e69440 0x5595d0e60370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cc0305f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5595d0e6e300 con 0x5595d0e69440 2024-09-17T03:15:08.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cc0305f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5595d0de3f30 con 0x5595d0d9d930 2024-09-17T03:15:08.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cc0305f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5595d0e6e480 con 0x5595d0e64180 2024-09-17T03:15:08.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cba5c0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595d0e69440 0x5595d0e60370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cba5c0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595d0e69440 0x5595d0e60370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50608/0 (socket says 172.21.15.78:50608) 2024-09-17T03:15:08.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cba5c0640 1 -- 172.21.15.78:0/3167900384 learned_addr learned my addr 172.21.15.78:0/3167900384 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cb15be640 1 --2- 172.21.15.78:0/3167900384 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595d0e64180 0x5595d0e5b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cb9dbf640 1 --2- 172.21.15.78:0/3167900384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595d0d9d930 0x5595d0e77d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cba5c0640 1 -- 172.21.15.78:0/3167900384 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595d0e64180 msgr2=0x5595d0e5b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cba5c0640 1 --2- 172.21.15.78:0/3167900384 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595d0e64180 0x5595d0e5b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cba5c0640 1 -- 172.21.15.78:0/3167900384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595d0d9d930 msgr2=0x5595d0e77d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cba5c0640 1 --2- 172.21.15.78:0/3167900384 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595d0d9d930 0x5595d0e77d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cba5c0640 1 -- 172.21.15.78:0/3167900384 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595d0e782a0 con 0x5595d0e69440 2024-09-17T03:15:08.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cba5c0640 1 --2- 172.21.15.78:0/3167900384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595d0e69440 0x5595d0e60370 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4046a40 tx=0x7f0cb4001490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cb37fe640 1 -- 172.21.15.78:0/3167900384 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4009ad0 con 0x5595d0e69440 2024-09-17T03:15:08.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cb37fe640 1 -- 172.21.15.78:0/3167900384 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0cb40090d0 con 0x5595d0e69440 2024-09-17T03:15:08.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cc0305f40 1 -- 172.21.15.78:0/3167900384 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595d0e6fa00 con 0x5595d0e69440 2024-09-17T03:15:08.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cb37fe640 1 -- 172.21.15.78:0/3167900384 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb4002050 con 0x5595d0e69440 2024-09-17T03:15:08.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.037+0000 7f0cc0305f40 1 -- 172.21.15.78:0/3167900384 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595d0e6b030 con 0x5595d0e69440 2024-09-17T03:15:08.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.039+0000 7f0cb37fe640 1 -- 172.21.15.78:0/3167900384 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0cb4007580 con 0x5595d0e69440 2024-09-17T03:15:08.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.039+0000 7f0cb37fe640 1 --2- 172.21.15.78:0/3167900384 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0c9c0775a0 0x7f0c9c079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.040+0000 7f0cb37fe640 1 -- 172.21.15.78:0/3167900384 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f0cb40dc9e0 con 0x5595d0e69440 2024-09-17T03:15:08.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.040+0000 7f0cb9dbf640 1 --2- 172.21.15.78:0/3167900384 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0c9c0775a0 0x7f0c9c079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.040+0000 7f0cc0305f40 1 --2- 172.21.15.78:0/3167900384 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x5595d0f0d210 0x5595d0e6cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.040+0000 7f0cc0305f40 1 -- 172.21.15.78:0/3167900384 --> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] -- osd_op(unknown.0.0:1 14.12 14:4bec3886:::10000000002.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x5595d0e6d1e0 con 0x5595d0f0d210 2024-09-17T03:15:08.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.040+0000 7f0cb15be640 1 --2- 172.21.15.78:0/3167900384 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x5595d0f0d210 0x5595d0e6cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.040+0000 7f0cb9dbf640 1 --2- 172.21.15.78:0/3167900384 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0c9c0775a0 0x7f0c9c079ab0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0cac0046f0 tx=0x7f0cac004880 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.040+0000 7f0cb15be640 1 --2- 172.21.15.78:0/3167900384 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x5595d0f0d210 0x5595d0e6cca0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.041+0000 7f0cb15be640 1 -- 172.21.15.78:0/3167900384 <== osd.2 v2:172.21.15.78:6824/3281582072 1 ==== osd_op_reply(1 10000000002.00000000 [rmxattr] v95'8 uv8 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f0ca4008070 con 0x5595d0f0d210 2024-09-17T03:15:08.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.041+0000 7f0cc0305f40 1 -- 172.21.15.78:0/3167900384 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x5595d0f0d210 msgr2=0x5595d0e6cca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.041+0000 7f0cc0305f40 1 --2- 172.21.15.78:0/3167900384 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x5595d0f0d210 0x5595d0e6cca0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.041+0000 7f0cc0305f40 1 -- 172.21.15.78:0/3167900384 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0c9c0775a0 msgr2=0x7f0c9c079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.041+0000 7f0cc0305f40 1 --2- 172.21.15.78:0/3167900384 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0c9c0775a0 0x7f0c9c079ab0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0cac0046f0 tx=0x7f0cac004880 comp rx=0 tx=0).stop 2024-09-17T03:15:08.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.041+0000 7f0cc0305f40 1 -- 172.21.15.78:0/3167900384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595d0e69440 msgr2=0x5595d0e60370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.041+0000 7f0cc0305f40 1 --2- 172.21.15.78:0/3167900384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595d0e69440 0x5595d0e60370 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f0cb4046a40 tx=0x7f0cb4001490 comp rx=0 tx=0).stop 2024-09-17T03:15:08.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.041+0000 7f0cba5c0640 1 -- 172.21.15.78:0/3167900384 reap_dead start 2024-09-17T03:15:08.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.041+0000 7f0cc0305f40 1 -- 172.21.15.78:0/3167900384 shutdown_connections 2024-09-17T03:15:08.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.041+0000 7f0cc0305f40 1 -- 172.21.15.78:0/3167900384 >> 172.21.15.78:0/3167900384 conn(0x5595d0cbdac0 msgr2=0x5595d0dcaa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.042+0000 7f0cc0305f40 1 -- 172.21.15.78:0/3167900384 shutdown_connections 2024-09-17T03:15:08.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.042+0000 7f0cc0305f40 1 -- 172.21.15.78:0/3167900384 wait complete. 2024-09-17T03:15:08.046 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000003.00000000 parent 2024-09-17T03:15:08.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.101+0000 7f0705321f40 1 Processor -- start 2024-09-17T03:15:08.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.101+0000 7f0705321f40 1 -- start start 2024-09-17T03:15:08.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.102+0000 7f0705321f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2ac888900 0x55f2ac937610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.102+0000 7f0705321f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2ac93cd10 0x55f2ac8cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.102+0000 7f0705321f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2ac95aa70 0x55f2ac93b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.102+0000 7f0705321f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f2ac95dde0 con 0x55f2ac93cd10 2024-09-17T03:15:08.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.102+0000 7f0705321f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f2ac7d4d60 con 0x55f2ac888900 2024-09-17T03:15:08.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.102+0000 7f0705321f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f2ac93d120 con 0x55f2ac95aa70 2024-09-17T03:15:08.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.103+0000 7f06f5b92640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2ac93cd10 0x55f2ac8cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.103+0000 7f06f5b92640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2ac93cd10 0x55f2ac8cf250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50626/0 (socket says 172.21.15.78:50626) 2024-09-17T03:15:08.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.103+0000 7f06f5b92640 1 -- 172.21.15.78:0/1244546997 learned_addr learned my addr 172.21.15.78:0/1244546997 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.103+0000 7f06fe393640 1 --2- 172.21.15.78:0/1244546997 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2ac888900 0x55f2ac937610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.103+0000 7f06feb94640 1 --2- 172.21.15.78:0/1244546997 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2ac95aa70 0x55f2ac93b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.103+0000 7f06f5b92640 1 -- 172.21.15.78:0/1244546997 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2ac95aa70 msgr2=0x55f2ac93b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.103+0000 7f06f5b92640 1 --2- 172.21.15.78:0/1244546997 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2ac95aa70 0x55f2ac93b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.103+0000 7f06f5b92640 1 -- 172.21.15.78:0/1244546997 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2ac888900 msgr2=0x55f2ac937610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.103+0000 7f06f5b92640 1 --2- 172.21.15.78:0/1244546997 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2ac888900 0x55f2ac937610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.103+0000 7f06f5b92640 1 -- 172.21.15.78:0/1244546997 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2ac8d0330 con 0x55f2ac93cd10 2024-09-17T03:15:08.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.103+0000 7f06feb94640 1 --2- 172.21.15.78:0/1244546997 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2ac95aa70 0x55f2ac93b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:08.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.103+0000 7f06f5b92640 1 --2- 172.21.15.78:0/1244546997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2ac93cd10 0x55f2ac8cf250 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f06e800b570 tx=0x7f06e800ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b02e1cb686116be server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.103+0000 7f06fd391640 1 -- 172.21.15.78:0/1244546997 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e8018070 con 0x55f2ac93cd10 2024-09-17T03:15:08.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.103+0000 7f06fd391640 1 -- 172.21.15.78:0/1244546997 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06e8009790 con 0x55f2ac93cd10 2024-09-17T03:15:08.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.103+0000 7f06fd391640 1 -- 172.21.15.78:0/1244546997 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e8009bc0 con 0x55f2ac93cd10 2024-09-17T03:15:08.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.104+0000 7f0705321f40 1 -- 172.21.15.78:0/1244546997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2ac93cd10 msgr2=0x55f2ac8cf250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.104+0000 7f0705321f40 1 --2- 172.21.15.78:0/1244546997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2ac93cd10 0x55f2ac8cf250 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f06e800b570 tx=0x7f06e800ba30 comp rx=0 tx=0).stop 2024-09-17T03:15:08.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.104+0000 7f0705321f40 1 -- 172.21.15.78:0/1244546997 shutdown_connections 2024-09-17T03:15:08.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.104+0000 7f0705321f40 1 --2- 172.21.15.78:0/1244546997 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2ac95aa70 0x55f2ac93b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.104+0000 7f0705321f40 1 --2- 172.21.15.78:0/1244546997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2ac93cd10 0x55f2ac8cf250 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.104+0000 7f0705321f40 1 --2- 172.21.15.78:0/1244546997 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2ac888900 0x55f2ac937610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.104+0000 7f0705321f40 1 -- 172.21.15.78:0/1244546997 >> 172.21.15.78:0/1244546997 conn(0x55f2ac7a5ac0 msgr2=0x55f2ac8c7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.104+0000 7f0705321f40 1 -- 172.21.15.78:0/1244546997 shutdown_connections 2024-09-17T03:15:08.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.104+0000 7f0705321f40 1 -- 172.21.15.78:0/1244546997 wait complete. 2024-09-17T03:15:08.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.105+0000 7f0705321f40 1 Processor -- start 2024-09-17T03:15:08.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.105+0000 7f0705321f40 1 -- start start 2024-09-17T03:15:08.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.106+0000 7f0705321f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2ac888900 0x55f2ac8cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.106+0000 7f0705321f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2ac93cd10 0x55f2ac935890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.106+0000 7f0705321f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2ac95aa70 0x55f2ac8c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.106+0000 7f0705321f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f2ac933a60 con 0x55f2ac888900 2024-09-17T03:15:08.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.106+0000 7f0705321f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f2ac8c7f80 con 0x55f2ac93cd10 2024-09-17T03:15:08.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.106+0000 7f0705321f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f2ac95c460 con 0x55f2ac95aa70 2024-09-17T03:15:08.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.106+0000 7f06fe393640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2ac888900 0x55f2ac8cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.106+0000 7f06fe393640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2ac888900 0x55f2ac8cb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50632/0 (socket says 172.21.15.78:50632) 2024-09-17T03:15:08.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.106+0000 7f06fe393640 1 -- 172.21.15.78:0/2360069139 learned_addr learned my addr 172.21.15.78:0/2360069139 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.106+0000 7f06f5b92640 1 --2- 172.21.15.78:0/2360069139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2ac93cd10 0x55f2ac935890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.106+0000 7f06feb94640 1 --2- 172.21.15.78:0/2360069139 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2ac95aa70 0x55f2ac8c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.106+0000 7f06fe393640 1 -- 172.21.15.78:0/2360069139 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2ac95aa70 msgr2=0x55f2ac8c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.106+0000 7f06fe393640 1 --2- 172.21.15.78:0/2360069139 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2ac95aa70 0x55f2ac8c9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.106+0000 7f06fe393640 1 -- 172.21.15.78:0/2360069139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2ac93cd10 msgr2=0x55f2ac935890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.106+0000 7f06fe393640 1 --2- 172.21.15.78:0/2360069139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2ac93cd10 0x55f2ac935890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.106+0000 7f06fe393640 1 -- 172.21.15.78:0/2360069139 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2ac9546d0 con 0x55f2ac888900 2024-09-17T03:15:08.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.106+0000 7f06f5b92640 1 --2- 172.21.15.78:0/2360069139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2ac93cd10 0x55f2ac935890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:08.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.106+0000 7f06fe393640 1 --2- 172.21.15.78:0/2360069139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2ac888900 0x55f2ac8cb650 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f06f0046680 tx=0x7f06f004d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.107+0000 7f06f7fff640 1 -- 172.21.15.78:0/2360069139 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f0068070 con 0x55f2ac888900 2024-09-17T03:15:08.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.107+0000 7f06f7fff640 1 -- 172.21.15.78:0/2360069139 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06f0058280 con 0x55f2ac888900 2024-09-17T03:15:08.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.107+0000 7f06f7fff640 1 -- 172.21.15.78:0/2360069139 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f0058750 con 0x55f2ac888900 2024-09-17T03:15:08.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.107+0000 7f0705321f40 1 -- 172.21.15.78:0/2360069139 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f2ac8cf920 con 0x55f2ac888900 2024-09-17T03:15:08.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.107+0000 7f0705321f40 1 -- 172.21.15.78:0/2360069139 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2ac8cbb90 con 0x55f2ac888900 2024-09-17T03:15:08.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.108+0000 7f06f7fff640 1 -- 172.21.15.78:0/2360069139 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f06f006b070 con 0x55f2ac888900 2024-09-17T03:15:08.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.109+0000 7f06f7fff640 1 --2- 172.21.15.78:0/2360069139 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f06e0077570 0x7f06e0079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.109+0000 7f06f7fff640 1 -- 172.21.15.78:0/2360069139 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f06f00dd890 con 0x55f2ac888900 2024-09-17T03:15:08.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.109+0000 7f06f5b92640 1 --2- 172.21.15.78:0/2360069139 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f06e0077570 0x7f06e0079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.109+0000 7f0705321f40 1 --2- 172.21.15.78:0/2360069139 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x55f2ac8ca170 0x55f2ac8ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.109+0000 7f0705321f40 1 -- 172.21.15.78:0/2360069139 --> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] -- osd_op(unknown.0.0:1 14.12 14:4def72d4:::10000000003.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x55f2ac935dd0 con 0x55f2ac8ca170 2024-09-17T03:15:08.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.109+0000 7f06feb94640 1 --2- 172.21.15.78:0/2360069139 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x55f2ac8ca170 0x55f2ac8ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.109+0000 7f06f5b92640 1 --2- 172.21.15.78:0/2360069139 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f06e0077570 0x7f06e0079a80 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f06e800b570 tx=0x7f06e8002fb0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.110+0000 7f06feb94640 1 --2- 172.21.15.78:0/2360069139 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x55f2ac8ca170 0x55f2ac8ca580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.111+0000 7f06feb94640 1 -- 172.21.15.78:0/2360069139 <== osd.2 v2:172.21.15.78:6824/3281582072 1 ==== osd_op_reply(1 10000000003.00000000 [rmxattr] v95'9 uv9 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f06f800e940 con 0x55f2ac8ca170 2024-09-17T03:15:08.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.111+0000 7f0705321f40 1 -- 172.21.15.78:0/2360069139 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x55f2ac8ca170 msgr2=0x55f2ac8ca580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.111+0000 7f0705321f40 1 --2- 172.21.15.78:0/2360069139 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x55f2ac8ca170 0x55f2ac8ca580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.111+0000 7f0705321f40 1 -- 172.21.15.78:0/2360069139 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f06e0077570 msgr2=0x7f06e0079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.111+0000 7f0705321f40 1 --2- 172.21.15.78:0/2360069139 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f06e0077570 0x7f06e0079a80 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f06e800b570 tx=0x7f06e8002fb0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.111+0000 7f0705321f40 1 -- 172.21.15.78:0/2360069139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2ac888900 msgr2=0x55f2ac8cb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.111+0000 7f0705321f40 1 --2- 172.21.15.78:0/2360069139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2ac888900 0x55f2ac8cb650 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f06f0046680 tx=0x7f06f004d9a0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.111+0000 7f06feb94640 1 -- 172.21.15.78:0/2360069139 reap_dead start 2024-09-17T03:15:08.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.111+0000 7f0705321f40 1 -- 172.21.15.78:0/2360069139 shutdown_connections 2024-09-17T03:15:08.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.111+0000 7f0705321f40 1 -- 172.21.15.78:0/2360069139 >> 172.21.15.78:0/2360069139 conn(0x55f2ac7a5ac0 msgr2=0x55f2ac937100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.111+0000 7f0705321f40 1 -- 172.21.15.78:0/2360069139 shutdown_connections 2024-09-17T03:15:08.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.111+0000 7f0705321f40 1 -- 172.21.15.78:0/2360069139 wait complete. 2024-09-17T03:15:08.114 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000004.00000000 parent 2024-09-17T03:15:08.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.171+0000 7fea50175f40 1 Processor -- start 2024-09-17T03:15:08.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.171+0000 7fea50175f40 1 -- start start 2024-09-17T03:15:08.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.173+0000 7fea50175f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea34003c40 0x562b7e0f6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.173+0000 7fea50175f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b7e0f7d90 0x562b7e085900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.173+0000 7fea50175f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b7e1a7230 0x562b7e114b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.173+0000 7fea50175f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x562b7dff2430 con 0x7fea34003c40 2024-09-17T03:15:08.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.173+0000 7fea50175f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562b7dfff1f0 con 0x562b7e1a7230 2024-09-17T03:15:08.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.173+0000 7fea50175f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x562b7df93d60 con 0x562b7e0f7d90 2024-09-17T03:15:08.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.173+0000 7fea49c2f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea34003c40 0x562b7e0f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.173+0000 7fea49c2f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea34003c40 0x562b7e0f6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50638/0 (socket says 172.21.15.78:50638) 2024-09-17T03:15:08.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.173+0000 7fea49c2f640 1 -- 172.21.15.78:0/3345400364 learned_addr learned my addr 172.21.15.78:0/3345400364 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.173+0000 7fea4942e640 1 --2- 172.21.15.78:0/3345400364 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b7e0f7d90 0x562b7e085900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.173+0000 7fea49c2f640 1 -- 172.21.15.78:0/3345400364 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b7e0f7d90 msgr2=0x562b7e085900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.173+0000 7fea49c2f640 1 --2- 172.21.15.78:0/3345400364 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b7e0f7d90 0x562b7e085900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.173+0000 7fea49c2f640 1 -- 172.21.15.78:0/3345400364 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b7e1a7230 msgr2=0x562b7e114b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.173+0000 7fea49c2f640 1 --2- 172.21.15.78:0/3345400364 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b7e1a7230 0x562b7e114b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.173+0000 7fea49c2f640 1 -- 172.21.15.78:0/3345400364 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b7e115fb0 con 0x7fea34003c40 2024-09-17T03:15:08.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.173+0000 7fea49c2f640 1 --2- 172.21.15.78:0/3345400364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea34003c40 0x562b7e0f6300 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00b7c0 tx=0x7fea3c004880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9f8f9d4c9f362b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.173+0000 7fea3bfff640 1 -- 172.21.15.78:0/3345400364 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c00ac20 con 0x7fea34003c40 2024-09-17T03:15:08.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.173+0000 7fea3bfff640 1 -- 172.21.15.78:0/3345400364 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea3c00adc0 con 0x7fea34003c40 2024-09-17T03:15:08.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.173+0000 7fea3bfff640 1 -- 172.21.15.78:0/3345400364 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c017670 con 0x7fea34003c40 2024-09-17T03:15:08.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.174+0000 7fea50175f40 1 -- 172.21.15.78:0/3345400364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea34003c40 msgr2=0x562b7e0f6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.174+0000 7fea50175f40 1 --2- 172.21.15.78:0/3345400364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea34003c40 0x562b7e0f6300 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00b7c0 tx=0x7fea3c004880 comp rx=0 tx=0).stop 2024-09-17T03:15:08.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.174+0000 7fea50175f40 1 -- 172.21.15.78:0/3345400364 shutdown_connections 2024-09-17T03:15:08.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.174+0000 7fea50175f40 1 --2- 172.21.15.78:0/3345400364 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b7e1a7230 0x562b7e114b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.174+0000 7fea50175f40 1 --2- 172.21.15.78:0/3345400364 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b7e0f7d90 0x562b7e085900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.174+0000 7fea50175f40 1 --2- 172.21.15.78:0/3345400364 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea34003c40 0x562b7e0f6300 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.174+0000 7fea50175f40 1 -- 172.21.15.78:0/3345400364 >> 172.21.15.78:0/3345400364 conn(0x562b7df64ac0 msgr2=0x562b7e1184c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.174+0000 7fea50175f40 1 -- 172.21.15.78:0/3345400364 shutdown_connections 2024-09-17T03:15:08.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.174+0000 7fea50175f40 1 -- 172.21.15.78:0/3345400364 wait complete. 2024-09-17T03:15:08.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.175+0000 7fea50175f40 1 Processor -- start 2024-09-17T03:15:08.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.175+0000 7fea50175f40 1 -- start start 2024-09-17T03:15:08.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.176+0000 7fea50175f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b7e0f7d90 0x562b7e0eeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.176+0000 7fea50175f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b7e1a7230 0x562b7e1180a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.176+0000 7fea50175f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea34003c40 0x562b7e1185e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.176+0000 7fea50175f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x562b7e116630 con 0x7fea34003c40 2024-09-17T03:15:08.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.176+0000 7fea50175f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562b7e085e40 con 0x562b7e1a7230 2024-09-17T03:15:08.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.176+0000 7fea50175f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x562b7e115d50 con 0x562b7e0f7d90 2024-09-17T03:15:08.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.176+0000 7fea4a430640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea34003c40 0x562b7e1185e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.176+0000 7fea4a430640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea34003c40 0x562b7e1185e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50654/0 (socket says 172.21.15.78:50654) 2024-09-17T03:15:08.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.176+0000 7fea4a430640 1 -- 172.21.15.78:0/1288367555 learned_addr learned my addr 172.21.15.78:0/1288367555 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.176+0000 7fea49c2f640 1 --2- 172.21.15.78:0/1288367555 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b7e0f7d90 0x562b7e0eeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.176+0000 7fea4942e640 1 --2- 172.21.15.78:0/1288367555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b7e1a7230 0x562b7e1180a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.177+0000 7fea4a430640 1 -- 172.21.15.78:0/1288367555 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b7e0f7d90 msgr2=0x562b7e0eeeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.177+0000 7fea4a430640 1 --2- 172.21.15.78:0/1288367555 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562b7e0f7d90 0x562b7e0eeeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.177+0000 7fea4a430640 1 -- 172.21.15.78:0/1288367555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b7e1a7230 msgr2=0x562b7e1180a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.177+0000 7fea4a430640 1 --2- 172.21.15.78:0/1288367555 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562b7e1a7230 0x562b7e1180a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.177+0000 7fea4a430640 1 -- 172.21.15.78:0/1288367555 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b7e08ab80 con 0x7fea34003c40 2024-09-17T03:15:08.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.177+0000 7fea4a430640 1 --2- 172.21.15.78:0/1288367555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea34003c40 0x562b7e1185e0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fea44025870 tx=0x7fea44008a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.177+0000 7fea3affd640 1 -- 172.21.15.78:0/1288367555 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea440018a0 con 0x7fea34003c40 2024-09-17T03:15:08.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.177+0000 7fea3affd640 1 -- 172.21.15.78:0/1288367555 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea44059040 con 0x7fea34003c40 2024-09-17T03:15:08.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.177+0000 7fea3affd640 1 -- 172.21.15.78:0/1288367555 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea44008b30 con 0x7fea34003c40 2024-09-17T03:15:08.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.177+0000 7fea50175f40 1 -- 172.21.15.78:0/1288367555 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562b7e08ae60 con 0x7fea34003c40 2024-09-17T03:15:08.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.177+0000 7fea50175f40 1 -- 172.21.15.78:0/1288367555 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b7e08b420 con 0x7fea34003c40 2024-09-17T03:15:08.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.179+0000 7fea3affd640 1 -- 172.21.15.78:0/1288367555 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea44065020 con 0x7fea34003c40 2024-09-17T03:15:08.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.179+0000 7fea3affd640 1 --2- 172.21.15.78:0/1288367555 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fea2c077570 0x7fea2c079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.179+0000 7fea3affd640 1 -- 172.21.15.78:0/1288367555 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fea440dcd30 con 0x7fea34003c40 2024-09-17T03:15:08.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.179+0000 7fea49c2f640 1 --2- 172.21.15.78:0/1288367555 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fea2c077570 0x7fea2c079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.179+0000 7fea50175f40 1 --2- 172.21.15.78:0/1288367555 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x562b7e08a410 0x562b7e0f8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.179+0000 7fea50175f40 1 -- 172.21.15.78:0/1288367555 --> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] -- osd_op(unknown.0.0:1 14.5 14:a367a3e8:::10000000004.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x562b7e0f9130 con 0x562b7e08a410 2024-09-17T03:15:08.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.179+0000 7fea4942e640 1 --2- 172.21.15.78:0/1288367555 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x562b7e08a410 0x562b7e0f8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.180+0000 7fea49c2f640 1 --2- 172.21.15.78:0/1288367555 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fea2c077570 0x7fea2c079a80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00b760 tx=0x7fea3c019040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.180+0000 7fea4942e640 1 --2- 172.21.15.78:0/1288367555 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x562b7e08a410 0x562b7e0f8bf0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.181+0000 7fea4942e640 1 -- 172.21.15.78:0/1288367555 <== osd.0 v2:172.21.15.78:6816/3825297687 1 ==== osd_op_reply(1 10000000004.00000000 [rmxattr] v95'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fea40009830 con 0x562b7e08a410 2024-09-17T03:15:08.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.181+0000 7fea50175f40 1 -- 172.21.15.78:0/1288367555 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x562b7e08a410 msgr2=0x562b7e0f8bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.181+0000 7fea50175f40 1 --2- 172.21.15.78:0/1288367555 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x562b7e08a410 0x562b7e0f8bf0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.181+0000 7fea50175f40 1 -- 172.21.15.78:0/1288367555 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fea2c077570 msgr2=0x7fea2c079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.181+0000 7fea50175f40 1 --2- 172.21.15.78:0/1288367555 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fea2c077570 0x7fea2c079a80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00b760 tx=0x7fea3c019040 comp rx=0 tx=0).stop 2024-09-17T03:15:08.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.181+0000 7fea50175f40 1 -- 172.21.15.78:0/1288367555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea34003c40 msgr2=0x562b7e1185e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.181+0000 7fea50175f40 1 --2- 172.21.15.78:0/1288367555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea34003c40 0x562b7e1185e0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fea44025870 tx=0x7fea44008a90 comp rx=0 tx=0).stop 2024-09-17T03:15:08.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.181+0000 7fea4a430640 1 -- 172.21.15.78:0/1288367555 reap_dead start 2024-09-17T03:15:08.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.181+0000 7fea50175f40 1 -- 172.21.15.78:0/1288367555 shutdown_connections 2024-09-17T03:15:08.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.181+0000 7fea50175f40 1 -- 172.21.15.78:0/1288367555 >> 172.21.15.78:0/1288367555 conn(0x562b7df64ac0 msgr2=0x562b7e08e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.181+0000 7fea50175f40 1 -- 172.21.15.78:0/1288367555 shutdown_connections 2024-09-17T03:15:08.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.181+0000 7fea50175f40 1 -- 172.21.15.78:0/1288367555 wait complete. 2024-09-17T03:15:08.185 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000005.00000000 parent 2024-09-17T03:15:08.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.242+0000 7f388c286f40 1 Processor -- start 2024-09-17T03:15:08.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.242+0000 7f388c286f40 1 -- start start 2024-09-17T03:15:08.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.244+0000 7f388c286f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f38740030f0 0x5597bd56c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.244+0000 7f388c286f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5597bd6103e0 0x5597bd53bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.244+0000 7f388c286f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5597bd6107f0 0x5597bd53c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.244+0000 7f388c286f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5597bd4eb430 con 0x5597bd6107f0 2024-09-17T03:15:08.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.244+0000 7f388c286f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5597bd4f81f0 con 0x7f38740030f0 2024-09-17T03:15:08.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.244+0000 7f388c286f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5597bd48cd60 con 0x5597bd6103e0 2024-09-17T03:15:08.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.244+0000 7f3886541640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5597bd6107f0 0x5597bd53c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.244+0000 7f3886541640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5597bd6107f0 0x5597bd53c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50662/0 (socket says 172.21.15.78:50662) 2024-09-17T03:15:08.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.244+0000 7f387d53f640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5597bd6103e0 0x5597bd53bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.244+0000 7f3885d40640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f38740030f0 0x5597bd56c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.244+0000 7f3886541640 1 -- 172.21.15.78:0/4139845609 learned_addr learned my addr 172.21.15.78:0/4139845609 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.244+0000 7f3886541640 1 -- 172.21.15.78:0/4139845609 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5597bd6103e0 msgr2=0x5597bd53bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.244+0000 7f3886541640 1 --2- 172.21.15.78:0/4139845609 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5597bd6103e0 0x5597bd53bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.244+0000 7f3886541640 1 -- 172.21.15.78:0/4139845609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f38740030f0 msgr2=0x5597bd56c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.244+0000 7f3886541640 1 --2- 172.21.15.78:0/4139845609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f38740030f0 0x5597bd56c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.244+0000 7f3886541640 1 -- 172.21.15.78:0/4139845609 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597bd60ef90 con 0x5597bd6107f0 2024-09-17T03:15:08.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.244+0000 7f3886541640 1 --2- 172.21.15.78:0/4139845609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5597bd6107f0 0x5597bd53c2d0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x5597bd5834b0 tx=0x7f388000ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96a4da53e7991d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.244+0000 7f3884d3e640 1 -- 172.21.15.78:0/4139845609 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3880012070 con 0x5597bd6107f0 2024-09-17T03:15:08.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.244+0000 7f3884d3e640 1 -- 172.21.15.78:0/4139845609 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f388000e6d0 con 0x5597bd6107f0 2024-09-17T03:15:08.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.244+0000 7f3884d3e640 1 -- 172.21.15.78:0/4139845609 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388000eb20 con 0x5597bd6107f0 2024-09-17T03:15:08.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.245+0000 7f388c286f40 1 -- 172.21.15.78:0/4139845609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5597bd6107f0 msgr2=0x5597bd53c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.245+0000 7f388c286f40 1 --2- 172.21.15.78:0/4139845609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5597bd6107f0 0x5597bd53c2d0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x5597bd5834b0 tx=0x7f388000ca70 comp rx=0 tx=0).stop 2024-09-17T03:15:08.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.245+0000 7f388c286f40 1 -- 172.21.15.78:0/4139845609 shutdown_connections 2024-09-17T03:15:08.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.245+0000 7f388c286f40 1 --2- 172.21.15.78:0/4139845609 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5597bd6107f0 0x5597bd53c2d0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.245+0000 7f388c286f40 1 --2- 172.21.15.78:0/4139845609 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5597bd6103e0 0x5597bd53bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.245+0000 7f388c286f40 1 --2- 172.21.15.78:0/4139845609 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f38740030f0 0x5597bd56c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.245+0000 7f388c286f40 1 -- 172.21.15.78:0/4139845609 >> 172.21.15.78:0/4139845609 conn(0x5597bd45dac0 msgr2=0x5597bd60f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.245+0000 7f388c286f40 1 -- 172.21.15.78:0/4139845609 shutdown_connections 2024-09-17T03:15:08.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.245+0000 7f388c286f40 1 -- 172.21.15.78:0/4139845609 wait complete. 2024-09-17T03:15:08.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.246+0000 7f388c286f40 1 Processor -- start 2024-09-17T03:15:08.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.246+0000 7f388c286f40 1 -- start start 2024-09-17T03:15:08.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.247+0000 7f388c286f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5597bd6103e0 0x5597bd6097f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.247+0000 7f388c286f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5597bd6107f0 0x5597bd608a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.247+0000 7f388c286f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f38740030f0 0x5597bd53c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.247+0000 7f388c286f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5597bd60f270 con 0x5597bd6107f0 2024-09-17T03:15:08.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.247+0000 7f388c286f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5597bd56bb80 con 0x7f38740030f0 2024-09-17T03:15:08.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.247+0000 7f388c286f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5597bd6ade20 con 0x5597bd6103e0 2024-09-17T03:15:08.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.247+0000 7f387d53f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5597bd6107f0 0x5597bd608a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.247+0000 7f387d53f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5597bd6107f0 0x5597bd608a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50664/0 (socket says 172.21.15.78:50664) 2024-09-17T03:15:08.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.247+0000 7f387d53f640 1 -- 172.21.15.78:0/2486123296 learned_addr learned my addr 172.21.15.78:0/2486123296 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.247+0000 7f3885d40640 1 --2- 172.21.15.78:0/2486123296 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5597bd6103e0 0x5597bd6097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.247+0000 7f3886541640 1 --2- 172.21.15.78:0/2486123296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f38740030f0 0x5597bd53c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.247+0000 7f387d53f640 1 -- 172.21.15.78:0/2486123296 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5597bd6103e0 msgr2=0x5597bd6097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.248+0000 7f387d53f640 1 --2- 172.21.15.78:0/2486123296 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5597bd6103e0 0x5597bd6097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.248+0000 7f387d53f640 1 -- 172.21.15.78:0/2486123296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f38740030f0 msgr2=0x5597bd53c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.248+0000 7f387d53f640 1 --2- 172.21.15.78:0/2486123296 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f38740030f0 0x5597bd53c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.248+0000 7f387d53f640 1 -- 172.21.15.78:0/2486123296 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597bd6acac0 con 0x5597bd6107f0 2024-09-17T03:15:08.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.248+0000 7f387d53f640 1 --2- 172.21.15.78:0/2486123296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5597bd6107f0 0x5597bd608a00 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f3870045d80 tx=0x7f3870057a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.248+0000 7f387f7fe640 1 -- 172.21.15.78:0/2486123296 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3870066020 con 0x5597bd6107f0 2024-09-17T03:15:08.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.248+0000 7f387f7fe640 1 -- 172.21.15.78:0/2486123296 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3870057bc0 con 0x5597bd6107f0 2024-09-17T03:15:08.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.248+0000 7f388c286f40 1 -- 172.21.15.78:0/2486123296 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5597bd57d2d0 con 0x5597bd6107f0 2024-09-17T03:15:08.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.248+0000 7f387f7fe640 1 -- 172.21.15.78:0/2486123296 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3870001c80 con 0x5597bd6107f0 2024-09-17T03:15:08.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.248+0000 7f388c286f40 1 -- 172.21.15.78:0/2486123296 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597bd57c720 con 0x5597bd6107f0 2024-09-17T03:15:08.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.250+0000 7f387f7fe640 1 -- 172.21.15.78:0/2486123296 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3870055470 con 0x5597bd6107f0 2024-09-17T03:15:08.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.250+0000 7f387f7fe640 1 --2- 172.21.15.78:0/2486123296 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3868077570 0x7f3868079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.250+0000 7f387f7fe640 1 -- 172.21.15.78:0/2486123296 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f38700dd0b0 con 0x5597bd6107f0 2024-09-17T03:15:08.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.250+0000 7f3885d40640 1 --2- 172.21.15.78:0/2486123296 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3868077570 0x7f3868079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.250+0000 7f388c286f40 1 --2- 172.21.15.78:0/2486123296 >> [v2:172.21.15.193:6810/399195358,v1:172.21.15.193:6811/399195358] conn(0x5597bd582a80 0x5597bd6ad380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.250+0000 7f388c286f40 1 -- 172.21.15.78:0/2486123296 --> [v2:172.21.15.193:6810/399195358,v1:172.21.15.193:6811/399195358] -- osd_op(unknown.0.0:1 14.9 14:9258b67d:::10000000005.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x5597bd57cc40 con 0x5597bd582a80 2024-09-17T03:15:08.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.251+0000 7f3886541640 1 --2- 172.21.15.78:0/2486123296 >> [v2:172.21.15.193:6810/399195358,v1:172.21.15.193:6811/399195358] conn(0x5597bd582a80 0x5597bd6ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.251+0000 7f3885d40640 1 --2- 172.21.15.78:0/2486123296 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3868077570 0x7f3868079a80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x5597bd568d70 tx=0x7f3878004c00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.251+0000 7f3886541640 1 --2- 172.21.15.78:0/2486123296 >> [v2:172.21.15.193:6810/399195358,v1:172.21.15.193:6811/399195358] conn(0x5597bd582a80 0x5597bd6ad380 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.252+0000 7f3886541640 1 -- 172.21.15.78:0/2486123296 <== osd.5 v2:172.21.15.193:6810/399195358 1 ==== osd_op_reply(1 10000000005.00000000 [rmxattr] v95'6 uv6 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f3880014030 con 0x5597bd582a80 2024-09-17T03:15:08.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.252+0000 7f388c286f40 1 -- 172.21.15.78:0/2486123296 >> [v2:172.21.15.193:6810/399195358,v1:172.21.15.193:6811/399195358] conn(0x5597bd582a80 msgr2=0x5597bd6ad380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.252+0000 7f388c286f40 1 --2- 172.21.15.78:0/2486123296 >> [v2:172.21.15.193:6810/399195358,v1:172.21.15.193:6811/399195358] conn(0x5597bd582a80 0x5597bd6ad380 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.252+0000 7f388c286f40 1 -- 172.21.15.78:0/2486123296 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3868077570 msgr2=0x7f3868079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.252+0000 7f388c286f40 1 --2- 172.21.15.78:0/2486123296 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3868077570 0x7f3868079a80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x5597bd568d70 tx=0x7f3878004c00 comp rx=0 tx=0).stop 2024-09-17T03:15:08.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.252+0000 7f388c286f40 1 -- 172.21.15.78:0/2486123296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5597bd6107f0 msgr2=0x5597bd608a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.252+0000 7f388c286f40 1 --2- 172.21.15.78:0/2486123296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5597bd6107f0 0x5597bd608a00 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f3870045d80 tx=0x7f3870057a50 comp rx=0 tx=0).stop 2024-09-17T03:15:08.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.252+0000 7f3886541640 1 -- 172.21.15.78:0/2486123296 reap_dead start 2024-09-17T03:15:08.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.252+0000 7f388c286f40 1 -- 172.21.15.78:0/2486123296 shutdown_connections 2024-09-17T03:15:08.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.252+0000 7f388c286f40 1 -- 172.21.15.78:0/2486123296 >> 172.21.15.78:0/2486123296 conn(0x5597bd45dac0 msgr2=0x5597bd56b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.252+0000 7f388c286f40 1 -- 172.21.15.78:0/2486123296 shutdown_connections 2024-09-17T03:15:08.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.252+0000 7f388c286f40 1 -- 172.21.15.78:0/2486123296 wait complete. 2024-09-17T03:15:08.256 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000006.00000000 parent 2024-09-17T03:15:08.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.312+0000 7f4e541d5f40 1 Processor -- start 2024-09-17T03:15:08.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.312+0000 7f4e541d5f40 1 -- start start 2024-09-17T03:15:08.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.313+0000 7f4e541d5f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a9ce512c0 0x564a9ceec6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.313+0000 7f4e541d5f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564a9cef6300 0x564a9cef4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.313+0000 7f4e541d5f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a9cefd6b0 0x564a9cef4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.313+0000 7f4e541d5f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x564a9cd71d60 con 0x564a9ce512c0 2024-09-17T03:15:08.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.313+0000 7f4e541d5f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564a9cdd0430 con 0x564a9cefd6b0 2024-09-17T03:15:08.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.313+0000 7f4e541d5f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x564a9ce6a840 con 0x564a9cef6300 2024-09-17T03:15:08.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.313+0000 7f4e4dc8f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a9ce512c0 0x564a9ceec6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.313+0000 7f4e4dc8f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a9ce512c0 0x564a9ceec6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50678/0 (socket says 172.21.15.78:50678) 2024-09-17T03:15:08.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.313+0000 7f4e4dc8f640 1 -- 172.21.15.78:0/3610880777 learned_addr learned my addr 172.21.15.78:0/3610880777 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.313+0000 7f4e4548e640 1 --2- 172.21.15.78:0/3610880777 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564a9cef6300 0x564a9cef4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.313+0000 7f4e4dc8f640 1 -- 172.21.15.78:0/3610880777 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564a9cef6300 msgr2=0x564a9cef4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.313+0000 7f4e4dc8f640 1 --2- 172.21.15.78:0/3610880777 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564a9cef6300 0x564a9cef4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.313+0000 7f4e4dc8f640 1 -- 172.21.15.78:0/3610880777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a9cefd6b0 msgr2=0x564a9cef4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.313+0000 7f4e4e490640 1 --2- 172.21.15.78:0/3610880777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a9cefd6b0 0x564a9cef4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.314+0000 7f4e4dc8f640 1 --2- 172.21.15.78:0/3610880777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a9cefd6b0 0x564a9cef4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.314+0000 7f4e4dc8f640 1 -- 172.21.15.78:0/3610880777 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a9ce23840 con 0x564a9ce512c0 2024-09-17T03:15:08.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.314+0000 7f4e4e490640 1 --2- 172.21.15.78:0/3610880777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a9cefd6b0 0x564a9cef4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:08.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.314+0000 7f4e4dc8f640 1 --2- 172.21.15.78:0/3610880777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a9ce512c0 0x564a9ceec6f0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f4e40025e80 tx=0x7f4e40002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a3f8a3b1a1d54d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.314+0000 7f4e4cc8d640 1 -- 172.21.15.78:0/3610880777 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4004db70 con 0x564a9ce512c0 2024-09-17T03:15:08.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.314+0000 7f4e4cc8d640 1 -- 172.21.15.78:0/3610880777 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e4004dd10 con 0x564a9ce512c0 2024-09-17T03:15:08.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.314+0000 7f4e4cc8d640 1 -- 172.21.15.78:0/3610880777 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e400566d0 con 0x564a9ce512c0 2024-09-17T03:15:08.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.314+0000 7f4e541d5f40 1 -- 172.21.15.78:0/3610880777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a9ce512c0 msgr2=0x564a9ceec6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.314+0000 7f4e541d5f40 1 --2- 172.21.15.78:0/3610880777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a9ce512c0 0x564a9ceec6f0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f4e40025e80 tx=0x7f4e40002fb0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.314+0000 7f4e541d5f40 1 -- 172.21.15.78:0/3610880777 shutdown_connections 2024-09-17T03:15:08.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.314+0000 7f4e541d5f40 1 --2- 172.21.15.78:0/3610880777 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a9cefd6b0 0x564a9cef4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.314+0000 7f4e541d5f40 1 --2- 172.21.15.78:0/3610880777 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564a9cef6300 0x564a9cef4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.314+0000 7f4e541d5f40 1 --2- 172.21.15.78:0/3610880777 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a9ce512c0 0x564a9ceec6f0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.314+0000 7f4e541d5f40 1 -- 172.21.15.78:0/3610880777 >> 172.21.15.78:0/3610880777 conn(0x564a9cd42ac0 msgr2=0x564a9ce4ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.314+0000 7f4e541d5f40 1 -- 172.21.15.78:0/3610880777 shutdown_connections 2024-09-17T03:15:08.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.315+0000 7f4e541d5f40 1 -- 172.21.15.78:0/3610880777 wait complete. 2024-09-17T03:15:08.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.315+0000 7f4e541d5f40 1 Processor -- start 2024-09-17T03:15:08.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.315+0000 7f4e541d5f40 1 -- start start 2024-09-17T03:15:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e541d5f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564a9ce512c0 0x564a9cee5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e541d5f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a9cef6300 0x564a9ce68040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e541d5f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a9cefd6b0 0x564a9cef3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e541d5f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x564a9cefd1d0 con 0x564a9cefd6b0 2024-09-17T03:15:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e541d5f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564a9ce235a0 con 0x564a9cef6300 2024-09-17T03:15:08.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e541d5f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x564a9ceefc60 con 0x564a9ce512c0 2024-09-17T03:15:08.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e4e490640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a9cefd6b0 0x564a9cef3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e4e490640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a9cefd6b0 0x564a9cef3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50684/0 (socket says 172.21.15.78:50684) 2024-09-17T03:15:08.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e4e490640 1 -- 172.21.15.78:0/3390569793 learned_addr learned my addr 172.21.15.78:0/3390569793 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e4548e640 1 --2- 172.21.15.78:0/3390569793 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a9cef6300 0x564a9ce68040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e4dc8f640 1 --2- 172.21.15.78:0/3390569793 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564a9ce512c0 0x564a9cee5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e4e490640 1 -- 172.21.15.78:0/3390569793 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564a9ce512c0 msgr2=0x564a9cee5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e4e490640 1 --2- 172.21.15.78:0/3390569793 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564a9ce512c0 0x564a9cee5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e4e490640 1 -- 172.21.15.78:0/3390569793 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a9cef6300 msgr2=0x564a9ce68040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e4e490640 1 --2- 172.21.15.78:0/3390569793 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564a9cef6300 0x564a9ce68040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e4e490640 1 -- 172.21.15.78:0/3390569793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a9ce4f750 con 0x564a9cefd6b0 2024-09-17T03:15:08.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e4e490640 1 --2- 172.21.15.78:0/3390569793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a9cefd6b0 0x564a9cef3a50 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800e610 tx=0x7f4e4800ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e477fe640 1 -- 172.21.15.78:0/3390569793 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e48004220 con 0x564a9cefd6b0 2024-09-17T03:15:08.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e541d5f40 1 -- 172.21.15.78:0/3390569793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564a9cee5650 con 0x564a9cefd6b0 2024-09-17T03:15:08.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e477fe640 1 -- 172.21.15.78:0/3390569793 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e48010710 con 0x564a9cefd6b0 2024-09-17T03:15:08.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e477fe640 1 -- 172.21.15.78:0/3390569793 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e48010b20 con 0x564a9cefd6b0 2024-09-17T03:15:08.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.317+0000 7f4e541d5f40 1 -- 172.21.15.78:0/3390569793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a9ceef980 con 0x564a9cefd6b0 2024-09-17T03:15:08.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.319+0000 7f4e477fe640 1 -- 172.21.15.78:0/3390569793 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4e48010cc0 con 0x564a9cefd6b0 2024-09-17T03:15:08.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.319+0000 7f4e477fe640 1 --2- 172.21.15.78:0/3390569793 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4e30077570 0x7f4e30079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.320+0000 7f4e477fe640 1 -- 172.21.15.78:0/3390569793 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f4e4809a840 con 0x564a9cefd6b0 2024-09-17T03:15:08.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.320+0000 7f4e4dc8f640 1 --2- 172.21.15.78:0/3390569793 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4e30077570 0x7f4e30079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.320+0000 7f4e541d5f40 1 --2- 172.21.15.78:0/3390569793 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x564a9cef2330 0x564a9cf9ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.320+0000 7f4e541d5f40 1 -- 172.21.15.78:0/3390569793 --> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] -- osd_op(unknown.0.0:1 14.5 14:a5feb6f3:::10000000006.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x564a9cee9320 con 0x564a9cef2330 2024-09-17T03:15:08.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.320+0000 7f4e4548e640 1 --2- 172.21.15.78:0/3390569793 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x564a9cef2330 0x564a9cf9ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.320+0000 7f4e4dc8f640 1 --2- 172.21.15.78:0/3390569793 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4e30077570 0x7f4e30079a80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4e40062000 tx=0x7f4e40004940 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.320+0000 7f4e4548e640 1 --2- 172.21.15.78:0/3390569793 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x564a9cef2330 0x564a9cf9ae50 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.321+0000 7f4e4548e640 1 -- 172.21.15.78:0/3390569793 <== osd.0 v2:172.21.15.78:6816/3825297687 1 ==== osd_op_reply(1 10000000006.00000000 [rmxattr] v95'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4e3800e040 con 0x564a9cef2330 2024-09-17T03:15:08.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.321+0000 7f4e541d5f40 1 -- 172.21.15.78:0/3390569793 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x564a9cef2330 msgr2=0x564a9cf9ae50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.321+0000 7f4e541d5f40 1 --2- 172.21.15.78:0/3390569793 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x564a9cef2330 0x564a9cf9ae50 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.322+0000 7f4e541d5f40 1 -- 172.21.15.78:0/3390569793 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4e30077570 msgr2=0x7f4e30079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.322+0000 7f4e541d5f40 1 --2- 172.21.15.78:0/3390569793 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4e30077570 0x7f4e30079a80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4e40062000 tx=0x7f4e40004940 comp rx=0 tx=0).stop 2024-09-17T03:15:08.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.322+0000 7f4e541d5f40 1 -- 172.21.15.78:0/3390569793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a9cefd6b0 msgr2=0x564a9cef3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.322+0000 7f4e541d5f40 1 --2- 172.21.15.78:0/3390569793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564a9cefd6b0 0x564a9cef3a50 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800e610 tx=0x7f4e4800ead0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.322+0000 7f4e4e490640 1 -- 172.21.15.78:0/3390569793 reap_dead start 2024-09-17T03:15:08.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.322+0000 7f4e541d5f40 1 -- 172.21.15.78:0/3390569793 shutdown_connections 2024-09-17T03:15:08.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.322+0000 7f4e541d5f40 1 -- 172.21.15.78:0/3390569793 >> 172.21.15.78:0/3390569793 conn(0x564a9cd42ac0 msgr2=0x564a9ceefe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.322+0000 7f4e541d5f40 1 -- 172.21.15.78:0/3390569793 shutdown_connections 2024-09-17T03:15:08.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.322+0000 7f4e541d5f40 1 -- 172.21.15.78:0/3390569793 wait complete. 2024-09-17T03:15:08.329 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmxattr 10000000007.00000000 parent 2024-09-17T03:15:08.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.385+0000 7f6c0f368f40 1 Processor -- start 2024-09-17T03:15:08.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.385+0000 7f6c0f368f40 1 -- start start 2024-09-17T03:15:08.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.386+0000 7f6c0f368f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55850b0083d0 0x55850b0d2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.386+0000 7f6c0f368f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55850b009ea0 0x55850b034590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.386+0000 7f6c0f368f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55850b00be60 0x55850b0d6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.386+0000 7f6c0f368f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55850af59d60 con 0x55850b00be60 2024-09-17T03:15:08.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.386+0000 7f6c0f368f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55850afb8430 con 0x55850b0083d0 2024-09-17T03:15:08.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.386+0000 7f6c0f368f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55850b00b660 con 0x55850b009ea0 2024-09-17T03:15:08.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.386+0000 7f6c09623640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55850b00be60 0x55850b0d6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.386+0000 7f6c09623640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55850b00be60 0x55850b0d6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50694/0 (socket says 172.21.15.78:50694) 2024-09-17T03:15:08.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.387+0000 7f6c09623640 1 -- 172.21.15.78:0/1875674795 learned_addr learned my addr 172.21.15.78:0/1875674795 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.387+0000 7f6c03fff640 1 --2- 172.21.15.78:0/1875674795 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55850b009ea0 0x55850b034590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.387+0000 7f6c08e22640 1 --2- 172.21.15.78:0/1875674795 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55850b0083d0 0x55850b0d2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.387+0000 7f6c09623640 1 -- 172.21.15.78:0/1875674795 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55850b009ea0 msgr2=0x55850b034590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.387+0000 7f6c09623640 1 --2- 172.21.15.78:0/1875674795 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55850b009ea0 0x55850b034590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.387+0000 7f6c09623640 1 -- 172.21.15.78:0/1875674795 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55850b0083d0 msgr2=0x55850b0d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.387+0000 7f6c09623640 1 --2- 172.21.15.78:0/1875674795 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55850b0083d0 0x55850b0d2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.387+0000 7f6c09623640 1 -- 172.21.15.78:0/1875674795 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55850b0db400 con 0x55850b00be60 2024-09-17T03:15:08.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.387+0000 7f6c09623640 1 --2- 172.21.15.78:0/1875674795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55850b00be60 0x55850b0d6b80 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f6c04001570 tx=0x7f6c04001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3102661764f03edd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.387+0000 7f6c02ffd640 1 -- 172.21.15.78:0/1875674795 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c04016070 con 0x55850b00be60 2024-09-17T03:15:08.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.387+0000 7f6c02ffd640 1 -- 172.21.15.78:0/1875674795 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c0400f800 con 0x55850b00be60 2024-09-17T03:15:08.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.387+0000 7f6c02ffd640 1 -- 172.21.15.78:0/1875674795 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0400fc70 con 0x55850b00be60 2024-09-17T03:15:08.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.388+0000 7f6c0f368f40 1 -- 172.21.15.78:0/1875674795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55850b00be60 msgr2=0x55850b0d6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.388+0000 7f6c0f368f40 1 --2- 172.21.15.78:0/1875674795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55850b00be60 0x55850b0d6b80 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f6c04001570 tx=0x7f6c04001a30 comp rx=0 tx=0).stop 2024-09-17T03:15:08.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.388+0000 7f6c0f368f40 1 -- 172.21.15.78:0/1875674795 shutdown_connections 2024-09-17T03:15:08.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.388+0000 7f6c0f368f40 1 --2- 172.21.15.78:0/1875674795 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55850b00be60 0x55850b0d6b80 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.388+0000 7f6c0f368f40 1 --2- 172.21.15.78:0/1875674795 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55850b009ea0 0x55850b034590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.388+0000 7f6c0f368f40 1 --2- 172.21.15.78:0/1875674795 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55850b0083d0 0x55850b0d2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.388+0000 7f6c0f368f40 1 -- 172.21.15.78:0/1875674795 >> 172.21.15.78:0/1875674795 conn(0x55850af2aac0 msgr2=0x55850b0d9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.388+0000 7f6c0f368f40 1 -- 172.21.15.78:0/1875674795 shutdown_connections 2024-09-17T03:15:08.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.388+0000 7f6c0f368f40 1 -- 172.21.15.78:0/1875674795 wait complete. 2024-09-17T03:15:08.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.389+0000 7f6c0f368f40 1 Processor -- start 2024-09-17T03:15:08.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.389+0000 7f6c0f368f40 1 -- start start 2024-09-17T03:15:08.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.390+0000 7f6c0f368f40 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55850b0083d0 0x55850b0dded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.390+0000 7f6c0f368f40 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55850b009ea0 0x55850b0d4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.390+0000 7f6c0f368f40 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55850b00be60 0x55850b0357d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.390+0000 7f6c0f368f40 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55850b0d2c80 con 0x55850b00be60 2024-09-17T03:15:08.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.390+0000 7f6c0f368f40 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55850b0d6760 con 0x55850b0083d0 2024-09-17T03:15:08.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.390+0000 7f6c0f368f40 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55850b0da390 con 0x55850b009ea0 2024-09-17T03:15:08.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.390+0000 7f6c09623640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55850b00be60 0x55850b0357d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.390+0000 7f6c09623640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55850b00be60 0x55850b0357d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50704/0 (socket says 172.21.15.78:50704) 2024-09-17T03:15:08.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.390+0000 7f6c09623640 1 -- 172.21.15.78:0/1164498645 learned_addr learned my addr 172.21.15.78:0/1164498645 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.390+0000 7f6c08e22640 1 --2- 172.21.15.78:0/1164498645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55850b0083d0 0x55850b0dded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.390+0000 7f6c03fff640 1 --2- 172.21.15.78:0/1164498645 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55850b009ea0 0x55850b0d4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.390+0000 7f6c09623640 1 -- 172.21.15.78:0/1164498645 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55850b009ea0 msgr2=0x55850b0d4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.390+0000 7f6c09623640 1 --2- 172.21.15.78:0/1164498645 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55850b009ea0 0x55850b0d4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.390+0000 7f6c09623640 1 -- 172.21.15.78:0/1164498645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55850b0083d0 msgr2=0x55850b0dded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.390+0000 7f6c09623640 1 --2- 172.21.15.78:0/1164498645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55850b0083d0 0x55850b0dded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.390+0000 7f6c09623640 1 -- 172.21.15.78:0/1164498645 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55850b00add0 con 0x55850b00be60 2024-09-17T03:15:08.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.390+0000 7f6c03fff640 1 --2- 172.21.15.78:0/1164498645 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55850b009ea0 0x55850b0d4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:08.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.390+0000 7f6c09623640 1 --2- 172.21.15.78:0/1164498645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55850b00be60 0x55850b0357d0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f6c04009040 tx=0x7f6c040116f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.391+0000 7f6c01ffb640 1 -- 172.21.15.78:0/1164498645 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c04021020 con 0x55850b00be60 2024-09-17T03:15:08.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.391+0000 7f6c01ffb640 1 -- 172.21.15.78:0/1164498645 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c0400f510 con 0x55850b00be60 2024-09-17T03:15:08.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.391+0000 7f6c0f368f40 1 -- 172.21.15.78:0/1164498645 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55850b0d1d20 con 0x55850b00be60 2024-09-17T03:15:08.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.391+0000 7f6c01ffb640 1 -- 172.21.15.78:0/1164498645 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c04016030 con 0x55850b00be60 2024-09-17T03:15:08.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.391+0000 7f6c0f368f40 1 -- 172.21.15.78:0/1164498645 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55850b0da990 con 0x55850b00be60 2024-09-17T03:15:08.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.392+0000 7f6c01ffb640 1 -- 172.21.15.78:0/1164498645 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6c04024020 con 0x55850b00be60 2024-09-17T03:15:08.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.393+0000 7f6c01ffb640 1 --2- 172.21.15.78:0/1164498645 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6bec077570 0x7f6bec079a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.393+0000 7f6c01ffb640 1 -- 172.21.15.78:0/1164498645 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f6c0409b120 con 0x55850b00be60 2024-09-17T03:15:08.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.393+0000 7f6c0f368f40 1 --2- 172.21.15.78:0/1164498645 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x55850b0d0ce0 0x55850b17a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.393+0000 7f6c0f368f40 1 -- 172.21.15.78:0/1164498645 --> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] -- osd_op(unknown.0.0:1 14.1d 14:bbf5850a:::10000000007.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e95) -- 0x55850b050b60 con 0x55850b0d0ce0 2024-09-17T03:15:08.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.393+0000 7f6c08e22640 1 --2- 172.21.15.78:0/1164498645 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6bec077570 0x7f6bec079a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.393+0000 7f6c03fff640 1 --2- 172.21.15.78:0/1164498645 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x55850b0d0ce0 0x55850b17a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.393+0000 7f6c08e22640 1 --2- 172.21.15.78:0/1164498645 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6bec077570 0x7f6bec079a80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00c640 tx=0x7f6bfc0049a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.394+0000 7f6c03fff640 1 --2- 172.21.15.78:0/1164498645 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x55850b0d0ce0 0x55850b17a8b0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.395+0000 7f6c03fff640 1 -- 172.21.15.78:0/1164498645 <== osd.0 v2:172.21.15.78:6816/3825297687 1 ==== osd_op_reply(1 10000000007.00000000 [rmxattr] v95'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6bf404ebe0 con 0x55850b0d0ce0 2024-09-17T03:15:08.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.395+0000 7f6c0f368f40 1 -- 172.21.15.78:0/1164498645 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x55850b0d0ce0 msgr2=0x55850b17a8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.395+0000 7f6c0f368f40 1 --2- 172.21.15.78:0/1164498645 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x55850b0d0ce0 0x55850b17a8b0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.395+0000 7f6c0f368f40 1 -- 172.21.15.78:0/1164498645 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6bec077570 msgr2=0x7f6bec079a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.395+0000 7f6c0f368f40 1 --2- 172.21.15.78:0/1164498645 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6bec077570 0x7f6bec079a80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00c640 tx=0x7f6bfc0049a0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.395+0000 7f6c0f368f40 1 -- 172.21.15.78:0/1164498645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55850b00be60 msgr2=0x55850b0357d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.395+0000 7f6c0f368f40 1 --2- 172.21.15.78:0/1164498645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55850b00be60 0x55850b0357d0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f6c04009040 tx=0x7f6c040116f0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.395+0000 7f6c09623640 1 -- 172.21.15.78:0/1164498645 reap_dead start 2024-09-17T03:15:08.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.395+0000 7f6c0f368f40 1 -- 172.21.15.78:0/1164498645 shutdown_connections 2024-09-17T03:15:08.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.395+0000 7f6c0f368f40 1 -- 172.21.15.78:0/1164498645 >> 172.21.15.78:0/1164498645 conn(0x55850af2aac0 msgr2=0x55850b0d7570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.395+0000 7f6c0f368f40 1 -- 172.21.15.78:0/1164498645 shutdown_connections 2024-09-17T03:15:08.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.395+0000 7f6c0f368f40 1 -- 172.21.15.78:0/1164498645 wait complete. 2024-09-17T03:15:08.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:08.398 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start /d1/d2/d3 recursive,force 2024-09-17T03:15:08.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.516+0000 7f23fb038640 1 -- 172.21.15.78:0/1221354966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23f40cb300 msgr2=0x7f23f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.516+0000 7f23fb038640 1 --2- 172.21.15.78:0/1221354966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23f40cb300 0x7f23f406edb0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f23f4069ea0 tx=0x7f23ec02a980 comp rx=0 tx=0).stop 2024-09-17T03:15:08.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.516+0000 7f23fb038640 1 -- 172.21.15.78:0/1221354966 shutdown_connections 2024-09-17T03:15:08.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.516+0000 7f23fb038640 1 --2- 172.21.15.78:0/1221354966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23f40cb300 0x7f23f406edb0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.516+0000 7f23fb038640 1 --2- 172.21.15.78:0/1221354966 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f23f415fb80 0x7f23f40cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.516+0000 7f23fb038640 1 --2- 172.21.15.78:0/1221354966 >> v2:172.21.15.193:3300/0 conn(0x7f23f40cc560 0x7f23f4073820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.516+0000 7f23fb038640 1 -- 172.21.15.78:0/1221354966 >> 172.21.15.78:0/1221354966 conn(0x7f23f40d0130 msgr2=0x7f23f40d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.516+0000 7f23fb038640 1 -- 172.21.15.78:0/1221354966 shutdown_connections 2024-09-17T03:15:08.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.516+0000 7f23fb038640 1 -- 172.21.15.78:0/1221354966 wait complete. 2024-09-17T03:15:08.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.517+0000 7f23fb038640 1 Processor -- start 2024-09-17T03:15:08.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.518+0000 7f23fb038640 1 -- start start 2024-09-17T03:15:08.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.519+0000 7f23fb038640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23f40cb300 0x7f23f409b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.519+0000 7f23fb038640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23f40cc560 0x7f23f41524d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.519+0000 7f23fb038640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f23f415fb80 0x7f23f409c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.519+0000 7f23fb038640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f23f406f700 con 0x7f23f40cc560 2024-09-17T03:15:08.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.519+0000 7f23fb038640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f23f406f580 con 0x7f23f40cb300 2024-09-17T03:15:08.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.519+0000 7f23fb038640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f23f406f880 con 0x7f23f415fb80 2024-09-17T03:15:08.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.519+0000 7f23f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23f40cc560 0x7f23f41524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.519+0000 7f23f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23f40cc560 0x7f23f41524d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50716/0 (socket says 172.21.15.78:50716) 2024-09-17T03:15:08.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.519+0000 7f23f3fff640 1 -- 172.21.15.78:0/661026477 learned_addr learned my addr 172.21.15.78:0/661026477 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.519+0000 7f23f95d5640 1 --2- 172.21.15.78:0/661026477 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f23f415fb80 0x7f23f409c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.519+0000 7f23f8dd4640 1 --2- 172.21.15.78:0/661026477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23f40cb300 0x7f23f409b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.519+0000 7f23f3fff640 1 -- 172.21.15.78:0/661026477 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f23f415fb80 msgr2=0x7f23f409c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.519+0000 7f23f3fff640 1 --2- 172.21.15.78:0/661026477 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f23f415fb80 0x7f23f409c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.519+0000 7f23f3fff640 1 -- 172.21.15.78:0/661026477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23f40cb300 msgr2=0x7f23f409b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.519+0000 7f23f3fff640 1 --2- 172.21.15.78:0/661026477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23f40cb300 0x7f23f409b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.519+0000 7f23f3fff640 1 -- 172.21.15.78:0/661026477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f4152a10 con 0x7f23f40cc560 2024-09-17T03:15:08.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.519+0000 7f23f8dd4640 1 --2- 172.21.15.78:0/661026477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23f40cb300 0x7f23f409b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:08.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.520+0000 7f23f3fff640 1 --2- 172.21.15.78:0/661026477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23f40cc560 0x7f23f41524d0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f23e800d750 tx=0x7f23e800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.520+0000 7f23f17fa640 1 -- 172.21.15.78:0/661026477 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e8017070 con 0x7f23f40cc560 2024-09-17T03:15:08.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.520+0000 7f23fb038640 1 -- 172.21.15.78:0/661026477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23f409bc90 con 0x7f23f40cc560 2024-09-17T03:15:08.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.520+0000 7f23f17fa640 1 -- 172.21.15.78:0/661026477 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23e8004310 con 0x7f23f40cc560 2024-09-17T03:15:08.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.520+0000 7f23f17fa640 1 -- 172.21.15.78:0/661026477 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e8005280 con 0x7f23f40cc560 2024-09-17T03:15:08.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.520+0000 7f23fb038640 1 -- 172.21.15.78:0/661026477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23f409c250 con 0x7f23f40cc560 2024-09-17T03:15:08.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.522+0000 7f23f17fa640 1 -- 172.21.15.78:0/661026477 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f23e8005420 con 0x7f23f40cc560 2024-09-17T03:15:08.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.523+0000 7f23f17fa640 1 --2- 172.21.15.78:0/661026477 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f23e0078b90 0x7f23e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.523+0000 7f23f17fa640 1 -- 172.21.15.78:0/661026477 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f23e809b0c0 con 0x7f23f40cc560 2024-09-17T03:15:08.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.523+0000 7f23f8dd4640 1 --2- 172.21.15.78:0/661026477 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f23e0078b90 0x7f23e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.523+0000 7f2402084740 1 Processor -- start 2024-09-17T03:15:08.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.523+0000 7f2402084740 1 -- start start 2024-09-17T03:15:08.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.523+0000 7f23f8dd4640 1 --2- 172.21.15.78:0/661026477 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f23e0078b90 0x7f23e007b0a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f23e4009b00 tx=0x7f23e4005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.524+0000 7f2402084740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80f9680 0x55b2b84bb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.525+0000 7f2402084740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80d07c0 0x55b2b84e70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.525+0000 7f2402084740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b2b80d89a0 0x55b2b84c8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.525+0000 7f2402084740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55b2b84140b0 con 0x55b2b80f9680 2024-09-17T03:15:08.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.525+0000 7f2402084740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b2b84034e0 con 0x55b2b80d07c0 2024-09-17T03:15:08.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.525+0000 7f2402084740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55b2b84072f0 con 0x55b2b80d89a0 2024-09-17T03:15:08.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.525+0000 7f23f8dd4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80f9680 0x55b2b84bb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.525+0000 7f23f8dd4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80f9680 0x55b2b84bb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50726/0 (socket says 172.21.15.78:50726) 2024-09-17T03:15:08.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.525+0000 7f23f8dd4640 1 -- 172.21.15.78:0/2344052375 learned_addr learned my addr 172.21.15.78:0/2344052375 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.525+0000 7f23f95d5640 1 --2- 172.21.15.78:0/2344052375 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b2b80d89a0 0x55b2b84c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.525+0000 7f23f3fff640 1 --2- 172.21.15.78:0/2344052375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80d07c0 0x55b2b84e70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.525+0000 7f23f8dd4640 1 -- 172.21.15.78:0/2344052375 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b2b80d89a0 msgr2=0x55b2b84c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.525+0000 7f23f8dd4640 1 --2- 172.21.15.78:0/2344052375 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b2b80d89a0 0x55b2b84c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.525+0000 7f23f8dd4640 1 -- 172.21.15.78:0/2344052375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80d07c0 msgr2=0x55b2b84e70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.525+0000 7f23f8dd4640 1 --2- 172.21.15.78:0/2344052375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80d07c0 0x55b2b84e70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.525+0000 7f23f8dd4640 1 -- 172.21.15.78:0/2344052375 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2b81d9a50 con 0x55b2b80f9680 2024-09-17T03:15:08.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.525+0000 7f23f8dd4640 1 --2- 172.21.15.78:0/2344052375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80f9680 0x55b2b84bb550 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f23e4011f70 tx=0x7f23e4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18e98dd2b750062 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.525+0000 7f23da7fc640 1 -- 172.21.15.78:0/2344052375 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e401f620 con 0x55b2b80f9680 2024-09-17T03:15:08.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.525+0000 7f23da7fc640 1 -- 172.21.15.78:0/2344052375 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23e401f8b0 con 0x55b2b80f9680 2024-09-17T03:15:08.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.525+0000 7f23da7fc640 1 -- 172.21.15.78:0/2344052375 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e401fc60 con 0x55b2b80f9680 2024-09-17T03:15:08.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.526+0000 7f2402084740 1 -- 172.21.15.78:0/2344052375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80f9680 msgr2=0x55b2b84bb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.526+0000 7f2402084740 1 --2- 172.21.15.78:0/2344052375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80f9680 0x55b2b84bb550 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f23e4011f70 tx=0x7f23e4014000 comp rx=0 tx=0).stop 2024-09-17T03:15:08.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.526+0000 7f2402084740 1 -- 172.21.15.78:0/2344052375 shutdown_connections 2024-09-17T03:15:08.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.526+0000 7f2402084740 1 --2- 172.21.15.78:0/2344052375 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b2b80d89a0 0x55b2b84c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.526+0000 7f2402084740 1 --2- 172.21.15.78:0/2344052375 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80d07c0 0x55b2b84e70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.526+0000 7f2402084740 1 --2- 172.21.15.78:0/2344052375 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80f9680 0x55b2b84bb550 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.526+0000 7f2402084740 1 -- 172.21.15.78:0/2344052375 >> 172.21.15.78:0/2344052375 conn(0x55b2b80ed7d0 msgr2=0x55b2b84a1430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.526+0000 7f2402084740 1 -- 172.21.15.78:0/2344052375 shutdown_connections 2024-09-17T03:15:08.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.526+0000 7f2402084740 1 -- 172.21.15.78:0/2344052375 wait complete. 2024-09-17T03:15:08.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.527+0000 7f2402084740 1 -- start start 2024-09-17T03:15:08.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.527+0000 7f2402084740 1 Processor -- start 2024-09-17T03:15:08.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f2402084740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d07c0 0x55b2b84fa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f2402084740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80d89a0 0x55b2b84fd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f2402084740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b2b80f9680 0x55b2b84ca240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f2402084740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55b2b8173a30 con 0x55b2b80d07c0 2024-09-17T03:15:08.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f2402084740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55b2b83899d0 con 0x55b2b80d89a0 2024-09-17T03:15:08.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f2402084740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55b2b84ba7f0 con 0x55b2b80f9680 2024-09-17T03:15:08.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f2402084740 10 client.0 _ll_register_callbacks cb 0x55b2b83fdac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:08.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f23f8dd4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d07c0 0x55b2b84fa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f23f8dd4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d07c0 0x55b2b84fa3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50742/0 (socket says 172.21.15.78:50742) 2024-09-17T03:15:08.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f23f8dd4640 1 -- 172.21.15.78:0/3973943707 learned_addr learned my addr 172.21.15.78:0/3973943707 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f23f3fff640 1 --2- 172.21.15.78:0/3973943707 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80d89a0 0x55b2b84fd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f23f95d5640 1 --2- 172.21.15.78:0/3973943707 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b2b80f9680 0x55b2b84ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f23f8dd4640 1 -- 172.21.15.78:0/3973943707 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b2b80f9680 msgr2=0x55b2b84ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f23f8dd4640 1 --2- 172.21.15.78:0/3973943707 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b2b80f9680 0x55b2b84ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f23f8dd4640 1 -- 172.21.15.78:0/3973943707 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80d89a0 msgr2=0x55b2b84fd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f23f8dd4640 1 --2- 172.21.15.78:0/3973943707 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80d89a0 0x55b2b84fd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f23f8dd4640 1 -- 172.21.15.78:0/3973943707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2b8142990 con 0x55b2b80d07c0 2024-09-17T03:15:08.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f23f8dd4640 1 --2- 172.21.15.78:0/3973943707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d07c0 0x55b2b84fa3e0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f23e40098e0 tx=0x7f23e40093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb51e8bd8fcdaa5 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f23d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:08.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f23d37fe640 1 -- 172.21.15.78:0/3973943707 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e401fdf0 con 0x55b2b80d07c0 2024-09-17T03:15:08.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f23d37fe640 1 -- 172.21.15.78:0/3973943707 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f23e4032ad0 con 0x55b2b80d07c0 2024-09-17T03:15:08.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.529+0000 7f2402084740 1 -- 172.21.15.78:0/3973943707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23e401f8b0 con 0x55b2b80d07c0 2024-09-17T03:15:08.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.530+0000 7f23d37fe640 1 -- 172.21.15.78:0/3973943707 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f23e4032cd0 con 0x55b2b80d07c0 2024-09-17T03:15:08.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.530+0000 7f2402084740 10 client.8637 fetch_fsmap learned FSMap version 100 2024-09-17T03:15:08.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.530+0000 7f2402084740 1 -- 172.21.15.78:0/3973943707 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x55b2b823a1e0 con 0x55b2b80d07c0 2024-09-17T03:15:08.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.530+0000 7f23d37fe640 1 -- 172.21.15.78:0/3973943707 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23e401f8b0 con 0x55b2b80d07c0 2024-09-17T03:15:08.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.530+0000 7f23d37fe640 1 -- 172.21.15.78:0/3973943707 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 100) ==== 3554+0+0 (secure 0 0 0) 0x7f23e4039050 con 0x55b2b80d07c0 2024-09-17T03:15:08.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.530+0000 7f2402084740 10 client.8637 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T03:15:08.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.530+0000 7f2402084740 10 client.8637 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T03:15:08.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.530+0000 7f2402084740 20 client.8637 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:08.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.530+0000 7f2402084740 1 --2- 172.21.15.78:0/3973943707 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55b2b80b8250 0x55b2b84cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.530+0000 7f2402084740 4 client.8637 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:08.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.530+0000 7f2402084740 1 -- 172.21.15.78:0/3973943707 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2b8416000 con 0x55b2b80b8250 2024-09-17T03:15:08.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.530+0000 7f23f3fff640 1 --2- 172.21.15.78:0/3973943707 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55b2b80b8250 0x55b2b84cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.530+0000 7f23d37fe640 10 client.8637 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:08.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.530+0000 7f23f3fff640 1 --2- 172.21.15.78:0/3973943707 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55b2b80b8250 0x55b2b84cdae0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2836fd3fc381383 server_cookie=aadb9073be659855 in_seq=0 out_seq=0 2024-09-17T03:15:08.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.531+0000 7f23d37fe640 1 -- 172.21.15.78:0/3973943707 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b2b8416000 con 0x55b2b80b8250 2024-09-17T03:15:08.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.531+0000 7f23d37fe640 10 client.8637 handle_command_reply: tid=0 2024-09-17T03:15:08.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.531+0000 7f2402084740 1 client.8637 shutdown 2024-09-17T03:15:08.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.531+0000 7f2402084740 1 -- 172.21.15.78:0/3973943707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d07c0 msgr2=0x55b2b84fa3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.531+0000 7f2402084740 1 --2- 172.21.15.78:0/3973943707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d07c0 0x55b2b84fa3e0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f23e40098e0 tx=0x7f23e40093e0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.531+0000 7f2402084740 1 -- 172.21.15.78:0/3973943707 shutdown_connections 2024-09-17T03:15:08.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.531+0000 7f2402084740 1 --2- 172.21.15.78:0/3973943707 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b2b80f9680 0x55b2b84ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.531+0000 7f2402084740 1 --2- 172.21.15.78:0/3973943707 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55b2b80b8250 0x55b2b84cdae0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.531+0000 7f2402084740 1 --2- 172.21.15.78:0/3973943707 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80d89a0 0x55b2b84fd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.531+0000 7f2402084740 1 --2- 172.21.15.78:0/3973943707 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d07c0 0x55b2b84fa3e0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.531+0000 7f23d37fe640 0 client.8637 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:08.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.531+0000 7f2402084740 1 -- 172.21.15.78:0/3973943707 >> 172.21.15.78:0/3973943707 conn(0x55b2b80ed7d0 msgr2=0x55b2b84e6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.531+0000 7f2402084740 1 -- 172.21.15.78:0/3973943707 shutdown_connections 2024-09-17T03:15:08.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.531+0000 7f2402084740 1 -- 172.21.15.78:0/3973943707 wait complete. 2024-09-17T03:15:08.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.532+0000 7f2402084740 20 client.8637 trim_cache size 0 max 16384 2024-09-17T03:15:08.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.549+0000 7f2402084740 1 Processor -- start 2024-09-17T03:15:08.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.549+0000 7f2402084740 1 -- start start 2024-09-17T03:15:08.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.550+0000 7f2402084740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b2b80d07c0 0x55b2b84ba660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.550+0000 7f2402084740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d89a0 0x55b2b84efdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.550+0000 7f2402084740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80f9680 0x55b2b84f0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.550+0000 7f2402084740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f23f41fde70 con 0x55b2b80d89a0 2024-09-17T03:15:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.550+0000 7f2402084740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f23f40cf3d0 con 0x55b2b80f9680 2024-09-17T03:15:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.550+0000 7f2402084740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f23f40cfa90 con 0x55b2b80d07c0 2024-09-17T03:15:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.551+0000 7f23f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d89a0 0x55b2b84efdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.551+0000 7f23f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d89a0 0x55b2b84efdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50752/0 (socket says 172.21.15.78:50752) 2024-09-17T03:15:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.551+0000 7f23f3fff640 1 -- 172.21.15.78:0/598709627 learned_addr learned my addr 172.21.15.78:0/598709627 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.551+0000 7f23f3fff640 1 -- 172.21.15.78:0/598709627 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b2b80d07c0 msgr2=0x55b2b84ba660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.551+0000 7f23f3fff640 1 --2- 172.21.15.78:0/598709627 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b2b80d07c0 0x55b2b84ba660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.551+0000 7f23f3fff640 1 -- 172.21.15.78:0/598709627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80f9680 msgr2=0x55b2b84f0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.551+0000 7f23f95d5640 1 --2- 172.21.15.78:0/598709627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80f9680 0x55b2b84f0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.551+0000 7f23f3fff640 1 --2- 172.21.15.78:0/598709627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80f9680 0x55b2b84f0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.551+0000 7f23f3fff640 1 -- 172.21.15.78:0/598709627 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2b81d7d50 con 0x55b2b80d89a0 2024-09-17T03:15:08.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.551+0000 7f23f95d5640 1 --2- 172.21.15.78:0/598709627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80f9680 0x55b2b84f0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:08.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.551+0000 7f23f3fff640 1 --2- 172.21.15.78:0/598709627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d89a0 0x55b2b84efdc0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f23e8062a80 tx=0x7f23e8085040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417235ed5c9d273c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.551+0000 7f23d9ffb640 1 -- 172.21.15.78:0/598709627 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e8062d80 con 0x55b2b80d89a0 2024-09-17T03:15:08.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.551+0000 7f23d9ffb640 1 -- 172.21.15.78:0/598709627 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23e806c7a0 con 0x55b2b80d89a0 2024-09-17T03:15:08.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.551+0000 7f23d9ffb640 1 -- 172.21.15.78:0/598709627 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e805f080 con 0x55b2b80d89a0 2024-09-17T03:15:08.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.552+0000 7f2402084740 1 -- 172.21.15.78:0/598709627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d89a0 msgr2=0x55b2b84efdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.552+0000 7f2402084740 1 --2- 172.21.15.78:0/598709627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d89a0 0x55b2b84efdc0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f23e8062a80 tx=0x7f23e8085040 comp rx=0 tx=0).stop 2024-09-17T03:15:08.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.552+0000 7f2402084740 1 -- 172.21.15.78:0/598709627 shutdown_connections 2024-09-17T03:15:08.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.552+0000 7f2402084740 1 --2- 172.21.15.78:0/598709627 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80f9680 0x55b2b84f0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.552+0000 7f2402084740 1 --2- 172.21.15.78:0/598709627 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d89a0 0x55b2b84efdc0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.552+0000 7f2402084740 1 --2- 172.21.15.78:0/598709627 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b2b80d07c0 0x55b2b84ba660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.552+0000 7f2402084740 1 -- 172.21.15.78:0/598709627 >> 172.21.15.78:0/598709627 conn(0x55b2b80ed7d0 msgr2=0x55b2b849bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.552+0000 7f2402084740 1 -- 172.21.15.78:0/598709627 shutdown_connections 2024-09-17T03:15:08.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.552+0000 7f2402084740 1 -- 172.21.15.78:0/598709627 wait complete. 2024-09-17T03:15:08.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.553+0000 7f2402084740 1 -- start start 2024-09-17T03:15:08.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.553+0000 7f2402084740 1 Processor -- start 2024-09-17T03:15:08.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.554+0000 7f2402084740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b2b80d07c0 0x55b2b8569fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.554+0000 7f2402084740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d89a0 0x55b2b856db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.554+0000 7f2402084740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80f9680 0x55b2b849b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.554+0000 7f2402084740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55b2b84fc580 con 0x55b2b80d89a0 2024-09-17T03:15:08.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.554+0000 7f2402084740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f23f41f77b0 con 0x55b2b80f9680 2024-09-17T03:15:08.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.554+0000 7f2402084740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55b2b84a1cf0 con 0x55b2b80d07c0 2024-09-17T03:15:08.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.554+0000 7f2402084740 10 client.0 _ll_register_callbacks cb 0x7f23e8004560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:08.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.554+0000 7f23f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d89a0 0x55b2b856db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.554+0000 7f23f3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d89a0 0x55b2b856db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50758/0 (socket says 172.21.15.78:50758) 2024-09-17T03:15:08.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.554+0000 7f23f3fff640 1 -- 172.21.15.78:0/1691645834 learned_addr learned my addr 172.21.15.78:0/1691645834 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f23f8dd4640 1 --2- 172.21.15.78:0/1691645834 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b2b80d07c0 0x55b2b8569fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f23f95d5640 1 --2- 172.21.15.78:0/1691645834 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80f9680 0x55b2b849b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f23f3fff640 1 -- 172.21.15.78:0/1691645834 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b2b80d07c0 msgr2=0x55b2b8569fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f23f3fff640 1 --2- 172.21.15.78:0/1691645834 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b2b80d07c0 0x55b2b8569fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f23f3fff640 1 -- 172.21.15.78:0/1691645834 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80f9680 msgr2=0x55b2b849b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f23f3fff640 1 --2- 172.21.15.78:0/1691645834 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80f9680 0x55b2b849b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f23f3fff640 1 -- 172.21.15.78:0/1691645834 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2b856e0b0 con 0x55b2b80d89a0 2024-09-17T03:15:08.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f23f3fff640 1 --2- 172.21.15.78:0/1691645834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d89a0 0x55b2b856db70 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f23e8018000 tx=0x7f23e8022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591625b915b5f474 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f23d37fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:08.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f23d37fe640 1 -- 172.21.15.78:0/1691645834 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e805f080 con 0x55b2b80d89a0 2024-09-17T03:15:08.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f23d37fe640 1 -- 172.21.15.78:0/1691645834 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f23e804e180 con 0x55b2b80d89a0 2024-09-17T03:15:08.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f2402084740 1 -- 172.21.15.78:0/1691645834 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23e806c7a0 con 0x55b2b80d89a0 2024-09-17T03:15:08.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f23d37fe640 1 -- 172.21.15.78:0/1691645834 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f23e805f220 con 0x55b2b80d89a0 2024-09-17T03:15:08.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f2402084740 10 client.8643 fetch_fsmap learned FSMap version 100 2024-09-17T03:15:08.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f2402084740 1 -- 172.21.15.78:0/1691645834 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x55b2b84c2240 con 0x55b2b80d89a0 2024-09-17T03:15:08.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f23d37fe640 1 -- 172.21.15.78:0/1691645834 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23e806c7a0 con 0x55b2b80d89a0 2024-09-17T03:15:08.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f23d37fe640 1 -- 172.21.15.78:0/1691645834 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 100) ==== 3554+0+0 (secure 0 0 0) 0x7f23e80850b0 con 0x55b2b80d89a0 2024-09-17T03:15:08.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f2402084740 10 client.8643 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T03:15:08.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f2402084740 10 client.8643 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T03:15:08.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f2402084740 20 client.8643 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:08.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f2402084740 1 --2- 172.21.15.78:0/1691645834 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55b2b850d910 0x55b2b84efdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f2402084740 4 client.8643 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}] 2024-09-17T03:15:08.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.555+0000 7f2402084740 1 -- 172.21.15.78:0/1691645834 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "scrub start", "path": "/d1/d2/d3", "scrubops": ["recursive", "force"]}) -- 0x55b2b84df580 con 0x55b2b850d910 2024-09-17T03:15:08.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.556+0000 7f23f8dd4640 1 --2- 172.21.15.78:0/1691645834 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55b2b850d910 0x55b2b84efdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.556+0000 7f23d37fe640 10 client.8643 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:08.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.556+0000 7f23f8dd4640 1 --2- 172.21.15.78:0/1691645834 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55b2b850d910 0x55b2b84efdc0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce98fbd8011bb8d8 server_cookie=efb4183ff27b8a83 in_seq=0 out_seq=0 2024-09-17T03:15:08.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.557+0000 7f23d37fe640 1 -- 172.21.15.78:0/1691645834 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b2b84df580 con 0x55b2b850d910 2024-09-17T03:15:08.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.557+0000 7f23d37fe640 10 client.8643 handle_command_reply: tid=0 2024-09-17T03:15:08.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.557+0000 7f2402084740 1 client.8643 shutdown 2024-09-17T03:15:08.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.557+0000 7f2402084740 1 -- 172.21.15.78:0/1691645834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d89a0 msgr2=0x55b2b856db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.564 INFO:tasks.ceph.mds.c.smithi078.stderr:2024-09-17T03:15:08.557+0000 7f4bf616f640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-17T03:14:51.062943+0000 1=0+1) n(v3 rc2024-09-17T03:14:51.297939+0000 6=0+6) (inest mix dirty) (ifile excl) caps={8433=pAsLsXsFsx/pAsLsXsFsxcral@4},l=8433 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55a1f171d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:14:51.062943+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:14:51.297939+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-17T03:14:51.062943+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-17T03:14:51.297939+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-17T03:15:08.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.557+0000 7f2402084740 1 --2- 172.21.15.78:0/1691645834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d89a0 0x55b2b856db70 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f23e8018000 tx=0x7f23e8022000 comp rx=0 tx=0).stop 2024-09-17T03:15:08.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.557+0000 7f2402084740 1 -- 172.21.15.78:0/1691645834 shutdown_connections 2024-09-17T03:15:08.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.557+0000 7f2402084740 1 --2- 172.21.15.78:0/1691645834 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55b2b850d910 0x55b2b84efdc0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.557+0000 7f2402084740 1 --2- 172.21.15.78:0/1691645834 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55b2b80f9680 0x55b2b849b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.557+0000 7f23d37fe640 0 client.8643 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:08.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.557+0000 7f2402084740 1 --2- 172.21.15.78:0/1691645834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55b2b80d89a0 0x55b2b856db70 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.557+0000 7f2402084740 1 --2- 172.21.15.78:0/1691645834 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55b2b80d07c0 0x55b2b8569fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.557+0000 7f2402084740 1 -- 172.21.15.78:0/1691645834 >> 172.21.15.78:0/1691645834 conn(0x55b2b80ed7d0 msgr2=0x55b2b84ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.557+0000 7f2402084740 1 -- 172.21.15.78:0/1691645834 shutdown_connections 2024-09-17T03:15:08.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.557+0000 7f2402084740 1 -- 172.21.15.78:0/1691645834 wait complete. 2024-09-17T03:15:08.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.557+0000 7f2402084740 20 client.8643 trim_cache size 0 max 16384 2024-09-17T03:15:08.567 INFO:tasks.ceph.mds.a.smithi078.stderr:2024-09-17T03:15:08.557+0000 7f2693f32640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-17T03:14:51.063943+0000 1=0+1) n(v2 rc2024-09-17T03:14:51.297939+0000 4=0+4) (inest lock) (ifile excl) caps={8433=pAsLsXsFsx/pAsLsXsFsxcral@4},l=8433 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x55d16fba8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:14:51.063943+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:14:51.297939+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-17T03:14:51.063943+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-17T03:14:51.297939+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-17T03:15:08.568 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:08.568 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0, 2024-09-17T03:15:08.568 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_tag": "0d177712-01a0-4dfb-8f16-2e7c84183356", 2024-09-17T03:15:08.568 INFO:teuthology.orchestra.run.smithi078.stdout: "mode": "asynchronous" 2024-09-17T03:15:08.568 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:08.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.558+0000 7f23fb038640 1 -- 172.21.15.78:0/661026477 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f23e0078b90 msgr2=0x7f23e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.558+0000 7f23fb038640 1 --2- 172.21.15.78:0/661026477 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f23e0078b90 0x7f23e007b0a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f23e4009b00 tx=0x7f23e4005f90 comp rx=0 tx=0).stop 2024-09-17T03:15:08.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.558+0000 7f23fb038640 1 -- 172.21.15.78:0/661026477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23f40cc560 msgr2=0x7f23f41524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.558+0000 7f23fb038640 1 --2- 172.21.15.78:0/661026477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23f40cc560 0x7f23f41524d0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f23e800d750 tx=0x7f23e800dc10 comp rx=0 tx=0).stop 2024-09-17T03:15:08.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.558+0000 7f23fb038640 1 -- 172.21.15.78:0/661026477 shutdown_connections 2024-09-17T03:15:08.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.558+0000 7f23fb038640 1 --2- 172.21.15.78:0/661026477 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f23f415fb80 0x7f23f409c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.558+0000 7f23fb038640 1 --2- 172.21.15.78:0/661026477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23f40cc560 0x7f23f41524d0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.558+0000 7f23fb038640 1 --2- 172.21.15.78:0/661026477 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f23e0078b90 0x7f23e007b0a0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.558+0000 7f23fb038640 1 --2- 172.21.15.78:0/661026477 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f23f40cb300 0x7f23f409b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.558+0000 7f23fb038640 1 -- 172.21.15.78:0/661026477 >> 172.21.15.78:0/661026477 conn(0x7f23f40d0130 msgr2=0x7f23f415e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.558+0000 7f23fb038640 1 -- 172.21.15.78:0/661026477 shutdown_connections 2024-09-17T03:15:08.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.558+0000 7f23fb038640 1 -- 172.21.15.78:0/661026477 wait complete. 2024-09-17T03:15:08.570 INFO:tasks.ceph.mds.c.smithi078.stderr:2024-09-17T03:15:08.559+0000 7f4bfc97c640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-17T03:14:51.063943+0000 1=0+1) n(v4 rc2024-09-17T03:14:51.297939+0000 5=0+5) (inest sync->mix g=1,2) caps={8433=pAsLsXsFs/pAsLsXsFsxcral@8} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55a1f171d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:14:51.063943+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:14:51.297939+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-17T03:14:51.063943+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-17T03:14:51.297939+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-17T03:15:08.571 INFO:tasks.ceph.mds.a.smithi078.stderr:2024-09-17T03:15:08.559+0000 7f269a73f640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-17T03:14:51.064943+0000 1=0+1) n(v1 rc2024-09-17T03:14:51.297939+0000 3=0+3) (inest sync->mix g=0,2 scatter_wanted) caps={8433=pAsLsXsFs/pAsLsXsFsxcral@7} | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x55d16fba8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:14:51.064943+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:14:51.064943+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-17T03:14:51.064943+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-17T03:14:51.297939+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-17T03:15:08.571 INFO:tasks.ceph.mds.d.smithi193.stderr:2024-09-17T03:15:08.558+0000 7f08d87ef640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-17T03:14:51.064943+0000 1=0+1) n(v0 rc2024-09-17T03:14:51.064943+0000 2=0+2) (inest lock) (ifile excl) caps={8433=pAsLsXsFsx/pAsLsXsFsxcral@4},l=8433 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x564fb2198c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:14:51.064943+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:14:51.064943+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-17T03:14:51.064943+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-17T03:14:51.064943+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-17T03:15:08.571 INFO:tasks.ceph.mds.d.smithi193.stderr:2024-09-17T03:15:08.558+0000 7f08d87ef640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) caps={8433=pAsLsXsFsx/AsLsXsFsx@2},l=8433 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x564fb2199700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-17T03:15:08.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:08.572 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub pause 2024-09-17T03:15:08.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.689+0000 7f420c0d3640 1 -- 172.21.15.78:0/3280636617 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42040701b0 msgr2=0x7f420415c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.689+0000 7f420c0d3640 1 --2- 172.21.15.78:0/3280636617 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42040701b0 0x7f420415c570 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4200005fd0 tx=0x7f420002aac0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.689+0000 7f420c0d3640 1 -- 172.21.15.78:0/3280636617 shutdown_connections 2024-09-17T03:15:08.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.689+0000 7f420c0d3640 1 --2- 172.21.15.78:0/3280636617 >> v2:172.21.15.193:3300/0 conn(0x7f420406cde0 0x7f420406d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.689+0000 7f420c0d3640 1 --2- 172.21.15.78:0/3280636617 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42040701b0 0x7f420415c570 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.689+0000 7f420c0d3640 1 -- 172.21.15.78:0/3280636617 >> 172.21.15.78:0/3280636617 conn(0x7f42040cdcb0 msgr2=0x7f42040ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.689+0000 7f420c0d3640 1 -- 172.21.15.78:0/3280636617 shutdown_connections 2024-09-17T03:15:08.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.689+0000 7f420c0d3640 1 -- 172.21.15.78:0/3280636617 wait complete. 2024-09-17T03:15:08.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.691+0000 7f420c0d3640 1 Processor -- start 2024-09-17T03:15:08.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.691+0000 7f420c0d3640 1 -- start start 2024-09-17T03:15:08.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.692+0000 7f420c0d3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f420406cde0 0x7f42040c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.692+0000 7f420c0d3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42040701b0 0x7f42041f9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.692+0000 7f420c0d3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f420415f9f0 0x7f42040c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.692+0000 7f420c0d3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f42040b3350 con 0x7f420415f9f0 2024-09-17T03:15:08.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.692+0000 7f420c0d3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f42040b31d0 con 0x7f42040701b0 2024-09-17T03:15:08.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.692+0000 7f420c0d3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f42040b34d0 con 0x7f420406cde0 2024-09-17T03:15:08.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.692+0000 7f420a670640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f420415f9f0 0x7f42040c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.692+0000 7f420a670640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f420415f9f0 0x7f42040c6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50768/0 (socket says 172.21.15.78:50768) 2024-09-17T03:15:08.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.692+0000 7f4209e6f640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f420406cde0 0x7f42040c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.692+0000 7f420a670640 1 -- 172.21.15.78:0/3182352107 learned_addr learned my addr 172.21.15.78:0/3182352107 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.692+0000 7f420966e640 1 --2- 172.21.15.78:0/3182352107 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42040701b0 0x7f42041f9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.692+0000 7f420a670640 1 -- 172.21.15.78:0/3182352107 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f420406cde0 msgr2=0x7f42040c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.692+0000 7f420a670640 1 --2- 172.21.15.78:0/3182352107 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f420406cde0 0x7f42040c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.692+0000 7f420a670640 1 -- 172.21.15.78:0/3182352107 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42040701b0 msgr2=0x7f42041f9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.692+0000 7f420a670640 1 --2- 172.21.15.78:0/3182352107 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42040701b0 0x7f42041f9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.692+0000 7f420a670640 1 -- 172.21.15.78:0/3182352107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42041f5d50 con 0x7f420415f9f0 2024-09-17T03:15:08.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.692+0000 7f4209e6f640 1 --2- 172.21.15.78:0/3182352107 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f420406cde0 0x7f42040c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:15:08.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.692+0000 7f420966e640 1 --2- 172.21.15.78:0/3182352107 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42040701b0 0x7f42041f9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:15:08.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.693+0000 7f420a670640 1 --2- 172.21.15.78:0/3182352107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f420415f9f0 0x7f42040c6f30 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00e700 tx=0x7f41fc00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.693+0000 7f41fa7fc640 1 -- 172.21.15.78:0/3182352107 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc00cab0 con 0x7f420415f9f0 2024-09-17T03:15:08.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.693+0000 7f420c0d3640 1 -- 172.21.15.78:0/3182352107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42041f6010 con 0x7f420415f9f0 2024-09-17T03:15:08.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.693+0000 7f41fa7fc640 1 -- 172.21.15.78:0/3182352107 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f41fc00cc50 con 0x7f420415f9f0 2024-09-17T03:15:08.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.693+0000 7f41fa7fc640 1 -- 172.21.15.78:0/3182352107 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc005020 con 0x7f420415f9f0 2024-09-17T03:15:08.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.693+0000 7f420c0d3640 1 -- 172.21.15.78:0/3182352107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42041f65d0 con 0x7f420415f9f0 2024-09-17T03:15:08.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.695+0000 7f41fa7fc640 1 -- 172.21.15.78:0/3182352107 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f41fc0051c0 con 0x7f420415f9f0 2024-09-17T03:15:08.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.695+0000 7f41fa7fc640 1 --2- 172.21.15.78:0/3182352107 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f41e8078b90 0x7f41e807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.695+0000 7f41fa7fc640 1 -- 172.21.15.78:0/3182352107 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f41fc09b5f0 con 0x7f420415f9f0 2024-09-17T03:15:08.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.696+0000 7f4209e6f640 1 --2- 172.21.15.78:0/3182352107 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f41e8078b90 0x7f41e807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.696+0000 7f4209e6f640 1 --2- 172.21.15.78:0/3182352107 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f41e8078b90 0x7f41e807b0a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4200035000 tx=0x7f4200038040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.696+0000 7f4213045740 1 Processor -- start 2024-09-17T03:15:08.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.696+0000 7f4213045740 1 -- start start 2024-09-17T03:15:08.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.697+0000 7f4213045740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff04154390 0x55ff04542b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.697+0000 7f4213045740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff0412b4d0 0x55ff04525830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.697+0000 7f4213045740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041336b0 0x55ff04525d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.697+0000 7f4213045740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ff0446ebd0 con 0x55ff04154390 2024-09-17T03:15:08.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.697+0000 7f4213045740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ff0445e000 con 0x55ff041336b0 2024-09-17T03:15:08.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.697+0000 7f4213045740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ff04461e10 con 0x55ff0412b4d0 2024-09-17T03:15:08.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.698+0000 7f4209e6f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff04154390 0x55ff04542b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.698+0000 7f4209e6f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff04154390 0x55ff04542b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50784/0 (socket says 172.21.15.78:50784) 2024-09-17T03:15:08.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.698+0000 7f4209e6f640 1 -- 172.21.15.78:0/3937995608 learned_addr learned my addr 172.21.15.78:0/3937995608 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.698+0000 7f420966e640 1 --2- 172.21.15.78:0/3937995608 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff0412b4d0 0x55ff04525830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.698+0000 7f420a670640 1 --2- 172.21.15.78:0/3937995608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041336b0 0x55ff04525d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.698+0000 7f4209e6f640 1 -- 172.21.15.78:0/3937995608 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff0412b4d0 msgr2=0x55ff04525830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.698+0000 7f4209e6f640 1 --2- 172.21.15.78:0/3937995608 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff0412b4d0 0x55ff04525830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.698+0000 7f4209e6f640 1 -- 172.21.15.78:0/3937995608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041336b0 msgr2=0x55ff04525d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.698+0000 7f4209e6f640 1 --2- 172.21.15.78:0/3937995608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041336b0 0x55ff04525d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.698+0000 7f4209e6f640 1 -- 172.21.15.78:0/3937995608 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff042367d0 con 0x55ff04154390 2024-09-17T03:15:08.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.698+0000 7f420966e640 1 --2- 172.21.15.78:0/3937995608 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff0412b4d0 0x55ff04525830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:15:08.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.698+0000 7f4209e6f640 1 --2- 172.21.15.78:0/3937995608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff04154390 0x55ff04542b60 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f420002b0b0 tx=0x7f420002aac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cee26447a6de5b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.698+0000 7f41e77fe640 1 -- 172.21.15.78:0/3937995608 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200051070 con 0x55ff04154390 2024-09-17T03:15:08.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.698+0000 7f41e77fe640 1 -- 172.21.15.78:0/3937995608 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4200004790 con 0x55ff04154390 2024-09-17T03:15:08.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.698+0000 7f41e77fe640 1 -- 172.21.15.78:0/3937995608 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200041680 con 0x55ff04154390 2024-09-17T03:15:08.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.699+0000 7f4213045740 1 -- 172.21.15.78:0/3937995608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff04154390 msgr2=0x55ff04542b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.699+0000 7f4213045740 1 --2- 172.21.15.78:0/3937995608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff04154390 0x55ff04542b60 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f420002b0b0 tx=0x7f420002aac0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.699+0000 7f4213045740 1 -- 172.21.15.78:0/3937995608 shutdown_connections 2024-09-17T03:15:08.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.699+0000 7f4213045740 1 --2- 172.21.15.78:0/3937995608 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041336b0 0x55ff04525d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.699+0000 7f4213045740 1 --2- 172.21.15.78:0/3937995608 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff0412b4d0 0x55ff04525830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.699+0000 7f4213045740 1 --2- 172.21.15.78:0/3937995608 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff04154390 0x55ff04542b60 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.699+0000 7f4213045740 1 -- 172.21.15.78:0/3937995608 >> 172.21.15.78:0/3937995608 conn(0x55ff041484e0 msgr2=0x55ff044fba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.699+0000 7f4213045740 1 -- 172.21.15.78:0/3937995608 shutdown_connections 2024-09-17T03:15:08.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.699+0000 7f4213045740 1 -- 172.21.15.78:0/3937995608 wait complete. 2024-09-17T03:15:08.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.700+0000 7f4213045740 1 -- start start 2024-09-17T03:15:08.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.700+0000 7f4213045740 1 Processor -- start 2024-09-17T03:15:08.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.701+0000 7f4213045740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff0412b4d0 0x55ff04514250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.701+0000 7f4213045740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041336b0 0x55ff04552c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.701+0000 7f4213045740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff04154390 0x55ff045531d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.701+0000 7f4213045740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ff041ce740 con 0x55ff0412b4d0 2024-09-17T03:15:08.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.701+0000 7f4213045740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ff04403540 con 0x55ff041336b0 2024-09-17T03:15:08.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.701+0000 7f4213045740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ff04522d30 con 0x55ff04154390 2024-09-17T03:15:08.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.702+0000 7f4213045740 10 client.0 _ll_register_callbacks cb 0x55ff044020e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:08.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.702+0000 7f4209e6f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff0412b4d0 0x55ff04514250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.702+0000 7f4209e6f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff0412b4d0 0x55ff04514250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50788/0 (socket says 172.21.15.78:50788) 2024-09-17T03:15:08.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.702+0000 7f4209e6f640 1 -- 172.21.15.78:0/1876486734 learned_addr learned my addr 172.21.15.78:0/1876486734 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.702+0000 7f420966e640 1 --2- 172.21.15.78:0/1876486734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041336b0 0x55ff04552c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.702+0000 7f420a670640 1 --2- 172.21.15.78:0/1876486734 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff04154390 0x55ff045531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.702+0000 7f4209e6f640 1 -- 172.21.15.78:0/1876486734 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff04154390 msgr2=0x55ff045531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.702+0000 7f4209e6f640 1 --2- 172.21.15.78:0/1876486734 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff04154390 0x55ff045531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.702+0000 7f4209e6f640 1 -- 172.21.15.78:0/1876486734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041336b0 msgr2=0x55ff04552c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.702+0000 7f4209e6f640 1 --2- 172.21.15.78:0/1876486734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041336b0 0x55ff04552c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.702+0000 7f4209e6f640 1 -- 172.21.15.78:0/1876486734 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff0419d6a0 con 0x55ff0412b4d0 2024-09-17T03:15:08.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.702+0000 7f4209e6f640 1 --2- 172.21.15.78:0/1876486734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff0412b4d0 0x55ff04514250 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f4200009d90 tx=0x7f4200004940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abab26853431eeb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.702+0000 7f41e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:08.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.702+0000 7f41e4ff9640 1 -- 172.21.15.78:0/1876486734 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420005c060 con 0x55ff0412b4d0 2024-09-17T03:15:08.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.702+0000 7f41e4ff9640 1 -- 172.21.15.78:0/1876486734 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f4200041480 con 0x55ff0412b4d0 2024-09-17T03:15:08.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.702+0000 7f4213045740 1 -- 172.21.15.78:0/1876486734 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4200004790 con 0x55ff0412b4d0 2024-09-17T03:15:08.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.702+0000 7f41e4ff9640 1 -- 172.21.15.78:0/1876486734 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f4200062050 con 0x55ff0412b4d0 2024-09-17T03:15:08.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.702+0000 7f4213045740 10 client.8652 fetch_fsmap learned FSMap version 100 2024-09-17T03:15:08.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.702+0000 7f4213045740 1 -- 172.21.15.78:0/1876486734 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x55ff04296f60 con 0x55ff0412b4d0 2024-09-17T03:15:08.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.703+0000 7f41e4ff9640 1 -- 172.21.15.78:0/1876486734 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4200004790 con 0x55ff0412b4d0 2024-09-17T03:15:08.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.703+0000 7f41e4ff9640 1 -- 172.21.15.78:0/1876486734 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 100) ==== 3554+0+0 (secure 0 0 0) 0x7f4200065020 con 0x55ff0412b4d0 2024-09-17T03:15:08.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.703+0000 7f4213045740 10 client.8652 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T03:15:08.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.703+0000 7f4213045740 10 client.8652 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T03:15:08.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.703+0000 7f4213045740 20 client.8652 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:08.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.703+0000 7f4213045740 1 --2- 172.21.15.78:0/1876486734 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55ff04112f60 0x55ff0451ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.703+0000 7f4213045740 4 client.8652 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:08.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.703+0000 7f4213045740 1 -- 172.21.15.78:0/1876486734 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff04470b20 con 0x55ff04112f60 2024-09-17T03:15:08.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.703+0000 7f420966e640 1 --2- 172.21.15.78:0/1876486734 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55ff04112f60 0x55ff0451ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.703+0000 7f41e4ff9640 10 client.8652 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:08.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.703+0000 7f420966e640 1 --2- 172.21.15.78:0/1876486734 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55ff04112f60 0x55ff0451ece0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17b4c40b5a92e7cb server_cookie=91d049443bb59c6a in_seq=0 out_seq=0 2024-09-17T03:15:08.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.704+0000 7f41e4ff9640 1 -- 172.21.15.78:0/1876486734 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ff04470b20 con 0x55ff04112f60 2024-09-17T03:15:08.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.704+0000 7f41e4ff9640 10 client.8652 handle_command_reply: tid=0 2024-09-17T03:15:08.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.704+0000 7f4213045740 1 client.8652 shutdown 2024-09-17T03:15:08.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.704+0000 7f4213045740 1 -- 172.21.15.78:0/1876486734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff0412b4d0 msgr2=0x55ff04514250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.704+0000 7f4213045740 1 --2- 172.21.15.78:0/1876486734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff0412b4d0 0x55ff04514250 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f4200009d90 tx=0x7f4200004940 comp rx=0 tx=0).stop 2024-09-17T03:15:08.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.704+0000 7f4213045740 1 -- 172.21.15.78:0/1876486734 shutdown_connections 2024-09-17T03:15:08.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.704+0000 7f4213045740 1 --2- 172.21.15.78:0/1876486734 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff04154390 0x55ff045531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.704+0000 7f4213045740 1 --2- 172.21.15.78:0/1876486734 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55ff04112f60 0x55ff0451ece0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.704+0000 7f4213045740 1 --2- 172.21.15.78:0/1876486734 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041336b0 0x55ff04552c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.704+0000 7f41e4ff9640 0 client.8652 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:08.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.704+0000 7f4213045740 1 --2- 172.21.15.78:0/1876486734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff0412b4d0 0x55ff04514250 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.704+0000 7f4213045740 1 -- 172.21.15.78:0/1876486734 >> 172.21.15.78:0/1876486734 conn(0x55ff041484e0 msgr2=0x55ff04543b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.705+0000 7f4213045740 1 -- 172.21.15.78:0/1876486734 shutdown_connections 2024-09-17T03:15:08.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.705+0000 7f4213045740 1 -- 172.21.15.78:0/1876486734 wait complete. 2024-09-17T03:15:08.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.705+0000 7f4213045740 20 client.8652 trim_cache size 0 max 16384 2024-09-17T03:15:08.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.722+0000 7f4213045740 1 Processor -- start 2024-09-17T03:15:08.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.722+0000 7f4213045740 1 -- start start 2024-09-17T03:15:08.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.723+0000 7f4213045740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff04112f60 0x55ff044f4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.723+0000 7f4213045740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff0412b4d0 0x55ff044f52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.723+0000 7f4213045740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041336b0 0x55ff045623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.723+0000 7f4213045740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4204202400 con 0x55ff04112f60 2024-09-17T03:15:08.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.723+0000 7f4213045740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f42042015d0 con 0x55ff041336b0 2024-09-17T03:15:08.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.723+0000 7f4213045740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4204201cd0 con 0x55ff0412b4d0 2024-09-17T03:15:08.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.724+0000 7f4209e6f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff04112f60 0x55ff044f4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.724+0000 7f4209e6f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff04112f60 0x55ff044f4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50790/0 (socket says 172.21.15.78:50790) 2024-09-17T03:15:08.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.724+0000 7f4209e6f640 1 -- 172.21.15.78:0/3613618824 learned_addr learned my addr 172.21.15.78:0/3613618824 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.724+0000 7f420a670640 1 --2- 172.21.15.78:0/3613618824 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041336b0 0x55ff045623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.724+0000 7f420966e640 1 --2- 172.21.15.78:0/3613618824 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff0412b4d0 0x55ff044f52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.724+0000 7f4209e6f640 1 -- 172.21.15.78:0/3613618824 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff0412b4d0 msgr2=0x55ff044f52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.724+0000 7f4209e6f640 1 --2- 172.21.15.78:0/3613618824 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff0412b4d0 0x55ff044f52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.724+0000 7f4209e6f640 1 -- 172.21.15.78:0/3613618824 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041336b0 msgr2=0x55ff045623c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.724+0000 7f4209e6f640 1 --2- 172.21.15.78:0/3613618824 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041336b0 0x55ff045623c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.724+0000 7f4209e6f640 1 -- 172.21.15.78:0/3613618824 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff04234ad0 con 0x55ff04112f60 2024-09-17T03:15:08.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.724+0000 7f4209e6f640 1 --2- 172.21.15.78:0/3613618824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff04112f60 0x55ff044f4d60 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f420002cc30 tx=0x7f4200009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42386c2403e06b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.724+0000 7f41e6ffd640 1 -- 172.21.15.78:0/3613618824 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f420006b070 con 0x55ff04112f60 2024-09-17T03:15:08.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.724+0000 7f41e6ffd640 1 -- 172.21.15.78:0/3613618824 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4200041bb0 con 0x55ff04112f60 2024-09-17T03:15:08.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.724+0000 7f41e6ffd640 1 -- 172.21.15.78:0/3613618824 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200051040 con 0x55ff04112f60 2024-09-17T03:15:08.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.725+0000 7f4213045740 1 -- 172.21.15.78:0/3613618824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff04112f60 msgr2=0x55ff044f4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.725+0000 7f4213045740 1 --2- 172.21.15.78:0/3613618824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff04112f60 0x55ff044f4d60 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f420002cc30 tx=0x7f4200009b20 comp rx=0 tx=0).stop 2024-09-17T03:15:08.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.725+0000 7f4213045740 1 -- 172.21.15.78:0/3613618824 shutdown_connections 2024-09-17T03:15:08.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.725+0000 7f4213045740 1 --2- 172.21.15.78:0/3613618824 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff041336b0 0x55ff045623c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.725+0000 7f4213045740 1 --2- 172.21.15.78:0/3613618824 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff0412b4d0 0x55ff044f52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.725+0000 7f4213045740 1 --2- 172.21.15.78:0/3613618824 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff04112f60 0x55ff044f4d60 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.725+0000 7f4213045740 1 -- 172.21.15.78:0/3613618824 >> 172.21.15.78:0/3613618824 conn(0x55ff041484e0 msgr2=0x55ff04522180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.725+0000 7f4213045740 1 -- 172.21.15.78:0/3613618824 shutdown_connections 2024-09-17T03:15:08.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.725+0000 7f4213045740 1 -- 172.21.15.78:0/3613618824 wait complete. 2024-09-17T03:15:08.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.726+0000 7f4213045740 1 -- start start 2024-09-17T03:15:08.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.726+0000 7f4213045740 1 Processor -- start 2024-09-17T03:15:08.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.727+0000 7f4213045740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff04112f60 0x55ff045b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.727+0000 7f4213045740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff0412b4d0 0x55ff04559330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.727+0000 7f4213045740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff041336b0 0x55ff04556f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.727+0000 7f4213045740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f42040ae9d0 con 0x55ff041336b0 2024-09-17T03:15:08.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.727+0000 7f4213045740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ff045599d0 con 0x55ff04112f60 2024-09-17T03:15:08.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.727+0000 7f4213045740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ff045528c0 con 0x55ff0412b4d0 2024-09-17T03:15:08.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.727+0000 7f4213045740 10 client.0 _ll_register_callbacks cb 0x7f420004f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:08.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.728+0000 7f420a670640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff041336b0 0x55ff04556f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.728+0000 7f420a670640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff041336b0 0x55ff04556f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50806/0 (socket says 172.21.15.78:50806) 2024-09-17T03:15:08.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.728+0000 7f420a670640 1 -- 172.21.15.78:0/2668256695 learned_addr learned my addr 172.21.15.78:0/2668256695 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.728+0000 7f4209e6f640 1 --2- 172.21.15.78:0/2668256695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff04112f60 0x55ff045b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.728+0000 7f420966e640 1 --2- 172.21.15.78:0/2668256695 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff0412b4d0 0x55ff04559330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.728+0000 7f420a670640 1 -- 172.21.15.78:0/2668256695 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff0412b4d0 msgr2=0x55ff04559330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.728+0000 7f420a670640 1 --2- 172.21.15.78:0/2668256695 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff0412b4d0 0x55ff04559330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.728+0000 7f420a670640 1 -- 172.21.15.78:0/2668256695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff04112f60 msgr2=0x55ff045b6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.728+0000 7f420a670640 1 --2- 172.21.15.78:0/2668256695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff04112f60 0x55ff045b6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.728+0000 7f420a670640 1 -- 172.21.15.78:0/2668256695 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff045c4350 con 0x55ff041336b0 2024-09-17T03:15:08.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.728+0000 7f420a670640 1 --2- 172.21.15.78:0/2668256695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff041336b0 0x55ff04556f70 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f41fc060650 tx=0x7f41fc0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9811ad5680d1c608 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.728+0000 7f41e4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:08.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.728+0000 7f41e4ff9640 1 -- 172.21.15.78:0/2668256695 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc067d90 con 0x55ff041336b0 2024-09-17T03:15:08.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.728+0000 7f41e4ff9640 1 -- 172.21.15.78:0/2668256695 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f41fc06ca50 con 0x55ff041336b0 2024-09-17T03:15:08.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.728+0000 7f4213045740 1 -- 172.21.15.78:0/2668256695 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4200041bb0 con 0x55ff041336b0 2024-09-17T03:15:08.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.728+0000 7f41e4ff9640 1 -- 172.21.15.78:0/2668256695 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f41fc073050 con 0x55ff041336b0 2024-09-17T03:15:08.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.728+0000 7f4213045740 10 client.8658 fetch_fsmap learned FSMap version 100 2024-09-17T03:15:08.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.728+0000 7f4213045740 1 -- 172.21.15.78:0/2668256695 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x55ff04525a40 con 0x55ff041336b0 2024-09-17T03:15:08.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.728+0000 7f41e4ff9640 1 -- 172.21.15.78:0/2668256695 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4200041bb0 con 0x55ff041336b0 2024-09-17T03:15:08.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.729+0000 7f41e4ff9640 1 -- 172.21.15.78:0/2668256695 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 100) ==== 3554+0+0 (secure 0 0 0) 0x7f41fc085b30 con 0x55ff041336b0 2024-09-17T03:15:08.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.729+0000 7f4213045740 10 client.8658 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T03:15:08.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.729+0000 7f4213045740 10 client.8658 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T03:15:08.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.729+0000 7f4213045740 20 client.8658 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:08.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.729+0000 7f4213045740 1 --2- 172.21.15.78:0/2668256695 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55ff040e83a0 0x55ff045c35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.729+0000 7f4213045740 4 client.8658 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "scrub pause"}] 2024-09-17T03:15:08.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.729+0000 7f4213045740 1 -- 172.21.15.78:0/2668256695 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "scrub pause"}) -- 0x55ff0446c5d0 con 0x55ff040e83a0 2024-09-17T03:15:08.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.729+0000 7f4209e6f640 1 --2- 172.21.15.78:0/2668256695 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55ff040e83a0 0x55ff045c35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.729+0000 7f41e4ff9640 10 client.8658 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:08.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.729+0000 7f4209e6f640 1 --2- 172.21.15.78:0/2668256695 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55ff040e83a0 0x55ff045c35f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2ca906db67982eb server_cookie=1b6ff1adb7084418 in_seq=0 out_seq=0 2024-09-17T03:15:08.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.730+0000 7f41e4ff9640 1 -- 172.21.15.78:0/2668256695 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ff0446c5d0 con 0x55ff040e83a0 2024-09-17T03:15:08.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.730+0000 7f41e4ff9640 10 client.8658 handle_command_reply: tid=0 2024-09-17T03:15:08.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.730+0000 7f4213045740 1 client.8658 shutdown 2024-09-17T03:15:08.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.730+0000 7f4213045740 1 -- 172.21.15.78:0/2668256695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff041336b0 msgr2=0x55ff04556f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.730+0000 7f4213045740 1 --2- 172.21.15.78:0/2668256695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff041336b0 0x55ff04556f70 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f41fc060650 tx=0x7f41fc0056e0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.730+0000 7f4213045740 1 -- 172.21.15.78:0/2668256695 shutdown_connections 2024-09-17T03:15:08.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.730+0000 7f4213045740 1 --2- 172.21.15.78:0/2668256695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff041336b0 0x55ff04556f70 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.730+0000 7f4213045740 1 --2- 172.21.15.78:0/2668256695 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff0412b4d0 0x55ff04559330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.730+0000 7f4213045740 1 --2- 172.21.15.78:0/2668256695 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55ff040e83a0 0x55ff045c35f0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.730+0000 7f4213045740 1 --2- 172.21.15.78:0/2668256695 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff04112f60 0x55ff045b6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.730+0000 7f4213045740 1 -- 172.21.15.78:0/2668256695 >> 172.21.15.78:0/2668256695 conn(0x55ff041484e0 msgr2=0x55ff045623c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.730+0000 7f41e4ff9640 0 client.8658 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:08.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.730+0000 7f4213045740 1 -- 172.21.15.78:0/2668256695 shutdown_connections 2024-09-17T03:15:08.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.730+0000 7f4213045740 1 -- 172.21.15.78:0/2668256695 wait complete. 2024-09-17T03:15:08.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.730+0000 7f4213045740 20 client.8658 trim_cache size 0 max 16384 2024-09-17T03:15:08.735 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:08.735 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:15:08.735 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:15:08.735 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:08.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.730+0000 7f420c0d3640 1 -- 172.21.15.78:0/3182352107 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f41e8078b90 msgr2=0x7f41e807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.730+0000 7f420c0d3640 1 --2- 172.21.15.78:0/3182352107 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f41e8078b90 0x7f41e807b0a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4200035000 tx=0x7f4200038040 comp rx=0 tx=0).stop 2024-09-17T03:15:08.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.730+0000 7f420c0d3640 1 -- 172.21.15.78:0/3182352107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f420415f9f0 msgr2=0x7f42040c6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.730+0000 7f420c0d3640 1 --2- 172.21.15.78:0/3182352107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f420415f9f0 0x7f42040c6f30 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00e700 tx=0x7f41fc00ebc0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.731+0000 7f420c0d3640 1 -- 172.21.15.78:0/3182352107 shutdown_connections 2024-09-17T03:15:08.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.731+0000 7f420c0d3640 1 --2- 172.21.15.78:0/3182352107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f420415f9f0 0x7f42040c6f30 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.731+0000 7f420c0d3640 1 --2- 172.21.15.78:0/3182352107 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f41e8078b90 0x7f41e807b0a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.731+0000 7f420c0d3640 1 --2- 172.21.15.78:0/3182352107 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42040701b0 0x7f42041f9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.731+0000 7f420c0d3640 1 --2- 172.21.15.78:0/3182352107 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f420406cde0 0x7f42040c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.731+0000 7f420c0d3640 1 -- 172.21.15.78:0/3182352107 >> 172.21.15.78:0/3182352107 conn(0x7f42040cdcb0 msgr2=0x7f4204073f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.731+0000 7f420c0d3640 1 -- 172.21.15.78:0/3182352107 shutdown_connections 2024-09-17T03:15:08.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.731+0000 7f420c0d3640 1 -- 172.21.15.78:0/3182352107 wait complete. 2024-09-17T03:15:08.740 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:15:08.741 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:1 scrub status 2024-09-17T03:15:08.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.856+0000 7f48b08d5640 1 -- 172.21.15.78:0/887956431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4894003f90 msgr2=0x7f4894004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.856+0000 7f48b08d5640 1 --2- 172.21.15.78:0/887956431 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4894003f90 0x7f4894004800 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f48a0006fc0 tx=0x7f4894005830 comp rx=0 tx=0).stop 2024-09-17T03:15:08.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.856+0000 7f48aad9d640 1 -- 172.21.15.78:0/887956431 reap_dead start 2024-09-17T03:15:08.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.856+0000 7f48b08d5640 1 -- 172.21.15.78:0/887956431 shutdown_connections 2024-09-17T03:15:08.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.856+0000 7f48b08d5640 1 -- 172.21.15.78:0/887956431 >> 172.21.15.78:0/887956431 conn(0x7f48ac0cdcc0 msgr2=0x7f48ac0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.856+0000 7f48b08d5640 1 -- 172.21.15.78:0/887956431 shutdown_connections 2024-09-17T03:15:08.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.856+0000 7f48b08d5640 1 -- 172.21.15.78:0/887956431 wait complete. 2024-09-17T03:15:08.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.858+0000 7f48b08d5640 1 Processor -- start 2024-09-17T03:15:08.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.858+0000 7f48b08d5640 1 -- start start 2024-09-17T03:15:08.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.860+0000 7f48b08d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4894003f90 0x7f48ac157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.860+0000 7f48b08d5640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f48ac152990 0x7f48ac15c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.860+0000 7f48b08d5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48ac1f2ad0 0x7f48ac1f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.860+0000 7f48b08d5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac0b46a0 con 0x7f4894003f90 2024-09-17T03:15:08.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.860+0000 7f48b08d5640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac0b3950 con 0x7f48ac1f2ad0 2024-09-17T03:15:08.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.860+0000 7f48b08d5640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f48ac0b4820 con 0x7f48ac152990 2024-09-17T03:15:08.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.860+0000 7f48aa59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4894003f90 0x7f48ac157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.860+0000 7f48aa59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4894003f90 0x7f48ac157ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50812/0 (socket says 172.21.15.78:50812) 2024-09-17T03:15:08.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.860+0000 7f48aa59c640 1 -- 172.21.15.78:0/1207814125 learned_addr learned my addr 172.21.15.78:0/1207814125 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.860+0000 7f48a9d9b640 1 --2- 172.21.15.78:0/1207814125 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f48ac152990 0x7f48ac15c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.860+0000 7f48aad9d640 1 --2- 172.21.15.78:0/1207814125 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48ac1f2ad0 0x7f48ac1f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.860+0000 7f48aa59c640 1 -- 172.21.15.78:0/1207814125 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f48ac152990 msgr2=0x7f48ac15c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.860+0000 7f48aa59c640 1 --2- 172.21.15.78:0/1207814125 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f48ac152990 0x7f48ac15c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.860+0000 7f48aa59c640 1 -- 172.21.15.78:0/1207814125 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48ac1f2ad0 msgr2=0x7f48ac1f2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.860+0000 7f48aa59c640 1 --2- 172.21.15.78:0/1207814125 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48ac1f2ad0 0x7f48ac1f2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.860+0000 7f48aa59c640 1 -- 172.21.15.78:0/1207814125 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ac1f6000 con 0x7f4894003f90 2024-09-17T03:15:08.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.860+0000 7f48aa59c640 1 --2- 172.21.15.78:0/1207814125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4894003f90 0x7f48ac157ae0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f489c011b10 tx=0x7f489c009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.860+0000 7f489affd640 1 -- 172.21.15.78:0/1207814125 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c01e070 con 0x7f4894003f90 2024-09-17T03:15:08.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.861+0000 7f489affd640 1 -- 172.21.15.78:0/1207814125 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f489c004050 con 0x7f4894003f90 2024-09-17T03:15:08.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.861+0000 7f48b08d5640 1 -- 172.21.15.78:0/1207814125 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48ac1f62e0 con 0x7f4894003f90 2024-09-17T03:15:08.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.861+0000 7f489affd640 1 -- 172.21.15.78:0/1207814125 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c00fea0 con 0x7f4894003f90 2024-09-17T03:15:08.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.861+0000 7f48b08d5640 1 -- 172.21.15.78:0/1207814125 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48ac1f68a0 con 0x7f4894003f90 2024-09-17T03:15:08.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.862+0000 7f489affd640 1 -- 172.21.15.78:0/1207814125 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f489c021070 con 0x7f4894003f90 2024-09-17T03:15:08.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.863+0000 7f489affd640 1 --2- 172.21.15.78:0/1207814125 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f488c078b90 0x7f488c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.863+0000 7f489affd640 1 -- 172.21.15.78:0/1207814125 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f489c09b8a0 con 0x7f4894003f90 2024-09-17T03:15:08.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.863+0000 7f48a9d9b640 1 --2- 172.21.15.78:0/1207814125 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f488c078b90 0x7f488c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.864+0000 7f48a9d9b640 1 --2- 172.21.15.78:0/1207814125 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f488c078b90 0x7f488c07b0a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f48a0033000 tx=0x7f48a0038040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.864+0000 7f48b783e740 1 Processor -- start 2024-09-17T03:15:08.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.864+0000 7f48b783e740 1 -- start start 2024-09-17T03:15:08.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.865+0000 7f48b783e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf702390 0x562cafaa8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.865+0000 7f48b783e740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562caf6d94d0 0x562cafaa4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.865+0000 7f48b783e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562caf6e16b0 0x562cafad3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.865+0000 7f48b783e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x562cafa1ca60 con 0x562caf702390 2024-09-17T03:15:08.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.865+0000 7f48b783e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562cafa0be90 con 0x562caf6e16b0 2024-09-17T03:15:08.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.865+0000 7f48b783e740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x562cafa0fca0 con 0x562caf6d94d0 2024-09-17T03:15:08.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.865+0000 7f48aa59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf702390 0x562cafaa8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.865+0000 7f48aa59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf702390 0x562cafaa8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50826/0 (socket says 172.21.15.78:50826) 2024-09-17T03:15:08.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.865+0000 7f48aa59c640 1 -- 172.21.15.78:0/258424990 learned_addr learned my addr 172.21.15.78:0/258424990 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.866+0000 7f48a9d9b640 1 --2- 172.21.15.78:0/258424990 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562caf6d94d0 0x562cafaa4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.866+0000 7f48aad9d640 1 --2- 172.21.15.78:0/258424990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562caf6e16b0 0x562cafad3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.866+0000 7f48aa59c640 1 -- 172.21.15.78:0/258424990 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562caf6d94d0 msgr2=0x562cafaa4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.866+0000 7f48aa59c640 1 --2- 172.21.15.78:0/258424990 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562caf6d94d0 0x562cafaa4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.866+0000 7f48aa59c640 1 -- 172.21.15.78:0/258424990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562caf6e16b0 msgr2=0x562cafad3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.866+0000 7f48aa59c640 1 --2- 172.21.15.78:0/258424990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562caf6e16b0 0x562cafad3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.866+0000 7f48aa59c640 1 -- 172.21.15.78:0/258424990 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562caf7e47d0 con 0x562caf702390 2024-09-17T03:15:08.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.866+0000 7f48aa59c640 1 --2- 172.21.15.78:0/258424990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf702390 0x562cafaa8170 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f489c099df0 tx=0x7f489c062f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7f50b14119905d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.866+0000 7f488bfff640 1 -- 172.21.15.78:0/258424990 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c068100 con 0x562caf702390 2024-09-17T03:15:08.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.866+0000 7f488bfff640 1 -- 172.21.15.78:0/258424990 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f489c06d040 con 0x562caf702390 2024-09-17T03:15:08.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.866+0000 7f488bfff640 1 -- 172.21.15.78:0/258424990 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c06c2a0 con 0x562caf702390 2024-09-17T03:15:08.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.867+0000 7f48b783e740 1 -- 172.21.15.78:0/258424990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf702390 msgr2=0x562cafaa8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.867+0000 7f48b783e740 1 --2- 172.21.15.78:0/258424990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf702390 0x562cafaa8170 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f489c099df0 tx=0x7f489c062f00 comp rx=0 tx=0).stop 2024-09-17T03:15:08.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.867+0000 7f48b783e740 1 -- 172.21.15.78:0/258424990 shutdown_connections 2024-09-17T03:15:08.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.867+0000 7f48b783e740 1 --2- 172.21.15.78:0/258424990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562caf6e16b0 0x562cafad3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.867+0000 7f48b783e740 1 --2- 172.21.15.78:0/258424990 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562caf6d94d0 0x562cafaa4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.867+0000 7f48b783e740 1 --2- 172.21.15.78:0/258424990 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf702390 0x562cafaa8170 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.867+0000 7f48b783e740 1 -- 172.21.15.78:0/258424990 >> 172.21.15.78:0/258424990 conn(0x562caf6f64e0 msgr2=0x562cafaa9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.867+0000 7f48b783e740 1 -- 172.21.15.78:0/258424990 shutdown_connections 2024-09-17T03:15:08.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.867+0000 7f48b783e740 1 -- 172.21.15.78:0/258424990 wait complete. 2024-09-17T03:15:08.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.868+0000 7f48b783e740 1 -- start start 2024-09-17T03:15:08.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.868+0000 7f48b783e740 1 Processor -- start 2024-09-17T03:15:08.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.869+0000 7f48b783e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6d94d0 0x562cafb00b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.869+0000 7f48b783e740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562caf6e16b0 0x562cafaea9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.869+0000 7f48b783e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562caf702390 0x562cafaa9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.869+0000 7f48b783e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x562caf77c740 con 0x562caf6d94d0 2024-09-17T03:15:08.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.869+0000 7f48b783e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562caf9b1970 con 0x562caf702390 2024-09-17T03:15:08.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.869+0000 7f48b783e740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x562cafaaafc0 con 0x562caf6e16b0 2024-09-17T03:15:08.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.869+0000 7f48b783e740 10 client.0 _ll_register_callbacks cb 0x562caf9c0780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:08.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.870+0000 7f48aa59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6d94d0 0x562cafb00b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.870+0000 7f48aa59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6d94d0 0x562cafb00b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50830/0 (socket says 172.21.15.78:50830) 2024-09-17T03:15:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.870+0000 7f48aa59c640 1 -- 172.21.15.78:0/2836799269 learned_addr learned my addr 172.21.15.78:0/2836799269 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.870+0000 7f48a9d9b640 1 --2- 172.21.15.78:0/2836799269 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562caf6e16b0 0x562cafaea9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.870+0000 7f48aad9d640 1 --2- 172.21.15.78:0/2836799269 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562caf702390 0x562cafaa9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.870+0000 7f48aa59c640 1 -- 172.21.15.78:0/2836799269 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562caf6e16b0 msgr2=0x562cafaea9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.870+0000 7f48aa59c640 1 --2- 172.21.15.78:0/2836799269 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562caf6e16b0 0x562cafaea9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.870+0000 7f48aa59c640 1 -- 172.21.15.78:0/2836799269 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562caf702390 msgr2=0x562cafaa9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.870+0000 7f48aa59c640 1 --2- 172.21.15.78:0/2836799269 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562caf702390 0x562cafaa9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.870+0000 7f48aa59c640 1 -- 172.21.15.78:0/2836799269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562caf76d970 con 0x562caf6d94d0 2024-09-17T03:15:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.870+0000 7f48aa59c640 1 --2- 172.21.15.78:0/2836799269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6d94d0 0x562cafb00b70 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f489c088040 tx=0x7f489c062b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334ecf58a8e2f102 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.870+0000 7f48897fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.870+0000 7f48897fa640 1 -- 172.21.15.78:0/2836799269 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c07dab0 con 0x562caf6d94d0 2024-09-17T03:15:08.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.870+0000 7f48897fa640 1 -- 172.21.15.78:0/2836799269 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f489c07dc50 con 0x562caf6d94d0 2024-09-17T03:15:08.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.870+0000 7f48b783e740 1 -- 172.21.15.78:0/2836799269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f489c06d040 con 0x562caf6d94d0 2024-09-17T03:15:08.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.870+0000 7f48897fa640 1 -- 172.21.15.78:0/2836799269 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f489c07de50 con 0x562caf6d94d0 2024-09-17T03:15:08.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.870+0000 7f48b783e740 10 client.8670 fetch_fsmap learned FSMap version 100 2024-09-17T03:15:08.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.870+0000 7f48b783e740 1 -- 172.21.15.78:0/2836799269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x562caf74b6a0 con 0x562caf6d94d0 2024-09-17T03:15:08.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.870+0000 7f48897fa640 1 -- 172.21.15.78:0/2836799269 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f489c06d040 con 0x562caf6d94d0 2024-09-17T03:15:08.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.871+0000 7f48897fa640 1 -- 172.21.15.78:0/2836799269 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 100) ==== 3554+0+0 (secure 0 0 0) 0x7f489c089ce0 con 0x562caf6d94d0 2024-09-17T03:15:08.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.871+0000 7f48b783e740 10 client.8670 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T03:15:08.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.871+0000 7f48b783e740 10 client.8670 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2024-09-17T03:15:08.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.871+0000 7f48b783e740 20 client.8670 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:08.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.871+0000 7f48b783e740 1 --2- 172.21.15.78:0/2836799269 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x562caf6c0f60 0x562cafb036f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.871+0000 7f48b783e740 4 client.8670 mds_command: new command op to 8283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:08.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.871+0000 7f48b783e740 1 -- 172.21.15.78:0/2836799269 --> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562cafa1e9b0 con 0x562caf6c0f60 2024-09-17T03:15:08.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.871+0000 7f48a9d9b640 1 --2- 172.21.15.78:0/2836799269 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x562caf6c0f60 0x562cafb036f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.871+0000 7f48897fa640 10 client.8670 ms_handle_connect on v2:172.21.15.78:6832/1810198137 2024-09-17T03:15:08.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.871+0000 7f48a9d9b640 1 --2- 172.21.15.78:0/2836799269 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x562caf6c0f60 0x562cafb036f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=44cd334ee4934d5c server_cookie=a7f74007133ed081 in_seq=0 out_seq=0 2024-09-17T03:15:08.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.872+0000 7f48897fa640 1 -- 172.21.15.78:0/2836799269 <== mds.1 v2:172.21.15.78:6832/1810198137 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562cafa1e9b0 con 0x562caf6c0f60 2024-09-17T03:15:08.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.872+0000 7f48897fa640 10 client.8670 handle_command_reply: tid=0 2024-09-17T03:15:08.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.872+0000 7f48b783e740 1 client.8670 shutdown 2024-09-17T03:15:08.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.872+0000 7f48b783e740 1 -- 172.21.15.78:0/2836799269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6d94d0 msgr2=0x562cafb00b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.872+0000 7f48b783e740 1 --2- 172.21.15.78:0/2836799269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6d94d0 0x562cafb00b70 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f489c088040 tx=0x7f489c062b60 comp rx=0 tx=0).stop 2024-09-17T03:15:08.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.872+0000 7f48b783e740 1 -- 172.21.15.78:0/2836799269 shutdown_connections 2024-09-17T03:15:08.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.872+0000 7f48b783e740 1 --2- 172.21.15.78:0/2836799269 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x562caf6c0f60 0x562cafb036f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.872+0000 7f48b783e740 1 --2- 172.21.15.78:0/2836799269 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562caf702390 0x562cafaa9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.872+0000 7f48b783e740 1 --2- 172.21.15.78:0/2836799269 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562caf6e16b0 0x562cafaea9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.872+0000 7f48897fa640 0 client.8670 ms_handle_reset on v2:172.21.15.78:6832/1810198137 2024-09-17T03:15:08.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.872+0000 7f48b783e740 1 --2- 172.21.15.78:0/2836799269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6d94d0 0x562cafb00b70 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.872+0000 7f48b783e740 1 -- 172.21.15.78:0/2836799269 >> 172.21.15.78:0/2836799269 conn(0x562caf6f64e0 msgr2=0x562cafaa2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.872+0000 7f48b783e740 1 -- 172.21.15.78:0/2836799269 shutdown_connections 2024-09-17T03:15:08.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.872+0000 7f48b783e740 1 -- 172.21.15.78:0/2836799269 wait complete. 2024-09-17T03:15:08.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.872+0000 7f48b783e740 20 client.8670 trim_cache size 0 max 16384 2024-09-17T03:15:08.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.889+0000 7f48b783e740 1 Processor -- start 2024-09-17T03:15:08.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.890+0000 7f48b783e740 1 -- start start 2024-09-17T03:15:08.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.891+0000 7f48b783e740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562caf6d94d0 0x562cafac5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.891+0000 7f48b783e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6e16b0 0x562cafaa4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.891+0000 7f48b783e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562caf702390 0x562cafacf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.891+0000 7f48b783e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac1fe3d0 con 0x562caf6e16b0 2024-09-17T03:15:08.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.891+0000 7f48b783e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac06d6b0 con 0x562caf702390 2024-09-17T03:15:08.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.891+0000 7f48b783e740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f48ac1fde20 con 0x562caf6d94d0 2024-09-17T03:15:08.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.891+0000 7f48a9d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6e16b0 0x562cafaa4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.891+0000 7f48a9d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6e16b0 0x562cafaa4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50838/0 (socket says 172.21.15.78:50838) 2024-09-17T03:15:08.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.891+0000 7f48a9d9b640 1 -- 172.21.15.78:0/213302062 learned_addr learned my addr 172.21.15.78:0/213302062 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.891+0000 7f48aa59c640 1 --2- 172.21.15.78:0/213302062 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562caf6d94d0 0x562cafac5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.891+0000 7f48a9d9b640 1 -- 172.21.15.78:0/213302062 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562caf6d94d0 msgr2=0x562cafac5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.891+0000 7f48a9d9b640 1 --2- 172.21.15.78:0/213302062 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562caf6d94d0 0x562cafac5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.891+0000 7f48a9d9b640 1 -- 172.21.15.78:0/213302062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562caf702390 msgr2=0x562cafacf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.891+0000 7f48a9d9b640 1 --2- 172.21.15.78:0/213302062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562caf702390 0x562cafacf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.891+0000 7f48a9d9b640 1 -- 172.21.15.78:0/213302062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562cafaa6860 con 0x562caf6e16b0 2024-09-17T03:15:08.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.891+0000 7f48a9d9b640 1 --2- 172.21.15.78:0/213302062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6e16b0 0x562cafaa4e40 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f48a0006d50 tx=0x7f4894005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1e39554e13b0af server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.891+0000 7f488b7fe640 1 -- 172.21.15.78:0/213302062 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a0031040 con 0x562caf6e16b0 2024-09-17T03:15:08.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.892+0000 7f488b7fe640 1 -- 172.21.15.78:0/213302062 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48a00014b0 con 0x562caf6e16b0 2024-09-17T03:15:08.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.892+0000 7f488b7fe640 1 -- 172.21.15.78:0/213302062 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a0004bd0 con 0x562caf6e16b0 2024-09-17T03:15:08.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.892+0000 7f48b783e740 1 -- 172.21.15.78:0/213302062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6e16b0 msgr2=0x562cafaa4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.892+0000 7f48b783e740 1 --2- 172.21.15.78:0/213302062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6e16b0 0x562cafaa4e40 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f48a0006d50 tx=0x7f4894005830 comp rx=0 tx=0).stop 2024-09-17T03:15:08.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.892+0000 7f48b783e740 1 -- 172.21.15.78:0/213302062 shutdown_connections 2024-09-17T03:15:08.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.892+0000 7f48b783e740 1 --2- 172.21.15.78:0/213302062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562caf702390 0x562cafacf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.892+0000 7f48b783e740 1 --2- 172.21.15.78:0/213302062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6e16b0 0x562cafaa4e40 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.892+0000 7f48b783e740 1 --2- 172.21.15.78:0/213302062 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562caf6d94d0 0x562cafac5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.892+0000 7f48b783e740 1 -- 172.21.15.78:0/213302062 >> 172.21.15.78:0/213302062 conn(0x562caf6f64e0 msgr2=0x562cafaa2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.892+0000 7f48b783e740 1 -- 172.21.15.78:0/213302062 shutdown_connections 2024-09-17T03:15:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.892+0000 7f48b783e740 1 -- 172.21.15.78:0/213302062 wait complete. 2024-09-17T03:15:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.893+0000 7f48b783e740 1 -- start start 2024-09-17T03:15:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.893+0000 7f48b783e740 1 Processor -- start 2024-09-17T03:15:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48b783e740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6d94d0 0x562cafb55490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48b783e740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562caf6e16b0 0x562cafaa2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48b783e740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562caf702390 0x562cafacf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48b783e740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac156a40 con 0x562caf6d94d0 2024-09-17T03:15:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48b783e740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x562cafb58330 con 0x562caf6e16b0 2024-09-17T03:15:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48b783e740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x562cafaa3720 con 0x562caf702390 2024-09-17T03:15:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48b783e740 10 client.0 _ll_register_callbacks cb 0x7f48940036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48aa59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6d94d0 0x562cafb55490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48aa59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6d94d0 0x562cafb55490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50850/0 (socket says 172.21.15.78:50850) 2024-09-17T03:15:08.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48aa59c640 1 -- 172.21.15.78:0/1283129883 learned_addr learned my addr 172.21.15.78:0/1283129883 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:08.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48a9d9b640 1 --2- 172.21.15.78:0/1283129883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562caf6e16b0 0x562cafaa2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48aad9d640 1 --2- 172.21.15.78:0/1283129883 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562caf702390 0x562cafacf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48aa59c640 1 -- 172.21.15.78:0/1283129883 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562caf702390 msgr2=0x562cafacf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48aa59c640 1 --2- 172.21.15.78:0/1283129883 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562caf702390 0x562cafacf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48aa59c640 1 -- 172.21.15.78:0/1283129883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562caf6e16b0 msgr2=0x562cafaa2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:08.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48aa59c640 1 --2- 172.21.15.78:0/1283129883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562caf6e16b0 0x562cafaa2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48aa59c640 1 -- 172.21.15.78:0/1283129883 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562cafb137c0 con 0x562caf6d94d0 2024-09-17T03:15:08.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48aa59c640 1 --2- 172.21.15.78:0/1283129883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6d94d0 0x562cafb55490 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f489c0633d0 tx=0x7f489c06c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc602296e580b730 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:08.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48897fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:08.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48897fa640 1 -- 172.21.15.78:0/1283129883 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f489c06c360 con 0x562caf6d94d0 2024-09-17T03:15:08.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48897fa640 1 -- 172.21.15.78:0/1283129883 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f489c0625b0 con 0x562caf6d94d0 2024-09-17T03:15:08.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.895+0000 7f48b783e740 1 -- 172.21.15.78:0/1283129883 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48a00014b0 con 0x562caf6d94d0 2024-09-17T03:15:08.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.896+0000 7f48897fa640 1 -- 172.21.15.78:0/1283129883 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f489c06d040 con 0x562caf6d94d0 2024-09-17T03:15:08.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.896+0000 7f48b783e740 10 client.8676 fetch_fsmap learned FSMap version 100 2024-09-17T03:15:08.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.896+0000 7f48b783e740 1 -- 172.21.15.78:0/1283129883 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x562cafb55a90 con 0x562caf6d94d0 2024-09-17T03:15:08.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.896+0000 7f48897fa640 1 -- 172.21.15.78:0/1283129883 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48a00014b0 con 0x562caf6d94d0 2024-09-17T03:15:08.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.896+0000 7f48897fa640 1 -- 172.21.15.78:0/1283129883 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 100) ==== 3554+0+0 (secure 0 0 0) 0x7f489c089ce0 con 0x562caf6d94d0 2024-09-17T03:15:08.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.896+0000 7f48b783e740 10 client.8676 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T03:15:08.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.896+0000 7f48b783e740 10 client.8676 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2024-09-17T03:15:08.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.896+0000 7f48b783e740 20 client.8676 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:08.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.896+0000 7f48b783e740 1 --2- 172.21.15.78:0/1283129883 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x562cafacfcc0 0x562cafb72e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:08.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.896+0000 7f48b783e740 4 client.8676 mds_command: new command op to 8283 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:15:08.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.896+0000 7f48b783e740 1 -- 172.21.15.78:0/1283129883 --> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562cafa1a460 con 0x562cafacfcc0 2024-09-17T03:15:08.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.896+0000 7f48a9d9b640 1 --2- 172.21.15.78:0/1283129883 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x562cafacfcc0 0x562cafb72e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:08.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.896+0000 7f48897fa640 10 client.8676 ms_handle_connect on v2:172.21.15.78:6832/1810198137 2024-09-17T03:15:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.896+0000 7f48a9d9b640 1 --2- 172.21.15.78:0/1283129883 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x562cafacfcc0 0x562cafb72e70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3264177dc8f4fb69 server_cookie=a842055d6bd71f4f in_seq=0 out_seq=0 2024-09-17T03:15:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.897+0000 7f48897fa640 1 -- 172.21.15.78:0/1283129883 <== mds.1 v2:172.21.15.78:6832/1810198137 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x562cafa1a460 con 0x562cafacfcc0 2024-09-17T03:15:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.897+0000 7f48897fa640 10 client.8676 handle_command_reply: tid=0 2024-09-17T03:15:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.897+0000 7f48b783e740 1 client.8676 shutdown 2024-09-17T03:15:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.897+0000 7f48b783e740 1 -- 172.21.15.78:0/1283129883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6d94d0 msgr2=0x562cafb55490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.897+0000 7f48b783e740 1 --2- 172.21.15.78:0/1283129883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6d94d0 0x562cafb55490 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f489c0633d0 tx=0x7f489c06c270 comp rx=0 tx=0).stop 2024-09-17T03:15:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.897+0000 7f48b783e740 1 -- 172.21.15.78:0/1283129883 shutdown_connections 2024-09-17T03:15:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.897+0000 7f48b783e740 1 --2- 172.21.15.78:0/1283129883 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x562cafacfcc0 0x562cafb72e70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.897+0000 7f48b783e740 1 --2- 172.21.15.78:0/1283129883 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x562caf702390 0x562cafacf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.897+0000 7f48897fa640 0 client.8676 ms_handle_reset on v2:172.21.15.78:6832/1810198137 2024-09-17T03:15:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.897+0000 7f48b783e740 1 --2- 172.21.15.78:0/1283129883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x562caf6e16b0 0x562cafaa2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.897+0000 7f48b783e740 1 --2- 172.21.15.78:0/1283129883 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x562caf6d94d0 0x562cafb55490 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.897+0000 7f48b783e740 1 -- 172.21.15.78:0/1283129883 >> 172.21.15.78:0/1283129883 conn(0x562caf6f64e0 msgr2=0x562cafb024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.897+0000 7f48b783e740 1 -- 172.21.15.78:0/1283129883 shutdown_connections 2024-09-17T03:15:08.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.897+0000 7f48b783e740 1 -- 172.21.15.78:0/1283129883 wait complete. 2024-09-17T03:15:08.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.897+0000 7f48b783e740 20 client.8676 trim_cache size 0 max 16384 2024-09-17T03:15:08.902 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:08.902 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-17T03:15:08.902 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:15:08.902 INFO:teuthology.orchestra.run.smithi078.stdout: "0d177712-01a0-4dfb-8f16-2e7c84183356": { 2024-09-17T03:15:08.902 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:15:08.902 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "0d177712-01a0-4dfb-8f16-2e7c84183356", 2024-09-17T03:15:08.902 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:15:08.903 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:08.903 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:08.903 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:08.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.898+0000 7f48b08d5640 1 -- 172.21.15.78:0/1207814125 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f488c078b90 msgr2=0x7f488c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.898+0000 7f48b08d5640 1 --2- 172.21.15.78:0/1207814125 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f488c078b90 0x7f488c07b0a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f48a0033000 tx=0x7f48a0038040 comp rx=0 tx=0).stop 2024-09-17T03:15:08.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.898+0000 7f48b08d5640 1 -- 172.21.15.78:0/1207814125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4894003f90 msgr2=0x7f48ac157ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:08.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.898+0000 7f48b08d5640 1 --2- 172.21.15.78:0/1207814125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4894003f90 0x7f48ac157ae0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f489c011b10 tx=0x7f489c009e90 comp rx=0 tx=0).stop 2024-09-17T03:15:08.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.898+0000 7f48b08d5640 1 -- 172.21.15.78:0/1207814125 shutdown_connections 2024-09-17T03:15:08.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.898+0000 7f48b08d5640 1 --2- 172.21.15.78:0/1207814125 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f488c078b90 0x7f488c07b0a0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.898+0000 7f48b08d5640 1 --2- 172.21.15.78:0/1207814125 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48ac1f2ad0 0x7f48ac1f2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.898+0000 7f48b08d5640 1 --2- 172.21.15.78:0/1207814125 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f48ac152990 0x7f48ac15c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.898+0000 7f48b08d5640 1 --2- 172.21.15.78:0/1207814125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4894003f90 0x7f48ac157ae0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:08.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.898+0000 7f48b08d5640 1 -- 172.21.15.78:0/1207814125 >> 172.21.15.78:0/1207814125 conn(0x7f48ac0cdcc0 msgr2=0x7f48ac1558b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:08.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.898+0000 7f48b08d5640 1 -- 172.21.15.78:0/1207814125 shutdown_connections 2024-09-17T03:15:08.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:08.898+0000 7f48b08d5640 1 -- 172.21.15.78:0/1207814125 wait complete. 2024-09-17T03:15:08.907 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:15:08.907 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:15:08.908 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:2 scrub status 2024-09-17T03:15:09.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.023+0000 7f0525230640 1 -- 172.21.15.78:0/1003111645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0520074560 msgr2=0x7f05200cfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.023+0000 7f0525230640 1 --2- 172.21.15.78:0/1003111645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0520074560 0x7f05200cfe60 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f05200749e0 tx=0x7f051802aac0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.023+0000 7f0525230640 1 -- 172.21.15.78:0/1003111645 shutdown_connections 2024-09-17T03:15:09.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.023+0000 7f0525230640 1 --2- 172.21.15.78:0/1003111645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0520074560 0x7f05200cfe60 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.023+0000 7f0525230640 1 --2- 172.21.15.78:0/1003111645 >> v2:172.21.15.193:3300/0 conn(0x7f0520144270 0x7f05200b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.023+0000 7f0525230640 1 -- 172.21.15.78:0/1003111645 >> 172.21.15.78:0/1003111645 conn(0x7f05200d15f0 msgr2=0x7f0520073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:09.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.023+0000 7f0525230640 1 -- 172.21.15.78:0/1003111645 shutdown_connections 2024-09-17T03:15:09.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.023+0000 7f0525230640 1 -- 172.21.15.78:0/1003111645 wait complete. 2024-09-17T03:15:09.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.025+0000 7f0525230640 1 Processor -- start 2024-09-17T03:15:09.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.025+0000 7f0525230640 1 -- start start 2024-09-17T03:15:09.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.026+0000 7f0525230640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0520142270 0x7f052013e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.026+0000 7f0525230640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0520144270 0x7f052006f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.026+0000 7f0525230640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0520158490 0x7f05200cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.026+0000 7f0525230640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0520142800 con 0x7f0520144270 2024-09-17T03:15:09.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.026+0000 7f0525230640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0520142680 con 0x7f0520158490 2024-09-17T03:15:09.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.026+0000 7f0525230640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0520142980 con 0x7f0520142270 2024-09-17T03:15:09.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.026+0000 7f051659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0520144270 0x7f052006f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.026+0000 7f051659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0520144270 0x7f052006f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50864/0 (socket says 172.21.15.78:50864) 2024-09-17T03:15:09.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.026+0000 7f051659c640 1 -- 172.21.15.78:0/3115996259 learned_addr learned my addr 172.21.15.78:0/3115996259 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:09.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.027+0000 7f051ed9d640 1 --2- 172.21.15.78:0/3115996259 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0520142270 0x7f052013e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.027+0000 7f051f59e640 1 --2- 172.21.15.78:0/3115996259 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0520158490 0x7f05200cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.027+0000 7f051659c640 1 -- 172.21.15.78:0/3115996259 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0520142270 msgr2=0x7f052013e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.027+0000 7f051659c640 1 --2- 172.21.15.78:0/3115996259 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0520142270 0x7f052013e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.027+0000 7f051659c640 1 -- 172.21.15.78:0/3115996259 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0520158490 msgr2=0x7f05200cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.027+0000 7f051659c640 1 --2- 172.21.15.78:0/3115996259 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0520158490 0x7f05200cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.027+0000 7f051659c640 1 -- 172.21.15.78:0/3115996259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05201573f0 con 0x7f0520144270 2024-09-17T03:15:09.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.027+0000 7f051659c640 1 --2- 172.21.15.78:0/3115996259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0520144270 0x7f052006f900 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f050800c390 tx=0x7f050800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:09.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.027+0000 7f0517fff640 1 -- 172.21.15.78:0/3115996259 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508017070 con 0x7f0520144270 2024-09-17T03:15:09.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.027+0000 7f0517fff640 1 -- 172.21.15.78:0/3115996259 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05080035f0 con 0x7f0520144270 2024-09-17T03:15:09.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.027+0000 7f0525230640 1 -- 172.21.15.78:0/3115996259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05201576d0 con 0x7f0520144270 2024-09-17T03:15:09.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.027+0000 7f0517fff640 1 -- 172.21.15.78:0/3115996259 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508003a20 con 0x7f0520144270 2024-09-17T03:15:09.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.027+0000 7f0525230640 1 -- 172.21.15.78:0/3115996259 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0520157c90 con 0x7f0520144270 2024-09-17T03:15:09.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.029+0000 7f0517fff640 1 -- 172.21.15.78:0/3115996259 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f050801a070 con 0x7f0520144270 2024-09-17T03:15:09.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.029+0000 7f0517fff640 1 --2- 172.21.15.78:0/3115996259 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0500078bc0 0x7f050007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.029+0000 7f0517fff640 1 -- 172.21.15.78:0/3115996259 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f050809a050 con 0x7f0520144270 2024-09-17T03:15:09.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.029+0000 7f051ed9d640 1 --2- 172.21.15.78:0/3115996259 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0500078bc0 0x7f050007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.030+0000 7f051ed9d640 1 --2- 172.21.15.78:0/3115996259 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0500078bc0 0x7f050007b0d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0510005fd0 tx=0x7f0510005850 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:09.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.030+0000 7f052c279740 1 Processor -- start 2024-09-17T03:15:09.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.030+0000 7f052c279740 1 -- start start 2024-09-17T03:15:09.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f052c279740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd778390 0x557acdb64a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f052c279740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd74f4d0 0x557acdb39860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f052c279740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd7576b0 0x557acdb39da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f052c279740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557acda92a60 con 0x557acd7576b0 2024-09-17T03:15:09.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f052c279740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557acda81e90 con 0x557acd778390 2024-09-17T03:15:09.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f052c279740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x557acda85ca0 con 0x557acd74f4d0 2024-09-17T03:15:09.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f051f59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd7576b0 0x557acdb39da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f051f59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd7576b0 0x557acdb39da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50870/0 (socket says 172.21.15.78:50870) 2024-09-17T03:15:09.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f051f59e640 1 -- 172.21.15.78:0/150174123 learned_addr learned my addr 172.21.15.78:0/150174123 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:09.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f051659c640 1 --2- 172.21.15.78:0/150174123 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd74f4d0 0x557acdb39860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f051ed9d640 1 --2- 172.21.15.78:0/150174123 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd778390 0x557acdb64a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f051f59e640 1 -- 172.21.15.78:0/150174123 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd74f4d0 msgr2=0x557acdb39860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:09.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f051f59e640 1 --2- 172.21.15.78:0/150174123 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd74f4d0 0x557acdb39860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f051f59e640 1 -- 172.21.15.78:0/150174123 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd778390 msgr2=0x557acdb64a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:09.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f051f59e640 1 --2- 172.21.15.78:0/150174123 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd778390 0x557acdb64a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f051f59e640 1 -- 172.21.15.78:0/150174123 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557acd85a7d0 con 0x557acd7576b0 2024-09-17T03:15:09.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f051ed9d640 1 --2- 172.21.15.78:0/150174123 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd778390 0x557acdb64a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:09.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f051f59e640 1 --2- 172.21.15.78:0/150174123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd7576b0 0x557acdb39da0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f051802b0b0 tx=0x7f0518004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9be955797996d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:09.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f0514d99640 1 -- 172.21.15.78:0/150174123 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0518045070 con 0x557acd7576b0 2024-09-17T03:15:09.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f0514d99640 1 -- 172.21.15.78:0/150174123 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0518009360 con 0x557acd7576b0 2024-09-17T03:15:09.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.032+0000 7f0514d99640 1 -- 172.21.15.78:0/150174123 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051802c7d0 con 0x557acd7576b0 2024-09-17T03:15:09.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.033+0000 7f052c279740 1 -- 172.21.15.78:0/150174123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd7576b0 msgr2=0x557acdb39da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.033+0000 7f052c279740 1 --2- 172.21.15.78:0/150174123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd7576b0 0x557acdb39da0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f051802b0b0 tx=0x7f0518004a40 comp rx=0 tx=0).stop 2024-09-17T03:15:09.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.033+0000 7f052c279740 1 -- 172.21.15.78:0/150174123 shutdown_connections 2024-09-17T03:15:09.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.033+0000 7f052c279740 1 --2- 172.21.15.78:0/150174123 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd7576b0 0x557acdb39da0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.033+0000 7f052c279740 1 --2- 172.21.15.78:0/150174123 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd74f4d0 0x557acdb39860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.033+0000 7f052c279740 1 --2- 172.21.15.78:0/150174123 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd778390 0x557acdb64a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.033+0000 7f052c279740 1 -- 172.21.15.78:0/150174123 >> 172.21.15.78:0/150174123 conn(0x557acd76c4e0 msgr2=0x557acdb1fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:09.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.033+0000 7f052c279740 1 -- 172.21.15.78:0/150174123 shutdown_connections 2024-09-17T03:15:09.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.033+0000 7f052c279740 1 -- 172.21.15.78:0/150174123 wait complete. 2024-09-17T03:15:09.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.034+0000 7f052c279740 1 -- start start 2024-09-17T03:15:09.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.034+0000 7f052c279740 1 Processor -- start 2024-09-17T03:15:09.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f052c279740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd74f4d0 0x557acdb5b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f052c279740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd7576b0 0x557acdb5a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f052c279740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd778390 0x557acdb487c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f052c279740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557acd7f2740 con 0x557acd778390 2024-09-17T03:15:09.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f052c279740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x557acda27970 con 0x557acd7576b0 2024-09-17T03:15:09.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f052c279740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x557acdb495c0 con 0x557acd74f4d0 2024-09-17T03:15:09.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f052c279740 10 client.0 _ll_register_callbacks cb 0x557acda36780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:09.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f051f59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd778390 0x557acdb487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f051f59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd778390 0x557acdb487c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50884/0 (socket says 172.21.15.78:50884) 2024-09-17T03:15:09.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f051f59e640 1 -- 172.21.15.78:0/2182481279 learned_addr learned my addr 172.21.15.78:0/2182481279 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:09.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f051ed9d640 1 --2- 172.21.15.78:0/2182481279 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd74f4d0 0x557acdb5b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f051f59e640 1 -- 172.21.15.78:0/2182481279 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd74f4d0 msgr2=0x557acdb5b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:09.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f051f59e640 1 --2- 172.21.15.78:0/2182481279 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd74f4d0 0x557acdb5b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f051f59e640 1 -- 172.21.15.78:0/2182481279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd7576b0 msgr2=0x557acdb5a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:09.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f051f59e640 1 --2- 172.21.15.78:0/2182481279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd7576b0 0x557acdb5a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f051f59e640 1 -- 172.21.15.78:0/2182481279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557acd7e3970 con 0x557acd778390 2024-09-17T03:15:09.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f051f59e640 1 --2- 172.21.15.78:0/2182481279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd778390 0x557acdb487c0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f0518043040 tx=0x7f051802cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac66c43e6c4d405 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:09.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f04fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f04fdffb640 1 -- 172.21.15.78:0/2182481279 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0518045070 con 0x557acd778390 2024-09-17T03:15:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f04fdffb640 1 -- 172.21.15.78:0/2182481279 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f0518003d80 con 0x557acd778390 2024-09-17T03:15:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f052c279740 1 -- 172.21.15.78:0/2182481279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0518009360 con 0x557acd778390 2024-09-17T03:15:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f04fdffb640 1 -- 172.21.15.78:0/2182481279 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f0518054050 con 0x557acd778390 2024-09-17T03:15:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f052c279740 10 client.8691 fetch_fsmap learned FSMap version 100 2024-09-17T03:15:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.036+0000 7f052c279740 1 -- 172.21.15.78:0/2182481279 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x557acd7c16a0 con 0x557acd778390 2024-09-17T03:15:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.037+0000 7f04fdffb640 1 -- 172.21.15.78:0/2182481279 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0518009360 con 0x557acd778390 2024-09-17T03:15:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.037+0000 7f04fdffb640 1 -- 172.21.15.78:0/2182481279 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 100) ==== 3554+0+0 (secure 0 0 0) 0x7f0518057020 con 0x557acd778390 2024-09-17T03:15:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.037+0000 7f052c279740 10 client.8691 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T03:15:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.037+0000 7f052c279740 10 client.8691 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.d 2024-09-17T03:15:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.037+0000 7f052c279740 20 client.8691 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.037+0000 7f052c279740 1 --2- 172.21.15.78:0/2182481279 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x557acd736f60 0x557acdb48d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.037+0000 7f052c279740 4 client.8691 mds_command: new command op to 7213 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:09.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.037+0000 7f052c279740 1 -- 172.21.15.78:0/2182481279 --> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557acda949b0 con 0x557acd736f60 2024-09-17T03:15:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.037+0000 7f051ed9d640 1 --2- 172.21.15.78:0/2182481279 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x557acd736f60 0x557acdb48d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.037+0000 7f04fdffb640 10 client.8691 ms_handle_connect on v2:172.21.15.193:6835/2983826871 2024-09-17T03:15:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.037+0000 7f051ed9d640 1 --2- 172.21.15.78:0/2182481279 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x557acd736f60 0x557acdb48d00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f8717a29e2549f1e server_cookie=31dc2aa21375ef45 in_seq=0 out_seq=0 2024-09-17T03:15:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.038+0000 7f04fdffb640 1 -- 172.21.15.78:0/2182481279 <== mds.2 v2:172.21.15.193:6835/2983826871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557acda949b0 con 0x557acd736f60 2024-09-17T03:15:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.038+0000 7f04fdffb640 10 client.8691 handle_command_reply: tid=0 2024-09-17T03:15:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.038+0000 7f052c279740 1 client.8691 shutdown 2024-09-17T03:15:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.039+0000 7f052c279740 1 -- 172.21.15.78:0/2182481279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd778390 msgr2=0x557acdb487c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.039+0000 7f052c279740 1 --2- 172.21.15.78:0/2182481279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd778390 0x557acdb487c0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f0518043040 tx=0x7f051802cce0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.039+0000 7f052c279740 1 -- 172.21.15.78:0/2182481279 shutdown_connections 2024-09-17T03:15:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.039+0000 7f052c279740 1 --2- 172.21.15.78:0/2182481279 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x557acd736f60 0x557acdb48d00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.039+0000 7f052c279740 1 --2- 172.21.15.78:0/2182481279 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd778390 0x557acdb487c0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.039+0000 7f052c279740 1 --2- 172.21.15.78:0/2182481279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd7576b0 0x557acdb5a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.039+0000 7f04fdffb640 0 client.8691 ms_handle_reset on v2:172.21.15.193:6835/2983826871 2024-09-17T03:15:09.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.039+0000 7f052c279740 1 --2- 172.21.15.78:0/2182481279 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd74f4d0 0x557acdb5b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.039+0000 7f052c279740 1 -- 172.21.15.78:0/2182481279 >> 172.21.15.78:0/2182481279 conn(0x557acd76c4e0 msgr2=0x557acdb18e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:09.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.039+0000 7f052c279740 1 -- 172.21.15.78:0/2182481279 shutdown_connections 2024-09-17T03:15:09.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.039+0000 7f052c279740 1 -- 172.21.15.78:0/2182481279 wait complete. 2024-09-17T03:15:09.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.039+0000 7f052c279740 20 client.8691 trim_cache size 0 max 16384 2024-09-17T03:15:09.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.057+0000 7f052c279740 1 Processor -- start 2024-09-17T03:15:09.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.057+0000 7f052c279740 1 -- start start 2024-09-17T03:15:09.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.058+0000 7f052c279740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd74f4d0 0x557acdb87b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.058+0000 7f052c279740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd7576b0 0x557acdb5df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.058+0000 7f052c279740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd778390 0x557acdb48730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.058+0000 7f052c279740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0520202050 con 0x557acd74f4d0 2024-09-17T03:15:09.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.058+0000 7f052c279740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0520201220 con 0x557acd778390 2024-09-17T03:15:09.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.058+0000 7f052c279740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0520201920 con 0x557acd7576b0 2024-09-17T03:15:09.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.058+0000 7f051ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd74f4d0 0x557acdb87b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.058+0000 7f051ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd74f4d0 0x557acdb87b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50896/0 (socket says 172.21.15.78:50896) 2024-09-17T03:15:09.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.059+0000 7f051ed9d640 1 -- 172.21.15.78:0/1533702662 learned_addr learned my addr 172.21.15.78:0/1533702662 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:09.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.059+0000 7f051659c640 1 --2- 172.21.15.78:0/1533702662 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd7576b0 0x557acdb5df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.059+0000 7f051f59e640 1 --2- 172.21.15.78:0/1533702662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd778390 0x557acdb48730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.059+0000 7f051ed9d640 1 -- 172.21.15.78:0/1533702662 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd7576b0 msgr2=0x557acdb5df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:09.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.059+0000 7f051ed9d640 1 --2- 172.21.15.78:0/1533702662 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd7576b0 0x557acdb5df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.059+0000 7f051ed9d640 1 -- 172.21.15.78:0/1533702662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd778390 msgr2=0x557acdb48730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:09.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.059+0000 7f051ed9d640 1 --2- 172.21.15.78:0/1533702662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd778390 0x557acdb48730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.059+0000 7f051ed9d640 1 -- 172.21.15.78:0/1533702662 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557acdb47990 con 0x557acd74f4d0 2024-09-17T03:15:09.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.059+0000 7f051f59e640 1 --2- 172.21.15.78:0/1533702662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd778390 0x557acdb48730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:09.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.059+0000 7f051ed9d640 1 --2- 172.21.15.78:0/1533702662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd74f4d0 0x557acdb87b10 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x557acdb2f950 tx=0x7f0510015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403708cbb969f5ca server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:09.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.059+0000 7f04fffff640 1 -- 172.21.15.78:0/1533702662 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051002b070 con 0x557acd74f4d0 2024-09-17T03:15:09.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.059+0000 7f04fffff640 1 -- 172.21.15.78:0/1533702662 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f051001e620 con 0x557acd74f4d0 2024-09-17T03:15:09.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.059+0000 7f04fffff640 1 -- 172.21.15.78:0/1533702662 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051001ea10 con 0x557acd74f4d0 2024-09-17T03:15:09.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.060+0000 7f052c279740 1 -- 172.21.15.78:0/1533702662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd74f4d0 msgr2=0x557acdb87b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.060+0000 7f052c279740 1 --2- 172.21.15.78:0/1533702662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd74f4d0 0x557acdb87b10 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x557acdb2f950 tx=0x7f0510015000 comp rx=0 tx=0).stop 2024-09-17T03:15:09.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.060+0000 7f052c279740 1 -- 172.21.15.78:0/1533702662 shutdown_connections 2024-09-17T03:15:09.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.060+0000 7f052c279740 1 --2- 172.21.15.78:0/1533702662 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd778390 0x557acdb48730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.060+0000 7f052c279740 1 --2- 172.21.15.78:0/1533702662 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd7576b0 0x557acdb5df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.060+0000 7f052c279740 1 --2- 172.21.15.78:0/1533702662 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd74f4d0 0x557acdb87b10 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.060+0000 7f052c279740 1 -- 172.21.15.78:0/1533702662 >> 172.21.15.78:0/1533702662 conn(0x557acd76c4e0 msgr2=0x557acdb46c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:09.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.060+0000 7f052c279740 1 -- 172.21.15.78:0/1533702662 shutdown_connections 2024-09-17T03:15:09.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.060+0000 7f052c279740 1 -- 172.21.15.78:0/1533702662 wait complete. 2024-09-17T03:15:09.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.061+0000 7f052c279740 1 -- start start 2024-09-17T03:15:09.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.061+0000 7f052c279740 1 Processor -- start 2024-09-17T03:15:09.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.062+0000 7f052c279740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd74f4d0 0x557acdbe5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.062+0000 7f052c279740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd7576b0 0x557acdb61390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.062+0000 7f052c279740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd778390 0x557acdb618d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.062+0000 7f052c279740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x557acdb5e4a0 con 0x557acd778390 2024-09-17T03:15:09.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.062+0000 7f052c279740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f05201f9030 con 0x557acd7576b0 2024-09-17T03:15:09.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.062+0000 7f052c279740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x557acdb7d6a0 con 0x557acd74f4d0 2024-09-17T03:15:09.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.062+0000 7f052c279740 10 client.0 _ll_register_callbacks cb 0x7f0518043070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:09.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.062+0000 7f051f59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd778390 0x557acdb618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.062+0000 7f051f59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd778390 0x557acdb618d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50906/0 (socket says 172.21.15.78:50906) 2024-09-17T03:15:09.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.062+0000 7f051f59e640 1 -- 172.21.15.78:0/1059602009 learned_addr learned my addr 172.21.15.78:0/1059602009 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:09.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.062+0000 7f051ed9d640 1 --2- 172.21.15.78:0/1059602009 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd74f4d0 0x557acdbe5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.062+0000 7f051659c640 1 --2- 172.21.15.78:0/1059602009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd7576b0 0x557acdb61390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f051f59e640 1 -- 172.21.15.78:0/1059602009 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd74f4d0 msgr2=0x557acdbe5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:09.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f051f59e640 1 --2- 172.21.15.78:0/1059602009 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd74f4d0 0x557acdbe5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f051f59e640 1 -- 172.21.15.78:0/1059602009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd7576b0 msgr2=0x557acdb61390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:09.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f051f59e640 1 --2- 172.21.15.78:0/1059602009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd7576b0 0x557acdb61390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f051f59e640 1 -- 172.21.15.78:0/1059602009 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557acdb7db30 con 0x557acd778390 2024-09-17T03:15:09.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f051ed9d640 1 --2- 172.21.15.78:0/1059602009 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd74f4d0 0x557acdbe5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:09.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f051f59e640 1 --2- 172.21.15.78:0/1059602009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd778390 0x557acdb618d0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f0518004af0 tx=0x7f05180098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324e7520b09e33cb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:09.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f04fdffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:09.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f04fdffb640 1 -- 172.21.15.78:0/1059602009 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051805d060 con 0x557acd778390 2024-09-17T03:15:09.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f04fdffb640 1 -- 172.21.15.78:0/1059602009 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f0518051950 con 0x557acd778390 2024-09-17T03:15:09.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f052c279740 1 -- 172.21.15.78:0/1059602009 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f051001e620 con 0x557acd778390 2024-09-17T03:15:09.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f04fdffb640 1 -- 172.21.15.78:0/1059602009 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7f0518045040 con 0x557acd778390 2024-09-17T03:15:09.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f052c279740 10 client.8697 fetch_fsmap learned FSMap version 100 2024-09-17T03:15:09.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f052c279740 1 -- 172.21.15.78:0/1059602009 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x557acdb87230 con 0x557acd778390 2024-09-17T03:15:09.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f04fdffb640 1 -- 172.21.15.78:0/1059602009 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f051001e620 con 0x557acd778390 2024-09-17T03:15:09.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f04fdffb640 1 -- 172.21.15.78:0/1059602009 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 100) ==== 3554+0+0 (secure 0 0 0) 0x7f0518057040 con 0x557acd778390 2024-09-17T03:15:09.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f052c279740 10 client.8697 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T03:15:09.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f052c279740 10 client.8697 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.d 2024-09-17T03:15:09.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f052c279740 20 client.8697 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:09.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f052c279740 1 --2- 172.21.15.78:0/1059602009 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x557acdb46e40 0x557acdbe6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f052c279740 4 client.8697 mds_command: new command op to 7213 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:15:09.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.063+0000 7f052c279740 1 -- 172.21.15.78:0/1059602009 --> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557acda90460 con 0x557acdb46e40 2024-09-17T03:15:09.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.064+0000 7f051ed9d640 1 --2- 172.21.15.78:0/1059602009 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x557acdb46e40 0x557acdbe6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.064+0000 7f04fdffb640 10 client.8697 ms_handle_connect on v2:172.21.15.193:6835/2983826871 2024-09-17T03:15:09.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.064+0000 7f051ed9d640 1 --2- 172.21.15.78:0/1059602009 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x557acdb46e40 0x557acdbe6790 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f3fc7429b66ede8c server_cookie=f0775437929a8756 in_seq=0 out_seq=0 2024-09-17T03:15:09.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.064+0000 7f04fdffb640 1 -- 172.21.15.78:0/1059602009 <== mds.2 v2:172.21.15.193:6835/2983826871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x557acda90460 con 0x557acdb46e40 2024-09-17T03:15:09.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.064+0000 7f04fdffb640 10 client.8697 handle_command_reply: tid=0 2024-09-17T03:15:09.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.064+0000 7f052c279740 1 client.8697 shutdown 2024-09-17T03:15:09.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.064+0000 7f052c279740 1 -- 172.21.15.78:0/1059602009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd778390 msgr2=0x557acdb618d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.064+0000 7f052c279740 1 --2- 172.21.15.78:0/1059602009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd778390 0x557acdb618d0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f0518004af0 tx=0x7f05180098a0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.064+0000 7f052c279740 1 -- 172.21.15.78:0/1059602009 shutdown_connections 2024-09-17T03:15:09.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.064+0000 7f052c279740 1 --2- 172.21.15.78:0/1059602009 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x557acdb46e40 0x557acdbe6790 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.064+0000 7f052c279740 1 --2- 172.21.15.78:0/1059602009 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x557acd778390 0x557acdb618d0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.064+0000 7f052c279740 1 --2- 172.21.15.78:0/1059602009 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x557acd7576b0 0x557acdb61390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.064+0000 7f04fdffb640 0 client.8697 ms_handle_reset on v2:172.21.15.193:6835/2983826871 2024-09-17T03:15:09.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.064+0000 7f052c279740 1 --2- 172.21.15.78:0/1059602009 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x557acd74f4d0 0x557acdbe5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.064+0000 7f052c279740 1 -- 172.21.15.78:0/1059602009 >> 172.21.15.78:0/1059602009 conn(0x557acd76c4e0 msgr2=0x557acdb48730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:09.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.064+0000 7f052c279740 1 -- 172.21.15.78:0/1059602009 shutdown_connections 2024-09-17T03:15:09.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.065+0000 7f052c279740 1 -- 172.21.15.78:0/1059602009 wait complete. 2024-09-17T03:15:09.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.065+0000 7f052c279740 20 client.8697 trim_cache size 0 max 16384 2024-09-17T03:15:09.081 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:09.081 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-17T03:15:09.081 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:15:09.082 INFO:teuthology.orchestra.run.smithi078.stdout: "0d177712-01a0-4dfb-8f16-2e7c84183356": { 2024-09-17T03:15:09.082 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:15:09.082 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "0d177712-01a0-4dfb-8f16-2e7c84183356", 2024-09-17T03:15:09.082 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:15:09.082 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:09.082 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:09.082 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:09.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.065+0000 7f0525230640 1 -- 172.21.15.78:0/3115996259 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0500078bc0 msgr2=0x7f050007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.065+0000 7f0525230640 1 --2- 172.21.15.78:0/3115996259 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0500078bc0 0x7f050007b0d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f0510005fd0 tx=0x7f0510005850 comp rx=0 tx=0).stop 2024-09-17T03:15:09.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.065+0000 7f0525230640 1 -- 172.21.15.78:0/3115996259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0520144270 msgr2=0x7f052006f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.065+0000 7f0525230640 1 --2- 172.21.15.78:0/3115996259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0520144270 0x7f052006f900 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f050800c390 tx=0x7f050800c850 comp rx=0 tx=0).stop 2024-09-17T03:15:09.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.065+0000 7f0525230640 1 -- 172.21.15.78:0/3115996259 shutdown_connections 2024-09-17T03:15:09.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.065+0000 7f0525230640 1 --2- 172.21.15.78:0/3115996259 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0500078bc0 0x7f050007b0d0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.065+0000 7f0525230640 1 --2- 172.21.15.78:0/3115996259 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0520158490 0x7f05200cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.065+0000 7f0525230640 1 --2- 172.21.15.78:0/3115996259 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0520144270 0x7f052006f900 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.065+0000 7f0525230640 1 --2- 172.21.15.78:0/3115996259 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0520142270 0x7f052013e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.065+0000 7f0525230640 1 -- 172.21.15.78:0/3115996259 >> 172.21.15.78:0/3115996259 conn(0x7f05200d15f0 msgr2=0x7f052015e380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:09.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.065+0000 7f0525230640 1 -- 172.21.15.78:0/3115996259 shutdown_connections 2024-09-17T03:15:09.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.065+0000 7f0525230640 1 -- 172.21.15.78:0/3115996259 wait complete. 2024-09-17T03:15:09.085 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:15:09.085 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:15:09.085 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-17T03:15:09.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.201+0000 7fd4ec990640 1 -- 172.21.15.78:0/335184038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4e806e170 msgr2=0x7fd4e80b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.201+0000 7fd4ec990640 1 --2- 172.21.15.78:0/335184038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4e806e170 0x7fd4e80b3540 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8005fd0 tx=0x7fd4d802a820 comp rx=0 tx=0).stop 2024-09-17T03:15:09.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.201+0000 7fd4ec990640 1 -- 172.21.15.78:0/335184038 shutdown_connections 2024-09-17T03:15:09.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.201+0000 7fd4ec990640 1 --2- 172.21.15.78:0/335184038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4e806e170 0x7fd4e80b3540 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.201+0000 7fd4ec990640 1 -- 172.21.15.78:0/335184038 >> 172.21.15.78:0/335184038 conn(0x7fd4e808bfc0 msgr2=0x7fd4e809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:09.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.201+0000 7fd4ec990640 1 -- 172.21.15.78:0/335184038 shutdown_connections 2024-09-17T03:15:09.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.201+0000 7fd4ec990640 1 -- 172.21.15.78:0/335184038 wait complete. 2024-09-17T03:15:09.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.203+0000 7fd4ec990640 1 Processor -- start 2024-09-17T03:15:09.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.203+0000 7fd4ec990640 1 -- start start 2024-09-17T03:15:09.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.204+0000 7fd4ec990640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd4e806f4b0 0x7fd4e81f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.204+0000 7fd4ec990640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4e80ceb40 0x7fd4e81f8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.204+0000 7fd4ec990640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd4e81f93a0 0x7fd4e80a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.204+0000 7fd4ec990640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e80d1070 con 0x7fd4e80ceb40 2024-09-17T03:15:09.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.204+0000 7fd4ec990640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e80d0ef0 con 0x7fd4e806f4b0 2024-09-17T03:15:09.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.204+0000 7fd4ec990640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e80d11f0 con 0x7fd4e81f93a0 2024-09-17T03:15:09.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.204+0000 7fd4e5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4e80ceb40 0x7fd4e81f8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.205+0000 7fd4e5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4e80ceb40 0x7fd4e81f8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50920/0 (socket says 172.21.15.78:50920) 2024-09-17T03:15:09.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.205+0000 7fd4e5d9b640 1 -- 172.21.15.78:0/487853236 learned_addr learned my addr 172.21.15.78:0/487853236 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:09.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.205+0000 7fd4e659c640 1 --2- 172.21.15.78:0/487853236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd4e806f4b0 0x7fd4e81f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.205+0000 7fd4e6d9d640 1 --2- 172.21.15.78:0/487853236 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd4e81f93a0 0x7fd4e80a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.205+0000 7fd4e5d9b640 1 -- 172.21.15.78:0/487853236 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd4e81f93a0 msgr2=0x7fd4e80a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.205+0000 7fd4e5d9b640 1 --2- 172.21.15.78:0/487853236 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd4e81f93a0 0x7fd4e80a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.205+0000 7fd4e5d9b640 1 -- 172.21.15.78:0/487853236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd4e806f4b0 msgr2=0x7fd4e81f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.205+0000 7fd4e5d9b640 1 --2- 172.21.15.78:0/487853236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd4e806f4b0 0x7fd4e81f5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.205+0000 7fd4e5d9b640 1 -- 172.21.15.78:0/487853236 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e81f6270 con 0x7fd4e80ceb40 2024-09-17T03:15:09.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.205+0000 7fd4e5d9b640 1 --2- 172.21.15.78:0/487853236 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4e80ceb40 0x7fd4e81f8e60 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00b3e0 tx=0x7fd4dc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:09.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.205+0000 7fd4d6ffd640 1 -- 172.21.15.78:0/487853236 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc015020 con 0x7fd4e80ceb40 2024-09-17T03:15:09.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.205+0000 7fd4d6ffd640 1 -- 172.21.15.78:0/487853236 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4dc011920 con 0x7fd4e80ceb40 2024-09-17T03:15:09.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.205+0000 7fd4ec990640 1 -- 172.21.15.78:0/487853236 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e81f6550 con 0x7fd4e80ceb40 2024-09-17T03:15:09.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.205+0000 7fd4d6ffd640 1 -- 172.21.15.78:0/487853236 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc011d70 con 0x7fd4e80ceb40 2024-09-17T03:15:09.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.205+0000 7fd4ec990640 1 -- 172.21.15.78:0/487853236 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e80cca20 con 0x7fd4e80ceb40 2024-09-17T03:15:09.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.207+0000 7fd4d6ffd640 1 -- 172.21.15.78:0/487853236 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd4dc018020 con 0x7fd4e80ceb40 2024-09-17T03:15:09.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.207+0000 7fd4d6ffd640 1 --2- 172.21.15.78:0/487853236 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd4c8078b90 0x7fd4c807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.208+0000 7fd4d6ffd640 1 -- 172.21.15.78:0/487853236 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fd4dc09aca0 con 0x7fd4e80ceb40 2024-09-17T03:15:09.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.208+0000 7fd4e659c640 1 --2- 172.21.15.78:0/487853236 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd4c8078b90 0x7fd4c807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.208+0000 7fd4e659c640 1 --2- 172.21.15.78:0/487853236 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd4c8078b90 0x7fd4c807b0a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8034000 tx=0x7fd4d8004ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:09.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.209+0000 7fd4f39df740 1 Processor -- start 2024-09-17T03:15:09.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.209+0000 7fd4f39df740 1 -- start start 2024-09-17T03:15:09.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.210+0000 7fd4f39df740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 0x55729d2b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.210+0000 7fd4f39df740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55729ce9f4d0 0x55729d289860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.210+0000 7fd4f39df740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55729cea76b0 0x55729d289da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.210+0000 7fd4f39df740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55729d1e2a60 con 0x55729cec8390 2024-09-17T03:15:09.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.210+0000 7fd4f39df740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55729d1d1e90 con 0x55729ce9f4d0 2024-09-17T03:15:09.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.210+0000 7fd4f39df740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55729d1d5ca0 con 0x55729cea76b0 2024-09-17T03:15:09.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.210+0000 7fd4e659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 0x55729d2b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.210+0000 7fd4e659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 0x55729d2b4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50932/0 (socket says 172.21.15.78:50932) 2024-09-17T03:15:09.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.210+0000 7fd4e659c640 1 -- 172.21.15.78:0/1906688002 learned_addr learned my addr 172.21.15.78:0/1906688002 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:09.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.210+0000 7fd4e6d9d640 1 --2- 172.21.15.78:0/1906688002 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55729cea76b0 0x55729d289da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.210+0000 7fd4e5d9b640 1 --2- 172.21.15.78:0/1906688002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55729ce9f4d0 0x55729d289860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.210+0000 7fd4e659c640 1 -- 172.21.15.78:0/1906688002 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55729cea76b0 msgr2=0x55729d289da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:09.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.210+0000 7fd4e659c640 1 --2- 172.21.15.78:0/1906688002 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55729cea76b0 0x55729d289da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.210+0000 7fd4e659c640 1 -- 172.21.15.78:0/1906688002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55729ce9f4d0 msgr2=0x55729d289860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:09.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.210+0000 7fd4e659c640 1 --2- 172.21.15.78:0/1906688002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55729ce9f4d0 0x55729d289860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.210+0000 7fd4e659c640 1 -- 172.21.15.78:0/1906688002 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55729cfaa7d0 con 0x55729cec8390 2024-09-17T03:15:09.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.210+0000 7fd4e6d9d640 1 --2- 172.21.15.78:0/1906688002 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55729cea76b0 0x55729d289da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:09.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.211+0000 7fd4e659c640 1 --2- 172.21.15.78:0/1906688002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 0x55729d2b4a10 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8000f80 tx=0x7fd4d803b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4b1b160695dbe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:09.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.211+0000 7fd4c7fff640 1 -- 172.21.15.78:0/1906688002 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8037040 con 0x55729cec8390 2024-09-17T03:15:09.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.211+0000 7fd4c7fff640 1 -- 172.21.15.78:0/1906688002 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4d8042070 con 0x55729cec8390 2024-09-17T03:15:09.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.211+0000 7fd4c7fff640 1 -- 172.21.15.78:0/1906688002 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8032950 con 0x55729cec8390 2024-09-17T03:15:09.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.212+0000 7fd4f39df740 1 -- 172.21.15.78:0/1906688002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 msgr2=0x55729d2b4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.212+0000 7fd4f39df740 1 --2- 172.21.15.78:0/1906688002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 0x55729d2b4a10 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8000f80 tx=0x7fd4d803b000 comp rx=0 tx=0).stop 2024-09-17T03:15:09.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.212+0000 7fd4f39df740 1 -- 172.21.15.78:0/1906688002 shutdown_connections 2024-09-17T03:15:09.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.212+0000 7fd4f39df740 1 --2- 172.21.15.78:0/1906688002 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55729cea76b0 0x55729d289da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.212+0000 7fd4f39df740 1 --2- 172.21.15.78:0/1906688002 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55729ce9f4d0 0x55729d289860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.212+0000 7fd4f39df740 1 --2- 172.21.15.78:0/1906688002 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 0x55729d2b4a10 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.212+0000 7fd4f39df740 1 -- 172.21.15.78:0/1906688002 >> 172.21.15.78:0/1906688002 conn(0x55729cebc4e0 msgr2=0x55729d26fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:09.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.212+0000 7fd4f39df740 1 -- 172.21.15.78:0/1906688002 shutdown_connections 2024-09-17T03:15:09.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.212+0000 7fd4f39df740 1 -- 172.21.15.78:0/1906688002 wait complete. 2024-09-17T03:15:09.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.213+0000 7fd4f39df740 1 -- start start 2024-09-17T03:15:09.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.213+0000 7fd4f39df740 1 Processor -- start 2024-09-17T03:15:09.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.214+0000 7fd4f39df740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729ce9f4d0 0x55729d299570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.214+0000 7fd4f39df740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55729cea76b0 0x55729d2affa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.214+0000 7fd4f39df740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55729cec8390 0x55729d2b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.214+0000 7fd4f39df740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55729cf42740 con 0x55729ce9f4d0 2024-09-17T03:15:09.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.214+0000 7fd4f39df740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55729d177970 con 0x55729cec8390 2024-09-17T03:15:09.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.214+0000 7fd4f39df740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55729d2b0b40 con 0x55729cea76b0 2024-09-17T03:15:09.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.214+0000 7fd4f39df740 10 client.0 _ll_register_callbacks cb 0x55729d186780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:09.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.214+0000 7fd4e659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729ce9f4d0 0x55729d299570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.214+0000 7fd4e659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729ce9f4d0 0x55729d299570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50948/0 (socket says 172.21.15.78:50948) 2024-09-17T03:15:09.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.214+0000 7fd4e659c640 1 -- 172.21.15.78:0/593062529 learned_addr learned my addr 172.21.15.78:0/593062529 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:09.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.214+0000 7fd4e6d9d640 1 --2- 172.21.15.78:0/593062529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55729cec8390 0x55729d2b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.214+0000 7fd4e5d9b640 1 --2- 172.21.15.78:0/593062529 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55729cea76b0 0x55729d2affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4e659c640 1 -- 172.21.15.78:0/593062529 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55729cea76b0 msgr2=0x55729d2affa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:09.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4e659c640 1 --2- 172.21.15.78:0/593062529 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55729cea76b0 0x55729d2affa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4e659c640 1 -- 172.21.15.78:0/593062529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55729cec8390 msgr2=0x55729d2b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:09.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4e659c640 1 --2- 172.21.15.78:0/593062529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55729cec8390 0x55729d2b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4e659c640 1 -- 172.21.15.78:0/593062529 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55729cf33970 con 0x55729ce9f4d0 2024-09-17T03:15:09.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4e659c640 1 --2- 172.21.15.78:0/593062529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729ce9f4d0 0x55729d299570 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8006010 tx=0x7fd4d8032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05cbb7eeec3f866 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:09.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:09.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4c57fa640 1 -- 172.21.15.78:0/593062529 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8037040 con 0x55729ce9f4d0 2024-09-17T03:15:09.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4f39df740 1 -- 172.21.15.78:0/593062529 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4d8042070 con 0x55729ce9f4d0 2024-09-17T03:15:09.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4c57fa640 1 -- 172.21.15.78:0/593062529 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fd4d803d680 con 0x55729ce9f4d0 2024-09-17T03:15:09.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4c57fa640 1 -- 172.21.15.78:0/593062529 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7fd4d8061050 con 0x55729ce9f4d0 2024-09-17T03:15:09.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4f39df740 10 client.8712 fetch_fsmap learned FSMap version 100 2024-09-17T03:15:09.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4f39df740 1 -- 172.21.15.78:0/593062529 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x55729cf116a0 con 0x55729ce9f4d0 2024-09-17T03:15:09.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4c57fa640 1 -- 172.21.15.78:0/593062529 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4d8042070 con 0x55729ce9f4d0 2024-09-17T03:15:09.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4c57fa640 1 -- 172.21.15.78:0/593062529 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 100) ==== 3554+0+0 (secure 0 0 0) 0x7fd4d8064020 con 0x55729ce9f4d0 2024-09-17T03:15:09.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4f39df740 10 client.8712 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T03:15:09.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4f39df740 10 client.8712 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T03:15:09.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4f39df740 20 client.8712 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:09.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4f39df740 1 --2- 172.21.15.78:0/593062529 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55729ce86f60 0x55729d2b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4f39df740 4 client.8712 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:09.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.215+0000 7fd4f39df740 1 -- 172.21.15.78:0/593062529 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55729d1e49b0 con 0x55729ce86f60 2024-09-17T03:15:09.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.216+0000 7fd4e5d9b640 1 --2- 172.21.15.78:0/593062529 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55729ce86f60 0x55729d2b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.216+0000 7fd4c57fa640 10 client.8712 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:09.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.216+0000 7fd4e5d9b640 1 --2- 172.21.15.78:0/593062529 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55729ce86f60 0x55729d2b04e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=557b90cb70d15b9b server_cookie=80bdef41e857fd08 in_seq=0 out_seq=0 2024-09-17T03:15:09.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.216+0000 7fd4c57fa640 1 -- 172.21.15.78:0/593062529 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55729d1e49b0 con 0x55729ce86f60 2024-09-17T03:15:09.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.216+0000 7fd4c57fa640 10 client.8712 handle_command_reply: tid=0 2024-09-17T03:15:09.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.217+0000 7fd4f39df740 1 client.8712 shutdown 2024-09-17T03:15:09.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.217+0000 7fd4f39df740 1 -- 172.21.15.78:0/593062529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729ce9f4d0 msgr2=0x55729d299570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.217+0000 7fd4f39df740 1 --2- 172.21.15.78:0/593062529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729ce9f4d0 0x55729d299570 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8006010 tx=0x7fd4d8032c90 comp rx=0 tx=0).stop 2024-09-17T03:15:09.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.217+0000 7fd4f39df740 1 -- 172.21.15.78:0/593062529 shutdown_connections 2024-09-17T03:15:09.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.217+0000 7fd4f39df740 1 --2- 172.21.15.78:0/593062529 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55729ce86f60 0x55729d2b04e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.217+0000 7fd4f39df740 1 --2- 172.21.15.78:0/593062529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55729cec8390 0x55729d2b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.217+0000 7fd4f39df740 1 --2- 172.21.15.78:0/593062529 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55729cea76b0 0x55729d2affa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.217+0000 7fd4f39df740 1 --2- 172.21.15.78:0/593062529 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729ce9f4d0 0x55729d299570 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.217+0000 7fd4c57fa640 0 client.8712 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:09.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.217+0000 7fd4f39df740 1 -- 172.21.15.78:0/593062529 >> 172.21.15.78:0/593062529 conn(0x55729cebc4e0 msgr2=0x55729d289ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:09.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.217+0000 7fd4f39df740 1 -- 172.21.15.78:0/593062529 shutdown_connections 2024-09-17T03:15:09.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.217+0000 7fd4f39df740 1 -- 172.21.15.78:0/593062529 wait complete. 2024-09-17T03:15:09.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.217+0000 7fd4f39df740 20 client.8712 trim_cache size 0 max 16384 2024-09-17T03:15:09.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.234+0000 7fd4f39df740 1 Processor -- start 2024-09-17T03:15:09.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.234+0000 7fd4f39df740 1 -- start start 2024-09-17T03:15:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.236+0000 7fd4f39df740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55729ce9f4d0 0x55729d296690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.236+0000 7fd4f39df740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55729cea76b0 0x55729d296bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.236+0000 7fd4f39df740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 0x55729d2aff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.236+0000 7fd4f39df740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e82023c0 con 0x55729cec8390 2024-09-17T03:15:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.236+0000 7fd4f39df740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e8201590 con 0x55729ce9f4d0 2024-09-17T03:15:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.236+0000 7fd4f39df740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd4e8201c90 con 0x55729cea76b0 2024-09-17T03:15:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.236+0000 7fd4e6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 0x55729d2aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.236+0000 7fd4e6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 0x55729d2aff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50954/0 (socket says 172.21.15.78:50954) 2024-09-17T03:15:09.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.236+0000 7fd4e6d9d640 1 -- 172.21.15.78:0/3283115150 learned_addr learned my addr 172.21.15.78:0/3283115150 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:09.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.236+0000 7fd4e6d9d640 1 -- 172.21.15.78:0/3283115150 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55729cea76b0 msgr2=0x55729d296bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:09.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.236+0000 7fd4e6d9d640 1 --2- 172.21.15.78:0/3283115150 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55729cea76b0 0x55729d296bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.236+0000 7fd4e6d9d640 1 -- 172.21.15.78:0/3283115150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55729ce9f4d0 msgr2=0x55729d296690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:09.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.236+0000 7fd4e6d9d640 1 --2- 172.21.15.78:0/3283115150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55729ce9f4d0 0x55729d296690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.236+0000 7fd4e6d9d640 1 -- 172.21.15.78:0/3283115150 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55729d2714f0 con 0x55729cec8390 2024-09-17T03:15:09.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.236+0000 7fd4e6d9d640 1 --2- 172.21.15.78:0/3283115150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 0x55729d2aff60 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0001660 tx=0x7fd4e0001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4dd071ce28aac18 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:09.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.236+0000 7fd4c77fe640 1 -- 172.21.15.78:0/3283115150 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e001a030 con 0x55729cec8390 2024-09-17T03:15:09.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.236+0000 7fd4c77fe640 1 -- 172.21.15.78:0/3283115150 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4e0013830 con 0x55729cec8390 2024-09-17T03:15:09.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.236+0000 7fd4c77fe640 1 -- 172.21.15.78:0/3283115150 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0013a60 con 0x55729cec8390 2024-09-17T03:15:09.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.237+0000 7fd4f39df740 1 -- 172.21.15.78:0/3283115150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 msgr2=0x55729d2aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.237+0000 7fd4f39df740 1 --2- 172.21.15.78:0/3283115150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 0x55729d2aff60 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0001660 tx=0x7fd4e0001b20 comp rx=0 tx=0).stop 2024-09-17T03:15:09.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.237+0000 7fd4f39df740 1 -- 172.21.15.78:0/3283115150 shutdown_connections 2024-09-17T03:15:09.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.237+0000 7fd4f39df740 1 --2- 172.21.15.78:0/3283115150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 0x55729d2aff60 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.237+0000 7fd4f39df740 1 --2- 172.21.15.78:0/3283115150 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55729cea76b0 0x55729d296bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.237+0000 7fd4f39df740 1 --2- 172.21.15.78:0/3283115150 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55729ce9f4d0 0x55729d296690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.237+0000 7fd4f39df740 1 -- 172.21.15.78:0/3283115150 >> 172.21.15.78:0/3283115150 conn(0x55729cebc4e0 msgr2=0x55729d26f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:09.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.237+0000 7fd4f39df740 1 -- 172.21.15.78:0/3283115150 shutdown_connections 2024-09-17T03:15:09.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.237+0000 7fd4f39df740 1 -- 172.21.15.78:0/3283115150 wait complete. 2024-09-17T03:15:09.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.238+0000 7fd4f39df740 1 -- start start 2024-09-17T03:15:09.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.238+0000 7fd4f39df740 1 Processor -- start 2024-09-17T03:15:09.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4f39df740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55729ce9f4d0 0x55729d2aef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4f39df740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55729cea76b0 0x55729d32a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4f39df740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 0x55729d26f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4f39df740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e8154010 con 0x55729cec8390 2024-09-17T03:15:09.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4f39df740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55729d2acb30 con 0x55729ce9f4d0 2024-09-17T03:15:09.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4f39df740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55729d3380d0 con 0x55729cea76b0 2024-09-17T03:15:09.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4f39df740 10 client.0 _ll_register_callbacks cb 0x7fd4d8009a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:09.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4e6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 0x55729d26f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4e6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 0x55729d26f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50960/0 (socket says 172.21.15.78:50960) 2024-09-17T03:15:09.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4e6d9d640 1 -- 172.21.15.78:0/3643686093 learned_addr learned my addr 172.21.15.78:0/3643686093 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:09.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4e5d9b640 1 --2- 172.21.15.78:0/3643686093 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55729cea76b0 0x55729d32a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4e659c640 1 --2- 172.21.15.78:0/3643686093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55729ce9f4d0 0x55729d2aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4e6d9d640 1 -- 172.21.15.78:0/3643686093 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55729cea76b0 msgr2=0x55729d32a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:09.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4e6d9d640 1 --2- 172.21.15.78:0/3643686093 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55729cea76b0 0x55729d32a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4e6d9d640 1 -- 172.21.15.78:0/3643686093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55729ce9f4d0 msgr2=0x55729d2aef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:09.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4e6d9d640 1 --2- 172.21.15.78:0/3643686093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55729ce9f4d0 0x55729d2aef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4e6d9d640 1 -- 172.21.15.78:0/3643686093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55729d337310 con 0x55729cec8390 2024-09-17T03:15:09.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4e659c640 1 --2- 172.21.15.78:0/3643686093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55729ce9f4d0 0x55729d2aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:09.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4e6d9d640 1 --2- 172.21.15.78:0/3643686093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 0x55729d26f770 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0000c00 tx=0x7fd4e0005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9da5e0f57449f58 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:09.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:09.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4c57fa640 1 -- 172.21.15.78:0/3643686093 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4e0027060 con 0x55729cec8390 2024-09-17T03:15:09.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4c57fa640 1 -- 172.21.15.78:0/3643686093 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fd4e0006890 con 0x55729cec8390 2024-09-17T03:15:09.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.240+0000 7fd4f39df740 1 -- 172.21.15.78:0/3643686093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4e0013830 con 0x55729cec8390 2024-09-17T03:15:09.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.241+0000 7fd4c57fa640 1 -- 172.21.15.78:0/3643686093 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) ==== 24+0+0 (secure 0 0 0) 0x7fd4e002d050 con 0x55729cec8390 2024-09-17T03:15:09.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.241+0000 7fd4f39df740 10 client.8718 fetch_fsmap learned FSMap version 100 2024-09-17T03:15:09.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.241+0000 7fd4f39df740 1 -- 172.21.15.78:0/3643686093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) -- 0x55729d32a9a0 con 0x55729cec8390 2024-09-17T03:15:09.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.241+0000 7fd4c57fa640 1 -- 172.21.15.78:0/3643686093 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4e0013830 con 0x55729cec8390 2024-09-17T03:15:09.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.241+0000 7fd4c57fa640 1 -- 172.21.15.78:0/3643686093 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 100) ==== 3554+0+0 (secure 0 0 0) 0x7fd4e0030020 con 0x55729cec8390 2024-09-17T03:15:09.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.241+0000 7fd4f39df740 10 client.8718 fetch_fsmap finished waiting for FSMap version 100 2024-09-17T03:15:09.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.241+0000 7fd4f39df740 10 client.8718 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T03:15:09.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.241+0000 7fd4f39df740 20 client.8718 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:09.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.241+0000 7fd4f39df740 1 --2- 172.21.15.78:0/3643686093 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55729d26fcb0 0x55729d295680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.241+0000 7fd4f39df740 4 client.8718 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:15:09.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.241+0000 7fd4f39df740 1 -- 172.21.15.78:0/3643686093 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55729d1e0460 con 0x55729d26fcb0 2024-09-17T03:15:09.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.241+0000 7fd4e659c640 1 --2- 172.21.15.78:0/3643686093 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55729d26fcb0 0x55729d295680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.241+0000 7fd4c57fa640 10 client.8718 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:09.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.241+0000 7fd4e659c640 1 --2- 172.21.15.78:0/3643686093 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55729d26fcb0 0x55729d295680 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdedef15a82334f7 server_cookie=895c5e5278f9d3ca in_seq=0 out_seq=0 2024-09-17T03:15:09.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.242+0000 7fd4c57fa640 1 -- 172.21.15.78:0/3643686093 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x55729d1e0460 con 0x55729d26fcb0 2024-09-17T03:15:09.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.242+0000 7fd4c57fa640 10 client.8718 handle_command_reply: tid=0 2024-09-17T03:15:09.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.242+0000 7fd4f39df740 1 client.8718 shutdown 2024-09-17T03:15:09.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.242+0000 7fd4f39df740 1 -- 172.21.15.78:0/3643686093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 msgr2=0x55729d26f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.242+0000 7fd4f39df740 1 --2- 172.21.15.78:0/3643686093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 0x55729d26f770 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fd4e0000c00 tx=0x7fd4e0005270 comp rx=0 tx=0).stop 2024-09-17T03:15:09.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.242+0000 7fd4f39df740 1 -- 172.21.15.78:0/3643686093 shutdown_connections 2024-09-17T03:15:09.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.242+0000 7fd4f39df740 1 --2- 172.21.15.78:0/3643686093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55729cec8390 0x55729d26f770 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.242+0000 7fd4f39df740 1 --2- 172.21.15.78:0/3643686093 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55729cea76b0 0x55729d32a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.242+0000 7fd4f39df740 1 --2- 172.21.15.78:0/3643686093 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55729d26fcb0 0x55729d295680 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.242+0000 7fd4f39df740 1 --2- 172.21.15.78:0/3643686093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55729ce9f4d0 0x55729d2aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.242+0000 7fd4c57fa640 0 client.8718 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:09.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.242+0000 7fd4f39df740 1 -- 172.21.15.78:0/3643686093 >> 172.21.15.78:0/3643686093 conn(0x55729cebc4e0 msgr2=0x55729d2697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:09.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.242+0000 7fd4f39df740 1 -- 172.21.15.78:0/3643686093 shutdown_connections 2024-09-17T03:15:09.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.242+0000 7fd4f39df740 1 -- 172.21.15.78:0/3643686093 wait complete. 2024-09-17T03:15:09.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.242+0000 7fd4f39df740 20 client.8718 trim_cache size 0 max 16384 2024-09-17T03:15:09.247 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:09.247 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-17T03:15:09.247 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:15:09.247 INFO:teuthology.orchestra.run.smithi078.stdout: "0d177712-01a0-4dfb-8f16-2e7c84183356": { 2024-09-17T03:15:09.247 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:15:09.247 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "0d177712-01a0-4dfb-8f16-2e7c84183356", 2024-09-17T03:15:09.247 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:15:09.248 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:09.248 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:15:09.248 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-17T03:15:09.248 INFO:teuthology.orchestra.run.smithi078.stdout: "0d177712-01a0-4dfb-8f16-2e7c84183356": { 2024-09-17T03:15:09.248 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-17T03:15:08.556658+0000", 2024-09-17T03:15:09.248 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:15:09.248 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-17T03:15:09.248 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-17T03:15:09.248 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-17T03:15:09.248 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-17T03:15:09.248 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:09.248 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:09.248 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:09.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.243+0000 7fd4ec990640 1 -- 172.21.15.78:0/487853236 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd4c8078b90 msgr2=0x7fd4c807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.243+0000 7fd4ec990640 1 --2- 172.21.15.78:0/487853236 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd4c8078b90 0x7fd4c807b0a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8034000 tx=0x7fd4d8004ab0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.243+0000 7fd4ec990640 1 -- 172.21.15.78:0/487853236 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4e80ceb40 msgr2=0x7fd4e81f8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.243+0000 7fd4ec990640 1 --2- 172.21.15.78:0/487853236 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4e80ceb40 0x7fd4e81f8e60 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00b3e0 tx=0x7fd4dc00b8a0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.243+0000 7fd4ec990640 1 -- 172.21.15.78:0/487853236 shutdown_connections 2024-09-17T03:15:09.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.243+0000 7fd4ec990640 1 --2- 172.21.15.78:0/487853236 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd4e81f93a0 0x7fd4e80a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.243+0000 7fd4ec990640 1 --2- 172.21.15.78:0/487853236 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4e80ceb40 0x7fd4e81f8e60 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.243+0000 7fd4ec990640 1 --2- 172.21.15.78:0/487853236 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd4c8078b90 0x7fd4c807b0a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.243+0000 7fd4ec990640 1 --2- 172.21.15.78:0/487853236 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd4e806f4b0 0x7fd4e81f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.243+0000 7fd4ec990640 1 -- 172.21.15.78:0/487853236 >> 172.21.15.78:0/487853236 conn(0x7fd4e808bfc0 msgr2=0x7fd4e8161950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:09.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.243+0000 7fd4ec990640 1 -- 172.21.15.78:0/487853236 shutdown_connections 2024-09-17T03:15:09.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.243+0000 7fd4ec990640 1 -- 172.21.15.78:0/487853236 wait complete. 2024-09-17T03:15:09.253 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:15:09.254 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:09.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.367+0000 7fe0ac0f9640 1 -- 172.21.15.78:0/1101073487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40b9970 msgr2=0x7fe0a40b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.367+0000 7fe0ac0f9640 1 --2- 172.21.15.78:0/1101073487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40b9970 0x7fe0a40b3710 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fe0a408d760 tx=0x7fe0a002a980 comp rx=0 tx=0).stop 2024-09-17T03:15:09.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.367+0000 7fe0ac0f9640 1 -- 172.21.15.78:0/1101073487 shutdown_connections 2024-09-17T03:15:09.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.367+0000 7fe0ac0f9640 1 --2- 172.21.15.78:0/1101073487 >> v2:172.21.15.193:3300/0 conn(0x7fe0a406e0e0 0x7fe0a406e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.367+0000 7fe0ac0f9640 1 --2- 172.21.15.78:0/1101073487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40b9970 0x7fe0a40b3710 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.367+0000 7fe0ac0f9640 1 -- 172.21.15.78:0/1101073487 >> 172.21.15.78:0/1101073487 conn(0x7fe0a409d7f0 msgr2=0x7fe0a40d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:09.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.367+0000 7fe0ac0f9640 1 -- 172.21.15.78:0/1101073487 shutdown_connections 2024-09-17T03:15:09.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.367+0000 7fe0ac0f9640 1 -- 172.21.15.78:0/1101073487 wait complete. 2024-09-17T03:15:09.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.369+0000 7fe0ac0f9640 1 Processor -- start 2024-09-17T03:15:09.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.369+0000 7fe0ac0f9640 1 -- start start 2024-09-17T03:15:09.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.370+0000 7fe0ac0f9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0a406e0e0 0x7fe0a415af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.370+0000 7fe0ac0f9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40b5fa0 0x7fe0a40c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.370+0000 7fe0ac0f9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0a40b9970 0x7fe0a40c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.370+0000 7fe0ac0f9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a406ea30 con 0x7fe0a40b5fa0 2024-09-17T03:15:09.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.370+0000 7fe0ac0f9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a40d5010 con 0x7fe0a406e0e0 2024-09-17T03:15:09.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.370+0000 7fe0ac0f9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a406ebb0 con 0x7fe0a40b9970 2024-09-17T03:15:09.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.370+0000 7fe0a9694640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40b5fa0 0x7fe0a40c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.370+0000 7fe0a9694640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40b5fa0 0x7fe0a40c8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50990/0 (socket says 172.21.15.78:50990) 2024-09-17T03:15:09.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.370+0000 7fe0a9694640 1 -- 172.21.15.78:0/1226135645 learned_addr learned my addr 172.21.15.78:0/1226135645 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:09.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.371+0000 7fe0aa696640 1 --2- 172.21.15.78:0/1226135645 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0a40b9970 0x7fe0a40c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.371+0000 7fe0a9e95640 1 --2- 172.21.15.78:0/1226135645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0a406e0e0 0x7fe0a415af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.371+0000 7fe0a9694640 1 -- 172.21.15.78:0/1226135645 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0a40b9970 msgr2=0x7fe0a40c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.371+0000 7fe0a9694640 1 --2- 172.21.15.78:0/1226135645 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0a40b9970 0x7fe0a40c8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.371+0000 7fe0a9694640 1 -- 172.21.15.78:0/1226135645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0a406e0e0 msgr2=0x7fe0a415af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.371+0000 7fe0a9694640 1 --2- 172.21.15.78:0/1226135645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0a406e0e0 0x7fe0a415af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.371+0000 7fe0a9694640 1 -- 172.21.15.78:0/1226135645 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a40caeb0 con 0x7fe0a40b5fa0 2024-09-17T03:15:09.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.371+0000 7fe0a9694640 1 --2- 172.21.15.78:0/1226135645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40b5fa0 0x7fe0a40c8960 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fe09400b420 tx=0x7fe09400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:09.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.371+0000 7fe09a7fc640 1 -- 172.21.15.78:0/1226135645 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094011830 con 0x7fe0a40b5fa0 2024-09-17T03:15:09.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.371+0000 7fe09a7fc640 1 -- 172.21.15.78:0/1226135645 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe094016070 con 0x7fe0a40b5fa0 2024-09-17T03:15:09.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.371+0000 7fe0ac0f9640 1 -- 172.21.15.78:0/1226135645 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a415c160 con 0x7fe0a40b5fa0 2024-09-17T03:15:09.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.371+0000 7fe09a7fc640 1 -- 172.21.15.78:0/1226135645 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094011d60 con 0x7fe0a40b5fa0 2024-09-17T03:15:09.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.371+0000 7fe0ac0f9640 1 -- 172.21.15.78:0/1226135645 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a415c720 con 0x7fe0a40b5fa0 2024-09-17T03:15:09.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.372+0000 7fe0ac0f9640 1 -- 172.21.15.78:0/1226135645 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a406e4f0 con 0x7fe0a40b5fa0 2024-09-17T03:15:09.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.373+0000 7fe09a7fc640 1 -- 172.21.15.78:0/1226135645 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe09401b460 con 0x7fe0a40b5fa0 2024-09-17T03:15:09.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.373+0000 7fe09a7fc640 1 --2- 172.21.15.78:0/1226135645 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe088078b90 0x7fe08807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.374+0000 7fe09a7fc640 1 -- 172.21.15.78:0/1226135645 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fe09409a760 con 0x7fe0a40b5fa0 2024-09-17T03:15:09.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.374+0000 7fe0a9e95640 1 --2- 172.21.15.78:0/1226135645 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe088078b90 0x7fe08807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.374+0000 7fe0a9e95640 1 --2- 172.21.15.78:0/1226135645 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe088078b90 0x7fe08807b0a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0035000 tx=0x7fe0a0004ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:09.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.378+0000 7fe09a7fc640 1 -- 172.21.15.78:0/1226135645 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fe094020020 con 0x7fe0a40b5fa0 2024-09-17T03:15:09.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.588+0000 7fe0ac0f9640 1 -- 172.21.15.78:0/1226135645 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0a40cac00 con 0x7fe0a40b5fa0 2024-09-17T03:15:09.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.588+0000 7fe09a7fc640 1 -- 172.21.15.78:0/1226135645 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) ==== 95+0+5275 (secure 0 0 0) 0x7fe094062540 con 0x7fe0a40b5fa0 2024-09-17T03:15:09.588 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:09.588 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":100,"btime":"2024-09-17T03:15:05:697068+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:15:05.053995+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8286,"mds_1":8283,"mds_2":7213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7213":{"gid":7213,"name":"d","rank":2,"incarnation":97,"state":"up:active","state_seq":5,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8283":{"gid":8283,"name":"a","rank":1,"incarnation":95,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[7213,8283,8286]},"id":7}]} 2024-09-17T03:15:09.588 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 100 2024-09-17T03:15:09.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.590+0000 7fe0ac0f9640 1 -- 172.21.15.78:0/1226135645 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe088078b90 msgr2=0x7fe08807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.590+0000 7fe0ac0f9640 1 --2- 172.21.15.78:0/1226135645 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe088078b90 0x7fe08807b0a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0035000 tx=0x7fe0a0004ab0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.590+0000 7fe0ac0f9640 1 -- 172.21.15.78:0/1226135645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40b5fa0 msgr2=0x7fe0a40c8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.590+0000 7fe0ac0f9640 1 --2- 172.21.15.78:0/1226135645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40b5fa0 0x7fe0a40c8960 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fe09400b420 tx=0x7fe09400b8e0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.591+0000 7fe0ac0f9640 1 -- 172.21.15.78:0/1226135645 shutdown_connections 2024-09-17T03:15:09.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.591+0000 7fe0ac0f9640 1 --2- 172.21.15.78:0/1226135645 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0a40b9970 0x7fe0a40c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.591+0000 7fe0ac0f9640 1 --2- 172.21.15.78:0/1226135645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40b5fa0 0x7fe0a40c8960 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.591+0000 7fe0ac0f9640 1 --2- 172.21.15.78:0/1226135645 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe088078b90 0x7fe08807b0a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.591+0000 7fe0ac0f9640 1 --2- 172.21.15.78:0/1226135645 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0a406e0e0 0x7fe0a415af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.591+0000 7fe0ac0f9640 1 -- 172.21.15.78:0/1226135645 >> 172.21.15.78:0/1226135645 conn(0x7fe0a409d7f0 msgr2=0x7fe0a415e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:09.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.591+0000 7fe0ac0f9640 1 -- 172.21.15.78:0/1226135645 shutdown_connections 2024-09-17T03:15:09.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.591+0000 7fe0ac0f9640 1 -- 172.21.15.78:0/1226135645 wait complete. 2024-09-17T03:15:09.601 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2024-09-17T03:15:09.601 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:15:09.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.713+0000 7f7791a70640 1 -- 172.21.15.78:0/4068438938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f778c0cd360 msgr2=0x7f778c15c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.713+0000 7f7791a70640 1 --2- 172.21.15.78:0/4068438938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f778c0cd360 0x7f778c15c6a0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f777c009830 tx=0x7f777c02a480 comp rx=0 tx=0).stop 2024-09-17T03:15:09.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.713+0000 7f7791a70640 1 -- 172.21.15.78:0/4068438938 shutdown_connections 2024-09-17T03:15:09.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.713+0000 7f7791a70640 1 --2- 172.21.15.78:0/4068438938 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f778c0cf440 0x7f778c0d0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.713+0000 7f7791a70640 1 --2- 172.21.15.78:0/4068438938 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f778c0cd360 0x7f778c15c6a0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.713+0000 7f7791a70640 1 -- 172.21.15.78:0/4068438938 >> 172.21.15.78:0/4068438938 conn(0x7f778c0710b0 msgr2=0x7f778c0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:09.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.713+0000 7f7791a70640 1 -- 172.21.15.78:0/4068438938 shutdown_connections 2024-09-17T03:15:09.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.713+0000 7f7791a70640 1 -- 172.21.15.78:0/4068438938 wait complete. 2024-09-17T03:15:09.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.715+0000 7f7791a70640 1 Processor -- start 2024-09-17T03:15:09.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.715+0000 7f7791a70640 1 -- start start 2024-09-17T03:15:09.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.716+0000 7f7791a70640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f778c0b7fe0 0x7f778c15ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.716+0000 7f7791a70640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f778c0cd360 0x7f778c15e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.716+0000 7f7791a70640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f778c15ba50 0x7f778c15e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.716+0000 7f7791a70640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f778c0d0c50 con 0x7f778c15ba50 2024-09-17T03:15:09.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.716+0000 7f7791a70640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f778c0d0ad0 con 0x7f778c0b7fe0 2024-09-17T03:15:09.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.716+0000 7f7791a70640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f778c0d0dd0 con 0x7f778c0cd360 2024-09-17T03:15:09.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.716+0000 7f778bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f778c15ba50 0x7f778c15e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.717+0000 7f778bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f778c15ba50 0x7f778c15e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51014/0 (socket says 172.21.15.78:51014) 2024-09-17T03:15:09.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.717+0000 7f778bfff640 1 -- 172.21.15.78:0/2720110747 learned_addr learned my addr 172.21.15.78:0/2720110747 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:09.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.717+0000 7f778b7fe640 1 --2- 172.21.15.78:0/2720110747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f778c0b7fe0 0x7f778c15ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.717+0000 7f778affd640 1 --2- 172.21.15.78:0/2720110747 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f778c0cd360 0x7f778c15e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.717+0000 7f778bfff640 1 -- 172.21.15.78:0/2720110747 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f778c0cd360 msgr2=0x7f778c15e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.717+0000 7f778bfff640 1 --2- 172.21.15.78:0/2720110747 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f778c0cd360 0x7f778c15e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.717+0000 7f778bfff640 1 -- 172.21.15.78:0/2720110747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f778c0b7fe0 msgr2=0x7f778c15ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.717+0000 7f778bfff640 1 --2- 172.21.15.78:0/2720110747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f778c0b7fe0 0x7f778c15ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.717+0000 7f778bfff640 1 -- 172.21.15.78:0/2720110747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f778c15ce10 con 0x7f778c15ba50 2024-09-17T03:15:09.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.717+0000 7f778bfff640 1 --2- 172.21.15.78:0/2720110747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f778c15ba50 0x7f778c15e960 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f778400da90 tx=0x7f778400df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:09.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.717+0000 7f7773fff640 1 -- 172.21.15.78:0/2720110747 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784017070 con 0x7f778c15ba50 2024-09-17T03:15:09.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.717+0000 7f7773fff640 1 -- 172.21.15.78:0/2720110747 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7784003970 con 0x7f778c15ba50 2024-09-17T03:15:09.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.717+0000 7f7791a70640 1 -- 172.21.15.78:0/2720110747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f778c15d0f0 con 0x7f778c15ba50 2024-09-17T03:15:09.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.717+0000 7f7773fff640 1 -- 172.21.15.78:0/2720110747 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784003dc0 con 0x7f778c15ba50 2024-09-17T03:15:09.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.717+0000 7f7791a70640 1 -- 172.21.15.78:0/2720110747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f778c15d6b0 con 0x7f778c15ba50 2024-09-17T03:15:09.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.718+0000 7f7791a70640 1 -- 172.21.15.78:0/2720110747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f778c15b7c0 con 0x7f778c15ba50 2024-09-17T03:15:09.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.719+0000 7f7773fff640 1 -- 172.21.15.78:0/2720110747 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7784003f60 con 0x7f778c15ba50 2024-09-17T03:15:09.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.719+0000 7f7773fff640 1 --2- 172.21.15.78:0/2720110747 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7778078bc0 0x7f777807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:09.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.719+0000 7f7773fff640 1 -- 172.21.15.78:0/2720110747 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f778409b170 con 0x7f778c15ba50 2024-09-17T03:15:09.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.720+0000 7f778b7fe640 1 --2- 172.21.15.78:0/2720110747 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7778078bc0 0x7f777807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:09.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.720+0000 7f778b7fe640 1 --2- 172.21.15.78:0/2720110747 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7778078bc0 0x7f777807b0d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f777c034000 tx=0x7f777c004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:09.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.724+0000 7f7773fff640 1 -- 172.21.15.78:0/2720110747 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7784062ee0 con 0x7f778c15ba50 2024-09-17T03:15:09.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.965+0000 7f7791a70640 1 -- 172.21.15.78:0/2720110747 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f778c0d12f0 con 0x7f778c15ba50 2024-09-17T03:15:09.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.966+0000 7f7773fff640 1 -- 172.21.15.78:0/2720110747 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1620 (secure 0 0 0) 0x7f7784067910 con 0x7f778c15ba50 2024-09-17T03:15:09.965 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:09.965 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":427,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":62,"data_bytes":668434,"bytes_used":262049792,"bytes_avail":772832063488,"bytes_total":773094113280,"write_bytes_sec":4947,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":100,"btime":"2024-09-17T03:15:05:697068+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7213},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8283},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8286}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":28,"modified":"2024-09-17T03:14:33.219581+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:15:09.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.968+0000 7f7791a70640 1 -- 172.21.15.78:0/2720110747 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7778078bc0 msgr2=0x7f777807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.968+0000 7f7791a70640 1 --2- 172.21.15.78:0/2720110747 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7778078bc0 0x7f777807b0d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f777c034000 tx=0x7f777c004730 comp rx=0 tx=0).stop 2024-09-17T03:15:09.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.968+0000 7f7791a70640 1 -- 172.21.15.78:0/2720110747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f778c15ba50 msgr2=0x7f778c15e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:09.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.968+0000 7f7791a70640 1 --2- 172.21.15.78:0/2720110747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f778c15ba50 0x7f778c15e960 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f778400da90 tx=0x7f778400df50 comp rx=0 tx=0).stop 2024-09-17T03:15:09.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.968+0000 7f7791a70640 1 -- 172.21.15.78:0/2720110747 shutdown_connections 2024-09-17T03:15:09.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.968+0000 7f7791a70640 1 --2- 172.21.15.78:0/2720110747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f778c15ba50 0x7f778c15e960 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.968+0000 7f7791a70640 1 --2- 172.21.15.78:0/2720110747 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f778c0cd360 0x7f778c15e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.968+0000 7f7791a70640 1 --2- 172.21.15.78:0/2720110747 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7778078bc0 0x7f777807b0d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.968+0000 7f7791a70640 1 --2- 172.21.15.78:0/2720110747 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f778c0b7fe0 0x7f778c15ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:09.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.968+0000 7f7791a70640 1 -- 172.21.15.78:0/2720110747 >> 172.21.15.78:0/2720110747 conn(0x7f778c0710b0 msgr2=0x7f778c0b5810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:09.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.968+0000 7f7791a70640 1 -- 172.21.15.78:0/2720110747 shutdown_connections 2024-09-17T03:15:09.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:09.968+0000 7f7791a70640 1 -- 172.21.15.78:0/2720110747 wait complete. 2024-09-17T03:15:09.978 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T03:15:10.979 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:11.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.101+0000 7fde139ad640 1 -- 172.21.15.78:0/1040403832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddf8003a50 msgr2=0x7fddf8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:11.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.101+0000 7fde139ad640 1 --2- 172.21.15.78:0/1040403832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddf8003a50 0x7fddf8003ec0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fde08006fc0 tx=0x7fddf8005830 comp rx=0 tx=0).stop 2024-09-17T03:15:11.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.101+0000 7fde139ad640 1 -- 172.21.15.78:0/1040403832 shutdown_connections 2024-09-17T03:15:11.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.101+0000 7fde139ad640 1 --2- 172.21.15.78:0/1040403832 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fddf8003a50 0x7fddf8003ec0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:11.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.101+0000 7fde139ad640 1 -- 172.21.15.78:0/1040403832 >> 172.21.15.78:0/1040403832 conn(0x7fde0c06d550 msgr2=0x7fde0c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:11.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.102+0000 7fde139ad640 1 -- 172.21.15.78:0/1040403832 shutdown_connections 2024-09-17T03:15:11.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.102+0000 7fde139ad640 1 -- 172.21.15.78:0/1040403832 wait complete. 2024-09-17T03:15:11.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.103+0000 7fde139ad640 1 Processor -- start 2024-09-17T03:15:11.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.103+0000 7fde139ad640 1 -- start start 2024-09-17T03:15:11.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde139ad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf8003a50 0x7fde0c0cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:11.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde139ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde0c1f4380 0x7fde0c156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:11.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde139ad640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fde0c1e81b0 0x7fde0c1e85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:11.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde139ad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c15d4c0 con 0x7fde0c1f4380 2024-09-17T03:15:11.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde139ad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c15d340 con 0x7fddf8003a50 2024-09-17T03:15:11.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde139ad640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fde0c0d1f20 con 0x7fde0c1e81b0 2024-09-17T03:15:11.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde10f48640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde0c1f4380 0x7fde0c156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:11.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde10f48640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde0c1f4380 0x7fde0c156590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51028/0 (socket says 172.21.15.78:51028) 2024-09-17T03:15:11.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde10f48640 1 -- 172.21.15.78:0/367372602 learned_addr learned my addr 172.21.15.78:0/367372602 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:11.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde11749640 1 --2- 172.21.15.78:0/367372602 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf8003a50 0x7fde0c0cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:11.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde11f4a640 1 --2- 172.21.15.78:0/367372602 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fde0c1e81b0 0x7fde0c1e85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:11.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde10f48640 1 -- 172.21.15.78:0/367372602 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fde0c1e81b0 msgr2=0x7fde0c1e85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:11.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde10f48640 1 --2- 172.21.15.78:0/367372602 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fde0c1e81b0 0x7fde0c1e85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:11.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde10f48640 1 -- 172.21.15.78:0/367372602 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf8003a50 msgr2=0x7fde0c0cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:11.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde10f48640 1 --2- 172.21.15.78:0/367372602 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf8003a50 0x7fde0c0cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:11.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde10f48640 1 -- 172.21.15.78:0/367372602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0c1e8b00 con 0x7fde0c1f4380 2024-09-17T03:15:11.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde10f48640 1 --2- 172.21.15.78:0/367372602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde0c1f4380 0x7fde0c156590 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fddfc011ae0 tx=0x7fddfc009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:11.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde01ffb640 1 -- 172.21.15.78:0/367372602 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc00fcb0 con 0x7fde0c1f4380 2024-09-17T03:15:11.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde01ffb640 1 -- 172.21.15.78:0/367372602 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fddfc00fe50 con 0x7fde0c1f4380 2024-09-17T03:15:11.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde139ad640 1 -- 172.21.15.78:0/367372602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde0c0cca00 con 0x7fde0c1f4380 2024-09-17T03:15:11.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.105+0000 7fde01ffb640 1 -- 172.21.15.78:0/367372602 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc004280 con 0x7fde0c1f4380 2024-09-17T03:15:11.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.106+0000 7fde139ad640 1 -- 172.21.15.78:0/367372602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde0c0c6190 con 0x7fde0c1f4380 2024-09-17T03:15:11.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.107+0000 7fde139ad640 1 -- 172.21.15.78:0/367372602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde0c0d2410 con 0x7fde0c1f4380 2024-09-17T03:15:11.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.108+0000 7fde01ffb640 1 -- 172.21.15.78:0/367372602 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fddfc0035f0 con 0x7fde0c1f4380 2024-09-17T03:15:11.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.108+0000 7fde01ffb640 1 --2- 172.21.15.78:0/367372602 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fddf0078b90 0x7fddf007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:11.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.108+0000 7fde01ffb640 1 -- 172.21.15.78:0/367372602 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fddfc09b710 con 0x7fde0c1f4380 2024-09-17T03:15:11.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.108+0000 7fde11749640 1 --2- 172.21.15.78:0/367372602 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fddf0078b90 0x7fddf007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:11.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.109+0000 7fde11749640 1 --2- 172.21.15.78:0/367372602 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fddf0078b90 0x7fddf007b0a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fde08033000 tx=0x7fde08038040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:11.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.113+0000 7fde01ffb640 1 -- 172.21.15.78:0/367372602 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fde0c1e8b00 con 0x7fde0c1f4380 2024-09-17T03:15:11.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.322+0000 7fde139ad640 1 -- 172.21.15.78:0/367372602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde0c0b8110 con 0x7fde0c1f4380 2024-09-17T03:15:11.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.322+0000 7fde01ffb640 1 -- 172.21.15.78:0/367372602 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5277 (secure 0 0 0) 0x7fddfc063500 con 0x7fde0c1f4380 2024-09-17T03:15:11.321 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:11.321 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":101,"btime":"2024-09-17T03:15:10:710733+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:15:10.054141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8286,"mds_1":8283,"mds_2":7213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7213":{"gid":7213,"name":"d","rank":2,"incarnation":97,"state":"up:active","state_seq":5,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8283":{"gid":8283,"name":"a","rank":1,"incarnation":95,"state":"up:active","state_seq":5,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[8286,8283,7213]},"id":7}]} 2024-09-17T03:15:11.322 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 101 2024-09-17T03:15:11.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.324+0000 7fde139ad640 1 -- 172.21.15.78:0/367372602 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fddf0078b90 msgr2=0x7fddf007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:11.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.324+0000 7fde139ad640 1 --2- 172.21.15.78:0/367372602 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fddf0078b90 0x7fddf007b0a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fde08033000 tx=0x7fde08038040 comp rx=0 tx=0).stop 2024-09-17T03:15:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.324+0000 7fde139ad640 1 -- 172.21.15.78:0/367372602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde0c1f4380 msgr2=0x7fde0c156590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.324+0000 7fde139ad640 1 --2- 172.21.15.78:0/367372602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde0c1f4380 0x7fde0c156590 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fddfc011ae0 tx=0x7fddfc009f10 comp rx=0 tx=0).stop 2024-09-17T03:15:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.324+0000 7fde139ad640 1 -- 172.21.15.78:0/367372602 shutdown_connections 2024-09-17T03:15:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.324+0000 7fde139ad640 1 --2- 172.21.15.78:0/367372602 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fde0c1e81b0 0x7fde0c1e85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.324+0000 7fde139ad640 1 --2- 172.21.15.78:0/367372602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde0c1f4380 0x7fde0c156590 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.324+0000 7fde139ad640 1 --2- 172.21.15.78:0/367372602 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fddf0078b90 0x7fddf007b0a0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.324+0000 7fde139ad640 1 --2- 172.21.15.78:0/367372602 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fddf8003a50 0x7fde0c0cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.324+0000 7fde139ad640 1 -- 172.21.15.78:0/367372602 >> 172.21.15.78:0/367372602 conn(0x7fde0c06d550 msgr2=0x7fde0c0b7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.324+0000 7fde139ad640 1 -- 172.21.15.78:0/367372602 shutdown_connections 2024-09-17T03:15:11.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.325+0000 7fde139ad640 1 -- 172.21.15.78:0/367372602 wait complete. 2024-09-17T03:15:11.334 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2024-09-17T03:15:11.335 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:15:11.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.448+0000 7f298b9df640 1 -- 172.21.15.78:0/3156198493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2970003a80 msgr2=0x7f2970003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:11.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.448+0000 7f298b9df640 1 --2- 172.21.15.78:0/3156198493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2970003a80 0x7f2970003ef0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f2980001660 tx=0x7f2970005830 comp rx=0 tx=0).stop 2024-09-17T03:15:11.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.448+0000 7f2989f7c640 1 -- 172.21.15.78:0/3156198493 reap_dead start 2024-09-17T03:15:11.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.449+0000 7f298b9df640 1 -- 172.21.15.78:0/3156198493 shutdown_connections 2024-09-17T03:15:11.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.449+0000 7f298b9df640 1 -- 172.21.15.78:0/3156198493 >> 172.21.15.78:0/3156198493 conn(0x7f29840cdcb0 msgr2=0x7f29840ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:11.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.449+0000 7f298b9df640 1 -- 172.21.15.78:0/3156198493 shutdown_connections 2024-09-17T03:15:11.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.449+0000 7f298b9df640 1 -- 172.21.15.78:0/3156198493 wait complete. 2024-09-17T03:15:11.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.450+0000 7f298b9df640 1 Processor -- start 2024-09-17T03:15:11.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.450+0000 7f298b9df640 1 -- start start 2024-09-17T03:15:11.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f298b9df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2970003a80 0x7f29841488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:11.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f298b9df640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f298409e430 0x7f298406cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:11.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f298b9df640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f298406d320 0x7f298414b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:11.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f298b9df640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f29840adfa0 con 0x7f2970003a80 2024-09-17T03:15:11.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f298b9df640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f29840b3350 con 0x7f298406d320 2024-09-17T03:15:11.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f298b9df640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f29840ae120 con 0x7f298409e430 2024-09-17T03:15:11.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f298977b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2970003a80 0x7f29841488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:11.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f298977b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2970003a80 0x7f29841488c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51048/0 (socket says 172.21.15.78:51048) 2024-09-17T03:15:11.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f298977b640 1 -- 172.21.15.78:0/1939359806 learned_addr learned my addr 172.21.15.78:0/1939359806 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:11.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f2989f7c640 1 --2- 172.21.15.78:0/1939359806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f298406d320 0x7f298414b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:11.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f2988f7a640 1 --2- 172.21.15.78:0/1939359806 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f298409e430 0x7f298406cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:11.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f298977b640 1 -- 172.21.15.78:0/1939359806 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f298409e430 msgr2=0x7f298406cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:11.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f298977b640 1 --2- 172.21.15.78:0/1939359806 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f298409e430 0x7f298406cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:11.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f298977b640 1 -- 172.21.15.78:0/1939359806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f298406d320 msgr2=0x7f298414b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:11.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f298977b640 1 --2- 172.21.15.78:0/1939359806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f298406d320 0x7f298414b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:11.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f298977b640 1 -- 172.21.15.78:0/1939359806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298406d730 con 0x7f2970003a80 2024-09-17T03:15:11.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f2989f7c640 1 --2- 172.21.15.78:0/1939359806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f298406d320 0x7f298414b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:11.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f2988f7a640 1 --2- 172.21.15.78:0/1939359806 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f298409e430 0x7f298406cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:11.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f298977b640 1 --2- 172.21.15.78:0/1939359806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2970003a80 0x7f29841488c0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f2980001780 tx=0x7f2980006360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:11.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f2979ffb640 1 -- 172.21.15.78:0/1939359806 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2980041070 con 0x7f2970003a80 2024-09-17T03:15:11.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f2979ffb640 1 -- 172.21.15.78:0/1939359806 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2980003af0 con 0x7f2970003a80 2024-09-17T03:15:11.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f298b9df640 1 -- 172.21.15.78:0/1939359806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f298409b820 con 0x7f2970003a80 2024-09-17T03:15:11.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.452+0000 7f2979ffb640 1 -- 172.21.15.78:0/1939359806 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2980038070 con 0x7f2970003a80 2024-09-17T03:15:11.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.453+0000 7f298b9df640 1 -- 172.21.15.78:0/1939359806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2984149200 con 0x7f2970003a80 2024-09-17T03:15:11.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.454+0000 7f298b9df640 1 -- 172.21.15.78:0/1939359806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2984149020 con 0x7f2970003a80 2024-09-17T03:15:11.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.454+0000 7f2979ffb640 1 -- 172.21.15.78:0/1939359806 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2980044070 con 0x7f2970003a80 2024-09-17T03:15:11.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.455+0000 7f2979ffb640 1 --2- 172.21.15.78:0/1939359806 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2968078b90 0x7f296807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:11.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.455+0000 7f2979ffb640 1 -- 172.21.15.78:0/1939359806 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f29800ba530 con 0x7f2970003a80 2024-09-17T03:15:11.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.455+0000 7f2988f7a640 1 --2- 172.21.15.78:0/1939359806 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2968078b90 0x7f296807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:11.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.456+0000 7f2988f7a640 1 --2- 172.21.15.78:0/1939359806 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2968078b90 0x7f296807b0a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2974001a50 tx=0x7f29740011b0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:11.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.459+0000 7f2979ffb640 1 -- 172.21.15.78:0/1939359806 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f2984149020 con 0x7f2970003a80 2024-09-17T03:15:11.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.699+0000 7f298b9df640 1 -- 172.21.15.78:0/1939359806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f29840ae680 con 0x7f2970003a80 2024-09-17T03:15:11.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.699+0000 7f2979ffb640 1 -- 172.21.15.78:0/1939359806 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1620 (secure 0 0 0) 0x7f298406d730 con 0x7f2970003a80 2024-09-17T03:15:11.698 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:11.698 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":428,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":62,"data_bytes":668434,"bytes_used":262049792,"bytes_avail":772832063488,"bytes_total":773094113280,"write_bytes_sec":4947,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":101,"btime":"2024-09-17T03:15:10:710733+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7213},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8283},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8286}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":28,"modified":"2024-09-17T03:14:33.219581+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:15:11.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.702+0000 7f298b9df640 1 -- 172.21.15.78:0/1939359806 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2968078b90 msgr2=0x7f296807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:11.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.702+0000 7f298b9df640 1 --2- 172.21.15.78:0/1939359806 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2968078b90 0x7f296807b0a0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2974001a50 tx=0x7f29740011b0 comp rx=0 tx=0).stop 2024-09-17T03:15:11.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.702+0000 7f298b9df640 1 -- 172.21.15.78:0/1939359806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2970003a80 msgr2=0x7f29841488c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:11.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.702+0000 7f298b9df640 1 --2- 172.21.15.78:0/1939359806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2970003a80 0x7f29841488c0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f2980001780 tx=0x7f2980006360 comp rx=0 tx=0).stop 2024-09-17T03:15:11.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.702+0000 7f298b9df640 1 -- 172.21.15.78:0/1939359806 shutdown_connections 2024-09-17T03:15:11.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.702+0000 7f298b9df640 1 --2- 172.21.15.78:0/1939359806 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f2968078b90 0x7f296807b0a0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:11.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.702+0000 7f298b9df640 1 --2- 172.21.15.78:0/1939359806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f298406d320 0x7f298414b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:11.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.702+0000 7f298b9df640 1 --2- 172.21.15.78:0/1939359806 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f298409e430 0x7f298406cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:11.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.702+0000 7f298b9df640 1 --2- 172.21.15.78:0/1939359806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2970003a80 0x7f29841488c0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:11.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.702+0000 7f298b9df640 1 -- 172.21.15.78:0/1939359806 >> 172.21.15.78:0/1939359806 conn(0x7f29840cdcb0 msgr2=0x7f29840b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:11.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.702+0000 7f298b9df640 1 -- 172.21.15.78:0/1939359806 shutdown_connections 2024-09-17T03:15:11.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:11.702+0000 7f298b9df640 1 -- 172.21.15.78:0/1939359806 wait complete. 2024-09-17T03:15:11.712 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T03:15:11.723 INFO:tasks.ceph.mon.a.smithi078.stderr:2024-09-17T03:15:11.724+0000 7f192d77d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-17T03:15:12.713 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:12.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.833+0000 7f0a2828b640 1 -- 172.21.15.78:0/798829086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a200ca800 msgr2=0x7f0a200cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:12.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.833+0000 7f0a2828b640 1 --2- 172.21.15.78:0/798829086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a200ca800 0x7f0a200cba00 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f0a2009e2e0 tx=0x7f0a1802aa30 comp rx=0 tx=0).stop 2024-09-17T03:15:12.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.833+0000 7f0a2828b640 1 -- 172.21.15.78:0/798829086 shutdown_connections 2024-09-17T03:15:12.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.833+0000 7f0a2828b640 1 --2- 172.21.15.78:0/798829086 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0a200704e0 0x7f0a200cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:12.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.833+0000 7f0a2828b640 1 --2- 172.21.15.78:0/798829086 >> v2:172.21.15.193:3300/0 conn(0x7f0a200cad30 0x7f0a2006ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:12.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.833+0000 7f0a2828b640 1 --2- 172.21.15.78:0/798829086 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a200ca800 0x7f0a200cba00 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:12.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.834+0000 7f0a2828b640 1 -- 172.21.15.78:0/798829086 >> 172.21.15.78:0/798829086 conn(0x7f0a200b1cb0 msgr2=0x7f0a200b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:12.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.834+0000 7f0a2828b640 1 -- 172.21.15.78:0/798829086 shutdown_connections 2024-09-17T03:15:12.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.834+0000 7f0a2828b640 1 -- 172.21.15.78:0/798829086 wait complete. 2024-09-17T03:15:12.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.835+0000 7f0a2828b640 1 Processor -- start 2024-09-17T03:15:12.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.835+0000 7f0a2828b640 1 -- start start 2024-09-17T03:15:12.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.837+0000 7f0a2828b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a200704e0 0x7f0a2009d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:12.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.837+0000 7f0a2828b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a200ca800 0x7f0a200c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:12.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.837+0000 7f0a2828b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0a200cad30 0x7f0a200c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:12.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.837+0000 7f0a2828b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0a200cd140 con 0x7f0a200ca800 2024-09-17T03:15:12.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.837+0000 7f0a2828b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0a200ccfc0 con 0x7f0a200704e0 2024-09-17T03:15:12.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.837+0000 7f0a2828b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0a200cd2c0 con 0x7f0a200cad30 2024-09-17T03:15:12.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.837+0000 7f0a25826640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a200ca800 0x7f0a200c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:12.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.837+0000 7f0a25826640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a200ca800 0x7f0a200c8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51056/0 (socket says 172.21.15.78:51056) 2024-09-17T03:15:12.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.837+0000 7f0a25826640 1 -- 172.21.15.78:0/2850396700 learned_addr learned my addr 172.21.15.78:0/2850396700 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:12.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.837+0000 7f0a25826640 1 -- 172.21.15.78:0/2850396700 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0a200cad30 msgr2=0x7f0a200c9160 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:15:12.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.837+0000 7f0a25826640 1 --2- 172.21.15.78:0/2850396700 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0a200cad30 0x7f0a200c9160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:12.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.837+0000 7f0a25826640 1 -- 172.21.15.78:0/2850396700 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a200704e0 msgr2=0x7f0a2009d210 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:15:12.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.837+0000 7f0a25826640 1 --2- 172.21.15.78:0/2850396700 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a200704e0 0x7f0a2009d210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:12.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.837+0000 7f0a25826640 1 -- 172.21.15.78:0/2850396700 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a200c7420 con 0x7f0a200ca800 2024-09-17T03:15:12.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.837+0000 7f0a25826640 1 --2- 172.21.15.78:0/2850396700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a200ca800 0x7f0a200c8c20 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400b440 tx=0x7f0a1400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:12.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.837+0000 7f0a1effd640 1 -- 172.21.15.78:0/2850396700 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14015020 con 0x7f0a200ca800 2024-09-17T03:15:12.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.837+0000 7f0a1effd640 1 -- 172.21.15.78:0/2850396700 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a14011980 con 0x7f0a200ca800 2024-09-17T03:15:12.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.837+0000 7f0a2828b640 1 -- 172.21.15.78:0/2850396700 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a200c7700 con 0x7f0a200ca800 2024-09-17T03:15:12.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.837+0000 7f0a1effd640 1 -- 172.21.15.78:0/2850396700 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14011dd0 con 0x7f0a200ca800 2024-09-17T03:15:12.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.837+0000 7f0a2828b640 1 -- 172.21.15.78:0/2850396700 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a2009b7d0 con 0x7f0a200ca800 2024-09-17T03:15:12.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.838+0000 7f0a2828b640 1 -- 172.21.15.78:0/2850396700 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a200cba00 con 0x7f0a200ca800 2024-09-17T03:15:12.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.839+0000 7f0a1effd640 1 -- 172.21.15.78:0/2850396700 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0a14018020 con 0x7f0a200ca800 2024-09-17T03:15:12.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.840+0000 7f0a1effd640 1 --2- 172.21.15.78:0/2850396700 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0a0c078b90 0x7f0a0c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:12.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.840+0000 7f0a1effd640 1 -- 172.21.15.78:0/2850396700 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f0a1409ad90 con 0x7f0a200ca800 2024-09-17T03:15:12.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.840+0000 7f0a26027640 1 --2- 172.21.15.78:0/2850396700 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0a0c078b90 0x7f0a0c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:12.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.841+0000 7f0a26027640 1 --2- 172.21.15.78:0/2850396700 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0a0c078b90 0x7f0a0c07b0a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0a18035000 tx=0x7f0a18004ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:12.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:12.844+0000 7f0a1effd640 1 -- 172.21.15.78:0/2850396700 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f0a1401f020 con 0x7f0a200ca800 2024-09-17T03:15:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.053+0000 7f0a2828b640 1 -- 172.21.15.78:0/2850396700 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a2009d750 con 0x7f0a200ca800 2024-09-17T03:15:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.054+0000 7f0a1effd640 1 -- 172.21.15.78:0/2850396700 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5280 (secure 0 0 0) 0x7f0a1400d040 con 0x7f0a200ca800 2024-09-17T03:15:13.053 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:13.053 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:15:12.673912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8286,"mds_1":8283,"mds_2":7213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7213":{"gid":7213,"name":"d","rank":2,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8283":{"gid":8283,"name":"a","rank":1,"incarnation":95,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[8286,8283,7213]},"id":7}]} 2024-09-17T03:15:13.053 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 103 2024-09-17T03:15:13.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.056+0000 7f0a2828b640 1 -- 172.21.15.78:0/2850396700 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0a0c078b90 msgr2=0x7f0a0c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:13.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.056+0000 7f0a2828b640 1 --2- 172.21.15.78:0/2850396700 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0a0c078b90 0x7f0a0c07b0a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f0a18035000 tx=0x7f0a18004ab0 comp rx=0 tx=0).stop 2024-09-17T03:15:13.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.056+0000 7f0a2828b640 1 -- 172.21.15.78:0/2850396700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a200ca800 msgr2=0x7f0a200c8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:13.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.056+0000 7f0a2828b640 1 --2- 172.21.15.78:0/2850396700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a200ca800 0x7f0a200c8c20 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400b440 tx=0x7f0a1400b900 comp rx=0 tx=0).stop 2024-09-17T03:15:13.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.056+0000 7f0a2828b640 1 -- 172.21.15.78:0/2850396700 shutdown_connections 2024-09-17T03:15:13.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.056+0000 7f0a2828b640 1 --2- 172.21.15.78:0/2850396700 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0a200cad30 0x7f0a200c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:13.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.056+0000 7f0a2828b640 1 --2- 172.21.15.78:0/2850396700 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a200ca800 0x7f0a200c8c20 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:13.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.056+0000 7f0a2828b640 1 --2- 172.21.15.78:0/2850396700 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0a0c078b90 0x7f0a0c07b0a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:13.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.056+0000 7f0a2828b640 1 --2- 172.21.15.78:0/2850396700 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a200704e0 0x7f0a2009d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:13.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.056+0000 7f0a2828b640 1 -- 172.21.15.78:0/2850396700 >> 172.21.15.78:0/2850396700 conn(0x7f0a200b1cb0 msgr2=0x7f0a200d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:13.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.056+0000 7f0a2828b640 1 -- 172.21.15.78:0/2850396700 shutdown_connections 2024-09-17T03:15:13.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.056+0000 7f0a2828b640 1 -- 172.21.15.78:0/2850396700 wait complete. 2024-09-17T03:15:13.070 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2024-09-17T03:15:13.070 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:15:13.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.183+0000 7f5c40c0e640 1 -- 172.21.15.78:0/1180494825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c3c075fa0 msgr2=0x7f5c3c070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:13.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.183+0000 7f5c40c0e640 1 --2- 172.21.15.78:0/1180494825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c3c075fa0 0x7f5c3c070e40 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c0cbe10 tx=0x7f5c2c02aa50 comp rx=0 tx=0).stop 2024-09-17T03:15:13.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.183+0000 7f5c40c0e640 1 -- 172.21.15.78:0/1180494825 shutdown_connections 2024-09-17T03:15:13.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.183+0000 7f5c40c0e640 1 --2- 172.21.15.78:0/1180494825 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c3c15f7e0 0x7f5c3c15bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:13.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.183+0000 7f5c40c0e640 1 --2- 172.21.15.78:0/1180494825 >> v2:172.21.15.193:3300/0 conn(0x7f5c3c06e100 0x7f5c3c15f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:13.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.183+0000 7f5c40c0e640 1 --2- 172.21.15.78:0/1180494825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c3c075fa0 0x7f5c3c070e40 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:13.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.183+0000 7f5c40c0e640 1 -- 172.21.15.78:0/1180494825 >> 172.21.15.78:0/1180494825 conn(0x7f5c3c0cd530 msgr2=0x7f5c3c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:13.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.183+0000 7f5c40c0e640 1 -- 172.21.15.78:0/1180494825 shutdown_connections 2024-09-17T03:15:13.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.183+0000 7f5c40c0e640 1 -- 172.21.15.78:0/1180494825 wait complete. 2024-09-17T03:15:13.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.185+0000 7f5c40c0e640 1 Processor -- start 2024-09-17T03:15:13.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.185+0000 7f5c40c0e640 1 -- start start 2024-09-17T03:15:13.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.186+0000 7f5c40c0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c3c06e100 0x7f5c3c0c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:13.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.186+0000 7f5c40c0e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c3c075fa0 0x7f5c3c14c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:13.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.186+0000 7f5c40c0e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c3c15f7e0 0x7f5c3c0ce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:13.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.186+0000 7f5c40c0e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c15c400 con 0x7f5c3c06e100 2024-09-17T03:15:13.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.186+0000 7f5c40c0e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3c0cc520 con 0x7f5c3c15f7e0 2024-09-17T03:15:13.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.186+0000 7f5c40c0e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5c3c15c580 con 0x7f5c3c075fa0 2024-09-17T03:15:13.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.186+0000 7f5c3a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c3c06e100 0x7f5c3c0c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:13.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.186+0000 7f5c3a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c3c06e100 0x7f5c3c0c59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51072/0 (socket says 172.21.15.78:51072) 2024-09-17T03:15:13.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.186+0000 7f5c3a59c640 1 -- 172.21.15.78:0/2324616093 learned_addr learned my addr 172.21.15.78:0/2324616093 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:13.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.186+0000 7f5c39d9b640 1 --2- 172.21.15.78:0/2324616093 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c3c075fa0 0x7f5c3c14c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:13.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.186+0000 7f5c3ad9d640 1 --2- 172.21.15.78:0/2324616093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c3c15f7e0 0x7f5c3c0ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:13.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.187+0000 7f5c3a59c640 1 -- 172.21.15.78:0/2324616093 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c3c075fa0 msgr2=0x7f5c3c14c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:13.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.187+0000 7f5c3a59c640 1 --2- 172.21.15.78:0/2324616093 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c3c075fa0 0x7f5c3c14c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:13.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.187+0000 7f5c3a59c640 1 -- 172.21.15.78:0/2324616093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c3c15f7e0 msgr2=0x7f5c3c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:13.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.187+0000 7f5c3a59c640 1 --2- 172.21.15.78:0/2324616093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c3c15f7e0 0x7f5c3c0ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:13.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.187+0000 7f5c3a59c640 1 -- 172.21.15.78:0/2324616093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3c1f7060 con 0x7f5c3c06e100 2024-09-17T03:15:13.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.187+0000 7f5c3a59c640 1 --2- 172.21.15.78:0/2324616093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c3c06e100 0x7f5c3c0c59d0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c009bf0 tx=0x7f5c2c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:13.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.187+0000 7f5c2affd640 1 -- 172.21.15.78:0/2324616093 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c033050 con 0x7f5c3c06e100 2024-09-17T03:15:13.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.187+0000 7f5c2affd640 1 -- 172.21.15.78:0/2324616093 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c2c004450 con 0x7f5c3c06e100 2024-09-17T03:15:13.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.187+0000 7f5c40c0e640 1 -- 172.21.15.78:0/2324616093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c3c14ca40 con 0x7f5c3c06e100 2024-09-17T03:15:13.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.187+0000 7f5c2affd640 1 -- 172.21.15.78:0/2324616093 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c004840 con 0x7f5c3c06e100 2024-09-17T03:15:13.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.187+0000 7f5c40c0e640 1 -- 172.21.15.78:0/2324616093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c3c1f7620 con 0x7f5c3c06e100 2024-09-17T03:15:13.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.188+0000 7f5c40c0e640 1 -- 172.21.15.78:0/2324616093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c3c15caa0 con 0x7f5c3c06e100 2024-09-17T03:15:13.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.189+0000 7f5c2affd640 1 -- 172.21.15.78:0/2324616093 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5c2c036070 con 0x7f5c3c06e100 2024-09-17T03:15:13.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.189+0000 7f5c2affd640 1 --2- 172.21.15.78:0/2324616093 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5c1c078bc0 0x7f5c1c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:13.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.189+0000 7f5c2affd640 1 -- 172.21.15.78:0/2324616093 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f5c2c0bc280 con 0x7f5c3c06e100 2024-09-17T03:15:13.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.189+0000 7f5c39d9b640 1 --2- 172.21.15.78:0/2324616093 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5c1c078bc0 0x7f5c1c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:13.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.190+0000 7f5c39d9b640 1 --2- 172.21.15.78:0/2324616093 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5c1c078bc0 0x7f5c1c07b0d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5c30005fd0 tx=0x7f5c30005da0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:13.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.193+0000 7f5c2affd640 1 -- 172.21.15.78:0/2324616093 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5c3c15fbf0 con 0x7f5c3c06e100 2024-09-17T03:15:13.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.433+0000 7f5c40c0e640 1 -- 172.21.15.78:0/2324616093 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f5c3c155900 con 0x7f5c3c06e100 2024-09-17T03:15:13.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.433+0000 7f5c2affd640 1 -- 172.21.15.78:0/2324616093 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1927 (secure 0 0 0) 0x7f5c2c08be20 con 0x7f5c3c06e100 2024-09-17T03:15:13.433 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:13.433 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":430,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700753,"bytes_used":262094848,"bytes_avail":772832018432,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":9810,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7213},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8283},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8286}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":29,"modified":"2024-09-17T03:15:11.230912+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:15:13.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.435+0000 7f5c40c0e640 1 -- 172.21.15.78:0/2324616093 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5c1c078bc0 msgr2=0x7f5c1c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:13.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.435+0000 7f5c40c0e640 1 --2- 172.21.15.78:0/2324616093 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5c1c078bc0 0x7f5c1c07b0d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5c30005fd0 tx=0x7f5c30005da0 comp rx=0 tx=0).stop 2024-09-17T03:15:13.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.435+0000 7f5c40c0e640 1 -- 172.21.15.78:0/2324616093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c3c06e100 msgr2=0x7f5c3c0c59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:13.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.435+0000 7f5c40c0e640 1 --2- 172.21.15.78:0/2324616093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c3c06e100 0x7f5c3c0c59d0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c009bf0 tx=0x7f5c2c003f90 comp rx=0 tx=0).stop 2024-09-17T03:15:13.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.435+0000 7f5c40c0e640 1 -- 172.21.15.78:0/2324616093 shutdown_connections 2024-09-17T03:15:13.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.435+0000 7f5c40c0e640 1 --2- 172.21.15.78:0/2324616093 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5c1c078bc0 0x7f5c1c07b0d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:13.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.435+0000 7f5c40c0e640 1 --2- 172.21.15.78:0/2324616093 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c3c15f7e0 0x7f5c3c0ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:13.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.435+0000 7f5c40c0e640 1 --2- 172.21.15.78:0/2324616093 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c3c075fa0 0x7f5c3c14c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:13.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.435+0000 7f5c40c0e640 1 --2- 172.21.15.78:0/2324616093 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c3c06e100 0x7f5c3c0c59d0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:13.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.435+0000 7f5c40c0e640 1 -- 172.21.15.78:0/2324616093 >> 172.21.15.78:0/2324616093 conn(0x7f5c3c0cd530 msgr2=0x7f5c3c0b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:13.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.436+0000 7f5c40c0e640 1 -- 172.21.15.78:0/2324616093 shutdown_connections 2024-09-17T03:15:13.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:13.436+0000 7f5c40c0e640 1 -- 172.21.15.78:0/2324616093 wait complete. 2024-09-17T03:15:13.446 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/d1/d2/d3]'} 2024-09-17T03:15:14.447 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:14.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.570+0000 7f6847830640 1 -- 172.21.15.78:0/2510618105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682c004d40 msgr2=0x7f682c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:14.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.570+0000 7f6847830640 1 --2- 172.21.15.78:0/2510618105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f682c004d40 0x7f682c005190 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f6838005fd0 tx=0x7f682c005830 comp rx=0 tx=0).stop 2024-09-17T03:15:14.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.571+0000 7f6845dcd640 1 -- 172.21.15.78:0/2510618105 reap_dead start 2024-09-17T03:15:14.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.571+0000 7f6847830640 1 -- 172.21.15.78:0/2510618105 shutdown_connections 2024-09-17T03:15:14.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.571+0000 7f6847830640 1 -- 172.21.15.78:0/2510618105 >> 172.21.15.78:0/2510618105 conn(0x7f68400d15f0 msgr2=0x7f6840073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:14.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.571+0000 7f6847830640 1 -- 172.21.15.78:0/2510618105 shutdown_connections 2024-09-17T03:15:14.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.571+0000 7f6847830640 1 -- 172.21.15.78:0/2510618105 wait complete. 2024-09-17T03:15:14.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.572+0000 7f6847830640 1 Processor -- start 2024-09-17T03:15:14.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.572+0000 7f6847830640 1 -- start start 2024-09-17T03:15:14.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6847830640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f682c004d40 0x7f6840154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:14.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6847830640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f684013d8d0 0x7f6840155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:14.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6847830640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f68400b4480 0x7f68401f6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:14.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6847830640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f684015dba0 con 0x7f684013d8d0 2024-09-17T03:15:14.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6847830640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f684015da20 con 0x7f682c004d40 2024-09-17T03:15:14.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6847830640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f6840158b00 con 0x7f68400b4480 2024-09-17T03:15:14.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6844dcb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f684013d8d0 0x7f6840155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:14.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6844dcb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f684013d8d0 0x7f6840155530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51098/0 (socket says 172.21.15.78:51098) 2024-09-17T03:15:14.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6844dcb640 1 -- 172.21.15.78:0/1296171379 learned_addr learned my addr 172.21.15.78:0/1296171379 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:14.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f68455cc640 1 --2- 172.21.15.78:0/1296171379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f682c004d40 0x7f6840154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:14.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6845dcd640 1 --2- 172.21.15.78:0/1296171379 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f68400b4480 0x7f68401f6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:14.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6844dcb640 1 -- 172.21.15.78:0/1296171379 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f68400b4480 msgr2=0x7f68401f6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:14.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6844dcb640 1 --2- 172.21.15.78:0/1296171379 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f68400b4480 0x7f68401f6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:14.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6844dcb640 1 -- 172.21.15.78:0/1296171379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f682c004d40 msgr2=0x7f6840154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:14.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6844dcb640 1 --2- 172.21.15.78:0/1296171379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f682c004d40 0x7f6840154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:14.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6844dcb640 1 -- 172.21.15.78:0/1296171379 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68401609b0 con 0x7f684013d8d0 2024-09-17T03:15:14.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6845dcd640 1 --2- 172.21.15.78:0/1296171379 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f68400b4480 0x7f68401f6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:14.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f68455cc640 1 --2- 172.21.15.78:0/1296171379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f682c004d40 0x7f6840154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:14.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6844dcb640 1 --2- 172.21.15.78:0/1296171379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f684013d8d0 0x7f6840155530 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f6830006ed0 tx=0x7f68300049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:14.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6835ffb640 1 -- 172.21.15.78:0/1296171379 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6830015020 con 0x7f684013d8d0 2024-09-17T03:15:14.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6835ffb640 1 -- 172.21.15.78:0/1296171379 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6830010980 con 0x7f684013d8d0 2024-09-17T03:15:14.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6847830640 1 -- 172.21.15.78:0/1296171379 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f684015fe70 con 0x7f684013d8d0 2024-09-17T03:15:14.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.574+0000 7f6835ffb640 1 -- 172.21.15.78:0/1296171379 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6830010dd0 con 0x7f684013d8d0 2024-09-17T03:15:14.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.575+0000 7f6847830640 1 -- 172.21.15.78:0/1296171379 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6840158840 con 0x7f684013d8d0 2024-09-17T03:15:14.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.576+0000 7f6847830640 1 -- 172.21.15.78:0/1296171379 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6840074260 con 0x7f684013d8d0 2024-09-17T03:15:14.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.576+0000 7f6835ffb640 1 -- 172.21.15.78:0/1296171379 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6830018020 con 0x7f684013d8d0 2024-09-17T03:15:14.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.577+0000 7f6835ffb640 1 --2- 172.21.15.78:0/1296171379 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6824078b90 0x7f682407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:14.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.577+0000 7f6835ffb640 1 -- 172.21.15.78:0/1296171379 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f683009b8a0 con 0x7f684013d8d0 2024-09-17T03:15:14.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.577+0000 7f68455cc640 1 --2- 172.21.15.78:0/1296171379 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6824078b90 0x7f682407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:14.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.577+0000 7f68455cc640 1 --2- 172.21.15.78:0/1296171379 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6824078b90 0x7f682407b0a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f683c005fd0 tx=0x7f683c0113e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:14.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.581+0000 7f6835ffb640 1 -- 172.21.15.78:0/1296171379 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f683001f020 con 0x7f684013d8d0 2024-09-17T03:15:14.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.791+0000 7f6847830640 1 -- 172.21.15.78:0/1296171379 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f684014f910 con 0x7f684013d8d0 2024-09-17T03:15:14.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.791+0000 7f6835ffb640 1 -- 172.21.15.78:0/1296171379 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5280 (secure 0 0 0) 0x7f684015cd90 con 0x7f684013d8d0 2024-09-17T03:15:14.791 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:14.791 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:15:12.673912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8286,"mds_1":8283,"mds_2":7213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7213":{"gid":7213,"name":"d","rank":2,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8283":{"gid":8283,"name":"a","rank":1,"incarnation":95,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[8286,8283,7213]},"id":7}]} 2024-09-17T03:15:14.791 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 103 2024-09-17T03:15:14.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.794+0000 7f6847830640 1 -- 172.21.15.78:0/1296171379 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6824078b90 msgr2=0x7f682407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:14.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.794+0000 7f6847830640 1 --2- 172.21.15.78:0/1296171379 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6824078b90 0x7f682407b0a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f683c005fd0 tx=0x7f683c0113e0 comp rx=0 tx=0).stop 2024-09-17T03:15:14.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.794+0000 7f6847830640 1 -- 172.21.15.78:0/1296171379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f684013d8d0 msgr2=0x7f6840155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:14.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.794+0000 7f6847830640 1 --2- 172.21.15.78:0/1296171379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f684013d8d0 0x7f6840155530 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f6830006ed0 tx=0x7f68300049d0 comp rx=0 tx=0).stop 2024-09-17T03:15:14.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.794+0000 7f6847830640 1 -- 172.21.15.78:0/1296171379 shutdown_connections 2024-09-17T03:15:14.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.794+0000 7f6847830640 1 --2- 172.21.15.78:0/1296171379 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f68400b4480 0x7f68401f6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:14.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.794+0000 7f6847830640 1 --2- 172.21.15.78:0/1296171379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f684013d8d0 0x7f6840155530 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:14.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.794+0000 7f6847830640 1 --2- 172.21.15.78:0/1296171379 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f6824078b90 0x7f682407b0a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:14.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.794+0000 7f6847830640 1 --2- 172.21.15.78:0/1296171379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f682c004d40 0x7f6840154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:14.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.794+0000 7f6847830640 1 -- 172.21.15.78:0/1296171379 >> 172.21.15.78:0/1296171379 conn(0x7f68400d15f0 msgr2=0x7f6840156b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:14.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.794+0000 7f6847830640 1 -- 172.21.15.78:0/1296171379 shutdown_connections 2024-09-17T03:15:14.794 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.794+0000 7f6847830640 1 -- 172.21.15.78:0/1296171379 wait complete. 2024-09-17T03:15:14.804 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2024-09-17T03:15:14.804 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:15:14.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.918+0000 7f5bda5f1640 1 -- 172.21.15.78:0/460465372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd415b6a0 msgr2=0x7f5bd40b5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:14.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.918+0000 7f5bda5f1640 1 --2- 172.21.15.78:0/460465372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd415b6a0 0x7f5bd40b5250 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f5bd40cdb20 tx=0x7f5bc402a560 comp rx=0 tx=0).stop 2024-09-17T03:15:14.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.918+0000 7f5bda5f1640 1 -- 172.21.15.78:0/460465372 shutdown_connections 2024-09-17T03:15:14.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.918+0000 7f5bda5f1640 1 --2- 172.21.15.78:0/460465372 >> v2:172.21.15.193:3300/0 conn(0x7f5bd40cf0d0 0x7f5bd40b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:14.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.918+0000 7f5bda5f1640 1 --2- 172.21.15.78:0/460465372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd415b6a0 0x7f5bd40b5250 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:14.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.918+0000 7f5bda5f1640 1 -- 172.21.15.78:0/460465372 >> 172.21.15.78:0/460465372 conn(0x7f5bd40b2160 msgr2=0x7f5bd40b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:14.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.918+0000 7f5bda5f1640 1 -- 172.21.15.78:0/460465372 shutdown_connections 2024-09-17T03:15:14.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.918+0000 7f5bda5f1640 1 -- 172.21.15.78:0/460465372 wait complete. 2024-09-17T03:15:14.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.919+0000 7f5bda5f1640 1 Processor -- start 2024-09-17T03:15:14.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.920+0000 7f5bda5f1640 1 -- start start 2024-09-17T03:15:14.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.921+0000 7f5bda5f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd40cf0d0 0x7f5bd415a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:14.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.921+0000 7f5bda5f1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5bd40cf4e0 0x7f5bd40af7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:14.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.921+0000 7f5bda5f1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bd415b6a0 0x7f5bd4140ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:14.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.921+0000 7f5bda5f1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd406ff70 con 0x7f5bd40cf0d0 2024-09-17T03:15:14.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.921+0000 7f5bda5f1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5bd406fdf0 con 0x7f5bd415b6a0 2024-09-17T03:15:14.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.921+0000 7f5bda5f1640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5bd40700f0 con 0x7f5bd40cf4e0 2024-09-17T03:15:14.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.921+0000 7f5bd3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd40cf0d0 0x7f5bd415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:14.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.921+0000 7f5bd3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd40cf0d0 0x7f5bd415a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51110/0 (socket says 172.21.15.78:51110) 2024-09-17T03:15:14.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.921+0000 7f5bd3fff640 1 -- 172.21.15.78:0/2033337691 learned_addr learned my addr 172.21.15.78:0/2033337691 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:14.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.921+0000 7f5bd3fff640 1 -- 172.21.15.78:0/2033337691 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5bd40cf4e0 msgr2=0x7f5bd40af7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:14.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.921+0000 7f5bd37fe640 1 --2- 172.21.15.78:0/2033337691 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5bd40cf4e0 0x7f5bd40af7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:14.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.921+0000 7f5bd3fff640 1 --2- 172.21.15.78:0/2033337691 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5bd40cf4e0 0x7f5bd40af7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:14.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.921+0000 7f5bd8b8e640 1 --2- 172.21.15.78:0/2033337691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bd415b6a0 0x7f5bd4140ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:14.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.921+0000 7f5bd3fff640 1 -- 172.21.15.78:0/2033337691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bd415b6a0 msgr2=0x7f5bd4140ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:14.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.921+0000 7f5bd3fff640 1 --2- 172.21.15.78:0/2033337691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bd415b6a0 0x7f5bd4140ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:14.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.921+0000 7f5bd3fff640 1 -- 172.21.15.78:0/2033337691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bd4146f40 con 0x7f5bd40cf0d0 2024-09-17T03:15:14.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.922+0000 7f5bd3fff640 1 --2- 172.21.15.78:0/2033337691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd40cf0d0 0x7f5bd415a350 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4034040 tx=0x7f5bc40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:14.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.922+0000 7f5bd0ff9640 1 -- 172.21.15.78:0/2033337691 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc403e030 con 0x7f5bd40cf0d0 2024-09-17T03:15:14.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.922+0000 7f5bd0ff9640 1 -- 172.21.15.78:0/2033337691 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5bc40047a0 con 0x7f5bd40cf0d0 2024-09-17T03:15:14.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.922+0000 7f5bd0ff9640 1 -- 172.21.15.78:0/2033337691 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bc4035040 con 0x7f5bd40cf0d0 2024-09-17T03:15:14.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.922+0000 7f5bda5f1640 1 -- 172.21.15.78:0/2033337691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bd41592b0 con 0x7f5bd40cf0d0 2024-09-17T03:15:14.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.922+0000 7f5bda5f1640 1 -- 172.21.15.78:0/2033337691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bd4159870 con 0x7f5bd40cf0d0 2024-09-17T03:15:14.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.923+0000 7f5bda5f1640 1 -- 172.21.15.78:0/2033337691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bd40b4ee0 con 0x7f5bd40cf0d0 2024-09-17T03:15:14.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.924+0000 7f5bd0ff9640 1 -- 172.21.15.78:0/2033337691 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5bc4041030 con 0x7f5bd40cf0d0 2024-09-17T03:15:14.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.924+0000 7f5bd0ff9640 1 --2- 172.21.15.78:0/2033337691 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5bc0078b90 0x7f5bc007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:14.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.924+0000 7f5bd0ff9640 1 -- 172.21.15.78:0/2033337691 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f5bc40bb600 con 0x7f5bd40cf0d0 2024-09-17T03:15:14.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.924+0000 7f5bd37fe640 1 --2- 172.21.15.78:0/2033337691 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5bc0078b90 0x7f5bc007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:14.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.925+0000 7f5bd37fe640 1 --2- 172.21.15.78:0/2033337691 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5bc0078b90 0x7f5bc007b0a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5bd415b400 tx=0x7f5bc8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:14.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:14.929+0000 7f5bd0ff9640 1 -- 172.21.15.78:0/2033337691 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f5bd4146f40 con 0x7f5bd40cf0d0 2024-09-17T03:15:15.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.173+0000 7f5bda5f1640 1 -- 172.21.15.78:0/2033337691 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f5bd415eb30 con 0x7f5bd40cf0d0 2024-09-17T03:15:15.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.174+0000 7f5bd0ff9640 1 -- 172.21.15.78:0/2033337691 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2009 (secure 0 0 0) 0x7f5bd40ce370 con 0x7f5bd40cf0d0 2024-09-17T03:15:15.173 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:15.173 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":432,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700753,"bytes_used":262094848,"bytes_avail":772832018432,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":6568,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7213},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8283},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8286}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":30,"modified":"2024-09-17T03:15:13.231420+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-17T03:15:15.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.176+0000 7f5bda5f1640 1 -- 172.21.15.78:0/2033337691 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5bc0078b90 msgr2=0x7f5bc007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.176+0000 7f5bda5f1640 1 --2- 172.21.15.78:0/2033337691 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5bc0078b90 0x7f5bc007b0a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5bd415b400 tx=0x7f5bc8008040 comp rx=0 tx=0).stop 2024-09-17T03:15:15.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.176+0000 7f5bda5f1640 1 -- 172.21.15.78:0/2033337691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd40cf0d0 msgr2=0x7f5bd415a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.176+0000 7f5bda5f1640 1 --2- 172.21.15.78:0/2033337691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd40cf0d0 0x7f5bd415a350 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4034040 tx=0x7f5bc40039e0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.176+0000 7f5bda5f1640 1 -- 172.21.15.78:0/2033337691 shutdown_connections 2024-09-17T03:15:15.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.176+0000 7f5bda5f1640 1 --2- 172.21.15.78:0/2033337691 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f5bc0078b90 0x7f5bc007b0a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.176+0000 7f5bda5f1640 1 --2- 172.21.15.78:0/2033337691 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5bd415b6a0 0x7f5bd4140ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.176+0000 7f5bda5f1640 1 --2- 172.21.15.78:0/2033337691 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5bd40cf4e0 0x7f5bd40af7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.176+0000 7f5bda5f1640 1 --2- 172.21.15.78:0/2033337691 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5bd40cf0d0 0x7f5bd415a350 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.176+0000 7f5bda5f1640 1 -- 172.21.15.78:0/2033337691 >> 172.21.15.78:0/2033337691 conn(0x7f5bd40b2160 msgr2=0x7f5bd415c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.176+0000 7f5bda5f1640 1 -- 172.21.15.78:0/2033337691 shutdown_connections 2024-09-17T03:15:15.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.176+0000 7f5bda5f1640 1 -- 172.21.15.78:0/2033337691 wait complete. 2024-09-17T03:15:15.186 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-17T03:15:15.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:15.187 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub abort 2024-09-17T03:15:15.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.302+0000 7f79f958e640 1 -- 172.21.15.78:0/3718265479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f40b9b60 msgr2=0x7f79f40d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.302+0000 7f79f958e640 1 --2- 172.21.15.78:0/3718265479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f40b9b60 0x7f79f40d4d80 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f79e4009820 tx=0x7f79e402a3f0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.302+0000 7f79f958e640 1 -- 172.21.15.78:0/3718265479 shutdown_connections 2024-09-17T03:15:15.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.302+0000 7f79f958e640 1 --2- 172.21.15.78:0/3718265479 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79f40cf540 0x7f79f40b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.302+0000 7f79f958e640 1 --2- 172.21.15.78:0/3718265479 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f40b9b60 0x7f79f40d4d80 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.302+0000 7f79f958e640 1 -- 172.21.15.78:0/3718265479 >> 172.21.15.78:0/3718265479 conn(0x7f79f409d7f0 msgr2=0x7f79f40d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.302+0000 7f79f958e640 1 -- 172.21.15.78:0/3718265479 shutdown_connections 2024-09-17T03:15:15.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.302+0000 7f79f958e640 1 -- 172.21.15.78:0/3718265479 wait complete. 2024-09-17T03:15:15.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.304+0000 7f79f958e640 1 Processor -- start 2024-09-17T03:15:15.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.304+0000 7f79f958e640 1 -- start start 2024-09-17T03:15:15.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.305+0000 7f79f958e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79f40b64e0 0x7f79f41ebcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.305+0000 7f79f958e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79f40b9b60 0x7f79f41f9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.305+0000 7f79f958e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f40cf540 0x7f79f41f9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.305+0000 7f79f958e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f79f40d2e40 con 0x7f79f40cf540 2024-09-17T03:15:15.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.305+0000 7f79f958e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f79f40d2cc0 con 0x7f79f40b64e0 2024-09-17T03:15:15.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.305+0000 7f79f958e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f79f40d2fc0 con 0x7f79f40b9b60 2024-09-17T03:15:15.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.306+0000 7f79f37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f40cf540 0x7f79f41f9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.306+0000 7f79f37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f40cf540 0x7f79f41f9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51122/0 (socket says 172.21.15.78:51122) 2024-09-17T03:15:15.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.306+0000 7f79f37fe640 1 -- 172.21.15.78:0/3673080376 learned_addr learned my addr 172.21.15.78:0/3673080376 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.306+0000 7f79ebfff640 1 --2- 172.21.15.78:0/3673080376 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79f40b9b60 0x7f79f41f9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.306+0000 7f79f2ffd640 1 --2- 172.21.15.78:0/3673080376 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79f40b64e0 0x7f79f41ebcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.306+0000 7f79f37fe640 1 -- 172.21.15.78:0/3673080376 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79f40b9b60 msgr2=0x7f79f41f9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.306+0000 7f79f37fe640 1 --2- 172.21.15.78:0/3673080376 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79f40b9b60 0x7f79f41f9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.306+0000 7f79f37fe640 1 -- 172.21.15.78:0/3673080376 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79f40b64e0 msgr2=0x7f79f41ebcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.306+0000 7f79f37fe640 1 --2- 172.21.15.78:0/3673080376 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79f40b64e0 0x7f79f41ebcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.306+0000 7f79f37fe640 1 -- 172.21.15.78:0/3673080376 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f40cd7b0 con 0x7f79f40cf540 2024-09-17T03:15:15.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.306+0000 7f79f37fe640 1 --2- 172.21.15.78:0/3673080376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f40cf540 0x7f79f41f9e70 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00caa0 tx=0x7f79ec00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.306+0000 7f79eb7fe640 1 -- 172.21.15.78:0/3673080376 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec016020 con 0x7f79f40cf540 2024-09-17T03:15:15.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.306+0000 7f79eb7fe640 1 -- 172.21.15.78:0/3673080376 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79ec00acf0 con 0x7f79f40cf540 2024-09-17T03:15:15.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.306+0000 7f79f958e640 1 -- 172.21.15.78:0/3673080376 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79f40cda90 con 0x7f79f40cf540 2024-09-17T03:15:15.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.306+0000 7f79eb7fe640 1 -- 172.21.15.78:0/3673080376 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec012680 con 0x7f79f40cf540 2024-09-17T03:15:15.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.306+0000 7f79f958e640 1 -- 172.21.15.78:0/3673080376 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79f40ce050 con 0x7f79f40cf540 2024-09-17T03:15:15.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.308+0000 7f79eb7fe640 1 -- 172.21.15.78:0/3673080376 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f79ec019020 con 0x7f79f40cf540 2024-09-17T03:15:15.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.309+0000 7f79eb7fe640 1 --2- 172.21.15.78:0/3673080376 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f79d4078bc0 0x7f79d407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.309+0000 7f79eb7fe640 1 -- 172.21.15.78:0/3673080376 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f79ec09b340 con 0x7f79f40cf540 2024-09-17T03:15:15.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.309+0000 7f79f2ffd640 1 --2- 172.21.15.78:0/3673080376 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f79d4078bc0 0x7f79d407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.309+0000 7f7a005db740 1 Processor -- start 2024-09-17T03:15:15.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.310+0000 7f7a005db740 1 -- start start 2024-09-17T03:15:15.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.310+0000 7f79f2ffd640 1 --2- 172.21.15.78:0/3673080376 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f79d4078bc0 0x7f79d407b0d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f79e4034000 tx=0x7f79e4004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.311+0000 7f7a005db740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2274bc390 0x55f2278ab310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.311+0000 7f7a005db740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2274934d0 0x55f22788dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.311+0000 7f7a005db740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f22749b6b0 0x55f22788e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.311+0000 7f7a005db740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f2277d6bd0 con 0x55f22749b6b0 2024-09-17T03:15:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.311+0000 7f7a005db740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f2277c6000 con 0x55f2274934d0 2024-09-17T03:15:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.311+0000 7f7a005db740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f2277c9e10 con 0x55f2274bc390 2024-09-17T03:15:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.311+0000 7f79f37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f22749b6b0 0x55f22788e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.311+0000 7f79f37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f22749b6b0 0x55f22788e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51126/0 (socket says 172.21.15.78:51126) 2024-09-17T03:15:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.311+0000 7f79f37fe640 1 -- 172.21.15.78:0/1369648191 learned_addr learned my addr 172.21.15.78:0/1369648191 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.311+0000 7f79f2ffd640 1 --2- 172.21.15.78:0/1369648191 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2274bc390 0x55f2278ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.311+0000 7f79ebfff640 1 --2- 172.21.15.78:0/1369648191 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2274934d0 0x55f22788dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.311+0000 7f79f37fe640 1 -- 172.21.15.78:0/1369648191 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2274bc390 msgr2=0x55f2278ab310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.311+0000 7f79f37fe640 1 --2- 172.21.15.78:0/1369648191 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2274bc390 0x55f2278ab310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.311+0000 7f79f37fe640 1 -- 172.21.15.78:0/1369648191 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2274934d0 msgr2=0x55f22788dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.311+0000 7f79f37fe640 1 --2- 172.21.15.78:0/1369648191 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2274934d0 0x55f22788dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.311+0000 7f79f37fe640 1 -- 172.21.15.78:0/1369648191 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f22759e7d0 con 0x55f22749b6b0 2024-09-17T03:15:15.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.311+0000 7f79f2ffd640 1 --2- 172.21.15.78:0/1369648191 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2274bc390 0x55f2278ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:15.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.311+0000 7f79ebfff640 1 --2- 172.21.15.78:0/1369648191 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2274934d0 0x55f22788dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:15.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.311+0000 7f79f37fe640 1 --2- 172.21.15.78:0/1369648191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f22749b6b0 0x55f22788e520 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f79ec099890 tx=0x7f79ec062c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532862efb44ec546 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.311+0000 7f79e8ff9640 1 -- 172.21.15.78:0/1369648191 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec07d3d0 con 0x55f22749b6b0 2024-09-17T03:15:15.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.312+0000 7f79e8ff9640 1 -- 172.21.15.78:0/1369648191 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79ec067bf0 con 0x55f22749b6b0 2024-09-17T03:15:15.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.312+0000 7f79e8ff9640 1 -- 172.21.15.78:0/1369648191 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec06caa0 con 0x55f22749b6b0 2024-09-17T03:15:15.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.312+0000 7f7a005db740 1 -- 172.21.15.78:0/1369648191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f22749b6b0 msgr2=0x55f22788e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.312+0000 7f7a005db740 1 --2- 172.21.15.78:0/1369648191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f22749b6b0 0x55f22788e520 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f79ec099890 tx=0x7f79ec062c20 comp rx=0 tx=0).stop 2024-09-17T03:15:15.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.312+0000 7f7a005db740 1 -- 172.21.15.78:0/1369648191 shutdown_connections 2024-09-17T03:15:15.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.312+0000 7f7a005db740 1 --2- 172.21.15.78:0/1369648191 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f22749b6b0 0x55f22788e520 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.312+0000 7f7a005db740 1 --2- 172.21.15.78:0/1369648191 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2274934d0 0x55f22788dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.312+0000 7f7a005db740 1 --2- 172.21.15.78:0/1369648191 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2274bc390 0x55f2278ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.312+0000 7f7a005db740 1 -- 172.21.15.78:0/1369648191 >> 172.21.15.78:0/1369648191 conn(0x55f2274b04e0 msgr2=0x55f227864200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.313+0000 7f7a005db740 1 -- 172.21.15.78:0/1369648191 shutdown_connections 2024-09-17T03:15:15.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.313+0000 7f7a005db740 1 -- 172.21.15.78:0/1369648191 wait complete. 2024-09-17T03:15:15.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.313+0000 7f7a005db740 1 -- start start 2024-09-17T03:15:15.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.313+0000 7f7a005db740 1 Processor -- start 2024-09-17T03:15:15.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f7a005db740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2274934d0 0x55f22787c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f7a005db740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f22749b6b0 0x55f2278bb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f7a005db740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2274bc390 0x55f2278a8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f7a005db740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55f227536740 con 0x55f22749b6b0 2024-09-17T03:15:15.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f7a005db740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f22776b540 con 0x55f2274bc390 2024-09-17T03:15:15.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f7a005db740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f2278bbe60 con 0x55f2274934d0 2024-09-17T03:15:15.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f7a005db740 10 client.0 _ll_register_callbacks cb 0x55f22776a0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:15.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f79ebfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f22749b6b0 0x55f2278bb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f79ebfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f22749b6b0 0x55f2278bb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51134/0 (socket says 172.21.15.78:51134) 2024-09-17T03:15:15.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f79ebfff640 1 -- 172.21.15.78:0/687881064 learned_addr learned my addr 172.21.15.78:0/687881064 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f79f2ffd640 1 --2- 172.21.15.78:0/687881064 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2274934d0 0x55f22787c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f79f37fe640 1 --2- 172.21.15.78:0/687881064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2274bc390 0x55f2278a8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f79ebfff640 1 -- 172.21.15.78:0/687881064 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2274934d0 msgr2=0x55f22787c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f79ebfff640 1 --2- 172.21.15.78:0/687881064 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2274934d0 0x55f22787c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f79ebfff640 1 -- 172.21.15.78:0/687881064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2274bc390 msgr2=0x55f2278a8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f79ebfff640 1 --2- 172.21.15.78:0/687881064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2274bc390 0x55f2278a8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f79ebfff640 1 -- 172.21.15.78:0/687881064 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2275056a0 con 0x55f22749b6b0 2024-09-17T03:15:15.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f79f37fe640 1 --2- 172.21.15.78:0/687881064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2274bc390 0x55f2278a8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:15.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f79ebfff640 1 --2- 172.21.15.78:0/687881064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f22749b6b0 0x55f2278bb350 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00df40 tx=0x7f79dc00f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ee0397a0a43d93 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f79d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:15.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.315+0000 7f79d1ffb640 1 -- 172.21.15.78:0/687881064 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79dc018020 con 0x55f22749b6b0 2024-09-17T03:15:15.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.316+0000 7f79d1ffb640 1 -- 172.21.15.78:0/687881064 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f79dc014670 con 0x55f22749b6b0 2024-09-17T03:15:15.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.316+0000 7f7a005db740 1 -- 172.21.15.78:0/687881064 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79ec067bf0 con 0x55f22749b6b0 2024-09-17T03:15:15.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.316+0000 7f79d1ffb640 1 -- 172.21.15.78:0/687881064 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f79dc022050 con 0x55f22749b6b0 2024-09-17T03:15:15.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.316+0000 7f7a005db740 10 client.8781 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:15.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.316+0000 7f7a005db740 1 -- 172.21.15.78:0/687881064 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x55f2275fef60 con 0x55f22749b6b0 2024-09-17T03:15:15.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.316+0000 7f79d1ffb640 1 -- 172.21.15.78:0/687881064 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79ec067bf0 con 0x55f22749b6b0 2024-09-17T03:15:15.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.316+0000 7f79d1ffb640 1 -- 172.21.15.78:0/687881064 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7f79dc025020 con 0x55f22749b6b0 2024-09-17T03:15:15.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.316+0000 7f7a005db740 10 client.8781 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:15.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.316+0000 7f7a005db740 10 client.8781 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T03:15:15.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.316+0000 7f7a005db740 20 client.8781 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:15.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.316+0000 7f7a005db740 1 --2- 172.21.15.78:0/687881064 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f22747af60 0x55f2278a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.316+0000 7f7a005db740 4 client.8781 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:15.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.316+0000 7f7a005db740 1 -- 172.21.15.78:0/687881064 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2277d8b20 con 0x55f22747af60 2024-09-17T03:15:15.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.316+0000 7f79f2ffd640 1 --2- 172.21.15.78:0/687881064 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f22747af60 0x55f2278a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.317+0000 7f79d1ffb640 10 client.8781 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:15.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.317+0000 7f79f2ffd640 1 --2- 172.21.15.78:0/687881064 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f22747af60 0x55f2278a57c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1ee3d9a38664fce server_cookie=15f221323efac843 in_seq=0 out_seq=0 2024-09-17T03:15:15.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.317+0000 7f79d1ffb640 1 -- 172.21.15.78:0/687881064 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f2277d8b20 con 0x55f22747af60 2024-09-17T03:15:15.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.317+0000 7f79d1ffb640 10 client.8781 handle_command_reply: tid=0 2024-09-17T03:15:15.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.317+0000 7f7a005db740 1 client.8781 shutdown 2024-09-17T03:15:15.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.317+0000 7f7a005db740 1 -- 172.21.15.78:0/687881064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f22749b6b0 msgr2=0x55f2278bb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.317+0000 7f7a005db740 1 --2- 172.21.15.78:0/687881064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f22749b6b0 0x55f2278bb350 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f79dc00df40 tx=0x7f79dc00f670 comp rx=0 tx=0).stop 2024-09-17T03:15:15.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.317+0000 7f7a005db740 1 -- 172.21.15.78:0/687881064 shutdown_connections 2024-09-17T03:15:15.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.317+0000 7f7a005db740 1 --2- 172.21.15.78:0/687881064 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f22747af60 0x55f2278a57c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.317+0000 7f7a005db740 1 --2- 172.21.15.78:0/687881064 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2274bc390 0x55f2278a8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.317+0000 7f7a005db740 1 --2- 172.21.15.78:0/687881064 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f22749b6b0 0x55f2278bb350 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.317+0000 7f7a005db740 1 --2- 172.21.15.78:0/687881064 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2274934d0 0x55f22787c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.317+0000 7f79d1ffb640 0 client.8781 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.317+0000 7f7a005db740 1 -- 172.21.15.78:0/687881064 >> 172.21.15.78:0/687881064 conn(0x55f2274b04e0 msgr2=0x55f22787e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.317+0000 7f7a005db740 1 -- 172.21.15.78:0/687881064 shutdown_connections 2024-09-17T03:15:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.317+0000 7f7a005db740 1 -- 172.21.15.78:0/687881064 wait complete. 2024-09-17T03:15:15.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.318+0000 7f7a005db740 20 client.8781 trim_cache size 0 max 16384 2024-09-17T03:15:15.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.335+0000 7f7a005db740 1 Processor -- start 2024-09-17T03:15:15.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.335+0000 7f7a005db740 1 -- start start 2024-09-17T03:15:15.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.336+0000 7f7a005db740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2274934d0 0x55f227859cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.336+0000 7f7a005db740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f22749b6b0 0x55f2278a7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.336+0000 7f7a005db740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2274bc390 0x55f2278cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.336+0000 7f7a005db740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f79f4202290 con 0x55f2274bc390 2024-09-17T03:15:15.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.336+0000 7f7a005db740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f79f4201450 con 0x55f22749b6b0 2024-09-17T03:15:15.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.336+0000 7f7a005db740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f79f4201b60 con 0x55f2274934d0 2024-09-17T03:15:15.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.336+0000 7f79f37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2274bc390 0x55f2278cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.336+0000 7f79f37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2274bc390 0x55f2278cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51138/0 (socket says 172.21.15.78:51138) 2024-09-17T03:15:15.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.336+0000 7f79f37fe640 1 -- 172.21.15.78:0/2518382179 learned_addr learned my addr 172.21.15.78:0/2518382179 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.336+0000 7f79f37fe640 1 -- 172.21.15.78:0/2518382179 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2274934d0 msgr2=0x55f227859cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.336+0000 7f79f37fe640 1 --2- 172.21.15.78:0/2518382179 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2274934d0 0x55f227859cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.336+0000 7f79f37fe640 1 -- 172.21.15.78:0/2518382179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f22749b6b0 msgr2=0x55f2278a7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.336+0000 7f79f37fe640 1 --2- 172.21.15.78:0/2518382179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f22749b6b0 0x55f2278a7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.336+0000 7f79f37fe640 1 -- 172.21.15.78:0/2518382179 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f22759cad0 con 0x55f2274bc390 2024-09-17T03:15:15.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.336+0000 7f79f37fe640 1 --2- 172.21.15.78:0/2518382179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2274bc390 0x55f2278cb7d0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f79ec060380 tx=0x7f79ec066040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47a9d4e69f4711a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.337+0000 7f79d3fff640 1 -- 172.21.15.78:0/2518382179 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec05f760 con 0x55f2274bc390 2024-09-17T03:15:15.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.337+0000 7f79d3fff640 1 -- 172.21.15.78:0/2518382179 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79ec067bf0 con 0x55f2274bc390 2024-09-17T03:15:15.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.337+0000 7f79d3fff640 1 -- 172.21.15.78:0/2518382179 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec06caa0 con 0x55f2274bc390 2024-09-17T03:15:15.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.337+0000 7f7a005db740 1 -- 172.21.15.78:0/2518382179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2274bc390 msgr2=0x55f2278cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.337+0000 7f7a005db740 1 --2- 172.21.15.78:0/2518382179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2274bc390 0x55f2278cb7d0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f79ec060380 tx=0x7f79ec066040 comp rx=0 tx=0).stop 2024-09-17T03:15:15.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.337+0000 7f7a005db740 1 -- 172.21.15.78:0/2518382179 shutdown_connections 2024-09-17T03:15:15.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.337+0000 7f7a005db740 1 --2- 172.21.15.78:0/2518382179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2274bc390 0x55f2278cb7d0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.337+0000 7f7a005db740 1 --2- 172.21.15.78:0/2518382179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f22749b6b0 0x55f2278a7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.337+0000 7f7a005db740 1 --2- 172.21.15.78:0/2518382179 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f2274934d0 0x55f227859cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.337+0000 7f7a005db740 1 -- 172.21.15.78:0/2518382179 >> 172.21.15.78:0/2518382179 conn(0x55f2274b04e0 msgr2=0x55f2278a8e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.337+0000 7f7a005db740 1 -- 172.21.15.78:0/2518382179 shutdown_connections 2024-09-17T03:15:15.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.337+0000 7f7a005db740 1 -- 172.21.15.78:0/2518382179 wait complete. 2024-09-17T03:15:15.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.338+0000 7f7a005db740 1 -- start start 2024-09-17T03:15:15.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.338+0000 7f7a005db740 1 Processor -- start 2024-09-17T03:15:15.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.339+0000 7f7a005db740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2274934d0 0x55f227878350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.339+0000 7f7a005db740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f22749b6b0 0x55f22791ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.339+0000 7f7a005db740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2274bc390 0x55f22791ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.339+0000 7f7a005db740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f79f40c9910 con 0x55f2274bc390 2024-09-17T03:15:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f7a005db740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55f227862b60 con 0x55f2274934d0 2024-09-17T03:15:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f7a005db740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55f2278bad30 con 0x55f22749b6b0 2024-09-17T03:15:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f7a005db740 10 client.0 _ll_register_callbacks cb 0x7f79dc00d220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f79f37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2274bc390 0x55f22791ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f79f37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2274bc390 0x55f22791ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51140/0 (socket says 172.21.15.78:51140) 2024-09-17T03:15:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f79f37fe640 1 -- 172.21.15.78:0/467016754 learned_addr learned my addr 172.21.15.78:0/467016754 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f79f2ffd640 1 --2- 172.21.15.78:0/467016754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2274934d0 0x55f227878350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f79ebfff640 1 --2- 172.21.15.78:0/467016754 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f22749b6b0 0x55f22791ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f79f37fe640 1 -- 172.21.15.78:0/467016754 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f22749b6b0 msgr2=0x55f22791ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f79f37fe640 1 --2- 172.21.15.78:0/467016754 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f22749b6b0 0x55f22791ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f79f37fe640 1 -- 172.21.15.78:0/467016754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2274934d0 msgr2=0x55f227878350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f79f37fe640 1 --2- 172.21.15.78:0/467016754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2274934d0 0x55f227878350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f79f37fe640 1 -- 172.21.15.78:0/467016754 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2278ca630 con 0x55f2274bc390 2024-09-17T03:15:15.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f79f37fe640 1 --2- 172.21.15.78:0/467016754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2274bc390 0x55f22791ef90 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00ca70 tx=0x7f79ec001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4be57b7a615582 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f79d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:15.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f79d1ffb640 1 -- 172.21.15.78:0/467016754 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec0853f0 con 0x55f2274bc390 2024-09-17T03:15:15.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f79d1ffb640 1 -- 172.21.15.78:0/467016754 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f79ec0891b0 con 0x55f2274bc390 2024-09-17T03:15:15.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f7a005db740 1 -- 172.21.15.78:0/467016754 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79ec067bf0 con 0x55f2274bc390 2024-09-17T03:15:15.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f79d1ffb640 1 -- 172.21.15.78:0/467016754 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f79ec091050 con 0x55f2274bc390 2024-09-17T03:15:15.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f7a005db740 10 client.8787 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:15.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.340+0000 7f7a005db740 1 -- 172.21.15.78:0/467016754 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x55f227863a00 con 0x55f2274bc390 2024-09-17T03:15:15.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.341+0000 7f79d1ffb640 1 -- 172.21.15.78:0/467016754 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79ec067bf0 con 0x55f2274bc390 2024-09-17T03:15:15.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.341+0000 7f79d1ffb640 1 -- 172.21.15.78:0/467016754 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7f79ec094020 con 0x55f2274bc390 2024-09-17T03:15:15.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.341+0000 7f7a005db740 10 client.8787 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:15.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.341+0000 7f7a005db740 10 client.8787 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T03:15:15.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.341+0000 7f7a005db740 20 client.8787 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:15.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.341+0000 7f7a005db740 1 --2- 172.21.15.78:0/467016754 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f227865630 0x55f227861c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.341+0000 7f7a005db740 4 client.8787 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "scrub abort"}] 2024-09-17T03:15:15.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.341+0000 7f7a005db740 1 -- 172.21.15.78:0/467016754 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "scrub abort"}) -- 0x55f2277d45d0 con 0x55f227865630 2024-09-17T03:15:15.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.341+0000 7f79f2ffd640 1 --2- 172.21.15.78:0/467016754 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f227865630 0x55f227861c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.341+0000 7f79d1ffb640 10 client.8787 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:15.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.341+0000 7f79f2ffd640 1 --2- 172.21.15.78:0/467016754 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f227865630 0x55f227861c60 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfc178d6eec5c508 server_cookie=2d2478af364d2130 in_seq=0 out_seq=0 2024-09-17T03:15:15.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.341+0000 7f79d1ffb640 1 -- 172.21.15.78:0/467016754 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f2277d45d0 con 0x55f227865630 2024-09-17T03:15:15.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.341+0000 7f79d1ffb640 10 client.8787 handle_command_reply: tid=0 2024-09-17T03:15:15.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f7a005db740 1 client.8787 shutdown 2024-09-17T03:15:15.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f7a005db740 1 -- 172.21.15.78:0/467016754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2274bc390 msgr2=0x55f22791ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f7a005db740 1 --2- 172.21.15.78:0/467016754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2274bc390 0x55f22791ef90 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00ca70 tx=0x7f79ec001ad0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f7a005db740 1 -- 172.21.15.78:0/467016754 shutdown_connections 2024-09-17T03:15:15.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f7a005db740 1 --2- 172.21.15.78:0/467016754 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55f2274bc390 0x55f22791ef90 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f7a005db740 1 --2- 172.21.15.78:0/467016754 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55f22749b6b0 0x55f22791ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f7a005db740 1 --2- 172.21.15.78:0/467016754 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55f227865630 0x55f227861c60 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f7a005db740 1 --2- 172.21.15.78:0/467016754 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55f2274934d0 0x55f227878350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f79d1ffb640 0 client.8787 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:15.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f7a005db740 1 -- 172.21.15.78:0/467016754 >> 172.21.15.78:0/467016754 conn(0x55f2274b04e0 msgr2=0x55f2278a7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f7a005db740 1 -- 172.21.15.78:0/467016754 shutdown_connections 2024-09-17T03:15:15.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f7a005db740 1 -- 172.21.15.78:0/467016754 wait complete. 2024-09-17T03:15:15.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f7a005db740 20 client.8787 trim_cache size 0 max 16384 2024-09-17T03:15:15.346 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:15.346 INFO:teuthology.orchestra.run.smithi078.stdout: "message": "", 2024-09-17T03:15:15.347 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:15:15.347 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:15.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f79f958e640 1 -- 172.21.15.78:0/3673080376 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f79d4078bc0 msgr2=0x7f79d407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f79f958e640 1 --2- 172.21.15.78:0/3673080376 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f79d4078bc0 0x7f79d407b0d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f79e4034000 tx=0x7f79e4004730 comp rx=0 tx=0).stop 2024-09-17T03:15:15.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f79f958e640 1 -- 172.21.15.78:0/3673080376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f40cf540 msgr2=0x7f79f41f9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f79f958e640 1 --2- 172.21.15.78:0/3673080376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f40cf540 0x7f79f41f9e70 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f79ec00caa0 tx=0x7f79ec00cf60 comp rx=0 tx=0).stop 2024-09-17T03:15:15.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f79f958e640 1 -- 172.21.15.78:0/3673080376 shutdown_connections 2024-09-17T03:15:15.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f79f958e640 1 --2- 172.21.15.78:0/3673080376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f79f40cf540 0x7f79f41f9e70 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f79f958e640 1 --2- 172.21.15.78:0/3673080376 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79f40b9b60 0x7f79f41f9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f79f958e640 1 --2- 172.21.15.78:0/3673080376 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f79d4078bc0 0x7f79d407b0d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f79f958e640 1 --2- 172.21.15.78:0/3673080376 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79f40b64e0 0x7f79f41ebcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f79f958e640 1 -- 172.21.15.78:0/3673080376 >> 172.21.15.78:0/3673080376 conn(0x7f79f409d7f0 msgr2=0x7f79f40ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f79f958e640 1 -- 172.21.15.78:0/3673080376 shutdown_connections 2024-09-17T03:15:15.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.342+0000 7f79f958e640 1 -- 172.21.15.78:0/3673080376 wait complete. 2024-09-17T03:15:15.352 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:15:15.353 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:1 scrub status 2024-09-17T03:15:15.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.468+0000 7f8253038640 1 -- 172.21.15.78:0/2344590958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f824c15b830 msgr2=0x7f824c074180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.468+0000 7f8253038640 1 --2- 172.21.15.78:0/2344590958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f824c15b830 0x7f824c074180 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f824c0b4f00 tx=0x7f824002aa00 comp rx=0 tx=0).stop 2024-09-17T03:15:15.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.468+0000 7f8253038640 1 -- 172.21.15.78:0/2344590958 shutdown_connections 2024-09-17T03:15:15.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.468+0000 7f8253038640 1 --2- 172.21.15.78:0/2344590958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f824c15b830 0x7f824c074180 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.468+0000 7f8253038640 1 --2- 172.21.15.78:0/2344590958 >> v2:172.21.15.193:3300/0 conn(0x7f824c0b2fb0 0x7f824c0af680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.468+0000 7f8253038640 1 -- 172.21.15.78:0/2344590958 >> 172.21.15.78:0/2344590958 conn(0x7f824c06d7d0 msgr2=0x7f824c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.468+0000 7f8253038640 1 -- 172.21.15.78:0/2344590958 shutdown_connections 2024-09-17T03:15:15.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.468+0000 7f8253038640 1 -- 172.21.15.78:0/2344590958 wait complete. 2024-09-17T03:15:15.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.470+0000 7f8253038640 1 Processor -- start 2024-09-17T03:15:15.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.470+0000 7f8253038640 1 -- start start 2024-09-17T03:15:15.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.471+0000 7f8253038640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f824c06ffa0 0x7f824c1447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.471+0000 7f8253038640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f824c0b2fb0 0x7f824c1537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.471+0000 7f8253038640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f824c15b830 0x7f824c15def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.471+0000 7f8253038640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f824c0ceaf0 con 0x7f824c0b2fb0 2024-09-17T03:15:15.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.471+0000 7f8253038640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f824c0ce970 con 0x7f824c06ffa0 2024-09-17T03:15:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.471+0000 7f8253038640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f824c0cec70 con 0x7f824c15b830 2024-09-17T03:15:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.471+0000 7f824bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f824c0b2fb0 0x7f824c1537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.471+0000 7f824bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f824c0b2fb0 0x7f824c1537f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51148/0 (socket says 172.21.15.78:51148) 2024-09-17T03:15:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.471+0000 7f824bfff640 1 -- 172.21.15.78:0/1109812382 learned_addr learned my addr 172.21.15.78:0/1109812382 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.471+0000 7f8250dd4640 1 --2- 172.21.15.78:0/1109812382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f824c06ffa0 0x7f824c1447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.471+0000 7f82515d5640 1 --2- 172.21.15.78:0/1109812382 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f824c15b830 0x7f824c15def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.472+0000 7f824bfff640 1 -- 172.21.15.78:0/1109812382 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f824c15b830 msgr2=0x7f824c15def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.472+0000 7f824bfff640 1 --2- 172.21.15.78:0/1109812382 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f824c15b830 0x7f824c15def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.472+0000 7f824bfff640 1 -- 172.21.15.78:0/1109812382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f824c06ffa0 msgr2=0x7f824c1447c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.472+0000 7f824bfff640 1 --2- 172.21.15.78:0/1109812382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f824c06ffa0 0x7f824c1447c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.472+0000 7f824bfff640 1 -- 172.21.15.78:0/1109812382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f824c155610 con 0x7f824c0b2fb0 2024-09-17T03:15:15.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.472+0000 7f824bfff640 1 --2- 172.21.15.78:0/1109812382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f824c0b2fb0 0x7f824c1537f0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f8240005fd0 tx=0x7f8240003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.472+0000 7f82497fa640 1 -- 172.21.15.78:0/1109812382 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8240033050 con 0x7f824c0b2fb0 2024-09-17T03:15:15.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.472+0000 7f8253038640 1 -- 172.21.15.78:0/1109812382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f824c144d00 con 0x7f824c0b2fb0 2024-09-17T03:15:15.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.472+0000 7f82497fa640 1 -- 172.21.15.78:0/1109812382 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8240004550 con 0x7f824c0b2fb0 2024-09-17T03:15:15.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.472+0000 7f82497fa640 1 -- 172.21.15.78:0/1109812382 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8240038450 con 0x7f824c0b2fb0 2024-09-17T03:15:15.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.472+0000 7f8253038640 1 -- 172.21.15.78:0/1109812382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f824c1f3d90 con 0x7f824c0b2fb0 2024-09-17T03:15:15.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.474+0000 7f82497fa640 1 -- 172.21.15.78:0/1109812382 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8240036070 con 0x7f824c0b2fb0 2024-09-17T03:15:15.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.475+0000 7f82497fa640 1 --2- 172.21.15.78:0/1109812382 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8238078bc0 0x7f823807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.475+0000 7f82497fa640 1 -- 172.21.15.78:0/1109812382 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f82400bc200 con 0x7f824c0b2fb0 2024-09-17T03:15:15.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.475+0000 7f8250dd4640 1 --2- 172.21.15.78:0/1109812382 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8238078bc0 0x7f823807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.475+0000 7f825a085740 1 Processor -- start 2024-09-17T03:15:15.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.475+0000 7f825a085740 1 -- start start 2024-09-17T03:15:15.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.476+0000 7f8250dd4640 1 --2- 172.21.15.78:0/1109812382 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8238078bc0 0x7f823807b0d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f823c0098e0 tx=0x7f823c009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f825a085740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342af3390 0x55d342ee0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f825a085740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342aca4d0 0x55d342e96530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f825a085740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342ad26b0 0x55d342ec1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f825a085740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55d342e0da60 con 0x55d342aca4d0 2024-09-17T03:15:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f825a085740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d342dfce90 con 0x55d342ad26b0 2024-09-17T03:15:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f825a085740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55d342e00ca0 con 0x55d342af3390 2024-09-17T03:15:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f824bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342aca4d0 0x55d342e96530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f824bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342aca4d0 0x55d342e96530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51164/0 (socket says 172.21.15.78:51164) 2024-09-17T03:15:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f824bfff640 1 -- 172.21.15.78:0/1366280799 learned_addr learned my addr 172.21.15.78:0/1366280799 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f8250dd4640 1 --2- 172.21.15.78:0/1366280799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342af3390 0x55d342ee0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f82515d5640 1 --2- 172.21.15.78:0/1366280799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342ad26b0 0x55d342ec1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f824bfff640 1 -- 172.21.15.78:0/1366280799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342af3390 msgr2=0x55d342ee0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f824bfff640 1 --2- 172.21.15.78:0/1366280799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342af3390 0x55d342ee0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f824bfff640 1 -- 172.21.15.78:0/1366280799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342ad26b0 msgr2=0x55d342ec1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f824bfff640 1 --2- 172.21.15.78:0/1366280799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342ad26b0 0x55d342ec1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f824bfff640 1 -- 172.21.15.78:0/1366280799 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d342bd57d0 con 0x55d342aca4d0 2024-09-17T03:15:15.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f8250dd4640 1 --2- 172.21.15.78:0/1366280799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342af3390 0x55d342ee0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:15.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f82515d5640 1 --2- 172.21.15.78:0/1366280799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342ad26b0 0x55d342ec1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:15.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f824bfff640 1 --2- 172.21.15.78:0/1366280799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342aca4d0 0x55d342e96530 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f8240083c70 tx=0x7f824007ff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352e41950aeeedeb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f82327fc640 1 -- 172.21.15.78:0/1366280799 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8240083a80 con 0x55d342aca4d0 2024-09-17T03:15:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f82327fc640 1 -- 172.21.15.78:0/1366280799 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8240083f70 con 0x55d342aca4d0 2024-09-17T03:15:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.477+0000 7f82327fc640 1 -- 172.21.15.78:0/1366280799 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82400889a0 con 0x55d342aca4d0 2024-09-17T03:15:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.478+0000 7f825a085740 1 -- 172.21.15.78:0/1366280799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342aca4d0 msgr2=0x55d342e96530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.478+0000 7f825a085740 1 --2- 172.21.15.78:0/1366280799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342aca4d0 0x55d342e96530 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f8240083c70 tx=0x7f824007ff10 comp rx=0 tx=0).stop 2024-09-17T03:15:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.478+0000 7f825a085740 1 -- 172.21.15.78:0/1366280799 shutdown_connections 2024-09-17T03:15:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.478+0000 7f825a085740 1 --2- 172.21.15.78:0/1366280799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342ad26b0 0x55d342ec1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.478+0000 7f825a085740 1 --2- 172.21.15.78:0/1366280799 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342aca4d0 0x55d342e96530 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.478+0000 7f825a085740 1 --2- 172.21.15.78:0/1366280799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342af3390 0x55d342ee0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.478+0000 7f825a085740 1 -- 172.21.15.78:0/1366280799 >> 172.21.15.78:0/1366280799 conn(0x55d342ae74e0 msgr2=0x55d342e9ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.478+0000 7f825a085740 1 -- 172.21.15.78:0/1366280799 shutdown_connections 2024-09-17T03:15:15.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.478+0000 7f825a085740 1 -- 172.21.15.78:0/1366280799 wait complete. 2024-09-17T03:15:15.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.479+0000 7f825a085740 1 -- start start 2024-09-17T03:15:15.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.479+0000 7f825a085740 1 Processor -- start 2024-09-17T03:15:15.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f825a085740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342aca4d0 0x55d342ec2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f825a085740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342ad26b0 0x55d342ef3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f825a085740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342af3390 0x55d342ed88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f825a085740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55d342b6d740 con 0x55d342af3390 2024-09-17T03:15:15.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f825a085740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55d342da2970 con 0x55d342ad26b0 2024-09-17T03:15:15.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f825a085740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55d342dfce90 con 0x55d342aca4d0 2024-09-17T03:15:15.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f825a085740 10 client.0 _ll_register_callbacks cb 0x55d342db1780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:15.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f82515d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342af3390 0x55d342ed88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f82515d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342af3390 0x55d342ed88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51178/0 (socket says 172.21.15.78:51178) 2024-09-17T03:15:15.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f82515d5640 1 -- 172.21.15.78:0/759736623 learned_addr learned my addr 172.21.15.78:0/759736623 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f824bfff640 1 --2- 172.21.15.78:0/759736623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342ad26b0 0x55d342ef3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f8250dd4640 1 --2- 172.21.15.78:0/759736623 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342aca4d0 0x55d342ec2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f82515d5640 1 -- 172.21.15.78:0/759736623 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342aca4d0 msgr2=0x55d342ec2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f82515d5640 1 --2- 172.21.15.78:0/759736623 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342aca4d0 0x55d342ec2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f82515d5640 1 -- 172.21.15.78:0/759736623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342ad26b0 msgr2=0x55d342ef3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f82515d5640 1 --2- 172.21.15.78:0/759736623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342ad26b0 0x55d342ef3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f82515d5640 1 -- 172.21.15.78:0/759736623 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d342b5e970 con 0x55d342af3390 2024-09-17T03:15:15.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f82515d5640 1 --2- 172.21.15.78:0/759736623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342af3390 0x55d342ed88e0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f824c0cdba0 tx=0x7f8244011630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58cbe4da010d16b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f822b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:15.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f822b7fe640 1 -- 172.21.15.78:0/759736623 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8244019070 con 0x55d342af3390 2024-09-17T03:15:15.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f822b7fe640 1 -- 172.21.15.78:0/759736623 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f8244015660 con 0x55d342af3390 2024-09-17T03:15:15.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.481+0000 7f825a085740 1 -- 172.21.15.78:0/759736623 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8240083f70 con 0x55d342af3390 2024-09-17T03:15:15.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.482+0000 7f822b7fe640 1 -- 172.21.15.78:0/759736623 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f8244015860 con 0x55d342af3390 2024-09-17T03:15:15.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.482+0000 7f825a085740 10 client.8799 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:15.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.482+0000 7f825a085740 1 -- 172.21.15.78:0/759736623 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x55d342b3c6a0 con 0x55d342af3390 2024-09-17T03:15:15.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.482+0000 7f822b7fe640 1 -- 172.21.15.78:0/759736623 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8240083f70 con 0x55d342af3390 2024-09-17T03:15:15.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.482+0000 7f822b7fe640 1 -- 172.21.15.78:0/759736623 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7f8244015a00 con 0x55d342af3390 2024-09-17T03:15:15.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.482+0000 7f825a085740 10 client.8799 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:15.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.482+0000 7f825a085740 10 client.8799 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2024-09-17T03:15:15.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.482+0000 7f825a085740 20 client.8799 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:15.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.482+0000 7f825a085740 1 --2- 172.21.15.78:0/759736623 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x55d342ab1f60 0x55d342ef69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.482+0000 7f825a085740 4 client.8799 mds_command: new command op to 8283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:15.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.482+0000 7f825a085740 1 -- 172.21.15.78:0/759736623 --> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d342e0f9b0 con 0x55d342ab1f60 2024-09-17T03:15:15.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.482+0000 7f8250dd4640 1 --2- 172.21.15.78:0/759736623 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x55d342ab1f60 0x55d342ef69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.482+0000 7f822b7fe640 10 client.8799 ms_handle_connect on v2:172.21.15.78:6832/1810198137 2024-09-17T03:15:15.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.482+0000 7f8250dd4640 1 --2- 172.21.15.78:0/759736623 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x55d342ab1f60 0x55d342ef69f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ffed74807d464df server_cookie=236987483cbb9a6f in_seq=0 out_seq=0 2024-09-17T03:15:15.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.483+0000 7f822b7fe640 1 -- 172.21.15.78:0/759736623 <== mds.1 v2:172.21.15.78:6832/1810198137 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d342e0f9b0 con 0x55d342ab1f60 2024-09-17T03:15:15.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.483+0000 7f822b7fe640 10 client.8799 handle_command_reply: tid=0 2024-09-17T03:15:15.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.483+0000 7f825a085740 1 client.8799 shutdown 2024-09-17T03:15:15.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.483+0000 7f825a085740 1 -- 172.21.15.78:0/759736623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342af3390 msgr2=0x55d342ed88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.483+0000 7f825a085740 1 --2- 172.21.15.78:0/759736623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342af3390 0x55d342ed88e0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f824c0cdba0 tx=0x7f8244011630 comp rx=0 tx=0).stop 2024-09-17T03:15:15.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.483+0000 7f825a085740 1 -- 172.21.15.78:0/759736623 shutdown_connections 2024-09-17T03:15:15.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.483+0000 7f825a085740 1 --2- 172.21.15.78:0/759736623 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x55d342ab1f60 0x55d342ef69f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.483+0000 7f825a085740 1 --2- 172.21.15.78:0/759736623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342af3390 0x55d342ed88e0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.483+0000 7f822b7fe640 0 client.8799 ms_handle_reset on v2:172.21.15.78:6832/1810198137 2024-09-17T03:15:15.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.483+0000 7f825a085740 1 --2- 172.21.15.78:0/759736623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342ad26b0 0x55d342ef3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.483+0000 7f825a085740 1 --2- 172.21.15.78:0/759736623 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342aca4d0 0x55d342ec2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.483+0000 7f825a085740 1 -- 172.21.15.78:0/759736623 >> 172.21.15.78:0/759736623 conn(0x55d342ae74e0 msgr2=0x55d342eb4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.483+0000 7f825a085740 1 -- 172.21.15.78:0/759736623 shutdown_connections 2024-09-17T03:15:15.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.483+0000 7f825a085740 1 -- 172.21.15.78:0/759736623 wait complete. 2024-09-17T03:15:15.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.484+0000 7f825a085740 20 client.8799 trim_cache size 0 max 16384 2024-09-17T03:15:15.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.501+0000 7f825a085740 1 Processor -- start 2024-09-17T03:15:15.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.501+0000 7f825a085740 1 -- start start 2024-09-17T03:15:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.502+0000 7f825a085740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342aca4d0 0x55d342ed6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.502+0000 7f825a085740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342ad26b0 0x55d342e966d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.502+0000 7f825a085740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342af3390 0x55d342e96c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.502+0000 7f825a085740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f824c1fe0e0 con 0x55d342aca4d0 2024-09-17T03:15:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.502+0000 7f825a085740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f824c06f120 con 0x55d342ad26b0 2024-09-17T03:15:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.502+0000 7f825a085740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f824c06f850 con 0x55d342af3390 2024-09-17T03:15:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.502+0000 7f8250dd4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342aca4d0 0x55d342ed6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.502+0000 7f8250dd4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342aca4d0 0x55d342ed6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51182/0 (socket says 172.21.15.78:51182) 2024-09-17T03:15:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.502+0000 7f8250dd4640 1 -- 172.21.15.78:0/2730846641 learned_addr learned my addr 172.21.15.78:0/2730846641 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.502+0000 7f82515d5640 1 --2- 172.21.15.78:0/2730846641 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342af3390 0x55d342e96c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.503+0000 7f8250dd4640 1 -- 172.21.15.78:0/2730846641 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342af3390 msgr2=0x55d342e96c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.503+0000 7f8250dd4640 1 --2- 172.21.15.78:0/2730846641 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342af3390 0x55d342e96c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.503+0000 7f8250dd4640 1 -- 172.21.15.78:0/2730846641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342ad26b0 msgr2=0x55d342e966d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.503+0000 7f824bfff640 1 --2- 172.21.15.78:0/2730846641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342ad26b0 0x55d342e966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.503+0000 7f8250dd4640 1 --2- 172.21.15.78:0/2730846641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342ad26b0 0x55d342e966d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.503+0000 7f8250dd4640 1 -- 172.21.15.78:0/2730846641 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d342e95670 con 0x55d342aca4d0 2024-09-17T03:15:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.503+0000 7f82515d5640 1 --2- 172.21.15.78:0/2730846641 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342af3390 0x55d342e96c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.503+0000 7f824bfff640 1 --2- 172.21.15.78:0/2730846641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342ad26b0 0x55d342e966d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.503+0000 7f8250dd4640 1 --2- 172.21.15.78:0/2730846641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342aca4d0 0x55d342ed6260 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f823c00eca0 tx=0x7f823c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9f880306b7e013 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.503+0000 7f8231ffb640 1 -- 172.21.15.78:0/2730846641 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c01b040 con 0x55d342aca4d0 2024-09-17T03:15:15.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.503+0000 7f8231ffb640 1 -- 172.21.15.78:0/2730846641 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f823c00ed90 con 0x55d342aca4d0 2024-09-17T03:15:15.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.503+0000 7f8231ffb640 1 -- 172.21.15.78:0/2730846641 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f823c022430 con 0x55d342aca4d0 2024-09-17T03:15:15.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.504+0000 7f825a085740 1 -- 172.21.15.78:0/2730846641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342aca4d0 msgr2=0x55d342ed6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.504+0000 7f825a085740 1 --2- 172.21.15.78:0/2730846641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342aca4d0 0x55d342ed6260 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f823c00eca0 tx=0x7f823c015000 comp rx=0 tx=0).stop 2024-09-17T03:15:15.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.504+0000 7f825a085740 1 -- 172.21.15.78:0/2730846641 shutdown_connections 2024-09-17T03:15:15.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.504+0000 7f825a085740 1 --2- 172.21.15.78:0/2730846641 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342af3390 0x55d342e96c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.504+0000 7f825a085740 1 --2- 172.21.15.78:0/2730846641 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342ad26b0 0x55d342e966d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.504+0000 7f825a085740 1 --2- 172.21.15.78:0/2730846641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342aca4d0 0x55d342ed6260 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.504+0000 7f825a085740 1 -- 172.21.15.78:0/2730846641 >> 172.21.15.78:0/2730846641 conn(0x55d342ae74e0 msgr2=0x55d342ef3720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.504+0000 7f825a085740 1 -- 172.21.15.78:0/2730846641 shutdown_connections 2024-09-17T03:15:15.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.504+0000 7f825a085740 1 -- 172.21.15.78:0/2730846641 wait complete. 2024-09-17T03:15:15.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.504+0000 7f825a085740 1 -- start start 2024-09-17T03:15:15.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.505+0000 7f825a085740 1 Processor -- start 2024-09-17T03:15:15.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.506+0000 7f825a085740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342aca4d0 0x55d342f597f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.506+0000 7f825a085740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342ad26b0 0x55d342eb13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.506+0000 7f825a085740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342af3390 0x55d342eb1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.506+0000 7f825a085740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55d342e0da60 con 0x55d342af3390 2024-09-17T03:15:15.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.506+0000 7f825a085740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f824c15d320 con 0x55d342aca4d0 2024-09-17T03:15:15.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.506+0000 7f825a085740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55d342f63640 con 0x55d342ad26b0 2024-09-17T03:15:15.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.506+0000 7f825a085740 10 client.0 _ll_register_callbacks cb 0x7f8244009320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:15.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.506+0000 7f82515d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342af3390 0x55d342eb1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.506+0000 7f82515d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342af3390 0x55d342eb1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51188/0 (socket says 172.21.15.78:51188) 2024-09-17T03:15:15.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.506+0000 7f82515d5640 1 -- 172.21.15.78:0/1035035612 learned_addr learned my addr 172.21.15.78:0/1035035612 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.506+0000 7f824bfff640 1 --2- 172.21.15.78:0/1035035612 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342ad26b0 0x55d342eb13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.506+0000 7f8250dd4640 1 --2- 172.21.15.78:0/1035035612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342aca4d0 0x55d342f597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.506+0000 7f82515d5640 1 -- 172.21.15.78:0/1035035612 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342ad26b0 msgr2=0x55d342eb13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.506+0000 7f82515d5640 1 --2- 172.21.15.78:0/1035035612 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342ad26b0 0x55d342eb13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.506+0000 7f82515d5640 1 -- 172.21.15.78:0/1035035612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342aca4d0 msgr2=0x55d342f597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.506+0000 7f82515d5640 1 --2- 172.21.15.78:0/1035035612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342aca4d0 0x55d342f597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.506+0000 7f82515d5640 1 -- 172.21.15.78:0/1035035612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d342ef3ba0 con 0x55d342af3390 2024-09-17T03:15:15.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.506+0000 7f8250dd4640 1 --2- 172.21.15.78:0/1035035612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342aca4d0 0x55d342f597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:15.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.507+0000 7f82515d5640 1 --2- 172.21.15.78:0/1035035612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342af3390 0x55d342eb1920 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f8244015d10 tx=0x7f8244015460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77f44cfcb19c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.507+0000 7f822b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:15.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.507+0000 7f822b7fe640 1 -- 172.21.15.78:0/1035035612 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824402d060 con 0x55d342af3390 2024-09-17T03:15:15.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.507+0000 7f822b7fe640 1 -- 172.21.15.78:0/1035035612 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f8244028640 con 0x55d342af3390 2024-09-17T03:15:15.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.507+0000 7f825a085740 1 -- 172.21.15.78:0/1035035612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f823c00ed90 con 0x55d342af3390 2024-09-17T03:15:15.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.507+0000 7f822b7fe640 1 -- 172.21.15.78:0/1035035612 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f8244033050 con 0x55d342af3390 2024-09-17T03:15:15.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.507+0000 7f825a085740 10 client.8805 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:15.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.507+0000 7f825a085740 1 -- 172.21.15.78:0/1035035612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x55d342f59d90 con 0x55d342af3390 2024-09-17T03:15:15.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.507+0000 7f822b7fe640 1 -- 172.21.15.78:0/1035035612 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f823c00ed90 con 0x55d342af3390 2024-09-17T03:15:15.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.507+0000 7f822b7fe640 1 -- 172.21.15.78:0/1035035612 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7f8244036020 con 0x55d342af3390 2024-09-17T03:15:15.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.507+0000 7f825a085740 10 client.8805 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:15.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.507+0000 7f825a085740 10 client.8805 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2024-09-17T03:15:15.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.507+0000 7f825a085740 20 client.8805 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:15.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.507+0000 7f825a085740 1 --2- 172.21.15.78:0/1035035612 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x55d342f62ea0 0x55d342f669b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.507+0000 7f825a085740 4 client.8805 mds_command: new command op to 8283 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:15:15.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.507+0000 7f825a085740 1 -- 172.21.15.78:0/1035035612 --> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d342e0b460 con 0x55d342f62ea0 2024-09-17T03:15:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.507+0000 7f8250dd4640 1 --2- 172.21.15.78:0/1035035612 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x55d342f62ea0 0x55d342f669b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.508+0000 7f822b7fe640 10 client.8805 ms_handle_connect on v2:172.21.15.78:6832/1810198137 2024-09-17T03:15:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.508+0000 7f8250dd4640 1 --2- 172.21.15.78:0/1035035612 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x55d342f62ea0 0x55d342f669b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=78e7c3cf8c338cbe server_cookie=db49af0217de4fa6 in_seq=0 out_seq=0 2024-09-17T03:15:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.508+0000 7f822b7fe640 1 -- 172.21.15.78:0/1035035612 <== mds.1 v2:172.21.15.78:6832/1810198137 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x55d342e0b460 con 0x55d342f62ea0 2024-09-17T03:15:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.508+0000 7f822b7fe640 10 client.8805 handle_command_reply: tid=0 2024-09-17T03:15:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.508+0000 7f825a085740 1 client.8805 shutdown 2024-09-17T03:15:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.508+0000 7f825a085740 1 -- 172.21.15.78:0/1035035612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342af3390 msgr2=0x55d342eb1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.508+0000 7f825a085740 1 --2- 172.21.15.78:0/1035035612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342af3390 0x55d342eb1920 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f8244015d10 tx=0x7f8244015460 comp rx=0 tx=0).stop 2024-09-17T03:15:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.508+0000 7f825a085740 1 -- 172.21.15.78:0/1035035612 shutdown_connections 2024-09-17T03:15:15.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.508+0000 7f825a085740 1 --2- 172.21.15.78:0/1035035612 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x55d342f62ea0 0x55d342f669b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.508+0000 7f825a085740 1 --2- 172.21.15.78:0/1035035612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55d342af3390 0x55d342eb1920 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.508+0000 7f825a085740 1 --2- 172.21.15.78:0/1035035612 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55d342ad26b0 0x55d342eb13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.508+0000 7f825a085740 1 --2- 172.21.15.78:0/1035035612 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55d342aca4d0 0x55d342f597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.508+0000 7f822b7fe640 0 client.8805 ms_handle_reset on v2:172.21.15.78:6832/1810198137 2024-09-17T03:15:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.508+0000 7f825a085740 1 -- 172.21.15.78:0/1035035612 >> 172.21.15.78:0/1035035612 conn(0x55d342ae74e0 msgr2=0x55d342eb45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.508+0000 7f825a085740 1 -- 172.21.15.78:0/1035035612 shutdown_connections 2024-09-17T03:15:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.508+0000 7f825a085740 1 -- 172.21.15.78:0/1035035612 wait complete. 2024-09-17T03:15:15.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.509+0000 7f825a085740 20 client.8805 trim_cache size 0 max 16384 2024-09-17T03:15:15.519 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:15.519 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-17T03:15:15.520 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:15:15.520 INFO:teuthology.orchestra.run.smithi078.stdout: "0d177712-01a0-4dfb-8f16-2e7c84183356": { 2024-09-17T03:15:15.520 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:15:15.520 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "0d177712-01a0-4dfb-8f16-2e7c84183356", 2024-09-17T03:15:15.520 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:15:15.520 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:15.520 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:15.521 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:15.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.509+0000 7f8253038640 1 -- 172.21.15.78:0/1109812382 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8238078bc0 msgr2=0x7f823807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.509+0000 7f8253038640 1 --2- 172.21.15.78:0/1109812382 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8238078bc0 0x7f823807b0d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f823c0098e0 tx=0x7f823c009060 comp rx=0 tx=0).stop 2024-09-17T03:15:15.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.509+0000 7f8253038640 1 -- 172.21.15.78:0/1109812382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f824c0b2fb0 msgr2=0x7f824c1537f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.509+0000 7f8253038640 1 --2- 172.21.15.78:0/1109812382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f824c0b2fb0 0x7f824c1537f0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f8240005fd0 tx=0x7f8240003f90 comp rx=0 tx=0).stop 2024-09-17T03:15:15.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.509+0000 7f8253038640 1 -- 172.21.15.78:0/1109812382 shutdown_connections 2024-09-17T03:15:15.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.509+0000 7f8253038640 1 --2- 172.21.15.78:0/1109812382 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f824c15b830 0x7f824c15def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.509+0000 7f8253038640 1 --2- 172.21.15.78:0/1109812382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f824c0b2fb0 0x7f824c1537f0 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.509+0000 7f8253038640 1 --2- 172.21.15.78:0/1109812382 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8238078bc0 0x7f823807b0d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.509+0000 7f8253038640 1 --2- 172.21.15.78:0/1109812382 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f824c06ffa0 0x7f824c1447c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.509+0000 7f8253038640 1 -- 172.21.15.78:0/1109812382 >> 172.21.15.78:0/1109812382 conn(0x7f824c06d7d0 msgr2=0x7f824c0af500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.509+0000 7f8253038640 1 -- 172.21.15.78:0/1109812382 shutdown_connections 2024-09-17T03:15:15.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.509+0000 7f8253038640 1 -- 172.21.15.78:0/1109812382 wait complete. 2024-09-17T03:15:15.524 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:15:15.524 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:15:15.525 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:2 scrub status 2024-09-17T03:15:15.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.641+0000 7fe3a9a3f640 1 -- 172.21.15.78:0/2110329205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a40b64e0 msgr2=0x7fe3a40d25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.641+0000 7fe3a9a3f640 1 --2- 172.21.15.78:0/2110329205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a40b64e0 0x7fe3a40d25b0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fe3a408cab0 tx=0x7fe39c02a8f0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.641+0000 7fe3a9a3f640 1 -- 172.21.15.78:0/2110329205 shutdown_connections 2024-09-17T03:15:15.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.641+0000 7fe3a9a3f640 1 --2- 172.21.15.78:0/2110329205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a40b64e0 0x7fe3a40d25b0 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.641+0000 7fe3a9a3f640 1 --2- 172.21.15.78:0/2110329205 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe3a40cf540 0x7fe3a40b5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.641+0000 7fe3a9a3f640 1 --2- 172.21.15.78:0/2110329205 >> v2:172.21.15.193:3300/0 conn(0x7fe3a40b9b60 0x7fe3a40d4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.641+0000 7fe3a9a3f640 1 -- 172.21.15.78:0/2110329205 >> 172.21.15.78:0/2110329205 conn(0x7fe3a409d7f0 msgr2=0x7fe3a40d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.641+0000 7fe3a9a3f640 1 -- 172.21.15.78:0/2110329205 shutdown_connections 2024-09-17T03:15:15.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.641+0000 7fe3a9a3f640 1 -- 172.21.15.78:0/2110329205 wait complete. 2024-09-17T03:15:15.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.643+0000 7fe3a9a3f640 1 Processor -- start 2024-09-17T03:15:15.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.643+0000 7fe3a9a3f640 1 -- start start 2024-09-17T03:15:15.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.644+0000 7fe3a9a3f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3a40b64e0 0x7fe3a40c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.644+0000 7fe3a9a3f640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe3a40b9b60 0x7fe3a41603c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.644+0000 7fe3a9a3f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a40cf540 0x7fe3a4160900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.644+0000 7fe3a9a3f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a40d2f90 con 0x7fe3a40cf540 2024-09-17T03:15:15.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.644+0000 7fe3a9a3f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a40d2e10 con 0x7fe3a40b64e0 2024-09-17T03:15:15.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.644+0000 7fe3a9a3f640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a40d3110 con 0x7fe3a40b9b60 2024-09-17T03:15:15.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.644+0000 7fe3a37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a40cf540 0x7fe3a4160900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.644+0000 7fe3a37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a40cf540 0x7fe3a4160900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51206/0 (socket says 172.21.15.78:51206) 2024-09-17T03:15:15.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.644+0000 7fe3a37fe640 1 -- 172.21.15.78:0/1272117924 learned_addr learned my addr 172.21.15.78:0/1272117924 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.644+0000 7fe39a7fc640 1 --2- 172.21.15.78:0/1272117924 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe3a40b9b60 0x7fe3a41603c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.644+0000 7fe3a2ffd640 1 --2- 172.21.15.78:0/1272117924 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3a40b64e0 0x7fe3a40c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.644+0000 7fe3a37fe640 1 -- 172.21.15.78:0/1272117924 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe3a40b9b60 msgr2=0x7fe3a41603c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.644+0000 7fe3a37fe640 1 --2- 172.21.15.78:0/1272117924 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe3a40b9b60 0x7fe3a41603c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.644+0000 7fe3a37fe640 1 -- 172.21.15.78:0/1272117924 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3a40b64e0 msgr2=0x7fe3a40c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.644+0000 7fe3a37fe640 1 --2- 172.21.15.78:0/1272117924 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3a40b64e0 0x7fe3a40c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.644+0000 7fe3a37fe640 1 -- 172.21.15.78:0/1272117924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a409ea70 con 0x7fe3a40cf540 2024-09-17T03:15:15.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.645+0000 7fe3a37fe640 1 --2- 172.21.15.78:0/1272117924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a40cf540 0x7fe3a4160900 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fe39c033040 tx=0x7fe39c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.645+0000 7fe3a0ff9640 1 -- 172.21.15.78:0/1272117924 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c004240 con 0x7fe3a40cf540 2024-09-17T03:15:15.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.645+0000 7fe3a0ff9640 1 -- 172.21.15.78:0/1272117924 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe39c02d070 con 0x7fe3a40cf540 2024-09-17T03:15:15.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.645+0000 7fe3a0ff9640 1 -- 172.21.15.78:0/1272117924 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0046a0 con 0x7fe3a40cf540 2024-09-17T03:15:15.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.645+0000 7fe3a9a3f640 1 -- 172.21.15.78:0/1272117924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a41f5950 con 0x7fe3a40cf540 2024-09-17T03:15:15.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.645+0000 7fe3a9a3f640 1 -- 172.21.15.78:0/1272117924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a41f5f10 con 0x7fe3a40cf540 2024-09-17T03:15:15.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.647+0000 7fe3a0ff9640 1 -- 172.21.15.78:0/1272117924 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe39c031480 con 0x7fe3a40cf540 2024-09-17T03:15:15.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.647+0000 7fe3a0ff9640 1 --2- 172.21.15.78:0/1272117924 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe384078b90 0x7fe38407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.647+0000 7fe3a0ff9640 1 -- 172.21.15.78:0/1272117924 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fe39c0bc730 con 0x7fe3a40cf540 2024-09-17T03:15:15.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.647+0000 7fe3a2ffd640 1 --2- 172.21.15.78:0/1272117924 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe384078b90 0x7fe38407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.648+0000 7fe3b0a8a740 1 Processor -- start 2024-09-17T03:15:15.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.648+0000 7fe3a2ffd640 1 --2- 172.21.15.78:0/1272117924 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe384078b90 0x7fe38407b0a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe394005da0 tx=0x7fe394005cf0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.648+0000 7fe3b0a8a740 1 -- start start 2024-09-17T03:15:15.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.649+0000 7fe3b0a8a740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5652be78f390 0x5652beb7ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.649+0000 7fe3b0a8a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be7664d0 0x5652beb50860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.649+0000 7fe3b0a8a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652be76e6b0 0x5652beb50da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.649+0000 7fe3b0a8a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5652beaa9a60 con 0x5652be7664d0 2024-09-17T03:15:15.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.649+0000 7fe3b0a8a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5652bea98e90 con 0x5652be76e6b0 2024-09-17T03:15:15.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.649+0000 7fe3b0a8a740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5652bea9cca0 con 0x5652be78f390 2024-09-17T03:15:15.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.649+0000 7fe39a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be7664d0 0x5652beb50860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.649+0000 7fe39a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be7664d0 0x5652beb50860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51212/0 (socket says 172.21.15.78:51212) 2024-09-17T03:15:15.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.649+0000 7fe39a7fc640 1 -- 172.21.15.78:0/3492190599 learned_addr learned my addr 172.21.15.78:0/3492190599 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.650+0000 7fe3a2ffd640 1 --2- 172.21.15.78:0/3492190599 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5652be78f390 0x5652beb7ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.650+0000 7fe3a37fe640 1 --2- 172.21.15.78:0/3492190599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652be76e6b0 0x5652beb50da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.650+0000 7fe39a7fc640 1 -- 172.21.15.78:0/3492190599 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5652be78f390 msgr2=0x5652beb7ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.650+0000 7fe39a7fc640 1 --2- 172.21.15.78:0/3492190599 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5652be78f390 0x5652beb7ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.650+0000 7fe39a7fc640 1 -- 172.21.15.78:0/3492190599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652be76e6b0 msgr2=0x5652beb50da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.650+0000 7fe39a7fc640 1 --2- 172.21.15.78:0/3492190599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652be76e6b0 0x5652beb50da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.650+0000 7fe39a7fc640 1 -- 172.21.15.78:0/3492190599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652be8717d0 con 0x5652be7664d0 2024-09-17T03:15:15.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.650+0000 7fe39a7fc640 1 --2- 172.21.15.78:0/3492190599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be7664d0 0x5652beb50860 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00cba0 tx=0x7fe38c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5d26d41bcc06b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.650+0000 7fe3997fa640 1 -- 172.21.15.78:0/3492190599 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c00cea0 con 0x5652be7664d0 2024-09-17T03:15:15.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.650+0000 7fe3997fa640 1 -- 172.21.15.78:0/3492190599 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe38c010630 con 0x5652be7664d0 2024-09-17T03:15:15.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.650+0000 7fe3997fa640 1 -- 172.21.15.78:0/3492190599 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c010a80 con 0x5652be7664d0 2024-09-17T03:15:15.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.651+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/3492190599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be7664d0 msgr2=0x5652beb50860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.651+0000 7fe3b0a8a740 1 --2- 172.21.15.78:0/3492190599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be7664d0 0x5652beb50860 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00cba0 tx=0x7fe38c00e720 comp rx=0 tx=0).stop 2024-09-17T03:15:15.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.651+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/3492190599 shutdown_connections 2024-09-17T03:15:15.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.651+0000 7fe3b0a8a740 1 --2- 172.21.15.78:0/3492190599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652be76e6b0 0x5652beb50da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.651+0000 7fe3b0a8a740 1 --2- 172.21.15.78:0/3492190599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be7664d0 0x5652beb50860 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.651+0000 7fe3b0a8a740 1 --2- 172.21.15.78:0/3492190599 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5652be78f390 0x5652beb7ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.651+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/3492190599 >> 172.21.15.78:0/3492190599 conn(0x5652be7834e0 msgr2=0x5652beb36d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.651+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/3492190599 shutdown_connections 2024-09-17T03:15:15.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.651+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/3492190599 wait complete. 2024-09-17T03:15:15.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.652+0000 7fe3b0a8a740 1 -- start start 2024-09-17T03:15:15.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.652+0000 7fe3b0a8a740 1 Processor -- start 2024-09-17T03:15:15.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.653+0000 7fe3b0a8a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652be7664d0 0x5652beb75540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.653+0000 7fe3b0a8a740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5652be76e6b0 0x5652beb71950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.653+0000 7fe3b0a8a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be78f390 0x5652beb4e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.653+0000 7fe3b0a8a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5652be809740 con 0x5652be78f390 2024-09-17T03:15:15.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.653+0000 7fe3b0a8a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5652bea3e970 con 0x5652be7664d0 2024-09-17T03:15:15.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.653+0000 7fe3b0a8a740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5652beb60e90 con 0x5652be76e6b0 2024-09-17T03:15:15.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.653+0000 7fe3b0a8a740 10 client.0 _ll_register_callbacks cb 0x5652bea4d780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:15.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.654+0000 7fe3a37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be78f390 0x5652beb4e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.654+0000 7fe3a37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be78f390 0x5652beb4e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51224/0 (socket says 172.21.15.78:51224) 2024-09-17T03:15:15.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.654+0000 7fe3a37fe640 1 -- 172.21.15.78:0/981496922 learned_addr learned my addr 172.21.15.78:0/981496922 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.654+0000 7fe39a7fc640 1 --2- 172.21.15.78:0/981496922 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5652be76e6b0 0x5652beb71950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.654+0000 7fe3a2ffd640 1 --2- 172.21.15.78:0/981496922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652be7664d0 0x5652beb75540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.654+0000 7fe3a37fe640 1 -- 172.21.15.78:0/981496922 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5652be76e6b0 msgr2=0x5652beb71950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.654+0000 7fe3a37fe640 1 --2- 172.21.15.78:0/981496922 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5652be76e6b0 0x5652beb71950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.654+0000 7fe3a37fe640 1 -- 172.21.15.78:0/981496922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652be7664d0 msgr2=0x5652beb75540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.654+0000 7fe3a37fe640 1 --2- 172.21.15.78:0/981496922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652be7664d0 0x5652beb75540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.654+0000 7fe3a37fe640 1 -- 172.21.15.78:0/981496922 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652be7fa970 con 0x5652be78f390 2024-09-17T03:15:15.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.654+0000 7fe3a2ffd640 1 --2- 172.21.15.78:0/981496922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652be7664d0 0x5652beb75540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:15.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.654+0000 7fe3a37fe640 1 --2- 172.21.15.78:0/981496922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be78f390 0x5652beb4e340 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fe39c009d60 tx=0x7fe39c009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc3287f66231d2b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.654+0000 7fe3827fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:15.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.654+0000 7fe3827fc640 1 -- 172.21.15.78:0/981496922 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0aa020 con 0x5652be78f390 2024-09-17T03:15:15.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.654+0000 7fe3827fc640 1 -- 172.21.15.78:0/981496922 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fe39c0848e0 con 0x5652be78f390 2024-09-17T03:15:15.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.654+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/981496922 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe38c010630 con 0x5652be78f390 2024-09-17T03:15:15.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.654+0000 7fe3827fc640 1 -- 172.21.15.78:0/981496922 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7fe39c0a3050 con 0x5652be78f390 2024-09-17T03:15:15.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.654+0000 7fe3b0a8a740 10 client.8817 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:15.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.654+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/981496922 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x5652be7d86a0 con 0x5652be78f390 2024-09-17T03:15:15.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.654+0000 7fe3827fc640 1 -- 172.21.15.78:0/981496922 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe38c010630 con 0x5652be78f390 2024-09-17T03:15:15.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.655+0000 7fe3827fc640 1 -- 172.21.15.78:0/981496922 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7fe39c08d980 con 0x5652be78f390 2024-09-17T03:15:15.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.655+0000 7fe3b0a8a740 10 client.8817 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:15.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.655+0000 7fe3b0a8a740 10 client.8817 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.d 2024-09-17T03:15:15.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.655+0000 7fe3b0a8a740 20 client.8817 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:15.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.655+0000 7fe3b0a8a740 1 --2- 172.21.15.78:0/981496922 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x5652be74df60 0x5652beb765b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.655+0000 7fe3b0a8a740 4 client.8817 mds_command: new command op to 7213 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:15.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.655+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/981496922 --> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652beaab9b0 con 0x5652be74df60 2024-09-17T03:15:15.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.655+0000 7fe3a2ffd640 1 --2- 172.21.15.78:0/981496922 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x5652be74df60 0x5652beb765b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.655+0000 7fe3a2ffd640 1 --2- 172.21.15.78:0/981496922 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x5652be74df60 0x5652beb765b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2cb84ec9bd9893ea server_cookie=f0cf235f9aff6b3 in_seq=0 out_seq=0 2024-09-17T03:15:15.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.655+0000 7fe3827fc640 10 client.8817 ms_handle_connect on v2:172.21.15.193:6835/2983826871 2024-09-17T03:15:15.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.656+0000 7fe3827fc640 1 -- 172.21.15.78:0/981496922 <== mds.2 v2:172.21.15.193:6835/2983826871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5652beaab9b0 con 0x5652be74df60 2024-09-17T03:15:15.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.656+0000 7fe3827fc640 10 client.8817 handle_command_reply: tid=0 2024-09-17T03:15:15.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.656+0000 7fe3b0a8a740 1 client.8817 shutdown 2024-09-17T03:15:15.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.656+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/981496922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be78f390 msgr2=0x5652beb4e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.656+0000 7fe3b0a8a740 1 --2- 172.21.15.78:0/981496922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be78f390 0x5652beb4e340 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fe39c009d60 tx=0x7fe39c009670 comp rx=0 tx=0).stop 2024-09-17T03:15:15.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.657+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/981496922 shutdown_connections 2024-09-17T03:15:15.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.657+0000 7fe3b0a8a740 1 --2- 172.21.15.78:0/981496922 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x5652be74df60 0x5652beb765b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.657+0000 7fe3b0a8a740 1 --2- 172.21.15.78:0/981496922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be78f390 0x5652beb4e340 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.657+0000 7fe3827fc640 0 client.8817 ms_handle_reset on v2:172.21.15.193:6835/2983826871 2024-09-17T03:15:15.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.657+0000 7fe3b0a8a740 1 --2- 172.21.15.78:0/981496922 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5652be76e6b0 0x5652beb71950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.657+0000 7fe3b0a8a740 1 --2- 172.21.15.78:0/981496922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652be7664d0 0x5652beb75540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.657+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/981496922 >> 172.21.15.78:0/981496922 conn(0x5652be7834e0 msgr2=0x5652beb50d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.657+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/981496922 shutdown_connections 2024-09-17T03:15:15.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.657+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/981496922 wait complete. 2024-09-17T03:15:15.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.657+0000 7fe3b0a8a740 20 client.8817 trim_cache size 0 max 16384 2024-09-17T03:15:15.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.674+0000 7fe3b0a8a740 1 Processor -- start 2024-09-17T03:15:15.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.674+0000 7fe3b0a8a740 1 -- start start 2024-09-17T03:15:15.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.675+0000 7fe3b0a8a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652be7664d0 0x5652beb9f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.675+0000 7fe3b0a8a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be76e6b0 0x5652beb31a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.675+0000 7fe3b0a8a740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5652be78f390 0x5652beb31f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.675+0000 7fe3b0a8a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a4202150 con 0x5652be76e6b0 2024-09-17T03:15:15.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.675+0000 7fe3b0a8a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a4201330 con 0x5652be7664d0 2024-09-17T03:15:15.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.675+0000 7fe3b0a8a740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a4201a20 con 0x5652be78f390 2024-09-17T03:15:15.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.676+0000 7fe39a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be76e6b0 0x5652beb31a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.676+0000 7fe39a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be76e6b0 0x5652beb31a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51228/0 (socket says 172.21.15.78:51228) 2024-09-17T03:15:15.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.676+0000 7fe39a7fc640 1 -- 172.21.15.78:0/864939610 learned_addr learned my addr 172.21.15.78:0/864939610 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.676+0000 7fe39a7fc640 1 -- 172.21.15.78:0/864939610 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5652be78f390 msgr2=0x5652beb31f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.676+0000 7fe39a7fc640 1 --2- 172.21.15.78:0/864939610 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5652be78f390 0x5652beb31f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.676+0000 7fe39a7fc640 1 -- 172.21.15.78:0/864939610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652be7664d0 msgr2=0x5652beb9f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.676+0000 7fe39a7fc640 1 --2- 172.21.15.78:0/864939610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652be7664d0 0x5652beb9f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.676+0000 7fe39a7fc640 1 -- 172.21.15.78:0/864939610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652beb78570 con 0x5652be76e6b0 2024-09-17T03:15:15.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.676+0000 7fe39a7fc640 1 --2- 172.21.15.78:0/864939610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be76e6b0 0x5652beb31a20 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fe38c005d70 tx=0x7fe38c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a773b0f09ec4f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.676+0000 7fe398ff9640 1 -- 172.21.15.78:0/864939610 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c029070 con 0x5652be76e6b0 2024-09-17T03:15:15.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.676+0000 7fe398ff9640 1 -- 172.21.15.78:0/864939610 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe38c004240 con 0x5652be76e6b0 2024-09-17T03:15:15.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.676+0000 7fe398ff9640 1 -- 172.21.15.78:0/864939610 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0035f0 con 0x5652be76e6b0 2024-09-17T03:15:15.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.677+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/864939610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be76e6b0 msgr2=0x5652beb31a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.677+0000 7fe3b0a8a740 1 --2- 172.21.15.78:0/864939610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be76e6b0 0x5652beb31a20 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fe38c005d70 tx=0x7fe38c004730 comp rx=0 tx=0).stop 2024-09-17T03:15:15.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.677+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/864939610 shutdown_connections 2024-09-17T03:15:15.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.677+0000 7fe3b0a8a740 1 --2- 172.21.15.78:0/864939610 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5652be78f390 0x5652beb31f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.677+0000 7fe3b0a8a740 1 --2- 172.21.15.78:0/864939610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be76e6b0 0x5652beb31a20 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.677+0000 7fe3b0a8a740 1 --2- 172.21.15.78:0/864939610 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652be7664d0 0x5652beb9f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.677+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/864939610 >> 172.21.15.78:0/864939610 conn(0x5652be7834e0 msgr2=0x5652beb37ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.677+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/864939610 shutdown_connections 2024-09-17T03:15:15.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.677+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/864939610 wait complete. 2024-09-17T03:15:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.678+0000 7fe3b0a8a740 1 -- start start 2024-09-17T03:15:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.678+0000 7fe3b0a8a740 1 Processor -- start 2024-09-17T03:15:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.679+0000 7fe3b0a8a740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5652be7664d0 0x5652bebf9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.679+0000 7fe3b0a8a740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652be76e6b0 0x5652beb748f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.679+0000 7fe3b0a8a740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be78f390 0x5652beb7dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.679+0000 7fe3b0a8a740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a40ce2f0 con 0x5652be78f390 2024-09-17T03:15:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.679+0000 7fe3b0a8a740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5652bebfbf00 con 0x5652be76e6b0 2024-09-17T03:15:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.679+0000 7fe3b0a8a740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5652beb507a0 con 0x5652be7664d0 2024-09-17T03:15:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.679+0000 7fe3b0a8a740 10 client.0 _ll_register_callbacks cb 0x7fe39c0bc040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.679+0000 7fe3a37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be78f390 0x5652beb7dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.679+0000 7fe3a37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be78f390 0x5652beb7dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51240/0 (socket says 172.21.15.78:51240) 2024-09-17T03:15:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.679+0000 7fe3a37fe640 1 -- 172.21.15.78:0/3342666737 learned_addr learned my addr 172.21.15.78:0/3342666737 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.679+0000 7fe3a2ffd640 1 --2- 172.21.15.78:0/3342666737 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5652be7664d0 0x5652bebf9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe39a7fc640 1 --2- 172.21.15.78:0/3342666737 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652be76e6b0 0x5652beb748f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3a37fe640 1 -- 172.21.15.78:0/3342666737 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5652be7664d0 msgr2=0x5652bebf9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3a37fe640 1 --2- 172.21.15.78:0/3342666737 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5652be7664d0 0x5652bebf9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3a37fe640 1 -- 172.21.15.78:0/3342666737 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652be76e6b0 msgr2=0x5652beb748f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3a37fe640 1 --2- 172.21.15.78:0/3342666737 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652be76e6b0 0x5652beb748f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3a37fe640 1 -- 172.21.15.78:0/3342666737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652beb50580 con 0x5652be78f390 2024-09-17T03:15:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3a37fe640 1 --2- 172.21.15.78:0/3342666737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be78f390 0x5652beb7dbc0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fe39c084410 tx=0x7fe39c080b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de1649b99a46067 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3827fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3827fc640 1 -- 172.21.15.78:0/3342666737 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0aa030 con 0x5652be78f390 2024-09-17T03:15:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3827fc640 1 -- 172.21.15.78:0/3342666737 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fe39c004b40 con 0x5652be78f390 2024-09-17T03:15:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/3342666737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe38c004240 con 0x5652be78f390 2024-09-17T03:15:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3827fc640 1 -- 172.21.15.78:0/3342666737 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7fe39c083bf0 con 0x5652be78f390 2024-09-17T03:15:15.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3b0a8a740 10 client.8823 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:15.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/3342666737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x5652beb5eab0 con 0x5652be78f390 2024-09-17T03:15:15.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3827fc640 1 -- 172.21.15.78:0/3342666737 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe38c004240 con 0x5652be78f390 2024-09-17T03:15:15.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3827fc640 1 -- 172.21.15.78:0/3342666737 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7fe39c09a080 con 0x5652be78f390 2024-09-17T03:15:15.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3b0a8a740 10 client.8823 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:15.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3b0a8a740 10 client.8823 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.d 2024-09-17T03:15:15.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3b0a8a740 20 client.8823 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:15.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3b0a8a740 1 --2- 172.21.15.78:0/3342666737 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x5652beb74e30 0x5652beb7e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3b0a8a740 4 client.8823 mds_command: new command op to 7213 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:15:15.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.680+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/3342666737 --> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5652beaa7460 con 0x5652beb74e30 2024-09-17T03:15:15.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.681+0000 7fe3a2ffd640 1 --2- 172.21.15.78:0/3342666737 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x5652beb74e30 0x5652beb7e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.681+0000 7fe3827fc640 10 client.8823 ms_handle_connect on v2:172.21.15.193:6835/2983826871 2024-09-17T03:15:15.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.681+0000 7fe3a2ffd640 1 --2- 172.21.15.78:0/3342666737 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x5652beb74e30 0x5652beb7e100 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eb9fb57c560cef51 server_cookie=e40c5b9cbe774ccb in_seq=0 out_seq=0 2024-09-17T03:15:15.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.681+0000 7fe3827fc640 1 -- 172.21.15.78:0/3342666737 <== mds.2 v2:172.21.15.193:6835/2983826871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x5652beaa7460 con 0x5652beb74e30 2024-09-17T03:15:15.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.681+0000 7fe3827fc640 10 client.8823 handle_command_reply: tid=0 2024-09-17T03:15:15.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.681+0000 7fe3b0a8a740 1 client.8823 shutdown 2024-09-17T03:15:15.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.681+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/3342666737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be78f390 msgr2=0x5652beb7dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.681+0000 7fe3b0a8a740 1 --2- 172.21.15.78:0/3342666737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be78f390 0x5652beb7dbc0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fe39c084410 tx=0x7fe39c080b40 comp rx=0 tx=0).stop 2024-09-17T03:15:15.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.681+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/3342666737 shutdown_connections 2024-09-17T03:15:15.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.681+0000 7fe3b0a8a740 1 --2- 172.21.15.78:0/3342666737 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x5652beb74e30 0x5652beb7e100 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.681+0000 7fe3b0a8a740 1 --2- 172.21.15.78:0/3342666737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5652be78f390 0x5652beb7dbc0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.681+0000 7fe3b0a8a740 1 --2- 172.21.15.78:0/3342666737 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5652be76e6b0 0x5652beb748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.682+0000 7fe3827fc640 0 client.8823 ms_handle_reset on v2:172.21.15.193:6835/2983826871 2024-09-17T03:15:15.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.682+0000 7fe3b0a8a740 1 --2- 172.21.15.78:0/3342666737 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5652be7664d0 0x5652bebf9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.682+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/3342666737 >> 172.21.15.78:0/3342666737 conn(0x5652be7834e0 msgr2=0x5652beb7b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.682+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/3342666737 shutdown_connections 2024-09-17T03:15:15.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.682+0000 7fe3b0a8a740 1 -- 172.21.15.78:0/3342666737 wait complete. 2024-09-17T03:15:15.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.682+0000 7fe3b0a8a740 20 client.8823 trim_cache size 0 max 16384 2024-09-17T03:15:15.687 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:15.687 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-17T03:15:15.687 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:15:15.687 INFO:teuthology.orchestra.run.smithi078.stdout: "0d177712-01a0-4dfb-8f16-2e7c84183356": { 2024-09-17T03:15:15.688 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:15:15.688 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "0d177712-01a0-4dfb-8f16-2e7c84183356", 2024-09-17T03:15:15.688 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:15:15.688 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:15.688 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:15.688 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:15.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.682+0000 7fe3a9a3f640 1 -- 172.21.15.78:0/1272117924 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe384078b90 msgr2=0x7fe38407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.682+0000 7fe3a9a3f640 1 --2- 172.21.15.78:0/1272117924 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe384078b90 0x7fe38407b0a0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe394005da0 tx=0x7fe394005cf0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.682+0000 7fe3a9a3f640 1 -- 172.21.15.78:0/1272117924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a40cf540 msgr2=0x7fe3a4160900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.682+0000 7fe3a9a3f640 1 --2- 172.21.15.78:0/1272117924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a40cf540 0x7fe3a4160900 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fe39c033040 tx=0x7fe39c003c20 comp rx=0 tx=0).stop 2024-09-17T03:15:15.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.682+0000 7fe3a9a3f640 1 -- 172.21.15.78:0/1272117924 shutdown_connections 2024-09-17T03:15:15.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.682+0000 7fe3a9a3f640 1 --2- 172.21.15.78:0/1272117924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe3a40cf540 0x7fe3a4160900 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.682+0000 7fe3a9a3f640 1 --2- 172.21.15.78:0/1272117924 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe3a40b9b60 0x7fe3a41603c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.682+0000 7fe3a9a3f640 1 --2- 172.21.15.78:0/1272117924 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe384078b90 0x7fe38407b0a0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.682+0000 7fe3a9a3f640 1 --2- 172.21.15.78:0/1272117924 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe3a40b64e0 0x7fe3a40c9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.682+0000 7fe3a9a3f640 1 -- 172.21.15.78:0/1272117924 >> 172.21.15.78:0/1272117924 conn(0x7fe3a409d7f0 msgr2=0x7fe3a40b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.682+0000 7fe3a9a3f640 1 -- 172.21.15.78:0/1272117924 shutdown_connections 2024-09-17T03:15:15.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.682+0000 7fe3a9a3f640 1 -- 172.21.15.78:0/1272117924 wait complete. 2024-09-17T03:15:15.692 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:15:15.692 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:15:15.692 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-17T03:15:15.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.808+0000 7ff782a4a640 1 -- 172.21.15.78:0/1385006118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff77c072ff0 msgr2=0x7ff77c073400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.808+0000 7ff782a4a640 1 --2- 172.21.15.78:0/1385006118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff77c072ff0 0x7ff77c073400 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7ff77c072040 tx=0x7ff77402aa30 comp rx=0 tx=0).stop 2024-09-17T03:15:15.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.808+0000 7ff782a4a640 1 -- 172.21.15.78:0/1385006118 shutdown_connections 2024-09-17T03:15:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.808+0000 7ff782a4a640 1 --2- 172.21.15.78:0/1385006118 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff77c072ff0 0x7ff77c073400 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.808+0000 7ff782a4a640 1 --2- 172.21.15.78:0/1385006118 >> v2:172.21.15.193:3300/0 conn(0x7ff77c0af780 0x7ff77c0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.808+0000 7ff782a4a640 1 -- 172.21.15.78:0/1385006118 >> 172.21.15.78:0/1385006118 conn(0x7ff77c06d7d0 msgr2=0x7ff77c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.808+0000 7ff782a4a640 1 -- 172.21.15.78:0/1385006118 shutdown_connections 2024-09-17T03:15:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.808+0000 7ff782a4a640 1 -- 172.21.15.78:0/1385006118 wait complete. 2024-09-17T03:15:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.810+0000 7ff782a4a640 1 Processor -- start 2024-09-17T03:15:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.810+0000 7ff782a4a640 1 -- start start 2024-09-17T03:15:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.811+0000 7ff782a4a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff77c072ff0 0x7ff77c1523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.811+0000 7ff782a4a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff77c0af780 0x7ff77c09c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.811+0000 7ff782a4a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff77c0cd3e0 0x7ff77c1678e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.811+0000 7ff782a4a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c073cd0 con 0x7ff77c072ff0 2024-09-17T03:15:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.811+0000 7ff782a4a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c073b50 con 0x7ff77c0af780 2024-09-17T03:15:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.811+0000 7ff782a4a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff77c0cd9e0 con 0x7ff77c0cd3e0 2024-09-17T03:15:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.811+0000 7ff77bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff77c072ff0 0x7ff77c1523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.812+0000 7ff77bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff77c072ff0 0x7ff77c1523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51262/0 (socket says 172.21.15.78:51262) 2024-09-17T03:15:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.812+0000 7ff77bfff640 1 -- 172.21.15.78:0/452288019 learned_addr learned my addr 172.21.15.78:0/452288019 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.812+0000 7ff77b7fe640 1 --2- 172.21.15.78:0/452288019 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff77c0af780 0x7ff77c09c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.812+0000 7ff780fe7640 1 --2- 172.21.15.78:0/452288019 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff77c0cd3e0 0x7ff77c1678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.812+0000 7ff77bfff640 1 -- 172.21.15.78:0/452288019 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff77c0cd3e0 msgr2=0x7ff77c1678e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.812+0000 7ff77bfff640 1 --2- 172.21.15.78:0/452288019 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff77c0cd3e0 0x7ff77c1678e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.812+0000 7ff77bfff640 1 -- 172.21.15.78:0/452288019 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff77c0af780 msgr2=0x7ff77c09c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.812+0000 7ff77bfff640 1 --2- 172.21.15.78:0/452288019 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff77c0af780 0x7ff77c09c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.812+0000 7ff77bfff640 1 -- 172.21.15.78:0/452288019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77c165e00 con 0x7ff77c072ff0 2024-09-17T03:15:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.812+0000 7ff77b7fe640 1 --2- 172.21.15.78:0/452288019 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff77c0af780 0x7ff77c09c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.812+0000 7ff77bfff640 1 --2- 172.21.15.78:0/452288019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff77c072ff0 0x7ff77c1523e0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00c9a0 tx=0x7ff76c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.812+0000 7ff778ff9640 1 -- 172.21.15.78:0/452288019 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c007bb0 con 0x7ff77c072ff0 2024-09-17T03:15:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.812+0000 7ff778ff9640 1 -- 172.21.15.78:0/452288019 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff76c005020 con 0x7ff77c072ff0 2024-09-17T03:15:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.812+0000 7ff782a4a640 1 -- 172.21.15.78:0/452288019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff77c165b20 con 0x7ff77c072ff0 2024-09-17T03:15:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.812+0000 7ff778ff9640 1 -- 172.21.15.78:0/452288019 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c007e60 con 0x7ff77c072ff0 2024-09-17T03:15:15.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.812+0000 7ff782a4a640 1 -- 172.21.15.78:0/452288019 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff77c09adb0 con 0x7ff77c072ff0 2024-09-17T03:15:15.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.814+0000 7ff778ff9640 1 -- 172.21.15.78:0/452288019 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff76c005470 con 0x7ff77c072ff0 2024-09-17T03:15:15.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.815+0000 7ff778ff9640 1 --2- 172.21.15.78:0/452288019 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff768078b90 0x7ff76807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.815+0000 7ff778ff9640 1 -- 172.21.15.78:0/452288019 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7ff76c09b1d0 con 0x7ff77c072ff0 2024-09-17T03:15:15.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.815+0000 7ff77b7fe640 1 --2- 172.21.15.78:0/452288019 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff768078b90 0x7ff76807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.816+0000 7ff789a90740 1 Processor -- start 2024-09-17T03:15:15.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.816+0000 7ff77b7fe640 1 --2- 172.21.15.78:0/452288019 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff768078b90 0x7ff76807b0a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff770006fd0 tx=0x7ff770008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.816+0000 7ff789a90740 1 -- start start 2024-09-17T03:15:15.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.817+0000 7ff789a90740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594defa2390 0x5594df38ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.817+0000 7ff789a90740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def794d0 0x5594df363860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.817+0000 7ff789a90740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def816b0 0x5594df363da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.817+0000 7ff789a90740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5594df2bca60 con 0x5594def816b0 2024-09-17T03:15:15.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.817+0000 7ff789a90740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5594df2abe90 con 0x5594defa2390 2024-09-17T03:15:15.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.817+0000 7ff789a90740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5594df2afca0 con 0x5594def794d0 2024-09-17T03:15:15.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.817+0000 7ff780fe7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def816b0 0x5594df363da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.817+0000 7ff780fe7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def816b0 0x5594df363da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51272/0 (socket says 172.21.15.78:51272) 2024-09-17T03:15:15.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.817+0000 7ff780fe7640 1 -- 172.21.15.78:0/254494429 learned_addr learned my addr 172.21.15.78:0/254494429 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.817+0000 7ff77b7fe640 1 --2- 172.21.15.78:0/254494429 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def794d0 0x5594df363860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.817+0000 7ff77bfff640 1 --2- 172.21.15.78:0/254494429 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594defa2390 0x5594df38ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.817+0000 7ff780fe7640 1 -- 172.21.15.78:0/254494429 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def794d0 msgr2=0x5594df363860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.817+0000 7ff780fe7640 1 --2- 172.21.15.78:0/254494429 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def794d0 0x5594df363860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.817+0000 7ff780fe7640 1 -- 172.21.15.78:0/254494429 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594defa2390 msgr2=0x5594df38ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.817+0000 7ff780fe7640 1 --2- 172.21.15.78:0/254494429 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594defa2390 0x5594df38ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.817+0000 7ff780fe7640 1 -- 172.21.15.78:0/254494429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594df0847d0 con 0x5594def816b0 2024-09-17T03:15:15.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.818+0000 7ff780fe7640 1 --2- 172.21.15.78:0/254494429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def816b0 0x5594df363da0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7ff774005fd0 tx=0x7ff774004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4fea45d1feef60 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.818+0000 7ff761ffb640 1 -- 172.21.15.78:0/254494429 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff774033030 con 0x5594def816b0 2024-09-17T03:15:15.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.818+0000 7ff761ffb640 1 -- 172.21.15.78:0/254494429 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff77402fa80 con 0x5594def816b0 2024-09-17T03:15:15.818 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.818+0000 7ff761ffb640 1 -- 172.21.15.78:0/254494429 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff774003970 con 0x5594def816b0 2024-09-17T03:15:15.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.819+0000 7ff789a90740 1 -- 172.21.15.78:0/254494429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def816b0 msgr2=0x5594df363da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.819+0000 7ff789a90740 1 --2- 172.21.15.78:0/254494429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def816b0 0x5594df363da0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7ff774005fd0 tx=0x7ff774004a40 comp rx=0 tx=0).stop 2024-09-17T03:15:15.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.819+0000 7ff789a90740 1 -- 172.21.15.78:0/254494429 shutdown_connections 2024-09-17T03:15:15.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.819+0000 7ff789a90740 1 --2- 172.21.15.78:0/254494429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def816b0 0x5594df363da0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.819+0000 7ff789a90740 1 --2- 172.21.15.78:0/254494429 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def794d0 0x5594df363860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.819+0000 7ff789a90740 1 --2- 172.21.15.78:0/254494429 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594defa2390 0x5594df38ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.819+0000 7ff789a90740 1 -- 172.21.15.78:0/254494429 >> 172.21.15.78:0/254494429 conn(0x5594def964e0 msgr2=0x5594df349d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.819+0000 7ff789a90740 1 -- 172.21.15.78:0/254494429 shutdown_connections 2024-09-17T03:15:15.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.819+0000 7ff789a90740 1 -- 172.21.15.78:0/254494429 wait complete. 2024-09-17T03:15:15.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.820+0000 7ff789a90740 1 -- start start 2024-09-17T03:15:15.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.820+0000 7ff789a90740 1 Processor -- start 2024-09-17T03:15:15.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.821+0000 7ff789a90740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def794d0 0x5594df388930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.821+0000 7ff789a90740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def816b0 0x5594df361cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.821+0000 7ff789a90740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594defa2390 0x5594df372670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.821+0000 7ff789a90740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5594df01c740 con 0x5594def794d0 2024-09-17T03:15:15.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.821+0000 7ff789a90740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5594df251970 con 0x5594defa2390 2024-09-17T03:15:15.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.821+0000 7ff789a90740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5594df373470 con 0x5594def816b0 2024-09-17T03:15:15.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.821+0000 7ff789a90740 10 client.0 _ll_register_callbacks cb 0x5594df260780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:15.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.822+0000 7ff77bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def794d0 0x5594df388930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.822+0000 7ff77bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def794d0 0x5594df388930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51274/0 (socket says 172.21.15.78:51274) 2024-09-17T03:15:15.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.822+0000 7ff77bfff640 1 -- 172.21.15.78:0/894160922 learned_addr learned my addr 172.21.15.78:0/894160922 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.822+0000 7ff77b7fe640 1 --2- 172.21.15.78:0/894160922 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def816b0 0x5594df361cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.822+0000 7ff780fe7640 1 --2- 172.21.15.78:0/894160922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594defa2390 0x5594df372670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.822+0000 7ff77bfff640 1 -- 172.21.15.78:0/894160922 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def816b0 msgr2=0x5594df361cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.822+0000 7ff77bfff640 1 --2- 172.21.15.78:0/894160922 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def816b0 0x5594df361cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.822+0000 7ff77bfff640 1 -- 172.21.15.78:0/894160922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594defa2390 msgr2=0x5594df372670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.822+0000 7ff77bfff640 1 --2- 172.21.15.78:0/894160922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594defa2390 0x5594df372670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.822+0000 7ff77bfff640 1 -- 172.21.15.78:0/894160922 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594df00d970 con 0x5594def794d0 2024-09-17T03:15:15.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.822+0000 7ff780fe7640 1 --2- 172.21.15.78:0/894160922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594defa2390 0x5594df372670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:15.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.822+0000 7ff77bfff640 1 --2- 172.21.15.78:0/894160922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def794d0 0x5594df388930 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7ff76c062c10 tx=0x7ff76c063460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40da0831d138fbed server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.822+0000 7ff75affd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:15.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.822+0000 7ff75affd640 1 -- 172.21.15.78:0/894160922 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c01d050 con 0x5594def794d0 2024-09-17T03:15:15.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.822+0000 7ff75affd640 1 -- 172.21.15.78:0/894160922 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7ff76c04e380 con 0x5594def794d0 2024-09-17T03:15:15.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.822+0000 7ff789a90740 1 -- 172.21.15.78:0/894160922 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff77402fa80 con 0x5594def794d0 2024-09-17T03:15:15.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.822+0000 7ff75affd640 1 -- 172.21.15.78:0/894160922 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7ff76c062f10 con 0x5594def794d0 2024-09-17T03:15:15.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.822+0000 7ff789a90740 10 client.8835 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:15.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.822+0000 7ff789a90740 1 -- 172.21.15.78:0/894160922 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x5594defeb6a0 con 0x5594def794d0 2024-09-17T03:15:15.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.822+0000 7ff75affd640 1 -- 172.21.15.78:0/894160922 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff77402fa80 con 0x5594def794d0 2024-09-17T03:15:15.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.823+0000 7ff75affd640 1 -- 172.21.15.78:0/894160922 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7ff76c099b20 con 0x5594def794d0 2024-09-17T03:15:15.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.823+0000 7ff789a90740 10 client.8835 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:15.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.823+0000 7ff789a90740 10 client.8835 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T03:15:15.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.823+0000 7ff789a90740 20 client.8835 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:15.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.823+0000 7ff789a90740 1 --2- 172.21.15.78:0/894160922 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x5594def60f60 0x5594df372bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.823+0000 7ff789a90740 4 client.8835 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:15.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.823+0000 7ff789a90740 1 -- 172.21.15.78:0/894160922 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594df2be9b0 con 0x5594def60f60 2024-09-17T03:15:15.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.823+0000 7ff77b7fe640 1 --2- 172.21.15.78:0/894160922 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x5594def60f60 0x5594df372bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.823+0000 7ff75affd640 10 client.8835 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:15.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.823+0000 7ff77b7fe640 1 --2- 172.21.15.78:0/894160922 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x5594def60f60 0x5594df372bb0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53dd01e655dcdcc0 server_cookie=ececaec719de1faf in_seq=0 out_seq=0 2024-09-17T03:15:15.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.824+0000 7ff75affd640 1 -- 172.21.15.78:0/894160922 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5594df2be9b0 con 0x5594def60f60 2024-09-17T03:15:15.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.824+0000 7ff75affd640 10 client.8835 handle_command_reply: tid=0 2024-09-17T03:15:15.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.824+0000 7ff789a90740 1 client.8835 shutdown 2024-09-17T03:15:15.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.824+0000 7ff789a90740 1 -- 172.21.15.78:0/894160922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def794d0 msgr2=0x5594df388930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.824+0000 7ff789a90740 1 --2- 172.21.15.78:0/894160922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def794d0 0x5594df388930 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7ff76c062c10 tx=0x7ff76c063460 comp rx=0 tx=0).stop 2024-09-17T03:15:15.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.824+0000 7ff789a90740 1 -- 172.21.15.78:0/894160922 shutdown_connections 2024-09-17T03:15:15.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.824+0000 7ff789a90740 1 --2- 172.21.15.78:0/894160922 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x5594def60f60 0x5594df372bb0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.824+0000 7ff789a90740 1 --2- 172.21.15.78:0/894160922 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594defa2390 0x5594df372670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.824+0000 7ff789a90740 1 --2- 172.21.15.78:0/894160922 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def816b0 0x5594df361cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.824+0000 7ff75affd640 0 client.8835 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:15.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.824+0000 7ff789a90740 1 --2- 172.21.15.78:0/894160922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def794d0 0x5594df388930 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.824+0000 7ff789a90740 1 -- 172.21.15.78:0/894160922 >> 172.21.15.78:0/894160922 conn(0x5594def964e0 msgr2=0x5594df38de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.824+0000 7ff789a90740 1 -- 172.21.15.78:0/894160922 shutdown_connections 2024-09-17T03:15:15.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.824+0000 7ff789a90740 1 -- 172.21.15.78:0/894160922 wait complete. 2024-09-17T03:15:15.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.824+0000 7ff789a90740 20 client.8835 trim_cache size 0 max 16384 2024-09-17T03:15:15.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.842+0000 7ff789a90740 1 Processor -- start 2024-09-17T03:15:15.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.842+0000 7ff789a90740 1 -- start start 2024-09-17T03:15:15.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.843+0000 7ff789a90740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def794d0 0x5594df385b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.843+0000 7ff789a90740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def816b0 0x5594df382b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.843+0000 7ff789a90740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594defa2390 0x5594df383050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.843+0000 7ff789a90740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c202240 con 0x5594def794d0 2024-09-17T03:15:15.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.843+0000 7ff789a90740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c2013e0 con 0x5594defa2390 2024-09-17T03:15:15.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.843+0000 7ff789a90740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff77c201b10 con 0x5594def816b0 2024-09-17T03:15:15.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.843+0000 7ff77bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def794d0 0x5594df385b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.843+0000 7ff77bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def794d0 0x5594df385b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51276/0 (socket says 172.21.15.78:51276) 2024-09-17T03:15:15.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.843+0000 7ff77bfff640 1 -- 172.21.15.78:0/3773379599 learned_addr learned my addr 172.21.15.78:0/3773379599 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.844+0000 7ff77b7fe640 1 --2- 172.21.15.78:0/3773379599 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def816b0 0x5594df382b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.844+0000 7ff77bfff640 1 -- 172.21.15.78:0/3773379599 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def816b0 msgr2=0x5594df382b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.844+0000 7ff77bfff640 1 --2- 172.21.15.78:0/3773379599 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def816b0 0x5594df382b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.844+0000 7ff77bfff640 1 -- 172.21.15.78:0/3773379599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594defa2390 msgr2=0x5594df383050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.844+0000 7ff77bfff640 1 --2- 172.21.15.78:0/3773379599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594defa2390 0x5594df383050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.844+0000 7ff77bfff640 1 -- 172.21.15.78:0/3773379599 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594df347490 con 0x5594def794d0 2024-09-17T03:15:15.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.844+0000 7ff77b7fe640 1 --2- 172.21.15.78:0/3773379599 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def816b0 0x5594df382b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:15.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.844+0000 7ff77bfff640 1 --2- 172.21.15.78:0/3773379599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def794d0 0x5594df385b80 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00c970 tx=0x7ff76c0995d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ba6e10b83a5322 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.844+0000 7ff7617fa640 1 -- 172.21.15.78:0/3773379599 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c01d040 con 0x5594def794d0 2024-09-17T03:15:15.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.844+0000 7ff7617fa640 1 -- 172.21.15.78:0/3773379599 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff76c071070 con 0x5594def794d0 2024-09-17T03:15:15.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.844+0000 7ff7617fa640 1 -- 172.21.15.78:0/3773379599 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c099640 con 0x5594def794d0 2024-09-17T03:15:15.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.845+0000 7ff789a90740 1 -- 172.21.15.78:0/3773379599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def794d0 msgr2=0x5594df385b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.845+0000 7ff789a90740 1 --2- 172.21.15.78:0/3773379599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def794d0 0x5594df385b80 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00c970 tx=0x7ff76c0995d0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.845+0000 7ff789a90740 1 -- 172.21.15.78:0/3773379599 shutdown_connections 2024-09-17T03:15:15.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.845+0000 7ff789a90740 1 --2- 172.21.15.78:0/3773379599 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594defa2390 0x5594df383050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.845+0000 7ff789a90740 1 --2- 172.21.15.78:0/3773379599 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def816b0 0x5594df382b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.845+0000 7ff789a90740 1 --2- 172.21.15.78:0/3773379599 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594def794d0 0x5594df385b80 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.845+0000 7ff789a90740 1 -- 172.21.15.78:0/3773379599 >> 172.21.15.78:0/3773379599 conn(0x5594def964e0 msgr2=0x5594df373600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.845+0000 7ff789a90740 1 -- 172.21.15.78:0/3773379599 shutdown_connections 2024-09-17T03:15:15.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.845+0000 7ff789a90740 1 -- 172.21.15.78:0/3773379599 wait complete. 2024-09-17T03:15:15.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.845+0000 7ff789a90740 1 -- start start 2024-09-17T03:15:15.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.846+0000 7ff789a90740 1 Processor -- start 2024-09-17T03:15:15.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.847+0000 7ff789a90740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594def794d0 0x5594df4049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.847+0000 7ff789a90740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def816b0 0x5594df382b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.847+0000 7ff789a90740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594defa2390 0x5594df383050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.847+0000 7ff789a90740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5594df3b2360 con 0x5594defa2390 2024-09-17T03:15:15.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.847+0000 7ff789a90740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c164230 con 0x5594def794d0 2024-09-17T03:15:15.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.847+0000 7ff789a90740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5594df3902f0 con 0x5594def816b0 2024-09-17T03:15:15.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.847+0000 7ff789a90740 10 client.0 _ll_register_callbacks cb 0x7ff76c05ee60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:15.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.847+0000 7ff780fe7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594defa2390 0x5594df383050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.847+0000 7ff780fe7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594defa2390 0x5594df383050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51280/0 (socket says 172.21.15.78:51280) 2024-09-17T03:15:15.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.847+0000 7ff780fe7640 1 -- 172.21.15.78:0/1886238164 learned_addr learned my addr 172.21.15.78:0/1886238164 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.847+0000 7ff77b7fe640 1 --2- 172.21.15.78:0/1886238164 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def816b0 0x5594df382b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.847+0000 7ff77bfff640 1 --2- 172.21.15.78:0/1886238164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594def794d0 0x5594df4049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.847+0000 7ff780fe7640 1 -- 172.21.15.78:0/1886238164 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def816b0 msgr2=0x5594df382b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.847+0000 7ff780fe7640 1 --2- 172.21.15.78:0/1886238164 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def816b0 0x5594df382b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.847+0000 7ff780fe7640 1 -- 172.21.15.78:0/1886238164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594def794d0 msgr2=0x5594df4049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.847+0000 7ff780fe7640 1 --2- 172.21.15.78:0/1886238164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594def794d0 0x5594df4049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.848+0000 7ff780fe7640 1 -- 172.21.15.78:0/1886238164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594df346860 con 0x5594defa2390 2024-09-17T03:15:15.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.848+0000 7ff77bfff640 1 --2- 172.21.15.78:0/1886238164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594def794d0 0x5594df4049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:15.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.848+0000 7ff780fe7640 1 --2- 172.21.15.78:0/1886238164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594defa2390 0x5594df383050 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7ff774031000 tx=0x7ff77402af30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3197deab0d019c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.848+0000 7ff75affd640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:15.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.848+0000 7ff75affd640 1 -- 172.21.15.78:0/1886238164 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff774033070 con 0x5594defa2390 2024-09-17T03:15:15.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.848+0000 7ff75affd640 1 -- 172.21.15.78:0/1886238164 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7ff774003b80 con 0x5594defa2390 2024-09-17T03:15:15.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.848+0000 7ff789a90740 1 -- 172.21.15.78:0/1886238164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff76c071070 con 0x5594defa2390 2024-09-17T03:15:15.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.848+0000 7ff75affd640 1 -- 172.21.15.78:0/1886238164 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7ff774003da0 con 0x5594defa2390 2024-09-17T03:15:15.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.848+0000 7ff789a90740 10 client.8841 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:15.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.848+0000 7ff789a90740 1 -- 172.21.15.78:0/1886238164 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x5594df3a1000 con 0x5594defa2390 2024-09-17T03:15:15.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.848+0000 7ff75affd640 1 -- 172.21.15.78:0/1886238164 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff76c071070 con 0x5594defa2390 2024-09-17T03:15:15.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.848+0000 7ff75affd640 1 -- 172.21.15.78:0/1886238164 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7ff774004c30 con 0x5594defa2390 2024-09-17T03:15:15.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.848+0000 7ff789a90740 10 client.8841 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:15.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.848+0000 7ff789a90740 10 client.8841 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T03:15:15.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.848+0000 7ff789a90740 20 client.8841 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:15.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.848+0000 7ff789a90740 1 --2- 172.21.15.78:0/1886238164 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x5594df3962e0 0x5594df4114f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.848+0000 7ff789a90740 4 client.8841 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:15:15.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.848+0000 7ff789a90740 1 -- 172.21.15.78:0/1886238164 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5594df2ba460 con 0x5594df3962e0 2024-09-17T03:15:15.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.848+0000 7ff77bfff640 1 --2- 172.21.15.78:0/1886238164 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x5594df3962e0 0x5594df4114f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.849+0000 7ff75affd640 10 client.8841 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:15.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.849+0000 7ff77bfff640 1 --2- 172.21.15.78:0/1886238164 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x5594df3962e0 0x5594df4114f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4281cd58a59aefe6 server_cookie=f1468ebd597404e7 in_seq=0 out_seq=0 2024-09-17T03:15:15.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.849+0000 7ff75affd640 1 -- 172.21.15.78:0/1886238164 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x5594df2ba460 con 0x5594df3962e0 2024-09-17T03:15:15.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.849+0000 7ff75affd640 10 client.8841 handle_command_reply: tid=0 2024-09-17T03:15:15.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.849+0000 7ff789a90740 1 client.8841 shutdown 2024-09-17T03:15:15.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.849+0000 7ff789a90740 1 -- 172.21.15.78:0/1886238164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594defa2390 msgr2=0x5594df383050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.849+0000 7ff789a90740 1 --2- 172.21.15.78:0/1886238164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594defa2390 0x5594df383050 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7ff774031000 tx=0x7ff77402af30 comp rx=0 tx=0).stop 2024-09-17T03:15:15.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.849+0000 7ff789a90740 1 -- 172.21.15.78:0/1886238164 shutdown_connections 2024-09-17T03:15:15.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.849+0000 7ff789a90740 1 --2- 172.21.15.78:0/1886238164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5594defa2390 0x5594df383050 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.849+0000 7ff789a90740 1 --2- 172.21.15.78:0/1886238164 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5594def816b0 0x5594df382b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.849+0000 7ff789a90740 1 --2- 172.21.15.78:0/1886238164 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x5594df3962e0 0x5594df4114f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.849+0000 7ff789a90740 1 --2- 172.21.15.78:0/1886238164 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5594def794d0 0x5594df4049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.849+0000 7ff75affd640 0 client.8841 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:15.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.849+0000 7ff789a90740 1 -- 172.21.15.78:0/1886238164 >> 172.21.15.78:0/1886238164 conn(0x5594def964e0 msgr2=0x5594df372940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.850+0000 7ff789a90740 1 -- 172.21.15.78:0/1886238164 shutdown_connections 2024-09-17T03:15:15.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.850+0000 7ff789a90740 1 -- 172.21.15.78:0/1886238164 wait complete. 2024-09-17T03:15:15.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.850+0000 7ff789a90740 20 client.8841 trim_cache size 0 max 16384 2024-09-17T03:15:15.855 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:15.855 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-17T03:15:15.855 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:15:15.855 INFO:teuthology.orchestra.run.smithi078.stdout: "0d177712-01a0-4dfb-8f16-2e7c84183356": { 2024-09-17T03:15:15.856 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:15:15.856 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "0d177712-01a0-4dfb-8f16-2e7c84183356", 2024-09-17T03:15:15.856 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:15:15.856 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:15.856 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:15:15.856 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-17T03:15:15.856 INFO:teuthology.orchestra.run.smithi078.stdout: "0d177712-01a0-4dfb-8f16-2e7c84183356": { 2024-09-17T03:15:15.856 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-17T03:15:08.556658+0000", 2024-09-17T03:15:15.856 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:15:15.856 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-17T03:15:15.856 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-17T03:15:15.856 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-17T03:15:15.856 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-17T03:15:15.857 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:15.857 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:15.857 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:15.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.850+0000 7ff782a4a640 1 -- 172.21.15.78:0/452288019 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff768078b90 msgr2=0x7ff76807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.850+0000 7ff782a4a640 1 --2- 172.21.15.78:0/452288019 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff768078b90 0x7ff76807b0a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff770006fd0 tx=0x7ff770008040 comp rx=0 tx=0).stop 2024-09-17T03:15:15.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.850+0000 7ff782a4a640 1 -- 172.21.15.78:0/452288019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff77c072ff0 msgr2=0x7ff77c1523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.850+0000 7ff782a4a640 1 --2- 172.21.15.78:0/452288019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff77c072ff0 0x7ff77c1523e0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00c9a0 tx=0x7ff76c00ce60 comp rx=0 tx=0).stop 2024-09-17T03:15:15.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.850+0000 7ff782a4a640 1 -- 172.21.15.78:0/452288019 shutdown_connections 2024-09-17T03:15:15.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.850+0000 7ff782a4a640 1 --2- 172.21.15.78:0/452288019 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff77c0cd3e0 0x7ff77c1678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.850+0000 7ff782a4a640 1 --2- 172.21.15.78:0/452288019 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff768078b90 0x7ff76807b0a0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.850+0000 7ff782a4a640 1 --2- 172.21.15.78:0/452288019 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff77c0af780 0x7ff77c09c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.850+0000 7ff782a4a640 1 --2- 172.21.15.78:0/452288019 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff77c072ff0 0x7ff77c1523e0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.850+0000 7ff782a4a640 1 -- 172.21.15.78:0/452288019 >> 172.21.15.78:0/452288019 conn(0x7ff77c06d7d0 msgr2=0x7ff77c0b0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.850+0000 7ff782a4a640 1 -- 172.21.15.78:0/452288019 shutdown_connections 2024-09-17T03:15:15.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.850+0000 7ff782a4a640 1 -- 172.21.15.78:0/452288019 wait complete. 2024-09-17T03:15:15.860 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:15:15.860 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:15:15.860 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:1 scrub status 2024-09-17T03:15:15.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.976+0000 7f1799b8b640 1 -- 172.21.15.78:0/297418997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f179415b8f0 msgr2=0x7f17940cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.976+0000 7f1799b8b640 1 --2- 172.21.15.78:0/297418997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f179415b8f0 0x7f17940cf130 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f1784009900 tx=0x7f178402a610 comp rx=0 tx=0).stop 2024-09-17T03:15:15.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.976+0000 7f1799b8b640 1 -- 172.21.15.78:0/297418997 shutdown_connections 2024-09-17T03:15:15.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.976+0000 7f1799b8b640 1 --2- 172.21.15.78:0/297418997 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17940b2cb0 0x7f17940b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.976+0000 7f1799b8b640 1 --2- 172.21.15.78:0/297418997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f179415b8f0 0x7f17940cf130 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.976+0000 7f1799b8b640 1 -- 172.21.15.78:0/297418997 >> 172.21.15.78:0/297418997 conn(0x7f17940cdcb0 msgr2=0x7f17940ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.976+0000 7f1799b8b640 1 -- 172.21.15.78:0/297418997 shutdown_connections 2024-09-17T03:15:15.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.976+0000 7f1799b8b640 1 -- 172.21.15.78:0/297418997 wait complete. 2024-09-17T03:15:15.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.978+0000 7f1799b8b640 1 Processor -- start 2024-09-17T03:15:15.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.978+0000 7f1799b8b640 1 -- start start 2024-09-17T03:15:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.979+0000 7f1799b8b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17940b0520 0x7f1794156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.979+0000 7f1799b8b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17940b2cb0 0x7f17941f4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.979+0000 7f1799b8b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f179415b8f0 0x7f179406cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.979+0000 7f1799b8b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f17940ae330 con 0x7f17940b2cb0 2024-09-17T03:15:15.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.979+0000 7f1799b8b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f17940ae1b0 con 0x7f179415b8f0 2024-09-17T03:15:15.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.979+0000 7f1799b8b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f17940ae4b0 con 0x7f17940b0520 2024-09-17T03:15:15.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.979+0000 7f1792ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17940b2cb0 0x7f17941f4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.979+0000 7f1792ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17940b2cb0 0x7f17941f4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51302/0 (socket says 172.21.15.78:51302) 2024-09-17T03:15:15.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.979+0000 7f1792ffd640 1 -- 172.21.15.78:0/3267346309 learned_addr learned my addr 172.21.15.78:0/3267346309 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.979+0000 7f17937fe640 1 --2- 172.21.15.78:0/3267346309 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17940b0520 0x7f1794156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.979+0000 7f1793fff640 1 --2- 172.21.15.78:0/3267346309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f179415b8f0 0x7f179406cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.980+0000 7f1792ffd640 1 -- 172.21.15.78:0/3267346309 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17940b0520 msgr2=0x7f1794156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.980+0000 7f1792ffd640 1 --2- 172.21.15.78:0/3267346309 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17940b0520 0x7f1794156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.980+0000 7f1792ffd640 1 -- 172.21.15.78:0/3267346309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f179415b8f0 msgr2=0x7f179406cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.980+0000 7f1792ffd640 1 --2- 172.21.15.78:0/3267346309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f179415b8f0 0x7f179406cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.980+0000 7f1792ffd640 1 -- 172.21.15.78:0/3267346309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17941f9d60 con 0x7f17940b2cb0 2024-09-17T03:15:15.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.980+0000 7f1792ffd640 1 --2- 172.21.15.78:0/3267346309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17940b2cb0 0x7f17941f4fd0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f178800c3a0 tx=0x7f178800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.980+0000 7f177bfff640 1 -- 172.21.15.78:0/3267346309 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17880052d0 con 0x7f17940b2cb0 2024-09-17T03:15:15.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.980+0000 7f177bfff640 1 -- 172.21.15.78:0/3267346309 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1788007020 con 0x7f17940b2cb0 2024-09-17T03:15:15.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.980+0000 7f177bfff640 1 -- 172.21.15.78:0/3267346309 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1788007470 con 0x7f17940b2cb0 2024-09-17T03:15:15.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.980+0000 7f1799b8b640 1 -- 172.21.15.78:0/3267346309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17941f97e0 con 0x7f17940b2cb0 2024-09-17T03:15:15.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.980+0000 7f1799b8b640 1 -- 172.21.15.78:0/3267346309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17941f9a80 con 0x7f17940b2cb0 2024-09-17T03:15:15.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.982+0000 7f177bfff640 1 -- 172.21.15.78:0/3267346309 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f17880067d0 con 0x7f17940b2cb0 2024-09-17T03:15:15.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.982+0000 7f177bfff640 1 --2- 172.21.15.78:0/3267346309 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1780078b90 0x7f178007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.982+0000 7f177bfff640 1 -- 172.21.15.78:0/3267346309 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f178809a150 con 0x7f17940b2cb0 2024-09-17T03:15:15.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.983+0000 7f17937fe640 1 --2- 172.21.15.78:0/3267346309 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1780078b90 0x7f178007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.983+0000 7f17937fe640 1 --2- 172.21.15.78:0/3267346309 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1780078b90 0x7f178007b0a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1784033000 tx=0x7f1784004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.983+0000 7f17a0bd6740 1 Processor -- start 2024-09-17T03:15:15.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.983+0000 7f17a0bd6740 1 -- start start 2024-09-17T03:15:15.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f17a0bd6740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 0x563e1446da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f17a0bd6740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e14442860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f17a0bd6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 0x563e14442da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f17a0bd6740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x563e1439ba60 con 0x563e140584d0 2024-09-17T03:15:15.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f17a0bd6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563e1438ae90 con 0x563e140606b0 2024-09-17T03:15:15.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f17a0bd6740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x563e1438eca0 con 0x563e14081390 2024-09-17T03:15:15.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f1792ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e14442860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f1792ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e14442860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51314/0 (socket says 172.21.15.78:51314) 2024-09-17T03:15:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f1792ffd640 1 -- 172.21.15.78:0/552079011 learned_addr learned my addr 172.21.15.78:0/552079011 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f17937fe640 1 --2- 172.21.15.78:0/552079011 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 0x563e1446da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f1793fff640 1 --2- 172.21.15.78:0/552079011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 0x563e14442da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f1792ffd640 1 -- 172.21.15.78:0/552079011 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 msgr2=0x563e1446da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f1792ffd640 1 --2- 172.21.15.78:0/552079011 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 0x563e1446da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f1792ffd640 1 -- 172.21.15.78:0/552079011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 msgr2=0x563e14442da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f1792ffd640 1 --2- 172.21.15.78:0/552079011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 0x563e14442da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f1792ffd640 1 -- 172.21.15.78:0/552079011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e141637d0 con 0x563e140584d0 2024-09-17T03:15:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f17937fe640 1 --2- 172.21.15.78:0/552079011 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 0x563e1446da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f1792ffd640 1 --2- 172.21.15.78:0/552079011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e14442860 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f17880986a0 tx=0x7f1788000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e2a28e26b1c6ba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f17797fa640 1 -- 172.21.15.78:0/552079011 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1788066a00 con 0x563e140584d0 2024-09-17T03:15:15.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f17797fa640 1 -- 172.21.15.78:0/552079011 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f178806b8b0 con 0x563e140584d0 2024-09-17T03:15:15.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.985+0000 7f17797fa640 1 -- 172.21.15.78:0/552079011 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178805e240 con 0x563e140584d0 2024-09-17T03:15:15.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.986+0000 7f17a0bd6740 1 -- 172.21.15.78:0/552079011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 msgr2=0x563e14442860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.986+0000 7f17a0bd6740 1 --2- 172.21.15.78:0/552079011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e14442860 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f17880986a0 tx=0x7f1788000ed0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.986+0000 7f17a0bd6740 1 -- 172.21.15.78:0/552079011 shutdown_connections 2024-09-17T03:15:15.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.986+0000 7f17a0bd6740 1 --2- 172.21.15.78:0/552079011 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 0x563e14442da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.986+0000 7f17a0bd6740 1 --2- 172.21.15.78:0/552079011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e14442860 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.986+0000 7f17a0bd6740 1 --2- 172.21.15.78:0/552079011 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 0x563e1446da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.986+0000 7f17a0bd6740 1 -- 172.21.15.78:0/552079011 >> 172.21.15.78:0/552079011 conn(0x563e140754e0 msgr2=0x563e14428d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.986+0000 7f17a0bd6740 1 -- 172.21.15.78:0/552079011 shutdown_connections 2024-09-17T03:15:15.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.986+0000 7f17a0bd6740 1 -- 172.21.15.78:0/552079011 wait complete. 2024-09-17T03:15:15.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.987+0000 7f17a0bd6740 1 -- start start 2024-09-17T03:15:15.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.987+0000 7f17a0bd6740 1 Processor -- start 2024-09-17T03:15:15.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17a0bd6740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e1447fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17a0bd6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 0x563e1447d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17a0bd6740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 0x563e14428770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17a0bd6740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x563e140fb740 con 0x563e140584d0 2024-09-17T03:15:15.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17a0bd6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563e14330970 con 0x563e140606b0 2024-09-17T03:15:15.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17a0bd6740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x563e1447e460 con 0x563e14081390 2024-09-17T03:15:15.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17a0bd6740 10 client.0 _ll_register_callbacks cb 0x563e1433f780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:15.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17937fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e1447fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17937fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e1447fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51322/0 (socket says 172.21.15.78:51322) 2024-09-17T03:15:15.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17937fe640 1 -- 172.21.15.78:0/489980557 learned_addr learned my addr 172.21.15.78:0/489980557 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:15.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f1792ffd640 1 --2- 172.21.15.78:0/489980557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 0x563e1447d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f1793fff640 1 --2- 172.21.15.78:0/489980557 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 0x563e14428770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17937fe640 1 -- 172.21.15.78:0/489980557 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 msgr2=0x563e14428770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17937fe640 1 --2- 172.21.15.78:0/489980557 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 0x563e14428770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17937fe640 1 -- 172.21.15.78:0/489980557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 msgr2=0x563e1447d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:15.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17937fe640 1 --2- 172.21.15.78:0/489980557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 0x563e1447d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17937fe640 1 -- 172.21.15.78:0/489980557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e140ec970 con 0x563e140584d0 2024-09-17T03:15:15.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17937fe640 1 --2- 172.21.15.78:0/489980557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e1447fb40 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f1784009a20 tx=0x7f1784009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61bb871c365a0e96 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:15.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17727fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:15.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17727fc640 1 -- 172.21.15.78:0/489980557 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178404d020 con 0x563e140584d0 2024-09-17T03:15:15.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17727fc640 1 -- 172.21.15.78:0/489980557 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f1784003a80 con 0x563e140584d0 2024-09-17T03:15:15.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17a0bd6740 1 -- 172.21.15.78:0/489980557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f178806b8b0 con 0x563e140584d0 2024-09-17T03:15:15.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17727fc640 1 -- 172.21.15.78:0/489980557 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f1784057050 con 0x563e140584d0 2024-09-17T03:15:15.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.989+0000 7f17a0bd6740 10 client.8853 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:15.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.990+0000 7f17a0bd6740 1 -- 172.21.15.78:0/489980557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x563e140ca6a0 con 0x563e140584d0 2024-09-17T03:15:15.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.990+0000 7f17727fc640 1 -- 172.21.15.78:0/489980557 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f178806b8b0 con 0x563e140584d0 2024-09-17T03:15:15.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.990+0000 7f17727fc640 1 -- 172.21.15.78:0/489980557 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7f178405a020 con 0x563e140584d0 2024-09-17T03:15:15.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.990+0000 7f17a0bd6740 10 client.8853 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:15.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.990+0000 7f17a0bd6740 10 client.8853 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2024-09-17T03:15:15.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.990+0000 7f17a0bd6740 20 client.8853 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:15.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.990+0000 7f17a0bd6740 1 --2- 172.21.15.78:0/489980557 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x563e1403ff60 0x563e14467110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:15.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.990+0000 7f17a0bd6740 4 client.8853 mds_command: new command op to 8283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:15.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.990+0000 7f17a0bd6740 1 -- 172.21.15.78:0/489980557 --> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e1439d9b0 con 0x563e1403ff60 2024-09-17T03:15:15.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.990+0000 7f1792ffd640 1 --2- 172.21.15.78:0/489980557 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x563e1403ff60 0x563e14467110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:15.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.990+0000 7f17727fc640 10 client.8853 ms_handle_connect on v2:172.21.15.78:6832/1810198137 2024-09-17T03:15:15.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.990+0000 7f1792ffd640 1 --2- 172.21.15.78:0/489980557 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x563e1403ff60 0x563e14467110 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d9325e890ef2dde1 server_cookie=371cd617afe4e6c5 in_seq=0 out_seq=0 2024-09-17T03:15:15.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.991+0000 7f17727fc640 1 -- 172.21.15.78:0/489980557 <== mds.1 v2:172.21.15.78:6832/1810198137 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563e1439d9b0 con 0x563e1403ff60 2024-09-17T03:15:15.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.991+0000 7f17727fc640 10 client.8853 handle_command_reply: tid=0 2024-09-17T03:15:15.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.991+0000 7f17a0bd6740 1 client.8853 shutdown 2024-09-17T03:15:15.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.991+0000 7f17a0bd6740 1 -- 172.21.15.78:0/489980557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 msgr2=0x563e1447fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:15.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.991+0000 7f17a0bd6740 1 --2- 172.21.15.78:0/489980557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e1447fb40 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f1784009a20 tx=0x7f1784009260 comp rx=0 tx=0).stop 2024-09-17T03:15:15.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.991+0000 7f17a0bd6740 1 -- 172.21.15.78:0/489980557 shutdown_connections 2024-09-17T03:15:15.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.991+0000 7f17a0bd6740 1 --2- 172.21.15.78:0/489980557 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x563e1403ff60 0x563e14467110 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.991+0000 7f17a0bd6740 1 --2- 172.21.15.78:0/489980557 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 0x563e14428770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.991+0000 7f17a0bd6740 1 --2- 172.21.15.78:0/489980557 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 0x563e1447d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.991+0000 7f17a0bd6740 1 --2- 172.21.15.78:0/489980557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e1447fb40 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:15.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.991+0000 7f17727fc640 0 client.8853 ms_handle_reset on v2:172.21.15.78:6832/1810198137 2024-09-17T03:15:15.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.991+0000 7f17a0bd6740 1 -- 172.21.15.78:0/489980557 >> 172.21.15.78:0/489980557 conn(0x563e140754e0 msgr2=0x563e1444fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:15.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.991+0000 7f17a0bd6740 1 -- 172.21.15.78:0/489980557 shutdown_connections 2024-09-17T03:15:15.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.991+0000 7f17a0bd6740 1 -- 172.21.15.78:0/489980557 wait complete. 2024-09-17T03:15:15.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:15.991+0000 7f17a0bd6740 20 client.8853 trim_cache size 0 max 16384 2024-09-17T03:15:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.009+0000 7f17a0bd6740 1 Processor -- start 2024-09-17T03:15:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.009+0000 7f17a0bd6740 1 -- start start 2024-09-17T03:15:16.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.010+0000 7f17a0bd6740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e144672e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.010+0000 7f17a0bd6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 0x563e14442850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.010+0000 7f17a0bd6740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 0x563e14442d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.010+0000 7f17a0bd6740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1794202430 con 0x563e140584d0 2024-09-17T03:15:16.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.010+0000 7f17a0bd6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f17942015d0 con 0x563e140606b0 2024-09-17T03:15:16.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.010+0000 7f17a0bd6740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f1794201d00 con 0x563e14081390 2024-09-17T03:15:16.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.010+0000 7f17937fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e144672e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.010+0000 7f17937fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e144672e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51324/0 (socket says 172.21.15.78:51324) 2024-09-17T03:15:16.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.010+0000 7f17937fe640 1 -- 172.21.15.78:0/1757538541 learned_addr learned my addr 172.21.15.78:0/1757538541 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:16.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.010+0000 7f17937fe640 1 -- 172.21.15.78:0/1757538541 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 msgr2=0x563e14442d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:16.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.010+0000 7f1793fff640 1 --2- 172.21.15.78:0/1757538541 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 0x563e14442d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.010+0000 7f1792ffd640 1 --2- 172.21.15.78:0/1757538541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 0x563e14442850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.010+0000 7f17937fe640 1 --2- 172.21.15.78:0/1757538541 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 0x563e14442d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.010+0000 7f17937fe640 1 -- 172.21.15.78:0/1757538541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 msgr2=0x563e14442850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:16.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.011+0000 7f17937fe640 1 --2- 172.21.15.78:0/1757538541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 0x563e14442850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.011+0000 7f17937fe640 1 -- 172.21.15.78:0/1757538541 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e14464400 con 0x563e140584d0 2024-09-17T03:15:16.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.011+0000 7f1793fff640 1 --2- 172.21.15.78:0/1757538541 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 0x563e14442d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:16.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.011+0000 7f1792ffd640 1 --2- 172.21.15.78:0/1757538541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 0x563e14442850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:16.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.011+0000 7f17937fe640 1 --2- 172.21.15.78:0/1757538541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e144672e0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f1784000c00 tx=0x7f17840047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1aeca342e01c211 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:16.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.011+0000 7f1778ff9640 1 -- 172.21.15.78:0/1757538541 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178405f020 con 0x563e140584d0 2024-09-17T03:15:16.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.011+0000 7f1778ff9640 1 -- 172.21.15.78:0/1757538541 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1784005630 con 0x563e140584d0 2024-09-17T03:15:16.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.011+0000 7f1778ff9640 1 -- 172.21.15.78:0/1757538541 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178404d040 con 0x563e140584d0 2024-09-17T03:15:16.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.012+0000 7f17a0bd6740 1 -- 172.21.15.78:0/1757538541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 msgr2=0x563e144672e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.012+0000 7f17a0bd6740 1 --2- 172.21.15.78:0/1757538541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e144672e0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f1784000c00 tx=0x7f17840047a0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.012+0000 7f17a0bd6740 1 -- 172.21.15.78:0/1757538541 shutdown_connections 2024-09-17T03:15:16.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.012+0000 7f17a0bd6740 1 --2- 172.21.15.78:0/1757538541 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 0x563e14442d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.012+0000 7f17a0bd6740 1 --2- 172.21.15.78:0/1757538541 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 0x563e14442850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.012+0000 7f17a0bd6740 1 --2- 172.21.15.78:0/1757538541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e144672e0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.012+0000 7f17a0bd6740 1 -- 172.21.15.78:0/1757538541 >> 172.21.15.78:0/1757538541 conn(0x563e140754e0 msgr2=0x563e14429a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:16.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.012+0000 7f17a0bd6740 1 -- 172.21.15.78:0/1757538541 shutdown_connections 2024-09-17T03:15:16.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.012+0000 7f17a0bd6740 1 -- 172.21.15.78:0/1757538541 wait complete. 2024-09-17T03:15:16.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.013+0000 7f17a0bd6740 1 -- start start 2024-09-17T03:15:16.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.013+0000 7f17a0bd6740 1 Processor -- start 2024-09-17T03:15:16.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.014+0000 7f17a0bd6740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e144901f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.014+0000 7f17a0bd6740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 0x563e144ece70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.014+0000 7f17a0bd6740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 0x563e1446d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.014+0000 7f17a0bd6740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1794152d70 con 0x563e140584d0 2024-09-17T03:15:16.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.014+0000 7f17a0bd6740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x563e14490730 con 0x563e140606b0 2024-09-17T03:15:16.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.014+0000 7f17a0bd6740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x563e144edb10 con 0x563e14081390 2024-09-17T03:15:16.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.014+0000 7f17a0bd6740 10 client.0 _ll_register_callbacks cb 0x7f1784040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:16.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.014+0000 7f17937fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e144901f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.014+0000 7f17937fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e144901f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51332/0 (socket says 172.21.15.78:51332) 2024-09-17T03:15:16.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.014+0000 7f17937fe640 1 -- 172.21.15.78:0/495714542 learned_addr learned my addr 172.21.15.78:0/495714542 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:16.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.014+0000 7f1793fff640 1 --2- 172.21.15.78:0/495714542 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 0x563e1446d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.014+0000 7f1792ffd640 1 --2- 172.21.15.78:0/495714542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 0x563e144ece70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.014+0000 7f17937fe640 1 -- 172.21.15.78:0/495714542 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 msgr2=0x563e1446d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:16.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.014+0000 7f17937fe640 1 --2- 172.21.15.78:0/495714542 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 0x563e1446d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.014+0000 7f17937fe640 1 -- 172.21.15.78:0/495714542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 msgr2=0x563e144ece70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:16.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.014+0000 7f17937fe640 1 --2- 172.21.15.78:0/495714542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 0x563e144ece70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.014+0000 7f17937fe640 1 -- 172.21.15.78:0/495714542 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e14423fa0 con 0x563e140584d0 2024-09-17T03:15:16.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.014+0000 7f1793fff640 1 --2- 172.21.15.78:0/495714542 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 0x563e1446d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:16.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.014+0000 7f17937fe640 1 --2- 172.21.15.78:0/495714542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e144901f0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f1784009900 tx=0x7f1784004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2635abbe82a391c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:16.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.014+0000 7f17727fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:16.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.015+0000 7f17727fc640 1 -- 172.21.15.78:0/495714542 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178405f030 con 0x563e140584d0 2024-09-17T03:15:16.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.015+0000 7f17727fc640 1 -- 172.21.15.78:0/495714542 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f1784064450 con 0x563e140584d0 2024-09-17T03:15:16.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.015+0000 7f17a0bd6740 1 -- 172.21.15.78:0/495714542 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563e14399460 con 0x563e140584d0 2024-09-17T03:15:16.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.015+0000 7f17727fc640 1 -- 172.21.15.78:0/495714542 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f1784071050 con 0x563e140584d0 2024-09-17T03:15:16.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.015+0000 7f17a0bd6740 10 client.8859 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:16.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.015+0000 7f17a0bd6740 1 -- 172.21.15.78:0/495714542 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x563e1447f810 con 0x563e140584d0 2024-09-17T03:15:16.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.015+0000 7f17727fc640 1 -- 172.21.15.78:0/495714542 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x563e14399460 con 0x563e140584d0 2024-09-17T03:15:16.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.015+0000 7f17727fc640 1 -- 172.21.15.78:0/495714542 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7f1784074020 con 0x563e140584d0 2024-09-17T03:15:16.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.015+0000 7f17a0bd6740 10 client.8859 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:16.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.015+0000 7f17a0bd6740 10 client.8859 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2024-09-17T03:15:16.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.015+0000 7f17a0bd6740 20 client.8859 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:16.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.015+0000 7f17a0bd6740 1 --2- 172.21.15.78:0/495714542 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x563e144ed3b0 0x563e1446dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.015+0000 7f17a0bd6740 4 client.8859 mds_command: new command op to 8283 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:15:16.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.015+0000 7f17a0bd6740 1 -- 172.21.15.78:0/495714542 --> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563e14396890 con 0x563e144ed3b0 2024-09-17T03:15:16.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.015+0000 7f1792ffd640 1 --2- 172.21.15.78:0/495714542 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x563e144ed3b0 0x563e1446dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.015+0000 7f17727fc640 10 client.8859 ms_handle_connect on v2:172.21.15.78:6832/1810198137 2024-09-17T03:15:16.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.016+0000 7f1792ffd640 1 --2- 172.21.15.78:0/495714542 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x563e144ed3b0 0x563e1446dbb0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=eed90091960865b1 server_cookie=15d6517bfba659e5 in_seq=0 out_seq=0 2024-09-17T03:15:16.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.016+0000 7f17727fc640 1 -- 172.21.15.78:0/495714542 <== mds.1 v2:172.21.15.78:6832/1810198137 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x563e14396890 con 0x563e144ed3b0 2024-09-17T03:15:16.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.016+0000 7f17727fc640 10 client.8859 handle_command_reply: tid=0 2024-09-17T03:15:16.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.016+0000 7f17a0bd6740 1 client.8859 shutdown 2024-09-17T03:15:16.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.016+0000 7f17a0bd6740 1 -- 172.21.15.78:0/495714542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 msgr2=0x563e144901f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.016+0000 7f17a0bd6740 1 --2- 172.21.15.78:0/495714542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e144901f0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f1784009900 tx=0x7f1784004bb0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.016+0000 7f17a0bd6740 1 -- 172.21.15.78:0/495714542 shutdown_connections 2024-09-17T03:15:16.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.016+0000 7f17a0bd6740 1 --2- 172.21.15.78:0/495714542 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x563e144ed3b0 0x563e1446dbb0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.016+0000 7f17a0bd6740 1 --2- 172.21.15.78:0/495714542 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x563e14081390 0x563e1446d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.016+0000 7f17727fc640 0 client.8859 ms_handle_reset on v2:172.21.15.78:6832/1810198137 2024-09-17T03:15:16.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.016+0000 7f17a0bd6740 1 --2- 172.21.15.78:0/495714542 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x563e140606b0 0x563e144ece70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.016+0000 7f17a0bd6740 1 --2- 172.21.15.78:0/495714542 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x563e140584d0 0x563e144901f0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.016+0000 7f17a0bd6740 1 -- 172.21.15.78:0/495714542 >> 172.21.15.78:0/495714542 conn(0x563e140754e0 msgr2=0x563e14453210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:16.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.016+0000 7f17a0bd6740 1 -- 172.21.15.78:0/495714542 shutdown_connections 2024-09-17T03:15:16.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.016+0000 7f17a0bd6740 1 -- 172.21.15.78:0/495714542 wait complete. 2024-09-17T03:15:16.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.016+0000 7f17a0bd6740 20 client.8859 trim_cache size 0 max 16384 2024-09-17T03:15:16.021 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:16.021 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-17T03:15:16.021 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:15:16.021 INFO:teuthology.orchestra.run.smithi078.stdout: "0d177712-01a0-4dfb-8f16-2e7c84183356": { 2024-09-17T03:15:16.022 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:15:16.022 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "0d177712-01a0-4dfb-8f16-2e7c84183356", 2024-09-17T03:15:16.022 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:15:16.022 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:16.022 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:16.022 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:16.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.017+0000 7f1799b8b640 1 -- 172.21.15.78:0/3267346309 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1780078b90 msgr2=0x7f178007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.017+0000 7f1799b8b640 1 --2- 172.21.15.78:0/3267346309 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1780078b90 0x7f178007b0a0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1784033000 tx=0x7f1784004730 comp rx=0 tx=0).stop 2024-09-17T03:15:16.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.017+0000 7f1799b8b640 1 -- 172.21.15.78:0/3267346309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17940b2cb0 msgr2=0x7f17941f4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.017+0000 7f1799b8b640 1 --2- 172.21.15.78:0/3267346309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17940b2cb0 0x7f17941f4fd0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f178800c3a0 tx=0x7f178800c860 comp rx=0 tx=0).stop 2024-09-17T03:15:16.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.017+0000 7f1799b8b640 1 -- 172.21.15.78:0/3267346309 shutdown_connections 2024-09-17T03:15:16.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.017+0000 7f1799b8b640 1 --2- 172.21.15.78:0/3267346309 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1780078b90 0x7f178007b0a0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.017+0000 7f1799b8b640 1 --2- 172.21.15.78:0/3267346309 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f179415b8f0 0x7f179406cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.017+0000 7f1799b8b640 1 --2- 172.21.15.78:0/3267346309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17940b2cb0 0x7f17941f4fd0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.017+0000 7f1799b8b640 1 --2- 172.21.15.78:0/3267346309 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17940b0520 0x7f1794156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.017+0000 7f1799b8b640 1 -- 172.21.15.78:0/3267346309 >> 172.21.15.78:0/3267346309 conn(0x7f17940cdcb0 msgr2=0x7f17940cd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:16.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.017+0000 7f1799b8b640 1 -- 172.21.15.78:0/3267346309 shutdown_connections 2024-09-17T03:15:16.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.017+0000 7f1799b8b640 1 -- 172.21.15.78:0/3267346309 wait complete. 2024-09-17T03:15:16.027 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:15:16.027 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:15:16.028 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:2 scrub status 2024-09-17T03:15:16.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.143+0000 7f155ada1640 1 -- 172.21.15.78:0/2130902294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15541600b0 msgr2=0x7f15540ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.143+0000 7f155ada1640 1 --2- 172.21.15.78:0/2130902294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15541600b0 0x7f15540ccbc0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f15540b7c50 tx=0x7f154402a560 comp rx=0 tx=0).stop 2024-09-17T03:15:16.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.143+0000 7f155ada1640 1 -- 172.21.15.78:0/2130902294 shutdown_connections 2024-09-17T03:15:16.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.143+0000 7f155ada1640 1 --2- 172.21.15.78:0/2130902294 >> v2:172.21.15.193:3300/0 conn(0x7f15540cf320 0x7f15540d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.143+0000 7f155ada1640 1 --2- 172.21.15.78:0/2130902294 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15541600b0 0x7f15540ccbc0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.143+0000 7f155ada1640 1 -- 172.21.15.78:0/2130902294 >> 172.21.15.78:0/2130902294 conn(0x7f155406d4f0 msgr2=0x7f1554071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:16.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.143+0000 7f155ada1640 1 -- 172.21.15.78:0/2130902294 shutdown_connections 2024-09-17T03:15:16.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.143+0000 7f155ada1640 1 -- 172.21.15.78:0/2130902294 wait complete. 2024-09-17T03:15:16.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.145+0000 7f155ada1640 1 Processor -- start 2024-09-17T03:15:16.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.145+0000 7f155ada1640 1 -- start start 2024-09-17T03:15:16.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.146+0000 7f155ada1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15540b7cc0 0x7f15541f44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.146+0000 7f155ada1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15540cf320 0x7f15540aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.146+0000 7f155ada1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15541600b0 0x7f15541503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.146+0000 7f155ada1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f15540d13c0 con 0x7f15540cf320 2024-09-17T03:15:16.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.146+0000 7f155ada1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f15540d1240 con 0x7f15541600b0 2024-09-17T03:15:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.146+0000 7f155ada1640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f15540d1540 con 0x7f15540b7cc0 2024-09-17T03:15:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.146+0000 7f1553fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15540cf320 0x7f15540aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.146+0000 7f1553fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15540cf320 0x7f15540aafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51338/0 (socket says 172.21.15.78:51338) 2024-09-17T03:15:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.146+0000 7f1553fff640 1 -- 172.21.15.78:0/1815763810 learned_addr learned my addr 172.21.15.78:0/1815763810 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.147+0000 7f1558b3d640 1 --2- 172.21.15.78:0/1815763810 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15540b7cc0 0x7f15541f44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.147+0000 7f155933e640 1 --2- 172.21.15.78:0/1815763810 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15541600b0 0x7f15541503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.147+0000 7f1553fff640 1 -- 172.21.15.78:0/1815763810 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15540b7cc0 msgr2=0x7f15541f44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.147+0000 7f1553fff640 1 --2- 172.21.15.78:0/1815763810 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15540b7cc0 0x7f15541f44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.147+0000 7f1553fff640 1 -- 172.21.15.78:0/1815763810 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15541600b0 msgr2=0x7f15541503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.147+0000 7f1553fff640 1 --2- 172.21.15.78:0/1815763810 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15541600b0 0x7f15541503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.147+0000 7f1553fff640 1 -- 172.21.15.78:0/1815763810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15541f49f0 con 0x7f15540cf320 2024-09-17T03:15:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.147+0000 7f1553fff640 1 --2- 172.21.15.78:0/1815763810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15540cf320 0x7f15540aafd0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f154800b420 tx=0x7f154800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.147+0000 7f15517fa640 1 -- 172.21.15.78:0/1815763810 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1548011830 con 0x7f15540cf320 2024-09-17T03:15:16.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.147+0000 7f15517fa640 1 -- 172.21.15.78:0/1815763810 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1548016070 con 0x7f15540cf320 2024-09-17T03:15:16.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.147+0000 7f15517fa640 1 -- 172.21.15.78:0/1815763810 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1548011d60 con 0x7f15540cf320 2024-09-17T03:15:16.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.147+0000 7f155ada1640 1 -- 172.21.15.78:0/1815763810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15540a9540 con 0x7f15540cf320 2024-09-17T03:15:16.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.147+0000 7f155ada1640 1 -- 172.21.15.78:0/1815763810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15541f7930 con 0x7f15540cf320 2024-09-17T03:15:16.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.149+0000 7f15517fa640 1 -- 172.21.15.78:0/1815763810 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f154801b460 con 0x7f15540cf320 2024-09-17T03:15:16.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.150+0000 7f15517fa640 1 --2- 172.21.15.78:0/1815763810 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1540078b90 0x7f154007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.150+0000 7f15517fa640 1 -- 172.21.15.78:0/1815763810 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f154809a7a0 con 0x7f15540cf320 2024-09-17T03:15:16.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.150+0000 7f1558b3d640 1 --2- 172.21.15.78:0/1815763810 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1540078b90 0x7f154007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.151+0000 7f1558b3d640 1 --2- 172.21.15.78:0/1815763810 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1540078b90 0x7f154007b0a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1544033000 tx=0x7f1544004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:16.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.151+0000 7f1561deb740 1 Processor -- start 2024-09-17T03:15:16.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.151+0000 7f1561deb740 1 -- start start 2024-09-17T03:15:16.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.152+0000 7f1561deb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595f8447390 0x5595f8818740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.152+0000 7f1561deb740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595f841e4d0 0x5595f8818c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.152+0000 7f1561deb740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f84266b0 0x5595f8835b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.152+0000 7f1561deb740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5595f8761a60 con 0x5595f84266b0 2024-09-17T03:15:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.152+0000 7f1561deb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5595f8750e90 con 0x5595f8447390 2024-09-17T03:15:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.152+0000 7f1561deb740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5595f8754ca0 con 0x5595f841e4d0 2024-09-17T03:15:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.152+0000 7f155933e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f84266b0 0x5595f8835b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.152+0000 7f155933e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f84266b0 0x5595f8835b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51350/0 (socket says 172.21.15.78:51350) 2024-09-17T03:15:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.152+0000 7f155933e640 1 -- 172.21.15.78:0/450974028 learned_addr learned my addr 172.21.15.78:0/450974028 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.152+0000 7f1553fff640 1 --2- 172.21.15.78:0/450974028 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595f841e4d0 0x5595f8818c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.152+0000 7f1558b3d640 1 --2- 172.21.15.78:0/450974028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595f8447390 0x5595f8818740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.152+0000 7f155933e640 1 -- 172.21.15.78:0/450974028 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595f841e4d0 msgr2=0x5595f8818c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.152+0000 7f155933e640 1 --2- 172.21.15.78:0/450974028 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595f841e4d0 0x5595f8818c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.152+0000 7f155933e640 1 -- 172.21.15.78:0/450974028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595f8447390 msgr2=0x5595f8818740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:16.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.152+0000 7f155933e640 1 --2- 172.21.15.78:0/450974028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595f8447390 0x5595f8818740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.152+0000 7f155933e640 1 -- 172.21.15.78:0/450974028 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595f85297d0 con 0x5595f84266b0 2024-09-17T03:15:16.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.153+0000 7f155933e640 1 --2- 172.21.15.78:0/450974028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f84266b0 0x5595f8835b80 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f154c00aec0 tx=0x7f154c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b32e424e77ba88 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:16.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.153+0000 7f153a7fc640 1 -- 172.21.15.78:0/450974028 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c004d20 con 0x5595f84266b0 2024-09-17T03:15:16.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.153+0000 7f153a7fc640 1 -- 172.21.15.78:0/450974028 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f154c010640 con 0x5595f84266b0 2024-09-17T03:15:16.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.153+0000 7f153a7fc640 1 -- 172.21.15.78:0/450974028 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c010a50 con 0x5595f84266b0 2024-09-17T03:15:16.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.154+0000 7f1561deb740 1 -- 172.21.15.78:0/450974028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f84266b0 msgr2=0x5595f8835b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.154+0000 7f1561deb740 1 --2- 172.21.15.78:0/450974028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f84266b0 0x5595f8835b80 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f154c00aec0 tx=0x7f154c00f790 comp rx=0 tx=0).stop 2024-09-17T03:15:16.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.154+0000 7f1561deb740 1 -- 172.21.15.78:0/450974028 shutdown_connections 2024-09-17T03:15:16.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.154+0000 7f1561deb740 1 --2- 172.21.15.78:0/450974028 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f84266b0 0x5595f8835b80 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.154+0000 7f1561deb740 1 --2- 172.21.15.78:0/450974028 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595f841e4d0 0x5595f8818c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.154+0000 7f1561deb740 1 --2- 172.21.15.78:0/450974028 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595f8447390 0x5595f8818740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.154+0000 7f1561deb740 1 -- 172.21.15.78:0/450974028 >> 172.21.15.78:0/450974028 conn(0x5595f843b4e0 msgr2=0x5595f87eea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:16.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.154+0000 7f1561deb740 1 -- 172.21.15.78:0/450974028 shutdown_connections 2024-09-17T03:15:16.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.154+0000 7f1561deb740 1 -- 172.21.15.78:0/450974028 wait complete. 2024-09-17T03:15:16.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.154+0000 7f1561deb740 1 -- start start 2024-09-17T03:15:16.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.155+0000 7f1561deb740 1 Processor -- start 2024-09-17T03:15:16.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.156+0000 7f1561deb740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595f841e4d0 0x5595f88293f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.156+0000 7f1561deb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595f84266b0 0x5595f8806470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.156+0000 7f1561deb740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f8447390 0x5595f88069b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.156+0000 7f1561deb740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5595f84c1740 con 0x5595f8447390 2024-09-17T03:15:16.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.156+0000 7f1561deb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5595f86f6970 con 0x5595f84266b0 2024-09-17T03:15:16.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.156+0000 7f1561deb740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5595f88191c0 con 0x5595f841e4d0 2024-09-17T03:15:16.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.156+0000 7f1561deb740 10 client.0 _ll_register_callbacks cb 0x5595f86f9be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:16.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.156+0000 7f155933e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f8447390 0x5595f88069b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.156+0000 7f155933e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f8447390 0x5595f88069b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51366/0 (socket says 172.21.15.78:51366) 2024-09-17T03:15:16.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.156+0000 7f155933e640 1 -- 172.21.15.78:0/1534432644 learned_addr learned my addr 172.21.15.78:0/1534432644 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.156+0000 7f1553fff640 1 --2- 172.21.15.78:0/1534432644 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595f84266b0 0x5595f8806470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.156+0000 7f1558b3d640 1 --2- 172.21.15.78:0/1534432644 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595f841e4d0 0x5595f88293f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.156+0000 7f155933e640 1 -- 172.21.15.78:0/1534432644 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595f841e4d0 msgr2=0x5595f88293f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.156+0000 7f155933e640 1 --2- 172.21.15.78:0/1534432644 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595f841e4d0 0x5595f88293f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.156+0000 7f155933e640 1 -- 172.21.15.78:0/1534432644 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595f84266b0 msgr2=0x5595f8806470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.156+0000 7f155933e640 1 --2- 172.21.15.78:0/1534432644 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595f84266b0 0x5595f8806470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.156+0000 7f155933e640 1 -- 172.21.15.78:0/1534432644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595f84b2970 con 0x5595f8447390 2024-09-17T03:15:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.156+0000 7f1558b3d640 1 --2- 172.21.15.78:0/1534432644 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595f841e4d0 0x5595f88293f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.157+0000 7f155933e640 1 --2- 172.21.15.78:0/1534432644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f8447390 0x5595f88069b0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f154c005c10 tx=0x7f154c003e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d3571cbeab5e73 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.157+0000 7f15337fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.157+0000 7f15337fe640 1 -- 172.21.15.78:0/1534432644 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f154c010a00 con 0x5595f8447390 2024-09-17T03:15:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.157+0000 7f15337fe640 1 -- 172.21.15.78:0/1534432644 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f154c010ba0 con 0x5595f8447390 2024-09-17T03:15:16.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.157+0000 7f1561deb740 1 -- 172.21.15.78:0/1534432644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f154c010640 con 0x5595f8447390 2024-09-17T03:15:16.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.157+0000 7f15337fe640 1 -- 172.21.15.78:0/1534432644 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f154c02d050 con 0x5595f8447390 2024-09-17T03:15:16.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.157+0000 7f1561deb740 10 client.8871 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:16.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.157+0000 7f1561deb740 1 -- 172.21.15.78:0/1534432644 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x5595f84906a0 con 0x5595f8447390 2024-09-17T03:15:16.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.157+0000 7f15337fe640 1 -- 172.21.15.78:0/1534432644 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f154c010640 con 0x5595f8447390 2024-09-17T03:15:16.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.157+0000 7f15337fe640 1 -- 172.21.15.78:0/1534432644 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7f154c030020 con 0x5595f8447390 2024-09-17T03:15:16.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.157+0000 7f1561deb740 10 client.8871 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:16.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.157+0000 7f1561deb740 10 client.8871 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.d 2024-09-17T03:15:16.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.157+0000 7f1561deb740 20 client.8871 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:16.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.157+0000 7f1561deb740 1 --2- 172.21.15.78:0/1534432644 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x5595f8405f60 0x5595f87ec580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.157+0000 7f1561deb740 4 client.8871 mds_command: new command op to 7213 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:16.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.157+0000 7f1561deb740 1 -- 172.21.15.78:0/1534432644 --> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595f87639b0 con 0x5595f8405f60 2024-09-17T03:15:16.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.158+0000 7f1558b3d640 1 --2- 172.21.15.78:0/1534432644 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x5595f8405f60 0x5595f87ec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.158+0000 7f1558b3d640 1 --2- 172.21.15.78:0/1534432644 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x5595f8405f60 0x5595f87ec580 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8b9c016eafd65030 server_cookie=492906a8a44577d9 in_seq=0 out_seq=0 2024-09-17T03:15:16.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.158+0000 7f15337fe640 10 client.8871 ms_handle_connect on v2:172.21.15.193:6835/2983826871 2024-09-17T03:15:16.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.159+0000 7f15337fe640 1 -- 172.21.15.78:0/1534432644 <== mds.2 v2:172.21.15.193:6835/2983826871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5595f87639b0 con 0x5595f8405f60 2024-09-17T03:15:16.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.159+0000 7f15337fe640 10 client.8871 handle_command_reply: tid=0 2024-09-17T03:15:16.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.159+0000 7f1561deb740 1 client.8871 shutdown 2024-09-17T03:15:16.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.159+0000 7f1561deb740 1 -- 172.21.15.78:0/1534432644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f8447390 msgr2=0x5595f88069b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.159+0000 7f1561deb740 1 --2- 172.21.15.78:0/1534432644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f8447390 0x5595f88069b0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f154c005c10 tx=0x7f154c003e20 comp rx=0 tx=0).stop 2024-09-17T03:15:16.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.159+0000 7f1561deb740 1 -- 172.21.15.78:0/1534432644 shutdown_connections 2024-09-17T03:15:16.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.159+0000 7f1561deb740 1 --2- 172.21.15.78:0/1534432644 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x5595f8405f60 0x5595f87ec580 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.159+0000 7f1561deb740 1 --2- 172.21.15.78:0/1534432644 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f8447390 0x5595f88069b0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.159+0000 7f1561deb740 1 --2- 172.21.15.78:0/1534432644 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595f84266b0 0x5595f8806470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.159+0000 7f15337fe640 0 client.8871 ms_handle_reset on v2:172.21.15.193:6835/2983826871 2024-09-17T03:15:16.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.159+0000 7f1561deb740 1 --2- 172.21.15.78:0/1534432644 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595f841e4d0 0x5595f88293f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.159+0000 7f1561deb740 1 -- 172.21.15.78:0/1534432644 >> 172.21.15.78:0/1534432644 conn(0x5595f843b4e0 msgr2=0x5595f87ee8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:16.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.159+0000 7f1561deb740 1 -- 172.21.15.78:0/1534432644 shutdown_connections 2024-09-17T03:15:16.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.159+0000 7f1561deb740 1 -- 172.21.15.78:0/1534432644 wait complete. 2024-09-17T03:15:16.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.160+0000 7f1561deb740 20 client.8871 trim_cache size 0 max 16384 2024-09-17T03:15:16.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.177+0000 7f1561deb740 1 Processor -- start 2024-09-17T03:15:16.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.177+0000 7f1561deb740 1 -- start start 2024-09-17T03:15:16.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.178+0000 7f1561deb740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f841e4d0 0x5595f87eea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.178+0000 7f1561deb740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595f84266b0 0x5595f8856b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.178+0000 7f1561deb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595f8447390 0x5595f88570c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.178+0000 7f1561deb740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f15542000d0 con 0x5595f841e4d0 2024-09-17T03:15:16.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.178+0000 7f1561deb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f15541ff3b0 con 0x5595f8447390 2024-09-17T03:15:16.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.178+0000 7f1561deb740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f15541ff9a0 con 0x5595f84266b0 2024-09-17T03:15:16.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.178+0000 7f1558b3d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f841e4d0 0x5595f87eea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.178+0000 7f1558b3d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f841e4d0 0x5595f87eea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51368/0 (socket says 172.21.15.78:51368) 2024-09-17T03:15:16.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.178+0000 7f1558b3d640 1 -- 172.21.15.78:0/2243128654 learned_addr learned my addr 172.21.15.78:0/2243128654 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:16.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.178+0000 7f1558b3d640 1 -- 172.21.15.78:0/2243128654 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595f84266b0 msgr2=0x5595f8856b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:16.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.178+0000 7f1558b3d640 1 --2- 172.21.15.78:0/2243128654 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595f84266b0 0x5595f8856b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.178+0000 7f1558b3d640 1 -- 172.21.15.78:0/2243128654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595f8447390 msgr2=0x5595f88570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:16.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.178+0000 7f1558b3d640 1 --2- 172.21.15.78:0/2243128654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595f8447390 0x5595f88570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.178+0000 7f1558b3d640 1 -- 172.21.15.78:0/2243128654 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595f88376e0 con 0x5595f841e4d0 2024-09-17T03:15:16.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.179+0000 7f1558b3d640 1 --2- 172.21.15.78:0/2243128654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f841e4d0 0x5595f87eea80 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f1544009230 tx=0x7f154403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59cf50730c6b0a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:16.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.179+0000 7f1539ffb640 1 -- 172.21.15.78:0/2243128654 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1544035040 con 0x5595f841e4d0 2024-09-17T03:15:16.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.179+0000 7f1539ffb640 1 -- 172.21.15.78:0/2243128654 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1544003b00 con 0x5595f841e4d0 2024-09-17T03:15:16.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.179+0000 7f1539ffb640 1 -- 172.21.15.78:0/2243128654 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15440047a0 con 0x5595f841e4d0 2024-09-17T03:15:16.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.179+0000 7f1561deb740 1 -- 172.21.15.78:0/2243128654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f841e4d0 msgr2=0x5595f87eea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.179+0000 7f1561deb740 1 --2- 172.21.15.78:0/2243128654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f841e4d0 0x5595f87eea80 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f1544009230 tx=0x7f154403d000 comp rx=0 tx=0).stop 2024-09-17T03:15:16.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.180+0000 7f1561deb740 1 -- 172.21.15.78:0/2243128654 shutdown_connections 2024-09-17T03:15:16.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.180+0000 7f1561deb740 1 --2- 172.21.15.78:0/2243128654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595f8447390 0x5595f88570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.180+0000 7f1561deb740 1 --2- 172.21.15.78:0/2243128654 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595f84266b0 0x5595f8856b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.180+0000 7f1561deb740 1 --2- 172.21.15.78:0/2243128654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f841e4d0 0x5595f87eea80 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.180+0000 7f1561deb740 1 -- 172.21.15.78:0/2243128654 >> 172.21.15.78:0/2243128654 conn(0x5595f843b4e0 msgr2=0x5595f87ef980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:16.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.180+0000 7f1561deb740 1 -- 172.21.15.78:0/2243128654 shutdown_connections 2024-09-17T03:15:16.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.180+0000 7f1561deb740 1 -- 172.21.15.78:0/2243128654 wait complete. 2024-09-17T03:15:16.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.180+0000 7f1561deb740 1 -- start start 2024-09-17T03:15:16.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.181+0000 7f1561deb740 1 Processor -- start 2024-09-17T03:15:16.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.182+0000 7f1561deb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595f841e4d0 0x5595f882c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.182+0000 7f1561deb740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f84266b0 0x5595f88b6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.182+0000 7f1561deb740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595f8447390 0x5595f88b2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.182+0000 7f1561deb740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5595f87edbf0 con 0x5595f84266b0 2024-09-17T03:15:16.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.182+0000 7f1561deb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f15540cbbd0 con 0x5595f841e4d0 2024-09-17T03:15:16.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.182+0000 7f1561deb740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5595f87e4680 con 0x5595f8447390 2024-09-17T03:15:16.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.182+0000 7f1561deb740 10 client.0 _ll_register_callbacks cb 0x7f154805ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:16.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.182+0000 7f1553fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f84266b0 0x5595f88b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.182+0000 7f1553fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f84266b0 0x5595f88b6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51376/0 (socket says 172.21.15.78:51376) 2024-09-17T03:15:16.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.182+0000 7f1553fff640 1 -- 172.21.15.78:0/1711435547 learned_addr learned my addr 172.21.15.78:0/1711435547 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:16.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.182+0000 7f155933e640 1 --2- 172.21.15.78:0/1711435547 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595f8447390 0x5595f88b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.182+0000 7f1558b3d640 1 --2- 172.21.15.78:0/1711435547 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595f841e4d0 0x5595f882c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.182+0000 7f1553fff640 1 -- 172.21.15.78:0/1711435547 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595f8447390 msgr2=0x5595f88b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:16.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.182+0000 7f1553fff640 1 --2- 172.21.15.78:0/1711435547 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595f8447390 0x5595f88b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.182+0000 7f1553fff640 1 -- 172.21.15.78:0/1711435547 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595f841e4d0 msgr2=0x5595f882c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:16.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.182+0000 7f1553fff640 1 --2- 172.21.15.78:0/1711435547 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595f841e4d0 0x5595f882c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.182+0000 7f1553fff640 1 -- 172.21.15.78:0/1711435547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595f882a3d0 con 0x5595f84266b0 2024-09-17T03:15:16.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.182+0000 7f1558b3d640 1 --2- 172.21.15.78:0/1711435547 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595f841e4d0 0x5595f882c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:16.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.182+0000 7f1553fff640 1 --2- 172.21.15.78:0/1711435547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f84266b0 0x5595f88b6850 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f1548062330 tx=0x7f1548062280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257888eb82e8c04f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:16.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.182+0000 7f15337fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:16.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.183+0000 7f15337fe640 1 -- 172.21.15.78:0/1711435547 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15480691d0 con 0x5595f84266b0 2024-09-17T03:15:16.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.183+0000 7f15337fe640 1 -- 172.21.15.78:0/1711435547 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f1548069370 con 0x5595f84266b0 2024-09-17T03:15:16.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.183+0000 7f1561deb740 1 -- 172.21.15.78:0/1711435547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1544003b00 con 0x5595f84266b0 2024-09-17T03:15:16.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.183+0000 7f15337fe640 1 -- 172.21.15.78:0/1711435547 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f1548081050 con 0x5595f84266b0 2024-09-17T03:15:16.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.183+0000 7f1561deb740 10 client.8877 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:16.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.183+0000 7f1561deb740 1 -- 172.21.15.78:0/1711435547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x5595f88b2580 con 0x5595f84266b0 2024-09-17T03:15:16.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.183+0000 7f15337fe640 1 -- 172.21.15.78:0/1711435547 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1544003b00 con 0x5595f84266b0 2024-09-17T03:15:16.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.183+0000 7f15337fe640 1 -- 172.21.15.78:0/1711435547 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7f1548084ce0 con 0x5595f84266b0 2024-09-17T03:15:16.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.183+0000 7f1561deb740 10 client.8877 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:16.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.183+0000 7f1561deb740 10 client.8877 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.d 2024-09-17T03:15:16.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.183+0000 7f1561deb740 20 client.8877 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:16.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.183+0000 7f1561deb740 1 --2- 172.21.15.78:0/1711435547 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x5595f8845900 0x5595f87ec580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.183+0000 7f1561deb740 4 client.8877 mds_command: new command op to 7213 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:15:16.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.183+0000 7f1561deb740 1 -- 172.21.15.78:0/1711435547 --> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5595f88020c0 con 0x5595f8845900 2024-09-17T03:15:16.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.183+0000 7f1558b3d640 1 --2- 172.21.15.78:0/1711435547 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x5595f8845900 0x5595f87ec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.184+0000 7f1558b3d640 1 --2- 172.21.15.78:0/1711435547 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x5595f8845900 0x5595f87ec580 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=acd2e977e272a327 server_cookie=ff6a74f1cea17c15 in_seq=0 out_seq=0 2024-09-17T03:15:16.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.184+0000 7f15337fe640 10 client.8877 ms_handle_connect on v2:172.21.15.193:6835/2983826871 2024-09-17T03:15:16.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.184+0000 7f15337fe640 1 -- 172.21.15.78:0/1711435547 <== mds.2 v2:172.21.15.193:6835/2983826871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x5595f88020c0 con 0x5595f8845900 2024-09-17T03:15:16.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.184+0000 7f15337fe640 10 client.8877 handle_command_reply: tid=0 2024-09-17T03:15:16.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.184+0000 7f1561deb740 1 client.8877 shutdown 2024-09-17T03:15:16.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.184+0000 7f1561deb740 1 -- 172.21.15.78:0/1711435547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f84266b0 msgr2=0x5595f88b6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.184+0000 7f1561deb740 1 --2- 172.21.15.78:0/1711435547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f84266b0 0x5595f88b6850 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f1548062330 tx=0x7f1548062280 comp rx=0 tx=0).stop 2024-09-17T03:15:16.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.184+0000 7f1561deb740 1 -- 172.21.15.78:0/1711435547 shutdown_connections 2024-09-17T03:15:16.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.184+0000 7f1561deb740 1 --2- 172.21.15.78:0/1711435547 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x5595f8845900 0x5595f87ec580 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.184+0000 7f1561deb740 1 --2- 172.21.15.78:0/1711435547 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5595f8447390 0x5595f88b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.184+0000 7f1561deb740 1 --2- 172.21.15.78:0/1711435547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5595f84266b0 0x5595f88b6850 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.184+0000 7f1561deb740 1 --2- 172.21.15.78:0/1711435547 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5595f841e4d0 0x5595f882c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.184+0000 7f15337fe640 0 client.8877 ms_handle_reset on v2:172.21.15.193:6835/2983826871 2024-09-17T03:15:16.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.184+0000 7f1561deb740 1 -- 172.21.15.78:0/1711435547 >> 172.21.15.78:0/1711435547 conn(0x5595f843b4e0 msgr2=0x5595f88291f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:16.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.184+0000 7f1561deb740 1 -- 172.21.15.78:0/1711435547 shutdown_connections 2024-09-17T03:15:16.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.184+0000 7f1561deb740 1 -- 172.21.15.78:0/1711435547 wait complete. 2024-09-17T03:15:16.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.184+0000 7f1561deb740 20 client.8877 trim_cache size 0 max 16384 2024-09-17T03:15:16.189 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:16.189 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-17T03:15:16.189 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:15:16.189 INFO:teuthology.orchestra.run.smithi078.stdout: "0d177712-01a0-4dfb-8f16-2e7c84183356": { 2024-09-17T03:15:16.189 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:15:16.189 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "0d177712-01a0-4dfb-8f16-2e7c84183356", 2024-09-17T03:15:16.189 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:15:16.189 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:16.189 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:16.190 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:16.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.185+0000 7f155ada1640 1 -- 172.21.15.78:0/1815763810 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1540078b90 msgr2=0x7f154007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.185+0000 7f155ada1640 1 --2- 172.21.15.78:0/1815763810 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1540078b90 0x7f154007b0a0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1544033000 tx=0x7f1544004730 comp rx=0 tx=0).stop 2024-09-17T03:15:16.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.185+0000 7f155ada1640 1 -- 172.21.15.78:0/1815763810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15540cf320 msgr2=0x7f15540aafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.185+0000 7f155ada1640 1 --2- 172.21.15.78:0/1815763810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15540cf320 0x7f15540aafd0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f154800b420 tx=0x7f154800b8e0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.185+0000 7f155ada1640 1 -- 172.21.15.78:0/1815763810 shutdown_connections 2024-09-17T03:15:16.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.185+0000 7f155ada1640 1 --2- 172.21.15.78:0/1815763810 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1540078b90 0x7f154007b0a0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.185+0000 7f155ada1640 1 --2- 172.21.15.78:0/1815763810 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15541600b0 0x7f15541503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.185+0000 7f155ada1640 1 --2- 172.21.15.78:0/1815763810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15540cf320 0x7f15540aafd0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.185+0000 7f155ada1640 1 --2- 172.21.15.78:0/1815763810 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15540b7cc0 0x7f15541f44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.185+0000 7f155ada1640 1 -- 172.21.15.78:0/1815763810 >> 172.21.15.78:0/1815763810 conn(0x7f155406d4f0 msgr2=0x7f155415f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:16.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.185+0000 7f155ada1640 1 -- 172.21.15.78:0/1815763810 shutdown_connections 2024-09-17T03:15:16.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.185+0000 7f155ada1640 1 -- 172.21.15.78:0/1815763810 wait complete. 2024-09-17T03:15:16.195 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:15:16.195 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:15:16.195 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-17T03:15:16.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.311+0000 7f9efb44d640 1 -- 172.21.15.78:0/973909814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef4144270 msgr2=0x7f9ef40b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.311+0000 7f9efb44d640 1 --2- 172.21.15.78:0/973909814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef4144270 0x7f9ef40b5680 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009830 tx=0x7f9ef002a510 comp rx=0 tx=0).stop 2024-09-17T03:15:16.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.311+0000 7f9efb44d640 1 -- 172.21.15.78:0/973909814 shutdown_connections 2024-09-17T03:15:16.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.311+0000 7f9efb44d640 1 --2- 172.21.15.78:0/973909814 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9ef4074560 0x7f9ef40cfe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.311+0000 7f9efb44d640 1 --2- 172.21.15.78:0/973909814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef4144270 0x7f9ef40b5680 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.311+0000 7f9efb44d640 1 -- 172.21.15.78:0/973909814 >> 172.21.15.78:0/973909814 conn(0x7f9ef40d15f0 msgr2=0x7f9ef4073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:16.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.311+0000 7f9efb44d640 1 -- 172.21.15.78:0/973909814 shutdown_connections 2024-09-17T03:15:16.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.311+0000 7f9efb44d640 1 -- 172.21.15.78:0/973909814 wait complete. 2024-09-17T03:15:16.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.313+0000 7f9efb44d640 1 Processor -- start 2024-09-17T03:15:16.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.313+0000 7f9efb44d640 1 -- start start 2024-09-17T03:15:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.314+0000 7f9efb44d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef4142270 0x7f9ef4131940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.314+0000 7f9efb44d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ef4144270 0x7f9ef413fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.314+0000 7f9efb44d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9ef41f5550 0x7f9ef41f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.314+0000 7f9efb44d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef4142800 con 0x7f9ef4142270 2024-09-17T03:15:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.314+0000 7f9efb44d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef4142680 con 0x7f9ef4144270 2024-09-17T03:15:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.314+0000 7f9efb44d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f9ef4142980 con 0x7f9ef41f5550 2024-09-17T03:15:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.314+0000 7f9ef91e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef4142270 0x7f9ef4131940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.314+0000 7f9ef91e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef4142270 0x7f9ef4131940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51398/0 (socket says 172.21.15.78:51398) 2024-09-17T03:15:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.314+0000 7f9ef91e9640 1 -- 172.21.15.78:0/3351389468 learned_addr learned my addr 172.21.15.78:0/3351389468 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.315+0000 7f9ef91e9640 1 -- 172.21.15.78:0/3351389468 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9ef41f5550 msgr2=0x7f9ef41f5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.315+0000 7f9ef91e9640 1 --2- 172.21.15.78:0/3351389468 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9ef41f5550 0x7f9ef41f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.315+0000 7f9ef91e9640 1 -- 172.21.15.78:0/3351389468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ef4144270 msgr2=0x7f9ef413fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.315+0000 7f9ef91e9640 1 --2- 172.21.15.78:0/3351389468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ef4144270 0x7f9ef413fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.315+0000 7f9ef91e9640 1 -- 172.21.15.78:0/3351389468 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef41f5ea0 con 0x7f9ef4142270 2024-09-17T03:15:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.315+0000 7f9ef91e9640 1 --2- 172.21.15.78:0/3351389468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef4142270 0x7f9ef4131940 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f9ef002ab00 tx=0x7f9ef0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.315+0000 7f9ee9ffb640 1 -- 172.21.15.78:0/3351389468 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0031d60 con 0x7f9ef4142270 2024-09-17T03:15:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.315+0000 7f9ee9ffb640 1 -- 172.21.15.78:0/3351389468 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ef0033e10 con 0x7f9ef4142270 2024-09-17T03:15:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.315+0000 7f9ee9ffb640 1 -- 172.21.15.78:0/3351389468 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0005260 con 0x7f9ef4142270 2024-09-17T03:15:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.315+0000 7f9efb44d640 1 -- 172.21.15.78:0/3351389468 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ef4140350 con 0x7f9ef4142270 2024-09-17T03:15:16.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.315+0000 7f9efb44d640 1 -- 172.21.15.78:0/3351389468 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ef4140ab0 con 0x7f9ef4142270 2024-09-17T03:15:16.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.317+0000 7f9ee9ffb640 1 -- 172.21.15.78:0/3351389468 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9ef0005400 con 0x7f9ef4142270 2024-09-17T03:15:16.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.318+0000 7f9ee9ffb640 1 --2- 172.21.15.78:0/3351389468 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9ed8078b90 0x7f9ed807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.318+0000 7f9ee9ffb640 1 -- 172.21.15.78:0/3351389468 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f9ef00bbff0 con 0x7f9ef4142270 2024-09-17T03:15:16.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.318+0000 7f9ef89e8640 1 --2- 172.21.15.78:0/3351389468 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9ed8078b90 0x7f9ed807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.319+0000 7f9ef89e8640 1 --2- 172.21.15.78:0/3351389468 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9ed8078b90 0x7f9ed807b0a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40cd330 tx=0x7f9ee4007930 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:16.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.319+0000 7f9f01ffd740 1 Processor -- start 2024-09-17T03:15:16.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.319+0000 7f9f01ffd740 1 -- start start 2024-09-17T03:15:16.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.320+0000 7f9f01ffd740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff1368c390 0x55ff13a5d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.320+0000 7f9f01ffd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff136634d0 0x55ff13a5dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.320+0000 7f9f01ffd740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1366b6b0 0x55ff13a7ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.320+0000 7f9f01ffd740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ff139a6a60 con 0x55ff1366b6b0 2024-09-17T03:15:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.320+0000 7f9f01ffd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ff13995e90 con 0x55ff136634d0 2024-09-17T03:15:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.320+0000 7f9f01ffd740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ff13999ca0 con 0x55ff1368c390 2024-09-17T03:15:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.320+0000 7f9ef99ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1366b6b0 0x55ff13a7ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.320+0000 7f9ef99ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1366b6b0 0x55ff13a7ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51400/0 (socket says 172.21.15.78:51400) 2024-09-17T03:15:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.320+0000 7f9ef99ea640 1 -- 172.21.15.78:0/260264528 learned_addr learned my addr 172.21.15.78:0/260264528 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.320+0000 7f9ef91e9640 1 --2- 172.21.15.78:0/260264528 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff1368c390 0x55ff13a5d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.320+0000 7f9ef89e8640 1 --2- 172.21.15.78:0/260264528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff136634d0 0x55ff13a5dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.320+0000 7f9ef99ea640 1 -- 172.21.15.78:0/260264528 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff1368c390 msgr2=0x55ff13a5d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.320+0000 7f9ef99ea640 1 --2- 172.21.15.78:0/260264528 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff1368c390 0x55ff13a5d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.320+0000 7f9ef99ea640 1 -- 172.21.15.78:0/260264528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff136634d0 msgr2=0x55ff13a5dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:16.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.320+0000 7f9ef99ea640 1 --2- 172.21.15.78:0/260264528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff136634d0 0x55ff13a5dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.320+0000 7f9ef99ea640 1 -- 172.21.15.78:0/260264528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff1376e7d0 con 0x55ff1366b6b0 2024-09-17T03:15:16.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.321+0000 7f9ef99ea640 1 --2- 172.21.15.78:0/260264528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1366b6b0 0x55ff13a7ab80 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f9eec007c40 tx=0x7f9eec00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e530c43eb48872cb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:16.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.321+0000 7f9ed6ffd640 1 -- 172.21.15.78:0/260264528 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec003b70 con 0x55ff1366b6b0 2024-09-17T03:15:16.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.321+0000 7f9ed6ffd640 1 -- 172.21.15.78:0/260264528 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9eec003e20 con 0x55ff1366b6b0 2024-09-17T03:15:16.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.321+0000 7f9ed6ffd640 1 -- 172.21.15.78:0/260264528 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec004270 con 0x55ff1366b6b0 2024-09-17T03:15:16.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.322+0000 7f9f01ffd740 1 -- 172.21.15.78:0/260264528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1366b6b0 msgr2=0x55ff13a7ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.322+0000 7f9f01ffd740 1 --2- 172.21.15.78:0/260264528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1366b6b0 0x55ff13a7ab80 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f9eec007c40 tx=0x7f9eec00c6a0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.322+0000 7f9f01ffd740 1 -- 172.21.15.78:0/260264528 shutdown_connections 2024-09-17T03:15:16.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.322+0000 7f9f01ffd740 1 --2- 172.21.15.78:0/260264528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1366b6b0 0x55ff13a7ab80 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.322+0000 7f9f01ffd740 1 --2- 172.21.15.78:0/260264528 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff136634d0 0x55ff13a5dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.322+0000 7f9f01ffd740 1 --2- 172.21.15.78:0/260264528 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff1368c390 0x55ff13a5d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.322+0000 7f9f01ffd740 1 -- 172.21.15.78:0/260264528 >> 172.21.15.78:0/260264528 conn(0x55ff136804e0 msgr2=0x55ff13a33a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:16.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.322+0000 7f9f01ffd740 1 -- 172.21.15.78:0/260264528 shutdown_connections 2024-09-17T03:15:16.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.322+0000 7f9f01ffd740 1 -- 172.21.15.78:0/260264528 wait complete. 2024-09-17T03:15:16.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.322+0000 7f9f01ffd740 1 -- start start 2024-09-17T03:15:16.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.323+0000 7f9f01ffd740 1 Processor -- start 2024-09-17T03:15:16.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.324+0000 7f9f01ffd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff136634d0 0x55ff13a78d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.324+0000 7f9f01ffd740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff1366b6b0 0x55ff13a75270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.324+0000 7f9f01ffd740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1368c390 0x55ff13a8af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.324+0000 7f9f01ffd740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55ff13706740 con 0x55ff1368c390 2024-09-17T03:15:16.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.324+0000 7f9f01ffd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ff1393b970 con 0x55ff136634d0 2024-09-17T03:15:16.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.324+0000 7f9f01ffd740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ff13a5e1c0 con 0x55ff1366b6b0 2024-09-17T03:15:16.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.324+0000 7f9f01ffd740 10 client.0 _ll_register_callbacks cb 0x55ff1393ebe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:16.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.324+0000 7f9ef99ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1368c390 0x55ff13a8af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.324+0000 7f9ef99ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1368c390 0x55ff13a8af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:51414/0 (socket says 172.21.15.78:51414) 2024-09-17T03:15:16.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.324+0000 7f9ef99ea640 1 -- 172.21.15.78:0/1578250911 learned_addr learned my addr 172.21.15.78:0/1578250911 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:16.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.324+0000 7f9ef89e8640 1 --2- 172.21.15.78:0/1578250911 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff1366b6b0 0x55ff13a75270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.324+0000 7f9ef91e9640 1 --2- 172.21.15.78:0/1578250911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff136634d0 0x55ff13a78d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.324+0000 7f9ef99ea640 1 -- 172.21.15.78:0/1578250911 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff1366b6b0 msgr2=0x55ff13a75270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:16.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.324+0000 7f9ef99ea640 1 --2- 172.21.15.78:0/1578250911 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff1366b6b0 0x55ff13a75270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.324+0000 7f9ef99ea640 1 -- 172.21.15.78:0/1578250911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff136634d0 msgr2=0x55ff13a78d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:16.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.324+0000 7f9ef99ea640 1 --2- 172.21.15.78:0/1578250911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff136634d0 0x55ff13a78d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.324+0000 7f9ef99ea640 1 -- 172.21.15.78:0/1578250911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff136f7970 con 0x55ff1368c390 2024-09-17T03:15:16.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.324+0000 7f9ef91e9640 1 --2- 172.21.15.78:0/1578250911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff136634d0 0x55ff13a78d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.325+0000 7f9ef99ea640 1 --2- 172.21.15.78:0/1578250911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1368c390 0x55ff13a8af40 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x55ff13a355d0 tx=0x7f9eec0079b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0851d14845f9ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.325+0000 7f9ecffff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.325+0000 7f9ecffff640 1 -- 172.21.15.78:0/1578250911 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec004b20 con 0x55ff1368c390 2024-09-17T03:15:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.325+0000 7f9ecffff640 1 -- 172.21.15.78:0/1578250911 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f9eec004cc0 con 0x55ff1368c390 2024-09-17T03:15:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.325+0000 7f9f01ffd740 1 -- 172.21.15.78:0/1578250911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9eec003e20 con 0x55ff1368c390 2024-09-17T03:15:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.325+0000 7f9ecffff640 1 -- 172.21.15.78:0/1578250911 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f9eec004240 con 0x55ff1368c390 2024-09-17T03:15:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.325+0000 7f9f01ffd740 10 client.8892 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.325+0000 7f9f01ffd740 1 -- 172.21.15.78:0/1578250911 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x55ff136d56a0 con 0x55ff1368c390 2024-09-17T03:15:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.325+0000 7f9ecffff640 1 -- 172.21.15.78:0/1578250911 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9eec003e20 con 0x55ff1368c390 2024-09-17T03:15:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.325+0000 7f9ecffff640 1 -- 172.21.15.78:0/1578250911 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7f9eec02e080 con 0x55ff1368c390 2024-09-17T03:15:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.325+0000 7f9f01ffd740 10 client.8892 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.325+0000 7f9f01ffd740 10 client.8892 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T03:15:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.325+0000 7f9f01ffd740 20 client.8892 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.325+0000 7f9f01ffd740 1 --2- 172.21.15.78:0/1578250911 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55ff1364af60 0x55ff13a4b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.325+0000 7f9f01ffd740 4 client.8892 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.325+0000 7f9f01ffd740 1 -- 172.21.15.78:0/1578250911 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff139a89b0 con 0x55ff1364af60 2024-09-17T03:15:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.325+0000 7f9ef91e9640 1 --2- 172.21.15.78:0/1578250911 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55ff1364af60 0x55ff13a4b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.326+0000 7f9ecffff640 10 client.8892 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.326+0000 7f9ef91e9640 1 --2- 172.21.15.78:0/1578250911 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55ff1364af60 0x55ff13a4b760 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4b4550c83a8801 server_cookie=106e2b0e1fe0ee8d in_seq=0 out_seq=0 2024-09-17T03:15:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.326+0000 7f9ecffff640 1 -- 172.21.15.78:0/1578250911 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ff139a89b0 con 0x55ff1364af60 2024-09-17T03:15:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.326+0000 7f9ecffff640 10 client.8892 handle_command_reply: tid=0 2024-09-17T03:15:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.326+0000 7f9f01ffd740 1 client.8892 shutdown 2024-09-17T03:15:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.327+0000 7f9f01ffd740 1 -- 172.21.15.78:0/1578250911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1368c390 msgr2=0x55ff13a8af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.327+0000 7f9f01ffd740 1 --2- 172.21.15.78:0/1578250911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1368c390 0x55ff13a8af40 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x55ff13a355d0 tx=0x7f9eec0079b0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.327+0000 7f9f01ffd740 1 -- 172.21.15.78:0/1578250911 shutdown_connections 2024-09-17T03:15:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.327+0000 7f9f01ffd740 1 --2- 172.21.15.78:0/1578250911 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1368c390 0x55ff13a8af40 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.327+0000 7f9f01ffd740 1 --2- 172.21.15.78:0/1578250911 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff1366b6b0 0x55ff13a75270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.327+0000 7f9f01ffd740 1 --2- 172.21.15.78:0/1578250911 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55ff1364af60 0x55ff13a4b760 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.327+0000 7f9f01ffd740 1 --2- 172.21.15.78:0/1578250911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff136634d0 0x55ff13a78d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.327+0000 7f9ecffff640 0 client.8892 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.327+0000 7f9f01ffd740 1 -- 172.21.15.78:0/1578250911 >> 172.21.15.78:0/1578250911 conn(0x55ff136804e0 msgr2=0x55ff13a2e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.327+0000 7f9f01ffd740 1 -- 172.21.15.78:0/1578250911 shutdown_connections 2024-09-17T03:15:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.327+0000 7f9f01ffd740 1 -- 172.21.15.78:0/1578250911 wait complete. 2024-09-17T03:15:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.327+0000 7f9f01ffd740 20 client.8892 trim_cache size 0 max 16384 2024-09-17T03:15:16.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.344+0000 7f9f01ffd740 1 Processor -- start 2024-09-17T03:15:16.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.344+0000 7f9f01ffd740 1 -- start start 2024-09-17T03:15:16.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.346+0000 7f9f01ffd740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff136634d0 0x55ff13a6e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.346+0000 7f9f01ffd740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1366b6b0 0x55ff13a9c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.346+0000 7f9f01ffd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff1368c390 0x55ff13a9cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.346+0000 7f9f01ffd740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef41fee30 con 0x55ff1366b6b0 2024-09-17T03:15:16.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.346+0000 7f9f01ffd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef41fdfd0 con 0x55ff1368c390 2024-09-17T03:15:16.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.346+0000 7f9f01ffd740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f9ef41fe700 con 0x55ff136634d0 2024-09-17T03:15:16.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.346+0000 7f9ef89e8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1366b6b0 0x55ff13a9c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.346+0000 7f9ef89e8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1366b6b0 0x55ff13a9c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43030/0 (socket says 172.21.15.78:43030) 2024-09-17T03:15:16.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.346+0000 7f9ef89e8640 1 -- 172.21.15.78:0/3874538 learned_addr learned my addr 172.21.15.78:0/3874538 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:16.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.346+0000 7f9ef91e9640 1 --2- 172.21.15.78:0/3874538 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff136634d0 0x55ff13a6e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.346+0000 7f9ef99ea640 1 --2- 172.21.15.78:0/3874538 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff1368c390 0x55ff13a9cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.346+0000 7f9ef89e8640 1 -- 172.21.15.78:0/3874538 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff136634d0 msgr2=0x55ff13a6e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:16.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.346+0000 7f9ef89e8640 1 --2- 172.21.15.78:0/3874538 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff136634d0 0x55ff13a6e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.347 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.346+0000 7f9ef89e8640 1 -- 172.21.15.78:0/3874538 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff1368c390 msgr2=0x55ff13a9cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.346+0000 7f9ef89e8640 1 --2- 172.21.15.78:0/3874538 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff1368c390 0x55ff13a9cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.346+0000 7f9ef89e8640 1 -- 172.21.15.78:0/3874538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff13a2df80 con 0x55ff1366b6b0 2024-09-17T03:15:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.346+0000 7f9ef89e8640 1 --2- 172.21.15.78:0/3874538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1366b6b0 0x55ff13a9c690 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4003910 tx=0x7f9ee401a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab7d5e1ab978aec server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.346+0000 7f9ed67fc640 1 -- 172.21.15.78:0/3874538 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4015b40 con 0x55ff1366b6b0 2024-09-17T03:15:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.346+0000 7f9ed67fc640 1 -- 172.21.15.78:0/3874538 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ee4015ce0 con 0x55ff1366b6b0 2024-09-17T03:15:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.346+0000 7f9ed67fc640 1 -- 172.21.15.78:0/3874538 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4023630 con 0x55ff1366b6b0 2024-09-17T03:15:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.347+0000 7f9f01ffd740 1 -- 172.21.15.78:0/3874538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1366b6b0 msgr2=0x55ff13a9c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.347+0000 7f9f01ffd740 1 --2- 172.21.15.78:0/3874538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1366b6b0 0x55ff13a9c690 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4003910 tx=0x7f9ee401a040 comp rx=0 tx=0).stop 2024-09-17T03:15:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.347+0000 7f9f01ffd740 1 -- 172.21.15.78:0/3874538 shutdown_connections 2024-09-17T03:15:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.347+0000 7f9f01ffd740 1 --2- 172.21.15.78:0/3874538 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff1368c390 0x55ff13a9cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.347+0000 7f9f01ffd740 1 --2- 172.21.15.78:0/3874538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff1366b6b0 0x55ff13a9c690 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.347+0000 7f9f01ffd740 1 --2- 172.21.15.78:0/3874538 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff136634d0 0x55ff13a6e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.347+0000 7f9f01ffd740 1 -- 172.21.15.78:0/3874538 >> 172.21.15.78:0/3874538 conn(0x55ff136804e0 msgr2=0x55ff13a74e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:16.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.347+0000 7f9f01ffd740 1 -- 172.21.15.78:0/3874538 shutdown_connections 2024-09-17T03:15:16.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.347+0000 7f9f01ffd740 1 -- 172.21.15.78:0/3874538 wait complete. 2024-09-17T03:15:16.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.348+0000 7f9f01ffd740 1 -- start start 2024-09-17T03:15:16.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.348+0000 7f9f01ffd740 1 Processor -- start 2024-09-17T03:15:16.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.349+0000 7f9f01ffd740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff136634d0 0x55ff13a70440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.349+0000 7f9f01ffd740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff1366b6b0 0x55ff13a91af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.349+0000 7f9f01ffd740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff1368c390 0x55ff13a92030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.349+0000 7f9f01ffd740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef412f790 con 0x55ff136634d0 2024-09-17T03:15:16.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.349+0000 7f9f01ffd740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55ff13a92880 con 0x55ff1368c390 2024-09-17T03:15:16.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.349+0000 7f9f01ffd740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55ff13a722f0 con 0x55ff1366b6b0 2024-09-17T03:15:16.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.350+0000 7f9f01ffd740 10 client.0 _ll_register_callbacks cb 0x7f9ee4001210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:16.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.350+0000 7f9ef91e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff136634d0 0x55ff13a70440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.350+0000 7f9ef91e9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff136634d0 0x55ff13a70440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43046/0 (socket says 172.21.15.78:43046) 2024-09-17T03:15:16.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.350+0000 7f9ef91e9640 1 -- 172.21.15.78:0/3722446018 learned_addr learned my addr 172.21.15.78:0/3722446018 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:16.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.350+0000 7f9ef89e8640 1 --2- 172.21.15.78:0/3722446018 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff1366b6b0 0x55ff13a91af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.350+0000 7f9ef99ea640 1 --2- 172.21.15.78:0/3722446018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff1368c390 0x55ff13a92030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.350+0000 7f9ef91e9640 1 -- 172.21.15.78:0/3722446018 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff1366b6b0 msgr2=0x55ff13a91af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:16.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.350+0000 7f9ef91e9640 1 --2- 172.21.15.78:0/3722446018 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff1366b6b0 0x55ff13a91af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.350+0000 7f9ef91e9640 1 -- 172.21.15.78:0/3722446018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff1368c390 msgr2=0x55ff13a92030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:16.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.350+0000 7f9ef91e9640 1 --2- 172.21.15.78:0/3722446018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff1368c390 0x55ff13a92030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.350+0000 7f9ef91e9640 1 -- 172.21.15.78:0/3722446018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff13a2d500 con 0x55ff136634d0 2024-09-17T03:15:16.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.350+0000 7f9ef89e8640 1 --2- 172.21.15.78:0/3722446018 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff1366b6b0 0x55ff13a91af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:16.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.350+0000 7f9ef91e9640 1 --2- 172.21.15.78:0/3722446018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff136634d0 0x55ff13a70440 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00ba850 tx=0x7f9ef0005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a34334369541132 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.350+0000 7f9ecffff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.350+0000 7f9ecffff640 1 -- 172.21.15.78:0/3722446018 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0048050 con 0x55ff136634d0 2024-09-17T03:15:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.350+0000 7f9ecffff640 1 -- 172.21.15.78:0/3722446018 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f9ef006f130 con 0x55ff136634d0 2024-09-17T03:15:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.350+0000 7f9f01ffd740 1 -- 172.21.15.78:0/3722446018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ee4015ce0 con 0x55ff136634d0 2024-09-17T03:15:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.350+0000 7f9ecffff640 1 -- 172.21.15.78:0/3722446018 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f9ef00888f0 con 0x55ff136634d0 2024-09-17T03:15:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.350+0000 7f9f01ffd740 10 client.8898 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.350+0000 7f9f01ffd740 1 -- 172.21.15.78:0/3722446018 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x55ff13a92620 con 0x55ff136634d0 2024-09-17T03:15:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.351+0000 7f9ecffff640 1 -- 172.21.15.78:0/3722446018 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ee4015ce0 con 0x55ff136634d0 2024-09-17T03:15:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.351+0000 7f9ecffff640 1 -- 172.21.15.78:0/3722446018 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7f9ef008bbe0 con 0x55ff136634d0 2024-09-17T03:15:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.351+0000 7f9f01ffd740 10 client.8898 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.351+0000 7f9f01ffd740 10 client.8898 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T03:15:16.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.351+0000 7f9f01ffd740 20 client.8898 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:16.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.351+0000 7f9f01ffd740 1 --2- 172.21.15.78:0/3722446018 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55ff13a2ed10 0x55ff13a79e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.351+0000 7f9f01ffd740 4 client.8898 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:15:16.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.351+0000 7f9f01ffd740 1 -- 172.21.15.78:0/3722446018 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ff139a4460 con 0x55ff13a2ed10 2024-09-17T03:15:16.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.351+0000 7f9ef89e8640 1 --2- 172.21.15.78:0/3722446018 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55ff13a2ed10 0x55ff13a79e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.351+0000 7f9ecffff640 10 client.8898 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:16.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.351+0000 7f9ef89e8640 1 --2- 172.21.15.78:0/3722446018 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55ff13a2ed10 0x55ff13a79e90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79ebffb70217aab server_cookie=7617f14363630964 in_seq=0 out_seq=0 2024-09-17T03:15:16.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.352+0000 7f9ecffff640 1 -- 172.21.15.78:0/3722446018 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x55ff139a4460 con 0x55ff13a2ed10 2024-09-17T03:15:16.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.352+0000 7f9ecffff640 10 client.8898 handle_command_reply: tid=0 2024-09-17T03:15:16.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.352+0000 7f9f01ffd740 1 client.8898 shutdown 2024-09-17T03:15:16.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.352+0000 7f9f01ffd740 1 -- 172.21.15.78:0/3722446018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff136634d0 msgr2=0x55ff13a70440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.352+0000 7f9f01ffd740 1 --2- 172.21.15.78:0/3722446018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff136634d0 0x55ff13a70440 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00ba850 tx=0x7f9ef0005f90 comp rx=0 tx=0).stop 2024-09-17T03:15:16.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.352+0000 7f9f01ffd740 1 -- 172.21.15.78:0/3722446018 shutdown_connections 2024-09-17T03:15:16.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.352+0000 7f9f01ffd740 1 --2- 172.21.15.78:0/3722446018 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55ff13a2ed10 0x55ff13a79e90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.352+0000 7f9f01ffd740 1 --2- 172.21.15.78:0/3722446018 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55ff1368c390 0x55ff13a92030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.352+0000 7f9f01ffd740 1 --2- 172.21.15.78:0/3722446018 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55ff1366b6b0 0x55ff13a91af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.352+0000 7f9f01ffd740 1 --2- 172.21.15.78:0/3722446018 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55ff136634d0 0x55ff13a70440 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.352+0000 7f9ecffff640 0 client.8898 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:16.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.352+0000 7f9f01ffd740 1 -- 172.21.15.78:0/3722446018 >> 172.21.15.78:0/3722446018 conn(0x55ff136804e0 msgr2=0x55ff13a8ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:16.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.352+0000 7f9f01ffd740 1 -- 172.21.15.78:0/3722446018 shutdown_connections 2024-09-17T03:15:16.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.352+0000 7f9f01ffd740 1 -- 172.21.15.78:0/3722446018 wait complete. 2024-09-17T03:15:16.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.352+0000 7f9f01ffd740 20 client.8898 trim_cache size 0 max 16384 2024-09-17T03:15:16.359 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:16.359 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "PAUSED (0 inodes in the stack)", 2024-09-17T03:15:16.359 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:15:16.359 INFO:teuthology.orchestra.run.smithi078.stdout: "0d177712-01a0-4dfb-8f16-2e7c84183356": { 2024-09-17T03:15:16.359 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:15:16.359 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "0d177712-01a0-4dfb-8f16-2e7c84183356", 2024-09-17T03:15:16.359 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:15:16.359 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:16.359 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:15:16.359 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-17T03:15:16.359 INFO:teuthology.orchestra.run.smithi078.stdout: "0d177712-01a0-4dfb-8f16-2e7c84183356": { 2024-09-17T03:15:16.359 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-17T03:15:08.556658+0000", 2024-09-17T03:15:16.360 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:15:16.360 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-17T03:15:16.360 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-17T03:15:16.360 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-17T03:15:16.360 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-17T03:15:16.360 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:16.360 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:16.360 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:16.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.352+0000 7f9efb44d640 1 -- 172.21.15.78:0/3351389468 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9ed8078b90 msgr2=0x7f9ed807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.353+0000 7f9efb44d640 1 --2- 172.21.15.78:0/3351389468 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9ed8078b90 0x7f9ed807b0a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40cd330 tx=0x7f9ee4007930 comp rx=0 tx=0).stop 2024-09-17T03:15:16.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.353+0000 7f9efb44d640 1 -- 172.21.15.78:0/3351389468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef4142270 msgr2=0x7f9ef4131940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.353+0000 7f9efb44d640 1 --2- 172.21.15.78:0/3351389468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef4142270 0x7f9ef4131940 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f9ef002ab00 tx=0x7f9ef0033c20 comp rx=0 tx=0).stop 2024-09-17T03:15:16.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.353+0000 7f9efb44d640 1 -- 172.21.15.78:0/3351389468 shutdown_connections 2024-09-17T03:15:16.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.353+0000 7f9efb44d640 1 --2- 172.21.15.78:0/3351389468 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9ef41f5550 0x7f9ef41f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.353+0000 7f9efb44d640 1 --2- 172.21.15.78:0/3351389468 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9ed8078b90 0x7f9ed807b0a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.353+0000 7f9efb44d640 1 --2- 172.21.15.78:0/3351389468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9ef4144270 0x7f9ef413fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.353+0000 7f9efb44d640 1 --2- 172.21.15.78:0/3351389468 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef4142270 0x7f9ef4131940 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.353+0000 7f9efb44d640 1 -- 172.21.15.78:0/3351389468 >> 172.21.15.78:0/3351389468 conn(0x7f9ef40d15f0 msgr2=0x7f9ef415af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:16.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.353+0000 7f9efb44d640 1 -- 172.21.15.78:0/3351389468 shutdown_connections 2024-09-17T03:15:16.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.353+0000 7f9efb44d640 1 -- 172.21.15.78:0/3351389468 wait complete. 2024-09-17T03:15:16.363 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:15:16.363 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:16.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.476+0000 7fec2923f640 1 -- 172.21.15.78:0/4050850929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec2406e170 msgr2=0x7fec240b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.476+0000 7fec2923f640 1 --2- 172.21.15.78:0/4050850929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec2406e170 0x7fec240b3540 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009830 tx=0x7fec0c02a480 comp rx=0 tx=0).stop 2024-09-17T03:15:16.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.476+0000 7fec2923f640 1 -- 172.21.15.78:0/4050850929 shutdown_connections 2024-09-17T03:15:16.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.476+0000 7fec2923f640 1 --2- 172.21.15.78:0/4050850929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec2406e170 0x7fec240b3540 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.476+0000 7fec2923f640 1 -- 172.21.15.78:0/4050850929 >> 172.21.15.78:0/4050850929 conn(0x7fec2408bfc0 msgr2=0x7fec2409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:16.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.476+0000 7fec2923f640 1 -- 172.21.15.78:0/4050850929 shutdown_connections 2024-09-17T03:15:16.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.476+0000 7fec2923f640 1 -- 172.21.15.78:0/4050850929 wait complete. 2024-09-17T03:15:16.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.478+0000 7fec2923f640 1 Processor -- start 2024-09-17T03:15:16.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.478+0000 7fec2923f640 1 -- start start 2024-09-17T03:15:16.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec2923f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec2406f4b0 0x7fec2414da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec2923f640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fec240ceb40 0x7fec24150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec2923f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec2415e210 0x7fec24150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec2923f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fec240d10b0 con 0x7fec2406f4b0 2024-09-17T03:15:16.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec2923f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fec240d0f30 con 0x7fec2415e210 2024-09-17T03:15:16.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec2923f640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fec240d1230 con 0x7fec240ceb40 2024-09-17T03:15:16.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec22d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec2406f4b0 0x7fec2414da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec22d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec2406f4b0 0x7fec2414da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43072/0 (socket says 172.21.15.78:43072) 2024-09-17T03:15:16.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec22d9d640 1 -- 172.21.15.78:0/127638113 learned_addr learned my addr 172.21.15.78:0/127638113 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:16.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec2359e640 1 --2- 172.21.15.78:0/127638113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec2415e210 0x7fec24150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec2259c640 1 --2- 172.21.15.78:0/127638113 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fec240ceb40 0x7fec24150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec22d9d640 1 -- 172.21.15.78:0/127638113 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fec240ceb40 msgr2=0x7fec24150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec22d9d640 1 --2- 172.21.15.78:0/127638113 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fec240ceb40 0x7fec24150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec22d9d640 1 -- 172.21.15.78:0/127638113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec2415e210 msgr2=0x7fec24150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec22d9d640 1 --2- 172.21.15.78:0/127638113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec2415e210 0x7fec24150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec22d9d640 1 -- 172.21.15.78:0/127638113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec24160070 con 0x7fec2406f4b0 2024-09-17T03:15:16.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec2359e640 1 --2- 172.21.15.78:0/127638113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec2415e210 0x7fec24150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:16.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec22d9d640 1 --2- 172.21.15.78:0/127638113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec2406f4b0 0x7fec2414da20 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009950 tx=0x7fec0c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:16.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec1b7fe640 1 -- 172.21.15.78:0/127638113 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c031d60 con 0x7fec2406f4b0 2024-09-17T03:15:16.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec1b7fe640 1 -- 172.21.15.78:0/127638113 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec0c033e10 con 0x7fec2406f4b0 2024-09-17T03:15:16.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec2923f640 1 -- 172.21.15.78:0/127638113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec2415fab0 con 0x7fec2406f4b0 2024-09-17T03:15:16.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.480+0000 7fec1b7fe640 1 -- 172.21.15.78:0/127638113 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0c005260 con 0x7fec2406f4b0 2024-09-17T03:15:16.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.481+0000 7fec2923f640 1 -- 172.21.15.78:0/127638113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec241e8370 con 0x7fec2406f4b0 2024-09-17T03:15:16.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.482+0000 7fec2923f640 1 -- 172.21.15.78:0/127638113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec2406e170 con 0x7fec2406f4b0 2024-09-17T03:15:16.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.482+0000 7fec1b7fe640 1 -- 172.21.15.78:0/127638113 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fec0c005400 con 0x7fec2406f4b0 2024-09-17T03:15:16.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.483+0000 7fec1b7fe640 1 --2- 172.21.15.78:0/127638113 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fec04078bc0 0x7fec0407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.483+0000 7fec1b7fe640 1 -- 172.21.15.78:0/127638113 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fec0c0bc050 con 0x7fec2406f4b0 2024-09-17T03:15:16.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.483+0000 7fec2259c640 1 --2- 172.21.15.78:0/127638113 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fec04078bc0 0x7fec0407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.483+0000 7fec2259c640 1 --2- 172.21.15.78:0/127638113 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fec04078bc0 0x7fec0407b0d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fec14006fd0 tx=0x7fec14008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:16.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.487+0000 7fec1b7fe640 1 -- 172.21.15.78:0/127638113 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fec0c03f030 con 0x7fec2406f4b0 2024-09-17T03:15:16.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.698+0000 7fec2923f640 1 -- 172.21.15.78:0/127638113 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec240b1af0 con 0x7fec2406f4b0 2024-09-17T03:15:16.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.698+0000 7fec1b7fe640 1 -- 172.21.15.78:0/127638113 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5280 (secure 0 0 0) 0x7fec0c0844a0 con 0x7fec2406f4b0 2024-09-17T03:15:16.697 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:16.697 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:15:12.673912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8286,"mds_1":8283,"mds_2":7213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7213":{"gid":7213,"name":"d","rank":2,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8283":{"gid":8283,"name":"a","rank":1,"incarnation":95,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[8286,8283,7213]},"id":7}]} 2024-09-17T03:15:16.697 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 103 2024-09-17T03:15:16.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.700+0000 7fec2923f640 1 -- 172.21.15.78:0/127638113 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fec04078bc0 msgr2=0x7fec0407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.700+0000 7fec2923f640 1 --2- 172.21.15.78:0/127638113 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fec04078bc0 0x7fec0407b0d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fec14006fd0 tx=0x7fec14008040 comp rx=0 tx=0).stop 2024-09-17T03:15:16.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.700+0000 7fec2923f640 1 -- 172.21.15.78:0/127638113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec2406f4b0 msgr2=0x7fec2414da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.700+0000 7fec2923f640 1 --2- 172.21.15.78:0/127638113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec2406f4b0 0x7fec2414da20 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009950 tx=0x7fec0c033c20 comp rx=0 tx=0).stop 2024-09-17T03:15:16.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.700+0000 7fec2923f640 1 -- 172.21.15.78:0/127638113 shutdown_connections 2024-09-17T03:15:16.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.700+0000 7fec2923f640 1 --2- 172.21.15.78:0/127638113 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fec04078bc0 0x7fec0407b0d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.700+0000 7fec2923f640 1 --2- 172.21.15.78:0/127638113 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fec2415e210 0x7fec24150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.700+0000 7fec2923f640 1 --2- 172.21.15.78:0/127638113 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fec240ceb40 0x7fec24150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.700+0000 7fec2923f640 1 --2- 172.21.15.78:0/127638113 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec2406f4b0 0x7fec2414da20 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.700+0000 7fec2923f640 1 -- 172.21.15.78:0/127638113 >> 172.21.15.78:0/127638113 conn(0x7fec2408bfc0 msgr2=0x7fec24161ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:16.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.700+0000 7fec2923f640 1 -- 172.21.15.78:0/127638113 shutdown_connections 2024-09-17T03:15:16.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.700+0000 7fec2923f640 1 -- 172.21.15.78:0/127638113 wait complete. 2024-09-17T03:15:16.711 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2024-09-17T03:15:16.711 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:15:16.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.825+0000 7f8c662dc640 1 -- 172.21.15.78:0/1553636065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c48003a50 msgr2=0x7f8c48003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.825+0000 7f8c662dc640 1 --2- 172.21.15.78:0/1553636065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c48003a50 0x7f8c48003ec0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f8c5000c610 tx=0x7f8c48005830 comp rx=0 tx=0).stop 2024-09-17T03:15:16.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.825+0000 7f8c662dc640 1 -- 172.21.15.78:0/1553636065 shutdown_connections 2024-09-17T03:15:16.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.825+0000 7f8c662dc640 1 --2- 172.21.15.78:0/1553636065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c48003a50 0x7f8c48003ec0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.825+0000 7f8c662dc640 1 -- 172.21.15.78:0/1553636065 >> 172.21.15.78:0/1553636065 conn(0x7f8c600cdcb0 msgr2=0x7f8c600ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:16.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.825+0000 7f8c662dc640 1 -- 172.21.15.78:0/1553636065 shutdown_connections 2024-09-17T03:15:16.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.825+0000 7f8c662dc640 1 -- 172.21.15.78:0/1553636065 wait complete. 2024-09-17T03:15:16.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.827+0000 7f8c662dc640 1 Processor -- start 2024-09-17T03:15:16.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.827+0000 7f8c662dc640 1 -- start start 2024-09-17T03:15:16.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.828+0000 7f8c662dc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c48003a50 0x7f8c600c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.828+0000 7f8c662dc640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c601f3150 0x7f8c600c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.828+0000 7f8c662dc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c6009e2e0 0x7f8c6009d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.828+0000 7f8c662dc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f8c600b3450 con 0x7f8c6009e2e0 2024-09-17T03:15:16.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.828+0000 7f8c662dc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8c600b32d0 con 0x7f8c48003a50 2024-09-17T03:15:16.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.828+0000 7f8c662dc640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8c60071650 con 0x7f8c601f3150 2024-09-17T03:15:16.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.828+0000 7f8c64879640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c6009e2e0 0x7f8c6009d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.828+0000 7f8c64879640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c6009e2e0 0x7f8c6009d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43086/0 (socket says 172.21.15.78:43086) 2024-09-17T03:15:16.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.828+0000 7f8c64879640 1 -- 172.21.15.78:0/4202492231 learned_addr learned my addr 172.21.15.78:0/4202492231 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:16.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.828+0000 7f8c5f7fe640 1 --2- 172.21.15.78:0/4202492231 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c601f3150 0x7f8c600c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.828+0000 7f8c5ffff640 1 --2- 172.21.15.78:0/4202492231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c48003a50 0x7f8c600c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.829+0000 7f8c64879640 1 -- 172.21.15.78:0/4202492231 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c601f3150 msgr2=0x7f8c600c4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.829+0000 7f8c64879640 1 --2- 172.21.15.78:0/4202492231 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c601f3150 0x7f8c600c4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.829+0000 7f8c64879640 1 -- 172.21.15.78:0/4202492231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c48003a50 msgr2=0x7f8c600c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:16.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.829+0000 7f8c64879640 1 --2- 172.21.15.78:0/4202492231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c48003a50 0x7f8c600c7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:16.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.829+0000 7f8c64879640 1 -- 172.21.15.78:0/4202492231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c601f3560 con 0x7f8c6009e2e0 2024-09-17T03:15:16.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.829+0000 7f8c5ffff640 1 --2- 172.21.15.78:0/4202492231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c48003a50 0x7f8c600c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:16.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.829+0000 7f8c5f7fe640 1 --2- 172.21.15.78:0/4202492231 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c601f3150 0x7f8c600c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:16.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.829+0000 7f8c64879640 1 --2- 172.21.15.78:0/4202492231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c6009e2e0 0x7f8c6009d4e0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f8c600cdb60 tx=0x7f8c58010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:16.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.829+0000 7f8c5cff9640 1 -- 172.21.15.78:0/4202492231 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58004b20 con 0x7f8c6009e2e0 2024-09-17T03:15:16.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.829+0000 7f8c5cff9640 1 -- 172.21.15.78:0/4202492231 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c58015070 con 0x7f8c6009e2e0 2024-09-17T03:15:16.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.829+0000 7f8c662dc640 1 -- 172.21.15.78:0/4202492231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c601f3a60 con 0x7f8c6009e2e0 2024-09-17T03:15:16.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.829+0000 7f8c5cff9640 1 -- 172.21.15.78:0/4202492231 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58003970 con 0x7f8c6009e2e0 2024-09-17T03:15:16.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.829+0000 7f8c662dc640 1 -- 172.21.15.78:0/4202492231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c601f4020 con 0x7f8c6009e2e0 2024-09-17T03:15:16.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.830+0000 7f8c662dc640 1 -- 172.21.15.78:0/4202492231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c601f37d0 con 0x7f8c6009e2e0 2024-09-17T03:15:16.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.831+0000 7f8c5cff9640 1 -- 172.21.15.78:0/4202492231 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8c58003b10 con 0x7f8c6009e2e0 2024-09-17T03:15:16.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.831+0000 7f8c5cff9640 1 --2- 172.21.15.78:0/4202492231 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c4c078bc0 0x7f8c4c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:16.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.831+0000 7f8c5cff9640 1 -- 172.21.15.78:0/4202492231 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f8c5809b430 con 0x7f8c6009e2e0 2024-09-17T03:15:16.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.831+0000 7f8c5ffff640 1 --2- 172.21.15.78:0/4202492231 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c4c078bc0 0x7f8c4c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:16.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.832+0000 7f8c5ffff640 1 --2- 172.21.15.78:0/4202492231 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c4c078bc0 0x7f8c4c07b0d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8c50033000 tx=0x7f8c50001c50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:16.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:16.836+0000 7f8c5cff9640 1 -- 172.21.15.78:0/4202492231 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f8c58063870 con 0x7f8c6009e2e0 2024-09-17T03:15:17.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.076+0000 7f8c662dc640 1 -- 172.21.15.78:0/4202492231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f8c600b0520 con 0x7f8c6009e2e0 2024-09-17T03:15:17.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.077+0000 7f8c5cff9640 1 -- 172.21.15.78:0/4202492231 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2009 (secure 0 0 0) 0x7f8c58063170 con 0x7f8c6009e2e0 2024-09-17T03:15:17.076 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:17.076 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":434,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":700753,"bytes_used":262094848,"bytes_avail":772832018432,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":6568,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7213},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8283},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8286}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":30,"modified":"2024-09-17T03:15:13.231420+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-17T03:15:17.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.079+0000 7f8c662dc640 1 -- 172.21.15.78:0/4202492231 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c4c078bc0 msgr2=0x7f8c4c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.079+0000 7f8c662dc640 1 --2- 172.21.15.78:0/4202492231 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c4c078bc0 0x7f8c4c07b0d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8c50033000 tx=0x7f8c50001c50 comp rx=0 tx=0).stop 2024-09-17T03:15:17.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.079+0000 7f8c662dc640 1 -- 172.21.15.78:0/4202492231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c6009e2e0 msgr2=0x7f8c6009d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.079+0000 7f8c662dc640 1 --2- 172.21.15.78:0/4202492231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c6009e2e0 0x7f8c6009d4e0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f8c600cdb60 tx=0x7f8c58010f40 comp rx=0 tx=0).stop 2024-09-17T03:15:17.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.079+0000 7f8c662dc640 1 -- 172.21.15.78:0/4202492231 shutdown_connections 2024-09-17T03:15:17.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.079+0000 7f8c662dc640 1 --2- 172.21.15.78:0/4202492231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c6009e2e0 0x7f8c6009d4e0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.079+0000 7f8c662dc640 1 --2- 172.21.15.78:0/4202492231 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c601f3150 0x7f8c600c4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.079+0000 7f8c662dc640 1 --2- 172.21.15.78:0/4202492231 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f8c4c078bc0 0x7f8c4c07b0d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.079+0000 7f8c662dc640 1 --2- 172.21.15.78:0/4202492231 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c48003a50 0x7f8c600c7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.079+0000 7f8c662dc640 1 -- 172.21.15.78:0/4202492231 >> 172.21.15.78:0/4202492231 conn(0x7f8c600cdcb0 msgr2=0x7f8c600cccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.079+0000 7f8c662dc640 1 -- 172.21.15.78:0/4202492231 shutdown_connections 2024-09-17T03:15:17.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.079+0000 7f8c662dc640 1 -- 172.21.15.78:0/4202492231 wait complete. 2024-09-17T03:15:17.089 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-17T03:15:17.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:17.090 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub resume 2024-09-17T03:15:17.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.205+0000 7feb12030640 1 -- 172.21.15.78:0/3323090298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c06cde0 msgr2=0x7feb0c06d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.205+0000 7feb12030640 1 --2- 172.21.15.78:0/3323090298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c06cde0 0x7feb0c06d1f0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7feb00005fd0 tx=0x7feb0002a4a0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.205+0000 7feb12030640 1 -- 172.21.15.78:0/3323090298 shutdown_connections 2024-09-17T03:15:17.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.205+0000 7feb12030640 1 --2- 172.21.15.78:0/3323090298 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c06cde0 0x7feb0c06d1f0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.205+0000 7feb12030640 1 --2- 172.21.15.78:0/3323090298 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb0c06e470 0x7feb0c070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.205+0000 7feb12030640 1 -- 172.21.15.78:0/3323090298 >> 172.21.15.78:0/3323090298 conn(0x7feb0c0cd530 msgr2=0x7feb0c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.205+0000 7feb12030640 1 -- 172.21.15.78:0/3323090298 shutdown_connections 2024-09-17T03:15:17.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.205+0000 7feb12030640 1 -- 172.21.15.78:0/3323090298 wait complete. 2024-09-17T03:15:17.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.207+0000 7feb12030640 1 Processor -- start 2024-09-17T03:15:17.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.207+0000 7feb12030640 1 -- start start 2024-09-17T03:15:17.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.208+0000 7feb12030640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb0c06cde0 0x7feb0c0c59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.208+0000 7feb12030640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb0c06e470 0x7feb0c0ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.208+0000 7feb12030640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c15cd50 0x7feb0c1f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.208+0000 7feb12030640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feb0c0cbb70 con 0x7feb0c15cd50 2024-09-17T03:15:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.208+0000 7feb12030640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7feb0c0cb9f0 con 0x7feb0c06e470 2024-09-17T03:15:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.208+0000 7feb12030640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7feb0c15d870 con 0x7feb0c06cde0 2024-09-17T03:15:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.208+0000 7feb0bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c15cd50 0x7feb0c1f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.208+0000 7feb0bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c15cd50 0x7feb0c1f26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43112/0 (socket says 172.21.15.78:43112) 2024-09-17T03:15:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.208+0000 7feb0bfff640 1 -- 172.21.15.78:0/4229252469 learned_addr learned my addr 172.21.15.78:0/4229252469 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.208+0000 7feb0affd640 1 --2- 172.21.15.78:0/4229252469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb0c06e470 0x7feb0c0ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.208+0000 7feb0b7fe640 1 --2- 172.21.15.78:0/4229252469 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb0c06cde0 0x7feb0c0c59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.209+0000 7feb0bfff640 1 -- 172.21.15.78:0/4229252469 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb0c06cde0 msgr2=0x7feb0c0c59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.209+0000 7feb0bfff640 1 --2- 172.21.15.78:0/4229252469 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb0c06cde0 0x7feb0c0c59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.209+0000 7feb0bfff640 1 -- 172.21.15.78:0/4229252469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb0c06e470 msgr2=0x7feb0c0ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.209+0000 7feb0bfff640 1 --2- 172.21.15.78:0/4229252469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb0c06e470 0x7feb0c0ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.209+0000 7feb0bfff640 1 -- 172.21.15.78:0/4229252469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb0c1e73e0 con 0x7feb0c15cd50 2024-09-17T03:15:17.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.209+0000 7feb0bfff640 1 --2- 172.21.15.78:0/4229252469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c15cd50 0x7feb0c1f26e0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7feb0400b970 tx=0x7feb0400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.209+0000 7feaf3fff640 1 -- 172.21.15.78:0/4229252469 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb04019070 con 0x7feb0c15cd50 2024-09-17T03:15:17.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.209+0000 7feaf3fff640 1 -- 172.21.15.78:0/4229252469 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb0400cc30 con 0x7feb0c15cd50 2024-09-17T03:15:17.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.209+0000 7feb12030640 1 -- 172.21.15.78:0/4229252469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb0c1e76c0 con 0x7feb0c15cd50 2024-09-17T03:15:17.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.209+0000 7feaf3fff640 1 -- 172.21.15.78:0/4229252469 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb040146a0 con 0x7feb0c15cd50 2024-09-17T03:15:17.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.209+0000 7feb12030640 1 -- 172.21.15.78:0/4229252469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb0c0c9840 con 0x7feb0c15cd50 2024-09-17T03:15:17.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.211+0000 7feaf3fff640 1 -- 172.21.15.78:0/4229252469 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7feb0401c070 con 0x7feb0c15cd50 2024-09-17T03:15:17.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.211+0000 7feaf3fff640 1 --2- 172.21.15.78:0/4229252469 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feaf8078b90 0x7feaf807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.211+0000 7feaf3fff640 1 -- 172.21.15.78:0/4229252469 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7feb0409aa60 con 0x7feb0c15cd50 2024-09-17T03:15:17.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.212+0000 7feb0b7fe640 1 --2- 172.21.15.78:0/4229252469 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feaf8078b90 0x7feaf807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.212+0000 7feb1907d740 1 Processor -- start 2024-09-17T03:15:17.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.212+0000 7feb0b7fe640 1 --2- 172.21.15.78:0/4229252469 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feaf8078b90 0x7feaf807b0a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7feb0c073710 tx=0x7feafc00b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.212+0000 7feb1907d740 1 -- start start 2024-09-17T03:15:17.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.213+0000 7feb1907d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32ce390 0x55a2d36baa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.213+0000 7feb1907d740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a2d32a54d0 0x55a2d368f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.214+0000 7feb1907d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32ad6b0 0x55a2d368fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.214+0000 7feb1907d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a2d35e8a60 con 0x55a2d32ad6b0 2024-09-17T03:15:17.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.214+0000 7feb1907d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a2d35d7e90 con 0x55a2d32ce390 2024-09-17T03:15:17.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.214+0000 7feb1907d740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a2d35dbca0 con 0x55a2d32a54d0 2024-09-17T03:15:17.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.214+0000 7feb0bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32ad6b0 0x55a2d368fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.214+0000 7feb0bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32ad6b0 0x55a2d368fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43122/0 (socket says 172.21.15.78:43122) 2024-09-17T03:15:17.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.214+0000 7feb0bfff640 1 -- 172.21.15.78:0/3400221243 learned_addr learned my addr 172.21.15.78:0/3400221243 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.214+0000 7feb0affd640 1 --2- 172.21.15.78:0/3400221243 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a2d32a54d0 0x55a2d368f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.214+0000 7feb0b7fe640 1 --2- 172.21.15.78:0/3400221243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32ce390 0x55a2d36baa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.214+0000 7feb0bfff640 1 -- 172.21.15.78:0/3400221243 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a2d32a54d0 msgr2=0x55a2d368f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.214+0000 7feb0bfff640 1 --2- 172.21.15.78:0/3400221243 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a2d32a54d0 0x55a2d368f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.214+0000 7feb0bfff640 1 -- 172.21.15.78:0/3400221243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32ce390 msgr2=0x55a2d36baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.214+0000 7feb0bfff640 1 --2- 172.21.15.78:0/3400221243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32ce390 0x55a2d36baa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.214+0000 7feb0bfff640 1 -- 172.21.15.78:0/3400221243 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2d33b07d0 con 0x55a2d32ad6b0 2024-09-17T03:15:17.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.214+0000 7feb0bfff640 1 --2- 172.21.15.78:0/3400221243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32ad6b0 0x55a2d368fda0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7feb04098fb0 tx=0x7feb04062060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f20e2f9e3a7ba9be server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.214+0000 7feaf17fa640 1 -- 172.21.15.78:0/3400221243 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb04067320 con 0x55a2d32ad6b0 2024-09-17T03:15:17.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.214+0000 7feaf17fa640 1 -- 172.21.15.78:0/3400221243 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb0406c1d0 con 0x55a2d32ad6b0 2024-09-17T03:15:17.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.214+0000 7feaf17fa640 1 -- 172.21.15.78:0/3400221243 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0406bf40 con 0x55a2d32ad6b0 2024-09-17T03:15:17.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.215+0000 7feb1907d740 1 -- 172.21.15.78:0/3400221243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32ad6b0 msgr2=0x55a2d368fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.215+0000 7feb1907d740 1 --2- 172.21.15.78:0/3400221243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32ad6b0 0x55a2d368fda0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7feb04098fb0 tx=0x7feb04062060 comp rx=0 tx=0).stop 2024-09-17T03:15:17.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.215+0000 7feb1907d740 1 -- 172.21.15.78:0/3400221243 shutdown_connections 2024-09-17T03:15:17.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.215+0000 7feb1907d740 1 --2- 172.21.15.78:0/3400221243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32ad6b0 0x55a2d368fda0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.215+0000 7feb1907d740 1 --2- 172.21.15.78:0/3400221243 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a2d32a54d0 0x55a2d368f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.215+0000 7feb1907d740 1 --2- 172.21.15.78:0/3400221243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32ce390 0x55a2d36baa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.215+0000 7feb1907d740 1 -- 172.21.15.78:0/3400221243 >> 172.21.15.78:0/3400221243 conn(0x55a2d32c24e0 msgr2=0x55a2d3675d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.215+0000 7feb1907d740 1 -- 172.21.15.78:0/3400221243 shutdown_connections 2024-09-17T03:15:17.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.215+0000 7feb1907d740 1 -- 172.21.15.78:0/3400221243 wait complete. 2024-09-17T03:15:17.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.216+0000 7feb1907d740 1 -- start start 2024-09-17T03:15:17.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.216+0000 7feb1907d740 1 Processor -- start 2024-09-17T03:15:17.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.217+0000 7feb1907d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32a54d0 0x55a2d3675e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.217+0000 7feb1907d740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a2d32ad6b0 0x55a2d36b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.217+0000 7feb1907d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32ce390 0x55a2d36b7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.217+0000 7feb1907d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55a2d3348740 con 0x55a2d32a54d0 2024-09-17T03:15:17.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.217+0000 7feb1907d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a2d357d970 con 0x55a2d32ce390 2024-09-17T03:15:17.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.217+0000 7feb1907d740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a2d3689d50 con 0x55a2d32ad6b0 2024-09-17T03:15:17.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.218+0000 7feb1907d740 10 client.0 _ll_register_callbacks cb 0x55a2d358c780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:17.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.218+0000 7feb0b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32a54d0 0x55a2d3675e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.218+0000 7feb0b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32a54d0 0x55a2d3675e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43132/0 (socket says 172.21.15.78:43132) 2024-09-17T03:15:17.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.218+0000 7feb0b7fe640 1 -- 172.21.15.78:0/3402892715 learned_addr learned my addr 172.21.15.78:0/3402892715 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.218+0000 7feb0affd640 1 --2- 172.21.15.78:0/3402892715 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a2d32ad6b0 0x55a2d36b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.218+0000 7feb0bfff640 1 --2- 172.21.15.78:0/3402892715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32ce390 0x55a2d36b7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.218+0000 7feb0b7fe640 1 -- 172.21.15.78:0/3402892715 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a2d32ad6b0 msgr2=0x55a2d36b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.218+0000 7feb0b7fe640 1 --2- 172.21.15.78:0/3402892715 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a2d32ad6b0 0x55a2d36b6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.218+0000 7feb0b7fe640 1 -- 172.21.15.78:0/3402892715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32ce390 msgr2=0x55a2d36b7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.218+0000 7feb0b7fe640 1 --2- 172.21.15.78:0/3402892715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32ce390 0x55a2d36b7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.218+0000 7feb0b7fe640 1 -- 172.21.15.78:0/3402892715 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2d3339970 con 0x55a2d32a54d0 2024-09-17T03:15:17.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.218+0000 7feb0bfff640 1 --2- 172.21.15.78:0/3402892715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32ce390 0x55a2d36b7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:17.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.218+0000 7feb0b7fe640 1 --2- 172.21.15.78:0/3402892715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32a54d0 0x55a2d3675e50 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7feafc0116f0 tx=0x7feafc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c6401b121f2280 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.218+0000 7feaea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:17.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.218+0000 7feaea7fc640 1 -- 172.21.15.78:0/3402892715 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feafc01fa80 con 0x55a2d32a54d0 2024-09-17T03:15:17.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.218+0000 7feb1907d740 1 -- 172.21.15.78:0/3402892715 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb0406c1d0 con 0x55a2d32a54d0 2024-09-17T03:15:17.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.218+0000 7feaea7fc640 1 -- 172.21.15.78:0/3402892715 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7feafc01fc20 con 0x55a2d32a54d0 2024-09-17T03:15:17.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.218+0000 7feaea7fc640 1 -- 172.21.15.78:0/3402892715 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7feafc01fe20 con 0x55a2d32a54d0 2024-09-17T03:15:17.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.218+0000 7feb1907d740 10 client.8925 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:17.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.218+0000 7feb1907d740 1 -- 172.21.15.78:0/3402892715 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x55a2d33176a0 con 0x55a2d32a54d0 2024-09-17T03:15:17.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.219+0000 7feaea7fc640 1 -- 172.21.15.78:0/3402892715 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb0406c1d0 con 0x55a2d32a54d0 2024-09-17T03:15:17.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.219+0000 7feaea7fc640 1 -- 172.21.15.78:0/3402892715 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7feafc030050 con 0x55a2d32a54d0 2024-09-17T03:15:17.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.219+0000 7feb1907d740 10 client.8925 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:17.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.219+0000 7feb1907d740 10 client.8925 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T03:15:17.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.219+0000 7feb1907d740 20 client.8925 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:17.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.219+0000 7feb1907d740 1 --2- 172.21.15.78:0/3402892715 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55a2d328cf60 0x55a2d36748e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.219+0000 7feb1907d740 4 client.8925 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:17.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.219+0000 7feb1907d740 1 -- 172.21.15.78:0/3402892715 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a2d35ea9b0 con 0x55a2d328cf60 2024-09-17T03:15:17.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.219+0000 7feb0affd640 1 --2- 172.21.15.78:0/3402892715 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55a2d328cf60 0x55a2d36748e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.219+0000 7feaea7fc640 10 client.8925 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:17.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.219+0000 7feb0affd640 1 --2- 172.21.15.78:0/3402892715 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55a2d328cf60 0x55a2d36748e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3ee1aec5a9d939e server_cookie=daf2262b338abc26 in_seq=0 out_seq=0 2024-09-17T03:15:17.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.220+0000 7feaea7fc640 1 -- 172.21.15.78:0/3402892715 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a2d35ea9b0 con 0x55a2d328cf60 2024-09-17T03:15:17.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.220+0000 7feaea7fc640 10 client.8925 handle_command_reply: tid=0 2024-09-17T03:15:17.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.220+0000 7feb1907d740 1 client.8925 shutdown 2024-09-17T03:15:17.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.220+0000 7feb1907d740 1 -- 172.21.15.78:0/3402892715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32a54d0 msgr2=0x55a2d3675e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.220+0000 7feb1907d740 1 --2- 172.21.15.78:0/3402892715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32a54d0 0x55a2d3675e50 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7feafc0116f0 tx=0x7feafc004730 comp rx=0 tx=0).stop 2024-09-17T03:15:17.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.220+0000 7feb1907d740 1 -- 172.21.15.78:0/3402892715 shutdown_connections 2024-09-17T03:15:17.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.220+0000 7feb1907d740 1 --2- 172.21.15.78:0/3402892715 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55a2d328cf60 0x55a2d36748e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.220+0000 7feb1907d740 1 --2- 172.21.15.78:0/3402892715 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32ce390 0x55a2d36b7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.220+0000 7feb1907d740 1 --2- 172.21.15.78:0/3402892715 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a2d32ad6b0 0x55a2d36b6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.220+0000 7feaea7fc640 0 client.8925 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:17.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.220+0000 7feb1907d740 1 --2- 172.21.15.78:0/3402892715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32a54d0 0x55a2d3675e50 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.220+0000 7feb1907d740 1 -- 172.21.15.78:0/3402892715 >> 172.21.15.78:0/3402892715 conn(0x55a2d32c24e0 msgr2=0x55a2d3670a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.220+0000 7feb1907d740 1 -- 172.21.15.78:0/3402892715 shutdown_connections 2024-09-17T03:15:17.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.220+0000 7feb1907d740 1 -- 172.21.15.78:0/3402892715 wait complete. 2024-09-17T03:15:17.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.220+0000 7feb1907d740 20 client.8925 trim_cache size 0 max 16384 2024-09-17T03:15:17.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.237+0000 7feb1907d740 1 Processor -- start 2024-09-17T03:15:17.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.238+0000 7feb1907d740 1 -- start start 2024-09-17T03:15:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.239+0000 7feb1907d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32c24e0 0x55a2d36ddac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.239+0000 7feb1907d740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a2d32a54d0 0x55a2d36cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.239+0000 7feb1907d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32ad6b0 0x55a2d36cc620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.239+0000 7feb1907d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feb0c200140 con 0x55a2d32c24e0 2024-09-17T03:15:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.239+0000 7feb1907d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7feb0c1e66c0 con 0x55a2d32ad6b0 2024-09-17T03:15:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.239+0000 7feb1907d740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7feb0c1e6df0 con 0x55a2d32a54d0 2024-09-17T03:15:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.239+0000 7feb0b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32c24e0 0x55a2d36ddac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.239+0000 7feb0b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32c24e0 0x55a2d36ddac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43138/0 (socket says 172.21.15.78:43138) 2024-09-17T03:15:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.239+0000 7feb0b7fe640 1 -- 172.21.15.78:0/2246032566 learned_addr learned my addr 172.21.15.78:0/2246032566 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.239+0000 7feb0affd640 1 --2- 172.21.15.78:0/2246032566 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a2d32a54d0 0x55a2d36cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.239+0000 7feb0bfff640 1 --2- 172.21.15.78:0/2246032566 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32ad6b0 0x55a2d36cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.239+0000 7feb0b7fe640 1 -- 172.21.15.78:0/2246032566 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a2d32a54d0 msgr2=0x55a2d36cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.239+0000 7feb0b7fe640 1 --2- 172.21.15.78:0/2246032566 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a2d32a54d0 0x55a2d36cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.239+0000 7feb0b7fe640 1 -- 172.21.15.78:0/2246032566 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32ad6b0 msgr2=0x55a2d36cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.239+0000 7feb0b7fe640 1 --2- 172.21.15.78:0/2246032566 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32ad6b0 0x55a2d36cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.239+0000 7feb0b7fe640 1 -- 172.21.15.78:0/2246032566 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a2d36b16e0 con 0x55a2d32c24e0 2024-09-17T03:15:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.239+0000 7feb0b7fe640 1 --2- 172.21.15.78:0/2246032566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32c24e0 0x55a2d36ddac0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7feafc000c00 tx=0x7feafc0324c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f273b39f4a605570 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.240+0000 7feaf0ff9640 1 -- 172.21.15.78:0/2246032566 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feafc01f230 con 0x55a2d32c24e0 2024-09-17T03:15:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.240+0000 7feaf0ff9640 1 -- 172.21.15.78:0/2246032566 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feafc0326b0 con 0x55a2d32c24e0 2024-09-17T03:15:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.240+0000 7feaf0ff9640 1 -- 172.21.15.78:0/2246032566 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feafc01fae0 con 0x55a2d32c24e0 2024-09-17T03:15:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.240+0000 7feb1907d740 1 -- 172.21.15.78:0/2246032566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32c24e0 msgr2=0x55a2d36ddac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.240+0000 7feb1907d740 1 --2- 172.21.15.78:0/2246032566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32c24e0 0x55a2d36ddac0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7feafc000c00 tx=0x7feafc0324c0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.240+0000 7feb1907d740 1 -- 172.21.15.78:0/2246032566 shutdown_connections 2024-09-17T03:15:17.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.240+0000 7feb1907d740 1 --2- 172.21.15.78:0/2246032566 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32ad6b0 0x55a2d36cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.240+0000 7feb1907d740 1 --2- 172.21.15.78:0/2246032566 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a2d32a54d0 0x55a2d36cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.240+0000 7feb1907d740 1 --2- 172.21.15.78:0/2246032566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32c24e0 0x55a2d36ddac0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.240+0000 7feb1907d740 1 -- 172.21.15.78:0/2246032566 >> 172.21.15.78:0/2246032566 conn(0x55a2d36b0aa0 msgr2=0x55a2d3674f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.241+0000 7feb1907d740 1 -- 172.21.15.78:0/2246032566 shutdown_connections 2024-09-17T03:15:17.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.241+0000 7feb1907d740 1 -- 172.21.15.78:0/2246032566 wait complete. 2024-09-17T03:15:17.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.241+0000 7feb1907d740 1 -- start start 2024-09-17T03:15:17.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.241+0000 7feb1907d740 1 Processor -- start 2024-09-17T03:15:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feb1907d740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a2d32a54d0 0x55a2d373cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feb1907d740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32ad6b0 0x55a2d3687770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feb1907d740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32c24e0 0x55a2d3687cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feb1907d740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7feb0c0c9610 con 0x55a2d32ad6b0 2024-09-17T03:15:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feb1907d740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55a2d373b2d0 con 0x55a2d32c24e0 2024-09-17T03:15:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feb1907d740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55a2d373a930 con 0x55a2d32a54d0 2024-09-17T03:15:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feb1907d740 10 client.0 _ll_register_callbacks cb 0x7feafc010f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:17.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feb0affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32ad6b0 0x55a2d3687770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feb0affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32ad6b0 0x55a2d3687770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43146/0 (socket says 172.21.15.78:43146) 2024-09-17T03:15:17.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feb0affd640 1 -- 172.21.15.78:0/2966337828 learned_addr learned my addr 172.21.15.78:0/2966337828 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feb0b7fe640 1 --2- 172.21.15.78:0/2966337828 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a2d32a54d0 0x55a2d373cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feb0bfff640 1 --2- 172.21.15.78:0/2966337828 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32c24e0 0x55a2d3687cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feb0affd640 1 -- 172.21.15.78:0/2966337828 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a2d32a54d0 msgr2=0x55a2d373cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feb0affd640 1 --2- 172.21.15.78:0/2966337828 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a2d32a54d0 0x55a2d373cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feb0affd640 1 -- 172.21.15.78:0/2966337828 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32c24e0 msgr2=0x55a2d3687cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feb0affd640 1 --2- 172.21.15.78:0/2966337828 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32c24e0 0x55a2d3687cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feb0affd640 1 -- 172.21.15.78:0/2966337828 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a2d367b2a0 con 0x55a2d32ad6b0 2024-09-17T03:15:17.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feb0affd640 1 --2- 172.21.15.78:0/2966337828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32ad6b0 0x55a2d3687770 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7feb00009230 tx=0x7feb000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43799f3f3da69105 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feaea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:17.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feaea7fc640 1 -- 172.21.15.78:0/2966337828 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb0004a070 con 0x55a2d32ad6b0 2024-09-17T03:15:17.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feaea7fc640 1 -- 172.21.15.78:0/2966337828 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7feb000037f0 con 0x55a2d32ad6b0 2024-09-17T03:15:17.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.243+0000 7feb1907d740 1 -- 172.21.15.78:0/2966337828 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feafc0326b0 con 0x55a2d32ad6b0 2024-09-17T03:15:17.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.244+0000 7feaea7fc640 1 -- 172.21.15.78:0/2966337828 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7feb00055050 con 0x55a2d32ad6b0 2024-09-17T03:15:17.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.244+0000 7feb1907d740 10 client.8931 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:17.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.244+0000 7feb1907d740 1 -- 172.21.15.78:0/2966337828 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x55a2d373b0d0 con 0x55a2d32ad6b0 2024-09-17T03:15:17.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.244+0000 7feaea7fc640 1 -- 172.21.15.78:0/2966337828 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feafc0326b0 con 0x55a2d32ad6b0 2024-09-17T03:15:17.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.244+0000 7feaea7fc640 1 -- 172.21.15.78:0/2966337828 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7feb00058020 con 0x55a2d32ad6b0 2024-09-17T03:15:17.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.244+0000 7feb1907d740 10 client.8931 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:17.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.244+0000 7feb1907d740 10 client.8931 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T03:15:17.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.244+0000 7feb1907d740 20 client.8931 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:17.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.244+0000 7feb1907d740 1 --2- 172.21.15.78:0/2966337828 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55a2d32623a0 0x55a2d36b6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.244+0000 7feb1907d740 4 client.8931 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "scrub resume"}] 2024-09-17T03:15:17.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.244+0000 7feb1907d740 1 -- 172.21.15.78:0/2966337828 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "scrub resume"}) -- 0x55a2d35e6460 con 0x55a2d32623a0 2024-09-17T03:15:17.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.244+0000 7feb0b7fe640 1 --2- 172.21.15.78:0/2966337828 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55a2d32623a0 0x55a2d36b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.244+0000 7feaea7fc640 10 client.8931 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:17.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.245+0000 7feb0b7fe640 1 --2- 172.21.15.78:0/2966337828 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55a2d32623a0 0x55a2d36b6890 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42ebd26904d7d898 server_cookie=2b063f9c225be686 in_seq=0 out_seq=0 2024-09-17T03:15:17.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.245+0000 7feaea7fc640 1 -- 172.21.15.78:0/2966337828 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+25 (crc 0 0 0) 0x55a2d35e6460 con 0x55a2d32623a0 2024-09-17T03:15:17.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.245+0000 7feaea7fc640 10 client.8931 handle_command_reply: tid=0 2024-09-17T03:15:17.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.245+0000 7feb1907d740 1 client.8931 shutdown 2024-09-17T03:15:17.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.245+0000 7feb1907d740 1 -- 172.21.15.78:0/2966337828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32ad6b0 msgr2=0x55a2d3687770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.245+0000 7feb1907d740 1 --2- 172.21.15.78:0/2966337828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32ad6b0 0x55a2d3687770 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7feb00009230 tx=0x7feb000046c0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.245+0000 7feb1907d740 1 -- 172.21.15.78:0/2966337828 shutdown_connections 2024-09-17T03:15:17.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.245+0000 7feb1907d740 1 --2- 172.21.15.78:0/2966337828 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55a2d32623a0 0x55a2d36b6890 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.245+0000 7feb1907d740 1 --2- 172.21.15.78:0/2966337828 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55a2d32c24e0 0x55a2d3687cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.245+0000 7feaea7fc640 0 client.8931 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:17.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.245+0000 7feb1907d740 1 --2- 172.21.15.78:0/2966337828 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55a2d32ad6b0 0x55a2d3687770 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.245+0000 7feb1907d740 1 --2- 172.21.15.78:0/2966337828 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55a2d32a54d0 0x55a2d373cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.245+0000 7feb1907d740 1 -- 172.21.15.78:0/2966337828 >> 172.21.15.78:0/2966337828 conn(0x55a2d36b0aa0 msgr2=0x55a2d369c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.245+0000 7feb1907d740 1 -- 172.21.15.78:0/2966337828 shutdown_connections 2024-09-17T03:15:17.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.245+0000 7feb1907d740 1 -- 172.21.15.78:0/2966337828 wait complete. 2024-09-17T03:15:17.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.245+0000 7feb1907d740 20 client.8931 trim_cache size 0 max 16384 2024-09-17T03:15:17.250 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:17.251 INFO:teuthology.orchestra.run.smithi078.stdout: "return_code": 0 2024-09-17T03:15:17.251 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.246+0000 7feb12030640 1 -- 172.21.15.78:0/4229252469 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feaf8078b90 msgr2=0x7feaf807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.246+0000 7feb12030640 1 --2- 172.21.15.78:0/4229252469 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feaf8078b90 0x7feaf807b0a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7feb0c073710 tx=0x7feafc00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.246+0000 7feb12030640 1 -- 172.21.15.78:0/4229252469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c15cd50 msgr2=0x7feb0c1f26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.246+0000 7feb12030640 1 --2- 172.21.15.78:0/4229252469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c15cd50 0x7feb0c1f26e0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7feb0400b970 tx=0x7feb0400be30 comp rx=0 tx=0).stop 2024-09-17T03:15:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.246+0000 7feb12030640 1 -- 172.21.15.78:0/4229252469 shutdown_connections 2024-09-17T03:15:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.246+0000 7feb12030640 1 --2- 172.21.15.78:0/4229252469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb0c15cd50 0x7feb0c1f26e0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.246+0000 7feb12030640 1 --2- 172.21.15.78:0/4229252469 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7feaf8078b90 0x7feaf807b0a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.246+0000 7feb12030640 1 --2- 172.21.15.78:0/4229252469 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb0c06e470 0x7feb0c0ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.246+0000 7feb12030640 1 --2- 172.21.15.78:0/4229252469 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb0c06cde0 0x7feb0c0c59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.246+0000 7feb12030640 1 -- 172.21.15.78:0/4229252469 >> 172.21.15.78:0/4229252469 conn(0x7feb0c0cd530 msgr2=0x7feb0c15f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.246+0000 7feb12030640 1 -- 172.21.15.78:0/4229252469 shutdown_connections 2024-09-17T03:15:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.246+0000 7feb12030640 1 -- 172.21.15.78:0/4229252469 wait complete. 2024-09-17T03:15:17.255 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:15:17.256 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:1 scrub status 2024-09-17T03:15:17.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.372+0000 7fadb6d72640 1 -- 172.21.15.78:0/765129282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad98003a50 msgr2=0x7fad98003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.372+0000 7fadb6d72640 1 --2- 172.21.15.78:0/765129282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad98003a50 0x7fad98003ec0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fadac001690 tx=0x7fad98005830 comp rx=0 tx=0).stop 2024-09-17T03:15:17.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.372+0000 7fadb6d72640 1 -- 172.21.15.78:0/765129282 shutdown_connections 2024-09-17T03:15:17.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.372+0000 7fadb6d72640 1 --2- 172.21.15.78:0/765129282 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fad98003a50 0x7fad98003ec0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.372+0000 7fadb6d72640 1 -- 172.21.15.78:0/765129282 >> 172.21.15.78:0/765129282 conn(0x7fadb00d15f0 msgr2=0x7fadb0073740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.372+0000 7fadb6d72640 1 -- 172.21.15.78:0/765129282 shutdown_connections 2024-09-17T03:15:17.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.372+0000 7fadb6d72640 1 -- 172.21.15.78:0/765129282 wait complete. 2024-09-17T03:15:17.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.374+0000 7fadb6d72640 1 Processor -- start 2024-09-17T03:15:17.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.374+0000 7fadb6d72640 1 -- start start 2024-09-17T03:15:17.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.375+0000 7fadb6d72640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad98003a50 0x7fadb0153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.375+0000 7fadb6d72640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb0147490 0x7fadb01f6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.375+0000 7fadb6d72640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fadb01f6ed0 0x7fadb01f5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.375+0000 7fadb6d72640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fadb00ce230 con 0x7fadb0147490 2024-09-17T03:15:17.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.375+0000 7fadb6d72640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fadb00ce0b0 con 0x7fad98003a50 2024-09-17T03:15:17.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.375+0000 7fadb6d72640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fadb00ce3b0 con 0x7fadb01f6ed0 2024-09-17T03:15:17.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.375+0000 7fada7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb0147490 0x7fadb01f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.375+0000 7fada7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb0147490 0x7fadb01f6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43164/0 (socket says 172.21.15.78:43164) 2024-09-17T03:15:17.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.375+0000 7fada7fff640 1 -- 172.21.15.78:0/2962772544 learned_addr learned my addr 172.21.15.78:0/2962772544 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.375+0000 7fadb4b0e640 1 --2- 172.21.15.78:0/2962772544 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad98003a50 0x7fadb0153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.375+0000 7fadb530f640 1 --2- 172.21.15.78:0/2962772544 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fadb01f6ed0 0x7fadb01f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.375+0000 7fada7fff640 1 -- 172.21.15.78:0/2962772544 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fadb01f6ed0 msgr2=0x7fadb01f5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.376+0000 7fada7fff640 1 --2- 172.21.15.78:0/2962772544 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fadb01f6ed0 0x7fadb01f5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.376+0000 7fada7fff640 1 -- 172.21.15.78:0/2962772544 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad98003a50 msgr2=0x7fadb0153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.376+0000 7fada7fff640 1 --2- 172.21.15.78:0/2962772544 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad98003a50 0x7fadb0153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.376+0000 7fada7fff640 1 -- 172.21.15.78:0/2962772544 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb01f72e0 con 0x7fadb0147490 2024-09-17T03:15:17.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.376+0000 7fadb530f640 1 --2- 172.21.15.78:0/2962772544 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fadb01f6ed0 0x7fadb01f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:17.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.376+0000 7fada7fff640 1 --2- 172.21.15.78:0/2962772544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb0147490 0x7fadb01f6990 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fada000e590 tx=0x7fada000ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.376+0000 7fada57fa640 1 -- 172.21.15.78:0/2962772544 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada0015070 con 0x7fadb0147490 2024-09-17T03:15:17.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.376+0000 7fada57fa640 1 -- 172.21.15.78:0/2962772544 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fada0010980 con 0x7fadb0147490 2024-09-17T03:15:17.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.376+0000 7fadb6d72640 1 -- 172.21.15.78:0/2962772544 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadb0156790 con 0x7fadb0147490 2024-09-17T03:15:17.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.376+0000 7fada57fa640 1 -- 172.21.15.78:0/2962772544 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada0010dd0 con 0x7fadb0147490 2024-09-17T03:15:17.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.376+0000 7fadb6d72640 1 -- 172.21.15.78:0/2962772544 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadb01f47b0 con 0x7fadb0147490 2024-09-17T03:15:17.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.378+0000 7fada57fa640 1 -- 172.21.15.78:0/2962772544 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fada0018070 con 0x7fadb0147490 2024-09-17T03:15:17.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.378+0000 7fada57fa640 1 --2- 172.21.15.78:0/2962772544 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fad9c078bc0 0x7fad9c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.379+0000 7fada57fa640 1 -- 172.21.15.78:0/2962772544 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fada009af70 con 0x7fadb0147490 2024-09-17T03:15:17.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.379+0000 7fadb4b0e640 1 --2- 172.21.15.78:0/2962772544 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fad9c078bc0 0x7fad9c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.379+0000 7fadbddc1740 1 Processor -- start 2024-09-17T03:15:17.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.379+0000 7fadb4b0e640 1 --2- 172.21.15.78:0/2962772544 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fad9c078bc0 0x7fad9c07b0d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fadac032000 tx=0x7fadac0011d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.379+0000 7fadbddc1740 1 -- start start 2024-09-17T03:15:17.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.380+0000 7fadbddc1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b77390 0x564583f63a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.380+0000 7fadbddc1740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b4e4d0 0x564583f38860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.380+0000 7fadbddc1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 0x564583f38da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.380+0000 7fadbddc1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x564583e91a60 con 0x564583b566b0 2024-09-17T03:15:17.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.380+0000 7fadbddc1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564583e80e90 con 0x564583b77390 2024-09-17T03:15:17.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.380+0000 7fadbddc1740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x564583e84ca0 con 0x564583b4e4d0 2024-09-17T03:15:17.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.381+0000 7fadb530f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 0x564583f38da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.381+0000 7fadb530f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 0x564583f38da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43172/0 (socket says 172.21.15.78:43172) 2024-09-17T03:15:17.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.381+0000 7fadb530f640 1 -- 172.21.15.78:0/3336122784 learned_addr learned my addr 172.21.15.78:0/3336122784 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.381+0000 7fada7fff640 1 --2- 172.21.15.78:0/3336122784 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b4e4d0 0x564583f38860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.381+0000 7fadb4b0e640 1 --2- 172.21.15.78:0/3336122784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b77390 0x564583f63a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.381+0000 7fadb530f640 1 -- 172.21.15.78:0/3336122784 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b4e4d0 msgr2=0x564583f38860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.381+0000 7fadb530f640 1 --2- 172.21.15.78:0/3336122784 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b4e4d0 0x564583f38860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.381+0000 7fadb530f640 1 -- 172.21.15.78:0/3336122784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b77390 msgr2=0x564583f63a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.381+0000 7fadb530f640 1 --2- 172.21.15.78:0/3336122784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b77390 0x564583f63a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.381+0000 7fadb530f640 1 -- 172.21.15.78:0/3336122784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564583c597d0 con 0x564583b566b0 2024-09-17T03:15:17.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.381+0000 7fadb530f640 1 --2- 172.21.15.78:0/3336122784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 0x564583f38da0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fada8005fd0 tx=0x7fada8003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47baf8e9696cc02c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.381+0000 7fad967fc640 1 -- 172.21.15.78:0/3336122784 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada8004820 con 0x564583b566b0 2024-09-17T03:15:17.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.381+0000 7fad967fc640 1 -- 172.21.15.78:0/3336122784 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fada8004b20 con 0x564583b566b0 2024-09-17T03:15:17.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.381+0000 7fad967fc640 1 -- 172.21.15.78:0/3336122784 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada8005020 con 0x564583b566b0 2024-09-17T03:15:17.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.382+0000 7fadbddc1740 1 -- 172.21.15.78:0/3336122784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 msgr2=0x564583f38da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.382+0000 7fadbddc1740 1 --2- 172.21.15.78:0/3336122784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 0x564583f38da0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fada8005fd0 tx=0x7fada8003d40 comp rx=0 tx=0).stop 2024-09-17T03:15:17.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.382+0000 7fadbddc1740 1 -- 172.21.15.78:0/3336122784 shutdown_connections 2024-09-17T03:15:17.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.382+0000 7fadbddc1740 1 --2- 172.21.15.78:0/3336122784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 0x564583f38da0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.382+0000 7fadbddc1740 1 --2- 172.21.15.78:0/3336122784 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b4e4d0 0x564583f38860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.382+0000 7fadbddc1740 1 --2- 172.21.15.78:0/3336122784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b77390 0x564583f63a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.382+0000 7fadbddc1740 1 -- 172.21.15.78:0/3336122784 >> 172.21.15.78:0/3336122784 conn(0x564583b6b4e0 msgr2=0x564583f1ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.382+0000 7fadbddc1740 1 -- 172.21.15.78:0/3336122784 shutdown_connections 2024-09-17T03:15:17.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.382+0000 7fadbddc1740 1 -- 172.21.15.78:0/3336122784 wait complete. 2024-09-17T03:15:17.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.383+0000 7fadbddc1740 1 -- start start 2024-09-17T03:15:17.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.383+0000 7fadbddc1740 1 Processor -- start 2024-09-17T03:15:17.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.384+0000 7fadbddc1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b4e4d0 0x564583f59710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.384+0000 7fadbddc1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 0x564583f5d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.384+0000 7fadbddc1740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b77390 0x564583f5a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.384+0000 7fadbddc1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x564583bf1740 con 0x564583b566b0 2024-09-17T03:15:17.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.384+0000 7fadbddc1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564583e26970 con 0x564583b4e4d0 2024-09-17T03:15:17.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.384+0000 7fadbddc1740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x564583f5fa60 con 0x564583b77390 2024-09-17T03:15:17.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.384+0000 7fadbddc1740 10 client.0 _ll_register_callbacks cb 0x564583e35780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:17.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.385+0000 7fada7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 0x564583f5d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.385+0000 7fada7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 0x564583f5d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43180/0 (socket says 172.21.15.78:43180) 2024-09-17T03:15:17.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.385+0000 7fada7fff640 1 -- 172.21.15.78:0/1224289611 learned_addr learned my addr 172.21.15.78:0/1224289611 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.385+0000 7fadb530f640 1 --2- 172.21.15.78:0/1224289611 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b77390 0x564583f5a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.385+0000 7fadb4b0e640 1 --2- 172.21.15.78:0/1224289611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b4e4d0 0x564583f59710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.385+0000 7fada7fff640 1 -- 172.21.15.78:0/1224289611 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b77390 msgr2=0x564583f5a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.385+0000 7fada7fff640 1 --2- 172.21.15.78:0/1224289611 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b77390 0x564583f5a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.385+0000 7fada7fff640 1 -- 172.21.15.78:0/1224289611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b4e4d0 msgr2=0x564583f59710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.385+0000 7fada7fff640 1 --2- 172.21.15.78:0/1224289611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b4e4d0 0x564583f59710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.385+0000 7fada7fff640 1 -- 172.21.15.78:0/1224289611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564583be2970 con 0x564583b566b0 2024-09-17T03:15:17.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.385+0000 7fada7fff640 1 --2- 172.21.15.78:0/1224289611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 0x564583f5d590 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fada00600f0 tx=0x7fada0062720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6729f65fcb35c82b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.385+0000 7fad8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:17.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.385+0000 7fad8f7fe640 1 -- 172.21.15.78:0/1224289611 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada0089020 con 0x564583b566b0 2024-09-17T03:15:17.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.385+0000 7fad8f7fe640 1 -- 172.21.15.78:0/1224289611 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fada004be70 con 0x564583b566b0 2024-09-17T03:15:17.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.385+0000 7fadbddc1740 1 -- 172.21.15.78:0/1224289611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fada8004b20 con 0x564583b566b0 2024-09-17T03:15:17.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.385+0000 7fad8f7fe640 1 -- 172.21.15.78:0/1224289611 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7fada0078e60 con 0x564583b566b0 2024-09-17T03:15:17.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.385+0000 7fadbddc1740 10 client.8943 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:17.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.385+0000 7fadbddc1740 1 -- 172.21.15.78:0/1224289611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x564583bc06a0 con 0x564583b566b0 2024-09-17T03:15:17.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.385+0000 7fad8f7fe640 1 -- 172.21.15.78:0/1224289611 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fada8004b20 con 0x564583b566b0 2024-09-17T03:15:17.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.386+0000 7fad8f7fe640 1 -- 172.21.15.78:0/1224289611 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7fada004e1b0 con 0x564583b566b0 2024-09-17T03:15:17.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.386+0000 7fadbddc1740 10 client.8943 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:17.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.386+0000 7fadbddc1740 10 client.8943 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2024-09-17T03:15:17.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.386+0000 7fadbddc1740 20 client.8943 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:17.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.386+0000 7fadbddc1740 1 --2- 172.21.15.78:0/1224289611 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x564583b35f60 0x564583f48880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.386+0000 7fadbddc1740 4 client.8943 mds_command: new command op to 8283 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:17.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.386+0000 7fadbddc1740 1 -- 172.21.15.78:0/1224289611 --> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564583e939b0 con 0x564583b35f60 2024-09-17T03:15:17.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.386+0000 7fadb4b0e640 1 --2- 172.21.15.78:0/1224289611 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x564583b35f60 0x564583f48880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.386+0000 7fad8f7fe640 10 client.8943 ms_handle_connect on v2:172.21.15.78:6832/1810198137 2024-09-17T03:15:17.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.386+0000 7fadb4b0e640 1 --2- 172.21.15.78:0/1224289611 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x564583b35f60 0x564583f48880 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=52a934277a9aa54e server_cookie=1ea4b8b72623acb in_seq=0 out_seq=0 2024-09-17T03:15:17.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.387+0000 7fad8f7fe640 1 -- 172.21.15.78:0/1224289611 <== mds.1 v2:172.21.15.78:6832/1810198137 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564583e939b0 con 0x564583b35f60 2024-09-17T03:15:17.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.387+0000 7fad8f7fe640 10 client.8943 handle_command_reply: tid=0 2024-09-17T03:15:17.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.387+0000 7fadbddc1740 1 client.8943 shutdown 2024-09-17T03:15:17.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.387+0000 7fadbddc1740 1 -- 172.21.15.78:0/1224289611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 msgr2=0x564583f5d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.387+0000 7fadbddc1740 1 --2- 172.21.15.78:0/1224289611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 0x564583f5d590 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fada00600f0 tx=0x7fada0062720 comp rx=0 tx=0).stop 2024-09-17T03:15:17.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.387+0000 7fadbddc1740 1 -- 172.21.15.78:0/1224289611 shutdown_connections 2024-09-17T03:15:17.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.387+0000 7fadbddc1740 1 --2- 172.21.15.78:0/1224289611 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x564583b35f60 0x564583f48880 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.387+0000 7fadbddc1740 1 --2- 172.21.15.78:0/1224289611 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b77390 0x564583f5a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.387+0000 7fad8f7fe640 0 client.8943 ms_handle_reset on v2:172.21.15.78:6832/1810198137 2024-09-17T03:15:17.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.387+0000 7fadbddc1740 1 --2- 172.21.15.78:0/1224289611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 0x564583f5d590 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.387+0000 7fadbddc1740 1 --2- 172.21.15.78:0/1224289611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b4e4d0 0x564583f59710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.387+0000 7fadbddc1740 1 -- 172.21.15.78:0/1224289611 >> 172.21.15.78:0/1224289611 conn(0x564583b6b4e0 msgr2=0x564583f61290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.387+0000 7fadbddc1740 1 -- 172.21.15.78:0/1224289611 shutdown_connections 2024-09-17T03:15:17.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.387+0000 7fadbddc1740 1 -- 172.21.15.78:0/1224289611 wait complete. 2024-09-17T03:15:17.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.387+0000 7fadbddc1740 20 client.8943 trim_cache size 0 max 16384 2024-09-17T03:15:17.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.405+0000 7fadbddc1740 1 Processor -- start 2024-09-17T03:15:17.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.405+0000 7fadbddc1740 1 -- start start 2024-09-17T03:15:17.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.406+0000 7fadbddc1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b4e4d0 0x564583f38b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.406+0000 7fadbddc1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 0x564583f5fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.406+0000 7fadbddc1740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b77390 0x564583f60130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.406+0000 7fadbddc1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fadb0200100 con 0x564583b566b0 2024-09-17T03:15:17.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.406+0000 7fadbddc1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fadb01ff2a0 con 0x564583b4e4d0 2024-09-17T03:15:17.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.406+0000 7fadbddc1740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fadb01ff9d0 con 0x564583b77390 2024-09-17T03:15:17.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.406+0000 7fada7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 0x564583f5fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.406+0000 7fada7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 0x564583f5fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43184/0 (socket says 172.21.15.78:43184) 2024-09-17T03:15:17.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.406+0000 7fada7fff640 1 -- 172.21.15.78:0/1392183334 learned_addr learned my addr 172.21.15.78:0/1392183334 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.406+0000 7fadb530f640 1 --2- 172.21.15.78:0/1392183334 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b77390 0x564583f60130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.406+0000 7fada7fff640 1 -- 172.21.15.78:0/1392183334 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b77390 msgr2=0x564583f60130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.406+0000 7fadb4b0e640 1 --2- 172.21.15.78:0/1392183334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b4e4d0 0x564583f38b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.406+0000 7fada7fff640 1 --2- 172.21.15.78:0/1392183334 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b77390 0x564583f60130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.406+0000 7fada7fff640 1 -- 172.21.15.78:0/1392183334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b4e4d0 msgr2=0x564583f38b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.406+0000 7fada7fff640 1 --2- 172.21.15.78:0/1392183334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b4e4d0 0x564583f38b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.406+0000 7fada7fff640 1 -- 172.21.15.78:0/1392183334 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564583f1acd0 con 0x564583b566b0 2024-09-17T03:15:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.406+0000 7fadb530f640 1 --2- 172.21.15.78:0/1392183334 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b77390 0x564583f60130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.406+0000 7fadb4b0e640 1 --2- 172.21.15.78:0/1392183334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b4e4d0 0x564583f38b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.407+0000 7fada7fff640 1 --2- 172.21.15.78:0/1392183334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 0x564583f5fbf0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fada009b290 tx=0x7fada006c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297aa4c0bfc2cefd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.407+0000 7fad95ffb640 1 -- 172.21.15.78:0/1392183334 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada0089040 con 0x564583b566b0 2024-09-17T03:15:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.407+0000 7fad95ffb640 1 -- 172.21.15.78:0/1392183334 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fada00993e0 con 0x564583b566b0 2024-09-17T03:15:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.407+0000 7fad95ffb640 1 -- 172.21.15.78:0/1392183334 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fada001f070 con 0x564583b566b0 2024-09-17T03:15:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.407+0000 7fadbddc1740 1 -- 172.21.15.78:0/1392183334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 msgr2=0x564583f5fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.407+0000 7fadbddc1740 1 --2- 172.21.15.78:0/1392183334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 0x564583f5fbf0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fada009b290 tx=0x7fada006c8c0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.408+0000 7fadbddc1740 1 -- 172.21.15.78:0/1392183334 shutdown_connections 2024-09-17T03:15:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.408+0000 7fadbddc1740 1 --2- 172.21.15.78:0/1392183334 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b77390 0x564583f60130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.408+0000 7fadbddc1740 1 --2- 172.21.15.78:0/1392183334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b566b0 0x564583f5fbf0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.408+0000 7fadbddc1740 1 --2- 172.21.15.78:0/1392183334 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b4e4d0 0x564583f38b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.408+0000 7fadbddc1740 1 -- 172.21.15.78:0/1392183334 >> 172.21.15.78:0/1392183334 conn(0x564583b6b4e0 msgr2=0x564583f592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.408+0000 7fadbddc1740 1 -- 172.21.15.78:0/1392183334 shutdown_connections 2024-09-17T03:15:17.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.408+0000 7fadbddc1740 1 -- 172.21.15.78:0/1392183334 wait complete. 2024-09-17T03:15:17.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.408+0000 7fadbddc1740 1 -- start start 2024-09-17T03:15:17.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.409+0000 7fadbddc1740 1 Processor -- start 2024-09-17T03:15:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.410+0000 7fadbddc1740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b4e4d0 0x564583fe6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.410+0000 7fadbddc1740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b566b0 0x564583fe3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.410+0000 7fadbddc1740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b77390 0x564583f37010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.410+0000 7fadbddc1740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fadb01f6060 con 0x564583b4e4d0 2024-09-17T03:15:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.410+0000 7fadbddc1740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564583e89f20 con 0x564583b566b0 2024-09-17T03:15:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.410+0000 7fadbddc1740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x564583fe7800 con 0x564583b77390 2024-09-17T03:15:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.410+0000 7fadbddc1740 10 client.0 _ll_register_callbacks cb 0x7fada00016b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.410+0000 7fadb4b0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b4e4d0 0x564583fe6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.410+0000 7fadb4b0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b4e4d0 0x564583fe6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43188/0 (socket says 172.21.15.78:43188) 2024-09-17T03:15:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.410+0000 7fadb4b0e640 1 -- 172.21.15.78:0/135615840 learned_addr learned my addr 172.21.15.78:0/135615840 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.410+0000 7fadb530f640 1 --2- 172.21.15.78:0/135615840 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b77390 0x564583f37010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.410+0000 7fada7fff640 1 --2- 172.21.15.78:0/135615840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b566b0 0x564583fe3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.410+0000 7fadb4b0e640 1 -- 172.21.15.78:0/135615840 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b77390 msgr2=0x564583f37010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.410+0000 7fadb4b0e640 1 --2- 172.21.15.78:0/135615840 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b77390 0x564583f37010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.410+0000 7fadb4b0e640 1 -- 172.21.15.78:0/135615840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b566b0 msgr2=0x564583fe3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.410+0000 7fadb4b0e640 1 --2- 172.21.15.78:0/135615840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b566b0 0x564583fe3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.410+0000 7fadb4b0e640 1 -- 172.21.15.78:0/135615840 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564583f1b860 con 0x564583b4e4d0 2024-09-17T03:15:17.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.411+0000 7fadb4b0e640 1 --2- 172.21.15.78:0/135615840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b4e4d0 0x564583fe6f00 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fadac02a8e0 tx=0x7fadac006b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfae88073811fa7a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.411+0000 7fad8f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:17.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.411+0000 7fad8f7fe640 1 -- 172.21.15.78:0/135615840 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadac058060 con 0x564583b4e4d0 2024-09-17T03:15:17.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.411+0000 7fad8f7fe640 1 -- 172.21.15.78:0/135615840 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fadac003bc0 con 0x564583b4e4d0 2024-09-17T03:15:17.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.411+0000 7fadbddc1740 1 -- 172.21.15.78:0/135615840 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fada00993e0 con 0x564583b4e4d0 2024-09-17T03:15:17.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.411+0000 7fad8f7fe640 1 -- 172.21.15.78:0/135615840 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7fadac05e050 con 0x564583b4e4d0 2024-09-17T03:15:17.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.411+0000 7fadbddc1740 10 client.8949 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:17.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.411+0000 7fadbddc1740 1 -- 172.21.15.78:0/135615840 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x564583f206f0 con 0x564583b4e4d0 2024-09-17T03:15:17.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.411+0000 7fad8f7fe640 1 -- 172.21.15.78:0/135615840 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fada00993e0 con 0x564583b4e4d0 2024-09-17T03:15:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.411+0000 7fad8f7fe640 1 -- 172.21.15.78:0/135615840 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7fadac061020 con 0x564583b4e4d0 2024-09-17T03:15:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.411+0000 7fadbddc1740 10 client.8949 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.411+0000 7fadbddc1740 10 client.8949 resolve_mds: resolved 7:1 to role '7:1' aka daemon mds.a 2024-09-17T03:15:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.411+0000 7fadbddc1740 20 client.8949 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.411+0000 7fadbddc1740 1 --2- 172.21.15.78:0/135615840 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x564583f5aa70 0x564583f637e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.411+0000 7fadbddc1740 4 client.8949 mds_command: new command op to 8283 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:15:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.411+0000 7fadbddc1740 1 -- 172.21.15.78:0/135615840 --> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564583e8f460 con 0x564583f5aa70 2024-09-17T03:15:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.411+0000 7fada7fff640 1 --2- 172.21.15.78:0/135615840 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x564583f5aa70 0x564583f637e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.412+0000 7fad8f7fe640 10 client.8949 ms_handle_connect on v2:172.21.15.78:6832/1810198137 2024-09-17T03:15:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.412+0000 7fada7fff640 1 --2- 172.21.15.78:0/135615840 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x564583f5aa70 0x564583f637e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c551aaeb541503d1 server_cookie=1c86bb7530dfaf61 in_seq=0 out_seq=0 2024-09-17T03:15:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.412+0000 7fad8f7fe640 1 -- 172.21.15.78:0/135615840 <== mds.1 v2:172.21.15.78:6832/1810198137 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x564583e8f460 con 0x564583f5aa70 2024-09-17T03:15:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.412+0000 7fad8f7fe640 10 client.8949 handle_command_reply: tid=0 2024-09-17T03:15:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.412+0000 7fadbddc1740 1 client.8949 shutdown 2024-09-17T03:15:17.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.412+0000 7fadbddc1740 1 -- 172.21.15.78:0/135615840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b4e4d0 msgr2=0x564583fe6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.412+0000 7fadbddc1740 1 --2- 172.21.15.78:0/135615840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b4e4d0 0x564583fe6f00 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fadac02a8e0 tx=0x7fadac006b50 comp rx=0 tx=0).stop 2024-09-17T03:15:17.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.412+0000 7fadbddc1740 1 -- 172.21.15.78:0/135615840 shutdown_connections 2024-09-17T03:15:17.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.412+0000 7fadbddc1740 1 --2- 172.21.15.78:0/135615840 >> [v2:172.21.15.78:6832/1810198137,v1:172.21.15.78:6834/1810198137] conn(0x564583f5aa70 0x564583f637e0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.412+0000 7fadbddc1740 1 --2- 172.21.15.78:0/135615840 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564583b77390 0x564583f37010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.412+0000 7fad8f7fe640 0 client.8949 ms_handle_reset on v2:172.21.15.78:6832/1810198137 2024-09-17T03:15:17.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.412+0000 7fadbddc1740 1 --2- 172.21.15.78:0/135615840 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564583b566b0 0x564583fe3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.412+0000 7fadbddc1740 1 --2- 172.21.15.78:0/135615840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x564583b4e4d0 0x564583fe6f00 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.412+0000 7fadbddc1740 1 -- 172.21.15.78:0/135615840 >> 172.21.15.78:0/135615840 conn(0x564583b6b4e0 msgr2=0x564583f1e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.412+0000 7fadbddc1740 1 -- 172.21.15.78:0/135615840 shutdown_connections 2024-09-17T03:15:17.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.412+0000 7fadbddc1740 1 -- 172.21.15.78:0/135615840 wait complete. 2024-09-17T03:15:17.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.412+0000 7fadbddc1740 20 client.8949 trim_cache size 0 max 16384 2024-09-17T03:15:17.417 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:17.417 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T03:15:17.417 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:15:17.417 INFO:teuthology.orchestra.run.smithi078.stdout: "0d177712-01a0-4dfb-8f16-2e7c84183356": { 2024-09-17T03:15:17.417 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:15:17.417 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "0d177712-01a0-4dfb-8f16-2e7c84183356", 2024-09-17T03:15:17.417 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:15:17.417 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:17.417 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:17.417 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:17.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.413+0000 7fadb6d72640 1 -- 172.21.15.78:0/2962772544 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fad9c078bc0 msgr2=0x7fad9c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.413+0000 7fadb6d72640 1 --2- 172.21.15.78:0/2962772544 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fad9c078bc0 0x7fad9c07b0d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fadac032000 tx=0x7fadac0011d0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.413+0000 7fadb6d72640 1 -- 172.21.15.78:0/2962772544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb0147490 msgr2=0x7fadb01f6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.413+0000 7fadb6d72640 1 --2- 172.21.15.78:0/2962772544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb0147490 0x7fadb01f6990 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7fada000e590 tx=0x7fada000ea50 comp rx=0 tx=0).stop 2024-09-17T03:15:17.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.413+0000 7fadb6d72640 1 -- 172.21.15.78:0/2962772544 shutdown_connections 2024-09-17T03:15:17.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.413+0000 7fadb6d72640 1 --2- 172.21.15.78:0/2962772544 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fadb01f6ed0 0x7fadb01f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.413+0000 7fadb6d72640 1 --2- 172.21.15.78:0/2962772544 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fadb0147490 0x7fadb01f6990 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.413+0000 7fadb6d72640 1 --2- 172.21.15.78:0/2962772544 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fad9c078bc0 0x7fad9c07b0d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.413+0000 7fadb6d72640 1 --2- 172.21.15.78:0/2962772544 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fad98003a50 0x7fadb0153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.413+0000 7fadb6d72640 1 -- 172.21.15.78:0/2962772544 >> 172.21.15.78:0/2962772544 conn(0x7fadb00d15f0 msgr2=0x7fadb0158590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.413+0000 7fadb6d72640 1 -- 172.21.15.78:0/2962772544 shutdown_connections 2024-09-17T03:15:17.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.413+0000 7fadb6d72640 1 -- 172.21.15.78:0/2962772544 wait complete. 2024-09-17T03:15:17.423 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:15:17.423 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:15:17.423 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:2 scrub status 2024-09-17T03:15:17.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.538+0000 7f9b59519640 1 -- 172.21.15.78:0/3191927712 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b540ceb40 msgr2=0x7f9b540cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.538+0000 7f9b59519640 1 --2- 172.21.15.78:0/3191927712 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b540ceb40 0x7f9b540cef50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c005fd0 tx=0x7f9b4c02a7a0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.538+0000 7f9b59519640 1 -- 172.21.15.78:0/3191927712 shutdown_connections 2024-09-17T03:15:17.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.538+0000 7f9b59519640 1 --2- 172.21.15.78:0/3191927712 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b540ceb40 0x7f9b540cef50 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.538+0000 7f9b59519640 1 --2- 172.21.15.78:0/3191927712 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9b5406e170 0x7f9b540b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.538+0000 7f9b59519640 1 -- 172.21.15.78:0/3191927712 >> 172.21.15.78:0/3191927712 conn(0x7f9b5408bfc0 msgr2=0x7f9b5409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.538+0000 7f9b59519640 1 -- 172.21.15.78:0/3191927712 shutdown_connections 2024-09-17T03:15:17.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.538+0000 7f9b59519640 1 -- 172.21.15.78:0/3191927712 wait complete. 2024-09-17T03:15:17.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.540+0000 7f9b59519640 1 Processor -- start 2024-09-17T03:15:17.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.540+0000 7f9b59519640 1 -- start start 2024-09-17T03:15:17.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.541+0000 7f9b59519640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b5406f4b0 0x7f9b54151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.541+0000 7f9b59519640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b540ceb40 0x7f9b541f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.541+0000 7f9b59519640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9b541f5210 0x7f9b540b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.541+0000 7f9b59519640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9b540d0e60 con 0x7f9b540ceb40 2024-09-17T03:15:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.541+0000 7f9b59519640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9b540d0ce0 con 0x7f9b5406f4b0 2024-09-17T03:15:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.541+0000 7f9b59519640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f9b540d0fe0 con 0x7f9b541f5210 2024-09-17T03:15:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.542+0000 7f9b4a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b540ceb40 0x7f9b541f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.542+0000 7f9b4a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b540ceb40 0x7f9b541f4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43194/0 (socket says 172.21.15.78:43194) 2024-09-17T03:15:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.542+0000 7f9b4a7fc640 1 -- 172.21.15.78:0/2061107508 learned_addr learned my addr 172.21.15.78:0/2061107508 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.542+0000 7f9b537fe640 1 --2- 172.21.15.78:0/2061107508 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9b541f5210 0x7f9b540b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.542+0000 7f9b52ffd640 1 --2- 172.21.15.78:0/2061107508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b5406f4b0 0x7f9b54151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.542+0000 7f9b4a7fc640 1 -- 172.21.15.78:0/2061107508 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9b541f5210 msgr2=0x7f9b540b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.542+0000 7f9b4a7fc640 1 --2- 172.21.15.78:0/2061107508 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9b541f5210 0x7f9b540b2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.542+0000 7f9b4a7fc640 1 -- 172.21.15.78:0/2061107508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b5406f4b0 msgr2=0x7f9b54151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.542+0000 7f9b4a7fc640 1 --2- 172.21.15.78:0/2061107508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b5406f4b0 0x7f9b54151480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.542+0000 7f9b4a7fc640 1 -- 172.21.15.78:0/2061107508 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b541f5960 con 0x7f9b540ceb40 2024-09-17T03:15:17.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.542+0000 7f9b4a7fc640 1 --2- 172.21.15.78:0/2061107508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b540ceb40 0x7f9b541f4cd0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00c500 tx=0x7f9b3c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.542+0000 7f9b4bfff640 1 -- 172.21.15.78:0/2061107508 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c016020 con 0x7f9b540ceb40 2024-09-17T03:15:17.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.542+0000 7f9b59519640 1 -- 172.21.15.78:0/2061107508 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b54153f90 con 0x7f9b540ceb40 2024-09-17T03:15:17.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.542+0000 7f9b4bfff640 1 -- 172.21.15.78:0/2061107508 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b3c012920 con 0x7f9b540ceb40 2024-09-17T03:15:17.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.542+0000 7f9b4bfff640 1 -- 172.21.15.78:0/2061107508 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c012d70 con 0x7f9b540ceb40 2024-09-17T03:15:17.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.542+0000 7f9b59519640 1 -- 172.21.15.78:0/2061107508 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b541519c0 con 0x7f9b540ceb40 2024-09-17T03:15:17.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.544+0000 7f9b4bfff640 1 -- 172.21.15.78:0/2061107508 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9b3c019020 con 0x7f9b540ceb40 2024-09-17T03:15:17.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.545+0000 7f9b4bfff640 1 --2- 172.21.15.78:0/2061107508 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9b34078bc0 0x7f9b3407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.545+0000 7f9b4bfff640 1 -- 172.21.15.78:0/2061107508 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f9b3c09ad90 con 0x7f9b540ceb40 2024-09-17T03:15:17.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.545+0000 7f9b52ffd640 1 --2- 172.21.15.78:0/2061107508 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9b34078bc0 0x7f9b3407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.545+0000 7f9b52ffd640 1 --2- 172.21.15.78:0/2061107508 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9b34078bc0 0x7f9b3407b0d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9b440099e0 tx=0x7f9b44005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.545+0000 7f9b60483740 1 Processor -- start 2024-09-17T03:15:17.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.546+0000 7f9b60483740 1 -- start start 2024-09-17T03:15:17.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.547+0000 7f9b60483740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55660839c390 0x556608788a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.547+0000 7f9b60483740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 0x55660875d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.547+0000 7f9b60483740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55660837b6b0 0x55660875dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.547+0000 7f9b60483740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x5566086b6a60 con 0x5566083734d0 2024-09-17T03:15:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.547+0000 7f9b60483740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5566086a5e90 con 0x55660839c390 2024-09-17T03:15:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.547+0000 7f9b60483740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5566086a9ca0 con 0x55660837b6b0 2024-09-17T03:15:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.547+0000 7f9b4a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 0x55660875d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.547+0000 7f9b4a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 0x55660875d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43206/0 (socket says 172.21.15.78:43206) 2024-09-17T03:15:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.547+0000 7f9b4a7fc640 1 -- 172.21.15.78:0/2715064073 learned_addr learned my addr 172.21.15.78:0/2715064073 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.547+0000 7f9b537fe640 1 --2- 172.21.15.78:0/2715064073 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55660837b6b0 0x55660875dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.547+0000 7f9b52ffd640 1 --2- 172.21.15.78:0/2715064073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55660839c390 0x556608788a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.547+0000 7f9b4a7fc640 1 -- 172.21.15.78:0/2715064073 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55660837b6b0 msgr2=0x55660875dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.547+0000 7f9b4a7fc640 1 --2- 172.21.15.78:0/2715064073 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55660837b6b0 0x55660875dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.547+0000 7f9b4a7fc640 1 -- 172.21.15.78:0/2715064073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55660839c390 msgr2=0x556608788a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.547+0000 7f9b4a7fc640 1 --2- 172.21.15.78:0/2715064073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55660839c390 0x556608788a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.547+0000 7f9b4a7fc640 1 -- 172.21.15.78:0/2715064073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55660847e7d0 con 0x5566083734d0 2024-09-17T03:15:17.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.547+0000 7f9b4a7fc640 1 --2- 172.21.15.78:0/2715064073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 0x55660875d860 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c062b00 tx=0x7f9b3c062a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c058630cd4de9d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.548+0000 7f9b48ff9640 1 -- 172.21.15.78:0/2715064073 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c067650 con 0x5566083734d0 2024-09-17T03:15:17.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.548+0000 7f9b48ff9640 1 -- 172.21.15.78:0/2715064073 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b3c05ede0 con 0x5566083734d0 2024-09-17T03:15:17.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.548+0000 7f9b48ff9640 1 -- 172.21.15.78:0/2715064073 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c062030 con 0x5566083734d0 2024-09-17T03:15:17.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.548+0000 7f9b60483740 1 -- 172.21.15.78:0/2715064073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 msgr2=0x55660875d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.548+0000 7f9b60483740 1 --2- 172.21.15.78:0/2715064073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 0x55660875d860 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c062b00 tx=0x7f9b3c062a70 comp rx=0 tx=0).stop 2024-09-17T03:15:17.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.548+0000 7f9b60483740 1 -- 172.21.15.78:0/2715064073 shutdown_connections 2024-09-17T03:15:17.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.548+0000 7f9b60483740 1 --2- 172.21.15.78:0/2715064073 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55660837b6b0 0x55660875dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.549+0000 7f9b60483740 1 --2- 172.21.15.78:0/2715064073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 0x55660875d860 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.549+0000 7f9b60483740 1 --2- 172.21.15.78:0/2715064073 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55660839c390 0x556608788a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.549+0000 7f9b60483740 1 -- 172.21.15.78:0/2715064073 >> 172.21.15.78:0/2715064073 conn(0x5566083904e0 msgr2=0x556608743d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.549+0000 7f9b60483740 1 -- 172.21.15.78:0/2715064073 shutdown_connections 2024-09-17T03:15:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.549+0000 7f9b60483740 1 -- 172.21.15.78:0/2715064073 wait complete. 2024-09-17T03:15:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.549+0000 7f9b60483740 1 -- start start 2024-09-17T03:15:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.550+0000 7f9b60483740 1 Processor -- start 2024-09-17T03:15:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.551+0000 7f9b60483740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5566083734d0 0x55660876e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.551+0000 7f9b60483740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55660837b6b0 0x55660875c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.551+0000 7f9b60483740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55660839c390 0x556608787980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.551+0000 7f9b60483740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x556608416740 con 0x55660837b6b0 2024-09-17T03:15:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.551+0000 7f9b60483740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55660864b970 con 0x5566083734d0 2024-09-17T03:15:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.551+0000 7f9b60483740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x556608782790 con 0x55660839c390 2024-09-17T03:15:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.551+0000 7f9b60483740 10 client.0 _ll_register_callbacks cb 0x55660865a780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:17.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.551+0000 7f9b4a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55660837b6b0 0x55660875c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.551+0000 7f9b4a7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55660837b6b0 0x55660875c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43216/0 (socket says 172.21.15.78:43216) 2024-09-17T03:15:17.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.551+0000 7f9b4a7fc640 1 -- 172.21.15.78:0/318071482 learned_addr learned my addr 172.21.15.78:0/318071482 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.551+0000 7f9b52ffd640 1 --2- 172.21.15.78:0/318071482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5566083734d0 0x55660876e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.551+0000 7f9b537fe640 1 --2- 172.21.15.78:0/318071482 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55660839c390 0x556608787980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.551+0000 7f9b4a7fc640 1 -- 172.21.15.78:0/318071482 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55660839c390 msgr2=0x556608787980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.551+0000 7f9b4a7fc640 1 --2- 172.21.15.78:0/318071482 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55660839c390 0x556608787980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.551+0000 7f9b4a7fc640 1 -- 172.21.15.78:0/318071482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5566083734d0 msgr2=0x55660876e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.551+0000 7f9b4a7fc640 1 --2- 172.21.15.78:0/318071482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5566083734d0 0x55660876e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.551+0000 7f9b4a7fc640 1 -- 172.21.15.78:0/318071482 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556608407970 con 0x55660837b6b0 2024-09-17T03:15:17.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.551+0000 7f9b4a7fc640 1 --2- 172.21.15.78:0/318071482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55660837b6b0 0x55660875c730 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c09b0b0 tx=0x7f9b3c05f020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5a35961b804236 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.551+0000 7f9b31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:17.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.552+0000 7f9b31ffb640 1 -- 172.21.15.78:0/318071482 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0670f0 con 0x55660837b6b0 2024-09-17T03:15:17.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.552+0000 7f9b31ffb640 1 -- 172.21.15.78:0/318071482 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f9b3c067290 con 0x55660837b6b0 2024-09-17T03:15:17.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.552+0000 7f9b60483740 1 -- 172.21.15.78:0/318071482 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b3c05ede0 con 0x55660837b6b0 2024-09-17T03:15:17.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.552+0000 7f9b31ffb640 1 -- 172.21.15.78:0/318071482 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f9b3c05e4c0 con 0x55660837b6b0 2024-09-17T03:15:17.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.552+0000 7f9b60483740 10 client.8961 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:17.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.552+0000 7f9b60483740 1 -- 172.21.15.78:0/318071482 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x5566083e56a0 con 0x55660837b6b0 2024-09-17T03:15:17.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.552+0000 7f9b31ffb640 1 -- 172.21.15.78:0/318071482 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b3c05ede0 con 0x55660837b6b0 2024-09-17T03:15:17.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.552+0000 7f9b31ffb640 1 -- 172.21.15.78:0/318071482 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7f9b3c05e660 con 0x55660837b6b0 2024-09-17T03:15:17.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.552+0000 7f9b60483740 10 client.8961 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:17.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.552+0000 7f9b60483740 10 client.8961 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.d 2024-09-17T03:15:17.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.552+0000 7f9b60483740 20 client.8961 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:17.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.552+0000 7f9b60483740 1 --2- 172.21.15.78:0/318071482 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x55660835af60 0x55660879afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.552+0000 7f9b60483740 4 client.8961 mds_command: new command op to 7213 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:17.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.552+0000 7f9b60483740 1 -- 172.21.15.78:0/318071482 --> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566086b89b0 con 0x55660835af60 2024-09-17T03:15:17.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.552+0000 7f9b52ffd640 1 --2- 172.21.15.78:0/318071482 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x55660835af60 0x55660879afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.553+0000 7f9b31ffb640 10 client.8961 ms_handle_connect on v2:172.21.15.193:6835/2983826871 2024-09-17T03:15:17.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.553+0000 7f9b52ffd640 1 --2- 172.21.15.78:0/318071482 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x55660835af60 0x55660879afe0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f9d65feaeb10cd56 server_cookie=f5be4a9a69326e5e in_seq=0 out_seq=0 2024-09-17T03:15:17.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.553+0000 7f9b31ffb640 1 -- 172.21.15.78:0/318071482 <== mds.2 v2:172.21.15.193:6835/2983826871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5566086b89b0 con 0x55660835af60 2024-09-17T03:15:17.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.553+0000 7f9b31ffb640 10 client.8961 handle_command_reply: tid=0 2024-09-17T03:15:17.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.553+0000 7f9b60483740 1 client.8961 shutdown 2024-09-17T03:15:17.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.554+0000 7f9b60483740 1 -- 172.21.15.78:0/318071482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55660837b6b0 msgr2=0x55660875c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.554+0000 7f9b60483740 1 --2- 172.21.15.78:0/318071482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55660837b6b0 0x55660875c730 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c09b0b0 tx=0x7f9b3c05f020 comp rx=0 tx=0).stop 2024-09-17T03:15:17.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.554+0000 7f9b60483740 1 -- 172.21.15.78:0/318071482 shutdown_connections 2024-09-17T03:15:17.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.554+0000 7f9b60483740 1 --2- 172.21.15.78:0/318071482 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x55660835af60 0x55660879afe0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.554+0000 7f9b60483740 1 --2- 172.21.15.78:0/318071482 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55660839c390 0x556608787980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.554+0000 7f9b31ffb640 0 client.8961 ms_handle_reset on v2:172.21.15.193:6835/2983826871 2024-09-17T03:15:17.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.554+0000 7f9b60483740 1 --2- 172.21.15.78:0/318071482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55660837b6b0 0x55660875c730 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.554+0000 7f9b60483740 1 --2- 172.21.15.78:0/318071482 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5566083734d0 0x55660876e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.554+0000 7f9b60483740 1 -- 172.21.15.78:0/318071482 >> 172.21.15.78:0/318071482 conn(0x5566083904e0 msgr2=0x55660873ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.554+0000 7f9b60483740 1 -- 172.21.15.78:0/318071482 shutdown_connections 2024-09-17T03:15:17.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.554+0000 7f9b60483740 1 -- 172.21.15.78:0/318071482 wait complete. 2024-09-17T03:15:17.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.554+0000 7f9b60483740 20 client.8961 trim_cache size 0 max 16384 2024-09-17T03:15:17.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.571+0000 7f9b60483740 1 Processor -- start 2024-09-17T03:15:17.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.571+0000 7f9b60483740 1 -- start start 2024-09-17T03:15:17.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.572+0000 7f9b60483740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 0x5566087ab9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.572+0000 7f9b60483740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55660837b6b0 0x556608788760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.572+0000 7f9b60483740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55660839c390 0x556608788ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.573+0000 7f9b60483740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9b54202190 con 0x5566083734d0 2024-09-17T03:15:17.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.573+0000 7f9b60483740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9b54201330 con 0x55660839c390 2024-09-17T03:15:17.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.573+0000 7f9b60483740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f9b54201a60 con 0x55660837b6b0 2024-09-17T03:15:17.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.573+0000 7f9b52ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 0x5566087ab9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.573+0000 7f9b52ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 0x5566087ab9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43228/0 (socket says 172.21.15.78:43228) 2024-09-17T03:15:17.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.573+0000 7f9b52ffd640 1 -- 172.21.15.78:0/1749753624 learned_addr learned my addr 172.21.15.78:0/1749753624 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.573+0000 7f9b52ffd640 1 -- 172.21.15.78:0/1749753624 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55660837b6b0 msgr2=0x556608788760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.573+0000 7f9b52ffd640 1 --2- 172.21.15.78:0/1749753624 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55660837b6b0 0x556608788760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.573+0000 7f9b52ffd640 1 -- 172.21.15.78:0/1749753624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55660839c390 msgr2=0x556608788ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.573+0000 7f9b52ffd640 1 --2- 172.21.15.78:0/1749753624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55660839c390 0x556608788ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.573+0000 7f9b52ffd640 1 -- 172.21.15.78:0/1749753624 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566086aef20 con 0x5566083734d0 2024-09-17T03:15:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.573+0000 7f9b52ffd640 1 --2- 172.21.15.78:0/1749753624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 0x5566087ab9c0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f9b44012450 tx=0x7f9b44016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818506f08303636b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.573+0000 7f9b33fff640 1 -- 172.21.15.78:0/1749753624 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4402d070 con 0x5566083734d0 2024-09-17T03:15:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.573+0000 7f9b33fff640 1 -- 172.21.15.78:0/1749753624 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b44012e50 con 0x5566083734d0 2024-09-17T03:15:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.573+0000 7f9b33fff640 1 -- 172.21.15.78:0/1749753624 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b440208b0 con 0x5566083734d0 2024-09-17T03:15:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.574+0000 7f9b60483740 1 -- 172.21.15.78:0/1749753624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 msgr2=0x5566087ab9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.574+0000 7f9b60483740 1 --2- 172.21.15.78:0/1749753624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 0x5566087ab9c0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f9b44012450 tx=0x7f9b44016000 comp rx=0 tx=0).stop 2024-09-17T03:15:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.574+0000 7f9b60483740 1 -- 172.21.15.78:0/1749753624 shutdown_connections 2024-09-17T03:15:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.574+0000 7f9b60483740 1 --2- 172.21.15.78:0/1749753624 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55660839c390 0x556608788ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.574+0000 7f9b60483740 1 --2- 172.21.15.78:0/1749753624 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55660837b6b0 0x556608788760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.574+0000 7f9b60483740 1 --2- 172.21.15.78:0/1749753624 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 0x5566087ab9c0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.574+0000 7f9b60483740 1 -- 172.21.15.78:0/1749753624 >> 172.21.15.78:0/1749753624 conn(0x5566083904e0 msgr2=0x55660876a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.574+0000 7f9b60483740 1 -- 172.21.15.78:0/1749753624 shutdown_connections 2024-09-17T03:15:17.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.574+0000 7f9b60483740 1 -- 172.21.15.78:0/1749753624 wait complete. 2024-09-17T03:15:17.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.575+0000 7f9b60483740 1 -- start start 2024-09-17T03:15:17.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.575+0000 7f9b60483740 1 Processor -- start 2024-09-17T03:15:17.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.576+0000 7f9b60483740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 0x5566088074a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.576+0000 7f9b60483740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55660837b6b0 0x55660878ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.576+0000 7f9b60483740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55660839c390 0x55660875d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.576+0000 7f9b60483740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x556608745720 con 0x5566083734d0 2024-09-17T03:15:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.576+0000 7f9b60483740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9b540ce500 con 0x55660837b6b0 2024-09-17T03:15:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.576+0000 7f9b60483740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55660877f860 con 0x55660839c390 2024-09-17T03:15:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.576+0000 7f9b60483740 10 client.0 _ll_register_callbacks cb 0x7f9b3c062370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.576+0000 7f9b52ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 0x5566088074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.576+0000 7f9b52ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 0x5566088074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43242/0 (socket says 172.21.15.78:43242) 2024-09-17T03:15:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.576+0000 7f9b52ffd640 1 -- 172.21.15.78:0/2247170728 learned_addr learned my addr 172.21.15.78:0/2247170728 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.576+0000 7f9b52ffd640 1 -- 172.21.15.78:0/2247170728 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55660839c390 msgr2=0x55660875d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.576+0000 7f9b52ffd640 1 --2- 172.21.15.78:0/2247170728 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55660839c390 0x55660875d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.576+0000 7f9b52ffd640 1 -- 172.21.15.78:0/2247170728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55660837b6b0 msgr2=0x55660878ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.576+0000 7f9b52ffd640 1 --2- 172.21.15.78:0/2247170728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55660837b6b0 0x55660878ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.577+0000 7f9b52ffd640 1 -- 172.21.15.78:0/2247170728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55660876ae90 con 0x5566083734d0 2024-09-17T03:15:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.577+0000 7f9b52ffd640 1 --2- 172.21.15.78:0/2247170728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 0x5566088074a0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f9b44010740 tx=0x7f9b44020590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ded3fc1ae3524d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.577+0000 7f9b31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.577+0000 7f9b31ffb640 1 -- 172.21.15.78:0/2247170728 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4402d040 con 0x5566083734d0 2024-09-17T03:15:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.577+0000 7f9b31ffb640 1 -- 172.21.15.78:0/2247170728 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f9b4403aaa0 con 0x5566083734d0 2024-09-17T03:15:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.577+0000 7f9b60483740 1 -- 172.21.15.78:0/2247170728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b44012e50 con 0x5566083734d0 2024-09-17T03:15:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.577+0000 7f9b31ffb640 1 -- 172.21.15.78:0/2247170728 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7f9b4403aca0 con 0x5566083734d0 2024-09-17T03:15:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.577+0000 7f9b60483740 10 client.8967 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.577+0000 7f9b60483740 1 -- 172.21.15.78:0/2247170728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x55660876e260 con 0x5566083734d0 2024-09-17T03:15:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.577+0000 7f9b31ffb640 1 -- 172.21.15.78:0/2247170728 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b44012e50 con 0x5566083734d0 2024-09-17T03:15:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.577+0000 7f9b31ffb640 1 -- 172.21.15.78:0/2247170728 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7f9b44044080 con 0x5566083734d0 2024-09-17T03:15:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.577+0000 7f9b60483740 10 client.8967 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.577+0000 7f9b60483740 10 client.8967 resolve_mds: resolved 7:2 to role '7:2' aka daemon mds.d 2024-09-17T03:15:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.577+0000 7f9b60483740 20 client.8967 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:17.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.577+0000 7f9b60483740 1 --2- 172.21.15.78:0/2247170728 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x55660875d980 0x55660876d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.577+0000 7f9b60483740 4 client.8967 mds_command: new command op to 7213 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:15:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.577+0000 7f9b60483740 1 -- 172.21.15.78:0/2247170728 --> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5566086b4460 con 0x55660875d980 2024-09-17T03:15:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.578+0000 7f9b4a7fc640 1 --2- 172.21.15.78:0/2247170728 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x55660875d980 0x55660876d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.578+0000 7f9b31ffb640 10 client.8967 ms_handle_connect on v2:172.21.15.193:6835/2983826871 2024-09-17T03:15:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.578+0000 7f9b4a7fc640 1 --2- 172.21.15.78:0/2247170728 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x55660875d980 0x55660876d2f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=515ffa1322b75c8f server_cookie=dd86d007856f6c63 in_seq=0 out_seq=0 2024-09-17T03:15:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.578+0000 7f9b31ffb640 1 -- 172.21.15.78:0/2247170728 <== mds.2 v2:172.21.15.193:6835/2983826871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x5566086b4460 con 0x55660875d980 2024-09-17T03:15:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.578+0000 7f9b31ffb640 10 client.8967 handle_command_reply: tid=0 2024-09-17T03:15:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.578+0000 7f9b60483740 1 client.8967 shutdown 2024-09-17T03:15:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.578+0000 7f9b60483740 1 -- 172.21.15.78:0/2247170728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 msgr2=0x5566088074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.578+0000 7f9b60483740 1 --2- 172.21.15.78:0/2247170728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 0x5566088074a0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f9b44010740 tx=0x7f9b44020590 comp rx=0 tx=0).stop 2024-09-17T03:15:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.578+0000 7f9b60483740 1 -- 172.21.15.78:0/2247170728 shutdown_connections 2024-09-17T03:15:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.578+0000 7f9b60483740 1 --2- 172.21.15.78:0/2247170728 >> [v2:172.21.15.193:6835/2983826871,v1:172.21.15.193:6837/2983826871] conn(0x55660875d980 0x55660876d2f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.578+0000 7f9b60483740 1 --2- 172.21.15.78:0/2247170728 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55660839c390 0x55660875d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.578+0000 7f9b31ffb640 0 client.8967 ms_handle_reset on v2:172.21.15.193:6835/2983826871 2024-09-17T03:15:17.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.578+0000 7f9b60483740 1 --2- 172.21.15.78:0/2247170728 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55660837b6b0 0x55660878ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.578+0000 7f9b60483740 1 --2- 172.21.15.78:0/2247170728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5566083734d0 0x5566088074a0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.578+0000 7f9b60483740 1 -- 172.21.15.78:0/2247170728 >> 172.21.15.78:0/2247170728 conn(0x5566083904e0 msgr2=0x5566087ab9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.578+0000 7f9b60483740 1 -- 172.21.15.78:0/2247170728 shutdown_connections 2024-09-17T03:15:17.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.579+0000 7f9b60483740 1 -- 172.21.15.78:0/2247170728 wait complete. 2024-09-17T03:15:17.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.579+0000 7f9b60483740 20 client.8967 trim_cache size 0 max 16384 2024-09-17T03:15:17.583 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:17.583 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T03:15:17.583 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:15:17.584 INFO:teuthology.orchestra.run.smithi078.stdout: "0d177712-01a0-4dfb-8f16-2e7c84183356": { 2024-09-17T03:15:17.584 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:15:17.584 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "0d177712-01a0-4dfb-8f16-2e7c84183356", 2024-09-17T03:15:17.584 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:15:17.584 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:17.584 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:17.584 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:17.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.579+0000 7f9b59519640 1 -- 172.21.15.78:0/2061107508 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9b34078bc0 msgr2=0x7f9b3407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.579+0000 7f9b59519640 1 --2- 172.21.15.78:0/2061107508 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9b34078bc0 0x7f9b3407b0d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9b440099e0 tx=0x7f9b44005f90 comp rx=0 tx=0).stop 2024-09-17T03:15:17.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.579+0000 7f9b59519640 1 -- 172.21.15.78:0/2061107508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b540ceb40 msgr2=0x7f9b541f4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.579+0000 7f9b59519640 1 --2- 172.21.15.78:0/2061107508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b540ceb40 0x7f9b541f4cd0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00c500 tx=0x7f9b3c00c9c0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.579+0000 7f9b59519640 1 -- 172.21.15.78:0/2061107508 shutdown_connections 2024-09-17T03:15:17.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.579+0000 7f9b59519640 1 --2- 172.21.15.78:0/2061107508 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9b541f5210 0x7f9b540b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.579+0000 7f9b59519640 1 --2- 172.21.15.78:0/2061107508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b540ceb40 0x7f9b541f4cd0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.579+0000 7f9b59519640 1 --2- 172.21.15.78:0/2061107508 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9b34078bc0 0x7f9b3407b0d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.579+0000 7f9b59519640 1 --2- 172.21.15.78:0/2061107508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b5406f4b0 0x7f9b54151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.579+0000 7f9b59519640 1 -- 172.21.15.78:0/2061107508 >> 172.21.15.78:0/2061107508 conn(0x7f9b5408bfc0 msgr2=0x7f9b540b2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.579+0000 7f9b59519640 1 -- 172.21.15.78:0/2061107508 shutdown_connections 2024-09-17T03:15:17.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.579+0000 7f9b59519640 1 -- 172.21.15.78:0/2061107508 wait complete. 2024-09-17T03:15:17.589 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:15:17.589 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-09-17T03:15:17.589 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph tell mds.7:0 scrub status 2024-09-17T03:15:17.649 INFO:tasks.ceph.mon.a.smithi078.stderr:2024-09-17T03:15:17.651+0000 7f192d77d640 -1 log_channel(cluster) log [ERR] : Health check update: 3 MDSs report damaged metadata (MDS_DAMAGE) 2024-09-17T03:15:17.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.705+0000 7fe214c27640 1 -- 172.21.15.78:0/2697472763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2100d3870 msgr2=0x7fe2100ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.705+0000 7fe214c27640 1 --2- 172.21.15.78:0/2697472763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2100d3870 0x7fe2100ceb40 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fe200009ca0 tx=0x7fe20002aa30 comp rx=0 tx=0).stop 2024-09-17T03:15:17.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.705+0000 7fe214c27640 1 -- 172.21.15.78:0/2697472763 shutdown_connections 2024-09-17T03:15:17.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.705+0000 7fe214c27640 1 --2- 172.21.15.78:0/2697472763 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2100d3870 0x7fe2100ceb40 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.705+0000 7fe214c27640 1 --2- 172.21.15.78:0/2697472763 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe2100b3540 0x7fe2100d3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.705+0000 7fe214c27640 1 -- 172.21.15.78:0/2697472763 >> 172.21.15.78:0/2697472763 conn(0x7fe21008bfc0 msgr2=0x7fe21009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.705+0000 7fe214c27640 1 -- 172.21.15.78:0/2697472763 shutdown_connections 2024-09-17T03:15:17.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.705+0000 7fe214c27640 1 -- 172.21.15.78:0/2697472763 wait complete. 2024-09-17T03:15:17.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.707+0000 7fe214c27640 1 Processor -- start 2024-09-17T03:15:17.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.707+0000 7fe214c27640 1 -- start start 2024-09-17T03:15:17.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.709+0000 7fe214c27640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe2100b3540 0x7fe2101f80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.709+0000 7fe214c27640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe2100d3870 0x7fe2100ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.709+0000 7fe214c27640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2100ca780 0x7fe2101f8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.709+0000 7fe214c27640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe2100d0e60 con 0x7fe2100ca780 2024-09-17T03:15:17.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.709+0000 7fe214c27640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe2100d0ce0 con 0x7fe2100d3870 2024-09-17T03:15:17.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.709+0000 7fe214c27640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe2100d0fe0 con 0x7fe2100b3540 2024-09-17T03:15:17.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.709+0000 7fe20ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2100ca780 0x7fe2101f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.709+0000 7fe20ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2100ca780 0x7fe2101f8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43256/0 (socket says 172.21.15.78:43256) 2024-09-17T03:15:17.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.709+0000 7fe20ed9d640 1 -- 172.21.15.78:0/1380592088 learned_addr learned my addr 172.21.15.78:0/1380592088 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.709+0000 7fe20e59c640 1 --2- 172.21.15.78:0/1380592088 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe2100b3540 0x7fe2101f80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.709+0000 7fe20dd9b640 1 --2- 172.21.15.78:0/1380592088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe2100d3870 0x7fe2100ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.709+0000 7fe20ed9d640 1 -- 172.21.15.78:0/1380592088 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe2100b3540 msgr2=0x7fe2101f80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.709+0000 7fe20ed9d640 1 --2- 172.21.15.78:0/1380592088 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe2100b3540 0x7fe2101f80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.709+0000 7fe20ed9d640 1 -- 172.21.15.78:0/1380592088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe2100d3870 msgr2=0x7fe2100ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.709+0000 7fe20ed9d640 1 --2- 172.21.15.78:0/1380592088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe2100d3870 0x7fe2100ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.709+0000 7fe20ed9d640 1 -- 172.21.15.78:0/1380592088 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2101f8600 con 0x7fe2100ca780 2024-09-17T03:15:17.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.709+0000 7fe20ed9d640 1 --2- 172.21.15.78:0/1380592088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2100ca780 0x7fe2101f8850 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fe200009ca0 tx=0x7fe200003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.709+0000 7fe1feffd640 1 -- 172.21.15.78:0/1380592088 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe200033050 con 0x7fe2100ca780 2024-09-17T03:15:17.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.709+0000 7fe1feffd640 1 -- 172.21.15.78:0/1380592088 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe200004450 con 0x7fe2100ca780 2024-09-17T03:15:17.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.710+0000 7fe1feffd640 1 -- 172.21.15.78:0/1380592088 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe200038450 con 0x7fe2100ca780 2024-09-17T03:15:17.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.710+0000 7fe214c27640 1 -- 172.21.15.78:0/1380592088 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2100caf50 con 0x7fe2100ca780 2024-09-17T03:15:17.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.710+0000 7fe214c27640 1 -- 172.21.15.78:0/1380592088 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2101e8540 con 0x7fe2100ca780 2024-09-17T03:15:17.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.711+0000 7fe1feffd640 1 -- 172.21.15.78:0/1380592088 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe200036070 con 0x7fe2100ca780 2024-09-17T03:15:17.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.712+0000 7fe1feffd640 1 --2- 172.21.15.78:0/1380592088 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe1f0078bc0 0x7fe1f007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.712+0000 7fe1feffd640 1 -- 172.21.15.78:0/1380592088 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fe2000bbff0 con 0x7fe2100ca780 2024-09-17T03:15:17.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.712+0000 7fe20e59c640 1 --2- 172.21.15.78:0/1380592088 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe1f0078bc0 0x7fe1f007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.713+0000 7fe20e59c640 1 --2- 172.21.15.78:0/1380592088 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe1f0078bc0 0x7fe1f007b0d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe2100d2780 tx=0x7fe208009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.713+0000 7fe21bc6c740 1 Processor -- start 2024-09-17T03:15:17.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.713+0000 7fe21bc6c740 1 -- start start 2024-09-17T03:15:17.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.714+0000 7fe21bc6c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55696ff7b390 0x556970367a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.714+0000 7fe21bc6c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696ff524d0 0x55697033c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.714+0000 7fe21bc6c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 0x55697033cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.714+0000 7fe21bc6c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x556970295a60 con 0x55696ff5a6b0 2024-09-17T03:15:17.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.714+0000 7fe21bc6c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x556970284e90 con 0x55696ff524d0 2024-09-17T03:15:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.714+0000 7fe21bc6c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x556970288ca0 con 0x55696ff7b390 2024-09-17T03:15:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.715+0000 7fe20ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 0x55697033cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.715+0000 7fe20ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 0x55697033cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43270/0 (socket says 172.21.15.78:43270) 2024-09-17T03:15:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.715+0000 7fe20ed9d640 1 -- 172.21.15.78:0/2574123250 learned_addr learned my addr 172.21.15.78:0/2574123250 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.715+0000 7fe20dd9b640 1 --2- 172.21.15.78:0/2574123250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696ff524d0 0x55697033c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.715+0000 7fe20e59c640 1 --2- 172.21.15.78:0/2574123250 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55696ff7b390 0x556970367a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.715+0000 7fe20ed9d640 1 -- 172.21.15.78:0/2574123250 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55696ff7b390 msgr2=0x556970367a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.715+0000 7fe20ed9d640 1 --2- 172.21.15.78:0/2574123250 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55696ff7b390 0x556970367a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.715+0000 7fe20ed9d640 1 -- 172.21.15.78:0/2574123250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696ff524d0 msgr2=0x55697033c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.715+0000 7fe20ed9d640 1 --2- 172.21.15.78:0/2574123250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696ff524d0 0x55697033c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.715+0000 7fe20ed9d640 1 -- 172.21.15.78:0/2574123250 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55697005d7d0 con 0x55696ff5a6b0 2024-09-17T03:15:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.715+0000 7fe20ed9d640 1 --2- 172.21.15.78:0/2574123250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 0x55697033cda0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fe200006010 tx=0x7fe200009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eced6e17fc04568 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.715+0000 7fe1effff640 1 -- 172.21.15.78:0/2574123250 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2000aa100 con 0x55696ff5a6b0 2024-09-17T03:15:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.715+0000 7fe1effff640 1 -- 172.21.15.78:0/2574123250 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe200083890 con 0x55696ff5a6b0 2024-09-17T03:15:17.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.715+0000 7fe1effff640 1 -- 172.21.15.78:0/2574123250 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe200083d80 con 0x55696ff5a6b0 2024-09-17T03:15:17.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.716+0000 7fe21bc6c740 1 -- 172.21.15.78:0/2574123250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 msgr2=0x55697033cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.716+0000 7fe21bc6c740 1 --2- 172.21.15.78:0/2574123250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 0x55697033cda0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fe200006010 tx=0x7fe200009a20 comp rx=0 tx=0).stop 2024-09-17T03:15:17.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.716+0000 7fe21bc6c740 1 -- 172.21.15.78:0/2574123250 shutdown_connections 2024-09-17T03:15:17.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.716+0000 7fe21bc6c740 1 --2- 172.21.15.78:0/2574123250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 0x55697033cda0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.716+0000 7fe21bc6c740 1 --2- 172.21.15.78:0/2574123250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696ff524d0 0x55697033c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.716+0000 7fe21bc6c740 1 --2- 172.21.15.78:0/2574123250 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55696ff7b390 0x556970367a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.716+0000 7fe21bc6c740 1 -- 172.21.15.78:0/2574123250 >> 172.21.15.78:0/2574123250 conn(0x55696ff6f4e0 msgr2=0x556970322d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.716+0000 7fe21bc6c740 1 -- 172.21.15.78:0/2574123250 shutdown_connections 2024-09-17T03:15:17.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.716+0000 7fe21bc6c740 1 -- 172.21.15.78:0/2574123250 wait complete. 2024-09-17T03:15:17.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.717+0000 7fe21bc6c740 1 -- start start 2024-09-17T03:15:17.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.717+0000 7fe21bc6c740 1 Processor -- start 2024-09-17T03:15:17.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.718+0000 7fe21bc6c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696ff524d0 0x556970363bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.718+0000 7fe21bc6c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 0x556970362970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.718+0000 7fe21bc6c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55696ff7b390 0x55697032b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe21bc6c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x55696fff5740 con 0x55696ff5a6b0 2024-09-17T03:15:17.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe21bc6c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55697022a970 con 0x55696ff524d0 2024-09-17T03:15:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe21bc6c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x556970284e90 con 0x55696ff7b390 2024-09-17T03:15:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe21bc6c740 10 client.0 _ll_register_callbacks cb 0x556970239780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe20dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 0x556970362970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe20dd9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 0x556970362970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43276/0 (socket says 172.21.15.78:43276) 2024-09-17T03:15:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe20dd9b640 1 -- 172.21.15.78:0/2951324416 learned_addr learned my addr 172.21.15.78:0/2951324416 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe20e59c640 1 --2- 172.21.15.78:0/2951324416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696ff524d0 0x556970363bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe20ed9d640 1 --2- 172.21.15.78:0/2951324416 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55696ff7b390 0x55697032b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe20dd9b640 1 -- 172.21.15.78:0/2951324416 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55696ff7b390 msgr2=0x55697032b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe20dd9b640 1 --2- 172.21.15.78:0/2951324416 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55696ff7b390 0x55697032b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe20dd9b640 1 -- 172.21.15.78:0/2951324416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696ff524d0 msgr2=0x556970363bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe20dd9b640 1 --2- 172.21.15.78:0/2951324416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696ff524d0 0x556970363bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe20dd9b640 1 -- 172.21.15.78:0/2951324416 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55696ffe6970 con 0x55696ff5a6b0 2024-09-17T03:15:17.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe20dd9b640 1 --2- 172.21.15.78:0/2951324416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 0x556970362970 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fe20400b980 tx=0x7fe204004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a56039c20b78400 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe1ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe1ed7fa640 1 -- 172.21.15.78:0/2951324416 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe204003e20 con 0x55696ff5a6b0 2024-09-17T03:15:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe1ed7fa640 1 -- 172.21.15.78:0/2951324416 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fe20401cb20 con 0x55696ff5a6b0 2024-09-17T03:15:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe21bc6c740 1 -- 172.21.15.78:0/2951324416 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe200083890 con 0x55696ff5a6b0 2024-09-17T03:15:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe1ed7fa640 1 -- 172.21.15.78:0/2951324416 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7fe20401cd20 con 0x55696ff5a6b0 2024-09-17T03:15:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe21bc6c740 10 client.8979 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.719+0000 7fe21bc6c740 1 -- 172.21.15.78:0/2951324416 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x55696ffc46a0 con 0x55696ff5a6b0 2024-09-17T03:15:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.720+0000 7fe1ed7fa640 1 -- 172.21.15.78:0/2951324416 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe200083890 con 0x55696ff5a6b0 2024-09-17T03:15:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.720+0000 7fe1ed7fa640 1 -- 172.21.15.78:0/2951324416 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7fe204005020 con 0x55696ff5a6b0 2024-09-17T03:15:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.720+0000 7fe21bc6c740 10 client.8979 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.720+0000 7fe21bc6c740 10 client.8979 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T03:15:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.720+0000 7fe21bc6c740 20 client.8979 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.720+0000 7fe21bc6c740 1 --2- 172.21.15.78:0/2951324416 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55696ff39f60 0x556970375fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.720+0000 7fe21bc6c740 4 client.8979 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T03:15:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.720+0000 7fe21bc6c740 1 -- 172.21.15.78:0/2951324416 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569702979b0 con 0x55696ff39f60 2024-09-17T03:15:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.720+0000 7fe20e59c640 1 --2- 172.21.15.78:0/2951324416 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55696ff39f60 0x556970375fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.720+0000 7fe1ed7fa640 10 client.8979 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.720+0000 7fe20e59c640 1 --2- 172.21.15.78:0/2951324416 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55696ff39f60 0x556970375fa0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fd3e0427f023334 server_cookie=e4c6d4cc6061a3c5 in_seq=0 out_seq=0 2024-09-17T03:15:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.721+0000 7fe1ed7fa640 1 -- 172.21.15.78:0/2951324416 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5569702979b0 con 0x55696ff39f60 2024-09-17T03:15:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.721+0000 7fe1ed7fa640 10 client.8979 handle_command_reply: tid=0 2024-09-17T03:15:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.721+0000 7fe21bc6c740 1 client.8979 shutdown 2024-09-17T03:15:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.721+0000 7fe21bc6c740 1 -- 172.21.15.78:0/2951324416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 msgr2=0x556970362970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.721+0000 7fe21bc6c740 1 --2- 172.21.15.78:0/2951324416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 0x556970362970 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fe20400b980 tx=0x7fe204004610 comp rx=0 tx=0).stop 2024-09-17T03:15:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.721+0000 7fe21bc6c740 1 -- 172.21.15.78:0/2951324416 shutdown_connections 2024-09-17T03:15:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.721+0000 7fe21bc6c740 1 --2- 172.21.15.78:0/2951324416 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55696ff7b390 0x55697032b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.721+0000 7fe21bc6c740 1 --2- 172.21.15.78:0/2951324416 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 0x556970362970 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.721+0000 7fe21bc6c740 1 --2- 172.21.15.78:0/2951324416 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55696ff39f60 0x556970375fa0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.721+0000 7fe21bc6c740 1 --2- 172.21.15.78:0/2951324416 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696ff524d0 0x556970363bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.721+0000 7fe1ed7fa640 0 client.8979 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:17.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.721+0000 7fe21bc6c740 1 -- 172.21.15.78:0/2951324416 >> 172.21.15.78:0/2951324416 conn(0x55696ff6f4e0 msgr2=0x55697033c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.721+0000 7fe21bc6c740 1 -- 172.21.15.78:0/2951324416 shutdown_connections 2024-09-17T03:15:17.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.721+0000 7fe21bc6c740 1 -- 172.21.15.78:0/2951324416 wait complete. 2024-09-17T03:15:17.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.722+0000 7fe21bc6c740 20 client.8979 trim_cache size 0 max 16384 2024-09-17T03:15:17.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.739+0000 7fe21bc6c740 1 Processor -- start 2024-09-17T03:15:17.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.739+0000 7fe21bc6c740 1 -- start start 2024-09-17T03:15:17.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.740+0000 7fe21bc6c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696ff6f4e0 0x55697031da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.740+0000 7fe21bc6c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55696ff524d0 0x55697031df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.740+0000 7fe21bc6c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 0x55697038a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.740+0000 7fe21bc6c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fe210202440 con 0x55696ff5a6b0 2024-09-17T03:15:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.740+0000 7fe21bc6c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe2102015e0 con 0x55696ff6f4e0 2024-09-17T03:15:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.740+0000 7fe21bc6c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe210201d10 con 0x55696ff524d0 2024-09-17T03:15:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.740+0000 7fe20ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 0x55697038a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.740+0000 7fe20ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 0x55697038a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43288/0 (socket says 172.21.15.78:43288) 2024-09-17T03:15:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.740+0000 7fe20ed9d640 1 -- 172.21.15.78:0/3925374880 learned_addr learned my addr 172.21.15.78:0/3925374880 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.740+0000 7fe20dd9b640 1 --2- 172.21.15.78:0/3925374880 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55696ff524d0 0x55697031df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.740+0000 7fe20e59c640 1 --2- 172.21.15.78:0/3925374880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696ff6f4e0 0x55697031da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.741+0000 7fe20ed9d640 1 -- 172.21.15.78:0/3925374880 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55696ff524d0 msgr2=0x55697031df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.741+0000 7fe20ed9d640 1 --2- 172.21.15.78:0/3925374880 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55696ff524d0 0x55697031df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.741+0000 7fe20ed9d640 1 -- 172.21.15.78:0/3925374880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696ff6f4e0 msgr2=0x55697031da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.741+0000 7fe20ed9d640 1 --2- 172.21.15.78:0/3925374880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696ff6f4e0 0x55697031da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.741+0000 7fe20ed9d640 1 -- 172.21.15.78:0/3925374880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55697031ecd0 con 0x55696ff5a6b0 2024-09-17T03:15:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.741+0000 7fe20dd9b640 1 --2- 172.21.15.78:0/3925374880 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55696ff524d0 0x55697031df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.741+0000 7fe20ed9d640 1 --2- 172.21.15.78:0/3925374880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 0x55697038a7d0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fe2000ba400 tx=0x7fe2000ba390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643f9f0188c36a02 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.741+0000 7fe1ef7fe640 1 -- 172.21.15.78:0/3925374880 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe200083890 con 0x55696ff5a6b0 2024-09-17T03:15:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.741+0000 7fe1ef7fe640 1 -- 172.21.15.78:0/3925374880 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2000887b0 con 0x55696ff5a6b0 2024-09-17T03:15:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.741+0000 7fe1ef7fe640 1 -- 172.21.15.78:0/3925374880 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20008d6f0 con 0x55696ff5a6b0 2024-09-17T03:15:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.742+0000 7fe21bc6c740 1 -- 172.21.15.78:0/3925374880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 msgr2=0x55697038a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.742+0000 7fe21bc6c740 1 --2- 172.21.15.78:0/3925374880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 0x55697038a7d0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fe2000ba400 tx=0x7fe2000ba390 comp rx=0 tx=0).stop 2024-09-17T03:15:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.742+0000 7fe21bc6c740 1 -- 172.21.15.78:0/3925374880 shutdown_connections 2024-09-17T03:15:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.742+0000 7fe21bc6c740 1 --2- 172.21.15.78:0/3925374880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff5a6b0 0x55697038a7d0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.742+0000 7fe21bc6c740 1 --2- 172.21.15.78:0/3925374880 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55696ff524d0 0x55697031df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.742+0000 7fe21bc6c740 1 --2- 172.21.15.78:0/3925374880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696ff6f4e0 0x55697031da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.742+0000 7fe21bc6c740 1 -- 172.21.15.78:0/3925374880 >> 172.21.15.78:0/3925374880 conn(0x5569703611e0 msgr2=0x55697034a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.742+0000 7fe21bc6c740 1 -- 172.21.15.78:0/3925374880 shutdown_connections 2024-09-17T03:15:17.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.742+0000 7fe21bc6c740 1 -- 172.21.15.78:0/3925374880 wait complete. 2024-09-17T03:15:17.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.743+0000 7fe21bc6c740 1 -- start start 2024-09-17T03:15:17.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.743+0000 7fe21bc6c740 1 Processor -- start 2024-09-17T03:15:17.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.744+0000 7fe21bc6c740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55696ff524d0 0x5569703eae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.744+0000 7fe21bc6c740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696ff5a6b0 0x55697031bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.744+0000 7fe21bc6c740 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff6f4e0 0x55697031dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.744+0000 7fe21bc6c740 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x556970295a60 con 0x55696ff6f4e0 2024-09-17T03:15:17.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.744+0000 7fe21bc6c740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe2101f5d60 con 0x55696ff5a6b0 2024-09-17T03:15:17.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.744+0000 7fe21bc6c740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55697033c7d0 con 0x55696ff524d0 2024-09-17T03:15:17.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.744+0000 7fe21bc6c740 10 client.0 _ll_register_callbacks cb 0x7fe2040041d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T03:15:17.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.744+0000 7fe20ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff6f4e0 0x55697031dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.744+0000 7fe20ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff6f4e0 0x55697031dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43302/0 (socket says 172.21.15.78:43302) 2024-09-17T03:15:17.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.744+0000 7fe20ed9d640 1 -- 172.21.15.78:0/1871373143 learned_addr learned my addr 172.21.15.78:0/1871373143 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.744+0000 7fe20ed9d640 1 -- 172.21.15.78:0/1871373143 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55696ff524d0 msgr2=0x5569703eae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.744+0000 7fe20ed9d640 1 --2- 172.21.15.78:0/1871373143 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55696ff524d0 0x5569703eae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.744+0000 7fe20ed9d640 1 -- 172.21.15.78:0/1871373143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696ff5a6b0 msgr2=0x55697031bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T03:15:17.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.744+0000 7fe20ed9d640 1 --2- 172.21.15.78:0/1871373143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696ff5a6b0 0x55697031bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.744+0000 7fe20ed9d640 1 -- 172.21.15.78:0/1871373143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569703676e0 con 0x55696ff6f4e0 2024-09-17T03:15:17.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.745+0000 7fe20ed9d640 1 --2- 172.21.15.78:0/1871373143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff6f4e0 0x55697031dc10 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fe200083a80 tx=0x7fe2000094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f28ec39b2b7c172 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.745+0000 7fe1ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2024-09-17T03:15:17.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.745+0000 7fe1ed7fa640 1 -- 172.21.15.78:0/1871373143 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe200084270 con 0x55696ff6f4e0 2024-09-17T03:15:17.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.745+0000 7fe1ed7fa640 1 -- 172.21.15.78:0/1871373143 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fe20008d470 con 0x55696ff6f4e0 2024-09-17T03:15:17.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.745+0000 7fe21bc6c740 1 -- 172.21.15.78:0/1871373143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2000887b0 con 0x55696ff6f4e0 2024-09-17T03:15:17.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.745+0000 7fe1ed7fa640 1 -- 172.21.15.78:0/1871373143 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) ==== 24+0+0 (secure 0 0 0) 0x7fe200083890 con 0x55696ff6f4e0 2024-09-17T03:15:17.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.745+0000 7fe21bc6c740 10 client.8985 fetch_fsmap learned FSMap version 103 2024-09-17T03:15:17.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.745+0000 7fe21bc6c740 1 -- 172.21.15.78:0/1871373143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) -- 0x556970362ae0 con 0x55696ff6f4e0 2024-09-17T03:15:17.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.745+0000 7fe1ed7fa640 1 -- 172.21.15.78:0/1871373143 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2000887b0 con 0x55696ff6f4e0 2024-09-17T03:15:17.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.745+0000 7fe1ed7fa640 1 -- 172.21.15.78:0/1871373143 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 103) ==== 3558+0+0 (secure 0 0 0) 0x7fe200040070 con 0x55696ff6f4e0 2024-09-17T03:15:17.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.745+0000 7fe21bc6c740 10 client.8985 fetch_fsmap finished waiting for FSMap version 103 2024-09-17T03:15:17.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.745+0000 7fe21bc6c740 10 client.8985 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2024-09-17T03:15:17.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.745+0000 7fe21bc6c740 20 client.8985 populate_metadata read hostname 'smithi078' 2024-09-17T03:15:17.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.745+0000 7fe21bc6c740 1 --2- 172.21.15.78:0/1871373143 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55696ff0f3a0 0x55697033c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.745+0000 7fe21bc6c740 4 client.8985 mds_command: new command op to 8286 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-17T03:15:17.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.745+0000 7fe21bc6c740 1 -- 172.21.15.78:0/1871373143 --> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556970293460 con 0x55696ff0f3a0 2024-09-17T03:15:17.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.745+0000 7fe20e59c640 1 --2- 172.21.15.78:0/1871373143 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55696ff0f3a0 0x55697033c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.746+0000 7fe1ed7fa640 10 client.8985 ms_handle_connect on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:17.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.746+0000 7fe20e59c640 1 --2- 172.21.15.78:0/1871373143 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55696ff0f3a0 0x55697033c7d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b9729f25429958d server_cookie=222710665caf95d0 in_seq=0 out_seq=0 2024-09-17T03:15:17.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.746+0000 7fe1ed7fa640 1 -- 172.21.15.78:0/1871373143 <== mds.0 v2:172.21.15.78:6833/1623349891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x556970293460 con 0x55696ff0f3a0 2024-09-17T03:15:17.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.746+0000 7fe1ed7fa640 10 client.8985 handle_command_reply: tid=0 2024-09-17T03:15:17.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.746+0000 7fe21bc6c740 1 client.8985 shutdown 2024-09-17T03:15:17.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.746+0000 7fe21bc6c740 1 -- 172.21.15.78:0/1871373143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff6f4e0 msgr2=0x55697031dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.746+0000 7fe21bc6c740 1 --2- 172.21.15.78:0/1871373143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff6f4e0 0x55697031dc10 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fe200083a80 tx=0x7fe2000094a0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.746+0000 7fe21bc6c740 1 -- 172.21.15.78:0/1871373143 shutdown_connections 2024-09-17T03:15:17.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.746+0000 7fe21bc6c740 1 --2- 172.21.15.78:0/1871373143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55696ff6f4e0 0x55697031dc10 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.746+0000 7fe21bc6c740 1 --2- 172.21.15.78:0/1871373143 >> [v2:172.21.15.78:6833/1623349891,v1:172.21.15.78:6835/1623349891] conn(0x55696ff0f3a0 0x55697033c7d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.746+0000 7fe21bc6c740 1 --2- 172.21.15.78:0/1871373143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55696ff5a6b0 0x55697031bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.746+0000 7fe21bc6c740 1 --2- 172.21.15.78:0/1871373143 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55696ff524d0 0x5569703eae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.746+0000 7fe1ed7fa640 0 client.8985 ms_handle_reset on v2:172.21.15.78:6833/1623349891 2024-09-17T03:15:17.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.746+0000 7fe21bc6c740 1 -- 172.21.15.78:0/1871373143 >> 172.21.15.78:0/1871373143 conn(0x5569703611e0 msgr2=0x55697035e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.746+0000 7fe21bc6c740 1 -- 172.21.15.78:0/1871373143 shutdown_connections 2024-09-17T03:15:17.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.746+0000 7fe21bc6c740 1 -- 172.21.15.78:0/1871373143 wait complete. 2024-09-17T03:15:17.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.747+0000 7fe21bc6c740 20 client.8985 trim_cache size 0 max 16384 2024-09-17T03:15:17.752 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:17.752 INFO:teuthology.orchestra.run.smithi078.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-17T03:15:17.752 INFO:teuthology.orchestra.run.smithi078.stdout: "scrubs": { 2024-09-17T03:15:17.752 INFO:teuthology.orchestra.run.smithi078.stdout: "0d177712-01a0-4dfb-8f16-2e7c84183356": { 2024-09-17T03:15:17.752 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:15:17.752 INFO:teuthology.orchestra.run.smithi078.stdout: "tag": "0d177712-01a0-4dfb-8f16-2e7c84183356", 2024-09-17T03:15:17.752 INFO:teuthology.orchestra.run.smithi078.stdout: "options": "recursive,force" 2024-09-17T03:15:17.752 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:17.753 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-17T03:15:17.753 INFO:teuthology.orchestra.run.smithi078.stdout: "scrub_stats": { 2024-09-17T03:15:17.753 INFO:teuthology.orchestra.run.smithi078.stdout: "0d177712-01a0-4dfb-8f16-2e7c84183356": { 2024-09-17T03:15:17.753 INFO:teuthology.orchestra.run.smithi078.stdout: "start_time": "2024-09-17T03:15:08.556658+0000", 2024-09-17T03:15:17.753 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/d1/d2/d3", 2024-09-17T03:15:17.753 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_started": 0, 2024-09-17T03:15:17.753 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_passed": 0, 2024-09-17T03:15:17.753 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_failed": 0, 2024-09-17T03:15:17.753 INFO:teuthology.orchestra.run.smithi078.stdout: "uninline_skipped": 0 2024-09-17T03:15:17.753 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:17.753 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-17T03:15:17.753 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:17.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.747+0000 7fe214c27640 1 -- 172.21.15.78:0/1380592088 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe1f0078bc0 msgr2=0x7fe1f007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.747+0000 7fe214c27640 1 --2- 172.21.15.78:0/1380592088 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe1f0078bc0 0x7fe1f007b0d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe2100d2780 tx=0x7fe208009040 comp rx=0 tx=0).stop 2024-09-17T03:15:17.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.747+0000 7fe214c27640 1 -- 172.21.15.78:0/1380592088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2100ca780 msgr2=0x7fe2101f8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.747+0000 7fe214c27640 1 --2- 172.21.15.78:0/1380592088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2100ca780 0x7fe2101f8850 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fe200009ca0 tx=0x7fe200003f10 comp rx=0 tx=0).stop 2024-09-17T03:15:17.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.747+0000 7fe214c27640 1 -- 172.21.15.78:0/1380592088 shutdown_connections 2024-09-17T03:15:17.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.747+0000 7fe214c27640 1 --2- 172.21.15.78:0/1380592088 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2100ca780 0x7fe2101f8850 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.747+0000 7fe214c27640 1 --2- 172.21.15.78:0/1380592088 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fe1f0078bc0 0x7fe1f007b0d0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.747+0000 7fe214c27640 1 --2- 172.21.15.78:0/1380592088 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe2100d3870 0x7fe2100ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.747+0000 7fe214c27640 1 --2- 172.21.15.78:0/1380592088 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe2100b3540 0x7fe2101f80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.747+0000 7fe214c27640 1 -- 172.21.15.78:0/1380592088 >> 172.21.15.78:0/1380592088 conn(0x7fe21008bfc0 msgr2=0x7fe2100b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.747+0000 7fe214c27640 1 -- 172.21.15.78:0/1380592088 shutdown_connections 2024-09-17T03:15:17.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.747+0000 7fe214c27640 1 -- 172.21.15.78:0/1380592088 wait complete. 2024-09-17T03:15:17.757 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-17T03:15:17.757 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:17.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.870+0000 7fdb18b62640 1 -- 172.21.15.78:0/4164913062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb140b3540 msgr2=0x7fdb140d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.870+0000 7fdb18b62640 1 --2- 172.21.15.78:0/4164913062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb140b3540 0x7fdb140d3330 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fdb08009860 tx=0x7fdb0802a4b0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.870+0000 7fdb18b62640 1 -- 172.21.15.78:0/4164913062 shutdown_connections 2024-09-17T03:15:17.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.870+0000 7fdb18b62640 1 --2- 172.21.15.78:0/4164913062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb140b3540 0x7fdb140d3330 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.870+0000 7fdb18b62640 1 --2- 172.21.15.78:0/4164913062 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdb140d3870 0x7fdb140ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.870+0000 7fdb18b62640 1 -- 172.21.15.78:0/4164913062 >> 172.21.15.78:0/4164913062 conn(0x7fdb1408bfc0 msgr2=0x7fdb1409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:17.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.870+0000 7fdb18b62640 1 -- 172.21.15.78:0/4164913062 shutdown_connections 2024-09-17T03:15:17.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.870+0000 7fdb18b62640 1 -- 172.21.15.78:0/4164913062 wait complete. 2024-09-17T03:15:17.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.872+0000 7fdb18b62640 1 Processor -- start 2024-09-17T03:15:17.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.872+0000 7fdb18b62640 1 -- start start 2024-09-17T03:15:17.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb18b62640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb140b3540 0x7fdb140b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb18b62640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdb140d3870 0x7fdb141f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb18b62640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb140b57f0 0x7fdb141505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb18b62640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdb140d0e60 con 0x7fdb140b3540 2024-09-17T03:15:17.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb18b62640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdb140d0ce0 con 0x7fdb140b57f0 2024-09-17T03:15:17.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb18b62640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fdb140d0fe0 con 0x7fdb140d3870 2024-09-17T03:15:17.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb1259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb140b3540 0x7fdb140b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb1259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb140b3540 0x7fdb140b52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43312/0 (socket says 172.21.15.78:43312) 2024-09-17T03:15:17.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb1259c640 1 -- 172.21.15.78:0/1244086390 learned_addr learned my addr 172.21.15.78:0/1244086390 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:17.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb11d9b640 1 --2- 172.21.15.78:0/1244086390 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdb140d3870 0x7fdb141f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb12d9d640 1 --2- 172.21.15.78:0/1244086390 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb140b57f0 0x7fdb141505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb1259c640 1 -- 172.21.15.78:0/1244086390 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdb140d3870 msgr2=0x7fdb141f4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb1259c640 1 --2- 172.21.15.78:0/1244086390 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdb140d3870 0x7fdb141f4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb1259c640 1 -- 172.21.15.78:0/1244086390 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb140b57f0 msgr2=0x7fdb141505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:17.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb1259c640 1 --2- 172.21.15.78:0/1244086390 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb140b57f0 0x7fdb141505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:17.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb1259c640 1 -- 172.21.15.78:0/1244086390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb141f5c70 con 0x7fdb140b3540 2024-09-17T03:15:17.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb1259c640 1 --2- 172.21.15.78:0/1244086390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb140b3540 0x7fdb140b52b0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400c3e0 tx=0x7fdb0400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb02ffd640 1 -- 172.21.15.78:0/1244086390 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb04011790 con 0x7fdb140b3540 2024-09-17T03:15:17.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb02ffd640 1 -- 172.21.15.78:0/1244086390 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb04017070 con 0x7fdb140b3540 2024-09-17T03:15:17.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb18b62640 1 -- 172.21.15.78:0/1244086390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb140ccd10 con 0x7fdb140b3540 2024-09-17T03:15:17.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb02ffd640 1 -- 172.21.15.78:0/1244086390 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb04011ce0 con 0x7fdb140b3540 2024-09-17T03:15:17.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.874+0000 7fdb18b62640 1 -- 172.21.15.78:0/1244086390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb140cd2d0 con 0x7fdb140b3540 2024-09-17T03:15:17.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.875+0000 7fdb18b62640 1 -- 172.21.15.78:0/1244086390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb140d1500 con 0x7fdb140b3540 2024-09-17T03:15:17.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.876+0000 7fdb02ffd640 1 -- 172.21.15.78:0/1244086390 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdb0401c460 con 0x7fdb140b3540 2024-09-17T03:15:17.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.877+0000 7fdb02ffd640 1 --2- 172.21.15.78:0/1244086390 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdaf4078bc0 0x7fdaf407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:17.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.877+0000 7fdb02ffd640 1 -- 172.21.15.78:0/1244086390 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fdb0409aae0 con 0x7fdb140b3540 2024-09-17T03:15:17.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.877+0000 7fdb11d9b640 1 --2- 172.21.15.78:0/1244086390 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdaf4078bc0 0x7fdaf407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:17.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.878+0000 7fdb11d9b640 1 --2- 172.21.15.78:0/1244086390 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdaf4078bc0 0x7fdaf407b0d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fdb08034000 tx=0x7fdb08004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:17.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:17.881+0000 7fdb02ffd640 1 -- 172.21.15.78:0/1244086390 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fdb04062fe0 con 0x7fdb140b3540 2024-09-17T03:15:18.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.090+0000 7fdb18b62640 1 -- 172.21.15.78:0/1244086390 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb1406cde0 con 0x7fdb140b3540 2024-09-17T03:15:18.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.091+0000 7fdb02ffd640 1 -- 172.21.15.78:0/1244086390 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5280 (secure 0 0 0) 0x7fdb040628e0 con 0x7fdb140b3540 2024-09-17T03:15:18.090 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:18.090 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:15:12.673912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8286,"mds_1":8283,"mds_2":7213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7213":{"gid":7213,"name":"d","rank":2,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8283":{"gid":8283,"name":"a","rank":1,"incarnation":95,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[8286,8283,7213]},"id":7}]} 2024-09-17T03:15:18.090 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 103 2024-09-17T03:15:18.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.093+0000 7fdb18b62640 1 -- 172.21.15.78:0/1244086390 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdaf4078bc0 msgr2=0x7fdaf407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:18.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.093+0000 7fdb18b62640 1 --2- 172.21.15.78:0/1244086390 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdaf4078bc0 0x7fdaf407b0d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fdb08034000 tx=0x7fdb08004730 comp rx=0 tx=0).stop 2024-09-17T03:15:18.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.093+0000 7fdb18b62640 1 -- 172.21.15.78:0/1244086390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb140b3540 msgr2=0x7fdb140b52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:18.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.093+0000 7fdb18b62640 1 --2- 172.21.15.78:0/1244086390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb140b3540 0x7fdb140b52b0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400c3e0 tx=0x7fdb0400c8a0 comp rx=0 tx=0).stop 2024-09-17T03:15:18.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.093+0000 7fdb18b62640 1 -- 172.21.15.78:0/1244086390 shutdown_connections 2024-09-17T03:15:18.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.093+0000 7fdb18b62640 1 --2- 172.21.15.78:0/1244086390 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdaf4078bc0 0x7fdaf407b0d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:18.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.093+0000 7fdb18b62640 1 --2- 172.21.15.78:0/1244086390 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb140b57f0 0x7fdb141505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:18.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.093+0000 7fdb18b62640 1 --2- 172.21.15.78:0/1244086390 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdb140d3870 0x7fdb141f4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:18.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.093+0000 7fdb18b62640 1 --2- 172.21.15.78:0/1244086390 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb140b3540 0x7fdb140b52b0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:18.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.093+0000 7fdb18b62640 1 -- 172.21.15.78:0/1244086390 >> 172.21.15.78:0/1244086390 conn(0x7fdb1408bfc0 msgr2=0x7fdb141619c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:18.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.093+0000 7fdb18b62640 1 -- 172.21.15.78:0/1244086390 shutdown_connections 2024-09-17T03:15:18.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.093+0000 7fdb18b62640 1 -- 172.21.15.78:0/1244086390 wait complete. 2024-09-17T03:15:18.103 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2024-09-17T03:15:18.104 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:15:18.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.216+0000 7f779489b640 1 -- 172.21.15.78:0/4239698826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f779015c6f0 msgr2=0x7f77900ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:18.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.216+0000 7f779489b640 1 --2- 172.21.15.78:0/4239698826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f779015c6f0 0x7f77900ceb50 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f7790070810 tx=0x7f778402a530 comp rx=0 tx=0).stop 2024-09-17T03:15:18.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.216+0000 7f779489b640 1 -- 172.21.15.78:0/4239698826 shutdown_connections 2024-09-17T03:15:18.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.216+0000 7f779489b640 1 --2- 172.21.15.78:0/4239698826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f779015c6f0 0x7f77900ceb50 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:18.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.216+0000 7f779489b640 1 --2- 172.21.15.78:0/4239698826 >> v2:172.21.15.193:3300/0 conn(0x7f77900d1d40 0x7f77900b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:18.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.216+0000 7f779489b640 1 -- 172.21.15.78:0/4239698826 >> 172.21.15.78:0/4239698826 conn(0x7f77900b3f10 msgr2=0x7f77900b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:18.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.216+0000 7f779489b640 1 -- 172.21.15.78:0/4239698826 shutdown_connections 2024-09-17T03:15:18.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.216+0000 7f779489b640 1 -- 172.21.15.78:0/4239698826 wait complete. 2024-09-17T03:15:18.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.218+0000 7f779489b640 1 Processor -- start 2024-09-17T03:15:18.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.218+0000 7f779489b640 1 -- start start 2024-09-17T03:15:18.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.219+0000 7f779489b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77900ccba0 0x7f77901563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:18.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.219+0000 7f779489b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f77900d1d40 0x7f7790157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:18.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.219+0000 7f779489b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f779015c6f0 0x7f7790159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:18.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.219+0000 7f779489b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f77900d11f0 con 0x7f779015c6f0 2024-09-17T03:15:18.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.219+0000 7f779489b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f77900d1070 con 0x7f77900ccba0 2024-09-17T03:15:18.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.219+0000 7f779489b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f77900d1370 con 0x7f77900d1d40 2024-09-17T03:15:18.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.219+0000 7f778ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f779015c6f0 0x7f7790159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:18.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.219+0000 7f778ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f779015c6f0 0x7f7790159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43320/0 (socket says 172.21.15.78:43320) 2024-09-17T03:15:18.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.219+0000 7f778ed9d640 1 -- 172.21.15.78:0/301499973 learned_addr learned my addr 172.21.15.78:0/301499973 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:18.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.220+0000 7f778dd9b640 1 --2- 172.21.15.78:0/301499973 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f77900d1d40 0x7f7790157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:18.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.220+0000 7f778e59c640 1 --2- 172.21.15.78:0/301499973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77900ccba0 0x7f77901563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:18.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.220+0000 7f778ed9d640 1 -- 172.21.15.78:0/301499973 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f77900d1d40 msgr2=0x7f7790157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:18.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.220+0000 7f778ed9d640 1 --2- 172.21.15.78:0/301499973 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f77900d1d40 0x7f7790157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:18.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.220+0000 7f778ed9d640 1 -- 172.21.15.78:0/301499973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77900ccba0 msgr2=0x7f77901563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:18.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.220+0000 7f778ed9d640 1 --2- 172.21.15.78:0/301499973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77900ccba0 0x7f77901563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:18.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.220+0000 7f778ed9d640 1 -- 172.21.15.78:0/301499973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77901579b0 con 0x7f779015c6f0 2024-09-17T03:15:18.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.220+0000 7f778e59c640 1 --2- 172.21.15.78:0/301499973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77900ccba0 0x7f77901563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:18.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.220+0000 7f778ed9d640 1 --2- 172.21.15.78:0/301499973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f779015c6f0 0x7f7790159270 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f778800c760 tx=0x7f778800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:18.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.220+0000 7f777effd640 1 -- 172.21.15.78:0/301499973 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7788003b70 con 0x7f779015c6f0 2024-09-17T03:15:18.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.220+0000 7f777effd640 1 -- 172.21.15.78:0/301499973 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7788003d10 con 0x7f779015c6f0 2024-09-17T03:15:18.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.220+0000 7f779489b640 1 -- 172.21.15.78:0/301499973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77901fa030 con 0x7f779015c6f0 2024-09-17T03:15:18.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.220+0000 7f777effd640 1 -- 172.21.15.78:0/301499973 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77880052d0 con 0x7f779015c6f0 2024-09-17T03:15:18.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.220+0000 7f779489b640 1 -- 172.21.15.78:0/301499973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77901f9550 con 0x7f779015c6f0 2024-09-17T03:15:18.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.221+0000 7f779489b640 1 -- 172.21.15.78:0/301499973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77900b5ce0 con 0x7f779015c6f0 2024-09-17T03:15:18.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.222+0000 7f777effd640 1 -- 172.21.15.78:0/301499973 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7788005470 con 0x7f779015c6f0 2024-09-17T03:15:18.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.222+0000 7f777effd640 1 --2- 172.21.15.78:0/301499973 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7770078bc0 0x7f777007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:18.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.222+0000 7f777effd640 1 -- 172.21.15.78:0/301499973 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f778809a9d0 con 0x7f779015c6f0 2024-09-17T03:15:18.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.222+0000 7f778e59c640 1 --2- 172.21.15.78:0/301499973 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7770078bc0 0x7f777007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:18.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.223+0000 7f778e59c640 1 --2- 172.21.15.78:0/301499973 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7770078bc0 0x7f777007b0d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f778000a870 tx=0x7f7780008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:18.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.227+0000 7f777effd640 1 -- 172.21.15.78:0/301499973 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7788062f30 con 0x7f779015c6f0 2024-09-17T03:15:18.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.466+0000 7f779489b640 1 -- 172.21.15.78:0/301499973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f77900b5a00 con 0x7f779015c6f0 2024-09-17T03:15:18.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.467+0000 7f777effd640 1 -- 172.21.15.78:0/301499973 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2009 (secure 0 0 0) 0x7f7788062830 con 0x7f779015c6f0 2024-09-17T03:15:18.466 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:18.466 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":435,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":706268,"bytes_used":262098944,"bytes_avail":772832014336,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":7251,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7213},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8283},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8286}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":30,"modified":"2024-09-17T03:15:13.231420+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-17T03:15:18.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.469+0000 7f779489b640 1 -- 172.21.15.78:0/301499973 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7770078bc0 msgr2=0x7f777007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:18.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.469+0000 7f779489b640 1 --2- 172.21.15.78:0/301499973 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7770078bc0 0x7f777007b0d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f778000a870 tx=0x7f7780008040 comp rx=0 tx=0).stop 2024-09-17T03:15:18.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.469+0000 7f779489b640 1 -- 172.21.15.78:0/301499973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f779015c6f0 msgr2=0x7f7790159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:18.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.469+0000 7f779489b640 1 --2- 172.21.15.78:0/301499973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f779015c6f0 0x7f7790159270 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f778800c760 tx=0x7f778800cb60 comp rx=0 tx=0).stop 2024-09-17T03:15:18.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.469+0000 7f779489b640 1 -- 172.21.15.78:0/301499973 shutdown_connections 2024-09-17T03:15:18.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.469+0000 7f779489b640 1 --2- 172.21.15.78:0/301499973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f779015c6f0 0x7f7790159270 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:18.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.469+0000 7f779489b640 1 --2- 172.21.15.78:0/301499973 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f77900d1d40 0x7f7790157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:18.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.469+0000 7f779489b640 1 --2- 172.21.15.78:0/301499973 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7770078bc0 0x7f777007b0d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:18.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.469+0000 7f779489b640 1 --2- 172.21.15.78:0/301499973 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77900ccba0 0x7f77901563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:18.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.469+0000 7f779489b640 1 -- 172.21.15.78:0/301499973 >> 172.21.15.78:0/301499973 conn(0x7f77900b3f10 msgr2=0x7f77900b6200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:18.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.469+0000 7f779489b640 1 -- 172.21.15.78:0/301499973 shutdown_connections 2024-09-17T03:15:18.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:18.469+0000 7f779489b640 1 -- 172.21.15.78:0/301499973 wait complete. 2024-09-17T03:15:18.479 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-17T03:15:19.480 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:19.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.596+0000 7f3a647e4640 1 -- 172.21.15.78:0/1042366943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c073820 msgr2=0x7f3a5c073c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:19.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.596+0000 7f3a647e4640 1 --2- 172.21.15.78:0/1042366943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c073820 0x7f3a5c073c30 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0721d0 tx=0x7f3a5402a820 comp rx=0 tx=0).stop 2024-09-17T03:15:19.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.596+0000 7f3a647e4640 1 -- 172.21.15.78:0/1042366943 shutdown_connections 2024-09-17T03:15:19.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.596+0000 7f3a647e4640 1 --2- 172.21.15.78:0/1042366943 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c073820 0x7f3a5c073c30 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.596+0000 7f3a647e4640 1 --2- 172.21.15.78:0/1042366943 >> v2:172.21.15.193:3300/0 conn(0x7f3a5c0caad0 0x7f3a5c15c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.596+0000 7f3a647e4640 1 -- 172.21.15.78:0/1042366943 >> 172.21.15.78:0/1042366943 conn(0x7f3a5c06cde0 msgr2=0x7f3a5c06d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:19.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.596+0000 7f3a647e4640 1 -- 172.21.15.78:0/1042366943 shutdown_connections 2024-09-17T03:15:19.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.596+0000 7f3a647e4640 1 -- 172.21.15.78:0/1042366943 wait complete. 2024-09-17T03:15:19.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.598+0000 7f3a647e4640 1 Processor -- start 2024-09-17T03:15:19.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.598+0000 7f3a647e4640 1 -- start start 2024-09-17T03:15:19.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.599+0000 7f3a647e4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3a5c073820 0x7f3a5c1f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:19.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.599+0000 7f3a647e4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c0caad0 0x7f3a5c14a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:19.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.599+0000 7f3a647e4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a5c15b530 0x7f3a5c14ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:19.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.599+0000 7f3a647e4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c0c6660 con 0x7f3a5c0caad0 2024-09-17T03:15:19.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.599+0000 7f3a647e4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c0c64e0 con 0x7f3a5c15b530 2024-09-17T03:15:19.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.599+0000 7f3a647e4640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3a5c0c67e0 con 0x7f3a5c073820 2024-09-17T03:15:19.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.599+0000 7f3a61d7f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c0caad0 0x7f3a5c14a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:19.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.599+0000 7f3a61d7f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c0caad0 0x7f3a5c14a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43346/0 (socket says 172.21.15.78:43346) 2024-09-17T03:15:19.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.599+0000 7f3a61d7f640 1 -- 172.21.15.78:0/499273478 learned_addr learned my addr 172.21.15.78:0/499273478 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:19.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.599+0000 7f3a62580640 1 --2- 172.21.15.78:0/499273478 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3a5c073820 0x7f3a5c1f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:19.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.599+0000 7f3a62d81640 1 --2- 172.21.15.78:0/499273478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a5c15b530 0x7f3a5c14ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:19.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.600+0000 7f3a61d7f640 1 -- 172.21.15.78:0/499273478 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3a5c073820 msgr2=0x7f3a5c1f2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:19.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.600+0000 7f3a61d7f640 1 --2- 172.21.15.78:0/499273478 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3a5c073820 0x7f3a5c1f2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.600+0000 7f3a61d7f640 1 -- 172.21.15.78:0/499273478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a5c15b530 msgr2=0x7f3a5c14ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:19.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.600+0000 7f3a61d7f640 1 --2- 172.21.15.78:0/499273478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a5c15b530 0x7f3a5c14ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.600+0000 7f3a61d7f640 1 -- 172.21.15.78:0/499273478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5c0a98e0 con 0x7f3a5c0caad0 2024-09-17T03:15:19.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.600+0000 7f3a62d81640 1 --2- 172.21.15.78:0/499273478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a5c15b530 0x7f3a5c14ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:19.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.600+0000 7f3a62580640 1 --2- 172.21.15.78:0/499273478 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3a5c073820 0x7f3a5c1f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:19.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.600+0000 7f3a61d7f640 1 --2- 172.21.15.78:0/499273478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c0caad0 0x7f3a5c14a6f0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c00c400 tx=0x7f3a4c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:19.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.600+0000 7f3a52ffd640 1 -- 172.21.15.78:0/499273478 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c011790 con 0x7f3a5c0caad0 2024-09-17T03:15:19.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.600+0000 7f3a52ffd640 1 -- 172.21.15.78:0/499273478 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a4c017070 con 0x7f3a5c0caad0 2024-09-17T03:15:19.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.600+0000 7f3a52ffd640 1 -- 172.21.15.78:0/499273478 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c011cc0 con 0x7f3a5c0caad0 2024-09-17T03:15:19.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.600+0000 7f3a647e4640 1 -- 172.21.15.78:0/499273478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a5c0b41f0 con 0x7f3a5c0caad0 2024-09-17T03:15:19.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.600+0000 7f3a647e4640 1 -- 172.21.15.78:0/499273478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a5c0b47b0 con 0x7f3a5c0caad0 2024-09-17T03:15:19.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.601+0000 7f3a647e4640 1 -- 172.21.15.78:0/499273478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a5c0b4020 con 0x7f3a5c0caad0 2024-09-17T03:15:19.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.602+0000 7f3a52ffd640 1 -- 172.21.15.78:0/499273478 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3a4c01c460 con 0x7f3a5c0caad0 2024-09-17T03:15:19.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.602+0000 7f3a52ffd640 1 --2- 172.21.15.78:0/499273478 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3a40078bc0 0x7f3a4007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:19.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.602+0000 7f3a52ffd640 1 -- 172.21.15.78:0/499273478 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f3a4c09a960 con 0x7f3a5c0caad0 2024-09-17T03:15:19.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.603+0000 7f3a62580640 1 --2- 172.21.15.78:0/499273478 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3a40078bc0 0x7f3a4007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:19.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.603+0000 7f3a62580640 1 --2- 172.21.15.78:0/499273478 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3a40078bc0 0x7f3a4007b0d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3a58005fd0 tx=0x7f3a5800f360 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:19.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.607+0000 7f3a52ffd640 1 -- 172.21.15.78:0/499273478 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3a5c0cc5d0 con 0x7f3a5c0caad0 2024-09-17T03:15:19.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.821+0000 7f3a647e4640 1 -- 172.21.15.78:0/499273478 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a5c0c6d70 con 0x7f3a5c0caad0 2024-09-17T03:15:19.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.821+0000 7f3a52ffd640 1 -- 172.21.15.78:0/499273478 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5280 (secure 0 0 0) 0x7f3a4c062ec0 con 0x7f3a5c0caad0 2024-09-17T03:15:19.820 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:19.820 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:15:12.673912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8286,"mds_1":8283,"mds_2":7213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7213":{"gid":7213,"name":"d","rank":2,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8283":{"gid":8283,"name":"a","rank":1,"incarnation":95,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[8286,8283,7213]},"id":7}]} 2024-09-17T03:15:19.821 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 103 2024-09-17T03:15:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.823+0000 7f3a647e4640 1 -- 172.21.15.78:0/499273478 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3a40078bc0 msgr2=0x7f3a4007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.823+0000 7f3a647e4640 1 --2- 172.21.15.78:0/499273478 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3a40078bc0 0x7f3a4007b0d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f3a58005fd0 tx=0x7f3a5800f360 comp rx=0 tx=0).stop 2024-09-17T03:15:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.823+0000 7f3a647e4640 1 -- 172.21.15.78:0/499273478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c0caad0 msgr2=0x7f3a5c14a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.823+0000 7f3a647e4640 1 --2- 172.21.15.78:0/499273478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c0caad0 0x7f3a5c14a6f0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c00c400 tx=0x7f3a4c00c8c0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.823+0000 7f3a647e4640 1 -- 172.21.15.78:0/499273478 shutdown_connections 2024-09-17T03:15:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.823+0000 7f3a647e4640 1 --2- 172.21.15.78:0/499273478 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3a40078bc0 0x7f3a4007b0d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.823+0000 7f3a647e4640 1 --2- 172.21.15.78:0/499273478 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3a5c15b530 0x7f3a5c14ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.823+0000 7f3a647e4640 1 --2- 172.21.15.78:0/499273478 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c0caad0 0x7f3a5c14a6f0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.823+0000 7f3a647e4640 1 --2- 172.21.15.78:0/499273478 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3a5c073820 0x7f3a5c1f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.823+0000 7f3a647e4640 1 -- 172.21.15.78:0/499273478 >> 172.21.15.78:0/499273478 conn(0x7f3a5c06cde0 msgr2=0x7f3a5c0af6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.823+0000 7f3a647e4640 1 -- 172.21.15.78:0/499273478 shutdown_connections 2024-09-17T03:15:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.823+0000 7f3a647e4640 1 -- 172.21.15.78:0/499273478 wait complete. 2024-09-17T03:15:19.833 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2024-09-17T03:15:19.834 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:15:19.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.947+0000 7fa2b7f8e640 1 -- 172.21.15.78:0/147342696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2b015b8f0 msgr2=0x7fa2b00cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:19.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.947+0000 7fa2b7f8e640 1 --2- 172.21.15.78:0/147342696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2b015b8f0 0x7fa2b00cf130 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac005fd0 tx=0x7fa2ac02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.947+0000 7fa2b7f8e640 1 -- 172.21.15.78:0/147342696 shutdown_connections 2024-09-17T03:15:19.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.947+0000 7fa2b7f8e640 1 --2- 172.21.15.78:0/147342696 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2b00b0520 0x7fa2b0071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.947+0000 7fa2b7f8e640 1 --2- 172.21.15.78:0/147342696 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2b015b8f0 0x7fa2b00cf130 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.947+0000 7fa2b7f8e640 1 -- 172.21.15.78:0/147342696 >> 172.21.15.78:0/147342696 conn(0x7fa2b00cdcb0 msgr2=0x7fa2b00ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:19.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.947+0000 7fa2b7f8e640 1 -- 172.21.15.78:0/147342696 shutdown_connections 2024-09-17T03:15:19.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.947+0000 7fa2b7f8e640 1 -- 172.21.15.78:0/147342696 wait complete. 2024-09-17T03:15:19.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.949+0000 7fa2b7f8e640 1 Processor -- start 2024-09-17T03:15:19.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.949+0000 7fa2b7f8e640 1 -- start start 2024-09-17T03:15:19.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.950+0000 7fa2b7f8e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2b00b0520 0x7fa2b014a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:19.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.950+0000 7fa2b7f8e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2b00b2cb0 0x7fa2b01f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:19.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.950+0000 7fa2b7f8e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2b015b8f0 0x7fa2b01e4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:19.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.950+0000 7fa2b7f8e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b00ae1b0 con 0x7fa2b00b2cb0 2024-09-17T03:15:19.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.950+0000 7fa2b7f8e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b0071e00 con 0x7fa2b00b0520 2024-09-17T03:15:19.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.950+0000 7fa2b7f8e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa2b00ae330 con 0x7fa2b015b8f0 2024-09-17T03:15:19.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.950+0000 7fa2b5529640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2b00b2cb0 0x7fa2b01f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:19.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.950+0000 7fa2b5529640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2b00b2cb0 0x7fa2b01f5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43372/0 (socket says 172.21.15.78:43372) 2024-09-17T03:15:19.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.950+0000 7fa2b5529640 1 -- 172.21.15.78:0/3759240793 learned_addr learned my addr 172.21.15.78:0/3759240793 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:19.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.950+0000 7fa2b652b640 1 --2- 172.21.15.78:0/3759240793 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2b015b8f0 0x7fa2b01e4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:19.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.950+0000 7fa2b5d2a640 1 --2- 172.21.15.78:0/3759240793 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2b00b0520 0x7fa2b014a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:19.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.950+0000 7fa2b5529640 1 -- 172.21.15.78:0/3759240793 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2b015b8f0 msgr2=0x7fa2b01e4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:19.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.950+0000 7fa2b5529640 1 --2- 172.21.15.78:0/3759240793 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2b015b8f0 0x7fa2b01e4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.950+0000 7fa2b5529640 1 -- 172.21.15.78:0/3759240793 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2b00b0520 msgr2=0x7fa2b014a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:19.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.950+0000 7fa2b5529640 1 --2- 172.21.15.78:0/3759240793 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2b00b0520 0x7fa2b014a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:19.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.950+0000 7fa2b5529640 1 -- 172.21.15.78:0/3759240793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b01f8f40 con 0x7fa2b00b2cb0 2024-09-17T03:15:19.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.950+0000 7fa2b5d2a640 1 --2- 172.21.15.78:0/3759240793 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2b00b0520 0x7fa2b014a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:19.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.951+0000 7fa2b5529640 1 --2- 172.21.15.78:0/3759240793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2b00b2cb0 0x7fa2b01f5a90 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000d700 tx=0x7fa2a000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:19.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.951+0000 7fa2a67fc640 1 -- 172.21.15.78:0/3759240793 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0017070 con 0x7fa2b00b2cb0 2024-09-17T03:15:19.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.951+0000 7fa2a67fc640 1 -- 172.21.15.78:0/3759240793 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2a0005310 con 0x7fa2b00b2cb0 2024-09-17T03:15:19.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.951+0000 7fa2b7f8e640 1 -- 172.21.15.78:0/3759240793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b01f9220 con 0x7fa2b00b2cb0 2024-09-17T03:15:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.951+0000 7fa2a67fc640 1 -- 172.21.15.78:0/3759240793 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0009820 con 0x7fa2b00b2cb0 2024-09-17T03:15:19.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.951+0000 7fa2b7f8e640 1 -- 172.21.15.78:0/3759240793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2b01f97e0 con 0x7fa2b00b2cb0 2024-09-17T03:15:19.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.952+0000 7fa2b7f8e640 1 -- 172.21.15.78:0/3759240793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2b00af9d0 con 0x7fa2b00b2cb0 2024-09-17T03:15:19.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.953+0000 7fa2a67fc640 1 -- 172.21.15.78:0/3759240793 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa2a00099c0 con 0x7fa2b00b2cb0 2024-09-17T03:15:19.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.953+0000 7fa2a67fc640 1 --2- 172.21.15.78:0/3759240793 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa294078bc0 0x7fa29407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:19.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.953+0000 7fa2a67fc640 1 -- 172.21.15.78:0/3759240793 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fa2a009add0 con 0x7fa2b00b2cb0 2024-09-17T03:15:19.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.953+0000 7fa2b5d2a640 1 --2- 172.21.15.78:0/3759240793 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa294078bc0 0x7fa29407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:19.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.954+0000 7fa2b5d2a640 1 --2- 172.21.15.78:0/3759240793 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa294078bc0 0x7fa29407b0d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac033000 tx=0x7fa2ac004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:19.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:19.957+0000 7fa2a67fc640 1 -- 172.21.15.78:0/3759240793 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa2a00632a0 con 0x7fa2b00b2cb0 2024-09-17T03:15:20.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:20.205+0000 7fa2b7f8e640 1 -- 172.21.15.78:0/3759240793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa2b00cb860 con 0x7fa2b00b2cb0 2024-09-17T03:15:20.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:20.206+0000 7fa2a67fc640 1 -- 172.21.15.78:0/3759240793 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2009 (secure 0 0 0) 0x7fa2a009c7f0 con 0x7fa2b00b2cb0 2024-09-17T03:15:20.204 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:20.205 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":437,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":706268,"bytes_used":262103040,"bytes_avail":772832010240,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":5800,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7213},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8283},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8286}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":30,"modified":"2024-09-17T03:15:13.231420+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-17T03:15:20.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:20.208+0000 7fa2b7f8e640 1 -- 172.21.15.78:0/3759240793 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa294078bc0 msgr2=0x7fa29407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:20.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:20.208+0000 7fa2b7f8e640 1 --2- 172.21.15.78:0/3759240793 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa294078bc0 0x7fa29407b0d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac033000 tx=0x7fa2ac004730 comp rx=0 tx=0).stop 2024-09-17T03:15:20.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:20.208+0000 7fa2b7f8e640 1 -- 172.21.15.78:0/3759240793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2b00b2cb0 msgr2=0x7fa2b01f5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:20.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:20.208+0000 7fa2b7f8e640 1 --2- 172.21.15.78:0/3759240793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2b00b2cb0 0x7fa2b01f5a90 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000d700 tx=0x7fa2a000dbc0 comp rx=0 tx=0).stop 2024-09-17T03:15:20.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:20.208+0000 7fa2b7f8e640 1 -- 172.21.15.78:0/3759240793 shutdown_connections 2024-09-17T03:15:20.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:20.208+0000 7fa2b7f8e640 1 --2- 172.21.15.78:0/3759240793 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2b015b8f0 0x7fa2b01e4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:20.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:20.208+0000 7fa2b7f8e640 1 --2- 172.21.15.78:0/3759240793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2b00b2cb0 0x7fa2b01f5a90 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:20.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:20.208+0000 7fa2b7f8e640 1 --2- 172.21.15.78:0/3759240793 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa294078bc0 0x7fa29407b0d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:20.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:20.208+0000 7fa2b7f8e640 1 --2- 172.21.15.78:0/3759240793 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2b00b0520 0x7fa2b014a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:20.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:20.208+0000 7fa2b7f8e640 1 -- 172.21.15.78:0/3759240793 >> 172.21.15.78:0/3759240793 conn(0x7fa2b00cdcb0 msgr2=0x7fa2b00cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:20.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:20.208+0000 7fa2b7f8e640 1 -- 172.21.15.78:0/3759240793 shutdown_connections 2024-09-17T03:15:20.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:20.208+0000 7fa2b7f8e640 1 -- 172.21.15.78:0/3759240793 wait complete. 2024-09-17T03:15:20.218 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'paused paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-17T03:15:21.219 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:21.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.334+0000 7fea98d8e640 1 -- 172.21.15.78:0/36305695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea940ccba0 msgr2=0x7fea940ccfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:21.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.334+0000 7fea98d8e640 1 --2- 172.21.15.78:0/36305695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea940ccba0 0x7fea940ccfb0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fea94074550 tx=0x7fea8c02a530 comp rx=0 tx=0).stop 2024-09-17T03:15:21.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.334+0000 7fea98d8e640 1 -- 172.21.15.78:0/36305695 shutdown_connections 2024-09-17T03:15:21.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.334+0000 7fea98d8e640 1 --2- 172.21.15.78:0/36305695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea940ccba0 0x7fea940ccfb0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:21.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.334+0000 7fea98d8e640 1 --2- 172.21.15.78:0/36305695 >> v2:172.21.15.193:3300/0 conn(0x7fea940b5210 0x7fea940ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:21.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.334+0000 7fea98d8e640 1 -- 172.21.15.78:0/36305695 >> 172.21.15.78:0/36305695 conn(0x7fea940b3f10 msgr2=0x7fea940b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:21.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.334+0000 7fea98d8e640 1 -- 172.21.15.78:0/36305695 shutdown_connections 2024-09-17T03:15:21.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.334+0000 7fea98d8e640 1 -- 172.21.15.78:0/36305695 wait complete. 2024-09-17T03:15:21.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.336+0000 7fea98d8e640 1 Processor -- start 2024-09-17T03:15:21.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.336+0000 7fea98d8e640 1 -- start start 2024-09-17T03:15:21.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.337+0000 7fea98d8e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fea940b5210 0x7fea941f5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:21.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.337+0000 7fea98d8e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea940ccba0 0x7fea9414deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:21.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.337+0000 7fea98d8e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea940d1d40 0x7fea9406f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:21.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.337+0000 7fea98d8e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fea940d11f0 con 0x7fea940d1d40 2024-09-17T03:15:21.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.337+0000 7fea98d8e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fea940d1070 con 0x7fea940ccba0 2024-09-17T03:15:21.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.337+0000 7fea98d8e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fea940d1370 con 0x7fea940b5210 2024-09-17T03:15:21.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.337+0000 7fea92d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea940d1d40 0x7fea9406f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:21.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.338+0000 7fea92d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea940d1d40 0x7fea9406f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43386/0 (socket says 172.21.15.78:43386) 2024-09-17T03:15:21.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.338+0000 7fea92d9d640 1 -- 172.21.15.78:0/3462568891 learned_addr learned my addr 172.21.15.78:0/3462568891 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:21.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.338+0000 7fea91d9b640 1 --2- 172.21.15.78:0/3462568891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea940ccba0 0x7fea9414deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:21.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.338+0000 7fea9259c640 1 --2- 172.21.15.78:0/3462568891 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fea940b5210 0x7fea941f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:21.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.338+0000 7fea92d9d640 1 -- 172.21.15.78:0/3462568891 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fea940b5210 msgr2=0x7fea941f5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:21.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.338+0000 7fea92d9d640 1 --2- 172.21.15.78:0/3462568891 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fea940b5210 0x7fea941f5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:21.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.338+0000 7fea92d9d640 1 -- 172.21.15.78:0/3462568891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea940ccba0 msgr2=0x7fea9414deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:21.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.338+0000 7fea92d9d640 1 --2- 172.21.15.78:0/3462568891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea940ccba0 0x7fea9414deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:21.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.338+0000 7fea92d9d640 1 -- 172.21.15.78:0/3462568891 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9415e040 con 0x7fea940d1d40 2024-09-17T03:15:21.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.338+0000 7fea91d9b640 1 --2- 172.21.15.78:0/3462568891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea940ccba0 0x7fea9414deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:21.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.338+0000 7fea92d9d640 1 --2- 172.21.15.78:0/3462568891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea940d1d40 0x7fea9406f2d0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009920 tx=0x7fea8c033cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:21.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.338+0000 7fea82ffd640 1 -- 172.21.15.78:0/3462568891 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c031d60 con 0x7fea940d1d40 2024-09-17T03:15:21.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.338+0000 7fea82ffd640 1 -- 172.21.15.78:0/3462568891 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea8c005020 con 0x7fea940d1d40 2024-09-17T03:15:21.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.338+0000 7fea98d8e640 1 -- 172.21.15.78:0/3462568891 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea941f5ee0 con 0x7fea940d1d40 2024-09-17T03:15:21.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.338+0000 7fea82ffd640 1 -- 172.21.15.78:0/3462568891 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8c005470 con 0x7fea940d1d40 2024-09-17T03:15:21.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.338+0000 7fea98d8e640 1 -- 172.21.15.78:0/3462568891 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea941f64a0 con 0x7fea940d1d40 2024-09-17T03:15:21.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.339+0000 7fea98d8e640 1 -- 172.21.15.78:0/3462568891 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea940d1840 con 0x7fea940d1d40 2024-09-17T03:15:21.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.340+0000 7fea82ffd640 1 -- 172.21.15.78:0/3462568891 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea8c0047a0 con 0x7fea940d1d40 2024-09-17T03:15:21.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.340+0000 7fea82ffd640 1 --2- 172.21.15.78:0/3462568891 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fea74078b90 0x7fea7407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:21.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.341+0000 7fea82ffd640 1 -- 172.21.15.78:0/3462568891 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fea8c0bc000 con 0x7fea940d1d40 2024-09-17T03:15:21.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.341+0000 7fea9259c640 1 --2- 172.21.15.78:0/3462568891 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fea74078b90 0x7fea7407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:21.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.342+0000 7fea9259c640 1 --2- 172.21.15.78:0/3462568891 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fea74078b90 0x7fea7407b0a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fea840012e0 tx=0x7fea84009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:21.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.345+0000 7fea82ffd640 1 -- 172.21.15.78:0/3462568891 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fea8c03f030 con 0x7fea940d1d40 2024-09-17T03:15:21.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.554+0000 7fea98d8e640 1 -- 172.21.15.78:0/3462568891 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea941f5c20 con 0x7fea940d1d40 2024-09-17T03:15:21.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.554+0000 7fea82ffd640 1 -- 172.21.15.78:0/3462568891 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5280 (secure 0 0 0) 0x7fea8c084450 con 0x7fea940d1d40 2024-09-17T03:15:21.553 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:21.553 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:15:12.673912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8286,"mds_1":8283,"mds_2":7213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7213":{"gid":7213,"name":"d","rank":2,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8283":{"gid":8283,"name":"a","rank":1,"incarnation":95,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[8286,8283,7213]},"id":7}]} 2024-09-17T03:15:21.554 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 103 2024-09-17T03:15:21.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.557+0000 7fea98d8e640 1 -- 172.21.15.78:0/3462568891 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fea74078b90 msgr2=0x7fea7407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:21.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.557+0000 7fea98d8e640 1 --2- 172.21.15.78:0/3462568891 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fea74078b90 0x7fea7407b0a0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fea840012e0 tx=0x7fea84009040 comp rx=0 tx=0).stop 2024-09-17T03:15:21.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.557+0000 7fea98d8e640 1 -- 172.21.15.78:0/3462568891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea940d1d40 msgr2=0x7fea9406f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:21.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.557+0000 7fea98d8e640 1 --2- 172.21.15.78:0/3462568891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea940d1d40 0x7fea9406f2d0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009920 tx=0x7fea8c033cc0 comp rx=0 tx=0).stop 2024-09-17T03:15:21.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.557+0000 7fea98d8e640 1 -- 172.21.15.78:0/3462568891 shutdown_connections 2024-09-17T03:15:21.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.557+0000 7fea98d8e640 1 --2- 172.21.15.78:0/3462568891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fea940d1d40 0x7fea9406f2d0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:21.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.557+0000 7fea98d8e640 1 --2- 172.21.15.78:0/3462568891 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fea74078b90 0x7fea7407b0a0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:21.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.557+0000 7fea98d8e640 1 --2- 172.21.15.78:0/3462568891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea940ccba0 0x7fea9414deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:21.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.557+0000 7fea98d8e640 1 --2- 172.21.15.78:0/3462568891 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fea940b5210 0x7fea941f5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:21.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.557+0000 7fea98d8e640 1 -- 172.21.15.78:0/3462568891 >> 172.21.15.78:0/3462568891 conn(0x7fea940b3f10 msgr2=0x7fea940b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:21.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.557+0000 7fea98d8e640 1 -- 172.21.15.78:0/3462568891 shutdown_connections 2024-09-17T03:15:21.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.557+0000 7fea98d8e640 1 -- 172.21.15.78:0/3462568891 wait complete. 2024-09-17T03:15:21.567 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2024-09-17T03:15:21.567 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:15:21.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.679+0000 7fd66ffc3640 1 -- 172.21.15.78:0/3080262724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6680b4110 msgr2=0x7fd6680b4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:21.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.679+0000 7fd66ffc3640 1 --2- 172.21.15.78:0/3080262724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6680b4110 0x7fd6680b4520 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fd668073660 tx=0x7fd65802a4d0 comp rx=0 tx=0).stop 2024-09-17T03:15:21.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.679+0000 7fd66ffc3640 1 -- 172.21.15.78:0/3080262724 shutdown_connections 2024-09-17T03:15:21.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.679+0000 7fd66ffc3640 1 --2- 172.21.15.78:0/3080262724 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6680b4110 0x7fd6680b4520 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:21.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.679+0000 7fd66ffc3640 1 --2- 172.21.15.78:0/3080262724 >> v2:172.21.15.193:3300/0 conn(0x7fd6681559b0 0x7fd66815cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:21.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.679+0000 7fd66ffc3640 1 -- 172.21.15.78:0/3080262724 >> 172.21.15.78:0/3080262724 conn(0x7fd66806def0 msgr2=0x7fd66806e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:21.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.679+0000 7fd66ffc3640 1 -- 172.21.15.78:0/3080262724 shutdown_connections 2024-09-17T03:15:21.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.679+0000 7fd66ffc3640 1 -- 172.21.15.78:0/3080262724 wait complete. 2024-09-17T03:15:21.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.681+0000 7fd66ffc3640 1 Processor -- start 2024-09-17T03:15:21.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.681+0000 7fd66ffc3640 1 -- start start 2024-09-17T03:15:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.682+0000 7fd66ffc3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd66806cde0 0x7fd668143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.682+0000 7fd66ffc3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd6680b4110 0x7fd6680ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.682+0000 7fd66ffc3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6681559b0 0x7fd6680d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.682+0000 7fd66ffc3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd668074a20 con 0x7fd66806cde0 2024-09-17T03:15:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.682+0000 7fd66ffc3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd6680748a0 con 0x7fd6681559b0 2024-09-17T03:15:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.682+0000 7fd66ffc3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd668074ba0 con 0x7fd6680b4110 2024-09-17T03:15:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.683+0000 7fd66dd5f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd66806cde0 0x7fd668143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.683+0000 7fd66dd5f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd66806cde0 0x7fd668143ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43414/0 (socket says 172.21.15.78:43414) 2024-09-17T03:15:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.683+0000 7fd66dd5f640 1 -- 172.21.15.78:0/3750697756 learned_addr learned my addr 172.21.15.78:0/3750697756 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.683+0000 7fd66d55e640 1 --2- 172.21.15.78:0/3750697756 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd6680b4110 0x7fd6680ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:21.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.683+0000 7fd66e560640 1 --2- 172.21.15.78:0/3750697756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6681559b0 0x7fd6680d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.683+0000 7fd66dd5f640 1 -- 172.21.15.78:0/3750697756 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd6680b4110 msgr2=0x7fd6680ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.683+0000 7fd66dd5f640 1 --2- 172.21.15.78:0/3750697756 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd6680b4110 0x7fd6680ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.683+0000 7fd66dd5f640 1 -- 172.21.15.78:0/3750697756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6681559b0 msgr2=0x7fd6680d0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.683+0000 7fd66dd5f640 1 --2- 172.21.15.78:0/3750697756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6681559b0 0x7fd6680d0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.683+0000 7fd66dd5f640 1 -- 172.21.15.78:0/3750697756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6680cfcb0 con 0x7fd66806cde0 2024-09-17T03:15:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.683+0000 7fd66e560640 1 --2- 172.21.15.78:0/3750697756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6681559b0 0x7fd6680d0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.683+0000 7fd66dd5f640 1 --2- 172.21.15.78:0/3750697756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd66806cde0 0x7fd668143ce0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fd66400c9a0 tx=0x7fd66400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.683+0000 7fd65e7fc640 1 -- 172.21.15.78:0/3750697756 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd664007bb0 con 0x7fd66806cde0 2024-09-17T03:15:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.683+0000 7fd65e7fc640 1 -- 172.21.15.78:0/3750697756 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd664007e40 con 0x7fd66806cde0 2024-09-17T03:15:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.683+0000 7fd65e7fc640 1 -- 172.21.15.78:0/3750697756 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66400f690 con 0x7fd66806cde0 2024-09-17T03:15:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.683+0000 7fd66ffc3640 1 -- 172.21.15.78:0/3750697756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6680cf1e0 con 0x7fd66806cde0 2024-09-17T03:15:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.683+0000 7fd66ffc3640 1 -- 172.21.15.78:0/3750697756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6680cf9d0 con 0x7fd66806cde0 2024-09-17T03:15:21.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.684+0000 7fd66ffc3640 1 -- 172.21.15.78:0/3750697756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd668071740 con 0x7fd66806cde0 2024-09-17T03:15:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.685+0000 7fd65e7fc640 1 -- 172.21.15.78:0/3750697756 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd664018400 con 0x7fd66806cde0 2024-09-17T03:15:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.686+0000 7fd65e7fc640 1 --2- 172.21.15.78:0/3750697756 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd64c078b90 0x7fd64c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.686+0000 7fd65e7fc640 1 -- 172.21.15.78:0/3750697756 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fd66409b950 con 0x7fd66806cde0 2024-09-17T03:15:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.686+0000 7fd66d55e640 1 --2- 172.21.15.78:0/3750697756 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd64c078b90 0x7fd64c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.686+0000 7fd66d55e640 1 --2- 172.21.15.78:0/3750697756 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd64c078b90 0x7fd64c07b0a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd658033000 tx=0x7fd658004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.689+0000 7fd65e7fc640 1 -- 172.21.15.78:0/3750697756 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd668071740 con 0x7fd66806cde0 2024-09-17T03:15:21.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.932+0000 7fd66ffc3640 1 -- 172.21.15.78:0/3750697756 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd6680750c0 con 0x7fd66806cde0 2024-09-17T03:15:21.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.932+0000 7fd65e7fc640 1 -- 172.21.15.78:0/3750697756 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2015 (secure 0 0 0) 0x7fd664026020 con 0x7fd66806cde0 2024-09-17T03:15:21.931 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:21.931 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":439,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":706268,"bytes_used":262103040,"bytes_avail":772832010240,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":5545,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7213},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8283},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8286}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":31,"modified":"2024-09-17T03:15:21.233733+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-17T03:15:21.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.934+0000 7fd66ffc3640 1 -- 172.21.15.78:0/3750697756 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd64c078b90 msgr2=0x7fd64c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:21.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.934+0000 7fd66ffc3640 1 --2- 172.21.15.78:0/3750697756 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd64c078b90 0x7fd64c07b0a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fd658033000 tx=0x7fd658004730 comp rx=0 tx=0).stop 2024-09-17T03:15:21.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.934+0000 7fd66ffc3640 1 -- 172.21.15.78:0/3750697756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd66806cde0 msgr2=0x7fd668143ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:21.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.934+0000 7fd66ffc3640 1 --2- 172.21.15.78:0/3750697756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd66806cde0 0x7fd668143ce0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fd66400c9a0 tx=0x7fd66400ce60 comp rx=0 tx=0).stop 2024-09-17T03:15:21.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.934+0000 7fd66ffc3640 1 -- 172.21.15.78:0/3750697756 shutdown_connections 2024-09-17T03:15:21.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.934+0000 7fd66ffc3640 1 --2- 172.21.15.78:0/3750697756 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd64c078b90 0x7fd64c07b0a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:21.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.934+0000 7fd66ffc3640 1 --2- 172.21.15.78:0/3750697756 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6681559b0 0x7fd6680d0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:21.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.934+0000 7fd66ffc3640 1 --2- 172.21.15.78:0/3750697756 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd6680b4110 0x7fd6680ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:21.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.934+0000 7fd66ffc3640 1 --2- 172.21.15.78:0/3750697756 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd66806cde0 0x7fd668143ce0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:21.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.934+0000 7fd66ffc3640 1 -- 172.21.15.78:0/3750697756 >> 172.21.15.78:0/3750697756 conn(0x7fd66806def0 msgr2=0x7fd6681589e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:21.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.934+0000 7fd66ffc3640 1 -- 172.21.15.78:0/3750697756 shutdown_connections 2024-09-17T03:15:21.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:21.934+0000 7fd66ffc3640 1 -- 172.21.15.78:0/3750697756 wait complete. 2024-09-17T03:15:21.944 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'idle+waiting paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-17T03:15:22.945 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:23.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.071+0000 7f782c2de640 1 -- 172.21.15.78:0/2266818445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78240cb0b0 msgr2=0x7f782406ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:23.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.071+0000 7f782c2de640 1 --2- 172.21.15.78:0/2266818445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78240cb0b0 0x7f782406ee90 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f78240d11c0 tx=0x7f781c02aa30 comp rx=0 tx=0).stop 2024-09-17T03:15:23.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.072+0000 7f782c2de640 1 -- 172.21.15.78:0/2266818445 shutdown_connections 2024-09-17T03:15:23.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.072+0000 7f782c2de640 1 --2- 172.21.15.78:0/2266818445 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78240cb0b0 0x7f782406ee90 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:23.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.072+0000 7f782c2de640 1 --2- 172.21.15.78:0/2266818445 >> v2:172.21.15.193:3300/0 conn(0x7f78240cfb00 0x7f782415bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:23.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.072+0000 7f782c2de640 1 -- 172.21.15.78:0/2266818445 >> 172.21.15.78:0/2266818445 conn(0x7f78240b1cb0 msgr2=0x7f78240b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:23.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.072+0000 7f782c2de640 1 -- 172.21.15.78:0/2266818445 shutdown_connections 2024-09-17T03:15:23.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.072+0000 7f782c2de640 1 -- 172.21.15.78:0/2266818445 wait complete. 2024-09-17T03:15:23.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.073+0000 7f782c2de640 1 Processor -- start 2024-09-17T03:15:23.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.073+0000 7f782c2de640 1 -- start start 2024-09-17T03:15:23.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.075+0000 7f782c2de640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78240cf160 0x7f782414aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:23.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.075+0000 7f782c2de640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78240cfb00 0x7f78240b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:23.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.075+0000 7f782c2de640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f782409d970 0x7f78240b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:23.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.075+0000 7f782c2de640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f782406f3d0 con 0x7f78240cfb00 2024-09-17T03:15:23.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.075+0000 7f782c2de640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f78240cf780 con 0x7f782409d970 2024-09-17T03:15:23.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.075+0000 7f782c2de640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f782406f550 con 0x7f78240cf160 2024-09-17T03:15:23.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.075+0000 7f7829879640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78240cfb00 0x7f78240b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:23.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.075+0000 7f7829879640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78240cfb00 0x7f78240b0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43426/0 (socket says 172.21.15.78:43426) 2024-09-17T03:15:23.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.075+0000 7f7829879640 1 -- 172.21.15.78:0/959982378 learned_addr learned my addr 172.21.15.78:0/959982378 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:23.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.075+0000 7f782a87b640 1 --2- 172.21.15.78:0/959982378 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f782409d970 0x7f78240b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:23.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.075+0000 7f7829879640 1 -- 172.21.15.78:0/959982378 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78240cf160 msgr2=0x7f782414aeb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T03:15:23.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.075+0000 7f7829879640 1 --2- 172.21.15.78:0/959982378 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78240cf160 0x7f782414aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:23.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.075+0000 7f7829879640 1 -- 172.21.15.78:0/959982378 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f782409d970 msgr2=0x7f78240b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:23.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.075+0000 7f7829879640 1 --2- 172.21.15.78:0/959982378 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f782409d970 0x7f78240b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:23.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.075+0000 7f7829879640 1 -- 172.21.15.78:0/959982378 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782414def0 con 0x7f78240cfb00 2024-09-17T03:15:23.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.075+0000 7f7829879640 1 --2- 172.21.15.78:0/959982378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78240cfb00 0x7f78240b0a50 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f781400b3e0 tx=0x7f781400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:23.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.075+0000 7f781affd640 1 -- 172.21.15.78:0/959982378 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f781400f8a0 con 0x7f78240cfb00 2024-09-17T03:15:23.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.076+0000 7f781affd640 1 -- 172.21.15.78:0/959982378 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f781400fb30 con 0x7f78240cfb00 2024-09-17T03:15:23.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.076+0000 7f782c2de640 1 -- 172.21.15.78:0/959982378 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f782414e1d0 con 0x7f78240cfb00 2024-09-17T03:15:23.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.076+0000 7f781affd640 1 -- 172.21.15.78:0/959982378 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7814010470 con 0x7f78240cfb00 2024-09-17T03:15:23.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.076+0000 7f782c2de640 1 -- 172.21.15.78:0/959982378 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f782414b900 con 0x7f78240cfb00 2024-09-17T03:15:23.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.077+0000 7f782c2de640 1 -- 172.21.15.78:0/959982378 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f782414dc60 con 0x7f78240cfb00 2024-09-17T03:15:23.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.077+0000 7f781affd640 1 -- 172.21.15.78:0/959982378 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7814019400 con 0x7f78240cfb00 2024-09-17T03:15:23.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.078+0000 7f781affd640 1 --2- 172.21.15.78:0/959982378 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7808078b90 0x7f780807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:23.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.078+0000 7f781affd640 1 -- 172.21.15.78:0/959982378 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f781409cb60 con 0x7f78240cfb00 2024-09-17T03:15:23.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.078+0000 7f782a07a640 1 --2- 172.21.15.78:0/959982378 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7808078b90 0x7f780807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:23.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.079+0000 7f782a07a640 1 --2- 172.21.15.78:0/959982378 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7808078b90 0x7f780807b0a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f78200058c0 tx=0x7f7820005850 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:23.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.082+0000 7f781affd640 1 -- 172.21.15.78:0/959982378 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7814015030 con 0x7f78240cfb00 2024-09-17T03:15:23.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.292+0000 7f782c2de640 1 -- 172.21.15.78:0/959982378 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78240b2400 con 0x7f78240cfb00 2024-09-17T03:15:23.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.292+0000 7f781affd640 1 -- 172.21.15.78:0/959982378 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5280 (secure 0 0 0) 0x7f7814065030 con 0x7f78240cfb00 2024-09-17T03:15:23.291 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:23.291 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:15:12.673912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8286,"mds_1":8283,"mds_2":7213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7213":{"gid":7213,"name":"d","rank":2,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8283":{"gid":8283,"name":"a","rank":1,"incarnation":95,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[8286,8283,7213]},"id":7}]} 2024-09-17T03:15:23.292 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 103 2024-09-17T03:15:23.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.294+0000 7f782c2de640 1 -- 172.21.15.78:0/959982378 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7808078b90 msgr2=0x7f780807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:23.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.294+0000 7f782c2de640 1 --2- 172.21.15.78:0/959982378 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7808078b90 0x7f780807b0a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f78200058c0 tx=0x7f7820005850 comp rx=0 tx=0).stop 2024-09-17T03:15:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.295+0000 7f782c2de640 1 -- 172.21.15.78:0/959982378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78240cfb00 msgr2=0x7f78240b0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.295+0000 7f782c2de640 1 --2- 172.21.15.78:0/959982378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78240cfb00 0x7f78240b0a50 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f781400b3e0 tx=0x7f781400b8a0 comp rx=0 tx=0).stop 2024-09-17T03:15:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.295+0000 7f782c2de640 1 -- 172.21.15.78:0/959982378 shutdown_connections 2024-09-17T03:15:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.295+0000 7f782c2de640 1 --2- 172.21.15.78:0/959982378 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7808078b90 0x7f780807b0a0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.295+0000 7f782c2de640 1 --2- 172.21.15.78:0/959982378 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f782409d970 0x7f78240b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.295+0000 7f782c2de640 1 --2- 172.21.15.78:0/959982378 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78240cfb00 0x7f78240b0a50 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.295+0000 7f782c2de640 1 --2- 172.21.15.78:0/959982378 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f78240cf160 0x7f782414aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.295+0000 7f782c2de640 1 -- 172.21.15.78:0/959982378 >> 172.21.15.78:0/959982378 conn(0x7f78240b1cb0 msgr2=0x7f78240b4980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.295+0000 7f782c2de640 1 -- 172.21.15.78:0/959982378 shutdown_connections 2024-09-17T03:15:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.295+0000 7f782c2de640 1 -- 172.21.15.78:0/959982378 wait complete. 2024-09-17T03:15:23.305 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2024-09-17T03:15:23.305 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:15:23.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.418+0000 7f9c9a19d640 1 -- 172.21.15.78:0/1240635925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c940b6e20 msgr2=0x7f9c940b4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:23.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.418+0000 7f9c9a19d640 1 --2- 172.21.15.78:0/1240635925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c940b6e20 0x7f9c940b4f40 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f9c94074900 tx=0x7f9c8402a530 comp rx=0 tx=0).stop 2024-09-17T03:15:23.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.418+0000 7f9c9a19d640 1 -- 172.21.15.78:0/1240635925 shutdown_connections 2024-09-17T03:15:23.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.418+0000 7f9c9a19d640 1 --2- 172.21.15.78:0/1240635925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c940b6e20 0x7f9c940b4f40 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:23.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.418+0000 7f9c9a19d640 1 --2- 172.21.15.78:0/1240635925 >> v2:172.21.15.193:3300/0 conn(0x7f9c940cd860 0x7f9c940b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:23.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.418+0000 7f9c9a19d640 1 -- 172.21.15.78:0/1240635925 >> 172.21.15.78:0/1240635925 conn(0x7f9c940b3be0 msgr2=0x7f9c940b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:23.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.418+0000 7f9c9a19d640 1 -- 172.21.15.78:0/1240635925 shutdown_connections 2024-09-17T03:15:23.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.418+0000 7f9c9a19d640 1 -- 172.21.15.78:0/1240635925 wait complete. 2024-09-17T03:15:23.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.420+0000 7f9c9a19d640 1 Processor -- start 2024-09-17T03:15:23.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.420+0000 7f9c9a19d640 1 -- start start 2024-09-17T03:15:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.421+0000 7f9c9a19d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c9409aa30 0x7f9c94158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.421+0000 7f9c9a19d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9c940b6e20 0x7f9c94158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.421+0000 7f9c9a19d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c940cd860 0x7f9c941f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.421+0000 7f9c9a19d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9c940d0a60 con 0x7f9c9409aa30 2024-09-17T03:15:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.421+0000 7f9c9a19d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9c940d08e0 con 0x7f9c940cd860 2024-09-17T03:15:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.421+0000 7f9c9a19d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f9c940d0be0 con 0x7f9c940b6e20 2024-09-17T03:15:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.421+0000 7f9c9919b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c9409aa30 0x7f9c94158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.421+0000 7f9c9919b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c9409aa30 0x7f9c94158250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43442/0 (socket says 172.21.15.78:43442) 2024-09-17T03:15:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.421+0000 7f9c9919b640 1 -- 172.21.15.78:0/698248806 learned_addr learned my addr 172.21.15.78:0/698248806 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.421+0000 7f9c9919b640 1 -- 172.21.15.78:0/698248806 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9c940b6e20 msgr2=0x7f9c94158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:23.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.421+0000 7f9c9919b640 1 --2- 172.21.15.78:0/698248806 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9c940b6e20 0x7f9c94158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:23.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.421+0000 7f9c9919b640 1 -- 172.21.15.78:0/698248806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c940cd860 msgr2=0x7f9c941f69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:23.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.421+0000 7f9c9919b640 1 --2- 172.21.15.78:0/698248806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c940cd860 0x7f9c941f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:23.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.421+0000 7f9c9919b640 1 -- 172.21.15.78:0/698248806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9414b300 con 0x7f9c9409aa30 2024-09-17T03:15:23.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.422+0000 7f9c9919b640 1 --2- 172.21.15.78:0/698248806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c9409aa30 0x7f9c94158250 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000d700 tx=0x7f9c9000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:23.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.422+0000 7f9c89ffb640 1 -- 172.21.15.78:0/698248806 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c90017070 con 0x7f9c9409aa30 2024-09-17T03:15:23.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.422+0000 7f9c89ffb640 1 -- 172.21.15.78:0/698248806 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c90009d20 con 0x7f9c9409aa30 2024-09-17T03:15:23.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.422+0000 7f9c9a19d640 1 -- 172.21.15.78:0/698248806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c9414b570 con 0x7f9c9409aa30 2024-09-17T03:15:23.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.422+0000 7f9c89ffb640 1 -- 172.21.15.78:0/698248806 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c900106c0 con 0x7f9c9409aa30 2024-09-17T03:15:23.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.422+0000 7f9c9a19d640 1 -- 172.21.15.78:0/698248806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c9409c1e0 con 0x7f9c9409aa30 2024-09-17T03:15:23.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.423+0000 7f9c9a19d640 1 -- 172.21.15.78:0/698248806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c9415ae30 con 0x7f9c9409aa30 2024-09-17T03:15:23.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.424+0000 7f9c89ffb640 1 -- 172.21.15.78:0/698248806 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9c9001a070 con 0x7f9c9409aa30 2024-09-17T03:15:23.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.424+0000 7f9c89ffb640 1 --2- 172.21.15.78:0/698248806 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9c78078b90 0x7f9c7807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:23.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.424+0000 7f9c89ffb640 1 -- 172.21.15.78:0/698248806 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f9c9009ae40 con 0x7f9c9409aa30 2024-09-17T03:15:23.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.425+0000 7f9c9899a640 1 --2- 172.21.15.78:0/698248806 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9c78078b90 0x7f9c7807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:23.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.425+0000 7f9c9899a640 1 --2- 172.21.15.78:0/698248806 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9c78078b90 0x7f9c7807b0a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9c84034000 tx=0x7f9c840046c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:23.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.429+0000 7f9c89ffb640 1 -- 172.21.15.78:0/698248806 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9c9415ae30 con 0x7f9c9409aa30 2024-09-17T03:15:23.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.670+0000 7f9c9a19d640 1 -- 172.21.15.78:0/698248806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f9c940d1090 con 0x7f9c9409aa30 2024-09-17T03:15:23.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.671+0000 7f9c89ffb640 1 -- 172.21.15.78:0/698248806 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2015 (secure 0 0 0) 0x7f9c90063310 con 0x7f9c9409aa30 2024-09-17T03:15:23.670 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:23.670 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":440,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":706268,"bytes_used":262103040,"bytes_avail":772832010240,"bytes_total":773094113280,"read_bytes_sec":0,"write_bytes_sec":5545,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7213},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8283},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8286}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":31,"modified":"2024-09-17T03:15:21.233733+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/d1/d2/d3]"}}}}}},"progress_events":{}} 2024-09-17T03:15:23.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.673+0000 7f9c9a19d640 1 -- 172.21.15.78:0/698248806 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9c78078b90 msgr2=0x7f9c7807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:23.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.673+0000 7f9c9a19d640 1 --2- 172.21.15.78:0/698248806 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9c78078b90 0x7f9c7807b0a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9c84034000 tx=0x7f9c840046c0 comp rx=0 tx=0).stop 2024-09-17T03:15:23.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.673+0000 7f9c9a19d640 1 -- 172.21.15.78:0/698248806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c9409aa30 msgr2=0x7f9c94158250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:23.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.673+0000 7f9c9a19d640 1 --2- 172.21.15.78:0/698248806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c9409aa30 0x7f9c94158250 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000d700 tx=0x7f9c9000dbc0 comp rx=0 tx=0).stop 2024-09-17T03:15:23.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.673+0000 7f9c9a19d640 1 -- 172.21.15.78:0/698248806 shutdown_connections 2024-09-17T03:15:23.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.673+0000 7f9c9a19d640 1 --2- 172.21.15.78:0/698248806 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9c78078b90 0x7f9c7807b0a0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:23.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.673+0000 7f9c9a19d640 1 --2- 172.21.15.78:0/698248806 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9c940cd860 0x7f9c941f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:23.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.673+0000 7f9c9a19d640 1 --2- 172.21.15.78:0/698248806 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9c940b6e20 0x7f9c94158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:23.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.673+0000 7f9c9a19d640 1 --2- 172.21.15.78:0/698248806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c9409aa30 0x7f9c94158250 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:23.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.673+0000 7f9c9a19d640 1 -- 172.21.15.78:0/698248806 >> 172.21.15.78:0/698248806 conn(0x7f9c940b3be0 msgr2=0x7f9c940b5720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:23.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.673+0000 7f9c9a19d640 1 -- 172.21.15.78:0/698248806 shutdown_connections 2024-09-17T03:15:23.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:23.673+0000 7f9c9a19d640 1 -- 172.21.15.78:0/698248806 wait complete. 2024-09-17T03:15:23.683 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'idle+waiting paths [/d1/d2/d3]', 'c': 'paused paths [/d1/d2/d3]', 'd': 'paused paths [/d1/d2/d3]'} 2024-09-17T03:15:24.684 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:24.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.811+0000 7f396a60e640 1 -- 172.21.15.78:0/325222675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39640b2cb0 msgr2=0x7f39640b30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:24.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.811+0000 7f396a60e640 1 --2- 172.21.15.78:0/325222675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39640b2cb0 0x7f39640b30c0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f395c009ca0 tx=0x7f395c02aa30 comp rx=0 tx=0).stop 2024-09-17T03:15:24.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.811+0000 7f396a60e640 1 -- 172.21.15.78:0/325222675 shutdown_connections 2024-09-17T03:15:24.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.811+0000 7f396a60e640 1 --2- 172.21.15.78:0/325222675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39640b2cb0 0x7f39640b30c0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:24.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.811+0000 7f396a60e640 1 --2- 172.21.15.78:0/325222675 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f396415b8f0 0x7f39640cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:24.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.811+0000 7f396a60e640 1 -- 172.21.15.78:0/325222675 >> 172.21.15.78:0/325222675 conn(0x7f39640cdcb0 msgr2=0x7f39640ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:24.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.811+0000 7f396a60e640 1 -- 172.21.15.78:0/325222675 shutdown_connections 2024-09-17T03:15:24.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.811+0000 7f396a60e640 1 -- 172.21.15.78:0/325222675 wait complete. 2024-09-17T03:15:24.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.812+0000 7f396a60e640 1 Processor -- start 2024-09-17T03:15:24.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.813+0000 7f396a60e640 1 -- start start 2024-09-17T03:15:24.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.814+0000 7f396a60e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39640b0520 0x7f3964147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:24.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.814+0000 7f396a60e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f39640b2cb0 0x7f39641e59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:24.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.814+0000 7f396a60e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f396415b8f0 0x7f39641e5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:24.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.814+0000 7f396a60e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f39640ae370 con 0x7f396415b8f0 2024-09-17T03:15:24.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.814+0000 7f396a60e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f39640ae1f0 con 0x7f39640b0520 2024-09-17T03:15:24.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.814+0000 7f396a60e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f39640ae4f0 con 0x7f39640b2cb0 2024-09-17T03:15:24.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.814+0000 7f3968bab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f396415b8f0 0x7f39641e5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.814+0000 7f3968bab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f396415b8f0 0x7f39641e5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43466/0 (socket says 172.21.15.78:43466) 2024-09-17T03:15:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.814+0000 7f3968bab640 1 -- 172.21.15.78:0/704498508 learned_addr learned my addr 172.21.15.78:0/704498508 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.814+0000 7f3963fff640 1 --2- 172.21.15.78:0/704498508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39640b0520 0x7f3964147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.814+0000 7f39637fe640 1 --2- 172.21.15.78:0/704498508 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f39640b2cb0 0x7f39641e59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.814+0000 7f3968bab640 1 -- 172.21.15.78:0/704498508 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f39640b2cb0 msgr2=0x7f39641e59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.814+0000 7f3968bab640 1 --2- 172.21.15.78:0/704498508 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f39640b2cb0 0x7f39641e59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.814+0000 7f3968bab640 1 -- 172.21.15.78:0/704498508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39640b0520 msgr2=0x7f3964147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.814+0000 7f3968bab640 1 --2- 172.21.15.78:0/704498508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39640b0520 0x7f3964147360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.815+0000 7f3968bab640 1 -- 172.21.15.78:0/704498508 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396415aec0 con 0x7f396415b8f0 2024-09-17T03:15:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.815+0000 7f3968bab640 1 --2- 172.21.15.78:0/704498508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f396415b8f0 0x7f39641e5f30 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f395c009dc0 tx=0x7f395c003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.815+0000 7f3960ff9640 1 -- 172.21.15.78:0/704498508 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c033050 con 0x7f396415b8f0 2024-09-17T03:15:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.815+0000 7f3960ff9640 1 -- 172.21.15.78:0/704498508 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f395c0045d0 con 0x7f396415b8f0 2024-09-17T03:15:24.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.815+0000 7f396a60e640 1 -- 172.21.15.78:0/704498508 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396409def0 con 0x7f396415b8f0 2024-09-17T03:15:24.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.815+0000 7f3960ff9640 1 -- 172.21.15.78:0/704498508 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c038450 con 0x7f396415b8f0 2024-09-17T03:15:24.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.815+0000 7f396a60e640 1 -- 172.21.15.78:0/704498508 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f396409e4b0 con 0x7f396415b8f0 2024-09-17T03:15:24.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.816+0000 7f396a60e640 1 -- 172.21.15.78:0/704498508 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f396409dc60 con 0x7f396415b8f0 2024-09-17T03:15:24.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.817+0000 7f3960ff9640 1 -- 172.21.15.78:0/704498508 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f395c036070 con 0x7f396415b8f0 2024-09-17T03:15:24.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.817+0000 7f3960ff9640 1 --2- 172.21.15.78:0/704498508 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3950078b90 0x7f395007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:24.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.817+0000 7f3960ff9640 1 -- 172.21.15.78:0/704498508 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f395c0bc120 con 0x7f396415b8f0 2024-09-17T03:15:24.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.818+0000 7f3963fff640 1 --2- 172.21.15.78:0/704498508 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3950078b90 0x7f395007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:24.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.818+0000 7f3963fff640 1 --2- 172.21.15.78:0/704498508 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3950078b90 0x7f395007b0a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3954005fd0 tx=0x7f395400a250 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:24.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:24.822+0000 7f3960ff9640 1 -- 172.21.15.78:0/704498508 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f39640b3600 con 0x7f396415b8f0 2024-09-17T03:15:25.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.030+0000 7f396a60e640 1 -- 172.21.15.78:0/704498508 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3964147b10 con 0x7f396415b8f0 2024-09-17T03:15:25.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.031+0000 7f3960ff9640 1 -- 172.21.15.78:0/704498508 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5280 (secure 0 0 0) 0x7f395c083f10 con 0x7f396415b8f0 2024-09-17T03:15:25.030 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:25.030 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:15:12.673912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8286,"mds_1":8283,"mds_2":7213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7213":{"gid":7213,"name":"d","rank":2,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8283":{"gid":8283,"name":"a","rank":1,"incarnation":95,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[8286,8283,7213]},"id":7}]} 2024-09-17T03:15:25.030 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 103 2024-09-17T03:15:25.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.033+0000 7f396a60e640 1 -- 172.21.15.78:0/704498508 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3950078b90 msgr2=0x7f395007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:25.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.033+0000 7f396a60e640 1 --2- 172.21.15.78:0/704498508 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3950078b90 0x7f395007b0a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3954005fd0 tx=0x7f395400a250 comp rx=0 tx=0).stop 2024-09-17T03:15:25.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.033+0000 7f396a60e640 1 -- 172.21.15.78:0/704498508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f396415b8f0 msgr2=0x7f39641e5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:25.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.033+0000 7f396a60e640 1 --2- 172.21.15.78:0/704498508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f396415b8f0 0x7f39641e5f30 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f395c009dc0 tx=0x7f395c003f80 comp rx=0 tx=0).stop 2024-09-17T03:15:25.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.033+0000 7f396a60e640 1 -- 172.21.15.78:0/704498508 shutdown_connections 2024-09-17T03:15:25.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.033+0000 7f396a60e640 1 --2- 172.21.15.78:0/704498508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f396415b8f0 0x7f39641e5f30 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:25.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.033+0000 7f396a60e640 1 --2- 172.21.15.78:0/704498508 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f39640b2cb0 0x7f39641e59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:25.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.033+0000 7f396a60e640 1 --2- 172.21.15.78:0/704498508 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3950078b90 0x7f395007b0a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:25.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.033+0000 7f396a60e640 1 --2- 172.21.15.78:0/704498508 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f39640b0520 0x7f3964147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:25.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.033+0000 7f396a60e640 1 -- 172.21.15.78:0/704498508 >> 172.21.15.78:0/704498508 conn(0x7f39640cdcb0 msgr2=0x7f39640cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:25.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.033+0000 7f396a60e640 1 -- 172.21.15.78:0/704498508 shutdown_connections 2024-09-17T03:15:25.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.033+0000 7f396a60e640 1 -- 172.21.15.78:0/704498508 wait complete. 2024-09-17T03:15:25.043 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2024-09-17T03:15:25.044 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:15:25.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.157+0000 7f00caf41640 1 -- 172.21.15.78:0/3955844553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00ac004d40 msgr2=0x7f00ac005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:25.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.157+0000 7f00caf41640 1 --2- 172.21.15.78:0/3955844553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00ac004d40 0x7f00ac005210 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f00c40cb830 tx=0x7f00ac005830 comp rx=0 tx=0).stop 2024-09-17T03:15:25.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.157+0000 7f00c94de640 1 -- 172.21.15.78:0/3955844553 reap_dead start 2024-09-17T03:15:25.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.157+0000 7f00caf41640 1 -- 172.21.15.78:0/3955844553 shutdown_connections 2024-09-17T03:15:25.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.157+0000 7f00caf41640 1 -- 172.21.15.78:0/3955844553 >> 172.21.15.78:0/3955844553 conn(0x7f00c40cdcb0 msgr2=0x7f00c40ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:25.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.157+0000 7f00caf41640 1 -- 172.21.15.78:0/3955844553 shutdown_connections 2024-09-17T03:15:25.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.157+0000 7f00caf41640 1 -- 172.21.15.78:0/3955844553 wait complete. 2024-09-17T03:15:25.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.159+0000 7f00caf41640 1 Processor -- start 2024-09-17T03:15:25.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.159+0000 7f00caf41640 1 -- start start 2024-09-17T03:15:25.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.160+0000 7f00caf41640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f00ac004d40 0x7f00c41f6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:25.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.160+0000 7f00caf41640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00c40c4d60 0x7f00c414e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:25.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.160+0000 7f00caf41640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00c409e030 0x7f00c409e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:25.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.160+0000 7f00caf41640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f00c4071bb0 con 0x7f00c409e030 2024-09-17T03:15:25.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.160+0000 7f00caf41640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f00c4071a30 con 0x7f00c40c4d60 2024-09-17T03:15:25.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.160+0000 7f00caf41640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f00c4071d30 con 0x7f00ac004d40 2024-09-17T03:15:25.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.160+0000 7f00c94de640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00c409e030 0x7f00c409e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:25.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.160+0000 7f00c94de640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00c409e030 0x7f00c409e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43498/0 (socket says 172.21.15.78:43498) 2024-09-17T03:15:25.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.160+0000 7f00c94de640 1 -- 172.21.15.78:0/1575812640 learned_addr learned my addr 172.21.15.78:0/1575812640 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:25.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.160+0000 7f00c8cdd640 1 --2- 172.21.15.78:0/1575812640 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f00ac004d40 0x7f00c41f6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:25.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.160+0000 7f00bbfff640 1 --2- 172.21.15.78:0/1575812640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00c40c4d60 0x7f00c414e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:25.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.161+0000 7f00c94de640 1 -- 172.21.15.78:0/1575812640 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f00ac004d40 msgr2=0x7f00c41f6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:25.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.161+0000 7f00c94de640 1 --2- 172.21.15.78:0/1575812640 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f00ac004d40 0x7f00c41f6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:25.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.161+0000 7f00c94de640 1 -- 172.21.15.78:0/1575812640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00c40c4d60 msgr2=0x7f00c414e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:25.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.161+0000 7f00c94de640 1 --2- 172.21.15.78:0/1575812640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00c40c4d60 0x7f00c414e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:25.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.161+0000 7f00c94de640 1 -- 172.21.15.78:0/1575812640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c409e980 con 0x7f00c409e030 2024-09-17T03:15:25.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.161+0000 7f00c8cdd640 1 --2- 172.21.15.78:0/1575812640 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f00ac004d40 0x7f00c41f6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:25.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.161+0000 7f00c94de640 1 --2- 172.21.15.78:0/1575812640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00c409e030 0x7f00c409e440 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f00bc02b450 tx=0x7f00bc004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:25.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.161+0000 7f00b97fa640 1 -- 172.21.15.78:0/1575812640 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc02b9a0 con 0x7f00c409e030 2024-09-17T03:15:25.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.161+0000 7f00b97fa640 1 -- 172.21.15.78:0/1575812640 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00bc02bc30 con 0x7f00c409e030 2024-09-17T03:15:25.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.161+0000 7f00caf41640 1 -- 172.21.15.78:0/1575812640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00c40c5170 con 0x7f00c409e030 2024-09-17T03:15:25.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.161+0000 7f00b97fa640 1 -- 172.21.15.78:0/1575812640 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc0060a0 con 0x7f00c409e030 2024-09-17T03:15:25.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.161+0000 7f00caf41640 1 -- 172.21.15.78:0/1575812640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00c40c5940 con 0x7f00c409e030 2024-09-17T03:15:25.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.162+0000 7f00caf41640 1 -- 172.21.15.78:0/1575812640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00c40c53d0 con 0x7f00c409e030 2024-09-17T03:15:25.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.163+0000 7f00b97fa640 1 -- 172.21.15.78:0/1575812640 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f00bc006240 con 0x7f00c409e030 2024-09-17T03:15:25.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.163+0000 7f00b97fa640 1 --2- 172.21.15.78:0/1575812640 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f00b0078b90 0x7f00b007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:25.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.163+0000 7f00b97fa640 1 -- 172.21.15.78:0/1575812640 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f00bc0bb3e0 con 0x7f00c409e030 2024-09-17T03:15:25.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.164+0000 7f00c8cdd640 1 --2- 172.21.15.78:0/1575812640 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f00b0078b90 0x7f00b007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:25.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.164+0000 7f00c8cdd640 1 --2- 172.21.15.78:0/1575812640 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f00b0078b90 0x7f00b007b0a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f00c0003700 tx=0x7f00c000b260 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:25.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.167+0000 7f00b97fa640 1 -- 172.21.15.78:0/1575812640 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f00c409e980 con 0x7f00c409e030 2024-09-17T03:15:25.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.409+0000 7f00caf41640 1 -- 172.21.15.78:0/1575812640 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f00c40cf130 con 0x7f00c409e030 2024-09-17T03:15:25.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.409+0000 7f00b97fa640 1 -- 172.21.15.78:0/1575812640 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1960 (secure 0 0 0) 0x7f00bc083a20 con 0x7f00c409e030 2024-09-17T03:15:25.408 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:25.408 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":442,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":706268,"bytes_used":262103040,"bytes_avail":772832010240,"bytes_total":773094113280,"write_bytes_sec":682,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7213},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8283},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8286}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":32,"modified":"2024-09-17T03:15:23.234290+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:15:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.412+0000 7f00caf41640 1 -- 172.21.15.78:0/1575812640 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f00b0078b90 msgr2=0x7f00b007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.412+0000 7f00caf41640 1 --2- 172.21.15.78:0/1575812640 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f00b0078b90 0x7f00b007b0a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f00c0003700 tx=0x7f00c000b260 comp rx=0 tx=0).stop 2024-09-17T03:15:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.412+0000 7f00caf41640 1 -- 172.21.15.78:0/1575812640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00c409e030 msgr2=0x7f00c409e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.412+0000 7f00caf41640 1 --2- 172.21.15.78:0/1575812640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00c409e030 0x7f00c409e440 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f00bc02b450 tx=0x7f00bc004bb0 comp rx=0 tx=0).stop 2024-09-17T03:15:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.412+0000 7f00caf41640 1 -- 172.21.15.78:0/1575812640 shutdown_connections 2024-09-17T03:15:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.412+0000 7f00caf41640 1 --2- 172.21.15.78:0/1575812640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00c409e030 0x7f00c409e440 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.412+0000 7f00caf41640 1 --2- 172.21.15.78:0/1575812640 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f00b0078b90 0x7f00b007b0a0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.412+0000 7f00caf41640 1 --2- 172.21.15.78:0/1575812640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f00c40c4d60 0x7f00c414e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.412+0000 7f00caf41640 1 --2- 172.21.15.78:0/1575812640 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f00ac004d40 0x7f00c41f6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.412+0000 7f00caf41640 1 -- 172.21.15.78:0/1575812640 >> 172.21.15.78:0/1575812640 conn(0x7f00c40cdcb0 msgr2=0x7f00c40d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.412+0000 7f00caf41640 1 -- 172.21.15.78:0/1575812640 shutdown_connections 2024-09-17T03:15:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:25.412+0000 7f00caf41640 1 -- 172.21.15.78:0/1575812640 wait complete. 2024-09-17T03:15:25.422 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'idle+waiting paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]'} 2024-09-17T03:15:26.423 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:26.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.549+0000 7f44a8ccc640 1 -- 172.21.15.78:0/1195175982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a415b8f0 msgr2=0x7f44a40cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:26.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.549+0000 7f44a8ccc640 1 --2- 172.21.15.78:0/1195175982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a415b8f0 0x7f44a40cf130 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f44a4075570 tx=0x7f449402a540 comp rx=0 tx=0).stop 2024-09-17T03:15:26.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.549+0000 7f44a8ccc640 1 -- 172.21.15.78:0/1195175982 shutdown_connections 2024-09-17T03:15:26.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.549+0000 7f44a8ccc640 1 --2- 172.21.15.78:0/1195175982 >> v2:172.21.15.193:3300/0 conn(0x7f44a40b0520 0x7f44a4071650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:26.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.549+0000 7f44a8ccc640 1 --2- 172.21.15.78:0/1195175982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a415b8f0 0x7f44a40cf130 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:26.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.549+0000 7f44a8ccc640 1 -- 172.21.15.78:0/1195175982 >> 172.21.15.78:0/1195175982 conn(0x7f44a40cdcb0 msgr2=0x7f44a40ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:26.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.549+0000 7f44a8ccc640 1 -- 172.21.15.78:0/1195175982 shutdown_connections 2024-09-17T03:15:26.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.549+0000 7f44a8ccc640 1 -- 172.21.15.78:0/1195175982 wait complete. 2024-09-17T03:15:26.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.551+0000 7f44a8ccc640 1 Processor -- start 2024-09-17T03:15:26.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.551+0000 7f44a8ccc640 1 -- start start 2024-09-17T03:15:26.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f44a8ccc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44a40b0520 0x7f44a41f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f44a8ccc640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44a40b2cb0 0x7f44a41f93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f44a8ccc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a415b8f0 0x7f44a41f9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f44a8ccc640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f44a40ae120 con 0x7f44a415b8f0 2024-09-17T03:15:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f44a8ccc640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f44a40adfa0 con 0x7f44a40b0520 2024-09-17T03:15:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f44a8ccc640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f44a40ae2a0 con 0x7f44a40b2cb0 2024-09-17T03:15:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f44a2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a415b8f0 0x7f44a41f9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f44a2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a415b8f0 0x7f44a41f9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58138/0 (socket says 172.21.15.78:58138) 2024-09-17T03:15:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f44a2d9d640 1 -- 172.21.15.78:0/2487703761 learned_addr learned my addr 172.21.15.78:0/2487703761 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f44a259c640 1 --2- 172.21.15.78:0/2487703761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44a40b0520 0x7f44a41f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f449bfff640 1 --2- 172.21.15.78:0/2487703761 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44a40b2cb0 0x7f44a41f93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f44a2d9d640 1 -- 172.21.15.78:0/2487703761 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44a40b2cb0 msgr2=0x7f44a41f93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f44a2d9d640 1 --2- 172.21.15.78:0/2487703761 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44a40b2cb0 0x7f44a41f93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:26.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f44a2d9d640 1 -- 172.21.15.78:0/2487703761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44a40b0520 msgr2=0x7f44a41f5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:26.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f44a2d9d640 1 --2- 172.21.15.78:0/2487703761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44a40b0520 0x7f44a41f5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:26.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f44a2d9d640 1 -- 172.21.15.78:0/2487703761 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a41e1530 con 0x7f44a415b8f0 2024-09-17T03:15:26.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f44a2d9d640 1 --2- 172.21.15.78:0/2487703761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a415b8f0 0x7f44a41f9920 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f449c00b990 tx=0x7f449c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:26.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f449affd640 1 -- 172.21.15.78:0/2487703761 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c019070 con 0x7f44a415b8f0 2024-09-17T03:15:26.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f449affd640 1 -- 172.21.15.78:0/2487703761 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f449c00cc90 con 0x7f44a415b8f0 2024-09-17T03:15:26.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f44a8ccc640 1 -- 172.21.15.78:0/2487703761 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a4156030 con 0x7f44a415b8f0 2024-09-17T03:15:26.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.553+0000 7f449affd640 1 -- 172.21.15.78:0/2487703761 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c0146a0 con 0x7f44a415b8f0 2024-09-17T03:15:26.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.554+0000 7f44a8ccc640 1 -- 172.21.15.78:0/2487703761 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a41fa290 con 0x7f44a415b8f0 2024-09-17T03:15:26.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.555+0000 7f44a8ccc640 1 -- 172.21.15.78:0/2487703761 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a40ae820 con 0x7f44a415b8f0 2024-09-17T03:15:26.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.555+0000 7f449affd640 1 -- 172.21.15.78:0/2487703761 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f449c01c070 con 0x7f44a415b8f0 2024-09-17T03:15:26.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.556+0000 7f449affd640 1 --2- 172.21.15.78:0/2487703761 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4484078b90 0x7f448407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:26.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.556+0000 7f449affd640 1 -- 172.21.15.78:0/2487703761 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f449c09aa90 con 0x7f44a415b8f0 2024-09-17T03:15:26.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.556+0000 7f44a259c640 1 --2- 172.21.15.78:0/2487703761 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4484078b90 0x7f448407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:26.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.556+0000 7f44a259c640 1 --2- 172.21.15.78:0/2487703761 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4484078b90 0x7f448407b0a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4494033000 tx=0x7f4494004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:26.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.560+0000 7f449affd640 1 -- 172.21.15.78:0/2487703761 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f449c062880 con 0x7f44a415b8f0 2024-09-17T03:15:26.646 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:15:26.649 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:15:26.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.774+0000 7f44a8ccc640 1 -- 172.21.15.78:0/2487703761 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f44a4155da0 con 0x7f44a415b8f0 2024-09-17T03:15:26.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.774+0000 7f449affd640 1 -- 172.21.15.78:0/2487703761 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5280 (secure 0 0 0) 0x7f449c0672b0 con 0x7f44a415b8f0 2024-09-17T03:15:26.774 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:26.774 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:15:12.673912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8286,"mds_1":8283,"mds_2":7213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7213":{"gid":7213,"name":"d","rank":2,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8283":{"gid":8283,"name":"a","rank":1,"incarnation":95,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[8286,8283,7213]},"id":7}]} 2024-09-17T03:15:26.774 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 103 2024-09-17T03:15:26.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.776+0000 7f44a8ccc640 1 -- 172.21.15.78:0/2487703761 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4484078b90 msgr2=0x7f448407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:26.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.776+0000 7f44a8ccc640 1 --2- 172.21.15.78:0/2487703761 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4484078b90 0x7f448407b0a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4494033000 tx=0x7f4494004730 comp rx=0 tx=0).stop 2024-09-17T03:15:26.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.776+0000 7f44a8ccc640 1 -- 172.21.15.78:0/2487703761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a415b8f0 msgr2=0x7f44a41f9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:26.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.776+0000 7f44a8ccc640 1 --2- 172.21.15.78:0/2487703761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a415b8f0 0x7f44a41f9920 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f449c00b990 tx=0x7f449c00be50 comp rx=0 tx=0).stop 2024-09-17T03:15:26.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.776+0000 7f44a8ccc640 1 -- 172.21.15.78:0/2487703761 shutdown_connections 2024-09-17T03:15:26.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.776+0000 7f44a8ccc640 1 --2- 172.21.15.78:0/2487703761 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a415b8f0 0x7f44a41f9920 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.776+0000 7f44a8ccc640 1 --2- 172.21.15.78:0/2487703761 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f44a40b2cb0 0x7f44a41f93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.776+0000 7f44a8ccc640 1 --2- 172.21.15.78:0/2487703761 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4484078b90 0x7f448407b0a0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.776+0000 7f44a8ccc640 1 --2- 172.21.15.78:0/2487703761 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f44a40b0520 0x7f44a41f5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.776+0000 7f44a8ccc640 1 -- 172.21.15.78:0/2487703761 >> 172.21.15.78:0/2487703761 conn(0x7f44a40cdcb0 msgr2=0x7f44a40b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:26.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.776+0000 7f44a8ccc640 1 -- 172.21.15.78:0/2487703761 shutdown_connections 2024-09-17T03:15:26.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.776+0000 7f44a8ccc640 1 -- 172.21.15.78:0/2487703761 wait complete. 2024-09-17T03:15:26.787 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2024-09-17T03:15:26.787 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:15:26.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.900+0000 7fcbf3751640 1 -- 172.21.15.78:0/947555414 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcbec0d2630 msgr2=0x7fcbec15d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:26.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.900+0000 7fcbf3751640 1 --2- 172.21.15.78:0/947555414 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcbec0d2630 0x7fcbec15d130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009830 tx=0x7fcbdc02a510 comp rx=0 tx=0).stop 2024-09-17T03:15:26.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.900+0000 7fcbf3751640 1 -- 172.21.15.78:0/947555414 shutdown_connections 2024-09-17T03:15:26.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.900+0000 7fcbf3751640 1 --2- 172.21.15.78:0/947555414 >> v2:172.21.15.193:3300/0 conn(0x7fcbec15d670 0x7fcbec0b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:26.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.900+0000 7fcbf3751640 1 --2- 172.21.15.78:0/947555414 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcbec0d2630 0x7fcbec15d130 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:26.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.900+0000 7fcbf3751640 1 -- 172.21.15.78:0/947555414 >> 172.21.15.78:0/947555414 conn(0x7fcbec06d550 msgr2=0x7fcbec071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:26.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.900+0000 7fcbf3751640 1 -- 172.21.15.78:0/947555414 shutdown_connections 2024-09-17T03:15:26.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.900+0000 7fcbf3751640 1 -- 172.21.15.78:0/947555414 wait complete. 2024-09-17T03:15:26.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.902+0000 7fcbf3751640 1 Processor -- start 2024-09-17T03:15:26.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.902+0000 7fcbf3751640 1 -- start start 2024-09-17T03:15:26.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.903+0000 7fcbf3751640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcbec1570e0 0x7fcbec15bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:26.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.903+0000 7fcbf3751640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcbec15d670 0x7fcbec1f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:26.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.903+0000 7fcbf3751640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbec15c170 0x7fcbec1f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:26.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.903+0000 7fcbf3751640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec0b7d60 con 0x7fcbec15c170 2024-09-17T03:15:26.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.903+0000 7fcbf3751640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcbec0b7be0 con 0x7fcbec15d670 2024-09-17T03:15:26.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.903+0000 7fcbf3751640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fcbec0b7ee0 con 0x7fcbec1570e0 2024-09-17T03:15:26.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.904+0000 7fcbf1cee640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbec15c170 0x7fcbec1f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:26.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.904+0000 7fcbf1cee640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbec15c170 0x7fcbec1f60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58140/0 (socket says 172.21.15.78:58140) 2024-09-17T03:15:26.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.904+0000 7fcbf1cee640 1 -- 172.21.15.78:0/3396158545 learned_addr learned my addr 172.21.15.78:0/3396158545 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:26.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.904+0000 7fcbf14ed640 1 --2- 172.21.15.78:0/3396158545 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcbec1570e0 0x7fcbec15bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:26.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.904+0000 7fcbf0cec640 1 --2- 172.21.15.78:0/3396158545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcbec15d670 0x7fcbec1f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:26.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.904+0000 7fcbf1cee640 1 -- 172.21.15.78:0/3396158545 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcbec1570e0 msgr2=0x7fcbec15bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:26.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.904+0000 7fcbf1cee640 1 --2- 172.21.15.78:0/3396158545 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcbec1570e0 0x7fcbec15bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:26.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.904+0000 7fcbf1cee640 1 -- 172.21.15.78:0/3396158545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcbec15d670 msgr2=0x7fcbec1f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:26.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.904+0000 7fcbf1cee640 1 --2- 172.21.15.78:0/3396158545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcbec15d670 0x7fcbec1f5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:26.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.904+0000 7fcbf1cee640 1 -- 172.21.15.78:0/3396158545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbec15e760 con 0x7fcbec15c170 2024-09-17T03:15:26.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.904+0000 7fcbf1cee640 1 --2- 172.21.15.78:0/3396158545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbec15c170 0x7fcbec1f60c0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400ebf0 tx=0x7fcbe400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:26.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.904+0000 7fcbe1ffb640 1 -- 172.21.15.78:0/3396158545 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4003b70 con 0x7fcbec15c170 2024-09-17T03:15:26.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.904+0000 7fcbe1ffb640 1 -- 172.21.15.78:0/3396158545 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbe4003d10 con 0x7fcbec15c170 2024-09-17T03:15:26.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.904+0000 7fcbf3751640 1 -- 172.21.15.78:0/3396158545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbec15ea40 con 0x7fcbec15c170 2024-09-17T03:15:26.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.904+0000 7fcbe1ffb640 1 -- 172.21.15.78:0/3396158545 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4004280 con 0x7fcbec15c170 2024-09-17T03:15:26.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.905+0000 7fcbf3751640 1 -- 172.21.15.78:0/3396158545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbec06eae0 con 0x7fcbec15c170 2024-09-17T03:15:26.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.905+0000 7fcbf3751640 1 -- 172.21.15.78:0/3396158545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbec15d130 con 0x7fcbec15c170 2024-09-17T03:15:26.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.906+0000 7fcbe1ffb640 1 -- 172.21.15.78:0/3396158545 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fcbe4004420 con 0x7fcbec15c170 2024-09-17T03:15:26.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.907+0000 7fcbe1ffb640 1 --2- 172.21.15.78:0/3396158545 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcbd0078b90 0x7fcbd007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:26.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.907+0000 7fcbe1ffb640 1 -- 172.21.15.78:0/3396158545 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fcbe409b9f0 con 0x7fcbec15c170 2024-09-17T03:15:26.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.907+0000 7fcbf14ed640 1 --2- 172.21.15.78:0/3396158545 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcbd0078b90 0x7fcbd007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:26.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.908+0000 7fcbf14ed640 1 --2- 172.21.15.78:0/3396158545 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcbd0078b90 0x7fcbd007b0a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8001610 tx=0x7fcbe8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:26.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:26.911+0000 7fcbe1ffb640 1 -- 172.21.15.78:0/3396158545 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fcbe4063e40 con 0x7fcbec15c170 2024-09-17T03:15:27.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:27.151+0000 7fcbf3751640 1 -- 172.21.15.78:0/3396158545 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fcbec1f6690 con 0x7fcbec15c170 2024-09-17T03:15:27.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:27.152+0000 7fcbe1ffb640 1 -- 172.21.15.78:0/3396158545 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1960 (secure 0 0 0) 0x7fcbe4063740 con 0x7fcbec15c170 2024-09-17T03:15:27.151 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:27.151 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":444,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":706268,"bytes_used":262103040,"bytes_avail":772832010240,"bytes_total":773094113280,"write_bytes_sec":682,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7213},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8283},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8286}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":32,"modified":"2024-09-17T03:15:23.234290+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"idle+waiting paths [/d1/d2/d3]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:15:27.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:27.154+0000 7fcbf3751640 1 -- 172.21.15.78:0/3396158545 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcbd0078b90 msgr2=0x7fcbd007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:27.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:27.154+0000 7fcbf3751640 1 --2- 172.21.15.78:0/3396158545 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcbd0078b90 0x7fcbd007b0a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8001610 tx=0x7fcbe8009040 comp rx=0 tx=0).stop 2024-09-17T03:15:27.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:27.154+0000 7fcbf3751640 1 -- 172.21.15.78:0/3396158545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbec15c170 msgr2=0x7fcbec1f60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:27.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:27.154+0000 7fcbf3751640 1 --2- 172.21.15.78:0/3396158545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbec15c170 0x7fcbec1f60c0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400ebf0 tx=0x7fcbe400c6a0 comp rx=0 tx=0).stop 2024-09-17T03:15:27.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:27.154+0000 7fcbf3751640 1 -- 172.21.15.78:0/3396158545 shutdown_connections 2024-09-17T03:15:27.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:27.154+0000 7fcbf3751640 1 --2- 172.21.15.78:0/3396158545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbec15c170 0x7fcbec1f60c0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:27.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:27.154+0000 7fcbf3751640 1 --2- 172.21.15.78:0/3396158545 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fcbd0078b90 0x7fcbd007b0a0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:27.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:27.154+0000 7fcbf3751640 1 --2- 172.21.15.78:0/3396158545 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcbec15d670 0x7fcbec1f5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:27.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:27.154+0000 7fcbf3751640 1 --2- 172.21.15.78:0/3396158545 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcbec1570e0 0x7fcbec15bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:27.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:27.154+0000 7fcbf3751640 1 -- 172.21.15.78:0/3396158545 >> 172.21.15.78:0/3396158545 conn(0x7fcbec06d550 msgr2=0x7fcbec156660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:27.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:27.154+0000 7fcbf3751640 1 -- 172.21.15.78:0/3396158545 shutdown_connections 2024-09-17T03:15:27.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:27.154+0000 7fcbf3751640 1 -- 172.21.15.78:0/3396158545 wait complete. 2024-09-17T03:15:27.164 INFO:tasks.ceph.ceph_manager.ceph:{'a': 'idle+waiting paths [/d1/d2/d3]', 'c': 'idle+waiting paths [/d1/d2/d3]'} 2024-09-17T03:15:28.165 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:28.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.281+0000 7fb59fcf9640 1 -- 172.21.15.78:0/3816615387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb59806e470 msgr2=0x7fb598070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:28.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.281+0000 7fb59fcf9640 1 --2- 172.21.15.78:0/3816615387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb59806e470 0x7fb598070ee0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fb588005fd0 tx=0x7fb58802a540 comp rx=0 tx=0).stop 2024-09-17T03:15:28.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.281+0000 7fb59fcf9640 1 -- 172.21.15.78:0/3816615387 shutdown_connections 2024-09-17T03:15:28.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.281+0000 7fb59fcf9640 1 --2- 172.21.15.78:0/3816615387 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb598160340 0x7fb598160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:28.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.281+0000 7fb59fcf9640 1 --2- 172.21.15.78:0/3816615387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb59806e470 0x7fb598070ee0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:28.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.281+0000 7fb59fcf9640 1 -- 172.21.15.78:0/3816615387 >> 172.21.15.78:0/3816615387 conn(0x7fb5980cd530 msgr2=0x7fb5980cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:28.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.281+0000 7fb59fcf9640 1 -- 172.21.15.78:0/3816615387 shutdown_connections 2024-09-17T03:15:28.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.281+0000 7fb59fcf9640 1 -- 172.21.15.78:0/3816615387 wait complete. 2024-09-17T03:15:28.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.283+0000 7fb59fcf9640 1 Processor -- start 2024-09-17T03:15:28.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.283+0000 7fb59fcf9640 1 -- start start 2024-09-17T03:15:28.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.284+0000 7fb59fcf9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb59806cde0 0x7fb5981f8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:28.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.284+0000 7fb59fcf9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb59806e470 0x7fb5981f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:28.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.284+0000 7fb59fcf9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb598160340 0x7fb5981519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:28.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.284+0000 7fb59fcf9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb5980715e0 con 0x7fb598160340 2024-09-17T03:15:28.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.284+0000 7fb59fcf9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb5980cbc00 con 0x7fb59806cde0 2024-09-17T03:15:28.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.284+0000 7fb59fcf9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb598160c90 con 0x7fb59806e470 2024-09-17T03:15:28.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.284+0000 7fb59e296640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb598160340 0x7fb5981519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:28.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.284+0000 7fb59e296640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb598160340 0x7fb5981519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58160/0 (socket says 172.21.15.78:58160) 2024-09-17T03:15:28.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.284+0000 7fb59e296640 1 -- 172.21.15.78:0/4078971632 learned_addr learned my addr 172.21.15.78:0/4078971632 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:28.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.284+0000 7fb59da95640 1 --2- 172.21.15.78:0/4078971632 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb59806cde0 0x7fb5981f8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:28.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.284+0000 7fb59d294640 1 --2- 172.21.15.78:0/4078971632 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb59806e470 0x7fb5981f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:28.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.284+0000 7fb59e296640 1 -- 172.21.15.78:0/4078971632 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb59806e470 msgr2=0x7fb5981f15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:28.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.284+0000 7fb59e296640 1 --2- 172.21.15.78:0/4078971632 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb59806e470 0x7fb5981f15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:28.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.284+0000 7fb59e296640 1 -- 172.21.15.78:0/4078971632 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb59806cde0 msgr2=0x7fb5981f8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:28.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.284+0000 7fb59e296640 1 --2- 172.21.15.78:0/4078971632 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb59806cde0 0x7fb5981f8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:28.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.284+0000 7fb59e296640 1 -- 172.21.15.78:0/4078971632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5981e8740 con 0x7fb598160340 2024-09-17T03:15:28.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.285+0000 7fb59e296640 1 --2- 172.21.15.78:0/4078971632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb598160340 0x7fb5981519c0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fb59000ea80 tx=0x7fb59000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:28.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.285+0000 7fb5967fc640 1 -- 172.21.15.78:0/4078971632 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb590004b20 con 0x7fb598160340 2024-09-17T03:15:28.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.285+0000 7fb5967fc640 1 -- 172.21.15.78:0/4078971632 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb590004ce0 con 0x7fb598160340 2024-09-17T03:15:28.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.285+0000 7fb59fcf9640 1 -- 172.21.15.78:0/4078971632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5981f43b0 con 0x7fb598160340 2024-09-17T03:15:28.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.285+0000 7fb5967fc640 1 -- 172.21.15.78:0/4078971632 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb590005280 con 0x7fb598160340 2024-09-17T03:15:28.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.285+0000 7fb59fcf9640 1 -- 172.21.15.78:0/4078971632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5981f4970 con 0x7fb598160340 2024-09-17T03:15:28.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.286+0000 7fb59fcf9640 1 -- 172.21.15.78:0/4078971632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5981e84b0 con 0x7fb598160340 2024-09-17T03:15:28.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.287+0000 7fb5967fc640 1 -- 172.21.15.78:0/4078971632 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb590005420 con 0x7fb598160340 2024-09-17T03:15:28.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.287+0000 7fb5967fc640 1 --2- 172.21.15.78:0/4078971632 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb584078b90 0x7fb58407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:28.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.287+0000 7fb5967fc640 1 -- 172.21.15.78:0/4078971632 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fb59009bc40 con 0x7fb598160340 2024-09-17T03:15:28.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.287+0000 7fb59da95640 1 --2- 172.21.15.78:0/4078971632 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb584078b90 0x7fb58407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:28.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.288+0000 7fb59da95640 1 --2- 172.21.15.78:0/4078971632 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb584078b90 0x7fb58407b0a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb588033000 tx=0x7fb588004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:28.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.291+0000 7fb5967fc640 1 -- 172.21.15.78:0/4078971632 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb590063ba0 con 0x7fb598160340 2024-09-17T03:15:28.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.499+0000 7fb59fcf9640 1 -- 172.21.15.78:0/4078971632 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5981610e0 con 0x7fb598160340 2024-09-17T03:15:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.500+0000 7fb5967fc640 1 -- 172.21.15.78:0/4078971632 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5280 (secure 0 0 0) 0x7fb590064e20 con 0x7fb598160340 2024-09-17T03:15:28.499 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:28.499 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:15:12.673912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8286,"mds_1":8283,"mds_2":7213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7213":{"gid":7213,"name":"d","rank":2,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8283":{"gid":8283,"name":"a","rank":1,"incarnation":95,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[8286,8283,7213]},"id":7}]} 2024-09-17T03:15:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 103 2024-09-17T03:15:28.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.502+0000 7fb59fcf9640 1 -- 172.21.15.78:0/4078971632 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb584078b90 msgr2=0x7fb58407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:28.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.502+0000 7fb59fcf9640 1 --2- 172.21.15.78:0/4078971632 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb584078b90 0x7fb58407b0a0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fb588033000 tx=0x7fb588004730 comp rx=0 tx=0).stop 2024-09-17T03:15:28.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.502+0000 7fb59fcf9640 1 -- 172.21.15.78:0/4078971632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb598160340 msgr2=0x7fb5981519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:28.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.502+0000 7fb59fcf9640 1 --2- 172.21.15.78:0/4078971632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb598160340 0x7fb5981519c0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7fb59000ea80 tx=0x7fb59000ef40 comp rx=0 tx=0).stop 2024-09-17T03:15:28.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.502+0000 7fb59fcf9640 1 -- 172.21.15.78:0/4078971632 shutdown_connections 2024-09-17T03:15:28.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.502+0000 7fb59fcf9640 1 --2- 172.21.15.78:0/4078971632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb598160340 0x7fb5981519c0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:28.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.502+0000 7fb59fcf9640 1 --2- 172.21.15.78:0/4078971632 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb59806e470 0x7fb5981f15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:28.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.502+0000 7fb59fcf9640 1 --2- 172.21.15.78:0/4078971632 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb584078b90 0x7fb58407b0a0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:28.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.502+0000 7fb59fcf9640 1 --2- 172.21.15.78:0/4078971632 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb59806cde0 0x7fb5981f8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:28.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.502+0000 7fb59fcf9640 1 -- 172.21.15.78:0/4078971632 >> 172.21.15.78:0/4078971632 conn(0x7fb5980cd530 msgr2=0x7fb5980cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:28.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.502+0000 7fb59fcf9640 1 -- 172.21.15.78:0/4078971632 shutdown_connections 2024-09-17T03:15:28.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.502+0000 7fb59fcf9640 1 -- 172.21.15.78:0/4078971632 wait complete. 2024-09-17T03:15:28.512 DEBUG:tasks.cephfs.test_multimds_misc:current active=['c', 'a', 'd'] 2024-09-17T03:15:28.512 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T03:15:28.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.625+0000 7f3bfd063640 1 -- 172.21.15.78:0/1143217638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3be4004d40 msgr2=0x7f3be4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:28.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.625+0000 7f3bfd063640 1 --2- 172.21.15.78:0/1143217638 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3be4004d40 0x7f3be4005190 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f3bf0002230 tx=0x7f3be4005830 comp rx=0 tx=0).stop 2024-09-17T03:15:28.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.625+0000 7f3bf759e640 1 -- 172.21.15.78:0/1143217638 reap_dead start 2024-09-17T03:15:28.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.625+0000 7f3bfd063640 1 -- 172.21.15.78:0/1143217638 shutdown_connections 2024-09-17T03:15:28.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.625+0000 7f3bfd063640 1 -- 172.21.15.78:0/1143217638 >> 172.21.15.78:0/1143217638 conn(0x7f3bf808bfc0 msgr2=0x7f3bf809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:28.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.625+0000 7f3bfd063640 1 -- 172.21.15.78:0/1143217638 shutdown_connections 2024-09-17T03:15:28.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.625+0000 7f3bfd063640 1 -- 172.21.15.78:0/1143217638 wait complete. 2024-09-17T03:15:28.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.627+0000 7f3bfd063640 1 Processor -- start 2024-09-17T03:15:28.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.627+0000 7f3bfd063640 1 -- start start 2024-09-17T03:15:28.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.628+0000 7f3bfd063640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3be4004d40 0x7f3bf81597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:28.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.628+0000 7f3bfd063640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3bf815b330 0x7f3bf815b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:28.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.628+0000 7f3bfd063640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3bf8160460 0x7f3bf8160870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:28.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.628+0000 7f3bfd063640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf80cf9e0 con 0x7f3be4004d40 2024-09-17T03:15:28.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.628+0000 7f3bfd063640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf80d1e80 con 0x7f3bf8160460 2024-09-17T03:15:28.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.628+0000 7f3bfd063640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf80cfb60 con 0x7f3bf815b330 2024-09-17T03:15:28.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.628+0000 7f3bf6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3be4004d40 0x7f3bf81597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:28.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.628+0000 7f3bf6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3be4004d40 0x7f3bf81597c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58170/0 (socket says 172.21.15.78:58170) 2024-09-17T03:15:28.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.628+0000 7f3bf6d9d640 1 -- 172.21.15.78:0/882181151 learned_addr learned my addr 172.21.15.78:0/882181151 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:28.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.629+0000 7f3beffff640 1 --2- 172.21.15.78:0/882181151 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3bf815b330 0x7f3bf815b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:28.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.629+0000 7f3bf759e640 1 --2- 172.21.15.78:0/882181151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3bf8160460 0x7f3bf8160870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:28.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.629+0000 7f3bf6d9d640 1 -- 172.21.15.78:0/882181151 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3bf815b330 msgr2=0x7f3bf815b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:28.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.629+0000 7f3bf6d9d640 1 --2- 172.21.15.78:0/882181151 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3bf815b330 0x7f3bf815b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:28.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.629+0000 7f3bf6d9d640 1 -- 172.21.15.78:0/882181151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3bf8160460 msgr2=0x7f3bf8160870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:28.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.629+0000 7f3bf6d9d640 1 --2- 172.21.15.78:0/882181151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3bf8160460 0x7f3bf8160870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:28.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.629+0000 7f3bf6d9d640 1 -- 172.21.15.78:0/882181151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf8160db0 con 0x7f3be4004d40 2024-09-17T03:15:28.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.629+0000 7f3beffff640 1 --2- 172.21.15.78:0/882181151 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3bf815b330 0x7f3bf815b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:28.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.629+0000 7f3bf759e640 1 --2- 172.21.15.78:0/882181151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3bf8160460 0x7f3bf8160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:28.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.629+0000 7f3bf6d9d640 1 --2- 172.21.15.78:0/882181151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3be4004d40 0x7f3bf81597c0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f3be800b5d0 tx=0x7f3be800ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:28.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.629+0000 7f3bef7fe640 1 -- 172.21.15.78:0/882181151 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be8010ae0 con 0x7f3be4004d40 2024-09-17T03:15:28.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.629+0000 7f3bef7fe640 1 -- 172.21.15.78:0/882181151 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3be8015070 con 0x7f3be4004d40 2024-09-17T03:15:28.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.629+0000 7f3bfd063640 1 -- 172.21.15.78:0/882181151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf80c9ce0 con 0x7f3be4004d40 2024-09-17T03:15:28.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.629+0000 7f3bef7fe640 1 -- 172.21.15.78:0/882181151 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be801a470 con 0x7f3be4004d40 2024-09-17T03:15:28.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.629+0000 7f3bfd063640 1 -- 172.21.15.78:0/882181151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf80ca2a0 con 0x7f3be4004d40 2024-09-17T03:15:28.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.630+0000 7f3bfd063640 1 -- 172.21.15.78:0/882181151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bf80cf090 con 0x7f3be4004d40 2024-09-17T03:15:28.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.631+0000 7f3bef7fe640 1 -- 172.21.15.78:0/882181151 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3be801a610 con 0x7f3be4004d40 2024-09-17T03:15:28.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.632+0000 7f3bef7fe640 1 --2- 172.21.15.78:0/882181151 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3bd8078bc0 0x7f3bd807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:28.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.632+0000 7f3bef7fe640 1 -- 172.21.15.78:0/882181151 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f3be809b8a0 con 0x7f3be4004d40 2024-09-17T03:15:28.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.632+0000 7f3beffff640 1 --2- 172.21.15.78:0/882181151 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3bd8078bc0 0x7f3bd807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:28.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.632+0000 7f3beffff640 1 --2- 172.21.15.78:0/882181151 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3bd8078bc0 0x7f3bd807b0d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80c7d70 tx=0x7f3be000b260 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:28.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.636+0000 7f3bef7fe640 1 -- 172.21.15.78:0/882181151 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3bf8160db0 con 0x7f3be4004d40 2024-09-17T03:15:28.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.880+0000 7f3bfd063640 1 -- 172.21.15.78:0/882181151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f3bf80b4020 con 0x7f3be4004d40 2024-09-17T03:15:28.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.881+0000 7f3bef7fe640 1 -- 172.21.15.78:0/882181151 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1867 (secure 0 0 0) 0x7f3be8063e00 con 0x7f3be4004d40 2024-09-17T03:15:28.886 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:28.886 INFO:teuthology.orchestra.run.smithi078.stdout:{"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","health":{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"3 MDSs report damaged metadata","count":3},"muted":false}},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":446,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":95,"num_osds":8,"num_up_osds":8,"osd_up_since":1726542495,"num_in_osds":8,"osd_in_since":1726542486,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":70,"data_bytes":712034,"bytes_used":262107136,"bytes_avail":772832006144,"bytes_total":773094113280,"write_bytes_sec":1279,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","id":7,"up":3,"in":3,"max":3,"by_rank":[{"filesystem_id":7,"rank":2,"name":"d","status":"up:active","gid":7213},{"filesystem_id":7,"rank":1,"name":"a","status":"up:active","gid":8283},{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8286}],"up:standby":1},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":33,"modified":"2024-09-17T03:15:27.235687+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T03:15:28.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.883+0000 7f3bfd063640 1 -- 172.21.15.78:0/882181151 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3bd8078bc0 msgr2=0x7f3bd807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:28.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.883+0000 7f3bfd063640 1 --2- 172.21.15.78:0/882181151 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3bd8078bc0 0x7f3bd807b0d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80c7d70 tx=0x7f3be000b260 comp rx=0 tx=0).stop 2024-09-17T03:15:28.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.883+0000 7f3bfd063640 1 -- 172.21.15.78:0/882181151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3be4004d40 msgr2=0x7f3bf81597c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:28.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.883+0000 7f3bfd063640 1 --2- 172.21.15.78:0/882181151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3be4004d40 0x7f3bf81597c0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f3be800b5d0 tx=0x7f3be800ba90 comp rx=0 tx=0).stop 2024-09-17T03:15:28.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.883+0000 7f3bfd063640 1 -- 172.21.15.78:0/882181151 shutdown_connections 2024-09-17T03:15:28.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.883+0000 7f3bfd063640 1 --2- 172.21.15.78:0/882181151 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3bd8078bc0 0x7f3bd807b0d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:28.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.883+0000 7f3bfd063640 1 --2- 172.21.15.78:0/882181151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3bf8160460 0x7f3bf8160870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:28.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.883+0000 7f3bfd063640 1 --2- 172.21.15.78:0/882181151 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3bf815b330 0x7f3bf815b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:28.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.883+0000 7f3bfd063640 1 --2- 172.21.15.78:0/882181151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3be4004d40 0x7f3bf81597c0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:28.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.883+0000 7f3bfd063640 1 -- 172.21.15.78:0/882181151 >> 172.21.15.78:0/882181151 conn(0x7f3bf808bfc0 msgr2=0x7f3bf806e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:28.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.883+0000 7f3bfd063640 1 -- 172.21.15.78:0/882181151 shutdown_connections 2024-09-17T03:15:28.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:28.883+0000 7f3bfd063640 1 -- 172.21.15.78:0/882181151 wait complete. 2024-09-17T03:15:28.893 INFO:tasks.ceph.ceph_manager.ceph:{} 2024-09-17T03:15:28.894 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T03:15:28.894 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:15:28.929 DEBUG:teuthology.orchestra.run.smithi193:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T03:15:28.975 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T03:15:28.975 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:15:28.976 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:15:28.976 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:28.991 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:15:28.992 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:29.047 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T03:15:29.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.201+0000 7fba99a0e640 1 -- 172.21.15.78:0/851307847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba940b9b60 msgr2=0x7fba940d4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:29.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.201+0000 7fba99a0e640 1 --2- 172.21.15.78:0/851307847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba940b9b60 0x7fba940d4d80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fba84009820 tx=0x7fba8402a3f0 comp rx=0 tx=0).stop 2024-09-17T03:15:29.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.201+0000 7fba99a0e640 1 -- 172.21.15.78:0/851307847 shutdown_connections 2024-09-17T03:15:29.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.201+0000 7fba99a0e640 1 --2- 172.21.15.78:0/851307847 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba940b66b0 0x7fba9406eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:29.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.201+0000 7fba99a0e640 1 --2- 172.21.15.78:0/851307847 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba940b9b60 0x7fba940d4d80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:29.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.201+0000 7fba99a0e640 1 -- 172.21.15.78:0/851307847 >> 172.21.15.78:0/851307847 conn(0x7fba9409d7f0 msgr2=0x7fba940d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:29.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.201+0000 7fba99a0e640 1 -- 172.21.15.78:0/851307847 shutdown_connections 2024-09-17T03:15:29.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.201+0000 7fba99a0e640 1 -- 172.21.15.78:0/851307847 wait complete. 2024-09-17T03:15:29.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.203+0000 7fba99a0e640 1 Processor -- start 2024-09-17T03:15:29.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.203+0000 7fba99a0e640 1 -- start start 2024-09-17T03:15:29.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba99a0e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba940b9b60 0x7fba940c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:29.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba99a0e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba940cf540 0x7fba940b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:29.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba99a0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba940b8380 0x7fba941f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba99a0e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fba9406f630 con 0x7fba940b8380 2024-09-17T03:15:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba99a0e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fba9406f4b0 con 0x7fba940b9b60 2024-09-17T03:15:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba99a0e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fba9406f7b0 con 0x7fba940cf540 2024-09-17T03:15:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba937fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba940b8380 0x7fba941f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba937fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba940b8380 0x7fba941f4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58180/0 (socket says 172.21.15.78:58180) 2024-09-17T03:15:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba937fe640 1 -- 172.21.15.78:0/3142932151 learned_addr learned my addr 172.21.15.78:0/3142932151 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba927fc640 1 --2- 172.21.15.78:0/3142932151 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba940cf540 0x7fba940b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba92ffd640 1 --2- 172.21.15.78:0/3142932151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba940b9b60 0x7fba940c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba937fe640 1 -- 172.21.15.78:0/3142932151 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba940cf540 msgr2=0x7fba940b7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba937fe640 1 --2- 172.21.15.78:0/3142932151 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba940cf540 0x7fba940b7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba937fe640 1 -- 172.21.15.78:0/3142932151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba940b9b60 msgr2=0x7fba940c9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:29.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba937fe640 1 --2- 172.21.15.78:0/3142932151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba940b9b60 0x7fba940c9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba937fe640 1 -- 172.21.15.78:0/3142932151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba940b3e40 con 0x7fba940b8380 2024-09-17T03:15:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba937fe640 1 --2- 172.21.15.78:0/3142932151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba940b8380 0x7fba941f4ab0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009fd0 tx=0x7fba8c00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba7bfff640 1 -- 172.21.15.78:0/3142932151 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c003970 con 0x7fba940b8380 2024-09-17T03:15:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba7bfff640 1 -- 172.21.15.78:0/3142932151 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba8c003c20 con 0x7fba940b8380 2024-09-17T03:15:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba99a0e640 1 -- 172.21.15.78:0/3142932151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba940b4120 con 0x7fba940b8380 2024-09-17T03:15:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.205+0000 7fba7bfff640 1 -- 172.21.15.78:0/3142932151 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c004280 con 0x7fba940b8380 2024-09-17T03:15:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.206+0000 7fba99a0e640 1 -- 172.21.15.78:0/3142932151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba940b46e0 con 0x7fba940b8380 2024-09-17T03:15:29.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.206+0000 7fba99a0e640 1 -- 172.21.15.78:0/3142932151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba940c9dc0 con 0x7fba940b8380 2024-09-17T03:15:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.207+0000 7fba7bfff640 1 -- 172.21.15.78:0/3142932151 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fba8c004420 con 0x7fba940b8380 2024-09-17T03:15:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.208+0000 7fba7bfff640 1 --2- 172.21.15.78:0/3142932151 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fba80078b90 0x7fba8007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.208+0000 7fba7bfff640 1 -- 172.21.15.78:0/3142932151 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fba8c09b670 con 0x7fba940b8380 2024-09-17T03:15:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.208+0000 7fba92ffd640 1 --2- 172.21.15.78:0/3142932151 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fba80078b90 0x7fba8007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:29.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.208+0000 7fba92ffd640 1 --2- 172.21.15.78:0/3142932151 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fba80078b90 0x7fba8007b0a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fba84034000 tx=0x7fba84004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:29.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.212+0000 7fba7bfff640 1 -- 172.21.15.78:0/3142932151 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fba8c063ab0 con 0x7fba940b8380 2024-09-17T03:15:29.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.398+0000 7fba99a0e640 1 -- 172.21.15.78:0/3142932151 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fba9406fcd0 con 0x7fba940b8380 2024-09-17T03:15:29.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.398+0000 7fba7bfff640 1 -- 172.21.15.78:0/3142932151 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v95) ==== 80+0+0 (secure 0 0 0) 0x7fba8c0633b0 con 0x7fba940b8380 2024-09-17T03:15:29.397 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2024-09-17T03:15:29.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.400+0000 7fba99a0e640 1 -- 172.21.15.78:0/3142932151 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fba80078b90 msgr2=0x7fba8007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.400+0000 7fba99a0e640 1 --2- 172.21.15.78:0/3142932151 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fba80078b90 0x7fba8007b0a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fba84034000 tx=0x7fba84004730 comp rx=0 tx=0).stop 2024-09-17T03:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.400+0000 7fba99a0e640 1 -- 172.21.15.78:0/3142932151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba940b8380 msgr2=0x7fba941f4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.400+0000 7fba99a0e640 1 --2- 172.21.15.78:0/3142932151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba940b8380 0x7fba941f4ab0 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009fd0 tx=0x7fba8c00c740 comp rx=0 tx=0).stop 2024-09-17T03:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.400+0000 7fba99a0e640 1 -- 172.21.15.78:0/3142932151 shutdown_connections 2024-09-17T03:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.400+0000 7fba99a0e640 1 --2- 172.21.15.78:0/3142932151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fba940b8380 0x7fba941f4ab0 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.400+0000 7fba99a0e640 1 --2- 172.21.15.78:0/3142932151 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba940cf540 0x7fba940b7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.400+0000 7fba99a0e640 1 --2- 172.21.15.78:0/3142932151 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fba80078b90 0x7fba8007b0a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.400+0000 7fba99a0e640 1 --2- 172.21.15.78:0/3142932151 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba940b9b60 0x7fba940c9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.400+0000 7fba99a0e640 1 -- 172.21.15.78:0/3142932151 >> 172.21.15.78:0/3142932151 conn(0x7fba9409d7f0 msgr2=0x7fba940d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.400+0000 7fba99a0e640 1 -- 172.21.15.78:0/3142932151 shutdown_connections 2024-09-17T03:15:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.400+0000 7fba99a0e640 1 -- 172.21.15.78:0/3142932151 wait complete. 2024-09-17T03:15:29.411 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-17T03:15:29.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:29.411 DEBUG:teuthology.orchestra.run.smithi078:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-17T03:15:29.440 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T03:15:29.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:29.441 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T03:15:29.497 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:15:29.497 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:15:29.498 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:29.518 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:15:29.518 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:15:29.519 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:15:29.519 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:29.553 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056010,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1013 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:15:29.553 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T03:15:29.553 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:15:29.553 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:29.577 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:15:29.577 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:29.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.706+0000 7f270424d640 1 -- 172.21.15.78:0/2404236333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26fc0af780 msgr2=0x7f26fc0b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:29.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.706+0000 7f270424d640 1 --2- 172.21.15.78:0/2404236333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26fc0af780 0x7f26fc0b39c0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f26f8009830 tx=0x7f26f802a510 comp rx=0 tx=0).stop 2024-09-17T03:15:29.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.706+0000 7f270424d640 1 -- 172.21.15.78:0/2404236333 shutdown_connections 2024-09-17T03:15:29.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.706+0000 7f270424d640 1 --2- 172.21.15.78:0/2404236333 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26fc072ff0 0x7f26fc073400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:29.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.706+0000 7f270424d640 1 --2- 172.21.15.78:0/2404236333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26fc0af780 0x7f26fc0b39c0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:29.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.706+0000 7f270424d640 1 -- 172.21.15.78:0/2404236333 >> 172.21.15.78:0/2404236333 conn(0x7f26fc06d7d0 msgr2=0x7f26fc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:29.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.706+0000 7f270424d640 1 -- 172.21.15.78:0/2404236333 shutdown_connections 2024-09-17T03:15:29.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.706+0000 7f270424d640 1 -- 172.21.15.78:0/2404236333 wait complete. 2024-09-17T03:15:29.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.708+0000 7f270424d640 1 Processor -- start 2024-09-17T03:15:29.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.708+0000 7f270424d640 1 -- start start 2024-09-17T03:15:29.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.709+0000 7f270424d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26fc072ff0 0x7f26fc1f2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:29.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.709+0000 7f270424d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26fc0af780 0x7f26fc15a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:29.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.709+0000 7f270424d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26fc0cd3e0 0x7f26fc14aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:29.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.709+0000 7f270424d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f26fc073d10 con 0x7f26fc0cd3e0 2024-09-17T03:15:29.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.710+0000 7f270424d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f26fc073b90 con 0x7f26fc0af780 2024-09-17T03:15:29.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.710+0000 7f270424d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f26fc15f930 con 0x7f26fc072ff0 2024-09-17T03:15:29.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.710+0000 7f27027ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26fc0cd3e0 0x7f26fc14aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:29.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.710+0000 7f27027ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26fc0cd3e0 0x7f26fc14aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58200/0 (socket says 172.21.15.78:58200) 2024-09-17T03:15:29.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.710+0000 7f27027ea640 1 -- 172.21.15.78:0/2475704336 learned_addr learned my addr 172.21.15.78:0/2475704336 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:29.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.710+0000 7f2701fe9640 1 --2- 172.21.15.78:0/2475704336 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26fc072ff0 0x7f26fc1f2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:29.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.710+0000 7f27017e8640 1 --2- 172.21.15.78:0/2475704336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26fc0af780 0x7f26fc15a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:29.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.710+0000 7f27027ea640 1 -- 172.21.15.78:0/2475704336 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26fc072ff0 msgr2=0x7f26fc1f2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:29.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.710+0000 7f27027ea640 1 --2- 172.21.15.78:0/2475704336 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26fc072ff0 0x7f26fc1f2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:29.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.710+0000 7f27027ea640 1 -- 172.21.15.78:0/2475704336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26fc0af780 msgr2=0x7f26fc15a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:29.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.710+0000 7f27027ea640 1 --2- 172.21.15.78:0/2475704336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26fc0af780 0x7f26fc15a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:29.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.710+0000 7f27027ea640 1 -- 172.21.15.78:0/2475704336 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26fc14a750 con 0x7f26fc0cd3e0 2024-09-17T03:15:29.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.710+0000 7f27027ea640 1 --2- 172.21.15.78:0/2475704336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26fc0cd3e0 0x7f26fc14aee0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f26f400cab0 tx=0x7f26f400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:29.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.710+0000 7f26f27fc640 1 -- 172.21.15.78:0/2475704336 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f4007d90 con 0x7f26fc0cd3e0 2024-09-17T03:15:29.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.710+0000 7f26f27fc640 1 -- 172.21.15.78:0/2475704336 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26f400f560 con 0x7f26fc0cd3e0 2024-09-17T03:15:29.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.710+0000 7f270424d640 1 -- 172.21.15.78:0/2475704336 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26fc1f31c0 con 0x7f26fc0cd3e0 2024-09-17T03:15:29.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.710+0000 7f26f27fc640 1 -- 172.21.15.78:0/2475704336 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f400f9b0 con 0x7f26fc0cd3e0 2024-09-17T03:15:29.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.710+0000 7f270424d640 1 -- 172.21.15.78:0/2475704336 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26fc15ab70 con 0x7f26fc0cd3e0 2024-09-17T03:15:29.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.711+0000 7f270424d640 1 -- 172.21.15.78:0/2475704336 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26fc15ed30 con 0x7f26fc0cd3e0 2024-09-17T03:15:29.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.712+0000 7f26f27fc640 1 -- 172.21.15.78:0/2475704336 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f26f400fb50 con 0x7f26fc0cd3e0 2024-09-17T03:15:29.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.713+0000 7f26f27fc640 1 --2- 172.21.15.78:0/2475704336 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f26e0078b90 0x7f26e007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:29.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.713+0000 7f26f27fc640 1 -- 172.21.15.78:0/2475704336 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f26f409b790 con 0x7f26fc0cd3e0 2024-09-17T03:15:29.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.713+0000 7f2701fe9640 1 --2- 172.21.15.78:0/2475704336 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f26e0078b90 0x7f26e007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:29.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.714+0000 7f2701fe9640 1 --2- 172.21.15.78:0/2475704336 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f26e0078b90 0x7f26e007b0a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f26f8034000 tx=0x7f26f8004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:29.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.717+0000 7f26f27fc640 1 -- 172.21.15.78:0/2475704336 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f26fc15ed30 con 0x7f26fc0cd3e0 2024-09-17T03:15:29.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.930+0000 7f270424d640 1 -- 172.21.15.78:0/2475704336 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26fc073400 con 0x7f26fc0cd3e0 2024-09-17T03:15:29.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.931+0000 7f26f27fc640 1 -- 172.21.15.78:0/2475704336 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5280 (secure 0 0 0) 0x7f26f4014070 con 0x7f26fc0cd3e0 2024-09-17T03:15:29.930 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:29.930 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:15:12.673912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8286,"mds_1":8283,"mds_2":7213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7213":{"gid":7213,"name":"d","rank":2,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8283":{"gid":8283,"name":"a","rank":1,"incarnation":95,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[8286,8283,7213]},"id":7}]} 2024-09-17T03:15:29.930 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 103 2024-09-17T03:15:29.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.933+0000 7f270424d640 1 -- 172.21.15.78:0/2475704336 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f26e0078b90 msgr2=0x7f26e007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:29.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.933+0000 7f270424d640 1 --2- 172.21.15.78:0/2475704336 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f26e0078b90 0x7f26e007b0a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f26f8034000 tx=0x7f26f8004730 comp rx=0 tx=0).stop 2024-09-17T03:15:29.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.933+0000 7f270424d640 1 -- 172.21.15.78:0/2475704336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26fc0cd3e0 msgr2=0x7f26fc14aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:29.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.933+0000 7f270424d640 1 --2- 172.21.15.78:0/2475704336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26fc0cd3e0 0x7f26fc14aee0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f26f400cab0 tx=0x7f26f400cf70 comp rx=0 tx=0).stop 2024-09-17T03:15:29.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.933+0000 7f270424d640 1 -- 172.21.15.78:0/2475704336 shutdown_connections 2024-09-17T03:15:29.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.933+0000 7f270424d640 1 --2- 172.21.15.78:0/2475704336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26fc0cd3e0 0x7f26fc14aee0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:29.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.933+0000 7f270424d640 1 --2- 172.21.15.78:0/2475704336 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f26e0078b90 0x7f26e007b0a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:29.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.933+0000 7f270424d640 1 --2- 172.21.15.78:0/2475704336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26fc0af780 0x7f26fc15a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:29.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.933+0000 7f270424d640 1 --2- 172.21.15.78:0/2475704336 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26fc072ff0 0x7f26fc1f2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:29.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.933+0000 7f270424d640 1 -- 172.21.15.78:0/2475704336 >> 172.21.15.78:0/2475704336 conn(0x7f26fc06d7d0 msgr2=0x7f26fc0ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:29.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.933+0000 7f270424d640 1 -- 172.21.15.78:0/2475704336 shutdown_connections 2024-09-17T03:15:29.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:29.933+0000 7f270424d640 1 -- 172.21.15.78:0/2475704336 wait complete. 2024-09-17T03:15:29.943 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:30.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.058+0000 7f155f84d640 1 -- 172.21.15.78:0/3410651122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15580af780 msgr2=0x7f15580b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:30.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.058+0000 7f155f84d640 1 --2- 172.21.15.78:0/3410651122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15580af780 0x7f15580b39c0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f1554005fd0 tx=0x7f155402a530 comp rx=0 tx=0).stop 2024-09-17T03:15:30.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.058+0000 7f155f84d640 1 -- 172.21.15.78:0/3410651122 shutdown_connections 2024-09-17T03:15:30.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.058+0000 7f155f84d640 1 --2- 172.21.15.78:0/3410651122 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1558072ff0 0x7f1558073400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.058+0000 7f155f84d640 1 --2- 172.21.15.78:0/3410651122 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15580af780 0x7f15580b39c0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.058+0000 7f155f84d640 1 -- 172.21.15.78:0/3410651122 >> 172.21.15.78:0/3410651122 conn(0x7f155806d7d0 msgr2=0x7f15580b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:30.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.058+0000 7f155f84d640 1 -- 172.21.15.78:0/3410651122 shutdown_connections 2024-09-17T03:15:30.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.058+0000 7f155f84d640 1 -- 172.21.15.78:0/3410651122 wait complete. 2024-09-17T03:15:30.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.060+0000 7f155f84d640 1 Processor -- start 2024-09-17T03:15:30.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.060+0000 7f155f84d640 1 -- start start 2024-09-17T03:15:30.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.061+0000 7f155f84d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1558072ff0 0x7f15581f3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:30.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.061+0000 7f155f84d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15580af780 0x7f155814bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:30.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.061+0000 7f155f84d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15580cd3e0 0x7f155815a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:30.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.061+0000 7f155f84d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1558073d10 con 0x7f15580cd3e0 2024-09-17T03:15:30.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.061+0000 7f155f84d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1558073b90 con 0x7f1558072ff0 2024-09-17T03:15:30.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.061+0000 7f155f84d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f155815f930 con 0x7f15580af780 2024-09-17T03:15:30.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.061+0000 7f155ddea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15580cd3e0 0x7f155815a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:30.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.061+0000 7f155ddea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15580cd3e0 0x7f155815a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58224/0 (socket says 172.21.15.78:58224) 2024-09-17T03:15:30.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.061+0000 7f155ddea640 1 -- 172.21.15.78:0/3959909220 learned_addr learned my addr 172.21.15.78:0/3959909220 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:30.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.061+0000 7f155cde8640 1 --2- 172.21.15.78:0/3959909220 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15580af780 0x7f155814bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:30.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.061+0000 7f155d5e9640 1 --2- 172.21.15.78:0/3959909220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1558072ff0 0x7f15581f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:30.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.061+0000 7f155ddea640 1 -- 172.21.15.78:0/3959909220 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15580af780 msgr2=0x7f155814bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:30.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.061+0000 7f155ddea640 1 --2- 172.21.15.78:0/3959909220 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15580af780 0x7f155814bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.061+0000 7f155ddea640 1 -- 172.21.15.78:0/3959909220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1558072ff0 msgr2=0x7f15581f3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:30.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.061+0000 7f155ddea640 1 --2- 172.21.15.78:0/3959909220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1558072ff0 0x7f15581f3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.061+0000 7f155ddea640 1 -- 172.21.15.78:0/3959909220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1558159950 con 0x7f15580cd3e0 2024-09-17T03:15:30.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.061+0000 7f155cde8640 1 --2- 172.21.15.78:0/3959909220 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15580af780 0x7f155814bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:30.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.062+0000 7f155ddea640 1 --2- 172.21.15.78:0/3959909220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15580cd3e0 0x7f155815a9f0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f155000cad0 tx=0x7f155000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:30.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.062+0000 7f154dffb640 1 -- 172.21.15.78:0/3959909220 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f155000ae20 con 0x7f15580cd3e0 2024-09-17T03:15:30.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.062+0000 7f154dffb640 1 -- 172.21.15.78:0/3959909220 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f155000f540 con 0x7f15580cd3e0 2024-09-17T03:15:30.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.062+0000 7f154dffb640 1 -- 172.21.15.78:0/3959909220 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f155000f990 con 0x7f15580cd3e0 2024-09-17T03:15:30.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.062+0000 7f155f84d640 1 -- 172.21.15.78:0/3959909220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1558159c30 con 0x7f15580cd3e0 2024-09-17T03:15:30.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.062+0000 7f155f84d640 1 -- 172.21.15.78:0/3959909220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f155815a1f0 con 0x7f15580cd3e0 2024-09-17T03:15:30.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.063+0000 7f155f84d640 1 -- 172.21.15.78:0/3959909220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1558073400 con 0x7f15580cd3e0 2024-09-17T03:15:30.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.064+0000 7f154dffb640 1 -- 172.21.15.78:0/3959909220 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f155000fb30 con 0x7f15580cd3e0 2024-09-17T03:15:30.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.064+0000 7f154dffb640 1 --2- 172.21.15.78:0/3959909220 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f153c078b90 0x7f153c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:30.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.064+0000 7f154dffb640 1 -- 172.21.15.78:0/3959909220 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f155009b870 con 0x7f15580cd3e0 2024-09-17T03:15:30.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.064+0000 7f155d5e9640 1 --2- 172.21.15.78:0/3959909220 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f153c078b90 0x7f153c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:30.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.065+0000 7f155d5e9640 1 --2- 172.21.15.78:0/3959909220 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f153c078b90 0x7f153c07b0a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1554033000 tx=0x7f1554004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:30.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.069+0000 7f154dffb640 1 -- 172.21.15.78:0/3959909220 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f1550014030 con 0x7f15580cd3e0 2024-09-17T03:15:30.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.278+0000 7f155f84d640 1 -- 172.21.15.78:0/3959909220 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15581596e0 con 0x7f15580cd3e0 2024-09-17T03:15:30.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.279+0000 7f154dffb640 1 -- 172.21.15.78:0/3959909220 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5280 (secure 0 0 0) 0x7f155000fe20 con 0x7f15580cd3e0 2024-09-17T03:15:30.278 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:30.278 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:15:12.673912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8286,"mds_1":8283,"mds_2":7213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7213":{"gid":7213,"name":"d","rank":2,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8283":{"gid":8283,"name":"a","rank":1,"incarnation":95,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[8286,8283,7213]},"id":7}]} 2024-09-17T03:15:30.279 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 103 2024-09-17T03:15:30.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.281+0000 7f155f84d640 1 -- 172.21.15.78:0/3959909220 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f153c078b90 msgr2=0x7f153c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:30.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.281+0000 7f155f84d640 1 --2- 172.21.15.78:0/3959909220 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f153c078b90 0x7f153c07b0a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1554033000 tx=0x7f1554004730 comp rx=0 tx=0).stop 2024-09-17T03:15:30.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.281+0000 7f155f84d640 1 -- 172.21.15.78:0/3959909220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15580cd3e0 msgr2=0x7f155815a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:30.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.281+0000 7f155f84d640 1 --2- 172.21.15.78:0/3959909220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15580cd3e0 0x7f155815a9f0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f155000cad0 tx=0x7f155000cf90 comp rx=0 tx=0).stop 2024-09-17T03:15:30.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.281+0000 7f155f84d640 1 -- 172.21.15.78:0/3959909220 shutdown_connections 2024-09-17T03:15:30.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.281+0000 7f155f84d640 1 --2- 172.21.15.78:0/3959909220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f15580cd3e0 0x7f155815a9f0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.281+0000 7f155f84d640 1 --2- 172.21.15.78:0/3959909220 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15580af780 0x7f155814bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.281+0000 7f155f84d640 1 --2- 172.21.15.78:0/3959909220 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f153c078b90 0x7f153c07b0a0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.281+0000 7f155f84d640 1 --2- 172.21.15.78:0/3959909220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1558072ff0 0x7f15581f3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.281+0000 7f155f84d640 1 -- 172.21.15.78:0/3959909220 >> 172.21.15.78:0/3959909220 conn(0x7f155806d7d0 msgr2=0x7f1558073e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:30.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.281+0000 7f155f84d640 1 -- 172.21.15.78:0/3959909220 shutdown_connections 2024-09-17T03:15:30.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.281+0000 7f155f84d640 1 -- 172.21.15.78:0/3959909220 wait complete. 2024-09-17T03:15:30.292 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:15:30.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.406+0000 7fbf5bc07640 1 -- 172.21.15.78:0/2470426385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf540cfb00 msgr2=0x7fbf5415bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:30.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.406+0000 7fbf5bc07640 1 --2- 172.21.15.78:0/2470426385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf540cfb00 0x7fbf5415bf20 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fbf54072c00 tx=0x7fbf4402b860 comp rx=0 tx=0).stop 2024-09-17T03:15:30.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.406+0000 7fbf5bc07640 1 -- 172.21.15.78:0/2470426385 shutdown_connections 2024-09-17T03:15:30.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.406+0000 7fbf5bc07640 1 --2- 172.21.15.78:0/2470426385 >> v2:172.21.15.193:3300/0 conn(0x7fbf540cf160 0x7fbf540ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.406+0000 7fbf5bc07640 1 --2- 172.21.15.78:0/2470426385 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf540cfb00 0x7fbf5415bf20 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.406+0000 7fbf5bc07640 1 -- 172.21.15.78:0/2470426385 >> 172.21.15.78:0/2470426385 conn(0x7fbf540b1cb0 msgr2=0x7fbf540b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:30.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.406+0000 7fbf5bc07640 1 -- 172.21.15.78:0/2470426385 shutdown_connections 2024-09-17T03:15:30.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.406+0000 7fbf5bc07640 1 -- 172.21.15.78:0/2470426385 wait complete. 2024-09-17T03:15:30.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.408+0000 7fbf5bc07640 1 Processor -- start 2024-09-17T03:15:30.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.408+0000 7fbf5bc07640 1 -- start start 2024-09-17T03:15:30.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.409+0000 7fbf5bc07640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbf540cf160 0x7fbf540c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:30.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.409+0000 7fbf5bc07640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf540cf570 0x7fbf541f2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:30.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.409+0000 7fbf5bc07640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbf540cfb00 0x7fbf540c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:30.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.409+0000 7fbf5bc07640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fbf540cb270 con 0x7fbf540cf570 2024-09-17T03:15:30.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.409+0000 7fbf5bc07640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbf540cb0f0 con 0x7fbf540cfb00 2024-09-17T03:15:30.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.409+0000 7fbf5bc07640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fbf540ccba0 con 0x7fbf540cf160 2024-09-17T03:15:30.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.409+0000 7fbf591a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf540cf570 0x7fbf541f2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:30.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.409+0000 7fbf591a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf540cf570 0x7fbf541f2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58236/0 (socket says 172.21.15.78:58236) 2024-09-17T03:15:30.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.409+0000 7fbf591a2640 1 -- 172.21.15.78:0/1086932437 learned_addr learned my addr 172.21.15.78:0/1086932437 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:30.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.409+0000 7fbf599a3640 1 --2- 172.21.15.78:0/1086932437 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbf540cf160 0x7fbf540c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:30.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.409+0000 7fbf5a1a4640 1 --2- 172.21.15.78:0/1086932437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbf540cfb00 0x7fbf540c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:30.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.409+0000 7fbf591a2640 1 -- 172.21.15.78:0/1086932437 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbf540cf160 msgr2=0x7fbf540c3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:30.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.409+0000 7fbf591a2640 1 --2- 172.21.15.78:0/1086932437 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbf540cf160 0x7fbf540c3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.409+0000 7fbf591a2640 1 -- 172.21.15.78:0/1086932437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbf540cfb00 msgr2=0x7fbf540c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:30.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.409+0000 7fbf591a2640 1 --2- 172.21.15.78:0/1086932437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbf540cfb00 0x7fbf540c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.409+0000 7fbf591a2640 1 -- 172.21.15.78:0/1086932437 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf540c6680 con 0x7fbf540cf570 2024-09-17T03:15:30.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.409+0000 7fbf591a2640 1 --2- 172.21.15.78:0/1086932437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf540cf570 0x7fbf541f2ff0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800d6d0 tx=0x7fbf4800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:30.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.410+0000 7fbf527fc640 1 -- 172.21.15.78:0/1086932437 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf48017070 con 0x7fbf540cf570 2024-09-17T03:15:30.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.410+0000 7fbf527fc640 1 -- 172.21.15.78:0/1086932437 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf48004310 con 0x7fbf540cf570 2024-09-17T03:15:30.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.410+0000 7fbf5bc07640 1 -- 172.21.15.78:0/1086932437 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf540c6960 con 0x7fbf540cf570 2024-09-17T03:15:30.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.410+0000 7fbf527fc640 1 -- 172.21.15.78:0/1086932437 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf48009a80 con 0x7fbf540cf570 2024-09-17T03:15:30.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.410+0000 7fbf5bc07640 1 -- 172.21.15.78:0/1086932437 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf540c5150 con 0x7fbf540cf570 2024-09-17T03:15:30.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.411+0000 7fbf5bc07640 1 -- 172.21.15.78:0/1086932437 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf540c63f0 con 0x7fbf540cf570 2024-09-17T03:15:30.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.412+0000 7fbf527fc640 1 -- 172.21.15.78:0/1086932437 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbf48009c20 con 0x7fbf540cf570 2024-09-17T03:15:30.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.412+0000 7fbf527fc640 1 --2- 172.21.15.78:0/1086932437 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbf40078b90 0x7fbf4007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:30.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.412+0000 7fbf527fc640 1 -- 172.21.15.78:0/1086932437 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fbf4809b220 con 0x7fbf540cf570 2024-09-17T03:15:30.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.412+0000 7fbf599a3640 1 --2- 172.21.15.78:0/1086932437 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbf40078b90 0x7fbf4007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:30.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.413+0000 7fbf599a3640 1 --2- 172.21.15.78:0/1086932437 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbf40078b90 0x7fbf4007b0a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fbf44036000 tx=0x7fbf44004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:30.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.416+0000 7fbf527fc640 1 -- 172.21.15.78:0/1086932437 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fbf48063740 con 0x7fbf540cf570 2024-09-17T03:15:30.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.588+0000 7fbf5bc07640 1 -- 172.21.15.78:0/1086932437 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf5415c130 con 0x7fbf540cf570 2024-09-17T03:15:30.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.589+0000 7fbf527fc640 1 -- 172.21.15.78:0/1086932437 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+16644 (secure 0 0 0) 0x7fbf48063040 con 0x7fbf540cf570 2024-09-17T03:15:30.589 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:30.589 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":95,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:14:40.724293+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:14:36.702637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T03:14:38.031363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:15:30.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.591+0000 7fbf5bc07640 1 -- 172.21.15.78:0/1086932437 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbf40078b90 msgr2=0x7fbf4007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:30.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.591+0000 7fbf5bc07640 1 --2- 172.21.15.78:0/1086932437 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbf40078b90 0x7fbf4007b0a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fbf44036000 tx=0x7fbf44004730 comp rx=0 tx=0).stop 2024-09-17T03:15:30.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.591+0000 7fbf5bc07640 1 -- 172.21.15.78:0/1086932437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf540cf570 msgr2=0x7fbf541f2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:30.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.591+0000 7fbf5bc07640 1 --2- 172.21.15.78:0/1086932437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf540cf570 0x7fbf541f2ff0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fbf4800d6d0 tx=0x7fbf4800db90 comp rx=0 tx=0).stop 2024-09-17T03:15:30.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.592+0000 7fbf5bc07640 1 -- 172.21.15.78:0/1086932437 shutdown_connections 2024-09-17T03:15:30.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.592+0000 7fbf5bc07640 1 --2- 172.21.15.78:0/1086932437 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fbf40078b90 0x7fbf4007b0a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.592+0000 7fbf5bc07640 1 --2- 172.21.15.78:0/1086932437 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbf540cfb00 0x7fbf540c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.592+0000 7fbf5bc07640 1 --2- 172.21.15.78:0/1086932437 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf540cf570 0x7fbf541f2ff0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.592+0000 7fbf5bc07640 1 --2- 172.21.15.78:0/1086932437 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbf540cf160 0x7fbf540c3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.592+0000 7fbf5bc07640 1 -- 172.21.15.78:0/1086932437 >> 172.21.15.78:0/1086932437 conn(0x7fbf540b1cb0 msgr2=0x7fbf540b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:30.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.592+0000 7fbf5bc07640 1 -- 172.21.15.78:0/1086932437 shutdown_connections 2024-09-17T03:15:30.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.592+0000 7fbf5bc07640 1 -- 172.21.15.78:0/1086932437 wait complete. 2024-09-17T03:15:30.602 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:15:30.603 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:30.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.716+0000 7fc050ea9640 1 -- 172.21.15.78:0/2886328105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc04c06e470 msgr2=0x7fc04c070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:30.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.716+0000 7fc050ea9640 1 --2- 172.21.15.78:0/2886328105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc04c06e470 0x7fc04c070ee0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0cb090 tx=0x7fc03c02a820 comp rx=0 tx=0).stop 2024-09-17T03:15:30.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.716+0000 7fc050ea9640 1 -- 172.21.15.78:0/2886328105 shutdown_connections 2024-09-17T03:15:30.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.716+0000 7fc050ea9640 1 --2- 172.21.15.78:0/2886328105 >> v2:172.21.15.193:3300/0 conn(0x7fc04c06cde0 0x7fc04c06d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.716+0000 7fc050ea9640 1 --2- 172.21.15.78:0/2886328105 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc04c06e470 0x7fc04c070ee0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.716+0000 7fc050ea9640 1 -- 172.21.15.78:0/2886328105 >> 172.21.15.78:0/2886328105 conn(0x7fc04c0cd530 msgr2=0x7fc04c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:30.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.716+0000 7fc050ea9640 1 -- 172.21.15.78:0/2886328105 shutdown_connections 2024-09-17T03:15:30.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.716+0000 7fc050ea9640 1 -- 172.21.15.78:0/2886328105 wait complete. 2024-09-17T03:15:30.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.718+0000 7fc050ea9640 1 Processor -- start 2024-09-17T03:15:30.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.718+0000 7fc050ea9640 1 -- start start 2024-09-17T03:15:30.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.719+0000 7fc050ea9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc04c06cde0 0x7fc04c147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:30.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.719+0000 7fc050ea9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc04c06e470 0x7fc04c155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:30.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.719+0000 7fc050ea9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc04c15cd50 0x7fc04c0c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:30.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.719+0000 7fc050ea9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c0cbb70 con 0x7fc04c15cd50 2024-09-17T03:15:30.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.719+0000 7fc050ea9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c0cb9f0 con 0x7fc04c06cde0 2024-09-17T03:15:30.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.719+0000 7fc050ea9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc04c15d870 con 0x7fc04c06e470 2024-09-17T03:15:30.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.719+0000 7fc04ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc04c15cd50 0x7fc04c0c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:30.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.719+0000 7fc04ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc04c15cd50 0x7fc04c0c9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58244/0 (socket says 172.21.15.78:58244) 2024-09-17T03:15:30.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.719+0000 7fc04ad9d640 1 -- 172.21.15.78:0/2588733050 learned_addr learned my addr 172.21.15.78:0/2588733050 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:30.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.719+0000 7fc049d9b640 1 --2- 172.21.15.78:0/2588733050 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc04c06e470 0x7fc04c155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:30.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.719+0000 7fc04a59c640 1 --2- 172.21.15.78:0/2588733050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc04c06cde0 0x7fc04c147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:30.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.720+0000 7fc04ad9d640 1 -- 172.21.15.78:0/2588733050 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc04c06e470 msgr2=0x7fc04c155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:30.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.720+0000 7fc04ad9d640 1 --2- 172.21.15.78:0/2588733050 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc04c06e470 0x7fc04c155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.720+0000 7fc04ad9d640 1 -- 172.21.15.78:0/2588733050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc04c06cde0 msgr2=0x7fc04c147420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:30.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.720+0000 7fc04ad9d640 1 --2- 172.21.15.78:0/2588733050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc04c06cde0 0x7fc04c147420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.720+0000 7fc04ad9d640 1 -- 172.21.15.78:0/2588733050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc04c0ce7b0 con 0x7fc04c15cd50 2024-09-17T03:15:30.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.720+0000 7fc04ad9d640 1 --2- 172.21.15.78:0/2588733050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc04c15cd50 0x7fc04c0c9de0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fc04400c3c0 tx=0x7fc04400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:30.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.720+0000 7fc03affd640 1 -- 172.21.15.78:0/2588733050 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc044017070 con 0x7fc04c15cd50 2024-09-17T03:15:30.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.720+0000 7fc03affd640 1 -- 172.21.15.78:0/2588733050 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0440035f0 con 0x7fc04c15cd50 2024-09-17T03:15:30.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.720+0000 7fc050ea9640 1 -- 172.21.15.78:0/2588733050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc04c0cea90 con 0x7fc04c15cd50 2024-09-17T03:15:30.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.720+0000 7fc03affd640 1 -- 172.21.15.78:0/2588733050 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc044003a40 con 0x7fc04c15cd50 2024-09-17T03:15:30.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.720+0000 7fc050ea9640 1 -- 172.21.15.78:0/2588733050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc04c154770 con 0x7fc04c15cd50 2024-09-17T03:15:30.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.721+0000 7fc050ea9640 1 -- 172.21.15.78:0/2588733050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc04c1549d0 con 0x7fc04c15cd50 2024-09-17T03:15:30.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.722+0000 7fc03affd640 1 -- 172.21.15.78:0/2588733050 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc04401a070 con 0x7fc04c15cd50 2024-09-17T03:15:30.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.722+0000 7fc03affd640 1 --2- 172.21.15.78:0/2588733050 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc02c078b90 0x7fc02c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:30.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.722+0000 7fc03affd640 1 -- 172.21.15.78:0/2588733050 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fc044099dc0 con 0x7fc04c15cd50 2024-09-17T03:15:30.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.722+0000 7fc04a59c640 1 --2- 172.21.15.78:0/2588733050 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc02c078b90 0x7fc02c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:30.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.723+0000 7fc04a59c640 1 --2- 172.21.15.78:0/2588733050 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc02c078b90 0x7fc02c07b0a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc03c034000 tx=0x7fc03c004ab0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:30.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.727+0000 7fc03affd640 1 -- 172.21.15.78:0/2588733050 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc044061d90 con 0x7fc04c15cd50 2024-09-17T03:15:30.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.936+0000 7fc050ea9640 1 -- 172.21.15.78:0/2588733050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc04c06d1f0 con 0x7fc04c15cd50 2024-09-17T03:15:30.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.937+0000 7fc03affd640 1 -- 172.21.15.78:0/2588733050 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5280 (secure 0 0 0) 0x7fc0440667c0 con 0x7fc04c15cd50 2024-09-17T03:15:30.936 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:30.936 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:15:12.673912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8286,"mds_1":8283,"mds_2":7213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7213":{"gid":7213,"name":"d","rank":2,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8283":{"gid":8283,"name":"a","rank":1,"incarnation":95,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[8286,8283,7213]},"id":7}]} 2024-09-17T03:15:30.936 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 103 2024-09-17T03:15:30.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.939+0000 7fc050ea9640 1 -- 172.21.15.78:0/2588733050 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc02c078b90 msgr2=0x7fc02c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:30.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.939+0000 7fc050ea9640 1 --2- 172.21.15.78:0/2588733050 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc02c078b90 0x7fc02c07b0a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc03c034000 tx=0x7fc03c004ab0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.939+0000 7fc050ea9640 1 -- 172.21.15.78:0/2588733050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc04c15cd50 msgr2=0x7fc04c0c9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:30.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.939+0000 7fc050ea9640 1 --2- 172.21.15.78:0/2588733050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc04c15cd50 0x7fc04c0c9de0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7fc04400c3c0 tx=0x7fc04400c880 comp rx=0 tx=0).stop 2024-09-17T03:15:30.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.939+0000 7fc050ea9640 1 -- 172.21.15.78:0/2588733050 shutdown_connections 2024-09-17T03:15:30.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.939+0000 7fc050ea9640 1 --2- 172.21.15.78:0/2588733050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc04c15cd50 0x7fc04c0c9de0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.939+0000 7fc050ea9640 1 --2- 172.21.15.78:0/2588733050 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc04c06e470 0x7fc04c155510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.939+0000 7fc050ea9640 1 --2- 172.21.15.78:0/2588733050 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc02c078b90 0x7fc02c07b0a0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.939+0000 7fc050ea9640 1 --2- 172.21.15.78:0/2588733050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc04c06cde0 0x7fc04c147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:30.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.939+0000 7fc050ea9640 1 -- 172.21.15.78:0/2588733050 >> 172.21.15.78:0/2588733050 conn(0x7fc04c0cd530 msgr2=0x7fc04c0cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:30.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.939+0000 7fc050ea9640 1 -- 172.21.15.78:0/2588733050 shutdown_connections 2024-09-17T03:15:30.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:30.939+0000 7fc050ea9640 1 -- 172.21.15.78:0/2588733050 wait complete. 2024-09-17T03:15:30.949 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:15:31.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.063+0000 7fd459abd640 1 -- 172.21.15.78:0/3644777480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd43c004d40 msgr2=0x7fd43c0051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.063+0000 7fd459abd640 1 --2- 172.21.15.78:0/3644777480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd43c004d40 0x7fd43c0051f0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fd44c001dc0 tx=0x7fd43c005830 comp rx=0 tx=0).stop 2024-09-17T03:15:31.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.063+0000 7fd453fff640 1 -- 172.21.15.78:0/3644777480 reap_dead start 2024-09-17T03:15:31.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.063+0000 7fd459abd640 1 -- 172.21.15.78:0/3644777480 shutdown_connections 2024-09-17T03:15:31.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.063+0000 7fd459abd640 1 -- 172.21.15.78:0/3644777480 >> 172.21.15.78:0/3644777480 conn(0x7fd454072ae0 msgr2=0x7fd454072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:31.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.063+0000 7fd459abd640 1 -- 172.21.15.78:0/3644777480 shutdown_connections 2024-09-17T03:15:31.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.063+0000 7fd459abd640 1 -- 172.21.15.78:0/3644777480 wait complete. 2024-09-17T03:15:31.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.065+0000 7fd459abd640 1 Processor -- start 2024-09-17T03:15:31.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.065+0000 7fd459abd640 1 -- start start 2024-09-17T03:15:31.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.066+0000 7fd459abd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd43c004d40 0x7fd4541f0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:31.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.066+0000 7fd459abd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4541f3e50 0x7fd4540c7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:31.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.066+0000 7fd459abd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd454158870 0x7fd454158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:31.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.066+0000 7fd459abd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fd45415c860 con 0x7fd4541f3e50 2024-09-17T03:15:31.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.066+0000 7fd459abd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd45415c6e0 con 0x7fd43c004d40 2024-09-17T03:15:31.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.066+0000 7fd459abd640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd45415c9e0 con 0x7fd454158870 2024-09-17T03:15:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.066+0000 7fd452ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4541f3e50 0x7fd4540c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.066+0000 7fd452ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4541f3e50 0x7fd4540c7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58266/0 (socket says 172.21.15.78:58266) 2024-09-17T03:15:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.066+0000 7fd452ffd640 1 -- 172.21.15.78:0/32032135 learned_addr learned my addr 172.21.15.78:0/32032135 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.066+0000 7fd4537fe640 1 --2- 172.21.15.78:0/32032135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd43c004d40 0x7fd4541f0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.066+0000 7fd453fff640 1 --2- 172.21.15.78:0/32032135 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd454158870 0x7fd454158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.067+0000 7fd452ffd640 1 -- 172.21.15.78:0/32032135 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd454158870 msgr2=0x7fd454158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.067+0000 7fd452ffd640 1 --2- 172.21.15.78:0/32032135 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd454158870 0x7fd454158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.067+0000 7fd452ffd640 1 -- 172.21.15.78:0/32032135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd43c004d40 msgr2=0x7fd4541f0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.067+0000 7fd452ffd640 1 --2- 172.21.15.78:0/32032135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd43c004d40 0x7fd4541f0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.067+0000 7fd452ffd640 1 -- 172.21.15.78:0/32032135 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4541f0b60 con 0x7fd4541f3e50 2024-09-17T03:15:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.067+0000 7fd4537fe640 1 --2- 172.21.15.78:0/32032135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd43c004d40 0x7fd4541f0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.067+0000 7fd452ffd640 1 --2- 172.21.15.78:0/32032135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4541f3e50 0x7fd4540c7970 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fd44800e600 tx=0x7fd44800eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.067+0000 7fd43bfff640 1 -- 172.21.15.78:0/32032135 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd448015070 con 0x7fd4541f3e50 2024-09-17T03:15:31.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.067+0000 7fd43bfff640 1 -- 172.21.15.78:0/32032135 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd44800ca90 con 0x7fd4541f3e50 2024-09-17T03:15:31.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.067+0000 7fd459abd640 1 -- 172.21.15.78:0/32032135 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4541591c0 con 0x7fd4541f3e50 2024-09-17T03:15:31.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.067+0000 7fd43bfff640 1 -- 172.21.15.78:0/32032135 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd448011460 con 0x7fd4541f3e50 2024-09-17T03:15:31.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.067+0000 7fd459abd640 1 -- 172.21.15.78:0/32032135 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4540c6300 con 0x7fd4541f3e50 2024-09-17T03:15:31.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.068+0000 7fd459abd640 1 -- 172.21.15.78:0/32032135 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4540cebf0 con 0x7fd4541f3e50 2024-09-17T03:15:31.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.069+0000 7fd43bfff640 1 -- 172.21.15.78:0/32032135 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd448018070 con 0x7fd4541f3e50 2024-09-17T03:15:31.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.070+0000 7fd43bfff640 1 --2- 172.21.15.78:0/32032135 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd440078bc0 0x7fd44007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:31.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.070+0000 7fd43bfff640 1 -- 172.21.15.78:0/32032135 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fd44809b4d0 con 0x7fd4541f3e50 2024-09-17T03:15:31.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.070+0000 7fd4537fe640 1 --2- 172.21.15.78:0/32032135 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd440078bc0 0x7fd44007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:31.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.071+0000 7fd4537fe640 1 --2- 172.21.15.78:0/32032135 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd440078bc0 0x7fd44007b0d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd444009b60 tx=0x7fd444005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:31.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.074+0000 7fd43bfff640 1 -- 172.21.15.78:0/32032135 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fd4541591c0 con 0x7fd4541f3e50 2024-09-17T03:15:31.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.282+0000 7fd459abd640 1 -- 172.21.15.78:0/32032135 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd4540b7d80 con 0x7fd4541f3e50 2024-09-17T03:15:31.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.282+0000 7fd43bfff640 1 -- 172.21.15.78:0/32032135 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) ==== 95+0+5280 (secure 0 0 0) 0x7fd4541f0b60 con 0x7fd4541f3e50 2024-09-17T03:15:31.281 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:31.281 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":103,"btime":"2024-09-17T03:15:12:732209+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T03:14:39.064178+0000","modified":"2024-09-17T03:15:12.673912+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":8286,"mds_1":8283,"mds_2":7213},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7213":{"gid":7213,"name":"d","rank":2,"incarnation":97,"state":"up:active","state_seq":11,"addr":"172.21.15.193:6837/2983826871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":2983826871},{"type":"v1","addr":"172.21.15.193:6837","nonce":2983826871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8283":{"gid":8283,"name":"a","rank":1,"incarnation":95,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6834/1810198137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1810198137},{"type":"v1","addr":"172.21.15.78:6834","nonce":1810198137}]},"join_fscid":-1,"export_targets":[0,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_8286":{"gid":8286,"name":"c","rank":0,"incarnation":90,"state":"up:active","state_seq":11,"addr":"172.21.15.78:6835/1623349891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6833","nonce":1623349891},{"type":"v1","addr":"172.21.15.78:6835","nonce":1623349891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8286,"qdb_cluster":[8286,8283,7213]},"id":7}]} 2024-09-17T03:15:31.281 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 103 2024-09-17T03:15:31.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.284+0000 7fd459abd640 1 -- 172.21.15.78:0/32032135 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd440078bc0 msgr2=0x7fd44007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.284+0000 7fd459abd640 1 --2- 172.21.15.78:0/32032135 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd440078bc0 0x7fd44007b0d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd444009b60 tx=0x7fd444005f90 comp rx=0 tx=0).stop 2024-09-17T03:15:31.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.284+0000 7fd459abd640 1 -- 172.21.15.78:0/32032135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4541f3e50 msgr2=0x7fd4540c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.284+0000 7fd459abd640 1 --2- 172.21.15.78:0/32032135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4541f3e50 0x7fd4540c7970 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fd44800e600 tx=0x7fd44800eac0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.284+0000 7fd459abd640 1 -- 172.21.15.78:0/32032135 shutdown_connections 2024-09-17T03:15:31.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.284+0000 7fd459abd640 1 --2- 172.21.15.78:0/32032135 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd454158870 0x7fd454158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.284+0000 7fd459abd640 1 --2- 172.21.15.78:0/32032135 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4541f3e50 0x7fd4540c7970 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.284+0000 7fd459abd640 1 --2- 172.21.15.78:0/32032135 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fd440078bc0 0x7fd44007b0d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.284+0000 7fd459abd640 1 --2- 172.21.15.78:0/32032135 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd43c004d40 0x7fd4541f0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.284+0000 7fd459abd640 1 -- 172.21.15.78:0/32032135 >> 172.21.15.78:0/32032135 conn(0x7fd454072ae0 msgr2=0x7fd45415bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:31.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.284+0000 7fd459abd640 1 -- 172.21.15.78:0/32032135 shutdown_connections 2024-09-17T03:15:31.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.284+0000 7fd459abd640 1 -- 172.21.15.78:0/32032135 wait complete. 2024-09-17T03:15:31.295 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:15:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.408+0000 7f3efb09b640 1 -- 172.21.15.78:0/1636750551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3edc0039e0 msgr2=0x7f3edc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.408+0000 7f3efb09b640 1 --2- 172.21.15.78:0/1636750551 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3edc0039e0 0x7f3edc003e10 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4009b50 tx=0x7f3edc005830 comp rx=0 tx=0).stop 2024-09-17T03:15:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.408+0000 7f3ef9638640 1 -- 172.21.15.78:0/1636750551 reap_dead start 2024-09-17T03:15:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.408+0000 7f3efb09b640 1 -- 172.21.15.78:0/1636750551 shutdown_connections 2024-09-17T03:15:31.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.408+0000 7f3efb09b640 1 -- 172.21.15.78:0/1636750551 >> 172.21.15.78:0/1636750551 conn(0x7f3ef408bfc0 msgr2=0x7f3ef409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:31.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.408+0000 7f3efb09b640 1 -- 172.21.15.78:0/1636750551 shutdown_connections 2024-09-17T03:15:31.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.408+0000 7f3efb09b640 1 -- 172.21.15.78:0/1636750551 wait complete. 2024-09-17T03:15:31.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.410+0000 7f3efb09b640 1 Processor -- start 2024-09-17T03:15:31.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.410+0000 7f3efb09b640 1 -- start start 2024-09-17T03:15:31.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.411+0000 7f3efb09b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3edc0039e0 0x7f3ef41f90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:31.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.411+0000 7f3efb09b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ef40cb5c0 0x7f3ef40b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:31.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.411+0000 7f3efb09b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ef40b57f0 0x7f3ef40cded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.411+0000 7f3efb09b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef40b3540 con 0x7f3ef40b57f0 2024-09-17T03:15:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.411+0000 7f3efb09b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3ef40b36c0 con 0x7f3ef40cb5c0 2024-09-17T03:15:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.411+0000 7f3efb09b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3ef40b3840 con 0x7f3edc0039e0 2024-09-17T03:15:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.411+0000 7f3ef9638640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ef40b57f0 0x7f3ef40cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.411+0000 7f3ef9638640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ef40b57f0 0x7f3ef40cded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58274/0 (socket says 172.21.15.78:58274) 2024-09-17T03:15:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.411+0000 7f3ef9638640 1 -- 172.21.15.78:0/2377636630 learned_addr learned my addr 172.21.15.78:0/2377636630 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.411+0000 7f3ef8e37640 1 --2- 172.21.15.78:0/2377636630 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3edc0039e0 0x7f3ef41f90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.411+0000 7f3ef3fff640 1 --2- 172.21.15.78:0/2377636630 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ef40cb5c0 0x7f3ef40b52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.412+0000 7f3ef9638640 1 -- 172.21.15.78:0/2377636630 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3edc0039e0 msgr2=0x7f3ef41f90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.412+0000 7f3ef9638640 1 --2- 172.21.15.78:0/2377636630 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3edc0039e0 0x7f3ef41f90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.412+0000 7f3ef9638640 1 -- 172.21.15.78:0/2377636630 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ef40cb5c0 msgr2=0x7f3ef40b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.412+0000 7f3ef9638640 1 --2- 172.21.15.78:0/2377636630 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ef40cb5c0 0x7f3ef40b52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.412+0000 7f3ef9638640 1 -- 172.21.15.78:0/2377636630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ef40c8dc0 con 0x7f3ef40b57f0 2024-09-17T03:15:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.412+0000 7f3ef9638640 1 --2- 172.21.15.78:0/2377636630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ef40b57f0 0x7f3ef40cded0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f3eec000f80 tx=0x7f3eec00ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.412+0000 7f3ef17fa640 1 -- 172.21.15.78:0/2377636630 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eec00c910 con 0x7f3ef40b57f0 2024-09-17T03:15:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.412+0000 7f3ef17fa640 1 -- 172.21.15.78:0/2377636630 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3eec017070 con 0x7f3ef40b57f0 2024-09-17T03:15:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.412+0000 7f3efb09b640 1 -- 172.21.15.78:0/2377636630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ef40a1ea0 con 0x7f3ef40b57f0 2024-09-17T03:15:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.412+0000 7f3ef17fa640 1 -- 172.21.15.78:0/2377636630 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eec00ce60 con 0x7f3ef40b57f0 2024-09-17T03:15:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.412+0000 7f3efb09b640 1 -- 172.21.15.78:0/2377636630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ef40cba30 con 0x7f3ef40b57f0 2024-09-17T03:15:31.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.413+0000 7f3efb09b640 1 -- 172.21.15.78:0/2377636630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ef40a1c90 con 0x7f3ef40b57f0 2024-09-17T03:15:31.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.414+0000 7f3ef17fa640 1 -- 172.21.15.78:0/2377636630 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3eec01c460 con 0x7f3ef40b57f0 2024-09-17T03:15:31.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.415+0000 7f3ef17fa640 1 --2- 172.21.15.78:0/2377636630 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3ee0078b90 0x7f3ee007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:31.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.415+0000 7f3ef17fa640 1 -- 172.21.15.78:0/2377636630 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7f3eec09af10 con 0x7f3ef40b57f0 2024-09-17T03:15:31.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.415+0000 7f3ef8e37640 1 --2- 172.21.15.78:0/2377636630 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3ee0078b90 0x7f3ee007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:31.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.415+0000 7f3ef8e37640 1 --2- 172.21.15.78:0/2377636630 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3ee0078b90 0x7f3ee007b0a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4035000 tx=0x7f3ee402d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:31.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.419+0000 7f3ef17fa640 1 -- 172.21.15.78:0/2377636630 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f3eec062d90 con 0x7f3ef40b57f0 2024-09-17T03:15:31.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.592+0000 7f3efb09b640 1 -- 172.21.15.78:0/2377636630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ef40d3330 con 0x7f3ef40b57f0 2024-09-17T03:15:31.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.593+0000 7f3ef17fa640 1 -- 172.21.15.78:0/2377636630 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) ==== 74+0+16644 (secure 0 0 0) 0x7f3eec0677c0 con 0x7f3ef40b57f0 2024-09-17T03:15:31.592 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:31.592 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":95,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:14:40.724293+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-17T03:14:36.702637+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"94","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-17T03:14:38.031363+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:15:31.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.595+0000 7f3efb09b640 1 -- 172.21.15.78:0/2377636630 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3ee0078b90 msgr2=0x7f3ee007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.595+0000 7f3efb09b640 1 --2- 172.21.15.78:0/2377636630 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3ee0078b90 0x7f3ee007b0a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4035000 tx=0x7f3ee402d040 comp rx=0 tx=0).stop 2024-09-17T03:15:31.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.595+0000 7f3efb09b640 1 -- 172.21.15.78:0/2377636630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ef40b57f0 msgr2=0x7f3ef40cded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.595+0000 7f3efb09b640 1 --2- 172.21.15.78:0/2377636630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ef40b57f0 0x7f3ef40cded0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f3eec000f80 tx=0x7f3eec00ea90 comp rx=0 tx=0).stop 2024-09-17T03:15:31.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.595+0000 7f3efb09b640 1 -- 172.21.15.78:0/2377636630 shutdown_connections 2024-09-17T03:15:31.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.595+0000 7f3efb09b640 1 --2- 172.21.15.78:0/2377636630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ef40b57f0 0x7f3ef40cded0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.595+0000 7f3efb09b640 1 --2- 172.21.15.78:0/2377636630 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3ee0078b90 0x7f3ee007b0a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.595+0000 7f3efb09b640 1 --2- 172.21.15.78:0/2377636630 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ef40cb5c0 0x7f3ef40b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.595+0000 7f3efb09b640 1 --2- 172.21.15.78:0/2377636630 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3edc0039e0 0x7f3ef41f90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.595+0000 7f3efb09b640 1 -- 172.21.15.78:0/2377636630 >> 172.21.15.78:0/2377636630 conn(0x7f3ef408bfc0 msgr2=0x7f3ef40b8500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:31.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.595+0000 7f3efb09b640 1 -- 172.21.15.78:0/2377636630 shutdown_connections 2024-09-17T03:15:31.595 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.595+0000 7f3efb09b640 1 -- 172.21.15.78:0/2377636630 wait complete. 2024-09-17T03:15:31.605 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T03:15:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.720+0000 7fc611838640 1 -- 172.21.15.78:0/2839665731 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc60c0d2ed0 msgr2=0x7fc60c0d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.720+0000 7fc611838640 1 --2- 172.21.15.78:0/2839665731 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc60c0d2ed0 0x7fc60c0d1a80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0098e0 tx=0x7fc5fc02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.720+0000 7fc611838640 1 -- 172.21.15.78:0/2839665731 shutdown_connections 2024-09-17T03:15:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.720+0000 7fc611838640 1 --2- 172.21.15.78:0/2839665731 >> v2:172.21.15.193:3300/0 conn(0x7fc60c0b9b70 0x7fc60c0cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.720+0000 7fc611838640 1 --2- 172.21.15.78:0/2839665731 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc60c0d2ed0 0x7fc60c0d1a80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.720+0000 7fc611838640 1 -- 172.21.15.78:0/2839665731 >> 172.21.15.78:0/2839665731 conn(0x7fc60c08bfc0 msgr2=0x7fc60c09d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.720+0000 7fc611838640 1 -- 172.21.15.78:0/2839665731 shutdown_connections 2024-09-17T03:15:31.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.720+0000 7fc611838640 1 -- 172.21.15.78:0/2839665731 wait complete. 2024-09-17T03:15:31.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.721+0000 7fc611838640 1 Processor -- start 2024-09-17T03:15:31.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.722+0000 7fc611838640 1 -- start start 2024-09-17T03:15:31.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.723+0000 7fc611838640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc60c0b9b70 0x7fc60c0c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:31.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.723+0000 7fc611838640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc60c0cf5d0 0x7fc60c15ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:31.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.723+0000 7fc611838640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc60c0d2ed0 0x7fc60c0b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:31.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.723+0000 7fc611838640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c0d4940 con 0x7fc60c0b9b70 2024-09-17T03:15:31.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.723+0000 7fc611838640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c0cfde0 con 0x7fc60c0cf5d0 2024-09-17T03:15:31.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.723+0000 7fc611838640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc60c0d4ac0 con 0x7fc60c0d2ed0 2024-09-17T03:15:31.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.723+0000 7fc60affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc60c0b9b70 0x7fc60c0c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:31.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.723+0000 7fc60affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc60c0b9b70 0x7fc60c0c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58276/0 (socket says 172.21.15.78:58276) 2024-09-17T03:15:31.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.723+0000 7fc60affd640 1 -- 172.21.15.78:0/664028356 learned_addr learned my addr 172.21.15.78:0/664028356 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:31.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.723+0000 7fc60b7fe640 1 --2- 172.21.15.78:0/664028356 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc60c0d2ed0 0x7fc60c0b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:31.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.723+0000 7fc60a7fc640 1 --2- 172.21.15.78:0/664028356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc60c0cf5d0 0x7fc60c15ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:31.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.723+0000 7fc60affd640 1 -- 172.21.15.78:0/664028356 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc60c0d2ed0 msgr2=0x7fc60c0b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.723+0000 7fc60affd640 1 --2- 172.21.15.78:0/664028356 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc60c0d2ed0 0x7fc60c0b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.723+0000 7fc60affd640 1 -- 172.21.15.78:0/664028356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc60c0cf5d0 msgr2=0x7fc60c15ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.723+0000 7fc60affd640 1 --2- 172.21.15.78:0/664028356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc60c0cf5d0 0x7fc60c15ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.723+0000 7fc60affd640 1 -- 172.21.15.78:0/664028356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60c0cb350 con 0x7fc60c0b9b70 2024-09-17T03:15:31.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.723+0000 7fc60b7fe640 1 --2- 172.21.15.78:0/664028356 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc60c0d2ed0 0x7fc60c0b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:31.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.724+0000 7fc60affd640 1 --2- 172.21.15.78:0/664028356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc60c0b9b70 0x7fc60c0c80f0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009a00 tx=0x7fc5fc0316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:31.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.724+0000 7fc5f3fff640 1 -- 172.21.15.78:0/664028356 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc031d60 con 0x7fc60c0b9b70 2024-09-17T03:15:31.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.724+0000 7fc5f3fff640 1 -- 172.21.15.78:0/664028356 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5fc0048a0 con 0x7fc60c0b9b70 2024-09-17T03:15:31.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.724+0000 7fc611838640 1 -- 172.21.15.78:0/664028356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60c0c8630 con 0x7fc60c0b9b70 2024-09-17T03:15:31.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.724+0000 7fc5f3fff640 1 -- 172.21.15.78:0/664028356 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc004cd0 con 0x7fc60c0b9b70 2024-09-17T03:15:31.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.724+0000 7fc611838640 1 -- 172.21.15.78:0/664028356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc60c0c8d90 con 0x7fc60c0b9b70 2024-09-17T03:15:31.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.725+0000 7fc611838640 1 -- 172.21.15.78:0/664028356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc60c0d5050 con 0x7fc60c0b9b70 2024-09-17T03:15:31.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.725+0000 7fc5f3fff640 1 -- 172.21.15.78:0/664028356 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc5fc005040 con 0x7fc60c0b9b70 2024-09-17T03:15:31.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.726+0000 7fc5f3fff640 1 --2- 172.21.15.78:0/664028356 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc5f8078bc0 0x7fc5f807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:31.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.726+0000 7fc5f3fff640 1 -- 172.21.15.78:0/664028356 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5709+0+0 (secure 0 0 0) 0x7fc5fc0bbe70 con 0x7fc60c0b9b70 2024-09-17T03:15:31.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.727+0000 7fc60a7fc640 1 --2- 172.21.15.78:0/664028356 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc5f8078bc0 0x7fc5f807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:31.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.727+0000 7fc60a7fc640 1 --2- 172.21.15.78:0/664028356 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc5f8078bc0 0x7fc5f807b0d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc60c0b5350 tx=0x7fc600005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:31.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.731+0000 7fc5f3fff640 1 -- 172.21.15.78:0/664028356 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc5fc03f030 con 0x7fc60c0b9b70 2024-09-17T03:15:31.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.941+0000 7fc611838640 1 -- 172.21.15.78:0/664028356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fc60c0b4020 con 0x7fc60c0b9b70 2024-09-17T03:15:31.940 INFO:tasks.ceph.mon.a.smithi078.stderr:2024-09-17T03:15:31.942+0000 7f192af78640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T03:15:31.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.943+0000 7fc5f3fff640 1 -- 172.21.15.78:0/664028356 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v104) ==== 161+0+0 (secure 0 0 0) 0x7fc5fc084340 con 0x7fc60c0b9b70 2024-09-17T03:15:31.942 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T03:15:31.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.946+0000 7fc611838640 1 -- 172.21.15.78:0/664028356 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc5f8078bc0 msgr2=0x7fc5f807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.946+0000 7fc611838640 1 --2- 172.21.15.78:0/664028356 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc5f8078bc0 0x7fc5f807b0d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc60c0b5350 tx=0x7fc600005f90 comp rx=0 tx=0).stop 2024-09-17T03:15:31.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.946+0000 7fc611838640 1 -- 172.21.15.78:0/664028356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc60c0b9b70 msgr2=0x7fc60c0c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:31.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.946+0000 7fc611838640 1 --2- 172.21.15.78:0/664028356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc60c0b9b70 0x7fc60c0c80f0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009a00 tx=0x7fc5fc0316b0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.946+0000 7fc611838640 1 -- 172.21.15.78:0/664028356 shutdown_connections 2024-09-17T03:15:31.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.946+0000 7fc611838640 1 --2- 172.21.15.78:0/664028356 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc60c0d2ed0 0x7fc60c0b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.946+0000 7fc611838640 1 --2- 172.21.15.78:0/664028356 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc5f8078bc0 0x7fc5f807b0d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.946+0000 7fc611838640 1 --2- 172.21.15.78:0/664028356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc60c0cf5d0 0x7fc60c15ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.946+0000 7fc611838640 1 --2- 172.21.15.78:0/664028356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc60c0b9b70 0x7fc60c0c80f0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:31.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.946+0000 7fc611838640 1 -- 172.21.15.78:0/664028356 >> 172.21.15.78:0/664028356 conn(0x7fc60c08bfc0 msgr2=0x7fc60c0b5fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:31.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.946+0000 7fc611838640 1 -- 172.21.15.78:0/664028356 shutdown_connections 2024-09-17T03:15:31.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:31.946+0000 7fc611838640 1 -- 172.21.15.78:0/664028356 wait complete. 2024-09-17T03:15:31.951 INFO:tasks.ceph.mds.d.smithi193.stderr: -1349> 2024-09-17T03:15:08.558+0000 7f08d87ef640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000006 [...2,head] /d1/d2/d3/d4/d5/d6/d7/ auth v4 ap=1 f(v0 m2024-09-17T03:14:51.064943+0000 1=0+1) n(v0 rc2024-09-17T03:14:51.064943+0000 2=0+2) (inest lock) (ifile excl) caps={8433=pAsLsXsFsx/pAsLsXsFsxcral@4},l=8433 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x564fb2198c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000006:[<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:14:51.064943+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:14:51.064943+0000 2=0+2)","memory_value.dirstat":"f(v0 m2024-09-17T03:14:51.064943+0000 1=0+1)","memory_value.rstat":"n(v0 rc2024-09-17T03:14:51.064943+0000 2=0+2)","error_str":""},"return_code":-61} 2024-09-17T03:15:31.952 INFO:tasks.ceph.mds.d.smithi193.stderr: -1327> 2024-09-17T03:15:08.558+0000 7f08d87ef640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000007 [...2,head] /d1/d2/d3/d4/d5/d6/d7/d8/ auth v2 ap=1 f() n(v0 1=0+1) (inest lock) (ifile excl) caps={8433=pAsLsXsFsx/AsLsXsFsx@2},l=8433 | importingcaps=0 dirfrag=0 caps=1 dirtyparent=0 replicated=0 dirty=0 authpin=1 scrubqueue=0 0x564fb2199700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000007:[<0x10000000006/d8 v2>,<0x10000000005/d7 v4>,<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f()","memory_value.rstat":"n(v0 1=0+1)","error_str":""},"return_code":-61} 2024-09-17T03:15:31.956 INFO:tasks.ceph.mds.a.smithi078.stderr: -1478> 2024-09-17T03:15:08.557+0000 7f2693f32640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000004 [...2,head] /d1/d2/d3/d4/d5/ auth{0=1,2=1} v15 ap=1 f(v0 m2024-09-17T03:14:51.063943+0000 1=0+1) n(v2 rc2024-09-17T03:14:51.297939+0000 4=0+4) (inest lock) (ifile excl) caps={8433=pAsLsXsFsx/pAsLsXsFsxcral@4},l=8433 | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=0 authpin=1 scrubqueue=0 0x55d16fba8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000004:[<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:14:51.063943+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:14:51.297939+0000 4=0+4)","memory_value.dirstat":"f(v0 m2024-09-17T03:14:51.063943+0000 1=0+1)","memory_value.rstat":"n(v2 rc2024-09-17T03:14:51.297939+0000 4=0+4)","error_str":""},"return_code":-61} 2024-09-17T03:15:31.958 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T03:15:31.958 INFO:tasks.ceph.mds.a.smithi078.stderr: -1328> 2024-09-17T03:15:08.559+0000 7f269a73f640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000005 [...2,head] /d1/d2/d3/d4/d5/d6/ auth{0=1,2=1} v11 ap=2 f(v0 m2024-09-17T03:14:51.064943+0000 1=0+1) n(v1 rc2024-09-17T03:14:51.297939+0000 3=0+3) (inest sync->mix g=0,2 scatter_wanted) caps={8433=pAsLsXsFs/pAsLsXsFsxcral@7} | request=0 lock=0 importingcaps=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 export_pin=2 0x55d16fba8c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000005:[<0x10000000004/d6 v11>,<0x10000000003/d5 v15>,<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v17>,<0x1/d1 v16>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:14:51.064943+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:14:51.064943+0000 3=0+3)","memory_value.dirstat":"f(v0 m2024-09-17T03:14:51.064943+0000 1=0+1)","memory_value.rstat":"n(v1 rc2024-09-17T03:14:51.297939+0000 3=0+3)","error_str":""},"return_code":-61} 2024-09-17T03:15:31.962 INFO:tasks.ceph.mds.c.smithi078.stderr: -3004> 2024-09-17T03:15:08.557+0000 7f4bf616f640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000002 [...2,head] /d1/d2/d3/ auth{1=1,2=1} v19 ap=1 f(v0 m2024-09-17T03:14:51.062943+0000 1=0+1) n(v3 rc2024-09-17T03:14:51.297939+0000 6=0+6) (inest mix dirty) (ifile excl) caps={8433=pAsLsXsFsx/pAsLsXsFsxcral@4},l=8433 | dirtyscattered=1 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x55a1f171d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000002:[<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:14:51.062943+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:14:51.297939+0000 6=0+6)","memory_value.dirstat":"f(v0 m2024-09-17T03:14:51.062943+0000 1=0+1)","memory_value.rstat":"n(v3 rc2024-09-17T03:14:51.297939+0000 6=0+6)","error_str":""},"return_code":-61} 2024-09-17T03:15:31.962 INFO:tasks.ceph.mds.c.smithi078.stderr: -2871> 2024-09-17T03:15:08.559+0000 7f4bfc97c640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000003 [...2,head] /d1/d2/d3/d4/ auth{1=1,2=1} v19 ap=2 f(v0 m2024-09-17T03:14:51.063943+0000 1=0+1) n(v4 rc2024-09-17T03:14:51.297939+0000 5=0+5) (inest sync->mix g=1,2) caps={8433=pAsLsXsFs/pAsLsXsFsxcral@8} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyrstat=0 dirtyparent=0 replicated=1 dirty=1 waiter=0 authpin=1 scrubqueue=0 export_pin=1 0x55a1f171d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000003:[<0x10000000002/d4 v19>,<0x10000000001/d3 v19>,<0x10000000000/d2 v19>,<0x1/d1 v18>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-09-17T03:14:51.063943+0000 1=0+1)","ondisk_value.rstat":"n(v0 rc2024-09-17T03:14:51.297939+0000 5=0+5)","memory_value.dirstat":"f(v0 m2024-09-17T03:14:51.063943+0000 1=0+1)","memory_value.rstat":"n(v4 rc2024-09-17T03:14:51.297939+0000 5=0+5)","error_str":""},"return_code":-61} 2024-09-17T03:15:32.005 INFO:tasks.ceph.mds.d.smithi193.stdout:starting mds.d at 2024-09-17T03:15:32.012 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2024-09-17T03:15:32.018 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2024-09-17T03:15:32.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.079+0000 7f9577e2e640 1 -- 172.21.15.78:0/2889258881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95700d1490 msgr2=0x7f95701674d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:32.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.079+0000 7f9577e2e640 1 --2- 172.21.15.78:0/2889258881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95700d1490 0x7f95701674d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9568005fd0 tx=0x7f956802a800 comp rx=0 tx=0).stop 2024-09-17T03:15:32.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.079+0000 7f9577e2e640 1 -- 172.21.15.78:0/2889258881 shutdown_connections 2024-09-17T03:15:32.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.079+0000 7f9577e2e640 1 --2- 172.21.15.78:0/2889258881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95700d1490 0x7f95701674d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.079+0000 7f9577e2e640 1 -- 172.21.15.78:0/2889258881 >> 172.21.15.78:0/2889258881 conn(0x7f9570072ae0 msgr2=0x7f9570072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:32.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.079+0000 7f9577e2e640 1 -- 172.21.15.78:0/2889258881 shutdown_connections 2024-09-17T03:15:32.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.079+0000 7f9577e2e640 1 -- 172.21.15.78:0/2889258881 wait complete. 2024-09-17T03:15:32.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.080+0000 7f9577e2e640 1 Processor -- start 2024-09-17T03:15:32.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.080+0000 7f9577e2e640 1 -- start start 2024-09-17T03:15:32.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f9577e2e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95700b51c0 0x7f957014e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:32.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f9577e2e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95700ccbd0 0x7f9570154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:32.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f9577e2e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95700d1490 0x7f957014eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:32.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f9577e2e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9570167da0 con 0x7f95700b51c0 2024-09-17T03:15:32.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f9577e2e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9570167c20 con 0x7f95700d1490 2024-09-17T03:15:32.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f9577e2e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f9570167f20 con 0x7f95700ccbd0 2024-09-17T03:15:32.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f9575bca640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95700b51c0 0x7f957014e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:32.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f9575bca640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95700b51c0 0x7f957014e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58298/0 (socket says 172.21.15.78:58298) 2024-09-17T03:15:32.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f9575bca640 1 -- 172.21.15.78:0/2467961732 learned_addr learned my addr 172.21.15.78:0/2467961732 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:32.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f95763cb640 1 --2- 172.21.15.78:0/2467961732 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95700d1490 0x7f957014eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:32.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f95753c9640 1 --2- 172.21.15.78:0/2467961732 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95700ccbd0 0x7f9570154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:32.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f9575bca640 1 -- 172.21.15.78:0/2467961732 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95700ccbd0 msgr2=0x7f9570154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:32.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f9575bca640 1 --2- 172.21.15.78:0/2467961732 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95700ccbd0 0x7f9570154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f9575bca640 1 -- 172.21.15.78:0/2467961732 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95700d1490 msgr2=0x7f957014eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:32.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f9575bca640 1 --2- 172.21.15.78:0/2467961732 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95700d1490 0x7f957014eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f9575bca640 1 -- 172.21.15.78:0/2467961732 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9570155fa0 con 0x7f95700b51c0 2024-09-17T03:15:32.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f9575bca640 1 --2- 172.21.15.78:0/2467961732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95700b51c0 0x7f957014e730 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f956c00c500 tx=0x7f956c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:32.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f95667fc640 1 -- 172.21.15.78:0/2467961732 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956c017070 con 0x7f95700b51c0 2024-09-17T03:15:32.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f95667fc640 1 -- 172.21.15.78:0/2467961732 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f956c0035f0 con 0x7f95700b51c0 2024-09-17T03:15:32.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f9577e2e640 1 -- 172.21.15.78:0/2467961732 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9570153700 con 0x7f95700b51c0 2024-09-17T03:15:32.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.082+0000 7f95667fc640 1 -- 172.21.15.78:0/2467961732 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f956c003a60 con 0x7f95700b51c0 2024-09-17T03:15:32.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.083+0000 7f9577e2e640 1 -- 172.21.15.78:0/2467961732 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9570153cc0 con 0x7f95700b51c0 2024-09-17T03:15:32.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.083+0000 7f9577e2e640 1 -- 172.21.15.78:0/2467961732 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f957015c6e0 con 0x7f95700b51c0 2024-09-17T03:15:32.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.084+0000 7f95667fc640 1 -- 172.21.15.78:0/2467961732 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f956c01a070 con 0x7f95700b51c0 2024-09-17T03:15:32.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.085+0000 7f95667fc640 1 --2- 172.21.15.78:0/2467961732 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9554078bc0 0x7f955407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:32.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.085+0000 7f95667fc640 1 -- 172.21.15.78:0/2467961732 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5967+0+0 (secure 0 0 0) 0x7f956c09a190 con 0x7f95700b51c0 2024-09-17T03:15:32.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.085+0000 7f95753c9640 1 --2- 172.21.15.78:0/2467961732 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9554078bc0 0x7f955407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:32.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.086+0000 7f95753c9640 1 --2- 172.21.15.78:0/2467961732 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9554078bc0 0x7f955407b0d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f95700b2620 tx=0x7f9560009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:32.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.089+0000 7f95667fc640 1 -- 172.21.15.78:0/2467961732 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f9570155fa0 con 0x7f95700b51c0 2024-09-17T03:15:32.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.301+0000 7f9577e2e640 1 -- 172.21.15.78:0/2467961732 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f95700b2930 con 0x7f95700b51c0 2024-09-17T03:15:32.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.945+0000 7f95667fc640 1 -- 172.21.15.78:0/2467961732 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v105) ==== 104+0+0 (secure 0 0 0) 0x7f956c061fa0 con 0x7f95700b51c0 2024-09-17T03:15:32.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.947+0000 7f9577e2e640 1 -- 172.21.15.78:0/2467961732 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9554078bc0 msgr2=0x7f955407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:32.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.947+0000 7f9577e2e640 1 --2- 172.21.15.78:0/2467961732 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9554078bc0 0x7f955407b0d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f95700b2620 tx=0x7f9560009040 comp rx=0 tx=0).stop 2024-09-17T03:15:32.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.947+0000 7f9577e2e640 1 -- 172.21.15.78:0/2467961732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95700b51c0 msgr2=0x7f957014e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:32.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.947+0000 7f9577e2e640 1 --2- 172.21.15.78:0/2467961732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95700b51c0 0x7f957014e730 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f956c00c500 tx=0x7f956c00c9c0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.947+0000 7f9577e2e640 1 -- 172.21.15.78:0/2467961732 shutdown_connections 2024-09-17T03:15:32.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.947+0000 7f9577e2e640 1 --2- 172.21.15.78:0/2467961732 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9554078bc0 0x7f955407b0d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.947+0000 7f9577e2e640 1 --2- 172.21.15.78:0/2467961732 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95700d1490 0x7f957014eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.947+0000 7f9577e2e640 1 --2- 172.21.15.78:0/2467961732 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95700ccbd0 0x7f9570154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.947+0000 7f9577e2e640 1 --2- 172.21.15.78:0/2467961732 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f95700b51c0 0x7f957014e730 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:32.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.947+0000 7f9577e2e640 1 -- 172.21.15.78:0/2467961732 >> 172.21.15.78:0/2467961732 conn(0x7f9570072ae0 msgr2=0x7f95700d1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:32.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.947+0000 7f9577e2e640 1 -- 172.21.15.78:0/2467961732 shutdown_connections 2024-09-17T03:15:32.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:32.947+0000 7f9577e2e640 1 -- 172.21.15.78:0/2467961732 wait complete. 2024-09-17T03:15:32.958 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T03:15:33.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.117+0000 7f982087e640 1 -- 172.21.15.78:0/945380340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9804004800 msgr2=0x7f9804004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:33.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.117+0000 7f982087e640 1 --2- 172.21.15.78:0/945380340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9804004800 0x7f9804004c10 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f9810001050 tx=0x7f9804005830 comp rx=0 tx=0).stop 2024-09-17T03:15:33.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.117+0000 7f981ad9d640 1 -- 172.21.15.78:0/945380340 reap_dead start 2024-09-17T03:15:33.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.117+0000 7f982087e640 1 -- 172.21.15.78:0/945380340 shutdown_connections 2024-09-17T03:15:33.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.117+0000 7f982087e640 1 -- 172.21.15.78:0/945380340 >> 172.21.15.78:0/945380340 conn(0x7f981c0b1c40 msgr2=0x7f981c0b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:33.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.117+0000 7f982087e640 1 -- 172.21.15.78:0/945380340 shutdown_connections 2024-09-17T03:15:33.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.117+0000 7f982087e640 1 -- 172.21.15.78:0/945380340 wait complete. 2024-09-17T03:15:33.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.119+0000 7f982087e640 1 Processor -- start 2024-09-17T03:15:33.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.119+0000 7f982087e640 1 -- start start 2024-09-17T03:15:33.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.120+0000 7f982087e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9804004800 0x7f981c09cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:33.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.120+0000 7f982087e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f981c09d2b0 0x7f981c1f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:33.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.120+0000 7f982087e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f981c1528c0 0x7f981c14eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:33.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.120+0000 7f982087e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f981c06f550 con 0x7f9804004800 2024-09-17T03:15:33.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.120+0000 7f982087e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f981c0cae70 con 0x7f981c09d2b0 2024-09-17T03:15:33.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.120+0000 7f982087e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f981c06f6d0 con 0x7f981c1528c0 2024-09-17T03:15:33.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.120+0000 7f981a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9804004800 0x7f981c09cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:33.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.120+0000 7f981a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9804004800 0x7f981c09cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58320/0 (socket says 172.21.15.78:58320) 2024-09-17T03:15:33.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.120+0000 7f981a59c640 1 -- 172.21.15.78:0/1341153898 learned_addr learned my addr 172.21.15.78:0/1341153898 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:33.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.120+0000 7f9819d9b640 1 --2- 172.21.15.78:0/1341153898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f981c09d2b0 0x7f981c1f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:33.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.120+0000 7f981ad9d640 1 --2- 172.21.15.78:0/1341153898 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f981c1528c0 0x7f981c14eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:33.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.120+0000 7f981a59c640 1 -- 172.21.15.78:0/1341153898 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f981c1528c0 msgr2=0x7f981c14eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:33.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.120+0000 7f981a59c640 1 --2- 172.21.15.78:0/1341153898 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f981c1528c0 0x7f981c14eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.120+0000 7f981a59c640 1 -- 172.21.15.78:0/1341153898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f981c09d2b0 msgr2=0x7f981c1f26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:33.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.120+0000 7f981a59c640 1 --2- 172.21.15.78:0/1341153898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f981c09d2b0 0x7f981c1f26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.120+0000 7f981a59c640 1 -- 172.21.15.78:0/1341153898 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c1f3410 con 0x7f9804004800 2024-09-17T03:15:33.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.120+0000 7f981ad9d640 1 --2- 172.21.15.78:0/1341153898 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f981c1528c0 0x7f981c14eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:33.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.121+0000 7f981a59c640 1 --2- 172.21.15.78:0/1341153898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9804004800 0x7f981c09cd70 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f980c011a50 tx=0x7f980c011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:33.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.121+0000 7f980affd640 1 -- 172.21.15.78:0/1341153898 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c01f070 con 0x7f9804004800 2024-09-17T03:15:33.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.121+0000 7f980affd640 1 -- 172.21.15.78:0/1341153898 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f980c00fe80 con 0x7f9804004800 2024-09-17T03:15:33.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.121+0000 7f982087e640 1 -- 172.21.15.78:0/1341153898 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f981c151de0 con 0x7f9804004800 2024-09-17T03:15:33.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.121+0000 7f980affd640 1 -- 172.21.15.78:0/1341153898 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c012690 con 0x7f9804004800 2024-09-17T03:15:33.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.121+0000 7f982087e640 1 -- 172.21.15.78:0/1341153898 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f981c1523a0 con 0x7f9804004800 2024-09-17T03:15:33.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.122+0000 7f982087e640 1 -- 172.21.15.78:0/1341153898 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f981c0c39c0 con 0x7f9804004800 2024-09-17T03:15:33.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.123+0000 7f980affd640 1 -- 172.21.15.78:0/1341153898 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f980c022070 con 0x7f9804004800 2024-09-17T03:15:33.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.123+0000 7f980affd640 1 --2- 172.21.15.78:0/1341153898 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f97fc078b90 0x7f97fc07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:33.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.123+0000 7f980affd640 1 -- 172.21.15.78:0/1341153898 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 5967+0+0 (secure 0 0 0) 0x7f980c09b820 con 0x7f9804004800 2024-09-17T03:15:33.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.123+0000 7f9819d9b640 1 --2- 172.21.15.78:0/1341153898 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f97fc078b90 0x7f97fc07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:33.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.124+0000 7f9819d9b640 1 --2- 172.21.15.78:0/1341153898 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f97fc078b90 0x7f97fc07b0a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9810033000 tx=0x7f9810001c00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:33.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.128+0000 7f980affd640 1 -- 172.21.15.78:0/1341153898 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f981c0c39c0 con 0x7f9804004800 2024-09-17T03:15:33.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.301+0000 7f982087e640 1 -- 172.21.15.78:0/1341153898 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f981c0cb5e0 con 0x7f9804004800 2024-09-17T03:15:33.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.948+0000 7f980affd640 1 -- 172.21.15.78:0/1341153898 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v97) ==== 181+0+0 (secure 0 0 0) 0x7f980c063630 con 0x7f9804004800 2024-09-17T03:15:33.949 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2024-09-17T03:15:33.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.950+0000 7f982087e640 1 -- 172.21.15.78:0/1341153898 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f97fc078b90 msgr2=0x7f97fc07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:33.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.950+0000 7f982087e640 1 --2- 172.21.15.78:0/1341153898 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f97fc078b90 0x7f97fc07b0a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f9810033000 tx=0x7f9810001c00 comp rx=0 tx=0).stop 2024-09-17T03:15:33.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.950+0000 7f982087e640 1 -- 172.21.15.78:0/1341153898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9804004800 msgr2=0x7f981c09cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:33.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.950+0000 7f982087e640 1 --2- 172.21.15.78:0/1341153898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9804004800 0x7f981c09cd70 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f980c011a50 tx=0x7f980c011f10 comp rx=0 tx=0).stop 2024-09-17T03:15:33.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.950+0000 7f982087e640 1 -- 172.21.15.78:0/1341153898 shutdown_connections 2024-09-17T03:15:33.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.950+0000 7f982087e640 1 --2- 172.21.15.78:0/1341153898 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f981c1528c0 0x7f981c14eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.950+0000 7f982087e640 1 --2- 172.21.15.78:0/1341153898 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f97fc078b90 0x7f97fc07b0a0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.950+0000 7f982087e640 1 --2- 172.21.15.78:0/1341153898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f981c09d2b0 0x7f981c1f26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.950+0000 7f982087e640 1 --2- 172.21.15.78:0/1341153898 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9804004800 0x7f981c09cd70 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:33.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.950+0000 7f982087e640 1 -- 172.21.15.78:0/1341153898 >> 172.21.15.78:0/1341153898 conn(0x7f981c0b1c40 msgr2=0x7f981c0afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:33.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.951+0000 7f982087e640 1 -- 172.21.15.78:0/1341153898 shutdown_connections 2024-09-17T03:15:33.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:33.951+0000 7f982087e640 1 -- 172.21.15.78:0/1341153898 wait complete. 2024-09-17T03:15:33.965 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T03:15:34.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.084+0000 7fb2fef72640 1 -- 172.21.15.78:0/2903878689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e0005350 msgr2=0x7fb2e000b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:34.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.084+0000 7fb2fef72640 1 --2- 172.21.15.78:0/2903878689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e0005350 0x7fb2e000b9e0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0005fd0 tx=0x7fb2e0005830 comp rx=0 tx=0).stop 2024-09-17T03:15:34.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.084+0000 7fb2fef72640 1 -- 172.21.15.78:0/2903878689 shutdown_connections 2024-09-17T03:15:34.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.084+0000 7fb2fef72640 1 --2- 172.21.15.78:0/2903878689 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2e0005350 0x7fb2e000b9e0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:34.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.084+0000 7fb2fef72640 1 -- 172.21.15.78:0/2903878689 >> 172.21.15.78:0/2903878689 conn(0x7fb2f806e520 msgr2=0x7fb2f80cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:34.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.084+0000 7fb2fef72640 1 -- 172.21.15.78:0/2903878689 shutdown_connections 2024-09-17T03:15:34.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.084+0000 7fb2fef72640 1 -- 172.21.15.78:0/2903878689 wait complete. 2024-09-17T03:15:34.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.085+0000 7fb2fef72640 1 Processor -- start 2024-09-17T03:15:34.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.086+0000 7fb2fef72640 1 -- start start 2024-09-17T03:15:34.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.087+0000 7fb2fef72640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2e0005350 0x7fb2f81f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:34.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.087+0000 7fb2fef72640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2f81d1400 0x7fb2f81e1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:34.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.087+0000 7fb2fef72640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb2f81d1810 0x7fb2f81e2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:34.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.087+0000 7fb2fef72640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f80b3010 con 0x7fb2f81d1400 2024-09-17T03:15:34.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.087+0000 7fb2fef72640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f80b2e90 con 0x7fb2e0005350 2024-09-17T03:15:34.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.087+0000 7fb2fef72640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb2f80b3190 con 0x7fb2f81d1810 2024-09-17T03:15:34.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.087+0000 7fb2f7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2f81d1400 0x7fb2f81e1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:34.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.087+0000 7fb2f7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2f81d1400 0x7fb2f81e1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58324/0 (socket says 172.21.15.78:58324) 2024-09-17T03:15:34.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.087+0000 7fb2f7fff640 1 -- 172.21.15.78:0/799493377 learned_addr learned my addr 172.21.15.78:0/799493377 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:34.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.087+0000 7fb2fcd0e640 1 --2- 172.21.15.78:0/799493377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2e0005350 0x7fb2f81f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:34.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.087+0000 7fb2fd50f640 1 --2- 172.21.15.78:0/799493377 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb2f81d1810 0x7fb2f81e2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:34.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.087+0000 7fb2f7fff640 1 -- 172.21.15.78:0/799493377 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb2f81d1810 msgr2=0x7fb2f81e2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:34.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.087+0000 7fb2f7fff640 1 --2- 172.21.15.78:0/799493377 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb2f81d1810 0x7fb2f81e2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:34.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.087+0000 7fb2f7fff640 1 -- 172.21.15.78:0/799493377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2e0005350 msgr2=0x7fb2f81f3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:34.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.087+0000 7fb2f7fff640 1 --2- 172.21.15.78:0/799493377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2e0005350 0x7fb2f81f3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:34.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.087+0000 7fb2f7fff640 1 -- 172.21.15.78:0/799493377 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f81d1f40 con 0x7fb2f81d1400 2024-09-17T03:15:34.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.087+0000 7fb2fcd0e640 1 --2- 172.21.15.78:0/799493377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2e0005350 0x7fb2f81f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:34.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.087+0000 7fb2fd50f640 1 --2- 172.21.15.78:0/799493377 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb2f81d1810 0x7fb2f81e2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:34.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.087+0000 7fb2f7fff640 1 --2- 172.21.15.78:0/799493377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2f81d1400 0x7fb2f81e1c30 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec004d60 tx=0x7fb2ec001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:34.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.088+0000 7fb2f57fa640 1 -- 172.21.15.78:0/799493377 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec0107d0 con 0x7fb2f81d1400 2024-09-17T03:15:34.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.088+0000 7fb2f57fa640 1 -- 172.21.15.78:0/799493377 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2ec016070 con 0x7fb2f81d1400 2024-09-17T03:15:34.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.088+0000 7fb2fef72640 1 -- 172.21.15.78:0/799493377 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2f81d2220 con 0x7fb2f81d1400 2024-09-17T03:15:34.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.088+0000 7fb2f57fa640 1 -- 172.21.15.78:0/799493377 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec010ce0 con 0x7fb2f81d1400 2024-09-17T03:15:34.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.088+0000 7fb2fef72640 1 -- 172.21.15.78:0/799493377 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2f81d27e0 con 0x7fb2f81d1400 2024-09-17T03:15:34.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.089+0000 7fb2fef72640 1 -- 172.21.15.78:0/799493377 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2f8073f20 con 0x7fb2f81d1400 2024-09-17T03:15:34.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.089+0000 7fb2f57fa640 1 -- 172.21.15.78:0/799493377 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb2ec01b460 con 0x7fb2f81d1400 2024-09-17T03:15:34.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.090+0000 7fb2f57fa640 1 --2- 172.21.15.78:0/799493377 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb2e4078b90 0x7fb2e407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:34.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.090+0000 7fb2f57fa640 1 -- 172.21.15.78:0/799493377 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 5529+0+0 (secure 0 0 0) 0x7fb2ec09b420 con 0x7fb2f81d1400 2024-09-17T03:15:34.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.090+0000 7fb2fcd0e640 1 --2- 172.21.15.78:0/799493377 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb2e4078b90 0x7fb2e407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:34.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.091+0000 7fb2fcd0e640 1 --2- 172.21.15.78:0/799493377 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb2e4078b90 0x7fb2e407b0a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8000fd0 tx=0x7fb2e8006720 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:34.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.094+0000 7fb2f57fa640 1 -- 172.21.15.78:0/799493377 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb2ec0639b0 con 0x7fb2f81d1400 2024-09-17T03:15:34.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.268+0000 7fb2fef72640 1 -- 172.21.15.78:0/799493377 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb2f8068da0 con 0x7fb2f81d1400 2024-09-17T03:15:34.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.958+0000 7fb2f57fa640 1 -- 172.21.15.78:0/799493377 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v98) ==== 169+0+0 (secure 0 0 0) 0x7fb2ec099e20 con 0x7fb2f81d1400 2024-09-17T03:15:34.957 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2024-09-17T03:15:34.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.961+0000 7fb2fef72640 1 -- 172.21.15.78:0/799493377 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb2e4078b90 msgr2=0x7fb2e407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:34.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.961+0000 7fb2fef72640 1 --2- 172.21.15.78:0/799493377 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb2e4078b90 0x7fb2e407b0a0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8000fd0 tx=0x7fb2e8006720 comp rx=0 tx=0).stop 2024-09-17T03:15:34.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.961+0000 7fb2fef72640 1 -- 172.21.15.78:0/799493377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2f81d1400 msgr2=0x7fb2f81e1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:34.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.961+0000 7fb2fef72640 1 --2- 172.21.15.78:0/799493377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2f81d1400 0x7fb2f81e1c30 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec004d60 tx=0x7fb2ec001630 comp rx=0 tx=0).stop 2024-09-17T03:15:34.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.962+0000 7fb2fef72640 1 -- 172.21.15.78:0/799493377 shutdown_connections 2024-09-17T03:15:34.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.962+0000 7fb2fef72640 1 --2- 172.21.15.78:0/799493377 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb2f81d1810 0x7fb2f81e2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:34.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.962+0000 7fb2fef72640 1 --2- 172.21.15.78:0/799493377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb2f81d1400 0x7fb2f81e1c30 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:34.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.962+0000 7fb2fef72640 1 --2- 172.21.15.78:0/799493377 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb2e4078b90 0x7fb2e407b0a0 secure :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8000fd0 tx=0x7fb2e8006720 comp rx=0 tx=0).stop 2024-09-17T03:15:34.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.962+0000 7fb2fef72640 1 --2- 172.21.15.78:0/799493377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2e0005350 0x7fb2f81f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:34.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.962+0000 7fb2fef72640 1 -- 172.21.15.78:0/799493377 >> 172.21.15.78:0/799493377 conn(0x7fb2f806e520 msgr2=0x7fb2f81e34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:34.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.962+0000 7fb2fef72640 1 -- 172.21.15.78:0/799493377 shutdown_connections 2024-09-17T03:15:34.962 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:34.962+0000 7fb2fef72640 1 -- 172.21.15.78:0/799493377 wait complete. 2024-09-17T03:15:34.975 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 31 2024-09-17T03:15:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.091+0000 7fc670a64640 1 -- 172.21.15.78:0/2096202986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc66c0b4090 msgr2=0x7fc66c0b44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.091+0000 7fc670a64640 1 --2- 172.21.15.78:0/2096202986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc66c0b4090 0x7fc66c0b44a0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fc654005fd0 tx=0x7fc65402a540 comp rx=0 tx=0).stop 2024-09-17T03:15:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.092+0000 7fc670a64640 1 -- 172.21.15.78:0/2096202986 shutdown_connections 2024-09-17T03:15:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.092+0000 7fc670a64640 1 --2- 172.21.15.78:0/2096202986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc66c0b4090 0x7fc66c0b44a0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.092+0000 7fc670a64640 1 -- 172.21.15.78:0/2096202986 >> 172.21.15.78:0/2096202986 conn(0x7fc66c0cdcc0 msgr2=0x7fc66c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.092+0000 7fc670a64640 1 -- 172.21.15.78:0/2096202986 shutdown_connections 2024-09-17T03:15:35.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.092+0000 7fc670a64640 1 -- 172.21.15.78:0/2096202986 wait complete. 2024-09-17T03:15:35.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.094+0000 7fc670a64640 1 Processor -- start 2024-09-17T03:15:35.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.094+0000 7fc670a64640 1 -- start start 2024-09-17T03:15:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.095+0000 7fc670a64640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc66c070af0 0x7fc66c14f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.095+0000 7fc670a64640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc66c0b4090 0x7fc66c1530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.095+0000 7fc670a64640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc66c09df00 0x7fc66c09e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.095+0000 7fc670a64640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c071ae0 con 0x7fc66c09df00 2024-09-17T03:15:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.095+0000 7fc670a64640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc66c071960 con 0x7fc66c070af0 2024-09-17T03:15:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.095+0000 7fc670a64640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc66c167dc0 con 0x7fc66c0b4090 2024-09-17T03:15:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.095+0000 7fc66ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc66c09df00 0x7fc66c09e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.095+0000 7fc66ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc66c09df00 0x7fc66c09e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58350/0 (socket says 172.21.15.78:58350) 2024-09-17T03:15:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.095+0000 7fc66ad9d640 1 -- 172.21.15.78:0/2911783303 learned_addr learned my addr 172.21.15.78:0/2911783303 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:35.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.095+0000 7fc66a59c640 1 --2- 172.21.15.78:0/2911783303 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc66c070af0 0x7fc66c14f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:35.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.095+0000 7fc661d9b640 1 --2- 172.21.15.78:0/2911783303 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc66c0b4090 0x7fc66c1530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:35.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.095+0000 7fc66ad9d640 1 -- 172.21.15.78:0/2911783303 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc66c0b4090 msgr2=0x7fc66c1530d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:35.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.095+0000 7fc66ad9d640 1 --2- 172.21.15.78:0/2911783303 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc66c0b4090 0x7fc66c1530d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.095+0000 7fc66ad9d640 1 -- 172.21.15.78:0/2911783303 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc66c070af0 msgr2=0x7fc66c14f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:35.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.095+0000 7fc66ad9d640 1 --2- 172.21.15.78:0/2911783303 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc66c070af0 0x7fc66c14f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.095+0000 7fc66ad9d640 1 -- 172.21.15.78:0/2911783303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66c09e850 con 0x7fc66c09df00 2024-09-17T03:15:35.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.096+0000 7fc66ad9d640 1 --2- 172.21.15.78:0/2911783303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc66c09df00 0x7fc66c09e310 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fc66400ba10 tx=0x7fc66400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:35.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.096+0000 7fc6637fe640 1 -- 172.21.15.78:0/2911783303 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc664019070 con 0x7fc66c09df00 2024-09-17T03:15:35.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.096+0000 7fc6637fe640 1 -- 172.21.15.78:0/2911783303 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc66400cc90 con 0x7fc66c09df00 2024-09-17T03:15:35.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.096+0000 7fc670a64640 1 -- 172.21.15.78:0/2911783303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc66c150210 con 0x7fc66c09df00 2024-09-17T03:15:35.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.096+0000 7fc6637fe640 1 -- 172.21.15.78:0/2911783303 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6640146a0 con 0x7fc66c09df00 2024-09-17T03:15:35.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.096+0000 7fc670a64640 1 -- 172.21.15.78:0/2911783303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc66c150a00 con 0x7fc66c09df00 2024-09-17T03:15:35.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.097+0000 7fc670a64640 1 -- 172.21.15.78:0/2911783303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc66c0725d0 con 0x7fc66c09df00 2024-09-17T03:15:35.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.098+0000 7fc6637fe640 1 -- 172.21.15.78:0/2911783303 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc66401c070 con 0x7fc66c09df00 2024-09-17T03:15:35.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.098+0000 7fc6637fe640 1 --2- 172.21.15.78:0/2911783303 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc64c078b90 0x7fc64c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:35.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.098+0000 7fc6637fe640 1 -- 172.21.15.78:0/2911783303 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7fc66409a8c0 con 0x7fc66c09df00 2024-09-17T03:15:35.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.098+0000 7fc66a59c640 1 --2- 172.21.15.78:0/2911783303 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc64c078b90 0x7fc64c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:35.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.099+0000 7fc66a59c640 1 --2- 172.21.15.78:0/2911783303 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc64c078b90 0x7fc64c07b0a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc65c001720 tx=0x7fc65c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:35.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.102+0000 7fc6637fe640 1 -- 172.21.15.78:0/2911783303 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc66c0725d0 con 0x7fc66c09df00 2024-09-17T03:15:35.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.276+0000 7fc670a64640 1 -- 172.21.15.78:0/2911783303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "config reset", "num": 31} v 0) -- 0x7fc66c0cd120 con 0x7fc66c09df00 2024-09-17T03:15:35.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.280+0000 7fc6637fe640 1 -- 172.21.15.78:0/2911783303 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 31}]=0 v43) ==== 71+0+0 (secure 0 0 0) 0x7fc66c09e850 con 0x7fc66c09df00 2024-09-17T03:15:35.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.282+0000 7fc670a64640 1 -- 172.21.15.78:0/2911783303 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc64c078b90 msgr2=0x7fc64c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:35.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.282+0000 7fc670a64640 1 --2- 172.21.15.78:0/2911783303 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc64c078b90 0x7fc64c07b0a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc65c001720 tx=0x7fc65c009040 comp rx=0 tx=0).stop 2024-09-17T03:15:35.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.282+0000 7fc670a64640 1 -- 172.21.15.78:0/2911783303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc66c09df00 msgr2=0x7fc66c09e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:35.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.282+0000 7fc670a64640 1 --2- 172.21.15.78:0/2911783303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc66c09df00 0x7fc66c09e310 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fc66400ba10 tx=0x7fc66400bed0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.283+0000 7fc670a64640 1 -- 172.21.15.78:0/2911783303 shutdown_connections 2024-09-17T03:15:35.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.283+0000 7fc670a64640 1 --2- 172.21.15.78:0/2911783303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc66c09df00 0x7fc66c09e310 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.283+0000 7fc670a64640 1 --2- 172.21.15.78:0/2911783303 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc66c0b4090 0x7fc66c1530d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.283+0000 7fc670a64640 1 --2- 172.21.15.78:0/2911783303 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc64c078b90 0x7fc64c07b0a0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.283+0000 7fc670a64640 1 --2- 172.21.15.78:0/2911783303 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc66c070af0 0x7fc66c14f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.283+0000 7fc670a64640 1 -- 172.21.15.78:0/2911783303 >> 172.21.15.78:0/2911783303 conn(0x7fc66c0cdcc0 msgr2=0x7fc66c0b51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.283+0000 7fc670a64640 1 -- 172.21.15.78:0/2911783303 shutdown_connections 2024-09-17T03:15:35.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.283+0000 7fc670a64640 1 -- 172.21.15.78:0/2911783303 wait complete. 2024-09-17T03:15:35.293 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0' 2024-09-17T03:15:35.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.407+0000 7efd657c3640 1 -- 172.21.15.78:0/2264763939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd600b3540 msgr2=0x7efd600d3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:35.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.407+0000 7efd657c3640 1 --2- 172.21.15.78:0/2264763939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd600b3540 0x7efd600d3330 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7efd48009830 tx=0x7efd4802a480 comp rx=0 tx=0).stop 2024-09-17T03:15:35.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.407+0000 7efd657c3640 1 -- 172.21.15.78:0/2264763939 shutdown_connections 2024-09-17T03:15:35.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.407+0000 7efd657c3640 1 --2- 172.21.15.78:0/2264763939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd600b3540 0x7efd600d3330 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.407+0000 7efd657c3640 1 -- 172.21.15.78:0/2264763939 >> 172.21.15.78:0/2264763939 conn(0x7efd6008bfc0 msgr2=0x7efd6009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:35.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.407+0000 7efd657c3640 1 -- 172.21.15.78:0/2264763939 shutdown_connections 2024-09-17T03:15:35.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.407+0000 7efd657c3640 1 -- 172.21.15.78:0/2264763939 wait complete. 2024-09-17T03:15:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.408+0000 7efd657c3640 1 Processor -- start 2024-09-17T03:15:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.409+0000 7efd657c3640 1 -- start start 2024-09-17T03:15:35.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.410+0000 7efd657c3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efd600b3540 0x7efd60156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:35.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.410+0000 7efd657c3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd600d3870 0x7efd600cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:35.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.410+0000 7efd657c3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd600b4fa0 0x7efd600b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:35.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.410+0000 7efd657c3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7efd600d1070 con 0x7efd600d3870 2024-09-17T03:15:35.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.410+0000 7efd657c3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efd600d0ef0 con 0x7efd600b4fa0 2024-09-17T03:15:35.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.410+0000 7efd657c3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7efd600d11f0 con 0x7efd600b3540 2024-09-17T03:15:35.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.410+0000 7efd567fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd600d3870 0x7efd600cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.410+0000 7efd567fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd600d3870 0x7efd600cbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58376/0 (socket says 172.21.15.78:58376) 2024-09-17T03:15:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.410+0000 7efd567fc640 1 -- 172.21.15.78:0/2094073820 learned_addr learned my addr 172.21.15.78:0/2094073820 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.410+0000 7efd5effd640 1 --2- 172.21.15.78:0/2094073820 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efd600b3540 0x7efd60156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.410+0000 7efd5f7fe640 1 --2- 172.21.15.78:0/2094073820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd600b4fa0 0x7efd600b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.410+0000 7efd567fc640 1 -- 172.21.15.78:0/2094073820 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efd600b3540 msgr2=0x7efd60156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.410+0000 7efd567fc640 1 --2- 172.21.15.78:0/2094073820 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efd600b3540 0x7efd60156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.410+0000 7efd567fc640 1 -- 172.21.15.78:0/2094073820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd600b4fa0 msgr2=0x7efd600b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.410+0000 7efd567fc640 1 --2- 172.21.15.78:0/2094073820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd600b4fa0 0x7efd600b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.410+0000 7efd567fc640 1 -- 172.21.15.78:0/2094073820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd600b58f0 con 0x7efd600d3870 2024-09-17T03:15:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.411+0000 7efd567fc640 1 --2- 172.21.15.78:0/2094073820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd600d3870 0x7efd600cbd40 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7efd48009950 tx=0x7efd48033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.411+0000 7efd57fff640 1 -- 172.21.15.78:0/2094073820 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd48031d60 con 0x7efd600d3870 2024-09-17T03:15:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.411+0000 7efd657c3640 1 -- 172.21.15.78:0/2094073820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd600cde00 con 0x7efd600d3870 2024-09-17T03:15:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.411+0000 7efd57fff640 1 -- 172.21.15.78:0/2094073820 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd48033e10 con 0x7efd600d3870 2024-09-17T03:15:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.411+0000 7efd57fff640 1 -- 172.21.15.78:0/2094073820 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd48005260 con 0x7efd600d3870 2024-09-17T03:15:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.411+0000 7efd657c3640 1 -- 172.21.15.78:0/2094073820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd600ce3c0 con 0x7efd600d3870 2024-09-17T03:15:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.412+0000 7efd657c3640 1 -- 172.21.15.78:0/2094073820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd600cc6c0 con 0x7efd600d3870 2024-09-17T03:15:35.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.412+0000 7efd57fff640 1 -- 172.21.15.78:0/2094073820 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efd48005400 con 0x7efd600d3870 2024-09-17T03:15:35.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.413+0000 7efd57fff640 1 --2- 172.21.15.78:0/2094073820 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efd40078bc0 0x7efd4007b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:35.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.413+0000 7efd57fff640 1 -- 172.21.15.78:0/2094073820 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7efd480bbd90 con 0x7efd600d3870 2024-09-17T03:15:35.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.413+0000 7efd5effd640 1 --2- 172.21.15.78:0/2094073820 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efd40078bc0 0x7efd4007b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:35.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.414+0000 7efd5effd640 1 --2- 172.21.15.78:0/2094073820 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efd40078bc0 0x7efd4007b0d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7efd50006fd0 tx=0x7efd50008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:35.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.417+0000 7efd57fff640 1 -- 172.21.15.78:0/2094073820 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7efd600b58f0 con 0x7efd600d3870 2024-09-17T03:15:35.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.656+0000 7efd657c3640 1 -- 172.21.15.78:0/2094073820 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0"]} v 0) -- 0x7efd600d0aa0 con 0x7efd600d3870 2024-09-17T03:15:35.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.968+0000 7efd57fff640 1 -- 172.21.15.78:0/2094073820 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multimds_misc.TestScrub2.test_scrub_pause_and_resume_with_abort_mds0"]}]=0 v367) ==== 165+0+0 (secure 0 0 0) 0x7efd600d0aa0 con 0x7efd600d3870 2024-09-17T03:15:35.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.970+0000 7efd657c3640 1 -- 172.21.15.78:0/2094073820 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efd40078bc0 msgr2=0x7efd4007b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.970+0000 7efd657c3640 1 --2- 172.21.15.78:0/2094073820 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efd40078bc0 0x7efd4007b0d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7efd50006fd0 tx=0x7efd50008040 comp rx=0 tx=0).stop 2024-09-17T03:15:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.970+0000 7efd657c3640 1 -- 172.21.15.78:0/2094073820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd600d3870 msgr2=0x7efd600cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.970+0000 7efd657c3640 1 --2- 172.21.15.78:0/2094073820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd600d3870 0x7efd600cbd40 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7efd48009950 tx=0x7efd48033c20 comp rx=0 tx=0).stop 2024-09-17T03:15:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.971+0000 7efd657c3640 1 -- 172.21.15.78:0/2094073820 shutdown_connections 2024-09-17T03:15:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.971+0000 7efd657c3640 1 --2- 172.21.15.78:0/2094073820 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7efd40078bc0 0x7efd4007b0d0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.971+0000 7efd657c3640 1 --2- 172.21.15.78:0/2094073820 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd600b4fa0 0x7efd600b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.971+0000 7efd657c3640 1 --2- 172.21.15.78:0/2094073820 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efd600d3870 0x7efd600cbd40 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.971+0000 7efd657c3640 1 --2- 172.21.15.78:0/2094073820 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efd600b3540 0x7efd60156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.971+0000 7efd657c3640 1 -- 172.21.15.78:0/2094073820 >> 172.21.15.78:0/2094073820 conn(0x7efd6008bfc0 msgr2=0x7efd600b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.971+0000 7efd657c3640 1 -- 172.21.15.78:0/2094073820 shutdown_connections 2024-09-17T03:15:35.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:35.971+0000 7efd657c3640 1 -- 172.21.15.78:0/2094073820 wait complete. 2024-09-17T03:15:35.981 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort_mds0 (tasks.cephfs.test_multimds_misc.TestScrub2) ... ok 2024-09-17T03:15:35.981 INFO:tasks.cephfs_test_runner: 2024-09-17T03:15:35.982 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-17T03:15:35.982 INFO:tasks.cephfs_test_runner:Ran 6 tests in 404.791s 2024-09-17T03:15:35.982 INFO:tasks.cephfs_test_runner: 2024-09-17T03:15:35.982 INFO:tasks.cephfs_test_runner:OK 2024-09-17T03:15:35.982 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-17T03:15:35.991 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-17T03:15:36.001 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-17T03:15:36.002 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:15:36.002 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:36.019 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056010,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1013 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:15:36.019 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-17T03:15:36.019 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:36.075 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056010,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1013 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248716k,nr_inodes=812179,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497436k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T03:15:36.075 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:15:36.075 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:36.095 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:15:36.095 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-09-17T03:15:36.095 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T03:15:36.155 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056029,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20674 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248732k,nr_inodes=812183,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497468k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T03:15:36.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:36.156 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-17T03:15:36.172 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T03:15:36.172 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T03:15:36.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:36.173 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T03:15:36.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:36.239 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T03:15:36.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:36.305 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2024-09-17T03:15:36.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:36.390 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2024-09-17T03:15:36.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:36.406 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2024-09-17T03:15:36.474 INFO:teuthology.orchestra.run.smithi078.stderr:Cannot find device "ceph-brx" 2024-09-17T03:15:36.475 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:15:36.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:36.475 DEBUG:teuthology.orchestra.run.smithi193:> ip netns list 2024-09-17T03:15:36.495 INFO:teuthology.orchestra.run.smithi193.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T03:15:36.495 INFO:teuthology.orchestra.run.smithi193.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T03:15:36.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:36.495 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T03:15:36.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:36.565 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T03:15:36.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:36.636 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link delete ceph-brx 2024-09-17T03:15:36.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:36.733 DEBUG:teuthology.orchestra.run.smithi193:> ip netns list 2024-09-17T03:15:36.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T03:15:36.749 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link delete ceph-brx 2024-09-17T03:15:36.818 INFO:teuthology.orchestra.run.smithi193.stderr:Cannot find device "ceph-brx" 2024-09-17T03:15:36.819 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:15:36.820 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T03:15:36.829 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T03:15:36.830 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:15:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.946+0000 7f7506807640 1 -- 172.21.15.78:0/511406252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e8004db0 msgr2=0x7f74e8005280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.946+0000 7f7506807640 1 --2- 172.21.15.78:0/511406252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74e8004db0 0x7f74e8005280 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f7500070de0 tx=0x7f74e8005830 comp rx=0 tx=0).stop 2024-09-17T03:15:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.946+0000 7f7504da4640 1 -- 172.21.15.78:0/511406252 reap_dead start 2024-09-17T03:15:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.946+0000 7f7506807640 1 -- 172.21.15.78:0/511406252 shutdown_connections 2024-09-17T03:15:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.946+0000 7f7506807640 1 -- 172.21.15.78:0/511406252 >> 172.21.15.78:0/511406252 conn(0x7f75000b1cb0 msgr2=0x7f75000b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.946+0000 7f7506807640 1 -- 172.21.15.78:0/511406252 shutdown_connections 2024-09-17T03:15:36.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.946+0000 7f7506807640 1 -- 172.21.15.78:0/511406252 wait complete. 2024-09-17T03:15:36.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.948+0000 7f7506807640 1 Processor -- start 2024-09-17T03:15:36.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.948+0000 7f7506807640 1 -- start start 2024-09-17T03:15:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.949+0000 7f7506807640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75001f5d40 0x7f750009d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.949+0000 7f7506807640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75000b46b0 0x7f75000b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.949+0000 7f7506807640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f750015cf50 0x7f750015d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.949+0000 7f7506807640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7500073cc0 con 0x7f750015cf50 2024-09-17T03:15:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.949+0000 7f7506807640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f75000cbd90 con 0x7f75000b46b0 2024-09-17T03:15:36.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.949+0000 7f7506807640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7500073e40 con 0x7f75001f5d40 2024-09-17T03:15:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.949+0000 7f7504da4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f750015cf50 0x7f750015d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.949+0000 7f7504da4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f750015cf50 0x7f750015d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60776/0 (socket says 172.21.15.78:60776) 2024-09-17T03:15:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.949+0000 7f7504da4640 1 -- 172.21.15.78:0/2178764880 learned_addr learned my addr 172.21.15.78:0/2178764880 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.949+0000 7f74ff7fe640 1 --2- 172.21.15.78:0/2178764880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75000b46b0 0x7f75000b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.949+0000 7f74fffff640 1 --2- 172.21.15.78:0/2178764880 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75001f5d40 0x7f750009d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.949+0000 7f7504da4640 1 -- 172.21.15.78:0/2178764880 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75001f5d40 msgr2=0x7f750009d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.949+0000 7f7504da4640 1 --2- 172.21.15.78:0/2178764880 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75001f5d40 0x7f750009d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.949+0000 7f7504da4640 1 -- 172.21.15.78:0/2178764880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75000b46b0 msgr2=0x7f75000b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.949+0000 7f7504da4640 1 --2- 172.21.15.78:0/2178764880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75000b46b0 0x7f75000b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.949+0000 7f7504da4640 1 -- 172.21.15.78:0/2178764880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f750009d840 con 0x7f750015cf50 2024-09-17T03:15:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.949+0000 7f74ff7fe640 1 --2- 172.21.15.78:0/2178764880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75000b46b0 0x7f75000b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.949+0000 7f74fffff640 1 --2- 172.21.15.78:0/2178764880 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75001f5d40 0x7f750009d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.950+0000 7f7504da4640 1 --2- 172.21.15.78:0/2178764880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f750015cf50 0x7f750015d360 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f74f8009f90 tx=0x7f74f8033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:36.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.950+0000 7f74fcff9640 1 -- 172.21.15.78:0/2178764880 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f8043070 con 0x7f750015cf50 2024-09-17T03:15:36.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.950+0000 7f74fcff9640 1 -- 172.21.15.78:0/2178764880 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f74f8033c90 con 0x7f750015cf50 2024-09-17T03:15:36.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.950+0000 7f7506807640 1 -- 172.21.15.78:0/2178764880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75001f1fe0 con 0x7f750015cf50 2024-09-17T03:15:36.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.950+0000 7f74fcff9640 1 -- 172.21.15.78:0/2178764880 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f8038040 con 0x7f750015cf50 2024-09-17T03:15:36.951 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.950+0000 7f7506807640 1 -- 172.21.15.78:0/2178764880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75001f25a0 con 0x7f750015cf50 2024-09-17T03:15:36.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.951+0000 7f7506807640 1 -- 172.21.15.78:0/2178764880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75001f1df0 con 0x7f750015cf50 2024-09-17T03:15:36.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.952+0000 7f74fcff9640 1 -- 172.21.15.78:0/2178764880 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f74f8003bd0 con 0x7f750015cf50 2024-09-17T03:15:36.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.952+0000 7f74fcff9640 1 --2- 172.21.15.78:0/2178764880 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74ec078b90 0x7f74ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:36.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.952+0000 7f74fcff9640 1 -- 172.21.15.78:0/2178764880 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7f74f80ba9a0 con 0x7f750015cf50 2024-09-17T03:15:36.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.952+0000 7f74fffff640 1 --2- 172.21.15.78:0/2178764880 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74ec078b90 0x7f74ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:36.952 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.953+0000 7f74fffff640 1 --2- 172.21.15.78:0/2178764880 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74ec078b90 0x7f74ec07b0a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f75000750c0 tx=0x7f74f0006b10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:36.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:36.957+0000 7f74fcff9640 1 -- 172.21.15.78:0/2178764880 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f74f8082a70 con 0x7f750015cf50 2024-09-17T03:15:37.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.128+0000 7f7506807640 1 -- 172.21.15.78:0/2178764880 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f75000743a0 con 0x7f74ec078b90 2024-09-17T03:15:37.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.129+0000 7f74fcff9640 1 -- 172.21.15.78:0/2178764880 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13387 (secure 0 0 0) 0x7f75000743a0 con 0x7f74ec078b90 2024-09-17T03:15:37.128 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:37.128 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:15:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.131+0000 7f7506807640 1 -- 172.21.15.78:0/2178764880 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74ec078b90 msgr2=0x7f74ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.131+0000 7f7506807640 1 --2- 172.21.15.78:0/2178764880 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74ec078b90 0x7f74ec07b0a0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f75000750c0 tx=0x7f74f0006b10 comp rx=0 tx=0).stop 2024-09-17T03:15:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.131+0000 7f7506807640 1 -- 172.21.15.78:0/2178764880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f750015cf50 msgr2=0x7f750015d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.131+0000 7f7506807640 1 --2- 172.21.15.78:0/2178764880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f750015cf50 0x7f750015d360 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f74f8009f90 tx=0x7f74f8033ba0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.131+0000 7f7506807640 1 -- 172.21.15.78:0/2178764880 shutdown_connections 2024-09-17T03:15:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.131+0000 7f7506807640 1 --2- 172.21.15.78:0/2178764880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f750015cf50 0x7f750015d360 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.131+0000 7f7506807640 1 --2- 172.21.15.78:0/2178764880 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f74ec078b90 0x7f74ec07b0a0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.131+0000 7f7506807640 1 --2- 172.21.15.78:0/2178764880 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f75000b46b0 0x7f75000b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.131+0000 7f7506807640 1 --2- 172.21.15.78:0/2178764880 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f75001f5d40 0x7f750009d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.131+0000 7f7506807640 1 -- 172.21.15.78:0/2178764880 >> 172.21.15.78:0/2178764880 conn(0x7f75000b1cb0 msgr2=0x7f75000735b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.131+0000 7f7506807640 1 -- 172.21.15.78:0/2178764880 shutdown_connections 2024-09-17T03:15:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.131+0000 7f7506807640 1 -- 172.21.15.78:0/2178764880 wait complete. 2024-09-17T03:15:37.141 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2024-09-17T03:15:35.237905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":255984,"kb_used_data":10668,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754718736,"statfs":{"total":773094113280,"available":772831985664,"internally_reserved":0,"allocated":10924032,"data_stored":5453299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-121666,"num_objects":-68,"num_object_clones":0,"num_object_copies":-136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-68,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-242,"num_write_kb":-199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001807"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":241,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-17T03:14:41.355331+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:14:41.355331+0000","last_peered":"2024-09-17T03:14:41.355331+0000","last_clean":"2024-09-17T03:14:41.355331+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:14:41.355331+0000","last_undegraded":"2024-09-17T03:14:41.355331+0000","last_fullsized":"2024-09-17T03:14:41.355331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509531,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1781760,"data_stored":1093915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509531,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1220608,"data_stored":541323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509530,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28176,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343664,"statfs":{"total":96636764160,"available":96607911936,"internally_reserved":0,"allocated":1179648,"data_stored":502991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509531,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32448,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339392,"statfs":{"total":96636764160,"available":96603537408,"internally_reserved":0,"allocated":1294336,"data_stored":600931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509532,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1171456,"data_stored":502775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509531,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1212416,"data_stored":525858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509531,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32920,"kb_used_data":1736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338920,"statfs":{"total":96636764160,"available":96603054080,"internally_reserved":0,"allocated":1777664,"data_stored":1094329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1286144,"data_stored":591177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:15:37.142 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:15:37.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.255+0000 7f45eede6640 1 -- 172.21.15.78:0/1779495073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e80b51c0 msgr2=0x7f45e815c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:37.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.255+0000 7f45eede6640 1 --2- 172.21.15.78:0/1779495073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e80b51c0 0x7f45e815c6e0 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f45e80cd8d0 tx=0x7f45e402a530 comp rx=0 tx=0).stop 2024-09-17T03:15:37.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.255+0000 7f45eede6640 1 -- 172.21.15.78:0/1779495073 shutdown_connections 2024-09-17T03:15:37.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.255+0000 7f45eede6640 1 --2- 172.21.15.78:0/1779495073 >> v2:172.21.15.193:3300/0 conn(0x7f45e80d1490 0x7f45e80cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.255+0000 7f45eede6640 1 --2- 172.21.15.78:0/1779495073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e80b51c0 0x7f45e815c6e0 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.255+0000 7f45eede6640 1 -- 172.21.15.78:0/1779495073 >> 172.21.15.78:0/1779495073 conn(0x7f45e8072ae0 msgr2=0x7f45e8072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:37.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.255+0000 7f45eede6640 1 -- 172.21.15.78:0/1779495073 shutdown_connections 2024-09-17T03:15:37.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.255+0000 7f45eede6640 1 -- 172.21.15.78:0/1779495073 wait complete. 2024-09-17T03:15:37.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.257+0000 7f45eede6640 1 Processor -- start 2024-09-17T03:15:37.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.257+0000 7f45eede6640 1 -- start start 2024-09-17T03:15:37.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45eede6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45e80b51c0 0x7f45e814d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:37.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45eede6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e80ccbd0 0x7f45e814eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:37.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45eede6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f45e80d1490 0x7f45e814f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:37.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45eede6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f45e80cf2b0 con 0x7f45e80ccbd0 2024-09-17T03:15:37.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45eede6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f45e80cf130 con 0x7f45e80b51c0 2024-09-17T03:15:37.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45eede6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f45e80cf430 con 0x7f45e80d1490 2024-09-17T03:15:37.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45dffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e80ccbd0 0x7f45e814eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:37.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45dffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e80ccbd0 0x7f45e814eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60796/0 (socket says 172.21.15.78:60796) 2024-09-17T03:15:37.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45dffff640 1 -- 172.21.15.78:0/3006830722 learned_addr learned my addr 172.21.15.78:0/3006830722 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:37.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45ecb82640 1 --2- 172.21.15.78:0/3006830722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45e80b51c0 0x7f45e814d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:37.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45ed383640 1 --2- 172.21.15.78:0/3006830722 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f45e80d1490 0x7f45e814f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:37.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45dffff640 1 -- 172.21.15.78:0/3006830722 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f45e80d1490 msgr2=0x7f45e814f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:37.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45dffff640 1 --2- 172.21.15.78:0/3006830722 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f45e80d1490 0x7f45e814f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45dffff640 1 -- 172.21.15.78:0/3006830722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45e80b51c0 msgr2=0x7f45e814d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:37.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45dffff640 1 --2- 172.21.15.78:0/3006830722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45e80b51c0 0x7f45e814d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45dffff640 1 -- 172.21.15.78:0/3006830722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e806f630 con 0x7f45e80ccbd0 2024-09-17T03:15:37.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45dffff640 1 --2- 172.21.15.78:0/3006830722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e80ccbd0 0x7f45e814eaf0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f45d800c390 tx=0x7f45d800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:37.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45dd7fa640 1 -- 172.21.15.78:0/3006830722 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d8017070 con 0x7f45e80ccbd0 2024-09-17T03:15:37.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45dd7fa640 1 -- 172.21.15.78:0/3006830722 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45d80035f0 con 0x7f45e80ccbd0 2024-09-17T03:15:37.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45eede6640 1 -- 172.21.15.78:0/3006830722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45e806f910 con 0x7f45e80ccbd0 2024-09-17T03:15:37.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.259+0000 7f45dd7fa640 1 -- 172.21.15.78:0/3006830722 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d8003a20 con 0x7f45e80ccbd0 2024-09-17T03:15:37.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.260+0000 7f45eede6640 1 -- 172.21.15.78:0/3006830722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45e814e2f0 con 0x7f45e80ccbd0 2024-09-17T03:15:37.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.261+0000 7f45eede6640 1 -- 172.21.15.78:0/3006830722 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45e80cf900 con 0x7f45e80ccbd0 2024-09-17T03:15:37.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.261+0000 7f45dd7fa640 1 -- 172.21.15.78:0/3006830722 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f45d801a070 con 0x7f45e80ccbd0 2024-09-17T03:15:37.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.262+0000 7f45dd7fa640 1 --2- 172.21.15.78:0/3006830722 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f45d4078b90 0x7f45d407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:37.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.262+0000 7f45dd7fa640 1 -- 172.21.15.78:0/3006830722 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7f45d8099db0 con 0x7f45e80ccbd0 2024-09-17T03:15:37.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.262+0000 7f45ecb82640 1 --2- 172.21.15.78:0/3006830722 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f45d4078b90 0x7f45d407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:37.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.262+0000 7f45ecb82640 1 --2- 172.21.15.78:0/3006830722 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f45d4078b90 0x7f45d407b0a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f45e4034000 tx=0x7f45e4004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:37.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.266+0000 7f45dd7fa640 1 -- 172.21.15.78:0/3006830722 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f45d8061d70 con 0x7f45e80ccbd0 2024-09-17T03:15:37.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.436+0000 7f45eede6640 1 -- 172.21.15.78:0/3006830722 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f45e806f3c0 con 0x7f45d4078b90 2024-09-17T03:15:37.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.437+0000 7f45dd7fa640 1 -- 172.21.15.78:0/3006830722 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13484 (secure 0 0 0) 0x7f45e806f3c0 con 0x7f45d4078b90 2024-09-17T03:15:37.436 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:37.436 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:15:37.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.439+0000 7f45eede6640 1 -- 172.21.15.78:0/3006830722 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f45d4078b90 msgr2=0x7f45d407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:37.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.439+0000 7f45eede6640 1 --2- 172.21.15.78:0/3006830722 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f45d4078b90 0x7f45d407b0a0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f45e4034000 tx=0x7f45e4004730 comp rx=0 tx=0).stop 2024-09-17T03:15:37.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.439+0000 7f45eede6640 1 -- 172.21.15.78:0/3006830722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e80ccbd0 msgr2=0x7f45e814eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:37.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.439+0000 7f45eede6640 1 --2- 172.21.15.78:0/3006830722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e80ccbd0 0x7f45e814eaf0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f45d800c390 tx=0x7f45d800c850 comp rx=0 tx=0).stop 2024-09-17T03:15:37.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.439+0000 7f45eede6640 1 -- 172.21.15.78:0/3006830722 shutdown_connections 2024-09-17T03:15:37.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.439+0000 7f45eede6640 1 --2- 172.21.15.78:0/3006830722 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f45e80d1490 0x7f45e814f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.439+0000 7f45eede6640 1 --2- 172.21.15.78:0/3006830722 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45e80ccbd0 0x7f45e814eaf0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.439+0000 7f45eede6640 1 --2- 172.21.15.78:0/3006830722 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f45d4078b90 0x7f45d407b0a0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.439+0000 7f45eede6640 1 --2- 172.21.15.78:0/3006830722 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f45e80b51c0 0x7f45e814d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.439+0000 7f45eede6640 1 -- 172.21.15.78:0/3006830722 >> 172.21.15.78:0/3006830722 conn(0x7f45e8072ae0 msgr2=0x7f45e80d1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:37.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.439+0000 7f45eede6640 1 -- 172.21.15.78:0/3006830722 shutdown_connections 2024-09-17T03:15:37.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.439+0000 7f45eede6640 1 -- 172.21.15.78:0/3006830722 wait complete. 2024-09-17T03:15:37.449 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-09-17T03:15:37.238324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":255988,"kb_used_data":10640,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754718732,"statfs":{"total":773094113280,"available":772831981568,"internally_reserved":0,"allocated":10895360,"data_stored":5396511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-122105,"num_objects":-68,"num_object_clones":0,"num_object_copies":-136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-68,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-252,"num_write_kb":-203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001600"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":247,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:15:35.805154+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:15:35.805154+0000","last_peered":"2024-09-17T03:15:35.805154+0000","last_clean":"2024-09-17T03:15:35.805154+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:15:35.805154+0000","last_undegraded":"2024-09-17T03:15:35.805154+0000","last_fullsized":"2024-09-17T03:15:35.805154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509532,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1789952,"data_stored":1105709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32372,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1212416,"data_stored":521078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509531,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28196,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1196032,"data_stored":515341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509532,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32376,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1212416,"data_stored":521078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509533,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32356,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1196032,"data_stored":515341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32356,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1196032,"data_stored":515341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509532,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1806336,"data_stored":1111446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1286144,"data_stored":591177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:15:37.449 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T03:15:37.449 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:15:37.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.562+0000 7f143a9e6640 1 -- 172.21.15.78:0/3593321668 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14340b0520 msgr2=0x7f1434071650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.562+0000 7f143a9e6640 1 --2- 172.21.15.78:0/3593321668 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14340b0520 0x7f1434071650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1428009830 tx=0x7f142802a490 comp rx=0 tx=0).stop 2024-09-17T03:15:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.562+0000 7f143a9e6640 1 -- 172.21.15.78:0/3593321668 shutdown_connections 2024-09-17T03:15:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.562+0000 7f143a9e6640 1 --2- 172.21.15.78:0/3593321668 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14340b0520 0x7f1434071650 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.562+0000 7f143a9e6640 1 --2- 172.21.15.78:0/3593321668 >> v2:172.21.15.193:3300/0 conn(0x7f143415b8f0 0x7f14340cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.562+0000 7f143a9e6640 1 -- 172.21.15.78:0/3593321668 >> 172.21.15.78:0/3593321668 conn(0x7f14340cdcb0 msgr2=0x7f14340ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.562+0000 7f143a9e6640 1 -- 172.21.15.78:0/3593321668 shutdown_connections 2024-09-17T03:15:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.562+0000 7f143a9e6640 1 -- 172.21.15.78:0/3593321668 wait complete. 2024-09-17T03:15:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.564+0000 7f143a9e6640 1 Processor -- start 2024-09-17T03:15:37.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.564+0000 7f143a9e6640 1 -- start start 2024-09-17T03:15:37.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.565+0000 7f143a9e6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14340b0520 0x7f14340caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:37.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.565+0000 7f143a9e6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14340b2cb0 0x7f143414efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:37.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.565+0000 7f143a9e6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f143415b8f0 0x7f143414f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:37.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.565+0000 7f143a9e6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f14340ae330 con 0x7f14340b2cb0 2024-09-17T03:15:37.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.565+0000 7f143a9e6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f14340ae1b0 con 0x7f14340b0520 2024-09-17T03:15:37.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.565+0000 7f143a9e6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f14340ae4b0 con 0x7f143415b8f0 2024-09-17T03:15:37.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.566+0000 7f14337fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14340b2cb0 0x7f143414efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:37.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.566+0000 7f14337fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14340b2cb0 0x7f143414efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60800/0 (socket says 172.21.15.78:60800) 2024-09-17T03:15:37.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.566+0000 7f14337fe640 1 -- 172.21.15.78:0/3457124550 learned_addr learned my addr 172.21.15.78:0/3457124550 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.566+0000 7f1433fff640 1 --2- 172.21.15.78:0/3457124550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14340b0520 0x7f14340caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.566+0000 7f1438f83640 1 --2- 172.21.15.78:0/3457124550 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f143415b8f0 0x7f143414f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.566+0000 7f14337fe640 1 -- 172.21.15.78:0/3457124550 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f143415b8f0 msgr2=0x7f143414f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.566+0000 7f14337fe640 1 --2- 172.21.15.78:0/3457124550 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f143415b8f0 0x7f143414f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.566+0000 7f14337fe640 1 -- 172.21.15.78:0/3457124550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14340b0520 msgr2=0x7f14340caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.566+0000 7f14337fe640 1 --2- 172.21.15.78:0/3457124550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14340b0520 0x7f14340caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.566+0000 7f14337fe640 1 -- 172.21.15.78:0/3457124550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14341f32a0 con 0x7f14340b2cb0 2024-09-17T03:15:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.566+0000 7f1438f83640 1 --2- 172.21.15.78:0/3457124550 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f143415b8f0 0x7f143414f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.566+0000 7f14337fe640 1 --2- 172.21.15.78:0/3457124550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14340b2cb0 0x7f143414efd0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f1428009950 tx=0x7f1428003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.566+0000 7f1430ff9640 1 -- 172.21.15.78:0/3457124550 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1428005c90 con 0x7f14340b2cb0 2024-09-17T03:15:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.566+0000 7f1430ff9640 1 -- 172.21.15.78:0/3457124550 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1428005020 con 0x7f14340b2cb0 2024-09-17T03:15:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.566+0000 7f143a9e6640 1 -- 172.21.15.78:0/3457124550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14341f3580 con 0x7f14340b2cb0 2024-09-17T03:15:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.566+0000 7f1430ff9640 1 -- 172.21.15.78:0/3457124550 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1428005450 con 0x7f14340b2cb0 2024-09-17T03:15:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.566+0000 7f143a9e6640 1 -- 172.21.15.78:0/3457124550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14341f3b40 con 0x7f14340b2cb0 2024-09-17T03:15:37.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.567+0000 7f143a9e6640 1 -- 172.21.15.78:0/3457124550 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1434071650 con 0x7f14340b2cb0 2024-09-17T03:15:37.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.568+0000 7f1430ff9640 1 -- 172.21.15.78:0/3457124550 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f14280317c0 con 0x7f14340b2cb0 2024-09-17T03:15:37.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.568+0000 7f1430ff9640 1 --2- 172.21.15.78:0/3457124550 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1420078b90 0x7f142007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:37.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.569+0000 7f1430ff9640 1 -- 172.21.15.78:0/3457124550 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7f14280bbaf0 con 0x7f14340b2cb0 2024-09-17T03:15:37.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.569+0000 7f1433fff640 1 --2- 172.21.15.78:0/3457124550 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1420078b90 0x7f142007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:37.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.569+0000 7f1433fff640 1 --2- 172.21.15.78:0/3457124550 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1420078b90 0x7f142007b0a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1424009b30 tx=0x7f1424005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:37.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.573+0000 7f1430ff9640 1 -- 172.21.15.78:0/3457124550 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f142803f030 con 0x7f14340b2cb0 2024-09-17T03:15:37.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.743+0000 7f143a9e6640 1 -- 172.21.15.78:0/3457124550 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f14340cb4a0 con 0x7f1420078b90 2024-09-17T03:15:37.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.744+0000 7f1430ff9640 1 -- 172.21.15.78:0/3457124550 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13484 (secure 0 0 0) 0x7f1424011be0 con 0x7f1420078b90 2024-09-17T03:15:37.743 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:37.743 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:15:37.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.746+0000 7f143a9e6640 1 -- 172.21.15.78:0/3457124550 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1420078b90 msgr2=0x7f142007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:37.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.746+0000 7f143a9e6640 1 --2- 172.21.15.78:0/3457124550 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1420078b90 0x7f142007b0a0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1424009b30 tx=0x7f1424005f90 comp rx=0 tx=0).stop 2024-09-17T03:15:37.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.746+0000 7f143a9e6640 1 -- 172.21.15.78:0/3457124550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14340b2cb0 msgr2=0x7f143414efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:37.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.746+0000 7f143a9e6640 1 --2- 172.21.15.78:0/3457124550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14340b2cb0 0x7f143414efd0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f1428009950 tx=0x7f1428003c10 comp rx=0 tx=0).stop 2024-09-17T03:15:37.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.746+0000 7f143a9e6640 1 -- 172.21.15.78:0/3457124550 shutdown_connections 2024-09-17T03:15:37.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.746+0000 7f143a9e6640 1 --2- 172.21.15.78:0/3457124550 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f143415b8f0 0x7f143414f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.746+0000 7f143a9e6640 1 --2- 172.21.15.78:0/3457124550 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14340b2cb0 0x7f143414efd0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.746+0000 7f143a9e6640 1 --2- 172.21.15.78:0/3457124550 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f1420078b90 0x7f142007b0a0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.746+0000 7f143a9e6640 1 --2- 172.21.15.78:0/3457124550 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14340b0520 0x7f14340caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.746+0000 7f143a9e6640 1 -- 172.21.15.78:0/3457124550 >> 172.21.15.78:0/3457124550 conn(0x7f14340cdcb0 msgr2=0x7f143406cde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:37.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.746+0000 7f143a9e6640 1 -- 172.21.15.78:0/3457124550 shutdown_connections 2024-09-17T03:15:37.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.746+0000 7f143a9e6640 1 -- 172.21.15.78:0/3457124550 wait complete. 2024-09-17T03:15:37.756 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2024-09-17T03:15:37.238324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":255988,"kb_used_data":10640,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754718732,"statfs":{"total":773094113280,"available":772831981568,"internally_reserved":0,"allocated":10895360,"data_stored":5396511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-122105,"num_objects":-68,"num_object_clones":0,"num_object_copies":-136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-68,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-252,"num_write_kb":-203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001600"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":247,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:15:35.805154+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:15:35.805154+0000","last_peered":"2024-09-17T03:15:35.805154+0000","last_clean":"2024-09-17T03:15:35.805154+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:15:35.805154+0000","last_undegraded":"2024-09-17T03:15:35.805154+0000","last_fullsized":"2024-09-17T03:15:35.805154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509532,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1789952,"data_stored":1105709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32372,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1212416,"data_stored":521078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509531,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28196,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1196032,"data_stored":515341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509532,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32376,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1212416,"data_stored":521078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509533,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32356,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1196032,"data_stored":515341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32356,"kb_used_data":1168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1196032,"data_stored":515341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509532,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1806336,"data_stored":1111446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574939,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1286144,"data_stored":591177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:15:37.756 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T03:15:37.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.870+0000 7fa427c8b640 1 -- 172.21.15.78:0/3584004902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa40c003a50 msgr2=0x7fa40c003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:37.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.870+0000 7fa427c8b640 1 --2- 172.21.15.78:0/3584004902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa40c003a50 0x7fa40c003ec0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fa42006ed10 tx=0x7fa40c005830 comp rx=0 tx=0).stop 2024-09-17T03:15:37.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.870+0000 7fa427c8b640 1 -- 172.21.15.78:0/3584004902 shutdown_connections 2024-09-17T03:15:37.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.870+0000 7fa427c8b640 1 --2- 172.21.15.78:0/3584004902 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa40c003a50 0x7fa40c003ec0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.870+0000 7fa427c8b640 1 -- 172.21.15.78:0/3584004902 >> 172.21.15.78:0/3584004902 conn(0x7fa4200b3f10 msgr2=0x7fa4200b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:37.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.870+0000 7fa427c8b640 1 -- 172.21.15.78:0/3584004902 shutdown_connections 2024-09-17T03:15:37.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.870+0000 7fa427c8b640 1 -- 172.21.15.78:0/3584004902 wait complete. 2024-09-17T03:15:37.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.872+0000 7fa427c8b640 1 Processor -- start 2024-09-17T03:15:37.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.872+0000 7fa427c8b640 1 -- start start 2024-09-17T03:15:37.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.873+0000 7fa427c8b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa40c003a50 0x7fa4200cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:37.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.873+0000 7fa427c8b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa42015c060 0x7fa42014e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:37.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.873+0000 7fa427c8b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa42014e790 0x7fa42014eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:37.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.873+0000 7fa427c8b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa4200d2200 con 0x7fa42015c060 2024-09-17T03:15:37.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.873+0000 7fa427c8b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa4200d0e70 con 0x7fa42014e790 2024-09-17T03:15:37.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.873+0000 7fa427c8b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa4200d2380 con 0x7fa40c003a50 2024-09-17T03:15:37.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.874+0000 7fa425226640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa42015c060 0x7fa42014e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:37.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.874+0000 7fa425226640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa42015c060 0x7fa42014e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60816/0 (socket says 172.21.15.78:60816) 2024-09-17T03:15:37.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.874+0000 7fa425226640 1 -- 172.21.15.78:0/2985450363 learned_addr learned my addr 172.21.15.78:0/2985450363 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:37.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.874+0000 7fa425a27640 1 --2- 172.21.15.78:0/2985450363 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa40c003a50 0x7fa4200cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:37.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.874+0000 7fa426228640 1 --2- 172.21.15.78:0/2985450363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa42014e790 0x7fa42014eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:37.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.874+0000 7fa425226640 1 -- 172.21.15.78:0/2985450363 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa40c003a50 msgr2=0x7fa4200cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:37.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.874+0000 7fa425226640 1 --2- 172.21.15.78:0/2985450363 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa40c003a50 0x7fa4200cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.874+0000 7fa425226640 1 -- 172.21.15.78:0/2985450363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa42014e790 msgr2=0x7fa42014eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:37.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.874+0000 7fa425226640 1 --2- 172.21.15.78:0/2985450363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa42014e790 0x7fa42014eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:37.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.874+0000 7fa425226640 1 -- 172.21.15.78:0/2985450363 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42015d0c0 con 0x7fa42015c060 2024-09-17T03:15:37.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.874+0000 7fa425226640 1 --2- 172.21.15.78:0/2985450363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa42015c060 0x7fa42014e250 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fa410003ec0 tx=0x7fa410001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:37.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.874+0000 7fa4167fc640 1 -- 172.21.15.78:0/2985450363 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa410015070 con 0x7fa42015c060 2024-09-17T03:15:37.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.874+0000 7fa4167fc640 1 -- 172.21.15.78:0/2985450363 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa410011840 con 0x7fa42015c060 2024-09-17T03:15:37.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.874+0000 7fa427c8b640 1 -- 172.21.15.78:0/2985450363 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa42015d3a0 con 0x7fa42015c060 2024-09-17T03:15:37.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.874+0000 7fa4167fc640 1 -- 172.21.15.78:0/2985450363 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa410011c90 con 0x7fa42015c060 2024-09-17T03:15:37.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.874+0000 7fa427c8b640 1 -- 172.21.15.78:0/2985450363 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa42015d960 con 0x7fa42015c060 2024-09-17T03:15:37.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.875+0000 7fa427c8b640 1 -- 172.21.15.78:0/2985450363 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa42015ce30 con 0x7fa42015c060 2024-09-17T03:15:37.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.876+0000 7fa4167fc640 1 -- 172.21.15.78:0/2985450363 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa410018070 con 0x7fa42015c060 2024-09-17T03:15:37.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.877+0000 7fa4167fc640 1 --2- 172.21.15.78:0/2985450363 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa404078b90 0x7fa40407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:37.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.877+0000 7fa4167fc640 1 -- 172.21.15.78:0/2985450363 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7fa41009b6f0 con 0x7fa42015c060 2024-09-17T03:15:37.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.877+0000 7fa425a27640 1 --2- 172.21.15.78:0/2985450363 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa404078b90 0x7fa40407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:37.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.878+0000 7fa425a27640 1 --2- 172.21.15.78:0/2985450363 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa404078b90 0x7fa40407b0a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa41c033000 tx=0x7fa41c001a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:37.880 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:37.881+0000 7fa4167fc640 1 -- 172.21.15.78:0/2985450363 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa410063d80 con 0x7fa42015c060 2024-09-17T03:15:38.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:38.058+0000 7fa427c8b640 1 -- 172.21.15.78:0/2985450363 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4200b8180 con 0x7fa42015c060 2024-09-17T03:15:38.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:38.059+0000 7fa4167fc640 1 -- 172.21.15.78:0/2985450363 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+13271 (secure 0 0 0) 0x7fa4200b8180 con 0x7fa42015c060 2024-09-17T03:15:38.058 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:38.058 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":98,"fsid":"f3c59ba9-dab4-4ee6-8989-d80d11d430b6","created":"2024-09-17T03:08:02.800741+0000","modified":"2024-09-17T03:15:34.957808+0000","last_up_change":"2024-09-17T03:08:15.936121+0000","last_in_change":"2024-09-17T03:08:06.427643+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T03:08:17.135915+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b8880a56-8cc2-46f2-bde8-5c4fe1c5cc39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6817","nonce":3825297687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6819","nonce":3825297687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6823","nonce":3825297687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":3825297687},{"type":"v1","addr":"172.21.15.78:6821","nonce":3825297687}]},"public_addr":"172.21.15.78:6817/3825297687","cluster_addr":"172.21.15.78:6819/3825297687","heartbeat_back_addr":"172.21.15.78:6823/3825297687","heartbeat_front_addr":"172.21.15.78:6821/3825297687","state":["exists","up"]},{"osd":1,"uuid":"30487d14-0be4-4f6b-b4b8-f53e3b786d18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6809","nonce":607587433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6811","nonce":607587433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6815","nonce":607587433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":607587433},{"type":"v1","addr":"172.21.15.78:6813","nonce":607587433}]},"public_addr":"172.21.15.78:6809/607587433","cluster_addr":"172.21.15.78:6811/607587433","heartbeat_back_addr":"172.21.15.78:6815/607587433","heartbeat_front_addr":"172.21.15.78:6813/607587433","state":["exists","up"]},{"osd":2,"uuid":"2abcddf6-5e1a-48be-923c-b86182a547d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6825","nonce":3281582072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6827","nonce":3281582072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6831","nonce":3281582072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3281582072},{"type":"v1","addr":"172.21.15.78:6829","nonce":3281582072}]},"public_addr":"172.21.15.78:6825/3281582072","cluster_addr":"172.21.15.78:6827/3281582072","heartbeat_back_addr":"172.21.15.78:6831/3281582072","heartbeat_front_addr":"172.21.15.78:6829/3281582072","state":["exists","up"]},{"osd":3,"uuid":"916d8afd-7f14-41c2-8154-8c2a6e6b61c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6801","nonce":2433795738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6803","nonce":2433795738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6807","nonce":2433795738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":2433795738},{"type":"v1","addr":"172.21.15.78:6805","nonce":2433795738}]},"public_addr":"172.21.15.78:6801/2433795738","cluster_addr":"172.21.15.78:6803/2433795738","heartbeat_back_addr":"172.21.15.78:6807/2433795738","heartbeat_front_addr":"172.21.15.78:6805/2433795738","state":["exists","up"]},{"osd":4,"uuid":"e27a6f71-733e-4ca0-9bf1-a703ce999504","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6827","nonce":443819515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6829","nonce":443819515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6833","nonce":443819515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":443819515},{"type":"v1","addr":"172.21.15.193:6831","nonce":443819515}]},"public_addr":"172.21.15.193:6827/443819515","cluster_addr":"172.21.15.193:6829/443819515","heartbeat_back_addr":"172.21.15.193:6833/443819515","heartbeat_front_addr":"172.21.15.193:6831/443819515","state":["exists","up"]},{"osd":5,"uuid":"1ffdb951-79f2-4a9f-b7f3-f095f09665ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6811","nonce":399195358}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6813","nonce":399195358}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6816","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6817","nonce":399195358}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":399195358},{"type":"v1","addr":"172.21.15.193:6815","nonce":399195358}]},"public_addr":"172.21.15.193:6811/399195358","cluster_addr":"172.21.15.193:6813/399195358","heartbeat_back_addr":"172.21.15.193:6817/399195358","heartbeat_front_addr":"172.21.15.193:6815/399195358","state":["exists","up"]},{"osd":6,"uuid":"f6bdf7b7-be88-41b3-84c5-8e4d5ec0d200","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6819","nonce":2885678262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6820","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6821","nonce":2885678262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6825","nonce":2885678262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2885678262},{"type":"v1","addr":"172.21.15.193:6823","nonce":2885678262}]},"public_addr":"172.21.15.193:6819/2885678262","cluster_addr":"172.21.15.193:6821/2885678262","heartbeat_back_addr":"172.21.15.193:6825/2885678262","heartbeat_front_addr":"172.21.15.193:6823/2885678262","state":["exists","up"]},{"osd":7,"uuid":"9d94c7cc-b3a1-428c-8ddf-8532c901a7ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":93,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6803","nonce":216613644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6805","nonce":216613644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6809","nonce":216613644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":216613644},{"type":"v1","addr":"172.21.15.193:6807","nonce":216613644}]},"public_addr":"172.21.15.193:6803/216613644","cluster_addr":"172.21.15.193:6805/216613644","heartbeat_back_addr":"172.21.15.193:6809/216613644","heartbeat_front_addr":"172.21.15.193:6807/216613644","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.915745+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.252348+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.946591+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:11.960330+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.037518+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.695284+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:13.206441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T03:08:12.493039+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.193:6837/2983826871":"2024-09-18T03:15:31.942718+0000","172.21.15.193:6835/2983826871":"2024-09-18T03:15:31.942718+0000","172.21.15.78:6835/1623349891":"2024-09-18T03:15:31.942741+0000","172.21.15.78:6833/1623349891":"2024-09-18T03:15:31.942741+0000","172.21.15.78:6834/1810198137":"2024-09-18T03:15:31.942735+0000","172.21.15.78:6832/1810198137":"2024-09-18T03:15:31.942735+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T03:15:38.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:38.061+0000 7fa427c8b640 1 -- 172.21.15.78:0/2985450363 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa404078b90 msgr2=0x7fa40407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:38.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:38.061+0000 7fa427c8b640 1 --2- 172.21.15.78:0/2985450363 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa404078b90 0x7fa40407b0a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa41c033000 tx=0x7fa41c001a10 comp rx=0 tx=0).stop 2024-09-17T03:15:38.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:38.061+0000 7fa427c8b640 1 -- 172.21.15.78:0/2985450363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa42015c060 msgr2=0x7fa42014e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:38.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:38.061+0000 7fa427c8b640 1 --2- 172.21.15.78:0/2985450363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa42015c060 0x7fa42014e250 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fa410003ec0 tx=0x7fa410001630 comp rx=0 tx=0).stop 2024-09-17T03:15:38.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:38.061+0000 7fa427c8b640 1 -- 172.21.15.78:0/2985450363 shutdown_connections 2024-09-17T03:15:38.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:38.061+0000 7fa427c8b640 1 --2- 172.21.15.78:0/2985450363 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa404078b90 0x7fa40407b0a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:38.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:38.061+0000 7fa427c8b640 1 --2- 172.21.15.78:0/2985450363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa42014e790 0x7fa42014eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:38.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:38.061+0000 7fa427c8b640 1 --2- 172.21.15.78:0/2985450363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa42015c060 0x7fa42014e250 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:38.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:38.061+0000 7fa427c8b640 1 --2- 172.21.15.78:0/2985450363 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa40c003a50 0x7fa4200cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:38.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:38.061+0000 7fa427c8b640 1 -- 172.21.15.78:0/2985450363 >> 172.21.15.78:0/2985450363 conn(0x7fa4200b3f10 msgr2=0x7fa4200b7560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:38.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:38.061+0000 7fa427c8b640 1 -- 172.21.15.78:0/2985450363 shutdown_connections 2024-09-17T03:15:38.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:38.061+0000 7fa427c8b640 1 -- 172.21.15.78:0/2985450363 wait complete. 2024-09-17T03:15:39.073 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T03:15:39.073 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:15:39.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.194+0000 7ff20fd7b640 1 -- 172.21.15.78:0/1020774459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff20806f1d0 msgr2=0x7ff20815f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.194+0000 7ff20fd7b640 1 --2- 172.21.15.78:0/1020774459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff20806f1d0 0x7ff20815f090 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7ff2080c3c30 tx=0x7ff1fc02a560 comp rx=0 tx=0).stop 2024-09-17T03:15:39.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.194+0000 7ff20fd7b640 1 -- 172.21.15.78:0/1020774459 shutdown_connections 2024-09-17T03:15:39.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.194+0000 7ff20fd7b640 1 --2- 172.21.15.78:0/1020774459 >> v2:172.21.15.193:3300/0 conn(0x7ff2080743a0 0x7ff2080747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.194+0000 7ff20fd7b640 1 --2- 172.21.15.78:0/1020774459 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff20806f1d0 0x7ff20815f090 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.194+0000 7ff20fd7b640 1 -- 172.21.15.78:0/1020774459 >> 172.21.15.78:0/1020774459 conn(0x7ff2080d0130 msgr2=0x7ff2080d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:39.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.194+0000 7ff20fd7b640 1 -- 172.21.15.78:0/1020774459 shutdown_connections 2024-09-17T03:15:39.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.194+0000 7ff20fd7b640 1 -- 172.21.15.78:0/1020774459 wait complete. 2024-09-17T03:15:39.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.197+0000 7ff20fd7b640 1 Processor -- start 2024-09-17T03:15:39.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.197+0000 7ff20fd7b640 1 -- start start 2024-09-17T03:15:39.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.199+0000 7ff20fd7b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff20806f1d0 0x7ff20814e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.199+0000 7ff20fd7b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2080743a0 0x7ff20806f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.199+0000 7ff20fd7b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff20815b660 0x7ff20815ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.199+0000 7ff20fd7b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ff208074cf0 con 0x7ff2080743a0 2024-09-17T03:15:39.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.199+0000 7ff20fd7b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff20806efc0 con 0x7ff20815b660 2024-09-17T03:15:39.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.199+0000 7ff20fd7b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff208074e70 con 0x7ff20806f1d0 2024-09-17T03:15:39.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.199+0000 7ff20d316640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2080743a0 0x7ff20806f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.199+0000 7ff20d316640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2080743a0 0x7ff20806f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60834/0 (socket says 172.21.15.78:60834) 2024-09-17T03:15:39.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.199+0000 7ff20d316640 1 -- 172.21.15.78:0/1182883467 learned_addr learned my addr 172.21.15.78:0/1182883467 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:39.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.199+0000 7ff20e318640 1 --2- 172.21.15.78:0/1182883467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff20815b660 0x7ff20815ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.199+0000 7ff20db17640 1 --2- 172.21.15.78:0/1182883467 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff20806f1d0 0x7ff20814e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.199+0000 7ff20d316640 1 -- 172.21.15.78:0/1182883467 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff20806f1d0 msgr2=0x7ff20814e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.199+0000 7ff20d316640 1 --2- 172.21.15.78:0/1182883467 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff20806f1d0 0x7ff20814e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.199+0000 7ff20d316640 1 -- 172.21.15.78:0/1182883467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff20815b660 msgr2=0x7ff20815ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.199+0000 7ff20d316640 1 --2- 172.21.15.78:0/1182883467 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff20815b660 0x7ff20815ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.199+0000 7ff20d316640 1 -- 172.21.15.78:0/1182883467 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff20809b5d0 con 0x7ff2080743a0 2024-09-17T03:15:39.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.200+0000 7ff20d316640 1 --2- 172.21.15.78:0/1182883467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2080743a0 0x7ff20806f790 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7ff20400c3c0 tx=0x7ff20400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:39.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.200+0000 7ff1fa7fc640 1 -- 172.21.15.78:0/1182883467 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff204017070 con 0x7ff2080743a0 2024-09-17T03:15:39.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.200+0000 7ff1fa7fc640 1 -- 172.21.15.78:0/1182883467 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2040035f0 con 0x7ff2080743a0 2024-09-17T03:15:39.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.200+0000 7ff20fd7b640 1 -- 172.21.15.78:0/1182883467 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff20809b8b0 con 0x7ff2080743a0 2024-09-17T03:15:39.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.200+0000 7ff1fa7fc640 1 -- 172.21.15.78:0/1182883467 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff204003a80 con 0x7ff2080743a0 2024-09-17T03:15:39.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.200+0000 7ff20fd7b640 1 -- 172.21.15.78:0/1182883467 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff20809be70 con 0x7ff2080743a0 2024-09-17T03:15:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.201+0000 7ff20fd7b640 1 -- 172.21.15.78:0/1182883467 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff208075390 con 0x7ff2080743a0 2024-09-17T03:15:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.202+0000 7ff1fa7fc640 1 -- 172.21.15.78:0/1182883467 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff20401a070 con 0x7ff2080743a0 2024-09-17T03:15:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.202+0000 7ff1fa7fc640 1 --2- 172.21.15.78:0/1182883467 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff1ec078b90 0x7ff1ec07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.202+0000 7ff1fa7fc640 1 -- 172.21.15.78:0/1182883467 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7ff20409a460 con 0x7ff2080743a0 2024-09-17T03:15:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.202+0000 7ff20db17640 1 --2- 172.21.15.78:0/1182883467 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff1ec078b90 0x7ff1ec07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.202+0000 7ff1fa7fc640 1 --2- 172.21.15.78:0/1182883467 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x7ff1ec07ebe0 0x7ff1ec081030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.202+0000 7ff1fa7fc640 1 -- 172.21.15.78:0/1182883467 --> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff1ec081700 con 0x7ff1ec07ebe0 2024-09-17T03:15:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.202+0000 7ff1fa7fc640 1 -- 172.21.15.78:0/1182883467 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7ff20409a8f0 con 0x7ff2080743a0 2024-09-17T03:15:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.202+0000 7ff20e318640 1 --2- 172.21.15.78:0/1182883467 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x7ff1ec07ebe0 0x7ff1ec081030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.203+0000 7ff20e318640 1 --2- 172.21.15.78:0/1182883467 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x7ff1ec07ebe0 0x7ff1ec081030 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:39.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.203+0000 7ff20db17640 1 --2- 172.21.15.78:0/1182883467 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff1ec078b90 0x7ff1ec07b0a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc033000 tx=0x7ff1fc004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:39.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.204+0000 7ff1fa7fc640 1 -- 172.21.15.78:0/1182883467 <== osd.0 v2:172.21.15.78:6816/3825297687 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff1ec081700 con 0x7ff1ec07ebe0 2024-09-17T03:15:39.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.216+0000 7ff20fd7b640 1 -- 172.21.15.78:0/1182883467 --> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff20809b380 con 0x7ff1ec07ebe0 2024-09-17T03:15:39.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.216+0000 7ff1fa7fc640 1 -- 172.21.15.78:0/1182883467 <== osd.0 v2:172.21.15.78:6816/3825297687 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff20809b380 con 0x7ff1ec07ebe0 2024-09-17T03:15:39.215 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:39.215 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:15:39.215 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:39.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.217+0000 7ff20fd7b640 1 -- 172.21.15.78:0/1182883467 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x7ff1ec07ebe0 msgr2=0x7ff1ec081030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.217+0000 7ff20fd7b640 1 --2- 172.21.15.78:0/1182883467 >> [v2:172.21.15.78:6816/3825297687,v1:172.21.15.78:6817/3825297687] conn(0x7ff1ec07ebe0 0x7ff1ec081030 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.217+0000 7ff20fd7b640 1 -- 172.21.15.78:0/1182883467 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff1ec078b90 msgr2=0x7ff1ec07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.217+0000 7ff20fd7b640 1 --2- 172.21.15.78:0/1182883467 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ff1ec078b90 0x7ff1ec07b0a0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff1fc033000 tx=0x7ff1fc004730 comp rx=0 tx=0).stop 2024-09-17T03:15:39.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.217+0000 7ff20fd7b640 1 -- 172.21.15.78:0/1182883467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2080743a0 msgr2=0x7ff20806f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.217+0000 7ff20fd7b640 1 --2- 172.21.15.78:0/1182883467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff2080743a0 0x7ff20806f790 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7ff20400c3c0 tx=0x7ff20400c880 comp rx=0 tx=0).stop 2024-09-17T03:15:39.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.217+0000 7ff20e318640 1 -- 172.21.15.78:0/1182883467 reap_dead start 2024-09-17T03:15:39.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.217+0000 7ff20fd7b640 1 -- 172.21.15.78:0/1182883467 shutdown_connections 2024-09-17T03:15:39.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.217+0000 7ff20fd7b640 1 -- 172.21.15.78:0/1182883467 >> 172.21.15.78:0/1182883467 conn(0x7ff2080d0130 msgr2=0x7ff2080d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:39.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.217+0000 7ff20fd7b640 1 -- 172.21.15.78:0/1182883467 shutdown_connections 2024-09-17T03:15:39.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.217+0000 7ff20fd7b640 1 -- 172.21.15.78:0/1182883467 wait complete. 2024-09-17T03:15:39.226 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-17T03:15:39.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.343+0000 7f333dab2640 1 -- 172.21.15.78:0/697189197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33200039e0 msgr2=0x7f3320003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.343+0000 7f333dab2640 1 --2- 172.21.15.78:0/697189197 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33200039e0 0x7f3320003e10 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f332800c640 tx=0x7f3320005830 comp rx=0 tx=0).stop 2024-09-17T03:15:39.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.343+0000 7f3337fff640 1 -- 172.21.15.78:0/697189197 reap_dead start 2024-09-17T03:15:39.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.343+0000 7f333dab2640 1 -- 172.21.15.78:0/697189197 shutdown_connections 2024-09-17T03:15:39.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.343+0000 7f333dab2640 1 -- 172.21.15.78:0/697189197 >> 172.21.15.78:0/697189197 conn(0x7f33380cdcc0 msgr2=0x7f33380ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:39.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.343+0000 7f333dab2640 1 -- 172.21.15.78:0/697189197 shutdown_connections 2024-09-17T03:15:39.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.343+0000 7f333dab2640 1 -- 172.21.15.78:0/697189197 wait complete. 2024-09-17T03:15:39.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.345+0000 7f333dab2640 1 Processor -- start 2024-09-17T03:15:39.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.345+0000 7f333dab2640 1 -- start start 2024-09-17T03:15:39.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.346+0000 7f333dab2640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f33200039e0 0x7f33381e4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.346+0000 7f333dab2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33380ccce0 0x7f333815b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.346+0000 7f333dab2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f333815b740 0x7f33381f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.346+0000 7f333dab2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f33380b46a0 con 0x7f33380ccce0 2024-09-17T03:15:39.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.346+0000 7f333dab2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f33380b39e0 con 0x7f333815b740 2024-09-17T03:15:39.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.346+0000 7f333dab2640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f33380b4820 con 0x7f33200039e0 2024-09-17T03:15:39.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.346+0000 7f3336ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33380ccce0 0x7f333815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.346+0000 7f3336ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33380ccce0 0x7f333815b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60862/0 (socket says 172.21.15.78:60862) 2024-09-17T03:15:39.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.346+0000 7f3336ffd640 1 -- 172.21.15.78:0/111787013 learned_addr learned my addr 172.21.15.78:0/111787013 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:39.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.346+0000 7f33377fe640 1 --2- 172.21.15.78:0/111787013 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f33200039e0 0x7f33381e4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.346+0000 7f3337fff640 1 --2- 172.21.15.78:0/111787013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f333815b740 0x7f33381f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.347+0000 7f3336ffd640 1 -- 172.21.15.78:0/111787013 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f33200039e0 msgr2=0x7f33381e4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.347+0000 7f3336ffd640 1 --2- 172.21.15.78:0/111787013 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f33200039e0 0x7f33381e4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.347+0000 7f3336ffd640 1 -- 172.21.15.78:0/111787013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f333815b740 msgr2=0x7f33381f40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.347+0000 7f3336ffd640 1 --2- 172.21.15.78:0/111787013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f333815b740 0x7f33381f40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.347+0000 7f3336ffd640 1 -- 172.21.15.78:0/111787013 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333815bb50 con 0x7f33380ccce0 2024-09-17T03:15:39.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.347+0000 7f3336ffd640 1 --2- 172.21.15.78:0/111787013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33380ccce0 0x7f333815b200 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f332c004dc0 tx=0x7f332c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:39.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.347+0000 7f331ffff640 1 -- 172.21.15.78:0/111787013 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c0107d0 con 0x7f33380ccce0 2024-09-17T03:15:39.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.347+0000 7f331ffff640 1 -- 172.21.15.78:0/111787013 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f332c016070 con 0x7f33380ccce0 2024-09-17T03:15:39.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.347+0000 7f333dab2640 1 -- 172.21.15.78:0/111787013 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33381f3030 con 0x7f33380ccce0 2024-09-17T03:15:39.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.347+0000 7f331ffff640 1 -- 172.21.15.78:0/111787013 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c010ce0 con 0x7f33380ccce0 2024-09-17T03:15:39.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.347+0000 7f333dab2640 1 -- 172.21.15.78:0/111787013 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33381f35f0 con 0x7f33380ccce0 2024-09-17T03:15:39.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.348+0000 7f333dab2640 1 -- 172.21.15.78:0/111787013 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33380cfeb0 con 0x7f33380ccce0 2024-09-17T03:15:39.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.349+0000 7f331ffff640 1 -- 172.21.15.78:0/111787013 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f332c01b460 con 0x7f33380ccce0 2024-09-17T03:15:39.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.350+0000 7f331ffff640 1 --2- 172.21.15.78:0/111787013 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3324078b90 0x7f332407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.350+0000 7f331ffff640 1 -- 172.21.15.78:0/111787013 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7f332c09b2e0 con 0x7f33380ccce0 2024-09-17T03:15:39.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.350+0000 7f33377fe640 1 --2- 172.21.15.78:0/111787013 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3324078b90 0x7f332407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.350+0000 7f33377fe640 1 --2- 172.21.15.78:0/111787013 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3324078b90 0x7f332407b0a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3328033000 tx=0x7f33380cf2c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:39.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.354+0000 7f331ffff640 1 -- 172.21.15.78:0/111787013 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f333815bb50 con 0x7f33380ccce0 2024-09-17T03:15:39.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.530+0000 7f333dab2640 1 -- 172.21.15.78:0/111787013 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f33380d1f70 con 0x7f3324078b90 2024-09-17T03:15:39.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.530+0000 7f331ffff640 1 -- 172.21.15.78:0/111787013 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f33380d1f70 con 0x7f3324078b90 2024-09-17T03:15:39.530 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 0 to deep-scrub 2024-09-17T03:15:39.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.532+0000 7f333dab2640 1 -- 172.21.15.78:0/111787013 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3324078b90 msgr2=0x7f332407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.532+0000 7f333dab2640 1 --2- 172.21.15.78:0/111787013 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3324078b90 0x7f332407b0a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3328033000 tx=0x7f33380cf2c0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.532+0000 7f333dab2640 1 -- 172.21.15.78:0/111787013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33380ccce0 msgr2=0x7f333815b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.532+0000 7f333dab2640 1 --2- 172.21.15.78:0/111787013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33380ccce0 0x7f333815b200 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f332c004dc0 tx=0x7f332c001710 comp rx=0 tx=0).stop 2024-09-17T03:15:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.532+0000 7f333dab2640 1 -- 172.21.15.78:0/111787013 shutdown_connections 2024-09-17T03:15:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.532+0000 7f333dab2640 1 --2- 172.21.15.78:0/111787013 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f3324078b90 0x7f332407b0a0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.532+0000 7f333dab2640 1 --2- 172.21.15.78:0/111787013 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f333815b740 0x7f33381f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.532+0000 7f333dab2640 1 --2- 172.21.15.78:0/111787013 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33380ccce0 0x7f333815b200 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.532+0000 7f333dab2640 1 --2- 172.21.15.78:0/111787013 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f33200039e0 0x7f33381e4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.532+0000 7f333dab2640 1 -- 172.21.15.78:0/111787013 >> 172.21.15.78:0/111787013 conn(0x7f33380cdcc0 msgr2=0x7f33380b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.533+0000 7f333dab2640 1 -- 172.21.15.78:0/111787013 shutdown_connections 2024-09-17T03:15:39.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.533+0000 7f333dab2640 1 -- 172.21.15.78:0/111787013 wait complete. 2024-09-17T03:15:39.542 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T03:15:39.542 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:15:39.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.660+0000 7fa965f13640 1 -- 172.21.15.78:0/3976460400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa960152740 msgr2=0x7fa96015c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.660+0000 7fa965f13640 1 --2- 172.21.15.78:0/3976460400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa960152740 0x7fa96015c710 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa950009830 tx=0x7fa95002a510 comp rx=0 tx=0).stop 2024-09-17T03:15:39.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.660+0000 7fa965f13640 1 -- 172.21.15.78:0/3976460400 shutdown_connections 2024-09-17T03:15:39.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.660+0000 7fa965f13640 1 --2- 172.21.15.78:0/3976460400 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa96015d260 0x7fa960070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.660+0000 7fa965f13640 1 --2- 172.21.15.78:0/3976460400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa960152740 0x7fa96015c710 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.660+0000 7fa965f13640 1 -- 172.21.15.78:0/3976460400 >> 172.21.15.78:0/3976460400 conn(0x7fa960073d90 msgr2=0x7fa9600741a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:39.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.660+0000 7fa965f13640 1 -- 172.21.15.78:0/3976460400 shutdown_connections 2024-09-17T03:15:39.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.660+0000 7fa965f13640 1 -- 172.21.15.78:0/3976460400 wait complete. 2024-09-17T03:15:39.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.662+0000 7fa965f13640 1 Processor -- start 2024-09-17T03:15:39.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.662+0000 7fa965f13640 1 -- start start 2024-09-17T03:15:39.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.663+0000 7fa965f13640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa960152740 0x7fa960158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.663+0000 7fa965f13640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa96015ce50 0x7fa9601f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.663+0000 7fa965f13640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa96015d260 0x7fa9601f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.663+0000 7fa965f13640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa9600d0690 con 0x7fa96015d260 2024-09-17T03:15:39.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.663+0000 7fa965f13640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa9600cff00 con 0x7fa96015ce50 2024-09-17T03:15:39.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.663+0000 7fa965f13640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa9600d0810 con 0x7fa960152740 2024-09-17T03:15:39.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.663+0000 7fa95ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa96015d260 0x7fa9601f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.663+0000 7fa95ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa96015d260 0x7fa9601f60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60872/0 (socket says 172.21.15.78:60872) 2024-09-17T03:15:39.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.663+0000 7fa95ffff640 1 -- 172.21.15.78:0/3110744860 learned_addr learned my addr 172.21.15.78:0/3110744860 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:39.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.663+0000 7fa95effd640 1 --2- 172.21.15.78:0/3110744860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa96015ce50 0x7fa9601f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.663+0000 7fa95f7fe640 1 --2- 172.21.15.78:0/3110744860 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa960152740 0x7fa960158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.664+0000 7fa95ffff640 1 -- 172.21.15.78:0/3110744860 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa960152740 msgr2=0x7fa960158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.664+0000 7fa95ffff640 1 --2- 172.21.15.78:0/3110744860 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa960152740 0x7fa960158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.664+0000 7fa95ffff640 1 -- 172.21.15.78:0/3110744860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa96015ce50 msgr2=0x7fa9601f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.664+0000 7fa95ffff640 1 --2- 172.21.15.78:0/3110744860 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa96015ce50 0x7fa9601f5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.664+0000 7fa95ffff640 1 -- 172.21.15.78:0/3110744860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9601552d0 con 0x7fa96015d260 2024-09-17T03:15:39.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.664+0000 7fa95ffff640 1 --2- 172.21.15.78:0/3110744860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa96015d260 0x7fa9601f60c0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fa95800ebf0 tx=0x7fa95800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:39.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.664+0000 7fa947fff640 1 -- 172.21.15.78:0/3110744860 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa958010630 con 0x7fa96015d260 2024-09-17T03:15:39.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.664+0000 7fa947fff640 1 -- 172.21.15.78:0/3110744860 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9580107d0 con 0x7fa96015d260 2024-09-17T03:15:39.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.664+0000 7fa947fff640 1 -- 172.21.15.78:0/3110744860 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa958010c20 con 0x7fa96015d260 2024-09-17T03:15:39.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.664+0000 7fa965f13640 1 -- 172.21.15.78:0/3110744860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa960153270 con 0x7fa96015d260 2024-09-17T03:15:39.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.664+0000 7fa965f13640 1 -- 172.21.15.78:0/3110744860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa960155890 con 0x7fa96015d260 2024-09-17T03:15:39.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.665+0000 7fa965f13640 1 -- 172.21.15.78:0/3110744860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa96015c940 con 0x7fa96015d260 2024-09-17T03:15:39.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.666+0000 7fa947fff640 1 -- 172.21.15.78:0/3110744860 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa958021430 con 0x7fa96015d260 2024-09-17T03:15:39.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.666+0000 7fa947fff640 1 --2- 172.21.15.78:0/3110744860 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa94c078b90 0x7fa94c07b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.666+0000 7fa947fff640 1 -- 172.21.15.78:0/3110744860 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7fa95809bcb0 con 0x7fa96015d260 2024-09-17T03:15:39.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.666+0000 7fa95f7fe640 1 --2- 172.21.15.78:0/3110744860 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa94c078b90 0x7fa94c07b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.667+0000 7fa947fff640 1 --2- 172.21.15.78:0/3110744860 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x7fa94c07ebe0 0x7fa94c081030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.667+0000 7fa947fff640 1 -- 172.21.15.78:0/3110744860 --> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa958022e50 con 0x7fa94c07ebe0 2024-09-17T03:15:39.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.667+0000 7fa947fff640 1 -- 172.21.15.78:0/3110744860 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7fa95809c140 con 0x7fa96015d260 2024-09-17T03:15:39.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.667+0000 7fa95effd640 1 --2- 172.21.15.78:0/3110744860 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x7fa94c07ebe0 0x7fa94c081030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.667+0000 7fa95effd640 1 --2- 172.21.15.78:0/3110744860 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x7fa94c07ebe0 0x7fa94c081030 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:39.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.667+0000 7fa95f7fe640 1 --2- 172.21.15.78:0/3110744860 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa94c078b90 0x7fa94c07b0a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa950034000 tx=0x7fa950004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:39.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.668+0000 7fa947fff640 1 -- 172.21.15.78:0/3110744860 <== osd.1 v2:172.21.15.78:6808/607587433 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa958022e50 con 0x7fa94c07ebe0 2024-09-17T03:15:39.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.680+0000 7fa965f13640 1 -- 172.21.15.78:0/3110744860 --> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa960071280 con 0x7fa94c07ebe0 2024-09-17T03:15:39.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.680+0000 7fa947fff640 1 -- 172.21.15.78:0/3110744860 <== osd.1 v2:172.21.15.78:6808/607587433 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa960071280 con 0x7fa94c07ebe0 2024-09-17T03:15:39.679 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:39.679 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:15:39.679 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:39.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.680+0000 7fa965f13640 1 -- 172.21.15.78:0/3110744860 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x7fa94c07ebe0 msgr2=0x7fa94c081030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.680+0000 7fa965f13640 1 --2- 172.21.15.78:0/3110744860 >> [v2:172.21.15.78:6808/607587433,v1:172.21.15.78:6809/607587433] conn(0x7fa94c07ebe0 0x7fa94c081030 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.680+0000 7fa965f13640 1 -- 172.21.15.78:0/3110744860 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa94c078b90 msgr2=0x7fa94c07b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.680+0000 7fa965f13640 1 --2- 172.21.15.78:0/3110744860 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa94c078b90 0x7fa94c07b0a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa950034000 tx=0x7fa950004730 comp rx=0 tx=0).stop 2024-09-17T03:15:39.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.680+0000 7fa965f13640 1 -- 172.21.15.78:0/3110744860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa96015d260 msgr2=0x7fa9601f60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.680+0000 7fa965f13640 1 --2- 172.21.15.78:0/3110744860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa96015d260 0x7fa9601f60c0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fa95800ebf0 tx=0x7fa95800c6a0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.680+0000 7fa95ffff640 1 -- 172.21.15.78:0/3110744860 reap_dead start 2024-09-17T03:15:39.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.680+0000 7fa965f13640 1 -- 172.21.15.78:0/3110744860 shutdown_connections 2024-09-17T03:15:39.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.680+0000 7fa965f13640 1 -- 172.21.15.78:0/3110744860 >> 172.21.15.78:0/3110744860 conn(0x7fa960073d90 msgr2=0x7fa96015f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:39.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.681+0000 7fa965f13640 1 -- 172.21.15.78:0/3110744860 shutdown_connections 2024-09-17T03:15:39.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.681+0000 7fa965f13640 1 -- 172.21.15.78:0/3110744860 wait complete. 2024-09-17T03:15:39.693 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-17T03:15:39.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.808+0000 7f7aeac93640 1 -- 172.21.15.78:0/2224513150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae40cf320 msgr2=0x7f7ae40ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.808+0000 7f7aeac93640 1 --2- 172.21.15.78:0/2224513150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae40cf320 0x7f7ae40ccbc0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0005fd0 tx=0x7f7ad002a5d0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.808+0000 7f7aeac93640 1 -- 172.21.15.78:0/2224513150 shutdown_connections 2024-09-17T03:15:39.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.808+0000 7f7aeac93640 1 --2- 172.21.15.78:0/2224513150 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ae40b7cc0 0x7f7ae40d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.808+0000 7f7aeac93640 1 --2- 172.21.15.78:0/2224513150 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae40cf320 0x7f7ae40ccbc0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.808+0000 7f7aeac93640 1 -- 172.21.15.78:0/2224513150 >> 172.21.15.78:0/2224513150 conn(0x7f7ae406d4f0 msgr2=0x7f7ae4071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:39.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.808+0000 7f7aeac93640 1 -- 172.21.15.78:0/2224513150 shutdown_connections 2024-09-17T03:15:39.807 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.808+0000 7f7aeac93640 1 -- 172.21.15.78:0/2224513150 wait complete. 2024-09-17T03:15:39.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.809+0000 7f7aeac93640 1 Processor -- start 2024-09-17T03:15:39.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.809+0000 7f7aeac93640 1 -- start start 2024-09-17T03:15:39.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.811+0000 7f7aeac93640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ae40b7cc0 0x7f7ae4157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.811+0000 7f7aeac93640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae40cf320 0x7f7ae40a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.811+0000 7f7aeac93640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ae41600b0 0x7f7ae40ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.811+0000 7f7aeac93640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae40d1410 con 0x7f7ae40cf320 2024-09-17T03:15:39.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.811+0000 7f7aeac93640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae40d1290 con 0x7f7ae40b7cc0 2024-09-17T03:15:39.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.811+0000 7f7aeac93640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae40d1590 con 0x7f7ae41600b0 2024-09-17T03:15:39.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.811+0000 7f7ae3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae40cf320 0x7f7ae40a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.811+0000 7f7ae3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae40cf320 0x7f7ae40a94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60896/0 (socket says 172.21.15.78:60896) 2024-09-17T03:15:39.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.811+0000 7f7ae3fff640 1 -- 172.21.15.78:0/2407715152 learned_addr learned my addr 172.21.15.78:0/2407715152 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:39.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.811+0000 7f7ae9230640 1 --2- 172.21.15.78:0/2407715152 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ae41600b0 0x7f7ae40ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.811+0000 7f7ae8a2f640 1 --2- 172.21.15.78:0/2407715152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ae40b7cc0 0x7f7ae4157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.811+0000 7f7ae3fff640 1 -- 172.21.15.78:0/2407715152 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ae41600b0 msgr2=0x7f7ae40ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.811+0000 7f7ae3fff640 1 --2- 172.21.15.78:0/2407715152 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ae41600b0 0x7f7ae40ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.811+0000 7f7ae3fff640 1 -- 172.21.15.78:0/2407715152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ae40b7cc0 msgr2=0x7f7ae4157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.811+0000 7f7ae3fff640 1 --2- 172.21.15.78:0/2407715152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ae40b7cc0 0x7f7ae4157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.811+0000 7f7ae3fff640 1 -- 172.21.15.78:0/2407715152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae40b1d30 con 0x7f7ae40cf320 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.811+0000 7f7ae3fff640 1 --2- 172.21.15.78:0/2407715152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae40cf320 0x7f7ae40a94a0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0034040 tx=0x7f7ad00035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.811+0000 7f7ae17fa640 1 -- 172.21.15.78:0/2407715152 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad003e030 con 0x7f7ae40cf320 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.812+0000 7f7ae17fa640 1 -- 172.21.15.78:0/2407715152 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ad0003ae0 con 0x7f7ae40cf320 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.812+0000 7f7aeac93640 1 -- 172.21.15.78:0/2407715152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae40b2230 con 0x7f7ae40cf320 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.812+0000 7f7ae17fa640 1 -- 172.21.15.78:0/2407715152 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0035040 con 0x7f7ae40cf320 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.812+0000 7f7aeac93640 1 -- 172.21.15.78:0/2407715152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae40b27f0 con 0x7f7ae40cf320 2024-09-17T03:15:39.813 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.812+0000 7f7aeac93640 1 -- 172.21.15.78:0/2407715152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ae40d1b20 con 0x7f7ae40cf320 2024-09-17T03:15:39.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.813+0000 7f7ae17fa640 1 -- 172.21.15.78:0/2407715152 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7ad0041030 con 0x7f7ae40cf320 2024-09-17T03:15:39.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.814+0000 7f7ae17fa640 1 --2- 172.21.15.78:0/2407715152 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7ac8078b90 0x7f7ac807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:39.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.814+0000 7f7ae17fa640 1 -- 172.21.15.78:0/2407715152 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7f7ad00bafa0 con 0x7f7ae40cf320 2024-09-17T03:15:39.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.814+0000 7f7ae8a2f640 1 --2- 172.21.15.78:0/2407715152 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7ac8078b90 0x7f7ac807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:39.814 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.814+0000 7f7ae8a2f640 1 --2- 172.21.15.78:0/2407715152 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7ac8078b90 0x7f7ac807b0a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4074810 tx=0x7f7ad8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:39.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.818+0000 7f7ae17fa640 1 -- 172.21.15.78:0/2407715152 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f7ad0082fe0 con 0x7f7ae40cf320 2024-09-17T03:15:39.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.994+0000 7f7aeac93640 1 -- 172.21.15.78:0/2407715152 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f7ae41f4c70 con 0x7f7ac8078b90 2024-09-17T03:15:39.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.994+0000 7f7ae17fa640 1 -- 172.21.15.78:0/2407715152 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f7ae41f4c70 con 0x7f7ac8078b90 2024-09-17T03:15:39.993 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 1 to deep-scrub 2024-09-17T03:15:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.996+0000 7f7aeac93640 1 -- 172.21.15.78:0/2407715152 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7ac8078b90 msgr2=0x7f7ac807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.996+0000 7f7aeac93640 1 --2- 172.21.15.78:0/2407715152 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7ac8078b90 0x7f7ac807b0a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4074810 tx=0x7f7ad8009040 comp rx=0 tx=0).stop 2024-09-17T03:15:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.996+0000 7f7aeac93640 1 -- 172.21.15.78:0/2407715152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae40cf320 msgr2=0x7f7ae40a94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.996+0000 7f7aeac93640 1 --2- 172.21.15.78:0/2407715152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae40cf320 0x7f7ae40a94a0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0034040 tx=0x7f7ad00035f0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.996+0000 7f7aeac93640 1 -- 172.21.15.78:0/2407715152 shutdown_connections 2024-09-17T03:15:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.996+0000 7f7aeac93640 1 --2- 172.21.15.78:0/2407715152 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ae41600b0 0x7f7ae40ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.996+0000 7f7aeac93640 1 --2- 172.21.15.78:0/2407715152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae40cf320 0x7f7ae40a94a0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.996+0000 7f7aeac93640 1 --2- 172.21.15.78:0/2407715152 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7ac8078b90 0x7f7ac807b0a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.996+0000 7f7aeac93640 1 --2- 172.21.15.78:0/2407715152 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ae40b7cc0 0x7f7ae4157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.996+0000 7f7aeac93640 1 -- 172.21.15.78:0/2407715152 >> 172.21.15.78:0/2407715152 conn(0x7f7ae406d4f0 msgr2=0x7f7ae415f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.997+0000 7f7aeac93640 1 -- 172.21.15.78:0/2407715152 shutdown_connections 2024-09-17T03:15:39.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:39.997+0000 7f7aeac93640 1 -- 172.21.15.78:0/2407715152 wait complete. 2024-09-17T03:15:40.007 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T03:15:40.007 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:15:40.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.124+0000 7fdb47e07640 1 -- 172.21.15.78:0/2468658924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb400cb4d0 msgr2=0x7fdb40073820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.124+0000 7fdb47e07640 1 --2- 172.21.15.78:0/2468658924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb400cb4d0 0x7fdb40073820 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fdb30009830 tx=0x7fdb3002a480 comp rx=0 tx=0).stop 2024-09-17T03:15:40.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.124+0000 7fdb47e07640 1 -- 172.21.15.78:0/2468658924 shutdown_connections 2024-09-17T03:15:40.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.124+0000 7fdb47e07640 1 --2- 172.21.15.78:0/2468658924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb400cb4d0 0x7fdb40073820 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.124+0000 7fdb47e07640 1 --2- 172.21.15.78:0/2468658924 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdb4015fb80 0x7fdb400acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.124+0000 7fdb47e07640 1 -- 172.21.15.78:0/2468658924 >> 172.21.15.78:0/2468658924 conn(0x7fdb400d0130 msgr2=0x7fdb400d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:40.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.124+0000 7fdb47e07640 1 -- 172.21.15.78:0/2468658924 shutdown_connections 2024-09-17T03:15:40.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.124+0000 7fdb47e07640 1 -- 172.21.15.78:0/2468658924 wait complete. 2024-09-17T03:15:40.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.125+0000 7fdb47e07640 1 Processor -- start 2024-09-17T03:15:40.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.125+0000 7fdb47e07640 1 -- start start 2024-09-17T03:15:40.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb47e07640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb400cc560 0x7fdb401504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb47e07640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb4015fb80 0x7fdb400b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb47e07640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdb400c9500 0x7fdb40152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb47e07640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fdb400ad9b0 con 0x7fdb400cc560 2024-09-17T03:15:40.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb47e07640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdb400ad830 con 0x7fdb4015fb80 2024-09-17T03:15:40.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb47e07640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fdb400adb30 con 0x7fdb400c9500 2024-09-17T03:15:40.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb45ba3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb400cc560 0x7fdb401504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb45ba3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb400cc560 0x7fdb401504f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60922/0 (socket says 172.21.15.78:60922) 2024-09-17T03:15:40.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb45ba3640 1 -- 172.21.15.78:0/2367838718 learned_addr learned my addr 172.21.15.78:0/2367838718 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:40.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb463a4640 1 --2- 172.21.15.78:0/2367838718 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdb400c9500 0x7fdb40152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb453a2640 1 --2- 172.21.15.78:0/2367838718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb4015fb80 0x7fdb400b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb45ba3640 1 -- 172.21.15.78:0/2367838718 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdb400c9500 msgr2=0x7fdb40152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb45ba3640 1 --2- 172.21.15.78:0/2367838718 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdb400c9500 0x7fdb40152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb45ba3640 1 -- 172.21.15.78:0/2367838718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb4015fb80 msgr2=0x7fdb400b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb45ba3640 1 --2- 172.21.15.78:0/2367838718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb4015fb80 0x7fdb400b59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb45ba3640 1 -- 172.21.15.78:0/2367838718 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb400c3520 con 0x7fdb400cc560 2024-09-17T03:15:40.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb453a2640 1 --2- 172.21.15.78:0/2367838718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb4015fb80 0x7fdb400b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:40.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb45ba3640 1 --2- 172.21.15.78:0/2367838718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb400cc560 0x7fdb401504f0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00c3d0 tx=0x7fdb3c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:40.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb367fc640 1 -- 172.21.15.78:0/2367838718 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c011790 con 0x7fdb400cc560 2024-09-17T03:15:40.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb367fc640 1 -- 172.21.15.78:0/2367838718 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb3c017070 con 0x7fdb400cc560 2024-09-17T03:15:40.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb47e07640 1 -- 172.21.15.78:0/2367838718 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb400c8d40 con 0x7fdb400cc560 2024-09-17T03:15:40.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb367fc640 1 -- 172.21.15.78:0/2367838718 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c011cc0 con 0x7fdb400cc560 2024-09-17T03:15:40.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.127+0000 7fdb47e07640 1 -- 172.21.15.78:0/2367838718 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb400c8fe0 con 0x7fdb400cc560 2024-09-17T03:15:40.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.128+0000 7fdb47e07640 1 -- 172.21.15.78:0/2367838718 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdb400ae050 con 0x7fdb400cc560 2024-09-17T03:15:40.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.129+0000 7fdb367fc640 1 -- 172.21.15.78:0/2367838718 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdb3c01c460 con 0x7fdb400cc560 2024-09-17T03:15:40.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.129+0000 7fdb367fc640 1 --2- 172.21.15.78:0/2367838718 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdb24078bc0 0x7fdb2407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.130+0000 7fdb367fc640 1 -- 172.21.15.78:0/2367838718 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7fdb3c09a7f0 con 0x7fdb400cc560 2024-09-17T03:15:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.130+0000 7fdb367fc640 1 --2- 172.21.15.78:0/2367838718 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x7fdb2407ec10 0x7fdb24081060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.130+0000 7fdb453a2640 1 --2- 172.21.15.78:0/2367838718 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdb24078bc0 0x7fdb2407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.130+0000 7fdb367fc640 1 -- 172.21.15.78:0/2367838718 --> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdb3c013ec0 con 0x7fdb2407ec10 2024-09-17T03:15:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.130+0000 7fdb367fc640 1 -- 172.21.15.78:0/2367838718 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7fdb3c09f2c0 con 0x7fdb400cc560 2024-09-17T03:15:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.130+0000 7fdb463a4640 1 --2- 172.21.15.78:0/2367838718 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x7fdb2407ec10 0x7fdb24081060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.130+0000 7fdb463a4640 1 --2- 172.21.15.78:0/2367838718 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x7fdb2407ec10 0x7fdb24081060 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:40.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.130+0000 7fdb453a2640 1 --2- 172.21.15.78:0/2367838718 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdb24078bc0 0x7fdb2407b0d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fdb30034000 tx=0x7fdb30004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:40.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.131+0000 7fdb367fc640 1 -- 172.21.15.78:0/2367838718 <== osd.2 v2:172.21.15.78:6824/3281582072 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdb3c013ec0 con 0x7fdb2407ec10 2024-09-17T03:15:40.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.143+0000 7fdb47e07640 1 -- 172.21.15.78:0/2367838718 --> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdb400cb240 con 0x7fdb2407ec10 2024-09-17T03:15:40.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.143+0000 7fdb367fc640 1 -- 172.21.15.78:0/2367838718 <== osd.2 v2:172.21.15.78:6824/3281582072 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdb400cb240 con 0x7fdb2407ec10 2024-09-17T03:15:40.142 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:40.142 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:15:40.142 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:40.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.143+0000 7fdb47e07640 1 -- 172.21.15.78:0/2367838718 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x7fdb2407ec10 msgr2=0x7fdb24081060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.143+0000 7fdb47e07640 1 --2- 172.21.15.78:0/2367838718 >> [v2:172.21.15.78:6824/3281582072,v1:172.21.15.78:6825/3281582072] conn(0x7fdb2407ec10 0x7fdb24081060 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.144+0000 7fdb47e07640 1 -- 172.21.15.78:0/2367838718 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdb24078bc0 msgr2=0x7fdb2407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.144+0000 7fdb47e07640 1 --2- 172.21.15.78:0/2367838718 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fdb24078bc0 0x7fdb2407b0d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fdb30034000 tx=0x7fdb30004730 comp rx=0 tx=0).stop 2024-09-17T03:15:40.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.144+0000 7fdb47e07640 1 -- 172.21.15.78:0/2367838718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb400cc560 msgr2=0x7fdb401504f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.144+0000 7fdb47e07640 1 --2- 172.21.15.78:0/2367838718 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdb400cc560 0x7fdb401504f0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00c3d0 tx=0x7fdb3c00c890 comp rx=0 tx=0).stop 2024-09-17T03:15:40.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.144+0000 7fdb463a4640 1 -- 172.21.15.78:0/2367838718 reap_dead start 2024-09-17T03:15:40.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.144+0000 7fdb47e07640 1 -- 172.21.15.78:0/2367838718 shutdown_connections 2024-09-17T03:15:40.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.144+0000 7fdb47e07640 1 -- 172.21.15.78:0/2367838718 >> 172.21.15.78:0/2367838718 conn(0x7fdb400d0130 msgr2=0x7fdb4015f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:40.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.144+0000 7fdb47e07640 1 -- 172.21.15.78:0/2367838718 shutdown_connections 2024-09-17T03:15:40.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.144+0000 7fdb47e07640 1 -- 172.21.15.78:0/2367838718 wait complete. 2024-09-17T03:15:40.153 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T03:15:40.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.267+0000 7ffaa6b71640 1 -- 172.21.15.78:0/2193877743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaa00d1490 msgr2=0x7ffaa00cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.267+0000 7ffaa6b71640 1 --2- 172.21.15.78:0/2193877743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaa00d1490 0x7ffaa00cebf0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009830 tx=0x7ffa9802a510 comp rx=0 tx=0).stop 2024-09-17T03:15:40.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.267+0000 7ffaa6b71640 1 -- 172.21.15.78:0/2193877743 shutdown_connections 2024-09-17T03:15:40.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.267+0000 7ffaa6b71640 1 --2- 172.21.15.78:0/2193877743 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaa00d1490 0x7ffaa00cebf0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.267+0000 7ffaa6b71640 1 --2- 172.21.15.78:0/2193877743 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffaa00b51c0 0x7ffaa015c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.267+0000 7ffaa6b71640 1 -- 172.21.15.78:0/2193877743 >> 172.21.15.78:0/2193877743 conn(0x7ffaa0072ae0 msgr2=0x7ffaa0072ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:40.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.267+0000 7ffaa6b71640 1 -- 172.21.15.78:0/2193877743 shutdown_connections 2024-09-17T03:15:40.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.267+0000 7ffaa6b71640 1 -- 172.21.15.78:0/2193877743 wait complete. 2024-09-17T03:15:40.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.269+0000 7ffaa6b71640 1 Processor -- start 2024-09-17T03:15:40.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.269+0000 7ffaa6b71640 1 -- start start 2024-09-17T03:15:40.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffaa6b71640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffaa00b51c0 0x7ffaa0156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffaa6b71640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaa00ccbd0 0x7ffaa01f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffaa6b71640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa00d1490 0x7ffaa01f70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffaa6b71640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa00cf2b0 con 0x7ffaa00d1490 2024-09-17T03:15:40.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffaa6b71640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa00cf130 con 0x7ffaa00ccbd0 2024-09-17T03:15:40.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffaa6b71640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ffaa00cf430 con 0x7ffaa00b51c0 2024-09-17T03:15:40.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffaa510e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa00d1490 0x7ffaa01f70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffaa510e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa00d1490 0x7ffaa01f70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60924/0 (socket says 172.21.15.78:60924) 2024-09-17T03:15:40.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffaa510e640 1 -- 172.21.15.78:0/1631772460 learned_addr learned my addr 172.21.15.78:0/1631772460 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:40.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffaa490d640 1 --2- 172.21.15.78:0/1631772460 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffaa00b51c0 0x7ffaa0156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffa9ffff640 1 --2- 172.21.15.78:0/1631772460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaa00ccbd0 0x7ffaa01f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffaa510e640 1 -- 172.21.15.78:0/1631772460 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffaa00b51c0 msgr2=0x7ffaa0156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffaa510e640 1 --2- 172.21.15.78:0/1631772460 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffaa00b51c0 0x7ffaa0156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffaa510e640 1 -- 172.21.15.78:0/1631772460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaa00ccbd0 msgr2=0x7ffaa01f3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffaa510e640 1 --2- 172.21.15.78:0/1631772460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaa00ccbd0 0x7ffaa01f3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffaa510e640 1 -- 172.21.15.78:0/1631772460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa01f36b0 con 0x7ffaa00d1490 2024-09-17T03:15:40.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffaa510e640 1 --2- 172.21.15.78:0/1631772460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa00d1490 0x7ffaa01f70c0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009950 tx=0x7ffa98033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:40.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffa9d7fa640 1 -- 172.21.15.78:0/1631772460 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa98031b50 con 0x7ffaa00d1490 2024-09-17T03:15:40.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffa9d7fa640 1 -- 172.21.15.78:0/1631772460 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa98031de0 con 0x7ffaa00d1490 2024-09-17T03:15:40.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffa9d7fa640 1 -- 172.21.15.78:0/1631772460 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa98005280 con 0x7ffaa00d1490 2024-09-17T03:15:40.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.271+0000 7ffaa6b71640 1 -- 172.21.15.78:0/1631772460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa01f3bc0 con 0x7ffaa00d1490 2024-09-17T03:15:40.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.272+0000 7ffaa6b71640 1 -- 172.21.15.78:0/1631772460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa01f68c0 con 0x7ffaa00d1490 2024-09-17T03:15:40.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.273+0000 7ffaa6b71640 1 -- 172.21.15.78:0/1631772460 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa00cf880 con 0x7ffaa00d1490 2024-09-17T03:15:40.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.273+0000 7ffa9d7fa640 1 -- 172.21.15.78:0/1631772460 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffa98005420 con 0x7ffaa00d1490 2024-09-17T03:15:40.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.274+0000 7ffa9d7fa640 1 --2- 172.21.15.78:0/1631772460 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ffa80078b90 0x7ffa8007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.274+0000 7ffa9d7fa640 1 -- 172.21.15.78:0/1631772460 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7ffa980bb9e0 con 0x7ffaa00d1490 2024-09-17T03:15:40.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.274+0000 7ffaa490d640 1 --2- 172.21.15.78:0/1631772460 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ffa80078b90 0x7ffa8007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.274+0000 7ffaa490d640 1 --2- 172.21.15.78:0/1631772460 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ffa80078b90 0x7ffa8007b0a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ffa900099a0 tx=0x7ffa90009500 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:40.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.278+0000 7ffa9d7fa640 1 -- 172.21.15.78:0/1631772460 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7ffa9803f030 con 0x7ffaa00d1490 2024-09-17T03:15:40.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.455+0000 7ffaa6b71640 1 -- 172.21.15.78:0/1631772460 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7ffaa01f3910 con 0x7ffa80078b90 2024-09-17T03:15:40.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.456+0000 7ffa9d7fa640 1 -- 172.21.15.78:0/1631772460 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ffaa01f3910 con 0x7ffa80078b90 2024-09-17T03:15:40.454 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T03:15:40.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.458+0000 7ffaa6b71640 1 -- 172.21.15.78:0/1631772460 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ffa80078b90 msgr2=0x7ffa8007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.458+0000 7ffaa6b71640 1 --2- 172.21.15.78:0/1631772460 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ffa80078b90 0x7ffa8007b0a0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ffa900099a0 tx=0x7ffa90009500 comp rx=0 tx=0).stop 2024-09-17T03:15:40.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.458+0000 7ffaa6b71640 1 -- 172.21.15.78:0/1631772460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa00d1490 msgr2=0x7ffaa01f70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.458+0000 7ffaa6b71640 1 --2- 172.21.15.78:0/1631772460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa00d1490 0x7ffaa01f70c0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7ffa98009950 tx=0x7ffa98033ba0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.458+0000 7ffaa6b71640 1 -- 172.21.15.78:0/1631772460 shutdown_connections 2024-09-17T03:15:40.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.458+0000 7ffaa6b71640 1 --2- 172.21.15.78:0/1631772460 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffaa00d1490 0x7ffaa01f70c0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.458+0000 7ffaa6b71640 1 --2- 172.21.15.78:0/1631772460 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7ffa80078b90 0x7ffa8007b0a0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.458+0000 7ffaa6b71640 1 --2- 172.21.15.78:0/1631772460 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffaa00ccbd0 0x7ffaa01f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.458+0000 7ffaa6b71640 1 --2- 172.21.15.78:0/1631772460 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffaa00b51c0 0x7ffaa0156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.458+0000 7ffaa6b71640 1 -- 172.21.15.78:0/1631772460 >> 172.21.15.78:0/1631772460 conn(0x7ffaa0072ae0 msgr2=0x7ffaa015bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:40.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.458+0000 7ffaa6b71640 1 -- 172.21.15.78:0/1631772460 shutdown_connections 2024-09-17T03:15:40.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.458+0000 7ffaa6b71640 1 -- 172.21.15.78:0/1631772460 wait complete. 2024-09-17T03:15:40.468 INFO:tasks.ceph:Scrubbing osd.3 2024-09-17T03:15:40.468 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:15:40.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.585+0000 7f1070520640 1 -- 172.21.15.78:0/4092554720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10680b5160 msgr2=0x7f1068166330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.585+0000 7f1070520640 1 --2- 172.21.15.78:0/4092554720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10680b5160 0x7f1068166330 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f1060005fd0 tx=0x7f106002a940 comp rx=0 tx=0).stop 2024-09-17T03:15:40.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.585+0000 7f1070520640 1 -- 172.21.15.78:0/4092554720 shutdown_connections 2024-09-17T03:15:40.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.585+0000 7f1070520640 1 --2- 172.21.15.78:0/4092554720 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10680b5160 0x7f1068166330 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.585+0000 7f1070520640 1 -- 172.21.15.78:0/4092554720 >> 172.21.15.78:0/4092554720 conn(0x7f106809aa30 msgr2=0x7f10680b2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:40.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.585+0000 7f1070520640 1 -- 172.21.15.78:0/4092554720 shutdown_connections 2024-09-17T03:15:40.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.585+0000 7f1070520640 1 -- 172.21.15.78:0/4092554720 wait complete. 2024-09-17T03:15:40.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.587+0000 7f1070520640 1 Processor -- start 2024-09-17T03:15:40.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.587+0000 7f1070520640 1 -- start start 2024-09-17T03:15:40.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.588+0000 7f1070520640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f10680b5160 0x7f10681f9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.588+0000 7f1070520640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10680ce8d0 0x7f106806cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.588+0000 7f1070520640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10680cf7e0 0x7f106806d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.588+0000 7f1070520640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f1068166c00 con 0x7f10680cf7e0 2024-09-17T03:15:40.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.588+0000 7f1070520640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1068166a80 con 0x7f10680ce8d0 2024-09-17T03:15:40.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.588+0000 7f1070520640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f1068166d80 con 0x7f10680b5160 2024-09-17T03:15:40.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.588+0000 7f106eabd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10680cf7e0 0x7f106806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.589+0000 7f106eabd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10680cf7e0 0x7f106806d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60940/0 (socket says 172.21.15.78:60940) 2024-09-17T03:15:40.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.589+0000 7f106eabd640 1 -- 172.21.15.78:0/3782924340 learned_addr learned my addr 172.21.15.78:0/3782924340 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:40.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.589+0000 7f106e2bc640 1 --2- 172.21.15.78:0/3782924340 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f10680b5160 0x7f10681f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.589+0000 7f106dabb640 1 --2- 172.21.15.78:0/3782924340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10680ce8d0 0x7f106806cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.589+0000 7f106eabd640 1 -- 172.21.15.78:0/3782924340 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f10680b5160 msgr2=0x7f10681f9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.589+0000 7f106eabd640 1 --2- 172.21.15.78:0/3782924340 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f10680b5160 0x7f10681f9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.589+0000 7f106eabd640 1 -- 172.21.15.78:0/3782924340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10680ce8d0 msgr2=0x7f106806cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.589+0000 7f106eabd640 1 --2- 172.21.15.78:0/3782924340 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f10680ce8d0 0x7f106806cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.589+0000 7f106eabd640 1 -- 172.21.15.78:0/3782924340 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10681fa130 con 0x7f10680cf7e0 2024-09-17T03:15:40.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.589+0000 7f106eabd640 1 --2- 172.21.15.78:0/3782924340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10680cf7e0 0x7f106806d320 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f106002af30 tx=0x7f1060031ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:40.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.589+0000 7f105effd640 1 -- 172.21.15.78:0/3782924340 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106003e070 con 0x7f10680cf7e0 2024-09-17T03:15:40.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.589+0000 7f105effd640 1 -- 172.21.15.78:0/3782924340 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1060004560 con 0x7f10680cf7e0 2024-09-17T03:15:40.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.589+0000 7f1070520640 1 -- 172.21.15.78:0/3782924340 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10681fa410 con 0x7f10680cf7e0 2024-09-17T03:15:40.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.589+0000 7f105effd640 1 -- 172.21.15.78:0/3782924340 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1060043460 con 0x7f10680cf7e0 2024-09-17T03:15:40.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.589+0000 7f1070520640 1 -- 172.21.15.78:0/3782924340 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10681fa9d0 con 0x7f10680cf7e0 2024-09-17T03:15:40.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.590+0000 7f1070520640 1 -- 172.21.15.78:0/3782924340 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f10680b6120 con 0x7f10680cf7e0 2024-09-17T03:15:40.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.591+0000 7f105effd640 1 -- 172.21.15.78:0/3782924340 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f106003a440 con 0x7f10680cf7e0 2024-09-17T03:15:40.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.591+0000 7f105effd640 1 --2- 172.21.15.78:0/3782924340 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f104c078bc0 0x7f104c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.591+0000 7f105effd640 1 -- 172.21.15.78:0/3782924340 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7f10600bc620 con 0x7f10680cf7e0 2024-09-17T03:15:40.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.591+0000 7f105effd640 1 --2- 172.21.15.78:0/3782924340 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x7f104c07ec10 0x7f104c081060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.591+0000 7f105effd640 1 -- 172.21.15.78:0/3782924340 --> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10600020b0 con 0x7f104c07ec10 2024-09-17T03:15:40.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.591+0000 7f105effd640 1 -- 172.21.15.78:0/3782924340 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f10600c3050 con 0x7f10680cf7e0 2024-09-17T03:15:40.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.591+0000 7f106e2bc640 1 --2- 172.21.15.78:0/3782924340 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f104c078bc0 0x7f104c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.592+0000 7f106dabb640 1 --2- 172.21.15.78:0/3782924340 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x7f104c07ec10 0x7f104c081060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.592+0000 7f106dabb640 1 --2- 172.21.15.78:0/3782924340 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x7f104c07ec10 0x7f104c081060 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:40.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.592+0000 7f106e2bc640 1 --2- 172.21.15.78:0/3782924340 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f104c078bc0 0x7f104c07b0d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f10640046b0 tx=0x7f1064007e90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:40.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.593+0000 7f105effd640 1 -- 172.21.15.78:0/3782924340 <== osd.3 v2:172.21.15.78:6800/2433795738 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f10600020b0 con 0x7f104c07ec10 2024-09-17T03:15:40.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.605+0000 7f1070520640 1 -- 172.21.15.78:0/3782924340 --> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f10681f9ed0 con 0x7f104c07ec10 2024-09-17T03:15:40.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.605+0000 7f105effd640 1 -- 172.21.15.78:0/3782924340 <== osd.3 v2:172.21.15.78:6800/2433795738 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1058001800 con 0x7f104c07ec10 2024-09-17T03:15:40.604 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:40.604 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:15:40.604 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:40.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.605+0000 7f1070520640 1 -- 172.21.15.78:0/3782924340 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x7f104c07ec10 msgr2=0x7f104c081060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.605+0000 7f1070520640 1 --2- 172.21.15.78:0/3782924340 >> [v2:172.21.15.78:6800/2433795738,v1:172.21.15.78:6801/2433795738] conn(0x7f104c07ec10 0x7f104c081060 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.605+0000 7f1070520640 1 -- 172.21.15.78:0/3782924340 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f104c078bc0 msgr2=0x7f104c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.605+0000 7f1070520640 1 --2- 172.21.15.78:0/3782924340 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f104c078bc0 0x7f104c07b0d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f10640046b0 tx=0x7f1064007e90 comp rx=0 tx=0).stop 2024-09-17T03:15:40.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.605+0000 7f1070520640 1 -- 172.21.15.78:0/3782924340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10680cf7e0 msgr2=0x7f106806d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.605+0000 7f1070520640 1 --2- 172.21.15.78:0/3782924340 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10680cf7e0 0x7f106806d320 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f106002af30 tx=0x7f1060031ea0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.605+0000 7f106eabd640 1 -- 172.21.15.78:0/3782924340 reap_dead start 2024-09-17T03:15:40.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.605+0000 7f1070520640 1 -- 172.21.15.78:0/3782924340 shutdown_connections 2024-09-17T03:15:40.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.605+0000 7f1070520640 1 -- 172.21.15.78:0/3782924340 >> 172.21.15.78:0/3782924340 conn(0x7f106809aa30 msgr2=0x7f10680cef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:40.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.605+0000 7f1070520640 1 -- 172.21.15.78:0/3782924340 shutdown_connections 2024-09-17T03:15:40.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.605+0000 7f1070520640 1 -- 172.21.15.78:0/3782924340 wait complete. 2024-09-17T03:15:40.615 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-17T03:15:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.730+0000 7fc4a1a8b640 1 -- 172.21.15.78:0/614628488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc49c0b4090 msgr2=0x7fc49c0b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.730+0000 7fc4a1a8b640 1 --2- 172.21.15.78:0/614628488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc49c0b4090 0x7fc49c0b3550 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fc49c071020 tx=0x7fc48c02a560 comp rx=0 tx=0).stop 2024-09-17T03:15:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.730+0000 7fc4a1a8b640 1 -- 172.21.15.78:0/614628488 shutdown_connections 2024-09-17T03:15:40.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.730+0000 7fc4a1a8b640 1 --2- 172.21.15.78:0/614628488 >> v2:172.21.15.193:3300/0 conn(0x7fc49c0cfeb0 0x7fc49c0d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.730+0000 7fc4a1a8b640 1 --2- 172.21.15.78:0/614628488 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc49c0b4090 0x7fc49c0b3550 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.730+0000 7fc4a1a8b640 1 -- 172.21.15.78:0/614628488 >> 172.21.15.78:0/614628488 conn(0x7fc49c0cdcc0 msgr2=0x7fc49c0ce0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:40.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.730+0000 7fc4a1a8b640 1 -- 172.21.15.78:0/614628488 shutdown_connections 2024-09-17T03:15:40.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.730+0000 7fc4a1a8b640 1 -- 172.21.15.78:0/614628488 wait complete. 2024-09-17T03:15:40.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.732+0000 7fc4a1a8b640 1 Processor -- start 2024-09-17T03:15:40.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.732+0000 7fc4a1a8b640 1 -- start start 2024-09-17T03:15:40.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.733+0000 7fc4a1a8b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc49c06fec0 0x7fc49c1e8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.733+0000 7fc4a1a8b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc49c0b4090 0x7fc49c0ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.733+0000 7fc4a1a8b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc49c0cfeb0 0x7fc49c14f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.733+0000 7fc4a1a8b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fc49c0b4a30 con 0x7fc49c06fec0 2024-09-17T03:15:40.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.733+0000 7fc4a1a8b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc49c0b48b0 con 0x7fc49c0cfeb0 2024-09-17T03:15:40.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.733+0000 7fc4a1a8b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc49c0b4bb0 con 0x7fc49c0b4090 2024-09-17T03:15:40.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.733+0000 7fc49b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc49c06fec0 0x7fc49c1e8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.733+0000 7fc49b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc49c06fec0 0x7fc49c1e8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60968/0 (socket says 172.21.15.78:60968) 2024-09-17T03:15:40.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.733+0000 7fc49b7fe640 1 -- 172.21.15.78:0/1895405420 learned_addr learned my addr 172.21.15.78:0/1895405420 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:40.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.733+0000 7fc49bfff640 1 --2- 172.21.15.78:0/1895405420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc49c0cfeb0 0x7fc49c14f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.733+0000 7fc49affd640 1 --2- 172.21.15.78:0/1895405420 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc49c0b4090 0x7fc49c0ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.734+0000 7fc49b7fe640 1 -- 172.21.15.78:0/1895405420 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc49c0b4090 msgr2=0x7fc49c0ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.734+0000 7fc49b7fe640 1 --2- 172.21.15.78:0/1895405420 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc49c0b4090 0x7fc49c0ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.734+0000 7fc49b7fe640 1 -- 172.21.15.78:0/1895405420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc49c0cfeb0 msgr2=0x7fc49c14f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.734+0000 7fc49b7fe640 1 --2- 172.21.15.78:0/1895405420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc49c0cfeb0 0x7fc49c14f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.734+0000 7fc49b7fe640 1 -- 172.21.15.78:0/1895405420 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc49c1f64c0 con 0x7fc49c06fec0 2024-09-17T03:15:40.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.734+0000 7fc49b7fe640 1 --2- 172.21.15.78:0/1895405420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc49c06fec0 0x7fc49c1e8460 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fc48c034040 tx=0x7fc48c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:40.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.734+0000 7fc483fff640 1 -- 172.21.15.78:0/1895405420 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c03e030 con 0x7fc49c06fec0 2024-09-17T03:15:40.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.734+0000 7fc483fff640 1 -- 172.21.15.78:0/1895405420 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc48c003e00 con 0x7fc49c06fec0 2024-09-17T03:15:40.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.734+0000 7fc483fff640 1 -- 172.21.15.78:0/1895405420 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc48c035040 con 0x7fc49c06fec0 2024-09-17T03:15:40.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.734+0000 7fc4a1a8b640 1 -- 172.21.15.78:0/1895405420 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc49c1f67a0 con 0x7fc49c06fec0 2024-09-17T03:15:40.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.734+0000 7fc4a1a8b640 1 -- 172.21.15.78:0/1895405420 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc49c14f1d0 con 0x7fc49c06fec0 2024-09-17T03:15:40.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.735+0000 7fc4a1a8b640 1 -- 172.21.15.78:0/1895405420 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc49c14efe0 con 0x7fc49c06fec0 2024-09-17T03:15:40.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.736+0000 7fc483fff640 1 -- 172.21.15.78:0/1895405420 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc48c041030 con 0x7fc49c06fec0 2024-09-17T03:15:40.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.736+0000 7fc483fff640 1 --2- 172.21.15.78:0/1895405420 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc488078b90 0x7fc48807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:40.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.737+0000 7fc483fff640 1 -- 172.21.15.78:0/1895405420 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7fc48c0bb260 con 0x7fc49c06fec0 2024-09-17T03:15:40.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.737+0000 7fc49affd640 1 --2- 172.21.15.78:0/1895405420 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc488078b90 0x7fc48807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:40.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.737+0000 7fc49affd640 1 --2- 172.21.15.78:0/1895405420 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc488078b90 0x7fc48807b0a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0d0370 tx=0x7fc490009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:40.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.741+0000 7fc483fff640 1 -- 172.21.15.78:0/1895405420 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fc48c083330 con 0x7fc49c06fec0 2024-09-17T03:15:40.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.916+0000 7fc4a1a8b640 1 -- 172.21.15.78:0/1895405420 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fc49c0cd310 con 0x7fc488078b90 2024-09-17T03:15:40.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.916+0000 7fc483fff640 1 -- 172.21.15.78:0/1895405420 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc4900095b0 con 0x7fc488078b90 2024-09-17T03:15:40.915 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 3 to deep-scrub 2024-09-17T03:15:40.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.919+0000 7fc4a1a8b640 1 -- 172.21.15.78:0/1895405420 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc488078b90 msgr2=0x7fc48807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.919+0000 7fc4a1a8b640 1 --2- 172.21.15.78:0/1895405420 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc488078b90 0x7fc48807b0a0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc49c0d0370 tx=0x7fc490009060 comp rx=0 tx=0).stop 2024-09-17T03:15:40.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.919+0000 7fc4a1a8b640 1 -- 172.21.15.78:0/1895405420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc49c06fec0 msgr2=0x7fc49c1e8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:40.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.919+0000 7fc4a1a8b640 1 --2- 172.21.15.78:0/1895405420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc49c06fec0 0x7fc49c1e8460 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fc48c034040 tx=0x7fc48c003910 comp rx=0 tx=0).stop 2024-09-17T03:15:40.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.919+0000 7fc4a1a8b640 1 -- 172.21.15.78:0/1895405420 shutdown_connections 2024-09-17T03:15:40.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.919+0000 7fc4a1a8b640 1 --2- 172.21.15.78:0/1895405420 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fc488078b90 0x7fc48807b0a0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.919+0000 7fc4a1a8b640 1 --2- 172.21.15.78:0/1895405420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc49c0cfeb0 0x7fc49c14f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.919+0000 7fc4a1a8b640 1 --2- 172.21.15.78:0/1895405420 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc49c0b4090 0x7fc49c0ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.919+0000 7fc4a1a8b640 1 --2- 172.21.15.78:0/1895405420 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc49c06fec0 0x7fc49c1e8460 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:40.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.919+0000 7fc4a1a8b640 1 -- 172.21.15.78:0/1895405420 >> 172.21.15.78:0/1895405420 conn(0x7fc49c0cdcc0 msgr2=0x7fc49c0af8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:40.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.919+0000 7fc4a1a8b640 1 -- 172.21.15.78:0/1895405420 shutdown_connections 2024-09-17T03:15:40.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:40.919+0000 7fc4a1a8b640 1 -- 172.21.15.78:0/1895405420 wait complete. 2024-09-17T03:15:40.929 INFO:tasks.ceph:Scrubbing osd.4 2024-09-17T03:15:40.929 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:15:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.048+0000 7f7186e94640 1 -- 172.21.15.78:0/3212305623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f718006f1d0 msgr2=0x7f718015f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.048+0000 7f7186e94640 1 --2- 172.21.15.78:0/3212305623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f718006f1d0 0x7f718015f090 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f7178005fd0 tx=0x7f717802a4b0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.048+0000 7f7186e94640 1 -- 172.21.15.78:0/3212305623 shutdown_connections 2024-09-17T03:15:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.048+0000 7f7186e94640 1 --2- 172.21.15.78:0/3212305623 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f71800743a0 0x7f71800747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.048+0000 7f7186e94640 1 --2- 172.21.15.78:0/3212305623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f718006f1d0 0x7f718015f090 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.048+0000 7f7186e94640 1 -- 172.21.15.78:0/3212305623 >> 172.21.15.78:0/3212305623 conn(0x7f71800d0130 msgr2=0x7f71800d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:41.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.048+0000 7f7186e94640 1 -- 172.21.15.78:0/3212305623 shutdown_connections 2024-09-17T03:15:41.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.048+0000 7f7186e94640 1 -- 172.21.15.78:0/3212305623 wait complete. 2024-09-17T03:15:41.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.050+0000 7f7186e94640 1 Processor -- start 2024-09-17T03:15:41.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.050+0000 7f7186e94640 1 -- start start 2024-09-17T03:15:41.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.051+0000 7f7186e94640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f718006f1d0 0x7f718015bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.051+0000 7f7186e94640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f71800743a0 0x7f718014d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.051+0000 7f7186e94640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f718015b660 0x7f718015e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.051+0000 7f7186e94640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7180074cf0 con 0x7f718006f1d0 2024-09-17T03:15:41.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.051+0000 7f7186e94640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f718006efc0 con 0x7f71800743a0 2024-09-17T03:15:41.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.051+0000 7f7186e94640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7180074e70 con 0x7f718015b660 2024-09-17T03:15:41.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.051+0000 7f7184c30640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f718006f1d0 0x7f718015bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.051+0000 7f7184c30640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f718006f1d0 0x7f718015bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:60988/0 (socket says 172.21.15.78:60988) 2024-09-17T03:15:41.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.051+0000 7f7184c30640 1 -- 172.21.15.78:0/1979447588 learned_addr learned my addr 172.21.15.78:0/1979447588 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:41.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.052+0000 7f717ffff640 1 --2- 172.21.15.78:0/1979447588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f71800743a0 0x7f718014d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.052+0000 7f7185431640 1 --2- 172.21.15.78:0/1979447588 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f718015b660 0x7f718015e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.052+0000 7f7184c30640 1 -- 172.21.15.78:0/1979447588 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f718015b660 msgr2=0x7f718015e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.052+0000 7f7184c30640 1 --2- 172.21.15.78:0/1979447588 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f718015b660 0x7f718015e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.052+0000 7f7184c30640 1 -- 172.21.15.78:0/1979447588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f71800743a0 msgr2=0x7f718014d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.052+0000 7f7184c30640 1 --2- 172.21.15.78:0/1979447588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f71800743a0 0x7f718014d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.052+0000 7f7184c30640 1 -- 172.21.15.78:0/1979447588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7180158ce0 con 0x7f718006f1d0 2024-09-17T03:15:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.052+0000 7f717ffff640 1 --2- 172.21.15.78:0/1979447588 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f71800743a0 0x7f718014d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.052+0000 7f7184c30640 1 --2- 172.21.15.78:0/1979447588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f718006f1d0 0x7f718015bb90 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f7178034040 tx=0x7f71780038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.052+0000 7f717d7fa640 1 -- 172.21.15.78:0/1979447588 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717803e030 con 0x7f718006f1d0 2024-09-17T03:15:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.052+0000 7f717d7fa640 1 -- 172.21.15.78:0/1979447588 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7178003d90 con 0x7f718006f1d0 2024-09-17T03:15:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.052+0000 7f7186e94640 1 -- 172.21.15.78:0/1979447588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f718009c8d0 con 0x7f718006f1d0 2024-09-17T03:15:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.052+0000 7f717d7fa640 1 -- 172.21.15.78:0/1979447588 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7178035040 con 0x7f718006f1d0 2024-09-17T03:15:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.052+0000 7f7186e94640 1 -- 172.21.15.78:0/1979447588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f718009ce90 con 0x7f718006f1d0 2024-09-17T03:15:41.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.053+0000 7f7186e94640 1 -- 172.21.15.78:0/1979447588 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f718009d270 con 0x7f718006f1d0 2024-09-17T03:15:41.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.054+0000 7f717d7fa640 1 -- 172.21.15.78:0/1979447588 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7178041030 con 0x7f718006f1d0 2024-09-17T03:15:41.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.054+0000 7f717d7fa640 1 --2- 172.21.15.78:0/1979447588 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7160078b90 0x7f716007b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.054+0000 7f717d7fa640 1 -- 172.21.15.78:0/1979447588 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7f71780bb5f0 con 0x7f718006f1d0 2024-09-17T03:15:41.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.054+0000 7f717d7fa640 1 --2- 172.21.15.78:0/1979447588 >> [v2:172.21.15.193:6826/443819515,v1:172.21.15.193:6827/443819515] conn(0x7f716007ebe0 0x7f7160081030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.055+0000 7f717d7fa640 1 -- 172.21.15.78:0/1979447588 --> [v2:172.21.15.193:6826/443819515,v1:172.21.15.193:6827/443819515] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7178005310 con 0x7f716007ebe0 2024-09-17T03:15:41.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.055+0000 7f717d7fa640 1 -- 172.21.15.78:0/1979447588 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f71780c2050 con 0x7f718006f1d0 2024-09-17T03:15:41.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.055+0000 7f717ffff640 1 --2- 172.21.15.78:0/1979447588 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7160078b90 0x7f716007b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.055+0000 7f7185431640 1 --2- 172.21.15.78:0/1979447588 >> [v2:172.21.15.193:6826/443819515,v1:172.21.15.193:6827/443819515] conn(0x7f716007ebe0 0x7f7160081030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.055+0000 7f717ffff640 1 --2- 172.21.15.78:0/1979447588 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7160078b90 0x7f716007b0a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7170007fd0 tx=0x7f7170009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:41.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.055+0000 7f7185431640 1 --2- 172.21.15.78:0/1979447588 >> [v2:172.21.15.193:6826/443819515,v1:172.21.15.193:6827/443819515] conn(0x7f716007ebe0 0x7f7160081030 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:41.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.056+0000 7f717d7fa640 1 -- 172.21.15.78:0/1979447588 <== osd.4 v2:172.21.15.193:6826/443819515 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7178005310 con 0x7f716007ebe0 2024-09-17T03:15:41.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.068+0000 7f7186e94640 1 -- 172.21.15.78:0/1979447588 --> [v2:172.21.15.193:6826/443819515,v1:172.21.15.193:6827/443819515] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7180075340 con 0x7f716007ebe0 2024-09-17T03:15:41.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.069+0000 7f717d7fa640 1 -- 172.21.15.78:0/1979447588 <== osd.4 v2:172.21.15.193:6826/443819515 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7180075340 con 0x7f716007ebe0 2024-09-17T03:15:41.068 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:41.068 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:15:41.068 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:41.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.069+0000 7f7186e94640 1 -- 172.21.15.78:0/1979447588 >> [v2:172.21.15.193:6826/443819515,v1:172.21.15.193:6827/443819515] conn(0x7f716007ebe0 msgr2=0x7f7160081030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.069+0000 7f7186e94640 1 --2- 172.21.15.78:0/1979447588 >> [v2:172.21.15.193:6826/443819515,v1:172.21.15.193:6827/443819515] conn(0x7f716007ebe0 0x7f7160081030 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.069+0000 7f7186e94640 1 -- 172.21.15.78:0/1979447588 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7160078b90 msgr2=0x7f716007b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.069+0000 7f7186e94640 1 --2- 172.21.15.78:0/1979447588 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7160078b90 0x7f716007b0a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f7170007fd0 tx=0x7f7170009040 comp rx=0 tx=0).stop 2024-09-17T03:15:41.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.069+0000 7f7186e94640 1 -- 172.21.15.78:0/1979447588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f718006f1d0 msgr2=0x7f718015bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.069+0000 7f7186e94640 1 --2- 172.21.15.78:0/1979447588 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f718006f1d0 0x7f718015bb90 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f7178034040 tx=0x7f71780038a0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.069+0000 7f7185431640 1 -- 172.21.15.78:0/1979447588 reap_dead start 2024-09-17T03:15:41.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.069+0000 7f7186e94640 1 -- 172.21.15.78:0/1979447588 shutdown_connections 2024-09-17T03:15:41.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.069+0000 7f7186e94640 1 -- 172.21.15.78:0/1979447588 >> 172.21.15.78:0/1979447588 conn(0x7f71800d0130 msgr2=0x7f71800afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:41.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.069+0000 7f7186e94640 1 -- 172.21.15.78:0/1979447588 shutdown_connections 2024-09-17T03:15:41.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.069+0000 7f7186e94640 1 -- 172.21.15.78:0/1979447588 wait complete. 2024-09-17T03:15:41.078 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-17T03:15:41.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.193+0000 7fb537c30640 1 -- 172.21.15.78:0/3540902567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5300ca800 msgr2=0x7fb5300cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.193+0000 7fb537c30640 1 --2- 172.21.15.78:0/3540902567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5300ca800 0x7fb5300cba00 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fb52c005fd0 tx=0x7fb52c02a5d0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.193+0000 7fb537c30640 1 -- 172.21.15.78:0/3540902567 shutdown_connections 2024-09-17T03:15:41.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.193+0000 7fb537c30640 1 --2- 172.21.15.78:0/3540902567 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb5300cad30 0x7fb53006ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.193+0000 7fb537c30640 1 --2- 172.21.15.78:0/3540902567 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5300ca800 0x7fb5300cba00 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.193+0000 7fb537c30640 1 -- 172.21.15.78:0/3540902567 >> 172.21.15.78:0/3540902567 conn(0x7fb5300b1cb0 msgr2=0x7fb5300b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:41.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.193+0000 7fb537c30640 1 -- 172.21.15.78:0/3540902567 shutdown_connections 2024-09-17T03:15:41.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.193+0000 7fb537c30640 1 -- 172.21.15.78:0/3540902567 wait complete. 2024-09-17T03:15:41.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.195+0000 7fb537c30640 1 Processor -- start 2024-09-17T03:15:41.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.195+0000 7fb537c30640 1 -- start start 2024-09-17T03:15:41.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.196+0000 7fb537c30640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5300704e0 0x7fb53009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.196+0000 7fb537c30640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb5300ca800 0x7fb5301f7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.196+0000 7fb537c30640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5300cad30 0x7fb5301533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.196+0000 7fb537c30640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fb5300ccf40 con 0x7fb5300cad30 2024-09-17T03:15:41.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.196+0000 7fb537c30640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb5300747d0 con 0x7fb5300704e0 2024-09-17T03:15:41.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.196+0000 7fb537c30640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb5300cd0c0 con 0x7fb5300ca800 2024-09-17T03:15:41.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.196+0000 7fb5361cd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5300cad30 0x7fb5301533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.196+0000 7fb5361cd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5300cad30 0x7fb5301533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32768/0 (socket says 172.21.15.78:32768) 2024-09-17T03:15:41.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.196+0000 7fb5361cd640 1 -- 172.21.15.78:0/1524751998 learned_addr learned my addr 172.21.15.78:0/1524751998 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:41.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.196+0000 7fb5359cc640 1 --2- 172.21.15.78:0/1524751998 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5300704e0 0x7fb53009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.196+0000 7fb5351cb640 1 --2- 172.21.15.78:0/1524751998 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb5300ca800 0x7fb5301f7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.196+0000 7fb5361cd640 1 -- 172.21.15.78:0/1524751998 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb5300ca800 msgr2=0x7fb5301f7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.196+0000 7fb5361cd640 1 --2- 172.21.15.78:0/1524751998 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb5300ca800 0x7fb5301f7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.196+0000 7fb5361cd640 1 -- 172.21.15.78:0/1524751998 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5300704e0 msgr2=0x7fb53009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.196+0000 7fb5361cd640 1 --2- 172.21.15.78:0/1524751998 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5300704e0 0x7fb53009aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.196+0000 7fb5361cd640 1 -- 172.21.15.78:0/1524751998 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb53014fd40 con 0x7fb5300cad30 2024-09-17T03:15:41.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.196+0000 7fb5359cc640 1 --2- 172.21.15.78:0/1524751998 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5300704e0 0x7fb53009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:41.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.196+0000 7fb5361cd640 1 --2- 172.21.15.78:0/1524751998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5300cad30 0x7fb5301533f0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fb52800c6b0 tx=0x7fb52800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:41.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.197+0000 7fb5267fc640 1 -- 172.21.15.78:0/1524751998 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb528003b70 con 0x7fb5300cad30 2024-09-17T03:15:41.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.197+0000 7fb5267fc640 1 -- 172.21.15.78:0/1524751998 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb528003d10 con 0x7fb5300cad30 2024-09-17T03:15:41.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.197+0000 7fb537c30640 1 -- 172.21.15.78:0/1524751998 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5301f7570 con 0x7fb5300cad30 2024-09-17T03:15:41.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.197+0000 7fb5267fc640 1 -- 172.21.15.78:0/1524751998 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb528005330 con 0x7fb5300cad30 2024-09-17T03:15:41.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.197+0000 7fb537c30640 1 -- 172.21.15.78:0/1524751998 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5301f7b20 con 0x7fb5300cad30 2024-09-17T03:15:41.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.198+0000 7fb537c30640 1 -- 172.21.15.78:0/1524751998 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5300b2510 con 0x7fb5300cad30 2024-09-17T03:15:41.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.198+0000 7fb5267fc640 1 -- 172.21.15.78:0/1524751998 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb5280054d0 con 0x7fb5300cad30 2024-09-17T03:15:41.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.199+0000 7fb5267fc640 1 --2- 172.21.15.78:0/1524751998 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb514078b90 0x7fb51407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.199+0000 7fb5267fc640 1 -- 172.21.15.78:0/1524751998 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7fb52809a930 con 0x7fb5300cad30 2024-09-17T03:15:41.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.199+0000 7fb5359cc640 1 --2- 172.21.15.78:0/1524751998 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb514078b90 0x7fb51407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.200+0000 7fb5359cc640 1 --2- 172.21.15.78:0/1524751998 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb514078b90 0x7fb51407b0a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb52c033000 tx=0x7fb52c004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:41.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.203+0000 7fb5267fc640 1 -- 172.21.15.78:0/1524751998 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fb5300b2510 con 0x7fb5300cad30 2024-09-17T03:15:41.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.377+0000 7fb537c30640 1 -- 172.21.15.78:0/1524751998 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fb5300cd650 con 0x7fb514078b90 2024-09-17T03:15:41.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.377+0000 7fb5267fc640 1 -- 172.21.15.78:0/1524751998 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb5300cd650 con 0x7fb514078b90 2024-09-17T03:15:41.376 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 4 to deep-scrub 2024-09-17T03:15:41.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.379+0000 7fb537c30640 1 -- 172.21.15.78:0/1524751998 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb514078b90 msgr2=0x7fb51407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.379+0000 7fb537c30640 1 --2- 172.21.15.78:0/1524751998 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb514078b90 0x7fb51407b0a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb52c033000 tx=0x7fb52c004730 comp rx=0 tx=0).stop 2024-09-17T03:15:41.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.379+0000 7fb537c30640 1 -- 172.21.15.78:0/1524751998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5300cad30 msgr2=0x7fb5301533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.379+0000 7fb537c30640 1 --2- 172.21.15.78:0/1524751998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5300cad30 0x7fb5301533f0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fb52800c6b0 tx=0x7fb52800cb70 comp rx=0 tx=0).stop 2024-09-17T03:15:41.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.379+0000 7fb537c30640 1 -- 172.21.15.78:0/1524751998 shutdown_connections 2024-09-17T03:15:41.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.379+0000 7fb537c30640 1 --2- 172.21.15.78:0/1524751998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb5300cad30 0x7fb5301533f0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.379+0000 7fb537c30640 1 --2- 172.21.15.78:0/1524751998 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb5300ca800 0x7fb5301f7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.379+0000 7fb537c30640 1 --2- 172.21.15.78:0/1524751998 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fb514078b90 0x7fb51407b0a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.379+0000 7fb537c30640 1 --2- 172.21.15.78:0/1524751998 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5300704e0 0x7fb53009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.379+0000 7fb537c30640 1 -- 172.21.15.78:0/1524751998 >> 172.21.15.78:0/1524751998 conn(0x7fb5300b1cb0 msgr2=0x7fb530073cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:41.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.379+0000 7fb537c30640 1 -- 172.21.15.78:0/1524751998 shutdown_connections 2024-09-17T03:15:41.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.379+0000 7fb537c30640 1 -- 172.21.15.78:0/1524751998 wait complete. 2024-09-17T03:15:41.389 INFO:tasks.ceph:Scrubbing osd.5 2024-09-17T03:15:41.389 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:15:41.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.507+0000 7f7aeb6f9640 1 -- 172.21.15.78:0/903081334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae40743a0 msgr2=0x7f7ae40747b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.507+0000 7f7aeb6f9640 1 --2- 172.21.15.78:0/903081334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae40743a0 0x7f7ae40747b0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f7adc005fd0 tx=0x7f7adc02a410 comp rx=0 tx=0).stop 2024-09-17T03:15:41.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.507+0000 7f7aeb6f9640 1 -- 172.21.15.78:0/903081334 shutdown_connections 2024-09-17T03:15:41.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.507+0000 7f7aeb6f9640 1 --2- 172.21.15.78:0/903081334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae40743a0 0x7f7ae40747b0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.507+0000 7f7aeb6f9640 1 --2- 172.21.15.78:0/903081334 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ae406f1d0 0x7f7ae415f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.507+0000 7f7aeb6f9640 1 -- 172.21.15.78:0/903081334 >> 172.21.15.78:0/903081334 conn(0x7f7ae40d0130 msgr2=0x7f7ae40d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:41.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.507+0000 7f7aeb6f9640 1 -- 172.21.15.78:0/903081334 shutdown_connections 2024-09-17T03:15:41.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.507+0000 7f7aeb6f9640 1 -- 172.21.15.78:0/903081334 wait complete. 2024-09-17T03:15:41.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.509+0000 7f7aeb6f9640 1 Processor -- start 2024-09-17T03:15:41.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.509+0000 7f7aeb6f9640 1 -- start start 2024-09-17T03:15:41.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.510+0000 7f7aeb6f9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae406f1d0 0x7f7ae41f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.510+0000 7f7aeb6f9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ae40743a0 0x7f7ae40cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.510+0000 7f7aeb6f9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ae415b660 0x7f7ae406f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.510+0000 7f7aeb6f9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae4074cf0 con 0x7f7ae406f1d0 2024-09-17T03:15:41.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.510+0000 7f7aeb6f9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae406efc0 con 0x7f7ae40743a0 2024-09-17T03:15:41.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.510+0000 7f7aeb6f9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae4074e70 con 0x7f7ae415b660 2024-09-17T03:15:41.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.510+0000 7f7ae9495640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae406f1d0 0x7f7ae41f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.510+0000 7f7ae9495640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae406f1d0 0x7f7ae41f74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32776/0 (socket says 172.21.15.78:32776) 2024-09-17T03:15:41.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.510+0000 7f7ae9495640 1 -- 172.21.15.78:0/1122105791 learned_addr learned my addr 172.21.15.78:0/1122105791 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:41.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.511+0000 7f7ae8c94640 1 --2- 172.21.15.78:0/1122105791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ae40743a0 0x7f7ae40cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.511+0000 7f7ae9c96640 1 --2- 172.21.15.78:0/1122105791 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ae415b660 0x7f7ae406f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.511+0000 7f7ae9495640 1 -- 172.21.15.78:0/1122105791 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ae415b660 msgr2=0x7f7ae406f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.511+0000 7f7ae9495640 1 --2- 172.21.15.78:0/1122105791 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ae415b660 0x7f7ae406f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.511+0000 7f7ae9495640 1 -- 172.21.15.78:0/1122105791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ae40743a0 msgr2=0x7f7ae40cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.511+0000 7f7ae9495640 1 --2- 172.21.15.78:0/1122105791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ae40743a0 0x7f7ae40cb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.511+0000 7f7ae9495640 1 -- 172.21.15.78:0/1122105791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae41f3980 con 0x7f7ae406f1d0 2024-09-17T03:15:41.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.511+0000 7f7ae9c96640 1 --2- 172.21.15.78:0/1122105791 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7ae415b660 0x7f7ae406f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:41.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.511+0000 7f7ae8c94640 1 --2- 172.21.15.78:0/1122105791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7ae40743a0 0x7f7ae40cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:41.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.511+0000 7f7ae9495640 1 --2- 172.21.15.78:0/1122105791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae406f1d0 0x7f7ae41f74a0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000cce0 tx=0x7f7ae000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:41.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.511+0000 7f7ad9ffb640 1 -- 172.21.15.78:0/1122105791 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae000f450 con 0x7f7ae406f1d0 2024-09-17T03:15:41.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.511+0000 7f7ad9ffb640 1 -- 172.21.15.78:0/1122105791 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ae000f6e0 con 0x7f7ae406f1d0 2024-09-17T03:15:41.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.511+0000 7f7aeb6f9640 1 -- 172.21.15.78:0/1122105791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae41f3c60 con 0x7f7ae406f1d0 2024-09-17T03:15:41.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.511+0000 7f7ad9ffb640 1 -- 172.21.15.78:0/1122105791 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae000fb30 con 0x7f7ae406f1d0 2024-09-17T03:15:41.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.511+0000 7f7aeb6f9640 1 -- 172.21.15.78:0/1122105791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae41f4220 con 0x7f7ae406f1d0 2024-09-17T03:15:41.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.512+0000 7f7aeb6f9640 1 -- 172.21.15.78:0/1122105791 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7ae4075390 con 0x7f7ae406f1d0 2024-09-17T03:15:41.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.513+0000 7f7ad9ffb640 1 -- 172.21.15.78:0/1122105791 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7ae000fcd0 con 0x7f7ae406f1d0 2024-09-17T03:15:41.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.513+0000 7f7ad9ffb640 1 --2- 172.21.15.78:0/1122105791 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7ac8078b90 0x7f7ac807b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.513+0000 7f7ad9ffb640 1 -- 172.21.15.78:0/1122105791 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7f7ae009b710 con 0x7f7ae406f1d0 2024-09-17T03:15:41.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.513+0000 7f7ad9ffb640 1 --2- 172.21.15.78:0/1122105791 >> [v2:172.21.15.193:6810/399195358,v1:172.21.15.193:6811/399195358] conn(0x7f7ac807ebe0 0x7f7ac8081030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.513+0000 7f7ad9ffb640 1 -- 172.21.15.78:0/1122105791 --> [v2:172.21.15.193:6810/399195358,v1:172.21.15.193:6811/399195358] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ae0015e50 con 0x7f7ac807ebe0 2024-09-17T03:15:41.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.513+0000 7f7ae8c94640 1 --2- 172.21.15.78:0/1122105791 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7ac8078b90 0x7f7ac807b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.513+0000 7f7ad9ffb640 1 -- 172.21.15.78:0/1122105791 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f7ae00a2050 con 0x7f7ae406f1d0 2024-09-17T03:15:41.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.514+0000 7f7ae9c96640 1 --2- 172.21.15.78:0/1122105791 >> [v2:172.21.15.193:6810/399195358,v1:172.21.15.193:6811/399195358] conn(0x7f7ac807ebe0 0x7f7ac8081030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.514+0000 7f7ae8c94640 1 --2- 172.21.15.78:0/1122105791 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7ac8078b90 0x7f7ac807b0a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7ae409db00 tx=0x7f7ad4008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:41.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.514+0000 7f7ae9c96640 1 --2- 172.21.15.78:0/1122105791 >> [v2:172.21.15.193:6810/399195358,v1:172.21.15.193:6811/399195358] conn(0x7f7ac807ebe0 0x7f7ac8081030 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:41.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.515+0000 7f7ad9ffb640 1 -- 172.21.15.78:0/1122105791 <== osd.5 v2:172.21.15.193:6810/399195358 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7ae0015e50 con 0x7f7ac807ebe0 2024-09-17T03:15:41.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.527+0000 7f7aeb6f9640 1 -- 172.21.15.78:0/1122105791 --> [v2:172.21.15.193:6810/399195358,v1:172.21.15.193:6811/399195358] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7ae40cf840 con 0x7f7ac807ebe0 2024-09-17T03:15:41.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.528+0000 7f7ad9ffb640 1 -- 172.21.15.78:0/1122105791 <== osd.5 v2:172.21.15.193:6810/399195358 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7ae40cf840 con 0x7f7ac807ebe0 2024-09-17T03:15:41.527 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:41.527 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:15:41.527 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:41.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.528+0000 7f7aeb6f9640 1 -- 172.21.15.78:0/1122105791 >> [v2:172.21.15.193:6810/399195358,v1:172.21.15.193:6811/399195358] conn(0x7f7ac807ebe0 msgr2=0x7f7ac8081030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.528+0000 7f7aeb6f9640 1 --2- 172.21.15.78:0/1122105791 >> [v2:172.21.15.193:6810/399195358,v1:172.21.15.193:6811/399195358] conn(0x7f7ac807ebe0 0x7f7ac8081030 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.528+0000 7f7aeb6f9640 1 -- 172.21.15.78:0/1122105791 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7ac8078b90 msgr2=0x7f7ac807b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.528+0000 7f7aeb6f9640 1 --2- 172.21.15.78:0/1122105791 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f7ac8078b90 0x7f7ac807b0a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7ae409db00 tx=0x7f7ad4008040 comp rx=0 tx=0).stop 2024-09-17T03:15:41.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.528+0000 7f7aeb6f9640 1 -- 172.21.15.78:0/1122105791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae406f1d0 msgr2=0x7f7ae41f74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.528+0000 7f7aeb6f9640 1 --2- 172.21.15.78:0/1122105791 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7ae406f1d0 0x7f7ae41f74a0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f7ae000cce0 tx=0x7f7ae000a620 comp rx=0 tx=0).stop 2024-09-17T03:15:41.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.528+0000 7f7ae9c96640 1 -- 172.21.15.78:0/1122105791 reap_dead start 2024-09-17T03:15:41.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.528+0000 7f7aeb6f9640 1 -- 172.21.15.78:0/1122105791 shutdown_connections 2024-09-17T03:15:41.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.528+0000 7f7aeb6f9640 1 -- 172.21.15.78:0/1122105791 >> 172.21.15.78:0/1122105791 conn(0x7f7ae40d0130 msgr2=0x7f7ae40ae910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:41.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.528+0000 7f7aeb6f9640 1 -- 172.21.15.78:0/1122105791 shutdown_connections 2024-09-17T03:15:41.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.529+0000 7f7aeb6f9640 1 -- 172.21.15.78:0/1122105791 wait complete. 2024-09-17T03:15:41.538 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-17T03:15:41.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.652+0000 7fceedcf9640 1 -- 172.21.15.78:0/1178772237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee81600a0 msgr2=0x7fcee8071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.652+0000 7fceedcf9640 1 --2- 172.21.15.78:0/1178772237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee81600a0 0x7fcee8071250 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fced8009830 tx=0x7fced802a5c0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.652+0000 7fceedcf9640 1 -- 172.21.15.78:0/1178772237 shutdown_connections 2024-09-17T03:15:41.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.652+0000 7fceedcf9640 1 --2- 172.21.15.78:0/1178772237 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcee80ce7d0 0x7fcee806cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.652+0000 7fceedcf9640 1 --2- 172.21.15.78:0/1178772237 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee81600a0 0x7fcee8071250 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.652+0000 7fceedcf9640 1 -- 172.21.15.78:0/1178772237 >> 172.21.15.78:0/1178772237 conn(0x7fcee80cdcb0 msgr2=0x7fcee80ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:41.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.652+0000 7fceedcf9640 1 -- 172.21.15.78:0/1178772237 shutdown_connections 2024-09-17T03:15:41.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.652+0000 7fceedcf9640 1 -- 172.21.15.78:0/1178772237 wait complete. 2024-09-17T03:15:41.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.654+0000 7fceedcf9640 1 Processor -- start 2024-09-17T03:15:41.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.654+0000 7fceedcf9640 1 -- start start 2024-09-17T03:15:41.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.655+0000 7fceedcf9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee8070360 0x7fcee81f2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.655+0000 7fceedcf9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcee80ce7d0 0x7fcee80c9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.655+0000 7fceedcf9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcee81600a0 0x7fcee80c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.655+0000 7fceedcf9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fcee80b33c0 con 0x7fcee8070360 2024-09-17T03:15:41.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.655+0000 7fceedcf9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcee806d700 con 0x7fcee81600a0 2024-09-17T03:15:41.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.655+0000 7fceedcf9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fcee80b3540 con 0x7fcee80ce7d0 2024-09-17T03:15:41.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.655+0000 7fcee77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee8070360 0x7fcee81f2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.655+0000 7fcee77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee8070360 0x7fcee81f2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32796/0 (socket says 172.21.15.78:32796) 2024-09-17T03:15:41.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.655+0000 7fcee77fe640 1 -- 172.21.15.78:0/3254043623 learned_addr learned my addr 172.21.15.78:0/3254043623 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:41.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.655+0000 7fcee7fff640 1 --2- 172.21.15.78:0/3254043623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcee81600a0 0x7fcee80c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.655+0000 7fcee6ffd640 1 --2- 172.21.15.78:0/3254043623 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcee80ce7d0 0x7fcee80c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.656+0000 7fcee77fe640 1 -- 172.21.15.78:0/3254043623 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcee80ce7d0 msgr2=0x7fcee80c9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.656+0000 7fcee77fe640 1 --2- 172.21.15.78:0/3254043623 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcee80ce7d0 0x7fcee80c9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.656+0000 7fcee77fe640 1 -- 172.21.15.78:0/3254043623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcee81600a0 msgr2=0x7fcee80c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.656+0000 7fcee77fe640 1 --2- 172.21.15.78:0/3254043623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcee81600a0 0x7fcee80c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.656+0000 7fcee77fe640 1 -- 172.21.15.78:0/3254043623 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee80cc240 con 0x7fcee8070360 2024-09-17T03:15:41.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.656+0000 7fcee6ffd640 1 --2- 172.21.15.78:0/3254043623 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcee80ce7d0 0x7fcee80c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:41.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.656+0000 7fcee77fe640 1 --2- 172.21.15.78:0/3254043623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee8070360 0x7fcee81f2fb0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fced8009950 tx=0x7fced8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:41.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.656+0000 7fcecffff640 1 -- 172.21.15.78:0/3254043623 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced8031d60 con 0x7fcee8070360 2024-09-17T03:15:41.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.656+0000 7fcecffff640 1 -- 172.21.15.78:0/3254043623 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fced8033e10 con 0x7fcee8070360 2024-09-17T03:15:41.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.656+0000 7fcecffff640 1 -- 172.21.15.78:0/3254043623 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced8005260 con 0x7fcee8070360 2024-09-17T03:15:41.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.656+0000 7fceedcf9640 1 -- 172.21.15.78:0/3254043623 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee80c9bf0 con 0x7fcee8070360 2024-09-17T03:15:41.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.656+0000 7fceedcf9640 1 -- 172.21.15.78:0/3254043623 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee80cc4e0 con 0x7fcee8070360 2024-09-17T03:15:41.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.657+0000 7fceedcf9640 1 -- 172.21.15.78:0/3254043623 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcee80b3980 con 0x7fcee8070360 2024-09-17T03:15:41.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.658+0000 7fcecffff640 1 -- 172.21.15.78:0/3254043623 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fced8005400 con 0x7fcee8070360 2024-09-17T03:15:41.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.658+0000 7fcecffff640 1 --2- 172.21.15.78:0/3254043623 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fced4078b90 0x7fced407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.659+0000 7fcecffff640 1 -- 172.21.15.78:0/3254043623 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7fced80bbd70 con 0x7fcee8070360 2024-09-17T03:15:41.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.659+0000 7fcee6ffd640 1 --2- 172.21.15.78:0/3254043623 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fced4078b90 0x7fced407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.659+0000 7fcee6ffd640 1 --2- 172.21.15.78:0/3254043623 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fced4078b90 0x7fced407b0a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcee80b00f0 tx=0x7fcedc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:41.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.663+0000 7fcecffff640 1 -- 172.21.15.78:0/3254043623 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fced803f030 con 0x7fcee8070360 2024-09-17T03:15:41.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.839+0000 7fceedcf9640 1 -- 172.21.15.78:0/3254043623 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fcee81f34f0 con 0x7fced4078b90 2024-09-17T03:15:41.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.840+0000 7fcecffff640 1 -- 172.21.15.78:0/3254043623 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcedc0094a0 con 0x7fced4078b90 2024-09-17T03:15:41.839 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 5 to deep-scrub 2024-09-17T03:15:41.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.842+0000 7fceedcf9640 1 -- 172.21.15.78:0/3254043623 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fced4078b90 msgr2=0x7fced407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.842+0000 7fceedcf9640 1 --2- 172.21.15.78:0/3254043623 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fced4078b90 0x7fced407b0a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcee80b00f0 tx=0x7fcedc008040 comp rx=0 tx=0).stop 2024-09-17T03:15:41.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.842+0000 7fceedcf9640 1 -- 172.21.15.78:0/3254043623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee8070360 msgr2=0x7fcee81f2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.842+0000 7fceedcf9640 1 --2- 172.21.15.78:0/3254043623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee8070360 0x7fcee81f2fb0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fced8009950 tx=0x7fced8033c20 comp rx=0 tx=0).stop 2024-09-17T03:15:41.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.843+0000 7fceedcf9640 1 -- 172.21.15.78:0/3254043623 shutdown_connections 2024-09-17T03:15:41.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.843+0000 7fceedcf9640 1 --2- 172.21.15.78:0/3254043623 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fced4078b90 0x7fced407b0a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.843+0000 7fceedcf9640 1 --2- 172.21.15.78:0/3254043623 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcee81600a0 0x7fcee80c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.843+0000 7fceedcf9640 1 --2- 172.21.15.78:0/3254043623 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcee80ce7d0 0x7fcee80c9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.843+0000 7fceedcf9640 1 --2- 172.21.15.78:0/3254043623 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcee8070360 0x7fcee81f2fb0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.843+0000 7fceedcf9640 1 -- 172.21.15.78:0/3254043623 >> 172.21.15.78:0/3254043623 conn(0x7fcee80cdcb0 msgr2=0x7fcee815a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:41.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.843+0000 7fceedcf9640 1 -- 172.21.15.78:0/3254043623 shutdown_connections 2024-09-17T03:15:41.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.843+0000 7fceedcf9640 1 -- 172.21.15.78:0/3254043623 wait complete. 2024-09-17T03:15:41.852 INFO:tasks.ceph:Scrubbing osd.6 2024-09-17T03:15:41.853 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:15:41.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.970+0000 7f0d5cf4a640 1 -- 172.21.15.78:0/3189711196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d58160f70 msgr2=0x7f0d580d0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.970+0000 7f0d5cf4a640 1 --2- 172.21.15.78:0/3189711196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d58160f70 0x7f0d580d0160 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f0d580d00b0 tx=0x7f0d5002a4d0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.970+0000 7f0d5cf4a640 1 -- 172.21.15.78:0/3189711196 shutdown_connections 2024-09-17T03:15:41.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.970+0000 7f0d5cf4a640 1 --2- 172.21.15.78:0/3189711196 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d58160f70 0x7f0d580d0160 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.970+0000 7f0d5cf4a640 1 --2- 172.21.15.78:0/3189711196 >> v2:172.21.15.193:3300/0 conn(0x7f0d580cf3d0 0x7f0d58160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.970+0000 7f0d5cf4a640 1 -- 172.21.15.78:0/3189711196 >> 172.21.15.78:0/3189711196 conn(0x7f0d5806d550 msgr2=0x7f0d58071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:41.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.970+0000 7f0d5cf4a640 1 -- 172.21.15.78:0/3189711196 shutdown_connections 2024-09-17T03:15:41.970 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.970+0000 7f0d5cf4a640 1 -- 172.21.15.78:0/3189711196 wait complete. 2024-09-17T03:15:41.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.972+0000 7f0d5cf4a640 1 Processor -- start 2024-09-17T03:15:41.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.972+0000 7f0d5cf4a640 1 -- start start 2024-09-17T03:15:41.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.973+0000 7f0d5cf4a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d580ccb70 0x7f0d58153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.973+0000 7f0d5cf4a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d58160f70 0x7f0d5806e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.973+0000 7f0d5cf4a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0d580b1ec0 0x7f0d580b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.973+0000 7f0d5cf4a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f0d580d0a30 con 0x7f0d580ccb70 2024-09-17T03:15:41.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.973+0000 7f0d5cf4a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0d580d08b0 con 0x7f0d58160f70 2024-09-17T03:15:41.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.973+0000 7f0d5cf4a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0d580d0bb0 con 0x7f0d580b1ec0 2024-09-17T03:15:41.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.974+0000 7f0d5659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d580ccb70 0x7f0d58153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.974+0000 7f0d5659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d580ccb70 0x7f0d58153950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32814/0 (socket says 172.21.15.78:32814) 2024-09-17T03:15:41.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.974+0000 7f0d5659c640 1 -- 172.21.15.78:0/1446217553 learned_addr learned my addr 172.21.15.78:0/1446217553 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:41.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.974+0000 7f0d55d9b640 1 --2- 172.21.15.78:0/1446217553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d58160f70 0x7f0d5806e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.974+0000 7f0d56d9d640 1 --2- 172.21.15.78:0/1446217553 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0d580b1ec0 0x7f0d580b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.974+0000 7f0d5659c640 1 -- 172.21.15.78:0/1446217553 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0d580b1ec0 msgr2=0x7f0d580b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.974+0000 7f0d5659c640 1 --2- 172.21.15.78:0/1446217553 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0d580b1ec0 0x7f0d580b22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.974+0000 7f0d5659c640 1 -- 172.21.15.78:0/1446217553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d58160f70 msgr2=0x7f0d5806e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.974+0000 7f0d5659c640 1 --2- 172.21.15.78:0/1446217553 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0d58160f70 0x7f0d5806e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.974+0000 7f0d5659c640 1 -- 172.21.15.78:0/1446217553 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d580c6c60 con 0x7f0d580ccb70 2024-09-17T03:15:41.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.974+0000 7f0d5659c640 1 --2- 172.21.15.78:0/1446217553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d580ccb70 0x7f0d58153950 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800ba50 tx=0x7f0d4800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:41.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.974+0000 7f0d4effd640 1 -- 172.21.15.78:0/1446217553 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d48019070 con 0x7f0d580ccb70 2024-09-17T03:15:41.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.974+0000 7f0d4effd640 1 -- 172.21.15.78:0/1446217553 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d4800cc40 con 0x7f0d580ccb70 2024-09-17T03:15:41.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.974+0000 7f0d5cf4a640 1 -- 172.21.15.78:0/1446217553 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d580c6f40 con 0x7f0d580ccb70 2024-09-17T03:15:41.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.974+0000 7f0d4effd640 1 -- 172.21.15.78:0/1446217553 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d480146a0 con 0x7f0d580ccb70 2024-09-17T03:15:41.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.974+0000 7f0d5cf4a640 1 -- 172.21.15.78:0/1446217553 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d580c7500 con 0x7f0d580ccb70 2024-09-17T03:15:41.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.975+0000 7f0d5cf4a640 1 -- 172.21.15.78:0/1446217553 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0d580d10f0 con 0x7f0d580ccb70 2024-09-17T03:15:41.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.976+0000 7f0d4effd640 1 -- 172.21.15.78:0/1446217553 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0d4801d3f0 con 0x7f0d580ccb70 2024-09-17T03:15:41.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.976+0000 7f0d4effd640 1 --2- 172.21.15.78:0/1446217553 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0d38078bc0 0x7f0d3807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.977+0000 7f0d4effd640 1 -- 172.21.15.78:0/1446217553 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7f0d4809ac90 con 0x7f0d580ccb70 2024-09-17T03:15:41.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.977+0000 7f0d4effd640 1 --2- 172.21.15.78:0/1446217553 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x7f0d3807ec10 0x7f0d38081060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:41.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.977+0000 7f0d55d9b640 1 --2- 172.21.15.78:0/1446217553 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0d38078bc0 0x7f0d3807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.977+0000 7f0d4effd640 1 -- 172.21.15.78:0/1446217553 --> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0d48012e50 con 0x7f0d3807ec10 2024-09-17T03:15:41.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.977+0000 7f0d4effd640 1 -- 172.21.15.78:0/1446217553 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f0d4809b120 con 0x7f0d580ccb70 2024-09-17T03:15:41.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.977+0000 7f0d56d9d640 1 --2- 172.21.15.78:0/1446217553 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x7f0d3807ec10 0x7f0d38081060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:41.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.977+0000 7f0d55d9b640 1 --2- 172.21.15.78:0/1446217553 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0d38078bc0 0x7f0d3807b0d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0d580ccb40 tx=0x7f0d40005f60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:41.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.977+0000 7f0d56d9d640 1 --2- 172.21.15.78:0/1446217553 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x7f0d3807ec10 0x7f0d38081060 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:41.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.978+0000 7f0d4effd640 1 -- 172.21.15.78:0/1446217553 <== osd.6 v2:172.21.15.193:6818/2885678262 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0d48012e50 con 0x7f0d3807ec10 2024-09-17T03:15:41.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.991+0000 7f0d5cf4a640 1 -- 172.21.15.78:0/1446217553 --> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0d580b7bd0 con 0x7f0d3807ec10 2024-09-17T03:15:41.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.991+0000 7f0d4effd640 1 -- 172.21.15.78:0/1446217553 <== osd.6 v2:172.21.15.193:6818/2885678262 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0d580b7bd0 con 0x7f0d3807ec10 2024-09-17T03:15:41.990 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:41.990 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:15:41.990 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.992+0000 7f0d5cf4a640 1 -- 172.21.15.78:0/1446217553 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x7f0d3807ec10 msgr2=0x7f0d38081060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.992+0000 7f0d5cf4a640 1 --2- 172.21.15.78:0/1446217553 >> [v2:172.21.15.193:6818/2885678262,v1:172.21.15.193:6819/2885678262] conn(0x7f0d3807ec10 0x7f0d38081060 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:41.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.992+0000 7f0d5cf4a640 1 -- 172.21.15.78:0/1446217553 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0d38078bc0 msgr2=0x7f0d3807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.992+0000 7f0d5cf4a640 1 --2- 172.21.15.78:0/1446217553 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f0d38078bc0 0x7f0d3807b0d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0d580ccb40 tx=0x7f0d40005f60 comp rx=0 tx=0).stop 2024-09-17T03:15:41.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.992+0000 7f0d5cf4a640 1 -- 172.21.15.78:0/1446217553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d580ccb70 msgr2=0x7f0d58153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:41.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.992+0000 7f0d5cf4a640 1 --2- 172.21.15.78:0/1446217553 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0d580ccb70 0x7f0d58153950 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800ba50 tx=0x7f0d4800bf10 comp rx=0 tx=0).stop 2024-09-17T03:15:41.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.992+0000 7f0d56d9d640 1 -- 172.21.15.78:0/1446217553 reap_dead start 2024-09-17T03:15:41.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.992+0000 7f0d5cf4a640 1 -- 172.21.15.78:0/1446217553 shutdown_connections 2024-09-17T03:15:41.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.992+0000 7f0d5cf4a640 1 -- 172.21.15.78:0/1446217553 >> 172.21.15.78:0/1446217553 conn(0x7f0d5806d550 msgr2=0x7f0d5815f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:41.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.992+0000 7f0d5cf4a640 1 -- 172.21.15.78:0/1446217553 shutdown_connections 2024-09-17T03:15:41.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:41.992+0000 7f0d5cf4a640 1 -- 172.21.15.78:0/1446217553 wait complete. 2024-09-17T03:15:42.001 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-17T03:15:42.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.115+0000 7faf9f1ad640 1 -- 172.21.15.78:0/4275957998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf980b7fe0 msgr2=0x7faf980ced30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.115+0000 7faf9f1ad640 1 --2- 172.21.15.78:0/4275957998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf980b7fe0 0x7faf980ced30 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7faf98072440 tx=0x7faf8802a4d0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.115+0000 7faf9f1ad640 1 -- 172.21.15.78:0/4275957998 shutdown_connections 2024-09-17T03:15:42.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.115+0000 7faf9f1ad640 1 --2- 172.21.15.78:0/4275957998 >> v2:172.21.15.193:3300/0 conn(0x7faf980cf270 0x7faf98072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.115+0000 7faf9f1ad640 1 --2- 172.21.15.78:0/4275957998 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf980b7fe0 0x7faf980ced30 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.115+0000 7faf9f1ad640 1 --2- 172.21.15.78:0/4275957998 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faf980cd360 0x7faf9815c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.115+0000 7faf9f1ad640 1 -- 172.21.15.78:0/4275957998 >> 172.21.15.78:0/4275957998 conn(0x7faf980710b0 msgr2=0x7faf980714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:42.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.115+0000 7faf9f1ad640 1 -- 172.21.15.78:0/4275957998 shutdown_connections 2024-09-17T03:15:42.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.115+0000 7faf9f1ad640 1 -- 172.21.15.78:0/4275957998 wait complete. 2024-09-17T03:15:42.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.117+0000 7faf9f1ad640 1 Processor -- start 2024-09-17T03:15:42.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.117+0000 7faf9f1ad640 1 -- start start 2024-09-17T03:15:42.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.118+0000 7faf9f1ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf980b7fe0 0x7faf980cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.118+0000 7faf9f1ad640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faf980cd360 0x7faf9814ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.119+0000 7faf9f1ad640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf980cf270 0x7faf9814b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.119+0000 7faf9f1ad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7faf98073120 con 0x7faf980b7fe0 2024-09-17T03:15:42.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.119+0000 7faf9f1ad640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faf98072fa0 con 0x7faf980cf270 2024-09-17T03:15:42.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.119+0000 7faf9f1ad640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7faf980732a0 con 0x7faf980cd360 2024-09-17T03:15:42.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.119+0000 7faf9cf49640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf980b7fe0 0x7faf980cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:42.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.119+0000 7faf9cf49640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf980b7fe0 0x7faf980cb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32826/0 (socket says 172.21.15.78:32826) 2024-09-17T03:15:42.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.119+0000 7faf9cf49640 1 -- 172.21.15.78:0/1035048452 learned_addr learned my addr 172.21.15.78:0/1035048452 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:42.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.119+0000 7faf8ffff640 1 --2- 172.21.15.78:0/1035048452 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faf980cd360 0x7faf9814ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:42.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.119+0000 7faf9d74a640 1 --2- 172.21.15.78:0/1035048452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf980cf270 0x7faf9814b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:42.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.119+0000 7faf9cf49640 1 -- 172.21.15.78:0/1035048452 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faf980cd360 msgr2=0x7faf9814ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.119+0000 7faf9cf49640 1 --2- 172.21.15.78:0/1035048452 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faf980cd360 0x7faf9814ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.119+0000 7faf9cf49640 1 -- 172.21.15.78:0/1035048452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf980cf270 msgr2=0x7faf9814b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.119+0000 7faf9cf49640 1 --2- 172.21.15.78:0/1035048452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf980cf270 0x7faf9814b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.119+0000 7faf9cf49640 1 -- 172.21.15.78:0/1035048452 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf980ca590 con 0x7faf980b7fe0 2024-09-17T03:15:42.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.119+0000 7faf9cf49640 1 --2- 172.21.15.78:0/1035048452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf980b7fe0 0x7faf980cb630 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7faf9400d700 tx=0x7faf9400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:42.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.119+0000 7faf8d7fa640 1 -- 172.21.15.78:0/1035048452 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94017070 con 0x7faf980b7fe0 2024-09-17T03:15:42.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.119+0000 7faf8d7fa640 1 -- 172.21.15.78:0/1035048452 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf94005310 con 0x7faf980b7fe0 2024-09-17T03:15:42.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.119+0000 7faf9f1ad640 1 -- 172.21.15.78:0/1035048452 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf980ca870 con 0x7faf980b7fe0 2024-09-17T03:15:42.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.119+0000 7faf8d7fa640 1 -- 172.21.15.78:0/1035048452 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94009820 con 0x7faf980b7fe0 2024-09-17T03:15:42.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.119+0000 7faf9f1ad640 1 -- 172.21.15.78:0/1035048452 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf980cae30 con 0x7faf980b7fe0 2024-09-17T03:15:42.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.120+0000 7faf9f1ad640 1 -- 172.21.15.78:0/1035048452 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf9815c6a0 con 0x7faf980b7fe0 2024-09-17T03:15:42.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.121+0000 7faf8d7fa640 1 -- 172.21.15.78:0/1035048452 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7faf940099c0 con 0x7faf980b7fe0 2024-09-17T03:15:42.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.122+0000 7faf8d7fa640 1 --2- 172.21.15.78:0/1035048452 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7faf84078b90 0x7faf8407b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.122+0000 7faf8d7fa640 1 -- 172.21.15.78:0/1035048452 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7faf9409ab80 con 0x7faf980b7fe0 2024-09-17T03:15:42.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.122+0000 7faf8ffff640 1 --2- 172.21.15.78:0/1035048452 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7faf84078b90 0x7faf8407b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:42.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.122+0000 7faf8ffff640 1 --2- 172.21.15.78:0/1035048452 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7faf84078b90 0x7faf8407b0a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7faf88033000 tx=0x7faf88004730 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:42.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.126+0000 7faf8d7fa640 1 -- 172.21.15.78:0/1035048452 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7faf94062bc0 con 0x7faf980b7fe0 2024-09-17T03:15:42.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.304+0000 7faf9f1ad640 1 -- 172.21.15.78:0/1035048452 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7faf980b5f00 con 0x7faf84078b90 2024-09-17T03:15:42.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.305+0000 7faf8d7fa640 1 -- 172.21.15.78:0/1035048452 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faf980b5f00 con 0x7faf84078b90 2024-09-17T03:15:42.303 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 6 to deep-scrub 2024-09-17T03:15:42.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.307+0000 7faf9f1ad640 1 -- 172.21.15.78:0/1035048452 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7faf84078b90 msgr2=0x7faf8407b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.307+0000 7faf9f1ad640 1 --2- 172.21.15.78:0/1035048452 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7faf84078b90 0x7faf8407b0a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7faf88033000 tx=0x7faf88004730 comp rx=0 tx=0).stop 2024-09-17T03:15:42.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.307+0000 7faf9f1ad640 1 -- 172.21.15.78:0/1035048452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf980b7fe0 msgr2=0x7faf980cb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.307+0000 7faf9f1ad640 1 --2- 172.21.15.78:0/1035048452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf980b7fe0 0x7faf980cb630 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7faf9400d700 tx=0x7faf9400dbc0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.307+0000 7faf9f1ad640 1 -- 172.21.15.78:0/1035048452 shutdown_connections 2024-09-17T03:15:42.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.307+0000 7faf9f1ad640 1 --2- 172.21.15.78:0/1035048452 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7faf84078b90 0x7faf8407b0a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.307+0000 7faf9f1ad640 1 --2- 172.21.15.78:0/1035048452 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf980cf270 0x7faf9814b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.307+0000 7faf9f1ad640 1 --2- 172.21.15.78:0/1035048452 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faf980cd360 0x7faf9814ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.307+0000 7faf9f1ad640 1 --2- 172.21.15.78:0/1035048452 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf980b7fe0 0x7faf980cb630 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.307+0000 7faf9f1ad640 1 -- 172.21.15.78:0/1035048452 >> 172.21.15.78:0/1035048452 conn(0x7faf980710b0 msgr2=0x7faf980c7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:42.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.307+0000 7faf9f1ad640 1 -- 172.21.15.78:0/1035048452 shutdown_connections 2024-09-17T03:15:42.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.307+0000 7faf9f1ad640 1 -- 172.21.15.78:0/1035048452 wait complete. 2024-09-17T03:15:42.317 INFO:tasks.ceph:Scrubbing osd.7 2024-09-17T03:15:42.317 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-17T03:15:42.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.435+0000 7f995c227640 1 -- 172.21.15.78:0/2404103772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9940005300 msgr2=0x7f994000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.435+0000 7f995c227640 1 --2- 172.21.15.78:0/2404103772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9940005300 0x7f994000b9c0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f994c00c630 tx=0x7f9940005830 comp rx=0 tx=0).stop 2024-09-17T03:15:42.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.435+0000 7f995c227640 1 -- 172.21.15.78:0/2404103772 shutdown_connections 2024-09-17T03:15:42.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.435+0000 7f995c227640 1 --2- 172.21.15.78:0/2404103772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9940005300 0x7f994000b9c0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.435+0000 7f995c227640 1 -- 172.21.15.78:0/2404103772 >> 172.21.15.78:0/2404103772 conn(0x7f99540d0130 msgr2=0x7f99540d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:42.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.435+0000 7f995c227640 1 -- 172.21.15.78:0/2404103772 shutdown_connections 2024-09-17T03:15:42.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.435+0000 7f995c227640 1 -- 172.21.15.78:0/2404103772 wait complete. 2024-09-17T03:15:42.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.437+0000 7f995c227640 1 Processor -- start 2024-09-17T03:15:42.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.437+0000 7f995c227640 1 -- start start 2024-09-17T03:15:42.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.438+0000 7f995c227640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9940005300 0x7f99540b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.438+0000 7f995c227640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f995415e100 0x7f995414f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.438+0000 7f995c227640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f995409ca40 0x7f995409ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.438+0000 7f995c227640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f9954073830 con 0x7f995415e100 2024-09-17T03:15:42.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.438+0000 7f995c227640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f99540736b0 con 0x7f995409ca40 2024-09-17T03:15:42.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.438+0000 7f995c227640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f99540739b0 con 0x7f9940005300 2024-09-17T03:15:42.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.438+0000 7f99597c2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f995415e100 0x7f995414f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:42.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.438+0000 7f99597c2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f995415e100 0x7f995414f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32850/0 (socket says 172.21.15.78:32850) 2024-09-17T03:15:42.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.438+0000 7f99597c2640 1 -- 172.21.15.78:0/3140295040 learned_addr learned my addr 172.21.15.78:0/3140295040 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:42.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.438+0000 7f9959fc3640 1 --2- 172.21.15.78:0/3140295040 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9940005300 0x7f99540b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:42.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.438+0000 7f995a7c4640 1 --2- 172.21.15.78:0/3140295040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f995409ca40 0x7f995409ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:42.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.439+0000 7f99597c2640 1 -- 172.21.15.78:0/3140295040 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9940005300 msgr2=0x7f99540b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.439+0000 7f99597c2640 1 --2- 172.21.15.78:0/3140295040 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9940005300 0x7f99540b2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.439+0000 7f99597c2640 1 -- 172.21.15.78:0/3140295040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f995409ca40 msgr2=0x7f995409ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.439+0000 7f99597c2640 1 --2- 172.21.15.78:0/3140295040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f995409ca40 0x7f995409ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.439+0000 7f99597c2640 1 -- 172.21.15.78:0/3140295040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f995409d390 con 0x7f995415e100 2024-09-17T03:15:42.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.439+0000 7f99597c2640 1 --2- 172.21.15.78:0/3140295040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f995415e100 0x7f995414f4a0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f994400ec20 tx=0x7f994400b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:42.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.439+0000 7f994a7fc640 1 -- 172.21.15.78:0/3140295040 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994401d070 con 0x7f995415e100 2024-09-17T03:15:42.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.439+0000 7f994a7fc640 1 -- 172.21.15.78:0/3140295040 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9944018680 con 0x7f995415e100 2024-09-17T03:15:42.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.439+0000 7f995c227640 1 -- 172.21.15.78:0/3140295040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99540b3720 con 0x7f995415e100 2024-09-17T03:15:42.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.439+0000 7f994a7fc640 1 -- 172.21.15.78:0/3140295040 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994400ee60 con 0x7f995415e100 2024-09-17T03:15:42.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.439+0000 7f995c227640 1 -- 172.21.15.78:0/3140295040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99540b3ce0 con 0x7f995415e100 2024-09-17T03:15:42.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.440+0000 7f995c227640 1 -- 172.21.15.78:0/3140295040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f995415e510 con 0x7f995415e100 2024-09-17T03:15:42.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.441+0000 7f994a7fc640 1 -- 172.21.15.78:0/3140295040 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9944020070 con 0x7f995415e100 2024-09-17T03:15:42.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.441+0000 7f994a7fc640 1 --2- 172.21.15.78:0/3140295040 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9938078bc0 0x7f993807b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.441+0000 7f994a7fc640 1 -- 172.21.15.78:0/3140295040 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7f994409c330 con 0x7f995415e100 2024-09-17T03:15:42.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.441+0000 7f994a7fc640 1 --2- 172.21.15.78:0/3140295040 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x7f993807ec10 0x7f9938081060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.441+0000 7f994a7fc640 1 -- 172.21.15.78:0/3140295040 --> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9944015e50 con 0x7f993807ec10 2024-09-17T03:15:42.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.441+0000 7f994a7fc640 1 -- 172.21.15.78:0/3140295040 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=98) ==== 24+0+0 (secure 0 0 0) 0x7f99440a3050 con 0x7f995415e100 2024-09-17T03:15:42.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.441+0000 7f9959fc3640 1 --2- 172.21.15.78:0/3140295040 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9938078bc0 0x7f993807b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:42.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.442+0000 7f995a7c4640 1 --2- 172.21.15.78:0/3140295040 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x7f993807ec10 0x7f9938081060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:42.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.442+0000 7f9959fc3640 1 --2- 172.21.15.78:0/3140295040 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9938078bc0 0x7f993807b0d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f9950006680 tx=0x7f9950006b70 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:42.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.442+0000 7f995a7c4640 1 --2- 172.21.15.78:0/3140295040 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x7f993807ec10 0x7f9938081060 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:42.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.443+0000 7f994a7fc640 1 -- 172.21.15.78:0/3140295040 <== osd.7 v2:172.21.15.193:6802/216613644 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9944015e50 con 0x7f993807ec10 2024-09-17T03:15:42.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.455+0000 7f995c227640 1 -- 172.21.15.78:0/3140295040 --> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f99540b34d0 con 0x7f993807ec10 2024-09-17T03:15:42.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.456+0000 7f994a7fc640 1 -- 172.21.15.78:0/3140295040 <== osd.7 v2:172.21.15.193:6802/216613644 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f99540b34d0 con 0x7f993807ec10 2024-09-17T03:15:42.454 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-17T03:15:42.455 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T03:15:42.455 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-17T03:15:42.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.456+0000 7f995c227640 1 -- 172.21.15.78:0/3140295040 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x7f993807ec10 msgr2=0x7f9938081060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.456+0000 7f995c227640 1 --2- 172.21.15.78:0/3140295040 >> [v2:172.21.15.193:6802/216613644,v1:172.21.15.193:6803/216613644] conn(0x7f993807ec10 0x7f9938081060 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.456+0000 7f995c227640 1 -- 172.21.15.78:0/3140295040 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9938078bc0 msgr2=0x7f993807b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.456+0000 7f995c227640 1 --2- 172.21.15.78:0/3140295040 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f9938078bc0 0x7f993807b0d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f9950006680 tx=0x7f9950006b70 comp rx=0 tx=0).stop 2024-09-17T03:15:42.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.456+0000 7f995c227640 1 -- 172.21.15.78:0/3140295040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f995415e100 msgr2=0x7f995414f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.456+0000 7f995c227640 1 --2- 172.21.15.78:0/3140295040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f995415e100 0x7f995414f4a0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f994400ec20 tx=0x7f994400b730 comp rx=0 tx=0).stop 2024-09-17T03:15:42.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.456+0000 7f995a7c4640 1 -- 172.21.15.78:0/3140295040 reap_dead start 2024-09-17T03:15:42.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.456+0000 7f995c227640 1 -- 172.21.15.78:0/3140295040 shutdown_connections 2024-09-17T03:15:42.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.456+0000 7f995c227640 1 -- 172.21.15.78:0/3140295040 >> 172.21.15.78:0/3140295040 conn(0x7f99540d0130 msgr2=0x7f99540d0540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:42.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.456+0000 7f995c227640 1 -- 172.21.15.78:0/3140295040 shutdown_connections 2024-09-17T03:15:42.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.456+0000 7f995c227640 1 -- 172.21.15.78:0/3140295040 wait complete. 2024-09-17T03:15:42.465 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-17T03:15:42.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.579+0000 7f4846732640 1 -- 172.21.15.78:0/4264220649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48400b7cc0 msgr2=0x7f48400ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.579+0000 7f4846732640 1 --2- 172.21.15.78:0/4264220649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48400b7cc0 0x7f48400ccbc0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f4838005fd0 tx=0x7f483802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.579+0000 7f4846732640 1 -- 172.21.15.78:0/4264220649 shutdown_connections 2024-09-17T03:15:42.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.579+0000 7f4846732640 1 --2- 172.21.15.78:0/4264220649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48400b7cc0 0x7f48400ccbc0 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.579+0000 7f4846732640 1 -- 172.21.15.78:0/4264220649 >> 172.21.15.78:0/4264220649 conn(0x7f484006d4f0 msgr2=0x7f4840071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:42.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.579+0000 7f4846732640 1 -- 172.21.15.78:0/4264220649 shutdown_connections 2024-09-17T03:15:42.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.579+0000 7f4846732640 1 -- 172.21.15.78:0/4264220649 wait complete. 2024-09-17T03:15:42.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.580+0000 7f4846732640 1 Processor -- start 2024-09-17T03:15:42.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.581+0000 7f4846732640 1 -- start start 2024-09-17T03:15:42.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.582+0000 7f4846732640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f48400b7cc0 0x7f48400cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.582+0000 7f4846732640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48400cf320 0x7f484015b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.582+0000 7f4846732640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48401600b0 0x7f484015b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.582+0000 7f4846732640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f48400d15b0 con 0x7f48401600b0 2024-09-17T03:15:42.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.582+0000 7f4846732640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f48400d1430 con 0x7f48400cf320 2024-09-17T03:15:42.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.582+0000 7f4846732640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f48400d1730 con 0x7f48400b7cc0 2024-09-17T03:15:42.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.582+0000 7f4844ccf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48401600b0 0x7f484015b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:42.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.582+0000 7f4844ccf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48401600b0 0x7f484015b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32880/0 (socket says 172.21.15.78:32880) 2024-09-17T03:15:42.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.582+0000 7f4844ccf640 1 -- 172.21.15.78:0/331328072 learned_addr learned my addr 172.21.15.78:0/331328072 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:42.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.582+0000 7f4844ccf640 1 -- 172.21.15.78:0/331328072 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f48400b7cc0 msgr2=0x7f48400cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.582+0000 7f4844ccf640 1 --2- 172.21.15.78:0/331328072 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f48400b7cc0 0x7f48400cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.582+0000 7f4844ccf640 1 -- 172.21.15.78:0/331328072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48400cf320 msgr2=0x7f484015b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.582+0000 7f483f7fe640 1 --2- 172.21.15.78:0/331328072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48400cf320 0x7f484015b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:42.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.582+0000 7f4844ccf640 1 --2- 172.21.15.78:0/331328072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48400cf320 0x7f484015b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.582+0000 7f4844ccf640 1 -- 172.21.15.78:0/331328072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48401f3c90 con 0x7f48401600b0 2024-09-17T03:15:42.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.582+0000 7f483f7fe640 1 --2- 172.21.15.78:0/331328072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48400cf320 0x7f484015b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T03:15:42.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.583+0000 7f4844ccf640 1 --2- 172.21.15.78:0/331328072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48401600b0 0x7f484015b830 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f4838006010 tx=0x7f4838003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:42.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.583+0000 7f483cff9640 1 -- 172.21.15.78:0/331328072 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838031b90 con 0x7f48401600b0 2024-09-17T03:15:42.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.583+0000 7f483cff9640 1 -- 172.21.15.78:0/331328072 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4838031e20 con 0x7f48401600b0 2024-09-17T03:15:42.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.583+0000 7f4846732640 1 -- 172.21.15.78:0/331328072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48401f3f70 con 0x7f48401600b0 2024-09-17T03:15:42.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.583+0000 7f483cff9640 1 -- 172.21.15.78:0/331328072 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4838033290 con 0x7f48401600b0 2024-09-17T03:15:42.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.583+0000 7f4846732640 1 -- 172.21.15.78:0/331328072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48401f4530 con 0x7f48401600b0 2024-09-17T03:15:42.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.584+0000 7f4846732640 1 -- 172.21.15.78:0/331328072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48400cc3b0 con 0x7f48401600b0 2024-09-17T03:15:42.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.585+0000 7f483cff9640 1 -- 172.21.15.78:0/331328072 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4838031660 con 0x7f48401600b0 2024-09-17T03:15:42.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.585+0000 7f483cff9640 1 --2- 172.21.15.78:0/331328072 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f482c078bc0 0x7f482c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.585+0000 7f483cff9640 1 -- 172.21.15.78:0/331328072 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7f48380bc190 con 0x7f48401600b0 2024-09-17T03:15:42.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.585+0000 7f483ffff640 1 --2- 172.21.15.78:0/331328072 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f482c078bc0 0x7f482c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:42.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.586+0000 7f483ffff640 1 --2- 172.21.15.78:0/331328072 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f482c078bc0 0x7f482c07b0d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4830001510 tx=0x7f4830007930 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:42.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.589+0000 7f483cff9640 1 -- 172.21.15.78:0/331328072 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f483803f030 con 0x7f48401600b0 2024-09-17T03:15:42.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.765+0000 7f4846732640 1 -- 172.21.15.78:0/331328072 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f484015ef90 con 0x7f482c078bc0 2024-09-17T03:15:42.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.766+0000 7f483cff9640 1 -- 172.21.15.78:0/331328072 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f48300050d0 con 0x7f482c078bc0 2024-09-17T03:15:42.765 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 7 to deep-scrub 2024-09-17T03:15:42.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.768+0000 7f4846732640 1 -- 172.21.15.78:0/331328072 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f482c078bc0 msgr2=0x7f482c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.768+0000 7f4846732640 1 --2- 172.21.15.78:0/331328072 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f482c078bc0 0x7f482c07b0d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f4830001510 tx=0x7f4830007930 comp rx=0 tx=0).stop 2024-09-17T03:15:42.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.768+0000 7f4846732640 1 -- 172.21.15.78:0/331328072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48401600b0 msgr2=0x7f484015b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.768+0000 7f4846732640 1 --2- 172.21.15.78:0/331328072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48401600b0 0x7f484015b830 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f4838006010 tx=0x7f4838003ba0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.768+0000 7f4846732640 1 -- 172.21.15.78:0/331328072 shutdown_connections 2024-09-17T03:15:42.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.768+0000 7f4846732640 1 --2- 172.21.15.78:0/331328072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f48401600b0 0x7f484015b830 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.768+0000 7f4846732640 1 --2- 172.21.15.78:0/331328072 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f482c078bc0 0x7f482c07b0d0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.768+0000 7f4846732640 1 --2- 172.21.15.78:0/331328072 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48400cf320 0x7f484015b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.768+0000 7f4846732640 1 --2- 172.21.15.78:0/331328072 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f48400b7cc0 0x7f48400cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.768+0000 7f4846732640 1 -- 172.21.15.78:0/331328072 >> 172.21.15.78:0/331328072 conn(0x7f484006d4f0 msgr2=0x7f484015f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:42.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.768+0000 7f4846732640 1 -- 172.21.15.78:0/331328072 shutdown_connections 2024-09-17T03:15:42.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.768+0000 7f4846732640 1 -- 172.21.15.78:0/331328072 wait complete. 2024-09-17T03:15:42.777 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:15:42.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.891+0000 7f09def39640 1 -- 172.21.15.78:0/1874198053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09c8003a30 msgr2=0x7f09c8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.891+0000 7f09def39640 1 --2- 172.21.15.78:0/1874198053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09c8003a30 0x7f09c8003ea0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f09cc001710 tx=0x7f09c8005830 comp rx=0 tx=0).stop 2024-09-17T03:15:42.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.891+0000 7f09dd4d6640 1 -- 172.21.15.78:0/1874198053 reap_dead start 2024-09-17T03:15:42.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.891+0000 7f09def39640 1 -- 172.21.15.78:0/1874198053 shutdown_connections 2024-09-17T03:15:42.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.891+0000 7f09def39640 1 -- 172.21.15.78:0/1874198053 >> 172.21.15.78:0/1874198053 conn(0x7f09d809d840 msgr2=0x7f09d808bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:42.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.891+0000 7f09def39640 1 -- 172.21.15.78:0/1874198053 shutdown_connections 2024-09-17T03:15:42.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.891+0000 7f09def39640 1 -- 172.21.15.78:0/1874198053 wait complete. 2024-09-17T03:15:42.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.892+0000 7f09def39640 1 Processor -- start 2024-09-17T03:15:42.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.892+0000 7f09def39640 1 -- start start 2024-09-17T03:15:42.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.894+0000 7f09def39640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09c8003a30 0x7f09d81e7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.894+0000 7f09def39640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f09d81e9cf0 0x7f09d81ea100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.894+0000 7f09def39640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09d81575b0 0x7f09d81579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.894+0000 7f09def39640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f09d80cfb10 con 0x7f09c8003a30 2024-09-17T03:15:42.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.894+0000 7f09def39640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f09d806f9d0 con 0x7f09d81575b0 2024-09-17T03:15:42.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.894+0000 7f09def39640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f09d80cfc90 con 0x7f09d81e9cf0 2024-09-17T03:15:42.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.894+0000 7f09dccd5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09c8003a30 0x7f09d81e7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:42.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.894+0000 7f09dccd5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09c8003a30 0x7f09d81e7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:32896/0 (socket says 172.21.15.78:32896) 2024-09-17T03:15:42.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.894+0000 7f09dccd5640 1 -- 172.21.15.78:0/1291357059 learned_addr learned my addr 172.21.15.78:0/1291357059 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:15:42.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.894+0000 7f09dd4d6640 1 --2- 172.21.15.78:0/1291357059 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09d81575b0 0x7f09d81579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:42.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.894+0000 7f09d7fff640 1 --2- 172.21.15.78:0/1291357059 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f09d81e9cf0 0x7f09d81ea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:42.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.894+0000 7f09dccd5640 1 -- 172.21.15.78:0/1291357059 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f09d81e9cf0 msgr2=0x7f09d81ea100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.894+0000 7f09dccd5640 1 --2- 172.21.15.78:0/1291357059 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f09d81e9cf0 0x7f09d81ea100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.894+0000 7f09dccd5640 1 -- 172.21.15.78:0/1291357059 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09d81575b0 msgr2=0x7f09d81579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:42.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.894+0000 7f09dccd5640 1 --2- 172.21.15.78:0/1291357059 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09d81575b0 0x7f09d81579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:42.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.894+0000 7f09dccd5640 1 -- 172.21.15.78:0/1291357059 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d8157f00 con 0x7f09c8003a30 2024-09-17T03:15:42.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.894+0000 7f09d7fff640 1 --2- 172.21.15.78:0/1291357059 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f09d81e9cf0 0x7f09d81ea100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T03:15:42.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.895+0000 7f09dccd5640 1 --2- 172.21.15.78:0/1291357059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09c8003a30 0x7f09d81e7f10 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f09cc02a930 tx=0x7f09cc006290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:42.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.895+0000 7f09d57fa640 1 -- 172.21.15.78:0/1291357059 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc038070 con 0x7f09c8003a30 2024-09-17T03:15:42.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.895+0000 7f09d57fa640 1 -- 172.21.15.78:0/1291357059 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f09cc003930 con 0x7f09c8003a30 2024-09-17T03:15:42.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.895+0000 7f09def39640 1 -- 172.21.15.78:0/1291357059 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09d81e8450 con 0x7f09c8003a30 2024-09-17T03:15:42.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.895+0000 7f09d57fa640 1 -- 172.21.15.78:0/1291357059 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc003d80 con 0x7f09c8003a30 2024-09-17T03:15:42.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.895+0000 7f09def39640 1 -- 172.21.15.78:0/1291357059 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09d8154500 con 0x7f09c8003a30 2024-09-17T03:15:42.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.896+0000 7f09def39640 1 -- 172.21.15.78:0/1291357059 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09d80d0100 con 0x7f09c8003a30 2024-09-17T03:15:42.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.897+0000 7f09d57fa640 1 -- 172.21.15.78:0/1291357059 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f09cc043020 con 0x7f09c8003a30 2024-09-17T03:15:42.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.897+0000 7f09d57fa640 1 --2- 172.21.15.78:0/1291357059 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f09bc078bf0 0x7f09bc07b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:15:42.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.897+0000 7f09d57fa640 1 -- 172.21.15.78:0/1291357059 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7f09cc0ba170 con 0x7f09c8003a30 2024-09-17T03:15:42.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.897+0000 7f09d7fff640 1 --2- 172.21.15.78:0/1291357059 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f09bc078bf0 0x7f09bc07b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:15:42.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.898+0000 7f09d7fff640 1 --2- 172.21.15.78:0/1291357059 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f09bc078bf0 0x7f09bc07b100 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f09d81508b0 tx=0x7f09c4005f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:15:42.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:42.902+0000 7f09d57fa640 1 -- 172.21.15.78:0/1291357059 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f09d8157f00 con 0x7f09c8003a30 2024-09-17T03:15:43.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:43.075+0000 7f09def39640 1 -- 172.21.15.78:0/1291357059 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f09d8069a50 con 0x7f09bc078bf0 2024-09-17T03:15:43.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:43.076+0000 7f09d57fa640 1 -- 172.21.15.78:0/1291357059 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13401 (secure 0 0 0) 0x7f09d8069a50 con 0x7f09bc078bf0 2024-09-17T03:15:43.075 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:15:43.075 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:15:43.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:43.078+0000 7f09def39640 1 -- 172.21.15.78:0/1291357059 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f09bc078bf0 msgr2=0x7f09bc07b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:43.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:43.078+0000 7f09def39640 1 --2- 172.21.15.78:0/1291357059 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f09bc078bf0 0x7f09bc07b100 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f09d81508b0 tx=0x7f09c4005f90 comp rx=0 tx=0).stop 2024-09-17T03:15:43.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:43.078+0000 7f09def39640 1 -- 172.21.15.78:0/1291357059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09c8003a30 msgr2=0x7f09d81e7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:15:43.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:43.078+0000 7f09def39640 1 --2- 172.21.15.78:0/1291357059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09c8003a30 0x7f09d81e7f10 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f09cc02a930 tx=0x7f09cc006290 comp rx=0 tx=0).stop 2024-09-17T03:15:43.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:43.078+0000 7f09def39640 1 -- 172.21.15.78:0/1291357059 shutdown_connections 2024-09-17T03:15:43.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:43.078+0000 7f09def39640 1 --2- 172.21.15.78:0/1291357059 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f09bc078bf0 0x7f09bc07b100 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:43.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:43.078+0000 7f09def39640 1 --2- 172.21.15.78:0/1291357059 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f09d81575b0 0x7f09d81579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:43.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:43.078+0000 7f09def39640 1 --2- 172.21.15.78:0/1291357059 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f09d81e9cf0 0x7f09d81ea100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:43.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:43.078+0000 7f09def39640 1 --2- 172.21.15.78:0/1291357059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f09c8003a30 0x7f09d81e7f10 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:15:43.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:43.078+0000 7f09def39640 1 -- 172.21.15.78:0/1291357059 >> 172.21.15.78:0/1291357059 conn(0x7f09d809d840 msgr2=0x7f09d8158b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:15:43.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:43.078+0000 7f09def39640 1 -- 172.21.15.78:0/1291357059 shutdown_connections 2024-09-17T03:15:43.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:15:43.078+0000 7f09def39640 1 -- 172.21.15.78:0/1291357059 wait complete. 2024-09-17T03:15:43.087 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2024-09-17T03:15:41.239047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":256004,"kb_used_data":10632,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754718716,"statfs":{"total":773094113280,"available":772831965184,"internally_reserved":0,"allocated":10887168,"data_stored":5349360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-122105,"num_objects":-68,"num_object_clones":0,"num_object_copies":-136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-68,"num_whiteouts":0,"num_read":-1,"num_read_kb":0,"num_write":-253,"num_write_kb":-204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001639"},"pg_stats":[{"pgid":"1.0","version":"18'72","reported_seq":247,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:15:35.805154+0000","last_change":"2024-09-17T03:08:19.000871+0000","last_active":"2024-09-17T03:15:35.805154+0000","last_peered":"2024-09-17T03:15:35.805154+0000","last_clean":"2024-09-17T03:15:35.805154+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:15:35.805154+0000","last_undegraded":"2024-09-17T03:15:35.805154+0000","last_fullsized":"2024-09-17T03:15:35.805154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T03:08:17.939629+0000","last_clean_scrub_stamp":"2024-09-17T03:08:17.939629+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:08:34.511700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509533,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32956,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1806336,"data_stored":1111446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32372,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1212416,"data_stored":521078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509532,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28216,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343624,"statfs":{"total":96636764160,"available":96607870976,"internally_reserved":0,"allocated":1212416,"data_stored":521078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32376,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1212416,"data_stored":521078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509534,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32376,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1212416,"data_stored":521078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509533,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32376,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1212416,"data_stored":521078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509533,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32952,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338888,"statfs":{"total":96636764160,"available":96603021312,"internally_reserved":0,"allocated":1806336,"data_stored":1111446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32380,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1212416,"data_stored":521078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:15:43.091 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T03:08:17.939629+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=3, tm_min=8, tm_sec=17, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=3, tm_min=15, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T03:15:43.091 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T03:15:56.797 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:15:56.802 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:16:03.093 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T03:16:03.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.225+0000 7fed80cec640 1 -- 172.21.15.78:0/2366693386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed7c0706c0 msgr2=0x7fed7c072ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:03.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.225+0000 7fed80cec640 1 --2- 172.21.15.78:0/2366693386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed7c0706c0 0x7fed7c072ff0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fed7c0cffa0 tx=0x7fed6c02aa00 comp rx=0 tx=0).stop 2024-09-17T03:16:03.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.225+0000 7fed80cec640 1 -- 172.21.15.78:0/2366693386 shutdown_connections 2024-09-17T03:16:03.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.225+0000 7fed80cec640 1 --2- 172.21.15.78:0/2366693386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed7c0706c0 0x7fed7c072ff0 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.225+0000 7fed80cec640 1 --2- 172.21.15.78:0/2366693386 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fed7c0cd3e0 0x7fed7c070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.225+0000 7fed80cec640 1 --2- 172.21.15.78:0/2366693386 >> v2:172.21.15.193:3300/0 conn(0x7fed7c0af780 0x7fed7c0b39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.225+0000 7fed80cec640 1 -- 172.21.15.78:0/2366693386 >> 172.21.15.78:0/2366693386 conn(0x7fed7c06d7d0 msgr2=0x7fed7c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:03.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.225+0000 7fed80cec640 1 -- 172.21.15.78:0/2366693386 shutdown_connections 2024-09-17T03:16:03.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.225+0000 7fed80cec640 1 -- 172.21.15.78:0/2366693386 wait complete. 2024-09-17T03:16:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.227+0000 7fed80cec640 1 Processor -- start 2024-09-17T03:16:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.227+0000 7fed80cec640 1 -- start start 2024-09-17T03:16:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.229+0000 7fed80cec640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed7c0706c0 0x7fed7c09bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:03.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.229+0000 7fed80cec640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fed7c0af780 0x7fed7c09d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.229+0000 7fed80cec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed7c0cd3e0 0x7fed7c1f9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.229+0000 7fed80cec640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fed7c073930 con 0x7fed7c0cd3e0 2024-09-17T03:16:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.229+0000 7fed80cec640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fed7c0737b0 con 0x7fed7c0706c0 2024-09-17T03:16:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.229+0000 7fed80cec640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fed7c073ab0 con 0x7fed7c0af780 2024-09-17T03:16:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.229+0000 7fed7ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed7c0cd3e0 0x7fed7c1f9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:03.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.229+0000 7fed7ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed7c0cd3e0 0x7fed7c1f9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38124/0 (socket says 172.21.15.78:38124) 2024-09-17T03:16:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.229+0000 7fed7ad9d640 1 -- 172.21.15.78:0/4148406287 learned_addr learned my addr 172.21.15.78:0/4148406287 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:16:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.229+0000 7fed7a59c640 1 --2- 172.21.15.78:0/4148406287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed7c0706c0 0x7fed7c09bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.229+0000 7fed79d9b640 1 --2- 172.21.15.78:0/4148406287 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fed7c0af780 0x7fed7c09d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.229+0000 7fed7ad9d640 1 -- 172.21.15.78:0/4148406287 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fed7c0af780 msgr2=0x7fed7c09d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:03.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.229+0000 7fed7ad9d640 1 --2- 172.21.15.78:0/4148406287 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fed7c0af780 0x7fed7c09d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.229+0000 7fed7ad9d640 1 -- 172.21.15.78:0/4148406287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed7c0706c0 msgr2=0x7fed7c09bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:03.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.229+0000 7fed7ad9d640 1 --2- 172.21.15.78:0/4148406287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed7c0706c0 0x7fed7c09bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.229+0000 7fed7ad9d640 1 -- 172.21.15.78:0/4148406287 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed7c09c4d0 con 0x7fed7c0cd3e0 2024-09-17T03:16:03.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.229+0000 7fed7a59c640 1 --2- 172.21.15.78:0/4148406287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed7c0706c0 0x7fed7c09bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T03:16:03.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.229+0000 7fed7ad9d640 1 --2- 172.21.15.78:0/4148406287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed7c0cd3e0 0x7fed7c1f9290 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fed6c02aff0 tx=0x7fed6c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:03.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.230+0000 7fed72ffd640 1 -- 172.21.15.78:0/4148406287 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6c033050 con 0x7fed7c0cd3e0 2024-09-17T03:16:03.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.230+0000 7fed72ffd640 1 -- 172.21.15.78:0/4148406287 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed6c004450 con 0x7fed7c0cd3e0 2024-09-17T03:16:03.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.230+0000 7fed80cec640 1 -- 172.21.15.78:0/4148406287 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed7c0cbe90 con 0x7fed7c0cd3e0 2024-09-17T03:16:03.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.230+0000 7fed72ffd640 1 -- 172.21.15.78:0/4148406287 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6c038450 con 0x7fed7c0cd3e0 2024-09-17T03:16:03.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.230+0000 7fed80cec640 1 -- 172.21.15.78:0/4148406287 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed7c0cc450 con 0x7fed7c0cd3e0 2024-09-17T03:16:03.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.231+0000 7fed80cec640 1 -- 172.21.15.78:0/4148406287 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed7c0b39c0 con 0x7fed7c0cd3e0 2024-09-17T03:16:03.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.232+0000 7fed72ffd640 1 -- 172.21.15.78:0/4148406287 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fed6c036070 con 0x7fed7c0cd3e0 2024-09-17T03:16:03.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.232+0000 7fed72ffd640 1 --2- 172.21.15.78:0/4148406287 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fed5c078bc0 0x7fed5c07b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:03.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.232+0000 7fed72ffd640 1 -- 172.21.15.78:0/4148406287 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7fed6c0bbcf0 con 0x7fed7c0cd3e0 2024-09-17T03:16:03.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.232+0000 7fed7a59c640 1 --2- 172.21.15.78:0/4148406287 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fed5c078bc0 0x7fed5c07b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:03.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.233+0000 7fed7a59c640 1 --2- 172.21.15.78:0/4148406287 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fed5c078bc0 0x7fed5c07b0d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fed7400bf40 tx=0x7fed7400b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:03.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.237+0000 7fed72ffd640 1 -- 172.21.15.78:0/4148406287 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fed6c083dc0 con 0x7fed7c0cd3e0 2024-09-17T03:16:03.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.409+0000 7fed80cec640 1 -- 172.21.15.78:0/4148406287 --> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed7c0b1ff0 con 0x7fed5c078bc0 2024-09-17T03:16:03.409 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.410+0000 7fed72ffd640 1 -- 172.21.15.78:0/4148406287 <== mgr.4099 v2:172.21.15.193:6800/2979273017 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13360 (secure 0 0 0) 0x7fed7c0b1ff0 con 0x7fed5c078bc0 2024-09-17T03:16:03.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:16:03.410 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-17T03:16:03.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.412+0000 7fed80cec640 1 -- 172.21.15.78:0/4148406287 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fed5c078bc0 msgr2=0x7fed5c07b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:03.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.412+0000 7fed80cec640 1 --2- 172.21.15.78:0/4148406287 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fed5c078bc0 0x7fed5c07b0d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fed7400bf40 tx=0x7fed7400b2e0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.412+0000 7fed80cec640 1 -- 172.21.15.78:0/4148406287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed7c0cd3e0 msgr2=0x7fed7c1f9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:03.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.412+0000 7fed80cec640 1 --2- 172.21.15.78:0/4148406287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed7c0cd3e0 0x7fed7c1f9290 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fed6c02aff0 tx=0x7fed6c003f10 comp rx=0 tx=0).stop 2024-09-17T03:16:03.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.412+0000 7fed80cec640 1 -- 172.21.15.78:0/4148406287 shutdown_connections 2024-09-17T03:16:03.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.412+0000 7fed80cec640 1 --2- 172.21.15.78:0/4148406287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed7c0cd3e0 0x7fed7c1f9290 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.412+0000 7fed80cec640 1 --2- 172.21.15.78:0/4148406287 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fed7c0af780 0x7fed7c09d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.412+0000 7fed80cec640 1 --2- 172.21.15.78:0/4148406287 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fed5c078bc0 0x7fed5c07b0d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.412+0000 7fed80cec640 1 --2- 172.21.15.78:0/4148406287 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fed7c0706c0 0x7fed7c09bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.413+0000 7fed80cec640 1 -- 172.21.15.78:0/4148406287 >> 172.21.15.78:0/4148406287 conn(0x7fed7c06d7d0 msgr2=0x7fed7c0b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:03.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.413+0000 7fed80cec640 1 -- 172.21.15.78:0/4148406287 shutdown_connections 2024-09-17T03:16:03.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.413+0000 7fed80cec640 1 -- 172.21.15.78:0/4148406287 wait complete. 2024-09-17T03:16:03.422 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2024-09-17T03:16:03.244245+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":255992,"kb_used_data":10632,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754718728,"statfs":{"total":773094113280,"available":772831977472,"internally_reserved":0,"allocated":10887168,"data_stored":5349360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":251055666},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002948"},"pg_stats":[{"pgid":"1.0","version":"98'74","reported_seq":257,"reported_epoch":98,"state":"active+clean","last_fresh":"2024-09-17T03:15:43.268995+0000","last_change":"2024-09-17T03:15:43.268995+0000","last_active":"2024-09-17T03:15:43.268995+0000","last_peered":"2024-09-17T03:15:43.268995+0000","last_clean":"2024-09-17T03:15:43.268995+0000","last_became_active":"2024-09-17T03:08:18.999955+0000","last_became_peered":"2024-09-17T03:08:18.999955+0000","last_unstale":"2024-09-17T03:15:43.268995+0000","last_undegraded":"2024-09-17T03:15:43.268995+0000","last_fullsized":"2024-09-17T03:15:43.268995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"98'74","last_scrub_stamp":"2024-09-17T03:15:43.268857+0000","last_deep_scrub":"98'74","last_deep_scrub_stamp":"2024-09-17T03:15:43.268857+0000","last_clean_scrub_stamp":"2024-09-17T03:15:43.268857+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:27:29.109862+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32948,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1806336,"data_stored":1111446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32372,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1212416,"data_stored":521078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":28216,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343624,"statfs":{"total":96636764160,"available":96607870976,"internally_reserved":0,"allocated":1212416,"data_stored":521078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32376,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1212416,"data_stored":521078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509538,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32376,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1212416,"data_stored":521078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32376,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1212416,"data_stored":521078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509537,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32948,"kb_used_data":1764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1806336,"data_stored":1111446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574945,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32380,"kb_used_data":1184,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1212416,"data_stored":521078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T03:16:03.424 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T03:16:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.537+0000 7fa207cde640 1 -- 172.21.15.78:0/4261546025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2000d2310 msgr2=0x7fa2000d2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.537+0000 7fa207cde640 1 --2- 172.21.15.78:0/4261546025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2000d2310 0x7fa2000d2720 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fa2000d03e0 tx=0x7fa1f802aa00 comp rx=0 tx=0).stop 2024-09-17T03:16:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.537+0000 7fa207cde640 1 -- 172.21.15.78:0/4261546025 shutdown_connections 2024-09-17T03:16:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.537+0000 7fa207cde640 1 --2- 172.21.15.78:0/4261546025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2000d2310 0x7fa2000d2720 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.537+0000 7fa207cde640 1 --2- 172.21.15.78:0/4261546025 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2000ccbe0 0x7fa20015c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.537+0000 7fa207cde640 1 -- 172.21.15.78:0/4261546025 >> 172.21.15.78:0/4261546025 conn(0x7fa2000b3f10 msgr2=0x7fa2000b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:03.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.537+0000 7fa207cde640 1 -- 172.21.15.78:0/4261546025 shutdown_connections 2024-09-17T03:16:03.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.537+0000 7fa207cde640 1 -- 172.21.15.78:0/4261546025 wait complete. 2024-09-17T03:16:03.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.539+0000 7fa207cde640 1 Processor -- start 2024-09-17T03:16:03.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.539+0000 7fa207cde640 1 -- start start 2024-09-17T03:16:03.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.540+0000 7fa207cde640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2000b5210 0x7fa200157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:03.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.540+0000 7fa207cde640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2000ccbe0 0x7fa2001f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:03.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.540+0000 7fa207cde640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2000d2310 0x7fa200144b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:03.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.540+0000 7fa207cde640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7fa2000d18b0 con 0x7fa2000d2310 2024-09-17T03:16:03.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.540+0000 7fa207cde640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa2000d1730 con 0x7fa2000b5210 2024-09-17T03:16:03.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.540+0000 7fa207cde640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa2000d1a30 con 0x7fa2000ccbe0 2024-09-17T03:16:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.540+0000 7fa20627b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2000d2310 0x7fa200144b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.540+0000 7fa20627b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2000d2310 0x7fa200144b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38146/0 (socket says 172.21.15.78:38146) 2024-09-17T03:16:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.540+0000 7fa20627b640 1 -- 172.21.15.78:0/2629047306 learned_addr learned my addr 172.21.15.78:0/2629047306 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:16:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.540+0000 7fa205a7a640 1 --2- 172.21.15.78:0/2629047306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2000b5210 0x7fa200157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.540+0000 7fa205279640 1 --2- 172.21.15.78:0/2629047306 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2000ccbe0 0x7fa2001f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.540+0000 7fa20627b640 1 -- 172.21.15.78:0/2629047306 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2000ccbe0 msgr2=0x7fa2001f2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.540+0000 7fa20627b640 1 --2- 172.21.15.78:0/2629047306 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2000ccbe0 0x7fa2001f2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.540+0000 7fa20627b640 1 -- 172.21.15.78:0/2629047306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2000b5210 msgr2=0x7fa200157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.540+0000 7fa20627b640 1 --2- 172.21.15.78:0/2629047306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2000b5210 0x7fa200157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.540+0000 7fa20627b640 1 -- 172.21.15.78:0/2629047306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa200157d50 con 0x7fa2000d2310 2024-09-17T03:16:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.541+0000 7fa20627b640 1 --2- 172.21.15.78:0/2629047306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2000d2310 0x7fa200144b30 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009d60 tx=0x7fa1f8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.541+0000 7fa1f67fc640 1 -- 172.21.15.78:0/2629047306 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8033050 con 0x7fa2000d2310 2024-09-17T03:16:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.541+0000 7fa1f67fc640 1 -- 172.21.15.78:0/2629047306 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1f8004450 con 0x7fa2000d2310 2024-09-17T03:16:03.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.541+0000 7fa207cde640 1 -- 172.21.15.78:0/2629047306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2001f3480 con 0x7fa2000d2310 2024-09-17T03:16:03.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.541+0000 7fa1f67fc640 1 -- 172.21.15.78:0/2629047306 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8038450 con 0x7fa2000d2310 2024-09-17T03:16:03.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.541+0000 7fa207cde640 1 -- 172.21.15.78:0/2629047306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa200158470 con 0x7fa2000d2310 2024-09-17T03:16:03.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.542+0000 7fa207cde640 1 -- 172.21.15.78:0/2629047306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2000d1f50 con 0x7fa2000d2310 2024-09-17T03:16:03.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.543+0000 7fa1f67fc640 1 -- 172.21.15.78:0/2629047306 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa1f8036070 con 0x7fa2000d2310 2024-09-17T03:16:03.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.543+0000 7fa1f67fc640 1 --2- 172.21.15.78:0/2629047306 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa1e4078bc0 0x7fa1e407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:03.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.544+0000 7fa1f67fc640 1 -- 172.21.15.78:0/2629047306 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7fa1f80bbea0 con 0x7fa2000d2310 2024-09-17T03:16:03.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.544+0000 7fa205a7a640 1 --2- 172.21.15.78:0/2629047306 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa1e4078bc0 0x7fa1e407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:03.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.544+0000 7fa205a7a640 1 --2- 172.21.15.78:0/2629047306 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa1e4078bc0 0x7fa1e407b0d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00bb50 tx=0x7fa1fc00b2e0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:03.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.548+0000 7fa1f67fc640 1 -- 172.21.15.78:0/2629047306 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7fa1f8083ee0 con 0x7fa2000d2310 2024-09-17T03:16:03.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.722+0000 7fa207cde640 1 -- 172.21.15.78:0/2629047306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fa200157f20 con 0x7fa2000d2310 2024-09-17T03:16:03.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.728+0000 7fa1f67fc640 1 -- 172.21.15.78:0/2629047306 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v44)=0 v44) ==== 123+0+0 (secure 0 0 0) 0x7fa1f8088910 con 0x7fa2000d2310 2024-09-17T03:16:03.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.729+0000 7fa1f67fc640 1 -- 172.21.15.78:0/2629047306 <== mon.0 v2:172.21.15.78:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fa1f80839f0 con 0x7fa2000d2310 2024-09-17T03:16:03.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.731+0000 7fa207cde640 1 -- 172.21.15.78:0/2629047306 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa1e4078bc0 msgr2=0x7fa1e407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:03.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.731+0000 7fa207cde640 1 --2- 172.21.15.78:0/2629047306 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa1e4078bc0 0x7fa1e407b0d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00bb50 tx=0x7fa1fc00b2e0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.731+0000 7fa207cde640 1 -- 172.21.15.78:0/2629047306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2000d2310 msgr2=0x7fa200144b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:03.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.731+0000 7fa207cde640 1 --2- 172.21.15.78:0/2629047306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2000d2310 0x7fa200144b30 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009d60 tx=0x7fa1f8003f10 comp rx=0 tx=0).stop 2024-09-17T03:16:03.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.731+0000 7fa207cde640 1 -- 172.21.15.78:0/2629047306 shutdown_connections 2024-09-17T03:16:03.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.731+0000 7fa207cde640 1 --2- 172.21.15.78:0/2629047306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa2000d2310 0x7fa200144b30 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.731+0000 7fa207cde640 1 --2- 172.21.15.78:0/2629047306 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2000ccbe0 0x7fa2001f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.731+0000 7fa207cde640 1 --2- 172.21.15.78:0/2629047306 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7fa1e4078bc0 0x7fa1e407b0d0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.731+0000 7fa207cde640 1 --2- 172.21.15.78:0/2629047306 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2000b5210 0x7fa200157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.731+0000 7fa207cde640 1 -- 172.21.15.78:0/2629047306 >> 172.21.15.78:0/2629047306 conn(0x7fa2000b3f10 msgr2=0x7fa2000b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:03.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.731+0000 7fa207cde640 1 -- 172.21.15.78:0/2629047306 shutdown_connections 2024-09-17T03:16:03.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.731+0000 7fa207cde640 1 -- 172.21.15.78:0/2629047306 wait complete. 2024-09-17T03:16:03.741 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T03:16:03.741 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T03:16:03.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.855+0000 7f4dfdc20640 1 -- 172.21.15.78:0/4275253107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df80d2ed0 msgr2=0x7f4df80d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:03.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.855+0000 7f4dfdc20640 1 --2- 172.21.15.78:0/4275253107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df80d2ed0 0x7f4df80d1a80 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f4df80d5690 tx=0x7f4de802a8b0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.855+0000 7f4dfdc20640 1 -- 172.21.15.78:0/4275253107 shutdown_connections 2024-09-17T03:16:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.855+0000 7f4dfdc20640 1 --2- 172.21.15.78:0/4275253107 >> v2:172.21.15.193:3300/0 conn(0x7f4df80b9b70 0x7f4df80cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.855+0000 7f4dfdc20640 1 --2- 172.21.15.78:0/4275253107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df80d2ed0 0x7f4df80d1a80 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.855+0000 7f4dfdc20640 1 -- 172.21.15.78:0/4275253107 >> 172.21.15.78:0/4275253107 conn(0x7f4df808bfc0 msgr2=0x7f4df809d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.855+0000 7f4dfdc20640 1 -- 172.21.15.78:0/4275253107 shutdown_connections 2024-09-17T03:16:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.855+0000 7f4dfdc20640 1 -- 172.21.15.78:0/4275253107 wait complete. 2024-09-17T03:16:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.857+0000 7f4dfdc20640 1 Processor -- start 2024-09-17T03:16:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.857+0000 7f4dfdc20640 1 -- start start 2024-09-17T03:16:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4dfdc20640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4df80b9b70 0x7f4df80caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4dfdc20640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df80cf5d0 0x7f4df814db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4dfdc20640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4df80d2ed0 0x7f4df80c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4dfdc20640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 -- 0x7f4df80d4940 con 0x7f4df80cf5d0 2024-09-17T03:16:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4dfdc20640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4df80cfdb0 con 0x7f4df80d2ed0 2024-09-17T03:16:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4dfdc20640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4df80d4ac0 con 0x7f4df80b9b70 2024-09-17T03:16:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4df6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df80cf5d0 0x7f4df814db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4df6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df80cf5d0 0x7f4df814db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:38158/0 (socket says 172.21.15.78:38158) 2024-09-17T03:16:03.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4df6ffd640 1 -- 172.21.15.78:0/2390655893 learned_addr learned my addr 172.21.15.78:0/2390655893 (peer_addr_for_me v2:172.21.15.78:0/0) 2024-09-17T03:16:03.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4df77fe640 1 --2- 172.21.15.78:0/2390655893 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4df80b9b70 0x7f4df80caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:03.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4df7fff640 1 --2- 172.21.15.78:0/2390655893 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4df80d2ed0 0x7f4df80c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:03.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4df6ffd640 1 -- 172.21.15.78:0/2390655893 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4df80b9b70 msgr2=0x7f4df80caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:03.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4df6ffd640 1 --2- 172.21.15.78:0/2390655893 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4df80b9b70 0x7f4df80caab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4df6ffd640 1 -- 172.21.15.78:0/2390655893 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4df80d2ed0 msgr2=0x7f4df80c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:03.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4df6ffd640 1 --2- 172.21.15.78:0/2390655893 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4df80d2ed0 0x7f4df80c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:03.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4df6ffd640 1 -- 172.21.15.78:0/2390655893 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df815cf60 con 0x7f4df80cf5d0 2024-09-17T03:16:03.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4df6ffd640 1 --2- 172.21.15.78:0/2390655893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df80cf5d0 0x7f4df814db00 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00c970 tx=0x7f4dec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:03.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4ddffff640 1 -- 172.21.15.78:0/2390655893 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dec007bb0 con 0x7f4df80cf5d0 2024-09-17T03:16:03.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4ddffff640 1 -- 172.21.15.78:0/2390655893 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f4dec00f450 con 0x7f4df80cf5d0 2024-09-17T03:16:03.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4dfdc20640 1 -- 172.21.15.78:0/2390655893 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df815d240 con 0x7f4df80cf5d0 2024-09-17T03:16:03.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.859+0000 7f4ddffff640 1 -- 172.21.15.78:0/2390655893 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dec007e60 con 0x7f4df80cf5d0 2024-09-17T03:16:03.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.860+0000 7f4dfdc20640 1 -- 172.21.15.78:0/2390655893 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df815d800 con 0x7f4df80cf5d0 2024-09-17T03:16:03.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.860+0000 7f4dfdc20640 1 -- 172.21.15.78:0/2390655893 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4df80cf090 con 0x7f4df80cf5d0 2024-09-17T03:16:03.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.861+0000 7f4ddffff640 1 -- 172.21.15.78:0/2390655893 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4dec00f8c0 con 0x7f4df80cf5d0 2024-09-17T03:16:03.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.862+0000 7f4ddffff640 1 --2- 172.21.15.78:0/2390655893 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4de4078bc0 0x7f4de407b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T03:16:03.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.862+0000 7f4ddffff640 1 -- 172.21.15.78:0/2390655893 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5115+0+0 (secure 0 0 0) 0x7f4dec09b330 con 0x7f4df80cf5d0 2024-09-17T03:16:03.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.862+0000 7f4df77fe640 1 --2- 172.21.15.78:0/2390655893 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4de4078bc0 0x7f4de407b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T03:16:03.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.863+0000 7f4df77fe640 1 --2- 172.21.15.78:0/2390655893 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4de4078bc0 0x7f4de407b0d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4df80d32e0 tx=0x7f4de8004a40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T03:16:03.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:03.867+0000 7f4ddffff640 1 -- 172.21.15.78:0/2390655893 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195964 (secure 0 0 0) 0x7f4dec014030 con 0x7f4df80cf5d0 2024-09-17T03:16:04.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:04.078+0000 7f4dfdc20640 1 -- 172.21.15.78:0/2390655893 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4df80b4020 con 0x7f4df80cf5d0 2024-09-17T03:16:04.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:04.078+0000 7f4ddffff640 1 -- 172.21.15.78:0/2390655893 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) ==== 95+0+3918 (secure 0 0 0) 0x7f4dec0639c0 con 0x7f4df80cf5d0 2024-09-17T03:16:04.077 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-17T03:16:04.078 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":105,"btime":"2024-09-17T03:15:32:944467+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7202,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/833332494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":833332494},{"type":"v1","addr":"172.21.15.193:6837","nonce":833332494}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":7210,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1851961737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1851961737},{"type":"v1","addr":"172.21.15.193:6836","nonce":1851961737}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":9147,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6833/3588439372","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":3588439372},{"type":"v1","addr":"172.21.15.78:6833","nonce":3588439372}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105},{"gid":9150,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/4254093511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4254093511},{"type":"v1","addr":"172.21.15.78:6835","nonce":4254093511}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":105}],"filesystems":[]} 2024-09-17T03:16:04.078 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 105 2024-09-17T03:16:04.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:04.080+0000 7f4dfdc20640 1 -- 172.21.15.78:0/2390655893 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4de4078bc0 msgr2=0x7f4de407b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:04.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:04.080+0000 7f4dfdc20640 1 --2- 172.21.15.78:0/2390655893 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4de4078bc0 0x7f4de407b0d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4df80d32e0 tx=0x7f4de8004a40 comp rx=0 tx=0).stop 2024-09-17T03:16:04.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:04.080+0000 7f4dfdc20640 1 -- 172.21.15.78:0/2390655893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df80cf5d0 msgr2=0x7f4df814db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T03:16:04.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:04.080+0000 7f4dfdc20640 1 --2- 172.21.15.78:0/2390655893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df80cf5d0 0x7f4df814db00 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f4dec00c970 tx=0x7f4dec00ce30 comp rx=0 tx=0).stop 2024-09-17T03:16:04.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:04.080+0000 7f4dfdc20640 1 -- 172.21.15.78:0/2390655893 shutdown_connections 2024-09-17T03:16:04.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:04.081+0000 7f4dfdc20640 1 --2- 172.21.15.78:0/2390655893 >> [v2:172.21.15.193:6800/2979273017,v1:172.21.15.193:6801/2979273017] conn(0x7f4de4078bc0 0x7f4de407b0d0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:04.081+0000 7f4dfdc20640 1 --2- 172.21.15.78:0/2390655893 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4df80d2ed0 0x7f4df80c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:04.081+0000 7f4dfdc20640 1 --2- 172.21.15.78:0/2390655893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4df80cf5d0 0x7f4df814db00 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:04.081+0000 7f4dfdc20640 1 --2- 172.21.15.78:0/2390655893 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4df80b9b70 0x7f4df80caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T03:16:04.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:04.081+0000 7f4dfdc20640 1 -- 172.21.15.78:0/2390655893 >> 172.21.15.78:0/2390655893 conn(0x7f4df808bfc0 msgr2=0x7f4df806e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T03:16:04.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:04.081+0000 7f4dfdc20640 1 -- 172.21.15.78:0/2390655893 shutdown_connections 2024-09-17T03:16:04.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-17T03:16:04.081+0000 7f4dfdc20640 1 -- 172.21.15.78:0/2390655893 wait complete. 2024-09-17T03:16:04.091 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-17T03:16:04.091 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T03:16:04.091 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T03:16:04.091 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:04.103 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T03:16:04.103 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T03:16:04.103 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:04.155 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T03:16:04.155 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T03:16:04.155 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:04.167 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T03:16:04.167 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T03:16:04.167 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:04.222 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T03:16:04.222 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T03:16:04.222 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T03:16:04.222 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:04.265 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T03:16:04.265 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T03:16:04.265 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:04.331 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T03:16:04.332 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T03:16:04.332 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:04.395 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T03:16:04.395 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-17T03:16:04.396 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:04.462 INFO:tasks.ceph.osd.3:Stopped 2024-09-17T03:16:04.462 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-17T03:16:04.463 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:04.501 INFO:tasks.ceph.osd.4:Stopped 2024-09-17T03:16:04.501 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-17T03:16:04.501 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:04.569 INFO:tasks.ceph.osd.5:Stopped 2024-09-17T03:16:04.570 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-17T03:16:04.570 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:04.638 INFO:tasks.ceph.osd.6:Stopped 2024-09-17T03:16:04.638 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-17T03:16:04.639 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:04.706 INFO:tasks.ceph.osd.7:Stopped 2024-09-17T03:16:04.707 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T03:16:04.707 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-17T03:16:04.707 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:04.734 INFO:tasks.ceph.mgr.y:Stopped 2024-09-17T03:16:04.734 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T03:16:04.735 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:04.777 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T03:16:04.777 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T03:16:04.778 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T03:16:04.778 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:04.790 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T03:16:04.790 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-17T03:16:04.790 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:04.830 INFO:tasks.ceph.mon.b:Stopped 2024-09-17T03:16:04.830 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T03:16:04.830 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T03:16:04.882 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T03:16:04.883 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T03:16:04.883 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'Scrub error on inode' | head -n 1 2024-09-17T03:16:04.919 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T03:16:04.920 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T03:16:05.034 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T03:16:05.034 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T03:16:05.130 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T03:16:05.130 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T03:16:05.195 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T03:16:05.196 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-17T03:16:05.246 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi193.front.sepia.ceph.com 2024-09-17T03:16:05.247 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-17T03:16:05.508 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi193.front.sepia.ceph.com 2024-09-17T03:16:05.508 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-17T03:16:05.573 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi193.front.sepia.ceph.com 2024-09-17T03:16:05.574 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-17T03:16:05.632 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com 2024-09-17T03:16:05.632 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-17T03:16:05.680 INFO:tasks.ceph:Archiving mon data... 2024-09-17T03:16:05.681 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908403/data/mon.a.tgz 2024-09-17T03:16:05.681 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-09-17T03:16:05.698 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.UX3OOEjKrb 2024-09-17T03:16:05.698 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.UX3OOEjKrb 2024-09-17T03:16:05.858 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.UX3OOEjKrb 2024-09-17T03:16:05.941 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.UX3OOEjKrb is 449KB 2024-09-17T03:16:06.011 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.UX3OOEjKrb 2024-09-17T03:16:06.026 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908403/data/mon.b.tgz 2024-09-17T03:16:06.026 DEBUG:teuthology.orchestra.run.smithi193:> mktemp 2024-09-17T03:16:06.043 INFO:teuthology.orchestra.run.smithi193.stdout:/tmp/tmp.NrStB0ZsED 2024-09-17T03:16:06.043 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.NrStB0ZsED 2024-09-17T03:16:06.201 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 0666 /tmp/tmp.NrStB0ZsED 2024-09-17T03:16:06.284 DEBUG:teuthology.orchestra.remote:smithi193:/tmp/tmp.NrStB0ZsED is 454KB 2024-09-17T03:16:06.382 DEBUG:teuthology.orchestra.run.smithi193:> rm -fr /tmp/tmp.NrStB0ZsED 2024-09-17T03:16:06.397 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908403/data/mon.c.tgz 2024-09-17T03:16:06.398 DEBUG:teuthology.orchestra.run.smithi193:> mktemp 2024-09-17T03:16:06.453 INFO:teuthology.orchestra.run.smithi193.stdout:/tmp/tmp.ETuIdVAa7r 2024-09-17T03:16:06.453 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ETuIdVAa7r 2024-09-17T03:16:06.606 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 0666 /tmp/tmp.ETuIdVAa7r 2024-09-17T03:16:06.689 DEBUG:teuthology.orchestra.remote:smithi193:/tmp/tmp.ETuIdVAa7r is 454KB 2024-09-17T03:16:06.794 DEBUG:teuthology.orchestra.run.smithi193:> rm -fr /tmp/tmp.ETuIdVAa7r 2024-09-17T03:16:06.810 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T03:16:06.810 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T03:16:06.814 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T03:16:06.894 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T03:16:06.928 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T03:16:06.929 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T03:16:06.933 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908403/remote/smithi078/crash 2024-09-17T03:16:06.934 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T03:16:06.960 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908403/remote/smithi193/crash 2024-09-17T03:16:06.961 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T03:16:06.993 INFO:tasks.ceph:Shutting down logrotate 2024-09-17T03:16:06.993 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:16:07.005 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T03:16:07.079 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T03:16:07.105 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T03:16:07.144 INFO:tasks.ceph:Compressing logs... 2024-09-17T03:16:07.144 DEBUG:teuthology.orchestra.run.smithi078:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T03:16:07.147 DEBUG:teuthology.orchestra.run.smithi193:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T03:16:07.169 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T03:16:07.169 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46168.log 2024-09-17T03:16:07.244 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36520.log 2024-09-17T03:16:07.244 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42490.log 2024-09-17T03:16:07.244 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-17T03:16:07.245 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.36520.log: /var/log/ceph/ceph-client.1.42490.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36520.log.gz 2024-09-17T03:16:07.245 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36280.log 2024-09-17T03:16:07.245 INFO:teuthology.orchestra.run.smithi193.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42490.log.gz 2024-09-17T03:16:07.245 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36360.log 2024-09-17T03:16:07.245 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.36280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36560.log 2024-09-17T03:16:07.245 INFO:teuthology.orchestra.run.smithi193.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36280.log.gz 2024-09-17T03:16:07.245 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.36360.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-17T03:16:07.245 INFO:teuthology.orchestra.run.smithi193.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36360.log.gz 2024-09-17T03:16:07.245 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.36560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36440.log 2024-09-17T03:16:07.245 INFO:teuthology.orchestra.run.smithi193.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36560.log.gz 2024-09-17T03:16:07.246 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36400.log 2024-09-17T03:16:07.246 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.36440.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-17T03:16:07.246 INFO:teuthology.orchestra.run.smithi193.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36440.log.gz 2024-09-17T03:16:07.246 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.36400.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T03:16:07.246 INFO:teuthology.orchestra.run.smithi193.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36400.log.gz 2024-09-17T03:16:07.247 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36480.log 2024-09-17T03:16:07.247 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-17T03:16:07.247 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.36480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36320.log 2024-09-17T03:16:07.247 INFO:teuthology.orchestra.run.smithi193.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36480.log.gz 2024-09-17T03:16:07.247 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-17T03:16:07.247 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.36320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42889.log 2024-09-17T03:16:07.247 INFO:teuthology.orchestra.run.smithi193.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36320.log.gz 2024-09-17T03:16:07.247 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-17T03:16:07.247 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.3.42889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42889.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.3.42885.log 2024-09-17T03:16:07.247 INFO:teuthology.orchestra.run.smithi193.stderr: 2024-09-17T03:16:07.248 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T03:16:07.248 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.3.42885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42885.log.gz 2024-09-17T03:16:07.248 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-17T03:16:07.248 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T03:16:07.248 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T03:16:07.248 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-mds.d.log: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T03:16:07.248 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-17T03:16:07.248 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42485.log 2024-09-17T03:16:07.258 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.1.42485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42485.log.gz 2024-09-17T03:16:07.358 INFO:teuthology.orchestra.run.smithi193.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-17T03:16:07.389 INFO:teuthology.orchestra.run.smithi193.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-17T03:16:07.401 INFO:teuthology.orchestra.run.smithi193.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T03:16:07.461 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55212.log 2024-09-17T03:16:07.461 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46252.log 2024-09-17T03:16:07.462 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5%/var/log/ceph/ceph-client.admin.55212.log: -- replaced with /var/log/ceph/ceph-client.admin.46168.log.gz 2024-09-17T03:16:07.462 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53163.log 2024-09-17T03:16:07.462 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55212.log.gz 2024-09-17T03:16:07.462 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68086.log 2024-09-17T03:16:07.462 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46252.log: /var/log/ceph/ceph-client.admin.53163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49952.log 2024-09-17T03:16:07.462 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46252.log.gz 2024-09-17T03:16:07.462 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.68086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62615.log 2024-09-17T03:16:07.462 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53163.log.gz 2024-09-17T03:16:07.462 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49952.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68086.log.gz 2024-09-17T03:16:07.462 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44776.log 2024-09-17T03:16:07.462 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49952.log.gz 2024-09-17T03:16:07.462 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71693.log 2024-09-17T03:16:07.462 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62615.log.gz 2024-09-17T03:16:07.462 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55902.log 2024-09-17T03:16:07.463 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44776.log.gz 2024-09-17T03:16:07.463 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.71693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48665.log 2024-09-17T03:16:07.463 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71693.log.gz 2024-09-17T03:16:07.463 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71328.log 2024-09-17T03:16:07.463 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55902.log.gz 2024-09-17T03:16:07.463 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50355.log 2024-09-17T03:16:07.463 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48665.log.gz 2024-09-17T03:16:07.463 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.71328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55524.log 2024-09-17T03:16:07.463 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.71328.log.gz 2024-09-17T03:16:07.463 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55734.log 2024-09-17T03:16:07.463 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50355.log.gz 2024-09-17T03:16:07.463 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56322.log 2024-09-17T03:16:07.463 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55524.log.gz 2024-09-17T03:16:07.463 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44409.log 2024-09-17T03:16:07.464 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55734.log.gz/var/log/ceph/ceph-client.admin.56322.log: 2024-09-17T03:16:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64556.log 2024-09-17T03:16:07.464 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56322.log.gz 2024-09-17T03:16:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44410.log 2024-09-17T03:16:07.464 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44409.log.gz 2024-09-17T03:16:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.64556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44818.log 2024-09-17T03:16:07.464 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2%/var/log/ceph/ceph-client.admin.44410.log: -- replaced with /var/log/ceph/ceph-client.admin.64556.log.gz 2024-09-17T03:16:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61407.log 2024-09-17T03:16:07.464 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44410.log.gz 2024-09-17T03:16:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60958.log 2024-09-17T03:16:07.464 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44818.log.gz 2024-09-17T03:16:07.464 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.61407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68494.log 2024-09-17T03:16:07.464 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61407.log.gz 2024-09-17T03:16:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.60958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61065.log 2024-09-17T03:16:07.465 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60958.log.gz 2024-09-17T03:16:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.68494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72564.log 2024-09-17T03:16:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.61065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37095.log 2024-09-17T03:16:07.465 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.68494.log.gz 2024-09-17T03:16:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.72564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71871.log 2024-09-17T03:16:07.465 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72564.log.gz 2024-09-17T03:16:07.465 INFO:teuthology.orchestra.run.smithi078.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.61065.log.gz 2024-09-17T03:16:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66574.log 2024-09-17T03:16:07.465 INFO:teuthology.orchestra.run.smithi078.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37095.log.gz 2024-09-17T03:16:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.71871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50687.log 2024-09-17T03:16:07.465 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71871.log.gz 2024-09-17T03:16:07.465 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.66574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60137.log 2024-09-17T03:16:07.465 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66574.log.gz 2024-09-17T03:16:07.466 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71556.log 2024-09-17T03:16:07.466 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50687.log.gz 2024-09-17T03:16:07.466 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.60137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43739.log 2024-09-17T03:16:07.466 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.71556.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.60137.log.gz 2024-09-17T03:16:07.466 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50481.log 2024-09-17T03:16:07.466 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71556.log.gz 2024-09-17T03:16:07.466 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65263.log 2024-09-17T03:16:07.466 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43739.log.gz 2024-09-17T03:16:07.466 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44068.log 2024-09-17T03:16:07.466 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4%/var/log/ceph/ceph-client.admin.65263.log: -- replaced with /var/log/ceph/ceph-client.admin.50481.log.gz 2024-09-17T03:16:07.466 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59321.log 2024-09-17T03:16:07.466 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65263.log.gz 2024-09-17T03:16:07.466 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53237.log 2024-09-17T03:16:07.466 INFO:teuthology.orchestra.run.smithi078.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.44068.log.gz 2024-09-17T03:16:07.467 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63461.log 2024-09-17T03:16:07.467 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53237.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59321.log.gz 2024-09-17T03:16:07.467 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47430.log 2024-09-17T03:16:07.467 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.63461.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53237.log.gz 2024-09-17T03:16:07.467 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.0.63461.log.gz 2024-09-17T03:16:07.467 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.55047.log 2024-09-17T03:16:07.467 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53311.log 2024-09-17T03:16:07.467 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47430.log.gz 2024-09-17T03:16:07.467 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51902.log 2024-09-17T03:16:07.467 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55047.log.gz 2024-09-17T03:16:07.467 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69928.log 2024-09-17T03:16:07.467 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53311.log.gz 2024-09-17T03:16:07.467 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61000.log 2024-09-17T03:16:07.467 INFO:teuthology.orchestra.run.smithi078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51902.log.gz 2024-09-17T03:16:07.468 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.69928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56484.log 2024-09-17T03:16:07.468 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.69928.log.gz 2024-09-17T03:16:07.468 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.61000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55776.log 2024-09-17T03:16:07.468 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67545.log 2024-09-17T03:16:07.468 INFO:teuthology.orchestra.run.smithi078.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.61000.log.gz 2024-09-17T03:16:07.468 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67978.log 2024-09-17T03:16:07.468 INFO:teuthology.orchestra.run.smithi078.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.56484.log.gz 2024-09-17T03:16:07.468 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- 86.7% /var/log/ceph/ceph-client.admin.73080.log 2024-09-17T03:16:07.468 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55776.log.gz 2024-09-17T03:16:07.468 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.67545.log: /var/log/ceph/ceph-client.admin.67978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57199.log 2024-09-17T03:16:07.468 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67545.log.gz 2024-09-17T03:16:07.468 INFO:teuthology.orchestra.run.smithi078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.67978.log.gz 2024-09-17T03:16:07.468 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5/var/log/ceph/ceph-client.admin.73080.log: --verbose -- /var/log/ceph/ceph-client.admin.47686.log 2024-09-17T03:16:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57199.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73080.log.gz 2024-09-17T03:16:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62745.log 2024-09-17T03:16:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47686.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57199.log.gz 2024-09-17T03:16:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73290.log 2024-09-17T03:16:07.469 INFO:teuthology.orchestra.run.smithi078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47686.log.gz 2024-09-17T03:16:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43432.log 2024-09-17T03:16:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.73290.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62745.log.gz 2024-09-17T03:16:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66199.log 2024-09-17T03:16:07.469 INFO:teuthology.orchestra.run.smithi078.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.73290.log.gz 2024-09-17T03:16:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48329.log 2024-09-17T03:16:07.469 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43432.log.gz 2024-09-17T03:16:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.66199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42437.log 2024-09-17T03:16:07.469 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66199.log.gz/var/log/ceph/ceph-client.admin.48329.log: 2024-09-17T03:16:07.469 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36787.log 2024-09-17T03:16:07.470 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51566.log 2024-09-17T03:16:07.470 INFO:teuthology.orchestra.run.smithi078.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.42437.log.gz 2024-09-17T03:16:07.470 INFO:teuthology.orchestra.run.smithi078.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.48329.log.gz 2024-09-17T03:16:07.470 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36685.log 2024-09-17T03:16:07.470 INFO:teuthology.orchestra.run.smithi078.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36787.log.gz 2024-09-17T03:16:07.470 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61781.log 2024-09-17T03:16:07.470 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51566.log.gz 2024-09-17T03:16:07.470 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66780.log 2024-09-17T03:16:07.470 INFO:teuthology.orchestra.run.smithi078.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36685.log.gz 2024-09-17T03:16:07.470 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.61781.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.65863.log 2024-09-17T03:16:07.470 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.66780.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61781.log.gz 2024-09-17T03:16:07.470 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58211.log 2024-09-17T03:16:07.470 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.66780.log.gz 2024-09-17T03:16:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54518.log 2024-09-17T03:16:07.471 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65863.log.gz 2024-09-17T03:16:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64519.log 2024-09-17T03:16:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54518.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.58211.log.gz 2024-09-17T03:16:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46722.log 2024-09-17T03:16:07.471 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54518.log.gz 2024-09-17T03:16:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.64519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64987.log 2024-09-17T03:16:07.471 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64519.log.gz 2024-09-17T03:16:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52028.log 2024-09-17T03:16:07.471 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46722.log.gz 2024-09-17T03:16:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.64987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62009.log 2024-09-17T03:16:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47642.log 2024-09-17T03:16:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62009.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.64987.log.gz 2024-09-17T03:16:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49794.log 2024-09-17T03:16:07.472 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52028.log.gz 2024-09-17T03:16:07.472 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62009.log.gz 2024-09-17T03:16:07.472 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54830.log 2024-09-17T03:16:07.472 INFO:teuthology.orchestra.run.smithi078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47642.log.gz 2024-09-17T03:16:07.472 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36724.log 2024-09-17T03:16:07.472 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54830.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T03:16:07.472 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54830.log.gz 2024-09-17T03:16:07.472 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36724.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49794.log.gz 2024-09-17T03:16:07.472 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71829.log 2024-09-17T03:16:07.472 INFO:teuthology.orchestra.run.smithi078.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36724.log.gz 2024-09-17T03:16:07.472 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56550.log 2024-09-17T03:16:07.472 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.71829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65905.log 2024-09-17T03:16:07.472 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71829.log.gz 2024-09-17T03:16:07.473 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59801.log 2024-09-17T03:16:07.473 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72522.log 2024-09-17T03:16:07.473 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65905.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56550.log.gz 2024-09-17T03:16:07.473 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52406.log 2024-09-17T03:16:07.473 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.65905.log.gz 2024-09-17T03:16:07.473 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.72522.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.67372.log 2024-09-17T03:16:07.473 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52406.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.72522.log.gz 2024-09-17T03:16:07.473 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66031.log 2024-09-17T03:16:07.473 INFO:teuthology.orchestra.run.smithi078.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.59801.log.gz 2024-09-17T03:16:07.473 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52406.log.gz 2024-09-17T03:16:07.473 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.67372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43180.log 2024-09-17T03:16:07.473 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67501.log 2024-09-17T03:16:07.473 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4%/var/log/ceph/ceph-client.admin.66031.log: -- replaced with /var/log/ceph/ceph-client.admin.67372.log.gz 2024-09-17T03:16:07.473 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69688.log 2024-09-17T03:16:07.474 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43180.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66031.log.gz 2024-09-17T03:16:07.474 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.67501.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43180.log.gz 2024-09-17T03:16:07.474 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71286.log 2024-09-17T03:16:07.474 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67501.log.gz 2024-09-17T03:16:07.474 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.69688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46806.log 2024-09-17T03:16:07.474 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49841.log 2024-09-17T03:16:07.474 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.71286.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.69688.log.gz 2024-09-17T03:16:07.474 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46806.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.71286.log.gz 2024-09-17T03:16:07.474 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71033.log 2024-09-17T03:16:07.474 INFO:teuthology.orchestra.run.smithi078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.46806.log.gz 2024-09-17T03:16:07.474 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44902.log 2024-09-17T03:16:07.474 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60275.log 2024-09-17T03:16:07.474 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.71033.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49841.log.gz 2024-09-17T03:16:07.474 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71033.log.gz 2024-09-17T03:16:07.475 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69556.log 2024-09-17T03:16:07.475 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64482.log 2024-09-17T03:16:07.475 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.60275.log: /var/log/ceph/ceph-client.admin.69556.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44902.log.gz 2024-09-17T03:16:07.475 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57273.log 2024-09-17T03:16:07.475 INFO:teuthology.orchestra.run.smithi078.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.60275.log.gz 2024-09-17T03:16:07.475 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.64482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47909.log 2024-09-17T03:16:07.475 INFO:teuthology.orchestra.run.smithi078.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.69556.log.gz 2024-09-17T03:16:07.475 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57506.log 2024-09-17T03:16:07.475 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57273.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64482.log.gz 2024-09-17T03:16:07.475 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61533.log 2024-09-17T03:16:07.475 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57273.log.gz 2024-09-17T03:16:07.475 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47909.log.gz 2024-09-17T03:16:07.475 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59096.log 2024-09-17T03:16:07.476 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53932.log 2024-09-17T03:16:07.476 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.61533.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.57506.log.gz 2024-09-17T03:16:07.476 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65053.log 2024-09-17T03:16:07.476 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61533.log.gz 2024-09-17T03:16:07.476 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59096.log.gz 2024-09-17T03:16:07.476 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64723.log 2024-09-17T03:16:07.476 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53932.log.gz 2024-09-17T03:16:07.476 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43138.log 2024-09-17T03:16:07.476 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65053.log: /var/log/ceph/ceph-client.admin.64723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69149.log 2024-09-17T03:16:07.476 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65053.log.gz 2024-09-17T03:16:07.476 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70727.log 2024-09-17T03:16:07.476 INFO:teuthology.orchestra.run.smithi078.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.64723.log.gz 2024-09-17T03:16:07.476 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43138.log.gz 2024-09-17T03:16:07.476 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.69149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56280.log 2024-09-17T03:16:07.477 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.70727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69315.log 2024-09-17T03:16:07.477 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56280.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.70727.log.gz 2024-09-17T03:16:07.477 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68692.log 2024-09-17T03:16:07.477 INFO:teuthology.orchestra.run.smithi078.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.69149.log.gz 2024-09-17T03:16:07.477 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56280.log.gz 2024-09-17T03:16:07.477 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.69315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59489.log 2024-09-17T03:16:07.477 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.68692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60892.log 2024-09-17T03:16:07.477 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69315.log.gz 2024-09-17T03:16:07.477 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68692.log.gz 2024-09-17T03:16:07.477 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57033.log 2024-09-17T03:16:07.477 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62230.log 2024-09-17T03:16:07.477 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59489.log.gz 2024-09-17T03:16:07.477 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.60892.log: /var/log/ceph/ceph-client.admin.57033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66948.log 2024-09-17T03:16:07.477 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62230.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.60892.log.gzgzip 2024-09-17T03:16:07.478 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.62135.log 2024-09-17T03:16:07.478 INFO:teuthology.orchestra.run.smithi078.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57033.log.gz 2024-09-17T03:16:07.478 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62230.log.gz 2024-09-17T03:16:07.478 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54602.log 2024-09-17T03:16:07.478 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.66948.log: /var/log/ceph/ceph-client.admin.62135.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66948.log.gz 2024-09-17T03:16:07.478 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46000.log 2024-09-17T03:16:07.478 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62135.log.gz 2024-09-17T03:16:07.478 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72912.log 2024-09-17T03:16:07.478 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54602.log.gz 2024-09-17T03:16:07.478 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73479.log 2024-09-17T03:16:07.478 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46000.log.gz 2024-09-17T03:16:07.478 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.72912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65605.log 2024-09-17T03:16:07.478 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72912.log.gz 2024-09-17T03:16:07.478 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.73479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53800.log 2024-09-17T03:16:07.479 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73479.log.gz 2024-09-17T03:16:07.479 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58501.log 2024-09-17T03:16:07.479 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36767.log 2024-09-17T03:16:07.479 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53800.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.65605.log.gz 2024-09-17T03:16:07.479 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47598.log 2024-09-17T03:16:07.479 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36767.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58501.log.gz 2024-09-17T03:16:07.479 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69083.log 2024-09-17T03:16:07.479 INFO:teuthology.orchestra.run.smithi078.stderr: 91.1% 86.0% -- replaced with /var/log/ceph/ceph-client.admin.53800.log.gz -- replaced with /var/log/ceph/ceph-client.admin.36767.log.gz 2024-09-17T03:16:07.479 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.479 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69426.log 2024-09-17T03:16:07.479 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.69083.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47598.log.gz 2024-09-17T03:16:07.479 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72744.log 2024-09-17T03:16:07.479 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.69426.log: gzip 90.9% -- replaced with /var/log/ceph/ceph-client.admin.69083.log.gz 2024-09-17T03:16:07.479 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.65431.log 2024-09-17T03:16:07.480 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.69426.log.gz 2024-09-17T03:16:07.480 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.72744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67810.log 2024-09-17T03:16:07.480 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61575.log 2024-09-17T03:16:07.480 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72744.log.gz 2024-09-17T03:16:07.480 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65431.log.gz 2024-09-17T03:16:07.480 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.67810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67211.log 2024-09-17T03:16:07.480 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67810.log.gz 2024-09-17T03:16:07.480 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.61575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36293.log 2024-09-17T03:16:07.480 INFO:teuthology.orchestra.run.smithi078.stderr:gzip 87.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.61575.log.gz --verbose 2024-09-17T03:16:07.480 INFO:teuthology.orchestra.run.smithi078.stderr: -- /var/log/ceph/ceph-client.admin.63747.log 2024-09-17T03:16:07.480 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.67211.log: /var/log/ceph/ceph-client.admin.36293.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.67211.log.gz 2024-09-17T03:16:07.480 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71454.log 2024-09-17T03:16:07.480 INFO:teuthology.orchestra.run.smithi078.stderr: 76.2% -- replaced with /var/log/ceph/ceph-client.admin.36293.log.gz 2024-09-17T03:16:07.481 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47303.log 2024-09-17T03:16:07.481 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.63747.log: /var/log/ceph/ceph-client.admin.71454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58711.log 2024-09-17T03:16:07.481 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71454.log.gz 2024-09-17T03:16:07.481 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66864.log 2024-09-17T03:16:07.481 INFO:teuthology.orchestra.run.smithi078.stderr: 90.8% 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63747.log.gz -- replaced with /var/log/ceph/ceph-client.admin.47303.log.gz 2024-09-17T03:16:07.481 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.481 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58459.log 2024-09-17T03:16:07.481 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58711.log.gz 2024-09-17T03:16:07.481 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57440.log 2024-09-17T03:16:07.481 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.66864.log: /var/log/ceph/ceph-client.admin.58459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56010.log 2024-09-17T03:16:07.481 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66864.log.gz 2024-09-17T03:16:07.481 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58459.log.gz 2024-09-17T03:16:07.481 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45821.log 2024-09-17T03:16:07.481 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54872.log 2024-09-17T03:16:07.482 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56010.log: /var/log/ceph/ceph-client.2.45821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45821.log.gz 2024-09-17T03:16:07.482 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56010.log.gz 2024-09-17T03:16:07.482 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 90.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.57440.log.gz 2024-09-17T03:16:07.482 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.55482.log 2024-09-17T03:16:07.482 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48035.log 2024-09-17T03:16:07.482 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54872.log: /var/log/ceph/ceph-client.admin.55482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67726.log 2024-09-17T03:16:07.482 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54872.log.gz 2024-09-17T03:16:07.482 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55482.log.gz 2024-09-17T03:16:07.482 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60826.log 2024-09-17T03:16:07.482 INFO:teuthology.orchestra.run.smithi078.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.48035.log.gz 2024-09-17T03:16:07.482 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44407.log 2024-09-17T03:16:07.482 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.67726.log: /var/log/ceph/ceph-client.admin.60826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46210.log 2024-09-17T03:16:07.482 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67726.log.gz 2024-09-17T03:16:07.482 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45825.log 2024-09-17T03:16:07.483 INFO:teuthology.orchestra.run.smithi078.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.60826.log.gz 2024-09-17T03:16:07.483 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44407.log.gz 2024-09-17T03:16:07.483 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59363.log 2024-09-17T03:16:07.483 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46210.log.gz 2024-09-17T03:16:07.483 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56418.log 2024-09-17T03:16:07.483 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.2.45825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.45825.log.gz 2024-09-17T03:16:07.483 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65473.log 2024-09-17T03:16:07.483 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59363.log.gz 2024-09-17T03:16:07.483 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52502.log 2024-09-17T03:16:07.483 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50897.log 2024-09-17T03:16:07.483 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65473.log: /var/log/ceph/ceph-client.admin.52502.log: 91.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.56418.log.gz -5 2024-09-17T03:16:07.483 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.65347.log 2024-09-17T03:16:07.483 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.65473.log.gz 2024-09-17T03:16:07.483 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66658.log 2024-09-17T03:16:07.484 INFO:teuthology.orchestra.run.smithi078.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.52502.log.gz 2024-09-17T03:16:07.484 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44734.log 2024-09-17T03:16:07.484 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50897.log.gz 2024-09-17T03:16:07.484 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65347.log: /var/log/ceph/ceph-client.admin.66658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46126.log 2024-09-17T03:16:07.484 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65347.log.gz 2024-09-17T03:16:07.484 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.66658.log.gz 2024-09-17T03:16:07.484 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47951.log 2024-09-17T03:16:07.484 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62699.log 2024-09-17T03:16:07.484 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44734.log.gz 2024-09-17T03:16:07.484 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46126.log: /var/log/ceph/ceph-client.admin.47951.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46126.log.gz 2024-09-17T03:16:07.484 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70055.log 2024-09-17T03:16:07.484 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47951.log.gz 2024-09-17T03:16:07.484 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46510.log 2024-09-17T03:16:07.484 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62699.log: /var/log/ceph/ceph-client.admin.70055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62093.log 2024-09-17T03:16:07.485 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62699.log.gz 2024-09-17T03:16:07.485 INFO:teuthology.orchestra.run.smithi078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.70055.log.gz 2024-09-17T03:16:07.485 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49709.log 2024-09-17T03:16:07.485 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46510.log.gz 2024-09-17T03:16:07.485 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54967.log 2024-09-17T03:16:07.485 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.62093.log.gz 2024-09-17T03:16:07.485 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64316.log 2024-09-17T03:16:07.485 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49709.log: /var/log/ceph/ceph-client.admin.54967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50813.log 2024-09-17T03:16:07.485 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.64316.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54967.log.gz 2024-09-17T03:16:07.485 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52931.log 2024-09-17T03:16:07.485 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49709.log.gz 2024-09-17T03:16:07.485 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45517.log 2024-09-17T03:16:07.485 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50813.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.64316.log.gz 2024-09-17T03:16:07.485 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44412.log 2024-09-17T03:16:07.485 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50813.log.gz 2024-09-17T03:16:07.486 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45517.log: gzip -5 --verbose -- 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45517.log.gz 2024-09-17T03:16:07.486 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.51237.log 2024-09-17T03:16:07.486 INFO:teuthology.orchestra.run.smithi078.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52931.log.gz 2024-09-17T03:16:07.486 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57656.log 2024-09-17T03:16:07.486 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44412.log.gz 2024-09-17T03:16:07.486 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70013.log 2024-09-17T03:16:07.486 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57656.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51237.log.gz 2024-09-17T03:16:07.486 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71514.log 2024-09-17T03:16:07.486 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.70013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53602.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.70013.log.gz 2024-09-17T03:16:07.486 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.486 INFO:teuthology.orchestra.run.smithi078.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.57656.log.gz 2024-09-17T03:16:07.486 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.71514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62829.log 2024-09-17T03:16:07.486 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71514.log.gz 2024-09-17T03:16:07.487 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43734.log 2024-09-17T03:16:07.487 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53536.log 2024-09-17T03:16:07.487 INFO:teuthology.orchestra.run.smithi078.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53602.log.gz 2024-09-17T03:16:07.487 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62829.log.gz 2024-09-17T03:16:07.487 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.43734.log: -- /var/log/ceph/ceph-client.admin.60473.log 2024-09-17T03:16:07.487 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73332.log 2024-09-17T03:16:07.487 INFO:teuthology.orchestra.run.smithi078.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.43734.log.gz 2024-09-17T03:16:07.487 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.60473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58085.log 2024-09-17T03:16:07.487 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60473.log.gz 2024-09-17T03:16:07.487 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.73332.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53536.log.gz 2024-09-17T03:16:07.487 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49915.log 2024-09-17T03:16:07.487 INFO:teuthology.orchestra.run.smithi078.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.73332.log.gz 2024-09-17T03:16:07.487 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59275.log 2024-09-17T03:16:07.487 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58085.log: /var/log/ceph/ceph-client.admin.49915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56616.log 2024-09-17T03:16:07.488 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58085.log.gz 2024-09-17T03:16:07.488 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59275.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49915.log.gz 2024-09-17T03:16:07.488 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52568.log 2024-09-17T03:16:07.488 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.59275.log.gz 2024-09-17T03:16:07.488 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43054.log 2024-09-17T03:16:07.488 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56616.log: /var/log/ceph/ceph-client.admin.52568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44291.log 2024-09-17T03:16:07.488 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56616.log.gz 2024-09-17T03:16:07.488 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54373.log 2024-09-17T03:16:07.488 INFO:teuthology.orchestra.run.smithi078.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52568.log.gz 2024-09-17T03:16:07.488 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43054.log.gz 2024-09-17T03:16:07.488 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55860.log 2024-09-17T03:16:07.488 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44291.log.gz 2024-09-17T03:16:07.488 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50439.log 2024-09-17T03:16:07.488 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54373.log: /var/log/ceph/ceph-client.admin.55860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47016.log 2024-09-17T03:16:07.489 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54373.log.gz 2024-09-17T03:16:07.489 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55860.log.gz 2024-09-17T03:16:07.489 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36367.log 2024-09-17T03:16:07.489 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50439.log.gz 2024-09-17T03:16:07.489 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48287.log 2024-09-17T03:16:07.489 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47016.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47016.log.gz 2024-09-17T03:16:07.489 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44066.log 2024-09-17T03:16:07.489 INFO:teuthology.orchestra.run.smithi078.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.36367.log.gz 2024-09-17T03:16:07.489 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36209.log 2024-09-17T03:16:07.489 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48287.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48287.log.gz 2024-09-17T03:16:07.489 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43222.log 2024-09-17T03:16:07.489 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44066.log.gz 2024-09-17T03:16:07.489 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52457.log 2024-09-17T03:16:07.489 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36209.log.gz 2024-09-17T03:16:07.490 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62913.log 2024-09-17T03:16:07.490 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43222.log.gz 2024-09-17T03:16:07.490 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42756.log 2024-09-17T03:16:07.490 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52457.log.gz 2024-09-17T03:16:07.490 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63273.log 2024-09-17T03:16:07.490 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62913.log.gz 2024-09-17T03:16:07.490 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61967.log 2024-09-17T03:16:07.490 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42756.log.gz 2024-09-17T03:16:07.490 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.63273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48583.log 2024-09-17T03:16:07.490 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63273.log.gz 2024-09-17T03:16:07.490 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.61967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67596.log 2024-09-17T03:16:07.490 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61967.log.gz 2024-09-17T03:16:07.490 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.48583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48583.log.gz 2024-09-17T03:16:07.490 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62391.log 2024-09-17T03:16:07.490 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.67596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68560.log 2024-09-17T03:16:07.491 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67596.log.gz 2024-09-17T03:16:07.491 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47058.log 2024-09-17T03:16:07.491 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62391.log.gz 2024-09-17T03:16:07.491 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53668.log 2024-09-17T03:16:07.491 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.68560.log: /var/log/ceph/ceph-client.admin.47058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36237.log 2024-09-17T03:16:07.491 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47058.log.gz 2024-09-17T03:16:07.491 INFO:teuthology.orchestra.run.smithi078.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.68560.log.gz 2024-09-17T03:16:07.491 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.53668.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.72039.log 2024-09-17T03:16:07.491 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43306.log 2024-09-17T03:16:07.491 INFO:teuthology.orchestra.run.smithi078.stderr: 76.7% -- replaced with /var/log/ceph/ceph-client.admin.36237.log.gz 2024-09-17T03:16:07.491 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.72039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54247.log 2024-09-17T03:16:07.491 INFO:teuthology.orchestra.run.smithi078.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53668.log.gz 2024-09-17T03:16:07.491 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43306.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.72039.log.gz 2024-09-17T03:16:07.491 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T03:16:07.492 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43306.log.gz 2024-09-17T03:16:07.492 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58417.log 2024-09-17T03:16:07.492 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54247.log.gz 2024-09-17T03:16:07.492 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58375.log 2024-09-17T03:16:07.492 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67414.log 2024-09-17T03:16:07.492 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58417.log.gz 2024-09-17T03:16:07.492 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66990.log 2024-09-17T03:16:07.492 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.67414.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58375.log.gz 2024-09-17T03:16:07.492 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50771.log 2024-09-17T03:16:07.492 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67414.log.gz 2024-09-17T03:16:07.492 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.66990.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50271.log 2024-09-17T03:16:07.492 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50771.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66990.log.gz 2024-09-17T03:16:07.492 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50771.log.gz 2024-09-17T03:16:07.492 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.64630.log 2024-09-17T03:16:07.493 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50271.log: gzip -5 89.6% --verbose -- -- replaced with /var/log/ceph/ceph.audit.log.gz /var/log/ceph/ceph-client.admin.36491.log 2024-09-17T03:16:07.493 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.493 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50271.log.gz 2024-09-17T03:16:07.493 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.64630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62955.log 2024-09-17T03:16:07.493 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64630.log.gz 2024-09-17T03:16:07.493 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66115.log 2024-09-17T03:16:07.493 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36491.log: /var/log/ceph/ceph-client.admin.62955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71117.log 2024-09-17T03:16:07.493 INFO:teuthology.orchestra.run.smithi078.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.36491.log.gz 2024-09-17T03:16:07.493 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4%/var/log/ceph/ceph-client.admin.66115.log: -- replaced with /var/log/ceph/ceph-client.admin.62955.log.gz 2024-09-17T03:16:07.493 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36654.log 2024-09-17T03:16:07.493 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66115.log.gz 2024-09-17T03:16:07.493 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.71117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51776.log 2024-09-17T03:16:07.493 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36654.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71117.log.gz 2024-09-17T03:16:07.493 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61449.log 2024-09-17T03:16:07.494 INFO:teuthology.orchestra.run.smithi078.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36654.log.gz 2024-09-17T03:16:07.494 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48395.log 2024-09-17T03:16:07.494 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51776.log.gz 2024-09-17T03:16:07.494 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.61449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65137.log 2024-09-17T03:16:07.494 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4%/var/log/ceph/ceph-client.admin.48395.log: -- replaced with /var/log/ceph/ceph-client.admin.61449.log.gz 2024-09-17T03:16:07.494 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50313.log 2024-09-17T03:16:07.494 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48395.log.gz 2024-09-17T03:16:07.494 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44650.log 2024-09-17T03:16:07.494 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.65137.log.gz 2024-09-17T03:16:07.494 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67456.log 2024-09-17T03:16:07.494 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50313.log.gz 2024-09-17T03:16:07.494 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65095.log 2024-09-17T03:16:07.494 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44650.log.gz 2024-09-17T03:16:07.494 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.67456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62475.log 2024-09-17T03:16:07.495 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67456.log.gz 2024-09-17T03:16:07.495 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69352.log 2024-09-17T03:16:07.495 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.65095.log.gz 2024-09-17T03:16:07.495 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47867.log 2024-09-17T03:16:07.495 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.62475.log.gz 2024-09-17T03:16:07.495 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.69352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48869.log 2024-09-17T03:16:07.495 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47867.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.69352.log.gz 2024-09-17T03:16:07.495 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73164.log 2024-09-17T03:16:07.495 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47867.log.gz 2024-09-17T03:16:07.495 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47472.log 2024-09-17T03:16:07.495 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.73164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48203.log 2024-09-17T03:16:07.495 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48869.log.gz 2024-09-17T03:16:07.495 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73164.log.gz 2024-09-17T03:16:07.495 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51195.log 2024-09-17T03:16:07.496 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47472.log: /var/log/ceph/ceph-client.admin.48203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58669.log 2024-09-17T03:16:07.496 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47472.log.gz 2024-09-17T03:16:07.496 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48203.log.gz 2024-09-17T03:16:07.496 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51860.log 2024-09-17T03:16:07.496 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51986.log 2024-09-17T03:16:07.496 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51195.log.gz 2024-09-17T03:16:07.496 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58669.log: /var/log/ceph/ceph-client.admin.51860.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58669.log.gz 2024-09-17T03:16:07.496 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68626.log 2024-09-17T03:16:07.496 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51860.log.gz 2024-09-17T03:16:07.496 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67680.log 2024-09-17T03:16:07.496 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51986.log: /var/log/ceph/ceph-client.admin.68626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70097.log 2024-09-17T03:16:07.496 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51986.log.gz 2024-09-17T03:16:07.496 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.67680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53348.log 2024-09-17T03:16:07.497 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67680.log.gz 2024-09-17T03:16:07.497 INFO:teuthology.orchestra.run.smithi078.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.68626.log.gz 2024-09-17T03:16:07.497 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.70097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72870.log 2024-09-17T03:16:07.497 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70097.log.gz 2024-09-17T03:16:07.497 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60059.log 2024-09-17T03:16:07.497 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53348.log: /var/log/ceph/ceph-client.admin.72870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70289.log 2024-09-17T03:16:07.497 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53348.log.gz 2024-09-17T03:16:07.497 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72870.log.gz 2024-09-17T03:16:07.497 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.60059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72828.log 2024-09-17T03:16:07.497 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60059.log.gz 2024-09-17T03:16:07.497 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60055.log 2024-09-17T03:16:07.497 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.70289.log: /var/log/ceph/ceph-client.admin.72828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63639.log 2024-09-17T03:16:07.497 INFO:teuthology.orchestra.run.smithi078.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.70289.log.gz 2024-09-17T03:16:07.497 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72828.log.gz 2024-09-17T03:16:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.60055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.60055.log.gz 2024-09-17T03:16:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59051.log 2024-09-17T03:16:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.63639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45379.log 2024-09-17T03:16:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59051.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63639.log.gz 2024-09-17T03:16:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70181.log 2024-09-17T03:16:07.498 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59051.log.gz 2024-09-17T03:16:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.45379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45379.log.gz 2024-09-17T03:16:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73038.log 2024-09-17T03:16:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57590.log 2024-09-17T03:16:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.70181.log: /var/log/ceph/ceph-client.admin.73038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72203.log 2024-09-17T03:16:07.498 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.70181.log.gz 2024-09-17T03:16:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57590.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.73038.log.gz 2024-09-17T03:16:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61659.log 2024-09-17T03:16:07.498 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.72203.log: gzip -5 --verbose -- 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72203.log.gz 2024-09-17T03:16:07.498 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.70553.log 2024-09-17T03:16:07.499 INFO:teuthology.orchestra.run.smithi078.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.57590.log.gz 2024-09-17T03:16:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.61659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53866.log 2024-09-17T03:16:07.499 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.61659.log.gz 2024-09-17T03:16:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.70553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44292.log 2024-09-17T03:16:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52634.log 2024-09-17T03:16:07.499 INFO:teuthology.orchestra.run.smithi078.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.70553.log.gz 2024-09-17T03:16:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43740.log 2024-09-17T03:16:07.499 INFO:teuthology.orchestra.run.smithi078.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.53866.log.gz 2024-09-17T03:16:07.499 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44292.log.gz 2024-09-17T03:16:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71997.log 2024-09-17T03:16:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43348.log 2024-09-17T03:16:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.71997.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43740.log.gz 2024-09-17T03:16:07.499 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43390.log 2024-09-17T03:16:07.499 INFO:teuthology.orchestra.run.smithi078.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.52634.log.gz 2024-09-17T03:16:07.500 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.71997.log.gz 2024-09-17T03:16:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57384.log 2024-09-17T03:16:07.500 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43348.log.gz 2024-09-17T03:16:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48935.log 2024-09-17T03:16:07.500 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43390.log.gz 2024-09-17T03:16:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64921.log 2024-09-17T03:16:07.500 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57384.log.gz 2024-09-17T03:16:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44075.log 2024-09-17T03:16:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54686.log 2024-09-17T03:16:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.64921.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48935.log.gz 2024-09-17T03:16:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55436.log 2024-09-17T03:16:07.500 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44075.log.gz 2024-09-17T03:16:07.500 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59447.log 2024-09-17T03:16:07.500 INFO:teuthology.orchestra.run.smithi078.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.64921.log.gz 2024-09-17T03:16:07.501 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54686.log.gz 2024-09-17T03:16:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71159.log 2024-09-17T03:16:07.501 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55436.log.gz 2024-09-17T03:16:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.59447.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.59140.log 2024-09-17T03:16:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.71159.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.59447.log.gz 2024-09-17T03:16:07.501 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71159.log.gz 2024-09-17T03:16:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54788.log 2024-09-17T03:16:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59531.log 2024-09-17T03:16:07.501 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59140.log.gz 2024-09-17T03:16:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67291.log 2024-09-17T03:16:07.501 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54788.log.gz 2024-09-17T03:16:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69622.log 2024-09-17T03:16:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59531.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59531.log.gz 2024-09-17T03:16:07.501 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.67291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62433.log 2024-09-17T03:16:07.502 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67291.log.gz 2024-09-17T03:16:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71202.log 2024-09-17T03:16:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.69622.log: /var/log/ceph/ceph-client.admin.62433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48119.log 2024-09-17T03:16:07.502 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62433.log.gz 2024-09-17T03:16:07.502 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.69622.log.gz 2024-09-17T03:16:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.71202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67894.log 2024-09-17T03:16:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48119.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71202.log.gz 2024-09-17T03:16:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48587.log 2024-09-17T03:16:07.502 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48119.log.gz 2024-09-17T03:16:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.67894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51389.log 2024-09-17T03:16:07.502 INFO:teuthology.orchestra.run.smithi078.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.67894.log.gz 2024-09-17T03:16:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.48587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47993.log 2024-09-17T03:16:07.502 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48587.log.gz 2024-09-17T03:16:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44070.log 2024-09-17T03:16:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51389.log: /var/log/ceph/ceph-client.admin.47993.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51389.log.gz 2024-09-17T03:16:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37336.log 2024-09-17T03:16:07.503 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47993.log.gz 2024-09-17T03:16:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42518.log 2024-09-17T03:16:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44070.log: /var/log/ceph/ceph-client.admin.37336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70967.log 2024-09-17T03:16:07.503 INFO:teuthology.orchestra.run.smithi078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44070.log.gz 2024-09-17T03:16:07.503 INFO:teuthology.orchestra.run.smithi078.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37336.log.gz 2024-09-17T03:16:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57907.log 2024-09-17T03:16:07.503 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42518.log.gz 2024-09-17T03:16:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.70967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47514.log 2024-09-17T03:16:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-17T03:16:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57907.log: /var/log/ceph/ceph-client.admin.47514.log: gzip 90.9% 87.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.57907.log.gz -- replaced with /var/log/ceph/ceph-client.admin.70967.log.gz 2024-09-17T03:16:07.503 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.504 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.73206.log 2024-09-17T03:16:07.504 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47514.log.gz 2024-09-17T03:16:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65179.log 2024-09-17T03:16:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.73206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53974.log 2024-09-17T03:16:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65179.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.73206.log.gz 2024-09-17T03:16:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59615.log 2024-09-17T03:16:07.504 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65179.log.gz 2024-09-17T03:16:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36567.log 2024-09-17T03:16:07.504 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53974.log.gz 2024-09-17T03:16:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36152.log 2024-09-17T03:16:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59615.log: /var/log/ceph/ceph-client.admin.36567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54163.log 2024-09-17T03:16:07.504 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59615.log.gz 2024-09-17T03:16:07.504 INFO:teuthology.orchestra.run.smithi078.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.36567.log.gz 2024-09-17T03:16:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46294.log 2024-09-17T03:16:07.505 INFO:teuthology.orchestra.run.smithi078.stderr: 76.5% -- replaced with /var/log/ceph/ceph-client.admin.36152.log.gz 2024-09-17T03:16:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52997.log 2024-09-17T03:16:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54163.log: /var/log/ceph/ceph-client.admin.46294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53470.log 2024-09-17T03:16:07.505 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54163.log.gz 2024-09-17T03:16:07.505 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46294.log.gz 2024-09-17T03:16:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61195.log 2024-09-17T03:16:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36321.log 2024-09-17T03:16:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53470.log: /var/log/ceph/ceph-client.admin.61195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56967.log 2024-09-17T03:16:07.505 INFO:teuthology.orchestra.run.smithi078.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.52997.log.gz 2024-09-17T03:16:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61841.log 2024-09-17T03:16:07.505 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53470.log.gz 2024-09-17T03:16:07.505 INFO:teuthology.orchestra.run.smithi078.stderr: 78.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49001.log 2024-09-17T03:16:07.505 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36321.log.gz 2024-09-17T03:16:07.506 INFO:teuthology.orchestra.run.smithi078.stderr: 90.8%/var/log/ceph/ceph-client.admin.56967.log: -- replaced with /var/log/ceph/ceph-client.admin.61195.log.gz 2024-09-17T03:16:07.506 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.61841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64593.log 2024-09-17T03:16:07.506 INFO:teuthology.orchestra.run.smithi078.stderr:gzip 87.1% -- replaced with /var/log/ceph/ceph-client.admin.61841.log.gz 2024-09-17T03:16:07.506 INFO:teuthology.orchestra.run.smithi078.stderr: -5/var/log/ceph/ceph-client.admin.49001.log: --verbose -- /var/log/ceph/ceph-client.admin.58886.log 2024-09-17T03:16:07.506 INFO:teuthology.orchestra.run.smithi078.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.56967.log.gz 2024-09-17T03:16:07.506 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.64593.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49001.log.gz 2024-09-17T03:16:07.506 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52282.log 2024-09-17T03:16:07.506 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64593.log.gz 2024-09-17T03:16:07.506 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72480.log 2024-09-17T03:16:07.506 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58886.log.gz 2024-09-17T03:16:07.506 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50523.log 2024-09-17T03:16:07.506 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.52282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52282.log.gz 2024-09-17T03:16:07.506 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.72480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63465.log 2024-09-17T03:16:07.506 INFO:teuthology.orchestra.run.smithi078.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.72480.log.gz 2024-09-17T03:16:07.507 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71787.log 2024-09-17T03:16:07.507 INFO:teuthology.orchestra.run.smithi078.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50523.log.gz 2024-09-17T03:16:07.507 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48161.log 2024-09-17T03:16:07.507 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.63465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.63465.log.gz 2024-09-17T03:16:07.507 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.71787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36543.log 2024-09-17T03:16:07.507 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71787.log.gz 2024-09-17T03:16:07.507 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54331.log 2024-09-17T03:16:07.507 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48161.log.gz 2024-09-17T03:16:07.507 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54644.log 2024-09-17T03:16:07.507 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36543.log: /var/log/ceph/ceph-client.admin.54331.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.36543.log.gz 2024-09-17T03:16:07.507 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55944.log 2024-09-17T03:16:07.507 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54331.log.gz 2024-09-17T03:16:07.507 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49643.log 2024-09-17T03:16:07.507 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47821.log 2024-09-17T03:16:07.508 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54644.log.gz 2024-09-17T03:16:07.508 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55944.log: /var/log/ceph/ceph-client.admin.49643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72606.log 2024-09-17T03:16:07.508 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47821.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.55944.log.gz 2024-09-17T03:16:07.508 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51944.log 2024-09-17T03:16:07.508 INFO:teuthology.orchestra.run.smithi078.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.49643.log.gz 2024-09-17T03:16:07.508 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6%/var/log/ceph/ceph-client.admin.72606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68356.log 2024-09-17T03:16:07.508 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47821.log.gz 2024-09-17T03:16:07.508 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.72606.log.gz 2024-09-17T03:16:07.508 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48077.log 2024-09-17T03:16:07.508 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- 87.1% /var/log/ceph/ceph-client.admin.57722.log 2024-09-17T03:16:07.508 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51944.log.gz 2024-09-17T03:16:07.508 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.68356.log: /var/log/ceph/ceph-client.admin.48077.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68356.log.gz 2024-09-17T03:16:07.508 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56202.log 2024-09-17T03:16:07.508 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48077.log.gz 2024-09-17T03:16:07.509 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.57722.log: /var/log/ceph/ceph-client.admin.71244.log 2024-09-17T03:16:07.509 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.56202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69971.log 2024-09-17T03:16:07.509 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.56202.log.gz 2024-09-17T03:16:07.509 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.71244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47737.log 2024-09-17T03:16:07.509 INFO:teuthology.orchestra.run.smithi078.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57722.log.gz 2024-09-17T03:16:07.509 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71244.log.gz 2024-09-17T03:16:07.509 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.69971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64184.log 2024-09-17T03:16:07.509 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.69971.log.gz 2024-09-17T03:16:07.509 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43737.log 2024-09-17T03:16:07.509 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47737.log.gz 2024-09-17T03:16:07.509 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60233.log 2024-09-17T03:16:07.509 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.64184.log: /var/log/ceph/ceph-client.admin.43737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49989.log 2024-09-17T03:16:07.509 INFO:teuthology.orchestra.run.smithi078.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43737.log.gz 2024-09-17T03:16:07.510 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.60233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51324.log 2024-09-17T03:16:07.510 INFO:teuthology.orchestra.run.smithi078.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.64184.log.gz 2024-09-17T03:16:07.510 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60233.log.gz 2024-09-17T03:16:07.510 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57310.log 2024-09-17T03:16:07.510 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49989.log.gz 2024-09-17T03:16:07.510 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49878.log 2024-09-17T03:16:07.510 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose 87.3% -- /var/log/ceph/ceph-client.admin.72081.log -- replaced with /var/log/ceph/ceph-client.admin.51324.log.gz 2024-09-17T03:16:07.510 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.510 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57310.log: /var/log/ceph/ceph-client.admin.49878.log: gzip -5 --verbose -- 89.3% /var/log/ceph/ceph-client.admin.44692.log 2024-09-17T03:16:07.510 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57310.log.gz 2024-09-17T03:16:07.510 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64855.log 2024-09-17T03:16:07.510 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.72081.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49878.log.gz 2024-09-17T03:16:07.510 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44692.log: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.72081.log.gz 2024-09-17T03:16:07.510 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55352.log 2024-09-17T03:16:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60407.log 2024-09-17T03:16:07.511 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44692.log.gz 2024-09-17T03:16:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.64855.log: /var/log/ceph/ceph-client.admin.55352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55608.log 2024-09-17T03:16:07.511 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55352.log.gz 2024-09-17T03:16:07.511 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.64855.log.gz 2024-09-17T03:16:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.60407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57788.log 2024-09-17T03:16:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47556.log 2024-09-17T03:16:07.511 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55608.log.gz 2024-09-17T03:16:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57788.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.60407.log.gz 2024-09-17T03:16:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70619.log 2024-09-17T03:16:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51114.log 2024-09-17T03:16:07.511 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.57788.log.gz 2024-09-17T03:16:07.511 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47556.log.gz 2024-09-17T03:16:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.70619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42614.log 2024-09-17T03:16:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73122.log 2024-09-17T03:16:07.512 INFO:teuthology.orchestra.run.smithi078.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.70619.log.gz 2024-09-17T03:16:07.512 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51114.log.gz 2024-09-17T03:16:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42842.log 2024-09-17T03:16:07.512 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42614.log.gz 2024-09-17T03:16:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.73122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66616.log 2024-09-17T03:16:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42842.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T03:16:07.512 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.73122.log.gz 2024-09-17T03:16:07.512 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42842.log.gz 2024-09-17T03:16:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.66616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50729.log 2024-09-17T03:16:07.512 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66616.log.gz 2024-09-17T03:16:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46848.log 2024-09-17T03:16:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.50729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62871.log 2024-09-17T03:16:07.512 INFO:teuthology.orchestra.run.smithi078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.50729.log.gz 2024-09-17T03:16:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51524.log 2024-09-17T03:16:07.513 INFO:teuthology.orchestra.run.smithi078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.46848.log.gz 2024-09-17T03:16:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65539.log 2024-09-17T03:16:07.513 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.62871.log.gz 2024-09-17T03:16:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51734.log 2024-09-17T03:16:07.513 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51524.log.gz 2024-09-17T03:16:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.65539.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.72659.log 2024-09-17T03:16:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61617.log 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51734.log.gz 2024-09-17T03:16:07.513 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.513 INFO:teuthology.orchestra.run.smithi078.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.65539.log.gz 2024-09-17T03:16:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.72659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63123.log 2024-09-17T03:16:07.513 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.72659.log.gz 2024-09-17T03:16:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.61617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59759.log 2024-09-17T03:16:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.63123.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61617.log.gz 2024-09-17T03:16:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68407.log 2024-09-17T03:16:07.514 INFO:teuthology.orchestra.run.smithi078.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.63123.log.gz 2024-09-17T03:16:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.59759.log: -- /var/log/ceph/ceph-client.admin.43558.log 2024-09-17T03:16:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.68407.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.59759.log.gz 2024-09-17T03:16:07.514 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68407.log.gz 2024-09-17T03:16:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36265.log 2024-09-17T03:16:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59867.log 2024-09-17T03:16:07.514 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43558.log.gz/var/log/ceph/ceph-client.admin.36265.log: 2024-09-17T03:16:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36740.log 2024-09-17T03:16:07.514 INFO:teuthology.orchestra.run.smithi078.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.36265.log.gz 2024-09-17T03:16:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55257.log 2024-09-17T03:16:07.514 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59867.log.gz 2024-09-17T03:16:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65737.log 2024-09-17T03:16:07.514 INFO:teuthology.orchestra.run.smithi078.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36740.log.gz 2024-09-17T03:16:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58043.log 2024-09-17T03:16:07.515 INFO:teuthology.orchestra.run.smithi078.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.55257.log.gz 2024-09-17T03:16:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44060.log 2024-09-17T03:16:07.515 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.65737.log.gz 2024-09-17T03:16:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55128.log 2024-09-17T03:16:07.515 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58043.log.gz 2024-09-17T03:16:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58585.log 2024-09-17T03:16:07.515 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44060.log.gz 2024-09-17T03:16:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46680.log 2024-09-17T03:16:07.515 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55128.log.gz 2024-09-17T03:16:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72161.log 2024-09-17T03:16:07.515 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58585.log.gz 2024-09-17T03:16:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46680.log: gzip -5 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46680.log.gz 2024-09-17T03:16:07.516 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50603.log 2024-09-17T03:16:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.72161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69886.log 2024-09-17T03:16:07.516 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.72161.log.gz 2024-09-17T03:16:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44411.log 2024-09-17T03:16:07.516 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50603.log.gz 2024-09-17T03:16:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.69886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63081.log 2024-09-17T03:16:07.516 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.69886.log.gz 2024-09-17T03:16:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67852.log 2024-09-17T03:16:07.516 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44411.log.gz 2024-09-17T03:16:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.63081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59717.log 2024-09-17T03:16:07.516 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63081.log.gz 2024-09-17T03:16:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.67852.log: -- /var/log/ceph/ceph-osd.2.log 2024-09-17T03:16:07.516 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67852.log.gz 2024-09-17T03:16:07.517 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51440.log 2024-09-17T03:16:07.517 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59717.log.gz 2024-09-17T03:16:07.517 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46974.log 2024-09-17T03:16:07.517 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51440.log: gzip -5 --verbose -- 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51440.log.gz 2024-09-17T03:16:07.517 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.67116.log 2024-09-17T03:16:07.517 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50026.log 2024-09-17T03:16:07.517 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46974.log.gz 2024-09-17T03:16:07.517 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.67116.log: gzip -5 --verbose -- 87.3% /var/log/ceph/ceph-client.admin.44074.log 2024-09-17T03:16:07.517 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67116.log.gz 2024-09-17T03:16:07.517 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69389.log 2024-09-17T03:16:07.517 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50026.log.gz/var/log/ceph/ceph-client.admin.44074.log: 2024-09-17T03:16:07.517 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56198.log 2024-09-17T03:16:07.517 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44074.log.gz 2024-09-17T03:16:07.517 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63594.log 2024-09-17T03:16:07.518 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.69389.log: gzip/var/log/ceph/ceph-client.0.56198.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.0.56198.log.gz 2024-09-17T03:16:07.518 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.46602.log 2024-09-17T03:16:07.518 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.63594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50135.log 2024-09-17T03:16:07.518 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.69389.log.gz 2024-09-17T03:16:07.518 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63594.log.gz 2024-09-17T03:16:07.518 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58295.log 2024-09-17T03:16:07.518 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46602.log.gz 2024-09-17T03:16:07.518 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50135.log: gzip -5 --verbose -- 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50135.log.gz 2024-09-17T03:16:07.518 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.54728.log 2024-09-17T03:16:07.518 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58295.log: gzip -5 --verbose -- 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58295.log.gz 2024-09-17T03:16:07.518 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.44408.log 2024-09-17T03:16:07.518 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54728.log: gzip -5 --verbose -- 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54728.log.gz 2024-09-17T03:16:07.518 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.65305.log 2024-09-17T03:16:07.519 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44408.log: gzip -5 --verbose -- 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44408.log.gz 2024-09-17T03:16:07.519 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.69463.log 2024-09-17T03:16:07.519 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65305.log: gzip -5 --verbose -- 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65305.log.gz 2024-09-17T03:16:07.519 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.61701.log 2024-09-17T03:16:07.519 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.69463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66388.log 2024-09-17T03:16:07.519 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69463.log.gz 2024-09-17T03:16:07.519 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.61701.log: gzip -5 --verbose -- 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61701.log.gz 2024-09-17T03:16:07.519 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.57347.log 2024-09-17T03:16:07.519 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.66388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51650.log 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66388.log.gz 2024-09-17T03:16:07.519 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.519 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42928.log 2024-09-17T03:16:07.519 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57347.log.gz 2024-09-17T03:16:07.519 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51650.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-17T03:16:07.519 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51650.log.gz 2024-09-17T03:16:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65779.log 2024-09-17T03:16:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70487.log 2024-09-17T03:16:07.520 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42928.log.gz 2024-09-17T03:16:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.65779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46406.log 2024-09-17T03:16:07.520 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.65779.log.gz 2024-09-17T03:16:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.70487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46932.log 2024-09-17T03:16:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46406.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.70487.log.gz 2024-09-17T03:16:07.520 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46406.log.gz 2024-09-17T03:16:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49392.log 2024-09-17T03:16:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43264.log 2024-09-17T03:16:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49392.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46932.log.gz 2024-09-17T03:16:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49458.log 2024-09-17T03:16:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43264.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49392.log.gz 2024-09-17T03:16:07.521 INFO:teuthology.orchestra.run.smithi078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43264.log.gz 2024-09-17T03:16:07.521 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68278.log 2024-09-17T03:16:07.521 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72287.log 2024-09-17T03:16:07.521 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.68278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.68278.log.gz 2024-09-17T03:16:07.521 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49458.log.gz 2024-09-17T03:16:07.521 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64250.log 2024-09-17T03:16:07.521 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.72287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60341.log 2024-09-17T03:16:07.521 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.64250.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72287.log.gz 2024-09-17T03:16:07.521 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45958.log 2024-09-17T03:16:07.521 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.60341.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.64250.log.gz 2024-09-17T03:16:07.521 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51608.log 2024-09-17T03:16:07.521 INFO:teuthology.orchestra.run.smithi078.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.60341.log.gz 2024-09-17T03:16:07.521 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65221.log 2024-09-17T03:16:07.521 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45958.log.gz 2024-09-17T03:16:07.522 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62051.log 2024-09-17T03:16:07.522 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65221.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51608.log.gz 2024-09-17T03:16:07.522 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65221.log.gz 2024-09-17T03:16:07.522 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T03:16:07.522 INFO:teuthology.orchestra.run.smithi078.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-17T03:16:07.522 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43516.log 2024-09-17T03:16:07.522 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.62051.log.gz 2024-09-17T03:16:07.522 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59675.log 2024-09-17T03:16:07.522 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.43516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57236.log 2024-09-17T03:16:07.522 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59675.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43516.log.gz 2024-09-17T03:16:07.522 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43733.log 2024-09-17T03:16:07.522 INFO:teuthology.orchestra.run.smithi078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.59675.log.gz 2024-09-17T03:16:07.522 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73397.log 2024-09-17T03:16:07.522 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57236.log.gz 2024-09-17T03:16:07.522 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71913.log 2024-09-17T03:16:07.523 INFO:teuthology.orchestra.run.smithi078.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.43733.log.gz 2024-09-17T03:16:07.523 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.73397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69017.log 2024-09-17T03:16:07.523 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.73397.log.gz 2024-09-17T03:16:07.523 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.71913.log: 87.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T03:16:07.523 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71913.log.gz 2024-09-17T03:16:07.523 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71370.log 2024-09-17T03:16:07.523 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.69017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69754.log 2024-09-17T03:16:07.523 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.71370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67638.log 2024-09-17T03:16:07.523 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.69017.log.gz 2024-09-17T03:16:07.523 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71370.log.gz 2024-09-17T03:16:07.523 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.69754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69500.log 2024-09-17T03:16:07.523 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43096.log 2024-09-17T03:16:07.523 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.67638.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.69754.log.gz 2024-09-17T03:16:07.523 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.69500.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67638.log.gz 2024-09-17T03:16:07.523 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.69500.log.gz 2024-09-17T03:16:07.524 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63039.log 2024-09-17T03:16:07.524 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43096.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30120.log 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43096.log.gz 2024-09-17T03:16:07.524 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.524 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.63039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62997.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63039.log.gz 2024-09-17T03:16:07.524 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.524 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.tmp-client.admin.30120.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30120.log.gz 2024-09-17T03:16:07.524 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60760.log 2024-09-17T03:16:07.524 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66430.log 2024-09-17T03:16:07.524 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62997.log.gz 2024-09-17T03:16:07.524 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.60760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65671.log 2024-09-17T03:16:07.524 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.66430.log: 90.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60188.log 2024-09-17T03:16:07.524 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60760.log.gz 2024-09-17T03:16:07.524 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66430.log.gz 2024-09-17T03:16:07.524 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73248.log 2024-09-17T03:16:07.525 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.60188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36752.log 2024-09-17T03:16:07.525 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60188.log.gz 2024-09-17T03:16:07.525 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.73248.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.65671.log.gz 2024-09-17T03:16:07.525 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.73248.log.gz 2024-09-17T03:16:07.525 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65821.log 2024-09-17T03:16:07.525 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61883.log 2024-09-17T03:16:07.525 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56901.log 2024-09-17T03:16:07.525 INFO:teuthology.orchestra.run.smithi078.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36752.log.gz 2024-09-17T03:16:07.525 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65821.log.gz 2024-09-17T03:16:07.525 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.61883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59233.log 2024-09-17T03:16:07.525 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56901.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66472.log 2024-09-17T03:16:07.525 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61883.log.gz 2024-09-17T03:16:07.525 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66294.log 2024-09-17T03:16:07.525 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.59233.log.gz 90.9% -- replaced with /var/log/ceph/ceph-client.admin.56901.log.gz 2024-09-17T03:16:07.526 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.526 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.66472.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66472.log.gz 2024-09-17T03:16:07.526 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53274.log 2024-09-17T03:16:07.526 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.66294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50229.log 2024-09-17T03:16:07.526 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53274.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66294.log.gz 2024-09-17T03:16:07.526 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55566.log 2024-09-17T03:16:07.526 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53274.log.gz 2024-09-17T03:16:07.526 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70835.log 2024-09-17T03:16:07.526 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50229.log: /var/log/ceph/ceph-client.admin.55566.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50229.log.gz 2024-09-17T03:16:07.526 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55566.log.gz 2024-09-17T03:16:07.526 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47388.log 2024-09-17T03:16:07.526 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.70835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59009.log 2024-09-17T03:16:07.526 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70685.log 2024-09-17T03:16:07.526 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47388.log.gz 2024-09-17T03:16:07.526 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70835.log.gz 2024-09-17T03:16:07.526 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58127.log 2024-09-17T03:16:07.527 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.70685.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59009.log.gz 2024-09-17T03:16:07.527 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70223.log 2024-09-17T03:16:07.527 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3%/var/log/ceph/ceph-client.admin.58127.log: -- replaced with /var/log/ceph/ceph-client.admin.70685.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50855.log 2024-09-17T03:16:07.527 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.527 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58127.log.gz 2024-09-17T03:16:07.527 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71412.log 2024-09-17T03:16:07.527 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.70223.log: /var/log/ceph/ceph-client.admin.50855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69820.log 2024-09-17T03:16:07.527 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.71412.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.50855.log.gz 2024-09-17T03:16:07.527 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65947.log 2024-09-17T03:16:07.527 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.71412.log.gz 2024-09-17T03:16:07.527 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.70223.log.gz 2024-09-17T03:16:07.527 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.69820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43012.log 2024-09-17T03:16:07.527 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72786.log 2024-09-17T03:16:07.527 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65947.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.69820.log.gz 2024-09-17T03:16:07.528 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43012.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65947.log.gz 2024-09-17T03:16:07.528 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47345.log 2024-09-17T03:16:07.528 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43012.log.gz 2024-09-17T03:16:07.528 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46042.log 2024-09-17T03:16:07.528 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.72786.log: /var/log/ceph/ceph-client.admin.47345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72954.log 2024-09-17T03:16:07.528 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1%/var/log/ceph/ceph-client.admin.46042.log: -- replaced with /var/log/ceph/ceph-client.admin.72786.log.gz 2024-09-17T03:16:07.528 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47345.log.gz 2024-09-17T03:16:07.528 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46042.log.gz 2024-09-17T03:16:07.528 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43731.log 2024-09-17T03:16:07.528 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.72954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66906.log 2024-09-17T03:16:07.528 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.72954.log.gz 2024-09-17T03:16:07.528 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42798.log 2024-09-17T03:16:07.528 INFO:teuthology.orchestra.run.smithi078.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.43731.log.gz 2024-09-17T03:16:07.528 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58253.log 2024-09-17T03:16:07.529 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.66906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45384.log 2024-09-17T03:16:07.529 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.66906.log.gz 2024-09-17T03:16:07.529 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42798.log: gzip/var/log/ceph/ceph-client.admin.58253.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47261.log 2024-09-17T03:16:07.529 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.45384.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58253.log.gz 2024-09-17T03:16:07.529 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% 0.0% -- replaced with /var/log/ceph/ceph-client.0.45384.log.gz 2024-09-17T03:16:07.529 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42798.log.gz 2024-09-17T03:16:07.529 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43474.log 2024-09-17T03:16:07.529 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55301.log 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47261.log.gz 2024-09-17T03:16:07.529 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.529 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43474.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.59191.log 2024-09-17T03:16:07.529 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43474.log.gz 2024-09-17T03:16:07.529 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70769.log 2024-09-17T03:16:07.529 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55301.log.gz 2024-09-17T03:16:07.530 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66073.log 2024-09-17T03:16:07.530 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59191.log: /var/log/ceph/ceph-client.admin.70769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48716.log 2024-09-17T03:16:07.530 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3%/var/log/ceph/ceph-client.admin.66073.log: -- replaced with /var/log/ceph/ceph-client.admin.59191.log.gz 2024-09-17T03:16:07.530 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66073.log.gz 2024-09-17T03:16:07.530 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.70769.log.gz 2024-09-17T03:16:07.530 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44073.log 2024-09-17T03:16:07.530 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54289.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48716.log.gz 2024-09-17T03:16:07.530 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.530 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51818.log 87.4% 2024-09-17T03:16:07.530 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44073.log.gz 2024-09-17T03:16:07.530 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44608.log 2024-09-17T03:16:07.530 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54289.log.gz 2024-09-17T03:16:07.530 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51692.log 2024-09-17T03:16:07.530 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51818.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51818.log.gz -5 2024-09-17T03:16:07.531 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54415.log 2024-09-17T03:16:07.531 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44608.log: /var/log/ceph/ceph-client.admin.51692.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44608.log.gz 2024-09-17T03:16:07.531 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51692.log.gz 2024-09-17T03:16:07.531 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59405.log 2024-09-17T03:16:07.531 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70139.log 2024-09-17T03:16:07.531 INFO:teuthology.orchestra.run.smithi078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.54415.log.gz 2024-09-17T03:16:07.531 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68020.log 87.2% -- replaced with /var/log/ceph/ceph-client.admin.59405.log.gz 2024-09-17T03:16:07.531 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.531 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.70139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71955.log 2024-09-17T03:16:07.531 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.70139.log.gz 2024-09-17T03:16:07.531 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.68020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44076.log 2024-09-17T03:16:07.531 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.71955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65389.log 2024-09-17T03:16:07.531 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.68020.log.gz 2024-09-17T03:16:07.531 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.71955.log.gz 2024-09-17T03:16:07.532 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53200.log 2024-09-17T03:16:07.532 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.65389.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44076.log.gz 2024-09-17T03:16:07.532 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73437.log 2024-09-17T03:16:07.532 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53200.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65389.log.gz 2024-09-17T03:16:07.532 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67074.log 2024-09-17T03:16:07.532 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61313.log 2024-09-17T03:16:07.532 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2%/var/log/ceph/ceph-client.admin.73437.log: -- replaced with /var/log/ceph/ceph-client.admin.53200.log.gz 2024-09-17T03:16:07.532 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7%/var/log/ceph/ceph-client.admin.67074.log: -- replaced with /var/log/ceph/ceph-client.admin.73437.log.gz 2024-09-17T03:16:07.532 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58806.log 2024-09-17T03:16:07.532 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67074.log.gz/var/log/ceph/ceph-client.admin.61313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37437.log 2024-09-17T03:16:07.532 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.532 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58806.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61313.log.gz 2024-09-17T03:16:07.532 INFO:teuthology.orchestra.run.smithi078.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.58806.log.gz 2024-09-17T03:16:07.532 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71075.log 2024-09-17T03:16:07.533 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58169.log 86.8% -- replaced with /var/log/ceph/ceph-client.admin.37437.log.gz 2024-09-17T03:16:07.533 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.533 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.71075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55394.log 2024-09-17T03:16:07.533 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71075.log.gz 2024-09-17T03:16:07.533 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43729.log 2024-09-17T03:16:07.533 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.58169.log.gz 2024-09-17T03:16:07.533 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51482.log 2024-09-17T03:16:07.533 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67032.log 2024-09-17T03:16:07.533 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55394.log.gz/var/log/ceph/ceph-client.admin.43729.log: 2024-09-17T03:16:07.533 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51482.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43729.log.gz 2024-09-17T03:16:07.533 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51482.log.gz 2024-09-17T03:16:07.533 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42696.log 2024-09-17T03:16:07.533 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.67032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72701.log 2024-09-17T03:16:07.533 INFO:teuthology.orchestra.run.smithi078.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.67032.log.gz/var/log/ceph/ceph-client.admin.42696.log: 2024-09-17T03:16:07.534 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70901.log 2024-09-17T03:16:07.534 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42696.log.gz 2024-09-17T03:16:07.534 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52700.log 2024-09-17T03:16:07.534 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.72701.log: /var/log/ceph/ceph-client.admin.70901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63165.log 2024-09-17T03:16:07.534 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52700.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.72701.log.gz 2024-09-17T03:16:07.534 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52700.log.gz 90.9% -- replaced with /var/log/ceph/ceph-client.admin.70901.log.gz 2024-09-17T03:16:07.534 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.534 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61491.log 2024-09-17T03:16:07.534 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.63165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47779.log 2024-09-17T03:16:07.534 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.61491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55692.log 2024-09-17T03:16:07.534 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.63165.log.gz 2024-09-17T03:16:07.534 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62787.log 2024-09-17T03:16:07.534 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61491.log.gz 2024-09-17T03:16:07.535 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47779.log: /var/log/ceph/ceph-client.admin.55692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63543.log 2024-09-17T03:16:07.535 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47779.log.gz 2024-09-17T03:16:07.535 INFO:teuthology.orchestra.run.smithi078.stderr: 87.0%/var/log/ceph/ceph-client.admin.62787.log: -- replaced with /var/log/ceph/ceph-client.admin.55692.log.gz 2024-09-17T03:16:07.535 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62787.log.gz 2024-09-17T03:16:07.535 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68452.log 2024-09-17T03:16:07.535 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.63543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37135.log 2024-09-17T03:16:07.535 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63543.log.gz/var/log/ceph/ceph-client.admin.68452.log: 2024-09-17T03:16:07.535 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65989.log 2024-09-17T03:16:07.535 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68452.log.gz 2024-09-17T03:16:07.535 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50939.log 2024-09-17T03:16:07.535 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.37135.log: /var/log/ceph/ceph-client.admin.65989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54205.log 2024-09-17T03:16:07.535 INFO:teuthology.orchestra.run.smithi078.stderr: 86.6%/var/log/ceph/ceph-client.admin.50939.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65989.log.gz 2024-09-17T03:16:07.535 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37135.log.gz 2024-09-17T03:16:07.535 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50939.log.gz 2024-09-17T03:16:07.536 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55170.log 2024-09-17T03:16:07.536 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44860.log 2024-09-17T03:16:07.536 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54205.log.gz 2024-09-17T03:16:07.536 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63813.log 87.0% -- replaced with /var/log/ceph/ceph-client.admin.55170.log.gz 2024-09-17T03:16:07.536 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.536 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52094.log 2024-09-17T03:16:07.536 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44860.log.gz 2024-09-17T03:16:07.536 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.63813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36786.log 2024-09-17T03:16:07.536 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52865.log 2024-09-17T03:16:07.536 INFO:teuthology.orchestra.run.smithi078.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.63813.log.gz 2024-09-17T03:16:07.536 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52094.log.gz 2024-09-17T03:16:07.536 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42970.log 2024-09-17T03:16:07.536 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36786.log: /var/log/ceph/ceph-client.admin.52865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52286.log 2024-09-17T03:16:07.537 INFO:teuthology.orchestra.run.smithi078.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.36786.log.gz/var/log/ceph/ceph-client.admin.42970.log: 2024-09-17T03:16:07.537 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42970.log.gz 2024-09-17T03:16:07.537 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52865.log.gz 2024-09-17T03:16:07.537 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58627.log 2024-09-17T03:16:07.537 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.0.52286.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36462.log 2024-09-17T03:16:07.537 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52286.log.gz 2024-09-17T03:16:07.537 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67768.log 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58627.log.gz 2024-09-17T03:16:07.537 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.537 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36462.log: gzip -5 --verbose 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36462.log.gz 2024-09-17T03:16:07.537 INFO:teuthology.orchestra.run.smithi078.stderr: -- /var/log/ceph/ceph-client.admin.70421.log 2024-09-17T03:16:07.537 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.67768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66157.log 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67768.log.gz 2024-09-17T03:16:07.537 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.537 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.70421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61130.log 2024-09-17T03:16:07.537 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.66157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52364.log 2024-09-17T03:16:07.538 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.70421.log.gz 2024-09-17T03:16:07.538 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66157.log.gz 2024-09-17T03:16:07.538 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51279.log 2024-09-17T03:16:07.538 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.61130.log: /var/log/ceph/ceph-client.admin.52364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46084.log 2024-09-17T03:16:07.538 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52364.log.gz/var/log/ceph/ceph-client.admin.51279.log: 2024-09-17T03:16:07.538 INFO:teuthology.orchestra.run.smithi078.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.61130.log.gz 2024-09-17T03:16:07.538 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51279.log.gz 2024-09-17T03:16:07.538 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59573.log 2024-09-17T03:16:07.538 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.46084.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36725.log 2024-09-17T03:16:07.538 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59573.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46084.log.gz 2024-09-17T03:16:07.538 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45040.log 2024-09-17T03:16:07.538 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59573.log.gz 2024-09-17T03:16:07.538 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50645.log 2024-09-17T03:16:07.538 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36725.log: /var/log/ceph/ceph-client.admin.45040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62520.log 2024-09-17T03:16:07.539 INFO:teuthology.orchestra.run.smithi078.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36725.log.gz 2024-09-17T03:16:07.539 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45040.log.gz 2024-09-17T03:16:07.539 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58543.log 2024-09-17T03:16:07.539 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50645.log.gz 2024-09-17T03:16:07.539 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63207.log 2024-09-17T03:16:07.539 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58543.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.62520.log.gz 2024-09-17T03:16:07.539 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62564.log 2024-09-17T03:16:07.539 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58543.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63879.log 2024-09-17T03:16:07.539 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.539 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.63207.log: /var/log/ceph/ceph-client.admin.62564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50397.log 2024-09-17T03:16:07.539 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6%/var/log/ceph/ceph-client.admin.63879.log: -- replaced with /var/log/ceph/ceph-client.admin.62564.log.gz 2024-09-17T03:16:07.539 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% 91.0% -- replaced with /var/log/ceph/ceph-client.admin.63207.log.gz 2024-09-17T03:16:07.539 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63879.log.gz 2024-09-17T03:16:07.539 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55650.log 2024-09-17T03:16:07.539 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43736.log 2024-09-17T03:16:07.540 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8%/var/log/ceph/ceph-client.admin.55650.log: -- replaced with /var/log/ceph/ceph-client.admin.50397.log.gz 2024-09-17T03:16:07.540 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56373.log 2024-09-17T03:16:07.540 INFO:teuthology.orchestra.run.smithi078.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.55650.log.gz 2024-09-17T03:16:07.540 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58001.log 2024-09-17T03:16:07.540 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43736.log: /var/log/ceph/ceph-client.admin.56373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49326.log 2024-09-17T03:16:07.540 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58001.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43736.log.gz 2024-09-17T03:16:07.540 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56373.log.gz 2024-09-17T03:16:07.540 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58001.log.gz 2024-09-17T03:16:07.540 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68274.log 2024-09-17T03:16:07.540 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72245.log 2024-09-17T03:16:07.540 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.68274.log: 90.9%gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.47180.log 2024-09-17T03:16:07.540 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.0.68274.log.gz 2024-09-17T03:16:07.540 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49326.log.gz 2024-09-17T03:16:07.540 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.72245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48245.log 2024-09-17T03:16:07.541 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64789.log 2024-09-17T03:16:07.541 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72245.log.gz 2024-09-17T03:16:07.541 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47180.log.gz 2024-09-17T03:16:07.541 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61925.log 2024-09-17T03:16:07.541 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.64789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62310.log 2024-09-17T03:16:07.541 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48245.log.gz 2024-09-17T03:16:07.541 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.61925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42886.log 2024-09-17T03:16:07.541 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61925.log.gz 2024-09-17T03:16:07.541 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64789.log.gz 2024-09-17T03:16:07.541 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47100.log 2024-09-17T03:16:07.541 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62310.log: /var/log/ceph/ceph-client.admin.42886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51034.log 2024-09-17T03:16:07.541 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62310.log.gz/var/log/ceph/ceph-client.admin.47100.log: 2024-09-17T03:16:07.541 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42886.log.gz 2024-09-17T03:16:07.541 INFO:teuthology.orchestra.run.smithi078.stderr:gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47100.log.gz 2024-09-17T03:16:07.542 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48761.log 2024-09-17T03:16:07.542 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51034.log: gzip -5 --verbose 87.3% -- /var/log/ceph/ceph-client.admin.53734.log 2024-09-17T03:16:07.542 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51034.log.gz 2024-09-17T03:16:07.542 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64667.log 2024-09-17T03:16:07.542 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48761.log.gz 2024-09-17T03:16:07.542 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-17T03:16:07.542 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53734.log: /var/log/ceph/ceph-client.admin.64667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53404.log 2024-09-17T03:16:07.542 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.3.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64667.log.gz 2024-09-17T03:16:07.542 INFO:teuthology.orchestra.run.smithi078.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.53734.log.gz 2024-09-17T03:16:07.542 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67936.log 2024-09-17T03:16:07.542 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53404.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-17T03:16:07.542 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.67936.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53404.log.gz 2024-09-17T03:16:07.542 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67936.log.gz 2024-09-17T03:16:07.542 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46764.log 2024-09-17T03:16:07.543 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66700.log 2024-09-17T03:16:07.543 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46764.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46764.log.gz 2024-09-17T03:16:07.543 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48803.log 2024-09-17T03:16:07.543 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.66700.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66700.log.gz 2024-09-17T03:16:07.543 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58967.log 2024-09-17T03:16:07.543 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48803.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48803.log.gz 2024-09-17T03:16:07.543 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54069.log 2024-09-17T03:16:07.543 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58967.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58967.log.gz 2024-09-17T03:16:07.543 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36763.log 2024-09-17T03:16:07.543 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54069.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54069.log.gz 2024-09-17T03:16:07.543 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66822.log 2024-09-17T03:16:07.543 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36763.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36763.log.gz 2024-09-17T03:16:07.543 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72996.log 2024-09-17T03:16:07.543 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.66822.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.66822.log.gz 2024-09-17T03:16:07.543 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71598.log 2024-09-17T03:16:07.544 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.72996.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72996.log.gz 2024-09-17T03:16:07.544 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62657.log 2024-09-17T03:16:07.544 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.71598.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71598.log.gz 2024-09-17T03:16:07.544 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46890.log 2024-09-17T03:16:07.544 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62657.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62657.log.gz 2024-09-17T03:16:07.544 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54560.log 2024-09-17T03:16:07.544 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46890.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46890.log.gz 2024-09-17T03:16:07.544 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55818.log 2024-09-17T03:16:07.544 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54560.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54560.log.gz 2024-09-17T03:16:07.544 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70355.log 2024-09-17T03:16:07.544 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55818.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.55818.log.gz 2024-09-17T03:16:07.544 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54457.log 2024-09-17T03:16:07.544 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.70355.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.70355.log.gz 2024-09-17T03:16:07.544 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63681.log 2024-09-17T03:16:07.544 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54457.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54457.log.gz 2024-09-17T03:16:07.545 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66532.log 2024-09-17T03:16:07.545 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.63681.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.63681.log.gz 2024-09-17T03:16:07.545 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36726.log 2024-09-17T03:16:07.545 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.66532.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66532.log.gz 2024-09-17T03:16:07.545 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.36726.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.36726.log.gz 2024-09-17T03:16:07.548 INFO:teuthology.orchestra.run.smithi193.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-17T03:16:07.584 INFO:teuthology.orchestra.run.smithi078.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T03:16:07.588 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-17T03:16:07.594 INFO:teuthology.orchestra.run.smithi193.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-17T03:16:07.615 INFO:teuthology.orchestra.run.smithi193.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-17T03:16:07.634 INFO:teuthology.orchestra.run.smithi078.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-17T03:16:07.639 INFO:teuthology.orchestra.run.smithi193.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-17T03:16:07.649 INFO:teuthology.orchestra.run.smithi193.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-17T03:16:07.649 INFO:teuthology.orchestra.run.smithi078.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T03:16:07.683 INFO:teuthology.orchestra.run.smithi193.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-17T03:16:07.685 INFO:teuthology.orchestra.run.smithi193.stderr: 2024-09-17T03:16:07.685 INFO:teuthology.orchestra.run.smithi193.stderr:real 0m0.484s 2024-09-17T03:16:07.685 INFO:teuthology.orchestra.run.smithi193.stderr:user 0m2.626s 2024-09-17T03:16:07.685 INFO:teuthology.orchestra.run.smithi193.stderr:sys 0m0.117s 2024-09-17T03:16:07.687 INFO:teuthology.orchestra.run.smithi078.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T03:16:07.828 INFO:teuthology.orchestra.run.smithi078.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-17T03:16:07.871 INFO:teuthology.orchestra.run.smithi078.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T03:16:07.873 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-17T03:16:07.873 INFO:teuthology.orchestra.run.smithi078.stderr:real 0m0.714s 2024-09-17T03:16:07.873 INFO:teuthology.orchestra.run.smithi078.stderr:user 0m3.088s 2024-09-17T03:16:07.873 INFO:teuthology.orchestra.run.smithi078.stderr:sys 0m0.429s 2024-09-17T03:16:07.873 INFO:tasks.ceph:Archiving logs... 2024-09-17T03:16:07.873 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908403/remote/smithi078/log 2024-09-17T03:16:07.874 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T03:16:08.736 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908403/remote/smithi193/log 2024-09-17T03:16:08.737 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T03:16:09.085 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T03:16:09.094 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T03:16:09.094 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T03:16:09.097 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T03:16:09.183 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T03:16:09.193 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T03:16:09.193 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T03:16:09.196 DEBUG:teuthology.orchestra.run.smithi193:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T03:16:09.209 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: ntpq: command not found 2024-09-17T03:16:09.211 INFO:teuthology.orchestra.run.smithi193.stderr:bash: line 1: ntpq: command not found 2024-09-17T03:16:09.214 INFO:teuthology.orchestra.run.smithi078.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T03:16:09.215 INFO:teuthology.orchestra.run.smithi078.stdout:=============================================================================== 2024-09-17T03:16:09.215 INFO:teuthology.orchestra.run.smithi078.stdout:^* hv01.front.sepia.ceph.com 3 6 377 53 +2056us[+2422us] +/- 39ms 2024-09-17T03:16:09.215 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 56 -884us[ -518us] +/- 75ms 2024-09-17T03:16:09.215 INFO:teuthology.orchestra.run.smithi078.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 53 -2771us[-2404us] +/- 81ms 2024-09-17T03:16:09.215 INFO:teuthology.orchestra.run.smithi078.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:16:09.215 INFO:teuthology.orchestra.run.smithi193.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T03:16:09.215 INFO:teuthology.orchestra.run.smithi193.stdout:=============================================================================== 2024-09-17T03:16:09.216 INFO:teuthology.orchestra.run.smithi193.stdout:^* hv01.front.sepia.ceph.com 3 6 377 53 +2019us[+2450us] +/- 39ms 2024-09-17T03:16:09.216 INFO:teuthology.orchestra.run.smithi193.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 51 -910us[ -910us] +/- 75ms 2024-09-17T03:16:09.216 INFO:teuthology.orchestra.run.smithi193.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 -2793us[-2363us] +/- 81ms 2024-09-17T03:16:09.216 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T03:16:09.217 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T03:16:09.226 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T03:16:09.227 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T03:16:09.236 DEBUG:teuthology.orchestra.run.smithi078:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T03:16:09.338 DEBUG:teuthology.orchestra.run.smithi193:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T03:16:09.403 DEBUG:teuthology.orchestra.run.smithi078:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T03:16:09.431 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:16:09.432 DEBUG:teuthology.orchestra.run.smithi193:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T03:16:09.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:16:09.460 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T03:16:09.498 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T03:16:09.506 INFO:teuthology.task.internal:Duration was 869.113306 seconds 2024-09-17T03:16:09.507 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T03:16:09.514 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T03:16:09.514 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T03:16:09.517 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T03:16:09.553 INFO:teuthology.orchestra.run.smithi078.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T03:16:09.555 INFO:teuthology.orchestra.run.smithi193.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T03:16:09.889 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T03:16:09.889 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2024-09-17T03:16:09.889 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T03:16:09.910 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi193.front.sepia.ceph.com 2024-09-17T03:16:09.910 DEBUG:teuthology.orchestra.run.smithi193:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T03:16:09.950 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T03:16:09.951 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T03:16:09.953 DEBUG:teuthology.orchestra.run.smithi193:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T03:16:10.016 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T03:16:10.017 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T03:16:10.020 DEBUG:teuthology.orchestra.run.smithi193:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T03:16:10.161 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T03:16:10.171 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T03:16:10.172 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T03:16:10.197 DEBUG:teuthology.orchestra.run.smithi193:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T03:16:10.222 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T03:16:10.256 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T03:16:10.259 DEBUG:teuthology.orchestra.run.smithi193:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T03:16:10.279 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2024-09-17T03:16:10.284 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern = core 2024-09-17T03:16:10.298 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T03:16:10.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:16:10.347 DEBUG:teuthology.orchestra.run.smithi193:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T03:16:10.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T03:16:10.361 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T03:16:10.371 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T03:16:10.372 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908403/remote/smithi078 2024-09-17T03:16:10.372 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T03:16:10.425 DEBUG:teuthology.misc:Transferring archived files from smithi193:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-17_02:09:51-fs-wip-pdonnell-testing-20240916.200549-debug-distro-default-smithi/7908403/remote/smithi193 2024-09-17T03:16:10.426 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T03:16:10.459 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T03:16:10.460 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T03:16:10.462 DEBUG:teuthology.orchestra.run.smithi193:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T03:16:10.509 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T03:16:10.519 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T03:16:10.519 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T03:16:10.529 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T03:16:10.529 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T03:16:10.531 DEBUG:teuthology.orchestra.run.smithi193:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T03:16:10.544 INFO:teuthology.orchestra.run.smithi078.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 03:16 /home/ubuntu/cephtest 2024-09-17T03:16:10.564 INFO:teuthology.orchestra.run.smithi193.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 03:16 /home/ubuntu/cephtest 2024-09-17T03:16:10.565 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T03:16:10.576 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T03:16:10.611 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/multimds_misc} duration: 869.1133058071136 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-17T03:16:10.611 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T03:16:10.700 INFO:teuthology.run:pass